2023-08-10T10:01:54.169 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T10:01:54.170 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/orig.config.yaml 2023-08-10T10:01:54.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:01:54.309 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529 branch: wip-rishabh-2023Aug1-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7364529' kernel: client: branch: testing flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-2023Aug1-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjIamWIXq3UVt00gEPbsgSAOOwebaQ5RW4IEp7f0ABBaPCi+wUcI9GmgKhgtIlAX5oRI4bHIhQrD4zvEYfMY+M= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3vC83PZpFEB/j0ySbC9zOSLGsmnDV6i8+w1/TKbOc/I9Svzn2yEEfdeyuU9mVYlbjFcHoQ/865Lc+UemjGdhU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_09:50:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-10T10:01:54.310 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa; will attempt to use it 2023-08-10T10:01:54.311 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks 2023-08-10T10:01:54.311 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-10T10:01:54.313 INFO:teuthology.task.internal:Checking packages... 2023-08-10T10:01:54.342 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8bf445f2d27d8e12e060dff0fd151d481b5290b' 2023-08-10T10:01:54.343 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-10T10:01:54.343 INFO:teuthology.packaging:ref: None 2023-08-10T10:01:54.343 INFO:teuthology.packaging:tag: None 2023-08-10T10:01:54.344 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-3 2023-08-10T10:01:54.344 INFO:teuthology.packaging:sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:01:54.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-2023Aug1-3 2023-08-10T10:01:54.631 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5118.ga8bf445f 2023-08-10T10:01:54.631 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-10T10:01:54.638 INFO:teuthology.task.internal:no buildpackages task found 2023-08-10T10:01:54.639 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-10T10:01:54.644 INFO:teuthology.task.internal:Saving configuration 2023-08-10T10:01:54.660 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-10T10:01:54.666 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:01:54.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:53.591669', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjIamWIXq3UVt00gEPbsgSAOOwebaQ5RW4IEp7f0ABBaPCi+wUcI9GmgKhgtIlAX5oRI4bHIhQrD4zvEYfMY+M='} 2023-08-10T10:01:54.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:53.592885', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3vC83PZpFEB/j0ySbC9zOSLGsmnDV6i8+w1/TKbOc/I9Svzn2yEEfdeyuU9mVYlbjFcHoQ/865Lc+UemjGdhU='} 2023-08-10T10:01:54.714 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-10T10:01:54.720 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-10T10:01:54.721 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-10T10:01:54.721 INFO:teuthology.run_tasks:Running task console_log... 2023-08-10T10:01:54.809 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f833bfe3f70>, signals=[15]) 2023-08-10T10:01:54.810 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-10T10:01:54.816 INFO:teuthology.task.internal:Opening connections... 2023-08-10T10:01:54.816 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:01:54.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:01:54.915 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:01:54.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:01:54.999 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-10T10:01:55.006 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-08-10T10:01:55.024 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-08-10T10:01:55.024 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-08-10T10:01:55.081 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-08-10T10:01:55.081 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-08-10T10:01:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:01:55.083 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:01:55.083 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:01:55.083 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:01:55.083 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:01:55.083 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:01:55.084 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-08-10T10:01:55.107 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-08-10T10:01:55.125 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-08-10T10:01:55.125 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-10T10:01:55.182 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2023-08-10T10:01:55.183 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2023-08-10T10:01:55.183 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2023-08-10T10:01:55.183 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:01:55.184 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2023-08-10T10:01:55.184 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:01:55.184 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:01:55.184 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-08-10T10:01:55.185 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:01:55.185 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:01:55.185 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:01:55.186 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:01:55.186 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:01:55.186 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:01:55.187 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-10T10:01:55.207 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-10T10:01:55.216 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-10T10:01:55.221 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-10T10:01:55.221 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:01:55.223 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:01:55.238 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-10T10:01:55.244 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-10T10:01:55.245 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:01:55.281 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:01:55.316 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-10T10:01:55.372 INFO:teuthology.run_tasks:Running task kernel... 2023-08-10T10:01:55.392 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-10T10:01:55.393 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-10T10:01:55.393 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-10T10:01:55.393 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:01:55.394 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:01:55.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:01:55.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-08-10T10:01:55.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:01:55.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-08-10T10:01:55.579 DEBUG:teuthology.task.kernel:sha1 for client.1 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:01:55.579 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:01:55.580 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-08-10T10:01:55.590 DEBUG:teuthology.task.kernel:sha1 for client.0 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:01:55.591 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:01:55.591 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-08-10T10:01:55.596 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-239.el9.x86_64 2023-08-10T10:01:55.597 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-239.el9.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:01:55.597 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:01:55.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum upgrade -y linux-firmware 2023-08-10T10:01:55.608 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-239.el9.x86_64 2023-08-10T10:01:55.609 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-239.el9.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:01:55.609 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:01:55.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2023-08-10T10:01:57.670 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-08-10T10:01:57.774 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 10 MB/s | 6.3 MB 00:00 2023-08-10T10:01:59.020 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-08-10T10:01:59.169 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-08-10T10:02:01.264 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.8 MB 00:01 2023-08-10T10:02:01.444 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.8 MB 00:01 2023-08-10T10:02:03.261 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-08-10T10:02:03.745 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-08-10T10:02:07.153 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 14 kB 00:00 2023-08-10T10:02:07.654 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 14 kB 00:00 2023-08-10T10:02:11.046 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 18 MB 00:03 2023-08-10T10:02:11.539 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 18 MB 00:03 2023-08-10T10:02:17.041 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-08-10T10:02:17.054 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware noarch 20230726-138.el9 CentOS-BaseOS 294 M 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:02:17.055 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2023-08-10T10:02:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2023-08-10T10:02:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 1 Package 2023-08-10T10:02:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:02:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 294 M 2023-08-10T10:02:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2023-08-10T10:02:17.754 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-08-10T10:02:17.764 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout: linux-firmware noarch 20230726-138.el9 CentOS-BaseOS 294 M 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-08-10T10:02:17.765 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-08-10T10:02:17.766 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 1 Package 2023-08-10T10:02:17.766 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:02:17.766 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 294 M 2023-08-10T10:02:17.766 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-08-10T10:02:25.397 INFO:teuthology.orchestra.run.smithi050.stdout:linux-firmware-20230726-138.el9.noarch.rpm 38 MB/s | 294 MB 00:07 2023-08-10T10:02:25.398 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:02:25.399 INFO:teuthology.orchestra.run.smithi050.stdout:Total 38 MB/s | 294 MB 00:07 2023-08-10T10:02:25.399 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-08-10T10:02:25.455 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-08-10T10:02:25.456 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-08-10T10:02:27.396 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-08-10T10:02:27.396 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-08-10T10:02:29.170 INFO:teuthology.orchestra.run.smithi117.stdout:linux-firmware-20230726-138.el9.noarch.rpm 24 MB/s | 294 MB 00:12 2023-08-10T10:02:29.171 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:02:29.171 INFO:teuthology.orchestra.run.smithi117.stdout:Total 24 MB/s | 294 MB 00:12 2023-08-10T10:02:29.171 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2023-08-10T10:02:29.245 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2023-08-10T10:02:29.246 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2023-08-10T10:02:31.106 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2023-08-10T10:02:31.107 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2023-08-10T10:02:33.661 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-08-10T10:02:34.524 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-10T10:02:34.657 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:36.033 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:36.033 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-10T10:02:36.539 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:36.540 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:02:36.540 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-08-10T10:02:36.540 INFO:teuthology.orchestra.run.smithi050.stdout: linux-firmware-20230726-138.el9.noarch 2023-08-10T10:02:36.540 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:02:36.540 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-08-10T10:02:36.863 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-10T10:02:36.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:36.878 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2023-08-10T10:02:37.019 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ 2023-08-10T10:02:37.020 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ --input-file=- 2023-08-10T10:02:37.022 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2023-08-10T10:02:37.846 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-10T10:02:37.932 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-10T10:02:39.488 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware-20230726-138.el9.noarch 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-08-10T10:02:39.805 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-10T10:02:39.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:40.167 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ 2023-08-10T10:02:40.168 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ --input-file=- 2023-08-10T10:02:40.170 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi117.front.sepia.ceph.com to complete... 2023-08-10T10:02:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10 10:02:52 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [319463472/319463472] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:02:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2023-08-10 10:02:52-- 2023-08-10T10:02:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 15s 2023-08-10T10:02:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 305M in 15s (20.2 MB/s) 2023-08-10T10:02:52.435 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-10T10:02:52.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:02:54.370 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2023-08-10T10:02:54.414 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2023-08-10T10:02:54.466 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2023-08-10T10:03:01.793 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:03:42.923 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:03:42.923 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:03:43.001 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:03:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:03:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:03:43.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:03:43.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:03:43.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:03:43.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:03:43.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:03:43.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:03:43.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:03:43.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:03:43.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:03:43.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:03:43.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:03:43.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:03:43.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:03:43.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:03:43.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:03:43.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:03:43.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:03:43.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:03:43.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:03:43.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:03:43.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:03:43.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:03:43.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:03:43.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:03:43.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:03:43.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:03:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:03:43.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:03:43.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:03:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:03:43.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:03:43.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:03:43.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:03:43.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:03:43.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:03:43.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:03:43.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:03:43.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:03:43.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:03:43.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:03:43.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:03:43.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:03:43.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:03:43.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:03:43.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:03:43.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:03:43.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:03:43.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:03:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:03:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:03:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:03:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:03:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:03:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:03:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:03:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:03:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:03:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:03:43.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:03:43.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:03:43.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:03:43.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:03:43.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:03:43.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:03:43.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:03:43.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:03:43.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:03:43.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:03:43.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:03:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:03:43.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:03:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:03:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:03:43.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:03:43.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:03:43.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:03:43.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:03:43.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:03:43.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:03:43.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:03:43.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:03:43.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:03:43.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:03:43.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:03:43.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:03:43.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:03:43.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:03:43.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:03:43.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:03:43.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:03:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:03:43.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:03:43.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:03:43.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:03:43.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:03:43.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:03:43.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:03:43.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:03:43.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:03:43.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:03:43.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:03:43.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:03:43.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:03:43.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:03:43.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:03:43.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:03:43.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:03:43.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:03:43.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:03:43.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:03:43.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:03:43.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:03:43.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:03:43.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:03:43.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:03:43.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:03:43.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:03:43.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:03:43.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:03:43.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:03:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:03:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:03:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:03:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:03:43.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:03:43.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:03:43.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:03:43.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:03:43.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:03:43.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:03:43.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:03:43.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:03:43.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:03:43.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:03:43.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:03:43.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:03:43.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:03:43.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:03:43.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:03:43.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:03:43.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:03:43.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:03:43.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:03:43.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:03:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:03:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:03:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:03:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:03:43.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:03:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:03:43.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:03:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:03:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:03:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:03:43.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:03:43.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:03:43.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:03:43.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:03:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:03:43.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:03:43.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:03:43.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:03:43.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:03:43.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:03:43.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:03:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:03:43.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:03:43.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:03:43.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:03:43.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:03:43.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:03:43.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:03:43.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:03:43.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:03:43.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:03:43.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:03:43.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:03:43.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:03:43.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:03:43.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:03:43.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:03:43.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:03:43.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:03:43.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:03:43.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:03:43.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:03:43.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:03:43.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:03:43.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:03:43.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:03:43.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:03:43.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:03:43.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:03:43.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:03:43.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:03:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:03:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:03:43.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:03:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:03:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:03:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:03:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:03:43.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:03:43.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:03:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:03:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:03:43.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:03:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:03:43.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:03:43.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:03:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:03:43.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:03:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:03:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:03:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:03:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:03:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:03:43.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:03:43.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:03:43.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:03:43.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:03:43.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:03:43.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:03:43.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:03:43.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:03:43.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:03:43.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:03:43.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:03:43.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:03:43.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:03:43.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:03:43.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:03:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:03:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:03:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:03:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:03:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:03:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:03:43.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:03:43.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:03:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:03:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:03:43.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:03:43.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:03:43.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:03:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:03:43.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:03:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:03:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:03:43.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:03:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:03:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:03:43.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:03:43.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:03:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:03:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:03:43.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:03:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:03:43.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:03:43.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:03:43.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:03:43.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:03:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:03:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:03:43.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:03:43.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:03:43.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:03:43.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:03:43.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:03:43.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:03:43.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:03:43.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:03:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:03:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:03:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:03:43.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:03:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:03:43.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:03:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:03:43.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:03:43.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:03:43.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:03:43.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:03:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:03:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:03:43.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:03:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:03:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:03:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:03:43.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:03:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:03:43.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:03:43.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:03:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:03:43.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:03:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:03:43.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:03:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:03:43.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:03:43.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:03:43.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:03:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:03:43.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:03:43.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:03:43.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:03:43.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:03:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:03:43.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:03:43.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:03:43.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:03:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:03:43.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:03:43.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:03:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:03:43.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:03:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:03:43.188 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:03:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:03:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:03:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:03:43.192 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:03:43.193 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:03:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:03:43.195 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:03:43.196 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:03:43.197 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:03:43.198 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:03:43.199 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:03:43.200 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:03:43.201 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:03:43.202 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:03:43.203 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:03:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:03:43.205 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:03:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:03:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:03:43.208 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:03:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:03:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:03:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:03:43.212 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:03:43.213 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:03:43.214 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:03:43.215 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:03:43.216 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:03:43.217 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:03:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:03:43.219 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:03:43.220 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:03:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:03:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:03:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:03:43.224 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:03:43.225 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:03:43.226 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:03:43.227 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:03:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:03:43.229 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:03:43.230 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:03:43.231 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:03:43.232 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:03:43.233 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:03:43.234 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:03:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:03:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:03:43.237 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:03:43.238 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:03:43.239 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:03:43.240 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:03:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:03:43.242 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:03:43.243 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:03:43.244 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:03:43.245 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:03:43.246 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:03:43.247 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:03:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:03:43.249 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:03:43.250 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:03:43.251 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:03:43.252 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:03:43.254 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:03:43.255 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:03:43.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:03:43.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:03:43.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:03:43.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:03:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:03:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:03:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:03:43.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:03:43.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:03:43.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:03:43.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:03:43.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:03:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:03:43.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:03:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:03:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:03:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:03:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:03:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:03:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:03:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:03:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:03:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:03:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:03:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:03:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:03:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:03:43.281 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.281 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:03:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:03:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:03:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:03:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:03:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:03:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-08-10T10:03:43.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-08-10T10:03:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-08-10T10:03:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 53.el9 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Mon 30 Jan 2023 10:38:40 AM UTC 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8551923 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-08-10T10:03:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Wed 18 Jan 2023 04:40:07 PM UTC, Key ID 05b555b38483c65d 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-53.el9.src.rpm 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Fri 13 Jan 2023 09:07:28 PM UTC 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:03:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-08-10T10:03:43.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:03:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:03:43.393 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:03:43.394 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:43.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:03:43.979 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-08-10T10:03:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-08-10T10:03:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-08-10T10:03:45.374 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-08-10T10:03:45.390 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.yYJb12M0Sx 2023-08-10T10:03:45.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yYJb12M0Sx 2023-08-10T10:03:45.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.yYJb12M0Sx 2023-08-10T10:03:45.607 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.yYJb12M0Sx is 6KB 2023-08-10T10:03:45.656 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.yYJb12M0Sx 2023-08-10T10:03:45.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:03:45.769 INFO:teuthology.orchestra.run.smithi050.stdout:e13cba1d25f14c51a1d04da8db823a4e-0-rescue.conf 2023-08-10T10:03:45.770 INFO:teuthology.orchestra.run.smithi050.stdout:e13cba1d25f14c51a1d04da8db823a4e-5.14.0-239.el9.x86_64.conf 2023-08-10T10:03:45.770 INFO:teuthology.orchestra.run.smithi050.stdout:e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:03:45.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:03:45.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-08-10T10:04:15.892 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-10T10:04:15.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-08-10T10:04:15.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:15.895 DEBUG:teuthology.orchestra.remote:timed out 2023-08-10T10:05:24.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-08-10T10:05:24.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:28.357 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-08-10T10:05:29.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-08-10T10:05:29.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:05:29.069 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-08-10T10:05:29.116 INFO:teuthology.orchestra.run.smithi050.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:05:29.117 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:05:29.117 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:05:29.117 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-10T10:05:30.118 DEBUG:teuthology.parallel:result is None 2023-08-10T10:05:42.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10 10:05:42 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [319463472/319463472] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:05:42.720 INFO:teuthology.orchestra.run.smithi117.stderr:FINISHED --2023-08-10 10:05:42-- 2023-08-10T10:05:42.721 INFO:teuthology.orchestra.run.smithi117.stderr:Total wall clock time: 3m 3s 2023-08-10T10:05:42.721 INFO:teuthology.orchestra.run.smithi117.stderr:Downloaded: 1 files, 305M in 3m 2s (1.68 MB/s) 2023-08-10T10:05:42.722 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-10T10:05:42.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:05:44.563 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying... ######################################## 2023-08-10T10:05:44.608 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing... ######################################## 2023-08-10T10:05:44.658 INFO:teuthology.orchestra.run.smithi117.stdout:Updating / installing... 2023-08-10T10:05:51.654 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:06:29.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:06:29.462 DEBUG:teuthology.orchestra.run.smithi117:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:29.539 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:06:29.540 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:06:29.541 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:06:29.542 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:06:29.543 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:06:29.544 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:06:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:06:29.546 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:06:29.547 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:06:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:06:29.549 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:06:29.550 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:06:29.550 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:06:29.550 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:06:29.550 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:06:29.550 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:06:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:06:29.552 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:06:29.553 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:06:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:06:29.555 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:06:29.556 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:06:29.557 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:06:29.558 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:06:29.559 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:06:29.560 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:06:29.561 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:06:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:06:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:06:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:06:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:06:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:06:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:06:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:06:29.569 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:06:29.570 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:06:29.571 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:06:29.572 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:06:29.573 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:06:29.574 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:06:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:06:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:06:29.577 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:06:29.578 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:06:29.579 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:06:29.579 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:06:29.579 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:06:29.580 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:06:29.580 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:06:29.580 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:06:29.580 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:06:29.581 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:06:29.582 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:06:29.583 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:06:29.584 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:06:29.585 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:06:29.586 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:06:29.587 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:06:29.588 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:06:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:06:29.590 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:06:29.591 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:06:29.592 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:06:29.593 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:06:29.594 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:06:29.595 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:06:29.596 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:06:29.597 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:06:29.598 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:06:29.599 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:06:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:06:29.601 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:06:29.601 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:06:29.601 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:06:29.601 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:06:29.601 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:06:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:06:29.603 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:06:29.604 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:06:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:06:29.606 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:06:29.607 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:06:29.608 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:06:29.609 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:06:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:06:29.611 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:06:29.612 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:06:29.613 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:06:29.614 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:06:29.615 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:06:29.616 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:06:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:06:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:06:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:06:29.620 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:06:29.621 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:06:29.622 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:06:29.623 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:06:29.624 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:06:29.625 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:06:29.626 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:06:29.627 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:06:29.628 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:06:29.629 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:06:29.630 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:06:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:06:29.632 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:06:29.633 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:06:29.634 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:06:29.635 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:06:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:06:29.637 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:06:29.638 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:06:29.639 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:06:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:06:29.641 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:06:29.642 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:06:29.643 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:06:29.644 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:06:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:06:29.646 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:06:29.647 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:06:29.648 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:06:29.649 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:06:29.650 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:06:29.651 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:06:29.652 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:06:29.653 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:06:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:06:29.655 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:06:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:06:29.657 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:06:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:06:29.659 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:06:29.660 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:06:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:06:29.663 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:06:29.664 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:06:29.665 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:06:29.666 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:06:29.667 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:06:29.668 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:06:29.669 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:06:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:06:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:06:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:06:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:06:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:06:29.675 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:06:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:06:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:06:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:06:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:06:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:06:29.681 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:06:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:06:29.683 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:06:29.684 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:06:29.685 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:06:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:06:29.687 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:06:29.688 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:06:29.689 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:06:29.690 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:06:29.691 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:06:29.692 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:06:29.693 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:06:29.694 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:06:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:06:29.696 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:06:29.697 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:06:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:06:29.699 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:06:29.700 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:06:29.701 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:06:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:06:29.703 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:06:29.705 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:06:29.706 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:06:29.707 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:06:29.708 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:06:29.709 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:06:29.710 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:06:29.711 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:06:29.712 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:06:29.713 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:06:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:06:29.715 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:06:29.716 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:06:29.717 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:06:29.718 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:06:29.719 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:06:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:06:29.721 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:06:29.722 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:06:29.723 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:06:29.724 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:06:29.725 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:06:29.726 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:06:29.727 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:06:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:06:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:06:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:06:29.728 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:06:29.729 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:06:29.730 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:06:29.731 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:06:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:06:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:06:29.734 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:06:29.735 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:06:29.736 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:06:29.737 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:06:29.738 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:06:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:06:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:06:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:06:29.742 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:06:29.743 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:06:29.744 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:06:29.745 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:06:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:06:29.747 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:06:29.748 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:06:29.749 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:06:29.750 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:06:29.751 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:06:29.752 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:06:29.753 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:06:29.754 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:06:29.755 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:06:29.756 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:06:29.757 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:06:29.758 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:06:29.759 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:06:29.760 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:06:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:06:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:06:29.763 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:06:29.764 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:06:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:06:29.766 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:06:29.767 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:06:29.768 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:06:29.769 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:06:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:06:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:06:29.772 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:06:29.773 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:06:29.774 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:06:29.775 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:06:29.776 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:06:29.777 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:06:29.778 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:06:29.779 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:06:29.780 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:06:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:06:29.782 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:06:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:06:29.784 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:06:29.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:06:29.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:06:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:06:29.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:06:29.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:06:29.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:06:29.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:06:29.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:06:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:06:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:06:29.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:06:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:06:29.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:06:29.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:06:29.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:06:29.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:06:29.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:06:29.799 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.800 DEBUG:teuthology.orchestra.run.smithi117:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:29.825 INFO:teuthology.orchestra.run.smithi117.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:06:29.825 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:06:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:06:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.828 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2023-08-10T10:06:29.828 INFO:teuthology.orchestra.run.smithi117.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:29.828 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:06:29.828 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.828 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2023-08-10T10:06:29.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2023-08-10T10:06:29.902 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2023-08-10T10:06:29.903 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2023-08-10T10:06:29.903 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2023-08-10T10:06:29.903 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 53.el9 2023-08-10T10:06:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2023-08-10T10:06:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Mon 30 Jan 2023 10:38:40 AM UTC 2023-08-10T10:06:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2023-08-10T10:06:29.904 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8551923 2023-08-10T10:06:29.905 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2023-08-10T10:06:29.905 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Wed 18 Jan 2023 04:40:07 PM UTC, Key ID 05b555b38483c65d 2023-08-10T10:06:29.905 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-53.el9.src.rpm 2023-08-10T10:06:29.905 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 13 Jan 2023 09:07:28 PM UTC 2023-08-10T10:06:29.906 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-08-10T10:06:29.906 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2023-08-10T10:06:29.906 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2023-08-10T10:06:29.906 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:06:29.906 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2023-08-10T10:06:29.907 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2023-08-10T10:06:29.907 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:06:29.907 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:06:29.907 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:06:29.908 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:06:29.908 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2023-08-10T10:06:29.908 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:06:29.908 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:06:29.910 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:06:29.910 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:29.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:06:30.493 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2023-08-10T10:06:31.791 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-08-10T10:06:31.832 INFO:teuthology.orchestra.run.smithi117.stderr:done 2023-08-10T10:06:31.839 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-08-10T10:06:31.916 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.ix8CXT3Cse 2023-08-10T10:06:31.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ix8CXT3Cse 2023-08-10T10:06:31.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.ix8CXT3Cse 2023-08-10T10:06:32.097 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.ix8CXT3Cse is 6KB 2023-08-10T10:06:32.144 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.ix8CXT3Cse 2023-08-10T10:06:32.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:06:32.224 INFO:teuthology.orchestra.run.smithi117.stdout:e13cba1d25f14c51a1d04da8db823a4e-0-rescue.conf 2023-08-10T10:06:32.225 INFO:teuthology.orchestra.run.smithi117.stdout:e13cba1d25f14c51a1d04da8db823a4e-5.14.0-239.el9.x86_64.conf 2023-08-10T10:06:32.225 INFO:teuthology.orchestra.run.smithi117.stdout:e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:06:32.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:32.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2023-08-10T10:07:02.424 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-10T10:07:02.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:07:02.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:07:37.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-10T10:07:46.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:07:46.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:07:49.136 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-10T10:08:01.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:08:01.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:04.208 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-10T10:08:19.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:08:19.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:19.677 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-08-10T10:08:20.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:08:20.273 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:08:20.273 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-08-10T10:08:20.315 INFO:teuthology.orchestra.run.smithi117.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:08:20.316 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:08:20.316 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:08:20.316 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-10T10:08:21.317 DEBUG:teuthology.parallel:result is None 2023-08-10T10:08:21.318 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-10T10:08:21.331 INFO:teuthology.task.internal:Creating test directory... 2023-08-10T10:08:21.331 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:08:21.342 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:08:21.397 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-10T10:08:21.406 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-10T10:08:21.420 INFO:teuthology.task.internal:Creating archive directory... 2023-08-10T10:08:21.420 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:08:21.429 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:08:21.503 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-10T10:08:21.519 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-10T10:08:21.520 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:08:21.528 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:08:21.661 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:08:21.719 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:08:21.781 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:08:21.785 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-10T10:08:21.795 INFO:teuthology.task.internal:Configuring sudo... 2023-08-10T10:08:21.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:08:21.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:08:21.900 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-10T10:08:21.913 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-10T10:08:21.914 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:08:21.920 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:08:21.973 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:08:22.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:08:22.191 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:08:22.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:08:22.393 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:08:22.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:08:22.502 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:08:22.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:08:22.673 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:08:22.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:08:22.843 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:08:22.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:08:22.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-08-10T10:08:22.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2023-08-10T10:08:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:08:23.063 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:08:23.450 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-10T10:08:23.458 INFO:teuthology.task.internal:Starting timer... 2023-08-10T10:08:23.458 INFO:teuthology.run_tasks:Running task pcp... 2023-08-10T10:08:23.471 INFO:teuthology.run_tasks:Running task selinux... 2023-08-10T10:08:23.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-08-10T10:08:23.625 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-08-10T10:08:23.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2023-08-10T10:08:23.787 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2023-08-10T10:08:23.792 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-10T10:08:23.792 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-08-10T10:08:23.861 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-08-10T10:08:23.862 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2023-08-10T10:08:23.914 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2023-08-10T10:08:23.915 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2023-08-10T10:08:23.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:08:24.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:08:24.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:08:24.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:08:24.113 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-10T10:08:24.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:08:24.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:08:24.324 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-10T10:08:24.336 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-10T10:08:24.337 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-10T10:08:24.357 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-10T10:08:24.378 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-10T10:28:53.014 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2023-08-10T10:28:53.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-08-10T10:28:53.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:28:53.163 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-08-10T10:28:53.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-08-10T10:28:53.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:28:53.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:28:53.453 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-08-10T10:28:53.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-10T10:28:53.611 INFO:teuthology.run_tasks:Running task clock... 2023-08-10T10:28:53.623 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-10T10:28:53.624 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:28:53.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:28:53.633 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:28:53.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:28:53.742 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:28:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:28:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:28:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:28:53.891 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2023-08-10T10:28:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-08-10T10:28:53.932 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2023-08-10T10:28:53.950 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-08-10T10:28:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:28:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:28:54.041 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:28:54.065 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:28:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2023-08-10T10:28:54.178 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:28:54.178 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2023-08-10T10:28:54.178 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.179 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.179 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.179 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.201 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-08-10T10:28:54.210 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:28:54.211 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-08-10T10:28:54.211 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.211 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.211 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.211 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:28:54.212 INFO:teuthology.run_tasks:Running task install... 2023-08-10T10:28:54.220 DEBUG:teuthology.task.install:project ceph 2023-08-10T10:28:54.221 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}} 2023-08-10T10:28:54.221 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'} 2023-08-10T10:28:54.222 INFO:teuthology.task.install:Using flavor: default 2023-08-10T10:28:54.227 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-10T10:28:54.228 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-10T10:28:54.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo dnf -y install 'dnf-command(copr)' 2023-08-10T10:28:54.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo dnf -y install 'dnf-command(copr)' 2023-08-10T10:28:54.969 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:04:22 ago on Thu 10 Aug 2023 10:24:32 AM UTC. 2023-08-10T10:28:54.994 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:03:52 ago on Thu 10 Aug 2023 10:25:02 AM UTC. 2023-08-10T10:28:55.054 INFO:teuthology.orchestra.run.smithi117.stdout:Package dnf-plugins-core-4.3.0-9.el9.noarch is already installed. 2023-08-10T10:28:55.082 INFO:teuthology.orchestra.run.smithi050.stdout:Package dnf-plugins-core-4.3.0-9.el9.noarch is already installed. 2023-08-10T10:28:55.103 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-08-10T10:28:55.105 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2023-08-10T10:28:55.105 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-08-10T10:28:55.135 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-08-10T10:28:55.136 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-08-10T10:28:55.136 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-08-10T10:28:55.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo dnf -y copr enable ceph/el9 2023-08-10T10:28:55.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo dnf -y copr enable ceph/el9 2023-08-10T10:28:55.491 INFO:teuthology.orchestra.run.smithi117.stderr:Enabling a Copr repository. Please note that this repository is not part 2023-08-10T10:28:55.491 INFO:teuthology.orchestra.run.smithi117.stderr:of the main distribution, and quality may vary. 2023-08-10T10:28:55.491 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:The Fedora Project does not exercise any power over the contents of 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:this repository beyond the rules outlined in the Copr FAQ at 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:, 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:and packages are not held to any quality or security level. 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:Please do not file bug reports about these packages in Fedora 2023-08-10T10:28:55.492 INFO:teuthology.orchestra.run.smithi117.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2023-08-10T10:28:55.567 INFO:teuthology.orchestra.run.smithi117.stdout:Repository successfully enabled. 2023-08-10T10:28:55.603 INFO:teuthology.orchestra.run.smithi050.stderr:Enabling a Copr repository. Please note that this repository is not part 2023-08-10T10:28:55.603 INFO:teuthology.orchestra.run.smithi050.stderr:of the main distribution, and quality may vary. 2023-08-10T10:28:55.604 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:28:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:The Fedora Project does not exercise any power over the contents of 2023-08-10T10:28:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:this repository beyond the rules outlined in the Copr FAQ at 2023-08-10T10:28:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:, 2023-08-10T10:28:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:and packages are not held to any quality or security level. 2023-08-10T10:28:55.605 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:28:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:Please do not file bug reports about these packages in Fedora 2023-08-10T10:28:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2023-08-10T10:28:55.624 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:28:55.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:28:55.684 INFO:teuthology.orchestra.run.smithi050.stdout:Repository successfully enabled. 2023-08-10T10:28:55.756 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:28:55.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:28:55.850 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/ 2023-08-10T10:28:55.851 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:28:55.898 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/ 2023-08-10T10:28:55.899 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:28:56.009 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:28:56.009 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:28:56.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:28:56.046 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:28:56.046 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:28:56.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:28:56.120 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:28:56.121 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:28:56.149 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:28:56.149 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:28:56.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:28:56.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:28:56.426 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:28:56.433 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:28:56.515 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2023-08-10T10:28:56.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2023-08-10T10:28:56.522 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-08-10T10:28:56.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-08-10T10:28:56.865 INFO:teuthology.orchestra.run.smithi117.stdout:72 files removed 2023-08-10T10:28:56.903 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:28:56.920 INFO:teuthology.orchestra.run.smithi050.stdout:72 files removed 2023-08-10T10:28:56.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:28:57.761 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 184 kB/s | 78 kB 00:00 2023-08-10T10:28:57.882 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 163 kB/s | 78 kB 00:00 2023-08-10T10:28:58.211 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-08-10T10:28:58.375 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-08-10T10:28:58.653 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-08-10T10:28:58.933 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-08-10T10:28:59.391 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 9.2 MB/s | 6.3 MB 00:00 2023-08-10T10:28:59.563 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-08-10T10:29:01.129 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-08-10T10:29:01.340 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2023-08-10T10:29:01.777 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for el9 owned by ceph 29 kB/s | 7.6 kB 00:00 2023-08-10T10:29:01.929 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for el9 owned by ceph 38 kB/s | 7.6 kB 00:00 2023-08-10T10:29:02.520 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.8 MB 00:00 2023-08-10T10:29:03.707 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 7.8 MB 00:01 2023-08-10T10:29:05.752 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 18 MB 00:02 2023-08-10T10:29:07.216 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 18 MB 00:02 2023-08-10T10:29:09.748 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.6 MB 00:00 2023-08-10T10:29:11.701 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 14 kB 00:00 2023-08-10T10:29:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.6 MB 00:01 2023-08-10T10:29:14.449 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 14 kB 00:00 2023-08-10T10:33:44.723 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 70 kB/s | 18 MB 04:30 2023-08-10T10:33:46.360 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 69 kB/s | 18 MB 04:34 2023-08-10T10:33:52.220 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-10T10:33:52.222 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-10T10:33:52.243 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-10T10:33:52.244 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-10T10:33:52.245 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-10T10:33:52.247 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-10T10:33:52.249 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-10T10:33:52.253 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-10T10:33:52.254 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-10T10:33:52.344 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-08-10T10:33:52.382 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 6.5 k 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 5.2 M 2023-08-10T10:33:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 838 k 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 141 k 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 1.4 M 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 129 k 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 1.7 M 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 7.4 M 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 47 k 2023-08-10T10:33:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 8.1 M 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 40 M 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 259 k 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 217 k 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 218 k 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 18 k 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-10T10:33:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 31 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 656 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 127 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-11.el9 CentOS-AppStream 24 k 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-10T10:33:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 161 k 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 321 k 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 297 k 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 99 k 2023-08-10T10:33:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 85 k 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.0 M 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 168 k 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.43.90-1.el9 CentOS-BaseOS 2.2 M 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.43.90-1.el9 CentOS-BaseOS 1.8 M 2023-08-10T10:33:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.43.90-1.el9 CentOS-BaseOS 41 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.43.90-1.el9 CentOS-BaseOS 245 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-10T10:33:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid x86_64 2.37.4-11.el9 CentOS-BaseOS 107 k 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk x86_64 2.37.4-11.el9 CentOS-BaseOS 153 k 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: libmount x86_64 2.37.4-11.el9 CentOS-BaseOS 133 k 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.3 M 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.0 M 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols x86_64 2.37.4-11.el9 CentOS-BaseOS 62 k 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid x86_64 2.37.4-11.el9 CentOS-BaseOS 27 k 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-10T10:33:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux x86_64 2.37.4-11.el9 CentOS-BaseOS 2.2 M 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-core x86_64 2.37.4-11.el9 CentOS-BaseOS 432 k 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user x86_64 2.37.4-11.el9 CentOS-BaseOS 30 k 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs x86_64 5.19.0-4.el9 CentOS-BaseOS 1.0 M 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-08-10T10:33:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 19 M 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 23 k 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 2.1 M 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 241 k 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 4.4 M 2023-08-10T10:33:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 18 M 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 15 k 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 24 k 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-10T10:33:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 163 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-10T10:33:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 473 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 4.7 M 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-10T10:33:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-10T10:33:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 45 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 124 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-10T10:33:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-10T10:33:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-10T10:33:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-10T10:33:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-10T10:33:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-10T10:33:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-10T10:33:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-08-10T10:33:52.404 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-08-10T10:33:52.405 INFO:teuthology.orchestra.run.smithi050.stdout:Install 131 Packages 2023-08-10T10:33:52.405 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 23 Packages 2023-08-10T10:33:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:33:52.405 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 205 M 2023-08-10T10:33:52.406 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-08-10T10:33:53.019 INFO:teuthology.orchestra.run.smithi050.stdout:(1/154): ceph-18.0.0-5118.ga8bf445f.el9.x86_64. 24 kB/s | 6.5 kB 00:00 2023-08-10T10:33:53.219 INFO:teuthology.orchestra.run.smithi050.stdout:(2/154): ceph-fuse-18.0.0-5118.ga8bf445f.el9.x8 4.1 MB/s | 838 kB 00:00 2023-08-10T10:33:53.269 INFO:teuthology.orchestra.run.smithi050.stdout:(3/154): ceph-immutable-object-cache-18.0.0-511 2.8 MB/s | 141 kB 00:00 2023-08-10T10:33:53.544 INFO:teuthology.orchestra.run.smithi050.stdout:(4/154): ceph-mds-18.0.0-5118.ga8bf445f.el9.x86 7.7 MB/s | 2.1 MB 00:00 2023-08-10T10:33:53.623 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-10T10:33:53.625 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-10T10:33:53.646 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-10T10:33:53.647 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-10T10:33:53.649 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-10T10:33:53.650 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-10T10:33:53.653 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-10T10:33:53.657 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-10T10:33:53.658 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-10T10:33:53.741 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-08-10T10:33:53.761 INFO:teuthology.orchestra.run.smithi050.stdout:(5/154): ceph-mgr-18.0.0-5118.ga8bf445f.el9.x86 6.7 MB/s | 1.4 MB 00:00 2023-08-10T10:33:53.773 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2023-08-10T10:33:53.773 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 6.5 k 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 5.2 M 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 838 k 2023-08-10T10:33:53.774 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 141 k 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 1.4 M 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 129 k 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 1.7 M 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 7.4 M 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 47 k 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 8.1 M 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 40 M 2023-08-10T10:33:53.775 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 259 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 217 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 218 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 18 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-10T10:33:53.776 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 31 k 2023-08-10T10:33:53.777 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 656 k 2023-08-10T10:33:53.777 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 127 k 2023-08-10T10:33:53.779 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-10T10:33:53.779 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-11.el9 CentOS-AppStream 24 k 2023-08-10T10:33:53.779 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 161 k 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 321 k 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 297 k 2023-08-10T10:33:53.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 99 k 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 85 k 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.0 M 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 168 k 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.43.90-1.el9 CentOS-BaseOS 2.2 M 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.43.90-1.el9 CentOS-BaseOS 1.8 M 2023-08-10T10:33:53.781 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.43.90-1.el9 CentOS-BaseOS 41 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.43.90-1.el9 CentOS-BaseOS 245 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid x86_64 2.37.4-11.el9 CentOS-BaseOS 107 k 2023-08-10T10:33:53.782 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk x86_64 2.37.4-11.el9 CentOS-BaseOS 153 k 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: libmount x86_64 2.37.4-11.el9 CentOS-BaseOS 133 k 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.3 M 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 3.0 M 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols x86_64 2.37.4-11.el9 CentOS-BaseOS 62 k 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid x86_64 2.37.4-11.el9 CentOS-BaseOS 27 k 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-10T10:33:53.783 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux x86_64 2.37.4-11.el9 CentOS-BaseOS 2.2 M 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-core x86_64 2.37.4-11.el9 CentOS-BaseOS 432 k 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user x86_64 2.37.4-11.el9 CentOS-BaseOS 30 k 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs x86_64 5.19.0-4.el9 CentOS-BaseOS 1.0 M 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-10T10:33:53.784 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 19 M 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 23 k 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 2.1 M 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 241 k 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 4.4 M 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 18 M 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el9 ceph-noarch 15 k 2023-08-10T10:33:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 24 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-10T10:33:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 163 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-10T10:33:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 473 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 4.7 M 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-10T10:33:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-10T10:33:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 45 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el9 ceph 124 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-10T10:33:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-10T10:33:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-10T10:33:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-10T10:33:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-10T10:33:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-10T10:33:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-10T10:33:53.796 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout:Install 131 Packages 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 23 Packages 2023-08-10T10:33:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:33:53.798 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 205 M 2023-08-10T10:33:53.798 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2023-08-10T10:33:54.285 INFO:teuthology.orchestra.run.smithi117.stdout:(1/154): ceph-18.0.0-5118.ga8bf445f.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2023-08-10T10:33:54.329 INFO:teuthology.orchestra.run.smithi050.stdout:(6/154): ceph-base-18.0.0-5118.ga8bf445f.el9.x8 3.3 MB/s | 5.2 MB 00:01 2023-08-10T10:33:54.437 INFO:teuthology.orchestra.run.smithi050.stdout:(7/154): ceph-mon-18.0.0-5118.ga8bf445f.el9.x86 6.5 MB/s | 4.4 MB 00:00 2023-08-10T10:33:54.469 INFO:teuthology.orchestra.run.smithi117.stdout:(2/154): ceph-fuse-18.0.0-5118.ga8bf445f.el9.x8 4.5 MB/s | 838 kB 00:00 2023-08-10T10:33:54.527 INFO:teuthology.orchestra.run.smithi117.stdout:(3/154): ceph-immutable-object-cache-18.0.0-511 2.4 MB/s | 141 kB 00:00 2023-08-10T10:33:54.738 INFO:teuthology.orchestra.run.smithi050.stdout:(8/154): ceph-common-18.0.0-5118.ga8bf445f.el9. 9.4 MB/s | 19 MB 00:01 2023-08-10T10:33:54.813 INFO:teuthology.orchestra.run.smithi050.stdout:(9/154): ceph-selinux-18.0.0-5118.ga8bf445f.el9 326 kB/s | 24 kB 00:00 2023-08-10T10:33:54.878 INFO:teuthology.orchestra.run.smithi117.stdout:(4/154): ceph-mds-18.0.0-5118.ga8bf445f.el9.x86 6.0 MB/s | 2.1 MB 00:00 2023-08-10T10:33:55.361 INFO:teuthology.orchestra.run.smithi117.stdout:(5/154): ceph-mgr-18.0.0-5118.ga8bf445f.el9.x86 3.0 MB/s | 1.4 MB 00:00 2023-08-10T10:33:55.380 INFO:teuthology.orchestra.run.smithi050.stdout:(10/154): ceph-radosgw-18.0.0-5118.ga8bf445f.el 8.6 MB/s | 8.1 MB 00:00 2023-08-10T10:33:55.503 INFO:teuthology.orchestra.run.smithi117.stdout:(6/154): ceph-base-18.0.0-5118.ga8bf445f.el9.x8 3.3 MB/s | 5.2 MB 00:01 2023-08-10T10:33:55.589 INFO:teuthology.orchestra.run.smithi050.stdout:(11/154): cephfs-mirror-18.0.0-5118.ga8bf445f.e 1.0 MB/s | 218 kB 00:00 2023-08-10T10:33:55.664 INFO:teuthology.orchestra.run.smithi050.stdout:(12/154): libcephfs-devel-18.0.0-5118.ga8bf445f 421 kB/s | 31 kB 00:00 2023-08-10T10:33:55.839 INFO:teuthology.orchestra.run.smithi050.stdout:(13/154): libcephfs2-18.0.0-5118.ga8bf445f.el9. 3.7 MB/s | 656 kB 00:00 2023-08-10T10:33:55.939 INFO:teuthology.orchestra.run.smithi050.stdout:(14/154): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.6 MB/s | 163 kB 00:00 2023-08-10T10:33:56.040 INFO:teuthology.orchestra.run.smithi050.stdout:(15/154): librados-devel-18.0.0-5118.ga8bf445f. 1.2 MB/s | 127 kB 00:00 2023-08-10T10:33:56.223 INFO:teuthology.orchestra.run.smithi050.stdout:(16/154): libradosstriper1-18.0.0-5118.ga8bf445 2.5 MB/s | 473 kB 00:00 2023-08-10T10:33:56.328 INFO:teuthology.orchestra.run.smithi117.stdout:(7/154): ceph-mon-18.0.0-5118.ga8bf445f.el9.x86 4.5 MB/s | 4.4 MB 00:00 2023-08-10T10:33:57.340 INFO:teuthology.orchestra.run.smithi050.stdout:(17/154): librgw2-18.0.0-5118.ga8bf445f.el9.x86 4.2 MB/s | 4.7 MB 00:01 2023-08-10T10:33:57.432 INFO:teuthology.orchestra.run.smithi050.stdout:(18/154): python3-ceph-argparse-18.0.0-5118.ga8 496 kB/s | 45 kB 00:00 2023-08-10T10:33:57.524 INFO:teuthology.orchestra.run.smithi050.stdout:(19/154): python3-ceph-common-18.0.0-5118.ga8bf 1.3 MB/s | 124 kB 00:00 2023-08-10T10:33:57.599 INFO:teuthology.orchestra.run.smithi050.stdout:(20/154): python3-cephfs-18.0.0-5118.ga8bf445f. 2.1 MB/s | 161 kB 00:00 2023-08-10T10:33:57.700 INFO:teuthology.orchestra.run.smithi050.stdout:(21/154): python3-rados-18.0.0-5118.ga8bf445f.e 3.2 MB/s | 321 kB 00:00 2023-08-10T10:33:57.737 INFO:teuthology.orchestra.run.smithi117.stdout:(8/154): ceph-osd-18.0.0-5118.ga8bf445f.el9.x86 7.9 MB/s | 18 MB 00:02 2023-08-10T10:33:57.775 INFO:teuthology.orchestra.run.smithi050.stdout:(22/154): python3-rbd-18.0.0-5118.ga8bf445f.el9 3.9 MB/s | 297 kB 00:00 2023-08-10T10:33:57.804 INFO:teuthology.orchestra.run.smithi117.stdout:(9/154): ceph-selinux-18.0.0-5118.ga8bf445f.el9 368 kB/s | 24 kB 00:00 2023-08-10T10:33:57.851 INFO:teuthology.orchestra.run.smithi050.stdout:(23/154): python3-rgw-18.0.0-5118.ga8bf445f.el9 1.3 MB/s | 99 kB 00:00 2023-08-10T10:33:57.926 INFO:teuthology.orchestra.run.smithi050.stdout:(24/154): rbd-fuse-18.0.0-5118.ga8bf445f.el9.x8 1.1 MB/s | 85 kB 00:00 2023-08-10T10:33:57.979 INFO:teuthology.orchestra.run.smithi117.stdout:(10/154): ceph-radosgw-18.0.0-5118.ga8bf445f.el 4.9 MB/s | 8.1 MB 00:01 2023-08-10T10:33:58.087 INFO:teuthology.orchestra.run.smithi117.stdout:(11/154): cephfs-mirror-18.0.0-5118.ga8bf445f.e 2.0 MB/s | 218 kB 00:00 2023-08-10T10:33:58.130 INFO:teuthology.orchestra.run.smithi117.stdout:(12/154): libcephfs-devel-18.0.0-5118.ga8bf445f 757 kB/s | 31 kB 00:00 2023-08-10T10:33:58.288 INFO:teuthology.orchestra.run.smithi117.stdout:(13/154): libcephfs2-18.0.0-5118.ga8bf445f.el9. 4.1 MB/s | 656 kB 00:00 2023-08-10T10:33:58.316 INFO:teuthology.orchestra.run.smithi050.stdout:(25/154): ceph-osd-18.0.0-5118.ga8bf445f.el9.x8 4.4 MB/s | 18 MB 00:03 2023-08-10T10:33:58.366 INFO:teuthology.orchestra.run.smithi117.stdout:(14/154): libcephsqlite-18.0.0-5118.ga8bf445f.e 2.1 MB/s | 163 kB 00:00 2023-08-10T10:33:58.441 INFO:teuthology.orchestra.run.smithi117.stdout:(15/154): librados-devel-18.0.0-5118.ga8bf445f. 1.7 MB/s | 127 kB 00:00 2023-08-10T10:33:58.452 INFO:teuthology.orchestra.run.smithi050.stdout:(26/154): rbd-nbd-18.0.0-5118.ga8bf445f.el9.x86 1.2 MB/s | 168 kB 00:00 2023-08-10T10:33:58.560 INFO:teuthology.orchestra.run.smithi050.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5118.g 216 kB/s | 23 kB 00:00 2023-08-10T10:33:58.575 INFO:teuthology.orchestra.run.smithi117.stdout:(16/154): libradosstriper1-18.0.0-5118.ga8bf445 3.5 MB/s | 473 kB 00:00 2023-08-10T10:33:58.644 INFO:teuthology.orchestra.run.smithi050.stdout:(28/154): rbd-mirror-18.0.0-5118.ga8bf445f.el9. 4.2 MB/s | 3.0 MB 00:00 2023-08-10T10:33:58.696 INFO:teuthology.orchestra.run.smithi050.stdout:(29/154): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 976 kB/s | 129 kB 00:00 2023-08-10T10:33:59.195 INFO:teuthology.orchestra.run.smithi050.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 3.1 MB/s | 1.7 MB 00:00 2023-08-10T10:33:59.345 INFO:teuthology.orchestra.run.smithi050.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5118.ga8 1.6 MB/s | 241 kB 00:00 2023-08-10T10:33:59.454 INFO:teuthology.orchestra.run.smithi050.stdout:(32/154): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 442 kB/s | 47 kB 00:00 2023-08-10T10:33:59.537 INFO:teuthology.orchestra.run.smithi050.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5118.ga 178 kB/s | 15 kB 00:00 2023-08-10T10:33:59.625 INFO:teuthology.orchestra.run.smithi117.stdout:(17/154): librgw2-18.0.0-5118.ga8bf445f.el9.x86 4.4 MB/s | 4.7 MB 00:01 2023-08-10T10:33:59.671 INFO:teuthology.orchestra.run.smithi050.stdout:(34/154): ceph-volume-18.0.0-5118.ga8bf445f.el9 1.9 MB/s | 259 kB 00:00 2023-08-10T10:33:59.700 INFO:teuthology.orchestra.run.smithi117.stdout:(18/154): python3-ceph-argparse-18.0.0-5118.ga8 612 kB/s | 45 kB 00:00 2023-08-10T10:33:59.771 INFO:teuthology.orchestra.run.smithi050.stdout:(35/154): cephadm-18.0.0-5118.ga8bf445f.el9.noa 2.1 MB/s | 217 kB 00:00 2023-08-10T10:33:59.784 INFO:teuthology.orchestra.run.smithi117.stdout:(19/154): python3-ceph-common-18.0.0-5118.ga8bf 1.5 MB/s | 124 kB 00:00 2023-08-10T10:33:59.838 INFO:teuthology.orchestra.run.smithi050.stdout:(36/154): cephfs-top-18.0.0-5118.ga8bf445f.el9. 276 kB/s | 18 kB 00:00 2023-08-10T10:33:59.867 INFO:teuthology.orchestra.run.smithi117.stdout:(20/154): python3-cephfs-18.0.0-5118.ga8bf445f. 1.9 MB/s | 161 kB 00:00 2023-08-10T10:34:00.009 INFO:teuthology.orchestra.run.smithi117.stdout:(21/154): python3-rados-18.0.0-5118.ga8bf445f.e 2.2 MB/s | 321 kB 00:00 2023-08-10T10:34:00.151 INFO:teuthology.orchestra.run.smithi117.stdout:(22/154): python3-rbd-18.0.0-5118.ga8bf445f.el9 2.1 MB/s | 297 kB 00:00 2023-08-10T10:34:00.164 INFO:teuthology.orchestra.run.smithi050.stdout:(37/154): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2023-08-10T10:34:00.210 INFO:teuthology.orchestra.run.smithi117.stdout:(23/154): python3-rgw-18.0.0-5118.ga8bf445f.el9 1.7 MB/s | 99 kB 00:00 2023-08-10T10:34:00.260 INFO:teuthology.orchestra.run.smithi117.stdout:(24/154): rbd-fuse-18.0.0-5118.ga8bf445f.el9.x8 1.7 MB/s | 85 kB 00:00 2023-08-10T10:34:00.656 INFO:teuthology.orchestra.run.smithi050.stdout:(38/154): ceph-test-18.0.0-5118.ga8bf445f.el9.x 6.9 MB/s | 40 MB 00:05 2023-08-10T10:34:00.723 INFO:teuthology.orchestra.run.smithi050.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 920 kB 00:00 2023-08-10T10:34:00.736 INFO:teuthology.orchestra.run.smithi117.stdout:(25/154): rbd-mirror-18.0.0-5118.ga8bf445f.el9. 6.4 MB/s | 3.0 MB 00:00 2023-08-10T10:34:00.765 INFO:teuthology.orchestra.run.smithi050.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2023-08-10T10:34:00.790 INFO:teuthology.orchestra.run.smithi050.stdout:(41/154): elfutils-libelf-devel-0.189-3.el9.x86 327 kB/s | 21 kB 00:00 2023-08-10T10:34:00.803 INFO:teuthology.orchestra.run.smithi117.stdout:(26/154): rbd-nbd-18.0.0-5118.ga8bf445f.el9.x86 2.5 MB/s | 168 kB 00:00 2023-08-10T10:34:00.840 INFO:teuthology.orchestra.run.smithi050.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-08-10T10:34:00.844 INFO:teuthology.orchestra.run.smithi117.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5118.g 570 kB/s | 23 kB 00:00 2023-08-10T10:34:00.899 INFO:teuthology.orchestra.run.smithi050.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 304 kB/s | 32 kB 00:00 2023-08-10T10:34:01.016 INFO:teuthology.orchestra.run.smithi050.stdout:(44/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2023-08-10T10:34:01.041 INFO:teuthology.orchestra.run.smithi050.stdout:(45/154): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2023-08-10T10:34:01.191 INFO:teuthology.orchestra.run.smithi050.stdout:(46/154): ceph-mgr-diskprediction-local-18.0.0- 3.0 MB/s | 7.4 MB 00:02 2023-08-10T10:34:01.217 INFO:teuthology.orchestra.run.smithi050.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 10 kB 00:00 2023-08-10T10:34:01.259 INFO:teuthology.orchestra.run.smithi050.stdout:(48/154): jq-1.6-15.el9.x86_64.rpm 859 kB/s | 186 kB 00:00 2023-08-10T10:34:01.261 INFO:teuthology.orchestra.run.smithi117.stdout:(28/154): ceph-test-18.0.0-5118.ga8bf445f.el9.x 12 MB/s | 40 MB 00:03 2023-08-10T10:34:01.293 INFO:teuthology.orchestra.run.smithi050.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2023-08-10T10:34:01.295 INFO:teuthology.orchestra.run.smithi117.stdout:(29/154): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 288 kB/s | 129 kB 00:00 2023-08-10T10:34:01.318 INFO:teuthology.orchestra.run.smithi050.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 462 kB/s | 44 kB 00:00 2023-08-10T10:34:01.385 INFO:teuthology.orchestra.run.smithi050.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.2 MB/s | 661 kB 00:00 2023-08-10T10:34:01.427 INFO:teuthology.orchestra.run.smithi050.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 578 kB 00:00 2023-08-10T10:34:01.452 INFO:teuthology.orchestra.run.smithi050.stdout:(53/154): libuuid-devel-2.37.4-11.el9.x86_64.rp 206 kB/s | 24 kB 00:00 2023-08-10T10:34:01.486 INFO:teuthology.orchestra.run.smithi117.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 7.7 MB/s | 1.7 MB 00:00 2023-08-10T10:34:01.507 INFO:teuthology.orchestra.run.smithi050.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 591 kB/s | 46 kB 00:00 2023-08-10T10:34:01.545 INFO:teuthology.orchestra.run.smithi050.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 282 kB 00:00 2023-08-10T10:34:01.545 INFO:teuthology.orchestra.run.smithi117.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5118.ga8 4.0 MB/s | 241 kB 00:00 2023-08-10T10:34:01.586 INFO:teuthology.orchestra.run.smithi050.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.6 MB/s | 217 kB 00:00 2023-08-10T10:34:01.587 INFO:teuthology.orchestra.run.smithi117.stdout:(32/154): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 1.1 MB/s | 47 kB 00:00 2023-08-10T10:34:01.629 INFO:teuthology.orchestra.run.smithi117.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5118.ga 361 kB/s | 15 kB 00:00 2023-08-10T10:34:01.645 INFO:teuthology.orchestra.run.smithi050.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 354 kB/s | 34 kB 00:00 2023-08-10T10:34:01.688 INFO:teuthology.orchestra.run.smithi117.stdout:(34/154): ceph-volume-18.0.0-5118.ga8bf445f.el9 4.4 MB/s | 259 kB 00:00 2023-08-10T10:34:01.747 INFO:teuthology.orchestra.run.smithi117.stdout:(35/154): cephadm-18.0.0-5118.ga8bf445f.el9.noa 3.7 MB/s | 217 kB 00:00 2023-08-10T10:34:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:(36/154): cephfs-top-18.0.0-5118.ga8bf445f.el9. 445 kB/s | 18 kB 00:00 2023-08-10T10:34:01.804 INFO:teuthology.orchestra.run.smithi050.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2023-08-10T10:34:01.929 INFO:teuthology.orchestra.run.smithi050.stdout:(59/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 9.5 MB/s | 3.0 MB 00:00 2023-08-10T10:34:01.972 INFO:teuthology.orchestra.run.smithi117.stdout:(37/154): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-08-10T10:34:01.987 INFO:teuthology.orchestra.run.smithi050.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 4.8 MB/s | 1.5 MB 00:00 2023-08-10T10:34:02.039 INFO:teuthology.orchestra.run.smithi117.stdout:(38/154): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2023-08-10T10:34:02.054 INFO:teuthology.orchestra.run.smithi050.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.3 MB/s | 811 kB 00:00 2023-08-10T10:34:02.081 INFO:teuthology.orchestra.run.smithi117.stdout:(39/154): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-08-10T10:34:02.121 INFO:teuthology.orchestra.run.smithi050.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-08-10T10:34:02.123 INFO:teuthology.orchestra.run.smithi117.stdout:(40/154): elfutils-libelf-devel-0.189-3.el9.x86 521 kB/s | 21 kB 00:00 2023-08-10T10:34:02.257 INFO:teuthology.orchestra.run.smithi117.stdout:(41/154): ceph-mgr-diskprediction-local-18.0.0- 7.7 MB/s | 7.4 MB 00:00 2023-08-10T10:34:02.290 INFO:teuthology.orchestra.run.smithi117.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 307 kB 00:00 2023-08-10T10:34:02.297 INFO:teuthology.orchestra.run.smithi050.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2023-08-10T10:34:02.316 INFO:teuthology.orchestra.run.smithi117.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 582 kB/s | 32 kB 00:00 2023-08-10T10:34:02.427 INFO:teuthology.orchestra.run.smithi117.stdout:(44/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2023-08-10T10:34:02.450 INFO:teuthology.orchestra.run.smithi117.stdout:(45/154): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2023-08-10T10:34:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:(64/154): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-08-10T10:34:02.483 INFO:teuthology.orchestra.run.smithi117.stdout:(46/154): jq-1.6-15.el9.x86_64.rpm 3.3 MB/s | 186 kB 00:00 2023-08-10T10:34:02.497 INFO:teuthology.orchestra.run.smithi050.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 646 kB/s | 228 kB 00:00 2023-08-10T10:34:02.509 INFO:teuthology.orchestra.run.smithi117.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 180 kB/s | 10 kB 00:00 2023-08-10T10:34:02.514 INFO:teuthology.orchestra.run.smithi050.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 123 kB/s | 24 kB 00:00 2023-08-10T10:34:02.539 INFO:teuthology.orchestra.run.smithi050.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 770 kB/s | 18 kB 00:00 2023-08-10T10:34:02.542 INFO:teuthology.orchestra.run.smithi117.stdout:(48/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-08-10T10:34:02.556 INFO:teuthology.orchestra.run.smithi050.stdout:(68/154): python3-markupsafe-1.1.1-12.el9.x86_6 788 kB/s | 32 kB 00:00 2023-08-10T10:34:02.567 INFO:teuthology.orchestra.run.smithi117.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 789 kB/s | 44 kB 00:00 2023-08-10T10:34:02.609 INFO:teuthology.orchestra.run.smithi117.stdout:(50/154): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2023-08-10T10:34:02.623 INFO:teuthology.orchestra.run.smithi050.stdout:(69/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-08-10T10:34:02.651 INFO:teuthology.orchestra.run.smithi117.stdout:(51/154): libtool-2.4.6-45.el9.x86_64.rpm 7.4 MB/s | 578 kB 00:00 2023-08-10T10:34:02.677 INFO:teuthology.orchestra.run.smithi117.stdout:(52/154): libuuid-devel-2.37.4-11.el9.x86_64.rp 403 kB/s | 24 kB 00:00 2023-08-10T10:34:02.702 INFO:teuthology.orchestra.run.smithi117.stdout:(53/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 46 kB 00:00 2023-08-10T10:34:02.735 INFO:teuthology.orchestra.run.smithi117.stdout:(54/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-08-10T10:34:02.769 INFO:teuthology.orchestra.run.smithi117.stdout:(55/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.4 MB/s | 217 kB 00:00 2023-08-10T10:34:02.788 INFO:teuthology.orchestra.run.smithi050.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2023-08-10T10:34:02.794 INFO:teuthology.orchestra.run.smithi117.stdout:(56/154): openblas-0.3.21-2.el9.x86_64.rpm 619 kB/s | 34 kB 00:00 2023-08-10T10:34:02.824 INFO:teuthology.orchestra.run.smithi050.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 927 kB/s | 217 kB 00:00 2023-08-10T10:34:02.857 INFO:teuthology.orchestra.run.smithi050.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 847 kB/s | 174 kB 00:00 2023-08-10T10:34:02.924 INFO:teuthology.orchestra.run.smithi050.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 41 kB 00:00 2023-08-10T10:34:02.928 INFO:teuthology.orchestra.run.smithi117.stdout:(57/154): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-08-10T10:34:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2023-08-10T10:34:03.000 INFO:teuthology.orchestra.run.smithi050.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 211 kB 00:00 2023-08-10T10:34:03.017 INFO:teuthology.orchestra.run.smithi050.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 538 kB/s | 47 kB 00:00 2023-08-10T10:34:03.045 INFO:teuthology.orchestra.run.smithi117.stdout:(58/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-08-10T10:34:03.075 INFO:teuthology.orchestra.run.smithi050.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 580 kB/s | 43 kB 00:00 2023-08-10T10:34:03.095 INFO:teuthology.orchestra.run.smithi117.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2023-08-10T10:34:03.138 INFO:teuthology.orchestra.run.smithi117.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-08-10T10:34:03.163 INFO:teuthology.orchestra.run.smithi117.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-08-10T10:34:03.455 INFO:teuthology.orchestra.run.smithi117.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2023-08-10T10:34:03.596 INFO:teuthology.orchestra.run.smithi117.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-08-10T10:34:03.621 INFO:teuthology.orchestra.run.smithi117.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-08-10T10:34:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:(65/154): python3-jsonpatch-1.21-16.el9.noarch. 765 kB/s | 24 kB 00:00 2023-08-10T10:34:03.668 INFO:teuthology.orchestra.run.smithi050.stdout:(78/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2023-08-10T10:34:03.672 INFO:teuthology.orchestra.run.smithi117.stdout:(66/154): python3-jsonpointer-2.0-4.el9.noarch. 372 kB/s | 18 kB 00:00 2023-08-10T10:34:03.701 INFO:teuthology.orchestra.run.smithi050.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 59 kB/s | 39 kB 00:00 2023-08-10T10:34:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:(67/154): python3-markupsafe-1.1.1-12.el9.x86_6 989 kB/s | 32 kB 00:00 2023-08-10T10:34:03.731 INFO:teuthology.orchestra.run.smithi117.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2023-08-10T10:34:03.743 INFO:teuthology.orchestra.run.smithi050.stdout:(80/154): socat-1.7.4.1-5.el9.x86_64.rpm 470 kB/s | 300 kB 00:00 2023-08-10T10:34:03.768 INFO:teuthology.orchestra.run.smithi050.stdout:(81/154): uuid-1.6.2-55.el9.x86_64.rpm 589 kB/s | 56 kB 00:00 2023-08-10T10:34:03.810 INFO:teuthology.orchestra.run.smithi050.stdout:(82/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-08-10T10:34:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:(83/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 695 kB/s | 63 kB 00:00 2023-08-10T10:34:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:(84/154): fuse-2.9.9-15.el9.x86_64.rpm 804 kB/s | 79 kB 00:00 2023-08-10T10:34:03.906 INFO:teuthology.orchestra.run.smithi117.stdout:(69/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-08-10T10:34:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:(85/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 2.6 MB/s | 197 kB 00:00 2023-08-10T10:34:03.948 INFO:teuthology.orchestra.run.smithi117.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-08-10T10:34:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:(86/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 6.0 MB/s | 807 kB 00:00 2023-08-10T10:34:03.990 INFO:teuthology.orchestra.run.smithi117.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 174 kB 00:00 2023-08-10T10:34:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:(87/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2023-08-10T10:34:04.015 INFO:teuthology.orchestra.run.smithi117.stdout:(72/154): python3-prettytable-0.7.2-27.el9.noar 639 kB/s | 41 kB 00:00 2023-08-10T10:34:04.041 INFO:teuthology.orchestra.run.smithi117.stdout:(73/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 132 kB 00:00 2023-08-10T10:34:04.074 INFO:teuthology.orchestra.run.smithi117.stdout:(74/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2023-08-10T10:34:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:(88/154): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.1 MB 00:00 2023-08-10T10:34:04.108 INFO:teuthology.orchestra.run.smithi117.stdout:(75/154): python3-pytz-2021.1-5.el9.noarch.rpm 738 kB/s | 47 kB 00:00 2023-08-10T10:34:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:(89/154): python3-ply-3.11-14.el9.noarch.rpm 925 kB/s | 103 kB 00:00 2023-08-10T10:34:04.141 INFO:teuthology.orchestra.run.smithi117.stdout:(76/154): python3-requests-oauthlib-1.3.0-12.el 651 kB/s | 43 kB 00:00 2023-08-10T10:34:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:(90/154): python3-pycparser-2.20-6.el9.noarch.r 812 kB/s | 124 kB 00:00 2023-08-10T10:34:04.592 INFO:teuthology.orchestra.run.smithi117.stdout:(77/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-08-10T10:34:04.634 INFO:teuthology.orchestra.run.smithi117.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 81 kB/s | 39 kB 00:00 2023-08-10T10:34:04.668 INFO:teuthology.orchestra.run.smithi117.stdout:(79/154): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2023-08-10T10:34:04.701 INFO:teuthology.orchestra.run.smithi117.stdout:(80/154): uuid-1.6.2-55.el9.x86_64.rpm 896 kB/s | 56 kB 00:00 2023-08-10T10:34:04.726 INFO:teuthology.orchestra.run.smithi117.stdout:(81/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-08-10T10:34:04.729 INFO:teuthology.orchestra.run.smithi050.stdout:(91/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 82 kB/s | 45 kB 00:00 2023-08-10T10:34:04.760 INFO:teuthology.orchestra.run.smithi117.stdout:(82/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-08-10T10:34:04.785 INFO:teuthology.orchestra.run.smithi117.stdout:(83/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-08-10T10:34:04.827 INFO:teuthology.orchestra.run.smithi117.stdout:(84/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 12 MB/s | 807 kB 00:00 2023-08-10T10:34:04.861 INFO:teuthology.orchestra.run.smithi117.stdout:(85/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 2.9 MB/s | 197 kB 00:00 2023-08-10T10:34:04.863 INFO:teuthology.orchestra.run.smithi050.stdout:(92/154): python3-devel-3.9.16-1.el9.x86_64.rpm 323 kB/s | 247 kB 00:00 2023-08-10T10:34:04.894 INFO:teuthology.orchestra.run.smithi117.stdout:(86/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-08-10T10:34:04.953 INFO:teuthology.orchestra.run.smithi117.stdout:(87/154): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-08-10T10:34:04.978 INFO:teuthology.orchestra.run.smithi117.stdout:(88/154): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-08-10T10:34:04.995 INFO:teuthology.orchestra.run.smithi117.stdout:(89/154): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 124 kB 00:00 2023-08-10T10:34:05.512 INFO:teuthology.orchestra.run.smithi117.stdout:(90/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 87 kB/s | 45 kB 00:00 2023-08-10T10:34:05.654 INFO:teuthology.orchestra.run.smithi117.stdout:(91/154): python3-devel-3.9.16-1.el9.x86_64.rpm 367 kB/s | 247 kB 00:00 2023-08-10T10:34:06.363 INFO:teuthology.orchestra.run.smithi117.stdout:(92/154): ceph-common-18.0.0-5118.ga8bf445f.el9 1.5 MB/s | 19 MB 00:12 2023-08-10T10:36:19.035 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.036 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.036 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] libarrow-9.0.0-9.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-9.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.179 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.180 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.180 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] libarrow-9.0.0-9.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-9.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:36:19.357 INFO:teuthology.orchestra.run.smithi117.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 847 B/s | 111 kB 02:13 2023-08-10T10:36:19.445 INFO:teuthology.orchestra.run.smithi050.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 838 B/s | 111 kB 02:15 2023-08-10T10:36:19.457 INFO:teuthology.orchestra.run.smithi117.stdout:(94/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 kB/s | 309 kB 02:13 2023-08-10T10:36:19.487 INFO:teuthology.orchestra.run.smithi050.stdout:(94/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 kB/s | 309 kB 02:14 2023-08-10T10:36:19.566 INFO:teuthology.orchestra.run.smithi117.stdout:(95/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 117 kB/s | 24 kB 00:00 2023-08-10T10:36:19.666 INFO:teuthology.orchestra.run.smithi117.stdout:(96/154): liboath-2.6.7-2.el9.x86_64.rpm 236 kB/s | 49 kB 00:00 2023-08-10T10:36:19.687 INFO:teuthology.orchestra.run.smithi050.stdout:(95/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 101 kB/s | 24 kB 00:00 2023-08-10T10:36:19.721 INFO:teuthology.orchestra.run.smithi050.stdout:(96/154): liboath-2.6.7-2.el9.x86_64.rpm 294 kB/s | 49 kB 00:00 2023-08-10T10:36:19.766 INFO:teuthology.orchestra.run.smithi117.stdout:(97/154): libunwind-1.6.2-1.el9.x86_64.rpm 341 kB/s | 67 kB 00:00 2023-08-10T10:36:19.850 INFO:teuthology.orchestra.run.smithi117.stdout:(98/154): libarrow-9.0.0-9.el9.x86_64.rpm 34 kB/s | 4.4 MB 02:13 2023-08-10T10:36:19.913 INFO:teuthology.orchestra.run.smithi050.stdout:(97/154): libunwind-1.6.2-1.el9.x86_64.rpm 301 kB/s | 67 kB 00:00 2023-08-10T10:36:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:(98/154): libarrow-9.0.0-9.el9.x86_64.rpm 33 kB/s | 4.4 MB 02:15 2023-08-10T10:36:20.083 INFO:teuthology.orchestra.run.smithi117.stdout:(99/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.0 MB/s | 837 kB 00:00 2023-08-10T10:36:20.117 INFO:teuthology.orchestra.run.smithi117.stdout:(100/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 210 kB/s | 43 kB 00:00 2023-08-10T10:36:20.197 INFO:teuthology.orchestra.run.smithi050.stdout:(99/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.0 MB/s | 837 kB 00:00 2023-08-10T10:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout:(101/154): python3-asyncssh-2.13.2-3.el9.noarch 1.0 MB/s | 548 kB 00:00 2023-08-10T10:36:20.305 INFO:teuthology.orchestra.run.smithi050.stdout:(100/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 189 kB/s | 43 kB 00:00 2023-08-10T10:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout:(102/154): python3-certifi-2021.10.8-2.el9.noar 107 kB/s | 15 kB 00:00 2023-08-10T10:36:20.356 INFO:teuthology.orchestra.run.smithi050.stdout:(101/154): python3-asyncssh-2.13.2-3.el9.noarch 1.2 MB/s | 548 kB 00:00 2023-08-10T10:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout:(103/154): python3-cachetools-4.2.4-1.el9.noarc 94 kB/s | 32 kB 00:00 2023-08-10T10:36:20.473 INFO:teuthology.orchestra.run.smithi050.stdout:(102/154): python3-cachetools-4.2.4-1.el9.noarc 118 kB/s | 32 kB 00:00 2023-08-10T10:36:20.585 INFO:teuthology.orchestra.run.smithi117.stdout:(104/154): python3-cheroot-8.6.0-4.el9.noarch.r 607 kB/s | 172 kB 00:00 2023-08-10T10:36:20.619 INFO:teuthology.orchestra.run.smithi117.stdout:(105/154): python3-cherrypy-18.6.1-2.el9.noarch 1.5 MB/s | 358 kB 00:00 2023-08-10T10:36:20.631 INFO:teuthology.orchestra.run.smithi050.stdout:(103/154): python3-certifi-2021.10.8-2.el9.noar 46 kB/s | 15 kB 00:00 2023-08-10T10:36:20.702 INFO:teuthology.orchestra.run.smithi117.stdout:(106/154): python3-google-auth-2.22.0-1.el9.noa 851 kB/s | 197 kB 00:00 2023-08-10T10:36:20.740 INFO:teuthology.orchestra.run.smithi050.stdout:(104/154): python3-cheroot-8.6.0-4.el9.noarch.r 537 kB/s | 172 kB 00:00 2023-08-10T10:36:20.819 INFO:teuthology.orchestra.run.smithi117.stdout:(107/154): python3-jaraco-8.2.1-3.el9.noarch.rp 46 kB/s | 11 kB 00:00 2023-08-10T10:36:20.853 INFO:teuthology.orchestra.run.smithi117.stdout:(108/154): python3-jaraco-classes-3.2.1-5.el9.n 102 kB/s | 18 kB 00:00 2023-08-10T10:36:20.857 INFO:teuthology.orchestra.run.smithi050.stdout:(105/154): python3-cherrypy-18.6.1-2.el9.noarch 1.1 MB/s | 358 kB 00:00 2023-08-10T10:36:20.928 INFO:teuthology.orchestra.run.smithi117.stdout:(109/154): python3-jaraco-collections-3.0.0-8.e 120 kB/s | 23 kB 00:00 2023-08-10T10:36:20.966 INFO:teuthology.orchestra.run.smithi050.stdout:(106/154): python3-jaraco-8.2.1-3.el9.noarch.rp 48 kB/s | 11 kB 00:00 2023-08-10T10:36:21.008 INFO:teuthology.orchestra.run.smithi050.stdout:(107/154): python3-google-auth-2.22.0-1.el9.noa 526 kB/s | 197 kB 00:00 2023-08-10T10:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout:(110/154): python3-jaraco-functools-3.5.0-2.el9 81 kB/s | 19 kB 00:00 2023-08-10T10:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout:(111/154): python3-jaraco-text-3.2.0-6.el9.noar 99 kB/s | 20 kB 00:00 2023-08-10T10:36:21.117 INFO:teuthology.orchestra.run.smithi050.stdout:(108/154): python3-jaraco-classes-3.2.1-5.el9.n 69 kB/s | 18 kB 00:00 2023-08-10T10:36:21.179 INFO:teuthology.orchestra.run.smithi117.stdout:(112/154): python3-jwt+crypto-2.4.0-1.el9.noarc 45 kB/s | 9.0 kB 00:00 2023-08-10T10:36:21.267 INFO:teuthology.orchestra.run.smithi050.stdout:(109/154): python3-jaraco-collections-3.0.0-8.e 78 kB/s | 23 kB 00:00 2023-08-10T10:36:21.292 INFO:teuthology.orchestra.run.smithi050.stdout:(110/154): python3-jaraco-functools-3.5.0-2.el9 88 kB/s | 19 kB 00:00 2023-08-10T10:36:21.312 INFO:teuthology.orchestra.run.smithi117.stdout:(113/154): python3-jwt-2.4.0-1.el9.noarch.rpm 164 kB/s | 41 kB 00:00 2023-08-10T10:36:21.384 INFO:teuthology.orchestra.run.smithi050.stdout:(111/154): python3-jaraco-text-3.2.0-6.el9.noar 95 kB/s | 20 kB 00:00 2023-08-10T10:36:21.413 INFO:teuthology.orchestra.run.smithi117.stdout:(114/154): python3-logutils-0.3.5-21.el9.noarch 252 kB/s | 46 kB 00:00 2023-08-10T10:36:21.526 INFO:teuthology.orchestra.run.smithi050.stdout:(112/154): python3-jwt+crypto-2.4.0-1.el9.noarc 35 kB/s | 9.0 kB 00:00 2023-08-10T10:36:21.551 INFO:teuthology.orchestra.run.smithi050.stdout:(113/154): python3-jwt-2.4.0-1.el9.noarch.rpm 202 kB/s | 41 kB 00:00 2023-08-10T10:36:21.555 INFO:teuthology.orchestra.run.smithi117.stdout:(115/154): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2023-08-10T10:36:21.580 INFO:teuthology.orchestra.run.smithi117.stdout:(116/154): python3-more-itertools-8.12.0-2.el9. 297 kB/s | 79 kB 00:00 2023-08-10T10:36:21.664 INFO:teuthology.orchestra.run.smithi117.stdout:(117/154): python3-natsort-7.1.1-5.el9.noarch.r 232 kB/s | 58 kB 00:00 2023-08-10T10:36:21.745 INFO:teuthology.orchestra.run.smithi050.stdout:(114/154): python3-logutils-0.3.5-21.el9.noarch 213 kB/s | 46 kB 00:00 2023-08-10T10:36:21.802 INFO:teuthology.orchestra.run.smithi050.stdout:(115/154): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2023-08-10T10:36:21.805 INFO:teuthology.orchestra.run.smithi117.stdout:(118/154): python3-portend-3.1.0-2.el9.noarch.r 102 kB/s | 16 kB 00:00 2023-08-10T10:36:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:(116/154): python3-more-itertools-8.12.0-2.el9. 265 kB/s | 79 kB 00:00 2023-08-10T10:36:21.931 INFO:teuthology.orchestra.run.smithi117.stdout:(119/154): python3-pecan-1.4.2-3.el9.noarch.rpm 730 kB/s | 272 kB 00:00 2023-08-10T10:36:21.947 INFO:teuthology.orchestra.run.smithi117.stdout:(120/154): python3-repoze-lru-0.7-16.el9.noarch 221 kB/s | 31 kB 00:00 2023-08-10T10:36:22.061 INFO:teuthology.orchestra.run.smithi050.stdout:(117/154): python3-natsort-7.1.1-5.el9.noarch.r 184 kB/s | 58 kB 00:00 2023-08-10T10:36:22.097 INFO:teuthology.orchestra.run.smithi117.stdout:(121/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 231 kB/s | 90 kB 00:00 2023-08-10T10:36:22.161 INFO:teuthology.orchestra.run.smithi050.stdout:(118/154): python3-portend-3.1.0-2.el9.noarch.r 82 kB/s | 16 kB 00:00 2023-08-10T10:36:22.189 INFO:teuthology.orchestra.run.smithi117.stdout:(122/154): python3-rsa-4.9-2.el9.noarch.rpm 333 kB/s | 59 kB 00:00 2023-08-10T10:36:22.203 INFO:teuthology.orchestra.run.smithi050.stdout:(119/154): python3-pecan-1.4.2-3.el9.noarch.rpm 819 kB/s | 272 kB 00:00 2023-08-10T10:36:22.223 INFO:teuthology.orchestra.run.smithi117.stdout:(123/154): python3-routes-2.5.1-5.el9.noarch.rp 646 kB/s | 188 kB 00:00 2023-08-10T10:36:22.307 INFO:teuthology.orchestra.run.smithi117.stdout:(124/154): python3-tempora-5.0.0-2.el9.noarch.r 172 kB/s | 36 kB 00:00 2023-08-10T10:36:22.382 INFO:teuthology.orchestra.run.smithi050.stdout:(120/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 282 kB/s | 90 kB 00:00 2023-08-10T10:36:22.412 INFO:teuthology.orchestra.run.smithi050.stdout:(121/154): python3-repoze-lru-0.7-16.el9.noarch 124 kB/s | 31 kB 00:00 2023-08-10T10:36:22.432 INFO:teuthology.orchestra.run.smithi117.stdout:(125/154): python3-typing-extensions-4.4.0-2.el 212 kB/s | 51 kB 00:00 2023-08-10T10:36:22.524 INFO:teuthology.orchestra.run.smithi117.stdout:(126/154): python3-webob-1.8.7-6.el9.noarch.rpm 934 kB/s | 230 kB 00:00 2023-08-10T10:36:22.549 INFO:teuthology.orchestra.run.smithi117.stdout:(127/154): python3-websocket-client-1.2.3-2.el9 465 kB/s | 90 kB 00:00 2023-08-10T10:36:22.587 INFO:teuthology.orchestra.run.smithi050.stdout:(122/154): python3-routes-2.5.1-5.el9.noarch.rp 584 kB/s | 188 kB 00:00 2023-08-10T10:36:22.612 INFO:teuthology.orchestra.run.smithi050.stdout:(123/154): python3-rsa-4.9-2.el9.noarch.rpm 260 kB/s | 59 kB 00:00 2023-08-10T10:36:22.691 INFO:teuthology.orchestra.run.smithi117.stdout:(128/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2023-08-10T10:36:22.696 INFO:teuthology.orchestra.run.smithi050.stdout:(124/154): python3-tempora-5.0.0-2.el9.noarch.r 162 kB/s | 36 kB 00:00 2023-08-10T10:36:22.716 INFO:teuthology.orchestra.run.smithi117.stdout:(129/154): python3-zc-lockfile-2.0-10.el9.noarc 105 kB/s | 20 kB 00:00 2023-08-10T10:36:22.830 INFO:teuthology.orchestra.run.smithi050.stdout:(125/154): python3-typing-extensions-4.4.0-2.el 213 kB/s | 51 kB 00:00 2023-08-10T10:36:22.883 INFO:teuthology.orchestra.run.smithi117.stdout:(130/154): re2-20211101-2.el9.x86_64.rpm 679 kB/s | 192 kB 00:00 2023-08-10T10:36:22.938 INFO:teuthology.orchestra.run.smithi050.stdout:(126/154): python3-webob-1.8.7-6.el9.noarch.rpm 866 kB/s | 230 kB 00:00 2023-08-10T10:36:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:(127/154): python3-websocket-client-1.2.3-2.el9 407 kB/s | 90 kB 00:00 2023-08-10T10:36:23.100 INFO:teuthology.orchestra.run.smithi117.stdout:(131/154): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2023-08-10T10:36:23.131 INFO:teuthology.orchestra.run.smithi050.stdout:(128/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.4 MB/s | 427 kB 00:00 2023-08-10T10:36:23.148 INFO:teuthology.orchestra.run.smithi050.stdout:(129/154): python3-zc-lockfile-2.0-10.el9.noarc 97 kB/s | 20 kB 00:00 2023-08-10T10:36:23.315 INFO:teuthology.orchestra.run.smithi050.stdout:(130/154): re2-20211101-2.el9.x86_64.rpm 676 kB/s | 192 kB 00:00 2023-08-10T10:36:23.334 INFO:teuthology.orchestra.run.smithi117.stdout:(132/154): NetworkManager-1.43.90-1.el9.x86_64. 9.7 MB/s | 2.2 MB 00:00 2023-08-10T10:36:23.417 INFO:teuthology.orchestra.run.smithi117.stdout:(133/154): NetworkManager-libnm-1.43.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2023-08-10T10:36:23.460 INFO:teuthology.orchestra.run.smithi117.stdout:(134/154): NetworkManager-team-1.43.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2023-08-10T10:36:23.502 INFO:teuthology.orchestra.run.smithi117.stdout:(135/154): NetworkManager-tui-1.43.90-1.el9.x86 5.9 MB/s | 245 kB 00:00 2023-08-10T10:36:23.527 INFO:teuthology.orchestra.run.smithi117.stdout:(136/154): elfutils-debuginfod-client-0.189-3.e 1.5 MB/s | 36 kB 00:00 2023-08-10T10:36:23.557 INFO:teuthology.orchestra.run.smithi050.stdout:(131/154): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2023-08-10T10:36:23.569 INFO:teuthology.orchestra.run.smithi117.stdout:(137/154): elfutils-libelf-0.189-3.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-08-10T10:36:23.611 INFO:teuthology.orchestra.run.smithi117.stdout:(138/154): elfutils-libs-0.189-3.el9.x86_64.rpm 6.1 MB/s | 254 kB 00:00 2023-08-10T10:36:23.669 INFO:teuthology.orchestra.run.smithi117.stdout:(139/154): iproute-6.2.0-5.el9.x86_64.rpm 13 MB/s | 785 kB 00:00 2023-08-10T10:36:23.720 INFO:teuthology.orchestra.run.smithi117.stdout:(140/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 8.9 MB/s | 448 kB 00:00 2023-08-10T10:36:23.790 INFO:teuthology.orchestra.run.smithi050.stdout:(132/154): NetworkManager-1.43.90-1.el9.x86_64. 9.7 MB/s | 2.2 MB 00:00 2023-08-10T10:36:23.795 INFO:teuthology.orchestra.run.smithi117.stdout:(141/154): librbd1-18.0.0-5118.ga8bf445f.el9.x8 3.3 MB/s | 3.0 MB 00:00 2023-08-10T10:36:23.820 INFO:teuthology.orchestra.run.smithi117.stdout:(142/154): libblkid-2.37.4-11.el9.x86_64.rpm 1.1 MB/s | 107 kB 00:00 2023-08-10T10:36:23.845 INFO:teuthology.orchestra.run.smithi117.stdout:(143/154): libfdisk-2.37.4-11.el9.x86_64.rpm 3.1 MB/s | 153 kB 00:00 2023-08-10T10:36:23.870 INFO:teuthology.orchestra.run.smithi117.stdout:(144/154): libmount-2.37.4-11.el9.x86_64.rpm 2.7 MB/s | 133 kB 00:00 2023-08-10T10:36:23.891 INFO:teuthology.orchestra.run.smithi050.stdout:(133/154): NetworkManager-libnm-1.43.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2023-08-10T10:36:23.896 INFO:teuthology.orchestra.run.smithi117.stdout:(145/154): libsmartcols-2.37.4-11.el9.x86_64.rp 1.3 MB/s | 62 kB 00:00 2023-08-10T10:36:23.921 INFO:teuthology.orchestra.run.smithi117.stdout:(146/154): libuuid-2.37.4-11.el9.x86_64.rpm 562 kB/s | 27 kB 00:00 2023-08-10T10:36:23.924 INFO:teuthology.orchestra.run.smithi050.stdout:(134/154): NetworkManager-team-1.43.90-1.el9.x8 1.2 MB/s | 41 kB 00:00 2023-08-10T10:36:23.975 INFO:teuthology.orchestra.run.smithi050.stdout:(135/154): NetworkManager-tui-1.43.90-1.el9.x86 4.9 MB/s | 245 kB 00:00 2023-08-10T10:36:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:(136/154): elfutils-debuginfod-client-0.189-3.e 1.1 MB/s | 36 kB 00:00 2023-08-10T10:36:24.013 INFO:teuthology.orchestra.run.smithi117.stdout:(147/154): librados2-18.0.0-5118.ga8bf445f.el9. 2.6 MB/s | 3.3 MB 00:01 2023-08-10T10:36:24.055 INFO:teuthology.orchestra.run.smithi117.stdout:(148/154): openssl-3.0.7-24.el9.x86_64.rpm 7.4 MB/s | 1.2 MB 00:00 2023-08-10T10:36:24.059 INFO:teuthology.orchestra.run.smithi050.stdout:(137/154): elfutils-libelf-0.189-3.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-08-10T10:36:24.117 INFO:teuthology.orchestra.run.smithi050.stdout:(138/154): elfutils-libs-0.189-3.el9.x86_64.rpm 4.3 MB/s | 254 kB 00:00 2023-08-10T10:36:24.130 INFO:teuthology.orchestra.run.smithi117.stdout:(149/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2023-08-10T10:36:24.174 INFO:teuthology.orchestra.run.smithi117.stdout:(150/154): util-linux-core-2.37.4-11.el9.x86_64 4.1 MB/s | 432 kB 00:00 2023-08-10T10:36:24.218 INFO:teuthology.orchestra.run.smithi050.stdout:(139/154): librados2-18.0.0-5118.ga8bf445f.el9. 3.2 MB/s | 3.3 MB 00:01 2023-08-10T10:36:24.256 INFO:teuthology.orchestra.run.smithi117.stdout:(151/154): util-linux-2.37.4-11.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2023-08-10T10:36:24.281 INFO:teuthology.orchestra.run.smithi117.stdout:(152/154): util-linux-user-2.37.4-11.el9.x86_64 205 kB/s | 30 kB 00:00 2023-08-10T10:36:24.301 INFO:teuthology.orchestra.run.smithi050.stdout:(140/154): iproute-6.2.0-5.el9.x86_64.rpm 4.2 MB/s | 785 kB 00:00 2023-08-10T10:36:24.314 INFO:teuthology.orchestra.run.smithi117.stdout:(153/154): xfsdump-3.1.12-3.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2023-08-10T10:36:24.343 INFO:teuthology.orchestra.run.smithi050.stdout:(141/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 3.8 MB/s | 448 kB 00:00 2023-08-10T10:36:24.364 INFO:teuthology.orchestra.run.smithi117.stdout:(154/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2023-08-10T10:36:24.372 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:36:24.373 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.4 MB/s | 205 MB 02:30 2023-08-10T10:36:24.387 INFO:teuthology.orchestra.run.smithi050.stdout:(142/154): libblkid-2.37.4-11.el9.x86_64.rpm 1.3 MB/s | 107 kB 00:00 2023-08-10T10:36:24.428 INFO:teuthology.orchestra.run.smithi050.stdout:(143/154): libfdisk-2.37.4-11.el9.x86_64.rpm 1.8 MB/s | 153 kB 00:00 2023-08-10T10:36:24.461 INFO:teuthology.orchestra.run.smithi050.stdout:(144/154): libmount-2.37.4-11.el9.x86_64.rpm 1.8 MB/s | 133 kB 00:00 2023-08-10T10:36:24.462 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2023-08-10T10:36:24.486 INFO:teuthology.orchestra.run.smithi050.stdout:(145/154): libsmartcols-2.37.4-11.el9.x86_64.rp 1.1 MB/s | 62 kB 00:00 2023-08-10T10:36:24.512 INFO:teuthology.orchestra.run.smithi050.stdout:(146/154): libuuid-2.37.4-11.el9.x86_64.rpm 563 kB/s | 27 kB 00:00 2023-08-10T10:36:24.587 INFO:teuthology.orchestra.run.smithi050.stdout:(147/154): openssl-3.0.7-24.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2023-08-10T10:36:24.704 INFO:teuthology.orchestra.run.smithi050.stdout:(148/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2023-08-10T10:36:24.766 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2023-08-10T10:36:24.766 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2023-08-10T10:36:24.804 INFO:teuthology.orchestra.run.smithi050.stdout:(149/154): util-linux-2.37.4-11.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2023-08-10T10:36:24.846 INFO:teuthology.orchestra.run.smithi050.stdout:(150/154): util-linux-core-2.37.4-11.el9.x86_64 3.4 MB/s | 432 kB 00:00 2023-08-10T10:36:24.889 INFO:teuthology.orchestra.run.smithi050.stdout:(151/154): util-linux-user-2.37.4-11.el9.x86_64 375 kB/s | 30 kB 00:00 2023-08-10T10:36:24.972 INFO:teuthology.orchestra.run.smithi050.stdout:(152/154): xfsdump-3.1.12-3.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2023-08-10T10:36:25.039 INFO:teuthology.orchestra.run.smithi050.stdout:(153/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 7.2 MB/s | 1.0 MB 00:00 2023-08-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi050.stdout:(154/154): librbd1-18.0.0-5118.ga8bf445f.el9.x8 1.7 MB/s | 3.0 MB 00:01 2023-08-10T10:36:25.148 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:36:25.148 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.3 MB/s | 205 MB 02:32 2023-08-10T10:36:25.243 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-08-10T10:36:25.576 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-08-10T10:36:25.576 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-08-10T10:36:26.741 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2023-08-10T10:36:26.742 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2023-08-10T10:36:27.867 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-08-10T10:36:27.868 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-08-10T10:36:33.069 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2023-08-10T10:36:33.184 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-10T10:36:33.235 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libuuid-2.37.4-11.el9.x86_64 2/177 2023-08-10T10:36:33.274 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-10T10:36:33.392 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-10T10:36:33.477 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-10T10:36:33.567 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-10T10:36:33.658 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-10T10:36:33.756 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-10T10:36:33.800 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-10T10:36:33.910 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-10T10:36:34.353 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-10T10:36:34.413 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:36:34.643 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-08-10T10:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:36:34.788 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-10T10:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 13/177 2023-08-10T10:36:34.846 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libuuid-2.37.4-11.el9.x86_64 2/177 2023-08-10T10:36:34.892 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-10T10:36:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-10T10:36:35.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-10T10:36:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-10T10:36:35.160 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-10T10:36:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-10T10:36:35.185 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:36:35.278 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-10T10:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:36:35.352 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-10T10:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 17/177 2023-08-10T10:36:35.477 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 17/177 2023-08-10T10:36:35.509 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-10T10:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libmount-2.37.4-11.el9.x86_64 18/177 2023-08-10T10:36:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-10T10:36:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libsmartcols-2.37.4-11.el9.x86_64 19/177 2023-08-10T10:36:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-10T10:36:36.095 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-10T10:36:36.123 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-10T10:36:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:36:36.315 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:36:36.349 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:36:36.350 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:36.436 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:36:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 13/177 2023-08-10T10:36:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-10T10:36:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-10T10:36:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:36:36.934 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:36.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-10T10:36:37.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-10T10:36:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:36:37.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-10T10:36:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 17/177 2023-08-10T10:36:37.157 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-10T10:36:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 17/177 2023-08-10T10:36:37.283 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-10T10:36:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libmount-2.37.4-11.el9.x86_64 18/177 2023-08-10T10:36:37.338 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-10T10:36:37.372 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-10T10:36:37.484 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-10T10:36:37.526 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9. 30/177 2023-08-10T10:36:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 31/177 2023-08-10T10:36:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libsmartcols-2.37.4-11.el9.x86_64 19/177 2023-08-10T10:36:37.711 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_6 32/177 2023-08-10T10:36:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-10T10:36:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-10T10:36:37.891 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-10T10:36:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-10T10:36:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:38.670 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-10T10:36:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-10T10:36:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-10T10:36:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-10T10:36:38.766 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-10T10:36:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-10T10:36:38.897 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-10T10:36:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-10T10:36:38.951 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-10T10:36:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-10T10:36:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_6 39/177 2023-08-10T10:36:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-10T10:36:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-10T10:36:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-10T10:36:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-10T10:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-10T10:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-10T10:36:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-10T10:36:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9. 30/177 2023-08-10T10:36:39.480 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 31/177 2023-08-10T10:36:39.619 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_6 32/177 2023-08-10T10:36:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libfdisk-2.37.4-11.el9.x86_64 43/177 2023-08-10T10:36:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-10T10:36:39.917 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-10T10:36:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-2.37.4-11.el9.x86_64 44/177 2023-08-10T10:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-10T10:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-11.el9.x86_64 46/177 2023-08-10T10:36:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-10T10:36:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-10T10:36:40.513 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-10T10:36:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-10T10:36:40.631 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-10T10:36:40.696 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-10T10:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-10T10:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-10T10:36:40.800 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-10T10:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-10T10:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-10T10:36:40.933 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-10T10:36:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-10T10:36:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-10T10:36:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-10T10:36:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-10T10:36:41.152 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_6 39/177 2023-08-10T10:36:41.175 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-10T10:36:41.209 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-10T10:36:41.224 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-10T10:36:41.266 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-10T10:36:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-10T10:36:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-10T10:36:41.419 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-10T10:36:41.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-10T10:36:41.489 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-10T10:36:41.523 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-10T10:36:41.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-10T10:36:41.604 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-10T10:36:41.762 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-10T10:36:41.814 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-10T10:36:41.879 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libfdisk-2.37.4-11.el9.x86_64 43/177 2023-08-10T10:36:41.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-10T10:36:41.963 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-10T10:36:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-2.37.4-11.el9.x86_64 44/177 2023-08-10T10:36:42.229 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-10T10:36:42.238 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-10T10:36:42.292 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-10T10:36:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-11.el9.x86_64 46/177 2023-08-10T10:36:42.471 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-10T10:36:42.519 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-10T10:36:42.544 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-10T10:36:42.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-10T10:36:42.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-10T10:36:42.624 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-10T10:36:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-10T10:36:42.668 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-10T10:36:42.716 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-10T10:36:42.774 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-10T10:36:42.811 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-10T10:36:42.854 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-10T10:36:42.857 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-10T10:36:42.942 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-10T10:36:42.985 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-10T10:36:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-10T10:36:43.048 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-10T10:36:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-10T10:36:43.100 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-10T10:36:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-10T10:36:43.156 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-10T10:36:43.197 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-10T10:36:43.258 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-10T10:36:43.330 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-10T10:36:43.330 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-10T10:36:43.376 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-10T10:36:43.415 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-10T10:36:43.513 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-10T10:36:43.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-10T10:36:43.644 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-10T10:36:43.723 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-10T10:36:43.791 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-10T10:36:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-10T10:36:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-10T10:36:44.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-10T10:36:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-10T10:36:44.163 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-10T10:36:44.213 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-10T10:36:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-10T10:36:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-10T10:36:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-10T10:36:44.582 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-10T10:36:44.648 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-10T10:36:44.682 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-10T10:36:44.697 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-10T10:36:44.724 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-10T10:36:44.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-10T10:36:44.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-10T10:36:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-10T10:36:45.066 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-10T10:36:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-10T10:36:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-10T10:36:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-10T10:36:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-10T10:36:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-10T10:36:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-10T10:36:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-10T10:36:45.613 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-10T10:36:45.698 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-10T10:36:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-10T10:36:45.913 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-10T10:36:45.920 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-10T10:36:45.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-10T10:36:46.028 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-10T10:36:46.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-10T10:36:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-10T10:36:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-10T10:36:46.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-10T10:36:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-10T10:36:46.554 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-10T10:36:46.626 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-10T10:36:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-10T10:36:47.680 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-10T10:36:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-10T10:36:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-10T10:36:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-10T10:36:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-10T10:36:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-10T10:36:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-10T10:36:48.171 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-10T10:36:48.205 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 106/177 2023-08-10T10:36:48.282 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-10T10:36:48.317 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 106/177 2023-08-10T10:36:48.352 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 107/177 2023-08-10T10:36:48.410 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-10T10:36:48.612 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-10T10:36:48.663 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-10T10:36:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-10T10:36:48.893 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-10T10:36:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 110/177 2023-08-10T10:36:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 110/177 2023-08-10T10:36:49.043 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 111/177 2023-08-10T10:36:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-10T10:36:49.840 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-10T10:36:51.526 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-10T10:36:51.553 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:51.597 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-10T10:36:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-10T10:36:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-10T10:36:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-10T10:36:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 106/177 2023-08-10T10:36:52.232 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 113/177 2023-08-10T10:36:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 106/177 2023-08-10T10:36:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 107/177 2023-08-10T10:36:52.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-10T10:36:52.464 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 113/177 2023-08-10T10:36:52.465 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-10T10:36:52.465 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-10T10:36:52.466 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:36:52.518 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 114/177 2023-08-10T10:36:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-10T10:36:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 110/177 2023-08-10T10:36:53.087 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 110/177 2023-08-10T10:36:53.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 111/177 2023-08-10T10:36:55.905 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:55.989 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:56.687 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 112/177 2023-08-10T10:36:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 113/177 2023-08-10T10:36:56.906 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 113/177 2023-08-10T10:36:56.906 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-10T10:36:56.906 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-10T10:36:56.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:36:56.956 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 114/177 2023-08-10T10:37:05.108 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 114/177 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2023-08-10T10:37:05.109 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2023-08-10T10:37:05.110 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2023-08-10T10:37:05.110 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 115/177 2023-08-10T10:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 115/177 2023-08-10T10:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-10T10:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:07.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 116/177 2023-08-10T10:37:07.257 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 116/177 2023-08-10T10:37:07.257 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:07.257 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-10T10:37:07.258 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-10T10:37:07.258 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-10T10:37:07.258 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:07.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 117/177 2023-08-10T10:37:07.602 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 117/177 2023-08-10T10:37:07.602 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:07.603 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-10T10:37:07.603 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-10T10:37:07.603 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-10T10:37:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:08.095 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 118/177 2023-08-10T10:37:08.198 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 118/177 2023-08-10T10:37:08.198 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:08.198 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-10T10:37:08.199 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-10T10:37:08.199 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-10T10:37:08.199 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:08.322 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-10T10:37:08.955 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 120/177 2023-08-10T10:37:08.998 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 120/177 2023-08-10T10:37:09.044 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 121/177 2023-08-10T10:37:09.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 122/177 2023-08-10T10:37:09.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 123/177 2023-08-10T10:37:09.494 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 123/177 2023-08-10T10:37:09.527 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 124/177 2023-08-10T10:37:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 114/177 2023-08-10T10:37:10.661 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-08-10T10:37:10.661 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-08-10T10:37:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:10.696 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 124/177 2023-08-10T10:37:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 125/177 2023-08-10T10:37:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 125/177 2023-08-10T10:37:10.904 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 115/177 2023-08-10T10:37:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 115/177 2023-08-10T10:37:10.975 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:10.975 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-10T10:37:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 126/177 2023-08-10T10:37:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 127/177 2023-08-10T10:37:11.178 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 127/177 2023-08-10T10:37:11.178 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:11.178 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-10T10:37:11.179 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-10T10:37:11.179 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-10T10:37:11.179 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 128/177 2023-08-10T10:37:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 128/177 2023-08-10T10:37:11.360 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 129/177 2023-08-10T10:37:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-10T10:37:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 131/177 2023-08-10T10:37:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 131/177 2023-08-10T10:37:12.355 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:12.355 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-10T10:37:12.356 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-10T10:37:12.356 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-10T10:37:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:12.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 132/177 2023-08-10T10:37:12.518 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 132/177 2023-08-10T10:37:12.518 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:12.518 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-10T10:37:12.518 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:12.600 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 133/177 2023-08-10T10:37:12.689 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 133/177 2023-08-10T10:37:12.689 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:12.689 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-10T10:37:12.689 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-10T10:37:12.689 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-10T10:37:12.690 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:12.821 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 116/177 2023-08-10T10:37:12.945 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 116/177 2023-08-10T10:37:12.946 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:12.946 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-10T10:37:12.946 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-10T10:37:12.946 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-10T10:37:12.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:13.067 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:13.143 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:13.143 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:13.143 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-10T10:37:13.144 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-10T10:37:13.144 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-10T10:37:13.144 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 117/177 2023-08-10T10:37:13.311 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 117/177 2023-08-10T10:37:13.311 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:13.312 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-10T10:37:13.312 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-10T10:37:13.312 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-10T10:37:13.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:13.842 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 118/177 2023-08-10T10:37:13.931 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 118/177 2023-08-10T10:37:13.931 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:13.931 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-10T10:37:13.932 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-10T10:37:13.932 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-10T10:37:13.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-10T10:37:14.686 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 120/177 2023-08-10T10:37:14.729 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 120/177 2023-08-10T10:37:14.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 121/177 2023-08-10T10:37:14.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 122/177 2023-08-10T10:37:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 123/177 2023-08-10T10:37:15.319 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 123/177 2023-08-10T10:37:15.364 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 124/177 2023-08-10T10:37:16.595 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 124/177 2023-08-10T10:37:16.630 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 125/177 2023-08-10T10:37:16.782 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 125/177 2023-08-10T10:37:16.976 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 126/177 2023-08-10T10:37:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 127/177 2023-08-10T10:37:17.103 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 127/177 2023-08-10T10:37:17.104 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:17.104 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-10T10:37:17.104 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-10T10:37:17.104 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-10T10:37:17.104 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:17.175 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 128/177 2023-08-10T10:37:17.218 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 128/177 2023-08-10T10:37:17.268 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 135/177 2023-08-10T10:37:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 136/177 2023-08-10T10:37:17.324 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 129/177 2023-08-10T10:37:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 137/177 2023-08-10T10:37:17.592 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-10T10:37:17.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-10T10:37:17.772 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 140/177 2023-08-10T10:37:17.820 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-10T10:37:17.872 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-10T10:37:17.969 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-user-2.37.4-11.el9.x86_64 143/177 2023-08-10T10:37:18.015 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-10T10:37:18.100 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-10T10:37:18.139 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_ 146/177 2023-08-10T10:37:18.194 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.43.90-1.el9.x86_64 147/177 2023-08-10T10:37:18.239 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.43.90-1.el9.x86_64 148/177 2023-08-10T10:37:18.276 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-10T10:37:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 131/177 2023-08-10T10:37:18.407 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 131/177 2023-08-10T10:37:18.407 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:18.407 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-10T10:37:18.408 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-10T10:37:18.408 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-10T10:37:18.408 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 132/177 2023-08-10T10:37:18.555 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 132/177 2023-08-10T10:37:18.556 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:18.556 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-10T10:37:18.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:18.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 133/177 2023-08-10T10:37:18.747 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 133/177 2023-08-10T10:37:18.747 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:18.748 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-10T10:37:18.748 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-10T10:37:18.748 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-10T10:37:18.748 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:19.172 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:19.172 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:19.249 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:19.250 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-10T10:37:19.250 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-10T10:37:19.250 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-10T10:37:19.250 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-10T10:37:19.250 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 150/177 2023-08-10T10:37:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-10T10:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-10T10:37:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-10T10:37:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-10T10:37:21.189 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-10T10:37:21.229 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-10T10:37:21.271 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-10T10:37:21.271 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-10T10:37:21.422 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-10T10:37:21.472 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-10T10:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-10T10:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-10T10:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-10T10:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-10T10:37:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-10T10:37:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-10T10:37:21.872 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-10T10:37:21.945 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-10T10:37:22.005 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-10T10:37:22.054 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-10T10:37:22.080 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-10T10:37:22.114 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-10T10:37:22.147 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-10T10:37:22.193 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:22.194 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-10T10:37:22.669 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-10T10:37:22.699 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-10T10:37:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-10T10:37:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-10T10:37:22.901 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-10T10:37:23.361 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-10T10:37:23.362 INFO:teuthology.orchestra.run.smithi117.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:37:23.362 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:23.668 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 135/177 2023-08-10T10:37:23.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 136/177 2023-08-10T10:37:23.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 137/177 2023-08-10T10:37:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-10T10:37:24.205 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-10T10:37:24.286 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 140/177 2023-08-10T10:37:24.358 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-10T10:37:24.444 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-10T10:37:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-user-2.37.4-11.el9.x86_64 143/177 2023-08-10T10:37:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-10T10:37:24.715 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-10T10:37:24.768 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_ 146/177 2023-08-10T10:37:24.840 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.43.90-1.el9.x86_64 147/177 2023-08-10T10:37:24.926 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.43.90-1.el9.x86_64 148/177 2023-08-10T10:37:25.804 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:25.856 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:25.934 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-10T10:37:27.386 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 150/177 2023-08-10T10:37:27.504 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-10T10:37:27.566 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-10T10:37:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-10T10:37:27.779 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 1/177 2023-08-10T10:37:27.779 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 2/177 2023-08-10T10:37:27.779 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 3/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 4/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 6/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 7/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 8/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 9/177 2023-08-10T10:37:27.780 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 10/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 13/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_ 14/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 15/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:37:27.781 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_6 17/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 18/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 19/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9. 21/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_6 22/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 23/177 2023-08-10T10:37:27.782 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 24/177 2023-08-10T10:37:27.783 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 25/177 2023-08-10T10:37:27.793 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 26/177 2023-08-10T10:37:27.793 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 27/177 2023-08-10T10:37:27.794 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 28/177 2023-08-10T10:37:27.794 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/177 2023-08-10T10:37:27.794 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 30/177 2023-08-10T10:37:27.795 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 31/177 2023-08-10T10:37:27.795 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/177 2023-08-10T10:37:27.795 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/177 2023-08-10T10:37:27.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 34/177 2023-08-10T10:37:27.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/177 2023-08-10T10:37:27.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 36/177 2023-08-10T10:37:27.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 37/177 2023-08-10T10:37:27.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 38/177 2023-08-10T10:37:27.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-10T10:37:27.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-10T10:37:27.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-10T10:37:27.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-10T10:37:27.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-10T10:37:27.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-10T10:37:27.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-10T10:37:27.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-10T10:37:27.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-10T10:37:27.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-10T10:37:27.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-10T10:37:27.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-10T10:37:27.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-10T10:37:27.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-10T10:37:27.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-11.el9.x86_64 53/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-10T10:37:27.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-10T10:37:27.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-10T10:37:27.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-10T10:37:27.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-10T10:37:27.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-10T10:37:27.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-10T10:37:27.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-10T10:37:27.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-10T10:37:27.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-10T10:37:27.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-10T10:37:27.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-10T10:37:27.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-10T10:37:27.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 85/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 86/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/177 2023-08-10T10:37:27.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/177 2023-08-10T10:37:27.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/177 2023-08-10T10:37:27.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/177 2023-08-10T10:37:27.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 91/177 2023-08-10T10:37:27.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-10T10:37:27.810 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-10T10:37:27.811 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-10T10:37:27.812 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-10T10:37:27.813 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-10T10:37:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-10T10:37:27.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-10T10:37:27.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-10T10:37:27.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-10T10:37:27.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-10T10:37:27.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 132/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.43.90-1.el9.x86_64 136/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-10T10:37:27.816 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 138/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.43.90-1.el9.x86_64 140/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.43.90-1.el9.x86_64 142/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-10T10:37:27.817 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-10T10:37:27.818 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.37.4-11.el9.x86_64 154/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.37.4-11.el9.x86_64 156/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-10T10:37:27.819 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.37.4-11.el9.x86_64 158/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.37.4-11.el9.x86_64 160/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.37.4-11.el9.x86_64 162/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-10T10:37:27.820 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.37.4-11.el9.x86_64 168/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-10T10:37:27.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-core-2.37.4-11.el9.x86_64 170/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.37.4-11.el9.x86_64 172/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-10T10:37:27.822 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-10T10:37:27.823 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-10T10:37:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-10T10:37:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-10T10:37:27.951 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-10T10:37:27.952 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-10T10:37:28.140 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-10T10:37:28.194 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-10T10:37:28.195 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-10T10:37:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-10T10:37:28.395 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-10T10:37:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-10T10:37:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-10T10:37:28.582 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-10T10:37:28.663 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-10T10:37:28.779 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-10T10:37:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-10T10:37:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-10T10:37:28.929 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-10T10:37:28.971 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-10T10:37:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-10T10:37:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:29.454 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-10T10:37:29.454 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-10T10:37:29.610 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-10T10:37:29.649 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-10T10:37:29.691 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-10T10:37:29.736 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-10T10:37:29.883 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-10T10:37:30.108 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-10T10:37:30.108 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:30.108 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2023-08-10T10:37:30.109 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:30.109 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:30.109 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:30.109 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:30.110 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-10T10:37:30.110 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-10T10:37:30.110 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: libmount-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.111 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-core-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.112 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-10T10:37:30.113 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.114 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.115 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.116 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-10T10:37:30.117 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-15.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.118 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.119 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-11.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-10T10:37:30.120 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.11-1.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-10T10:37:30.121 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.122 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-10T10:37:30.123 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-10T10:37:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-10T10:37:30.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-10T10:37:30.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-10T10:37:30.133 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2023-08-10T10:37:30.134 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-10T10:37:30.135 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-10T10:37:30.135 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-10T10:37:30.135 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-10T10:37:30.135 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-10T10:37:30.135 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-10T10:37:30.136 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-10T10:37:30.136 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.136 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.136 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-10T10:37:30.136 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-10T10:37:30.137 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-10T10:37:30.138 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-10T10:37:30.138 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-10T10:37:30.138 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-10T10:37:30.138 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-10T10:37:30.138 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-2.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-10T10:37:30.139 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-10T10:37:30.140 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-10T10:37:30.140 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-10T10:37:30.140 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:30.141 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-08-10T10:37:30.375 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-10T10:37:30.375 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:37:30.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:30.706 DEBUG:teuthology.parallel:result is None 2023-08-10T10:37:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 1/177 2023-08-10T10:37:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 2/177 2023-08-10T10:37:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 3/177 2023-08-10T10:37:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 4/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 6/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 7/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 8/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 9/177 2023-08-10T10:37:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 10/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 11/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 12/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 13/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_ 14/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 15/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 16/177 2023-08-10T10:37:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_6 17/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86 18/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 19/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9. 21/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_6 22/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 23/177 2023-08-10T10:37:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 24/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 25/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 26/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 27/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 28/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/177 2023-08-10T10:37:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noa 30/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.n 31/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 34/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 36/177 2023-08-10T10:37:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 37/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 38/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-10T10:37:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-10T10:37:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-11.el9.x86_64 53/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-10T10:37:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-10T10:37:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-10T10:37:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-10T10:37:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/177 2023-08-10T10:37:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 85/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 86/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/177 2023-08-10T10:37:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 91/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-10T10:37:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-10T10:37:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-10T10:37:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-10T10:37:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-10T10:37:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-10T10:37:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-10T10:37:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-10T10:37:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-10T10:37:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-10T10:37:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-10T10:37:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-10T10:37:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-10T10:37:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-10T10:37:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-10T10:37:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-10T10:37:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-10T10:37:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-10T10:37:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-10T10:37:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-10T10:37:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-10T10:37:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-10T10:37:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-10T10:37:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-10T10:37:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-10T10:37:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-10T10:37:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-10T10:37:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-10T10:37:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-10T10:37:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-10T10:37:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 132/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 134/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-10T10:37:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.43.90-1.el9.x86_64 136/177 2023-08-10T10:37:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-10T10:37:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 138/177 2023-08-10T10:37:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-10T10:37:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.43.90-1.el9.x86_64 140/177 2023-08-10T10:37:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-10T10:37:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.43.90-1.el9.x86_64 142/177 2023-08-10T10:37:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-10T10:37:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-10T10:37:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-10T10:37:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-10T10:37:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-10T10:37:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-10T10:37:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-10T10:37:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-10T10:37:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-10T10:37:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-10T10:37:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-10T10:37:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.37.4-11.el9.x86_64 154/177 2023-08-10T10:37:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-10T10:37:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.37.4-11.el9.x86_64 156/177 2023-08-10T10:37:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-10T10:37:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.37.4-11.el9.x86_64 158/177 2023-08-10T10:37:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-10T10:37:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.37.4-11.el9.x86_64 160/177 2023-08-10T10:37:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-10T10:37:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.37.4-11.el9.x86_64 162/177 2023-08-10T10:37:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-10T10:37:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-10T10:37:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-10T10:37:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-10T10:37:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-10T10:37:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.37.4-11.el9.x86_64 168/177 2023-08-10T10:37:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-10T10:37:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-core-2.37.4-11.el9.x86_64 170/177 2023-08-10T10:37:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-10T10:37:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.37.4-11.el9.x86_64 172/177 2023-08-10T10:37:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-10T10:37:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-10T10:37:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-10T10:37:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-10T10:37:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-10T10:37:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.43.90-1.el9.x86_64 2023-08-10T10:37:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-10T10:37:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-10T10:37:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-10T10:37:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-10T10:37:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: libmount-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-core-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-10T10:37:37.603 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el9.noarch 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-10T10:37:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-10T10:37:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-10T10:37:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-15.el9.x86_64 2023-08-10T10:37:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-10T10:37:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-10T10:37:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-10T10:37:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-10T10:37:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-10T10:37:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-10T10:37:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-10T10:37:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-10T10:37:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-10T10:37:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-10T10:37:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-10T10:37:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-11.el9.x86_64 2023-08-10T10:37:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-10T10:37:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-10T10:37:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-10T10:37:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-10T10:37:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-10T10:37:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-10T10:37:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.11-1.el9.x86_64 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-10T10:37:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-10T10:37:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-10T10:37:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-10T10:37:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-10T10:37:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-10T10:37:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-10T10:37:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-10T10:37:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-10T10:37:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-10T10:37:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-10T10:37:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-2.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-10T10:37:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-10T10:37:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-10T10:37:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:37.627 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-08-10T10:37:38.252 DEBUG:teuthology.parallel:result is None 2023-08-10T10:37:38.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:37:38.395 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:37:38.461 INFO:teuthology.orchestra.run.smithi050.stdout:18.0.0-5118.ga8bf445f.el9 2023-08-10T10:37:38.461 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el9 2023-08-10T10:37:38.462 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:37:38.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:37:38.671 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:37:38.746 INFO:teuthology.orchestra.run.smithi117.stdout:18.0.0-5118.ga8bf445f.el9 2023-08-10T10:37:38.747 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el9 2023-08-10T10:37:38.747 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:37:38.748 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-10T10:37:38.749 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:38.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:37:38.831 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:38.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:37:38.940 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-10T10:37:38.941 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:38.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:37:39.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:37:39.135 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:39.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:37:39.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:37:39.335 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-10T10:37:39.336 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:39.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:37:39.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:37:39.549 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:39.549 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:37:39.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:37:39.793 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-10T10:37:39.793 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:39.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:37:39.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:37:39.991 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:39.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:37:40.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:37:40.191 INFO:teuthology.run_tasks:Running task ceph... 2023-08-10T10:37:40.266 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-10T10:37:40.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-08-10T10:37:40.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2023-08-10T10:37:40.375 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-10T10:37:40.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:37:40.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:37:40.472 INFO:tasks.ceph:Creating extra log directories... 2023-08-10T10:37:40.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:37:40.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:37:40.583 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-10T10:37:40.583 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-10T10:37:40.583 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-10T10:37:40.584 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:40.584 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:37:40.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:40.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:40.919 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:40.919 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:37:40.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:41.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:37:41.353 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-10T10:37:41.353 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-10T10:37:41.353 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529', 'branch': 'wip-rishabh-2023Aug1-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7364529', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Aug1-3'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Aug1-3', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Aug1-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjIamWIXq3UVt00gEPbsgSAOOwebaQ5RW4IEp7f0ABBaPCi+wUcI9GmgKhgtIlAX5oRI4bHIhQrD4zvEYfMY+M=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3vC83PZpFEB/j0ySbC9zOSLGsmnDV6i8+w1/TKbOc/I9Svzn2yEEfdeyuU9mVYlbjFcHoQ/865Lc+UemjGdhU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '7fda95956ac10132c9b74016ba832db907df09fa', 'timestamp': '2023-08-10_09:50:44', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-10T10:37:41.354 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:37:41.364 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:37:41.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:37:41.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:37:41.518 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:41.519 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:37:41.564 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:37:41.564 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-08-10T10:37:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:37:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 629 Links: 1 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-08-10 10:37:30.885434941 +0000 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-08-10 10:28:03.179821885 +0000 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-08-10 10:28:03.179821885 +0000 2023-08-10T10:37:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-08-10 10:28:03.179821885 +0000 2023-08-10T10:37:41.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:37:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-08-10T10:37:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-08-10T10:37:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00029029 s, 1.8 MB/s 2023-08-10T10:37:41.767 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:37:41.809 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-08-10T10:37:41.893 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:37:41.893 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:41.893 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 647 Links: 1 2023-08-10T10:37:41.893 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:41.893 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:41.894 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-08-10 10:37:30.886434916 +0000 2023-08-10T10:37:41.894 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-08-10 10:28:04.229795662 +0000 2023-08-10T10:37:41.894 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-08-10 10:28:04.229795662 +0000 2023-08-10T10:37:41.894 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-08-10 10:28:04.229795662 +0000 2023-08-10T10:37:41.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:37:42.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-08-10T10:37:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-08-10T10:37:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000309061 s, 1.7 MB/s 2023-08-10T10:37:42.011 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:37:42.054 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-08-10T10:37:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:37:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:42.140 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-08-10T10:37:42.140 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:42.140 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:42.141 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-08-10 10:37:30.886434916 +0000 2023-08-10T10:37:42.141 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-08-10 10:28:05.303768839 +0000 2023-08-10T10:37:42.141 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-08-10 10:28:05.303768839 +0000 2023-08-10T10:37:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-08-10 10:28:05.303768839 +0000 2023-08-10T10:37:42.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:37:42.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-08-10T10:37:42.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-08-10T10:37:42.267 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000190941 s, 2.7 MB/s 2023-08-10T10:37:42.269 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:37:42.314 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:42.398 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-08-10 10:37:30.887434891 +0000 2023-08-10T10:37:42.399 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-08-10 10:28:06.384741842 +0000 2023-08-10T10:37:42.399 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-08-10 10:28:06.384741842 +0000 2023-08-10T10:37:42.399 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-08-10 10:28:06.384741842 +0000 2023-08-10T10:37:42.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:37:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-08-10T10:37:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-08-10T10:37:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000207962 s, 2.5 MB/s 2023-08-10T10:37:42.516 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:37:42.559 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:42.559 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:42.559 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:37:42.621 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:37:42.621 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2023-08-10T10:37:42.675 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 624 Links: 1 2023-08-10T10:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-10 10:37:23.812245056 +0000 2023-08-10T10:37:42.677 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-10 10:27:29.729738838 +0000 2023-08-10T10:37:42.677 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-10 10:27:29.730738819 +0000 2023-08-10T10:37:42.677 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-10 10:27:29.729738838 +0000 2023-08-10T10:37:42.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:37:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-10T10:37:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-10T10:37:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000353429 s, 1.4 MB/s 2023-08-10T10:37:42.772 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:37:42.830 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2023-08-10T10:37:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:37:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:42.883 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 643 Links: 1 2023-08-10T10:37:42.884 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:42.884 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:42.884 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-10 10:37:23.813245036 +0000 2023-08-10T10:37:42.884 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-10 10:27:30.769718306 +0000 2023-08-10T10:37:42.884 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-10 10:27:30.769718306 +0000 2023-08-10T10:37:42.885 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-10 10:27:30.769718306 +0000 2023-08-10T10:37:42.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:37:42.972 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-10T10:37:42.972 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-10T10:37:42.972 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000475717 s, 1.1 MB/s 2023-08-10T10:37:42.975 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:37:43.031 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2023-08-10T10:37:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 660 Links: 1 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-10 10:37:23.813245036 +0000 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-10 10:27:31.805697853 +0000 2023-08-10T10:37:43.081 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-10 10:27:31.805697853 +0000 2023-08-10T10:37:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-10 10:27:31.805697853 +0000 2023-08-10T10:37:43.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:37:43.162 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-10T10:37:43.163 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-10T10:37:43.163 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000364917 s, 1.4 MB/s 2023-08-10T10:37:43.165 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:37:43.217 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2023-08-10T10:37:43.266 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:37:43.267 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:37:43.267 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 676 Links: 1 2023-08-10T10:37:43.267 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:37:43.267 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:37:43.267 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-10 10:37:23.814245016 +0000 2023-08-10T10:37:43.268 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-10 10:27:32.838677460 +0000 2023-08-10T10:37:43.268 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-10 10:27:32.838677460 +0000 2023-08-10T10:37:43.268 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-10 10:27:32.838677460 +0000 2023-08-10T10:37:43.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:37:43.358 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-10T10:37:43.359 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-10T10:37:43.359 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000366656 s, 1.4 MB/s 2023-08-10T10:37:43.362 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:37:43.422 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:43.422 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:37:43.422 INFO:tasks.ceph:Generating config... 2023-08-10T10:37:43.424 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-10T10:37:43.424 INFO:tasks.ceph:[client] debug client = 20 2023-08-10T10:37:43.424 INFO:tasks.ceph:[client] debug ms = 1 2023-08-10T10:37:43.424 INFO:tasks.ceph:[client] pid file = 2023-08-10T10:37:43.424 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-10T10:37:43.425 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-10T10:37:43.425 INFO:tasks.ceph:[client.0] debug client = 20 2023-08-10T10:37:43.425 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-08-10T10:37:43.425 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-08-10T10:37:43.425 INFO:tasks.ceph:[client.1] debug client = 20 2023-08-10T10:37:43.426 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-08-10T10:37:43.426 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-08-10T10:37:43.426 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-10T10:37:43.426 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-10T10:37:43.426 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-10T10:37:43.427 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-10T10:37:43.427 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-10T10:37:43.427 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-10T10:37:43.427 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-10T10:37:43.427 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-10T10:37:43.428 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-10T10:37:43.428 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-10T10:37:43.428 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-10T10:37:43.428 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-10T10:37:43.428 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-08-10T10:37:43.429 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-08-10T10:37:43.430 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-08-10T10:37:43.430 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-10T10:37:43.430 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-10T10:37:43.430 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-10T10:37:43.430 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-10T10:37:43.431 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-10T10:37:43.431 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-10T10:37:43.431 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-10T10:37:43.431 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-08-10T10:37:43.431 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-10T10:37:43.432 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-10T10:37:43.432 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-10T10:37:43.432 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-08-10T10:37:43.432 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-08-10T10:37:43.432 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-08-10T10:37:43.433 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-10T10:37:43.433 INFO:tasks.ceph:Setting up mon.a... 2023-08-10T10:37:43.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-10T10:37:43.576 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-08-10T10:37:43.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-10T10:37:43.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:37:43.823 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2023-08-10T10:37:43.824 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-10T10:37:43.825 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:43.825 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:37:43.881 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:43.994 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:43.994 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 6795d532-1ac6-4473-b42c-017ab0d4d08a 2023-08-10T10:37:43.994 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-08-10T10:37:43.994 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 6795d532-1ac6-4473-b42c-017ab0d4d08a 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-08-10T10:37:43.994503+0000 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-08-10T10:37:43.994503+0000 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-08-10T10:37:43.995 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2023-08-10T10:37:43.996 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2023-08-10T10:37:43.996 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-10T10:37:43.997 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:37:44.049 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6795d532-1ac6-4473-b42c-017ab0d4d08a... 2023-08-10T10:37:44.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:37:44.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:37:44.218 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-08-10T10:37:44.218 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-08-10T10:37:44.218 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:37:44.218 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-08-10T10:37:44.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.219 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-08-10T10:37:44.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.219 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-08-10T10:37:44.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.220 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.221 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:37:44.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.223 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:37:44.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.224 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-08-10T10:37:44.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-08-10T10:37:44.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 6795d532-1ac6-4473-b42c-017ab0d4d08a 2023-08-10T10:37:44.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:37:44.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-08-10T10:37:44.227 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-08-10T10:37:44.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.229 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-08-10T10:37:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: memstore device bytes = 200000000 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 1.0 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: osd mon report interval = 5 2023-08-10T10:37:44.231 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = memstore 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-08-10T10:37:44.232 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-08-10T10:37:44.233 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-08-10T10:37:44.234 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:37:44.235 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-08-10T10:37:44.235 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-08-10T10:37:44.235 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:37:44.235 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.235 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:37:44.236 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:37:44.236 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:37:44.236 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.236 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:37:44.237 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:37:44.237 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:37:44.237 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.237 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-08-10T10:37:44.238 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:37:44.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.238 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:37:44.238 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-08-10T10:37:44.239 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull ratio = 0.6 2023-08-10T10:37:44.239 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.7 2023-08-10T10:37:44.239 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.6 2023-08-10T10:37:44.239 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:37:44.240 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-08-10T10:37:44.240 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-08-10T10:37:44.240 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-08-10T10:37:44.240 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-08-10T10:37:44.241 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:37:44.241 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:37:44.241 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-08-10T10:37:44.241 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-08-10T10:37:44.241 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-08-10T10:37:44.242 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-08-10T10:37:44.242 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-08-10T10:37:44.242 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-08-10T10:37:44.242 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-08-10T10:37:44.242 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-08-10T10:37:44.243 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-08-10T10:37:44.243 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-08-10T10:37:44.243 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-08-10T10:37:44.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-08-10T10:37:44.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-08-10T10:37:44.244 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:37:44.244 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-08-10T10:37:44.245 INFO:teuthology.orchestra.run.smithi050.stdout: debug objectcacher = 20 2023-08-10T10:37:44.245 INFO:teuthology.orchestra.run.smithi050.stdout: debug objecter = 20 2023-08-10T10:37:44.245 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-08-10T10:37:44.246 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-08-10T10:37:44.246 INFO:teuthology.orchestra.run.smithi050.stdout: debug objectcacher = 20 2023-08-10T10:37:44.246 INFO:teuthology.orchestra.run.smithi050.stdout: debug objecter = 20 2023-08-10T10:37:44.247 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-08-10T10:37:44.247 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-08-10T10:37:44.247 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2023-08-10T10:37:44.248 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-08-10T10:37:44.248 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-08-10T10:37:44.249 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-08-10T10:37:44.249 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-08-10T10:37:44.249 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-08-10T10:37:44.249 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-08-10T10:37:44.249 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-08-10T10:37:44.250 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-08-10T10:37:44.250 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2023-08-10T10:37:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2023-08-10T10:37:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:37:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2023-08-10T10:37:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2023-08-10T10:37:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2023-08-10T10:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2023-08-10T10:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:37:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2023-08-10T10:37:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.50,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 6795d532-1ac6-4473-b42c-017ab0d4d08a 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2023-08-10T10:37:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:37:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2023-08-10T10:37:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-10T10:37:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: memstore device bytes = 200000000 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 1.0 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: osd mon report interval = 5 2023-08-10T10:37:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = memstore 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-08-10T10:37:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-08-10T10:37:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:37:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:37:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:37:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull ratio = 0.6 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.7 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.6 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2023-08-10T10:37:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2023-08-10T10:37:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-08-10T10:37:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug objectcacher = 20 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug objecter = 20 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug objectcacher = 20 2023-08-10T10:37:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: debug objecter = 20 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2023-08-10T10:37:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2023-08-10T10:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2023-08-10T10:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-08-10T10:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-08-10T10:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-08-10T10:37:44.288 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-10T10:37:44.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-10T10:37:44.447 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-10T10:37:44.447 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:44.448 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-10T10:37:44.497 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:44.497 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-10T10:37:44.596 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:37:44.596 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:44.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:37:44.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:37:44.754 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:44.754 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:44.856 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:37:44.857 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:44.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:37:44.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:37:45.017 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:45.017 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:45.116 INFO:tasks.ceph:Setting up mon nodes... 2023-08-10T10:37:45.117 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-10T10:37:45.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:37:45.326 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:37:45.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:37:45.555 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:37:45.566 INFO:tasks.ceph:Setting up mds nodes... 2023-08-10T10:37:45.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:37:45.778 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:37:45.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-10T10:37:45.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:37:46.098 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:37:46.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-10T10:37:46.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:37:46.398 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:37:46.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-10T10:37:46.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:37:46.677 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:37:46.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-10T10:37:46.783 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-10T10:37:46.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-10T10:37:46.930 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-10T10:37:46.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-10T10:37:47.134 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-10T10:37:47.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-10T10:37:47.329 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-10T10:37:47.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-10T10:37:47.515 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-10T10:37:47.582 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-10T10:37:47.583 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:37:47.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-10T10:37:47.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:47.696 INFO:tasks.ceph:role: osd.0 2023-08-10T10:37:47.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:37:47.697 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:37:47.797 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:47.799 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:47.833 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-08-10T10:37:47.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-08-10T10:37:47.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-10T10:37:47.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-10T10:37:48.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-10T10:37:48.139 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:48.140 INFO:tasks.ceph:role: osd.1 2023-08-10T10:37:48.140 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:37:48.141 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:37:48.230 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:48.230 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:48.231 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:48.231 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:48.232 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:48.232 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:48.232 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:48.264 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-08-10T10:37:48.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-08-10T10:37:48.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-10T10:37:48.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-10T10:37:48.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-10T10:37:48.553 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:48.553 INFO:tasks.ceph:role: osd.2 2023-08-10T10:37:48.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:37:48.554 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:37:48.653 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:48.688 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-08-10T10:37:48.693 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-08-10T10:37:48.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-10T10:37:48.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-10T10:37:48.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-10T10:37:48.980 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:48.980 INFO:tasks.ceph:role: osd.3 2023-08-10T10:37:48.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:37:48.981 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:37:49.077 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:49.077 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:49.078 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:49.079 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:49.079 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:49.079 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:49.079 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:49.111 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-08-10T10:37:49.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-08-10T10:37:49.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-10T10:37:49.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-10T10:37:49.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.476+0000 7f8feca10500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-10T10:37:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.477+0000 7f8feca10500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-10T10:37:49.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.480+0000 7f8feca10500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-08-10T10:37:49.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-10T10:37:49.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:49.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.754+0000 7f1ac6011500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-10T10:37:49.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.755+0000 7f1ac6011500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-10T10:37:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:49.757+0000 7f1ac6011500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-08-10T10:37:49.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-10T10:37:49.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:50.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.021+0000 7f9cf0a10500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-10T10:37:50.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.022+0000 7f9cf0a10500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-10T10:37:50.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.023+0000 7f9cf0a10500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-08-10T10:37:50.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-10T10:37:50.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:50.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.272+0000 7f5397e13500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-10T10:37:50.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.272+0000 7f5397e13500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-10T10:37:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:37:50.275+0000 7f5397e13500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-08-10T10:37:50.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-10T10:37:50.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-10T10:37:50.509 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:50.510 INFO:tasks.ceph:role: osd.4 2023-08-10T10:37:50.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:37:50.510 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:37:50.615 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:50.616 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:50.617 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:50.617 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:50.617 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:50.617 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:51.129 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-10T10:37:51.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-10T10:37:51.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-10T10:37:51.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-10T10:37:51.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-10T10:37:51.523 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:51.524 INFO:tasks.ceph:role: osd.5 2023-08-10T10:37:51.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:37:51.524 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:37:51.628 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:51.629 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:51.630 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:51.630 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:51.630 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:52.107 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-10T10:37:52.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-10T10:37:52.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-10T10:37:52.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-10T10:37:52.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-10T10:37:52.452 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:52.453 INFO:tasks.ceph:role: osd.6 2023-08-10T10:37:52.453 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:37:52.453 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:37:52.552 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:52.553 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:52.553 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:52.553 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:52.553 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:52.553 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:52.554 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:52.554 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:52.554 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:52.554 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:53.073 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-10T10:37:53.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-10T10:37:53.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-10T10:37:53.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-10T10:37:53.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-10T10:37:53.451 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:37:53.451 INFO:tasks.ceph:role: osd.7 2023-08-10T10:37:53.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:37:53.451 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:37:53.553 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:37:53.553 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:37:53.553 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:37:53.554 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-10T10:37:53.554 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:37:53.554 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:37:53.554 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:37:53.555 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-10T10:37:53.555 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:37:53.555 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:37:54.010 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-10T10:37:54.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-10T10:37:54.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-10T10:37:54.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-10T10:37:54.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:54.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.375+0000 7f97bf521500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-10T10:37:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.379+0000 7f97bf521500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-10T10:37:54.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.381+0000 7f97bf521500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-08-10T10:37:54.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-10T10:37:54.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.645+0000 7f0615514500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-10T10:37:54.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.649+0000 7f0615514500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-10T10:37:54.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.659+0000 7f0615514500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-08-10T10:37:54.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-10T10:37:54.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:54.928 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.927+0000 7f4876c0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-10T10:37:54.931 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.930+0000 7f4876c0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-10T10:37:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:54.941+0000 7f4876c0d500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-08-10T10:37:54.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-10T10:37:55.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:37:55.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:55.220+0000 7f468921b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-10T10:37:55.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:55.220+0000 7f468921b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-10T10:37:55.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:37:55.222+0000 7f468921b500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-08-10T10:37:55.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-10T10:37:55.332 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-10T10:37:55.332 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-10T10:37:55.444 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-10T10:37:55.546 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-10T10:37:55.650 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-10T10:37:55.758 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-10T10:37:55.867 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-10T10:37:55.971 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:55.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-10T10:37:56.078 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-10T10:37:56.186 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-10T10:37:56.285 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-10T10:37:56.428 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-10T10:37:56.517 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-10T10:37:56.655 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.656 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-10T10:37:56.753 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-10T10:37:56.857 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:56.857 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-10T10:37:56.921 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:37:56.922 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-10T10:37:56.983 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:56.984 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-10T10:37:57.043 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:37:57.044 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-10T10:37:57.096 INFO:tasks.ceph:Adding keys to all mons... 2023-08-10T10:37:57.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:37:57.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:37:57.202 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q== 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ== 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA== 2023-08-10T10:37:57.203 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg== 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg== 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA== 2023-08-10T10:37:57.204 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg== 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA== 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ== 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w== 2023-08-10T10:37:57.205 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA== 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ== 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q== 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA== 2023-08-10T10:37:57.206 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA== 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg== 2023-08-10T10:37:57.207 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2023-08-10T10:37:57.208 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg== 2023-08-10T10:37:57.209 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-08-10T10:37:57.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q== 2023-08-10T10:37:57.209 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-08-10T10:37:57.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ== 2023-08-10T10:37:57.209 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-08-10T10:37:57.210 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA== 2023-08-10T10:37:57.210 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-08-10T10:37:57.210 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg== 2023-08-10T10:37:57.210 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-08-10T10:37:57.210 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg== 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA== 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg== 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-08-10T10:37:57.211 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA== 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ== 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w== 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA== 2023-08-10T10:37:57.212 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ== 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q== 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA== 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:37:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-08-10T10:37:57.214 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA== 2023-08-10T10:37:57.214 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-08-10T10:37:57.214 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg== 2023-08-10T10:37:57.214 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-08-10T10:37:57.214 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg== 2023-08-10T10:37:57.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:37:57.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:37:57.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:57.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:57.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:57.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:57.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:57.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:57.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:57.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:57.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:37:58.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:37:58.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:58.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:58.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:58.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:37:58.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:58.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:59.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:59.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:59.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:59.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:37:59.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:37:59.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:38:00.043 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-10T10:38:00.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-10T10:38:00.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:38:00.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-10T10:38:00.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-10T10:38:00.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:38:00.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-10T10:38:00.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-10T10:38:00.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:38:00.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-10T10:38:01.074 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:38:01.083 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:38:01.141 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-10T10:38:01.141 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-10T10:38:01.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-10T10:38:01.147 INFO:tasks.ceph.mon.a:Started 2023-08-10T10:38:01.147 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-10T10:38:01.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-10T10:38:01.153 INFO:tasks.ceph.mon.b:Started 2023-08-10T10:38:01.153 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-10T10:38:01.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-10T10:38:01.159 INFO:tasks.ceph.mon.c:Started 2023-08-10T10:38:01.159 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-10T10:38:01.159 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-10T10:38:01.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-10T10:38:01.165 INFO:tasks.ceph.mgr.y:Started 2023-08-10T10:38:01.165 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-10T10:38:01.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-10T10:38:01.170 INFO:tasks.ceph.mgr.x:Started 2023-08-10T10:38:01.171 INFO:tasks.ceph:Setting crush tunables to default 2023-08-10T10:38:01.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-08-10T10:38:01.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.354+0000 7ffa8a2c5640 1 Processor -- start 2023-08-10T10:38:01.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.355+0000 7ffa8a2c5640 1 -- start start 2023-08-10T10:38:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.356+0000 7ffa8a2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.356+0000 7ffa8a2c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 0x7ffa840d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.356+0000 7ffa8a2c5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840d1220 con 0x7ffa840cd730 2023-08-10T10:38:01.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.356+0000 7ffa8a2c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa840d2930 con 0x7ffa840b5af0 2023-08-10T10:38:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.356+0000 7ffa8a2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b8a30 con 0x7ffa8415ce00 2023-08-10T10:38:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:51122/0 (socket says 172.21.15.50:51122) 2023-08-10T10:38:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 -- 172.21.15.50:0/287014059 learned_addr learned my addr 172.21.15.50:0/287014059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 msgr2=0x7ffa840d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-10T10:38:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 msgr2=0x7ffa840d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:38:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:38:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:38:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 0x7ffa840d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 msgr2=0x7ffa840d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-10T10:38:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 msgr2=0x7ffa840d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:38:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 0x7ffa840d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:38:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.357+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 0x7ffa840d16b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:38:01.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.370+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129228034 0 0) 0x7ffa840d1220 con 0x7ffa840cd730 2023-08-10T10:38:01.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.370+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70003520 con 0x7ffa840cd730 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013153611 0 0) 0x7ffa70003520 con 0x7ffa840cd730 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 msgr2=0x7ffa840d23f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa840d23f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 msgr2=0x7ffa840d16b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 --2- 172.21.15.50:0/287014059 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b5af0 0x7ffa840d16b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.372+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840b1e70 con 0x7ffa840cd730 2023-08-10T10:38:01.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ffa74001670 con 0x7ffa840cd730 2023-08-10T10:38:01.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 >> v1:172.21.15.117:6789/0 conn(0x7ffa840cd730 legacy=0x7ffa840cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:01.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa700047c0 0x7ffa70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b8a30 con 0x7ffa700047c0 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000ba30 con 0x7ffa70003970 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000bbc0 con 0x7ffa8415ce00 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa83fff640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.373+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa700047c0 0x7ffa70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70003970 msgr2=0x7ffa70003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:01.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa700047c0 msgr2=0x7ffa70004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:01.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa700047c0 0x7ffa70004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70003520 con 0x7ffa8415ce00 2023-08-10T10:38:01.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa700047c0 0x7ffa70004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:01.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.375+0000 7ffa88862640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa70005180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009610 tx=0x7ffa700057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a86694ff2bebdfc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:01.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.376+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c02cc80 con 0x7ffa8415ce00 2023-08-10T10:38:01.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.376+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c02cde0 con 0x7ffa8415ce00 2023-08-10T10:38:01.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.376+0000 7ffa837fe640 1 -- 172.21.15.50:0/287014059 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c034680 con 0x7ffa8415ce00 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.376+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 msgr2=0x7ffa70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.376+0000 7ffa8a2c5640 1 --2- 172.21.15.50:0/287014059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa70005180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009610 tx=0x7ffa700057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.377+0000 7ffa88862640 1 -- 172.21.15.50:0/287014059 reap_dead start 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.377+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/287014059 shutdown_connections 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.377+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/287014059 >> 172.21.15.50:0/287014059 conn(0x7ffa840d2c60 msgr2=0x7ffa840d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:01.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.377+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/287014059 shutdown_connections 2023-08-10T10:38:01.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.377+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/287014059 wait complete. 2023-08-10T10:38:01.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.379+0000 7ffa8a2c5640 1 Processor -- start 2023-08-10T10:38:01.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.379+0000 7ffa8a2c5640 1 -- start start 2023-08-10T10:38:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa84153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 0x7ffa8415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 0x7ffa841584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8415b530 con 0x7ffa84158040 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84158d90 con 0x7ffa8415ab70 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.380+0000 7ffa8a2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84159070 con 0x7ffa8415ce00 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa84153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa84153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:51142/0 (socket says 172.21.15.50:51142) 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa83fff640 1 -- 172.21.15.50:0/4276858305 learned_addr learned my addr 172.21.15.50:0/4276858305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:01.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 0x7ffa841584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 0x7ffa8415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 -- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 msgr2=0x7ffa84153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa84153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 -- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 msgr2=0x7ffa8415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 0x7ffa8415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa88862640 1 -- 172.21.15.50:0/4276858305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840c9c60 con 0x7ffa84158040 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.381+0000 7ffa7bfff640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 0x7ffa8415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.382+0000 7ffa88862640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 0x7ffa841584d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c033000 tx=0x7ffa7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.382+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c03e410 con 0x7ffa84158040 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.382+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c03e570 con 0x7ffa84158040 2023-08-10T10:38:01.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.382+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840c9f40 con 0x7ffa84158040 2023-08-10T10:38:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.382+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c03e900 con 0x7ffa84158040 2023-08-10T10:38:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.383+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84158a10 con 0x7ffa84158040 2023-08-10T10:38:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.383+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffa7c03b050 con 0x7ffa84158040 2023-08-10T10:38:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.383+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffa7c048cd0 con 0x7ffa84158040 2023-08-10T10:38:01.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.384+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840c9ac0 con 0x7ffa84158040 2023-08-10T10:38:01.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.387+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ffa840c9ac0 con 0x7ffa84158040 2023-08-10T10:38:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.460+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffa8404e270 con 0x7ffa84158040 2023-08-10T10:38:01.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.464+0000 7ffa817fa640 1 -- 172.21.15.50:0/4276858305 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffa7c04d060 con 0x7ffa84158040 2023-08-10T10:38:01.466 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-08-10T10:38:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 msgr2=0x7ffa841584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 0x7ffa841584d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c033000 tx=0x7ffa7c004ab0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 shutdown_connections 2023-08-10T10:38:01.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa84158040 0x7ffa841584d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8415ab70 0x7ffa8415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 --2- 172.21.15.50:0/4276858305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415ce00 0x7ffa84153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 >> 172.21.15.50:0/4276858305 conn(0x7ffa840d2c60 msgr2=0x7ffa840d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 shutdown_connections 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:01.466+0000 7ffa8a2c5640 1 -- 172.21.15.50:0/4276858305 wait complete. 2023-08-10T10:38:01.485 INFO:tasks.ceph:check_enable_crimson: False 2023-08-10T10:38:01.486 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-10T10:38:01.486 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:01.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-10T10:38:01.558 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:01.557+0000 7f5475249040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:38:01.571 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:01.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-10T10:38:01.713 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:01.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-10T10:38:01.729 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:01.728+0000 7fc7db437040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:38:01.806 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:01.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-10T10:38:01.901 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:01.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-10T10:38:02.000 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:02.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-10T10:38:02.089 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:02.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-10T10:38:02.219 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:02.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-10T10:38:02.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-08-10T10:38:02.527 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:02.525+0000 7f5475249040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:38:02.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.543+0000 7f037870c640 1 Processor -- start 2023-08-10T10:38:02.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.543+0000 7f037870c640 1 -- start start 2023-08-10T10:38:02.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f037870c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f037015cca0 0x7f03700ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f037870c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0370072730 0x7f0370072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f037870c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700cf3f0 con 0x7f037006dec0 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f037870c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037006e630 con 0x7f037015cca0 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f037870c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700cbf20 con 0x7f0370072730 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f0376ca9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0370072730 0x7f0370072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f0376ca9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0370072730 0x7f0370072ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53532/0 (socket says 172.21.15.117:53532) 2023-08-10T10:38:02.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f0376ca9640 1 -- 172.21.15.117:0/158151368 learned_addr learned my addr 172.21.15.117:0/158151368 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:02.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.545+0000 7f03764a8640 1 --2- 172.21.15.117:0/158151368 >> v2:172.21.15.50:3300/0 conn(0x7f037015cca0 0x7f03700ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.546+0000 7f0376ca9640 1 -- 172.21.15.117:0/158151368 >> v2:172.21.15.50:3300/0 conn(0x7f037015cca0 msgr2=0x7f03700ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.546+0000 7f0376ca9640 1 --2- 172.21.15.117:0/158151368 >> v2:172.21.15.50:3300/0 conn(0x7f037015cca0 0x7f03700ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.546+0000 7f0376ca9640 1 -- 172.21.15.117:0/158151368 >> v1:172.21.15.50:6789/0 conn(0x7f037006dec0 legacy=0x7f037006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.546+0000 7f0376ca9640 1 -- 172.21.15.117:0/158151368 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037006e350 con 0x7f0370072730 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.547+0000 7f0376ca9640 1 --2- 172.21.15.117:0/158151368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0370072730 0x7f0370072ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03700af270 tx=0x7f036802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba07ec25d43f2c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.547+0000 7f03754a6640 1 -- 172.21.15.117:0/158151368 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036802ca80 con 0x7f0370072730 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.547+0000 7f03754a6640 1 -- 172.21.15.117:0/158151368 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036802cbe0 con 0x7f0370072730 2023-08-10T10:38:02.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.547+0000 7f03754a6640 1 -- 172.21.15.117:0/158151368 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680343f0 con 0x7f0370072730 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 -- 172.21.15.117:0/158151368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0370072730 msgr2=0x7f0370072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 --2- 172.21.15.117:0/158151368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0370072730 0x7f0370072ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03700af270 tx=0x7f036802bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 -- 172.21.15.117:0/158151368 shutdown_connections 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 --2- 172.21.15.117:0/158151368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0370072730 0x7f0370072ba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 --2- 172.21.15.117:0/158151368 >> v2:172.21.15.50:3300/0 conn(0x7f037015cca0 0x7f03700ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 -- 172.21.15.117:0/158151368 >> 172.21.15.117:0/158151368 conn(0x7f03700d01b0 msgr2=0x7f03700cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 -- 172.21.15.117:0/158151368 shutdown_connections 2023-08-10T10:38:02.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.548+0000 7f037870c640 1 -- 172.21.15.117:0/158151368 wait complete. 2023-08-10T10:38:02.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.551+0000 7f037870c640 1 Processor -- start 2023-08-10T10:38:02.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.551+0000 7f037870c640 1 -- start start 2023-08-10T10:38:02.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 0x7f03700b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037014d1a0 con 0x7f0370072730 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370157540 con 0x7f03701577b0 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f037870c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0370157d50 con 0x7f037015cca0 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0376ca9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0375ca7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0376ca9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53544/0 (socket says 172.21.15.117:53544) 2023-08-10T10:38:02.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0375ca7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58436/0 (socket says 172.21.15.117:58436) 2023-08-10T10:38:02.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0376ca9640 1 -- 172.21.15.117:0/1851162321 learned_addr learned my addr 172.21.15.117:0/1851162321 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:02.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f03764a8640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 0x7f03700b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0376ca9640 1 -- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 msgr2=0x7f037014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.553+0000 7f0376ca9640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0376ca9640 1 -- 172.21.15.117:0/1851162321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 msgr2=0x7f03700b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0376ca9640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 0x7f03700b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0376ca9640 1 -- 172.21.15.117:0/1851162321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009b30 con 0x7f03701577b0 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0375ca7640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f03764a8640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 0x7f03700b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0376ca9640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0368036040 tx=0x7f0368004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368009510 con 0x7f03701577b0 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036803e450 con 0x7f03701577b0 2023-08-10T10:38:02.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036803e7e0 con 0x7f03701577b0 2023-08-10T10:38:02.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0370158030 con 0x7f03701577b0 2023-08-10T10:38:02.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.554+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03701585f0 con 0x7f03701577b0 2023-08-10T10:38:02.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.555+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f036802cd50 con 0x7f03701577b0 2023-08-10T10:38:02.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.555+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f03680488e0 con 0x7f03701577b0 2023-08-10T10:38:02.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.555+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370073060 con 0x7f03701577b0 2023-08-10T10:38:02.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.558+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0368043020 con 0x7f03701577b0 2023-08-10T10:38:02.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.636+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f037004e270 con 0x7f03701577b0 2023-08-10T10:38:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.643+0000 7f0366ffd640 1 -- 172.21.15.117:0/1851162321 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0368048400 con 0x7f03701577b0 2023-08-10T10:38:02.644 INFO:teuthology.orchestra.run.smithi117.stdout:0 2023-08-10T10:38:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 msgr2=0x7f0370158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0368036040 tx=0x7f0368004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 shutdown_connections 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701577b0 0x7f0370158df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037015cca0 0x7f037014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 --2- 172.21.15.117:0/1851162321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0370072730 0x7f03700b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 >> 172.21.15.117:0/1851162321 conn(0x7f03700d01b0 msgr2=0x7f03700ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 shutdown_connections 2023-08-10T10:38:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.644+0000 7f037870c640 1 -- 172.21.15.117:0/1851162321 wait complete. 2023-08-10T10:38:02.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-08-10T10:38:02.693 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:02.691+0000 7f5475249040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:38:02.718 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:02.717+0000 7fc7db437040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:38:02.753 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:02.751+0000 7f5475249040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:38:02.808 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:02.806+0000 7f5475249040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:38:02.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.844+0000 7f1265c67640 1 Processor -- start 2023-08-10T10:38:02.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.845+0000 7f1265c67640 1 -- start start 2023-08-10T10:38:02.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.846+0000 7f1265c67640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1260160130 0x7f12600cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.846+0000 7f1265c67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12600d0160 0x7f12600d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.846+0000 7f1265c67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600d2230 con 0x7f12600b1c70 2023-08-10T10:38:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.846+0000 7f1265c67640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600b5c60 con 0x7f1260160130 2023-08-10T10:38:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.846+0000 7f1265c67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600b2310 con 0x7f12600d0160 2023-08-10T10:38:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12600d0160 0x7f12600d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12600d0160 0x7f12600d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53550/0 (socket says 172.21.15.117:53550) 2023-08-10T10:38:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 -- 172.21.15.117:0/3915352251 learned_addr learned my addr 172.21.15.117:0/3915352251 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:02.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 -- 172.21.15.117:0/3915352251 >> v2:172.21.15.50:3300/0 conn(0x7f1260160130 msgr2=0x7f12600cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:02.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 --2- 172.21.15.117:0/3915352251 >> v2:172.21.15.50:3300/0 conn(0x7f1260160130 0x7f12600cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 -- 172.21.15.117:0/3915352251 >> v1:172.21.15.50:6789/0 conn(0x7f12600b1c70 legacy=0x7f12600cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:02.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.847+0000 7f125ffff640 1 -- 172.21.15.117:0/3915352251 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600ce1b0 con 0x7f12600d0160 2023-08-10T10:38:02.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.848+0000 7f125ffff640 1 --2- 172.21.15.117:0/3915352251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600d0160 0x7f12600d26c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12600b53b0 tx=0x7f125802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9344127ee726b850 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:02.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.848+0000 7f125effd640 1 -- 172.21.15.117:0/3915352251 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125802c9f0 con 0x7f12600d0160 2023-08-10T10:38:02.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.848+0000 7f125effd640 1 -- 172.21.15.117:0/3915352251 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125802cb50 con 0x7f12600d0160 2023-08-10T10:38:02.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.848+0000 7f125effd640 1 -- 172.21.15.117:0/3915352251 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580343f0 con 0x7f12600d0160 2023-08-10T10:38:02.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 -- 172.21.15.117:0/3915352251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600d0160 msgr2=0x7f12600d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 --2- 172.21.15.117:0/3915352251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600d0160 0x7f12600d26c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12600b53b0 tx=0x7f125802be50 comp rx=0 tx=0).stop 2023-08-10T10:38:02.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 -- 172.21.15.117:0/3915352251 shutdown_connections 2023-08-10T10:38:02.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 --2- 172.21.15.117:0/3915352251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600d0160 0x7f12600d26c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 --2- 172.21.15.117:0/3915352251 >> v2:172.21.15.50:3300/0 conn(0x7f1260160130 0x7f12600cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 -- 172.21.15.117:0/3915352251 >> 172.21.15.117:0/3915352251 conn(0x7f1260069ac0 msgr2=0x7f1260069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:02.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 -- 172.21.15.117:0/3915352251 shutdown_connections 2023-08-10T10:38:02.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.849+0000 7f1265c67640 1 -- 172.21.15.117:0/3915352251 wait complete. 2023-08-10T10:38:02.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.852+0000 7f1265c67640 1 Processor -- start 2023-08-10T10:38:02.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.852+0000 7f1265c67640 1 -- start start 2023-08-10T10:38:02.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 0x7f12600c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 0x7f12600c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c8dc0 con 0x7f1260160130 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600a9740 con 0x7f12600b1c70 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1265c67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c81b0 con 0x7f12600d0160 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1257fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 0x7f12600c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53558/0 (socket says 172.21.15.117:53558) 2023-08-10T10:38:02.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f1257fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 0x7f12600c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58452/0 (socket says 172.21.15.117:58452) 2023-08-10T10:38:02.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 -- 172.21.15.117:0/2269116575 learned_addr learned my addr 172.21.15.117:0/2269116575 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:02.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125ffff640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 0x7f12600c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:02.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 -- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 msgr2=0x7f12600c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 0x7f12600c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 -- 172.21.15.117:0/2269116575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 msgr2=0x7f12600c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 0x7f12600c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125f7fe640 1 -- 172.21.15.117:0/2269116575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1258009b30 con 0x7f12600b1c70 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.854+0000 7f125ffff640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 0x7f12600c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f125f7fe640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f125000b4a0 tx=0x7f125000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250010610 con 0x7f12600b1c70 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250010770 con 0x7f12600b1c70 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250010b20 con 0x7f12600b1c70 2023-08-10T10:38:02.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600c8490 con 0x7f12600b1c70 2023-08-10T10:38:02.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600c8a50 con 0x7f12600b1c70 2023-08-10T10:38:02.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.855+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1250019450 con 0x7f12600b1c70 2023-08-10T10:38:02.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.856+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1250019ab0 con 0x7f12600b1c70 2023-08-10T10:38:02.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.856+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1260066390 con 0x7f12600b1c70 2023-08-10T10:38:02.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.859+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f125001e060 con 0x7f12600b1c70 2023-08-10T10:38:02.883 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:02.882+0000 7fc7db437040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:38:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.937+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f12600d1e90 con 0x7f12600b1c70 2023-08-10T10:38:02.942 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:02.941+0000 7fc7db437040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:38:02.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.944+0000 7f125cff9640 1 -- 172.21.15.117:0/2269116575 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1250014070 con 0x7f12600b1c70 2023-08-10T10:38:02.945 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:38:02.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 msgr2=0x7f126014bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:02.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f125000b4a0 tx=0x7f125000b960 comp rx=0 tx=0).stop 2023-08-10T10:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 shutdown_connections 2023-08-10T10:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1260160130 0x7f12600c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12600d0160 0x7f12600c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 --2- 172.21.15.117:0/2269116575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12600b1c70 0x7f126014bc30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 >> 172.21.15.117:0/2269116575 conn(0x7f1260069ac0 msgr2=0x7f12600b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:02.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 shutdown_connections 2023-08-10T10:38:02.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:02.945+0000 7f1265c67640 1 -- 172.21.15.117:0/2269116575 wait complete. 2023-08-10T10:38:02.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-08-10T10:38:03.002 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:03.001+0000 7fc7db437040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:38:03.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.153+0000 7f95eb22d640 1 Processor -- start 2023-08-10T10:38:03.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.153+0000 7f95eb22d640 1 -- start start 2023-08-10T10:38:03.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40cd730 0x7f95e40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 0x7f95e40cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95e40b5af0 0x7f95e40d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40d2930 con 0x7f95e415ce00 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40d1220 con 0x7f95e40b5af0 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95eb22d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b8a30 con 0x7f95e40cd730 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95e97ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95e40b5af0 0x7f95e40d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95e97ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95e40b5af0 0x7f95e40d16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53562/0 (socket says 172.21.15.117:53562) 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95e97ca640 1 -- 172.21.15.117:0/2425518780 learned_addr learned my addr 172.21.15.117:0/2425518780 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.155+0000 7f95e8fc9640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40cd730 0x7f95e40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e3fff640 1 --2- 172.21.15.117:0/2425518780 >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 0x7f95e40cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e97ca640 1 -- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40cd730 msgr2=0x7f95e40d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e97ca640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40cd730 0x7f95e40d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e97ca640 1 -- 172.21.15.117:0/2425518780 >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 msgr2=0x7f95e40cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e97ca640 1 --2- 172.21.15.117:0/2425518780 >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 0x7f95e40cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e97ca640 1 -- 172.21.15.117:0/2425518780 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40b1e70 con 0x7f95e40b5af0 2023-08-10T10:38:03.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.156+0000 7f95e3fff640 1 --2- 172.21.15.117:0/2425518780 >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 0x7f95e40cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:03.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.157+0000 7f95e97ca640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40b5af0 0x7f95e40d16b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e40b5530 tx=0x7f95dc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48da7174d7357f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.157+0000 7f95e37fe640 1 -- 172.21.15.117:0/2425518780 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc02ca80 con 0x7f95e40b5af0 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.157+0000 7f95e37fe640 1 -- 172.21.15.117:0/2425518780 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc02cbe0 con 0x7f95e40b5af0 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.157+0000 7f95e37fe640 1 -- 172.21.15.117:0/2425518780 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0343f0 con 0x7f95e40b5af0 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 -- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40b5af0 msgr2=0x7f95e40d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40b5af0 0x7f95e40d16b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e40b5530 tx=0x7f95dc02bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 -- 172.21.15.117:0/2425518780 shutdown_connections 2023-08-10T10:38:03.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40b5af0 0x7f95e40d16b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 --2- 172.21.15.117:0/2425518780 >> v2:172.21.15.50:3300/0 conn(0x7f95e415ce00 0x7f95e40cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 --2- 172.21.15.117:0/2425518780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40cd730 0x7f95e40d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 -- 172.21.15.117:0/2425518780 >> 172.21.15.117:0/2425518780 conn(0x7f95e40d2c60 msgr2=0x7f95e40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 -- 172.21.15.117:0/2425518780 shutdown_connections 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.158+0000 7f95eb22d640 1 -- 172.21.15.117:0/2425518780 wait complete. 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.159+0000 7f95eb22d640 1 Processor -- start 2023-08-10T10:38:03.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.160+0000 7f95eb22d640 1 -- start start 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.160+0000 7f95eb22d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.160+0000 7f95eb22d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 0x7f95e41f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95eb22d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e415ce00 0x7f95e40c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95eb22d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e415dbf0 con 0x7f95e415ce00 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95eb22d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e415ded0 con 0x7f95e40cd730 2023-08-10T10:38:03.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95eb22d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e415e1b0 con 0x7f95e40b5af0 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 0x7f95e41f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58482/0 (socket says 172.21.15.117:58482) 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 -- 172.21.15.117:0/543729385 learned_addr learned my addr 172.21.15.117:0/543729385 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e97ca640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e415ce00 0x7f95e40c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 -- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 msgr2=0x7f95e41f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 0x7f95e41f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 -- 172.21.15.117:0/543729385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e415ce00 msgr2=0x7f95e40c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e415ce00 0x7f95e40c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 -- 172.21.15.117:0/543729385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009b30 con 0x7f95e40b5af0 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e3fff640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 0x7f95e41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.161+0000 7f95e8fc9640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95d800e890 tx=0x7f95d800ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800c940 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800caa0 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800ce30 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e415e490 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e40c87f0 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95d8005c90 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.162+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f95d8006440 con 0x7f95e40b5af0 2023-08-10T10:38:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.163+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e404e270 con 0x7f95e40b5af0 2023-08-10T10:38:03.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.166+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f95d8021060 con 0x7f95e40b5af0 2023-08-10T10:38:03.243 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.243+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f95e40b1c50 con 0x7f95e40b5af0 2023-08-10T10:38:03.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.250+0000 7f95e17fa640 1 -- 172.21.15.117:0/543729385 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95d8029020 con 0x7f95e40b5af0 2023-08-10T10:38:03.250 INFO:teuthology.orchestra.run.smithi117.stdout:2 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 msgr2=0x7f95e40c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95d800e890 tx=0x7f95d800ed50 comp rx=0 tx=0).stop 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 shutdown_connections 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e415ce00 0x7f95e40c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e40cd730 0x7f95e41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 --2- 172.21.15.117:0/543729385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95e40b5af0 0x7f95e40c8cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 >> 172.21.15.117:0/543729385 conn(0x7f95e40d2c60 msgr2=0x7f95e415bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 shutdown_connections 2023-08-10T10:38:03.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.251+0000 7f95eb22d640 1 -- 172.21.15.117:0/543729385 wait complete. 2023-08-10T10:38:03.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-08-10T10:38:03.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.498+0000 7fc4aad42640 1 Processor -- start 2023-08-10T10:38:03.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.498+0000 7fc4aad42640 1 -- start start 2023-08-10T10:38:03.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.499+0000 7fc4aad42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.499+0000 7fc4aad42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4a40cf430 0x7fc4a40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.499+0000 7fc4aad42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a4160be0 con 0x7fc4a415cdf0 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.499+0000 7fc4aad42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a4161780 con 0x7fc4a40cf430 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.499+0000 7fc4aad42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40cfe00 con 0x7fc4a40b1ab0 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4a953f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4a40cf430 0x7fc4a40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4a40cf430 0x7fc4a40cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53592/0 (socket says 172.21.15.117:53592) 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 -- 172.21.15.117:0/2481749970 learned_addr learned my addr 172.21.15.117:0/2481749970 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4a953f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58486/0 (socket says 172.21.15.117:58486) 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4a9d40640 1 --1- 172.21.15.117:0/2481749970 >> v1:172.21.15.117:6789/0 conn(0x7fc4a415cdf0 0x7fc4a4161070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52058/0 (socket says 172.21.15.117:52058) 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 -- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 msgr2=0x7fc4a40d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 -- 172.21.15.117:0/2481749970 >> v1:172.21.15.117:6789/0 conn(0x7fc4a415cdf0 legacy=0x7fc4a4161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4aa541640 1 -- 172.21.15.117:0/2481749970 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40b8280 con 0x7fc4a40cf430 2023-08-10T10:38:03.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.500+0000 7fc4a953f640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.501+0000 7fc4aa541640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a40cf8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009e80 tx=0x7fc49c02bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa380651df70857f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4a8d3e640 1 -- 172.21.15.117:0/2481749970 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c02cae0 con 0x7fc4a40cf430 2023-08-10T10:38:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4a8d3e640 1 -- 172.21.15.117:0/2481749970 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c02cc40 con 0x7fc4a40cf430 2023-08-10T10:38:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4a8d3e640 1 -- 172.21.15.117:0/2481749970 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0343f0 con 0x7fc4a40cf430 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 -- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 msgr2=0x7fc4a40cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a40cf8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009e80 tx=0x7fc49c02bf40 comp rx=0 tx=0).stop 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 -- 172.21.15.117:0/2481749970 shutdown_connections 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a40cf8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 --2- 172.21.15.117:0/2481749970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a40b1ab0 0x7fc4a40d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 -- 172.21.15.117:0/2481749970 >> 172.21.15.117:0/2481749970 conn(0x7fc4a40696a0 msgr2=0x7fc4a4069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 -- 172.21.15.117:0/2481749970 shutdown_connections 2023-08-10T10:38:03.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.502+0000 7fc4aad42640 1 -- 172.21.15.117:0/2481749970 wait complete. 2023-08-10T10:38:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.504+0000 7fc4aad42640 1 Processor -- start 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.504+0000 7fc4aad42640 1 -- start start 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 0x7fc4a414a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a414a830 con 0x7fc4a40b1ab0 2023-08-10T10:38:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a415d710 con 0x7fc4a40cf430 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aad42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40cac90 con 0x7fc4a415cdf0 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4a953f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aa541640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4a953f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53596/0 (socket says 172.21.15.117:53596) 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4aa541640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58494/0 (socket says 172.21.15.117:58494) 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.505+0000 7fc4a953f640 1 -- 172.21.15.117:0/1432248671 learned_addr learned my addr 172.21.15.117:0/1432248671 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a9d40640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 0x7fc4a414a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 -- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 msgr2=0x7fc4a40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 -- 172.21.15.117:0/1432248671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 msgr2=0x7fc4a414a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 0x7fc4a414a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 -- 172.21.15.117:0/1432248671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009400 con 0x7fc4a40cf430 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4aa541640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a9d40640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 0x7fc4a414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4a953f640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc49400e960 tx=0x7fc49400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400ca00 con 0x7fc4a40cf430 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400cb60 con 0x7fc4a40cf430 2023-08-10T10:38:03.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494013470 con 0x7fc4a40cf430 2023-08-10T10:38:03.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c009b30 con 0x7fc4a40cf430 2023-08-10T10:38:03.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a40cb250 con 0x7fc4a40cf430 2023-08-10T10:38:03.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.506+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc494005c90 con 0x7fc4a40cf430 2023-08-10T10:38:03.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.507+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc4940135d0 con 0x7fc4a40cf430 2023-08-10T10:38:03.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.507+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a40672e0 con 0x7fc4a40cf430 2023-08-10T10:38:03.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.510+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc494021060 con 0x7fc4a40cf430 2023-08-10T10:38:03.586 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.585+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fc4a40612b0 con 0x7fc4a40cf430 2023-08-10T10:38:03.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.593+0000 7fc49a7fc640 1 -- 172.21.15.117:0/1432248671 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc494029020 con 0x7fc4a40cf430 2023-08-10T10:38:03.594 INFO:teuthology.orchestra.run.smithi117.stdout:3 2023-08-10T10:38:03.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 msgr2=0x7fc4a415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc49400e960 tx=0x7fc49400ee20 comp rx=0 tx=0).stop 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 shutdown_connections 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a415cdf0 0x7fc4a40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a40cf430 0x7fc4a415d1d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 --2- 172.21.15.117:0/1432248671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a40b1ab0 0x7fc4a414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 >> 172.21.15.117:0/1432248671 conn(0x7fc4a40696a0 msgr2=0x7fc4a415c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 shutdown_connections 2023-08-10T10:38:03.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.595+0000 7fc4aad42640 1 -- 172.21.15.117:0/1432248671 wait complete. 2023-08-10T10:38:03.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-08-10T10:38:03.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.807+0000 7f0747142640 1 Processor -- start 2023-08-10T10:38:03.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.808+0000 7f0747142640 1 -- start start 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f0747142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07400b1ab0 0x7f07400d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f0747142640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07400cf430 0x7f07400cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f0747142640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0740160be0 con 0x7f074015cdf0 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f0747142640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0740161780 con 0x7f07400cf430 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f0747142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07400cfe00 con 0x7f07400b1ab0 2023-08-10T10:38:03.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f074593f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07400b1ab0 0x7f07400d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f074593f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07400b1ab0 0x7f07400d2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53612/0 (socket says 172.21.15.117:53612) 2023-08-10T10:38:03.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.809+0000 7f074593f640 1 -- 172.21.15.117:0/1203242924 learned_addr learned my addr 172.21.15.117:0/1203242924 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.811 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:03.809+0000 7f5475249040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:38:03.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.810+0000 7f0746941640 1 --2- 172.21.15.117:0/1203242924 >> v2:172.21.15.50:3300/0 conn(0x7f07400cf430 0x7f07400cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.810+0000 7f074593f640 1 -- 172.21.15.117:0/1203242924 >> v2:172.21.15.50:3300/0 conn(0x7f07400cf430 msgr2=0x7f07400cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:03.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.810+0000 7f074593f640 1 --2- 172.21.15.117:0/1203242924 >> v2:172.21.15.50:3300/0 conn(0x7f07400cf430 0x7f07400cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.810+0000 7f074593f640 1 -- 172.21.15.117:0/1203242924 >> v1:172.21.15.50:6789/0 conn(0x7f074015cdf0 legacy=0x7f0740161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.810+0000 7f074593f640 1 -- 172.21.15.117:0/1203242924 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07400b8280 con 0x7f07400b1ab0 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.811+0000 7f074593f640 1 --2- 172.21.15.117:0/1203242924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400b1ab0 0x7f07400d2210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0730009870 tx=0x7f073002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a480d4987a0a3383 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.811+0000 7f074513e640 1 -- 172.21.15.117:0/1203242924 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730031870 con 0x7f07400b1ab0 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.811+0000 7f074513e640 1 -- 172.21.15.117:0/1203242924 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07300319d0 con 0x7f07400b1ab0 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.811+0000 7f074513e640 1 -- 172.21.15.117:0/1203242924 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730031d60 con 0x7f07400b1ab0 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 -- 172.21.15.117:0/1203242924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400b1ab0 msgr2=0x7f07400d2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 --2- 172.21.15.117:0/1203242924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400b1ab0 0x7f07400d2210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0730009870 tx=0x7f073002b910 comp rx=0 tx=0).stop 2023-08-10T10:38:03.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 -- 172.21.15.117:0/1203242924 shutdown_connections 2023-08-10T10:38:03.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 --2- 172.21.15.117:0/1203242924 >> v2:172.21.15.50:3300/0 conn(0x7f07400cf430 0x7f07400cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 --2- 172.21.15.117:0/1203242924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400b1ab0 0x7f07400d2210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 -- 172.21.15.117:0/1203242924 >> 172.21.15.117:0/1203242924 conn(0x7f07400696a0 msgr2=0x7f0740069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 -- 172.21.15.117:0/1203242924 shutdown_connections 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.812+0000 7f0747142640 1 -- 172.21.15.117:0/1203242924 wait complete. 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.814+0000 7f0747142640 1 Processor -- start 2023-08-10T10:38:03.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.814+0000 7f0747142640 1 -- start start 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07400b1ab0 0x7f07401f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f074015cdf0 0x7f07401f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401f4150 con 0x7f07400b1ab0 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401f4430 con 0x7f07400cf430 2023-08-10T10:38:03.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0747142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07401f4710 con 0x7f074015cdf0 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f074593f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f074593f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53628/0 (socket says 172.21.15.117:53628) 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f074593f640 1 -- 172.21.15.117:0/1480559779 learned_addr learned my addr 172.21.15.117:0/1480559779 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0746941640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f074015cdf0 0x7f07401f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.815+0000 7f0746140640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07400b1ab0 0x7f07401f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 -- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f074015cdf0 msgr2=0x7f07401f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f074015cdf0 0x7f07401f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 -- 172.21.15.117:0/1480559779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07400b1ab0 msgr2=0x7f07401f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07400b1ab0 0x7f07401f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 -- 172.21.15.117:0/1480559779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300094d0 con 0x7f07400cf430 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f074593f640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0730009870 tx=0x7f07300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730031820 con 0x7f07400cf430 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07300443f0 con 0x7f07400cf430 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07401f49f0 con 0x7f07400cf430 2023-08-10T10:38:03.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.816+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07300447a0 con 0x7f07400cf430 2023-08-10T10:38:03.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.817+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07401f3e40 con 0x7f07400cf430 2023-08-10T10:38:03.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.817+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0730044c00 con 0x7f07400cf430 2023-08-10T10:38:03.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.817+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f073002d040 con 0x7f07400cf430 2023-08-10T10:38:03.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.818+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07400672e0 con 0x7f07400cf430 2023-08-10T10:38:03.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.820+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0730035020 con 0x7f07400cf430 2023-08-10T10:38:03.876 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:03.875+0000 7f5475249040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:38:03.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.897+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f07400b2160 con 0x7f07400cf430 2023-08-10T10:38:03.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.906+0000 7f0736ffd640 1 -- 172.21.15.117:0/1480559779 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f073004d450 con 0x7f07400cf430 2023-08-10T10:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout:4 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 msgr2=0x7f07400d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0730009870 tx=0x7f07300046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 shutdown_connections 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f074015cdf0 0x7f07401f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07400cf430 0x7f07400d0fe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 --2- 172.21.15.117:0/1480559779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07400b1ab0 0x7f07401f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:03.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 >> 172.21.15.117:0/1480559779 conn(0x7f07400696a0 msgr2=0x7f074015ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:03.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 shutdown_connections 2023-08-10T10:38:03.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:03.907+0000 7f0747142640 1 -- 172.21.15.117:0/1480559779 wait complete. 2023-08-10T10:38:03.911 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:03.911+0000 7fc7db437040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:38:03.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-08-10T10:38:03.934 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:03.932+0000 7f5475249040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:38:03.979 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:03.979+0000 7fc7db437040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:38:04.036 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.035+0000 7fc7db437040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:38:04.065 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:04.064+0000 7f5475249040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:38:04.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.111+0000 7f62f864d640 1 Processor -- start 2023-08-10T10:38:04.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.111+0000 7f62f864d640 1 -- start start 2023-08-10T10:38:04.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f864d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62f0160130 0x7f62f00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f864d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62f00d0160 0x7f62f00d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f864d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f00d2230 con 0x7f62f00b1c70 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f864d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f00b5c60 con 0x7f62f00d0160 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f864d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f00b2310 con 0x7f62f0160130 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f63e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62f0160130 0x7f62f00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f63e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62f0160130 0x7f62f00cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53632/0 (socket says 172.21.15.117:53632) 2023-08-10T10:38:04.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f63e9640 1 -- 172.21.15.117:0/1821412155 learned_addr learned my addr 172.21.15.117:0/1821412155 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:04.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f63e9640 1 -- 172.21.15.117:0/1821412155 >> v2:172.21.15.50:3300/0 conn(0x7f62f00d0160 msgr2=0x7f62f00d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.113+0000 7f62f63e9640 1 --2- 172.21.15.117:0/1821412155 >> v2:172.21.15.50:3300/0 conn(0x7f62f00d0160 0x7f62f00d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.114+0000 7f62f63e9640 1 -- 172.21.15.117:0/1821412155 >> v1:172.21.15.50:6789/0 conn(0x7f62f00b1c70 legacy=0x7f62f00cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.114+0000 7f62f63e9640 1 -- 172.21.15.117:0/1821412155 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00ce1b0 con 0x7f62f0160130 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f63e9640 1 --2- 172.21.15.117:0/1821412155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00cdb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62f006a640 tx=0x7f62ec02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a45b744a50146f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f53e7640 1 -- 172.21.15.117:0/1821412155 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0317e0 con 0x7f62f0160130 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f53e7640 1 -- 172.21.15.117:0/1821412155 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec031940 con 0x7f62f0160130 2023-08-10T10:38:04.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f53e7640 1 -- 172.21.15.117:0/1821412155 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec031cd0 con 0x7f62f0160130 2023-08-10T10:38:04.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f864d640 1 -- 172.21.15.117:0/1821412155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 msgr2=0x7f62f00cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.115+0000 7f62f864d640 1 --2- 172.21.15.117:0/1821412155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00cdb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62f006a640 tx=0x7f62ec02b880 comp rx=0 tx=0).stop 2023-08-10T10:38:04.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 -- 172.21.15.117:0/1821412155 shutdown_connections 2023-08-10T10:38:04.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 --2- 172.21.15.117:0/1821412155 >> v2:172.21.15.50:3300/0 conn(0x7f62f00d0160 0x7f62f00d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 --2- 172.21.15.117:0/1821412155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00cdb20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 -- 172.21.15.117:0/1821412155 >> 172.21.15.117:0/1821412155 conn(0x7f62f0069ac0 msgr2=0x7f62f0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 -- 172.21.15.117:0/1821412155 shutdown_connections 2023-08-10T10:38:04.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.116+0000 7f62f864d640 1 -- 172.21.15.117:0/1821412155 wait complete. 2023-08-10T10:38:04.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.117+0000 7f62f864d640 1 Processor -- start 2023-08-10T10:38:04.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.117+0000 7f62f864d640 1 -- start start 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f00d0160 0x7f62f01f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c90e0 con 0x7f62f00d0160 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01f5810 con 0x7f62f0160130 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.118+0000 7f62f864d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c6690 con 0x7f62f00b1c70 2023-08-10T10:38:04.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f63e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f63e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58502/0 (socket says 172.21.15.117:58502) 2023-08-10T10:38:04.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f63e9640 1 -- 172.21.15.117:0/3592034864 learned_addr learned my addr 172.21.15.117:0/3592034864 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:04.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f5be8640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f00d0160 0x7f62f01f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 -- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 msgr2=0x7f62f01f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 -- 172.21.15.117:0/3592034864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f00d0160 msgr2=0x7f62f01f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f00d0160 0x7f62f01f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 -- 172.21.15.117:0/3592034864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0094d0 con 0x7f62f0160130 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f63e9640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.119+0000 7f62f6bea640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00ca5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62e800bdf0 tx=0x7f62e800bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800cd70 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8014440 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8014830 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f00c6970 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f00c6f30 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62e8014c90 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.120+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f62e801de40 con 0x7f62f0160130 2023-08-10T10:38:04.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.121+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f004e270 con 0x7f62f0160130 2023-08-10T10:38:04.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.123+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f62e8023060 con 0x7f62f0160130 2023-08-10T10:38:04.168 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.167+0000 7fc7db437040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:38:04.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.201+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f62f00cd900 con 0x7f62f0160130 2023-08-10T10:38:04.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.208+0000 7f62e6ffd640 1 -- 172.21.15.117:0/3592034864 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62e8019070 con 0x7f62f0160130 2023-08-10T10:38:04.209 INFO:teuthology.orchestra.run.smithi117.stdout:5 2023-08-10T10:38:04.210 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 msgr2=0x7f62f00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.210 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00ca5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62e800bdf0 tx=0x7f62e800bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 shutdown_connections 2023-08-10T10:38:04.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62f0160130 0x7f62f00ca5a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f00d0160 0x7f62f01f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 --2- 172.21.15.117:0/3592034864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62f00b1c70 0x7f62f01f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 >> 172.21.15.117:0/3592034864 conn(0x7f62f0069ac0 msgr2=0x7f62f00d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 shutdown_connections 2023-08-10T10:38:04.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.210+0000 7f62f864d640 1 -- 172.21.15.117:0/3592034864 wait complete. 2023-08-10T10:38:04.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-08-10T10:38:04.231 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:04.230+0000 7f5475249040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:38:04.335 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.335+0000 7fc7db437040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:38:04.344 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:04.343+0000 7f5475249040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:38:04.398 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:04.397+0000 7f5475249040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:38:04.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.409+0000 7f54fa671640 1 Processor -- start 2023-08-10T10:38:04.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.410+0000 7f54fa671640 1 -- start start 2023-08-10T10:38:04.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.411+0000 7f54fa671640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f40caf40 0x7f54f4065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.411+0000 7f54fa671640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54f40b4940 0x7f54f40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.411+0000 7f54fa671640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f415edb0 con 0x7f54f415a9a0 2023-08-10T10:38:04.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.411+0000 7f54fa671640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f415f370 con 0x7f54f40b4940 2023-08-10T10:38:04.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.411+0000 7f54fa671640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415f090 con 0x7f54f40caf40 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54f40b4940 0x7f54f40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f8e6e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f40caf40 0x7f54f4065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54f40b4940 0x7f54f40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53638/0 (socket says 172.21.15.117:53638) 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 -- 172.21.15.117:0/2138575168 learned_addr learned my addr 172.21.15.117:0/2138575168 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 -- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f40caf40 msgr2=0x7f54f4065bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 --2- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f40caf40 0x7f54f4065bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 -- 172.21.15.117:0/2138575168 >> v1:172.21.15.50:6789/0 conn(0x7f54f415a9a0 legacy=0x7f54f40ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.412+0000 7f54f9e70640 1 -- 172.21.15.117:0/2138575168 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40c94d0 con 0x7f54f40b4940 2023-08-10T10:38:04.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.413+0000 7f54f9e70640 1 --2- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f40c9fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009e50 tx=0x7f54ec02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f6fb555e03c982 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.413+0000 7f54ebfff640 1 -- 172.21.15.117:0/2138575168 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec02c9e0 con 0x7f54f40b4940 2023-08-10T10:38:04.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.413+0000 7f54ebfff640 1 -- 172.21.15.117:0/2138575168 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec02cb40 con 0x7f54f40b4940 2023-08-10T10:38:04.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.413+0000 7f54ebfff640 1 -- 172.21.15.117:0/2138575168 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0343f0 con 0x7f54f40b4940 2023-08-10T10:38:04.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 -- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 msgr2=0x7f54f40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 --2- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f40c9fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009e50 tx=0x7f54ec02be40 comp rx=0 tx=0).stop 2023-08-10T10:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 -- 172.21.15.117:0/2138575168 shutdown_connections 2023-08-10T10:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 --2- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f40c9fb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 --2- 172.21.15.117:0/2138575168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f40caf40 0x7f54f4065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 -- 172.21.15.117:0/2138575168 >> 172.21.15.117:0/2138575168 conn(0x7f54f40cece0 msgr2=0x7f54f40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 -- 172.21.15.117:0/2138575168 shutdown_connections 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.414+0000 7f54fa671640 1 -- 172.21.15.117:0/2138575168 wait complete. 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.416+0000 7f54fa671640 1 Processor -- start 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.416+0000 7f54fa671640 1 -- start start 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f4136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f40caf40 0x7f54f41367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f414b3a0 con 0x7f54f40caf40 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f406c120 con 0x7f54f40b4940 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54fa671640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f406c400 con 0x7f54f415a9a0 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:58516/0 (socket says 172.21.15.117:58516) 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 -- 172.21.15.117:0/3314165928 learned_addr learned my addr 172.21.15.117:0/3314165928 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f966f640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f4136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f8e6e640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f40caf40 0x7f54f41367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 -- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 msgr2=0x7f54f4136270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f4136270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 -- 172.21.15.117:0/3314165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f40caf40 msgr2=0x7f54f41367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f40caf40 0x7f54f41367b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.417+0000 7f54f9e70640 1 -- 172.21.15.117:0/3314165928 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec009b30 con 0x7f54f415a9a0 2023-08-10T10:38:04.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54f9e70640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009e50 tx=0x7f54ec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec009510 con 0x7f54f415a9a0 2023-08-10T10:38:04.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec03e450 con 0x7f54f415a9a0 2023-08-10T10:38:04.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec03e800 con 0x7f54f415a9a0 2023-08-10T10:38:04.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f406c6e0 con 0x7f54f415a9a0 2023-08-10T10:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4142d80 con 0x7f54f415a9a0 2023-08-10T10:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.418+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54ec03ec60 con 0x7f54f415a9a0 2023-08-10T10:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.419+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f54ec048400 con 0x7f54f415a9a0 2023-08-10T10:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.419+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f406cba0 con 0x7f54f415a9a0 2023-08-10T10:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.422+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f54ec043020 con 0x7f54f415a9a0 2023-08-10T10:38:04.451 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.451+0000 7fc7db437040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:38:04.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.500+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f54f4142f10 con 0x7f54f415a9a0 2023-08-10T10:38:04.503 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.502+0000 7fc7db437040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:38:04.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.507+0000 7f54e9ffb640 1 -- 172.21.15.117:0/3314165928 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54ec048a40 con 0x7f54f415a9a0 2023-08-10T10:38:04.508 INFO:teuthology.orchestra.run.smithi117.stdout:6 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 msgr2=0x7f54f414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009e50 tx=0x7f54ec004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 shutdown_connections 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f415a9a0 0x7f54f414f280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f40caf40 0x7f54f41367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 --2- 172.21.15.117:0/3314165928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f40b4940 0x7f54f4136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 >> 172.21.15.117:0/3314165928 conn(0x7f54f40cece0 msgr2=0x7f54f414d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 shutdown_connections 2023-08-10T10:38:04.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.508+0000 7f54fa671640 1 -- 172.21.15.117:0/3314165928 wait complete. 2023-08-10T10:38:04.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-08-10T10:38:04.572 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:04.571+0000 7f5475249040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:38:04.680 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:04.679+0000 7fc7db437040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:38:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.721+0000 7f644ca6a640 1 Processor -- start 2023-08-10T10:38:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.721+0000 7f644ca6a640 1 -- start start 2023-08-10T10:38:04.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f644ca6a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64480cd730 0x7f64480d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f644ca6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480d1220 con 0x7f64480b5af0 2023-08-10T10:38:04.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f644ca6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480b8a30 con 0x7f644815ce00 2023-08-10T10:38:04.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f644ca6a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480d2930 con 0x7f64480cd730 2023-08-10T10:38:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f643dd9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f644815ce00 0x7f64480cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52064/0 (socket says 172.21.15.117:52064) 2023-08-10T10:38:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f643dd9b640 1 -- 172.21.15.117:0/3050089862 learned_addr learned my addr 172.21.15.117:0/3050089862 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f644659c640 1 --2- 172.21.15.117:0/3050089862 >> v2:172.21.15.50:3300/0 conn(0x7f64480cd730 0x7f64480d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.723+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843430317 0 0) 0x7f64480b8a30 con 0x7f644815ce00 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6434003520 con 0x7f644815ce00 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009682961 0 0) 0x7f6434003520 con 0x7f644815ce00 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 >> v2:172.21.15.50:3300/0 conn(0x7f64480cd730 msgr2=0x7f64480d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 --2- 172.21.15.117:0/3050089862 >> v2:172.21.15.50:3300/0 conn(0x7f64480cd730 0x7f64480d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 >> v1:172.21.15.50:6789/0 conn(0x7f64480b5af0 legacy=0x7f64480d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480b1e70 con 0x7f644815ce00 2023-08-10T10:38:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6430001670 con 0x7f644815ce00 2023-08-10T10:38:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 >> v1:172.21.15.117:6789/0 conn(0x7f644815ce00 legacy=0x7f64480cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6434003970 0x7f6434003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64340047c0 0x7f6434004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f643400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643400bff0 con 0x7f6434003970 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643400c160 con 0x7f6434005180 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643400c320 con 0x7f64340047c0 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f6446d9d640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f643400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.724+0000 7f643dd9b640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64340047c0 0x7f6434004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f644659c640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6434003970 0x7f6434003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f6446d9d640 1 -- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64340047c0 msgr2=0x7f6434004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f6446d9d640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64340047c0 0x7f6434004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f6446d9d640 1 -- 172.21.15.117:0/3050089862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6434003970 msgr2=0x7f6434003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f6446d9d640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6434003970 0x7f6434003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f6446d9d640 1 -- 172.21.15.117:0/3050089862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434003520 con 0x7f6434005180 2023-08-10T10:38:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.725+0000 7f644659c640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6434003970 0x7f6434003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.726+0000 7f6446d9d640 1 -- 172.21.15.117:0/3050089862 reap_dead start 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.726+0000 7f6446d9d640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f643400b980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6440001e50 tx=0x7f64340057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bec5f1e07013d8f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.726+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440003b70 con 0x7f6434005180 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.726+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440003d10 con 0x7f6434005180 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.726+0000 7f6445d9b640 1 -- 172.21.15.117:0/3050089862 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440005310 con 0x7f6434005180 2023-08-10T10:38:04.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 -- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 msgr2=0x7f643400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f643400b980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6440001e50 tx=0x7f64340057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 -- 172.21.15.117:0/3050089862 shutdown_connections 2023-08-10T10:38:04.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 --2- 172.21.15.117:0/3050089862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f643400b980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 -- 172.21.15.117:0/3050089862 >> 172.21.15.117:0/3050089862 conn(0x7f64480d2c60 msgr2=0x7f64480d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 -- 172.21.15.117:0/3050089862 shutdown_connections 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.727+0000 7f644ca6a640 1 -- 172.21.15.117:0/3050089862 wait complete. 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.729+0000 7f644ca6a640 1 Processor -- start 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.729+0000 7f644ca6a640 1 -- start start 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f644815a3a0 0x7f64481f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64480c8530 0x7f64480c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c6a30 con 0x7f64480c8530 2023-08-10T10:38:04.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c8f20 con 0x7f6434005180 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644ca6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644814d470 con 0x7f644815a3a0 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:53676/0 (socket says 172.21.15.117:53676) 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 -- 172.21.15.117:0/2886778975 learned_addr learned my addr 172.21.15.117:0/2886778975 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f643dd9b640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f644815a3a0 0x7f64481f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 -- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f644815a3a0 msgr2=0x7f64481f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f644815a3a0 0x7f64481f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 -- 172.21.15.117:0/2886778975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64480c8530 msgr2=0x7f64480c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f6446d9d640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64480c8530 0x7f64480c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64480c8530 0x7f64480c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.730+0000 7f644659c640 1 -- 172.21.15.117:0/2886778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64481f5fa0 con 0x7f6434005180 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f644659c640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f64380108e0 tx=0x7f6438010ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800eb60 con 0x7f6434005180 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800ecc0 con 0x7f6434005180 2023-08-10T10:38:04.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643801c400 con 0x7f6434005180 2023-08-10T10:38:04.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64481f59e0 con 0x7f6434005180 2023-08-10T10:38:04.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64480c6650 con 0x7f6434005180 2023-08-10T10:38:04.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6438005990 con 0x7f6434005180 2023-08-10T10:38:04.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.731+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6438006020 con 0x7f6434005180 2023-08-10T10:38:04.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.732+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644804e270 con 0x7f6434005180 2023-08-10T10:38:04.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.736+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f643803bb20 con 0x7f6434005180 2023-08-10T10:38:04.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.814+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f64480c9350 con 0x7f6434005180 2023-08-10T10:38:04.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.821+0000 7f643f7fe640 1 -- 172.21.15.117:0/2886778975 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f643802a030 con 0x7f6434005180 2023-08-10T10:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout:7 2023-08-10T10:38:04.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 msgr2=0x7f644814cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:04.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f64380108e0 tx=0x7f6438010ce0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 shutdown_connections 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64480c8530 0x7f64480c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f644815a3a0 0x7f64481f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 --2- 172.21.15.117:0/2886778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6434005180 0x7f644814cf30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 >> 172.21.15.117:0/2886778975 conn(0x7f64480d2c60 msgr2=0x7f64480b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 shutdown_connections 2023-08-10T10:38:04.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-10T10:38:04.823+0000 7f644ca6a640 1 -- 172.21.15.117:0/2886778975 wait complete. 2023-08-10T10:38:04.840 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-10T10:38:04.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-10T10:38:04.849 INFO:tasks.ceph.osd.0:Started 2023-08-10T10:38:04.850 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-10T10:38:04.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-10T10:38:04.858 INFO:tasks.ceph.osd.1:Started 2023-08-10T10:38:04.859 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-10T10:38:04.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-10T10:38:04.865 INFO:tasks.ceph.osd.2:Started 2023-08-10T10:38:04.865 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-10T10:38:04.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-10T10:38:04.872 INFO:tasks.ceph.osd.3:Started 2023-08-10T10:38:04.872 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-10T10:38:04.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-10T10:38:04.879 INFO:tasks.ceph.osd.4:Started 2023-08-10T10:38:04.879 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-10T10:38:04.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-10T10:38:04.887 INFO:tasks.ceph.osd.5:Started 2023-08-10T10:38:04.887 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-10T10:38:04.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-10T10:38:04.893 INFO:tasks.ceph.osd.6:Started 2023-08-10T10:38:04.893 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-10T10:38:04.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-10T10:38:04.900 INFO:tasks.ceph.osd.7:Started 2023-08-10T10:38:04.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:05.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-10T10:38:05.047+0000 7f61cfed0500 -1 Falling back to public interface 2023-08-10T10:38:05.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-10T10:38:05.059+0000 7f7235a11500 -1 Falling back to public interface 2023-08-10T10:38:05.061 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-08-10T10:38:05.059+0000 7f894ea18500 -1 Falling back to public interface 2023-08-10T10:38:05.064 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-08-10T10:38:05.063+0000 7f6f6060e500 -1 Falling back to public interface 2023-08-10T10:38:05.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-10T10:38:05.067+0000 7f61cfed0500 -1 osd.5 0 log_to_monitors true 2023-08-10T10:38:05.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-10T10:38:05.080+0000 7f7db5574500 -1 Falling back to public interface 2023-08-10T10:38:05.081 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-08-10T10:38:05.079+0000 7efd87e13500 -1 Falling back to public interface 2023-08-10T10:38:05.084 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-08-10T10:38:05.082+0000 7fbf60069500 -1 Falling back to public interface 2023-08-10T10:38:05.084 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-08-10T10:38:05.083+0000 7f894ea18500 -1 osd.2 0 log_to_monitors true 2023-08-10T10:38:05.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-10T10:38:05.086+0000 7f7235a11500 -1 osd.6 0 log_to_monitors true 2023-08-10T10:38:05.087 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-08-10T10:38:05.086+0000 7f6f6060e500 -1 osd.3 0 log_to_monitors true 2023-08-10T10:38:05.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-10T10:38:05.097+0000 7f73490da500 -1 Falling back to public interface 2023-08-10T10:38:05.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-10T10:38:05.109+0000 7f7db5574500 -1 osd.4 0 log_to_monitors true 2023-08-10T10:38:05.115 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-08-10T10:38:05.114+0000 7fbf60069500 -1 osd.0 0 log_to_monitors true 2023-08-10T10:38:05.117 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.115+0000 7f5475249040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:38:05.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-10T10:38:05.121+0000 7f73490da500 -1 osd.7 0 log_to_monitors true 2023-08-10T10:38:05.127 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-08-10T10:38:05.125+0000 7efd87e13500 -1 osd.1 0 log_to_monitors true 2023-08-10T10:38:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.147+0000 7fa7422ba640 1 Processor -- start 2023-08-10T10:38:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.147+0000 7fa7422ba640 1 -- start start 2023-08-10T10:38:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa7422ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa7422ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa73c0cdf80 0x7fa73c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa7422ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c161180 con 0x7fa73c0b8430 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa7422ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0b5bd0 con 0x7fa73c0cdf80 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa7422ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c161460 con 0x7fa73c15cd60 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa733fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa73c0b8430 0x7fa73c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55398/0 (socket says 172.21.15.50:55398) 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa733fff640 1 -- 172.21.15.50:0/1778050196 learned_addr learned my addr 172.21.15.50:0/1778050196 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1778050196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:05.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.149+0000 7fa740857640 1 --2- 172.21.15.50:0/1778050196 >> v2:172.21.15.50:3300/0 conn(0x7fa73c0cdf80 0x7fa73c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:05.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.150+0000 7fa73bfff640 1 -- 172.21.15.50:0/1778050196 >> v2:172.21.15.50:3300/0 conn(0x7fa73c0cdf80 msgr2=0x7fa73c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.150+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1778050196 >> v2:172.21.15.50:3300/0 conn(0x7fa73c0cdf80 0x7fa73c0d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.150+0000 7fa73bfff640 1 -- 172.21.15.50:0/1778050196 >> v1:172.21.15.50:6789/0 conn(0x7fa73c0b8430 legacy=0x7fa73c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.150+0000 7fa73bfff640 1 -- 172.21.15.50:0/1778050196 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c161740 con 0x7fa73c15cd60 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.150+0000 7fa73b7fe640 1 -- 172.21.15.50:0/1778050196 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825533988 0 0) 0x7fa73c161180 con 0x7fa73c0b8430 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.151+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1778050196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c160930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097a0 tx=0x7fa72c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf62d5bb85f41fea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.151+0000 7fa73b7fe640 1 -- 172.21.15.50:0/1778050196 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c030800 con 0x7fa73c15cd60 2023-08-10T10:38:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.151+0000 7fa73b7fe640 1 -- 172.21.15.50:0/1778050196 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c030960 con 0x7fa73c15cd60 2023-08-10T10:38:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.151+0000 7fa73b7fe640 1 -- 172.21.15.50:0/1778050196 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c030cf0 con 0x7fa73c15cd60 2023-08-10T10:38:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 -- 172.21.15.50:0/1778050196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 msgr2=0x7fa73c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1778050196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c160930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097a0 tx=0x7fa72c02b940 comp rx=0 tx=0).stop 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 -- 172.21.15.50:0/1778050196 shutdown_connections 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1778050196 >> v2:172.21.15.50:3300/0 conn(0x7fa73c0cdf80 0x7fa73c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1778050196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c160930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 -- 172.21.15.50:0/1778050196 >> 172.21.15.50:0/1778050196 conn(0x7fa73c0d2ac0 msgr2=0x7fa73c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 -- 172.21.15.50:0/1778050196 shutdown_connections 2023-08-10T10:38:05.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.152+0000 7fa7422ba640 1 -- 172.21.15.50:0/1778050196 wait complete. 2023-08-10T10:38:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.154+0000 7fa7422ba640 1 Processor -- start 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.154+0000 7fa7422ba640 1 -- start start 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa73c0cdf80 0x7fa73c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c93d0 con 0x7fa73c0b8430 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14a280 con 0x7fa73c0cdf80 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa7422ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14a560 con 0x7fa73c15cd60 2023-08-10T10:38:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57460/0 (socket says 172.21.15.50:57460) 2023-08-10T10:38:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa73bfff640 1 -- 172.21.15.50:0/1393818828 learned_addr learned my addr 172.21.15.50:0/1393818828 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa733fff640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa73c0cdf80 0x7fa73c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.155+0000 7fa740857640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 -- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 msgr2=0x7fa73c1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 -- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa73c0cdf80 msgr2=0x7fa73c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa73c0cdf80 0x7fa73c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 -- 172.21.15.50:0/1393818828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009400 con 0x7fa73c0b8430 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa73bfff640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02bf50 tx=0x7fa72c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c03e070 con 0x7fa73c0b8430 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c039a10 con 0x7fa73c0b8430 2023-08-10T10:38:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.156+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c039da0 con 0x7fa73c0b8430 2023-08-10T10:38:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.157+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c14a840 con 0x7fa73c0b8430 2023-08-10T10:38:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.157+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c1f5da0 con 0x7fa73c0b8430 2023-08-10T10:38:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.157+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa72c04b400 con 0x7fa73c0b8430 2023-08-10T10:38:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.157+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa72c04bd80 con 0x7fa73c0b8430 2023-08-10T10:38:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.158+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c04e270 con 0x7fa73c0b8430 2023-08-10T10:38:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.161+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fa72c034070 con 0x7fa73c0b8430 2023-08-10T10:38:05.209 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.209+0000 7fc7db437040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:38:05.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.225+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73c0d3340 con 0x7fa73c0b8430 2023-08-10T10:38:05.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.226+0000 7fa7397fa640 1 -- 172.21.15.50:0/1393818828 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa72c04b710 con 0x7fa73c0b8430 2023-08-10T10:38:05.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:05.228 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:04.816895+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 msgr2=0x7fa73c149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02bf50 tx=0x7fa72c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 shutdown_connections 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa73c15cd60 0x7fa73c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa73c0cdf80 0x7fa73c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 --2- 172.21.15.50:0/1393818828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa73c0b8430 0x7fa73c149c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 >> 172.21.15.50:0/1393818828 conn(0x7fa73c0d2ac0 msgr2=0x7fa73c160690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 shutdown_connections 2023-08-10T10:38:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:05.228+0000 7fa7422ba640 1 -- 172.21.15.50:0/1393818828 wait complete. 2023-08-10T10:38:05.247 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-10T10:38:05.248 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-10T10:38:05.348 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.347+0000 7f5475249040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:38:05.413 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.412+0000 7f5475249040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:38:05.424 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.424+0000 7fc7db437040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:38:05.469 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.467+0000 7f5475249040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:38:05.484 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.484+0000 7fc7db437040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:38:05.532 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.530+0000 7f5475249040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:38:05.537 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.536+0000 7fc7db437040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:38:05.597 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.596+0000 7fc7db437040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:38:05.811 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.811+0000 7f5475249040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:38:05.858 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.858+0000 7fc7db437040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:38:05.877 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.876+0000 7f5475249040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:38:05.917 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.917+0000 7fc7db437040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:38:05.942 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:05.942+0000 7f5475249040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:38:05.984 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:05.983+0000 7fc7db437040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:38:06.053 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:06.112 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:06.111+0000 7f5475249040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:38:06.144 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:06.143+0000 7fc7db437040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:38:06.165 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:06.165+0000 7f5475249040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:38:06.193 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:06.192+0000 7fc7db437040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:38:06.229 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.228+0000 7f600be48640 1 Processor -- start 2023-08-10T10:38:06.229 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.228+0000 7f600be48640 1 -- start start 2023-08-10T10:38:06.230 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:06.229+0000 7f5475249040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:38:06.234 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f600be48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f6004160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.234 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f600be48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6004161180 con 0x7f60040b8430 2023-08-10T10:38:06.235 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f600be48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6004161460 con 0x7f60040cdf80 2023-08-10T10:38:06.235 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f600be48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040b5bd0 con 0x7f600415cd60 2023-08-10T10:38:06.235 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f60093e3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60040b8430 0x7f60040cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55406/0 (socket says 172.21.15.50:55406) 2023-08-10T10:38:06.236 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f60093e3640 1 -- 172.21.15.50:0/226441469 learned_addr learned my addr 172.21.15.50:0/226441469 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:06.236 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.230+0000 7f6009be4640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f6004160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.236 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23073956 0 0) 0x7f6004161180 con 0x7f60040b8430 2023-08-10T10:38:06.236 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff0003520 con 0x7f60040b8430 2023-08-10T10:38:06.236 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902657140 0 0) 0x7f5ff0003520 con 0x7f60040b8430 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 msgr2=0x7f6004160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f6004160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 >> v1:172.21.15.117:6789/0 conn(0x7f60040cdf80 legacy=0x7f60040d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004161740 con 0x7f60040b8430 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5ff4001670 con 0x7f60040b8430 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 >> v1:172.21.15.50:6789/0 conn(0x7f60040b8430 legacy=0x7f60040cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.237 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f5ff0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f5ff00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff0004d00 0x7f5ff0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040b5bd0 con 0x7f5ff00039a0 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff000b980 con 0x7f5ff0004d00 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.231+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff000bb40 con 0x7f600415cd60 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f5ff0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.238 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f60093e3640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f5ff00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 -- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 msgr2=0x7f5ff00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f600415cd60 0x7f5ff00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 -- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff0004d00 msgr2=0x7f5ff0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f600a3e5640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff0004d00 0x7f5ff0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff0004d00 0x7f5ff0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f6009be4640 1 -- 172.21.15.50:0/226441469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0003520 con 0x7f5ff00039a0 2023-08-10T10:38:06.239 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.232+0000 7f600a3e5640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff0004d00 0x7f5ff0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:06.240 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.233+0000 7f6009be4640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f5ff0003d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6000009ac0 tx=0x7f5ff00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9730c6f9a9edd8e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:06.240 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.233+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600002c600 con 0x7f5ff00039a0 2023-08-10T10:38:06.240 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600002c760 con 0x7f5ff00039a0 2023-08-10T10:38:06.240 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f6008be2640 1 -- 172.21.15.50:0/226441469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600002caf0 con 0x7f5ff00039a0 2023-08-10T10:38:06.243 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 -- 172.21.15.50:0/226441469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 msgr2=0x7f5ff0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.244 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 --2- 172.21.15.50:0/226441469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f5ff0003d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6000009ac0 tx=0x7f5ff00057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.244 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600a3e5640 1 -- 172.21.15.50:0/226441469 reap_dead start 2023-08-10T10:38:06.244 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 -- 172.21.15.50:0/226441469 shutdown_connections 2023-08-10T10:38:06.244 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 -- 172.21.15.50:0/226441469 >> 172.21.15.50:0/226441469 conn(0x7f60040d2ac0 msgr2=0x7f60040d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:06.245 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 -- 172.21.15.50:0/226441469 shutdown_connections 2023-08-10T10:38:06.245 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.234+0000 7f600be48640 1 -- 172.21.15.50:0/226441469 wait complete. 2023-08-10T10:38:06.245 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.236+0000 7f600be48640 1 Processor -- start 2023-08-10T10:38:06.246 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.236+0000 7f600be48640 1 -- start start 2023-08-10T10:38:06.246 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.246 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60040cadc0 0x7f60040cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.246 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60040cb240 0x7f60040cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:06.247 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040a9760 con 0x7f5ff00039a0 2023-08-10T10:38:06.247 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040cb790 con 0x7f60040cadc0 2023-08-10T10:38:06.247 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.237+0000 7f600be48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040cba70 con 0x7f60040cb240 2023-08-10T10:38:06.248 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.248 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57478/0 (socket says 172.21.15.50:57478) 2023-08-10T10:38:06.248 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 -- 172.21.15.50:0/3502225833 learned_addr learned my addr 172.21.15.50:0/3502225833 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:06.248 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f60093e3640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60040cadc0 0x7f60040cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.249 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f600a3e5640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60040cb240 0x7f60040cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:06.249 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 -- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60040cb240 msgr2=0x7f60040cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.249 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60040cb240 0x7f60040cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.250 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 -- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60040cadc0 msgr2=0x7f60040cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.250 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60040cadc0 0x7f60040cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.250 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.238+0000 7f6009be4640 1 -- 172.21.15.50:0/3502225833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040cbd50 con 0x7f5ff00039a0 2023-08-10T10:38:06.250 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f6009be4640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f600002c1a0 tx=0x7f6000004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:06.250 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000003810 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000003970 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000003ce0 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60040cc030 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60040cc5f0 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6000047750 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.239+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f6000034c50 con 0x7f5ff00039a0 2023-08-10T10:38:06.251 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.240+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60040cc780 con 0x7f5ff00039a0 2023-08-10T10:38:06.252 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.243+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f600004c060 con 0x7f5ff00039a0 2023-08-10T10:38:06.253 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:06.252+0000 7fc7db437040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:38:06.287 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:06.287+0000 7f5475249040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:38:06.300 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.299+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 2) v1 ==== 44470+0+0 (secure 0 0 0) 0x7f6000047a00 con 0x7f5ff00039a0 2023-08-10T10:38:06.307 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-10T10:38:06.307+0000 7fc7db437040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:38:06.319 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.319+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f600404e270 con 0x7f5ff00039a0 2023-08-10T10:38:06.320 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.319+0000 7f5ffa7fc640 1 -- 172.21.15.50:0/3502225833 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6000039030 con 0x7f5ff00039a0 2023-08-10T10:38:06.320 INFO:teuthology.misc.health.smithi050.stdout: 2023-08-10T10:38:06.321 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":11,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:05.819370+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:06.321 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.320+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 msgr2=0x7f60040aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.320+0000 7f600be48640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f600002c1a0 tx=0x7f6000004730 comp rx=0 tx=0).stop 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 shutdown_connections 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60040cb240 0x7f60040cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60040cadc0 0x7f60040cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 --2- 172.21.15.50:0/3502225833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ff00039a0 0x7f60040aa4e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:06.322 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 >> 172.21.15.50:0/3502225833 conn(0x7f60040d2ac0 msgr2=0x7f60040b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:06.323 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 shutdown_connections 2023-08-10T10:38:06.323 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:06.321+0000 7f600be48640 1 -- 172.21.15.50:0/3502225833 wait complete. 2023-08-10T10:38:06.336 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-10T10:38:06.867 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-08-10T10:38:06.867+0000 7efd837a0640 -1 osd.1 0 waiting for initial osdmap 2023-08-10T10:38:06.871 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-08-10T10:38:06.871+0000 7efd7cdd5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.873 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-08-10T10:38:06.873+0000 7fbf5c80b640 -1 osd.0 0 waiting for initial osdmap 2023-08-10T10:38:06.878 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-08-10T10:38:06.878+0000 7fbf5562a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-10T10:38:06.882+0000 7f7db1502640 -1 osd.4 0 waiting for initial osdmap 2023-08-10T10:38:06.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-10T10:38:06.882+0000 7f61cbe5c640 -1 osd.5 0 waiting for initial osdmap 2023-08-10T10:38:06.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-10T10:38:06.883+0000 7f72312da640 -1 osd.6 0 waiting for initial osdmap 2023-08-10T10:38:06.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-10T10:38:06.883+0000 7f7345066640 -1 osd.7 0 waiting for initial osdmap 2023-08-10T10:38:06.885 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-08-10T10:38:06.885+0000 7f6f5be97640 -1 osd.3 0 waiting for initial osdmap 2023-08-10T10:38:06.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-10T10:38:06.885+0000 7f61c5491640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.887 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-08-10T10:38:06.886+0000 7f894a403640 -1 osd.2 0 waiting for initial osdmap 2023-08-10T10:38:06.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-10T10:38:06.887+0000 7f722a90f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-10T10:38:06.888+0000 7f7daab37640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-10T10:38:06.888+0000 7f733e69b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.890 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-08-10T10:38:06.889+0000 7f6f554cc640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:06.890 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-08-10T10:38:06.889+0000 7f8943a38640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:38:07.350 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:07.350+0000 7f54167cf640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-10T10:38:07.351 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-08-10T10:38:07.351+0000 7f54167cf640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-10T10:38:11.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:11.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:13.144 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:13.342 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.342+0000 7efd5d355640 1 Processor -- start 2023-08-10T10:38:13.342 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.342+0000 7efd5d355640 1 -- start start 2023-08-10T10:38:13.344 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd5d355640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd5815cee0 0x7efd580d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.344 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd5d355640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd580b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.344 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd5d355640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580ce590 con 0x7efd580ce0e0 2023-08-10T10:38:13.345 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd5d355640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580d1420 con 0x7efd5815cee0 2023-08-10T10:38:13.345 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd5d355640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580d1630 con 0x7efd580cfc60 2023-08-10T10:38:13.345 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.343+0000 7efd56ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd5815cee0 0x7efd580d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.346 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd5815cee0 0x7efd580d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57576/0 (socket says 172.21.15.50:57576) 2023-08-10T10:38:13.346 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 -- 172.21.15.50:0/1313818263 learned_addr learned my addr 172.21.15.50:0/1313818263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:13.348 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd577fe640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd580b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.348 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 -- 172.21.15.50:0/1313818263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 msgr2=0x7efd580b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:13.349 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd580b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.349 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 -- 172.21.15.50:0/1313818263 >> v1:172.21.15.50:6789/0 conn(0x7efd580ce0e0 legacy=0x7efd580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.349 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.344+0000 7efd56ffd640 1 -- 172.21.15.50:0/1313818263 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580d1910 con 0x7efd5815cee0 2023-08-10T10:38:13.350 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.345+0000 7efd56ffd640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd580d0ee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd48009870 tx=0x7efd4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994780e465a29852 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.350 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.346+0000 7efd567fc640 1 -- 172.21.15.50:0/1313818263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48030840 con 0x7efd5815cee0 2023-08-10T10:38:13.350 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.346+0000 7efd567fc640 1 -- 172.21.15.50:0/1313818263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480309a0 con 0x7efd5815cee0 2023-08-10T10:38:13.350 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.346+0000 7efd567fc640 1 -- 172.21.15.50:0/1313818263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48030d30 con 0x7efd5815cee0 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.346+0000 7efd5d355640 1 -- 172.21.15.50:0/1313818263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 msgr2=0x7efd580d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.346+0000 7efd5d355640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd580d0ee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd48009870 tx=0x7efd4802b980 comp rx=0 tx=0).stop 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 -- 172.21.15.50:0/1313818263 shutdown_connections 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd580b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 --2- 172.21.15.50:0/1313818263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd580d0ee0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 -- 172.21.15.50:0/1313818263 >> 172.21.15.50:0/1313818263 conn(0x7efd5806fcc0 msgr2=0x7efd580700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:13.351 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 -- 172.21.15.50:0/1313818263 shutdown_connections 2023-08-10T10:38:13.352 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.347+0000 7efd5d355640 1 -- 172.21.15.50:0/1313818263 wait complete. 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.348+0000 7efd5d355640 1 Processor -- start 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.349+0000 7efd5d355640 1 -- start start 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.349+0000 7efd5d355640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 0x7efd581f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd5d355640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd5815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd5d355640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.354 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd5d355640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581f3400 con 0x7efd5815cee0 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd5d355640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c9cb0 con 0x7efd580ce0e0 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd5d355640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c9f90 con 0x7efd580cfc60 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57592/0 (socket says 172.21.15.50:57592) 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 -- 172.21.15.50:0/2880547363 learned_addr learned my addr 172.21.15.50:0/2880547363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd4e7fc640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd5815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.355 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd56ffd640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 0x7efd581f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 -- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 msgr2=0x7efd5815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd5815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 -- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 msgr2=0x7efd581f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 0x7efd581f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd577fe640 1 -- 172.21.15.50:0/2880547363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480094d0 con 0x7efd5815cee0 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.350+0000 7efd56ffd640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 0x7efd581f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:13.356 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd577fe640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd5000cd60 tx=0x7efd5000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50003b90 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50003d10 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50004260 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd580ca270 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.351+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580ca830 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.352+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd580caa50 con 0x7efd5815cee0 2023-08-10T10:38:13.357 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.353+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd500043c0 con 0x7efd5815cee0 2023-08-10T10:38:13.358 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.354+0000 7efd4ffff640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 0x7efd3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.358 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.354+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd50012070 con 0x7efd5815cee0 2023-08-10T10:38:13.358 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.355+0000 7efd56ffd640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 0x7efd3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.359 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.355+0000 7efd56ffd640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 0x7efd3806d110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd48036000 tx=0x7efd4803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.360 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.359+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd50054f40 con 0x7efd5815cee0 2023-08-10T10:38:13.551 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.550+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5804e270 con 0x7efd5815cee0 2023-08-10T10:38:13.553 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.552+0000 7efd4ffff640 1 -- 172.21.15.50:0/2880547363 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7efd50058560 con 0x7efd5815cee0 2023-08-10T10:38:13.553 INFO:teuthology.misc.health.smithi050.stdout: 2023-08-10T10:38:13.554 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":16,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:10.903217+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:13.556 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.554+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 msgr2=0x7efd3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.556 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.554+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 0x7efd3806d110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd48036000 tx=0x7efd4803b040 comp rx=0 tx=0).stop 2023-08-10T10:38:13.556 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 msgr2=0x7efd581f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd5000cd60 tx=0x7efd5000a660 comp rx=0 tx=0).stop 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 shutdown_connections 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd5815cee0 0x7efd581f3630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd580cfc60 0x7efd5815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd3806ac50 0x7efd3806d110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 --2- 172.21.15.50:0/2880547363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd580ce0e0 0x7efd581f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.557 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 >> 172.21.15.50:0/2880547363 conn(0x7efd5806fcc0 msgr2=0x7efd580c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:13.558 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 shutdown_connections 2023-08-10T10:38:13.558 INFO:teuthology.misc.health.smithi050.stderr:2023-08-10T10:38:13.555+0000 7efd5d355640 1 -- 172.21.15.50:0/2880547363 wait complete. 2023-08-10T10:38:13.574 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-10T10:38:13.575 INFO:tasks.ceph:Creating RBD pool 2023-08-10T10:38:13.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-10T10:38:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.792+0000 7fe09f3a2640 1 Processor -- start 2023-08-10T10:38:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.792+0000 7fe09f3a2640 1 -- start start 2023-08-10T10:38:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.793+0000 7fe09f3a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe09815fde0 0x7fe09806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.793+0000 7fe09f3a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0980cd660 0x7fe0980d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.793+0000 7fe09f3a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09806a5c0 con 0x7fe0980b1e00 2023-08-10T10:38:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.793+0000 7fe09f3a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09806b0c0 con 0x7fe0980cd660 2023-08-10T10:38:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.793+0000 7fe09f3a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09806a820 con 0x7fe09815fde0 2023-08-10T10:38:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0980cd660 0x7fe0980d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0980cd660 0x7fe0980d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57606/0 (socket says 172.21.15.50:57606) 2023-08-10T10:38:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 -- 172.21.15.50:0/659286665 learned_addr learned my addr 172.21.15.50:0/659286665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09e3a0640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe09815fde0 0x7fe09806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 -- 172.21.15.50:0/659286665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe09815fde0 msgr2=0x7fe09806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe09815fde0 0x7fe09806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 -- 172.21.15.50:0/659286665 >> v1:172.21.15.117:6789/0 conn(0x7fe0980b1e00 legacy=0x7fe0980ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.794+0000 7fe09eba1640 1 -- 172.21.15.50:0/659286665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09806ab00 con 0x7fe0980cd660 2023-08-10T10:38:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.795+0000 7fe09eba1640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980cd660 0x7fe0980d0b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0980c9950 tx=0x7fe09002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b43bc63eafcf4b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.796+0000 7fe09d39e640 1 -- 172.21.15.50:0/659286665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09002c910 con 0x7fe0980cd660 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.796+0000 7fe09d39e640 1 -- 172.21.15.50:0/659286665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09002ca70 con 0x7fe0980cd660 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.796+0000 7fe09d39e640 1 -- 172.21.15.50:0/659286665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09002ce00 con 0x7fe0980cd660 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.796+0000 7fe09f3a2640 1 -- 172.21.15.50:0/659286665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980cd660 msgr2=0x7fe0980d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.796+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980cd660 0x7fe0980d0b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0980c9950 tx=0x7fe09002bd70 comp rx=0 tx=0).stop 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 -- 172.21.15.50:0/659286665 shutdown_connections 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980cd660 0x7fe0980d0b20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/659286665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe09815fde0 0x7fe09806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 -- 172.21.15.50:0/659286665 >> 172.21.15.50:0/659286665 conn(0x7fe0980d2900 msgr2=0x7fe0980d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 -- 172.21.15.50:0/659286665 shutdown_connections 2023-08-10T10:38:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.797+0000 7fe09f3a2640 1 -- 172.21.15.50:0/659286665 wait complete. 2023-08-10T10:38:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.799+0000 7fe09f3a2640 1 Processor -- start 2023-08-10T10:38:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.799+0000 7fe09f3a2640 1 -- start start 2023-08-10T10:38:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0980cd660 0x7fe0980b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe09815fde0 0x7fe0980b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098145630 con 0x7fe0980b1e00 2023-08-10T10:38:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098159880 con 0x7fe09815fde0 2023-08-10T10:38:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09f3a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980b6a80 con 0x7fe0980cd660 2023-08-10T10:38:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09e3a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09e3a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57608/0 (socket says 172.21.15.50:57608) 2023-08-10T10:38:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.800+0000 7fe09e3a0640 1 -- 172.21.15.50:0/2100515724 learned_addr learned my addr 172.21.15.50:0/2100515724 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09eba1640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe09815fde0 0x7fe0980b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09db9f640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0980cd660 0x7fe0980b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 -- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0980cd660 msgr2=0x7fe0980b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0980cd660 0x7fe0980b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 -- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe09815fde0 msgr2=0x7fe0980b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe09815fde0 0x7fe0980b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 -- 172.21.15.50:0/2100515724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009b30 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09e3a0640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d800 tx=0x7fe09400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400b6c0 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400b820 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400bbb0 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.801+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe098144f70 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.802+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0981e90b0 con 0x7fe0980b1e00 2023-08-10T10:38:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.803+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098066e30 con 0x7fe0980b1e00 2023-08-10T10:38:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.803+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe09400bd10 con 0x7fe0980b1e00 2023-08-10T10:38:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.804+0000 7fe08effd640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 0x7fe07c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.805+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe094089560 con 0x7fe0980b1e00 2023-08-10T10:38:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.805+0000 7fe09db9f640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 0x7fe07c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.805+0000 7fe09db9f640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 0x7fe07c06d140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe088006fd0 tx=0x7fe088008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.809+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe094054ab0 con 0x7fe0980b1e00 2023-08-10T10:38:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:13.998+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe0980b1be0 con 0x7fe0980b1e00 2023-08-10T10:38:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.109+0000 7fe08effd640 1 -- 172.21.15.50:0/2100515724 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe0940580d0 con 0x7fe0980b1e00 2023-08-10T10:38:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2023-08-10T10:38:14.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 msgr2=0x7fe07c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 0x7fe07c06d140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe088006fd0 tx=0x7fe088008040 comp rx=0 tx=0).stop 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 msgr2=0x7fe0981e8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d800 tx=0x7fe09400dcc0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 shutdown_connections 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe07c06ac80 0x7fe07c06d140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe09815fde0 0x7fe0980b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0980cd660 0x7fe0980b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 --2- 172.21.15.50:0/2100515724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0980b1e00 0x7fe0981e8b70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 >> 172.21.15.50:0/2100515724 conn(0x7fe0980d2900 msgr2=0x7fe0980b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 shutdown_connections 2023-08-10T10:38:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.114+0000 7fe09f3a2640 1 -- 172.21.15.50:0/2100515724 wait complete. 2023-08-10T10:38:14.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-10T10:38:14.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.358+0000 7fc1feab8640 1 Processor -- start 2023-08-10T10:38:14.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.359+0000 7fc1feab8640 1 -- start start 2023-08-10T10:38:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.360+0000 7fc1feab8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.360+0000 7fc1feab8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.360+0000 7fc1feab8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80d20d0 con 0x7fc1f815cbe0 2023-08-10T10:38:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.360+0000 7fc1feab8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f80d12d0 con 0x7fc1f80b8760 2023-08-10T10:38:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.360+0000 7fc1feab8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f815cfc0 con 0x7fc1f80d2560 2023-08-10T10:38:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.361+0000 7fc1fd055640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.361+0000 7fc1f7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.361+0000 7fc1fd055640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:43896/0 (socket says 172.21.15.50:43896) 2023-08-10T10:38:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.361+0000 7fc1fd055640 1 -- 172.21.15.50:0/879902541 learned_addr learned my addr 172.21.15.50:0/879902541 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.362+0000 7fc1f7fff640 1 -- 172.21.15.50:0/879902541 >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 msgr2=0x7fc1f80b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.362+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/879902541 >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.362+0000 7fc1f7fff640 1 -- 172.21.15.50:0/879902541 >> v1:172.21.15.117:6789/0 conn(0x7fc1f815cbe0 legacy=0x7fc1f80d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.362+0000 7fc1f7fff640 1 -- 172.21.15.50:0/879902541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80b6af0 con 0x7fc1f80d2560 2023-08-10T10:38:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.362+0000 7fc1fd055640 1 --2- 172.21.15.50:0/879902541 >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.363+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/879902541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f80b4500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80097a0 tx=0x7fc1e802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3b904be411683d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.363+0000 7fc1f77fe640 1 -- 172.21.15.50:0/879902541 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8030800 con 0x7fc1f80d2560 2023-08-10T10:38:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1f77fe640 1 -- 172.21.15.50:0/879902541 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8030960 con 0x7fc1f80d2560 2023-08-10T10:38:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1f77fe640 1 -- 172.21.15.50:0/879902541 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8030cf0 con 0x7fc1f80d2560 2023-08-10T10:38:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 -- 172.21.15.50:0/879902541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 msgr2=0x7fc1f80b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 --2- 172.21.15.50:0/879902541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f80b4500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80097a0 tx=0x7fc1e802b940 comp rx=0 tx=0).stop 2023-08-10T10:38:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 -- 172.21.15.50:0/879902541 shutdown_connections 2023-08-10T10:38:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 --2- 172.21.15.50:0/879902541 >> v2:172.21.15.117:3300/0 conn(0x7fc1f80b8760 0x7fc1f80b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 --2- 172.21.15.50:0/879902541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f80b4500 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.364+0000 7fc1feab8640 1 -- 172.21.15.50:0/879902541 >> 172.21.15.50:0/879902541 conn(0x7fc1f80702f0 msgr2=0x7fc1f80d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.365+0000 7fc1feab8640 1 -- 172.21.15.50:0/879902541 shutdown_connections 2023-08-10T10:38:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.365+0000 7fc1feab8640 1 -- 172.21.15.50:0/879902541 wait complete. 2023-08-10T10:38:14.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.367+0000 7fc1feab8640 1 Processor -- start 2023-08-10T10:38:14.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.367+0000 7fc1feab8640 1 -- start start 2023-08-10T10:38:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f8158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f815cbe0 0x7fc1f80c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80ca4a0 con 0x7fc1f80b8760 2023-08-10T10:38:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80ca780 con 0x7fc1f815cbe0 2023-08-10T10:38:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.368+0000 7fc1feab8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80caa60 con 0x7fc1f80d2560 2023-08-10T10:38:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57612/0 (socket says 172.21.15.50:57612) 2023-08-10T10:38:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 -- 172.21.15.50:0/637119268 learned_addr learned my addr 172.21.15.50:0/637119268 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f8158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fd055640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f815cbe0 0x7fc1f80c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 -- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 msgr2=0x7fc1f8158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f8158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 -- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f815cbe0 msgr2=0x7fc1f80c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f815cbe0 0x7fc1f80c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1fc854640 1 -- 172.21.15.50:0/637119268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009b30 con 0x7fc1f80b8760 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.369+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f8158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1fc854640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c400 tx=0x7fc1ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0052d0 con 0x7fc1f80b8760 2023-08-10T10:38:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec005430 con 0x7fc1f80b8760 2023-08-10T10:38:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec003830 con 0x7fc1f80b8760 2023-08-10T10:38:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e8009400 con 0x7fc1f80b8760 2023-08-10T10:38:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.370+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f80cb020 con 0x7fc1f80b8760 2023-08-10T10:38:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.371+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f804e270 con 0x7fc1f80b8760 2023-08-10T10:38:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.372+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1ec003990 con 0x7fc1f80b8760 2023-08-10T10:38:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.373+0000 7fc1f57fa640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 0x7fc1e406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.373+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fc1ec088790 con 0x7fc1f80b8760 2023-08-10T10:38:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.374+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 0x7fc1e406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.374+0000 7fc1f7fff640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 0x7fc1e406d160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8036000 tx=0x7fc1e8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.378+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc1ec053b80 con 0x7fc1f80b8760 2023-08-10T10:38:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:14.577+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1f8159c40 con 0x7fc1f80b8760 2023-08-10T10:38:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.114+0000 7fc1f57fa640 1 -- 172.21.15.50:0/637119268 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc1ec0571a0 con 0x7fc1f80b8760 2023-08-10T10:38:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-10T10:38:15.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.119+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 msgr2=0x7fc1e406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.119+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 0x7fc1e406d160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8036000 tx=0x7fc1e8008030 comp rx=0 tx=0).stop 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.119+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 msgr2=0x7fc1f80cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.119+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c400 tx=0x7fc1ec00c8c0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 shutdown_connections 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc1e406aca0 0x7fc1e406d160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f815cbe0 0x7fc1f80c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1f80d2560 0x7fc1f8158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 --2- 172.21.15.50:0/637119268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f80b8760 0x7fc1f80cb540 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 >> 172.21.15.50:0/637119268 conn(0x7fc1f80702f0 msgr2=0x7fc1f815ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:15.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 shutdown_connections 2023-08-10T10:38:15.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.120+0000 7fc1feab8640 1 -- 172.21.15.50:0/637119268 wait complete. 2023-08-10T10:38:15.143 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-10T10:38:15.144 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:38:15.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:38:15.149 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:38:15.150 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:38:15.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:38:15.158 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:38:15.158 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:38:15.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:38:15.168 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:38:15.169 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:38:15.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:38:15.177 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:38:15.178 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-10T10:38:15.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:15.317 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:38:15.322 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:38:15.340 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:38:15.341 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:38:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.372+0000 7f5feeda6640 1 Processor -- start 2023-08-10T10:38:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.372+0000 7f5feeda6640 1 -- start start 2023-08-10T10:38:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5feeda6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fe8159970 0x7f5fe80b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5feeda6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fe8069db0 0x7f5fe80b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5feeda6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe815e1f0 con 0x7f5fe80b0f00 2023-08-10T10:38:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5feeda6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe815d5e0 con 0x7f5fe8159970 2023-08-10T10:38:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5feeda6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe815d8c0 con 0x7f5fe8069db0 2023-08-10T10:38:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.373+0000 7f5fecb42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fe8159970 0x7f5fe80b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fe8159970 0x7f5fe80b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55754/0 (socket says 172.21.15.50:55754) 2023-08-10T10:38:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 -- 172.21.15.50:0/1994591172 learned_addr learned my addr 172.21.15.50:0/1994591172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fed343640 1 --2- 172.21.15.50:0/1994591172 >> v2:172.21.15.117:3300/0 conn(0x7f5fe8069db0 0x7f5fe80b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 -- 172.21.15.50:0/1994591172 >> v2:172.21.15.117:3300/0 conn(0x7f5fe8069db0 msgr2=0x7f5fe80b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1994591172 >> v2:172.21.15.117:3300/0 conn(0x7f5fe8069db0 0x7f5fe80b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 -- 172.21.15.50:0/1994591172 >> v1:172.21.15.50:6789/0 conn(0x7f5fe80b0f00 legacy=0x7f5fe80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.374+0000 7f5fecb42640 1 -- 172.21.15.50:0/1994591172 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe815dba0 con 0x7f5fe8159970 2023-08-10T10:38:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.375+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1994591172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe80b09c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80c5710 tx=0x7f5fdc02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9249bff806c4594 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.375+0000 7f5fe77fe640 1 -- 172.21.15.50:0/1994591172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc030870 con 0x7f5fe8159970 2023-08-10T10:38:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.375+0000 7f5fe77fe640 1 -- 172.21.15.50:0/1994591172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc0309d0 con 0x7f5fe8159970 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.375+0000 7f5fe77fe640 1 -- 172.21.15.50:0/1994591172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc030d60 con 0x7f5fe8159970 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 -- 172.21.15.50:0/1994591172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 msgr2=0x7f5fe80b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1994591172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe80b09c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80c5710 tx=0x7f5fdc02b9b0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 -- 172.21.15.50:0/1994591172 shutdown_connections 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1994591172 >> v2:172.21.15.117:3300/0 conn(0x7f5fe8069db0 0x7f5fe80b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1994591172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe80b09c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 -- 172.21.15.50:0/1994591172 >> 172.21.15.50:0/1994591172 conn(0x7f5fe806b590 msgr2=0x7f5fe80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 -- 172.21.15.50:0/1994591172 shutdown_connections 2023-08-10T10:38:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.376+0000 7f5feeda6640 1 -- 172.21.15.50:0/1994591172 wait complete. 2023-08-10T10:38:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.378+0000 7f5feeda6640 1 Processor -- start 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.378+0000 7f5feeda6640 1 -- start start 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 0x7f5fe8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 0x7f5fe8154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8159f40 con 0x7f5fe8159970 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe815cea0 con 0x7f5fe8069db0 2023-08-10T10:38:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5feeda6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80b0470 con 0x7f5fe80b0f00 2023-08-10T10:38:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5fed343640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5fed343640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55770/0 (socket says 172.21.15.50:55770) 2023-08-10T10:38:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.379+0000 7f5fed343640 1 -- 172.21.15.50:0/1315765910 learned_addr learned my addr 172.21.15.50:0/1315765910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 0x7f5fe8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fe7fff640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 0x7f5fe8154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 -- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 msgr2=0x7f5fe8154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 0x7f5fe8154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 -- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 msgr2=0x7f5fe8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 0x7f5fe8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 -- 172.21.15.50:0/1315765910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0094d0 con 0x7f5fe8159970 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 0x7f5fe8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fe7fff640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 0x7f5fe8154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fed343640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007e60 tx=0x7f5fe000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.380+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0014420 con 0x7f5fe8159970 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.381+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00145a0 con 0x7f5fe8159970 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.381+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0014950 con 0x7f5fe8159970 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.381+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe81554a0 con 0x7f5fe8159970 2023-08-10T10:38:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.381+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe81559d0 con 0x7f5fe8159970 2023-08-10T10:38:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.382+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8154d40 con 0x7f5fe8159970 2023-08-10T10:38:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.383+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fe0014ab0 con 0x7f5fe8159970 2023-08-10T10:38:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.384+0000 7f5fe57fa640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 0x7f5fcc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.384+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fe0089a10 con 0x7f5fe8159970 2023-08-10T10:38:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.384+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 0x7f5fcc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.385+0000 7f5fecb42640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 0x7f5fcc06d140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc036000 tx=0x7f5fdc03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.388+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5fe8154d40 con 0x7f5fe8159970 2023-08-10T10:38:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.577+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe815b200 con 0x7f5fe8159970 2023-08-10T10:38:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.579+0000 7f5fe57fa640 1 -- 172.21.15.50:0/1315765910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14637 (secure 0 0 0) 0x7f5fe0058890 con 0x7f5fe8159970 2023-08-10T10:38:15.580 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:15.580 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:15.105967+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.581+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 msgr2=0x7f5fcc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.581+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 0x7f5fcc06d140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc036000 tx=0x7f5fdc03b040 comp rx=0 tx=0).stop 2023-08-10T10:38:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 msgr2=0x7f5fe8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007e60 tx=0x7f5fe000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 shutdown_connections 2023-08-10T10:38:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fe8159970 0x7f5fe8070410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe80b0f00 0x7f5fe8154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fcc06ac80 0x7f5fcc06d140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 --2- 172.21.15.50:0/1315765910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe8069db0 0x7f5fe8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 >> 172.21.15.50:0/1315765910 conn(0x7f5fe806b590 msgr2=0x7f5fe80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 shutdown_connections 2023-08-10T10:38:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.582+0000 7f5feeda6640 1 -- 172.21.15.50:0/1315765910 wait complete. 2023-08-10T10:38:15.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:15.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.840+0000 7f6152944640 1 Processor -- start 2023-08-10T10:38:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.840+0000 7f6152944640 1 -- start start 2023-08-10T10:38:15.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0cf730 0x7f614c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f614c15e1c0 0x7f614c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f614c0d1ec0 0x7f614c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c0d0900 con 0x7f614c15e1c0 2023-08-10T10:38:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c0b20d0 con 0x7f614c0d1ec0 2023-08-10T10:38:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6152944640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0d0050 con 0x7f614c0cf730 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6151141640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f614c15e1c0 0x7f614c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6151141640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f614c15e1c0 0x7f614c15cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6151141640 1 -- 172.21.15.50:0/466741454 learned_addr learned my addr 172.21.15.50:0/466741454 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.842+0000 7f6151942640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0cf730 0x7f614c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6152143640 1 --2- 172.21.15.50:0/466741454 >> v2:172.21.15.117:3300/0 conn(0x7f614c0d1ec0 0x7f614c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6151141640 1 -- 172.21.15.50:0/466741454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0cf730 msgr2=0x7f614c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6151141640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0cf730 0x7f614c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6151141640 1 -- 172.21.15.50:0/466741454 >> v2:172.21.15.117:3300/0 conn(0x7f614c0d1ec0 msgr2=0x7f614c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:15.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6151141640 1 --2- 172.21.15.50:0/466741454 >> v2:172.21.15.117:3300/0 conn(0x7f614c0d1ec0 0x7f614c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.843+0000 7f6151141640 1 -- 172.21.15.50:0/466741454 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c15d570 con 0x7f614c15e1c0 2023-08-10T10:38:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.844+0000 7f6151141640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c15e1c0 0x7f614c15cc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f614c0b8360 tx=0x7f613c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffd4e831e66c173 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.844+0000 7f6150940640 1 -- 172.21.15.50:0/466741454 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0317e0 con 0x7f614c15e1c0 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.844+0000 7f6150940640 1 -- 172.21.15.50:0/466741454 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c031940 con 0x7f614c15e1c0 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.844+0000 7f6150940640 1 -- 172.21.15.50:0/466741454 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c031cd0 con 0x7f614c15e1c0 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 -- 172.21.15.50:0/466741454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c15e1c0 msgr2=0x7f614c15cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c15e1c0 0x7f614c15cc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f614c0b8360 tx=0x7f613c02b880 comp rx=0 tx=0).stop 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 -- 172.21.15.50:0/466741454 shutdown_connections 2023-08-10T10:38:15.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 --2- 172.21.15.50:0/466741454 >> v2:172.21.15.117:3300/0 conn(0x7f614c0d1ec0 0x7f614c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c15e1c0 0x7f614c15cc30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 --2- 172.21.15.50:0/466741454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0cf730 0x7f614c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 -- 172.21.15.50:0/466741454 >> 172.21.15.50:0/466741454 conn(0x7f614c069880 msgr2=0x7f614c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 -- 172.21.15.50:0/466741454 shutdown_connections 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.845+0000 7f6152944640 1 -- 172.21.15.50:0/466741454 wait complete. 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.847+0000 7f6152944640 1 Processor -- start 2023-08-10T10:38:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.847+0000 7f6152944640 1 -- start start 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 0x7f614c0b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c15e1c0 0x7f614c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c7fd0 con 0x7f614c0d1ec0 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0b77c0 con 0x7f614c0cf730 2023-08-10T10:38:15.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.848+0000 7f6152944640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c7350 con 0x7f614c15e1c0 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55794/0 (socket says 172.21.15.50:55794) 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 -- 172.21.15.50:0/2475992329 learned_addr learned my addr 172.21.15.50:0/2475992329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6152143640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c15e1c0 0x7f614c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151942640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 0x7f614c0b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 -- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c15e1c0 msgr2=0x7f614c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c15e1c0 0x7f614c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 -- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 msgr2=0x7f614c0b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 0x7f614c0b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151141640 1 -- 172.21.15.50:0/2475992329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0094d0 con 0x7f614c0d1ec0 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.849+0000 7f6151942640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 0x7f614c0b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f6151141640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f613c000c00 tx=0x7f613c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c032880 con 0x7f614c0d1ec0 2023-08-10T10:38:15.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c032a20 con 0x7f614c0d1ec0 2023-08-10T10:38:15.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c032dd0 con 0x7f614c0d1ec0 2023-08-10T10:38:15.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c0c7630 con 0x7f614c0d1ec0 2023-08-10T10:38:15.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.850+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0c7bf0 con 0x7f614c0d1ec0 2023-08-10T10:38:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.851+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c0c8110 con 0x7f614c0d1ec0 2023-08-10T10:38:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.852+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f613c04e450 con 0x7f614c0d1ec0 2023-08-10T10:38:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.853+0000 7f61427fc640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 0x7f613006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.853+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f613c0ab390 con 0x7f614c0d1ec0 2023-08-10T10:38:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.854+0000 7f6151942640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 0x7f613006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.854+0000 7f6151942640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 0x7f613006d110 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f614800ba50 tx=0x7f6148008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:15.858+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f614c0c8110 con 0x7f614c0d1ec0 2023-08-10T10:38:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.051+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f614c0c8110 con 0x7f614c0d1ec0 2023-08-10T10:38:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.052+0000 7f61427fc640 1 -- 172.21.15.50:0/2475992329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f614c0c8110 con 0x7f614c0d1ec0 2023-08-10T10:38:16.053 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.054+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 msgr2=0x7f613006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.054+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 0x7f613006d110 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f614800ba50 tx=0x7f6148008040 comp rx=0 tx=0).stop 2023-08-10T10:38:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.054+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 msgr2=0x7f614c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.054+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f613c000c00 tx=0x7f613c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 shutdown_connections 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c15e1c0 0x7f614c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f614c0d1ec0 0x7f614c0b3550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f613006ac50 0x7f613006d110 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 --2- 172.21.15.50:0/2475992329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0cf730 0x7f614c0b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 >> 172.21.15.50:0/2475992329 conn(0x7f614c069880 msgr2=0x7f614c15ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:16.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 shutdown_connections 2023-08-10T10:38:16.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.055+0000 7f6152944640 1 -- 172.21.15.50:0/2475992329 wait complete. 2023-08-10T10:38:16.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:16.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.308+0000 7f2a357ab640 1 Processor -- start 2023-08-10T10:38:16.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.308+0000 7f2a357ab640 1 -- start start 2023-08-10T10:38:16.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a357ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a300cd660 0x7f2a3006a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a357ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a300b1e00 0x7f2a300d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a357ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3006a5c0 con 0x7f2a3015fde0 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a357ab640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3006b0c0 con 0x7f2a300cd660 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a357ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3006a820 con 0x7f2a300b1e00 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a2ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a3015fde0 0x7f2a300ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54350/0 (socket says 172.21.15.50:54350) 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.310+0000 7f2a2ffff640 1 -- 172.21.15.50:0/4119282693 learned_addr learned my addr 172.21.15.50:0/4119282693 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/4119282693 >> v2:172.21.15.50:3300/0 conn(0x7f2a300cd660 0x7f2a3006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a34faa640 1 --2- 172.21.15.50:0/4119282693 >> v2:172.21.15.117:3300/0 conn(0x7f2a300b1e00 0x7f2a300d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2effd640 1 -- 172.21.15.50:0/4119282693 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116011766 0 0) 0x7f2a3006a5c0 con 0x7f2a3015fde0 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2effd640 1 -- 172.21.15.50:0/4119282693 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a18003520 con 0x7f2a3015fde0 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2f7fe640 1 -- 172.21.15.50:0/4119282693 >> v2:172.21.15.117:3300/0 conn(0x7f2a300b1e00 msgr2=0x7f2a300d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/4119282693 >> v2:172.21.15.117:3300/0 conn(0x7f2a300b1e00 0x7f2a300d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2f7fe640 1 -- 172.21.15.50:0/4119282693 >> v1:172.21.15.50:6789/0 conn(0x7f2a3015fde0 legacy=0x7f2a300ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.311+0000 7f2a2f7fe640 1 -- 172.21.15.50:0/4119282693 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3006ab00 con 0x7f2a300cd660 2023-08-10T10:38:16.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.312+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/4119282693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300cd660 0x7f2a3006a080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a300d36d0 tx=0x7f2a2402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9982aaa6401721 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a2effd640 1 -- 172.21.15.50:0/4119282693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24031710 con 0x7f2a300cd660 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a2effd640 1 -- 172.21.15.50:0/4119282693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2402f050 con 0x7f2a300cd660 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a2effd640 1 -- 172.21.15.50:0/4119282693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24031a90 con 0x7f2a300cd660 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 -- 172.21.15.50:0/4119282693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300cd660 msgr2=0x7f2a3006a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 --2- 172.21.15.50:0/4119282693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300cd660 0x7f2a3006a080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a300d36d0 tx=0x7f2a2402b7b0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 -- 172.21.15.50:0/4119282693 shutdown_connections 2023-08-10T10:38:16.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 --2- 172.21.15.50:0/4119282693 >> v2:172.21.15.117:3300/0 conn(0x7f2a300b1e00 0x7f2a300d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 --2- 172.21.15.50:0/4119282693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300cd660 0x7f2a3006a080 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.313+0000 7f2a357ab640 1 -- 172.21.15.50:0/4119282693 >> 172.21.15.50:0/4119282693 conn(0x7f2a300d2900 msgr2=0x7f2a300d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:16.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.314+0000 7f2a357ab640 1 -- 172.21.15.50:0/4119282693 shutdown_connections 2023-08-10T10:38:16.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.314+0000 7f2a357ab640 1 -- 172.21.15.50:0/4119282693 wait complete. 2023-08-10T10:38:16.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.315+0000 7f2a357ab640 1 Processor -- start 2023-08-10T10:38:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.315+0000 7f2a357ab640 1 -- start start 2023-08-10T10:38:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.316+0000 7f2a357ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.316+0000 7f2a357ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a300cd660 0x7f2a301540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.316+0000 7f2a357ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a3015fde0 0x7f2a301f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.316+0000 7f2a357ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300aa5f0 con 0x7f2a300b1e00 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a357ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30154600 con 0x7f2a3015fde0 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a357ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a301f1ed0 con 0x7f2a300cd660 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55806/0 (socket says 172.21.15.50:55806) 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 -- 172.21.15.50:0/1026201306 learned_addr learned my addr 172.21.15.50:0/1026201306 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a300cd660 0x7f2a301540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a34faa640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a3015fde0 0x7f2a301f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 -- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a300cd660 msgr2=0x7f2a301540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a300cd660 0x7f2a301540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 -- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a3015fde0 msgr2=0x7f2a301f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a3015fde0 0x7f2a301f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.317+0000 7f2a2ffff640 1 -- 172.21.15.50:0/1026201306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24009400 con 0x7f2a300b1e00 2023-08-10T10:38:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a2ffff640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c400 tx=0x7f2a2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20005ce0 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20005e40 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a200072d0 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300a9970 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.318+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a300a9f30 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.320+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a300aa730 con 0x7f2a300b1e00 2023-08-10T10:38:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.320+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a200074b0 con 0x7f2a300b1e00 2023-08-10T10:38:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.321+0000 7f2a2cff9640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 0x7f2a1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.321+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a20088670 con 0x7f2a300b1e00 2023-08-10T10:38:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.322+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 0x7f2a1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.322+0000 7f2a2f7fe640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 0x7f2a1c06d110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a24035000 tx=0x7f2a24008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.326+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a300aa730 con 0x7f2a300b1e00 2023-08-10T10:38:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.519+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a300aa730 con 0x7f2a300b1e00 2023-08-10T10:38:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.520+0000 7f2a2cff9640 1 -- 172.21.15.50:0/1026201306 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a300aa730 con 0x7f2a300b1e00 2023-08-10T10:38:16.521 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 msgr2=0x7f2a1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 0x7f2a1c06d110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a24035000 tx=0x7f2a24008030 comp rx=0 tx=0).stop 2023-08-10T10:38:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 msgr2=0x7f2a300a92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c400 tx=0x7f2a2000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 shutdown_connections 2023-08-10T10:38:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a1c06ac50 0x7f2a1c06d110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a3015fde0 0x7f2a301f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a300cd660 0x7f2a301540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 --2- 172.21.15.50:0/1026201306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a300b1e00 0x7f2a300a92e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 >> 172.21.15.50:0/1026201306 conn(0x7f2a300d2900 msgr2=0x7f2a30065340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 shutdown_connections 2023-08-10T10:38:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.523+0000 7f2a357ab640 1 -- 172.21.15.50:0/1026201306 wait complete. 2023-08-10T10:38:16.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:38:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.771+0000 7fb877638640 1 Processor -- start 2023-08-10T10:38:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.772+0000 7fb877638640 1 -- start start 2023-08-10T10:38:16.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb87015cd60 0x7fb870160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8700b8430 0x7fb8700cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8700cddb0 0x7fb8700696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ce240 con 0x7fb87015cd60 2023-08-10T10:38:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700b5bd0 con 0x7fb8700cddb0 2023-08-10T10:38:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.773+0000 7fb877638640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb870161180 con 0x7fb8700b8430 2023-08-10T10:38:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb87015cd60 0x7fb870160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb87015cd60 0x7fb870160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55822/0 (socket says 172.21.15.50:55822) 2023-08-10T10:38:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 -- 172.21.15.50:0/3918753046 learned_addr learned my addr 172.21.15.50:0/3918753046 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb874bd3640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8700b8430 0x7fb8700cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb875bd5640 1 --2- 172.21.15.50:0/3918753046 >> v2:172.21.15.117:3300/0 conn(0x7fb8700cddb0 0x7fb8700696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 -- 172.21.15.50:0/3918753046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8700b8430 msgr2=0x7fb8700cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8700b8430 0x7fb8700cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 -- 172.21.15.50:0/3918753046 >> v2:172.21.15.117:3300/0 conn(0x7fb8700cddb0 msgr2=0x7fb8700696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 --2- 172.21.15.50:0/3918753046 >> v2:172.21.15.117:3300/0 conn(0x7fb8700cddb0 0x7fb8700696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.774+0000 7fb8753d4640 1 -- 172.21.15.50:0/3918753046 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870161460 con 0x7fb87015cd60 2023-08-10T10:38:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.776+0000 7fb8753d4640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87015cd60 0x7fb870160930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8700b5490 tx=0x7fb86c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec382736844ffdb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.776+0000 7fb867fff640 1 -- 172.21.15.50:0/3918753046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c02cb00 con 0x7fb87015cd60 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.776+0000 7fb867fff640 1 -- 172.21.15.50:0/3918753046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c02cc60 con 0x7fb87015cd60 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.776+0000 7fb867fff640 1 -- 172.21.15.50:0/3918753046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0343f0 con 0x7fb87015cd60 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 -- 172.21.15.50:0/3918753046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87015cd60 msgr2=0x7fb870160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87015cd60 0x7fb870160930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8700b5490 tx=0x7fb86c02bf60 comp rx=0 tx=0).stop 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 -- 172.21.15.50:0/3918753046 shutdown_connections 2023-08-10T10:38:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 --2- 172.21.15.50:0/3918753046 >> v2:172.21.15.117:3300/0 conn(0x7fb8700cddb0 0x7fb8700696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8700b8430 0x7fb8700cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 --2- 172.21.15.50:0/3918753046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87015cd60 0x7fb870160930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 -- 172.21.15.50:0/3918753046 >> 172.21.15.50:0/3918753046 conn(0x7fb8700d2ac0 msgr2=0x7fb8700d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 -- 172.21.15.50:0/3918753046 shutdown_connections 2023-08-10T10:38:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.777+0000 7fb877638640 1 -- 172.21.15.50:0/3918753046 wait complete. 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.779+0000 7fb877638640 1 Processor -- start 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.779+0000 7fb877638640 1 -- start start 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8700cddb0 0x7fb87014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb87015cd60 0x7fb8700b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700cd790 con 0x7fb8700b8430 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87014d6c0 con 0x7fb8700cddb0 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb877638640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87014d9a0 con 0x7fb87015cd60 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb8753d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb8753d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55836/0 (socket says 172.21.15.50:55836) 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.780+0000 7fb8753d4640 1 -- 172.21.15.50:0/1414723369 learned_addr learned my addr 172.21.15.50:0/1414723369 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb874bd3640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8700cddb0 0x7fb87014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 -- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb87015cd60 msgr2=0x7fb8700b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb87015cd60 0x7fb8700b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 -- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8700cddb0 msgr2=0x7fb87014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8700cddb0 0x7fb87014bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 -- 172.21.15.50:0/1414723369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009b30 con 0x7fb8700b8430 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb8753d4640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000f80 tx=0x7fb86c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.781+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c009510 con 0x7fb8700b8430 2023-08-10T10:38:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.782+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c03e450 con 0x7fb8700b8430 2023-08-10T10:38:16.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.782+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c03e800 con 0x7fb8700b8430 2023-08-10T10:38:16.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.782+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87014dc80 con 0x7fb8700b8430 2023-08-10T10:38:16.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.782+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87014e240 con 0x7fb8700b8430 2023-08-10T10:38:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.783+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87014e430 con 0x7fb8700b8430 2023-08-10T10:38:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.784+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb86c03e960 con 0x7fb8700b8430 2023-08-10T10:38:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.785+0000 7fb865ffb640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 0x7fb85406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:16.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.785+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb86c0ac0b0 con 0x7fb8700b8430 2023-08-10T10:38:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.785+0000 7fb874bd3640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 0x7fb85406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.786+0000 7fb874bd3640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 0x7fb85406d110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb860006fd0 tx=0x7fb860008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:16.789+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb86c077410 con 0x7fb8700b8430 2023-08-10T10:38:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.017+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87004e270 con 0x7fb8700b8430 2023-08-10T10:38:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.018+0000 7fb865ffb640 1 -- 172.21.15.50:0/1414723369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fb86c07aa30 con 0x7fb8700b8430 2023-08-10T10:38:17.019 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:17.019 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T10:38:17.019 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-08-10T10:38:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.020+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 msgr2=0x7fb85406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.020+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 0x7fb85406d110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb860006fd0 tx=0x7fb860008040 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.020+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 msgr2=0x7fb8700cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000f80 tx=0x7fb86c004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 shutdown_connections 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb87015cd60 0x7fb8700b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb85406ac50 0x7fb85406d110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8700cddb0 0x7fb87014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 --2- 172.21.15.50:0/1414723369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8700b8430 0x7fb8700cd250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 >> 172.21.15.50:0/1414723369 conn(0x7fb8700d2ac0 msgr2=0x7fb87015bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 shutdown_connections 2023-08-10T10:38:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.021+0000 7fb877638640 1 -- 172.21.15.50:0/1414723369 wait complete. 2023-08-10T10:38:17.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.283+0000 7f04b6db5640 1 Processor -- start 2023-08-10T10:38:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.283+0000 7f04b6db5640 1 -- start start 2023-08-10T10:38:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.285+0000 7f04b6db5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.285+0000 7f04b6db5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04b0069db0 0x7f04b00b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.285+0000 7f04b6db5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00719f0 con 0x7f04b00c9b30 2023-08-10T10:38:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.285+0000 7f04b6db5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00c8db0 con 0x7f04b0069db0 2023-08-10T10:38:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.285+0000 7f04b6db5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00c9050 con 0x7f04b015ccb0 2023-08-10T10:38:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.286+0000 7f04b4b51640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.286+0000 7f04b5352640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04b0069db0 0x7f04b00b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.286+0000 7f04b4b51640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:45770/0 (socket says 172.21.15.50:45770) 2023-08-10T10:38:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.286+0000 7f04b4b51640 1 -- 172.21.15.50:0/2284176319 learned_addr learned my addr 172.21.15.50:0/2284176319 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.287+0000 7f04b5352640 1 -- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 msgr2=0x7f04b00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.287+0000 7f04b5352640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.287+0000 7f04b5352640 1 -- 172.21.15.50:0/2284176319 >> v1:172.21.15.117:6789/0 conn(0x7f04b00c9b30 legacy=0x7f04b00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.287+0000 7f04b5352640 1 -- 172.21.15.50:0/2284176319 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00c9330 con 0x7f04b0069db0 2023-08-10T10:38:17.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.287+0000 7f04b4b51640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.288+0000 7f04b5352640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b0069db0 0x7f04b00b2e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=552b86e6e49e91bc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04af7fe640 1 -- 172.21.15.50:0/2284176319 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a802cc50 con 0x7f04b0069db0 2023-08-10T10:38:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04af7fe640 1 -- 172.21.15.50:0/2284176319 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a802cdb0 con 0x7f04b0069db0 2023-08-10T10:38:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04af7fe640 1 -- 172.21.15.50:0/2284176319 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8034660 con 0x7f04b0069db0 2023-08-10T10:38:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 -- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b0069db0 msgr2=0x7f04b00b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b0069db0 0x7f04b00b2e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a802bea0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 -- 172.21.15.50:0/2284176319 shutdown_connections 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b0069db0 0x7f04b00b2e40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 --2- 172.21.15.50:0/2284176319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b015ccb0 0x7f04b00b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.289+0000 7f04b6db5640 1 -- 172.21.15.50:0/2284176319 >> 172.21.15.50:0/2284176319 conn(0x7f04b006b590 msgr2=0x7f04b00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.290+0000 7f04b6db5640 1 -- 172.21.15.50:0/2284176319 shutdown_connections 2023-08-10T10:38:17.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.290+0000 7f04b6db5640 1 -- 172.21.15.50:0/2284176319 wait complete. 2023-08-10T10:38:17.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.291+0000 7f04b6db5640 1 Processor -- start 2023-08-10T10:38:17.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.291+0000 7f04b6db5640 1 -- start start 2023-08-10T10:38:17.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b0069db0 0x7f04b0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b00c9b30 0x7f04b01478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0158040 con 0x7f04b015ccb0 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0154970 con 0x7f04b00c9b30 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.292+0000 7f04b6db5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0151ea0 con 0x7f04b0069db0 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55850/0 (socket says 172.21.15.50:55850) 2023-08-10T10:38:17.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 -- 172.21.15.50:0/806354694 learned_addr learned my addr 172.21.15.50:0/806354694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:17.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b4b51640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b0069db0 0x7f04b0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04affff640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b00c9b30 0x7f04b01478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 -- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b0069db0 msgr2=0x7f04b0154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b0069db0 0x7f04b0154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 -- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b00c9b30 msgr2=0x7f04b01478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b00c9b30 0x7f04b01478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.293+0000 7f04b5352640 1 -- 172.21.15.50:0/806354694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40094d0 con 0x7f04b015ccb0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04b5352640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8040650 con 0x7f04b015ccb0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a80407b0 con 0x7f04b015ccb0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a8009a70 con 0x7f04b015ccb0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8040b60 con 0x7f04b015ccb0 2023-08-10T10:38:17.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.294+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01577a0 con 0x7f04b015ccb0 2023-08-10T10:38:17.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.295+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0152010 con 0x7f04b015ccb0 2023-08-10T10:38:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.296+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04a8040cc0 con 0x7f04b015ccb0 2023-08-10T10:38:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.297+0000 7f04ad7fa640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 0x7f049406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.298+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f04a80abff0 con 0x7f04b015ccb0 2023-08-10T10:38:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.298+0000 7f04b4b51640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 0x7f049406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.298+0000 7f04b4b51640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 0x7f049406d110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009c50 tx=0x7f04a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.302+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f04a80772c0 con 0x7f04b015ccb0 2023-08-10T10:38:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.497+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04b004e270 con 0x7f04b015ccb0 2023-08-10T10:38:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.499+0000 7f04ad7fa640 1 -- 172.21.15.50:0/806354694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14624 (secure 0 0 0) 0x7f04a8039090 con 0x7f04b015ccb0 2023-08-10T10:38:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:16.110351+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 msgr2=0x7f049406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 0x7f049406d110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009c50 tx=0x7f04a4008040 comp rx=0 tx=0).stop 2023-08-10T10:38:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 msgr2=0x7f04b015e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a8004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 shutdown_connections 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b015ccb0 0x7f04b015e1c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f049406ac50 0x7f049406d110 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04b00c9b30 0x7f04b01478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 --2- 172.21.15.50:0/806354694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04b0069db0 0x7f04b0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 >> 172.21.15.50:0/806354694 conn(0x7f04b006b590 msgr2=0x7f04b00cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.501+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 shutdown_connections 2023-08-10T10:38:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.502+0000 7f04b6db5640 1 -- 172.21.15.50:0/806354694 wait complete. 2023-08-10T10:38:17.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:17.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.749+0000 7f997cc14640 1 Processor -- start 2023-08-10T10:38:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.749+0000 7f997cc14640 1 -- start start 2023-08-10T10:38:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997cc14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 0x7f99780ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997cc14640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99780cea00 0x7f99780cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997cc14640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9978070ea0 con 0x7f997815a540 2023-08-10T10:38:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997cc14640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780cddc0 con 0x7f99780cea00 2023-08-10T10:38:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997cc14640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9978071180 con 0x7f99780afcb0 2023-08-10T10:38:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f9975d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99780cea00 0x7f99780cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f9975d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99780cea00 0x7f99780cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55858/0 (socket says 172.21.15.50:55858) 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f9975d9b640 1 -- 172.21.15.50:0/3021447289 learned_addr learned my addr 172.21.15.50:0/3021447289 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.751+0000 7f997659c640 1 --2- 172.21.15.50:0/3021447289 >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 0x7f99780ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.752+0000 7f9975d9b640 1 -- 172.21.15.50:0/3021447289 >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 msgr2=0x7f99780ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.752+0000 7f9975d9b640 1 --2- 172.21.15.50:0/3021447289 >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 0x7f99780ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.752+0000 7f9975d9b640 1 -- 172.21.15.50:0/3021447289 >> v1:172.21.15.117:6789/0 conn(0x7f997815a540 legacy=0x7f997815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.752+0000 7f9975d9b640 1 -- 172.21.15.50:0/3021447289 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978071460 con 0x7f99780cea00 2023-08-10T10:38:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.752+0000 7f997659c640 1 --2- 172.21.15.50:0/3021447289 >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 0x7f99780ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f9975d9b640 1 --2- 172.21.15.50:0/3021447289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f99780cee60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99780740e0 tx=0x7f996002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2d8e525501b6ae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f997559a640 1 -- 172.21.15.50:0/3021447289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960031870 con 0x7f99780cea00 2023-08-10T10:38:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f997559a640 1 -- 172.21.15.50:0/3021447289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99600319d0 con 0x7f99780cea00 2023-08-10T10:38:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f997559a640 1 -- 172.21.15.50:0/3021447289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960031d60 con 0x7f99780cea00 2023-08-10T10:38:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f997cc14640 1 -- 172.21.15.50:0/3021447289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 msgr2=0x7f99780cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.754+0000 7f997cc14640 1 --2- 172.21.15.50:0/3021447289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f99780cee60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99780740e0 tx=0x7f996002b910 comp rx=0 tx=0).stop 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 -- 172.21.15.50:0/3021447289 shutdown_connections 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 --2- 172.21.15.50:0/3021447289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f99780cee60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 --2- 172.21.15.50:0/3021447289 >> v2:172.21.15.117:3300/0 conn(0x7f99780afcb0 0x7f99780ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 -- 172.21.15.50:0/3021447289 >> 172.21.15.50:0/3021447289 conn(0x7f99780b23e0 msgr2=0x7f99780b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 -- 172.21.15.50:0/3021447289 shutdown_connections 2023-08-10T10:38:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.755+0000 7f997cc14640 1 -- 172.21.15.50:0/3021447289 wait complete. 2023-08-10T10:38:17.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.757+0000 7f997cc14640 1 Processor -- start 2023-08-10T10:38:17.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.757+0000 7f997cc14640 1 -- start start 2023-08-10T10:38:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 0x7f9978158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997815a540 0x7f997806a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997806a550 con 0x7f99780cea00 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997806af20 con 0x7f99780afcb0 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997cc14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780696a0 con 0x7f997815a540 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f9975d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f9975d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55864/0 (socket says 172.21.15.50:55864) 2023-08-10T10:38:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f9975d9b640 1 -- 172.21.15.50:0/2170928638 learned_addr learned my addr 172.21.15.50:0/2170928638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.758+0000 7f997659c640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 0x7f9978158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9976d9d640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997815a540 0x7f997806a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 -- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997815a540 msgr2=0x7f997806a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997815a540 0x7f997806a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 -- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 msgr2=0x7f9978158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 0x7f9978158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 -- 172.21.15.50:0/2170928638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600094d0 con 0x7f99780cea00 2023-08-10T10:38:17.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f997659c640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 0x7f9978158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:17.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f9975d9b640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f996002b950 tx=0x7f99600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.759+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996003ad30 con 0x7f99780cea00 2023-08-10T10:38:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.760+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99600443f0 con 0x7f99780cea00 2023-08-10T10:38:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.760+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600447a0 con 0x7f99780cea00 2023-08-10T10:38:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.760+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9978069940 con 0x7f99780cea00 2023-08-10T10:38:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.760+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9978069f00 con 0x7f99780cea00 2023-08-10T10:38:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.761+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99780612b0 con 0x7f99780cea00 2023-08-10T10:38:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.762+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f996004d450 con 0x7f99780cea00 2023-08-10T10:38:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.763+0000 7f996effd640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 0x7f995806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.763+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f996002d040 con 0x7f99780cea00 2023-08-10T10:38:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.763+0000 7f997659c640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 0x7f995806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.764+0000 7f997659c640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 0x7f995806d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9968009b40 tx=0x7f9968003a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.767+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9960076b30 con 0x7f99780cea00 2023-08-10T10:38:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.959+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99780b2af0 con 0x7f99780cea00 2023-08-10T10:38:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.960+0000 7f996effd640 1 -- 172.21.15.50:0/2170928638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99600350a0 con 0x7f99780cea00 2023-08-10T10:38:17.960 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 msgr2=0x7f995806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 0x7f995806d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9968009b40 tx=0x7f9968003a30 comp rx=0 tx=0).stop 2023-08-10T10:38:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 msgr2=0x7f9978150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f996002b950 tx=0x7f99600046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 shutdown_connections 2023-08-10T10:38:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997815a540 0x7f997806a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99780cea00 0x7f9978150dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f995806ac50 0x7f995806d110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 --2- 172.21.15.50:0/2170928638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99780afcb0 0x7f9978158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.962+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 >> 172.21.15.50:0/2170928638 conn(0x7f99780b23e0 msgr2=0x7f99780c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.963+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 shutdown_connections 2023-08-10T10:38:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:17.963+0000 7f997cc14640 1 -- 172.21.15.50:0/2170928638 wait complete. 2023-08-10T10:38:17.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.215+0000 7ff0dc8e0640 1 Processor -- start 2023-08-10T10:38:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.215+0000 7ff0dc8e0640 1 -- start start 2023-08-10T10:38:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.216+0000 7ff0dc8e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0d815fde0 0x7ff0d806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.216+0000 7ff0dc8e0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d80b1e00 0x7ff0d80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.216+0000 7ff0dc8e0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80cd8e0 con 0x7ff0d80cd490 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.216+0000 7ff0dc8e0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d806b0c0 con 0x7ff0d80b1e00 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.216+0000 7ff0dc8e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d806a5c0 con 0x7ff0d815fde0 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d80b1e00 0x7ff0d80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0d80b1e00 0x7ff0d80ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55878/0 (socket says 172.21.15.50:55878) 2023-08-10T10:38:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 -- 172.21.15.50:0/1735812241 learned_addr learned my addr 172.21.15.50:0/1735812241 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0d77fe640 1 --2- 172.21.15.50:0/1735812241 >> v2:172.21.15.117:3300/0 conn(0x7ff0d815fde0 0x7ff0d806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 -- 172.21.15.50:0/1735812241 >> v2:172.21.15.117:3300/0 conn(0x7ff0d815fde0 msgr2=0x7ff0d806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 --2- 172.21.15.50:0/1735812241 >> v2:172.21.15.117:3300/0 conn(0x7ff0d815fde0 0x7ff0d806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 -- 172.21.15.50:0/1735812241 >> v1:172.21.15.117:6789/0 conn(0x7ff0d80cd490 legacy=0x7ff0d81604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.217+0000 7ff0ceffd640 1 -- 172.21.15.50:0/1735812241 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d806a820 con 0x7ff0d80b1e00 2023-08-10T10:38:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.218+0000 7ff0ceffd640 1 --2- 172.21.15.50:0/1735812241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ccf50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8073bd0 tx=0x7ff0c002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f75a301ea6cdf27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0d6ffd640 1 -- 172.21.15.50:0/1735812241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0031750 con 0x7ff0d80b1e00 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0d6ffd640 1 -- 172.21.15.50:0/1735812241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00318b0 con 0x7ff0d80b1e00 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0d6ffd640 1 -- 172.21.15.50:0/1735812241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0031c40 con 0x7ff0d80b1e00 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/1735812241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80b1e00 msgr2=0x7ff0d80ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/1735812241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ccf50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8073bd0 tx=0x7ff0c002b7f0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/1735812241 shutdown_connections 2023-08-10T10:38:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/1735812241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ccf50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/1735812241 >> v2:172.21.15.117:3300/0 conn(0x7ff0d815fde0 0x7ff0d806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/1735812241 >> 172.21.15.50:0/1735812241 conn(0x7ff0d80d2900 msgr2=0x7ff0d80d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.219+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/1735812241 shutdown_connections 2023-08-10T10:38:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.220+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/1735812241 wait complete. 2023-08-10T10:38:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.221+0000 7ff0dc8e0640 1 Processor -- start 2023-08-10T10:38:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.221+0000 7ff0dc8e0640 1 -- start start 2023-08-10T10:38:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 0x7ff0d80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 0x7ff0d81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8158100 con 0x7ff0d815fde0 2023-08-10T10:38:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81577a0 con 0x7ff0d80b1e00 2023-08-10T10:38:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.222+0000 7ff0dc8e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81597d0 con 0x7ff0d80cd490 2023-08-10T10:38:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 0x7ff0d81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:51872/0 (socket says 172.21.15.50:51872) 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d77fe640 1 -- 172.21.15.50:0/2377679025 learned_addr learned my addr 172.21.15.50:0/2377679025 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0ceffd640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 0x7ff0d80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 -- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 msgr2=0x7ff0d80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 0x7ff0d80caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 -- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 msgr2=0x7ff0d80ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0d7fff640 1 -- 172.21.15.50:0/2377679025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00094d0 con 0x7ff0d815fde0 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.223+0000 7ff0ceffd640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 0x7ff0d80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0d7fff640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 0x7ff0d81f2170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000be20 tx=0x7ff0d000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000ce70 con 0x7ff0d815fde0 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0014440 con 0x7ff0d815fde0 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0014830 con 0x7ff0d815fde0 2023-08-10T10:38:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d80cb260 con 0x7ff0d815fde0 2023-08-10T10:38:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.224+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8157d20 con 0x7ff0d815fde0 2023-08-10T10:38:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.225+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8158240 con 0x7ff0d815fde0 2023-08-10T10:38:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.226+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0d001d3b0 con 0x7ff0d815fde0 2023-08-10T10:38:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.227+0000 7ff0d4ff9640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 0x7ff0b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.228+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff0d0089330 con 0x7ff0d815fde0 2023-08-10T10:38:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.228+0000 7ff0d77fe640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 0x7ff0b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.228+0000 7ff0d77fe640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 0x7ff0b806d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006fd0 tx=0x7ff0c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.232+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0d8158240 con 0x7ff0d815fde0 2023-08-10T10:38:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.423+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0d8158240 con 0x7ff0d815fde0 2023-08-10T10:38:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.423+0000 7ff0d4ff9640 1 -- 172.21.15.50:0/2377679025 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0d8158240 con 0x7ff0d815fde0 2023-08-10T10:38:18.424 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:18.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 msgr2=0x7ff0b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 0x7ff0b806d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006fd0 tx=0x7ff0c8008040 comp rx=0 tx=0).stop 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 msgr2=0x7ff0d81f2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 0x7ff0d81f2170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000be20 tx=0x7ff0d000bf10 comp rx=0 tx=0).stop 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 shutdown_connections 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d815fde0 0x7ff0d81f2170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d80cd490 0x7ff0d80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0b806ac50 0x7ff0b806d110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 --2- 172.21.15.50:0/2377679025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d80b1e00 0x7ff0d80ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 >> 172.21.15.50:0/2377679025 conn(0x7ff0d80d2900 msgr2=0x7ff0d80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 shutdown_connections 2023-08-10T10:38:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.426+0000 7ff0dc8e0640 1 -- 172.21.15.50:0/2377679025 wait complete. 2023-08-10T10:38:18.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:38:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.672+0000 7fb1514b3640 1 Processor -- start 2023-08-10T10:38:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.672+0000 7fb1514b3640 1 -- start start 2023-08-10T10:38:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb1514b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb14c167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb1514b3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c161180 con 0x7fb14c0b8430 2023-08-10T10:38:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb1514b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c161460 con 0x7fb14c15cd60 2023-08-10T10:38:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb1514b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b5bd0 con 0x7fb14c0cdf80 2023-08-10T10:38:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb143fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb14c0b8430 0x7fb14c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54358/0 (socket says 172.21.15.50:54358) 2023-08-10T10:38:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.674+0000 7fb143fff640 1 -- 172.21.15.50:0/578925797 learned_addr learned my addr 172.21.15.50:0/578925797 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:18.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14b7fe640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb14c167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749024193 0 0) 0x7fb14c161180 con 0x7fb14c0b8430 2023-08-10T10:38:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003520 con 0x7fb14c0b8430 2023-08-10T10:38:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2816827283 0 0) 0x7fb138003520 con 0x7fb14c0b8430 2023-08-10T10:38:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 msgr2=0x7fb14c167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb14c167c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 >> v1:172.21.15.117:6789/0 conn(0x7fb14c15cd60 legacy=0x7fb14c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c161740 con 0x7fb14c0b8430 2023-08-10T10:38:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb134001670 con 0x7fb14c0b8430 2023-08-10T10:38:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 >> v1:172.21.15.50:6789/0 conn(0x7fb14c0b8430 legacy=0x7fb14c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.675+0000 7fb14a7fc640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1380039a0 0x7fb138003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14a7fc640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb138004350 0x7fb138004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14a7fc640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb138005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b5bd0 con 0x7fb1380039a0 2023-08-10T10:38:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800b9b0 con 0x7fb138004350 2023-08-10T10:38:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bb70 con 0x7fb14c0cdf80 2023-08-10T10:38:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1380039a0 0x7fb138003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14b7fe640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb138005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb143fff640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb138004350 0x7fb138004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 -- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 msgr2=0x7fb138005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb14c0cdf80 0x7fb138005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 -- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb138004350 msgr2=0x7fb138004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb138004350 0x7fb138004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.676+0000 7fb14affd640 1 -- 172.21.15.50:0/578925797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138003520 con 0x7fb1380039a0 2023-08-10T10:38:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.677+0000 7fb14affd640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1380039a0 0x7fb138003d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001860 tx=0x7fb1380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b22a96e74c4e00 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c033630 con 0x7fb1380039a0 2023-08-10T10:38:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c0337b0 con 0x7fb1380039a0 2023-08-10T10:38:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb14a7fc640 1 -- 172.21.15.50:0/578925797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c033b60 con 0x7fb1380039a0 2023-08-10T10:38:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb1514b3640 1 -- 172.21.15.50:0/578925797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1380039a0 msgr2=0x7fb138003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb1514b3640 1 --2- 172.21.15.50:0/578925797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1380039a0 0x7fb138003d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001860 tx=0x7fb1380057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb14b7fe640 1 -- 172.21.15.50:0/578925797 reap_dead start 2023-08-10T10:38:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb1514b3640 1 -- 172.21.15.50:0/578925797 shutdown_connections 2023-08-10T10:38:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb1514b3640 1 -- 172.21.15.50:0/578925797 >> 172.21.15.50:0/578925797 conn(0x7fb14c0d2ac0 msgr2=0x7fb14c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.678+0000 7fb1514b3640 1 -- 172.21.15.50:0/578925797 shutdown_connections 2023-08-10T10:38:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.679+0000 7fb1514b3640 1 -- 172.21.15.50:0/578925797 wait complete. 2023-08-10T10:38:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.680+0000 7fb1514b3640 1 Processor -- start 2023-08-10T10:38:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.680+0000 7fb1514b3640 1 -- start start 2023-08-10T10:38:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1380039a0 0x7fb14c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb14c0b25c0 0x7fb14c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c155330 con 0x7fb14c1f5970 2023-08-10T10:38:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b2f60 con 0x7fb14c0b25c0 2023-08-10T10:38:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.681+0000 7fb1514b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c1549b0 con 0x7fb1380039a0 2023-08-10T10:38:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb143fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb14c0b25c0 0x7fb14c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55902/0 (socket says 172.21.15.50:55902) 2023-08-10T10:38:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 -- 172.21.15.50:0/1794371774 learned_addr learned my addr 172.21.15.50:0/1794371774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14affd640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1380039a0 0x7fb14c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 -- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1380039a0 msgr2=0x7fb14c153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1380039a0 0x7fb14c153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 -- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb14c0b25c0 msgr2=0x7fb14c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb14c0b25c0 0x7fb14c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.682+0000 7fb14b7fe640 1 -- 172.21.15.50:0/1794371774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c1f66a0 con 0x7fb14c1f5970 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb14b7fe640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06b3b0 tx=0x7fb1440115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400e070 con 0x7fb14c1f5970 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144003990 con 0x7fb14c1f5970 2023-08-10T10:38:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144003b40 con 0x7fb14c1f5970 2023-08-10T10:38:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c154c70 con 0x7fb14c1f5970 2023-08-10T10:38:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.683+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c1f2310 con 0x7fb14c1f5970 2023-08-10T10:38:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.684+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c155470 con 0x7fb14c1f5970 2023-08-10T10:38:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.685+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb144003ca0 con 0x7fb14c1f5970 2023-08-10T10:38:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.687+0000 7fb1437fe640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 0x7fb12c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.687+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb144089580 con 0x7fb14c1f5970 2023-08-10T10:38:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.687+0000 7fb14affd640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 0x7fb12c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.688+0000 7fb14affd640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 0x7fb12c06d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb13c036000 tx=0x7fb13c031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.691+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb14c155470 con 0x7fb14c1f5970 2023-08-10T10:38:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.889+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb14c04e270 con 0x7fb14c1f5970 2023-08-10T10:38:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.890+0000 7fb1437fe640 1 -- 172.21.15.50:0/1794371774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb144054ac0 con 0x7fb14c1f5970 2023-08-10T10:38:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:38:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:38:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:38:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:38:18.892 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:38:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 msgr2=0x7fb12c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 0x7fb12c06d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb13c036000 tx=0x7fb13c031000 comp rx=0 tx=0).stop 2023-08-10T10:38:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 msgr2=0x7fb14c1f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06b3b0 tx=0x7fb1440115a0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 shutdown_connections 2023-08-10T10:38:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb14c1f5970 0x7fb14c1f5df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb12c06ac50 0x7fb12c06d110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb14c0b25c0 0x7fb14c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 --2- 172.21.15.50:0/1794371774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1380039a0 0x7fb14c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 >> 172.21.15.50:0/1794371774 conn(0x7fb14c0d2ac0 msgr2=0x7fb14c0b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.892+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 shutdown_connections 2023-08-10T10:38:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:18.893+0000 7fb1514b3640 1 -- 172.21.15.50:0/1794371774 wait complete. 2023-08-10T10:38:18.913 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:38:18.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:38:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.148+0000 7f4a73fff640 1 Processor -- start 2023-08-10T10:38:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.148+0000 7f4a73fff640 1 -- start start 2023-08-10T10:38:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.150+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cfbe0 0x7f4a74161180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a73fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740cd590 con 0x7f4a7415cbc0 2023-08-10T10:38:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a73fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740733f0 con 0x7f4a740696a0 2023-08-10T10:38:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a73fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740736b0 con 0x7f4a740cfbe0 2023-08-10T10:38:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a72ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a7415cbc0 0x7f4a740cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54364/0 (socket says 172.21.15.50:54364) 2023-08-10T10:38:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a72ffd640 1 -- 172.21.15.50:0/867429102 learned_addr learned my addr 172.21.15.50:0/867429102 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867822353 0 0) 0x7f4a740cd590 con 0x7f4a7415cbc0 2023-08-10T10:38:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c003520 con 0x7f4a7415cbc0 2023-08-10T10:38:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cfbe0 0x7f4a74161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023928416 0 0) 0x7f4a5c003520 con 0x7f4a7415cbc0 2023-08-10T10:38:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cfbe0 msgr2=0x7f4a74161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cfbe0 0x7f4a74161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.151+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 >> v1:172.21.15.117:6789/0 conn(0x7f4a740696a0 legacy=0x7f4a740cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740cd220 con 0x7f4a7415cbc0 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4a64001670 con 0x7f4a7415cbc0 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 >> v1:172.21.15.50:6789/0 conn(0x7f4a7415cbc0 legacy=0x7f4a740cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c003a10 0x7f4a5c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c005380 0x7f4a5c00b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740736b0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c00c230 con 0x7f4a5c003a10 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c00c3f0 con 0x7f4a5c005380 2023-08-10T10:38:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cfbe0 0x7f4a74161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a72ffd640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c003a10 0x7f4a5c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.152+0000 7f4a737fe640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c005380 0x7f4a5c00b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.153+0000 7f4a727fc640 1 -- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c005380 msgr2=0x7f4a5c00b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.153+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c005380 0x7f4a5c00b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.153+0000 7f4a727fc640 1 -- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c003a10 msgr2=0x7f4a5c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.153+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c003a10 0x7f4a5c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.153+0000 7f4a727fc640 1 -- 172.21.15.50:0/867429102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c003520 con 0x7f4a5c0047c0 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.154+0000 7f4a727fc640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a5c004c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a740d0010 tx=0x7f4a5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410188f09385f04c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.154+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68033640 con 0x7f4a5c0047c0 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.154+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680337c0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.154+0000 7f4a71ffb640 1 -- 172.21.15.50:0/867429102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68033b70 con 0x7f4a5c0047c0 2023-08-10T10:38:19.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 -- 172.21.15.50:0/867429102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 msgr2=0x7f4a5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:19.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 --2- 172.21.15.50:0/867429102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a5c004c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a740d0010 tx=0x7f4a5c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a737fe640 1 -- 172.21.15.50:0/867429102 reap_dead start 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 -- 172.21.15.50:0/867429102 shutdown_connections 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 -- 172.21.15.50:0/867429102 >> 172.21.15.50:0/867429102 conn(0x7f4a740b2500 msgr2=0x7f4a740b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 -- 172.21.15.50:0/867429102 shutdown_connections 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.155+0000 7f4a73fff640 1 -- 172.21.15.50:0/867429102 wait complete. 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.157+0000 7f4a73fff640 1 Processor -- start 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.158+0000 7f4a73fff640 1 -- start start 2023-08-10T10:38:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 0x7f4a740aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 0x7f4a740caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c6d20 con 0x7f4a5c0047c0 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c7000 con 0x7f4a740caac0 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a73fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c72e0 con 0x7f4a740cc3b0 2023-08-10T10:38:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55914/0 (socket says 172.21.15.50:55914) 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a72ffd640 1 -- 172.21.15.50:0/3359580132 learned_addr learned my addr 172.21.15.50:0/3359580132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.159+0000 7f4a727fc640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 0x7f4a740aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a737fe640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 0x7f4a740caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 -- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 msgr2=0x7f4a740aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 0x7f4a740aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 -- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 msgr2=0x7f4a740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 0x7f4a740caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 -- 172.21.15.50:0/3359580132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740c75c0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a727fc640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 0x7f4a740aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a737fe640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 0x7f4a740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a72ffd640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400e7f0 tx=0x7f4a6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400eea0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6400c870 con 0x7f4a5c0047c0 2023-08-10T10:38:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400cc00 con 0x7f4a5c0047c0 2023-08-10T10:38:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740c3b60 con 0x7f4a5c0047c0 2023-08-10T10:38:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.160+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740acf40 con 0x7f4a5c0047c0 2023-08-10T10:38:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.161+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740c77b0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.162+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a6401d460 con 0x7f4a5c0047c0 2023-08-10T10:38:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.163+0000 7f4a5b7fe640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 0x7f4a6006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.164+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4a64089190 con 0x7f4a5c0047c0 2023-08-10T10:38:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.164+0000 7f4a727fc640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 0x7f4a6006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.164+0000 7f4a727fc640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 0x7f4a6006d110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a68036000 tx=0x7f4a68031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.168+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4a740c77b0 con 0x7f4a5c0047c0 2023-08-10T10:38:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:19.362+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4a740ad160 con 0x7f4a5c0047c0 2023-08-10T10:38:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.165+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/3359580132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4a740ad160 con 0x7f4a5c0047c0 2023-08-10T10:38:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:38:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.171+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 msgr2=0x7f4a6006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.171+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 0x7f4a6006d110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a68036000 tx=0x7f4a68031000 comp rx=0 tx=0).stop 2023-08-10T10:38:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.171+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 msgr2=0x7f4a740c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.171+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400e7f0 tx=0x7f4a6400ecb0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 shutdown_connections 2023-08-10T10:38:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a6006ac50 0x7f4a6006d110 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a740caac0 0x7f4a740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a740cc3b0 0x7f4a740aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 --2- 172.21.15.50:0/3359580132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0047c0 0x7f4a740c6680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.172+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 >> 172.21.15.50:0/3359580132 conn(0x7f4a740b2500 msgr2=0x7f4a7406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.174+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 shutdown_connections 2023-08-10T10:38:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.174+0000 7f4a73fff640 1 -- 172.21.15.50:0/3359580132 wait complete. 2023-08-10T10:38:20.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:38:20.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.435+0000 7f2499ec9640 1 Processor -- start 2023-08-10T10:38:20.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.435+0000 7f2499ec9640 1 -- start start 2023-08-10T10:38:20.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2499ec9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2499ec9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24940ca540 0x7f249415e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2499ec9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940c8420 con 0x7f24940c9c20 2023-08-10T10:38:20.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2499ec9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940cb6d0 con 0x7f24940ca540 2023-08-10T10:38:20.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2499ec9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940cada0 con 0x7f24940b40f0 2023-08-10T10:38:20.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f24996c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24940ca540 0x7f249415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.437+0000 7f2493fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24940ca540 0x7f249415e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:51924/0 (socket says 172.21.15.50:51924) 2023-08-10T10:38:20.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f2493fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:45840/0 (socket says 172.21.15.50:45840) 2023-08-10T10:38:20.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 -- 172.21.15.50:0/2961191722 learned_addr learned my addr 172.21.15.50:0/2961191722 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:20.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 -- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 msgr2=0x7f24940b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:20.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 -- 172.21.15.50:0/2961191722 >> v1:172.21.15.117:6789/0 conn(0x7f24940c9c20 legacy=0x7f24940b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f24996c8640 1 -- 172.21.15.50:0/2961191722 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940cb080 con 0x7f24940ca540 2023-08-10T10:38:20.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.438+0000 7f2493fff640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:20.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.440+0000 7f24996c8640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f249415e480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61ef605dcdbac45 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:20.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.440+0000 7f24937fe640 1 -- 172.21.15.50:0/2961191722 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c02ca80 con 0x7f24940ca540 2023-08-10T10:38:20.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.440+0000 7f24937fe640 1 -- 172.21.15.50:0/2961191722 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c02cbe0 con 0x7f24940ca540 2023-08-10T10:38:20.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.440+0000 7f24937fe640 1 -- 172.21.15.50:0/2961191722 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0343f0 con 0x7f24940ca540 2023-08-10T10:38:20.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 -- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 msgr2=0x7f249415e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f249415e480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c02bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 -- 172.21.15.50:0/2961191722 shutdown_connections 2023-08-10T10:38:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f249415e480 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 --2- 172.21.15.50:0/2961191722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f24940b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 -- 172.21.15.50:0/2961191722 >> 172.21.15.50:0/2961191722 conn(0x7f249406b4f0 msgr2=0x7f24940b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:20.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 -- 172.21.15.50:0/2961191722 shutdown_connections 2023-08-10T10:38:20.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.441+0000 7f2499ec9640 1 -- 172.21.15.50:0/2961191722 wait complete. 2023-08-10T10:38:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.443+0000 7f2499ec9640 1 Processor -- start 2023-08-10T10:38:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.443+0000 7f2499ec9640 1 -- start start 2023-08-10T10:38:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f249415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f24941578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249415a890 con 0x7f24940c9c20 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249406fa20 con 0x7f24940ca540 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2499ec9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249406fd00 con 0x7f24940b40f0 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.444+0000 7f2493fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55916/0 (socket says 172.21.15.50:55916) 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 -- 172.21.15.50:0/248703091 learned_addr learned my addr 172.21.15.50:0/248703091 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2498ec7640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f249415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f24996c8640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f24941578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 -- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 msgr2=0x7f249415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f249415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 -- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 msgr2=0x7f24941578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:20.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f24941578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 -- 172.21.15.50:0/248703091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2480009400 con 0x7f24940c9c20 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.445+0000 7f2493fff640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f248000e960 tx=0x7f248000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.446+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000ca00 con 0x7f24940c9c20 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.446+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000cb60 con 0x7f24940c9c20 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.446+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c009b30 con 0x7f24940c9c20 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.446+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480013470 con 0x7f24940c9c20 2023-08-10T10:38:20.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.446+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24940702c0 con 0x7f24940c9c20 2023-08-10T10:38:20.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.447+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24940b3f10 con 0x7f24940c9c20 2023-08-10T10:38:20.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.448+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24800135d0 con 0x7f24940c9c20 2023-08-10T10:38:20.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.450+0000 7f24917fa640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 0x7f247806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:20.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.450+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2480089550 con 0x7f24940c9c20 2023-08-10T10:38:20.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.450+0000 7f2498ec7640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 0x7f247806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:20.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.451+0000 7f2498ec7640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 0x7f247806d110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2488000f60 tx=0x7f2488009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:20.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.454+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f24800547d0 con 0x7f24940c9c20 2023-08-10T10:38:20.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:20.643+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2494066e30 con 0x7f24940c9c20 2023-08-10T10:38:21.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.183+0000 7f24917fa640 1 -- 172.21.15.50:0/248703091 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2480057df0 con 0x7f24940c9c20 2023-08-10T10:38:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.191+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 msgr2=0x7f247806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.191+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 0x7f247806d110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2488000f60 tx=0x7f2488009040 comp rx=0 tx=0).stop 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.192+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 msgr2=0x7f2494144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.192+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f248000e960 tx=0x7f248000ee20 comp rx=0 tx=0).stop 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 shutdown_connections 2023-08-10T10:38:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f247806ac50 0x7f247806d110 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24940ca540 0x7f24941578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24940c9c20 0x7f2494144450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 --2- 172.21.15.50:0/248703091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24940b40f0 0x7f249415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 >> 172.21.15.50:0/248703091 conn(0x7f249406b4f0 msgr2=0x7f249415d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 shutdown_connections 2023-08-10T10:38:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.193+0000 7f2499ec9640 1 -- 172.21.15.50:0/248703091 wait complete. 2023-08-10T10:38:21.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:38:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.430+0000 7f0e20ce0640 1 Processor -- start 2023-08-10T10:38:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.431+0000 7f0e20ce0640 1 -- start start 2023-08-10T10:38:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e20ce0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0e1c15cb90 0x7f0e1c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e20ce0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e1c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e20ce0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c160a40 con 0x7f0e1c0b4640 2023-08-10T10:38:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e20ce0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b4bb0 con 0x7f0e1c15cb90 2023-08-10T10:38:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e20ce0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b4e90 con 0x7f0e1c15cf70 2023-08-10T10:38:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e1ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e1c0b4640 0x7f0e1c06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54366/0 (socket says 172.21.15.50:54366) 2023-08-10T10:38:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e1ad9d640 1 -- 172.21.15.50:0/328867843 learned_addr learned my addr 172.21.15.50:0/328867843 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.432+0000 7f0e1a59c640 1 --2- 172.21.15.50:0/328867843 >> v2:172.21.15.117:3300/0 conn(0x7f0e1c15cb90 0x7f0e1c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e1c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243570190 0 0) 0x7f0e1c160a40 con 0x7f0e1c0b4640 2023-08-10T10:38:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e08003520 con 0x7f0e1c0b4640 2023-08-10T10:38:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747441719 0 0) 0x7f0e08003520 con 0x7f0e1c0b4640 2023-08-10T10:38:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 msgr2=0x7f0e1c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e1c160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 >> v2:172.21.15.117:3300/0 conn(0x7f0e1c15cb90 msgr2=0x7f0e1c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 --2- 172.21.15.50:0/328867843 >> v2:172.21.15.117:3300/0 conn(0x7f0e1c15cb90 0x7f0e1c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0b5170 con 0x7f0e1c0b4640 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0e14001670 con 0x7f0e1c0b4640 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 >> v1:172.21.15.50:6789/0 conn(0x7f0e1c0b4640 legacy=0x7f0e1c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e08003970 0x7f0e08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b4bb0 con 0x7f0e08004d00 2023-08-10T10:38:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b4e90 con 0x7f0e08003970 2023-08-10T10:38:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0800b980 con 0x7f0e1c15cf70 2023-08-10T10:38:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.433+0000 7f0e1ad9d640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1a59c640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e08003970 0x7f0e08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1ad9d640 1 -- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 msgr2=0x7f0e080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1ad9d640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1ad9d640 1 -- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e08003970 msgr2=0x7f0e08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1ad9d640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e08003970 0x7f0e08003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e1ad9d640 1 -- 172.21.15.50:0/328867843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08003520 con 0x7f0e08004d00 2023-08-10T10:38:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.434+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15cf70 0x7f0e080047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.435+0000 7f0e1ad9d640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e08005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c270 tx=0x7f0e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd04e32523a9af03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.435+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1402cae0 con 0x7f0e08004d00 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.435+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1402cc40 con 0x7f0e08004d00 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.435+0000 7f0e1959a640 1 -- 172.21.15.50:0/328867843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140058d0 con 0x7f0e08004d00 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 -- 172.21.15.50:0/328867843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 msgr2=0x7f0e08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/328867843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e08005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c270 tx=0x7f0e080057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e1ad9d640 1 -- 172.21.15.50:0/328867843 reap_dead start 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 -- 172.21.15.50:0/328867843 shutdown_connections 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 -- 172.21.15.50:0/328867843 >> 172.21.15.50:0/328867843 conn(0x7f0e1c0cf640 msgr2=0x7f0e1c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 -- 172.21.15.50:0/328867843 shutdown_connections 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.436+0000 7f0e20ce0640 1 -- 172.21.15.50:0/328867843 wait complete. 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.438+0000 7f0e20ce0640 1 Processor -- start 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.438+0000 7f0e20ce0640 1 -- start start 2023-08-10T10:38:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15e3a0 0x7f0e1c0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e1c0cb120 0x7f0e1c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c15abe0 con 0x7f0e08004d00 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c15f790 con 0x7f0e1c0cb120 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e20ce0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0cbac0 con 0x7f0e1c15e3a0 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e1a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e1a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55946/0 (socket says 172.21.15.50:55946) 2023-08-10T10:38:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.439+0000 7f0e1a59c640 1 -- 172.21.15.50:0/1436994490 learned_addr learned my addr 172.21.15.50:0/1436994490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15e3a0 0x7f0e1c0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1ad9d640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e1c0cb120 0x7f0e1c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 -- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15e3a0 msgr2=0x7f0e1c0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15e3a0 0x7f0e1c0c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 -- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e1c0cb120 msgr2=0x7f0e1c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e1c0cb120 0x7f0e1c0cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:21.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 -- 172.21.15.50:0/1436994490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c15fbb0 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e1a59c640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00f430 tx=0x7f0e0c00f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c009ea0 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c014800 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c014bb0 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.440+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c15eb10 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.441+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c15f0d0 con 0x7f0e08004d00 2023-08-10T10:38:21.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.442+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c0612b0 con 0x7f0e08004d00 2023-08-10T10:38:21.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.443+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e0c014d10 con 0x7f0e08004d00 2023-08-10T10:38:21.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.444+0000 7f0e12ffd640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 0x7f0dfc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.445+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0e0c08a550 con 0x7f0e08004d00 2023-08-10T10:38:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.445+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 0x7f0dfc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:21.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.445+0000 7f0e19d9b640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 0x7f0dfc06d110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c15ffc0 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:21.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.450+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0e0c055680 con 0x7f0e08004d00 2023-08-10T10:38:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:21.681+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0e1c0d0a10 con 0x7f0e08004d00 2023-08-10T10:38:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.355+0000 7f0e12ffd640 1 -- 172.21.15.50:0/1436994490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0e0c058ca0 con 0x7f0e08004d00 2023-08-10T10:38:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 3 and data pool 4 2023-08-10T10:38:22.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 msgr2=0x7f0dfc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 0x7f0dfc06d110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c15ffc0 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2023-08-10T10:38:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 msgr2=0x7f0e1c0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00f430 tx=0x7f0e0c00f8f0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 shutdown_connections 2023-08-10T10:38:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dfc06ac50 0x7f0dfc06d110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e1c0cb120 0x7f0e1c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e1c15e3a0 0x7f0e1c0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 --2- 172.21.15.50:0/1436994490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e08004d00 0x7f0e1c0ca890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 >> 172.21.15.50:0/1436994490 conn(0x7f0e1c0cf640 msgr2=0x7f0e1c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 shutdown_connections 2023-08-10T10:38:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.359+0000 7f0e20ce0640 1 -- 172.21.15.50:0/1436994490 wait complete. 2023-08-10T10:38:22.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:22.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.614+0000 7fbf6ec6a640 1 Processor -- start 2023-08-10T10:38:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.615+0000 7fbf6ec6a640 1 -- start start 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.616+0000 7fbf6ec6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf680b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.616+0000 7fbf6ec6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf680b0c60 0x7fbf680b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.616+0000 7fbf6ec6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf68071c70 con 0x7fbf68070e80 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.616+0000 7fbf6ec6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680713d0 con 0x7fbf680b0c60 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.616+0000 7fbf6ec6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680716b0 con 0x7fbf6815aa40 2023-08-10T10:38:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf6d207640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf68070e80 0x7fbf680696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54382/0 (socket says 172.21.15.50:54382) 2023-08-10T10:38:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf6d207640 1 -- 172.21.15.50:0/3790263289 learned_addr learned my addr 172.21.15.50:0/3790263289 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5ffff640 1 --2- 172.21.15.50:0/3790263289 >> v2:172.21.15.117:3300/0 conn(0x7fbf680b0c60 0x7fbf680b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf6ca06640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf680b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252299248 0 0) 0x7fbf68071c70 con 0x7fbf68070e80 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf50003520 con 0x7fbf68070e80 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002988090 0 0) 0x7fbf50003520 con 0x7fbf68070e80 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 msgr2=0x7fbf680b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf680b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 >> v2:172.21.15.117:3300/0 conn(0x7fbf680b0c60 msgr2=0x7fbf680b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 --2- 172.21.15.50:0/3790263289 >> v2:172.21.15.117:3300/0 conn(0x7fbf680b0c60 0x7fbf680b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68071990 con 0x7fbf68070e80 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fbf600019f0 con 0x7fbf68070e80 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 >> v1:172.21.15.50:6789/0 conn(0x7fbf68070e80 legacy=0x7fbf680696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.617+0000 7fbf5f7fe640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50003970 0x7fbf50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5f7fe640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5f7fe640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf50004d00 0x7fbf50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680713d0 con 0x7fbf50004d00 2023-08-10T10:38:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680716b0 con 0x7fbf50003970 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5000fd90 con 0x7fbf6815aa40 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf50004d00 0x7fbf50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6ca06640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50003970 0x7fbf50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf5ffff640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 -- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 msgr2=0x7fbf500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf6815aa40 0x7fbf500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 -- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50003970 msgr2=0x7fbf50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50003970 0x7fbf50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.618+0000 7fbf6d207640 1 -- 172.21.15.50:0/3790263289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50003520 con 0x7fbf50004d00 2023-08-10T10:38:22.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.619+0000 7fbf6d207640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf50004d00 0x7fbf50005180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000a860 tx=0x7fbf500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a0349f4f3e3516 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60034630 con 0x7fbf50004d00 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6002f070 con 0x7fbf50004d00 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf5f7fe640 1 -- 172.21.15.50:0/3790263289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600349f0 con 0x7fbf50004d00 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/3790263289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf50004d00 msgr2=0x7fbf50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/3790263289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf50004d00 0x7fbf50005180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000a860 tx=0x7fbf500057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf6d207640 1 -- 172.21.15.50:0/3790263289 reap_dead start 2023-08-10T10:38:22.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/3790263289 shutdown_connections 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.620+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/3790263289 >> 172.21.15.50:0/3790263289 conn(0x7fbf6806b590 msgr2=0x7fbf680ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.621+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/3790263289 shutdown_connections 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.621+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/3790263289 wait complete. 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.622+0000 7fbf6ec6a640 1 Processor -- start 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.623+0000 7fbf6ec6a640 1 -- start start 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.623+0000 7fbf6ec6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50004d00 0x7fbf68155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.623+0000 7fbf6ec6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf680c67e0 0x7fbf680c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.623+0000 7fbf6ec6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6ec6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680c77f0 con 0x7fbf680696a0 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6ec6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6806a070 con 0x7fbf50004d00 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6ec6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681ee0f0 con 0x7fbf680c67e0 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55972/0 (socket says 172.21.15.50:55972) 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 -- 172.21.15.50:0/1431147637 learned_addr learned my addr 172.21.15.50:0/1431147637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6ca06640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50004d00 0x7fbf68155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf5ffff640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf680c67e0 0x7fbf680c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 -- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf680c67e0 msgr2=0x7fbf680c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf680c67e0 0x7fbf680c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 -- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50004d00 msgr2=0x7fbf68155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50004d00 0x7fbf68155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.624+0000 7fbf6d207640 1 -- 172.21.15.50:0/1431147637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680c6c70 con 0x7fbf680696a0 2023-08-10T10:38:22.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf6d207640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000a860 tx=0x7fbf60001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:22.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60034840 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf600349a0 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60034d30 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf680c6f50 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.625+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf680c7510 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.626+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf681ee260 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.627+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf60031030 con 0x7fbf680696a0 2023-08-10T10:38:22.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.628+0000 7fbf5d7fa640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 0x7fbf5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:22.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.628+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf600aab10 con 0x7fbf680696a0 2023-08-10T10:38:22.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.628+0000 7fbf6ca06640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 0x7fbf5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:22.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.629+0000 7fbf6ca06640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 0x7fbf5406d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009a10 tx=0x7fbf64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:22.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.632+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbf60075b20 con 0x7fbf680696a0 2023-08-10T10:38:22.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.823+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf681ee260 con 0x7fbf680696a0 2023-08-10T10:38:22.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.825+0000 7fbf5d7fa640 1 -- 172.21.15.50:0/1431147637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18280 (secure 0 0 0) 0x7fbf60045020 con 0x7fbf680696a0 2023-08-10T10:38:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:22.826 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:21.682713+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.827+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 msgr2=0x7fbf5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.827+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 0x7fbf5406d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009a10 tx=0x7fbf64008040 comp rx=0 tx=0).stop 2023-08-10T10:38:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.827+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 msgr2=0x7fbf68069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.827+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000a860 tx=0x7fbf60001d80 comp rx=0 tx=0).stop 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 shutdown_connections 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf680696a0 0x7fbf68069b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf680c67e0 0x7fbf680c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbf5406ac50 0x7fbf5406d110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 --2- 172.21.15.50:0/1431147637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf50004d00 0x7fbf68155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 >> 172.21.15.50:0/1431147637 conn(0x7fbf6806b590 msgr2=0x7fbf68157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 shutdown_connections 2023-08-10T10:38:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:22.828+0000 7fbf6ec6a640 1 -- 172.21.15.50:0/1431147637 wait complete. 2023-08-10T10:38:22.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.062+0000 7f0cbffff640 1 Processor -- start 2023-08-10T10:38:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.062+0000 7f0cbffff640 1 -- start start 2023-08-10T10:38:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0cc00b1da0 0x7f0cc00cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc015d010 con 0x7f0cc0153c30 2023-08-10T10:38:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc015d290 con 0x7f0cc0153850 2023-08-10T10:38:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc015d570 con 0x7f0cc00b1da0 2023-08-10T10:38:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cc0153c30 0x7f0cc00ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54384/0 (socket says 172.21.15.50:54384) 2023-08-10T10:38:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.063+0000 7f0cbf7fe640 1 -- 172.21.15.50:0/3321926197 learned_addr learned my addr 172.21.15.50:0/3321926197 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbe7fc640 1 --2- 172.21.15.50:0/3321926197 >> v2:172.21.15.117:3300/0 conn(0x7f0cc00b1da0 0x7f0cc00cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398592562 0 0) 0x7f0cc015d010 con 0x7f0cc0153c30 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca8003520 con 0x7f0cc0153c30 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919005332 0 0) 0x7f0ca8003520 con 0x7f0cc0153c30 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 >> v2:172.21.15.117:3300/0 conn(0x7f0cc00b1da0 msgr2=0x7f0cc00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 --2- 172.21.15.50:0/3321926197 >> v2:172.21.15.117:3300/0 conn(0x7f0cc00b1da0 0x7f0cc00cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 >> v1:172.21.15.117:6789/0 conn(0x7f0cc0153850 legacy=0x7f0cc00b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc015d850 con 0x7f0cc0153c30 2023-08-10T10:38:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0cb80016e0 con 0x7f0cc0153c30 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 >> v1:172.21.15.50:6789/0 conn(0x7f0cc0153c30 legacy=0x7f0cc00ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0ca8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ca80047c0 0x7f0ca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.064+0000 7f0cbdffb640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca80051f0 0x7f0ca800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc015d570 con 0x7f0ca80039e0 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca800c150 con 0x7f0ca80051f0 2023-08-10T10:38:23.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca800c310 con 0x7f0ca80047c0 2023-08-10T10:38:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0ca8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbf7fe640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca80051f0 0x7f0ca800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 -- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ca80047c0 msgr2=0x7f0ca8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ca80047c0 0x7f0ca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 -- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca80051f0 msgr2=0x7f0ca800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca80051f0 0x7f0ca800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbeffd640 1 -- 172.21.15.50:0/3321926197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8003520 con 0x7f0ca80039e0 2023-08-10T10:38:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbf7fe640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca80051f0 0x7f0ca800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.065+0000 7f0cbf7fe640 1 -- 172.21.15.50:0/3321926197 reap_dead start 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.066+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0ca8003e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0001e50 tx=0x7f0ca80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb28c6227757bbd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0003b70 con 0x7f0ca80039e0 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0003cd0 con 0x7f0ca80039e0 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbdffb640 1 -- 172.21.15.50:0/3321926197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0005310 con 0x7f0ca80039e0 2023-08-10T10:38:23.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbffff640 1 -- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 msgr2=0x7f0ca8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbffff640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0ca8003e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0001e50 tx=0x7f0ca80057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbffff640 1 -- 172.21.15.50:0/3321926197 shutdown_connections 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbffff640 1 --2- 172.21.15.50:0/3321926197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0ca8003e00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.067+0000 7f0cbffff640 1 -- 172.21.15.50:0/3321926197 >> 172.21.15.50:0/3321926197 conn(0x7f0cc0069880 msgr2=0x7f0cc0069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.068+0000 7f0cbffff640 1 -- 172.21.15.50:0/3321926197 shutdown_connections 2023-08-10T10:38:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.068+0000 7f0cbffff640 1 -- 172.21.15.50:0/3321926197 wait complete. 2023-08-10T10:38:23.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.069+0000 7f0cbffff640 1 Processor -- start 2023-08-10T10:38:23.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.070+0000 7f0cbffff640 1 -- start start 2023-08-10T10:38:23.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 0x7f0cc00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc00a91e0 0x7f0cc00a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00cc710 con 0x7f0ca80039e0 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00a9ba0 con 0x7f0cc00a91e0 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00d1230 con 0x7f0cc00cb3d0 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55996/0 (socket says 172.21.15.50:55996) 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 -- 172.21.15.50:0/2715496750 learned_addr learned my addr 172.21.15.50:0/2715496750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbf7fe640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc00a91e0 0x7f0cc00a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbe7fc640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 0x7f0cc00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 -- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 msgr2=0x7f0cc00cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 0x7f0cc00cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 -- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc00a91e0 msgr2=0x7f0cc00a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc00a91e0 0x7f0cc00a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbeffd640 1 -- 172.21.15.50:0/2715496750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00cbe70 con 0x7f0ca80039e0 2023-08-10T10:38:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.071+0000 7f0cbe7fc640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 0x7f0cc00cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0cbeffd640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb002bf70 tx=0x7f0cb00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb003e070 con 0x7f0ca80039e0 2023-08-10T10:38:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb002f440 con 0x7f0ca80039e0 2023-08-10T10:38:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb002f7b0 con 0x7f0ca80039e0 2023-08-10T10:38:23.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00cc150 con 0x7f0ca80039e0 2023-08-10T10:38:23.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.072+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc0151180 con 0x7f0ca80039e0 2023-08-10T10:38:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.073+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00cc670 con 0x7f0ca80039e0 2023-08-10T10:38:23.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.074+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cb002f910 con 0x7f0ca80039e0 2023-08-10T10:38:23.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.075+0000 7f0ca77fe640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 0x7f0cac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.075+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cb00aa7e0 con 0x7f0ca80039e0 2023-08-10T10:38:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.075+0000 7f0cbe7fc640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 0x7f0cac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.076+0000 7f0cbe7fc640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 0x7f0cac06d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.080+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0cb0075930 con 0x7f0ca80039e0 2023-08-10T10:38:23.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.289+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc0066e30 con 0x7f0ca80039e0 2023-08-10T10:38:23.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.291+0000 7f0ca77fe640 1 -- 172.21.15.50:0/2715496750 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f0cb0078f50 con 0x7f0ca80039e0 2023-08-10T10:38:23.292 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:23.292 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 msgr2=0x7f0cac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 0x7f0cac06d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 msgr2=0x7f0cc00d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb002bf70 tx=0x7f0cb00014a0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 shutdown_connections 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cac06ac50 0x7f0cac06d110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc00a91e0 0x7f0cc00a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cc00cb3d0 0x7f0cc00cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 --2- 172.21.15.50:0/2715496750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca80039e0 0x7f0cc00d3070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 >> 172.21.15.50:0/2715496750 conn(0x7f0cc0069880 msgr2=0x7f0cc015ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 shutdown_connections 2023-08-10T10:38:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.294+0000 7f0cbffff640 1 -- 172.21.15.50:0/2715496750 wait complete. 2023-08-10T10:38:23.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:38:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.546+0000 7f959b3ad640 1 Processor -- start 2023-08-10T10:38:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.547+0000 7f959b3ad640 1 -- start start 2023-08-10T10:38:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.548+0000 7f959b3ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f95940ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.548+0000 7f959b3ad640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940cdb20 con 0x7f95940696a0 2023-08-10T10:38:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.548+0000 7f959b3ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940cde00 con 0x7f9594161360 2023-08-10T10:38:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.548+0000 7f959b3ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940cc0d0 con 0x7f959415ca80 2023-08-10T10:38:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.549+0000 7f959abac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95940696a0 0x7f95940c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54394/0 (socket says 172.21.15.50:54394) 2023-08-10T10:38:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.549+0000 7f959abac640 1 -- 172.21.15.50:0/1840231538 learned_addr learned my addr 172.21.15.50:0/1840231538 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.549+0000 7f959a3ab640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f95940ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.549+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264669972 0 0) 0x7f95940cdb20 con 0x7f95940696a0 2023-08-10T10:38:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.549+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9580003520 con 0x7f95940696a0 2023-08-10T10:38:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1288125441 0 0) 0x7f9580003520 con 0x7f95940696a0 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 msgr2=0x7f95940ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f95940ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 >> v1:172.21.15.117:6789/0 conn(0x7f9594161360 legacy=0x7f95940cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940cc3b0 con 0x7f95940696a0 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f958c0019f0 con 0x7f95940696a0 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 >> v1:172.21.15.50:6789/0 conn(0x7f95940696a0 legacy=0x7f95940c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f9580003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95800047c0 0x7f9580004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f9580005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940cc0d0 con 0x7f9580003a10 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958000ba80 con 0x7f95800047c0 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958000bc40 con 0x7f959415ca80 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.550+0000 7f959a3ab640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f9580003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f9599baa640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95800047c0 0x7f9580004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959abac640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f9580005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959a3ab640 1 -- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 msgr2=0x7f9580005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959a3ab640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f959415ca80 0x7f9580005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959a3ab640 1 -- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95800047c0 msgr2=0x7f9580004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959a3ab640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95800047c0 0x7f9580004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.551+0000 7f959a3ab640 1 -- 172.21.15.50:0/1840231538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580003520 con 0x7f9580003a10 2023-08-10T10:38:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.552+0000 7f959a3ab640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f9580003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9590009ac0 tx=0x7f95800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88236fc97c764de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.552+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959002c6b0 con 0x7f9580003a10 2023-08-10T10:38:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.552+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959002c810 con 0x7f9580003a10 2023-08-10T10:38:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.552+0000 7f95993a9640 1 -- 172.21.15.50:0/1840231538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959002cba0 con 0x7f9580003a10 2023-08-10T10:38:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 -- 172.21.15.50:0/1840231538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 msgr2=0x7f9580003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 --2- 172.21.15.50:0/1840231538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f9580003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9590009ac0 tx=0x7f95800057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959abac640 1 -- 172.21.15.50:0/1840231538 reap_dead start 2023-08-10T10:38:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 -- 172.21.15.50:0/1840231538 shutdown_connections 2023-08-10T10:38:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 -- 172.21.15.50:0/1840231538 >> 172.21.15.50:0/1840231538 conn(0x7f95940caf80 msgr2=0x7f95940cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 -- 172.21.15.50:0/1840231538 shutdown_connections 2023-08-10T10:38:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.553+0000 7f959b3ad640 1 -- 172.21.15.50:0/1840231538 wait complete. 2023-08-10T10:38:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.555+0000 7f959b3ad640 1 Processor -- start 2023-08-10T10:38:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.555+0000 7f959b3ad640 1 -- start start 2023-08-10T10:38:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95941f3110 0x7f959414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959406e800 0x7f959415f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f3590 con 0x7f9580003a10 2023-08-10T10:38:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f6ae0 con 0x7f959406e800 2023-08-10T10:38:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959b3ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f6240 con 0x7f95941f3110 2023-08-10T10:38:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56012/0 (socket says 172.21.15.50:56012) 2023-08-10T10:38:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 -- 172.21.15.50:0/2922902077 learned_addr learned my addr 172.21.15.50:0/2922902077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f9599baa640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95941f3110 0x7f959414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959abac640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959406e800 0x7f959415f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 -- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95941f3110 msgr2=0x7f959414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95941f3110 0x7f959414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 -- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959406e800 msgr2=0x7f959415f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959406e800 0x7f959415f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.556+0000 7f959a3ab640 1 -- 172.21.15.50:0/2922902077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95941f6520 con 0x7f9580003a10 2023-08-10T10:38:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f959a3ab640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f959002c250 tx=0x7f9590004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590003810 con 0x7f9580003a10 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590003970 con 0x7f9580003a10 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590003ce0 con 0x7f9580003a10 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95941f6800 con 0x7f9580003a10 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.557+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959414ddd0 con 0x7f9580003a10 2023-08-10T10:38:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.558+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9594071cf0 con 0x7f9580003a10 2023-08-10T10:38:23.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.559+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9590047450 con 0x7f9580003a10 2023-08-10T10:38:23.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.560+0000 7f958affd640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 0x7f957806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:23.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.560+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95900ab7c0 con 0x7f9580003a10 2023-08-10T10:38:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.560+0000 7f9599baa640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 0x7f957806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.561+0000 7f9599baa640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 0x7f957806d110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95941f5bc0 tx=0x7f9584009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.566+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f95900769a0 con 0x7f9580003a10 2023-08-10T10:38:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:23.800+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9594066e30 con 0x7f9580003a10 2023-08-10T10:38:24.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.369+0000 7f958affd640 1 -- 172.21.15.50:0/2922902077 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f95900044e0 con 0x7f9580003a10 2023-08-10T10:38:24.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 msgr2=0x7f957806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:24.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 0x7f957806d110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95941f5bc0 tx=0x7f9584009040 comp rx=0 tx=0).stop 2023-08-10T10:38:24.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 msgr2=0x7f95941f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:24.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f959002c250 tx=0x7f9590004730 comp rx=0 tx=0).stop 2023-08-10T10:38:24.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 shutdown_connections 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f957806ac50 0x7f957806d110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f959406e800 0x7f959415f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95941f3110 0x7f959414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 --2- 172.21.15.50:0/2922902077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580003a10 0x7f95941f5c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 >> 172.21.15.50:0/2922902077 conn(0x7f95940caf80 msgr2=0x7f95940af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.372+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 shutdown_connections 2023-08-10T10:38:24.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.373+0000 7f959b3ad640 1 -- 172.21.15.50:0/2922902077 wait complete. 2023-08-10T10:38:24.396 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2023-08-10T10:38:24.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:38:24.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.637+0000 7f0c4482c640 1 Processor -- start 2023-08-10T10:38:24.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.637+0000 7f0c4482c640 1 -- start start 2023-08-10T10:38:24.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c4482c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c400c15e0 0x7f0c400c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c4482c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400696a0 0x7f0c40069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c4482c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c400cc8d0 con 0x7f0c40160fa0 2023-08-10T10:38:24.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c4482c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4006a070 con 0x7f0c400c15e0 2023-08-10T10:38:24.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c4482c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ccbb0 con 0x7f0c400696a0 2023-08-10T10:38:24.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c400c15e0 0x7f0c400c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c400c15e0 0x7f0c400c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56020/0 (socket says 172.21.15.50:56020) 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.639+0000 7f0c3effd640 1 -- 172.21.15.50:0/3225105774 learned_addr learned my addr 172.21.15.50:0/3225105774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.640+0000 7f0c3ffff640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400696a0 0x7f0c40069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.640+0000 7f0c3effd640 1 -- 172.21.15.50:0/3225105774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400696a0 msgr2=0x7f0c40069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.640+0000 7f0c3effd640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400696a0 0x7f0c40069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.640+0000 7f0c3effd640 1 -- 172.21.15.50:0/3225105774 >> v1:172.21.15.117:6789/0 conn(0x7f0c40160fa0 legacy=0x7f0c400cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:24.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.640+0000 7f0c3effd640 1 -- 172.21.15.50:0/3225105774 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c400cce90 con 0x7f0c400c15e0 2023-08-10T10:38:24.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.641+0000 7f0c3effd640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400c15e0 0x7f0c400c97b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009870 tx=0x7f0c2802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1add473eff9997 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.641+0000 7f0c3e7fc640 1 -- 172.21.15.50:0/3225105774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28030840 con 0x7f0c400c15e0 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.641+0000 7f0c3e7fc640 1 -- 172.21.15.50:0/3225105774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c280309a0 con 0x7f0c400c15e0 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.641+0000 7f0c3e7fc640 1 -- 172.21.15.50:0/3225105774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28030d30 con 0x7f0c400c15e0 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 -- 172.21.15.50:0/3225105774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400c15e0 msgr2=0x7f0c400c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400c15e0 0x7f0c400c97b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009870 tx=0x7f0c2802b980 comp rx=0 tx=0).stop 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 -- 172.21.15.50:0/3225105774 shutdown_connections 2023-08-10T10:38:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400696a0 0x7f0c40069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 --2- 172.21.15.50:0/3225105774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400c15e0 0x7f0c400c97b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 -- 172.21.15.50:0/3225105774 >> 172.21.15.50:0/3225105774 conn(0x7f0c400caf80 msgr2=0x7f0c400cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:24.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 -- 172.21.15.50:0/3225105774 shutdown_connections 2023-08-10T10:38:24.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.642+0000 7f0c4482c640 1 -- 172.21.15.50:0/3225105774 wait complete. 2023-08-10T10:38:24.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.644+0000 7f0c4482c640 1 Processor -- start 2023-08-10T10:38:24.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.644+0000 7f0c4482c640 1 -- start start 2023-08-10T10:38:24.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400c15e0 0x7f0c401f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c40160fa0 0x7f0c4014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40163a10 con 0x7f0c400696a0 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401fa640 con 0x7f0c40160fa0 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c4482c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401fa920 con 0x7f0c400c15e0 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56030/0 (socket says 172.21.15.50:56030) 2023-08-10T10:38:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.645+0000 7f0c3f7fe640 1 -- 172.21.15.50:0/2549266596 learned_addr learned my addr 172.21.15.50:0/2549266596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3ffff640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c40160fa0 0x7f0c4014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 -- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400c15e0 msgr2=0x7f0c401f9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400c15e0 0x7f0c401f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 -- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c40160fa0 msgr2=0x7f0c4014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c40160fa0 0x7f0c4014d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 -- 172.21.15.50:0/2549266596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280094d0 con 0x7f0c400696a0 2023-08-10T10:38:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c3f7fe640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c730 tx=0x7f0c3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30003b70 con 0x7f0c400696a0 2023-08-10T10:38:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30003cf0 con 0x7f0c400696a0 2023-08-10T10:38:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30003ea0 con 0x7f0c400696a0 2023-08-10T10:38:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.646+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c401fac00 con 0x7f0c400696a0 2023-08-10T10:38:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.647+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c401635e0 con 0x7f0c400696a0 2023-08-10T10:38:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.648+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4006cc20 con 0x7f0c400696a0 2023-08-10T10:38:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.649+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c3000aa90 con 0x7f0c400696a0 2023-08-10T10:38:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.650+0000 7f0c37fff640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 0x7f0c2006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.650+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c30089320 con 0x7f0c400696a0 2023-08-10T10:38:24.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.650+0000 7f0c3effd640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 0x7f0c2006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:24.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.651+0000 7f0c3effd640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 0x7f0c2006d140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c28036000 tx=0x7f0c2803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:24.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.654+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0c30054330 con 0x7f0c400696a0 2023-08-10T10:38:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:24.884+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0c40066e30 con 0x7f0c400696a0 2023-08-10T10:38:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.371+0000 7f0c37fff640 1 -- 172.21.15.50:0/2549266596 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c30057950 con 0x7f0c400696a0 2023-08-10T10:38:25.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 msgr2=0x7f0c2006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 0x7f0c2006d140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c28036000 tx=0x7f0c2803b040 comp rx=0 tx=0).stop 2023-08-10T10:38:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 msgr2=0x7f0c4014d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c730 tx=0x7f0c3000cbf0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 shutdown_connections 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c2006ac80 0x7f0c2006d140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c40160fa0 0x7f0c4014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c400c15e0 0x7f0c401f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 --2- 172.21.15.50:0/2549266596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c400696a0 0x7f0c4014d310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 >> 172.21.15.50:0/2549266596 conn(0x7f0c400caf80 msgr2=0x7f0c4015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.375+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 shutdown_connections 2023-08-10T10:38:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.376+0000 7f0c4482c640 1 -- 172.21.15.50:0/2549266596 wait complete. 2023-08-10T10:38:25.398 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:38:25.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:38:25.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.628+0000 7f2326ad3640 1 Processor -- start 2023-08-10T10:38:25.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.628+0000 7f2326ad3640 1 -- start start 2023-08-10T10:38:25.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.630+0000 7f2326ad3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f232015aa40 0x7f23200b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.630+0000 7f2326ad3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.630+0000 7f2326ad3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2320071c70 con 0x7f23200b0c60 2023-08-10T10:38:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.630+0000 7f2326ad3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200713d0 con 0x7f232015aa40 2023-08-10T10:38:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.630+0000 7f2326ad3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200716b0 con 0x7f23200ca930 2023-08-10T10:38:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f232015aa40 0x7f23200b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f232015aa40 0x7f23200b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33236/0 (socket says 172.21.15.50:33236) 2023-08-10T10:38:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 -- 172.21.15.50:0/3750065876 learned_addr learned my addr 172.21.15.50:0/3750065876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f2325070640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 -- 172.21.15.50:0/3750065876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 msgr2=0x7f23200b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 -- 172.21.15.50:0/3750065876 >> v1:172.21.15.117:6789/0 conn(0x7f23200b0c60 legacy=0x7f23200696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.631+0000 7f232486f640 1 -- 172.21.15.50:0/3750065876 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320071990 con 0x7f232015aa40 2023-08-10T10:38:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.632+0000 7f232486f640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f23200b3820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2314009870 tx=0x7f231402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63aea2bb2deaac6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f231f7fe640 1 -- 172.21.15.50:0/3750065876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140317c0 con 0x7f232015aa40 2023-08-10T10:38:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f231f7fe640 1 -- 172.21.15.50:0/3750065876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314031920 con 0x7f232015aa40 2023-08-10T10:38:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f231f7fe640 1 -- 172.21.15.50:0/3750065876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314031cb0 con 0x7f232015aa40 2023-08-10T10:38:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 -- 172.21.15.50:0/3750065876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 msgr2=0x7f23200b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f23200b3820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2314009870 tx=0x7f231402b860 comp rx=0 tx=0).stop 2023-08-10T10:38:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 -- 172.21.15.50:0/3750065876 shutdown_connections 2023-08-10T10:38:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 --2- 172.21.15.50:0/3750065876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f23200b3820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.633+0000 7f2326ad3640 1 -- 172.21.15.50:0/3750065876 >> 172.21.15.50:0/3750065876 conn(0x7f232006b590 msgr2=0x7f23200ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.634+0000 7f2326ad3640 1 -- 172.21.15.50:0/3750065876 shutdown_connections 2023-08-10T10:38:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.634+0000 7f2326ad3640 1 -- 172.21.15.50:0/3750065876 wait complete. 2023-08-10T10:38:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.635+0000 7f2326ad3640 1 Processor -- start 2023-08-10T10:38:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.635+0000 7f2326ad3640 1 -- start start 2023-08-10T10:38:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.636+0000 7f2326ad3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23200b0c60 0x7f23200c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.636+0000 7f2326ad3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.636+0000 7f2326ad3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2326ad3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232015be10 con 0x7f232015aa40 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2326ad3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200b2b30 con 0x7f23200b0c60 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2326ad3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200b3630 con 0x7f23200ca930 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33240/0 (socket says 172.21.15.50:33240) 2023-08-10T10:38:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 -- 172.21.15.50:0/329638085 learned_addr learned my addr 172.21.15.50:0/329638085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f232486f640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23200b0c60 0x7f23200c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f231ffff640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 -- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 msgr2=0x7f23200b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 -- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23200b0c60 msgr2=0x7f23200c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23200b0c60 0x7f23200c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.637+0000 7f2325070640 1 -- 172.21.15.50:0/329638085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140094d0 con 0x7f232015aa40 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f2325070640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2318007e40 tx=0x7f231800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318014620 con 0x7f232015aa40 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231800ee90 con 0x7f232015aa40 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180149e0 con 0x7f232015aa40 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200b2d90 con 0x7f232015aa40 2023-08-10T10:38:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.638+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200b3350 con 0x7f232015aa40 2023-08-10T10:38:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.639+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232015bf80 con 0x7f232015aa40 2023-08-10T10:38:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.640+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2318014b40 con 0x7f232015aa40 2023-08-10T10:38:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.641+0000 7f231d7fa640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 0x7f230406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.642+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2318089ef0 con 0x7f232015aa40 2023-08-10T10:38:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.642+0000 7f232486f640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 0x7f230406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.643+0000 7f232486f640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 0x7f230406d110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2314036000 tx=0x7f231403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.648+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2318054f90 con 0x7f232015aa40 2023-08-10T10:38:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.878+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23200c93d0 con 0x7f232015aa40 2023-08-10T10:38:25.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.879+0000 7f231d7fa640 1 -- 172.21.15.50:0/329638085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f23180585b0 con 0x7f232015aa40 2023-08-10T10:38:25.880 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:25.880 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:38:25.880 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:38:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 msgr2=0x7f230406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 0x7f230406d110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2314036000 tx=0x7f231403d040 comp rx=0 tx=0).stop 2023-08-10T10:38:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 msgr2=0x7f2320143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2318007e40 tx=0x7f231800e4b0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 shutdown_connections 2023-08-10T10:38:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f232015aa40 0x7f2320143920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23200ca930 0x7f23200b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f230406ac50 0x7f230406d110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 --2- 172.21.15.50:0/329638085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23200b0c60 0x7f23200c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 >> 172.21.15.50:0/329638085 conn(0x7f232006b590 msgr2=0x7f23200c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 shutdown_connections 2023-08-10T10:38:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:25.882+0000 7f2326ad3640 1 -- 172.21.15.50:0/329638085 wait complete. 2023-08-10T10:38:25.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.130+0000 7f2b1759e640 1 Processor -- start 2023-08-10T10:38:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.131+0000 7f2b1759e640 1 -- start start 2023-08-10T10:38:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.132+0000 7f2b1759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b1815a940 0x7f2b180aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.132+0000 7f2b1759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b180b19d0 0x7f2b180b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.132+0000 7f2b1759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180b1f10 con 0x7f2b1815f2b0 2023-08-10T10:38:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.132+0000 7f2b1759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180b21f0 con 0x7f2b180b19d0 2023-08-10T10:38:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.132+0000 7f2b1759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1815e5c0 con 0x7f2b1815a940 2023-08-10T10:38:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b180b19d0 0x7f2b180b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b180b19d0 0x7f2b180b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33244/0 (socket says 172.21.15.50:33244) 2023-08-10T10:38:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 -- 172.21.15.50:0/1751590056 learned_addr learned my addr 172.21.15.50:0/1751590056 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b1659c640 1 --2- 172.21.15.50:0/1751590056 >> v2:172.21.15.117:3300/0 conn(0x7f2b1815a940 0x7f2b180aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 -- 172.21.15.50:0/1751590056 >> v2:172.21.15.117:3300/0 conn(0x7f2b1815a940 msgr2=0x7f2b180aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 --2- 172.21.15.50:0/1751590056 >> v2:172.21.15.117:3300/0 conn(0x7f2b1815a940 0x7f2b180aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.133+0000 7f2b16d9d640 1 -- 172.21.15.50:0/1751590056 >> v1:172.21.15.117:6789/0 conn(0x7f2b1815f2b0 legacy=0x7f2b180b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.134+0000 7f2b16d9d640 1 -- 172.21.15.50:0/1751590056 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1815e7d0 con 0x7f2b180b19d0 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.135+0000 7f2b16d9d640 1 --2- 172.21.15.50:0/1751590056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180b19d0 0x7f2b180b0450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b180ce2e0 tx=0x7f2b1002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c53a32d7cb5423 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.135+0000 7f2b15d9b640 1 -- 172.21.15.50:0/1751590056 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1002ca80 con 0x7f2b180b19d0 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b15d9b640 1 -- 172.21.15.50:0/1751590056 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1002cbe0 con 0x7f2b180b19d0 2023-08-10T10:38:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b15d9b640 1 -- 172.21.15.50:0/1751590056 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100343f0 con 0x7f2b180b19d0 2023-08-10T10:38:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 -- 172.21.15.50:0/1751590056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180b19d0 msgr2=0x7f2b180b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 --2- 172.21.15.50:0/1751590056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180b19d0 0x7f2b180b0450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b180ce2e0 tx=0x7f2b1002bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 -- 172.21.15.50:0/1751590056 shutdown_connections 2023-08-10T10:38:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 --2- 172.21.15.50:0/1751590056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180b19d0 0x7f2b180b0450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 --2- 172.21.15.50:0/1751590056 >> v2:172.21.15.117:3300/0 conn(0x7f2b1815a940 0x7f2b180aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 -- 172.21.15.50:0/1751590056 >> 172.21.15.50:0/1751590056 conn(0x7f2b1806ab80 msgr2=0x7f2b1806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 -- 172.21.15.50:0/1751590056 shutdown_connections 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.136+0000 7f2b1759e640 1 -- 172.21.15.50:0/1751590056 wait complete. 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.138+0000 7f2b1759e640 1 Processor -- start 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.138+0000 7f2b1759e640 1 -- start start 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 0x7f2b181589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b1815f2b0 0x7f2b180c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b18158ef0 con 0x7f2b1815a940 2023-08-10T10:38:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181f1d60 con 0x7f2b180b19d0 2023-08-10T10:38:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.139+0000 7f2b1759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181f2020 con 0x7f2b1815f2b0 2023-08-10T10:38:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33258/0 (socket says 172.21.15.50:33258) 2023-08-10T10:38:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 -- 172.21.15.50:0/131947993 learned_addr learned my addr 172.21.15.50:0/131947993 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b1659c640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 0x7f2b181589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b16d9d640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b1815f2b0 0x7f2b180c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 -- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b1815f2b0 msgr2=0x7f2b180c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b1815f2b0 0x7f2b180c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 -- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 msgr2=0x7f2b181589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 0x7f2b181589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b0ffff640 1 -- 172.21.15.50:0/131947993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10009b30 con 0x7f2b1815a940 2023-08-10T10:38:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.140+0000 7f2b1659c640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 0x7f2b181589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b0ffff640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c400 tx=0x7f2b0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000052d0 con 0x7f2b1815a940 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00005430 con 0x7f2b1815a940 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00003830 con 0x7f2b1815a940 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b181f2300 con 0x7f2b1815a940 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.141+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b181f28c0 con 0x7f2b1815a940 2023-08-10T10:38:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.142+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b18066e30 con 0x7f2b1815a940 2023-08-10T10:38:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.143+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b00003990 con 0x7f2b1815a940 2023-08-10T10:38:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.144+0000 7f2b0effd640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 0x7f2af806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.144+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b00088b10 con 0x7f2b1815a940 2023-08-10T10:38:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.144+0000 7f2b1659c640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 0x7f2af806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.145+0000 7f2b1659c640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 0x7f2af806d110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b18159f70 tx=0x7f2b08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.148+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2b00053bb0 con 0x7f2b1815a940 2023-08-10T10:38:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.339+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b180b0dc0 con 0x7f2b1815a940 2023-08-10T10:38:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.342+0000 7f2b0effd640 1 -- 172.21.15.50:0/131947993 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f2b000571d0 con 0x7f2b1815a940 2023-08-10T10:38:26.343 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:26.343 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 msgr2=0x7f2af806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 0x7f2af806d110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b18159f70 tx=0x7f2b08008040 comp rx=0 tx=0).stop 2023-08-10T10:38:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 msgr2=0x7f2b18071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c400 tx=0x7f2b0000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 shutdown_connections 2023-08-10T10:38:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b1815f2b0 0x7f2b180c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1815a940 0x7f2b18071330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2af806ac50 0x7f2af806d110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 --2- 172.21.15.50:0/131947993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b180b19d0 0x7f2b181589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 >> 172.21.15.50:0/131947993 conn(0x7f2b1806ab80 msgr2=0x7f2b180ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 shutdown_connections 2023-08-10T10:38:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.345+0000 7f2b1759e640 1 -- 172.21.15.50:0/131947993 wait complete. 2023-08-10T10:38:26.348 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-08-10T10:38:26.346+0000 7ff9e2115640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:38:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:38:26.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:38:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.583+0000 7fac27fff640 1 Processor -- start 2023-08-10T10:38:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.583+0000 7fac27fff640 1 -- start start 2023-08-10T10:38:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.584+0000 7fac27fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 0x7fac280aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.584+0000 7fac27fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.584+0000 7fac27fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280b1f10 con 0x7fac2815f2b0 2023-08-10T10:38:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.584+0000 7fac27fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280b21f0 con 0x7fac2815a940 2023-08-10T10:38:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.584+0000 7fac27fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2815e5c0 con 0x7fac280b19d0 2023-08-10T10:38:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.585+0000 7fac26ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 0x7fac280aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.585+0000 7fac277fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.585+0000 7fac26ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 0x7fac280aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42170/0 (socket says 172.21.15.50:42170) 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.585+0000 7fac277fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52168/0 (socket says 172.21.15.50:52168) 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.585+0000 7fac26ffd640 1 -- 172.21.15.50:0/3005884422 learned_addr learned my addr 172.21.15.50:0/3005884422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.586+0000 7fac277fe640 1 -- 172.21.15.50:0/3005884422 >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 msgr2=0x7fac280aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.586+0000 7fac277fe640 1 --2- 172.21.15.50:0/3005884422 >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 0x7fac280aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.586+0000 7fac277fe640 1 -- 172.21.15.50:0/3005884422 >> v1:172.21.15.117:6789/0 conn(0x7fac2815f2b0 legacy=0x7fac280b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.586+0000 7fac277fe640 1 -- 172.21.15.50:0/3005884422 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2815e7d0 con 0x7fac280b19d0 2023-08-10T10:38:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.587+0000 7fac277fe640 1 --2- 172.21.15.50:0/3005884422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac20009d90 tx=0x7fac2002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddfcb913fdc62ff9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.588+0000 7fac267fc640 1 -- 172.21.15.50:0/3005884422 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2002cbc0 con 0x7fac280b19d0 2023-08-10T10:38:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.588+0000 7fac267fc640 1 -- 172.21.15.50:0/3005884422 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2002cd20 con 0x7fac280b19d0 2023-08-10T10:38:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.588+0000 7fac267fc640 1 -- 172.21.15.50:0/3005884422 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20034660 con 0x7fac280b19d0 2023-08-10T10:38:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.588+0000 7fac27fff640 1 -- 172.21.15.50:0/3005884422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 msgr2=0x7fac280b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.588+0000 7fac27fff640 1 --2- 172.21.15.50:0/3005884422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac20009d90 tx=0x7fac2002be10 comp rx=0 tx=0).stop 2023-08-10T10:38:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 -- 172.21.15.50:0/3005884422 shutdown_connections 2023-08-10T10:38:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 --2- 172.21.15.50:0/3005884422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac280b19d0 0x7fac280b0450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 --2- 172.21.15.50:0/3005884422 >> v2:172.21.15.117:3300/0 conn(0x7fac2815a940 0x7fac280aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 -- 172.21.15.50:0/3005884422 >> 172.21.15.50:0/3005884422 conn(0x7fac2806ab80 msgr2=0x7fac2806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 -- 172.21.15.50:0/3005884422 shutdown_connections 2023-08-10T10:38:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.589+0000 7fac27fff640 1 -- 172.21.15.50:0/3005884422 wait complete. 2023-08-10T10:38:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.591+0000 7fac27fff640 1 Processor -- start 2023-08-10T10:38:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.591+0000 7fac27fff640 1 -- start start 2023-08-10T10:38:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac2815a940 0x7fac280c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac2815f2b0 0x7fac28071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28154f90 con 0x7fac280b19d0 2023-08-10T10:38:26.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2806e700 con 0x7fac2815a940 2023-08-10T10:38:26.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac27fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280c5c60 con 0x7fac2815f2b0 2023-08-10T10:38:26.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac26ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac26ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33260/0 (socket says 172.21.15.50:33260) 2023-08-10T10:38:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac26ffd640 1 -- 172.21.15.50:0/1931715790 learned_addr learned my addr 172.21.15.50:0/1931715790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac277fe640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac2815f2b0 0x7fac28071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.592+0000 7fac1e7fc640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac2815a940 0x7fac280c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 -- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac2815f2b0 msgr2=0x7fac28071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac2815f2b0 0x7fac28071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 -- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac2815a940 msgr2=0x7fac280c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac2815a940 0x7fac280c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 -- 172.21.15.50:0/1931715790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009a70 con 0x7fac280b19d0 2023-08-10T10:38:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac26ffd640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac1800e840 tx=0x7fac1800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800c8e0 con 0x7fac280b19d0 2023-08-10T10:38:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800ca40 con 0x7fac280b19d0 2023-08-10T10:38:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280c5f40 con 0x7fac280b19d0 2023-08-10T10:38:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800cdf0 con 0x7fac280b19d0 2023-08-10T10:38:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.593+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2815c390 con 0x7fac280b19d0 2023-08-10T10:38:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.595+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac28066e30 con 0x7fac280b19d0 2023-08-10T10:38:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.595+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac18013470 con 0x7fac280b19d0 2023-08-10T10:38:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.596+0000 7fac1ffff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 0x7fac0806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.596+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac18089630 con 0x7fac280b19d0 2023-08-10T10:38:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.597+0000 7fac1e7fc640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 0x7fac0806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.597+0000 7fac1e7fc640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 0x7fac0806d140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac280cbd00 tx=0x7fac10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.601+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac18054640 con 0x7fac280b19d0 2023-08-10T10:38:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.788+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac2815ed90 con 0x7fac0806ac80 2023-08-10T10:38:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.799+0000 7fac1ffff640 1 -- 172.21.15.50:0/1931715790 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280566 (secure 0 0 0) 0x7fac10001c70 con 0x7fac0806ac80 2023-08-10T10:38:26.803 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:38:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 msgr2=0x7fac0806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 0x7fac0806d140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac280cbd00 tx=0x7fac10009040 comp rx=0 tx=0).stop 2023-08-10T10:38:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 msgr2=0x7fac280c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac1800e840 tx=0x7fac1800ed00 comp rx=0 tx=0).stop 2023-08-10T10:38:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 shutdown_connections 2023-08-10T10:38:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac2815f2b0 0x7fac28071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0806ac80 0x7fac0806d140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac2815a940 0x7fac280c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 --2- 172.21.15.50:0/1931715790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b19d0 0x7fac280c2780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 >> 172.21.15.50:0/1931715790 conn(0x7fac2806ab80 msgr2=0x7fac2806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 shutdown_connections 2023-08-10T10:38:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:26.805+0000 7fac27fff640 1 -- 172.21.15.50:0/1931715790 wait complete. 2023-08-10T10:38:26.825 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-10T10:38:26.320389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560697,"statfs":{"total":1600000000,"available":1598154290,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002123"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.209949+0000","last_change":"2023-08-10T10:38:22.209741+0000","last_active":"2023-08-10T10:38:22.209949+0000","last_peered":"2023-08-10T10:38:22.209949+0000","last_clean":"2023-08-10T10:38:22.209949+0000","last_became_active":"2023-08-10T10:38:22.209086+0000","last_became_peered":"2023-08-10T10:38:22.209086+0000","last_unstale":"2023-08-10T10:38:22.209949+0000","last_undegraded":"2023-08-10T10:38:22.209949+0000","last_fullsized":"2023-08-10T10:38:22.209949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:57.587473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202298+0000","last_change":"2023-08-10T10:38:22.224666+0000","last_active":"2023-08-10T10:38:23.202298+0000","last_peered":"2023-08-10T10:38:23.202298+0000","last_clean":"2023-08-10T10:38:23.202298+0000","last_became_active":"2023-08-10T10:38:22.224412+0000","last_became_peered":"2023-08-10T10:38:22.224412+0000","last_unstale":"2023-08-10T10:38:23.202298+0000","last_undegraded":"2023-08-10T10:38:23.202298+0000","last_fullsized":"2023-08-10T10:38:23.202298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201886+0000","last_change":"2023-08-10T10:38:22.220964+0000","last_active":"2023-08-10T10:38:23.201886+0000","last_peered":"2023-08-10T10:38:23.201886+0000","last_clean":"2023-08-10T10:38:23.201886+0000","last_became_active":"2023-08-10T10:38:22.220680+0000","last_became_peered":"2023-08-10T10:38:22.220680+0000","last_unstale":"2023-08-10T10:38:23.201886+0000","last_undegraded":"2023-08-10T10:38:23.201886+0000","last_fullsized":"2023-08-10T10:38:23.201886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325437+0000","last_change":"2023-08-10T10:38:22.220325+0000","last_active":"2023-08-10T10:38:23.325437+0000","last_peered":"2023-08-10T10:38:23.325437+0000","last_clean":"2023-08-10T10:38:23.325437+0000","last_became_active":"2023-08-10T10:38:22.219756+0000","last_became_peered":"2023-08-10T10:38:22.219756+0000","last_unstale":"2023-08-10T10:38:23.325437+0000","last_undegraded":"2023-08-10T10:38:23.325437+0000","last_fullsized":"2023-08-10T10:38:23.325437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324712+0000","last_change":"2023-08-10T10:38:22.218733+0000","last_active":"2023-08-10T10:38:23.324712+0000","last_peered":"2023-08-10T10:38:23.324712+0000","last_clean":"2023-08-10T10:38:23.324712+0000","last_became_active":"2023-08-10T10:38:22.218457+0000","last_became_peered":"2023-08-10T10:38:22.218457+0000","last_unstale":"2023-08-10T10:38:23.324712+0000","last_undegraded":"2023-08-10T10:38:23.324712+0000","last_fullsized":"2023-08-10T10:38:23.324712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201252+0000","last_change":"2023-08-10T10:38:22.222593+0000","last_active":"2023-08-10T10:38:23.201252+0000","last_peered":"2023-08-10T10:38:23.201252+0000","last_clean":"2023-08-10T10:38:23.201252+0000","last_became_active":"2023-08-10T10:38:22.222180+0000","last_became_peered":"2023-08-10T10:38:22.222180+0000","last_unstale":"2023-08-10T10:38:23.201252+0000","last_undegraded":"2023-08-10T10:38:23.201252+0000","last_fullsized":"2023-08-10T10:38:23.201252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325878+0000","last_change":"2023-08-10T10:38:22.224370+0000","last_active":"2023-08-10T10:38:23.325878+0000","last_peered":"2023-08-10T10:38:23.325878+0000","last_clean":"2023-08-10T10:38:23.325878+0000","last_became_active":"2023-08-10T10:38:22.224117+0000","last_became_peered":"2023-08-10T10:38:22.224117+0000","last_unstale":"2023-08-10T10:38:23.325878+0000","last_undegraded":"2023-08-10T10:38:23.325878+0000","last_fullsized":"2023-08-10T10:38:23.325878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202295+0000","last_change":"2023-08-10T10:38:22.217074+0000","last_active":"2023-08-10T10:38:23.202295+0000","last_peered":"2023-08-10T10:38:23.202295+0000","last_clean":"2023-08-10T10:38:23.202295+0000","last_became_active":"2023-08-10T10:38:22.216567+0000","last_became_peered":"2023-08-10T10:38:22.216567+0000","last_unstale":"2023-08-10T10:38:23.202295+0000","last_undegraded":"2023-08-10T10:38:23.202295+0000","last_fullsized":"2023-08-10T10:38:23.202295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324543+0000","last_change":"2023-08-10T10:38:22.221017+0000","last_active":"2023-08-10T10:38:23.324543+0000","last_peered":"2023-08-10T10:38:23.324543+0000","last_clean":"2023-08-10T10:38:23.324543+0000","last_became_active":"2023-08-10T10:38:22.220731+0000","last_became_peered":"2023-08-10T10:38:22.220731+0000","last_unstale":"2023-08-10T10:38:23.324543+0000","last_undegraded":"2023-08-10T10:38:23.324543+0000","last_fullsized":"2023-08-10T10:38:23.324543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202425+0000","last_change":"2023-08-10T10:38:22.217793+0000","last_active":"2023-08-10T10:38:23.202425+0000","last_peered":"2023-08-10T10:38:23.202425+0000","last_clean":"2023-08-10T10:38:23.202425+0000","last_became_active":"2023-08-10T10:38:22.217531+0000","last_became_peered":"2023-08-10T10:38:22.217531+0000","last_unstale":"2023-08-10T10:38:23.202425+0000","last_undegraded":"2023-08-10T10:38:23.202425+0000","last_fullsized":"2023-08-10T10:38:23.202425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201607+0000","last_change":"2023-08-10T10:38:22.225166+0000","last_active":"2023-08-10T10:38:23.201607+0000","last_peered":"2023-08-10T10:38:23.201607+0000","last_clean":"2023-08-10T10:38:23.201607+0000","last_became_active":"2023-08-10T10:38:22.224921+0000","last_became_peered":"2023-08-10T10:38:22.224921+0000","last_unstale":"2023-08-10T10:38:23.201607+0000","last_undegraded":"2023-08-10T10:38:23.201607+0000","last_fullsized":"2023-08-10T10:38:23.201607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.197698+0000","last_change":"2023-08-10T10:38:22.197404+0000","last_active":"2023-08-10T10:38:22.197698+0000","last_peered":"2023-08-10T10:38:22.197698+0000","last_clean":"2023-08-10T10:38:22.197698+0000","last_became_active":"2023-08-10T10:38:22.196746+0000","last_became_peered":"2023-08-10T10:38:22.196746+0000","last_unstale":"2023-08-10T10:38:22.197698+0000","last_undegraded":"2023-08-10T10:38:22.197698+0000","last_fullsized":"2023-08-10T10:38:22.197698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:46.956429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.205260+0000","last_change":"2023-08-10T10:38:22.204317+0000","last_active":"2023-08-10T10:38:22.205260+0000","last_peered":"2023-08-10T10:38:22.205260+0000","last_clean":"2023-08-10T10:38:22.205260+0000","last_became_active":"2023-08-10T10:38:22.203630+0000","last_became_peered":"2023-08-10T10:38:22.203630+0000","last_unstale":"2023-08-10T10:38:22.205260+0000","last_undegraded":"2023-08-10T10:38:22.205260+0000","last_fullsized":"2023-08-10T10:38:22.205260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:19.616107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201451+0000","last_change":"2023-08-10T10:38:22.212769+0000","last_active":"2023-08-10T10:38:23.201451+0000","last_peered":"2023-08-10T10:38:23.201451+0000","last_clean":"2023-08-10T10:38:23.201451+0000","last_became_active":"2023-08-10T10:38:22.212324+0000","last_became_peered":"2023-08-10T10:38:22.212324+0000","last_unstale":"2023-08-10T10:38:23.201451+0000","last_undegraded":"2023-08-10T10:38:23.201451+0000","last_fullsized":"2023-08-10T10:38:23.201451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326152+0000","last_change":"2023-08-10T10:38:22.214280+0000","last_active":"2023-08-10T10:38:23.326152+0000","last_peered":"2023-08-10T10:38:23.326152+0000","last_clean":"2023-08-10T10:38:23.326152+0000","last_became_active":"2023-08-10T10:38:22.214007+0000","last_became_peered":"2023-08-10T10:38:22.214007+0000","last_unstale":"2023-08-10T10:38:23.326152+0000","last_undegraded":"2023-08-10T10:38:23.326152+0000","last_fullsized":"2023-08-10T10:38:23.326152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202287+0000","last_change":"2023-08-10T10:38:22.222420+0000","last_active":"2023-08-10T10:38:23.202287+0000","last_peered":"2023-08-10T10:38:23.202287+0000","last_clean":"2023-08-10T10:38:23.202287+0000","last_became_active":"2023-08-10T10:38:22.221840+0000","last_became_peered":"2023-08-10T10:38:22.221840+0000","last_unstale":"2023-08-10T10:38:23.202287+0000","last_undegraded":"2023-08-10T10:38:23.202287+0000","last_fullsized":"2023-08-10T10:38:23.202287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324343+0000","last_change":"2023-08-10T10:38:22.221851+0000","last_active":"2023-08-10T10:38:23.324343+0000","last_peered":"2023-08-10T10:38:23.324343+0000","last_clean":"2023-08-10T10:38:23.324343+0000","last_became_active":"2023-08-10T10:38:22.221350+0000","last_became_peered":"2023-08-10T10:38:22.221350+0000","last_unstale":"2023-08-10T10:38:23.324343+0000","last_undegraded":"2023-08-10T10:38:23.324343+0000","last_fullsized":"2023-08-10T10:38:23.324343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201197+0000","last_change":"2023-08-10T10:38:22.213747+0000","last_active":"2023-08-10T10:38:23.201197+0000","last_peered":"2023-08-10T10:38:23.201197+0000","last_clean":"2023-08-10T10:38:23.201197+0000","last_became_active":"2023-08-10T10:38:22.212182+0000","last_became_peered":"2023-08-10T10:38:22.212182+0000","last_unstale":"2023-08-10T10:38:23.201197+0000","last_undegraded":"2023-08-10T10:38:23.201197+0000","last_fullsized":"2023-08-10T10:38:23.201197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.214522+0000","last_change":"2023-08-10T10:38:22.214414+0000","last_active":"2023-08-10T10:38:22.214522+0000","last_peered":"2023-08-10T10:38:22.214522+0000","last_clean":"2023-08-10T10:38:22.214522+0000","last_became_active":"2023-08-10T10:38:22.213797+0000","last_became_peered":"2023-08-10T10:38:22.213797+0000","last_unstale":"2023-08-10T10:38:22.214522+0000","last_undegraded":"2023-08-10T10:38:22.214522+0000","last_fullsized":"2023-08-10T10:38:22.214522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:29:19.177342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201675+0000","last_change":"2023-08-10T10:38:22.222520+0000","last_active":"2023-08-10T10:38:23.201675+0000","last_peered":"2023-08-10T10:38:23.201675+0000","last_clean":"2023-08-10T10:38:23.201675+0000","last_became_active":"2023-08-10T10:38:22.221771+0000","last_became_peered":"2023-08-10T10:38:22.221771+0000","last_unstale":"2023-08-10T10:38:23.201675+0000","last_undegraded":"2023-08-10T10:38:23.201675+0000","last_fullsized":"2023-08-10T10:38:23.201675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326586+0000","last_change":"2023-08-10T10:38:22.217371+0000","last_active":"2023-08-10T10:38:23.326586+0000","last_peered":"2023-08-10T10:38:23.326586+0000","last_clean":"2023-08-10T10:38:23.326586+0000","last_became_active":"2023-08-10T10:38:22.216957+0000","last_became_peered":"2023-08-10T10:38:22.216957+0000","last_unstale":"2023-08-10T10:38:23.326586+0000","last_undegraded":"2023-08-10T10:38:23.326586+0000","last_fullsized":"2023-08-10T10:38:23.326586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.692722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324539+0000","last_change":"2023-08-10T10:38:22.226850+0000","last_active":"2023-08-10T10:38:23.324539+0000","last_peered":"2023-08-10T10:38:23.324539+0000","last_clean":"2023-08-10T10:38:23.324539+0000","last_became_active":"2023-08-10T10:38:22.226586+0000","last_became_peered":"2023-08-10T10:38:22.226586+0000","last_unstale":"2023-08-10T10:38:23.324539+0000","last_undegraded":"2023-08-10T10:38:23.324539+0000","last_fullsized":"2023-08-10T10:38:23.324539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199969+0000","last_change":"2023-08-10T10:38:22.220488+0000","last_active":"2023-08-10T10:38:23.199969+0000","last_peered":"2023-08-10T10:38:23.199969+0000","last_clean":"2023-08-10T10:38:23.199969+0000","last_became_active":"2023-08-10T10:38:22.220213+0000","last_became_peered":"2023-08-10T10:38:22.220213+0000","last_unstale":"2023-08-10T10:38:23.199969+0000","last_undegraded":"2023-08-10T10:38:23.199969+0000","last_fullsized":"2023-08-10T10:38:23.199969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326905+0000","last_change":"2023-08-10T10:38:22.222504+0000","last_active":"2023-08-10T10:38:23.326905+0000","last_peered":"2023-08-10T10:38:23.326905+0000","last_clean":"2023-08-10T10:38:23.326905+0000","last_became_active":"2023-08-10T10:38:22.219256+0000","last_became_peered":"2023-08-10T10:38:22.219256+0000","last_unstale":"2023-08-10T10:38:23.326905+0000","last_undegraded":"2023-08-10T10:38:23.326905+0000","last_fullsized":"2023-08-10T10:38:23.326905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:27.097082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.230855+0000","last_change":"2023-08-10T10:38:22.230697+0000","last_active":"2023-08-10T10:38:22.230855+0000","last_peered":"2023-08-10T10:38:22.230855+0000","last_clean":"2023-08-10T10:38:22.230855+0000","last_became_active":"2023-08-10T10:38:22.230177+0000","last_became_peered":"2023-08-10T10:38:22.230177+0000","last_unstale":"2023-08-10T10:38:22.230855+0000","last_undegraded":"2023-08-10T10:38:22.230855+0000","last_fullsized":"2023-08-10T10:38:22.230855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:43.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.230632+0000","last_change":"2023-08-10T10:38:22.230488+0000","last_active":"2023-08-10T10:38:22.230632+0000","last_peered":"2023-08-10T10:38:22.230632+0000","last_clean":"2023-08-10T10:38:22.230632+0000","last_became_active":"2023-08-10T10:38:22.230126+0000","last_became_peered":"2023-08-10T10:38:22.230126+0000","last_unstale":"2023-08-10T10:38:22.230632+0000","last_undegraded":"2023-08-10T10:38:22.230632+0000","last_fullsized":"2023-08-10T10:38:22.230632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:59.709121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202624+0000","last_change":"2023-08-10T10:38:22.218566+0000","last_active":"2023-08-10T10:38:23.202624+0000","last_peered":"2023-08-10T10:38:23.202624+0000","last_clean":"2023-08-10T10:38:23.202624+0000","last_became_active":"2023-08-10T10:38:22.218315+0000","last_became_peered":"2023-08-10T10:38:22.218315+0000","last_unstale":"2023-08-10T10:38:23.202624+0000","last_undegraded":"2023-08-10T10:38:23.202624+0000","last_fullsized":"2023-08-10T10:38:23.202624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.223623+0000","last_change":"2023-08-10T10:38:22.223531+0000","last_active":"2023-08-10T10:38:22.223623+0000","last_peered":"2023-08-10T10:38:22.223623+0000","last_clean":"2023-08-10T10:38:22.223623+0000","last_became_active":"2023-08-10T10:38:22.214439+0000","last_became_peered":"2023-08-10T10:38:22.214439+0000","last_unstale":"2023-08-10T10:38:22.223623+0000","last_undegraded":"2023-08-10T10:38:22.223623+0000","last_fullsized":"2023-08-10T10:38:22.223623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200614+0000","last_change":"2023-08-10T10:38:22.218268+0000","last_active":"2023-08-10T10:38:23.200614+0000","last_peered":"2023-08-10T10:38:23.200614+0000","last_clean":"2023-08-10T10:38:23.200614+0000","last_became_active":"2023-08-10T10:38:22.217322+0000","last_became_peered":"2023-08-10T10:38:22.217322+0000","last_unstale":"2023-08-10T10:38:23.200614+0000","last_undegraded":"2023-08-10T10:38:23.200614+0000","last_fullsized":"2023-08-10T10:38:23.200614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201983+0000","last_change":"2023-08-10T10:38:22.222356+0000","last_active":"2023-08-10T10:38:23.201983+0000","last_peered":"2023-08-10T10:38:23.201983+0000","last_clean":"2023-08-10T10:38:23.201983+0000","last_became_active":"2023-08-10T10:38:22.221452+0000","last_became_peered":"2023-08-10T10:38:22.221452+0000","last_unstale":"2023-08-10T10:38:23.201983+0000","last_undegraded":"2023-08-10T10:38:23.201983+0000","last_fullsized":"2023-08-10T10:38:23.201983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200438+0000","last_change":"2023-08-10T10:38:22.225427+0000","last_active":"2023-08-10T10:38:23.200438+0000","last_peered":"2023-08-10T10:38:23.200438+0000","last_clean":"2023-08-10T10:38:23.200438+0000","last_became_active":"2023-08-10T10:38:22.225202+0000","last_became_peered":"2023-08-10T10:38:22.225202+0000","last_unstale":"2023-08-10T10:38:23.200438+0000","last_undegraded":"2023-08-10T10:38:23.200438+0000","last_fullsized":"2023-08-10T10:38:23.200438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325176+0000","last_change":"2023-08-10T10:38:22.209191+0000","last_active":"2023-08-10T10:38:23.325176+0000","last_peered":"2023-08-10T10:38:23.325176+0000","last_clean":"2023-08-10T10:38:23.325176+0000","last_became_active":"2023-08-10T10:38:22.208584+0000","last_became_peered":"2023-08-10T10:38:22.208584+0000","last_unstale":"2023-08-10T10:38:23.325176+0000","last_undegraded":"2023-08-10T10:38:23.325176+0000","last_fullsized":"2023-08-10T10:38:23.325176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201306+0000","last_change":"2023-08-10T10:38:22.212595+0000","last_active":"2023-08-10T10:38:23.201306+0000","last_peered":"2023-08-10T10:38:23.201306+0000","last_clean":"2023-08-10T10:38:23.201306+0000","last_became_active":"2023-08-10T10:38:22.211581+0000","last_became_peered":"2023-08-10T10:38:22.211581+0000","last_unstale":"2023-08-10T10:38:23.201306+0000","last_undegraded":"2023-08-10T10:38:23.201306+0000","last_fullsized":"2023-08-10T10:38:23.201306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326485+0000","last_change":"2023-08-10T10:38:21.209499+0000","last_active":"2023-08-10T10:38:23.326485+0000","last_peered":"2023-08-10T10:38:23.326485+0000","last_clean":"2023-08-10T10:38:23.326485+0000","last_became_active":"2023-08-10T10:38:21.208930+0000","last_became_peered":"2023-08-10T10:38:21.208930+0000","last_unstale":"2023-08-10T10:38:23.326485+0000","last_undegraded":"2023-08-10T10:38:23.326485+0000","last_fullsized":"2023-08-10T10:38:23.326485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202626+0000","last_change":"2023-08-10T10:38:22.216900+0000","last_active":"2023-08-10T10:38:23.202626+0000","last_peered":"2023-08-10T10:38:23.202626+0000","last_clean":"2023-08-10T10:38:23.202626+0000","last_became_active":"2023-08-10T10:38:22.216199+0000","last_became_peered":"2023-08-10T10:38:22.216199+0000","last_unstale":"2023-08-10T10:38:23.202626+0000","last_undegraded":"2023-08-10T10:38:23.202626+0000","last_fullsized":"2023-08-10T10:38:23.202626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325918+0000","last_change":"2023-08-10T10:38:21.202495+0000","last_active":"2023-08-10T10:38:23.325918+0000","last_peered":"2023-08-10T10:38:23.325918+0000","last_clean":"2023-08-10T10:38:23.325918+0000","last_became_active":"2023-08-10T10:38:21.201907+0000","last_became_peered":"2023-08-10T10:38:21.201907+0000","last_unstale":"2023-08-10T10:38:23.325918+0000","last_undegraded":"2023-08-10T10:38:23.325918+0000","last_fullsized":"2023-08-10T10:38:23.325918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324734+0000","last_change":"2023-08-10T10:38:22.221638+0000","last_active":"2023-08-10T10:38:23.324734+0000","last_peered":"2023-08-10T10:38:23.324734+0000","last_clean":"2023-08-10T10:38:23.324734+0000","last_became_active":"2023-08-10T10:38:22.220935+0000","last_became_peered":"2023-08-10T10:38:22.220935+0000","last_unstale":"2023-08-10T10:38:23.324734+0000","last_undegraded":"2023-08-10T10:38:23.324734+0000","last_fullsized":"2023-08-10T10:38:23.324734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326520+0000","last_change":"2023-08-10T10:38:21.204133+0000","last_active":"2023-08-10T10:38:23.326520+0000","last_peered":"2023-08-10T10:38:23.326520+0000","last_clean":"2023-08-10T10:38:23.326520+0000","last_became_active":"2023-08-10T10:38:21.203842+0000","last_became_peered":"2023-08-10T10:38:21.203842+0000","last_unstale":"2023-08-10T10:38:23.326520+0000","last_undegraded":"2023-08-10T10:38:23.326520+0000","last_fullsized":"2023-08-10T10:38:23.326520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200052+0000","last_change":"2023-08-10T10:38:22.215664+0000","last_active":"2023-08-10T10:38:23.200052+0000","last_peered":"2023-08-10T10:38:23.200052+0000","last_clean":"2023-08-10T10:38:23.200052+0000","last_became_active":"2023-08-10T10:38:22.212636+0000","last_became_peered":"2023-08-10T10:38:22.212636+0000","last_unstale":"2023-08-10T10:38:23.200052+0000","last_undegraded":"2023-08-10T10:38:23.200052+0000","last_fullsized":"2023-08-10T10:38:23.200052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325452+0000","last_change":"2023-08-10T10:38:21.204543+0000","last_active":"2023-08-10T10:38:23.325452+0000","last_peered":"2023-08-10T10:38:23.325452+0000","last_clean":"2023-08-10T10:38:23.325452+0000","last_became_active":"2023-08-10T10:38:21.204298+0000","last_became_peered":"2023-08-10T10:38:21.204298+0000","last_unstale":"2023-08-10T10:38:23.325452+0000","last_undegraded":"2023-08-10T10:38:23.325452+0000","last_fullsized":"2023-08-10T10:38:23.325452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:42.165678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327421+0000","last_change":"2023-08-10T10:38:21.204939+0000","last_active":"2023-08-10T10:38:23.327421+0000","last_peered":"2023-08-10T10:38:23.327421+0000","last_clean":"2023-08-10T10:38:23.327421+0000","last_became_active":"2023-08-10T10:38:21.204670+0000","last_became_peered":"2023-08-10T10:38:21.204670+0000","last_unstale":"2023-08-10T10:38:23.327421+0000","last_undegraded":"2023-08-10T10:38:23.327421+0000","last_fullsized":"2023-08-10T10:38:23.327421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:15.925392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203322+0000","last_change":"2023-08-10T10:38:22.215812+0000","last_active":"2023-08-10T10:38:23.203322+0000","last_peered":"2023-08-10T10:38:23.203322+0000","last_clean":"2023-08-10T10:38:23.203322+0000","last_became_active":"2023-08-10T10:38:22.215518+0000","last_became_peered":"2023-08-10T10:38:22.215518+0000","last_unstale":"2023-08-10T10:38:23.203322+0000","last_undegraded":"2023-08-10T10:38:23.203322+0000","last_fullsized":"2023-08-10T10:38:23.203322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326826+0000","last_change":"2023-08-10T10:38:21.209700+0000","last_active":"2023-08-10T10:38:23.326826+0000","last_peered":"2023-08-10T10:38:23.326826+0000","last_clean":"2023-08-10T10:38:23.326826+0000","last_became_active":"2023-08-10T10:38:21.209258+0000","last_became_peered":"2023-08-10T10:38:21.209258+0000","last_unstale":"2023-08-10T10:38:23.326826+0000","last_undegraded":"2023-08-10T10:38:23.326826+0000","last_fullsized":"2023-08-10T10:38:23.326826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:10.268662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202875+0000","last_change":"2023-08-10T10:38:22.210784+0000","last_active":"2023-08-10T10:38:23.202875+0000","last_peered":"2023-08-10T10:38:23.202875+0000","last_clean":"2023-08-10T10:38:23.202875+0000","last_became_active":"2023-08-10T10:38:22.210275+0000","last_became_peered":"2023-08-10T10:38:22.210275+0000","last_unstale":"2023-08-10T10:38:23.202875+0000","last_undegraded":"2023-08-10T10:38:23.202875+0000","last_fullsized":"2023-08-10T10:38:23.202875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:31.071882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326869+0000","last_change":"2023-08-10T10:38:21.201970+0000","last_active":"2023-08-10T10:38:23.326869+0000","last_peered":"2023-08-10T10:38:23.326869+0000","last_clean":"2023-08-10T10:38:23.326869+0000","last_became_active":"2023-08-10T10:38:21.201599+0000","last_became_peered":"2023-08-10T10:38:21.201599+0000","last_unstale":"2023-08-10T10:38:23.326869+0000","last_undegraded":"2023-08-10T10:38:23.326869+0000","last_fullsized":"2023-08-10T10:38:23.326869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:15.895041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325811+0000","last_change":"2023-08-10T10:38:22.224729+0000","last_active":"2023-08-10T10:38:23.325811+0000","last_peered":"2023-08-10T10:38:23.325811+0000","last_clean":"2023-08-10T10:38:23.325811+0000","last_became_active":"2023-08-10T10:38:22.224473+0000","last_became_peered":"2023-08-10T10:38:22.224473+0000","last_unstale":"2023-08-10T10:38:23.325811+0000","last_undegraded":"2023-08-10T10:38:23.325811+0000","last_fullsized":"2023-08-10T10:38:23.325811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:32.356113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203242+0000","last_change":"2023-08-10T10:38:21.197513+0000","last_active":"2023-08-10T10:38:23.203242+0000","last_peered":"2023-08-10T10:38:23.203242+0000","last_clean":"2023-08-10T10:38:23.203242+0000","last_became_active":"2023-08-10T10:38:21.197186+0000","last_became_peered":"2023-08-10T10:38:21.197186+0000","last_unstale":"2023-08-10T10:38:23.203242+0000","last_undegraded":"2023-08-10T10:38:23.203242+0000","last_fullsized":"2023-08-10T10:38:23.203242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:10.021641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324784+0000","last_change":"2023-08-10T10:38:22.227601+0000","last_active":"2023-08-10T10:38:23.324784+0000","last_peered":"2023-08-10T10:38:23.324784+0000","last_clean":"2023-08-10T10:38:23.324784+0000","last_became_active":"2023-08-10T10:38:22.227145+0000","last_became_peered":"2023-08-10T10:38:22.227145+0000","last_unstale":"2023-08-10T10:38:23.324784+0000","last_undegraded":"2023-08-10T10:38:23.324784+0000","last_fullsized":"2023-08-10T10:38:23.324784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200784+0000","last_change":"2023-08-10T10:38:21.206280+0000","last_active":"2023-08-10T10:38:23.200784+0000","last_peered":"2023-08-10T10:38:23.200784+0000","last_clean":"2023-08-10T10:38:23.200784+0000","last_became_active":"2023-08-10T10:38:21.205889+0000","last_became_peered":"2023-08-10T10:38:21.205889+0000","last_unstale":"2023-08-10T10:38:23.200784+0000","last_undegraded":"2023-08-10T10:38:23.200784+0000","last_fullsized":"2023-08-10T10:38:23.200784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201888+0000","last_change":"2023-08-10T10:38:22.204248+0000","last_active":"2023-08-10T10:38:23.201888+0000","last_peered":"2023-08-10T10:38:23.201888+0000","last_clean":"2023-08-10T10:38:23.201888+0000","last_became_active":"2023-08-10T10:38:22.199227+0000","last_became_peered":"2023-08-10T10:38:22.199227+0000","last_unstale":"2023-08-10T10:38:23.201888+0000","last_undegraded":"2023-08-10T10:38:23.201888+0000","last_fullsized":"2023-08-10T10:38:23.201888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326432+0000","last_change":"2023-08-10T10:38:21.205456+0000","last_active":"2023-08-10T10:38:23.326432+0000","last_peered":"2023-08-10T10:38:23.326432+0000","last_clean":"2023-08-10T10:38:23.326432+0000","last_became_active":"2023-08-10T10:38:21.205215+0000","last_became_peered":"2023-08-10T10:38:21.205215+0000","last_unstale":"2023-08-10T10:38:23.326432+0000","last_undegraded":"2023-08-10T10:38:23.326432+0000","last_fullsized":"2023-08-10T10:38:23.326432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201985+0000","last_change":"2023-08-10T10:38:22.199554+0000","last_active":"2023-08-10T10:38:23.201985+0000","last_peered":"2023-08-10T10:38:23.201985+0000","last_clean":"2023-08-10T10:38:23.201985+0000","last_became_active":"2023-08-10T10:38:22.198747+0000","last_became_peered":"2023-08-10T10:38:22.198747+0000","last_unstale":"2023-08-10T10:38:23.201985+0000","last_undegraded":"2023-08-10T10:38:23.201985+0000","last_fullsized":"2023-08-10T10:38:23.201985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203786+0000","last_change":"2023-08-10T10:38:21.208724+0000","last_active":"2023-08-10T10:38:23.203786+0000","last_peered":"2023-08-10T10:38:23.203786+0000","last_clean":"2023-08-10T10:38:23.203786+0000","last_became_active":"2023-08-10T10:38:21.207707+0000","last_became_peered":"2023-08-10T10:38:21.207707+0000","last_unstale":"2023-08-10T10:38:23.203786+0000","last_undegraded":"2023-08-10T10:38:23.203786+0000","last_fullsized":"2023-08-10T10:38:23.203786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:26.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203495+0000","last_change":"2023-08-10T10:38:22.221214+0000","last_active":"2023-08-10T10:38:23.203495+0000","last_peered":"2023-08-10T10:38:23.203495+0000","last_clean":"2023-08-10T10:38:23.203495+0000","last_became_active":"2023-08-10T10:38:22.220236+0000","last_became_peered":"2023-08-10T10:38:22.220236+0000","last_unstale":"2023-08-10T10:38:23.203495+0000","last_undegraded":"2023-08-10T10:38:23.203495+0000","last_fullsized":"2023-08-10T10:38:23.203495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:16.910102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200842+0000","last_change":"2023-08-10T10:38:21.203702+0000","last_active":"2023-08-10T10:38:23.200842+0000","last_peered":"2023-08-10T10:38:23.200842+0000","last_clean":"2023-08-10T10:38:23.200842+0000","last_became_active":"2023-08-10T10:38:21.203440+0000","last_became_peered":"2023-08-10T10:38:21.203440+0000","last_unstale":"2023-08-10T10:38:23.200842+0000","last_undegraded":"2023-08-10T10:38:23.200842+0000","last_fullsized":"2023-08-10T10:38:23.200842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225556+0000","last_change":"2023-08-10T10:38:22.225268+0000","last_active":"2023-08-10T10:38:22.225556+0000","last_peered":"2023-08-10T10:38:22.225556+0000","last_clean":"2023-08-10T10:38:22.225556+0000","last_became_active":"2023-08-10T10:38:22.224857+0000","last_became_peered":"2023-08-10T10:38:22.224857+0000","last_unstale":"2023-08-10T10:38:22.225556+0000","last_undegraded":"2023-08-10T10:38:22.225556+0000","last_fullsized":"2023-08-10T10:38:22.225556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:50.180344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.328222+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:38:23.328222+0000","last_peered":"2023-08-10T10:38:23.328222+0000","last_clean":"2023-08-10T10:38:23.328222+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:38:23.328222+0000","last_undegraded":"2023-08-10T10:38:23.328222+0000","last_fullsized":"2023-08-10T10:38:23.328222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:21.161219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203958+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:38:23.203958+0000","last_peered":"2023-08-10T10:38:23.203958+0000","last_clean":"2023-08-10T10:38:23.203958+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:38:23.203958+0000","last_undegraded":"2023-08-10T10:38:23.203958+0000","last_fullsized":"2023-08-10T10:38:23.203958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:24.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201315+0000","last_change":"2023-08-10T10:38:21.202544+0000","last_active":"2023-08-10T10:38:23.201315+0000","last_peered":"2023-08-10T10:38:23.201315+0000","last_clean":"2023-08-10T10:38:23.201315+0000","last_became_active":"2023-08-10T10:38:21.202310+0000","last_became_peered":"2023-08-10T10:38:21.202310+0000","last_unstale":"2023-08-10T10:38:23.201315+0000","last_undegraded":"2023-08-10T10:38:23.201315+0000","last_fullsized":"2023-08-10T10:38:23.201315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326145+0000","last_change":"2023-08-10T10:38:22.220675+0000","last_active":"2023-08-10T10:38:23.326145+0000","last_peered":"2023-08-10T10:38:23.326145+0000","last_clean":"2023-08-10T10:38:23.326145+0000","last_became_active":"2023-08-10T10:38:22.220074+0000","last_became_peered":"2023-08-10T10:38:22.220074+0000","last_unstale":"2023-08-10T10:38:23.326145+0000","last_undegraded":"2023-08-10T10:38:23.326145+0000","last_fullsized":"2023-08-10T10:38:23.326145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327929+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:38:23.327929+0000","last_peered":"2023-08-10T10:38:23.327929+0000","last_clean":"2023-08-10T10:38:23.327929+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:38:23.327929+0000","last_undegraded":"2023-08-10T10:38:23.327929+0000","last_fullsized":"2023-08-10T10:38:23.327929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:11.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325615+0000","last_change":"2023-08-10T10:38:21.206286+0000","last_active":"2023-08-10T10:38:23.325615+0000","last_peered":"2023-08-10T10:38:23.325615+0000","last_clean":"2023-08-10T10:38:23.325615+0000","last_became_active":"2023-08-10T10:38:21.205708+0000","last_became_peered":"2023-08-10T10:38:21.205708+0000","last_unstale":"2023-08-10T10:38:23.325615+0000","last_undegraded":"2023-08-10T10:38:23.325615+0000","last_fullsized":"2023-08-10T10:38:23.325615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325132+0000","last_change":"2023-08-10T10:38:22.227415+0000","last_active":"2023-08-10T10:38:23.325132+0000","last_peered":"2023-08-10T10:38:23.325132+0000","last_clean":"2023-08-10T10:38:23.325132+0000","last_became_active":"2023-08-10T10:38:22.226780+0000","last_became_peered":"2023-08-10T10:38:22.226780+0000","last_unstale":"2023-08-10T10:38:23.325132+0000","last_undegraded":"2023-08-10T10:38:23.325132+0000","last_fullsized":"2023-08-10T10:38:23.325132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.194801+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:38:22.194801+0000","last_peered":"2023-08-10T10:38:22.194801+0000","last_clean":"2023-08-10T10:38:22.194801+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:38:22.194801+0000","last_undegraded":"2023-08-10T10:38:22.194801+0000","last_fullsized":"2023-08-10T10:38:22.194801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:26:52.758209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.201484+0000","last_change":"2023-08-10T10:38:21.195201+0000","last_active":"2023-08-10T10:38:22.201484+0000","last_peered":"2023-08-10T10:38:22.201484+0000","last_clean":"2023-08-10T10:38:22.201484+0000","last_became_active":"2023-08-10T10:38:21.194755+0000","last_became_peered":"2023-08-10T10:38:21.194755+0000","last_unstale":"2023-08-10T10:38:22.201484+0000","last_undegraded":"2023-08-10T10:38:22.201484+0000","last_fullsized":"2023-08-10T10:38:22.201484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:16.172173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225946+0000","last_change":"2023-08-10T10:38:22.225863+0000","last_active":"2023-08-10T10:38:22.225946+0000","last_peered":"2023-08-10T10:38:22.225946+0000","last_clean":"2023-08-10T10:38:22.225946+0000","last_became_active":"2023-08-10T10:38:22.225087+0000","last_became_peered":"2023-08-10T10:38:22.225087+0000","last_unstale":"2023-08-10T10:38:22.225946+0000","last_undegraded":"2023-08-10T10:38:22.225946+0000","last_fullsized":"2023-08-10T10:38:22.225946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:26.818785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203433+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:38:23.203433+0000","last_peered":"2023-08-10T10:38:23.203433+0000","last_clean":"2023-08-10T10:38:23.203433+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:38:23.203433+0000","last_undegraded":"2023-08-10T10:38:23.203433+0000","last_fullsized":"2023-08-10T10:38:23.203433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.917501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202604+0000","last_change":"2023-08-10T10:38:21.208553+0000","last_active":"2023-08-10T10:38:23.202604+0000","last_peered":"2023-08-10T10:38:23.202604+0000","last_clean":"2023-08-10T10:38:23.202604+0000","last_became_active":"2023-08-10T10:38:21.207885+0000","last_became_peered":"2023-08-10T10:38:21.207885+0000","last_unstale":"2023-08-10T10:38:23.202604+0000","last_undegraded":"2023-08-10T10:38:23.202604+0000","last_fullsized":"2023-08-10T10:38:23.202604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.213277+0000","last_change":"2023-08-10T10:38:22.209787+0000","last_active":"2023-08-10T10:38:22.213277+0000","last_peered":"2023-08-10T10:38:22.213277+0000","last_clean":"2023-08-10T10:38:22.213277+0000","last_became_active":"2023-08-10T10:38:22.209252+0000","last_became_peered":"2023-08-10T10:38:22.209252+0000","last_unstale":"2023-08-10T10:38:22.213277+0000","last_undegraded":"2023-08-10T10:38:22.213277+0000","last_fullsized":"2023-08-10T10:38:22.213277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201820+0000","last_change":"2023-08-10T10:38:21.199662+0000","last_active":"2023-08-10T10:38:23.201820+0000","last_peered":"2023-08-10T10:38:23.201820+0000","last_clean":"2023-08-10T10:38:23.201820+0000","last_became_active":"2023-08-10T10:38:21.199287+0000","last_became_peered":"2023-08-10T10:38:21.199287+0000","last_unstale":"2023-08-10T10:38:23.201820+0000","last_undegraded":"2023-08-10T10:38:23.201820+0000","last_fullsized":"2023-08-10T10:38:23.201820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.206754+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:38:22.206754+0000","last_peered":"2023-08-10T10:38:22.206754+0000","last_clean":"2023-08-10T10:38:22.206754+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:38:22.206754+0000","last_undegraded":"2023-08-10T10:38:22.206754+0000","last_fullsized":"2023-08-10T10:38:22.206754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:25.296287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225774+0000","last_change":"2023-08-10T10:38:22.225637+0000","last_active":"2023-08-10T10:38:22.225774+0000","last_peered":"2023-08-10T10:38:22.225774+0000","last_clean":"2023-08-10T10:38:22.225774+0000","last_became_active":"2023-08-10T10:38:22.224629+0000","last_became_peered":"2023-08-10T10:38:22.224629+0000","last_unstale":"2023-08-10T10:38:22.225774+0000","last_undegraded":"2023-08-10T10:38:22.225774+0000","last_fullsized":"2023-08-10T10:38:22.225774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:08.468410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.206527+0000","last_change":"2023-08-10T10:38:21.200714+0000","last_active":"2023-08-10T10:38:22.206527+0000","last_peered":"2023-08-10T10:38:22.206527+0000","last_clean":"2023-08-10T10:38:22.206527+0000","last_became_active":"2023-08-10T10:38:21.200451+0000","last_became_peered":"2023-08-10T10:38:21.200451+0000","last_unstale":"2023-08-10T10:38:22.206527+0000","last_undegraded":"2023-08-10T10:38:22.206527+0000","last_fullsized":"2023-08-10T10:38:22.206527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:48.872077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327627+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:38:23.327627+0000","last_peered":"2023-08-10T10:38:23.327627+0000","last_clean":"2023-08-10T10:38:23.327627+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:38:23.327627+0000","last_undegraded":"2023-08-10T10:38:23.327627+0000","last_fullsized":"2023-08-10T10:38:23.327627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:23.252217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325297+0000","last_change":"2023-08-10T10:38:22.216529+0000","last_active":"2023-08-10T10:38:23.325297+0000","last_peered":"2023-08-10T10:38:23.325297+0000","last_clean":"2023-08-10T10:38:23.325297+0000","last_became_active":"2023-08-10T10:38:22.216258+0000","last_became_peered":"2023-08-10T10:38:22.216258+0000","last_unstale":"2023-08-10T10:38:23.325297+0000","last_undegraded":"2023-08-10T10:38:23.325297+0000","last_fullsized":"2023-08-10T10:38:23.325297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200984+0000","last_change":"2023-08-10T10:38:21.201020+0000","last_active":"2023-08-10T10:38:23.200984+0000","last_peered":"2023-08-10T10:38:23.200984+0000","last_clean":"2023-08-10T10:38:23.200984+0000","last_became_active":"2023-08-10T10:38:21.200776+0000","last_became_peered":"2023-08-10T10:38:21.200776+0000","last_unstale":"2023-08-10T10:38:23.200984+0000","last_undegraded":"2023-08-10T10:38:23.200984+0000","last_fullsized":"2023-08-10T10:38:23.200984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.204764+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:38:22.204764+0000","last_peered":"2023-08-10T10:38:22.204764+0000","last_clean":"2023-08-10T10:38:22.204764+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:38:22.204764+0000","last_undegraded":"2023-08-10T10:38:22.204764+0000","last_fullsized":"2023-08-10T10:38:22.204764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:05.448881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200047+0000","last_change":"2023-08-10T10:38:22.218095+0000","last_active":"2023-08-10T10:38:23.200047+0000","last_peered":"2023-08-10T10:38:23.200047+0000","last_clean":"2023-08-10T10:38:23.200047+0000","last_became_active":"2023-08-10T10:38:22.216987+0000","last_became_peered":"2023-08-10T10:38:22.216987+0000","last_unstale":"2023-08-10T10:38:23.200047+0000","last_undegraded":"2023-08-10T10:38:23.200047+0000","last_fullsized":"2023-08-10T10:38:23.200047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324524+0000","last_change":"2023-08-10T10:38:21.205196+0000","last_active":"2023-08-10T10:38:23.324524+0000","last_peered":"2023-08-10T10:38:23.324524+0000","last_clean":"2023-08-10T10:38:23.324524+0000","last_became_active":"2023-08-10T10:38:21.204571+0000","last_became_peered":"2023-08-10T10:38:21.204571+0000","last_unstale":"2023-08-10T10:38:23.324524+0000","last_undegraded":"2023-08-10T10:38:23.324524+0000","last_fullsized":"2023-08-10T10:38:23.324524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325403+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:38:23.325403+0000","last_peered":"2023-08-10T10:38:23.325403+0000","last_clean":"2023-08-10T10:38:23.325403+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:38:23.325403+0000","last_undegraded":"2023-08-10T10:38:23.325403+0000","last_fullsized":"2023-08-10T10:38:23.325403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:42.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202232+0000","last_change":"2023-08-10T10:38:22.220123+0000","last_active":"2023-08-10T10:38:23.202232+0000","last_peered":"2023-08-10T10:38:23.202232+0000","last_clean":"2023-08-10T10:38:23.202232+0000","last_became_active":"2023-08-10T10:38:22.214781+0000","last_became_peered":"2023-08-10T10:38:22.214781+0000","last_unstale":"2023-08-10T10:38:23.202232+0000","last_undegraded":"2023-08-10T10:38:23.202232+0000","last_fullsized":"2023-08-10T10:38:23.202232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203196+0000","last_change":"2023-08-10T10:38:22.222039+0000","last_active":"2023-08-10T10:38:23.203196+0000","last_peered":"2023-08-10T10:38:23.203196+0000","last_clean":"2023-08-10T10:38:23.203196+0000","last_became_active":"2023-08-10T10:38:22.220581+0000","last_became_peered":"2023-08-10T10:38:22.220581+0000","last_unstale":"2023-08-10T10:38:23.203196+0000","last_undegraded":"2023-08-10T10:38:23.203196+0000","last_fullsized":"2023-08-10T10:38:23.203196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:11.283723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201459+0000","last_change":"2023-08-10T10:38:21.203533+0000","last_active":"2023-08-10T10:38:23.201459+0000","last_peered":"2023-08-10T10:38:23.201459+0000","last_clean":"2023-08-10T10:38:23.201459+0000","last_became_active":"2023-08-10T10:38:21.203281+0000","last_became_peered":"2023-08-10T10:38:21.203281+0000","last_unstale":"2023-08-10T10:38:23.201459+0000","last_undegraded":"2023-08-10T10:38:23.201459+0000","last_fullsized":"2023-08-10T10:38:23.201459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:26.689515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225039+0000","last_change":"2023-08-10T10:38:22.224954+0000","last_active":"2023-08-10T10:38:22.225039+0000","last_peered":"2023-08-10T10:38:22.225039+0000","last_clean":"2023-08-10T10:38:22.225039+0000","last_became_active":"2023-08-10T10:38:22.224681+0000","last_became_peered":"2023-08-10T10:38:22.224681+0000","last_unstale":"2023-08-10T10:38:22.225039+0000","last_undegraded":"2023-08-10T10:38:22.225039+0000","last_fullsized":"2023-08-10T10:38:22.225039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326588+0000","last_change":"2023-08-10T10:38:21.203411+0000","last_active":"2023-08-10T10:38:23.326588+0000","last_peered":"2023-08-10T10:38:23.326588+0000","last_clean":"2023-08-10T10:38:23.326588+0000","last_became_active":"2023-08-10T10:38:21.203148+0000","last_became_peered":"2023-08-10T10:38:21.203148+0000","last_unstale":"2023-08-10T10:38:23.326588+0000","last_undegraded":"2023-08-10T10:38:23.326588+0000","last_fullsized":"2023-08-10T10:38:23.326588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:30.056821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202965+0000","last_change":"2023-08-10T10:38:21.201006+0000","last_active":"2023-08-10T10:38:23.202965+0000","last_peered":"2023-08-10T10:38:23.202965+0000","last_clean":"2023-08-10T10:38:23.202965+0000","last_became_active":"2023-08-10T10:38:21.200714+0000","last_became_peered":"2023-08-10T10:38:21.200714+0000","last_unstale":"2023-08-10T10:38:23.202965+0000","last_undegraded":"2023-08-10T10:38:23.202965+0000","last_fullsized":"2023-08-10T10:38:23.202965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200418+0000","last_change":"2023-08-10T10:38:22.215890+0000","last_active":"2023-08-10T10:38:23.200418+0000","last_peered":"2023-08-10T10:38:23.200418+0000","last_clean":"2023-08-10T10:38:23.200418+0000","last_became_active":"2023-08-10T10:38:22.215479+0000","last_became_peered":"2023-08-10T10:38:22.215479+0000","last_unstale":"2023-08-10T10:38:23.200418+0000","last_undegraded":"2023-08-10T10:38:23.200418+0000","last_fullsized":"2023-08-10T10:38:23.200418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325621+0000","last_change":"2023-08-10T10:38:21.202668+0000","last_active":"2023-08-10T10:38:23.325621+0000","last_peered":"2023-08-10T10:38:23.325621+0000","last_clean":"2023-08-10T10:38:23.325621+0000","last_became_active":"2023-08-10T10:38:21.202245+0000","last_became_peered":"2023-08-10T10:38:21.202245+0000","last_unstale":"2023-08-10T10:38:23.325621+0000","last_undegraded":"2023-08-10T10:38:23.325621+0000","last_fullsized":"2023-08-10T10:38:23.325621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200327+0000","last_change":"2023-08-10T10:38:22.206881+0000","last_active":"2023-08-10T10:38:23.200327+0000","last_peered":"2023-08-10T10:38:23.200327+0000","last_clean":"2023-08-10T10:38:23.200327+0000","last_became_active":"2023-08-10T10:38:22.206376+0000","last_became_peered":"2023-08-10T10:38:22.206376+0000","last_unstale":"2023-08-10T10:38:23.200327+0000","last_undegraded":"2023-08-10T10:38:23.200327+0000","last_fullsized":"2023-08-10T10:38:23.200327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325097+0000","last_change":"2023-08-10T10:38:22.219281+0000","last_active":"2023-08-10T10:38:23.325097+0000","last_peered":"2023-08-10T10:38:23.325097+0000","last_clean":"2023-08-10T10:38:23.325097+0000","last_became_active":"2023-08-10T10:38:22.219015+0000","last_became_peered":"2023-08-10T10:38:22.219015+0000","last_unstale":"2023-08-10T10:38:23.325097+0000","last_undegraded":"2023-08-10T10:38:23.325097+0000","last_fullsized":"2023-08-10T10:38:23.325097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200334+0000","last_change":"2023-08-10T10:38:21.203137+0000","last_active":"2023-08-10T10:38:23.200334+0000","last_peered":"2023-08-10T10:38:23.200334+0000","last_clean":"2023-08-10T10:38:23.200334+0000","last_became_active":"2023-08-10T10:38:21.202879+0000","last_became_peered":"2023-08-10T10:38:21.202879+0000","last_unstale":"2023-08-10T10:38:23.200334+0000","last_undegraded":"2023-08-10T10:38:23.200334+0000","last_fullsized":"2023-08-10T10:38:23.200334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324925+0000","last_change":"2023-08-10T10:38:22.216641+0000","last_active":"2023-08-10T10:38:23.324925+0000","last_peered":"2023-08-10T10:38:23.324925+0000","last_clean":"2023-08-10T10:38:23.324925+0000","last_became_active":"2023-08-10T10:38:22.216326+0000","last_became_peered":"2023-08-10T10:38:22.216326+0000","last_unstale":"2023-08-10T10:38:23.324925+0000","last_undegraded":"2023-08-10T10:38:23.324925+0000","last_fullsized":"2023-08-10T10:38:23.324925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.201119+0000","last_change":"2023-08-10T10:38:21.196362+0000","last_active":"2023-08-10T10:38:22.201119+0000","last_peered":"2023-08-10T10:38:22.201119+0000","last_clean":"2023-08-10T10:38:22.201119+0000","last_became_active":"2023-08-10T10:38:21.196026+0000","last_became_peered":"2023-08-10T10:38:21.196026+0000","last_unstale":"2023-08-10T10:38:22.201119+0000","last_undegraded":"2023-08-10T10:38:22.201119+0000","last_fullsized":"2023-08-10T10:38:22.201119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:47.364374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199967+0000","last_change":"2023-08-10T10:38:22.211342+0000","last_active":"2023-08-10T10:38:23.199967+0000","last_peered":"2023-08-10T10:38:23.199967+0000","last_clean":"2023-08-10T10:38:23.199967+0000","last_became_active":"2023-08-10T10:38:22.210963+0000","last_became_peered":"2023-08-10T10:38:22.210963+0000","last_unstale":"2023-08-10T10:38:23.199967+0000","last_undegraded":"2023-08-10T10:38:23.199967+0000","last_fullsized":"2023-08-10T10:38:23.199967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202602+0000","last_change":"2023-08-10T10:38:21.192358+0000","last_active":"2023-08-10T10:38:23.202602+0000","last_peered":"2023-08-10T10:38:23.202602+0000","last_clean":"2023-08-10T10:38:23.202602+0000","last_became_active":"2023-08-10T10:38:21.188537+0000","last_became_peered":"2023-08-10T10:38:21.188537+0000","last_unstale":"2023-08-10T10:38:23.202602+0000","last_undegraded":"2023-08-10T10:38:23.202602+0000","last_fullsized":"2023-08-10T10:38:23.202602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.227306+0000","last_change":"2023-08-10T10:38:22.227114+0000","last_active":"2023-08-10T10:38:22.227306+0000","last_peered":"2023-08-10T10:38:22.227306+0000","last_clean":"2023-08-10T10:38:22.227306+0000","last_became_active":"2023-08-10T10:38:22.226785+0000","last_became_peered":"2023-08-10T10:38:22.226785+0000","last_unstale":"2023-08-10T10:38:22.227306+0000","last_undegraded":"2023-08-10T10:38:22.227306+0000","last_fullsized":"2023-08-10T10:38:22.227306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:55.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324921+0000","last_change":"2023-08-10T10:38:21.205454+0000","last_active":"2023-08-10T10:38:23.324921+0000","last_peered":"2023-08-10T10:38:23.324921+0000","last_clean":"2023-08-10T10:38:23.324921+0000","last_became_active":"2023-08-10T10:38:21.204999+0000","last_became_peered":"2023-08-10T10:38:21.204999+0000","last_unstale":"2023-08-10T10:38:23.324921+0000","last_undegraded":"2023-08-10T10:38:23.324921+0000","last_fullsized":"2023-08-10T10:38:23.324921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201533+0000","last_change":"2023-08-10T10:38:22.204621+0000","last_active":"2023-08-10T10:38:23.201533+0000","last_peered":"2023-08-10T10:38:23.201533+0000","last_clean":"2023-08-10T10:38:23.201533+0000","last_became_active":"2023-08-10T10:38:22.203468+0000","last_became_peered":"2023-08-10T10:38:22.203468+0000","last_unstale":"2023-08-10T10:38:23.201533+0000","last_undegraded":"2023-08-10T10:38:23.201533+0000","last_fullsized":"2023-08-10T10:38:23.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203621+0000","last_change":"2023-08-10T10:38:21.205716+0000","last_active":"2023-08-10T10:38:23.203621+0000","last_peered":"2023-08-10T10:38:23.203621+0000","last_clean":"2023-08-10T10:38:23.203621+0000","last_became_active":"2023-08-10T10:38:21.205452+0000","last_became_peered":"2023-08-10T10:38:21.205452+0000","last_unstale":"2023-08-10T10:38:23.203621+0000","last_undegraded":"2023-08-10T10:38:23.203621+0000","last_fullsized":"2023-08-10T10:38:23.203621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201532+0000","last_change":"2023-08-10T10:38:22.204384+0000","last_active":"2023-08-10T10:38:23.201532+0000","last_peered":"2023-08-10T10:38:23.201532+0000","last_clean":"2023-08-10T10:38:23.201532+0000","last_became_active":"2023-08-10T10:38:22.203734+0000","last_became_peered":"2023-08-10T10:38:22.203734+0000","last_unstale":"2023-08-10T10:38:23.201532+0000","last_undegraded":"2023-08-10T10:38:23.201532+0000","last_fullsized":"2023-08-10T10:38:23.201532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202837+0000","last_change":"2023-08-10T10:38:21.206125+0000","last_active":"2023-08-10T10:38:23.202837+0000","last_peered":"2023-08-10T10:38:23.202837+0000","last_clean":"2023-08-10T10:38:23.202837+0000","last_became_active":"2023-08-10T10:38:21.205886+0000","last_became_peered":"2023-08-10T10:38:21.205886+0000","last_unstale":"2023-08-10T10:38:23.202837+0000","last_undegraded":"2023-08-10T10:38:23.202837+0000","last_fullsized":"2023-08-10T10:38:23.202837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201042+0000","last_change":"2023-08-10T10:38:22.215801+0000","last_active":"2023-08-10T10:38:23.201042+0000","last_peered":"2023-08-10T10:38:23.201042+0000","last_clean":"2023-08-10T10:38:23.201042+0000","last_became_active":"2023-08-10T10:38:22.212123+0000","last_became_peered":"2023-08-10T10:38:22.212123+0000","last_unstale":"2023-08-10T10:38:23.201042+0000","last_undegraded":"2023-08-10T10:38:23.201042+0000","last_fullsized":"2023-08-10T10:38:23.201042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201481+0000","last_change":"2023-08-10T10:38:21.201607+0000","last_active":"2023-08-10T10:38:23.201481+0000","last_peered":"2023-08-10T10:38:23.201481+0000","last_clean":"2023-08-10T10:38:23.201481+0000","last_became_active":"2023-08-10T10:38:21.201016+0000","last_became_peered":"2023-08-10T10:38:21.201016+0000","last_unstale":"2023-08-10T10:38:23.201481+0000","last_undegraded":"2023-08-10T10:38:23.201481+0000","last_fullsized":"2023-08-10T10:38:23.201481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202358+0000","last_change":"2023-08-10T10:38:22.222200+0000","last_active":"2023-08-10T10:38:23.202358+0000","last_peered":"2023-08-10T10:38:23.202358+0000","last_clean":"2023-08-10T10:38:23.202358+0000","last_became_active":"2023-08-10T10:38:22.220969+0000","last_became_peered":"2023-08-10T10:38:22.220969+0000","last_unstale":"2023-08-10T10:38:23.202358+0000","last_undegraded":"2023-08-10T10:38:23.202358+0000","last_fullsized":"2023-08-10T10:38:23.202358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325410+0000","last_change":"2023-08-10T10:38:21.204806+0000","last_active":"2023-08-10T10:38:23.325410+0000","last_peered":"2023-08-10T10:38:23.325410+0000","last_clean":"2023-08-10T10:38:23.325410+0000","last_became_active":"2023-08-10T10:38:21.204098+0000","last_became_peered":"2023-08-10T10:38:21.204098+0000","last_unstale":"2023-08-10T10:38:23.325410+0000","last_undegraded":"2023-08-10T10:38:23.325410+0000","last_fullsized":"2023-08-10T10:38:23.325410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8480000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195232,"statfs":{"total":200000000,"available":199917581,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":82,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195230,"statfs":{"total":200000000,"available":199915594,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194655,"statfs":{"total":200000000,"available":199327283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]}],"pool_statfs":[]}} 2023-08-10T10:38:26.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:38:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.099+0000 7f53f1a2d640 1 Processor -- start 2023-08-10T10:38:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.099+0000 7f53f1a2d640 1 -- start start 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53f1a2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53f1a2d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53ec0b8430 0x7f53ec0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53f1a2d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec161180 con 0x7f53ec0cddb0 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53f1a2d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec0ce240 con 0x7f53ec0b8430 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53f1a2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0b5bd0 con 0x7f53ec15cd60 2023-08-10T10:38:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53ec0b8430 0x7f53ec0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53ec0b8430 0x7f53ec0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33270/0 (socket says 172.21.15.50:33270) 2023-08-10T10:38:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.101+0000 7f53e3fff640 1 -- 172.21.15.50:0/4012918267 learned_addr learned my addr 172.21.15.50:0/4012918267 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.102+0000 7f53eaffd640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.102+0000 7f53e3fff640 1 -- 172.21.15.50:0/4012918267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 msgr2=0x7f53ec160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.102+0000 7f53e3fff640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.102+0000 7f53e3fff640 1 -- 172.21.15.50:0/4012918267 >> v1:172.21.15.117:6789/0 conn(0x7f53ec0cddb0 legacy=0x7f53ec0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.102+0000 7f53e3fff640 1 -- 172.21.15.50:0/4012918267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec161460 con 0x7f53ec0b8430 2023-08-10T10:38:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.103+0000 7f53e3fff640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cd870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a3aff4125c11d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.104+0000 7f53ea7fc640 1 -- 172.21.15.50:0/4012918267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d402f840 con 0x7f53ec0b8430 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.104+0000 7f53ea7fc640 1 -- 172.21.15.50:0/4012918267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d402f9a0 con 0x7f53ec0b8430 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.104+0000 7f53ea7fc640 1 -- 172.21.15.50:0/4012918267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d402fd30 con 0x7f53ec0b8430 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 -- 172.21.15.50:0/4012918267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0b8430 msgr2=0x7f53ec0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cd870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d402ba20 comp rx=0 tx=0).stop 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 -- 172.21.15.50:0/4012918267 shutdown_connections 2023-08-10T10:38:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cd870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/4012918267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 -- 172.21.15.50:0/4012918267 >> 172.21.15.50:0/4012918267 conn(0x7f53ec0d2ac0 msgr2=0x7f53ec0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 -- 172.21.15.50:0/4012918267 shutdown_connections 2023-08-10T10:38:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.105+0000 7f53f1a2d640 1 -- 172.21.15.50:0/4012918267 wait complete. 2023-08-10T10:38:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.107+0000 7f53f1a2d640 1 Processor -- start 2023-08-10T10:38:27.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.107+0000 7f53f1a2d640 1 -- start start 2023-08-10T10:38:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec1f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1f6ae0 con 0x7f53ec0cddb0 2023-08-10T10:38:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1f6520 con 0x7f53ec0b8430 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53f1a2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1f6800 con 0x7f53ec15cd60 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33276/0 (socket says 172.21.15.50:33276) 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53e3fff640 1 -- 172.21.15.50:0/1599423371 learned_addr learned my addr 172.21.15.50:0/1599423371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.108+0000 7f53eaffd640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53eb7fe640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec1f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 -- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 msgr2=0x7f53ec1f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec1f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 -- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 msgr2=0x7f53ec0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 -- 172.21.15.50:0/1599423371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40094d0 con 0x7f53ec0cddb0 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53eaffd640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53eb7fe640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec1f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e3fff640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4037c40 con 0x7f53ec0cddb0 2023-08-10T10:38:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4037da0 con 0x7f53ec0cddb0 2023-08-10T10:38:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4041620 con 0x7f53ec0cddb0 2023-08-10T10:38:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.109+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec0c9c30 con 0x7f53ec0cddb0 2023-08-10T10:38:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.110+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec0ccee0 con 0x7f53ec0cddb0 2023-08-10T10:38:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.111+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec0ca150 con 0x7f53ec0cddb0 2023-08-10T10:38:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.112+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53d4041780 con 0x7f53ec0cddb0 2023-08-10T10:38:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.113+0000 7f53e8ff9640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 0x7f53cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.113+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d403c070 con 0x7f53ec0cddb0 2023-08-10T10:38:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.113+0000 7f53eaffd640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 0x7f53cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.114+0000 7f53eaffd640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 0x7f53cc06d110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.117+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53d40de330 con 0x7f53ec0cddb0 2023-08-10T10:38:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.302+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53ec0d0c00 con 0x7f53cc06ac50 2023-08-10T10:38:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.322+0000 7f53e8ff9640 1 -- 172.21.15.50:0/1599423371 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280566 (secure 0 0 0) 0x7f53dc009e10 con 0x7f53cc06ac50 2023-08-10T10:38:27.325 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:38:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 msgr2=0x7f53cc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 0x7f53cc06d110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc008040 comp rx=0 tx=0).stop 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 msgr2=0x7f53ec1f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d4004730 comp rx=0 tx=0).stop 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 shutdown_connections 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53ec15cd60 0x7f53ec1f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53ec0cddb0 0x7f53ec1f5bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53cc06ac50 0x7f53cc06d110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 --2- 172.21.15.50:0/1599423371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53ec0b8430 0x7f53ec0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 >> 172.21.15.50:0/1599423371 conn(0x7f53ec0d2ac0 msgr2=0x7f53ec0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 shutdown_connections 2023-08-10T10:38:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.329+0000 7f53f1a2d640 1 -- 172.21.15.50:0/1599423371 wait complete. 2023-08-10T10:38:27.350 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-10T10:38:26.320389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560697,"statfs":{"total":1600000000,"available":1598154290,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002123"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.209949+0000","last_change":"2023-08-10T10:38:22.209741+0000","last_active":"2023-08-10T10:38:22.209949+0000","last_peered":"2023-08-10T10:38:22.209949+0000","last_clean":"2023-08-10T10:38:22.209949+0000","last_became_active":"2023-08-10T10:38:22.209086+0000","last_became_peered":"2023-08-10T10:38:22.209086+0000","last_unstale":"2023-08-10T10:38:22.209949+0000","last_undegraded":"2023-08-10T10:38:22.209949+0000","last_fullsized":"2023-08-10T10:38:22.209949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:57.587473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202298+0000","last_change":"2023-08-10T10:38:22.224666+0000","last_active":"2023-08-10T10:38:23.202298+0000","last_peered":"2023-08-10T10:38:23.202298+0000","last_clean":"2023-08-10T10:38:23.202298+0000","last_became_active":"2023-08-10T10:38:22.224412+0000","last_became_peered":"2023-08-10T10:38:22.224412+0000","last_unstale":"2023-08-10T10:38:23.202298+0000","last_undegraded":"2023-08-10T10:38:23.202298+0000","last_fullsized":"2023-08-10T10:38:23.202298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201886+0000","last_change":"2023-08-10T10:38:22.220964+0000","last_active":"2023-08-10T10:38:23.201886+0000","last_peered":"2023-08-10T10:38:23.201886+0000","last_clean":"2023-08-10T10:38:23.201886+0000","last_became_active":"2023-08-10T10:38:22.220680+0000","last_became_peered":"2023-08-10T10:38:22.220680+0000","last_unstale":"2023-08-10T10:38:23.201886+0000","last_undegraded":"2023-08-10T10:38:23.201886+0000","last_fullsized":"2023-08-10T10:38:23.201886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325437+0000","last_change":"2023-08-10T10:38:22.220325+0000","last_active":"2023-08-10T10:38:23.325437+0000","last_peered":"2023-08-10T10:38:23.325437+0000","last_clean":"2023-08-10T10:38:23.325437+0000","last_became_active":"2023-08-10T10:38:22.219756+0000","last_became_peered":"2023-08-10T10:38:22.219756+0000","last_unstale":"2023-08-10T10:38:23.325437+0000","last_undegraded":"2023-08-10T10:38:23.325437+0000","last_fullsized":"2023-08-10T10:38:23.325437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324712+0000","last_change":"2023-08-10T10:38:22.218733+0000","last_active":"2023-08-10T10:38:23.324712+0000","last_peered":"2023-08-10T10:38:23.324712+0000","last_clean":"2023-08-10T10:38:23.324712+0000","last_became_active":"2023-08-10T10:38:22.218457+0000","last_became_peered":"2023-08-10T10:38:22.218457+0000","last_unstale":"2023-08-10T10:38:23.324712+0000","last_undegraded":"2023-08-10T10:38:23.324712+0000","last_fullsized":"2023-08-10T10:38:23.324712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201252+0000","last_change":"2023-08-10T10:38:22.222593+0000","last_active":"2023-08-10T10:38:23.201252+0000","last_peered":"2023-08-10T10:38:23.201252+0000","last_clean":"2023-08-10T10:38:23.201252+0000","last_became_active":"2023-08-10T10:38:22.222180+0000","last_became_peered":"2023-08-10T10:38:22.222180+0000","last_unstale":"2023-08-10T10:38:23.201252+0000","last_undegraded":"2023-08-10T10:38:23.201252+0000","last_fullsized":"2023-08-10T10:38:23.201252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325878+0000","last_change":"2023-08-10T10:38:22.224370+0000","last_active":"2023-08-10T10:38:23.325878+0000","last_peered":"2023-08-10T10:38:23.325878+0000","last_clean":"2023-08-10T10:38:23.325878+0000","last_became_active":"2023-08-10T10:38:22.224117+0000","last_became_peered":"2023-08-10T10:38:22.224117+0000","last_unstale":"2023-08-10T10:38:23.325878+0000","last_undegraded":"2023-08-10T10:38:23.325878+0000","last_fullsized":"2023-08-10T10:38:23.325878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202295+0000","last_change":"2023-08-10T10:38:22.217074+0000","last_active":"2023-08-10T10:38:23.202295+0000","last_peered":"2023-08-10T10:38:23.202295+0000","last_clean":"2023-08-10T10:38:23.202295+0000","last_became_active":"2023-08-10T10:38:22.216567+0000","last_became_peered":"2023-08-10T10:38:22.216567+0000","last_unstale":"2023-08-10T10:38:23.202295+0000","last_undegraded":"2023-08-10T10:38:23.202295+0000","last_fullsized":"2023-08-10T10:38:23.202295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324543+0000","last_change":"2023-08-10T10:38:22.221017+0000","last_active":"2023-08-10T10:38:23.324543+0000","last_peered":"2023-08-10T10:38:23.324543+0000","last_clean":"2023-08-10T10:38:23.324543+0000","last_became_active":"2023-08-10T10:38:22.220731+0000","last_became_peered":"2023-08-10T10:38:22.220731+0000","last_unstale":"2023-08-10T10:38:23.324543+0000","last_undegraded":"2023-08-10T10:38:23.324543+0000","last_fullsized":"2023-08-10T10:38:23.324543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202425+0000","last_change":"2023-08-10T10:38:22.217793+0000","last_active":"2023-08-10T10:38:23.202425+0000","last_peered":"2023-08-10T10:38:23.202425+0000","last_clean":"2023-08-10T10:38:23.202425+0000","last_became_active":"2023-08-10T10:38:22.217531+0000","last_became_peered":"2023-08-10T10:38:22.217531+0000","last_unstale":"2023-08-10T10:38:23.202425+0000","last_undegraded":"2023-08-10T10:38:23.202425+0000","last_fullsized":"2023-08-10T10:38:23.202425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201607+0000","last_change":"2023-08-10T10:38:22.225166+0000","last_active":"2023-08-10T10:38:23.201607+0000","last_peered":"2023-08-10T10:38:23.201607+0000","last_clean":"2023-08-10T10:38:23.201607+0000","last_became_active":"2023-08-10T10:38:22.224921+0000","last_became_peered":"2023-08-10T10:38:22.224921+0000","last_unstale":"2023-08-10T10:38:23.201607+0000","last_undegraded":"2023-08-10T10:38:23.201607+0000","last_fullsized":"2023-08-10T10:38:23.201607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.197698+0000","last_change":"2023-08-10T10:38:22.197404+0000","last_active":"2023-08-10T10:38:22.197698+0000","last_peered":"2023-08-10T10:38:22.197698+0000","last_clean":"2023-08-10T10:38:22.197698+0000","last_became_active":"2023-08-10T10:38:22.196746+0000","last_became_peered":"2023-08-10T10:38:22.196746+0000","last_unstale":"2023-08-10T10:38:22.197698+0000","last_undegraded":"2023-08-10T10:38:22.197698+0000","last_fullsized":"2023-08-10T10:38:22.197698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:46.956429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.205260+0000","last_change":"2023-08-10T10:38:22.204317+0000","last_active":"2023-08-10T10:38:22.205260+0000","last_peered":"2023-08-10T10:38:22.205260+0000","last_clean":"2023-08-10T10:38:22.205260+0000","last_became_active":"2023-08-10T10:38:22.203630+0000","last_became_peered":"2023-08-10T10:38:22.203630+0000","last_unstale":"2023-08-10T10:38:22.205260+0000","last_undegraded":"2023-08-10T10:38:22.205260+0000","last_fullsized":"2023-08-10T10:38:22.205260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:19.616107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201451+0000","last_change":"2023-08-10T10:38:22.212769+0000","last_active":"2023-08-10T10:38:23.201451+0000","last_peered":"2023-08-10T10:38:23.201451+0000","last_clean":"2023-08-10T10:38:23.201451+0000","last_became_active":"2023-08-10T10:38:22.212324+0000","last_became_peered":"2023-08-10T10:38:22.212324+0000","last_unstale":"2023-08-10T10:38:23.201451+0000","last_undegraded":"2023-08-10T10:38:23.201451+0000","last_fullsized":"2023-08-10T10:38:23.201451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326152+0000","last_change":"2023-08-10T10:38:22.214280+0000","last_active":"2023-08-10T10:38:23.326152+0000","last_peered":"2023-08-10T10:38:23.326152+0000","last_clean":"2023-08-10T10:38:23.326152+0000","last_became_active":"2023-08-10T10:38:22.214007+0000","last_became_peered":"2023-08-10T10:38:22.214007+0000","last_unstale":"2023-08-10T10:38:23.326152+0000","last_undegraded":"2023-08-10T10:38:23.326152+0000","last_fullsized":"2023-08-10T10:38:23.326152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202287+0000","last_change":"2023-08-10T10:38:22.222420+0000","last_active":"2023-08-10T10:38:23.202287+0000","last_peered":"2023-08-10T10:38:23.202287+0000","last_clean":"2023-08-10T10:38:23.202287+0000","last_became_active":"2023-08-10T10:38:22.221840+0000","last_became_peered":"2023-08-10T10:38:22.221840+0000","last_unstale":"2023-08-10T10:38:23.202287+0000","last_undegraded":"2023-08-10T10:38:23.202287+0000","last_fullsized":"2023-08-10T10:38:23.202287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324343+0000","last_change":"2023-08-10T10:38:22.221851+0000","last_active":"2023-08-10T10:38:23.324343+0000","last_peered":"2023-08-10T10:38:23.324343+0000","last_clean":"2023-08-10T10:38:23.324343+0000","last_became_active":"2023-08-10T10:38:22.221350+0000","last_became_peered":"2023-08-10T10:38:22.221350+0000","last_unstale":"2023-08-10T10:38:23.324343+0000","last_undegraded":"2023-08-10T10:38:23.324343+0000","last_fullsized":"2023-08-10T10:38:23.324343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201197+0000","last_change":"2023-08-10T10:38:22.213747+0000","last_active":"2023-08-10T10:38:23.201197+0000","last_peered":"2023-08-10T10:38:23.201197+0000","last_clean":"2023-08-10T10:38:23.201197+0000","last_became_active":"2023-08-10T10:38:22.212182+0000","last_became_peered":"2023-08-10T10:38:22.212182+0000","last_unstale":"2023-08-10T10:38:23.201197+0000","last_undegraded":"2023-08-10T10:38:23.201197+0000","last_fullsized":"2023-08-10T10:38:23.201197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.214522+0000","last_change":"2023-08-10T10:38:22.214414+0000","last_active":"2023-08-10T10:38:22.214522+0000","last_peered":"2023-08-10T10:38:22.214522+0000","last_clean":"2023-08-10T10:38:22.214522+0000","last_became_active":"2023-08-10T10:38:22.213797+0000","last_became_peered":"2023-08-10T10:38:22.213797+0000","last_unstale":"2023-08-10T10:38:22.214522+0000","last_undegraded":"2023-08-10T10:38:22.214522+0000","last_fullsized":"2023-08-10T10:38:22.214522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:29:19.177342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201675+0000","last_change":"2023-08-10T10:38:22.222520+0000","last_active":"2023-08-10T10:38:23.201675+0000","last_peered":"2023-08-10T10:38:23.201675+0000","last_clean":"2023-08-10T10:38:23.201675+0000","last_became_active":"2023-08-10T10:38:22.221771+0000","last_became_peered":"2023-08-10T10:38:22.221771+0000","last_unstale":"2023-08-10T10:38:23.201675+0000","last_undegraded":"2023-08-10T10:38:23.201675+0000","last_fullsized":"2023-08-10T10:38:23.201675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326586+0000","last_change":"2023-08-10T10:38:22.217371+0000","last_active":"2023-08-10T10:38:23.326586+0000","last_peered":"2023-08-10T10:38:23.326586+0000","last_clean":"2023-08-10T10:38:23.326586+0000","last_became_active":"2023-08-10T10:38:22.216957+0000","last_became_peered":"2023-08-10T10:38:22.216957+0000","last_unstale":"2023-08-10T10:38:23.326586+0000","last_undegraded":"2023-08-10T10:38:23.326586+0000","last_fullsized":"2023-08-10T10:38:23.326586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.692722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324539+0000","last_change":"2023-08-10T10:38:22.226850+0000","last_active":"2023-08-10T10:38:23.324539+0000","last_peered":"2023-08-10T10:38:23.324539+0000","last_clean":"2023-08-10T10:38:23.324539+0000","last_became_active":"2023-08-10T10:38:22.226586+0000","last_became_peered":"2023-08-10T10:38:22.226586+0000","last_unstale":"2023-08-10T10:38:23.324539+0000","last_undegraded":"2023-08-10T10:38:23.324539+0000","last_fullsized":"2023-08-10T10:38:23.324539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199969+0000","last_change":"2023-08-10T10:38:22.220488+0000","last_active":"2023-08-10T10:38:23.199969+0000","last_peered":"2023-08-10T10:38:23.199969+0000","last_clean":"2023-08-10T10:38:23.199969+0000","last_became_active":"2023-08-10T10:38:22.220213+0000","last_became_peered":"2023-08-10T10:38:22.220213+0000","last_unstale":"2023-08-10T10:38:23.199969+0000","last_undegraded":"2023-08-10T10:38:23.199969+0000","last_fullsized":"2023-08-10T10:38:23.199969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326905+0000","last_change":"2023-08-10T10:38:22.222504+0000","last_active":"2023-08-10T10:38:23.326905+0000","last_peered":"2023-08-10T10:38:23.326905+0000","last_clean":"2023-08-10T10:38:23.326905+0000","last_became_active":"2023-08-10T10:38:22.219256+0000","last_became_peered":"2023-08-10T10:38:22.219256+0000","last_unstale":"2023-08-10T10:38:23.326905+0000","last_undegraded":"2023-08-10T10:38:23.326905+0000","last_fullsized":"2023-08-10T10:38:23.326905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:27.097082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.230855+0000","last_change":"2023-08-10T10:38:22.230697+0000","last_active":"2023-08-10T10:38:22.230855+0000","last_peered":"2023-08-10T10:38:22.230855+0000","last_clean":"2023-08-10T10:38:22.230855+0000","last_became_active":"2023-08-10T10:38:22.230177+0000","last_became_peered":"2023-08-10T10:38:22.230177+0000","last_unstale":"2023-08-10T10:38:22.230855+0000","last_undegraded":"2023-08-10T10:38:22.230855+0000","last_fullsized":"2023-08-10T10:38:22.230855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:43.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.230632+0000","last_change":"2023-08-10T10:38:22.230488+0000","last_active":"2023-08-10T10:38:22.230632+0000","last_peered":"2023-08-10T10:38:22.230632+0000","last_clean":"2023-08-10T10:38:22.230632+0000","last_became_active":"2023-08-10T10:38:22.230126+0000","last_became_peered":"2023-08-10T10:38:22.230126+0000","last_unstale":"2023-08-10T10:38:22.230632+0000","last_undegraded":"2023-08-10T10:38:22.230632+0000","last_fullsized":"2023-08-10T10:38:22.230632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:59.709121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202624+0000","last_change":"2023-08-10T10:38:22.218566+0000","last_active":"2023-08-10T10:38:23.202624+0000","last_peered":"2023-08-10T10:38:23.202624+0000","last_clean":"2023-08-10T10:38:23.202624+0000","last_became_active":"2023-08-10T10:38:22.218315+0000","last_became_peered":"2023-08-10T10:38:22.218315+0000","last_unstale":"2023-08-10T10:38:23.202624+0000","last_undegraded":"2023-08-10T10:38:23.202624+0000","last_fullsized":"2023-08-10T10:38:23.202624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.223623+0000","last_change":"2023-08-10T10:38:22.223531+0000","last_active":"2023-08-10T10:38:22.223623+0000","last_peered":"2023-08-10T10:38:22.223623+0000","last_clean":"2023-08-10T10:38:22.223623+0000","last_became_active":"2023-08-10T10:38:22.214439+0000","last_became_peered":"2023-08-10T10:38:22.214439+0000","last_unstale":"2023-08-10T10:38:22.223623+0000","last_undegraded":"2023-08-10T10:38:22.223623+0000","last_fullsized":"2023-08-10T10:38:22.223623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200614+0000","last_change":"2023-08-10T10:38:22.218268+0000","last_active":"2023-08-10T10:38:23.200614+0000","last_peered":"2023-08-10T10:38:23.200614+0000","last_clean":"2023-08-10T10:38:23.200614+0000","last_became_active":"2023-08-10T10:38:22.217322+0000","last_became_peered":"2023-08-10T10:38:22.217322+0000","last_unstale":"2023-08-10T10:38:23.200614+0000","last_undegraded":"2023-08-10T10:38:23.200614+0000","last_fullsized":"2023-08-10T10:38:23.200614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201983+0000","last_change":"2023-08-10T10:38:22.222356+0000","last_active":"2023-08-10T10:38:23.201983+0000","last_peered":"2023-08-10T10:38:23.201983+0000","last_clean":"2023-08-10T10:38:23.201983+0000","last_became_active":"2023-08-10T10:38:22.221452+0000","last_became_peered":"2023-08-10T10:38:22.221452+0000","last_unstale":"2023-08-10T10:38:23.201983+0000","last_undegraded":"2023-08-10T10:38:23.201983+0000","last_fullsized":"2023-08-10T10:38:23.201983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200438+0000","last_change":"2023-08-10T10:38:22.225427+0000","last_active":"2023-08-10T10:38:23.200438+0000","last_peered":"2023-08-10T10:38:23.200438+0000","last_clean":"2023-08-10T10:38:23.200438+0000","last_became_active":"2023-08-10T10:38:22.225202+0000","last_became_peered":"2023-08-10T10:38:22.225202+0000","last_unstale":"2023-08-10T10:38:23.200438+0000","last_undegraded":"2023-08-10T10:38:23.200438+0000","last_fullsized":"2023-08-10T10:38:23.200438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325176+0000","last_change":"2023-08-10T10:38:22.209191+0000","last_active":"2023-08-10T10:38:23.325176+0000","last_peered":"2023-08-10T10:38:23.325176+0000","last_clean":"2023-08-10T10:38:23.325176+0000","last_became_active":"2023-08-10T10:38:22.208584+0000","last_became_peered":"2023-08-10T10:38:22.208584+0000","last_unstale":"2023-08-10T10:38:23.325176+0000","last_undegraded":"2023-08-10T10:38:23.325176+0000","last_fullsized":"2023-08-10T10:38:23.325176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201306+0000","last_change":"2023-08-10T10:38:22.212595+0000","last_active":"2023-08-10T10:38:23.201306+0000","last_peered":"2023-08-10T10:38:23.201306+0000","last_clean":"2023-08-10T10:38:23.201306+0000","last_became_active":"2023-08-10T10:38:22.211581+0000","last_became_peered":"2023-08-10T10:38:22.211581+0000","last_unstale":"2023-08-10T10:38:23.201306+0000","last_undegraded":"2023-08-10T10:38:23.201306+0000","last_fullsized":"2023-08-10T10:38:23.201306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326485+0000","last_change":"2023-08-10T10:38:21.209499+0000","last_active":"2023-08-10T10:38:23.326485+0000","last_peered":"2023-08-10T10:38:23.326485+0000","last_clean":"2023-08-10T10:38:23.326485+0000","last_became_active":"2023-08-10T10:38:21.208930+0000","last_became_peered":"2023-08-10T10:38:21.208930+0000","last_unstale":"2023-08-10T10:38:23.326485+0000","last_undegraded":"2023-08-10T10:38:23.326485+0000","last_fullsized":"2023-08-10T10:38:23.326485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202626+0000","last_change":"2023-08-10T10:38:22.216900+0000","last_active":"2023-08-10T10:38:23.202626+0000","last_peered":"2023-08-10T10:38:23.202626+0000","last_clean":"2023-08-10T10:38:23.202626+0000","last_became_active":"2023-08-10T10:38:22.216199+0000","last_became_peered":"2023-08-10T10:38:22.216199+0000","last_unstale":"2023-08-10T10:38:23.202626+0000","last_undegraded":"2023-08-10T10:38:23.202626+0000","last_fullsized":"2023-08-10T10:38:23.202626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325918+0000","last_change":"2023-08-10T10:38:21.202495+0000","last_active":"2023-08-10T10:38:23.325918+0000","last_peered":"2023-08-10T10:38:23.325918+0000","last_clean":"2023-08-10T10:38:23.325918+0000","last_became_active":"2023-08-10T10:38:21.201907+0000","last_became_peered":"2023-08-10T10:38:21.201907+0000","last_unstale":"2023-08-10T10:38:23.325918+0000","last_undegraded":"2023-08-10T10:38:23.325918+0000","last_fullsized":"2023-08-10T10:38:23.325918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324734+0000","last_change":"2023-08-10T10:38:22.221638+0000","last_active":"2023-08-10T10:38:23.324734+0000","last_peered":"2023-08-10T10:38:23.324734+0000","last_clean":"2023-08-10T10:38:23.324734+0000","last_became_active":"2023-08-10T10:38:22.220935+0000","last_became_peered":"2023-08-10T10:38:22.220935+0000","last_unstale":"2023-08-10T10:38:23.324734+0000","last_undegraded":"2023-08-10T10:38:23.324734+0000","last_fullsized":"2023-08-10T10:38:23.324734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326520+0000","last_change":"2023-08-10T10:38:21.204133+0000","last_active":"2023-08-10T10:38:23.326520+0000","last_peered":"2023-08-10T10:38:23.326520+0000","last_clean":"2023-08-10T10:38:23.326520+0000","last_became_active":"2023-08-10T10:38:21.203842+0000","last_became_peered":"2023-08-10T10:38:21.203842+0000","last_unstale":"2023-08-10T10:38:23.326520+0000","last_undegraded":"2023-08-10T10:38:23.326520+0000","last_fullsized":"2023-08-10T10:38:23.326520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200052+0000","last_change":"2023-08-10T10:38:22.215664+0000","last_active":"2023-08-10T10:38:23.200052+0000","last_peered":"2023-08-10T10:38:23.200052+0000","last_clean":"2023-08-10T10:38:23.200052+0000","last_became_active":"2023-08-10T10:38:22.212636+0000","last_became_peered":"2023-08-10T10:38:22.212636+0000","last_unstale":"2023-08-10T10:38:23.200052+0000","last_undegraded":"2023-08-10T10:38:23.200052+0000","last_fullsized":"2023-08-10T10:38:23.200052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325452+0000","last_change":"2023-08-10T10:38:21.204543+0000","last_active":"2023-08-10T10:38:23.325452+0000","last_peered":"2023-08-10T10:38:23.325452+0000","last_clean":"2023-08-10T10:38:23.325452+0000","last_became_active":"2023-08-10T10:38:21.204298+0000","last_became_peered":"2023-08-10T10:38:21.204298+0000","last_unstale":"2023-08-10T10:38:23.325452+0000","last_undegraded":"2023-08-10T10:38:23.325452+0000","last_fullsized":"2023-08-10T10:38:23.325452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:42.165678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327421+0000","last_change":"2023-08-10T10:38:21.204939+0000","last_active":"2023-08-10T10:38:23.327421+0000","last_peered":"2023-08-10T10:38:23.327421+0000","last_clean":"2023-08-10T10:38:23.327421+0000","last_became_active":"2023-08-10T10:38:21.204670+0000","last_became_peered":"2023-08-10T10:38:21.204670+0000","last_unstale":"2023-08-10T10:38:23.327421+0000","last_undegraded":"2023-08-10T10:38:23.327421+0000","last_fullsized":"2023-08-10T10:38:23.327421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:15.925392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203322+0000","last_change":"2023-08-10T10:38:22.215812+0000","last_active":"2023-08-10T10:38:23.203322+0000","last_peered":"2023-08-10T10:38:23.203322+0000","last_clean":"2023-08-10T10:38:23.203322+0000","last_became_active":"2023-08-10T10:38:22.215518+0000","last_became_peered":"2023-08-10T10:38:22.215518+0000","last_unstale":"2023-08-10T10:38:23.203322+0000","last_undegraded":"2023-08-10T10:38:23.203322+0000","last_fullsized":"2023-08-10T10:38:23.203322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326826+0000","last_change":"2023-08-10T10:38:21.209700+0000","last_active":"2023-08-10T10:38:23.326826+0000","last_peered":"2023-08-10T10:38:23.326826+0000","last_clean":"2023-08-10T10:38:23.326826+0000","last_became_active":"2023-08-10T10:38:21.209258+0000","last_became_peered":"2023-08-10T10:38:21.209258+0000","last_unstale":"2023-08-10T10:38:23.326826+0000","last_undegraded":"2023-08-10T10:38:23.326826+0000","last_fullsized":"2023-08-10T10:38:23.326826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:10.268662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202875+0000","last_change":"2023-08-10T10:38:22.210784+0000","last_active":"2023-08-10T10:38:23.202875+0000","last_peered":"2023-08-10T10:38:23.202875+0000","last_clean":"2023-08-10T10:38:23.202875+0000","last_became_active":"2023-08-10T10:38:22.210275+0000","last_became_peered":"2023-08-10T10:38:22.210275+0000","last_unstale":"2023-08-10T10:38:23.202875+0000","last_undegraded":"2023-08-10T10:38:23.202875+0000","last_fullsized":"2023-08-10T10:38:23.202875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:31.071882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326869+0000","last_change":"2023-08-10T10:38:21.201970+0000","last_active":"2023-08-10T10:38:23.326869+0000","last_peered":"2023-08-10T10:38:23.326869+0000","last_clean":"2023-08-10T10:38:23.326869+0000","last_became_active":"2023-08-10T10:38:21.201599+0000","last_became_peered":"2023-08-10T10:38:21.201599+0000","last_unstale":"2023-08-10T10:38:23.326869+0000","last_undegraded":"2023-08-10T10:38:23.326869+0000","last_fullsized":"2023-08-10T10:38:23.326869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:15.895041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325811+0000","last_change":"2023-08-10T10:38:22.224729+0000","last_active":"2023-08-10T10:38:23.325811+0000","last_peered":"2023-08-10T10:38:23.325811+0000","last_clean":"2023-08-10T10:38:23.325811+0000","last_became_active":"2023-08-10T10:38:22.224473+0000","last_became_peered":"2023-08-10T10:38:22.224473+0000","last_unstale":"2023-08-10T10:38:23.325811+0000","last_undegraded":"2023-08-10T10:38:23.325811+0000","last_fullsized":"2023-08-10T10:38:23.325811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:32.356113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203242+0000","last_change":"2023-08-10T10:38:21.197513+0000","last_active":"2023-08-10T10:38:23.203242+0000","last_peered":"2023-08-10T10:38:23.203242+0000","last_clean":"2023-08-10T10:38:23.203242+0000","last_became_active":"2023-08-10T10:38:21.197186+0000","last_became_peered":"2023-08-10T10:38:21.197186+0000","last_unstale":"2023-08-10T10:38:23.203242+0000","last_undegraded":"2023-08-10T10:38:23.203242+0000","last_fullsized":"2023-08-10T10:38:23.203242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:10.021641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324784+0000","last_change":"2023-08-10T10:38:22.227601+0000","last_active":"2023-08-10T10:38:23.324784+0000","last_peered":"2023-08-10T10:38:23.324784+0000","last_clean":"2023-08-10T10:38:23.324784+0000","last_became_active":"2023-08-10T10:38:22.227145+0000","last_became_peered":"2023-08-10T10:38:22.227145+0000","last_unstale":"2023-08-10T10:38:23.324784+0000","last_undegraded":"2023-08-10T10:38:23.324784+0000","last_fullsized":"2023-08-10T10:38:23.324784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200784+0000","last_change":"2023-08-10T10:38:21.206280+0000","last_active":"2023-08-10T10:38:23.200784+0000","last_peered":"2023-08-10T10:38:23.200784+0000","last_clean":"2023-08-10T10:38:23.200784+0000","last_became_active":"2023-08-10T10:38:21.205889+0000","last_became_peered":"2023-08-10T10:38:21.205889+0000","last_unstale":"2023-08-10T10:38:23.200784+0000","last_undegraded":"2023-08-10T10:38:23.200784+0000","last_fullsized":"2023-08-10T10:38:23.200784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201888+0000","last_change":"2023-08-10T10:38:22.204248+0000","last_active":"2023-08-10T10:38:23.201888+0000","last_peered":"2023-08-10T10:38:23.201888+0000","last_clean":"2023-08-10T10:38:23.201888+0000","last_became_active":"2023-08-10T10:38:22.199227+0000","last_became_peered":"2023-08-10T10:38:22.199227+0000","last_unstale":"2023-08-10T10:38:23.201888+0000","last_undegraded":"2023-08-10T10:38:23.201888+0000","last_fullsized":"2023-08-10T10:38:23.201888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326432+0000","last_change":"2023-08-10T10:38:21.205456+0000","last_active":"2023-08-10T10:38:23.326432+0000","last_peered":"2023-08-10T10:38:23.326432+0000","last_clean":"2023-08-10T10:38:23.326432+0000","last_became_active":"2023-08-10T10:38:21.205215+0000","last_became_peered":"2023-08-10T10:38:21.205215+0000","last_unstale":"2023-08-10T10:38:23.326432+0000","last_undegraded":"2023-08-10T10:38:23.326432+0000","last_fullsized":"2023-08-10T10:38:23.326432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201985+0000","last_change":"2023-08-10T10:38:22.199554+0000","last_active":"2023-08-10T10:38:23.201985+0000","last_peered":"2023-08-10T10:38:23.201985+0000","last_clean":"2023-08-10T10:38:23.201985+0000","last_became_active":"2023-08-10T10:38:22.198747+0000","last_became_peered":"2023-08-10T10:38:22.198747+0000","last_unstale":"2023-08-10T10:38:23.201985+0000","last_undegraded":"2023-08-10T10:38:23.201985+0000","last_fullsized":"2023-08-10T10:38:23.201985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203786+0000","last_change":"2023-08-10T10:38:21.208724+0000","last_active":"2023-08-10T10:38:23.203786+0000","last_peered":"2023-08-10T10:38:23.203786+0000","last_clean":"2023-08-10T10:38:23.203786+0000","last_became_active":"2023-08-10T10:38:21.207707+0000","last_became_peered":"2023-08-10T10:38:21.207707+0000","last_unstale":"2023-08-10T10:38:23.203786+0000","last_undegraded":"2023-08-10T10:38:23.203786+0000","last_fullsized":"2023-08-10T10:38:23.203786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:26.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203495+0000","last_change":"2023-08-10T10:38:22.221214+0000","last_active":"2023-08-10T10:38:23.203495+0000","last_peered":"2023-08-10T10:38:23.203495+0000","last_clean":"2023-08-10T10:38:23.203495+0000","last_became_active":"2023-08-10T10:38:22.220236+0000","last_became_peered":"2023-08-10T10:38:22.220236+0000","last_unstale":"2023-08-10T10:38:23.203495+0000","last_undegraded":"2023-08-10T10:38:23.203495+0000","last_fullsized":"2023-08-10T10:38:23.203495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:16.910102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200842+0000","last_change":"2023-08-10T10:38:21.203702+0000","last_active":"2023-08-10T10:38:23.200842+0000","last_peered":"2023-08-10T10:38:23.200842+0000","last_clean":"2023-08-10T10:38:23.200842+0000","last_became_active":"2023-08-10T10:38:21.203440+0000","last_became_peered":"2023-08-10T10:38:21.203440+0000","last_unstale":"2023-08-10T10:38:23.200842+0000","last_undegraded":"2023-08-10T10:38:23.200842+0000","last_fullsized":"2023-08-10T10:38:23.200842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225556+0000","last_change":"2023-08-10T10:38:22.225268+0000","last_active":"2023-08-10T10:38:22.225556+0000","last_peered":"2023-08-10T10:38:22.225556+0000","last_clean":"2023-08-10T10:38:22.225556+0000","last_became_active":"2023-08-10T10:38:22.224857+0000","last_became_peered":"2023-08-10T10:38:22.224857+0000","last_unstale":"2023-08-10T10:38:22.225556+0000","last_undegraded":"2023-08-10T10:38:22.225556+0000","last_fullsized":"2023-08-10T10:38:22.225556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:50.180344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.328222+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:38:23.328222+0000","last_peered":"2023-08-10T10:38:23.328222+0000","last_clean":"2023-08-10T10:38:23.328222+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:38:23.328222+0000","last_undegraded":"2023-08-10T10:38:23.328222+0000","last_fullsized":"2023-08-10T10:38:23.328222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:21.161219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203958+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:38:23.203958+0000","last_peered":"2023-08-10T10:38:23.203958+0000","last_clean":"2023-08-10T10:38:23.203958+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:38:23.203958+0000","last_undegraded":"2023-08-10T10:38:23.203958+0000","last_fullsized":"2023-08-10T10:38:23.203958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:24.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201315+0000","last_change":"2023-08-10T10:38:21.202544+0000","last_active":"2023-08-10T10:38:23.201315+0000","last_peered":"2023-08-10T10:38:23.201315+0000","last_clean":"2023-08-10T10:38:23.201315+0000","last_became_active":"2023-08-10T10:38:21.202310+0000","last_became_peered":"2023-08-10T10:38:21.202310+0000","last_unstale":"2023-08-10T10:38:23.201315+0000","last_undegraded":"2023-08-10T10:38:23.201315+0000","last_fullsized":"2023-08-10T10:38:23.201315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326145+0000","last_change":"2023-08-10T10:38:22.220675+0000","last_active":"2023-08-10T10:38:23.326145+0000","last_peered":"2023-08-10T10:38:23.326145+0000","last_clean":"2023-08-10T10:38:23.326145+0000","last_became_active":"2023-08-10T10:38:22.220074+0000","last_became_peered":"2023-08-10T10:38:22.220074+0000","last_unstale":"2023-08-10T10:38:23.326145+0000","last_undegraded":"2023-08-10T10:38:23.326145+0000","last_fullsized":"2023-08-10T10:38:23.326145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327929+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:38:23.327929+0000","last_peered":"2023-08-10T10:38:23.327929+0000","last_clean":"2023-08-10T10:38:23.327929+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:38:23.327929+0000","last_undegraded":"2023-08-10T10:38:23.327929+0000","last_fullsized":"2023-08-10T10:38:23.327929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:11.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325615+0000","last_change":"2023-08-10T10:38:21.206286+0000","last_active":"2023-08-10T10:38:23.325615+0000","last_peered":"2023-08-10T10:38:23.325615+0000","last_clean":"2023-08-10T10:38:23.325615+0000","last_became_active":"2023-08-10T10:38:21.205708+0000","last_became_peered":"2023-08-10T10:38:21.205708+0000","last_unstale":"2023-08-10T10:38:23.325615+0000","last_undegraded":"2023-08-10T10:38:23.325615+0000","last_fullsized":"2023-08-10T10:38:23.325615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325132+0000","last_change":"2023-08-10T10:38:22.227415+0000","last_active":"2023-08-10T10:38:23.325132+0000","last_peered":"2023-08-10T10:38:23.325132+0000","last_clean":"2023-08-10T10:38:23.325132+0000","last_became_active":"2023-08-10T10:38:22.226780+0000","last_became_peered":"2023-08-10T10:38:22.226780+0000","last_unstale":"2023-08-10T10:38:23.325132+0000","last_undegraded":"2023-08-10T10:38:23.325132+0000","last_fullsized":"2023-08-10T10:38:23.325132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.194801+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:38:22.194801+0000","last_peered":"2023-08-10T10:38:22.194801+0000","last_clean":"2023-08-10T10:38:22.194801+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:38:22.194801+0000","last_undegraded":"2023-08-10T10:38:22.194801+0000","last_fullsized":"2023-08-10T10:38:22.194801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:26:52.758209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.201484+0000","last_change":"2023-08-10T10:38:21.195201+0000","last_active":"2023-08-10T10:38:22.201484+0000","last_peered":"2023-08-10T10:38:22.201484+0000","last_clean":"2023-08-10T10:38:22.201484+0000","last_became_active":"2023-08-10T10:38:21.194755+0000","last_became_peered":"2023-08-10T10:38:21.194755+0000","last_unstale":"2023-08-10T10:38:22.201484+0000","last_undegraded":"2023-08-10T10:38:22.201484+0000","last_fullsized":"2023-08-10T10:38:22.201484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:16.172173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225946+0000","last_change":"2023-08-10T10:38:22.225863+0000","last_active":"2023-08-10T10:38:22.225946+0000","last_peered":"2023-08-10T10:38:22.225946+0000","last_clean":"2023-08-10T10:38:22.225946+0000","last_became_active":"2023-08-10T10:38:22.225087+0000","last_became_peered":"2023-08-10T10:38:22.225087+0000","last_unstale":"2023-08-10T10:38:22.225946+0000","last_undegraded":"2023-08-10T10:38:22.225946+0000","last_fullsized":"2023-08-10T10:38:22.225946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:26.818785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203433+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:38:23.203433+0000","last_peered":"2023-08-10T10:38:23.203433+0000","last_clean":"2023-08-10T10:38:23.203433+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:38:23.203433+0000","last_undegraded":"2023-08-10T10:38:23.203433+0000","last_fullsized":"2023-08-10T10:38:23.203433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.917501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202604+0000","last_change":"2023-08-10T10:38:21.208553+0000","last_active":"2023-08-10T10:38:23.202604+0000","last_peered":"2023-08-10T10:38:23.202604+0000","last_clean":"2023-08-10T10:38:23.202604+0000","last_became_active":"2023-08-10T10:38:21.207885+0000","last_became_peered":"2023-08-10T10:38:21.207885+0000","last_unstale":"2023-08-10T10:38:23.202604+0000","last_undegraded":"2023-08-10T10:38:23.202604+0000","last_fullsized":"2023-08-10T10:38:23.202604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.213277+0000","last_change":"2023-08-10T10:38:22.209787+0000","last_active":"2023-08-10T10:38:22.213277+0000","last_peered":"2023-08-10T10:38:22.213277+0000","last_clean":"2023-08-10T10:38:22.213277+0000","last_became_active":"2023-08-10T10:38:22.209252+0000","last_became_peered":"2023-08-10T10:38:22.209252+0000","last_unstale":"2023-08-10T10:38:22.213277+0000","last_undegraded":"2023-08-10T10:38:22.213277+0000","last_fullsized":"2023-08-10T10:38:22.213277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201820+0000","last_change":"2023-08-10T10:38:21.199662+0000","last_active":"2023-08-10T10:38:23.201820+0000","last_peered":"2023-08-10T10:38:23.201820+0000","last_clean":"2023-08-10T10:38:23.201820+0000","last_became_active":"2023-08-10T10:38:21.199287+0000","last_became_peered":"2023-08-10T10:38:21.199287+0000","last_unstale":"2023-08-10T10:38:23.201820+0000","last_undegraded":"2023-08-10T10:38:23.201820+0000","last_fullsized":"2023-08-10T10:38:23.201820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.206754+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:38:22.206754+0000","last_peered":"2023-08-10T10:38:22.206754+0000","last_clean":"2023-08-10T10:38:22.206754+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:38:22.206754+0000","last_undegraded":"2023-08-10T10:38:22.206754+0000","last_fullsized":"2023-08-10T10:38:22.206754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:25.296287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225774+0000","last_change":"2023-08-10T10:38:22.225637+0000","last_active":"2023-08-10T10:38:22.225774+0000","last_peered":"2023-08-10T10:38:22.225774+0000","last_clean":"2023-08-10T10:38:22.225774+0000","last_became_active":"2023-08-10T10:38:22.224629+0000","last_became_peered":"2023-08-10T10:38:22.224629+0000","last_unstale":"2023-08-10T10:38:22.225774+0000","last_undegraded":"2023-08-10T10:38:22.225774+0000","last_fullsized":"2023-08-10T10:38:22.225774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:08.468410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.206527+0000","last_change":"2023-08-10T10:38:21.200714+0000","last_active":"2023-08-10T10:38:22.206527+0000","last_peered":"2023-08-10T10:38:22.206527+0000","last_clean":"2023-08-10T10:38:22.206527+0000","last_became_active":"2023-08-10T10:38:21.200451+0000","last_became_peered":"2023-08-10T10:38:21.200451+0000","last_unstale":"2023-08-10T10:38:22.206527+0000","last_undegraded":"2023-08-10T10:38:22.206527+0000","last_fullsized":"2023-08-10T10:38:22.206527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:48.872077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327627+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:38:23.327627+0000","last_peered":"2023-08-10T10:38:23.327627+0000","last_clean":"2023-08-10T10:38:23.327627+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:38:23.327627+0000","last_undegraded":"2023-08-10T10:38:23.327627+0000","last_fullsized":"2023-08-10T10:38:23.327627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:23.252217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325297+0000","last_change":"2023-08-10T10:38:22.216529+0000","last_active":"2023-08-10T10:38:23.325297+0000","last_peered":"2023-08-10T10:38:23.325297+0000","last_clean":"2023-08-10T10:38:23.325297+0000","last_became_active":"2023-08-10T10:38:22.216258+0000","last_became_peered":"2023-08-10T10:38:22.216258+0000","last_unstale":"2023-08-10T10:38:23.325297+0000","last_undegraded":"2023-08-10T10:38:23.325297+0000","last_fullsized":"2023-08-10T10:38:23.325297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200984+0000","last_change":"2023-08-10T10:38:21.201020+0000","last_active":"2023-08-10T10:38:23.200984+0000","last_peered":"2023-08-10T10:38:23.200984+0000","last_clean":"2023-08-10T10:38:23.200984+0000","last_became_active":"2023-08-10T10:38:21.200776+0000","last_became_peered":"2023-08-10T10:38:21.200776+0000","last_unstale":"2023-08-10T10:38:23.200984+0000","last_undegraded":"2023-08-10T10:38:23.200984+0000","last_fullsized":"2023-08-10T10:38:23.200984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.204764+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:38:22.204764+0000","last_peered":"2023-08-10T10:38:22.204764+0000","last_clean":"2023-08-10T10:38:22.204764+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:38:22.204764+0000","last_undegraded":"2023-08-10T10:38:22.204764+0000","last_fullsized":"2023-08-10T10:38:22.204764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:05.448881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200047+0000","last_change":"2023-08-10T10:38:22.218095+0000","last_active":"2023-08-10T10:38:23.200047+0000","last_peered":"2023-08-10T10:38:23.200047+0000","last_clean":"2023-08-10T10:38:23.200047+0000","last_became_active":"2023-08-10T10:38:22.216987+0000","last_became_peered":"2023-08-10T10:38:22.216987+0000","last_unstale":"2023-08-10T10:38:23.200047+0000","last_undegraded":"2023-08-10T10:38:23.200047+0000","last_fullsized":"2023-08-10T10:38:23.200047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324524+0000","last_change":"2023-08-10T10:38:21.205196+0000","last_active":"2023-08-10T10:38:23.324524+0000","last_peered":"2023-08-10T10:38:23.324524+0000","last_clean":"2023-08-10T10:38:23.324524+0000","last_became_active":"2023-08-10T10:38:21.204571+0000","last_became_peered":"2023-08-10T10:38:21.204571+0000","last_unstale":"2023-08-10T10:38:23.324524+0000","last_undegraded":"2023-08-10T10:38:23.324524+0000","last_fullsized":"2023-08-10T10:38:23.324524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325403+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:38:23.325403+0000","last_peered":"2023-08-10T10:38:23.325403+0000","last_clean":"2023-08-10T10:38:23.325403+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:38:23.325403+0000","last_undegraded":"2023-08-10T10:38:23.325403+0000","last_fullsized":"2023-08-10T10:38:23.325403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:42.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202232+0000","last_change":"2023-08-10T10:38:22.220123+0000","last_active":"2023-08-10T10:38:23.202232+0000","last_peered":"2023-08-10T10:38:23.202232+0000","last_clean":"2023-08-10T10:38:23.202232+0000","last_became_active":"2023-08-10T10:38:22.214781+0000","last_became_peered":"2023-08-10T10:38:22.214781+0000","last_unstale":"2023-08-10T10:38:23.202232+0000","last_undegraded":"2023-08-10T10:38:23.202232+0000","last_fullsized":"2023-08-10T10:38:23.202232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203196+0000","last_change":"2023-08-10T10:38:22.222039+0000","last_active":"2023-08-10T10:38:23.203196+0000","last_peered":"2023-08-10T10:38:23.203196+0000","last_clean":"2023-08-10T10:38:23.203196+0000","last_became_active":"2023-08-10T10:38:22.220581+0000","last_became_peered":"2023-08-10T10:38:22.220581+0000","last_unstale":"2023-08-10T10:38:23.203196+0000","last_undegraded":"2023-08-10T10:38:23.203196+0000","last_fullsized":"2023-08-10T10:38:23.203196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:11.283723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201459+0000","last_change":"2023-08-10T10:38:21.203533+0000","last_active":"2023-08-10T10:38:23.201459+0000","last_peered":"2023-08-10T10:38:23.201459+0000","last_clean":"2023-08-10T10:38:23.201459+0000","last_became_active":"2023-08-10T10:38:21.203281+0000","last_became_peered":"2023-08-10T10:38:21.203281+0000","last_unstale":"2023-08-10T10:38:23.201459+0000","last_undegraded":"2023-08-10T10:38:23.201459+0000","last_fullsized":"2023-08-10T10:38:23.201459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:26.689515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.225039+0000","last_change":"2023-08-10T10:38:22.224954+0000","last_active":"2023-08-10T10:38:22.225039+0000","last_peered":"2023-08-10T10:38:22.225039+0000","last_clean":"2023-08-10T10:38:22.225039+0000","last_became_active":"2023-08-10T10:38:22.224681+0000","last_became_peered":"2023-08-10T10:38:22.224681+0000","last_unstale":"2023-08-10T10:38:22.225039+0000","last_undegraded":"2023-08-10T10:38:22.225039+0000","last_fullsized":"2023-08-10T10:38:22.225039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326588+0000","last_change":"2023-08-10T10:38:21.203411+0000","last_active":"2023-08-10T10:38:23.326588+0000","last_peered":"2023-08-10T10:38:23.326588+0000","last_clean":"2023-08-10T10:38:23.326588+0000","last_became_active":"2023-08-10T10:38:21.203148+0000","last_became_peered":"2023-08-10T10:38:21.203148+0000","last_unstale":"2023-08-10T10:38:23.326588+0000","last_undegraded":"2023-08-10T10:38:23.326588+0000","last_fullsized":"2023-08-10T10:38:23.326588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:30.056821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202965+0000","last_change":"2023-08-10T10:38:21.201006+0000","last_active":"2023-08-10T10:38:23.202965+0000","last_peered":"2023-08-10T10:38:23.202965+0000","last_clean":"2023-08-10T10:38:23.202965+0000","last_became_active":"2023-08-10T10:38:21.200714+0000","last_became_peered":"2023-08-10T10:38:21.200714+0000","last_unstale":"2023-08-10T10:38:23.202965+0000","last_undegraded":"2023-08-10T10:38:23.202965+0000","last_fullsized":"2023-08-10T10:38:23.202965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200418+0000","last_change":"2023-08-10T10:38:22.215890+0000","last_active":"2023-08-10T10:38:23.200418+0000","last_peered":"2023-08-10T10:38:23.200418+0000","last_clean":"2023-08-10T10:38:23.200418+0000","last_became_active":"2023-08-10T10:38:22.215479+0000","last_became_peered":"2023-08-10T10:38:22.215479+0000","last_unstale":"2023-08-10T10:38:23.200418+0000","last_undegraded":"2023-08-10T10:38:23.200418+0000","last_fullsized":"2023-08-10T10:38:23.200418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325621+0000","last_change":"2023-08-10T10:38:21.202668+0000","last_active":"2023-08-10T10:38:23.325621+0000","last_peered":"2023-08-10T10:38:23.325621+0000","last_clean":"2023-08-10T10:38:23.325621+0000","last_became_active":"2023-08-10T10:38:21.202245+0000","last_became_peered":"2023-08-10T10:38:21.202245+0000","last_unstale":"2023-08-10T10:38:23.325621+0000","last_undegraded":"2023-08-10T10:38:23.325621+0000","last_fullsized":"2023-08-10T10:38:23.325621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200327+0000","last_change":"2023-08-10T10:38:22.206881+0000","last_active":"2023-08-10T10:38:23.200327+0000","last_peered":"2023-08-10T10:38:23.200327+0000","last_clean":"2023-08-10T10:38:23.200327+0000","last_became_active":"2023-08-10T10:38:22.206376+0000","last_became_peered":"2023-08-10T10:38:22.206376+0000","last_unstale":"2023-08-10T10:38:23.200327+0000","last_undegraded":"2023-08-10T10:38:23.200327+0000","last_fullsized":"2023-08-10T10:38:23.200327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325097+0000","last_change":"2023-08-10T10:38:22.219281+0000","last_active":"2023-08-10T10:38:23.325097+0000","last_peered":"2023-08-10T10:38:23.325097+0000","last_clean":"2023-08-10T10:38:23.325097+0000","last_became_active":"2023-08-10T10:38:22.219015+0000","last_became_peered":"2023-08-10T10:38:22.219015+0000","last_unstale":"2023-08-10T10:38:23.325097+0000","last_undegraded":"2023-08-10T10:38:23.325097+0000","last_fullsized":"2023-08-10T10:38:23.325097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200334+0000","last_change":"2023-08-10T10:38:21.203137+0000","last_active":"2023-08-10T10:38:23.200334+0000","last_peered":"2023-08-10T10:38:23.200334+0000","last_clean":"2023-08-10T10:38:23.200334+0000","last_became_active":"2023-08-10T10:38:21.202879+0000","last_became_peered":"2023-08-10T10:38:21.202879+0000","last_unstale":"2023-08-10T10:38:23.200334+0000","last_undegraded":"2023-08-10T10:38:23.200334+0000","last_fullsized":"2023-08-10T10:38:23.200334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324925+0000","last_change":"2023-08-10T10:38:22.216641+0000","last_active":"2023-08-10T10:38:23.324925+0000","last_peered":"2023-08-10T10:38:23.324925+0000","last_clean":"2023-08-10T10:38:23.324925+0000","last_became_active":"2023-08-10T10:38:22.216326+0000","last_became_peered":"2023-08-10T10:38:22.216326+0000","last_unstale":"2023-08-10T10:38:23.324925+0000","last_undegraded":"2023-08-10T10:38:23.324925+0000","last_fullsized":"2023-08-10T10:38:23.324925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.201119+0000","last_change":"2023-08-10T10:38:21.196362+0000","last_active":"2023-08-10T10:38:22.201119+0000","last_peered":"2023-08-10T10:38:22.201119+0000","last_clean":"2023-08-10T10:38:22.201119+0000","last_became_active":"2023-08-10T10:38:21.196026+0000","last_became_peered":"2023-08-10T10:38:21.196026+0000","last_unstale":"2023-08-10T10:38:22.201119+0000","last_undegraded":"2023-08-10T10:38:22.201119+0000","last_fullsized":"2023-08-10T10:38:22.201119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:47.364374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199967+0000","last_change":"2023-08-10T10:38:22.211342+0000","last_active":"2023-08-10T10:38:23.199967+0000","last_peered":"2023-08-10T10:38:23.199967+0000","last_clean":"2023-08-10T10:38:23.199967+0000","last_became_active":"2023-08-10T10:38:22.210963+0000","last_became_peered":"2023-08-10T10:38:22.210963+0000","last_unstale":"2023-08-10T10:38:23.199967+0000","last_undegraded":"2023-08-10T10:38:23.199967+0000","last_fullsized":"2023-08-10T10:38:23.199967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202602+0000","last_change":"2023-08-10T10:38:21.192358+0000","last_active":"2023-08-10T10:38:23.202602+0000","last_peered":"2023-08-10T10:38:23.202602+0000","last_clean":"2023-08-10T10:38:23.202602+0000","last_became_active":"2023-08-10T10:38:21.188537+0000","last_became_peered":"2023-08-10T10:38:21.188537+0000","last_unstale":"2023-08-10T10:38:23.202602+0000","last_undegraded":"2023-08-10T10:38:23.202602+0000","last_fullsized":"2023-08-10T10:38:23.202602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-10T10:38:22.227306+0000","last_change":"2023-08-10T10:38:22.227114+0000","last_active":"2023-08-10T10:38:22.227306+0000","last_peered":"2023-08-10T10:38:22.227306+0000","last_clean":"2023-08-10T10:38:22.227306+0000","last_became_active":"2023-08-10T10:38:22.226785+0000","last_became_peered":"2023-08-10T10:38:22.226785+0000","last_unstale":"2023-08-10T10:38:22.227306+0000","last_undegraded":"2023-08-10T10:38:22.227306+0000","last_fullsized":"2023-08-10T10:38:22.227306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:55.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324921+0000","last_change":"2023-08-10T10:38:21.205454+0000","last_active":"2023-08-10T10:38:23.324921+0000","last_peered":"2023-08-10T10:38:23.324921+0000","last_clean":"2023-08-10T10:38:23.324921+0000","last_became_active":"2023-08-10T10:38:21.204999+0000","last_became_peered":"2023-08-10T10:38:21.204999+0000","last_unstale":"2023-08-10T10:38:23.324921+0000","last_undegraded":"2023-08-10T10:38:23.324921+0000","last_fullsized":"2023-08-10T10:38:23.324921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201533+0000","last_change":"2023-08-10T10:38:22.204621+0000","last_active":"2023-08-10T10:38:23.201533+0000","last_peered":"2023-08-10T10:38:23.201533+0000","last_clean":"2023-08-10T10:38:23.201533+0000","last_became_active":"2023-08-10T10:38:22.203468+0000","last_became_peered":"2023-08-10T10:38:22.203468+0000","last_unstale":"2023-08-10T10:38:23.201533+0000","last_undegraded":"2023-08-10T10:38:23.201533+0000","last_fullsized":"2023-08-10T10:38:23.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203621+0000","last_change":"2023-08-10T10:38:21.205716+0000","last_active":"2023-08-10T10:38:23.203621+0000","last_peered":"2023-08-10T10:38:23.203621+0000","last_clean":"2023-08-10T10:38:23.203621+0000","last_became_active":"2023-08-10T10:38:21.205452+0000","last_became_peered":"2023-08-10T10:38:21.205452+0000","last_unstale":"2023-08-10T10:38:23.203621+0000","last_undegraded":"2023-08-10T10:38:23.203621+0000","last_fullsized":"2023-08-10T10:38:23.203621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201532+0000","last_change":"2023-08-10T10:38:22.204384+0000","last_active":"2023-08-10T10:38:23.201532+0000","last_peered":"2023-08-10T10:38:23.201532+0000","last_clean":"2023-08-10T10:38:23.201532+0000","last_became_active":"2023-08-10T10:38:22.203734+0000","last_became_peered":"2023-08-10T10:38:22.203734+0000","last_unstale":"2023-08-10T10:38:23.201532+0000","last_undegraded":"2023-08-10T10:38:23.201532+0000","last_fullsized":"2023-08-10T10:38:23.201532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202837+0000","last_change":"2023-08-10T10:38:21.206125+0000","last_active":"2023-08-10T10:38:23.202837+0000","last_peered":"2023-08-10T10:38:23.202837+0000","last_clean":"2023-08-10T10:38:23.202837+0000","last_became_active":"2023-08-10T10:38:21.205886+0000","last_became_peered":"2023-08-10T10:38:21.205886+0000","last_unstale":"2023-08-10T10:38:23.202837+0000","last_undegraded":"2023-08-10T10:38:23.202837+0000","last_fullsized":"2023-08-10T10:38:23.202837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201042+0000","last_change":"2023-08-10T10:38:22.215801+0000","last_active":"2023-08-10T10:38:23.201042+0000","last_peered":"2023-08-10T10:38:23.201042+0000","last_clean":"2023-08-10T10:38:23.201042+0000","last_became_active":"2023-08-10T10:38:22.212123+0000","last_became_peered":"2023-08-10T10:38:22.212123+0000","last_unstale":"2023-08-10T10:38:23.201042+0000","last_undegraded":"2023-08-10T10:38:23.201042+0000","last_fullsized":"2023-08-10T10:38:23.201042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201481+0000","last_change":"2023-08-10T10:38:21.201607+0000","last_active":"2023-08-10T10:38:23.201481+0000","last_peered":"2023-08-10T10:38:23.201481+0000","last_clean":"2023-08-10T10:38:23.201481+0000","last_became_active":"2023-08-10T10:38:21.201016+0000","last_became_peered":"2023-08-10T10:38:21.201016+0000","last_unstale":"2023-08-10T10:38:23.201481+0000","last_undegraded":"2023-08-10T10:38:23.201481+0000","last_fullsized":"2023-08-10T10:38:23.201481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202358+0000","last_change":"2023-08-10T10:38:22.222200+0000","last_active":"2023-08-10T10:38:23.202358+0000","last_peered":"2023-08-10T10:38:23.202358+0000","last_clean":"2023-08-10T10:38:23.202358+0000","last_became_active":"2023-08-10T10:38:22.220969+0000","last_became_peered":"2023-08-10T10:38:22.220969+0000","last_unstale":"2023-08-10T10:38:23.202358+0000","last_undegraded":"2023-08-10T10:38:23.202358+0000","last_fullsized":"2023-08-10T10:38:23.202358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325410+0000","last_change":"2023-08-10T10:38:21.204806+0000","last_active":"2023-08-10T10:38:23.325410+0000","last_peered":"2023-08-10T10:38:23.325410+0000","last_clean":"2023-08-10T10:38:23.325410+0000","last_became_active":"2023-08-10T10:38:21.204098+0000","last_became_peered":"2023-08-10T10:38:21.204098+0000","last_unstale":"2023-08-10T10:38:23.325410+0000","last_undegraded":"2023-08-10T10:38:23.325410+0000","last_fullsized":"2023-08-10T10:38:23.325410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8480000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195232,"statfs":{"total":200000000,"available":199917581,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":82,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195230,"statfs":{"total":200000000,"available":199915594,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194655,"statfs":{"total":200000000,"available":199327283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]}],"pool_statfs":[]}} 2023-08-10T10:38:27.356 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:38:27.357 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-10T10:38:27.357 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-10T10:38:27.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-10T10:38:27.358 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-10T10:38:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.629+0000 7f19f920f640 1 Processor -- start 2023-08-10T10:38:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.629+0000 7f19f920f640 1 -- start start 2023-08-10T10:38:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f920f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19f40ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f920f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f40b40b0 con 0x7f19f40c14e0 2023-08-10T10:38:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f920f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f40cc100 con 0x7f19f4161140 2023-08-10T10:38:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f920f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40cc3e0 con 0x7f19f40b0620 2023-08-10T10:38:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f8a0e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19f40c14e0 0x7f19f40cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37226/0 (socket says 172.21.15.50:37226) 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.631+0000 7f19f8a0e640 1 -- 172.21.15.50:0/260061559 learned_addr learned my addr 172.21.15.50:0/260061559 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f37fe640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19f40ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298218726 0 0) 0x7f19f40b40b0 con 0x7f19f40c14e0 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19dc003520 con 0x7f19f40c14e0 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343795879 0 0) 0x7f19dc003520 con 0x7f19f40c14e0 2023-08-10T10:38:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 msgr2=0x7f19f40ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19f40ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 >> v1:172.21.15.117:6789/0 conn(0x7f19f4161140 legacy=0x7f19f40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40cc6c0 con 0x7f19f40c14e0 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f19ec0019f0 con 0x7f19f40c14e0 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 >> v1:172.21.15.50:6789/0 conn(0x7f19f40c14e0 legacy=0x7f19f40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19dc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc003f90 0x7f19dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc004d00 0x7f19dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40cc3e0 con 0x7f19dc003f90 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc00bae0 con 0x7f19dc004d00 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.632+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc00bca0 con 0x7f19f40b0620 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc003f90 0x7f19dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f3fff640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19dc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f8a0e640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc004d00 0x7f19dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 -- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 msgr2=0x7f19dc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:27.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19dc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 -- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc004d00 msgr2=0x7f19dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc004d00 0x7f19dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f37fe640 1 -- 172.21.15.50:0/260061559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc003520 con 0x7f19dc003f90 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.633+0000 7f19f3fff640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f40b0620 0x7f19dc003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.634+0000 7f19f37fe640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc003f90 0x7f19dc0047c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009ac0 tx=0x7f19dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450d0ed7a45fde38 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e802c600 con 0x7f19dc003f90 2023-08-10T10:38:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e802c760 con 0x7f19dc003f90 2023-08-10T10:38:27.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f2ffd640 1 -- 172.21.15.50:0/260061559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e802caf0 con 0x7f19dc003f90 2023-08-10T10:38:27.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 -- 172.21.15.50:0/260061559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc003f90 msgr2=0x7f19dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 --2- 172.21.15.50:0/260061559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19dc003f90 0x7f19dc0047c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009ac0 tx=0x7f19dc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f8a0e640 1 -- 172.21.15.50:0/260061559 reap_dead start 2023-08-10T10:38:27.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 -- 172.21.15.50:0/260061559 shutdown_connections 2023-08-10T10:38:27.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 -- 172.21.15.50:0/260061559 >> 172.21.15.50:0/260061559 conn(0x7f19f406ab80 msgr2=0x7f19f406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:27.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 -- 172.21.15.50:0/260061559 shutdown_connections 2023-08-10T10:38:27.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.635+0000 7f19f920f640 1 -- 172.21.15.50:0/260061559 wait complete. 2023-08-10T10:38:27.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.637+0000 7f19f920f640 1 Processor -- start 2023-08-10T10:38:27.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.638+0000 7f19f920f640 1 -- start start 2023-08-10T10:38:27.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 0x7f19f415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 0x7f19f41616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f415b1b0 con 0x7f19f40c70e0 2023-08-10T10:38:27.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40c5560 con 0x7f19dc003f90 2023-08-10T10:38:27.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f920f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41fa620 con 0x7f19f41fa120 2023-08-10T10:38:27.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33294/0 (socket says 172.21.15.50:33294) 2023-08-10T10:38:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 -- 172.21.15.50:0/2793255687 learned_addr learned my addr 172.21.15.50:0/2793255687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f37fe640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 0x7f19f41616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f3fff640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 0x7f19f415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 -- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 msgr2=0x7f19f41616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 0x7f19f41616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 -- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 msgr2=0x7f19f415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 0x7f19f415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f8a0e640 1 -- 172.21.15.50:0/2793255687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f41fa900 con 0x7f19f40c70e0 2023-08-10T10:38:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f37fe640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 0x7f19f41616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.639+0000 7f19f3fff640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 0x7f19f415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f8a0e640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0012e0 tx=0x7f19ec007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec00eb60 con 0x7f19f40c70e0 2023-08-10T10:38:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec00ecc0 con 0x7f19f40c70e0 2023-08-10T10:38:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec013420 con 0x7f19f40c70e0 2023-08-10T10:38:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f41fabe0 con 0x7f19f40c70e0 2023-08-10T10:38:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.640+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f4161be0 con 0x7f19f40c70e0 2023-08-10T10:38:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.641+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4161d70 con 0x7f19f40c70e0 2023-08-10T10:38:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.642+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19ec013580 con 0x7f19f40c70e0 2023-08-10T10:38:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.643+0000 7f19f0ff9640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 0x7f19e006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.643+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19ec089960 con 0x7f19f40c70e0 2023-08-10T10:38:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.644+0000 7f19f3fff640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 0x7f19e006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.644+0000 7f19f3fff640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 0x7f19e006d140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19e40016f0 tx=0x7f19e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.648+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f19ec054970 con 0x7f19f40c70e0 2023-08-10T10:38:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.887+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f19f4066e30 con 0x7f19f40c70e0 2023-08-10T10:38:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.892+0000 7f19f0ff9640 1 -- 172.21.15.50:0/2793255687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170842 (secure 0 0 0) 0x7f19ec057f90 con 0x7f19f40c70e0 2023-08-10T10:38:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 msgr2=0x7f19e006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 0x7f19e006d140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19e40016f0 tx=0x7f19e4009040 comp rx=0 tx=0).stop 2023-08-10T10:38:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 msgr2=0x7f19f40b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:27.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0012e0 tx=0x7f19ec007ba0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 shutdown_connections 2023-08-10T10:38:27.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f40c70e0 0x7f19f40b2100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f41fa120 0x7f19f41616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac80 0x7f19e006d140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 --2- 172.21.15.50:0/2793255687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19dc003f90 0x7f19f415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.897+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 >> 172.21.15.50:0/2793255687 conn(0x7f19f406ab80 msgr2=0x7f19f40adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.898+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 shutdown_connections 2023-08-10T10:38:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:27.898+0000 7f19f920f640 1 -- 172.21.15.50:0/2793255687 wait complete. 2023-08-10T10:38:27.918 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2197471967},{"type":"v1","addr":"172.21.15.50:6833","nonce":2197471967}]},"active_addr":"172.21.15.50:6833/2197471967","active_change":"2023-08-10T10:38:06.292329+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1446997910}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3145112552}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4169979137}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1198821150}]}]} 2023-08-10T10:38:27.922 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-10T10:38:27.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-10T10:38:27.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.146+0000 7f7e5626a640 1 Processor -- start 2023-08-10T10:38:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.146+0000 7f7e5626a640 1 -- start start 2023-08-10T10:38:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e5626a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e500b8430 0x7f7e500cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e5626a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500ce200 con 0x7f7e5015cd60 2023-08-10T10:38:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e5626a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e50161180 con 0x7f7e500cddb0 2023-08-10T10:38:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e5626a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500b5bd0 con 0x7f7e500b8430 2023-08-10T10:38:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e4ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7e5015cd60 0x7f7e50160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37238/0 (socket says 172.21.15.50:37238) 2023-08-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e4ffff640 1 -- 172.21.15.50:0/1548161450 learned_addr learned my addr 172.21.15.50:0/1548161450 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.148+0000 7f7e47fff640 1 --2- 172.21.15.50:0/1548161450 >> v2:172.21.15.50:3300/0 conn(0x7f7e500b8430 0x7f7e500cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.149+0000 7f7e4f7fe640 1 -- 172.21.15.50:0/1548161450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248552122 0 0) 0x7f7e40001110 con 0x7f7e5015cd60 2023-08-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.149+0000 7f7e4f7fe640 1 -- 172.21.15.50:0/1548161450 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e3c003520 con 0x7f7e5015cd60 2023-08-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.149+0000 7f7e47fff640 1 -- 172.21.15.50:0/1548161450 >> v1:172.21.15.117:6789/0 conn(0x7f7e500cddb0 legacy=0x7f7e500d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.149+0000 7f7e47fff640 1 -- 172.21.15.50:0/1548161450 >> v1:172.21.15.50:6789/0 conn(0x7f7e5015cd60 legacy=0x7f7e50160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.149+0000 7f7e47fff640 1 -- 172.21.15.50:0/1548161450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50161460 con 0x7f7e500b8430 2023-08-10T10:38:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.150+0000 7f7e47fff640 1 --2- 172.21.15.50:0/1548161450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500cd870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e380097a0 tx=0x7f7e3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1247e99e1593001 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.150+0000 7f7e4f7fe640 1 -- 172.21.15.50:0/1548161450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38031830 con 0x7f7e500b8430 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.150+0000 7f7e4f7fe640 1 -- 172.21.15.50:0/1548161450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38031990 con 0x7f7e500b8430 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.150+0000 7f7e4f7fe640 1 -- 172.21.15.50:0/1548161450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38031d00 con 0x7f7e500b8430 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 -- 172.21.15.50:0/1548161450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 msgr2=0x7f7e500cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 --2- 172.21.15.50:0/1548161450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500cd870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e380097a0 tx=0x7f7e3802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 -- 172.21.15.50:0/1548161450 shutdown_connections 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 --2- 172.21.15.50:0/1548161450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500cd870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 -- 172.21.15.50:0/1548161450 >> 172.21.15.50:0/1548161450 conn(0x7f7e500d2ac0 msgr2=0x7f7e500d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 -- 172.21.15.50:0/1548161450 shutdown_connections 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.151+0000 7f7e5626a640 1 -- 172.21.15.50:0/1548161450 wait complete. 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.153+0000 7f7e5626a640 1 Processor -- start 2023-08-10T10:38:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.153+0000 7f7e5626a640 1 -- start start 2023-08-10T10:38:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e500cddb0 0x7f7e500ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 0x7f7e500ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5015d6a0 con 0x7f7e500b8430 2023-08-10T10:38:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50157850 con 0x7f7e5015cd60 2023-08-10T10:38:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e5626a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b1170 con 0x7f7e500cddb0 2023-08-10T10:38:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.154+0000 7f7e4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33322/0 (socket says 172.21.15.50:33322) 2023-08-10T10:38:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 -- 172.21.15.50:0/3610191902 learned_addr learned my addr 172.21.15.50:0/3610191902 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 -- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e500cddb0 msgr2=0x7f7e500ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e47fff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e500cddb0 0x7f7e500ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e54807640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 0x7f7e500ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e500cddb0 0x7f7e500ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 -- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 msgr2=0x7f7e500ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 0x7f7e500ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 -- 172.21.15.50:0/3610191902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38009400 con 0x7f7e500b8430 2023-08-10T10:38:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e54807640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 0x7f7e500ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.155+0000 7f7e4ffff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000c780 tx=0x7f7e4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.156+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400072d0 con 0x7f7e500b8430 2023-08-10T10:38:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.156+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e40007430 con 0x7f7e500b8430 2023-08-10T10:38:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.156+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400047e0 con 0x7f7e500b8430 2023-08-10T10:38:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.156+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e500cb270 con 0x7f7e500b8430 2023-08-10T10:38:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.156+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5015d2c0 con 0x7f7e500b8430 2023-08-10T10:38:28.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.157+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50066390 con 0x7f7e500b8430 2023-08-10T10:38:28.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.158+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e40004940 con 0x7f7e500b8430 2023-08-10T10:38:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.159+0000 7f7e4d7fa640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 0x7f7e3006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.159+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e40088660 con 0x7f7e500b8430 2023-08-10T10:38:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.160+0000 7f7e47fff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 0x7f7e3006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.160+0000 7f7e47fff640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 0x7f7e3006d110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e38036000 tx=0x7f7e3803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.164+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7e40053700 con 0x7f7e500b8430 2023-08-10T10:38:28.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.360+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e500cb790 con 0x7f7e500b8430 2023-08-10T10:38:28.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.362+0000 7f7e4d7fa640 1 -- 172.21.15.50:0/3610191902 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f7e500cb790 con 0x7f7e500b8430 2023-08-10T10:38:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:28.364 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 msgr2=0x7f7e3006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 0x7f7e3006d110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e38036000 tx=0x7f7e3803c040 comp rx=0 tx=0).stop 2023-08-10T10:38:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 msgr2=0x7f7e500b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000c780 tx=0x7f7e4000cc40 comp rx=0 tx=0).stop 2023-08-10T10:38:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 shutdown_connections 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e3006ac50 0x7f7e3006d110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e5015cd60 0x7f7e500ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e500cddb0 0x7f7e500ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 --2- 172.21.15.50:0/3610191902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e500b8430 0x7f7e500b0c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.364+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 >> 172.21.15.50:0/3610191902 conn(0x7f7e500d2ac0 msgr2=0x7f7e500d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.365+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 shutdown_connections 2023-08-10T10:38:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.365+0000 7f7e5626a640 1 -- 172.21.15.50:0/3610191902 wait complete. 2023-08-10T10:38:28.385 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-10T10:38:28.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:28.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.600+0000 7f41a23c4640 1 Processor -- start 2023-08-10T10:38:28.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.600+0000 7f41a23c4640 1 -- start start 2023-08-10T10:38:28.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c153850 0x7f419c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 0x7f419c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c0cf630 0x7f419c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0d0020 con 0x7f419c153850 2023-08-10T10:38:28.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c15d010 con 0x7f419c153c30 2023-08-10T10:38:28.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a23c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15d290 con 0x7f419c0cf630 2023-08-10T10:38:28.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a13c2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c153850 0x7f419c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a13c2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c153850 0x7f419c0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33336/0 (socket says 172.21.15.50:33336) 2023-08-10T10:38:28.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.602+0000 7f41a13c2640 1 -- 172.21.15.50:0/1431460446 learned_addr learned my addr 172.21.15.50:0/1431460446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:28.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a1bc3640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c0cf630 0x7f419c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a0bc1640 1 --2- 172.21.15.50:0/1431460446 >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 0x7f419c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a13c2640 1 -- 172.21.15.50:0/1431460446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c0cf630 msgr2=0x7f419c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a13c2640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c0cf630 0x7f419c0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a13c2640 1 -- 172.21.15.50:0/1431460446 >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 msgr2=0x7f419c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a13c2640 1 --2- 172.21.15.50:0/1431460446 >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 0x7f419c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a13c2640 1 -- 172.21.15.50:0/1431460446 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c15d570 con 0x7f419c153850 2023-08-10T10:38:28.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.603+0000 7f41a0bc1640 1 --2- 172.21.15.50:0/1431460446 >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 0x7f419c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:28.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.604+0000 7f41a13c2640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c153850 0x7f419c0b1690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f419c08b960 tx=0x7f419802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3499b3fdddf3c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.604+0000 7f4193fff640 1 -- 172.21.15.50:0/1431460446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419802ca80 con 0x7f419c153850 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.604+0000 7f4193fff640 1 -- 172.21.15.50:0/1431460446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419802cbe0 con 0x7f419c153850 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.604+0000 7f4193fff640 1 -- 172.21.15.50:0/1431460446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980343f0 con 0x7f419c153850 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 -- 172.21.15.50:0/1431460446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c153850 msgr2=0x7f419c0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c153850 0x7f419c0b1690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f419c08b960 tx=0x7f419802bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 -- 172.21.15.50:0/1431460446 shutdown_connections 2023-08-10T10:38:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c0cf630 0x7f419c0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 --2- 172.21.15.50:0/1431460446 >> v2:172.21.15.117:3300/0 conn(0x7f419c153c30 0x7f419c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 --2- 172.21.15.50:0/1431460446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c153850 0x7f419c0b1690 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 -- 172.21.15.50:0/1431460446 >> 172.21.15.50:0/1431460446 conn(0x7f419c069880 msgr2=0x7f419c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 -- 172.21.15.50:0/1431460446 shutdown_connections 2023-08-10T10:38:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.605+0000 7f41a23c4640 1 -- 172.21.15.50:0/1431460446 wait complete. 2023-08-10T10:38:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.607+0000 7f41a23c4640 1 Processor -- start 2023-08-10T10:38:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.607+0000 7f41a23c4640 1 -- start start 2023-08-10T10:38:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419c153850 0x7f419c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c153c30 0x7f419c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0d3710 con 0x7f419c0cf630 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0d2e70 con 0x7f419c153850 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a23c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0d3150 con 0x7f419c153c30 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a13c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a13c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33344/0 (socket says 172.21.15.50:33344) 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.608+0000 7f41a13c2640 1 -- 172.21.15.50:0/472529536 learned_addr learned my addr 172.21.15.50:0/472529536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 -- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c153c30 msgr2=0x7f419c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c153c30 0x7f419c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 -- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419c153850 msgr2=0x7f419c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a0bc1640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419c153850 0x7f419c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419c153850 0x7f419c156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 -- 172.21.15.50:0/472529536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009b30 con 0x7f419c0cf630 2023-08-10T10:38:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.609+0000 7f41a13c2640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4198000f80 tx=0x7f4198004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.610+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419803e450 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.610+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419803e5f0 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.610+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419803e9a0 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.610+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c0d3430 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.610+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c156680 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.611+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c1540a0 con 0x7f419c0cf630 2023-08-10T10:38:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.612+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f419802cd50 con 0x7f419c0cf630 2023-08-10T10:38:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.613+0000 7f4191ffb640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 0x7f418006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.613+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41980ac200 con 0x7f419c0cf630 2023-08-10T10:38:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.613+0000 7f41a0bc1640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 0x7f418006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.614+0000 7f41a0bc1640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 0x7f418006d110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f419c151620 tx=0x7f418c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.618+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f419c1540a0 con 0x7f419c0cf630 2023-08-10T10:38:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.809+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f419c15db10 con 0x7f419c0cf630 2023-08-10T10:38:28.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.812+0000 7f4191ffb640 1 -- 172.21.15.50:0/472529536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f419c15db10 con 0x7f419c0cf630 2023-08-10T10:38:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:28.814 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.814+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 msgr2=0x7f418006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.814+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 0x7f418006d110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f419c151620 tx=0x7f418c008040 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.814+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 msgr2=0x7f419c0d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.814+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4198000f80 tx=0x7f4198004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 shutdown_connections 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419c153c30 0x7f419c0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f418006ac50 0x7f418006d110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419c153850 0x7f419c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 --2- 172.21.15.50:0/472529536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0cf630 0x7f419c0d2790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 >> 172.21.15.50:0/472529536 conn(0x7f419c069880 msgr2=0x7f419c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 shutdown_connections 2023-08-10T10:38:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:28.815+0000 7f41a23c4640 1 -- 172.21.15.50:0/472529536 wait complete. 2023-08-10T10:38:28.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-10T10:38:28.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-10T10:38:28.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-10T10:38:28.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-10T10:38:28.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-10T10:38:28.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-10T10:38:28.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-10T10:38:28.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-10T10:38:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.150+0000 7f66ad257640 1 Processor -- start 2023-08-10T10:38:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.150+0000 7f66ad257640 1 -- start start 2023-08-10T10:38:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.152+0000 7f66ad257640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f66a80c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.152+0000 7f66ad257640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66a806b4f0 0x7f66a80cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.152+0000 7f66ad257640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a8158fa0 con 0x7f66a8158bc0 2023-08-10T10:38:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.152+0000 7f66ad257640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80c9d90 con 0x7f66a806b4f0 2023-08-10T10:38:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.152+0000 7f66ad257640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c9180 con 0x7f66a806c970 2023-08-10T10:38:29.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.153+0000 7f66a6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66a8158bc0 0x7f66a806c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37242/0 (socket says 172.21.15.50:37242) 2023-08-10T10:38:29.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.153+0000 7f66a6d9d640 1 -- 172.21.15.50:0/2988017241 learned_addr learned my addr 172.21.15.50:0/2988017241 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a659c640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f66a80c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15258326 0 0) 0x7f6698001110 con 0x7f66a8158bc0 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6690007930 con 0x7f66a8158bc0 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a759e640 1 --2- 172.21.15.50:0/2988017241 >> v2:172.21.15.117:3300/0 conn(0x7f66a806b4f0 0x7f66a80cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3548896246 0 0) 0x7f6690007930 con 0x7f66a8158bc0 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 msgr2=0x7f66a80c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f66a80c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 >> v2:172.21.15.117:3300/0 conn(0x7f66a806b4f0 msgr2=0x7f66a80cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 --2- 172.21.15.50:0/2988017241 >> v2:172.21.15.117:3300/0 conn(0x7f66a806b4f0 0x7f66a80cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80c9460 con 0x7f66a8158bc0 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6698001800 con 0x7f66a8158bc0 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 >> v1:172.21.15.50:6789/0 conn(0x7f66a8158bc0 legacy=0x7f66a806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f6690007d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6690008300 0x7f6690008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690008780 0x7f6690009110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c9d90 con 0x7f6690008300 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c9180 con 0x7f6690008780 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.154+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900098e0 con 0x7f66a806c970 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6690008300 0x7f6690008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a6d9d640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f6690007d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 -- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 msgr2=0x7f6690007d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a806c970 0x7f6690007d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a759e640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690008780 0x7f6690009110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 -- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690008780 msgr2=0x7f6690009110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690008780 0x7f6690009110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.155+0000 7f66a659c640 1 -- 172.21.15.50:0/2988017241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80c9460 con 0x7f6690008300 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.157+0000 7f66a659c640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6690008300 0x7f6690008bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007da0 tx=0x7f6690009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5fe8c7f1d9fe5f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.158+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a002cde0 con 0x7f6690008300 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.158+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0008bb0 con 0x7f6690008300 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.158+0000 7f66a5d9b640 1 -- 172.21.15.50:0/2988017241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000a0d0 con 0x7f6690008300 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.159+0000 7f66ad257640 1 -- 172.21.15.50:0/2988017241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6690008300 msgr2=0x7f6690008bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.159+0000 7f66ad257640 1 --2- 172.21.15.50:0/2988017241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6690008300 0x7f6690008bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007da0 tx=0x7f6690009c00 comp rx=0 tx=0).stop 2023-08-10T10:38:29.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.159+0000 7f66a759e640 1 -- 172.21.15.50:0/2988017241 reap_dead start 2023-08-10T10:38:29.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.159+0000 7f66ad257640 1 -- 172.21.15.50:0/2988017241 shutdown_connections 2023-08-10T10:38:29.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.159+0000 7f66ad257640 1 -- 172.21.15.50:0/2988017241 >> 172.21.15.50:0/2988017241 conn(0x7f66a80ce4e0 msgr2=0x7f66a80ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.160+0000 7f66ad257640 1 -- 172.21.15.50:0/2988017241 shutdown_connections 2023-08-10T10:38:29.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.160+0000 7f66ad257640 1 -- 172.21.15.50:0/2988017241 wait complete. 2023-08-10T10:38:29.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.161+0000 7f71d3fb5640 1 Processor -- start 2023-08-10T10:38:29.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.162+0000 7f66ad257640 1 Processor -- start 2023-08-10T10:38:29.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.161+0000 7f71d3fb5640 1 -- start start 2023-08-10T10:38:29.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.163+0000 7f66ad257640 1 -- start start 2023-08-10T10:38:29.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.163+0000 7f71d3fb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.164+0000 7f71d3fb5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 0x7f71cc0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.164+0000 7f71d1d51640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f71cc15ca90 0x7f71cc0b8180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44512/0 (socket says 172.21.15.50:44512) 2023-08-10T10:38:29.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.164+0000 7f71d1550640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.164+0000 7f71d1550640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52278/0 (socket says 172.21.15.50:52278) 2023-08-10T10:38:29.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.164+0000 7f71d2552640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 0x7f71cc0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.165+0000 7f71d2552640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 0x7f71cc0cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33364/0 (socket says 172.21.15.50:33364) 2023-08-10T10:38:29.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.165+0000 7f71d1d51640 1 -- 172.21.15.50:0/3534968215 learned_addr learned my addr 172.21.15.50:0/3534968215 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.165+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc0b1d60 con 0x7f71cc15ca90 2023-08-10T10:38:29.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.165+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0d0ca0 con 0x7f71cc0d21a0 2023-08-10T10:38:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.165+0000 7f66ad257640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 0x7f66a8071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66ad257640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a815aa10 0x7f66a815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66ad257640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 0x7f66a81f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0d0f80 con 0x7f71cc0d1d40 2023-08-10T10:38:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f71d0d4f640 1 -- 172.21.15.50:0/3534968215 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392822697 0 0) 0x7f71cc0b1d60 con 0x7f71cc15ca90 2023-08-10T10:38:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 0x7f66a8071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 0x7f66a8071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52288/0 (socket says 172.21.15.50:52288) 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 0x7f66a81f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 0x7f66a81f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33376/0 (socket says 172.21.15.50:33376) 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a815aa10 0x7f66a815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f66a659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a815aa10 0x7f66a815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42272/0 (socket says 172.21.15.50:42272) 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f66a6d9d640 1 -- 172.21.15.50:0/1666531963 learned_addr learned my addr 172.21.15.50:0/1666531963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f66ad257640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815bf80 con 0x7f66a815bb00 2023-08-10T10:38:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f66ad257640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a806f850 con 0x7f66a815aa10 2023-08-10T10:38:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f66ad257640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a806faa0 con 0x7f66a80ccf10 2023-08-10T10:38:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.166+0000 7f71d0d4f640 1 -- 172.21.15.50:0/3534968215 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b8003520 con 0x7f71cc15ca90 2023-08-10T10:38:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f71d1550640 1 -- 172.21.15.50:0/3534968215 >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 msgr2=0x7f71cc0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f71d1550640 1 --2- 172.21.15.50:0/3534968215 >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 0x7f71cc0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f71d1550640 1 -- 172.21.15.50:0/3534968215 >> v1:172.21.15.117:6789/0 conn(0x7f71cc15ca90 legacy=0x7f71cc0b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.167+0000 7f71d1550640 1 -- 172.21.15.50:0/3534968215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0d1260 con 0x7f71cc0d1d40 2023-08-10T10:38:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a6d9d640 1 -- 172.21.15.50:0/1666531963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a815aa10 msgr2=0x7f66a815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a6d9d640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a815aa10 0x7f66a815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a6d9d640 1 -- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 msgr2=0x7f66a81f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a6d9d640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 0x7f66a81f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a6d9d640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a806fd80 con 0x7f66a80ccf10 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.168+0000 7f66a759e640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a815bb00 0x7f66a81f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.169+0000 7f66a6d9d640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 0x7f66a8071230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6698007380 tx=0x7f6698005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.169+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e8f0 con 0x7f66a80ccf10 2023-08-10T10:38:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.169+0000 7f71d1550640 1 --2- 172.21.15.50:0/3534968215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097a0 tx=0x7f71bc034050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7929d5f17104e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.170+0000 7f66ad257640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8070060 con 0x7f66a80ccf10 2023-08-10T10:38:29.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.170+0000 7f71d0d4f640 1 -- 172.21.15.50:0/3534968215 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc034e00 con 0x7f71cc0d1d40 2023-08-10T10:38:29.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.170+0000 7f66ad257640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a8070620 con 0x7f66a80ccf10 2023-08-10T10:38:29.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.170+0000 7f71d0d4f640 1 -- 172.21.15.50:0/3534968215 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc03c440 con 0x7f71cc0d1d40 2023-08-10T10:38:29.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.170+0000 7f71d0d4f640 1 -- 172.21.15.50:0/3534968215 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc03c7f0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.171+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 msgr2=0x7f71cc0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.171+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/3534968215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097a0 tx=0x7f71bc034050 comp rx=0 tx=0).stop 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 shutdown_connections 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/3534968215 >> v2:172.21.15.50:3300/0 conn(0x7f71cc0d21a0 0x7f71cc0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/3534968215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0cd5c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 >> 172.21.15.50:0/3534968215 conn(0x7f71cc069a90 msgr2=0x7f71cc069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 shutdown_connections 2023-08-10T10:38:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.174+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669800ea50 con 0x7f66a80ccf10 2023-08-10T10:38:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.174+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800ee00 con 0x7f66a80ccf10 2023-08-10T10:38:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.172+0000 7f71d3fb5640 1 -- 172.21.15.50:0/3534968215 wait complete. 2023-08-10T10:38:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.174+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f669801d460 con 0x7f66a80ccf10 2023-08-10T10:38:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.175+0000 7f71d3fb5640 1 Processor -- start 2023-08-10T10:38:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.176+0000 7f71d3fb5640 1 -- start start 2023-08-10T10:38:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.176+0000 7f668f7fe640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f669406acd0 0x7f669406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6688000fc0 con 0x7f66a80ccf10 2023-08-10T10:38:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f66a659c640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f669406acd0 0x7f669406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6698089450 con 0x7f66a80ccf10 2023-08-10T10:38:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f668f7fe640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f6694073510 0x7f6694075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6694075fe0 con 0x7f6694073510 2023-08-10T10:38:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669805e0d0 con 0x7f66a80ccf10 2023-08-10T10:38:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f66a759e640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f6694073510 0x7f6694075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f66a659c640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f669406acd0 0x7f669406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66a0035000 tx=0x7f66a002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.179+0000 7f66a759e640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f6694073510 0x7f6694075930 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71cc0d21a0 0x7f71cc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc15ca90 0x7f71cc15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc157350 con 0x7f71cc15ca90 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0c8d50 con 0x7f71cc0d21a0 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.177+0000 7f71d3fb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0cabc0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f71d1550640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71cc0d21a0 0x7f71cc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f71d1d51640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f71d1550640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71cc0d21a0 0x7f71cc06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42288/0 (socket says 172.21.15.50:42288) 2023-08-10T10:38:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.178+0000 7f71d1550640 1 -- 172.21.15.50:0/1573285070 learned_addr learned my addr 172.21.15.50:0/1573285070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.179+0000 7f71d2552640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc15ca90 0x7f71cc15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f0c05c85640 1 Processor -- start 2023-08-10T10:38:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f71d1d51640 1 -- 172.21.15.50:0/1573285070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71cc0d21a0 msgr2=0x7f71cc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f71d1d51640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71cc0d21a0 0x7f71cc06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f71d1d51640 1 -- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc15ca90 msgr2=0x7f71cc15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f71d1d51640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc15ca90 0x7f71cc15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f71d1d51640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009400 con 0x7f71cc0d1d40 2023-08-10T10:38:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f0c05c85640 1 -- start start 2023-08-10T10:38:29.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.180+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== osd.0 v2:172.21.15.50:6819/274313722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f6694075fe0 con 0x7f6694073510 2023-08-10T10:38:29.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71d1d51640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0c8810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71c8001eb0 tx=0x7f71c800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80074e0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8007640 con 0x7f71cc0d1d40 2023-08-10T10:38:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80049e0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc0caea0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.181+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc0cb460 con 0x7f71cc0d1d40 2023-08-10T10:38:29.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.182+0000 7f0c05c85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c000c9b60 0x7f0c000cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.182+0000 7f0c05c85640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c000cd7f0 0x7f0c0006c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.182+0000 7f0c05c85640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0006ccf0 con 0x7f0c0006c8a0 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.182+0000 7f0c05c85640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0015d750 con 0x7f0c000c9b60 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.182+0000 7f0c05c85640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c000c8ec0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c000c9b60 0x7f0c000cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c000c9b60 0x7f0c000cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33396/0 (socket says 172.21.15.50:33396) 2023-08-10T10:38:29.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 -- 172.21.15.50:0/32291952 learned_addr learned my addr 172.21.15.50:0/32291952 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0bf7fff640 1 --2- 172.21.15.50:0/32291952 >> v2:172.21.15.117:3300/0 conn(0x7f0c000cd7f0 0x7f0c0006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 -- 172.21.15.50:0/32291952 >> v2:172.21.15.117:3300/0 conn(0x7f0c000cd7f0 msgr2=0x7f0c0006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 --2- 172.21.15.50:0/32291952 >> v2:172.21.15.117:3300/0 conn(0x7f0c000cd7f0 0x7f0c0006c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 -- 172.21.15.50:0/32291952 >> v1:172.21.15.117:6789/0 conn(0x7f0c0006c8a0 legacy=0x7f0c0015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.183+0000 7f0c04c83640 1 -- 172.21.15.50:0/32291952 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0015d470 con 0x7f0c000c9b60 2023-08-10T10:38:29.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.184+0000 7ff1370a7640 1 Processor -- start 2023-08-10T10:38:29.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.184+0000 7f012bfff640 1 Processor -- start 2023-08-10T10:38:29.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.184+0000 7f012bfff640 1 -- start start 2023-08-10T10:38:29.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.184+0000 7ff1370a7640 1 -- start start 2023-08-10T10:38:29.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71cc0d1820 con 0x7f71cc0d1d40 2023-08-10T10:38:29.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7ff1370a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 0x7ff1300c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7ff1370a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7ff1370a7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300b43a0 con 0x7ff1300c1950 2023-08-10T10:38:29.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7ff1370a7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1300cca50 con 0x7ff130160fd0 2023-08-10T10:38:29.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.186+0000 7ff1370a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300cc0b0 con 0x7ff1300b0970 2023-08-10T10:38:29.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7f012bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 0x7f012c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52306/0 (socket says 172.21.15.50:52306) 2023-08-10T10:38:29.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7ff12ffff640 1 -- 172.21.15.50:0/3250998177 learned_addr learned my addr 172.21.15.50:0/3250998177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7f012affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f012c0696a0 0x7f012c0cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44528/0 (socket says 172.21.15.50:44528) 2023-08-10T10:38:29.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7f012affd640 1 -- 172.21.15.50:0/2170386777 learned_addr learned my addr 172.21.15.50:0/2170386777 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71c8004b40 con 0x7f71cc0d1d40 2023-08-10T10:38:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7ff12ffff640 1 -- 172.21.15.50:0/3250998177 >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 msgr2=0x7ff1300c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7ff134e43640 1 --2- 172.21.15.50:0/3250998177 >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 0x7ff1300c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7ff12f7fe640 1 -- 172.21.15.50:0/3250998177 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953476125 0 0) 0x7ff1300b43a0 con 0x7ff1300c1950 2023-08-10T10:38:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7f012b7fe640 1 --2- 172.21.15.50:0/2170386777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 0x7f012c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f71c27fc640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71b006ac50 0x7f71b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71c80891b0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f71c27fc640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f71b0073510 0x7f71b0075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71b0075fe0 con 0x7f71b0073510 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71c808b7d0 con 0x7f71cc0d1d40 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.190+0000 7f71d1550640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71b006ac50 0x7f71b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.190+0000 7f71d2552640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f71b0073510 0x7f71b0075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7ff12ffff640 1 --2- 172.21.15.50:0/3250998177 >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 0x7ff1300c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7ff12ffff640 1 -- 172.21.15.50:0/3250998177 >> v1:172.21.15.117:6789/0 conn(0x7ff1300c1950 legacy=0x7ff13006aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7ff12ffff640 1 -- 172.21.15.50:0/3250998177 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300cc390 con 0x7ff1300b0970 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.187+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0b2280 con 0x7f012c15ad00 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0b19e0 con 0x7f012c0696a0 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.188+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0b1cc0 con 0x7f012c0b1370 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398165001 0 0) 0x7f012c0b2280 con 0x7f012c15ad00 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0114003520 con 0x7f012c15ad00 2023-08-10T10:38:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063100841 0 0) 0x7f012c0b19e0 con 0x7f012c0696a0 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f012c0b2280 con 0x7f012c0696a0 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f012b7fe640 1 -- 172.21.15.50:0/2170386777 >> v1:172.21.15.117:6789/0 conn(0x7f012c0696a0 legacy=0x7f012c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f012b7fe640 1 -- 172.21.15.50:0/2170386777 >> v1:172.21.15.50:6789/0 conn(0x7f012c15ad00 legacy=0x7f012c069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f012b7fe640 1 -- 172.21.15.50:0/2170386777 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0b1fa0 con 0x7f012c0b1370 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0c878d3640 1 Processor -- start 2023-08-10T10:38:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.189+0000 7f0c878d3640 1 -- start start 2023-08-10T10:38:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7ff134e43640 1 --2- 172.21.15.50:0/3250998177 >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 0x7ff1300c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7f71d2552640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f71b0073510 0x7f71b0075930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7f71d1550640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71b006ac50 0x7f71b006d110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034090 tx=0x7f71bc038000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7ff12ffff640 1 --2- 172.21.15.50:0/3250998177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82189500af5ca4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7f0c04c83640 1 --2- 172.21.15.50:0/32291952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c000c9b60 0x7f0c000cd2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c0006d280 tx=0x7f0bf002da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6b2eb9cfe677a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.191+0000 7f012b7fe640 1 --2- 172.21.15.50:0/2170386777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 0x7f012c0ccfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01200097d0 tx=0x7f0120034150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930e4d21d39d1437 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7ff12f7fe640 1 -- 172.21.15.50:0/3250998177 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12002cac0 con 0x7ff1300b0970 2023-08-10T10:38:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7ff12f7fe640 1 -- 172.21.15.50:0/3250998177 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12002cc20 con 0x7ff1300b0970 2023-08-10T10:38:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7ff12f7fe640 1 -- 172.21.15.50:0/3250998177 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200343f0 con 0x7ff1300b0970 2023-08-10T10:38:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0bf77fe640 1 -- 172.21.15.50:0/32291952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0008df0 con 0x7f0c000c9b60 2023-08-10T10:38:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0bf77fe640 1 -- 172.21.15.50:0/32291952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000a0d0 con 0x7f0c000c9b60 2023-08-10T10:38:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== osd.1 v2:172.21.15.50:6816/534751664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f71b0075fe0 con 0x7f71b0073510 2023-08-10T10:38:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0bf77fe640 1 -- 172.21.15.50:0/32291952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000a460 con 0x7f0c000c9b60 2023-08-10T10:38:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012003c440 con 0x7f012c0b1370 2023-08-10T10:38:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012003c5a0 con 0x7f012c0b1370 2023-08-10T10:38:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.192+0000 7f0129ffb640 1 -- 172.21.15.50:0/2170386777 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012003c930 con 0x7f012c0b1370 2023-08-10T10:38:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c878d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c800c9450 0x7f0c800cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 -- 172.21.15.50:0/32291952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c000c9b60 msgr2=0x7f0c000cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 --2- 172.21.15.50:0/32291952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c000c9b60 0x7f0c000cd2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c0006d280 tx=0x7f0bf002da90 comp rx=0 tx=0).stop 2023-08-10T10:38:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c878d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 0x7f0c800cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 -- 172.21.15.50:0/32291952 shutdown_connections 2023-08-10T10:38:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 --2- 172.21.15.50:0/32291952 >> v2:172.21.15.117:3300/0 conn(0x7f0c000cd7f0 0x7f0c0006c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 --2- 172.21.15.50:0/32291952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c000c9b60 0x7f0c000cd2b0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c0006d280 tx=0x7f0bf002da90 comp rx=0 tx=0).stop 2023-08-10T10:38:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 -- 172.21.15.50:0/32291952 >> 172.21.15.50:0/32291952 conn(0x7f0c000ce520 msgr2=0x7f0c000ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c878d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800b43a0 con 0x7f0c80160fd0 2023-08-10T10:38:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c878d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800cca50 con 0x7f0c800b0970 2023-08-10T10:38:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c878d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800cc0b0 con 0x7f0c800c9450 2023-08-10T10:38:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 -- 172.21.15.50:0/32291952 shutdown_connections 2023-08-10T10:38:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c8566f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0c80160fd0 0x7f0c800c8d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44546/0 (socket says 172.21.15.50:44546) 2023-08-10T10:38:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c8566f640 1 -- 172.21.15.50:0/4187236672 learned_addr learned my addr 172.21.15.50:0/4187236672 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/4187236672 >> v2:172.21.15.117:3300/0 conn(0x7f0c800c9450 0x7f0c800cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c85e70640 1 --2- 172.21.15.50:0/4187236672 >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 0x7f0c800cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7ff1370a7640 1 -- 172.21.15.50:0/3250998177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 msgr2=0x7ff1300c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7ff1370a7640 1 --2- 172.21.15.50:0/3250998177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12002bf20 comp rx=0 tx=0).stop 2023-08-10T10:38:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 -- 172.21.15.50:0/3250998177 shutdown_connections 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 --2- 172.21.15.50:0/3250998177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c9280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 --2- 172.21.15.50:0/3250998177 >> v2:172.21.15.50:3300/0 conn(0x7ff130160fd0 0x7ff1300c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 -- 172.21.15.50:0/3250998177 >> 172.21.15.50:0/3250998177 conn(0x7ff1300caf60 msgr2=0x7ff1300cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 -- 172.21.15.50:0/3250998177 shutdown_connections 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7ff1370a7640 1 -- 172.21.15.50:0/3250998177 wait complete. 2023-08-10T10:38:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 msgr2=0x7f012c0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f012bfff640 1 --2- 172.21.15.50:0/2170386777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 0x7f012c0ccfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01200097d0 tx=0x7f0120034150 comp rx=0 tx=0).stop 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c84e6e640 1 -- 172.21.15.50:0/4187236672 >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 msgr2=0x7f0c800cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/4187236672 >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 0x7f0c800cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c7ffff640 1 -- 172.21.15.50:0/4187236672 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255077948 0 0) 0x7f0c800b43a0 con 0x7f0c80160fd0 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c84e6e640 1 -- 172.21.15.50:0/4187236672 >> v1:172.21.15.117:6789/0 conn(0x7f0c80160fd0 legacy=0x7f0c800c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.194+0000 7f0c84e6e640 1 -- 172.21.15.50:0/4187236672 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800cc390 con 0x7f0c800c9450 2023-08-10T10:38:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 shutdown_connections 2023-08-10T10:38:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f012bfff640 1 --2- 172.21.15.50:0/2170386777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c0b1370 0x7f012c0ccfb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 >> 172.21.15.50:0/2170386777 conn(0x7f012c0cafa0 msgr2=0x7f012c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f0c85e70640 1 --2- 172.21.15.50:0/4187236672 >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 0x7f0c800cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.193+0000 7f0c05c85640 1 -- 172.21.15.50:0/32291952 wait complete. 2023-08-10T10:38:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f0c05c85640 1 Processor -- start 2023-08-10T10:38:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 shutdown_connections 2023-08-10T10:38:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7ff1370a7640 1 Processor -- start 2023-08-10T10:38:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.197+0000 7ff1370a7640 1 -- start start 2023-08-10T10:38:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f0c05c85640 1 -- start start 2023-08-10T10:38:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f012bfff640 1 -- 172.21.15.50:0/2170386777 wait complete. 2023-08-10T10:38:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.196+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/4187236672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c800c9450 0x7f0c800cce70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006bc00 tx=0x7f0c6c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46e8dc82282792e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.197+0000 7f0c7ffff640 1 -- 172.21.15.50:0/4187236672 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0317e0 con 0x7f0c800c9450 2023-08-10T10:38:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.197+0000 7f0c7ffff640 1 -- 172.21.15.50:0/4187236672 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c031940 con 0x7f0c800c9450 2023-08-10T10:38:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.197+0000 7f0c7ffff640 1 -- 172.21.15.50:0/4187236672 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031cf0 con 0x7f0c800c9450 2023-08-10T10:38:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7f0c05c85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c0006c8a0 0x7f0c001fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1300c1950 0x7ff130152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7f0c05c85640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 0x7f0c00202570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7f0c05c85640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c0006b6a0 0x7f0c00202ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff130160fd0 0x7ff1301f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c5f90 con 0x7ff130160fd0 2023-08-10T10:38:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c6fd0 con 0x7ff1300c1950 2023-08-10T10:38:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.198+0000 7ff1370a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c6210 con 0x7ff1300b0970 2023-08-10T10:38:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7ff134e43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0c05c85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00071600 con 0x7f0c0006c8a0 2023-08-10T10:38:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7ff135644640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff130160fd0 0x7ff1301f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7ff134e43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52320/0 (socket says 172.21.15.50:52320) 2023-08-10T10:38:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7ff134e43640 1 -- 172.21.15.50:0/974783046 learned_addr learned my addr 172.21.15.50:0/974783046 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7ff12ffff640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1300c1950 0x7ff130152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0c05c85640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00203380 con 0x7f0c000cd7f0 2023-08-10T10:38:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0c05c85640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00070cd0 con 0x7f0c0006b6a0 2023-08-10T10:38:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f5508cc2640 1 Processor -- start 2023-08-10T10:38:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0bf7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 0x7f0c00202570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 -- 172.21.15.50:0/4187236672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c800c9450 msgr2=0x7f0c800cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 --2- 172.21.15.50:0/4187236672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c800c9450 0x7f0c800cce70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006bc00 tx=0x7f0c6c02b880 comp rx=0 tx=0).stop 2023-08-10T10:38:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7ff135644640 1 -- 172.21.15.50:0/974783046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 msgr2=0x7ff1300c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7ff135644640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1300b0970 0x7ff1300c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7ff135644640 1 -- 172.21.15.50:0/974783046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1300c1950 msgr2=0x7ff130152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7ff135644640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1300c1950 0x7ff130152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7ff135644640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120009b30 con 0x7ff130160fd0 2023-08-10T10:38:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0bf7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 0x7f0c00202570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42326/0 (socket says 172.21.15.50:42326) 2023-08-10T10:38:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0bf7fff640 1 -- 172.21.15.50:0/2613041013 learned_addr learned my addr 172.21.15.50:0/2613041013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f0c05484640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c0006b6a0 0x7f0c00202ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f012bfff640 1 Processor -- start 2023-08-10T10:38:29.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 -- 172.21.15.50:0/4187236672 shutdown_connections 2023-08-10T10:38:29.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 --2- 172.21.15.50:0/4187236672 >> v2:172.21.15.50:3300/0 conn(0x7f0c800b0970 0x7f0c800cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 --2- 172.21.15.50:0/4187236672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c800c9450 0x7f0c800cce70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c878d3640 1 -- 172.21.15.50:0/4187236672 >> 172.21.15.50:0/4187236672 conn(0x7f0c800caf60 msgr2=0x7f0c800cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f0c04c83640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c0006c8a0 0x7f0c001fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.199+0000 7f5508cc2640 1 -- start start 2023-08-10T10:38:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7ff135644640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff130160fd0 0x7ff1301f6980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff128007fd0 tx=0x7ff12800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0bf7fff640 1 -- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c0006b6a0 msgr2=0x7f0c00202ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0bf7fff640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c0006b6a0 0x7f0c00202ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0bf7fff640 1 -- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c0006c8a0 msgr2=0x7f0c001fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0bf7fff640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c0006c8a0 0x7f0c001fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0bf7fff640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0007040 con 0x7f0c000cd7f0 2023-08-10T10:38:29.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f0bf7fff640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 0x7f0c00202570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00d5f0 tx=0x7f0bfc00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.200+0000 7f012bfff640 1 -- start start 2023-08-10T10:38:29.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f012bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 0x7f012c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0c878d3640 1 -- 172.21.15.50:0/4187236672 shutdown_connections 2023-08-10T10:38:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.201+0000 7f0c878d3640 1 -- 172.21.15.50:0/4187236672 wait complete. 2023-08-10T10:38:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55040cf040 0x7f55040c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 0x7f55040cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55040cd7f0 0x7f550406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550415d750 con 0x7f55040cf040 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55040c8ec0 con 0x7f55040cd7f0 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7f5508cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55040cc7d0 con 0x7f55040c9e30 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280035f0 con 0x7ff130160fd0 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128003770 con 0x7ff130160fd0 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128003b20 con 0x7ff130160fd0 2023-08-10T10:38:29.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.202+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1300c64f0 con 0x7ff130160fd0 2023-08-10T10:38:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1300c6ab0 con 0x7ff130160fd0 2023-08-10T10:38:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f5502ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 0x7f55040cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f012affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 0x7f012c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f012affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 0x7f012c15d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33466/0 (socket says 172.21.15.50:33466) 2023-08-10T10:38:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f012affd640 1 -- 172.21.15.50:0/835999923 learned_addr learned my addr 172.21.15.50:0/835999923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f5503fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55040cd7f0 0x7f550406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f5502ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 0x7f55040cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52340/0 (socket says 172.21.15.50:52340) 2023-08-10T10:38:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f5502ffd640 1 -- 172.21.15.50:0/1595906176 learned_addr learned my addr 172.21.15.50:0/1595906176 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.203+0000 7f55037fe640 1 --2- 172.21.15.50:0/1595906176 >> v2:172.21.15.50:3300/0 conn(0x7f55040cf040 0x7f55040c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1300b4070 con 0x7ff130160fd0 2023-08-10T10:38:29.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7f55037fe640 1 -- 172.21.15.50:0/1595906176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 msgr2=0x7f55040cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7f55037fe640 1 --2- 172.21.15.50:0/1595906176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 0x7f55040cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7f55037fe640 1 -- 172.21.15.50:0/1595906176 >> v2:172.21.15.117:3300/0 conn(0x7f55040cd7f0 msgr2=0x7f550406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7f55037fe640 1 --2- 172.21.15.50:0/1595906176 >> v2:172.21.15.117:3300/0 conn(0x7f55040cd7f0 0x7f550406c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.205+0000 7f55037fe640 1 -- 172.21.15.50:0/1595906176 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040ccab0 con 0x7f55040cf040 2023-08-10T10:38:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.204+0000 7f012bfff640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0b1370 0x7f012c1ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.206+0000 7f012bfff640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c15ad00 0x7f012c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.206+0000 7f012a7fc640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0b1370 0x7f012c1ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.206+0000 7fb84462d640 1 Processor -- start 2023-08-10T10:38:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f012b7fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c15ad00 0x7f012c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7fb84462d640 1 -- start start 2023-08-10T10:38:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f55037fe640 1 --2- 172.21.15.50:0/1595906176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040cf040 0x7f55040c98f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f550406d4c0 tx=0x7f54f802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc314a1cbf2f63ad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c55f0 con 0x7f012c0696a0 2023-08-10T10:38:29.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c15dbe0 con 0x7f012c0b1370 2023-08-10T10:38:29.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f55027fc640 1 -- 172.21.15.50:0/1595906176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f802f050 con 0x7f55040cf040 2023-08-10T10:38:29.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f0c878d3640 1 Processor -- start 2023-08-10T10:38:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f55027fc640 1 -- 172.21.15.50:0/1595906176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8031700 con 0x7f55040cf040 2023-08-10T10:38:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f55027fc640 1 -- 172.21.15.50:0/1595906176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8031a90 con 0x7f55040cf040 2023-08-10T10:38:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff128003c80 con 0x7ff130160fd0 2023-08-10T10:38:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.207+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c15dec0 con 0x7f012c15ad00 2023-08-10T10:38:29.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7f0c878d3640 1 -- start start 2023-08-10T10:38:29.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7f5508cc2640 1 -- 172.21.15.50:0/1595906176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040cf040 msgr2=0x7f55040c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7f5508cc2640 1 --2- 172.21.15.50:0/1595906176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040cf040 0x7f55040c98f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f550406d4c0 tx=0x7f54f802b7a0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7fb84462d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 0x7fb83c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7fb84462d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0b43a0 con 0x7fb83c0b0970 2023-08-10T10:38:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7ff12d7fa640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11006aca0 0x7ff11006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 -- 172.21.15.50:0/1595906176 shutdown_connections 2023-08-10T10:38:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 --2- 172.21.15.50:0/1595906176 >> v2:172.21.15.117:3300/0 conn(0x7f55040cd7f0 0x7f550406c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 --2- 172.21.15.50:0/1595906176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c9e30 0x7f55040cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 --2- 172.21.15.50:0/1595906176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040cf040 0x7f55040c98f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 -- 172.21.15.50:0/1595906176 >> 172.21.15.50:0/1595906176 conn(0x7f55040ce520 msgr2=0x7f55040ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7fb84462d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0cc0b0 con 0x7fb83c160fd0 2023-08-10T10:38:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7fb84462d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0cca50 con 0x7fb83c0c9450 2023-08-10T10:38:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff128089120 con 0x7ff130160fd0 2023-08-10T10:38:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff12d7fa640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7ff110073560 0x7ff110075980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7fb8423c9640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb83c160fd0 0x7fb83c0c8d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44562/0 (socket says 172.21.15.50:44562) 2023-08-10T10:38:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7fb8423c9640 1 -- 172.21.15.50:0/2992756610 learned_addr learned my addr 172.21.15.50:0/2992756610 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff110076030 con 0x7ff110073560 2023-08-10T10:38:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff128089490 con 0x7ff130160fd0 2023-08-10T10:38:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff134e43640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11006aca0 0x7ff11006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 -- 172.21.15.50:0/1595906176 shutdown_connections 2023-08-10T10:38:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7ff12ffff640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7ff110073560 0x7ff110075980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7ff134e43640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11006aca0 0x7ff11006d160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1300c8590 tx=0x7ff118008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7ff12ffff640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7ff110073560 0x7ff110075980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7f012affd640 1 -- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c15ad00 msgr2=0x7f012c0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.208+0000 7f012affd640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c15ad00 0x7f012c0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f012affd640 1 -- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0b1370 msgr2=0x7f012c1ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f012affd640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0b1370 0x7f012c1ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f012affd640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009400 con 0x7f012c0696a0 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7f012affd640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 0x7f012c15d2e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f012400cbc0 tx=0x7f012400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7f012b7fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c15ad00 0x7f012c0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7f0c878d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 0x7f0c8015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c878d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 0x7f0c80162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7f5508cc2640 1 -- 172.21.15.50:0/1595906176 wait complete. 2023-08-10T10:38:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.209+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2992756610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 0x7fb83c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== osd.2 v2:172.21.15.50:6800/2061476148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7ff110076030 con 0x7ff110073560 2023-08-10T10:38:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c8566f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 0x7f0c8015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c8566f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 0x7f0c8015c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52364/0 (socket says 172.21.15.50:52364) 2023-08-10T10:38:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0125f0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c00070fb0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7fb841bc8640 1 -- 172.21.15.50:0/2992756610 >> v1:172.21.15.117:6789/0 conn(0x7fb83c160fd0 legacy=0x7fb83c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7fb841bc8640 1 -- 172.21.15.50:0/2992756610 >> v1:172.21.15.50:6789/0 conn(0x7fb83c0b0970 legacy=0x7fb83c0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.210+0000 7fb841bc8640 1 -- 172.21.15.50:0/2992756610 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0cc390 con 0x7fb83c0c9450 2023-08-10T10:38:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c84e6e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 0x7f0c80162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c84e6e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 0x7f0c80162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33472/0 (socket says 172.21.15.50:33472) 2023-08-10T10:38:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 --> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6688002c80 con 0x7f6694073510 2023-08-10T10:38:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f0c8566f640 1 -- 172.21.15.50:0/1258757859 learned_addr learned my addr 172.21.15.50:0/1258757859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f0c878d3640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80160fd0 0x7f0c8006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.211+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c00202ff0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc012750 con 0x7f0c000cd7f0 2023-08-10T10:38:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400ad40 con 0x7f012c0696a0 2023-08-10T10:38:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0124012400 con 0x7f012c0696a0 2023-08-10T10:38:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400aea0 con 0x7f012c0696a0 2023-08-10T10:38:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c0c5840 con 0x7f012c0696a0 2023-08-10T10:38:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c15d820 con 0x7f012c0696a0 2023-08-10T10:38:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7f5508cc2640 1 Processor -- start 2023-08-10T10:38:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.212+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2992756610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 0x7fb83c0cce70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0097d0 tx=0x7fb82c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503be46557314ebd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f668f7fe640 1 -- 172.21.15.50:0/1666531963 <== osd.0 v2:172.21.15.50:6819/274313722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6688002c80 con 0x7f6694073510 2023-08-10T10:38:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc012b00 con 0x7f0c000cd7f0 2023-08-10T10:38:29.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800c6260 con 0x7f0c800c9450 2023-08-10T10:38:29.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800c5650 con 0x7f0c80160fd0 2023-08-10T10:38:29.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0be0000fc0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f012c0cca90 con 0x7f012c0696a0 2023-08-10T10:38:29.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7f0c85e70640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80160fd0 0x7f0c8006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.214+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800c5930 con 0x7f0c800b0970 2023-08-10T10:38:29.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.214+0000 7f5508cc2640 1 -- start start 2023-08-10T10:38:29.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7fb8413c7640 1 -- 172.21.15.50:0/2992756610 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c02e070 con 0x7fb83c0c9450 2023-08-10T10:38:29.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7fb8413c7640 1 -- 172.21.15.50:0/2992756610 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c0315a0 con 0x7fb83c0c9450 2023-08-10T10:38:29.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.213+0000 7fb8413c7640 1 -- 172.21.15.50:0/2992756610 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c031970 con 0x7fb83c0c9450 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.214+0000 7fb84462d640 1 -- 172.21.15.50:0/2992756610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 msgr2=0x7fb83c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.214+0000 7fb84462d640 1 --2- 172.21.15.50:0/2992756610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 0x7fb83c0cce70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0097d0 tx=0x7fb82c02b840 comp rx=0 tx=0).stop 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 -- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80160fd0 msgr2=0x7f0c8006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80160fd0 0x7f0c8006f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 -- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 msgr2=0x7f0c80162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 0x7f0c80162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009400 con 0x7f0c800b0970 2023-08-10T10:38:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c85e70640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80160fd0 0x7f0c8006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c800c9450 0x7f0c80162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7fb84462d640 1 -- 172.21.15.50:0/2992756610 shutdown_connections 2023-08-10T10:38:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7fb84462d640 1 --2- 172.21.15.50:0/2992756610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0c9450 0x7fb83c0cce70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7fb84462d640 1 -- 172.21.15.50:0/2992756610 >> 172.21.15.50:0/2992756610 conn(0x7fb83c0caf60 msgr2=0x7fb83c0cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7fb84462d640 1 -- 172.21.15.50:0/2992756610 shutdown_connections 2023-08-10T10:38:29.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f0c8566f640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 0x7f0c8015c1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400cad0 tx=0x7f0c7400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 0x7f55040a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55040cd7f0 0x7f55040c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c4da0 0x7f5504151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5504153200 con 0x7f55040c9e30 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040a8b80 con 0x7f55040cd7f0 2023-08-10T10:38:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7f5508cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5504151080 con 0x7f55040c4da0 2023-08-10T10:38:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f6694073510 msgr2=0x7f6694075930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f6694073510 0x7f6694075930 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f669406acd0 msgr2=0x7f669406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f669406acd0 0x7f669406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66a0035000 tx=0x7f66a002e000 comp rx=0 tx=0).stop 2023-08-10T10:38:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 msgr2=0x7f66a8071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f668d7fa640 1 --2- 172.21.15.50:0/1666531963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a80ccf10 0x7f66a8071230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6698007380 tx=0x7f6698005f90 comp rx=0 tx=0).stop 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f66a759e640 1 -- 172.21.15.50:0/1666531963 reap_dead start 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 shutdown_connections 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 >> 172.21.15.50:0/1666531963 conn(0x7f66a80ce4e0 msgr2=0x7f66a80af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 shutdown_connections 2023-08-10T10:38:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f668d7fa640 1 -- 172.21.15.50:0/1666531963 wait complete. 2023-08-10T10:38:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bfc012c60 con 0x7f0c000cd7f0 2023-08-10T10:38:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f0bf57fa640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0bec06aca0 0x7f0bec06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bfc089bb0 con 0x7f0c000cd7f0 2023-08-10T10:38:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f0bf57fa640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7f0bec073560 0x7f0bec075980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bec076030 con 0x7f0bec073560 2023-08-10T10:38:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bfc089f20 con 0x7f0c000cd7f0 2023-08-10T10:38:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0124012770 con 0x7f012c0696a0 2023-08-10T10:38:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f01137fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f011806aca0 0x7f011806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0124089e80 con 0x7f012c0696a0 2023-08-10T10:38:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400ac30 con 0x7f0c800b0970 2023-08-10T10:38:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400ad90 con 0x7f0c800b0970 2023-08-10T10:38:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74012640 con 0x7f0c800b0970 2023-08-10T10:38:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f55037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 0x7f55040a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f55037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 0x7f55040a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33486/0 (socket says 172.21.15.50:33486) 2023-08-10T10:38:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.216+0000 7f55037fe640 1 -- 172.21.15.50:0/3765548544 learned_addr learned my addr 172.21.15.50:0/3765548544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f55037fe640 1 -- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c4da0 msgr2=0x7f5504151e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f55037fe640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55040c4da0 0x7f5504151e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f55037fe640 1 -- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55040cd7f0 msgr2=0x7f55040c7870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f55037fe640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55040cd7f0 0x7f55040c7870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.217+0000 7f55037fe640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009400 con 0x7f55040c9e30 2023-08-10T10:38:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f55037fe640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 0x7f55040a8480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54f802bd80 tx=0x7f54f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.215+0000 7fb84462d640 1 -- 172.21.15.50:0/2992756610 wait complete. 2023-08-10T10:38:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7fb84462d640 1 Processor -- start 2023-08-10T10:38:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8006e10 con 0x7f55040c9e30 2023-08-10T10:38:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8033a30 con 0x7f55040c9e30 2023-08-10T10:38:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8033da0 con 0x7f55040c9e30 2023-08-10T10:38:29.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c800c5c10 con 0x7f0c800b0970 2023-08-10T10:38:29.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f0c05484640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7f0bec073560 0x7f0bec075980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f0c04c83640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0bec06aca0 0x7f0bec06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.221+0000 7f0c05484640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7f0bec073560 0x7f0bec075980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7f01137fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7f0118073560 0x7f0118075980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0118076030 con 0x7f0118073560 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f012408a1f0 con 0x7f012c0696a0 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f012b7fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7f0118073560 0x7f0118075980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.220+0000 7f012a7fc640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f011806aca0 0x7f011806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.221+0000 7f012a7fc640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f011806aca0 0x7f011806d160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f011c007fd0 tx=0x7f011c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5504151360 con 0x7f55040c9e30 2023-08-10T10:38:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.219+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5504151920 con 0x7f55040c9e30 2023-08-10T10:38:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.220+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55040ccd90 con 0x7f55040c9e30 2023-08-10T10:38:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.218+0000 7fb84462d640 1 -- start start 2023-08-10T10:38:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.220+0000 7fb84462d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0b0970 0x7fb83c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.221+0000 7f0c04c83640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0bec06aca0 0x7f0bec06d160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0037000 tx=0x7f0bf000a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7f012b7fe640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7f0118073560 0x7f0118075980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c800c7aa0 con 0x7f0c800b0970 2023-08-10T10:38:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== osd.3 v2:172.21.15.50:6808/1161775809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0bec076030 con 0x7f0bec073560 2023-08-10T10:38:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 --> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71cc0d1540 con 0x7f71b0073510 2023-08-10T10:38:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7fb84462d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c9450 0x7fb83c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7fb84462d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb83c160fd0 0x7fb83c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7fb84462d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0c74e0 con 0x7fb83c160fd0 2023-08-10T10:38:29.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7fb84462d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0c68d0 con 0x7fb83c0c9450 2023-08-10T10:38:29.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.222+0000 7fb84462d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0c6bb0 con 0x7fb83c0b0970 2023-08-10T10:38:29.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c800b4070 con 0x7f0c800b0970 2023-08-10T10:38:29.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7f71c27fc640 1 -- 172.21.15.50:0/1573285070 <== osd.1 v2:172.21.15.50:6816/534751664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71c4009da0 con 0x7f71b0073510 2023-08-10T10:38:29.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54f803a040 con 0x7f55040c9e30 2023-08-10T10:38:29.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7fb8423c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0b0970 0x7fb83c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7fb8423c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0b0970 0x7fb83c15daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52374/0 (socket says 172.21.15.50:52374) 2023-08-10T10:38:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.223+0000 7fb8423c9640 1 -- 172.21.15.50:0/2756401421 learned_addr learned my addr 172.21.15.50:0/2756401421 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f71b0073510 msgr2=0x7f71b0075930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f71b0073510 0x7f71b0075930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== osd.4 v2:172.21.15.117:6816/4052651543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0118076030 con 0x7f0118073560 2023-08-10T10:38:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71b006ac50 msgr2=0x7f71b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71b006ac50 0x7f71b006d110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034090 tx=0x7f71bc038000 comp rx=0 tx=0).stop 2023-08-10T10:38:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 msgr2=0x7f71cc0c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 --2- 172.21.15.50:0/1573285070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71cc0d1d40 0x7f71cc0c8810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71c8001eb0 tx=0x7f71c800c870 comp rx=0 tx=0).stop 2023-08-10T10:38:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c9450 0x7fb83c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d2552640 1 -- 172.21.15.50:0/1573285070 reap_dead start 2023-08-10T10:38:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 -- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0b0970 msgr2=0x7fb83c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c0b0970 0x7fb83c15daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 -- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb83c160fd0 msgr2=0x7fb83c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb83c160fd0 0x7fb83c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.224+0000 7fb841bc8640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c009400 con 0x7fb83c0c9450 2023-08-10T10:38:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 shutdown_connections 2023-08-10T10:38:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f54ebfff640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54f006ad50 0x7f54f006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 >> 172.21.15.50:0/1573285070 conn(0x7f71cc069a90 msgr2=0x7f71cc159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54f80ab930 con 0x7f55040c9e30 2023-08-10T10:38:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 shutdown_connections 2023-08-10T10:38:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f71d3fb5640 1 -- 172.21.15.50:0/1573285070 wait complete. 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7fb841bc8640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c9450 0x7fb83c0c7970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb82c033000 tx=0x7fb82c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c032900 con 0x7fb83c0c9450 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c0c6e90 con 0x7fb83c0c9450 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c1ffac0 con 0x7fb83c0c9450 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c032a60 con 0x7fb83c0c9450 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c032e10 con 0x7fb83c0c9450 2023-08-10T10:38:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.227+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb824000fc0 con 0x7fb83c0c9450 2023-08-10T10:38:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f54ebfff640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7f54f0073610 0x7f54f0075a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54f00760e0 con 0x7f54f0073610 2023-08-10T10:38:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.225+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54f802f020 con 0x7f55040c9e30 2023-08-10T10:38:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.226+0000 7f5503fff640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7f54f0073610 0x7f54f0075a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.230+0000 7f5502ffd640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54f006ad50 0x7f54f006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.231+0000 7f5502ffd640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54f006ad50 0x7f54f006d210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55040ad5c0 tx=0x7f54f4009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.230+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c740127a0 con 0x7f0c800b0970 2023-08-10T10:38:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.231+0000 7f0c7dffb640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c6406ad20 0x7f0c6406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.232+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c740890b0 con 0x7f0c800b0970 2023-08-10T10:38:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.232+0000 7f0c7dffb640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f0c640735e0 0x7f0c64075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.232+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c640760b0 con 0x7f0c640735e0 2023-08-10T10:38:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.232+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c740893b0 con 0x7f0c800b0970 2023-08-10T10:38:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.231+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb82c0453f0 con 0x7fb83c0c9450 2023-08-10T10:38:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c6406ad20 0x7f0c6406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7f0c85e70640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f0c640735e0 0x7f0c64075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.234+0000 7f5503fff640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7f54f0073610 0x7f54f0075a30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb832ffd640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb82006ac50 0x7fb82006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb82c0ab4a0 con 0x7fb83c0c9450 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb8423c9640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb82006ac50 0x7fb82006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb832ffd640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7fb820073510 0x7fb820075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb820075fe0 con 0x7fb820073510 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.233+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb82c0ab850 con 0x7fb83c0c9450 2023-08-10T10:38:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.234+0000 7fb842bca640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7fb820073510 0x7fb820075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.234+0000 7f0c85e70640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f0c640735e0 0x7f0c64075a00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.235+0000 7fb8423c9640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb82006ac50 0x7fb82006d110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb838004e40 tx=0x7fb838007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.235+0000 7fb842bca640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7fb820073510 0x7fb820075930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.235+0000 7f0c84e6e640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c6406ad20 0x7f0c6406d1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c036000 tx=0x7f0c6c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.237+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 --> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff13015c590 con 0x7ff110073560 2023-08-10T10:38:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.237+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== osd.7 v2:172.21.15.117:6824/3330340519 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fb820075fe0 con 0x7fb820073510 2023-08-10T10:38:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.237+0000 7ff12d7fa640 1 -- 172.21.15.50:0/974783046 <== osd.2 v2:172.21.15.50:6800/2061476148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff13015c590 con 0x7ff110073560 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.238+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7ff110073560 msgr2=0x7ff110075980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.238+0000 7ff1370a7640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7ff110073560 0x7ff110075980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.238+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11006aca0 msgr2=0x7ff11006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.238+0000 7ff1370a7640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11006aca0 0x7ff11006d160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1300c8590 tx=0x7ff118008040 comp rx=0 tx=0).stop 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.238+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff130160fd0 msgr2=0x7ff1301f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff1370a7640 1 --2- 172.21.15.50:0/974783046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff130160fd0 0x7ff1301f6980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff128007fd0 tx=0x7ff12800c870 comp rx=0 tx=0).stop 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff135644640 1 -- 172.21.15.50:0/974783046 reap_dead start 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 shutdown_connections 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 >> 172.21.15.50:0/974783046 conn(0x7ff1300caf60 msgr2=0x7ff1300b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 shutdown_connections 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.239+0000 7ff1370a7640 1 -- 172.21.15.50:0/974783046 wait complete. 2023-08-10T10:38:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.235+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== osd.6 v2:172.21.15.117:6808/1322471095 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f54f00760e0 con 0x7f54f0073610 2023-08-10T10:38:29.286 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-10T10:38:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.244+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== osd.5 v2:172.21.15.117:6800/3863318081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0c640760b0 con 0x7f0c640735e0 2023-08-10T10:38:29.288 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-10T10:38:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.251+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 --> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f012c066e30 con 0x7f0118073560 2023-08-10T10:38:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.252+0000 7f01137fe640 1 -- 172.21.15.50:0/835999923 <== osd.4 v2:172.21.15.117:6816/4052651543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f012c066e30 con 0x7f0118073560 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.252+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7f0118073560 msgr2=0x7f0118075980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.252+0000 7f012bfff640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7f0118073560 0x7f0118075980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f011806aca0 msgr2=0x7f011806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f011806aca0 0x7f011806d160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f011c007fd0 tx=0x7f011c009040 comp rx=0 tx=0).stop 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 msgr2=0x7f012c15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 --2- 172.21.15.50:0/835999923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f012c0696a0 0x7f012c15d2e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f012400cbc0 tx=0x7f012400a430 comp rx=0 tx=0).stop 2023-08-10T10:38:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012b7fe640 1 -- 172.21.15.50:0/835999923 reap_dead start 2023-08-10T10:38:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 shutdown_connections 2023-08-10T10:38:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 >> 172.21.15.50:0/835999923 conn(0x7f012c0cafa0 msgr2=0x7f012c0ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 shutdown_connections 2023-08-10T10:38:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.253+0000 7f012bfff640 1 -- 172.21.15.50:0/835999923 wait complete. 2023-08-10T10:38:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.255+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 --> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0be0002cb0 con 0x7f0bec073560 2023-08-10T10:38:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.255+0000 7f0bf57fa640 1 -- 172.21.15.50:0/2613041013 <== osd.3 v2:172.21.15.50:6808/1161775809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0be0002cb0 con 0x7f0bec073560 2023-08-10T10:38:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7f0bec073560 msgr2=0x7f0bec075980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7f0bec073560 0x7f0bec075980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0bec06aca0 msgr2=0x7f0bec06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0bec06aca0 0x7f0bec06d160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0037000 tx=0x7f0bf000a000 comp rx=0 tx=0).stop 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 msgr2=0x7f0c00202570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 --2- 172.21.15.50:0/2613041013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c000cd7f0 0x7f0c00202570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00d5f0 tx=0x7f0bfc00dab0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05484640 1 -- 172.21.15.50:0/2613041013 reap_dead start 2023-08-10T10:38:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 shutdown_connections 2023-08-10T10:38:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.256+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 >> 172.21.15.50:0/2613041013 conn(0x7f0c000ce520 msgr2=0x7f0c000ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.257+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 shutdown_connections 2023-08-10T10:38:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.257+0000 7f0c05c85640 1 -- 172.21.15.50:0/2613041013 wait complete. 2023-08-10T10:38:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.259+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 --> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb824002cb0 con 0x7fb820073510 2023-08-10T10:38:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.260+0000 7fb832ffd640 1 -- 172.21.15.50:0/2756401421 <== osd.7 v2:172.21.15.117:6824/3330340519 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb824002cb0 con 0x7fb820073510 2023-08-10T10:38:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7fb820073510 msgr2=0x7fb820075930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7fb820073510 0x7fb820075930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb82006ac50 msgr2=0x7fb82006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb82006ac50 0x7fb82006d110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb838004e40 tx=0x7fb838007f10 comp rx=0 tx=0).stop 2023-08-10T10:38:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c9450 msgr2=0x7fb83c0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 --2- 172.21.15.50:0/2756401421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c9450 0x7fb83c0c7970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb82c033000 tx=0x7fb82c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb842bca640 1 -- 172.21.15.50:0/2756401421 reap_dead start 2023-08-10T10:38:29.296 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 shutdown_connections 2023-08-10T10:38:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.261+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 >> 172.21.15.50:0/2756401421 conn(0x7fb83c0caf60 msgr2=0x7fb83c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-10T10:38:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.262+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 shutdown_connections 2023-08-10T10:38:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.262+0000 7fb84462d640 1 -- 172.21.15.50:0/2756401421 wait complete. 2023-08-10T10:38:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.263+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 --> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5504066e30 con 0x7f54f0073610 2023-08-10T10:38:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.264+0000 7f54ebfff640 1 -- 172.21.15.50:0/3765548544 <== osd.6 v2:172.21.15.117:6808/1322471095 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5504066e30 con 0x7f54f0073610 2023-08-10T10:38:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7f54f0073610 msgr2=0x7f54f0075a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7f54f0073610 0x7f54f0075a30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54f006ad50 msgr2=0x7f54f006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54f006ad50 0x7f54f006d210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55040ad5c0 tx=0x7f54f4009240 comp rx=0 tx=0).stop 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 msgr2=0x7f55040a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5508cc2640 1 --2- 172.21.15.50:0/3765548544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55040c9e30 0x7f55040a8480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54f802bd80 tx=0x7f54f80046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.265+0000 7f5503fff640 1 -- 172.21.15.50:0/3765548544 reap_dead start 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.266+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 shutdown_connections 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.266+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 >> 172.21.15.50:0/3765548544 conn(0x7f55040ce520 msgr2=0x7f55040b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.266+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 shutdown_connections 2023-08-10T10:38:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.266+0000 7f5508cc2640 1 -- 172.21.15.50:0/3765548544 wait complete. 2023-08-10T10:38:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.268+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 --> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c800cc670 con 0x7f0c640735e0 2023-08-10T10:38:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.269+0000 7f0c7dffb640 1 -- 172.21.15.50:0/1258757859 <== osd.5 v2:172.21.15.117:6800/3863318081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c7800c040 con 0x7f0c640735e0 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.269+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f0c640735e0 msgr2=0x7f0c64075a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.269+0000 7f0c878d3640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f0c640735e0 0x7f0c64075a00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c6406ad20 msgr2=0x7f0c6406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c6406ad20 0x7f0c6406d1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c036000 tx=0x7f0c6c008030 comp rx=0 tx=0).stop 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 msgr2=0x7f0c8015c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 --2- 172.21.15.50:0/1258757859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c800b0970 0x7f0c8015c1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400cad0 tx=0x7f0c7400cf90 comp rx=0 tx=0).stop 2023-08-10T10:38:29.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c85e70640 1 -- 172.21.15.50:0/1258757859 reap_dead start 2023-08-10T10:38:29.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 shutdown_connections 2023-08-10T10:38:29.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 >> 172.21.15.50:0/1258757859 conn(0x7f0c800caf60 msgr2=0x7f0c8015ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 shutdown_connections 2023-08-10T10:38:29.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.270+0000 7f0c878d3640 1 -- 172.21.15.50:0/1258757859 wait complete. 2023-08-10T10:38:29.305 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-08-10T10:38:29.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-10T10:38:29.306 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-10T10:38:29.307 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-10T10:38:29.308 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-10T10:38:29.309 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:29.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-10T10:38:29.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.638+0000 7f41611cb640 1 Processor -- start 2023-08-10T10:38:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.639+0000 7f41611cb640 1 -- start start 2023-08-10T10:38:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.641+0000 7f41611cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.641+0000 7f41611cb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f415c06c260 0x7f415c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.641+0000 7f41611cb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c06cc00 con 0x7f415c0cf000 2023-08-10T10:38:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.641+0000 7f41611cb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c0c8f90 con 0x7f415c06c260 2023-08-10T10:38:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.641+0000 7f41611cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c06ba30 con 0x7f415c0c8b30 2023-08-10T10:38:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.642+0000 7f415a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.642+0000 7f415a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52390/0 (socket says 172.21.15.50:52390) 2023-08-10T10:38:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.642+0000 7f415a59c640 1 -- 172.21.15.50:0/1004142760 learned_addr learned my addr 172.21.15.50:0/1004142760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.642+0000 7f415b59e640 1 --2- 172.21.15.50:0/1004142760 >> v2:172.21.15.50:3300/0 conn(0x7f415c06c260 0x7f415c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.644+0000 7f415a59c640 1 -- 172.21.15.50:0/1004142760 >> v2:172.21.15.50:3300/0 conn(0x7f415c06c260 msgr2=0x7f415c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.644+0000 7f415a59c640 1 --2- 172.21.15.50:0/1004142760 >> v2:172.21.15.50:3300/0 conn(0x7f415c06c260 0x7f415c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.644+0000 7f415a59c640 1 -- 172.21.15.50:0/1004142760 >> v1:172.21.15.50:6789/0 conn(0x7f415c0cf000 legacy=0x7f415c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.644+0000 7f415a59c640 1 -- 172.21.15.50:0/1004142760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0c9d90 con 0x7f415c0c8b30 2023-08-10T10:38:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.646+0000 7f415a59c640 1 --2- 172.21.15.50:0/1004142760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4154009e50 tx=0x7f415402bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc9329d45130220 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.647+0000 7f4159d9b640 1 -- 172.21.15.50:0/1004142760 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415402cb20 con 0x7f415c0c8b30 2023-08-10T10:38:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.647+0000 7f4159d9b640 1 -- 172.21.15.50:0/1004142760 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415402cc80 con 0x7f415c0c8b30 2023-08-10T10:38:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.647+0000 7f4159d9b640 1 -- 172.21.15.50:0/1004142760 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154034610 con 0x7f415c0c8b30 2023-08-10T10:38:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 -- 172.21.15.50:0/1004142760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 msgr2=0x7f415c06b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 --2- 172.21.15.50:0/1004142760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4154009e50 tx=0x7f415402bf80 comp rx=0 tx=0).stop 2023-08-10T10:38:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 -- 172.21.15.50:0/1004142760 shutdown_connections 2023-08-10T10:38:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 --2- 172.21.15.50:0/1004142760 >> v2:172.21.15.50:3300/0 conn(0x7f415c06c260 0x7f415c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 --2- 172.21.15.50:0/1004142760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0c8b30 0x7f415c06b4f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.648+0000 7f41611cb640 1 -- 172.21.15.50:0/1004142760 >> 172.21.15.50:0/1004142760 conn(0x7f415c0ce4e0 msgr2=0x7f415c0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.649+0000 7f41611cb640 1 -- 172.21.15.50:0/1004142760 shutdown_connections 2023-08-10T10:38:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.649+0000 7f41611cb640 1 -- 172.21.15.50:0/1004142760 wait complete. 2023-08-10T10:38:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7f41611cb640 1 Processor -- start 2023-08-10T10:38:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.649+0000 7fb5df86a640 1 Processor -- start 2023-08-10T10:38:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7f41611cb640 1 -- start start 2023-08-10T10:38:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.650+0000 7fb5df86a640 1 -- start start 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7fb5df86a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7fb5df86a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5d80cd670 0x7fb5d80cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7fb5df86a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d80d1230 con 0x7fb5d80b82c0 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7fb5df86a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80ce040 con 0x7fb5d80cd670 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.652+0000 7fb5df86a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80d1510 con 0x7fb5d815cbb0 2023-08-10T10:38:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.653+0000 7fb5dd606640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.653+0000 7fb5dde07640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5d80cd670 0x7fb5d80cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5d80cd670 0x7fb5d80cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42368/0 (socket says 172.21.15.50:42368) 2023-08-10T10:38:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 -- 172.21.15.50:0/3240901440 learned_addr learned my addr 172.21.15.50:0/3240901440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dce05640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb5d80b82c0 0x7fb5d80d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44574/0 (socket says 172.21.15.50:44574) 2023-08-10T10:38:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 -- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 msgr2=0x7fb5d80d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80d22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 -- 172.21.15.50:0/3240901440 >> v1:172.21.15.117:6789/0 conn(0x7fb5d80b82c0 legacy=0x7fb5d80d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7fb5dde07640 1 -- 172.21.15.50:0/3240901440 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80d17f0 con 0x7fb5d80cd670 2023-08-10T10:38:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.654+0000 7f41611cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.655+0000 7fb5dd606640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.655+0000 7f415ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.655+0000 7f415ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33520/0 (socket says 172.21.15.50:33520) 2023-08-10T10:38:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.655+0000 7f415ad9d640 1 -- 172.21.15.50:0/2980602892 learned_addr learned my addr 172.21.15.50:0/2980602892 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.656+0000 7f41611cb640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 0x7f415c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.656+0000 7f41611cb640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0cf000 0x7f415c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.656+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c070e20 con 0x7f415c06c260 2023-08-10T10:38:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.656+0000 7fb5dde07640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80cd670 0x7fb5d80cdb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421bb588c9e89d5d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.656+0000 7f415a59c640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 0x7f415c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c071090 con 0x7f415c0c8b30 2023-08-10T10:38:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7fb5d7fff640 1 -- 172.21.15.50:0/3240901440 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0030840 con 0x7fb5d80cd670 2023-08-10T10:38:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7f415b59e640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0cf000 0x7f415c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c071370 con 0x7f415c0cf000 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415ad9d640 1 -- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0cf000 msgr2=0x7f415c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415ad9d640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0cf000 0x7f415c159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415ad9d640 1 -- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 msgr2=0x7f415c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415ad9d640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 0x7f415c156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415ad9d640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154009b30 con 0x7f415c06c260 2023-08-10T10:38:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7f415a59c640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 0x7f415c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7fb5d7fff640 1 -- 172.21.15.50:0/3240901440 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d00309a0 con 0x7fb5d80cd670 2023-08-10T10:38:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.657+0000 7fb5d7fff640 1 -- 172.21.15.50:0/3240901440 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0030d30 con 0x7fb5d80cd670 2023-08-10T10:38:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7fb5df86a640 1 -- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80cd670 msgr2=0x7fb5d80cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.658+0000 7fb5df86a640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80cd670 0x7fb5d80cdb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d002b980 comp rx=0 tx=0).stop 2023-08-10T10:38:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 -- 172.21.15.50:0/3240901440 shutdown_connections 2023-08-10T10:38:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80cd670 0x7fb5d80cdb00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 --2- 172.21.15.50:0/3240901440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 -- 172.21.15.50:0/3240901440 >> 172.21.15.50:0/3240901440 conn(0x7fb5d80d2930 msgr2=0x7fb5d80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7f415ad9d640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415000b3e0 tx=0x7f415000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150011830 con 0x7f415c06c260 2023-08-10T10:38:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41500119b0 con 0x7f415c06c260 2023-08-10T10:38:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150011d60 con 0x7f415c06c260 2023-08-10T10:38:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 -- 172.21.15.50:0/3240901440 shutdown_connections 2023-08-10T10:38:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.660+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0c2a20 con 0x7f415c06c260 2023-08-10T10:38:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.659+0000 7fb5df86a640 1 -- 172.21.15.50:0/3240901440 wait complete. 2023-08-10T10:38:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.662+0000 7fb5df86a640 1 Processor -- start 2023-08-10T10:38:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.662+0000 7fb5df86a640 1 -- start start 2023-08-10T10:38:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.663+0000 7f59d41c2640 1 Processor -- start 2023-08-10T10:38:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.664+0000 7fb5df86a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 0x7fb5d80c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.664+0000 7f59d41c2640 1 -- start start 2023-08-10T10:38:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.664+0000 7fb5df86a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.663+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f415001a400 con 0x7f415c06c260 2023-08-10T10:38:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7f41437fe640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 0x7f414806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5dd606640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 0x7fb5d80c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5dd606640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 0x7fb5d80c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42384/0 (socket says 172.21.15.50:42384) 2023-08-10T10:38:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5dce05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5dce05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33522/0 (socket says 172.21.15.50:33522) 2023-08-10T10:38:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5dd606640 1 -- 172.21.15.50:0/3664215458 learned_addr learned my addr 172.21.15.50:0/3664215458 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7fb5df86a640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d815ec00 con 0x7fb5d80cd670 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d41c2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59c4055620 0x7f59c4007470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d41c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c404fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d41c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40066b0 con 0x7f59c4005ed0 2023-08-10T10:38:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d41c2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40545a0 con 0x7f59c4055620 2023-08-10T10:38:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d41c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4006990 con 0x7f59c4054150 2023-08-10T10:38:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80c8fc0 con 0x7fb5d80b82c0 2023-08-10T10:38:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80c5930 con 0x7fb5d815cbb0 2023-08-10T10:38:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7fb5dde07640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d1f5e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59c4055620 0x7f59c4007470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d1f5e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59c4055620 0x7f59c4007470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33532/0 (socket says 172.21.15.50:33532) 2023-08-10T10:38:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.666+0000 7f59d1f5e640 1 -- 172.21.15.50:0/1266342452 learned_addr learned my addr 172.21.15.50:0/1266342452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0c4eb0 con 0x7f415c06c260 2023-08-10T10:38:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.665+0000 7f415a59c640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 0x7f414806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f415005b460 con 0x7f415c06c260 2023-08-10T10:38:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.668+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c071cd0 con 0x7f415c06c260 2023-08-10T10:38:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7fb5dce05640 1 -- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 msgr2=0x7fb5d80c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7fb5dce05640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7fb5dce05640 1 -- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 msgr2=0x7fb5d80c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7fb5dce05640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 0x7fb5d80c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7fb5dce05640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00094d0 con 0x7fb5d80cd670 2023-08-10T10:38:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f59d275f640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c404fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f59d1f5e640 1 -- 172.21.15.50:0/1266342452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 msgr2=0x7f59c404fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f59d1f5e640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c404fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f59d1f5e640 1 -- 172.21.15.50:0/1266342452 >> v1:172.21.15.117:6789/0 conn(0x7f59c4005ed0 legacy=0x7f59c40df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.667+0000 7f59d1f5e640 1 -- 172.21.15.50:0/1266342452 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4006c70 con 0x7f59c4055620 2023-08-10T10:38:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.668+0000 7fb5dce05640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c3c0 tx=0x7fb5c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.668+0000 7fb5dde07640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.669+0000 7f415a59c640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 0x7f414806d160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4154035000 tx=0x7f4154030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.669+0000 7f59d1f5e640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4055620 0x7f59c4007470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59cc02c540 tx=0x7f59cc0a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7b776a47cf7a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.671+0000 7f3daf59e640 1 Processor -- start 2023-08-10T10:38:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.671+0000 7f3daf59e640 1 -- start start 2023-08-10T10:38:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.673+0000 7f3daf59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3db00ca5d0 0x7f3db015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.673+0000 7f3dadd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3db00ca5d0 0x7f3db015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.673+0000 7f3dadd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3db00ca5d0 0x7f3db015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33548/0 (socket says 172.21.15.50:33548) 2023-08-10T10:38:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.674+0000 7f3dae59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3db0158390 0x7f3db00b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44596/0 (socket says 172.21.15.50:44596) 2023-08-10T10:38:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.674+0000 7f3daed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3db015f0f0 0x7f3db00affb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37278/0 (socket says 172.21.15.50:37278) 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.674+0000 7f3daed9d640 1 -- 172.21.15.50:0/1642464504 learned_addr learned my addr 172.21.15.50:0/1642464504 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.674+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db00b3bf0 con 0x7f3db015f0f0 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.674+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db015e720 con 0x7f3db0158390 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00b3e30 con 0x7f3db00ca5d0 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3dad59a640 1 -- 172.21.15.50:0/1642464504 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464623302 0 0) 0x7f3db015e720 con 0x7f3db0158390 2023-08-10T10:38:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3dad59a640 1 -- 172.21.15.50:0/1642464504 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d98003520 con 0x7f3db0158390 2023-08-10T10:38:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3dadd9b640 1 -- 172.21.15.50:0/1642464504 >> v1:172.21.15.117:6789/0 conn(0x7f3db0158390 legacy=0x7f3db00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3dadd9b640 1 -- 172.21.15.50:0/1642464504 >> v1:172.21.15.50:6789/0 conn(0x7f3db015f0f0 legacy=0x7f3db00affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.675+0000 7f3dadd9b640 1 -- 172.21.15.50:0/1642464504 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00b4110 con 0x7f3db00ca5d0 2023-08-10T10:38:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.676+0000 7faf321e1640 1 Processor -- start 2023-08-10T10:38:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.677+0000 7faf321e1640 1 -- start start 2023-08-10T10:38:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.677+0000 7f3dadd9b640 1 --2- 172.21.15.50:0/1642464504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db00ca5d0 0x7f3db015ebb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097a0 tx=0x7f3da402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b186e5e758bf8ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.678+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4150015020 con 0x7f415c06c260 2023-08-10T10:38:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.678+0000 7faf321e1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf24006b70 0x7faf24053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf321e1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2403c070 con 0x7faf24054190 2023-08-10T10:38:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf321e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240545e0 con 0x7faf240e3070 2023-08-10T10:38:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf2b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7faf240e3070 0x7faf2403ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44610/0 (socket says 172.21.15.50:44610) 2023-08-10T10:38:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf2b7fe640 1 -- 172.21.15.50:0/1339907184 learned_addr learned my addr 172.21.15.50:0/1339907184 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf321e1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240070f0 con 0x7faf24006b70 2023-08-10T10:38:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.679+0000 7faf2affd640 1 --2- 172.21.15.50:0/1339907184 >> v2:172.21.15.50:3300/0 conn(0x7faf24006b70 0x7faf24053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40074e0 con 0x7fb5d80cd670 2023-08-10T10:38:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80c8720 con 0x7fb5d80cd670 2023-08-10T10:38:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7f59d0f5c640 1 -- 172.21.15.50:0/1266342452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0aa770 con 0x7f59c4055620 2023-08-10T10:38:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d80c8ce0 con 0x7fb5d80cd670 2023-08-10T10:38:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7f59d0f5c640 1 -- 172.21.15.50:0/1266342452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc0aa8d0 con 0x7f59c4055620 2023-08-10T10:38:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7f59d0f5c640 1 -- 172.21.15.50:0/1266342452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0aad20 con 0x7f59c4055620 2023-08-10T10:38:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.681+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d80672e0 con 0x7fb5d80cd670 2023-08-10T10:38:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.681+0000 7f3dad59a640 1 -- 172.21.15.50:0/1642464504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4030610 con 0x7f3db00ca5d0 2023-08-10T10:38:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f3dad59a640 1 -- 172.21.15.50:0/1642464504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da4030770 con 0x7f3db00ca5d0 2023-08-10T10:38:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f3dad59a640 1 -- 172.21.15.50:0/1642464504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4030b00 con 0x7f3db00ca5d0 2023-08-10T10:38:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7faf2affd640 1 -- 172.21.15.50:0/1339907184 >> v1:172.21.15.117:6789/0 conn(0x7faf240e3070 legacy=0x7faf2403ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7faf2affd640 1 -- 172.21.15.50:0/1339907184 >> v1:172.21.15.50:6789/0 conn(0x7faf24054190 legacy=0x7faf24057720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.680+0000 7faf2affd640 1 -- 172.21.15.50:0/1339907184 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240073b0 con 0x7faf24006b70 2023-08-10T10:38:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.681+0000 7f59d41c2640 1 -- 172.21.15.50:0/1266342452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4055620 msgr2=0x7f59c4007470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.681+0000 7f59d41c2640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4055620 0x7f59c4007470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59cc02c540 tx=0x7f59cc0a5720 comp rx=0 tx=0).stop 2023-08-10T10:38:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4007640 con 0x7fb5d80cd670 2023-08-10T10:38:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4004a00 con 0x7fb5d80cd670 2023-08-10T10:38:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 -- 172.21.15.50:0/1266342452 shutdown_connections 2023-08-10T10:38:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c404fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 --2- 172.21.15.50:0/1266342452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4055620 0x7f59c4007470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 -- 172.21.15.50:0/1266342452 >> 172.21.15.50:0/1266342452 conn(0x7f59c4054b00 msgr2=0x7f59c4054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 -- 172.21.15.50:0/1266342452 shutdown_connections 2023-08-10T10:38:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f59d41c2640 1 -- 172.21.15.50:0/1266342452 wait complete. 2023-08-10T10:38:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db00ca5d0 msgr2=0x7f3db015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.682+0000 7f3daf59e640 1 --2- 172.21.15.50:0/1642464504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db00ca5d0 0x7f3db015ebb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097a0 tx=0x7f3da402b960 comp rx=0 tx=0).stop 2023-08-10T10:38:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 shutdown_connections 2023-08-10T10:38:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7f3daf59e640 1 --2- 172.21.15.50:0/1642464504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db00ca5d0 0x7f3db015ebb0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097a0 tx=0x7f3da402b960 comp rx=0 tx=0).stop 2023-08-10T10:38:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 >> 172.21.15.50:0/1642464504 conn(0x7f3db00cafb0 msgr2=0x7f3db00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7faf2affd640 1 --2- 172.21.15.50:0/1339907184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf24053c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf1802b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adab5e68e4dd4ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 shutdown_connections 2023-08-10T10:38:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.683+0000 7f3daf59e640 1 -- 172.21.15.50:0/1642464504 wait complete. 2023-08-10T10:38:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.685+0000 7f59d41c2640 1 Processor -- start 2023-08-10T10:38:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.685+0000 7f59d41c2640 1 -- start start 2023-08-10T10:38:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.685+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5c4004b60 con 0x7fb5d80cd670 2023-08-10T10:38:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.686+0000 7ff0dbfff640 1 Processor -- start 2023-08-10T10:38:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.686+0000 7f3daf59e640 1 Processor -- start 2023-08-10T10:38:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7f59d41c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7fb5d5ffb640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 0x7fb5bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5c4089080 con 0x7fb5d80cd670 2023-08-10T10:38:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7f59d1f5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7f59d1f5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33566/0 (socket says 172.21.15.50:33566) 2023-08-10T10:38:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7f59d1f5e640 1 -- 172.21.15.50:0/2498535262 learned_addr learned my addr 172.21.15.50:0/2498535262 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.686+0000 7ff0dbfff640 1 -- start start 2023-08-10T10:38:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f6737567640 1 Processor -- start 2023-08-10T10:38:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c40c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59c4055620 0x7f59c404dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40cb930 con 0x7f59c4005ed0 2023-08-10T10:38:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c0de0 con 0x7f59c4055620 2023-08-10T10:38:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4048240 con 0x7f59c4054150 2023-08-10T10:38:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7fb5dd606640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 0x7fb5bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.687+0000 7f3daf59e640 1 -- start start 2023-08-10T10:38:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7f3daf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 0x7f3db00715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7ff0dbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0dc15ce70 0x7ff0dc0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7ff0dbfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc160b60 con 0x7ff0dc0b1a30 2023-08-10T10:38:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7ff0dbfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0b8200 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.688+0000 7ff0dbfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc161700 con 0x7ff0dc15ce70 2023-08-10T10:38:29.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3daf59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 0x7f3db01fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f6737567640 1 -- start start 2023-08-10T10:38:29.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3daf59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3db00c4070 0x7f3db00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7fb5dd606640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 0x7fb5bc06d110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc003b30 tx=0x7fb5cc009930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7ff0daffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff0dc0cf3b0 0x7ff0dc0cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44620/0 (socket says 172.21.15.50:44620) 2023-08-10T10:38:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7ff0daffd640 1 -- 172.21.15.50:0/1990088198 learned_addr learned my addr 172.21.15.50:0/1990088198 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3dadd9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 0x7f3db01fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3dadd9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 0x7f3db01fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52436/0 (socket says 172.21.15.50:52436) 2023-08-10T10:38:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3dadd9b640 1 -- 172.21.15.50:0/3064817588 learned_addr learned my addr 172.21.15.50:0/3064817588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f3dae59c640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 0x7f3db00715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7ff0da7fc640 1 --2- 172.21.15.50:0/1990088198 >> v2:172.21.15.50:3300/0 conn(0x7ff0dc15ce70 0x7ff0dc0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7faf2a7fc640 1 -- 172.21.15.50:0/1339907184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18030710 con 0x7faf24006b70 2023-08-10T10:38:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7faf2a7fc640 1 -- 172.21.15.50:0/1339907184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1802e050 con 0x7faf24006b70 2023-08-10T10:38:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7faf2a7fc640 1 -- 172.21.15.50:0/1339907184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18030a90 con 0x7faf24006b70 2023-08-10T10:38:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f59d275f640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59c4055620 0x7f59c404dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.689+0000 7f59d175d640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c40c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 -- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 msgr2=0x7f59c40c08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c40c08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 -- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59c4055620 msgr2=0x7f59c404dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59c4055620 0x7f59c404dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4045c50 con 0x7f59c4005ed0 2023-08-10T10:38:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f3daed9d640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3db00c4070 0x7f3db00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7ff0d9ffb640 1 -- 172.21.15.50:0/1990088198 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390984294 0 0) 0x7ff0dc0b8200 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7ff0d9ffb640 1 -- 172.21.15.50:0/1990088198 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c4003520 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00c4a30 con 0x7f3db0158390 2023-08-10T10:38:29.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db01ffea0 con 0x7f3db00c4070 2023-08-10T10:38:29.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db01589b0 con 0x7f3db01ffa40 2023-08-10T10:38:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 -- 172.21.15.50:0/1339907184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 msgr2=0x7faf24053c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 --2- 172.21.15.50:0/1339907184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf24053c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf1802b5d0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59d1f5e640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000b60 tx=0x7f59cc072270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0adb80 con 0x7f59c4005ed0 2023-08-10T10:38:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc0adce0 con 0x7f59c4005ed0 2023-08-10T10:38:29.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0b7610 con 0x7f59c4005ed0 2023-08-10T10:38:29.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f3dae59c640 1 -- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 msgr2=0x7f3db01fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f3dae59c640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 0x7f3db01fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f3dae59c640 1 -- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3db00c4070 msgr2=0x7f3db00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f3dae59c640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3db00c4070 0x7f3db00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f3dae59c640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4009400 con 0x7f3db0158390 2023-08-10T10:38:29.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f3dae59c640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 0x7f3db00715f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c430 tx=0x7f3da000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 -- 172.21.15.50:0/1339907184 shutdown_connections 2023-08-10T10:38:29.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 --2- 172.21.15.50:0/1339907184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf24053c50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 -- 172.21.15.50:0/1339907184 >> 172.21.15.50:0/1339907184 conn(0x7faf24055a90 msgr2=0x7faf24055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 -- 172.21.15.50:0/1339907184 shutdown_connections 2023-08-10T10:38:29.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f6737567640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f6737567640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67300d08e0 0x7f67300cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7f99fd1e3640 1 Processor -- start 2023-08-10T10:38:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7ff0da7fc640 1 -- 172.21.15.50:0/1990088198 >> v1:172.21.15.117:6789/0 conn(0x7ff0dc0cf3b0 legacy=0x7ff0dc0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7ff0da7fc640 1 -- 172.21.15.50:0/1990088198 >> v1:172.21.15.50:6789/0 conn(0x7ff0dc0b1a30 legacy=0x7ff0dc160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7ff0da7fc640 1 -- 172.21.15.50:0/1990088198 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0b8750 con 0x7ff0dc15ce70 2023-08-10T10:38:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f6737567640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300d2630 con 0x7f67300cfc40 2023-08-10T10:38:29.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00074e0 con 0x7f3db0158390 2023-08-10T10:38:29.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0007660 con 0x7f3db0158390 2023-08-10T10:38:29.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0004a20 con 0x7f3db0158390 2023-08-10T10:38:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f6737567640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67300d00d0 con 0x7f67300d08e0 2023-08-10T10:38:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f6737567640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300b8010 con 0x7f673015cc30 2023-08-10T10:38:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.691+0000 7faf321e1640 1 -- 172.21.15.50:0/1339907184 wait complete. 2023-08-10T10:38:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.690+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb5c40540c0 con 0x7fb5d80cd670 2023-08-10T10:38:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6736565640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6735d64640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67300d08e0 0x7f67300cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6736565640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52452/0 (socket says 172.21.15.50:52452) 2023-08-10T10:38:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6736565640 1 -- 172.21.15.50:0/3743190154 learned_addr learned my addr 172.21.15.50:0/3743190154 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7ff0da7fc640 1 --2- 172.21.15.50:0/1990088198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0d2190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef8576e28895076 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6735d64640 1 -- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 msgr2=0x7f67300d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6735d64640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6735d64640 1 -- 172.21.15.50:0/3743190154 >> v1:172.21.15.50:6789/0 conn(0x7f67300cfc40 legacy=0x7f67300d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7ff0d9ffb640 1 -- 172.21.15.50:0/1990088198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d402cd10 con 0x7ff0dc15ce70 2023-08-10T10:38:29.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7ff0d9ffb640 1 -- 172.21.15.50:0/1990088198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d402ce70 con 0x7ff0dc15ce70 2023-08-10T10:38:29.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7ff0d9ffb640 1 -- 172.21.15.50:0/1990088198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4034640 con 0x7ff0dc15ce70 2023-08-10T10:38:29.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.693+0000 7f6735d64640 1 -- 172.21.15.50:0/3743190154 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300d0ea0 con 0x7f67300d08e0 2023-08-10T10:38:29.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f6736565640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:29.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7faf321e1640 1 Processor -- start 2023-08-10T10:38:29.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7faf321e1640 1 -- start start 2023-08-10T10:38:29.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7ff0dbfff640 1 -- 172.21.15.50:0/1990088198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc15ce70 msgr2=0x7ff0dc0d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/1990088198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0d2190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d402bf60 comp rx=0 tx=0).stop 2023-08-10T10:38:29.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7ff0dbfff640 1 -- 172.21.15.50:0/1990088198 shutdown_connections 2023-08-10T10:38:29.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/1990088198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0d2190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7ff0dbfff640 1 -- 172.21.15.50:0/1990088198 >> 172.21.15.50:0/1990088198 conn(0x7ff0dc0696a0 msgr2=0x7ff0dc069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f6735d64640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67300d08e0 0x7f67300cf700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67200097a0 tx=0x7f672002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f939e23429801275 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4045f30 con 0x7f59c4005ed0 2023-08-10T10:38:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40464f0 con 0x7f59c4005ed0 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.692+0000 7f99fd1e3640 1 -- start start 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99fd1e3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99f815ce70 0x7f99f80d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99fd1e3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f8160b60 con 0x7f99f80b1a30 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99fd1e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80b8200 con 0x7f99f80cf3b0 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99fd1e3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f8161700 con 0x7f99f815ce70 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99ef7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99f815ce70 0x7f99f80d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99ef7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99f815ce70 0x7f99f80d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33582/0 (socket says 172.21.15.50:33582) 2023-08-10T10:38:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f99ef7fe640 1 -- 172.21.15.50:0/2362153921 learned_addr learned my addr 172.21.15.50:0/2362153921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f99ef7fe640 1 -- 172.21.15.50:0/2362153921 >> v1:172.21.15.117:6789/0 conn(0x7f99f80cf3b0 legacy=0x7f99f80cf790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:38:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f99ef7fe640 1 -- 172.21.15.50:0/2362153921 >> v1:172.21.15.50:6789/0 conn(0x7f99f80b1a30 legacy=0x7f99f8160ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:38:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.695+0000 7f99ef7fe640 1 -- 172.21.15.50:0/2362153921 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80b8750 con 0x7f99f815ce70 2023-08-10T10:38:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0158c70 con 0x7f3db0158390 2023-08-10T10:38:29.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.694+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db0159230 con 0x7f3db0158390 2023-08-10T10:38:29.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7f6735563640 1 -- 172.21.15.50:0/3743190154 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672002d040 con 0x7f67300d08e0 2023-08-10T10:38:29.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7f6735563640 1 -- 172.21.15.50:0/3743190154 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720031810 con 0x7f67300d08e0 2023-08-10T10:38:29.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7f6735563640 1 -- 172.21.15.50:0/3743190154 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720031ba0 con 0x7f67300d08e0 2023-08-10T10:38:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7ff0dbfff640 1 -- 172.21.15.50:0/1990088198 shutdown_connections 2023-08-10T10:38:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7ff0dbfff640 1 -- 172.21.15.50:0/1990088198 wait complete. 2023-08-10T10:38:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.696+0000 7f99ef7fe640 1 --2- 172.21.15.50:0/2362153921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f815ce70 0x7f99f80d2190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009870 tx=0x7f99e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc0ea235d958f89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f6737567640 1 -- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67300d08e0 msgr2=0x7f67300cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f6737567640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67300d08e0 0x7f67300cf700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67200097a0 tx=0x7f672002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f99f77fe640 1 -- 172.21.15.50:0/2362153921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0031870 con 0x7f99f815ce70 2023-08-10T10:38:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f99f77fe640 1 -- 172.21.15.50:0/2362153921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00319d0 con 0x7f99f815ce70 2023-08-10T10:38:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f99f77fe640 1 -- 172.21.15.50:0/2362153921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0031d60 con 0x7f99f815ce70 2023-08-10T10:38:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4050c60 con 0x7f59c4005ed0 2023-08-10T10:38:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.697+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db015a5a0 con 0x7f3db0158390 2023-08-10T10:38:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.698+0000 7ff0dbfff640 1 Processor -- start 2023-08-10T10:38:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.698+0000 7faf321e1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.698+0000 7ff0dbfff640 1 -- start start 2023-08-10T10:38:29.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33584/0 (socket says 172.21.15.50:33584) 2023-08-10T10:38:29.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7faf2b7fe640 1 -- 172.21.15.50:0/4174982530 learned_addr learned my addr 172.21.15.50:0/4174982530 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7faf321e1640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf24054190 0x7faf24052140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7faf321e1640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf240e3070 0x7faf240c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.699+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0dc0b1a30 0x7ff0dc0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59cc0b4050 con 0x7f59c4005ed0 2023-08-10T10:38:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0dbfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cb7d0 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0dbfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cbab0 con 0x7ff0dc15ce70 2023-08-10T10:38:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0dbfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cbd90 con 0x7ff0dc0b1a30 2023-08-10T10:38:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0da7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0da7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33598/0 (socket says 172.21.15.50:33598) 2023-08-10T10:38:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0da7fc640 1 -- 172.21.15.50:0/3773313086 learned_addr learned my addr 172.21.15.50:0/3773313086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7faf2affd640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf24054190 0x7faf24052140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0daffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0dc0b1a30 0x7ff0dc0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7ff0db7fe640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7faf321e1640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24052ec0 con 0x7faf24006b70 2023-08-10T10:38:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 -- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0dc0b1a30 msgr2=0x7ff0dc0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0dc0b1a30 0x7ff0dc0c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 -- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0dc15ce70 msgr2=0x7ff0dc0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 -- 172.21.15.50:0/3773313086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009a70 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7faf2bfff640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf240e3070 0x7faf240c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7faf321e1640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24052be0 con 0x7faf240e3070 2023-08-10T10:38:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7faf321e1640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf24038ad0 con 0x7faf24054190 2023-08-10T10:38:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7f59c27fc640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 0x7f59b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.701+0000 7ff0da7fc640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009eb0 tx=0x7ff0d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59cc125370 con 0x7f59c4005ed0 2023-08-10T10:38:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7f59d175d640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 0x7f59b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7faf2b7fe640 1 -- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf24054190 msgr2=0x7faf24052140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7faf2b7fe640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf24054190 0x7faf24052140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7faf2b7fe640 1 -- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf240e3070 msgr2=0x7faf240c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7faf2b7fe640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf240e3070 0x7faf240c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7faf2b7fe640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009400 con 0x7faf24006b70 2023-08-10T10:38:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.703+0000 7faf2b7fe640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf2000c800 tx=0x7faf2000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.700+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3da0004b80 con 0x7f3db0158390 2023-08-10T10:38:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7f3d9effd640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 0x7f3d9006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.702+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3da0088ea0 con 0x7f3db0158390 2023-08-10T10:38:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.703+0000 7f3dadd9b640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 0x7f3d9006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.703+0000 7f59d175d640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 0x7f59b006d110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c40d4500 tx=0x7f59bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.704+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2362153921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f815ce70 msgr2=0x7f99f80d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.704+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2362153921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f815ce70 0x7f99f80d2190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009870 tx=0x7f99e002b910 comp rx=0 tx=0).stop 2023-08-10T10:38:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.704+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2362153921 shutdown_connections 2023-08-10T10:38:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2362153921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f815ce70 0x7f99f80d2190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2362153921 >> 172.21.15.50:0/2362153921 conn(0x7f99f80696a0 msgr2=0x7f99f8069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7f3dadd9b640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 0x7f3d9006d1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d403e610 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2362153921 shutdown_connections 2023-08-10T10:38:29.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0cc070 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc150420 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.706+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f59cc0f04a0 con 0x7f59c4005ed0 2023-08-10T10:38:29.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.705+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2362153921 wait complete. 2023-08-10T10:38:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.706+0000 7f6737567640 1 -- 172.21.15.50:0/3743190154 shutdown_connections 2023-08-10T10:38:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.706+0000 7f6737567640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67300d08e0 0x7f67300cf700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.706+0000 7f6737567640 1 --2- 172.21.15.50:0/3743190154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f673015cc30 0x7f67300d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.706+0000 7f6737567640 1 -- 172.21.15.50:0/3743190154 >> 172.21.15.50:0/3743190154 conn(0x7f6730069880 msgr2=0x7f6730069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:29.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.707+0000 7f6737567640 1 -- 172.21.15.50:0/3743190154 shutdown_connections 2023-08-10T10:38:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.707+0000 7f6737567640 1 -- 172.21.15.50:0/3743190154 wait complete. 2023-08-10T10:38:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.708+0000 7f99fd1e3640 1 Processor -- start 2023-08-10T10:38:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.709+0000 7f99fd1e3640 1 -- start start 2023-08-10T10:38:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.710+0000 7f6737567640 1 Processor -- start 2023-08-10T10:38:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.711+0000 7f99fd1e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.711+0000 7f99fd1e3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.710+0000 7f6737567640 1 -- start start 2023-08-10T10:38:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.711+0000 7f6737567640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 0x7f673014bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.711+0000 7f6737567640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67300d08e0 0x7f673015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6737567640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 0x7f673015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6736565640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 0x7f673014bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33610/0 (socket says 172.21.15.50:33610) 2023-08-10T10:38:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6736565640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 0x7f673014bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33622/0 (socket says 172.21.15.50:33622) 2023-08-10T10:38:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52474/0 (socket says 172.21.15.50:52474) 2023-08-10T10:38:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99ef7fe640 1 -- 172.21.15.50:0/2233931507 learned_addr learned my addr 172.21.15.50:0/2233931507 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6736565640 1 -- 172.21.15.50:0/2327077885 learned_addr learned my addr 172.21.15.50:0/2327077885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6735d64640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67300d08e0 0x7f673015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f815ce70 0x7f99f815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6737567640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300cb560 con 0x7f67300cfc40 2023-08-10T10:38:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6737567640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300ca8e0 con 0x7f673015cc30 2023-08-10T10:38:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f6737567640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300cabc0 con 0x7f67300d08e0 2023-08-10T10:38:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f6736d66640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 0x7f673015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3da0053f30 con 0x7f3db0158390 2023-08-10T10:38:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200074e0 con 0x7faf24006b70 2023-08-10T10:38:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20007640 con 0x7faf24006b70 2023-08-10T10:38:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20004a00 con 0x7faf24006b70 2023-08-10T10:38:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f6736d66640 1 -- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67300d08e0 msgr2=0x7f673015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f6736d66640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67300d08e0 0x7f673015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f6736d66640 1 -- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 msgr2=0x7f673014bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f6736d66640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 0x7f673014bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.714+0000 7f6736d66640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0094d0 con 0x7f673015cc30 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.712+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c81d0 con 0x7f99f80cf3b0 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7f99fc9e2640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f815ce70 0x7f99f815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.714+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c7340 con 0x7f99f815ce70 2023-08-10T10:38:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.714+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c75c0 con 0x7f99f80b1a30 2023-08-10T10:38:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d403e770 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d403eae0 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7faf321e1640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24038db0 con 0x7faf24006b70 2023-08-10T10:38:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.713+0000 7faf321e1640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf240c7aa0 con 0x7faf24006b70 2023-08-10T10:38:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.714+0000 7f6736d66640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 0x7f673015d600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f672800c700 tx=0x7f672800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728003bc0 con 0x7f673015cc30 2023-08-10T10:38:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f6737567640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720009400 con 0x7f673015cc30 2023-08-10T10:38:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 -- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f815ce70 msgr2=0x7f99f815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f815ce70 0x7f99f815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 -- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 msgr2=0x7f99f81546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00094d0 con 0x7f99f80b1a30 2023-08-10T10:38:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99ef7fe640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f99f7fff640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009fd0 tx=0x7f99e800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc005250 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6728003d40 con 0x7f673015cc30 2023-08-10T10:38:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f6737567640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67300cb180 con 0x7f673015cc30 2023-08-10T10:38:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.715+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728005310 con 0x7f673015cc30 2023-08-10T10:38:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.717+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0d403b050 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.719+0000 7ff0c37fe640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 0x7ff0c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.719+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d40ab9a0 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.719+0000 7ff0daffd640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 0x7ff0c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.719+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6728005470 con 0x7f673015cc30 2023-08-10T10:38:29.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.720+0000 7f6726ffd640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 0x7f671406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.721+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6728089040 con 0x7f673015cc30 2023-08-10T10:38:29.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.721+0000 7ff0daffd640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 0x7ff0c806d110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0011e0 tx=0x7ff0cc007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.721+0000 7f6736565640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 0x7f671406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.719+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf20004b60 con 0x7faf24006b70 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.720+0000 7faf17fff640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 0x7faf1006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.720+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf20088c50 con 0x7faf24006b70 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.720+0000 7faf2affd640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 0x7faf1006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.722+0000 7faf2affd640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 0x7faf1006d1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf18034000 tx=0x7faf18008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.722+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011830 con 0x7f99f80b1a30 2023-08-10T10:38:29.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.722+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8011990 con 0x7f99f80b1a30 2023-08-10T10:38:29.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.722+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011d40 con 0x7f99f80b1a30 2023-08-10T10:38:29.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.722+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80c78a0 con 0x7f99f80b1a30 2023-08-10T10:38:29.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.723+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f80c7e60 con 0x7f99f80b1a30 2023-08-10T10:38:29.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.724+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240545e0 con 0x7faf24006b70 2023-08-10T10:38:29.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.723+0000 7f6736565640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 0x7f671406d0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e20 tx=0x7f672c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.724+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f80612b0 con 0x7f99f80b1a30 2023-08-10T10:38:29.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.724+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6730066e30 con 0x7f673015cc30 2023-08-10T10:38:29.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.726+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0d4076b10 con 0x7ff0dc0cf3b0 2023-08-10T10:38:29.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.727+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99e801a400 con 0x7f99f80b1a30 2023-08-10T10:38:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.728+0000 7f99f57fa640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 0x7f99d806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.728+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99e8089b00 con 0x7f99f80b1a30 2023-08-10T10:38:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.729+0000 7f99ef7fe640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 0x7f99d806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.731+0000 7f99ef7fe640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 0x7f99d806d1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99e00090b0 tx=0x7f99e003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.734+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faf20088e60 con 0x7faf24006b70 2023-08-10T10:38:29.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.741+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6728054190 con 0x7f673015cc30 2023-08-10T10:38:29.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:29.741+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f99e8054c40 con 0x7f99f80b1a30 2023-08-10T10:38:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.092+0000 7f41611cb640 1 -- 172.21.15.50:0/2980602892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f415c0612b0 con 0x7f415c06c260 2023-08-10T10:38:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.093+0000 7f41437fe640 1 -- 172.21.15.50:0/2980602892 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4150057090 con 0x7f415c06c260 2023-08-10T10:38:30.094 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 msgr2=0x7f414806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 0x7f414806d160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4154035000 tx=0x7f4154030000 comp rx=0 tx=0).stop 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 msgr2=0x7f415c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415000b3e0 tx=0x7f415000b8a0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 shutdown_connections 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f415c0cf000 0x7f415c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f414806aca0 0x7f414806d160 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f415c0c8b30 0x7f415c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 --2- 172.21.15.50:0/2980602892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c06c260 0x7f415c0c48d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.096+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 >> 172.21.15.50:0/2980602892 conn(0x7f415c0ce4e0 msgr2=0x7f415c0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.097+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 shutdown_connections 2023-08-10T10:38:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.097+0000 7f41417fa640 1 -- 172.21.15.50:0/2980602892 wait complete. 2023-08-10T10:38:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.112+0000 7fb5df86a640 1 -- 172.21.15.50:0/3664215458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb5d80612b0 con 0x7fb5d80cd670 2023-08-10T10:38:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.113+0000 7fb5d5ffb640 1 -- 172.21.15.50:0/3664215458 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5c4020020 con 0x7fb5d80cd670 2023-08-10T10:38:30.117 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.117+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 msgr2=0x7fb5bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.117+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 0x7fb5bc06d110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc003b30 tx=0x7fb5cc009930 comp rx=0 tx=0).stop 2023-08-10T10:38:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.117+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 msgr2=0x7fb5d80c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.117+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c3c0 tx=0x7fb5c400c880 comp rx=0 tx=0).stop 2023-08-10T10:38:30.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 shutdown_connections 2023-08-10T10:38:30.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d815cbb0 0x7fb5d80c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5d80cd670 0x7fb5d80c79a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb5bc06ac50 0x7fb5bc06d110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 --2- 172.21.15.50:0/3664215458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d80b82c0 0x7fb5d80c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.118+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 >> 172.21.15.50:0/3664215458 conn(0x7fb5d80d2930 msgr2=0x7fb5d80b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.119+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 shutdown_connections 2023-08-10T10:38:30.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.119+0000 7fb5c37fe640 1 -- 172.21.15.50:0/3664215458 wait complete. 2023-08-10T10:38:30.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2023-08-10T10:38:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.127+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3db00612b0 con 0x7f3db0158390 2023-08-10T10:38:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.128+0000 7f3d9effd640 1 -- 172.21.15.50:0/3064817588 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3da0057550 con 0x7f3db0158390 2023-08-10T10:38:30.129 INFO:teuthology.orchestra.run.smithi050.stdout:55834574853 2023-08-10T10:38:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.131+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 msgr2=0x7f3d9006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.131+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 0x7f3d9006d1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da4008030 comp rx=0 tx=0).stop 2023-08-10T10:38:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.131+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 msgr2=0x7f3db00715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.131+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 0x7f3db00715f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c430 tx=0x7f3da000c8f0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 shutdown_connections 2023-08-10T10:38:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d9006ad20 0x7f3d9006d1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3db00c4070 0x7f3db00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3db01ffa40 0x7f3db01fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 --2- 172.21.15.50:0/3064817588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3db0158390 0x7f3db00715f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 >> 172.21.15.50:0/3064817588 conn(0x7f3db00cafb0 msgr2=0x7f3db015c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 shutdown_connections 2023-08-10T10:38:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.132+0000 7f3daf59e640 1 -- 172.21.15.50:0/3064817588 wait complete. 2023-08-10T10:38:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.135+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59c4008a10 con 0x7f59c4005ed0 2023-08-10T10:38:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.136+0000 7f59c27fc640 1 -- 172.21.15.50:0/2498535262 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59cc0c6090 con 0x7f59c4005ed0 2023-08-10T10:38:30.137 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.139+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 msgr2=0x7f59b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.139+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 0x7f59b006d110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c40d4500 tx=0x7f59bc009040 comp rx=0 tx=0).stop 2023-08-10T10:38:30.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.139+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 msgr2=0x7f59c40455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.139+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000b60 tx=0x7f59cc072270 comp rx=0 tx=0).stop 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.139+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 shutdown_connections 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f59b006ac50 0x7f59b006d110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59c4055620 0x7f59c404dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59c4054150 0x7f59c40c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 --2- 172.21.15.50:0/2498535262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c4005ed0 0x7f59c40455c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 >> 172.21.15.50:0/2498535262 conn(0x7f59c4054b00 msgr2=0x7f59c40e2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 shutdown_connections 2023-08-10T10:38:30.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.140+0000 7f59d41c2640 1 -- 172.21.15.50:0/2498535262 wait complete. 2023-08-10T10:38:30.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2023-08-10T10:38:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.149+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf24053000 con 0x7faf24006b70 2023-08-10T10:38:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.149+0000 7faf17fff640 1 -- 172.21.15.50:0/4174982530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf240545e0 con 0x7faf24006b70 2023-08-10T10:38:30.152 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 msgr2=0x7faf1006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 0x7faf1006d1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf18034000 tx=0x7faf18008030 comp rx=0 tx=0).stop 2023-08-10T10:38:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 msgr2=0x7faf2417ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf2000c800 tx=0x7faf2000ccc0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2023-08-10T10:38:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 shutdown_connections 2023-08-10T10:38:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faf1006ad20 0x7faf1006d1e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.153+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf240e3070 0x7faf240c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.154+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf24054190 0x7faf24052140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.154+0000 7faf15ffb640 1 --2- 172.21.15.50:0/4174982530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf24006b70 0x7faf2417ec30 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf2000c800 tx=0x7faf2000ccc0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.154+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 >> 172.21.15.50:0/4174982530 conn(0x7faf24055a90 msgr2=0x7faf2403c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.154+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 shutdown_connections 2023-08-10T10:38:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.154+0000 7faf15ffb640 1 -- 172.21.15.50:0/4174982530 wait complete. 2023-08-10T10:38:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.155+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f99f80b20e0 con 0x7f99f80b1a30 2023-08-10T10:38:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.156+0000 7f99f57fa640 1 -- 172.21.15.50:0/2233931507 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99e8015090 con 0x7f99f80b1a30 2023-08-10T10:38:30.159 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 msgr2=0x7f99d806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 0x7f99d806d1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99e00090b0 tx=0x7f99e003c040 comp rx=0 tx=0).stop 2023-08-10T10:38:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 msgr2=0x7f99f80c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009fd0 tx=0x7f99e800b870 comp rx=0 tx=0).stop 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 shutdown_connections 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f99d806ad20 0x7f99d806d1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f815ce70 0x7f99f815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f80cf3b0 0x7f99f81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 --2- 172.21.15.50:0/2233931507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99f80b1a30 0x7f99f80c6e00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 >> 172.21.15.50:0/2233931507 conn(0x7f99f80696a0 msgr2=0x7f99f8069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.158+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 shutdown_connections 2023-08-10T10:38:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.159+0000 7f99fd1e3640 1 -- 172.21.15.50:0/2233931507 wait complete. 2023-08-10T10:38:30.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2023-08-10T10:38:30.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.162+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff0bc005500 con 0x7ff0dc0cf3b0 2023-08-10T10:38:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.162+0000 7ff0c37fe640 1 -- 172.21.15.50:0/3773313086 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0d407a130 con 0x7ff0dc0cf3b0 2023-08-10T10:38:30.164 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.165+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 msgr2=0x7ff0c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.165+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 0x7ff0c806d110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0011e0 tx=0x7ff0cc007d30 comp rx=0 tx=0).stop 2023-08-10T10:38:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 msgr2=0x7ff0dc0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009eb0 tx=0x7ff0d4004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 shutdown_connections 2023-08-10T10:38:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0c806ac50 0x7ff0c806d110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0dc15ce70 0x7ff0dc0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0dc0cf3b0 0x7ff0dc0c7fd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 --2- 172.21.15.50:0/3773313086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0dc0b1a30 0x7ff0dc0c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 >> 172.21.15.50:0/3773313086 conn(0x7ff0dc0696a0 msgr2=0x7ff0dc0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 shutdown_connections 2023-08-10T10:38:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.166+0000 7ff0dbfff640 1 -- 172.21.15.50:0/3773313086 wait complete. 2023-08-10T10:38:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.169+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f67300cf940 con 0x7f673015cc30 2023-08-10T10:38:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.170+0000 7f6726ffd640 1 -- 172.21.15.50:0/2327077885 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67280577b0 con 0x7f673015cc30 2023-08-10T10:38:30.172 INFO:teuthology.orchestra.run.smithi050.stdout:55834574852 2023-08-10T10:38:30.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2023-08-10T10:38:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 msgr2=0x7f671406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 0x7f671406d0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e20 tx=0x7f672c009240 comp rx=0 tx=0).stop 2023-08-10T10:38:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 msgr2=0x7f673015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 0x7f673015d600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f672800c700 tx=0x7f672800cbc0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 shutdown_connections 2023-08-10T10:38:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f671406ac20 0x7f671406d0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673015cc30 0x7f673015d600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67300d08e0 0x7f673015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 --2- 172.21.15.50:0/2327077885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67300cfc40 0x7f673014bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 >> 172.21.15.50:0/2327077885 conn(0x7f6730069880 msgr2=0x7f673015e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 shutdown_connections 2023-08-10T10:38:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:30.173+0000 7f6724ff9640 1 -- 172.21.15.50:0/2327077885 wait complete. 2023-08-10T10:38:30.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2023-08-10T10:38:30.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2023-08-10T10:38:30.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-08-10T10:38:31.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-10T10:38:31.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-10T10:38:31.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-10T10:38:31.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-10T10:38:31.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-10T10:38:31.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-10T10:38:31.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-10T10:38:31.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-10T10:38:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.436+0000 7f62b42ec640 1 Processor -- start 2023-08-10T10:38:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.441+0000 7f62b42ec640 1 -- start start 2023-08-10T10:38:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.443+0000 7f62b42ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62ac0c8b30 0x7f62ac06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.443+0000 7f62b42ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac158fa0 con 0x7f62ac158bc0 2023-08-10T10:38:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.443+0000 7f62b42ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac06ba30 con 0x7f62ac06c970 2023-08-10T10:38:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.443+0000 7f62b42ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0c8f80 con 0x7f62ac0c8b30 2023-08-10T10:38:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.444+0000 7f62b2889640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62ac0c8b30 0x7f62ac06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.444+0000 7f62b2088640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62ac158bc0 0x7f62ac06c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37308/0 (socket says 172.21.15.50:37308) 2023-08-10T10:38:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.444+0000 7f62b2889640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62ac0c8b30 0x7f62ac06b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33636/0 (socket says 172.21.15.50:33636) 2023-08-10T10:38:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.444+0000 7f62b2088640 1 -- 172.21.15.50:0/1012439728 learned_addr learned my addr 172.21.15.50:0/1012439728 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.445+0000 7f62b2889640 1 -- 172.21.15.50:0/1012439728 >> v1:172.21.15.117:6789/0 conn(0x7f62ac06c970 legacy=0x7f62ac0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.445+0000 7f62b2889640 1 -- 172.21.15.50:0/1012439728 >> v1:172.21.15.50:6789/0 conn(0x7f62ac158bc0 legacy=0x7f62ac06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.446+0000 7f62b2889640 1 -- 172.21.15.50:0/1012439728 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0c9d90 con 0x7f62ac0c8b30 2023-08-10T10:38:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.447+0000 7f62b2889640 1 --2- 172.21.15.50:0/1012439728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac0c8b30 0x7f62ac06b4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f62a8008260 tx=0x7f62a802ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1006e8a62db55d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.448+0000 7f62b1086640 1 -- 172.21.15.50:0/1012439728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8008df0 con 0x7f62ac0c8b30 2023-08-10T10:38:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.448+0000 7f62b1086640 1 -- 172.21.15.50:0/1012439728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a802e790 con 0x7f62ac0c8b30 2023-08-10T10:38:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.448+0000 7f62b1086640 1 -- 172.21.15.50:0/1012439728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a802eb20 con 0x7f62ac0c8b30 2023-08-10T10:38:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.449+0000 7f62b42ec640 1 -- 172.21.15.50:0/1012439728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac0c8b30 msgr2=0x7f62ac06b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.449+0000 7f62b42ec640 1 --2- 172.21.15.50:0/1012439728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac0c8b30 0x7f62ac06b4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f62a8008260 tx=0x7f62a802ddf0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.449+0000 7f62b42ec640 1 -- 172.21.15.50:0/1012439728 shutdown_connections 2023-08-10T10:38:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.449+0000 7f62b42ec640 1 --2- 172.21.15.50:0/1012439728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac0c8b30 0x7f62ac06b4f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.449+0000 7f62b42ec640 1 -- 172.21.15.50:0/1012439728 >> 172.21.15.50:0/1012439728 conn(0x7f62ac0ce4e0 msgr2=0x7f62ac0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.450+0000 7f62b42ec640 1 -- 172.21.15.50:0/1012439728 shutdown_connections 2023-08-10T10:38:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.450+0000 7f62b42ec640 1 -- 172.21.15.50:0/1012439728 wait complete. 2023-08-10T10:38:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.453+0000 7f62b42ec640 1 Processor -- start 2023-08-10T10:38:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.453+0000 7f62b42ec640 1 -- start start 2023-08-10T10:38:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.455+0000 7f62b42ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 0x7f62ac157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.455+0000 7f62b42ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 0x7f62ac1fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.456+0000 7f62b42ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 0x7f62ac1e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.456+0000 7f62b2088640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 0x7f62ac157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.456+0000 7f62b2088640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 0x7f62ac157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52498/0 (socket says 172.21.15.50:52498) 2023-08-10T10:38:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.456+0000 7f62b1887640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 0x7f62ac1fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.456+0000 7f62b1887640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 0x7f62ac1fe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42452/0 (socket says 172.21.15.50:42452) 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.457+0000 7f62b2088640 1 -- 172.21.15.50:0/692431595 learned_addr learned my addr 172.21.15.50:0/692431595 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.457+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1fed30 con 0x7f62ac158bc0 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.457+0000 7f62b2889640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 0x7f62ac1e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.457+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0c4ac0 con 0x7f62ac0c8b30 2023-08-10T10:38:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.457+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0c47e0 con 0x7f62ac06c970 2023-08-10T10:38:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 -- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 msgr2=0x7f62ac157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 0x7f62ac157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 -- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 msgr2=0x7f62ac1fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 0x7f62ac1fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a800ae30 con 0x7f62ac158bc0 2023-08-10T10:38:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.458+0000 7f62b2889640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 0x7f62ac1e12b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f62a8034000 tx=0x7f62a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.459+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80403f0 con 0x7f62ac158bc0 2023-08-10T10:38:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.459+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac159270 con 0x7f62ac158bc0 2023-08-10T10:38:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.460+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac159830 con 0x7f62ac158bc0 2023-08-10T10:38:31.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.462+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8040550 con 0x7f62ac158bc0 2023-08-10T10:38:31.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.462+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8040900 con 0x7f62ac158bc0 2023-08-10T10:38:31.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.464+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62a80363f0 con 0x7f62ac158bc0 2023-08-10T10:38:31.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.465+0000 7f62a2ffd640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 0x7f629006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.465+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62a80ab3e0 con 0x7f62ac158bc0 2023-08-10T10:38:31.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.466+0000 7f62b2088640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 0x7f629006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.466+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6294005250 con 0x7f62ac158bc0 2023-08-10T10:38:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.469+0000 7f62b2088640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 0x7f629006d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f629c005880 tx=0x7f629c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.474+0000 7fd23b59e640 1 Processor -- start 2023-08-10T10:38:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f62a80766b0 con 0x7f62ac158bc0 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.475+0000 7fd23b59e640 1 -- start start 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7fd23b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7fd23b59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c8b80 0x7fd23c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7fd23b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c06b9f0 con 0x7fd23c0ad8f0 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7fd23b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c06ade0 con 0x7fd23c15c200 2023-08-10T10:38:31.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.477+0000 7fd23b59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c06b0c0 con 0x7fd23c0c8b80 2023-08-10T10:38:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.478+0000 7fd23a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.478+0000 7fd23a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33652/0 (socket says 172.21.15.50:33652) 2023-08-10T10:38:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.478+0000 7fd23a59c640 1 -- 172.21.15.50:0/1527529905 learned_addr learned my addr 172.21.15.50:0/1527529905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.478+0000 7fd239d9b640 1 --2- 172.21.15.50:0/1527529905 >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c8b80 0x7fd23c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fd239d9b640 1 -- 172.21.15.50:0/1527529905 >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 msgr2=0x7fd23c06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fd239d9b640 1 --2- 172.21.15.50:0/1527529905 >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fd239d9b640 1 -- 172.21.15.50:0/1527529905 >> v1:172.21.15.50:6789/0 conn(0x7fd23c0ad8f0 legacy=0x7fd23c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fed5082c640 1 Processor -- start 2023-08-10T10:38:31.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fd239d9b640 1 -- 172.21.15.50:0/1527529905 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c06b3a0 con 0x7fd23c0c8b80 2023-08-10T10:38:31.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.479+0000 7fd23a59c640 1 --2- 172.21.15.50:0/1527529905 >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:31.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.480+0000 7fed5082c640 1 -- start start 2023-08-10T10:38:31.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.481+0000 7fd239d9b640 1 --2- 172.21.15.50:0/1527529905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c8b80 0x7fd23c06c7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0c1c40 tx=0x7fd22c02fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7a7e3c8804863c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fd23959a640 1 -- 172.21.15.50:0/1527529905 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0307f0 con 0x7fd23c0c8b80 2023-08-10T10:38:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fd23959a640 1 -- 172.21.15.50:0/1527529905 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c030950 con 0x7fd23c0c8b80 2023-08-10T10:38:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fd23959a640 1 -- 172.21.15.50:0/1527529905 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c030ce0 con 0x7fd23c0c8b80 2023-08-10T10:38:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fed5082c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed4c15c200 0x7fed4c06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fed5082c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed4c0c8b80 0x7fed4c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fd23b59e640 1 -- 172.21.15.50:0/1527529905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c8b80 msgr2=0x7fd23c06c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fd23b59e640 1 --2- 172.21.15.50:0/1527529905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c8b80 0x7fd23c06c7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0c1c40 tx=0x7fd22c02fc50 comp rx=0 tx=0).stop 2023-08-10T10:38:31.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.482+0000 7fed5082c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0ad8f0 0x7fed4c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed4b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed4c15c200 0x7fed4c06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed4b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed4c15c200 0x7fed4c06c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33656/0 (socket says 172.21.15.50:33656) 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed4b7fe640 1 -- 172.21.15.50:0/1603883501 learned_addr learned my addr 172.21.15.50:0/1603883501 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed4affd640 1 --2- 172.21.15.50:0/1603883501 >> v2:172.21.15.117:3300/0 conn(0x7fed4c0c8b80 0x7fed4c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed4bfff640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0ad8f0 0x7fed4c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c06b9f0 con 0x7fed4c15c200 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.483+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c06ade0 con 0x7fed4c0c8b80 2023-08-10T10:38:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.484+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c06b0c0 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.484+0000 7f421c099640 1 Processor -- start 2023-08-10T10:38:31.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7fed4b7fe640 1 -- 172.21.15.50:0/1603883501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0ad8f0 msgr2=0x7fed4c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0ad8f0 0x7fed4c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7fed4b7fe640 1 -- 172.21.15.50:0/1603883501 >> v2:172.21.15.117:3300/0 conn(0x7fed4c0c8b80 msgr2=0x7fed4c06c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/1603883501 >> v2:172.21.15.117:3300/0 conn(0x7fed4c0c8b80 0x7fed4c06c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7fed4b7fe640 1 -- 172.21.15.50:0/1603883501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c06b3a0 con 0x7fed4c15c200 2023-08-10T10:38:31.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.485+0000 7f421c099640 1 -- start start 2023-08-10T10:38:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.486+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c15c200 0x7fed4c06c260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0c1c40 tx=0x7fed4002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeeb4828f5fa48f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7fed4a7fc640 1 -- 172.21.15.50:0/1603883501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40007ce0 con 0x7fed4c15c200 2023-08-10T10:38:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7fed4a7fc640 1 -- 172.21.15.50:0/1603883501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed40007e40 con 0x7fed4c15c200 2023-08-10T10:38:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7fed4a7fc640 1 -- 172.21.15.50:0/1603883501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400092f0 con 0x7fed4c15c200 2023-08-10T10:38:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7f421c099640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 0x7f42140c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7f421c099640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42140cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7f421c099640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4214158fa0 con 0x7f421406b4f0 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7f421c099640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42140c9d90 con 0x7f4214158bc0 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.487+0000 7f421c099640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42140c9180 con 0x7f421406c970 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.488+0000 7f4219634640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f421406b4f0 0x7f421406c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44638/0 (socket says 172.21.15.50:44638) 2023-08-10T10:38:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.488+0000 7f4219634640 1 -- 172.21.15.50:0/832474078 learned_addr learned my addr 172.21.15.50:0/832474078 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:31.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.488+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c15c200 msgr2=0x7fed4c06c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.488+0000 7fed5082c640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c15c200 0x7fed4c06c260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0c1c40 tx=0x7fed4002b870 comp rx=0 tx=0).stop 2023-08-10T10:38:31.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.488+0000 7f421a636640 1 --2- 172.21.15.50:0/832474078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42140cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f4219e35640 1 --2- 172.21.15.50:0/832474078 >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 0x7f42140c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 shutdown_connections 2023-08-10T10:38:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0ad8f0 0x7fed4c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 --2- 172.21.15.50:0/1603883501 >> v2:172.21.15.117:3300/0 conn(0x7fed4c0c8b80 0x7fed4c06c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 --2- 172.21.15.50:0/1603883501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c15c200 0x7fed4c06c260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 >> 172.21.15.50:0/1603883501 conn(0x7fed4c0ce530 msgr2=0x7fed4c0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f4218e33640 1 -- 172.21.15.50:0/832474078 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934221093 0 0) 0x7f4204004900 con 0x7f421406b4f0 2023-08-10T10:38:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f4218e33640 1 -- 172.21.15.50:0/832474078 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4200005730 con 0x7f421406b4f0 2023-08-10T10:38:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 shutdown_connections 2023-08-10T10:38:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f421a636640 1 -- 172.21.15.50:0/832474078 >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 msgr2=0x7f42140c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f421a636640 1 --2- 172.21.15.50:0/832474078 >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 0x7f42140c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f421a636640 1 -- 172.21.15.50:0/832474078 >> v1:172.21.15.117:6789/0 conn(0x7f421406b4f0 legacy=0x7f421406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7f421a636640 1 -- 172.21.15.50:0/832474078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140c9460 con 0x7f421406c970 2023-08-10T10:38:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7f4219e35640 1 --2- 172.21.15.50:0/832474078 >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 0x7f42140c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7fd23b59e640 1 -- 172.21.15.50:0/1527529905 shutdown_connections 2023-08-10T10:38:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7fd23b59e640 1 --2- 172.21.15.50:0/1527529905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c8b80 0x7fd23c06c7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7fd23b59e640 1 --2- 172.21.15.50:0/1527529905 >> v2:172.21.15.50:3300/0 conn(0x7fd23c15c200 0x7fd23c06c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7fd23b59e640 1 -- 172.21.15.50:0/1527529905 >> 172.21.15.50:0/1527529905 conn(0x7fd23c0ce530 msgr2=0x7fd23c0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.489+0000 7fed5082c640 1 -- 172.21.15.50:0/1603883501 wait complete. 2023-08-10T10:38:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.491+0000 7f421a636640 1 --2- 172.21.15.50:0/832474078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42140cc750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17096bd07ae8cc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7fd23b59e640 1 -- 172.21.15.50:0/1527529905 shutdown_connections 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7fed5082c640 1 Processor -- start 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7fed5082c640 1 -- start start 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7f4218e33640 1 -- 172.21.15.50:0/832474078 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c02d8b0 con 0x7f421406c970 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7f4218e33640 1 -- 172.21.15.50:0/832474078 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c02da10 con 0x7f421406c970 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7f4218e33640 1 -- 172.21.15.50:0/832474078 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c02dd80 con 0x7f421406c970 2023-08-10T10:38:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.493+0000 7f421c099640 1 -- 172.21.15.50:0/832474078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 msgr2=0x7f42140cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.493+0000 7f421c099640 1 --2- 172.21.15.50:0/832474078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42140cc750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02baf0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.493+0000 7fed5082c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.493+0000 7f421c099640 1 -- 172.21.15.50:0/832474078 shutdown_connections 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7f421c099640 1 --2- 172.21.15.50:0/832474078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42140cc750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7f421c099640 1 --2- 172.21.15.50:0/832474078 >> v2:172.21.15.50:3300/0 conn(0x7f4214158bc0 0x7f42140c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7f421c099640 1 -- 172.21.15.50:0/832474078 >> 172.21.15.50:0/832474078 conn(0x7f42140ce4e0 msgr2=0x7f42140ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7f421c099640 1 -- 172.21.15.50:0/832474078 shutdown_connections 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.492+0000 7fd23b59e640 1 -- 172.21.15.50:0/1527529905 wait complete. 2023-08-10T10:38:31.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7fd23b59e640 1 Processor -- start 2023-08-10T10:38:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7fed4b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7fed4b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33672/0 (socket says 172.21.15.50:33672) 2023-08-10T10:38:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7fed4b7fe640 1 -- 172.21.15.50:0/2077088263 learned_addr learned my addr 172.21.15.50:0/2077088263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.495+0000 7fd23b59e640 1 -- start start 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.496+0000 7fd23b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 0x7fd23c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.495+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c0c8b80 0x7fed4c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.495+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c15c200 0x7fed4c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.495+0000 7fed4affd640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c0c8b80 0x7fed4c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.495+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c06e970 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.496+0000 7fed4bfff640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c15c200 0x7fed4c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.496+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c06ec50 con 0x7fed4c0c8b80 2023-08-10T10:38:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.496+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1480b0 con 0x7fed4c15c200 2023-08-10T10:38:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.494+0000 7f421c099640 1 -- 172.21.15.50:0/832474078 wait complete. 2023-08-10T10:38:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7f421c099640 1 Processor -- start 2023-08-10T10:38:31.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c8b80 0x7fd23c06f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 0x7fd23c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1fb180 con 0x7fd23c15c200 2023-08-10T10:38:31.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c06e960 con 0x7fd23c0ad8f0 2023-08-10T10:38:31.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c06ec40 con 0x7fd23c0c8b80 2023-08-10T10:38:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fed4b7fe640 1 -- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c15c200 msgr2=0x7fed4c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c15c200 0x7fed4c0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fed4b7fe640 1 -- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c0c8b80 msgr2=0x7fed4c147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c0c8b80 0x7fed4c147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fed4b7fe640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40009df0 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd239d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c8b80 0x7fd23c06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7fd23a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 0x7fd23c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 0x7fd23c156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42492/0 (socket says 172.21.15.50:42492) 2023-08-10T10:38:31.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23a59c640 1 -- 172.21.15.50:0/3213583794 learned_addr learned my addr 172.21.15.50:0/3213583794 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 0x7fd23c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fed4b7fe640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed400072c0 tx=0x7fed40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 -- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c8b80 msgr2=0x7fd23c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c8b80 0x7fd23c06f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 -- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 msgr2=0x7fd23c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 0x7fd23c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fd23ad9d640 1 -- 172.21.15.50:0/3213583794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234007790 con 0x7fd23c15c200 2023-08-10T10:38:31.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4003c850 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4003c9b0 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4003cd40 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0c47a0 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.497+0000 7f421c099640 1 -- start start 2023-08-10T10:38:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.498+0000 7f421c099640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7fd23ad9d640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 0x7fd23c0c4070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c3c0 tx=0x7fd23000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0c4d60 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7f4219e35640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7f4219e35640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33696/0 (socket says 172.21.15.50:33696) 2023-08-10T10:38:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7f421c099640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42141547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.499+0000 7f4219e35640 1 -- 172.21.15.50:0/2990524078 learned_addr learned my addr 172.21.15.50:0/2990524078 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4214158bc0 0x7f42140ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421415afc0 con 0x7f421406b4f0 2023-08-10T10:38:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421414fd20 con 0x7f4214158bc0 2023-08-10T10:38:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4214154d00 con 0x7f421406c970 2023-08-10T10:38:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0612b0 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300052d0 con 0x7fd23c15c200 2023-08-10T10:38:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230005430 con 0x7fd23c15c200 2023-08-10T10:38:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230007260 con 0x7fd23c15c200 2023-08-10T10:38:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c00d8a0 con 0x7fd23c15c200 2023-08-10T10:38:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c06f200 con 0x7fd23c15c200 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f4219e35640 1 -- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 msgr2=0x7f42141547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f4219634640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42141547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f421a636640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4214158bc0 0x7f42140ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f4219e35640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42141547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f4219e35640 1 -- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4214158bc0 msgr2=0x7f42140ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.500+0000 7f4219e35640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4214158bc0 0x7f42140ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7f4219e35640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009400 con 0x7f421406b4f0 2023-08-10T10:38:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.501+0000 7f4219e35640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f421000cf60 tx=0x7f421000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.504+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c06f3f0 con 0x7fd23c15c200 2023-08-10T10:38:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.504+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000d840 con 0x7f421406b4f0 2023-08-10T10:38:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.504+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000d9a0 con 0x7f421406b4f0 2023-08-10T10:38:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.504+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000dd30 con 0x7f421406b4f0 2023-08-10T10:38:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.503+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed40030070 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.505+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421415a3b0 con 0x7f421406b4f0 2023-08-10T10:38:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.505+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421415a970 con 0x7f421406b4f0 2023-08-10T10:38:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.505+0000 7fed33fff640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 0x7fed3806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.505+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed400ab360 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.506+0000 7fed4affd640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 0x7fed3806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.507+0000 7fed4affd640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 0x7fed3806d1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed4c070c40 tx=0x7fed3c00a660 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.507+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42140612b0 con 0x7f421406b4f0 2023-08-10T10:38:31.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.506+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2300073c0 con 0x7fd23c15c200 2023-08-10T10:38:31.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.508+0000 7fd22affd640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 0x7fd21c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.508+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd230088640 con 0x7fd23c15c200 2023-08-10T10:38:31.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.508+0000 7fd23a59c640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 0x7fd21c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.509+0000 7fd23a59c640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 0x7fd21c06d1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd234003aa0 tx=0x7fd23400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.515+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed40076530 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.516+0000 7f51b3179640 1 Processor -- start 2023-08-10T10:38:31.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.516+0000 7f51b3179640 1 -- start start 2023-08-10T10:38:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.518+0000 7f51b3179640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51ac15ce00 0x7f51ac0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.519+0000 7f51b3179640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0d1220 con 0x7f51ac0cd730 2023-08-10T10:38:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.519+0000 7f51b3179640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b8a30 con 0x7f51ac0b5af0 2023-08-10T10:38:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.519+0000 7f51b3179640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0d2930 con 0x7f51ac15ce00 2023-08-10T10:38:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.518+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4210015440 con 0x7f421406b4f0 2023-08-10T10:38:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.519+0000 7f420a7fc640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 0x7f420006d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f51b1716640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f51ac0b5af0 0x7f51ac0d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44642/0 (socket says 172.21.15.50:44642) 2023-08-10T10:38:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f51b1716640 1 -- 172.21.15.50:0/394063042 learned_addr learned my addr 172.21.15.50:0/394063042 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.517+0000 7f0622657640 1 Processor -- start 2023-08-10T10:38:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.517+0000 7f0622657640 1 -- start start 2023-08-10T10:38:31.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.519+0000 7f0622657640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0614049050 0x7f0614053ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f0622657640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06140494c0 con 0x7f0614006a30 2023-08-10T10:38:31.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f0622657640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0614052380 con 0x7f0614048bd0 2023-08-10T10:38:31.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f0622657640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140e7a70 con 0x7f0614049050 2023-08-10T10:38:31.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f51abfff640 1 --2- 172.21.15.50:0/394063042 >> v2:172.21.15.50:3300/0 conn(0x7f51ac15ce00 0x7f51ac0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f4219634640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 0x7f420006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f51ab7fe640 1 -- 172.21.15.50:0/394063042 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724923711 0 0) 0x7f51ac0b8a30 con 0x7f51ac0b5af0 2023-08-10T10:38:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f51ab7fe640 1 -- 172.21.15.50:0/394063042 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5194003520 con 0x7f51ac0b5af0 2023-08-10T10:38:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f51abfff640 1 -- 172.21.15.50:0/394063042 >> v1:172.21.15.117:6789/0 conn(0x7f51ac0b5af0 legacy=0x7f51ac0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f51abfff640 1 -- 172.21.15.50:0/394063042 >> v1:172.21.15.50:6789/0 conn(0x7f51ac0cd730 legacy=0x7f51ac0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f51abfff640 1 -- 172.21.15.50:0/394063042 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0b1e70 con 0x7f51ac15ce00 2023-08-10T10:38:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f061b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0614048bd0 0x7f06140537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44650/0 (socket says 172.21.15.50:44650) 2023-08-10T10:38:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.522+0000 7f4219634640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 0x7f420006d610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42140c2610 tx=0x7f4204005bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.520+0000 7f061b7fe640 1 -- 172.21.15.50:0/2467252213 learned_addr learned my addr 172.21.15.50:0/2467252213 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:31.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f0620bf4640 1 --2- 172.21.15.50:0/2467252213 >> v2:172.21.15.117:3300/0 conn(0x7f0614049050 0x7f0614053ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f0620bf4640 1 -- 172.21.15.50:0/2467252213 >> v1:172.21.15.117:6789/0 conn(0x7f0614048bd0 legacy=0x7f06140537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.521+0000 7f0620bf4640 1 -- 172.21.15.50:0/2467252213 >> v1:172.21.15.50:6789/0 conn(0x7f0614006a30 legacy=0x7f0614006e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:38:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.522+0000 7f0620bf4640 1 -- 172.21.15.50:0/2467252213 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140506a0 con 0x7f0614049050 2023-08-10T10:38:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.523+0000 7f51abfff640 1 --2- 172.21.15.50:0/394063042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac15ce00 0x7f51ac0d23f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f519c0097a0 tx=0x7f519c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df25ea3ee7d76898 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.523+0000 7f0620bf4640 1 --2- 172.21.15.50:0/2467252213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f0614053ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f061c000b60 tx=0x7f061c0a5610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9f0ddf0818a29 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.523+0000 7f061affd640 1 -- 172.21.15.50:0/2467252213 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0aa7d0 con 0x7f0614049050 2023-08-10T10:38:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.524+0000 7f061affd640 1 -- 172.21.15.50:0/2467252213 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0a8050 con 0x7f0614049050 2023-08-10T10:38:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.524+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f421005d4b0 con 0x7f421406b4f0 2023-08-10T10:38:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.524+0000 7f061affd640 1 -- 172.21.15.50:0/2467252213 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0aac50 con 0x7f0614049050 2023-08-10T10:38:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f51ab7fe640 1 -- 172.21.15.50:0/394063042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c031830 con 0x7f51ac15ce00 2023-08-10T10:38:31.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd230053810 con 0x7fd23c15c200 2023-08-10T10:38:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f0622657640 1 -- 172.21.15.50:0/2467252213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 msgr2=0x7f0614053ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f0622657640 1 --2- 172.21.15.50:0/2467252213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f0614053ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f061c000b60 tx=0x7f061c0a5610 comp rx=0 tx=0).stop 2023-08-10T10:38:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f0622657640 1 -- 172.21.15.50:0/2467252213 shutdown_connections 2023-08-10T10:38:31.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f0622657640 1 --2- 172.21.15.50:0/2467252213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f0614053ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.525+0000 7f0622657640 1 -- 172.21.15.50:0/2467252213 >> 172.21.15.50:0/2467252213 conn(0x7f0614055c10 msgr2=0x7f0614056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.526+0000 7f0622657640 1 -- 172.21.15.50:0/2467252213 shutdown_connections 2023-08-10T10:38:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.526+0000 7f0622657640 1 -- 172.21.15.50:0/2467252213 wait complete. 2023-08-10T10:38:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.529+0000 7f0622657640 1 Processor -- start 2023-08-10T10:38:31.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.529+0000 7f0622657640 1 -- start start 2023-08-10T10:38:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.530+0000 7f0622657640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 0x7f06140d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.530+0000 7f0622657640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.530+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f42100558e0 con 0x7f421406b4f0 2023-08-10T10:38:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f0622657640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f06140d69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f51ab7fe640 1 -- 172.21.15.50:0/394063042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c031990 con 0x7f51ac15ce00 2023-08-10T10:38:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f51ab7fe640 1 -- 172.21.15.50:0/394063042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c031d00 con 0x7f51ac15ce00 2023-08-10T10:38:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52564/0 (socket says 172.21.15.50:52564) 2023-08-10T10:38:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f061b7fe640 1 -- 172.21.15.50:0/2699243080 learned_addr learned my addr 172.21.15.50:0/2699243080 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140cc7c0 con 0x7f0614006a30 2023-08-10T10:38:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f51b3179640 1 -- 172.21.15.50:0/394063042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac15ce00 msgr2=0x7f51ac0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.531+0000 7f51b3179640 1 --2- 172.21.15.50:0/394063042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac15ce00 0x7f51ac0d23f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f519c0097a0 tx=0x7f519c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f0620bf4640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f06140d69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614038390 con 0x7f0614049050 2023-08-10T10:38:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0614037f00 con 0x7f0614048bd0 2023-08-10T10:38:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f51b3179640 1 -- 172.21.15.50:0/394063042 shutdown_connections 2023-08-10T10:38:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f51b3179640 1 --2- 172.21.15.50:0/394063042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac15ce00 0x7f51ac0d23f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f51b3179640 1 -- 172.21.15.50:0/394063042 >> 172.21.15.50:0/394063042 conn(0x7f51ac0d2c60 msgr2=0x7f51ac0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f51b3179640 1 -- 172.21.15.50:0/394063042 shutdown_connections 2023-08-10T10:38:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.533+0000 7f061b7fe640 1 -- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 msgr2=0x7f06140d69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.533+0000 7f061b7fe640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f06140d69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.533+0000 7f061b7fe640 1 -- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 msgr2=0x7f06140d2d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:38:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.533+0000 7f061bfff640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 0x7f06140d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.533+0000 7f061b7fe640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 0x7f06140d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.534+0000 7f061b7fe640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0676f0 con 0x7f0614048bd0 2023-08-10T10:38:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.534+0000 7f061bfff640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 0x7f06140d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.534+0000 7f061b7fe640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f061000c4d0 tx=0x7f061000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.532+0000 7f51b3179640 1 -- 172.21.15.50:0/394063042 wait complete. 2023-08-10T10:38:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.535+0000 7f51b3179640 1 Processor -- start 2023-08-10T10:38:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.536+0000 7f51b3179640 1 -- start start 2023-08-10T10:38:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.537+0000 7f51b3179640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.535+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610005ce0 con 0x7f0614048bd0 2023-08-10T10:38:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.535+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610005e40 con 0x7f0614048bd0 2023-08-10T10:38:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.535+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610007270 con 0x7f0614048bd0 2023-08-10T10:38:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.536+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06140d3250 con 0x7f0614048bd0 2023-08-10T10:38:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.537+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06140375d0 con 0x7f0614048bd0 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.538+0000 7f51b0f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.538+0000 7f51b0f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33730/0 (socket says 172.21.15.50:33730) 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.538+0000 7f51b3179640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51ac0cd730 0x7f51ac14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.538+0000 7f51b0f15640 1 -- 172.21.15.50:0/128762246 learned_addr learned my addr 172.21.15.50:0/128762246 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.539+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51ac15ce00 0x7f51ac0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.539+0000 7f51abfff640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51ac0cd730 0x7f51ac14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.539+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c93c0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.539+0000 7f51b1716640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51ac15ce00 0x7f51ac0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.540+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1fa030 con 0x7f51ac0cd730 2023-08-10T10:38:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.540+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1fa310 con 0x7f51ac15ce00 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f51b0f15640 1 -- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51ac15ce00 msgr2=0x7f51ac0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f51b0f15640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51ac15ce00 0x7f51ac0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f51b0f15640 1 -- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51ac0cd730 msgr2=0x7f51ac14ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f51b0f15640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51ac0cd730 0x7f51ac14ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f51b0f15640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009400 con 0x7f51ac0b5af0 2023-08-10T10:38:31.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.542+0000 7f51b0f15640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c410 tx=0x7f51a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a00035f0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac1fa5f0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac1f6500 con 0x7f51ac0b5af0 2023-08-10T10:38:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.541+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06100073d0 con 0x7f0614048bd0 2023-08-10T10:38:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f0618ff9640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 0x7f060006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06100889e0 con 0x7f0614048bd0 2023-08-10T10:38:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614009b20 con 0x7f0614048bd0 2023-08-10T10:38:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.543+0000 7f061bfff640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 0x7f060006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.545+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac04e270 con 0x7f51ac0b5af0 2023-08-10T10:38:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.545+0000 7f061bfff640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 0x7f060006d1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f061404fa10 tx=0x7f0608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.545+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0003750 con 0x7f51ac0b5af0 2023-08-10T10:38:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.545+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0003b40 con 0x7f51ac0b5af0 2023-08-10T10:38:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.547+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51a001b3b0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.548+0000 7f51a97fa640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 0x7f519806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.549+0000 7f51abfff640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 0x7f519806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.551+0000 7f51abfff640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 0x7f519806d160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f519c036000 tx=0x7f519c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.551+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51a0088ab0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.556+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51a0053c80 con 0x7f51ac0b5af0 2023-08-10T10:38:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.558+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0610017080 con 0x7f0614048bd0 2023-08-10T10:38:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.561+0000 7f303f59e640 1 Processor -- start 2023-08-10T10:38:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f6b76e7c640 1 Processor -- start 2023-08-10T10:38:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.561+0000 7f303f59e640 1 -- start start 2023-08-10T10:38:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f6b76e7c640 1 -- start start 2023-08-10T10:38:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f6b76e7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b7015a620 0x7f6b700ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f6b76e7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 0x7f6b700d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f6b76e7c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700cd460 con 0x7f6b7015d8e0 2023-08-10T10:38:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f6b76e7c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70160dd0 con 0x7f6b7015a620 2023-08-10T10:38:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f6b76e7c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70160430 con 0x7f6b700cf6d0 2023-08-10T10:38:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30380df500 0x7f3038007580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f3038054260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f303804fc70 0x7f3038050100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3038050640 con 0x7f30380df500 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30380df8e0 con 0x7f303804fc70 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.563+0000 7f303f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30380064e0 con 0x7f3038005fe0 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.564+0000 7f303e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30380df500 0x7f3038007580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30380df500 0x7f3038007580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33746/0 (socket says 172.21.15.50:33746) 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 -- 172.21.15.50:0/3091893211 learned_addr learned my addr 172.21.15.50:0/3091893211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303ed9d640 1 --2- 172.21.15.50:0/3091893211 >> v2:172.21.15.117:3300/0 conn(0x7f303804fc70 0x7f3038050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 -- 172.21.15.50:0/3091893211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 msgr2=0x7f3038054260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:38:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 --2- 172.21.15.50:0/3091893211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f3038054260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 -- 172.21.15.50:0/3091893211 >> v2:172.21.15.117:3300/0 conn(0x7f303804fc70 msgr2=0x7f3038050100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 --2- 172.21.15.50:0/3091893211 >> v2:172.21.15.117:3300/0 conn(0x7f303804fc70 0x7f3038050100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.565+0000 7f303e59c640 1 -- 172.21.15.50:0/3091893211 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380067c0 con 0x7f30380df500 2023-08-10T10:38:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.567+0000 7f303e59c640 1 --2- 172.21.15.50:0/3091893211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30380df500 0x7f3038007580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3038055cc0 tx=0x7f303002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710f9913a9d8f65a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.568+0000 7f6b6ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6b7015d8e0 0x7f6b700cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:44652/0 (socket says 172.21.15.50:44652) 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.568+0000 7f6b6ffff640 1 -- 172.21.15.50:0/117749357 learned_addr learned my addr 172.21.15.50:0/117749357 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.568+0000 7f6b75419640 1 --2- 172.21.15.50:0/117749357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 0x7f6b700d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.568+0000 7f6b74c18640 1 --2- 172.21.15.50:0/117749357 >> v2:172.21.15.50:3300/0 conn(0x7f6b7015a620 0x7f6b700ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b6f7fe640 1 -- 172.21.15.50:0/117749357 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656125530 0 0) 0x7f6b700cd460 con 0x7f6b7015d8e0 2023-08-10T10:38:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b6f7fe640 1 -- 172.21.15.50:0/117749357 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b58003520 con 0x7f6b7015d8e0 2023-08-10T10:38:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b75419640 1 -- 172.21.15.50:0/117749357 >> v2:172.21.15.50:3300/0 conn(0x7f6b7015a620 msgr2=0x7f6b700ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b75419640 1 --2- 172.21.15.50:0/117749357 >> v2:172.21.15.50:3300/0 conn(0x7f6b7015a620 0x7f6b700ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b75419640 1 -- 172.21.15.50:0/117749357 >> v1:172.21.15.117:6789/0 conn(0x7f6b7015d8e0 legacy=0x7f6b700cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.569+0000 7f6b75419640 1 -- 172.21.15.50:0/117749357 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70160710 con 0x7f6b700cf6d0 2023-08-10T10:38:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.571+0000 7f303d59a640 1 -- 172.21.15.50:0/3091893211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030030890 con 0x7f30380df500 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.571+0000 7f303d59a640 1 -- 172.21.15.50:0/3091893211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30300309f0 con 0x7f30380df500 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.571+0000 7f303d59a640 1 -- 172.21.15.50:0/3091893211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030030dc0 con 0x7f30380df500 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 -- 172.21.15.50:0/3091893211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30380df500 msgr2=0x7f3038007580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 --2- 172.21.15.50:0/3091893211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30380df500 0x7f3038007580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3038055cc0 tx=0x7f303002b9d0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 -- 172.21.15.50:0/3091893211 shutdown_connections 2023-08-10T10:38:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 --2- 172.21.15.50:0/3091893211 >> v2:172.21.15.117:3300/0 conn(0x7f303804fc70 0x7f3038050100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 --2- 172.21.15.50:0/3091893211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f3038054260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 --2- 172.21.15.50:0/3091893211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30380df500 0x7f3038007580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 -- 172.21.15.50:0/3091893211 >> 172.21.15.50:0/3091893211 conn(0x7f3038054c10 msgr2=0x7f3038055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.572+0000 7f303f59e640 1 -- 172.21.15.50:0/3091893211 shutdown_connections 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.573+0000 7f6b75419640 1 --2- 172.21.15.50:0/117749357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 0x7f6b700d06e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002530 tx=0x7f6b6802c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c5fc410553eca4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.573+0000 7f6b6f7fe640 1 -- 172.21.15.50:0/117749357 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68031710 con 0x7f6b700cf6d0 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.573+0000 7f6b6f7fe640 1 -- 172.21.15.50:0/117749357 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6802f050 con 0x7f6b700cf6d0 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.573+0000 7f6b6f7fe640 1 -- 172.21.15.50:0/117749357 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68031a90 con 0x7f6b700cf6d0 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.574+0000 7f6b76e7c640 1 -- 172.21.15.50:0/117749357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 msgr2=0x7f6b700d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.574+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/117749357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 0x7f6b700d06e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002530 tx=0x7f6b6802c460 comp rx=0 tx=0).stop 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 -- 172.21.15.50:0/117749357 shutdown_connections 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/117749357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b700cf6d0 0x7f6b700d06e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/117749357 >> v2:172.21.15.50:3300/0 conn(0x7f6b7015a620 0x7f6b700ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 -- 172.21.15.50:0/117749357 >> 172.21.15.50:0/117749357 conn(0x7f6b7006fcc0 msgr2=0x7f6b700700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 -- 172.21.15.50:0/117749357 shutdown_connections 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.573+0000 7f303f59e640 1 -- 172.21.15.50:0/3091893211 wait complete. 2023-08-10T10:38:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f303f59e640 1 Processor -- start 2023-08-10T10:38:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.576+0000 7f303f59e640 1 -- start start 2023-08-10T10:38:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.577+0000 7f303f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 0x7f303804efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30380df500 0x7f303804c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.575+0000 7f6b76e7c640 1 -- 172.21.15.50:0/117749357 wait complete. 2023-08-10T10:38:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303804cc30 con 0x7f303804fc70 2023-08-10T10:38:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303804d9c0 con 0x7f30380df500 2023-08-10T10:38:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303804ce40 con 0x7f3038005fe0 2023-08-10T10:38:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f6b76e7c640 1 Processor -- start 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:52584/0 (socket says 172.21.15.50:52584) 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f303e59c640 1 -- 172.21.15.50:0/1242603436 learned_addr learned my addr 172.21.15.50:0/1242603436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.579+0000 7f303ed9d640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30380df500 0x7f303804c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.579+0000 7f303e59c640 1 -- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30380df500 msgr2=0x7f303804c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.579+0000 7f303e59c640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30380df500 0x7f303804c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.579+0000 7f303e59c640 1 -- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 msgr2=0x7f303804efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.579+0000 7f303dd9b640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 0x7f303804efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f303e59c640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 0x7f303804efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f303e59c640 1 -- 172.21.15.50:0/1242603436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300094d0 con 0x7f3038005fe0 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f303dd9b640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 0x7f303804efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.578+0000 7f6b76e7c640 1 -- start start 2023-08-10T10:38:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f6b76e7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 0x7f6b701575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f303e59c640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3030009960 tx=0x7f3030004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f6b76e7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.580+0000 7f6b76e7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b7015d8e0 0x7f6b700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b76e7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700ca210 con 0x7f6b700cf6d0 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42552/0 (socket says 172.21.15.50:42552) 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b6ffff640 1 -- 172.21.15.50:0/72574407 learned_addr learned my addr 172.21.15.50:0/72574407 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b75419640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b7015d8e0 0x7f6b700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b74c18640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 0x7f6b701575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700caca0 con 0x7f6b7015a620 2023-08-10T10:38:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.581+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030039c90 con 0x7f3038005fe0 2023-08-10T10:38:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.582+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303804d120 con 0x7f3038005fe0 2023-08-10T10:38:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.582+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030039df0 con 0x7f3038005fe0 2023-08-10T10:38:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.582+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030043600 con 0x7f3038005fe0 2023-08-10T10:38:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.582+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b2770 con 0x7f6b7015d8e0 2023-08-10T10:38:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.582+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303804d6e0 con 0x7f3038005fe0 2023-08-10T10:38:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b74c18640 1 -- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b7015d8e0 msgr2=0x7f6b700cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b74c18640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b7015d8e0 0x7f6b700cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b74c18640 1 -- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 msgr2=0x7f6b700c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b74c18640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b74c18640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009970 con 0x7f6b700cf6d0 2023-08-10T10:38:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f6b6ffff640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b74c18640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 0x7f6b701575f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000e850 tx=0x7f6b6000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.583+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3038050d70 con 0x7f3038005fe0 2023-08-10T10:38:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600095b0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000c940 con 0x7f6b700cf6d0 2023-08-10T10:38:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000ccd0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b700c64e0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.584+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700ca6e0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.589+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b60013470 con 0x7f6b700cf6d0 2023-08-10T10:38:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.586+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3030043760 con 0x7f3038005fe0 2023-08-10T10:38:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.587+0000 7f302effd640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 0x7f302006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.587+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f303003e070 con 0x7f3038005fe0 2023-08-10T10:38:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.588+0000 7f303dd9b640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 0x7f302006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.590+0000 7f303dd9b640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 0x7f302006d1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f303804f990 tx=0x7f3034008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.590+0000 7f6b6d7fa640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 0x7f6b5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.590+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b700c62b0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.590+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b600894a0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.591+0000 7f6b6ffff640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 0x7f6b5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.592+0000 7f6b6ffff640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 0x7f6b5c06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b700ccb50 tx=0x7f6b64007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.599+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3030077b70 con 0x7f3038005fe0 2023-08-10T10:38:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.601+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b700c62b0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.883+0000 7f62b42ec640 1 -- 172.21.15.50:0/692431595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6294005500 con 0x7f62ac158bc0 2023-08-10T10:38:31.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.884+0000 7f62a2ffd640 1 -- 172.21.15.50:0/692431595 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62a8045070 con 0x7f62ac158bc0 2023-08-10T10:38:31.887 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.888+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 msgr2=0x7f629006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.888+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 0x7f629006d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f629c005880 tx=0x7f629c009040 comp rx=0 tx=0).stop 2023-08-10T10:38:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.888+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 msgr2=0x7f62ac1e12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.888+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 0x7f62ac1e12b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f62a8034000 tx=0x7f62a80046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 shutdown_connections 2023-08-10T10:38:31.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ac158bc0 0x7f62ac1e12b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f629006ad20 0x7f629006d1e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62ac0c8b30 0x7f62ac1fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 --2- 172.21.15.50:0/692431595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62ac06c970 0x7f62ac157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.889+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 >> 172.21.15.50:0/692431595 conn(0x7f62ac0ce4e0 msgr2=0x7f62ac0ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.890+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 shutdown_connections 2023-08-10T10:38:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.890+0000 7f62a0ff9640 1 -- 172.21.15.50:0/692431595 wait complete. 2023-08-10T10:38:31.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-10T10:38:31.918 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:31.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.921+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fed4c071610 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.922+0000 7fed33fff640 1 -- 172.21.15.50:0/2077088263 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed40079b50 con 0x7fed4c0ad8f0 2023-08-10T10:38:31.923 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-08-10T10:38:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.925+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 msgr2=0x7fed3806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.925+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 0x7fed3806d1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed4c070c40 tx=0x7fed3c00a660 comp rx=0 tx=0).stop 2023-08-10T10:38:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.926+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 msgr2=0x7fed4c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.926+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed400072c0 tx=0x7fed40004730 comp rx=0 tx=0).stop 2023-08-10T10:38:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.926+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 shutdown_connections 2023-08-10T10:38:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.926+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c15c200 0x7fed4c0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.927+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3806ad20 0x7fed3806d1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.927+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c0c8b80 0x7fed4c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.927+0000 7fed5082c640 1 --2- 172.21.15.50:0/2077088263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c0ad8f0 0x7fed4c0c4180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.927+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 >> 172.21.15.50:0/2077088263 conn(0x7fed4c0ce530 msgr2=0x7fed4c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.927+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 shutdown_connections 2023-08-10T10:38:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.928+0000 7fed5082c640 1 -- 172.21.15.50:0/2077088263 wait complete. 2023-08-10T10:38:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.944+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0614005790 con 0x7f0614048bd0 2023-08-10T10:38:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.945+0000 7f0618ff9640 1 -- 172.21.15.50:0/2699243080 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0610053b20 con 0x7f0614048bd0 2023-08-10T10:38:31.947 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 msgr2=0x7f060006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 0x7f060006d1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f061404fa10 tx=0x7f0608008040 comp rx=0 tx=0).stop 2023-08-10T10:38:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 msgr2=0x7f061403af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f061000c4d0 tx=0x7f061000c990 comp rx=0 tx=0).stop 2023-08-10T10:38:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 shutdown_connections 2023-08-10T10:38:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f060006ad20 0x7f060006d1e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0614049050 0x7f06140d69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0614048bd0 0x7f061403af30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 --2- 172.21.15.50:0/2699243080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0614006a30 0x7f06140d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 >> 172.21.15.50:0/2699243080 conn(0x7f0614055c10 msgr2=0x7f0614055ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.948+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 shutdown_connections 2023-08-10T10:38:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.949+0000 7f0622657640 1 -- 172.21.15.50:0/2699243080 wait complete. 2023-08-10T10:38:31.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-08-10T10:38:31.956 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:31.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-08-10T10:38:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.966+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42140cc3c0 con 0x7f421406b4f0 2023-08-10T10:38:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.967+0000 7f420a7fc640 1 -- 172.21.15.50:0/2990524078 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4210024090 con 0x7f421406b4f0 2023-08-10T10:38:31.969 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:31.970 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.967+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd23c0612b0 con 0x7fd23c15c200 2023-08-10T10:38:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.968+0000 7fd22affd640 1 -- 172.21.15.50:0/3213583794 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd230056e30 con 0x7fd23c15c200 2023-08-10T10:38:31.971 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 msgr2=0x7f420006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 0x7f420006d610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42140c2610 tx=0x7f4204005bc0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 msgr2=0x7f421414f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f421000cf60 tx=0x7f421000cf90 comp rx=0 tx=0).stop 2023-08-10T10:38:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 shutdown_connections 2023-08-10T10:38:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420006b150 0x7f420006d610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4214158bc0 0x7f42140ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f421406c970 0x7f42141547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 --2- 172.21.15.50:0/2990524078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421406b4f0 0x7f421414f7e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.970+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 >> 172.21.15.50:0/2990524078 conn(0x7f42140ce4e0 msgr2=0x7f42140b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 shutdown_connections 2023-08-10T10:38:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7f421c099640 1 -- 172.21.15.50:0/2990524078 wait complete. 2023-08-10T10:38:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 msgr2=0x7fd21c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 0x7fd21c06d1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd234003aa0 tx=0x7fd23400d040 comp rx=0 tx=0).stop 2023-08-10T10:38:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 msgr2=0x7fd23c0c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.971+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 0x7fd23c0c4070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c3c0 tx=0x7fd23000c880 comp rx=0 tx=0).stop 2023-08-10T10:38:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 shutdown_connections 2023-08-10T10:38:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd23c15c200 0x7fd23c0c4070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c8b80 0x7fd23c06f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21c06ad20 0x7fd21c06d1e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 --2- 172.21.15.50:0/3213583794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0ad8f0 0x7fd23c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 >> 172.21.15.50:0/3213583794 conn(0x7fd23c0ce530 msgr2=0x7fd23c06c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 shutdown_connections 2023-08-10T10:38:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.972+0000 7fd23b59e640 1 -- 172.21.15.50:0/3213583794 wait complete. 2023-08-10T10:38:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.975+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51ac0d3140 con 0x7f51ac0b5af0 2023-08-10T10:38:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.975+0000 7f51a97fa640 1 -- 172.21.15.50:0/128762246 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51a00572a0 con 0x7f51ac0b5af0 2023-08-10T10:38:31.978 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.977+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 msgr2=0x7f519806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.977+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 0x7f519806d160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f519c036000 tx=0x7f519c03d040 comp rx=0 tx=0).stop 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.977+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 msgr2=0x7f51ac1f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.977+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c410 tx=0x7f51a000c8d0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 shutdown_connections 2023-08-10T10:38:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51ac15ce00 0x7f51ac0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f519806aca0 0x7f519806d160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51ac0cd730 0x7f51ac14ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 --2- 172.21.15.50:0/128762246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51ac0b5af0 0x7f51ac1f99e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 >> 172.21.15.50:0/128762246 conn(0x7f51ac0d2c60 msgr2=0x7f51ac15c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 shutdown_connections 2023-08-10T10:38:31.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.978+0000 7f51b3179640 1 -- 172.21.15.50:0/128762246 wait complete. 2023-08-10T10:38:31.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.979+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6b700c62b0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.980+0000 7f6b6d7fa640 1 -- 172.21.15.50:0/72574407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b700c62b0 con 0x7f6b700cf6d0 2023-08-10T10:38:31.982 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:31.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 msgr2=0x7f6b5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 0x7f6b5c06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b700ccb50 tx=0x7f6b64007d70 comp rx=0 tx=0).stop 2023-08-10T10:38:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 msgr2=0x7f6b701575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 0x7f6b701575f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000e850 tx=0x7f6b6000ed10 comp rx=0 tx=0).stop 2023-08-10T10:38:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 shutdown_connections 2023-08-10T10:38:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b7015d8e0 0x7f6b700cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6b5c06acd0 0x7f6b5c06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7015a620 0x7f6b700c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 --2- 172.21.15.50:0/72574407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cf6d0 0x7f6b701575f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 >> 172.21.15.50:0/72574407 conn(0x7f6b7006fcc0 msgr2=0x7f6b700b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 shutdown_connections 2023-08-10T10:38:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:31.982+0000 7f6b76e7c640 1 -- 172.21.15.50:0/72574407 wait complete. 2023-08-10T10:38:31.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-08-10T10:38:31.999 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:32.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-08-10T10:38:32.001 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:32.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-08-10T10:38:32.002 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:32.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-08-10T10:38:32.003 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.007+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3038006a70 con 0x7f3038005fe0 2023-08-10T10:38:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.008+0000 7f302effd640 1 -- 172.21.15.50:0/1242603436 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f303007b190 con 0x7f3038005fe0 2023-08-10T10:38:32.009 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2023-08-10T10:38:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 msgr2=0x7f302006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 0x7f302006d1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f303804f990 tx=0x7f3034008040 comp rx=0 tx=0).stop 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 msgr2=0x7f30380d29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3030009960 tx=0x7f3030004730 comp rx=0 tx=0).stop 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 shutdown_connections 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f302006ad20 0x7f302006d1e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30380df500 0x7f303804c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303804fc70 0x7f303804efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 --2- 172.21.15.50:0/1242603436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3038005fe0 0x7f30380d29b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 >> 172.21.15.50:0/1242603436 conn(0x7f3038054c10 msgr2=0x7f3038053fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 shutdown_connections 2023-08-10T10:38:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.010+0000 7f303f59e640 1 -- 172.21.15.50:0/1242603436 wait complete. 2023-08-10T10:38:32.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-08-10T10:38:32.028 DEBUG:teuthology.parallel:result is None 2023-08-10T10:38:32.028 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-10T10:38:32.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:38:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.291+0000 7f46f93eb640 1 Processor -- start 2023-08-10T10:38:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.291+0000 7f46f93eb640 1 -- start start 2023-08-10T10:38:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f93eb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46f4159000 0x7f46f40ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f93eb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 0x7f46f40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f93eb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f40cca30 con 0x7f46f40c8e90 2023-08-10T10:38:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f93eb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40ca180 con 0x7f46f4159000 2023-08-10T10:38:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f93eb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40cc100 con 0x7f46f40c9cf0 2023-08-10T10:38:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46f4159000 0x7f46f40ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46f4159000 0x7f46f40ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33790/0 (socket says 172.21.15.50:33790) 2023-08-10T10:38:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.292+0000 7f46f3fff640 1 -- 172.21.15.50:0/1689445479 learned_addr learned my addr 172.21.15.50:0/1689445479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f8bea640 1 --2- 172.21.15.50:0/1689445479 >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 0x7f46f40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f3fff640 1 -- 172.21.15.50:0/1689445479 >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 msgr2=0x7f46f40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f3fff640 1 --2- 172.21.15.50:0/1689445479 >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 0x7f46f40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f3fff640 1 -- 172.21.15.50:0/1689445479 >> v1:172.21.15.50:6789/0 conn(0x7f46f40c8e90 legacy=0x7f46f40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f2ffd640 1 -- 172.21.15.50:0/1689445479 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334572858 0 0) 0x7f46f40cca30 con 0x7f46f40c8e90 2023-08-10T10:38:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f3fff640 1 -- 172.21.15.50:0/1689445479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40cc3e0 con 0x7f46f4159000 2023-08-10T10:38:32.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.293+0000 7f46f8bea640 1 --2- 172.21.15.50:0/1689445479 >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 0x7f46f40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:32.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.294+0000 7f46f3fff640 1 --2- 172.21.15.50:0/1689445479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f4159000 0x7f46f40ad970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46f40cbd90 tx=0x7f46e402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c1f57f6cc6f3f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.294+0000 7f46f2ffd640 1 -- 172.21.15.50:0/1689445479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4031880 con 0x7f46f4159000 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.294+0000 7f46f2ffd640 1 -- 172.21.15.50:0/1689445479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40319e0 con 0x7f46f4159000 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.294+0000 7f46f2ffd640 1 -- 172.21.15.50:0/1689445479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4031d70 con 0x7f46f4159000 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 -- 172.21.15.50:0/1689445479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f4159000 msgr2=0x7f46f40ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 --2- 172.21.15.50:0/1689445479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f4159000 0x7f46f40ad970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46f40cbd90 tx=0x7f46e402b920 comp rx=0 tx=0).stop 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 -- 172.21.15.50:0/1689445479 shutdown_connections 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 --2- 172.21.15.50:0/1689445479 >> v2:172.21.15.117:3300/0 conn(0x7f46f40c9cf0 0x7f46f40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 --2- 172.21.15.50:0/1689445479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f4159000 0x7f46f40ad970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 -- 172.21.15.50:0/1689445479 >> 172.21.15.50:0/1689445479 conn(0x7f46f406ab80 msgr2=0x7f46f406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 -- 172.21.15.50:0/1689445479 shutdown_connections 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.295+0000 7f46f93eb640 1 -- 172.21.15.50:0/1689445479 wait complete. 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.297+0000 7f46f93eb640 1 Processor -- start 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.297+0000 7f46f93eb640 1 -- start start 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 0x7f46f40c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 0x7f46f414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40c3770 con 0x7f46f40c8e90 2023-08-10T10:38:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40c3a50 con 0x7f46f40adbd0 2023-08-10T10:38:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f93eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40c3d30 con 0x7f46f4159000 2023-08-10T10:38:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33794/0 (socket says 172.21.15.50:33794) 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 -- 172.21.15.50:0/2055368002 learned_addr learned my addr 172.21.15.50:0/2055368002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f37fe640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 0x7f46f40c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f8bea640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 0x7f46f414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 -- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 msgr2=0x7f46f40c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 0x7f46f40c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 -- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 msgr2=0x7f46f414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 0x7f46f414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f3fff640 1 -- 172.21.15.50:0/2055368002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40094d0 con 0x7f46f40c8e90 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f8bea640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 0x7f46f414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.298+0000 7f46f37fe640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 0x7f46f40c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f3fff640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4031850 con 0x7f46f40c8e90 2023-08-10T10:38:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40443f0 con 0x7f46f40c8e90 2023-08-10T10:38:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40447a0 con 0x7f46f40c8e90 2023-08-10T10:38:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f40c4010 con 0x7f46f40c8e90 2023-08-10T10:38:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.299+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f4150240 con 0x7f46f40c8e90 2023-08-10T10:38:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.300+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f40c3e70 con 0x7f46f40c8e90 2023-08-10T10:38:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.301+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46e40303d0 con 0x7f46f40c8e90 2023-08-10T10:38:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.302+0000 7f46f0ff9640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 0x7f46e006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.302+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46e40abeb0 con 0x7f46f40c8e90 2023-08-10T10:38:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.303+0000 7f46f37fe640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 0x7f46e006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.303+0000 7f46f37fe640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 0x7f46e006d0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46f40ad050 tx=0x7f46e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.306+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f46f40c3e70 con 0x7f46f40c8e90 2023-08-10T10:38:32.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.487+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46f40cc6c0 con 0x7f46e006ac20 2023-08-10T10:38:32.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.510+0000 7f46f0ff9640 1 -- 172.21.15.50:0/2055368002 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280617 (secure 0 0 0) 0x7f46e80013d0 con 0x7f46e006ac20 2023-08-10T10:38:32.515 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:32.516 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:38:32.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 msgr2=0x7f46e006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 0x7f46e006d0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46f40ad050 tx=0x7f46e8009040 comp rx=0 tx=0).stop 2023-08-10T10:38:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 msgr2=0x7f46f40ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e40046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 shutdown_connections 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46e006ac20 0x7f46e006d0e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46f40adbd0 0x7f46f414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46f4159000 0x7f46f40c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 --2- 172.21.15.50:0/2055368002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46f40c8e90 0x7f46f40ad690 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.515+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 >> 172.21.15.50:0/2055368002 conn(0x7f46f406ab80 msgr2=0x7f46f40b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.516+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 shutdown_connections 2023-08-10T10:38:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.516+0000 7f46f93eb640 1 -- 172.21.15.50:0/2055368002 wait complete. 2023-08-10T10:38:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-10T10:38:32.322575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003724"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533984+0000","last_change":"2023-08-10T10:38:22.209741+0000","last_active":"2023-08-10T10:38:23.533984+0000","last_peered":"2023-08-10T10:38:23.533984+0000","last_clean":"2023-08-10T10:38:23.533984+0000","last_became_active":"2023-08-10T10:38:22.209086+0000","last_became_peered":"2023-08-10T10:38:22.209086+0000","last_unstale":"2023-08-10T10:38:23.533984+0000","last_undegraded":"2023-08-10T10:38:23.533984+0000","last_fullsized":"2023-08-10T10:38:23.533984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:26.818785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202298+0000","last_change":"2023-08-10T10:38:22.224666+0000","last_active":"2023-08-10T10:38:23.202298+0000","last_peered":"2023-08-10T10:38:23.202298+0000","last_clean":"2023-08-10T10:38:23.202298+0000","last_became_active":"2023-08-10T10:38:22.224412+0000","last_became_peered":"2023-08-10T10:38:22.224412+0000","last_unstale":"2023-08-10T10:38:23.202298+0000","last_undegraded":"2023-08-10T10:38:23.202298+0000","last_fullsized":"2023-08-10T10:38:23.202298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201886+0000","last_change":"2023-08-10T10:38:22.220964+0000","last_active":"2023-08-10T10:38:23.201886+0000","last_peered":"2023-08-10T10:38:23.201886+0000","last_clean":"2023-08-10T10:38:23.201886+0000","last_became_active":"2023-08-10T10:38:22.220680+0000","last_became_peered":"2023-08-10T10:38:22.220680+0000","last_unstale":"2023-08-10T10:38:23.201886+0000","last_undegraded":"2023-08-10T10:38:23.201886+0000","last_fullsized":"2023-08-10T10:38:23.201886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325437+0000","last_change":"2023-08-10T10:38:22.220325+0000","last_active":"2023-08-10T10:38:23.325437+0000","last_peered":"2023-08-10T10:38:23.325437+0000","last_clean":"2023-08-10T10:38:23.325437+0000","last_became_active":"2023-08-10T10:38:22.219756+0000","last_became_peered":"2023-08-10T10:38:22.219756+0000","last_unstale":"2023-08-10T10:38:23.325437+0000","last_undegraded":"2023-08-10T10:38:23.325437+0000","last_fullsized":"2023-08-10T10:38:23.325437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324712+0000","last_change":"2023-08-10T10:38:22.218733+0000","last_active":"2023-08-10T10:38:23.324712+0000","last_peered":"2023-08-10T10:38:23.324712+0000","last_clean":"2023-08-10T10:38:23.324712+0000","last_became_active":"2023-08-10T10:38:22.218457+0000","last_became_peered":"2023-08-10T10:38:22.218457+0000","last_unstale":"2023-08-10T10:38:23.324712+0000","last_undegraded":"2023-08-10T10:38:23.324712+0000","last_fullsized":"2023-08-10T10:38:23.324712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201252+0000","last_change":"2023-08-10T10:38:22.222593+0000","last_active":"2023-08-10T10:38:23.201252+0000","last_peered":"2023-08-10T10:38:23.201252+0000","last_clean":"2023-08-10T10:38:23.201252+0000","last_became_active":"2023-08-10T10:38:22.222180+0000","last_became_peered":"2023-08-10T10:38:22.222180+0000","last_unstale":"2023-08-10T10:38:23.201252+0000","last_undegraded":"2023-08-10T10:38:23.201252+0000","last_fullsized":"2023-08-10T10:38:23.201252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325878+0000","last_change":"2023-08-10T10:38:22.224370+0000","last_active":"2023-08-10T10:38:23.325878+0000","last_peered":"2023-08-10T10:38:23.325878+0000","last_clean":"2023-08-10T10:38:23.325878+0000","last_became_active":"2023-08-10T10:38:22.224117+0000","last_became_peered":"2023-08-10T10:38:22.224117+0000","last_unstale":"2023-08-10T10:38:23.325878+0000","last_undegraded":"2023-08-10T10:38:23.325878+0000","last_fullsized":"2023-08-10T10:38:23.325878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202295+0000","last_change":"2023-08-10T10:38:22.217074+0000","last_active":"2023-08-10T10:38:23.202295+0000","last_peered":"2023-08-10T10:38:23.202295+0000","last_clean":"2023-08-10T10:38:23.202295+0000","last_became_active":"2023-08-10T10:38:22.216567+0000","last_became_peered":"2023-08-10T10:38:22.216567+0000","last_unstale":"2023-08-10T10:38:23.202295+0000","last_undegraded":"2023-08-10T10:38:23.202295+0000","last_fullsized":"2023-08-10T10:38:23.202295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324543+0000","last_change":"2023-08-10T10:38:22.221017+0000","last_active":"2023-08-10T10:38:23.324543+0000","last_peered":"2023-08-10T10:38:23.324543+0000","last_clean":"2023-08-10T10:38:23.324543+0000","last_became_active":"2023-08-10T10:38:22.220731+0000","last_became_peered":"2023-08-10T10:38:22.220731+0000","last_unstale":"2023-08-10T10:38:23.324543+0000","last_undegraded":"2023-08-10T10:38:23.324543+0000","last_fullsized":"2023-08-10T10:38:23.324543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202425+0000","last_change":"2023-08-10T10:38:22.217793+0000","last_active":"2023-08-10T10:38:23.202425+0000","last_peered":"2023-08-10T10:38:23.202425+0000","last_clean":"2023-08-10T10:38:23.202425+0000","last_became_active":"2023-08-10T10:38:22.217531+0000","last_became_peered":"2023-08-10T10:38:22.217531+0000","last_unstale":"2023-08-10T10:38:23.202425+0000","last_undegraded":"2023-08-10T10:38:23.202425+0000","last_fullsized":"2023-08-10T10:38:23.202425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201607+0000","last_change":"2023-08-10T10:38:22.225166+0000","last_active":"2023-08-10T10:38:23.201607+0000","last_peered":"2023-08-10T10:38:23.201607+0000","last_clean":"2023-08-10T10:38:23.201607+0000","last_became_active":"2023-08-10T10:38:22.224921+0000","last_became_peered":"2023-08-10T10:38:22.224921+0000","last_unstale":"2023-08-10T10:38:23.201607+0000","last_undegraded":"2023-08-10T10:38:23.201607+0000","last_fullsized":"2023-08-10T10:38:23.201607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533966+0000","last_change":"2023-08-10T10:38:22.197404+0000","last_active":"2023-08-10T10:38:23.533966+0000","last_peered":"2023-08-10T10:38:23.533966+0000","last_clean":"2023-08-10T10:38:23.533966+0000","last_became_active":"2023-08-10T10:38:22.196746+0000","last_became_peered":"2023-08-10T10:38:22.196746+0000","last_unstale":"2023-08-10T10:38:23.533966+0000","last_undegraded":"2023-08-10T10:38:23.533966+0000","last_fullsized":"2023-08-10T10:38:23.533966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533643+0000","last_change":"2023-08-10T10:38:22.204317+0000","last_active":"2023-08-10T10:38:23.533643+0000","last_peered":"2023-08-10T10:38:23.533643+0000","last_clean":"2023-08-10T10:38:23.533643+0000","last_became_active":"2023-08-10T10:38:22.203630+0000","last_became_peered":"2023-08-10T10:38:22.203630+0000","last_unstale":"2023-08-10T10:38:23.533643+0000","last_undegraded":"2023-08-10T10:38:23.533643+0000","last_fullsized":"2023-08-10T10:38:23.533643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:08.468410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201451+0000","last_change":"2023-08-10T10:38:22.212769+0000","last_active":"2023-08-10T10:38:23.201451+0000","last_peered":"2023-08-10T10:38:23.201451+0000","last_clean":"2023-08-10T10:38:23.201451+0000","last_became_active":"2023-08-10T10:38:22.212324+0000","last_became_peered":"2023-08-10T10:38:22.212324+0000","last_unstale":"2023-08-10T10:38:23.201451+0000","last_undegraded":"2023-08-10T10:38:23.201451+0000","last_fullsized":"2023-08-10T10:38:23.201451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326152+0000","last_change":"2023-08-10T10:38:22.214280+0000","last_active":"2023-08-10T10:38:23.326152+0000","last_peered":"2023-08-10T10:38:23.326152+0000","last_clean":"2023-08-10T10:38:23.326152+0000","last_became_active":"2023-08-10T10:38:22.214007+0000","last_became_peered":"2023-08-10T10:38:22.214007+0000","last_unstale":"2023-08-10T10:38:23.326152+0000","last_undegraded":"2023-08-10T10:38:23.326152+0000","last_fullsized":"2023-08-10T10:38:23.326152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202287+0000","last_change":"2023-08-10T10:38:22.222420+0000","last_active":"2023-08-10T10:38:23.202287+0000","last_peered":"2023-08-10T10:38:23.202287+0000","last_clean":"2023-08-10T10:38:23.202287+0000","last_became_active":"2023-08-10T10:38:22.221840+0000","last_became_peered":"2023-08-10T10:38:22.221840+0000","last_unstale":"2023-08-10T10:38:23.202287+0000","last_undegraded":"2023-08-10T10:38:23.202287+0000","last_fullsized":"2023-08-10T10:38:23.202287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324343+0000","last_change":"2023-08-10T10:38:22.221851+0000","last_active":"2023-08-10T10:38:23.324343+0000","last_peered":"2023-08-10T10:38:23.324343+0000","last_clean":"2023-08-10T10:38:23.324343+0000","last_became_active":"2023-08-10T10:38:22.221350+0000","last_became_peered":"2023-08-10T10:38:22.221350+0000","last_unstale":"2023-08-10T10:38:23.324343+0000","last_undegraded":"2023-08-10T10:38:23.324343+0000","last_fullsized":"2023-08-10T10:38:23.324343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201197+0000","last_change":"2023-08-10T10:38:22.213747+0000","last_active":"2023-08-10T10:38:23.201197+0000","last_peered":"2023-08-10T10:38:23.201197+0000","last_clean":"2023-08-10T10:38:23.201197+0000","last_became_active":"2023-08-10T10:38:22.212182+0000","last_became_peered":"2023-08-10T10:38:22.212182+0000","last_unstale":"2023-08-10T10:38:23.201197+0000","last_undegraded":"2023-08-10T10:38:23.201197+0000","last_fullsized":"2023-08-10T10:38:23.201197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533917+0000","last_change":"2023-08-10T10:38:22.214414+0000","last_active":"2023-08-10T10:38:23.533917+0000","last_peered":"2023-08-10T10:38:23.533917+0000","last_clean":"2023-08-10T10:38:23.533917+0000","last_became_active":"2023-08-10T10:38:22.213797+0000","last_became_peered":"2023-08-10T10:38:22.213797+0000","last_unstale":"2023-08-10T10:38:23.533917+0000","last_undegraded":"2023-08-10T10:38:23.533917+0000","last_fullsized":"2023-08-10T10:38:23.533917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:17.187234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201675+0000","last_change":"2023-08-10T10:38:22.222520+0000","last_active":"2023-08-10T10:38:23.201675+0000","last_peered":"2023-08-10T10:38:23.201675+0000","last_clean":"2023-08-10T10:38:23.201675+0000","last_became_active":"2023-08-10T10:38:22.221771+0000","last_became_peered":"2023-08-10T10:38:22.221771+0000","last_unstale":"2023-08-10T10:38:23.201675+0000","last_undegraded":"2023-08-10T10:38:23.201675+0000","last_fullsized":"2023-08-10T10:38:23.201675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326586+0000","last_change":"2023-08-10T10:38:22.217371+0000","last_active":"2023-08-10T10:38:23.326586+0000","last_peered":"2023-08-10T10:38:23.326586+0000","last_clean":"2023-08-10T10:38:23.326586+0000","last_became_active":"2023-08-10T10:38:22.216957+0000","last_became_peered":"2023-08-10T10:38:22.216957+0000","last_unstale":"2023-08-10T10:38:23.326586+0000","last_undegraded":"2023-08-10T10:38:23.326586+0000","last_fullsized":"2023-08-10T10:38:23.326586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.692722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324539+0000","last_change":"2023-08-10T10:38:22.226850+0000","last_active":"2023-08-10T10:38:23.324539+0000","last_peered":"2023-08-10T10:38:23.324539+0000","last_clean":"2023-08-10T10:38:23.324539+0000","last_became_active":"2023-08-10T10:38:22.226586+0000","last_became_peered":"2023-08-10T10:38:22.226586+0000","last_unstale":"2023-08-10T10:38:23.324539+0000","last_undegraded":"2023-08-10T10:38:23.324539+0000","last_fullsized":"2023-08-10T10:38:23.324539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199969+0000","last_change":"2023-08-10T10:38:22.220488+0000","last_active":"2023-08-10T10:38:23.199969+0000","last_peered":"2023-08-10T10:38:23.199969+0000","last_clean":"2023-08-10T10:38:23.199969+0000","last_became_active":"2023-08-10T10:38:22.220213+0000","last_became_peered":"2023-08-10T10:38:22.220213+0000","last_unstale":"2023-08-10T10:38:23.199969+0000","last_undegraded":"2023-08-10T10:38:23.199969+0000","last_fullsized":"2023-08-10T10:38:23.199969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326905+0000","last_change":"2023-08-10T10:38:22.222504+0000","last_active":"2023-08-10T10:38:23.326905+0000","last_peered":"2023-08-10T10:38:23.326905+0000","last_clean":"2023-08-10T10:38:23.326905+0000","last_became_active":"2023-08-10T10:38:22.219256+0000","last_became_peered":"2023-08-10T10:38:22.219256+0000","last_unstale":"2023-08-10T10:38:23.326905+0000","last_undegraded":"2023-08-10T10:38:23.326905+0000","last_fullsized":"2023-08-10T10:38:23.326905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:27.097082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534822+0000","last_change":"2023-08-10T10:38:22.230697+0000","last_active":"2023-08-10T10:38:23.534822+0000","last_peered":"2023-08-10T10:38:23.534822+0000","last_clean":"2023-08-10T10:38:23.534822+0000","last_became_active":"2023-08-10T10:38:22.230177+0000","last_became_peered":"2023-08-10T10:38:22.230177+0000","last_unstale":"2023-08-10T10:38:23.534822+0000","last_undegraded":"2023-08-10T10:38:23.534822+0000","last_fullsized":"2023-08-10T10:38:23.534822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535514+0000","last_change":"2023-08-10T10:38:22.230488+0000","last_active":"2023-08-10T10:38:23.535514+0000","last_peered":"2023-08-10T10:38:23.535514+0000","last_clean":"2023-08-10T10:38:23.535514+0000","last_became_active":"2023-08-10T10:38:22.230126+0000","last_became_peered":"2023-08-10T10:38:22.230126+0000","last_unstale":"2023-08-10T10:38:23.535514+0000","last_undegraded":"2023-08-10T10:38:23.535514+0000","last_fullsized":"2023-08-10T10:38:23.535514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202624+0000","last_change":"2023-08-10T10:38:22.218566+0000","last_active":"2023-08-10T10:38:23.202624+0000","last_peered":"2023-08-10T10:38:23.202624+0000","last_clean":"2023-08-10T10:38:23.202624+0000","last_became_active":"2023-08-10T10:38:22.218315+0000","last_became_peered":"2023-08-10T10:38:22.218315+0000","last_unstale":"2023-08-10T10:38:23.202624+0000","last_undegraded":"2023-08-10T10:38:23.202624+0000","last_fullsized":"2023-08-10T10:38:23.202624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534276+0000","last_change":"2023-08-10T10:38:22.223531+0000","last_active":"2023-08-10T10:38:23.534276+0000","last_peered":"2023-08-10T10:38:23.534276+0000","last_clean":"2023-08-10T10:38:23.534276+0000","last_became_active":"2023-08-10T10:38:22.214439+0000","last_became_peered":"2023-08-10T10:38:22.214439+0000","last_unstale":"2023-08-10T10:38:23.534276+0000","last_undegraded":"2023-08-10T10:38:23.534276+0000","last_fullsized":"2023-08-10T10:38:23.534276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200614+0000","last_change":"2023-08-10T10:38:22.218268+0000","last_active":"2023-08-10T10:38:23.200614+0000","last_peered":"2023-08-10T10:38:23.200614+0000","last_clean":"2023-08-10T10:38:23.200614+0000","last_became_active":"2023-08-10T10:38:22.217322+0000","last_became_peered":"2023-08-10T10:38:22.217322+0000","last_unstale":"2023-08-10T10:38:23.200614+0000","last_undegraded":"2023-08-10T10:38:23.200614+0000","last_fullsized":"2023-08-10T10:38:23.200614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201983+0000","last_change":"2023-08-10T10:38:22.222356+0000","last_active":"2023-08-10T10:38:23.201983+0000","last_peered":"2023-08-10T10:38:23.201983+0000","last_clean":"2023-08-10T10:38:23.201983+0000","last_became_active":"2023-08-10T10:38:22.221452+0000","last_became_peered":"2023-08-10T10:38:22.221452+0000","last_unstale":"2023-08-10T10:38:23.201983+0000","last_undegraded":"2023-08-10T10:38:23.201983+0000","last_fullsized":"2023-08-10T10:38:23.201983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200438+0000","last_change":"2023-08-10T10:38:22.225427+0000","last_active":"2023-08-10T10:38:23.200438+0000","last_peered":"2023-08-10T10:38:23.200438+0000","last_clean":"2023-08-10T10:38:23.200438+0000","last_became_active":"2023-08-10T10:38:22.225202+0000","last_became_peered":"2023-08-10T10:38:22.225202+0000","last_unstale":"2023-08-10T10:38:23.200438+0000","last_undegraded":"2023-08-10T10:38:23.200438+0000","last_fullsized":"2023-08-10T10:38:23.200438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325176+0000","last_change":"2023-08-10T10:38:22.209191+0000","last_active":"2023-08-10T10:38:23.325176+0000","last_peered":"2023-08-10T10:38:23.325176+0000","last_clean":"2023-08-10T10:38:23.325176+0000","last_became_active":"2023-08-10T10:38:22.208584+0000","last_became_peered":"2023-08-10T10:38:22.208584+0000","last_unstale":"2023-08-10T10:38:23.325176+0000","last_undegraded":"2023-08-10T10:38:23.325176+0000","last_fullsized":"2023-08-10T10:38:23.325176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201306+0000","last_change":"2023-08-10T10:38:22.212595+0000","last_active":"2023-08-10T10:38:23.201306+0000","last_peered":"2023-08-10T10:38:23.201306+0000","last_clean":"2023-08-10T10:38:23.201306+0000","last_became_active":"2023-08-10T10:38:22.211581+0000","last_became_peered":"2023-08-10T10:38:22.211581+0000","last_unstale":"2023-08-10T10:38:23.201306+0000","last_undegraded":"2023-08-10T10:38:23.201306+0000","last_fullsized":"2023-08-10T10:38:23.201306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326485+0000","last_change":"2023-08-10T10:38:21.209499+0000","last_active":"2023-08-10T10:38:23.326485+0000","last_peered":"2023-08-10T10:38:23.326485+0000","last_clean":"2023-08-10T10:38:23.326485+0000","last_became_active":"2023-08-10T10:38:21.208930+0000","last_became_peered":"2023-08-10T10:38:21.208930+0000","last_unstale":"2023-08-10T10:38:23.326485+0000","last_undegraded":"2023-08-10T10:38:23.326485+0000","last_fullsized":"2023-08-10T10:38:23.326485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202626+0000","last_change":"2023-08-10T10:38:22.216900+0000","last_active":"2023-08-10T10:38:23.202626+0000","last_peered":"2023-08-10T10:38:23.202626+0000","last_clean":"2023-08-10T10:38:23.202626+0000","last_became_active":"2023-08-10T10:38:22.216199+0000","last_became_peered":"2023-08-10T10:38:22.216199+0000","last_unstale":"2023-08-10T10:38:23.202626+0000","last_undegraded":"2023-08-10T10:38:23.202626+0000","last_fullsized":"2023-08-10T10:38:23.202626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325918+0000","last_change":"2023-08-10T10:38:21.202495+0000","last_active":"2023-08-10T10:38:23.325918+0000","last_peered":"2023-08-10T10:38:23.325918+0000","last_clean":"2023-08-10T10:38:23.325918+0000","last_became_active":"2023-08-10T10:38:21.201907+0000","last_became_peered":"2023-08-10T10:38:21.201907+0000","last_unstale":"2023-08-10T10:38:23.325918+0000","last_undegraded":"2023-08-10T10:38:23.325918+0000","last_fullsized":"2023-08-10T10:38:23.325918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324734+0000","last_change":"2023-08-10T10:38:22.221638+0000","last_active":"2023-08-10T10:38:23.324734+0000","last_peered":"2023-08-10T10:38:23.324734+0000","last_clean":"2023-08-10T10:38:23.324734+0000","last_became_active":"2023-08-10T10:38:22.220935+0000","last_became_peered":"2023-08-10T10:38:22.220935+0000","last_unstale":"2023-08-10T10:38:23.324734+0000","last_undegraded":"2023-08-10T10:38:23.324734+0000","last_fullsized":"2023-08-10T10:38:23.324734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326520+0000","last_change":"2023-08-10T10:38:21.204133+0000","last_active":"2023-08-10T10:38:23.326520+0000","last_peered":"2023-08-10T10:38:23.326520+0000","last_clean":"2023-08-10T10:38:23.326520+0000","last_became_active":"2023-08-10T10:38:21.203842+0000","last_became_peered":"2023-08-10T10:38:21.203842+0000","last_unstale":"2023-08-10T10:38:23.326520+0000","last_undegraded":"2023-08-10T10:38:23.326520+0000","last_fullsized":"2023-08-10T10:38:23.326520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200052+0000","last_change":"2023-08-10T10:38:22.215664+0000","last_active":"2023-08-10T10:38:23.200052+0000","last_peered":"2023-08-10T10:38:23.200052+0000","last_clean":"2023-08-10T10:38:23.200052+0000","last_became_active":"2023-08-10T10:38:22.212636+0000","last_became_peered":"2023-08-10T10:38:22.212636+0000","last_unstale":"2023-08-10T10:38:23.200052+0000","last_undegraded":"2023-08-10T10:38:23.200052+0000","last_fullsized":"2023-08-10T10:38:23.200052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325452+0000","last_change":"2023-08-10T10:38:21.204543+0000","last_active":"2023-08-10T10:38:23.325452+0000","last_peered":"2023-08-10T10:38:23.325452+0000","last_clean":"2023-08-10T10:38:23.325452+0000","last_became_active":"2023-08-10T10:38:21.204298+0000","last_became_peered":"2023-08-10T10:38:21.204298+0000","last_unstale":"2023-08-10T10:38:23.325452+0000","last_undegraded":"2023-08-10T10:38:23.325452+0000","last_fullsized":"2023-08-10T10:38:23.325452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:42.165678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327421+0000","last_change":"2023-08-10T10:38:21.204939+0000","last_active":"2023-08-10T10:38:23.327421+0000","last_peered":"2023-08-10T10:38:23.327421+0000","last_clean":"2023-08-10T10:38:23.327421+0000","last_became_active":"2023-08-10T10:38:21.204670+0000","last_became_peered":"2023-08-10T10:38:21.204670+0000","last_unstale":"2023-08-10T10:38:23.327421+0000","last_undegraded":"2023-08-10T10:38:23.327421+0000","last_fullsized":"2023-08-10T10:38:23.327421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:15.925392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203322+0000","last_change":"2023-08-10T10:38:22.215812+0000","last_active":"2023-08-10T10:38:23.203322+0000","last_peered":"2023-08-10T10:38:23.203322+0000","last_clean":"2023-08-10T10:38:23.203322+0000","last_became_active":"2023-08-10T10:38:22.215518+0000","last_became_peered":"2023-08-10T10:38:22.215518+0000","last_unstale":"2023-08-10T10:38:23.203322+0000","last_undegraded":"2023-08-10T10:38:23.203322+0000","last_fullsized":"2023-08-10T10:38:23.203322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326826+0000","last_change":"2023-08-10T10:38:21.209700+0000","last_active":"2023-08-10T10:38:23.326826+0000","last_peered":"2023-08-10T10:38:23.326826+0000","last_clean":"2023-08-10T10:38:23.326826+0000","last_became_active":"2023-08-10T10:38:21.209258+0000","last_became_peered":"2023-08-10T10:38:21.209258+0000","last_unstale":"2023-08-10T10:38:23.326826+0000","last_undegraded":"2023-08-10T10:38:23.326826+0000","last_fullsized":"2023-08-10T10:38:23.326826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:10.268662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202875+0000","last_change":"2023-08-10T10:38:22.210784+0000","last_active":"2023-08-10T10:38:23.202875+0000","last_peered":"2023-08-10T10:38:23.202875+0000","last_clean":"2023-08-10T10:38:23.202875+0000","last_became_active":"2023-08-10T10:38:22.210275+0000","last_became_peered":"2023-08-10T10:38:22.210275+0000","last_unstale":"2023-08-10T10:38:23.202875+0000","last_undegraded":"2023-08-10T10:38:23.202875+0000","last_fullsized":"2023-08-10T10:38:23.202875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:31.071882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326869+0000","last_change":"2023-08-10T10:38:21.201970+0000","last_active":"2023-08-10T10:38:23.326869+0000","last_peered":"2023-08-10T10:38:23.326869+0000","last_clean":"2023-08-10T10:38:23.326869+0000","last_became_active":"2023-08-10T10:38:21.201599+0000","last_became_peered":"2023-08-10T10:38:21.201599+0000","last_unstale":"2023-08-10T10:38:23.326869+0000","last_undegraded":"2023-08-10T10:38:23.326869+0000","last_fullsized":"2023-08-10T10:38:23.326869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:15.895041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325811+0000","last_change":"2023-08-10T10:38:22.224729+0000","last_active":"2023-08-10T10:38:23.325811+0000","last_peered":"2023-08-10T10:38:23.325811+0000","last_clean":"2023-08-10T10:38:23.325811+0000","last_became_active":"2023-08-10T10:38:22.224473+0000","last_became_peered":"2023-08-10T10:38:22.224473+0000","last_unstale":"2023-08-10T10:38:23.325811+0000","last_undegraded":"2023-08-10T10:38:23.325811+0000","last_fullsized":"2023-08-10T10:38:23.325811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:32.356113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203242+0000","last_change":"2023-08-10T10:38:21.197513+0000","last_active":"2023-08-10T10:38:23.203242+0000","last_peered":"2023-08-10T10:38:23.203242+0000","last_clean":"2023-08-10T10:38:23.203242+0000","last_became_active":"2023-08-10T10:38:21.197186+0000","last_became_peered":"2023-08-10T10:38:21.197186+0000","last_unstale":"2023-08-10T10:38:23.203242+0000","last_undegraded":"2023-08-10T10:38:23.203242+0000","last_fullsized":"2023-08-10T10:38:23.203242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:10.021641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324784+0000","last_change":"2023-08-10T10:38:22.227601+0000","last_active":"2023-08-10T10:38:23.324784+0000","last_peered":"2023-08-10T10:38:23.324784+0000","last_clean":"2023-08-10T10:38:23.324784+0000","last_became_active":"2023-08-10T10:38:22.227145+0000","last_became_peered":"2023-08-10T10:38:22.227145+0000","last_unstale":"2023-08-10T10:38:23.324784+0000","last_undegraded":"2023-08-10T10:38:23.324784+0000","last_fullsized":"2023-08-10T10:38:23.324784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200784+0000","last_change":"2023-08-10T10:38:21.206280+0000","last_active":"2023-08-10T10:38:23.200784+0000","last_peered":"2023-08-10T10:38:23.200784+0000","last_clean":"2023-08-10T10:38:23.200784+0000","last_became_active":"2023-08-10T10:38:21.205889+0000","last_became_peered":"2023-08-10T10:38:21.205889+0000","last_unstale":"2023-08-10T10:38:23.200784+0000","last_undegraded":"2023-08-10T10:38:23.200784+0000","last_fullsized":"2023-08-10T10:38:23.200784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201888+0000","last_change":"2023-08-10T10:38:22.204248+0000","last_active":"2023-08-10T10:38:23.201888+0000","last_peered":"2023-08-10T10:38:23.201888+0000","last_clean":"2023-08-10T10:38:23.201888+0000","last_became_active":"2023-08-10T10:38:22.199227+0000","last_became_peered":"2023-08-10T10:38:22.199227+0000","last_unstale":"2023-08-10T10:38:23.201888+0000","last_undegraded":"2023-08-10T10:38:23.201888+0000","last_fullsized":"2023-08-10T10:38:23.201888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326432+0000","last_change":"2023-08-10T10:38:21.205456+0000","last_active":"2023-08-10T10:38:23.326432+0000","last_peered":"2023-08-10T10:38:23.326432+0000","last_clean":"2023-08-10T10:38:23.326432+0000","last_became_active":"2023-08-10T10:38:21.205215+0000","last_became_peered":"2023-08-10T10:38:21.205215+0000","last_unstale":"2023-08-10T10:38:23.326432+0000","last_undegraded":"2023-08-10T10:38:23.326432+0000","last_fullsized":"2023-08-10T10:38:23.326432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201985+0000","last_change":"2023-08-10T10:38:22.199554+0000","last_active":"2023-08-10T10:38:23.201985+0000","last_peered":"2023-08-10T10:38:23.201985+0000","last_clean":"2023-08-10T10:38:23.201985+0000","last_became_active":"2023-08-10T10:38:22.198747+0000","last_became_peered":"2023-08-10T10:38:22.198747+0000","last_unstale":"2023-08-10T10:38:23.201985+0000","last_undegraded":"2023-08-10T10:38:23.201985+0000","last_fullsized":"2023-08-10T10:38:23.201985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203786+0000","last_change":"2023-08-10T10:38:21.208724+0000","last_active":"2023-08-10T10:38:23.203786+0000","last_peered":"2023-08-10T10:38:23.203786+0000","last_clean":"2023-08-10T10:38:23.203786+0000","last_became_active":"2023-08-10T10:38:21.207707+0000","last_became_peered":"2023-08-10T10:38:21.207707+0000","last_unstale":"2023-08-10T10:38:23.203786+0000","last_undegraded":"2023-08-10T10:38:23.203786+0000","last_fullsized":"2023-08-10T10:38:23.203786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:26.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203495+0000","last_change":"2023-08-10T10:38:22.221214+0000","last_active":"2023-08-10T10:38:23.203495+0000","last_peered":"2023-08-10T10:38:23.203495+0000","last_clean":"2023-08-10T10:38:23.203495+0000","last_became_active":"2023-08-10T10:38:22.220236+0000","last_became_peered":"2023-08-10T10:38:22.220236+0000","last_unstale":"2023-08-10T10:38:23.203495+0000","last_undegraded":"2023-08-10T10:38:23.203495+0000","last_fullsized":"2023-08-10T10:38:23.203495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:16.910102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200842+0000","last_change":"2023-08-10T10:38:21.203702+0000","last_active":"2023-08-10T10:38:23.200842+0000","last_peered":"2023-08-10T10:38:23.200842+0000","last_clean":"2023-08-10T10:38:23.200842+0000","last_became_active":"2023-08-10T10:38:21.203440+0000","last_became_peered":"2023-08-10T10:38:21.203440+0000","last_unstale":"2023-08-10T10:38:23.200842+0000","last_undegraded":"2023-08-10T10:38:23.200842+0000","last_fullsized":"2023-08-10T10:38:23.200842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534365+0000","last_change":"2023-08-10T10:38:22.225268+0000","last_active":"2023-08-10T10:38:23.534365+0000","last_peered":"2023-08-10T10:38:23.534365+0000","last_clean":"2023-08-10T10:38:23.534365+0000","last_became_active":"2023-08-10T10:38:22.224857+0000","last_became_peered":"2023-08-10T10:38:22.224857+0000","last_unstale":"2023-08-10T10:38:23.534365+0000","last_undegraded":"2023-08-10T10:38:23.534365+0000","last_fullsized":"2023-08-10T10:38:23.534365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.328222+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:38:23.328222+0000","last_peered":"2023-08-10T10:38:23.328222+0000","last_clean":"2023-08-10T10:38:23.328222+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:38:23.328222+0000","last_undegraded":"2023-08-10T10:38:23.328222+0000","last_fullsized":"2023-08-10T10:38:23.328222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:21.161219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203958+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:38:23.203958+0000","last_peered":"2023-08-10T10:38:23.203958+0000","last_clean":"2023-08-10T10:38:23.203958+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:38:23.203958+0000","last_undegraded":"2023-08-10T10:38:23.203958+0000","last_fullsized":"2023-08-10T10:38:23.203958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:24.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201315+0000","last_change":"2023-08-10T10:38:21.202544+0000","last_active":"2023-08-10T10:38:23.201315+0000","last_peered":"2023-08-10T10:38:23.201315+0000","last_clean":"2023-08-10T10:38:23.201315+0000","last_became_active":"2023-08-10T10:38:21.202310+0000","last_became_peered":"2023-08-10T10:38:21.202310+0000","last_unstale":"2023-08-10T10:38:23.201315+0000","last_undegraded":"2023-08-10T10:38:23.201315+0000","last_fullsized":"2023-08-10T10:38:23.201315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326145+0000","last_change":"2023-08-10T10:38:22.220675+0000","last_active":"2023-08-10T10:38:23.326145+0000","last_peered":"2023-08-10T10:38:23.326145+0000","last_clean":"2023-08-10T10:38:23.326145+0000","last_became_active":"2023-08-10T10:38:22.220074+0000","last_became_peered":"2023-08-10T10:38:22.220074+0000","last_unstale":"2023-08-10T10:38:23.326145+0000","last_undegraded":"2023-08-10T10:38:23.326145+0000","last_fullsized":"2023-08-10T10:38:23.326145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327929+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:38:23.327929+0000","last_peered":"2023-08-10T10:38:23.327929+0000","last_clean":"2023-08-10T10:38:23.327929+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:38:23.327929+0000","last_undegraded":"2023-08-10T10:38:23.327929+0000","last_fullsized":"2023-08-10T10:38:23.327929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:11.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325615+0000","last_change":"2023-08-10T10:38:21.206286+0000","last_active":"2023-08-10T10:38:23.325615+0000","last_peered":"2023-08-10T10:38:23.325615+0000","last_clean":"2023-08-10T10:38:23.325615+0000","last_became_active":"2023-08-10T10:38:21.205708+0000","last_became_peered":"2023-08-10T10:38:21.205708+0000","last_unstale":"2023-08-10T10:38:23.325615+0000","last_undegraded":"2023-08-10T10:38:23.325615+0000","last_fullsized":"2023-08-10T10:38:23.325615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325132+0000","last_change":"2023-08-10T10:38:22.227415+0000","last_active":"2023-08-10T10:38:23.325132+0000","last_peered":"2023-08-10T10:38:23.325132+0000","last_clean":"2023-08-10T10:38:23.325132+0000","last_became_active":"2023-08-10T10:38:22.226780+0000","last_became_peered":"2023-08-10T10:38:22.226780+0000","last_unstale":"2023-08-10T10:38:23.325132+0000","last_undegraded":"2023-08-10T10:38:23.325132+0000","last_fullsized":"2023-08-10T10:38:23.325132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533781+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:38:23.533781+0000","last_peered":"2023-08-10T10:38:23.533781+0000","last_clean":"2023-08-10T10:38:23.533781+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:38:23.533781+0000","last_undegraded":"2023-08-10T10:38:23.533781+0000","last_fullsized":"2023-08-10T10:38:23.533781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:41.319609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535282+0000","last_change":"2023-08-10T10:38:21.195201+0000","last_active":"2023-08-10T10:38:23.535282+0000","last_peered":"2023-08-10T10:38:23.535282+0000","last_clean":"2023-08-10T10:38:23.535282+0000","last_became_active":"2023-08-10T10:38:21.194755+0000","last_became_peered":"2023-08-10T10:38:21.194755+0000","last_unstale":"2023-08-10T10:38:23.535282+0000","last_undegraded":"2023-08-10T10:38:23.535282+0000","last_fullsized":"2023-08-10T10:38:23.535282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534544+0000","last_change":"2023-08-10T10:38:22.225863+0000","last_active":"2023-08-10T10:38:23.534544+0000","last_peered":"2023-08-10T10:38:23.534544+0000","last_clean":"2023-08-10T10:38:23.534544+0000","last_became_active":"2023-08-10T10:38:22.225087+0000","last_became_peered":"2023-08-10T10:38:22.225087+0000","last_unstale":"2023-08-10T10:38:23.534544+0000","last_undegraded":"2023-08-10T10:38:23.534544+0000","last_fullsized":"2023-08-10T10:38:23.534544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203433+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:38:23.203433+0000","last_peered":"2023-08-10T10:38:23.203433+0000","last_clean":"2023-08-10T10:38:23.203433+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:38:23.203433+0000","last_undegraded":"2023-08-10T10:38:23.203433+0000","last_fullsized":"2023-08-10T10:38:23.203433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.917501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202604+0000","last_change":"2023-08-10T10:38:21.208553+0000","last_active":"2023-08-10T10:38:23.202604+0000","last_peered":"2023-08-10T10:38:23.202604+0000","last_clean":"2023-08-10T10:38:23.202604+0000","last_became_active":"2023-08-10T10:38:21.207885+0000","last_became_peered":"2023-08-10T10:38:21.207885+0000","last_unstale":"2023-08-10T10:38:23.202604+0000","last_undegraded":"2023-08-10T10:38:23.202604+0000","last_fullsized":"2023-08-10T10:38:23.202604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534974+0000","last_change":"2023-08-10T10:38:22.209787+0000","last_active":"2023-08-10T10:38:23.534974+0000","last_peered":"2023-08-10T10:38:23.534974+0000","last_clean":"2023-08-10T10:38:23.534974+0000","last_became_active":"2023-08-10T10:38:22.209252+0000","last_became_peered":"2023-08-10T10:38:22.209252+0000","last_unstale":"2023-08-10T10:38:23.534974+0000","last_undegraded":"2023-08-10T10:38:23.534974+0000","last_fullsized":"2023-08-10T10:38:23.534974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201820+0000","last_change":"2023-08-10T10:38:21.199662+0000","last_active":"2023-08-10T10:38:23.201820+0000","last_peered":"2023-08-10T10:38:23.201820+0000","last_clean":"2023-08-10T10:38:23.201820+0000","last_became_active":"2023-08-10T10:38:21.199287+0000","last_became_peered":"2023-08-10T10:38:21.199287+0000","last_unstale":"2023-08-10T10:38:23.201820+0000","last_undegraded":"2023-08-10T10:38:23.201820+0000","last_fullsized":"2023-08-10T10:38:23.201820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535100+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:38:23.535100+0000","last_peered":"2023-08-10T10:38:23.535100+0000","last_clean":"2023-08-10T10:38:23.535100+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:38:23.535100+0000","last_undegraded":"2023-08-10T10:38:23.535100+0000","last_fullsized":"2023-08-10T10:38:23.535100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:52.669054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534779+0000","last_change":"2023-08-10T10:38:22.225637+0000","last_active":"2023-08-10T10:38:23.534779+0000","last_peered":"2023-08-10T10:38:23.534779+0000","last_clean":"2023-08-10T10:38:23.534779+0000","last_became_active":"2023-08-10T10:38:22.224629+0000","last_became_peered":"2023-08-10T10:38:22.224629+0000","last_unstale":"2023-08-10T10:38:23.534779+0000","last_undegraded":"2023-08-10T10:38:23.534779+0000","last_fullsized":"2023-08-10T10:38:23.534779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535040+0000","last_change":"2023-08-10T10:38:21.200714+0000","last_active":"2023-08-10T10:38:23.535040+0000","last_peered":"2023-08-10T10:38:23.535040+0000","last_clean":"2023-08-10T10:38:23.535040+0000","last_became_active":"2023-08-10T10:38:21.200451+0000","last_became_peered":"2023-08-10T10:38:21.200451+0000","last_unstale":"2023-08-10T10:38:23.535040+0000","last_undegraded":"2023-08-10T10:38:23.535040+0000","last_fullsized":"2023-08-10T10:38:23.535040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327627+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:38:23.327627+0000","last_peered":"2023-08-10T10:38:23.327627+0000","last_clean":"2023-08-10T10:38:23.327627+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:38:23.327627+0000","last_undegraded":"2023-08-10T10:38:23.327627+0000","last_fullsized":"2023-08-10T10:38:23.327627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:23.252217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325297+0000","last_change":"2023-08-10T10:38:22.216529+0000","last_active":"2023-08-10T10:38:23.325297+0000","last_peered":"2023-08-10T10:38:23.325297+0000","last_clean":"2023-08-10T10:38:23.325297+0000","last_became_active":"2023-08-10T10:38:22.216258+0000","last_became_peered":"2023-08-10T10:38:22.216258+0000","last_unstale":"2023-08-10T10:38:23.325297+0000","last_undegraded":"2023-08-10T10:38:23.325297+0000","last_fullsized":"2023-08-10T10:38:23.325297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200984+0000","last_change":"2023-08-10T10:38:21.201020+0000","last_active":"2023-08-10T10:38:23.200984+0000","last_peered":"2023-08-10T10:38:23.200984+0000","last_clean":"2023-08-10T10:38:23.200984+0000","last_became_active":"2023-08-10T10:38:21.200776+0000","last_became_peered":"2023-08-10T10:38:21.200776+0000","last_unstale":"2023-08-10T10:38:23.200984+0000","last_undegraded":"2023-08-10T10:38:23.200984+0000","last_fullsized":"2023-08-10T10:38:23.200984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534460+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:38:23.534460+0000","last_peered":"2023-08-10T10:38:23.534460+0000","last_clean":"2023-08-10T10:38:23.534460+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:38:23.534460+0000","last_undegraded":"2023-08-10T10:38:23.534460+0000","last_fullsized":"2023-08-10T10:38:23.534460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:50.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200047+0000","last_change":"2023-08-10T10:38:22.218095+0000","last_active":"2023-08-10T10:38:23.200047+0000","last_peered":"2023-08-10T10:38:23.200047+0000","last_clean":"2023-08-10T10:38:23.200047+0000","last_became_active":"2023-08-10T10:38:22.216987+0000","last_became_peered":"2023-08-10T10:38:22.216987+0000","last_unstale":"2023-08-10T10:38:23.200047+0000","last_undegraded":"2023-08-10T10:38:23.200047+0000","last_fullsized":"2023-08-10T10:38:23.200047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.343733+0000","last_change":"2023-08-10T10:38:21.205196+0000","last_active":"2023-08-10T10:38:23.343733+0000","last_peered":"2023-08-10T10:38:23.343733+0000","last_clean":"2023-08-10T10:38:23.343733+0000","last_became_active":"2023-08-10T10:38:21.204571+0000","last_became_peered":"2023-08-10T10:38:21.204571+0000","last_unstale":"2023-08-10T10:38:23.343733+0000","last_undegraded":"2023-08-10T10:38:23.343733+0000","last_fullsized":"2023-08-10T10:38:23.343733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325403+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:38:23.325403+0000","last_peered":"2023-08-10T10:38:23.325403+0000","last_clean":"2023-08-10T10:38:23.325403+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:38:23.325403+0000","last_undegraded":"2023-08-10T10:38:23.325403+0000","last_fullsized":"2023-08-10T10:38:23.325403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:42.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202232+0000","last_change":"2023-08-10T10:38:22.220123+0000","last_active":"2023-08-10T10:38:23.202232+0000","last_peered":"2023-08-10T10:38:23.202232+0000","last_clean":"2023-08-10T10:38:23.202232+0000","last_became_active":"2023-08-10T10:38:22.214781+0000","last_became_peered":"2023-08-10T10:38:22.214781+0000","last_unstale":"2023-08-10T10:38:23.202232+0000","last_undegraded":"2023-08-10T10:38:23.202232+0000","last_fullsized":"2023-08-10T10:38:23.202232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203196+0000","last_change":"2023-08-10T10:38:22.222039+0000","last_active":"2023-08-10T10:38:23.203196+0000","last_peered":"2023-08-10T10:38:23.203196+0000","last_clean":"2023-08-10T10:38:23.203196+0000","last_became_active":"2023-08-10T10:38:22.220581+0000","last_became_peered":"2023-08-10T10:38:22.220581+0000","last_unstale":"2023-08-10T10:38:23.203196+0000","last_undegraded":"2023-08-10T10:38:23.203196+0000","last_fullsized":"2023-08-10T10:38:23.203196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:11.283723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201459+0000","last_change":"2023-08-10T10:38:21.203533+0000","last_active":"2023-08-10T10:38:23.201459+0000","last_peered":"2023-08-10T10:38:23.201459+0000","last_clean":"2023-08-10T10:38:23.201459+0000","last_became_active":"2023-08-10T10:38:21.203281+0000","last_became_peered":"2023-08-10T10:38:21.203281+0000","last_unstale":"2023-08-10T10:38:23.201459+0000","last_undegraded":"2023-08-10T10:38:23.201459+0000","last_fullsized":"2023-08-10T10:38:23.201459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:26.689515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535765+0000","last_change":"2023-08-10T10:38:22.224954+0000","last_active":"2023-08-10T10:38:23.535765+0000","last_peered":"2023-08-10T10:38:23.535765+0000","last_clean":"2023-08-10T10:38:23.535765+0000","last_became_active":"2023-08-10T10:38:22.224681+0000","last_became_peered":"2023-08-10T10:38:22.224681+0000","last_unstale":"2023-08-10T10:38:23.535765+0000","last_undegraded":"2023-08-10T10:38:23.535765+0000","last_fullsized":"2023-08-10T10:38:23.535765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326588+0000","last_change":"2023-08-10T10:38:21.203411+0000","last_active":"2023-08-10T10:38:23.326588+0000","last_peered":"2023-08-10T10:38:23.326588+0000","last_clean":"2023-08-10T10:38:23.326588+0000","last_became_active":"2023-08-10T10:38:21.203148+0000","last_became_peered":"2023-08-10T10:38:21.203148+0000","last_unstale":"2023-08-10T10:38:23.326588+0000","last_undegraded":"2023-08-10T10:38:23.326588+0000","last_fullsized":"2023-08-10T10:38:23.326588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:30.056821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202965+0000","last_change":"2023-08-10T10:38:21.201006+0000","last_active":"2023-08-10T10:38:23.202965+0000","last_peered":"2023-08-10T10:38:23.202965+0000","last_clean":"2023-08-10T10:38:23.202965+0000","last_became_active":"2023-08-10T10:38:21.200714+0000","last_became_peered":"2023-08-10T10:38:21.200714+0000","last_unstale":"2023-08-10T10:38:23.202965+0000","last_undegraded":"2023-08-10T10:38:23.202965+0000","last_fullsized":"2023-08-10T10:38:23.202965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200418+0000","last_change":"2023-08-10T10:38:22.215890+0000","last_active":"2023-08-10T10:38:23.200418+0000","last_peered":"2023-08-10T10:38:23.200418+0000","last_clean":"2023-08-10T10:38:23.200418+0000","last_became_active":"2023-08-10T10:38:22.215479+0000","last_became_peered":"2023-08-10T10:38:22.215479+0000","last_unstale":"2023-08-10T10:38:23.200418+0000","last_undegraded":"2023-08-10T10:38:23.200418+0000","last_fullsized":"2023-08-10T10:38:23.200418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325621+0000","last_change":"2023-08-10T10:38:21.202668+0000","last_active":"2023-08-10T10:38:23.325621+0000","last_peered":"2023-08-10T10:38:23.325621+0000","last_clean":"2023-08-10T10:38:23.325621+0000","last_became_active":"2023-08-10T10:38:21.202245+0000","last_became_peered":"2023-08-10T10:38:21.202245+0000","last_unstale":"2023-08-10T10:38:23.325621+0000","last_undegraded":"2023-08-10T10:38:23.325621+0000","last_fullsized":"2023-08-10T10:38:23.325621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200327+0000","last_change":"2023-08-10T10:38:22.206881+0000","last_active":"2023-08-10T10:38:23.200327+0000","last_peered":"2023-08-10T10:38:23.200327+0000","last_clean":"2023-08-10T10:38:23.200327+0000","last_became_active":"2023-08-10T10:38:22.206376+0000","last_became_peered":"2023-08-10T10:38:22.206376+0000","last_unstale":"2023-08-10T10:38:23.200327+0000","last_undegraded":"2023-08-10T10:38:23.200327+0000","last_fullsized":"2023-08-10T10:38:23.200327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325097+0000","last_change":"2023-08-10T10:38:22.219281+0000","last_active":"2023-08-10T10:38:23.325097+0000","last_peered":"2023-08-10T10:38:23.325097+0000","last_clean":"2023-08-10T10:38:23.325097+0000","last_became_active":"2023-08-10T10:38:22.219015+0000","last_became_peered":"2023-08-10T10:38:22.219015+0000","last_unstale":"2023-08-10T10:38:23.325097+0000","last_undegraded":"2023-08-10T10:38:23.325097+0000","last_fullsized":"2023-08-10T10:38:23.325097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200334+0000","last_change":"2023-08-10T10:38:21.203137+0000","last_active":"2023-08-10T10:38:23.200334+0000","last_peered":"2023-08-10T10:38:23.200334+0000","last_clean":"2023-08-10T10:38:23.200334+0000","last_became_active":"2023-08-10T10:38:21.202879+0000","last_became_peered":"2023-08-10T10:38:21.202879+0000","last_unstale":"2023-08-10T10:38:23.200334+0000","last_undegraded":"2023-08-10T10:38:23.200334+0000","last_fullsized":"2023-08-10T10:38:23.200334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324925+0000","last_change":"2023-08-10T10:38:22.216641+0000","last_active":"2023-08-10T10:38:23.324925+0000","last_peered":"2023-08-10T10:38:23.324925+0000","last_clean":"2023-08-10T10:38:23.324925+0000","last_became_active":"2023-08-10T10:38:22.216326+0000","last_became_peered":"2023-08-10T10:38:22.216326+0000","last_unstale":"2023-08-10T10:38:23.324925+0000","last_undegraded":"2023-08-10T10:38:23.324925+0000","last_fullsized":"2023-08-10T10:38:23.324925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534753+0000","last_change":"2023-08-10T10:38:21.196362+0000","last_active":"2023-08-10T10:38:23.534753+0000","last_peered":"2023-08-10T10:38:23.534753+0000","last_clean":"2023-08-10T10:38:23.534753+0000","last_became_active":"2023-08-10T10:38:21.196026+0000","last_became_peered":"2023-08-10T10:38:21.196026+0000","last_unstale":"2023-08-10T10:38:23.534753+0000","last_undegraded":"2023-08-10T10:38:23.534753+0000","last_fullsized":"2023-08-10T10:38:23.534753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199967+0000","last_change":"2023-08-10T10:38:22.211342+0000","last_active":"2023-08-10T10:38:23.199967+0000","last_peered":"2023-08-10T10:38:23.199967+0000","last_clean":"2023-08-10T10:38:23.199967+0000","last_became_active":"2023-08-10T10:38:22.210963+0000","last_became_peered":"2023-08-10T10:38:22.210963+0000","last_unstale":"2023-08-10T10:38:23.199967+0000","last_undegraded":"2023-08-10T10:38:23.199967+0000","last_fullsized":"2023-08-10T10:38:23.199967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202602+0000","last_change":"2023-08-10T10:38:21.192358+0000","last_active":"2023-08-10T10:38:23.202602+0000","last_peered":"2023-08-10T10:38:23.202602+0000","last_clean":"2023-08-10T10:38:23.202602+0000","last_became_active":"2023-08-10T10:38:21.188537+0000","last_became_peered":"2023-08-10T10:38:21.188537+0000","last_unstale":"2023-08-10T10:38:23.202602+0000","last_undegraded":"2023-08-10T10:38:23.202602+0000","last_fullsized":"2023-08-10T10:38:23.202602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534112+0000","last_change":"2023-08-10T10:38:22.227114+0000","last_active":"2023-08-10T10:38:23.534112+0000","last_peered":"2023-08-10T10:38:23.534112+0000","last_clean":"2023-08-10T10:38:23.534112+0000","last_became_active":"2023-08-10T10:38:22.226785+0000","last_became_peered":"2023-08-10T10:38:22.226785+0000","last_unstale":"2023-08-10T10:38:23.534112+0000","last_undegraded":"2023-08-10T10:38:23.534112+0000","last_fullsized":"2023-08-10T10:38:23.534112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324921+0000","last_change":"2023-08-10T10:38:21.205454+0000","last_active":"2023-08-10T10:38:23.324921+0000","last_peered":"2023-08-10T10:38:23.324921+0000","last_clean":"2023-08-10T10:38:23.324921+0000","last_became_active":"2023-08-10T10:38:21.204999+0000","last_became_peered":"2023-08-10T10:38:21.204999+0000","last_unstale":"2023-08-10T10:38:23.324921+0000","last_undegraded":"2023-08-10T10:38:23.324921+0000","last_fullsized":"2023-08-10T10:38:23.324921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201533+0000","last_change":"2023-08-10T10:38:22.204621+0000","last_active":"2023-08-10T10:38:23.201533+0000","last_peered":"2023-08-10T10:38:23.201533+0000","last_clean":"2023-08-10T10:38:23.201533+0000","last_became_active":"2023-08-10T10:38:22.203468+0000","last_became_peered":"2023-08-10T10:38:22.203468+0000","last_unstale":"2023-08-10T10:38:23.201533+0000","last_undegraded":"2023-08-10T10:38:23.201533+0000","last_fullsized":"2023-08-10T10:38:23.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203621+0000","last_change":"2023-08-10T10:38:21.205716+0000","last_active":"2023-08-10T10:38:23.203621+0000","last_peered":"2023-08-10T10:38:23.203621+0000","last_clean":"2023-08-10T10:38:23.203621+0000","last_became_active":"2023-08-10T10:38:21.205452+0000","last_became_peered":"2023-08-10T10:38:21.205452+0000","last_unstale":"2023-08-10T10:38:23.203621+0000","last_undegraded":"2023-08-10T10:38:23.203621+0000","last_fullsized":"2023-08-10T10:38:23.203621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201532+0000","last_change":"2023-08-10T10:38:22.204384+0000","last_active":"2023-08-10T10:38:23.201532+0000","last_peered":"2023-08-10T10:38:23.201532+0000","last_clean":"2023-08-10T10:38:23.201532+0000","last_became_active":"2023-08-10T10:38:22.203734+0000","last_became_peered":"2023-08-10T10:38:22.203734+0000","last_unstale":"2023-08-10T10:38:23.201532+0000","last_undegraded":"2023-08-10T10:38:23.201532+0000","last_fullsized":"2023-08-10T10:38:23.201532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202837+0000","last_change":"2023-08-10T10:38:21.206125+0000","last_active":"2023-08-10T10:38:23.202837+0000","last_peered":"2023-08-10T10:38:23.202837+0000","last_clean":"2023-08-10T10:38:23.202837+0000","last_became_active":"2023-08-10T10:38:21.205886+0000","last_became_peered":"2023-08-10T10:38:21.205886+0000","last_unstale":"2023-08-10T10:38:23.202837+0000","last_undegraded":"2023-08-10T10:38:23.202837+0000","last_fullsized":"2023-08-10T10:38:23.202837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201042+0000","last_change":"2023-08-10T10:38:22.215801+0000","last_active":"2023-08-10T10:38:23.201042+0000","last_peered":"2023-08-10T10:38:23.201042+0000","last_clean":"2023-08-10T10:38:23.201042+0000","last_became_active":"2023-08-10T10:38:22.212123+0000","last_became_peered":"2023-08-10T10:38:22.212123+0000","last_unstale":"2023-08-10T10:38:23.201042+0000","last_undegraded":"2023-08-10T10:38:23.201042+0000","last_fullsized":"2023-08-10T10:38:23.201042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201481+0000","last_change":"2023-08-10T10:38:21.201607+0000","last_active":"2023-08-10T10:38:23.201481+0000","last_peered":"2023-08-10T10:38:23.201481+0000","last_clean":"2023-08-10T10:38:23.201481+0000","last_became_active":"2023-08-10T10:38:21.201016+0000","last_became_peered":"2023-08-10T10:38:21.201016+0000","last_unstale":"2023-08-10T10:38:23.201481+0000","last_undegraded":"2023-08-10T10:38:23.201481+0000","last_fullsized":"2023-08-10T10:38:23.201481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202358+0000","last_change":"2023-08-10T10:38:22.222200+0000","last_active":"2023-08-10T10:38:23.202358+0000","last_peered":"2023-08-10T10:38:23.202358+0000","last_clean":"2023-08-10T10:38:23.202358+0000","last_became_active":"2023-08-10T10:38:22.220969+0000","last_became_peered":"2023-08-10T10:38:22.220969+0000","last_unstale":"2023-08-10T10:38:23.202358+0000","last_undegraded":"2023-08-10T10:38:23.202358+0000","last_fullsized":"2023-08-10T10:38:23.202358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325410+0000","last_change":"2023-08-10T10:38:21.204806+0000","last_active":"2023-08-10T10:38:23.325410+0000","last_peered":"2023-08-10T10:38:23.325410+0000","last_clean":"2023-08-10T10:38:23.325410+0000","last_became_active":"2023-08-10T10:38:21.204098+0000","last_became_peered":"2023-08-10T10:38:21.204098+0000","last_unstale":"2023-08-10T10:38:23.325410+0000","last_undegraded":"2023-08-10T10:38:23.325410+0000","last_fullsized":"2023-08-10T10:38:23.325410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194646,"statfs":{"total":200000000,"available":199318413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":86,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199908941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194649,"statfs":{"total":200000000,"available":199320630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:38:32.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:38:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.804+0000 7fcba451f640 1 Processor -- start 2023-08-10T10:38:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.804+0000 7fcba451f640 1 -- start start 2023-08-10T10:38:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.805+0000 7fcba451f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb9c159970 0x7fcb9c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.805+0000 7fcba451f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb9c069db0 0x7fcb9c0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba451f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c15e1f0 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba451f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c15d5e0 con 0x7fcb9c159970 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba451f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c15d8c0 con 0x7fcb9c069db0 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb9c159970 0x7fcb9c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb9c159970 0x7fcb9c0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33800/0 (socket says 172.21.15.50:33800) 2023-08-10T10:38:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 -- 172.21.15.50:0/1614852282 learned_addr learned my addr 172.21.15.50:0/1614852282 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba2abc640 1 --2- 172.21.15.50:0/1614852282 >> v2:172.21.15.117:3300/0 conn(0x7fcb9c069db0 0x7fcb9c0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 -- 172.21.15.50:0/1614852282 >> v2:172.21.15.117:3300/0 conn(0x7fcb9c069db0 msgr2=0x7fcb9c0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:32.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 --2- 172.21.15.50:0/1614852282 >> v2:172.21.15.117:3300/0 conn(0x7fcb9c069db0 0x7fcb9c0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 -- 172.21.15.50:0/1614852282 >> v1:172.21.15.117:6789/0 conn(0x7fcb9c0b0f00 legacy=0x7fcb9c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:32.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.806+0000 7fcba22bb640 1 -- 172.21.15.50:0/1614852282 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c15dba0 con 0x7fcb9c159970 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.807+0000 7fcba22bb640 1 --2- 172.21.15.50:0/1614852282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c159970 0x7fcb9c0b09c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0c5710 tx=0x7fcb9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b95beea39fb9da5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.808+0000 7fcba12b9640 1 -- 172.21.15.50:0/1614852282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98031870 con 0x7fcb9c159970 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.808+0000 7fcba12b9640 1 -- 172.21.15.50:0/1614852282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb980319d0 con 0x7fcb9c159970 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.808+0000 7fcba12b9640 1 -- 172.21.15.50:0/1614852282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98031d60 con 0x7fcb9c159970 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.808+0000 7fcba451f640 1 -- 172.21.15.50:0/1614852282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c159970 msgr2=0x7fcb9c0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.808+0000 7fcba451f640 1 --2- 172.21.15.50:0/1614852282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c159970 0x7fcb9c0b09c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0c5710 tx=0x7fcb9802b910 comp rx=0 tx=0).stop 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 -- 172.21.15.50:0/1614852282 shutdown_connections 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 --2- 172.21.15.50:0/1614852282 >> v2:172.21.15.117:3300/0 conn(0x7fcb9c069db0 0x7fcb9c0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 --2- 172.21.15.50:0/1614852282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c159970 0x7fcb9c0b09c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 -- 172.21.15.50:0/1614852282 >> 172.21.15.50:0/1614852282 conn(0x7fcb9c06b590 msgr2=0x7fcb9c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 -- 172.21.15.50:0/1614852282 shutdown_connections 2023-08-10T10:38:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.809+0000 7fcba451f640 1 -- 172.21.15.50:0/1614852282 wait complete. 2023-08-10T10:38:32.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.810+0000 7fcba451f640 1 Processor -- start 2023-08-10T10:38:32.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.811+0000 7fcba451f640 1 -- start start 2023-08-10T10:38:32.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.811+0000 7fcba451f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb9c069db0 0x7fcb9c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.811+0000 7fcba451f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba451f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 0x7fcb9c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba451f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c15d080 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba451f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0c6e90 con 0x7fcb9c159970 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba451f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0c7170 con 0x7fcb9c069db0 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba1aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba1aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33808/0 (socket says 172.21.15.50:33808) 2023-08-10T10:38:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba1aba640 1 -- 172.21.15.50:0/1178447558 learned_addr learned my addr 172.21.15.50:0/1178447558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba22bb640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb9c069db0 0x7fcb9c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.812+0000 7fcba2abc640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 0x7fcb9c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 -- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb9c069db0 msgr2=0x7fcb9c15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb9c069db0 0x7fcb9c15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 -- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 msgr2=0x7fcb9c0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 0x7fcb9c0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:32.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 -- 172.21.15.50:0/1178447558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980094d0 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba2abc640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 0x7fcb9c0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:32.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba1aba640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c430 tx=0x7fcb8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011790 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c0118f0 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011ce0 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c0c7450 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.813+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c0c7a10 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.814+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c04e270 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.815+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb8c01c460 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.816+0000 7fcb92ffd640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 0x7fcb8006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.816+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb8c0894b0 con 0x7fcb9c0b0f00 2023-08-10T10:38:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.817+0000 7fcba22bb640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 0x7fcb8006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:32.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.817+0000 7fcba22bb640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 0x7fcb8006d110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb98036000 tx=0x7fcb9803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:32.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.821+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb8c054550 con 0x7fcb9c0b0f00 2023-08-10T10:38:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:32.998+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb9c159d50 con 0x7fcb8006ac50 2023-08-10T10:38:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.007+0000 7fcb92ffd640 1 -- 172.21.15.50:0/1178447558 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280617 (secure 0 0 0) 0x7fcb98031bc0 con 0x7fcb8006ac50 2023-08-10T10:38:33.009 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:38:33.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.012+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 msgr2=0x7fcb8006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.012+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 0x7fcb8006d110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb98036000 tx=0x7fcb9803c040 comp rx=0 tx=0).stop 2023-08-10T10:38:33.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.012+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 msgr2=0x7fcb9c1503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.012+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c430 tx=0x7fcb8c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 shutdown_connections 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcb8006ac50 0x7fcb8006d110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9c159970 0x7fcb9c0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c0b0f00 0x7fcb9c1503e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 --2- 172.21.15.50:0/1178447558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb9c069db0 0x7fcb9c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 >> 172.21.15.50:0/1178447558 conn(0x7fcb9c06b590 msgr2=0x7fcb9c0cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:33.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 shutdown_connections 2023-08-10T10:38:33.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.013+0000 7fcba451f640 1 -- 172.21.15.50:0/1178447558 wait complete. 2023-08-10T10:38:33.033 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-10T10:38:32.322575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003724"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533984+0000","last_change":"2023-08-10T10:38:22.209741+0000","last_active":"2023-08-10T10:38:23.533984+0000","last_peered":"2023-08-10T10:38:23.533984+0000","last_clean":"2023-08-10T10:38:23.533984+0000","last_became_active":"2023-08-10T10:38:22.209086+0000","last_became_peered":"2023-08-10T10:38:22.209086+0000","last_unstale":"2023-08-10T10:38:23.533984+0000","last_undegraded":"2023-08-10T10:38:23.533984+0000","last_fullsized":"2023-08-10T10:38:23.533984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:26.818785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202298+0000","last_change":"2023-08-10T10:38:22.224666+0000","last_active":"2023-08-10T10:38:23.202298+0000","last_peered":"2023-08-10T10:38:23.202298+0000","last_clean":"2023-08-10T10:38:23.202298+0000","last_became_active":"2023-08-10T10:38:22.224412+0000","last_became_peered":"2023-08-10T10:38:22.224412+0000","last_unstale":"2023-08-10T10:38:23.202298+0000","last_undegraded":"2023-08-10T10:38:23.202298+0000","last_fullsized":"2023-08-10T10:38:23.202298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201886+0000","last_change":"2023-08-10T10:38:22.220964+0000","last_active":"2023-08-10T10:38:23.201886+0000","last_peered":"2023-08-10T10:38:23.201886+0000","last_clean":"2023-08-10T10:38:23.201886+0000","last_became_active":"2023-08-10T10:38:22.220680+0000","last_became_peered":"2023-08-10T10:38:22.220680+0000","last_unstale":"2023-08-10T10:38:23.201886+0000","last_undegraded":"2023-08-10T10:38:23.201886+0000","last_fullsized":"2023-08-10T10:38:23.201886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325437+0000","last_change":"2023-08-10T10:38:22.220325+0000","last_active":"2023-08-10T10:38:23.325437+0000","last_peered":"2023-08-10T10:38:23.325437+0000","last_clean":"2023-08-10T10:38:23.325437+0000","last_became_active":"2023-08-10T10:38:22.219756+0000","last_became_peered":"2023-08-10T10:38:22.219756+0000","last_unstale":"2023-08-10T10:38:23.325437+0000","last_undegraded":"2023-08-10T10:38:23.325437+0000","last_fullsized":"2023-08-10T10:38:23.325437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:57:37.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324712+0000","last_change":"2023-08-10T10:38:22.218733+0000","last_active":"2023-08-10T10:38:23.324712+0000","last_peered":"2023-08-10T10:38:23.324712+0000","last_clean":"2023-08-10T10:38:23.324712+0000","last_became_active":"2023-08-10T10:38:22.218457+0000","last_became_peered":"2023-08-10T10:38:22.218457+0000","last_unstale":"2023-08-10T10:38:23.324712+0000","last_undegraded":"2023-08-10T10:38:23.324712+0000","last_fullsized":"2023-08-10T10:38:23.324712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201252+0000","last_change":"2023-08-10T10:38:22.222593+0000","last_active":"2023-08-10T10:38:23.201252+0000","last_peered":"2023-08-10T10:38:23.201252+0000","last_clean":"2023-08-10T10:38:23.201252+0000","last_became_active":"2023-08-10T10:38:22.222180+0000","last_became_peered":"2023-08-10T10:38:22.222180+0000","last_unstale":"2023-08-10T10:38:23.201252+0000","last_undegraded":"2023-08-10T10:38:23.201252+0000","last_fullsized":"2023-08-10T10:38:23.201252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325878+0000","last_change":"2023-08-10T10:38:22.224370+0000","last_active":"2023-08-10T10:38:23.325878+0000","last_peered":"2023-08-10T10:38:23.325878+0000","last_clean":"2023-08-10T10:38:23.325878+0000","last_became_active":"2023-08-10T10:38:22.224117+0000","last_became_peered":"2023-08-10T10:38:22.224117+0000","last_unstale":"2023-08-10T10:38:23.325878+0000","last_undegraded":"2023-08-10T10:38:23.325878+0000","last_fullsized":"2023-08-10T10:38:23.325878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202295+0000","last_change":"2023-08-10T10:38:22.217074+0000","last_active":"2023-08-10T10:38:23.202295+0000","last_peered":"2023-08-10T10:38:23.202295+0000","last_clean":"2023-08-10T10:38:23.202295+0000","last_became_active":"2023-08-10T10:38:22.216567+0000","last_became_peered":"2023-08-10T10:38:22.216567+0000","last_unstale":"2023-08-10T10:38:23.202295+0000","last_undegraded":"2023-08-10T10:38:23.202295+0000","last_fullsized":"2023-08-10T10:38:23.202295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324543+0000","last_change":"2023-08-10T10:38:22.221017+0000","last_active":"2023-08-10T10:38:23.324543+0000","last_peered":"2023-08-10T10:38:23.324543+0000","last_clean":"2023-08-10T10:38:23.324543+0000","last_became_active":"2023-08-10T10:38:22.220731+0000","last_became_peered":"2023-08-10T10:38:22.220731+0000","last_unstale":"2023-08-10T10:38:23.324543+0000","last_undegraded":"2023-08-10T10:38:23.324543+0000","last_fullsized":"2023-08-10T10:38:23.324543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202425+0000","last_change":"2023-08-10T10:38:22.217793+0000","last_active":"2023-08-10T10:38:23.202425+0000","last_peered":"2023-08-10T10:38:23.202425+0000","last_clean":"2023-08-10T10:38:23.202425+0000","last_became_active":"2023-08-10T10:38:22.217531+0000","last_became_peered":"2023-08-10T10:38:22.217531+0000","last_unstale":"2023-08-10T10:38:23.202425+0000","last_undegraded":"2023-08-10T10:38:23.202425+0000","last_fullsized":"2023-08-10T10:38:23.202425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:29.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201607+0000","last_change":"2023-08-10T10:38:22.225166+0000","last_active":"2023-08-10T10:38:23.201607+0000","last_peered":"2023-08-10T10:38:23.201607+0000","last_clean":"2023-08-10T10:38:23.201607+0000","last_became_active":"2023-08-10T10:38:22.224921+0000","last_became_peered":"2023-08-10T10:38:22.224921+0000","last_unstale":"2023-08-10T10:38:23.201607+0000","last_undegraded":"2023-08-10T10:38:23.201607+0000","last_fullsized":"2023-08-10T10:38:23.201607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533966+0000","last_change":"2023-08-10T10:38:22.197404+0000","last_active":"2023-08-10T10:38:23.533966+0000","last_peered":"2023-08-10T10:38:23.533966+0000","last_clean":"2023-08-10T10:38:23.533966+0000","last_became_active":"2023-08-10T10:38:22.196746+0000","last_became_peered":"2023-08-10T10:38:22.196746+0000","last_unstale":"2023-08-10T10:38:23.533966+0000","last_undegraded":"2023-08-10T10:38:23.533966+0000","last_fullsized":"2023-08-10T10:38:23.533966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533643+0000","last_change":"2023-08-10T10:38:22.204317+0000","last_active":"2023-08-10T10:38:23.533643+0000","last_peered":"2023-08-10T10:38:23.533643+0000","last_clean":"2023-08-10T10:38:23.533643+0000","last_became_active":"2023-08-10T10:38:22.203630+0000","last_became_peered":"2023-08-10T10:38:22.203630+0000","last_unstale":"2023-08-10T10:38:23.533643+0000","last_undegraded":"2023-08-10T10:38:23.533643+0000","last_fullsized":"2023-08-10T10:38:23.533643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:08.468410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201451+0000","last_change":"2023-08-10T10:38:22.212769+0000","last_active":"2023-08-10T10:38:23.201451+0000","last_peered":"2023-08-10T10:38:23.201451+0000","last_clean":"2023-08-10T10:38:23.201451+0000","last_became_active":"2023-08-10T10:38:22.212324+0000","last_became_peered":"2023-08-10T10:38:22.212324+0000","last_unstale":"2023-08-10T10:38:23.201451+0000","last_undegraded":"2023-08-10T10:38:23.201451+0000","last_fullsized":"2023-08-10T10:38:23.201451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326152+0000","last_change":"2023-08-10T10:38:22.214280+0000","last_active":"2023-08-10T10:38:23.326152+0000","last_peered":"2023-08-10T10:38:23.326152+0000","last_clean":"2023-08-10T10:38:23.326152+0000","last_became_active":"2023-08-10T10:38:22.214007+0000","last_became_peered":"2023-08-10T10:38:22.214007+0000","last_unstale":"2023-08-10T10:38:23.326152+0000","last_undegraded":"2023-08-10T10:38:23.326152+0000","last_fullsized":"2023-08-10T10:38:23.326152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202287+0000","last_change":"2023-08-10T10:38:22.222420+0000","last_active":"2023-08-10T10:38:23.202287+0000","last_peered":"2023-08-10T10:38:23.202287+0000","last_clean":"2023-08-10T10:38:23.202287+0000","last_became_active":"2023-08-10T10:38:22.221840+0000","last_became_peered":"2023-08-10T10:38:22.221840+0000","last_unstale":"2023-08-10T10:38:23.202287+0000","last_undegraded":"2023-08-10T10:38:23.202287+0000","last_fullsized":"2023-08-10T10:38:23.202287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324343+0000","last_change":"2023-08-10T10:38:22.221851+0000","last_active":"2023-08-10T10:38:23.324343+0000","last_peered":"2023-08-10T10:38:23.324343+0000","last_clean":"2023-08-10T10:38:23.324343+0000","last_became_active":"2023-08-10T10:38:22.221350+0000","last_became_peered":"2023-08-10T10:38:22.221350+0000","last_unstale":"2023-08-10T10:38:23.324343+0000","last_undegraded":"2023-08-10T10:38:23.324343+0000","last_fullsized":"2023-08-10T10:38:23.324343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201197+0000","last_change":"2023-08-10T10:38:22.213747+0000","last_active":"2023-08-10T10:38:23.201197+0000","last_peered":"2023-08-10T10:38:23.201197+0000","last_clean":"2023-08-10T10:38:23.201197+0000","last_became_active":"2023-08-10T10:38:22.212182+0000","last_became_peered":"2023-08-10T10:38:22.212182+0000","last_unstale":"2023-08-10T10:38:23.201197+0000","last_undegraded":"2023-08-10T10:38:23.201197+0000","last_fullsized":"2023-08-10T10:38:23.201197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533917+0000","last_change":"2023-08-10T10:38:22.214414+0000","last_active":"2023-08-10T10:38:23.533917+0000","last_peered":"2023-08-10T10:38:23.533917+0000","last_clean":"2023-08-10T10:38:23.533917+0000","last_became_active":"2023-08-10T10:38:22.213797+0000","last_became_peered":"2023-08-10T10:38:22.213797+0000","last_unstale":"2023-08-10T10:38:23.533917+0000","last_undegraded":"2023-08-10T10:38:23.533917+0000","last_fullsized":"2023-08-10T10:38:23.533917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:17.187234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201675+0000","last_change":"2023-08-10T10:38:22.222520+0000","last_active":"2023-08-10T10:38:23.201675+0000","last_peered":"2023-08-10T10:38:23.201675+0000","last_clean":"2023-08-10T10:38:23.201675+0000","last_became_active":"2023-08-10T10:38:22.221771+0000","last_became_peered":"2023-08-10T10:38:22.221771+0000","last_unstale":"2023-08-10T10:38:23.201675+0000","last_undegraded":"2023-08-10T10:38:23.201675+0000","last_fullsized":"2023-08-10T10:38:23.201675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326586+0000","last_change":"2023-08-10T10:38:22.217371+0000","last_active":"2023-08-10T10:38:23.326586+0000","last_peered":"2023-08-10T10:38:23.326586+0000","last_clean":"2023-08-10T10:38:23.326586+0000","last_became_active":"2023-08-10T10:38:22.216957+0000","last_became_peered":"2023-08-10T10:38:22.216957+0000","last_unstale":"2023-08-10T10:38:23.326586+0000","last_undegraded":"2023-08-10T10:38:23.326586+0000","last_fullsized":"2023-08-10T10:38:23.326586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.692722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324539+0000","last_change":"2023-08-10T10:38:22.226850+0000","last_active":"2023-08-10T10:38:23.324539+0000","last_peered":"2023-08-10T10:38:23.324539+0000","last_clean":"2023-08-10T10:38:23.324539+0000","last_became_active":"2023-08-10T10:38:22.226586+0000","last_became_peered":"2023-08-10T10:38:22.226586+0000","last_unstale":"2023-08-10T10:38:23.324539+0000","last_undegraded":"2023-08-10T10:38:23.324539+0000","last_fullsized":"2023-08-10T10:38:23.324539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199969+0000","last_change":"2023-08-10T10:38:22.220488+0000","last_active":"2023-08-10T10:38:23.199969+0000","last_peered":"2023-08-10T10:38:23.199969+0000","last_clean":"2023-08-10T10:38:23.199969+0000","last_became_active":"2023-08-10T10:38:22.220213+0000","last_became_peered":"2023-08-10T10:38:22.220213+0000","last_unstale":"2023-08-10T10:38:23.199969+0000","last_undegraded":"2023-08-10T10:38:23.199969+0000","last_fullsized":"2023-08-10T10:38:23.199969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326905+0000","last_change":"2023-08-10T10:38:22.222504+0000","last_active":"2023-08-10T10:38:23.326905+0000","last_peered":"2023-08-10T10:38:23.326905+0000","last_clean":"2023-08-10T10:38:23.326905+0000","last_became_active":"2023-08-10T10:38:22.219256+0000","last_became_peered":"2023-08-10T10:38:22.219256+0000","last_unstale":"2023-08-10T10:38:23.326905+0000","last_undegraded":"2023-08-10T10:38:23.326905+0000","last_fullsized":"2023-08-10T10:38:23.326905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:27.097082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534822+0000","last_change":"2023-08-10T10:38:22.230697+0000","last_active":"2023-08-10T10:38:23.534822+0000","last_peered":"2023-08-10T10:38:23.534822+0000","last_clean":"2023-08-10T10:38:23.534822+0000","last_became_active":"2023-08-10T10:38:22.230177+0000","last_became_peered":"2023-08-10T10:38:22.230177+0000","last_unstale":"2023-08-10T10:38:23.534822+0000","last_undegraded":"2023-08-10T10:38:23.534822+0000","last_fullsized":"2023-08-10T10:38:23.534822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535514+0000","last_change":"2023-08-10T10:38:22.230488+0000","last_active":"2023-08-10T10:38:23.535514+0000","last_peered":"2023-08-10T10:38:23.535514+0000","last_clean":"2023-08-10T10:38:23.535514+0000","last_became_active":"2023-08-10T10:38:22.230126+0000","last_became_peered":"2023-08-10T10:38:22.230126+0000","last_unstale":"2023-08-10T10:38:23.535514+0000","last_undegraded":"2023-08-10T10:38:23.535514+0000","last_fullsized":"2023-08-10T10:38:23.535514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202624+0000","last_change":"2023-08-10T10:38:22.218566+0000","last_active":"2023-08-10T10:38:23.202624+0000","last_peered":"2023-08-10T10:38:23.202624+0000","last_clean":"2023-08-10T10:38:23.202624+0000","last_became_active":"2023-08-10T10:38:22.218315+0000","last_became_peered":"2023-08-10T10:38:22.218315+0000","last_unstale":"2023-08-10T10:38:23.202624+0000","last_undegraded":"2023-08-10T10:38:23.202624+0000","last_fullsized":"2023-08-10T10:38:23.202624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534276+0000","last_change":"2023-08-10T10:38:22.223531+0000","last_active":"2023-08-10T10:38:23.534276+0000","last_peered":"2023-08-10T10:38:23.534276+0000","last_clean":"2023-08-10T10:38:23.534276+0000","last_became_active":"2023-08-10T10:38:22.214439+0000","last_became_peered":"2023-08-10T10:38:22.214439+0000","last_unstale":"2023-08-10T10:38:23.534276+0000","last_undegraded":"2023-08-10T10:38:23.534276+0000","last_fullsized":"2023-08-10T10:38:23.534276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:00:42.027115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200614+0000","last_change":"2023-08-10T10:38:22.218268+0000","last_active":"2023-08-10T10:38:23.200614+0000","last_peered":"2023-08-10T10:38:23.200614+0000","last_clean":"2023-08-10T10:38:23.200614+0000","last_became_active":"2023-08-10T10:38:22.217322+0000","last_became_peered":"2023-08-10T10:38:22.217322+0000","last_unstale":"2023-08-10T10:38:23.200614+0000","last_undegraded":"2023-08-10T10:38:23.200614+0000","last_fullsized":"2023-08-10T10:38:23.200614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201983+0000","last_change":"2023-08-10T10:38:22.222356+0000","last_active":"2023-08-10T10:38:23.201983+0000","last_peered":"2023-08-10T10:38:23.201983+0000","last_clean":"2023-08-10T10:38:23.201983+0000","last_became_active":"2023-08-10T10:38:22.221452+0000","last_became_peered":"2023-08-10T10:38:22.221452+0000","last_unstale":"2023-08-10T10:38:23.201983+0000","last_undegraded":"2023-08-10T10:38:23.201983+0000","last_fullsized":"2023-08-10T10:38:23.201983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200438+0000","last_change":"2023-08-10T10:38:22.225427+0000","last_active":"2023-08-10T10:38:23.200438+0000","last_peered":"2023-08-10T10:38:23.200438+0000","last_clean":"2023-08-10T10:38:23.200438+0000","last_became_active":"2023-08-10T10:38:22.225202+0000","last_became_peered":"2023-08-10T10:38:22.225202+0000","last_unstale":"2023-08-10T10:38:23.200438+0000","last_undegraded":"2023-08-10T10:38:23.200438+0000","last_fullsized":"2023-08-10T10:38:23.200438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325176+0000","last_change":"2023-08-10T10:38:22.209191+0000","last_active":"2023-08-10T10:38:23.325176+0000","last_peered":"2023-08-10T10:38:23.325176+0000","last_clean":"2023-08-10T10:38:23.325176+0000","last_became_active":"2023-08-10T10:38:22.208584+0000","last_became_peered":"2023-08-10T10:38:22.208584+0000","last_unstale":"2023-08-10T10:38:23.325176+0000","last_undegraded":"2023-08-10T10:38:23.325176+0000","last_fullsized":"2023-08-10T10:38:23.325176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201306+0000","last_change":"2023-08-10T10:38:22.212595+0000","last_active":"2023-08-10T10:38:23.201306+0000","last_peered":"2023-08-10T10:38:23.201306+0000","last_clean":"2023-08-10T10:38:23.201306+0000","last_became_active":"2023-08-10T10:38:22.211581+0000","last_became_peered":"2023-08-10T10:38:22.211581+0000","last_unstale":"2023-08-10T10:38:23.201306+0000","last_undegraded":"2023-08-10T10:38:23.201306+0000","last_fullsized":"2023-08-10T10:38:23.201306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:11.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326485+0000","last_change":"2023-08-10T10:38:21.209499+0000","last_active":"2023-08-10T10:38:23.326485+0000","last_peered":"2023-08-10T10:38:23.326485+0000","last_clean":"2023-08-10T10:38:23.326485+0000","last_became_active":"2023-08-10T10:38:21.208930+0000","last_became_peered":"2023-08-10T10:38:21.208930+0000","last_unstale":"2023-08-10T10:38:23.326485+0000","last_undegraded":"2023-08-10T10:38:23.326485+0000","last_fullsized":"2023-08-10T10:38:23.326485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202626+0000","last_change":"2023-08-10T10:38:22.216900+0000","last_active":"2023-08-10T10:38:23.202626+0000","last_peered":"2023-08-10T10:38:23.202626+0000","last_clean":"2023-08-10T10:38:23.202626+0000","last_became_active":"2023-08-10T10:38:22.216199+0000","last_became_peered":"2023-08-10T10:38:22.216199+0000","last_unstale":"2023-08-10T10:38:23.202626+0000","last_undegraded":"2023-08-10T10:38:23.202626+0000","last_fullsized":"2023-08-10T10:38:23.202626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325918+0000","last_change":"2023-08-10T10:38:21.202495+0000","last_active":"2023-08-10T10:38:23.325918+0000","last_peered":"2023-08-10T10:38:23.325918+0000","last_clean":"2023-08-10T10:38:23.325918+0000","last_became_active":"2023-08-10T10:38:21.201907+0000","last_became_peered":"2023-08-10T10:38:21.201907+0000","last_unstale":"2023-08-10T10:38:23.325918+0000","last_undegraded":"2023-08-10T10:38:23.325918+0000","last_fullsized":"2023-08-10T10:38:23.325918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324734+0000","last_change":"2023-08-10T10:38:22.221638+0000","last_active":"2023-08-10T10:38:23.324734+0000","last_peered":"2023-08-10T10:38:23.324734+0000","last_clean":"2023-08-10T10:38:23.324734+0000","last_became_active":"2023-08-10T10:38:22.220935+0000","last_became_peered":"2023-08-10T10:38:22.220935+0000","last_unstale":"2023-08-10T10:38:23.324734+0000","last_undegraded":"2023-08-10T10:38:23.324734+0000","last_fullsized":"2023-08-10T10:38:23.324734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326520+0000","last_change":"2023-08-10T10:38:21.204133+0000","last_active":"2023-08-10T10:38:23.326520+0000","last_peered":"2023-08-10T10:38:23.326520+0000","last_clean":"2023-08-10T10:38:23.326520+0000","last_became_active":"2023-08-10T10:38:21.203842+0000","last_became_peered":"2023-08-10T10:38:21.203842+0000","last_unstale":"2023-08-10T10:38:23.326520+0000","last_undegraded":"2023-08-10T10:38:23.326520+0000","last_fullsized":"2023-08-10T10:38:23.326520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200052+0000","last_change":"2023-08-10T10:38:22.215664+0000","last_active":"2023-08-10T10:38:23.200052+0000","last_peered":"2023-08-10T10:38:23.200052+0000","last_clean":"2023-08-10T10:38:23.200052+0000","last_became_active":"2023-08-10T10:38:22.212636+0000","last_became_peered":"2023-08-10T10:38:22.212636+0000","last_unstale":"2023-08-10T10:38:23.200052+0000","last_undegraded":"2023-08-10T10:38:23.200052+0000","last_fullsized":"2023-08-10T10:38:23.200052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325452+0000","last_change":"2023-08-10T10:38:21.204543+0000","last_active":"2023-08-10T10:38:23.325452+0000","last_peered":"2023-08-10T10:38:23.325452+0000","last_clean":"2023-08-10T10:38:23.325452+0000","last_became_active":"2023-08-10T10:38:21.204298+0000","last_became_peered":"2023-08-10T10:38:21.204298+0000","last_unstale":"2023-08-10T10:38:23.325452+0000","last_undegraded":"2023-08-10T10:38:23.325452+0000","last_fullsized":"2023-08-10T10:38:23.325452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:42.165678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327421+0000","last_change":"2023-08-10T10:38:21.204939+0000","last_active":"2023-08-10T10:38:23.327421+0000","last_peered":"2023-08-10T10:38:23.327421+0000","last_clean":"2023-08-10T10:38:23.327421+0000","last_became_active":"2023-08-10T10:38:21.204670+0000","last_became_peered":"2023-08-10T10:38:21.204670+0000","last_unstale":"2023-08-10T10:38:23.327421+0000","last_undegraded":"2023-08-10T10:38:23.327421+0000","last_fullsized":"2023-08-10T10:38:23.327421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:15.925392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203322+0000","last_change":"2023-08-10T10:38:22.215812+0000","last_active":"2023-08-10T10:38:23.203322+0000","last_peered":"2023-08-10T10:38:23.203322+0000","last_clean":"2023-08-10T10:38:23.203322+0000","last_became_active":"2023-08-10T10:38:22.215518+0000","last_became_peered":"2023-08-10T10:38:22.215518+0000","last_unstale":"2023-08-10T10:38:23.203322+0000","last_undegraded":"2023-08-10T10:38:23.203322+0000","last_fullsized":"2023-08-10T10:38:23.203322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326826+0000","last_change":"2023-08-10T10:38:21.209700+0000","last_active":"2023-08-10T10:38:23.326826+0000","last_peered":"2023-08-10T10:38:23.326826+0000","last_clean":"2023-08-10T10:38:23.326826+0000","last_became_active":"2023-08-10T10:38:21.209258+0000","last_became_peered":"2023-08-10T10:38:21.209258+0000","last_unstale":"2023-08-10T10:38:23.326826+0000","last_undegraded":"2023-08-10T10:38:23.326826+0000","last_fullsized":"2023-08-10T10:38:23.326826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:10.268662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202875+0000","last_change":"2023-08-10T10:38:22.210784+0000","last_active":"2023-08-10T10:38:23.202875+0000","last_peered":"2023-08-10T10:38:23.202875+0000","last_clean":"2023-08-10T10:38:23.202875+0000","last_became_active":"2023-08-10T10:38:22.210275+0000","last_became_peered":"2023-08-10T10:38:22.210275+0000","last_unstale":"2023-08-10T10:38:23.202875+0000","last_undegraded":"2023-08-10T10:38:23.202875+0000","last_fullsized":"2023-08-10T10:38:23.202875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:31.071882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326869+0000","last_change":"2023-08-10T10:38:21.201970+0000","last_active":"2023-08-10T10:38:23.326869+0000","last_peered":"2023-08-10T10:38:23.326869+0000","last_clean":"2023-08-10T10:38:23.326869+0000","last_became_active":"2023-08-10T10:38:21.201599+0000","last_became_peered":"2023-08-10T10:38:21.201599+0000","last_unstale":"2023-08-10T10:38:23.326869+0000","last_undegraded":"2023-08-10T10:38:23.326869+0000","last_fullsized":"2023-08-10T10:38:23.326869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:15.895041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325811+0000","last_change":"2023-08-10T10:38:22.224729+0000","last_active":"2023-08-10T10:38:23.325811+0000","last_peered":"2023-08-10T10:38:23.325811+0000","last_clean":"2023-08-10T10:38:23.325811+0000","last_became_active":"2023-08-10T10:38:22.224473+0000","last_became_peered":"2023-08-10T10:38:22.224473+0000","last_unstale":"2023-08-10T10:38:23.325811+0000","last_undegraded":"2023-08-10T10:38:23.325811+0000","last_fullsized":"2023-08-10T10:38:23.325811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:32.356113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203242+0000","last_change":"2023-08-10T10:38:21.197513+0000","last_active":"2023-08-10T10:38:23.203242+0000","last_peered":"2023-08-10T10:38:23.203242+0000","last_clean":"2023-08-10T10:38:23.203242+0000","last_became_active":"2023-08-10T10:38:21.197186+0000","last_became_peered":"2023-08-10T10:38:21.197186+0000","last_unstale":"2023-08-10T10:38:23.203242+0000","last_undegraded":"2023-08-10T10:38:23.203242+0000","last_fullsized":"2023-08-10T10:38:23.203242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:10.021641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324784+0000","last_change":"2023-08-10T10:38:22.227601+0000","last_active":"2023-08-10T10:38:23.324784+0000","last_peered":"2023-08-10T10:38:23.324784+0000","last_clean":"2023-08-10T10:38:23.324784+0000","last_became_active":"2023-08-10T10:38:22.227145+0000","last_became_peered":"2023-08-10T10:38:22.227145+0000","last_unstale":"2023-08-10T10:38:23.324784+0000","last_undegraded":"2023-08-10T10:38:23.324784+0000","last_fullsized":"2023-08-10T10:38:23.324784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200784+0000","last_change":"2023-08-10T10:38:21.206280+0000","last_active":"2023-08-10T10:38:23.200784+0000","last_peered":"2023-08-10T10:38:23.200784+0000","last_clean":"2023-08-10T10:38:23.200784+0000","last_became_active":"2023-08-10T10:38:21.205889+0000","last_became_peered":"2023-08-10T10:38:21.205889+0000","last_unstale":"2023-08-10T10:38:23.200784+0000","last_undegraded":"2023-08-10T10:38:23.200784+0000","last_fullsized":"2023-08-10T10:38:23.200784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201888+0000","last_change":"2023-08-10T10:38:22.204248+0000","last_active":"2023-08-10T10:38:23.201888+0000","last_peered":"2023-08-10T10:38:23.201888+0000","last_clean":"2023-08-10T10:38:23.201888+0000","last_became_active":"2023-08-10T10:38:22.199227+0000","last_became_peered":"2023-08-10T10:38:22.199227+0000","last_unstale":"2023-08-10T10:38:23.201888+0000","last_undegraded":"2023-08-10T10:38:23.201888+0000","last_fullsized":"2023-08-10T10:38:23.201888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:59.728880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326432+0000","last_change":"2023-08-10T10:38:21.205456+0000","last_active":"2023-08-10T10:38:23.326432+0000","last_peered":"2023-08-10T10:38:23.326432+0000","last_clean":"2023-08-10T10:38:23.326432+0000","last_became_active":"2023-08-10T10:38:21.205215+0000","last_became_peered":"2023-08-10T10:38:21.205215+0000","last_unstale":"2023-08-10T10:38:23.326432+0000","last_undegraded":"2023-08-10T10:38:23.326432+0000","last_fullsized":"2023-08-10T10:38:23.326432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201985+0000","last_change":"2023-08-10T10:38:22.199554+0000","last_active":"2023-08-10T10:38:23.201985+0000","last_peered":"2023-08-10T10:38:23.201985+0000","last_clean":"2023-08-10T10:38:23.201985+0000","last_became_active":"2023-08-10T10:38:22.198747+0000","last_became_peered":"2023-08-10T10:38:22.198747+0000","last_unstale":"2023-08-10T10:38:23.201985+0000","last_undegraded":"2023-08-10T10:38:23.201985+0000","last_fullsized":"2023-08-10T10:38:23.201985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:34.611263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203786+0000","last_change":"2023-08-10T10:38:21.208724+0000","last_active":"2023-08-10T10:38:23.203786+0000","last_peered":"2023-08-10T10:38:23.203786+0000","last_clean":"2023-08-10T10:38:23.203786+0000","last_became_active":"2023-08-10T10:38:21.207707+0000","last_became_peered":"2023-08-10T10:38:21.207707+0000","last_unstale":"2023-08-10T10:38:23.203786+0000","last_undegraded":"2023-08-10T10:38:23.203786+0000","last_fullsized":"2023-08-10T10:38:23.203786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:26.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203495+0000","last_change":"2023-08-10T10:38:22.221214+0000","last_active":"2023-08-10T10:38:23.203495+0000","last_peered":"2023-08-10T10:38:23.203495+0000","last_clean":"2023-08-10T10:38:23.203495+0000","last_became_active":"2023-08-10T10:38:22.220236+0000","last_became_peered":"2023-08-10T10:38:22.220236+0000","last_unstale":"2023-08-10T10:38:23.203495+0000","last_undegraded":"2023-08-10T10:38:23.203495+0000","last_fullsized":"2023-08-10T10:38:23.203495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:16.910102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200842+0000","last_change":"2023-08-10T10:38:21.203702+0000","last_active":"2023-08-10T10:38:23.200842+0000","last_peered":"2023-08-10T10:38:23.200842+0000","last_clean":"2023-08-10T10:38:23.200842+0000","last_became_active":"2023-08-10T10:38:21.203440+0000","last_became_peered":"2023-08-10T10:38:21.203440+0000","last_unstale":"2023-08-10T10:38:23.200842+0000","last_undegraded":"2023-08-10T10:38:23.200842+0000","last_fullsized":"2023-08-10T10:38:23.200842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534365+0000","last_change":"2023-08-10T10:38:22.225268+0000","last_active":"2023-08-10T10:38:23.534365+0000","last_peered":"2023-08-10T10:38:23.534365+0000","last_clean":"2023-08-10T10:38:23.534365+0000","last_became_active":"2023-08-10T10:38:22.224857+0000","last_became_peered":"2023-08-10T10:38:22.224857+0000","last_unstale":"2023-08-10T10:38:23.534365+0000","last_undegraded":"2023-08-10T10:38:23.534365+0000","last_fullsized":"2023-08-10T10:38:23.534365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:08.274140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.328222+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:38:23.328222+0000","last_peered":"2023-08-10T10:38:23.328222+0000","last_clean":"2023-08-10T10:38:23.328222+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:38:23.328222+0000","last_undegraded":"2023-08-10T10:38:23.328222+0000","last_fullsized":"2023-08-10T10:38:23.328222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:21.161219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203958+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:38:23.203958+0000","last_peered":"2023-08-10T10:38:23.203958+0000","last_clean":"2023-08-10T10:38:23.203958+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:38:23.203958+0000","last_undegraded":"2023-08-10T10:38:23.203958+0000","last_fullsized":"2023-08-10T10:38:23.203958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:24.012056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201315+0000","last_change":"2023-08-10T10:38:21.202544+0000","last_active":"2023-08-10T10:38:23.201315+0000","last_peered":"2023-08-10T10:38:23.201315+0000","last_clean":"2023-08-10T10:38:23.201315+0000","last_became_active":"2023-08-10T10:38:21.202310+0000","last_became_peered":"2023-08-10T10:38:21.202310+0000","last_unstale":"2023-08-10T10:38:23.201315+0000","last_undegraded":"2023-08-10T10:38:23.201315+0000","last_fullsized":"2023-08-10T10:38:23.201315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326145+0000","last_change":"2023-08-10T10:38:22.220675+0000","last_active":"2023-08-10T10:38:23.326145+0000","last_peered":"2023-08-10T10:38:23.326145+0000","last_clean":"2023-08-10T10:38:23.326145+0000","last_became_active":"2023-08-10T10:38:22.220074+0000","last_became_peered":"2023-08-10T10:38:22.220074+0000","last_unstale":"2023-08-10T10:38:23.326145+0000","last_undegraded":"2023-08-10T10:38:23.326145+0000","last_fullsized":"2023-08-10T10:38:23.326145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:52.377630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327929+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:38:23.327929+0000","last_peered":"2023-08-10T10:38:23.327929+0000","last_clean":"2023-08-10T10:38:23.327929+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:38:23.327929+0000","last_undegraded":"2023-08-10T10:38:23.327929+0000","last_fullsized":"2023-08-10T10:38:23.327929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:11.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325615+0000","last_change":"2023-08-10T10:38:21.206286+0000","last_active":"2023-08-10T10:38:23.325615+0000","last_peered":"2023-08-10T10:38:23.325615+0000","last_clean":"2023-08-10T10:38:23.325615+0000","last_became_active":"2023-08-10T10:38:21.205708+0000","last_became_peered":"2023-08-10T10:38:21.205708+0000","last_unstale":"2023-08-10T10:38:23.325615+0000","last_undegraded":"2023-08-10T10:38:23.325615+0000","last_fullsized":"2023-08-10T10:38:23.325615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325132+0000","last_change":"2023-08-10T10:38:22.227415+0000","last_active":"2023-08-10T10:38:23.325132+0000","last_peered":"2023-08-10T10:38:23.325132+0000","last_clean":"2023-08-10T10:38:23.325132+0000","last_became_active":"2023-08-10T10:38:22.226780+0000","last_became_peered":"2023-08-10T10:38:22.226780+0000","last_unstale":"2023-08-10T10:38:23.325132+0000","last_undegraded":"2023-08-10T10:38:23.325132+0000","last_fullsized":"2023-08-10T10:38:23.325132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:10.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.533781+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:38:23.533781+0000","last_peered":"2023-08-10T10:38:23.533781+0000","last_clean":"2023-08-10T10:38:23.533781+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:38:23.533781+0000","last_undegraded":"2023-08-10T10:38:23.533781+0000","last_fullsized":"2023-08-10T10:38:23.533781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:41.319609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535282+0000","last_change":"2023-08-10T10:38:21.195201+0000","last_active":"2023-08-10T10:38:23.535282+0000","last_peered":"2023-08-10T10:38:23.535282+0000","last_clean":"2023-08-10T10:38:23.535282+0000","last_became_active":"2023-08-10T10:38:21.194755+0000","last_became_peered":"2023-08-10T10:38:21.194755+0000","last_unstale":"2023-08-10T10:38:23.535282+0000","last_undegraded":"2023-08-10T10:38:23.535282+0000","last_fullsized":"2023-08-10T10:38:23.535282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534544+0000","last_change":"2023-08-10T10:38:22.225863+0000","last_active":"2023-08-10T10:38:23.534544+0000","last_peered":"2023-08-10T10:38:23.534544+0000","last_clean":"2023-08-10T10:38:23.534544+0000","last_became_active":"2023-08-10T10:38:22.225087+0000","last_became_peered":"2023-08-10T10:38:22.225087+0000","last_unstale":"2023-08-10T10:38:23.534544+0000","last_undegraded":"2023-08-10T10:38:23.534544+0000","last_fullsized":"2023-08-10T10:38:23.534544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203433+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:38:23.203433+0000","last_peered":"2023-08-10T10:38:23.203433+0000","last_clean":"2023-08-10T10:38:23.203433+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:38:23.203433+0000","last_undegraded":"2023-08-10T10:38:23.203433+0000","last_fullsized":"2023-08-10T10:38:23.203433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.917501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202604+0000","last_change":"2023-08-10T10:38:21.208553+0000","last_active":"2023-08-10T10:38:23.202604+0000","last_peered":"2023-08-10T10:38:23.202604+0000","last_clean":"2023-08-10T10:38:23.202604+0000","last_became_active":"2023-08-10T10:38:21.207885+0000","last_became_peered":"2023-08-10T10:38:21.207885+0000","last_unstale":"2023-08-10T10:38:23.202604+0000","last_undegraded":"2023-08-10T10:38:23.202604+0000","last_fullsized":"2023-08-10T10:38:23.202604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534974+0000","last_change":"2023-08-10T10:38:22.209787+0000","last_active":"2023-08-10T10:38:23.534974+0000","last_peered":"2023-08-10T10:38:23.534974+0000","last_clean":"2023-08-10T10:38:23.534974+0000","last_became_active":"2023-08-10T10:38:22.209252+0000","last_became_peered":"2023-08-10T10:38:22.209252+0000","last_unstale":"2023-08-10T10:38:23.534974+0000","last_undegraded":"2023-08-10T10:38:23.534974+0000","last_fullsized":"2023-08-10T10:38:23.534974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201820+0000","last_change":"2023-08-10T10:38:21.199662+0000","last_active":"2023-08-10T10:38:23.201820+0000","last_peered":"2023-08-10T10:38:23.201820+0000","last_clean":"2023-08-10T10:38:23.201820+0000","last_became_active":"2023-08-10T10:38:21.199287+0000","last_became_peered":"2023-08-10T10:38:21.199287+0000","last_unstale":"2023-08-10T10:38:23.201820+0000","last_undegraded":"2023-08-10T10:38:23.201820+0000","last_fullsized":"2023-08-10T10:38:23.201820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535100+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:38:23.535100+0000","last_peered":"2023-08-10T10:38:23.535100+0000","last_clean":"2023-08-10T10:38:23.535100+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:38:23.535100+0000","last_undegraded":"2023-08-10T10:38:23.535100+0000","last_fullsized":"2023-08-10T10:38:23.535100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:52.669054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534779+0000","last_change":"2023-08-10T10:38:22.225637+0000","last_active":"2023-08-10T10:38:23.534779+0000","last_peered":"2023-08-10T10:38:23.534779+0000","last_clean":"2023-08-10T10:38:23.534779+0000","last_became_active":"2023-08-10T10:38:22.224629+0000","last_became_peered":"2023-08-10T10:38:22.224629+0000","last_unstale":"2023-08-10T10:38:23.534779+0000","last_undegraded":"2023-08-10T10:38:23.534779+0000","last_fullsized":"2023-08-10T10:38:23.534779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535040+0000","last_change":"2023-08-10T10:38:21.200714+0000","last_active":"2023-08-10T10:38:23.535040+0000","last_peered":"2023-08-10T10:38:23.535040+0000","last_clean":"2023-08-10T10:38:23.535040+0000","last_became_active":"2023-08-10T10:38:21.200451+0000","last_became_peered":"2023-08-10T10:38:21.200451+0000","last_unstale":"2023-08-10T10:38:23.535040+0000","last_undegraded":"2023-08-10T10:38:23.535040+0000","last_fullsized":"2023-08-10T10:38:23.535040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.327627+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:38:23.327627+0000","last_peered":"2023-08-10T10:38:23.327627+0000","last_clean":"2023-08-10T10:38:23.327627+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:38:23.327627+0000","last_undegraded":"2023-08-10T10:38:23.327627+0000","last_fullsized":"2023-08-10T10:38:23.327627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:23.252217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325297+0000","last_change":"2023-08-10T10:38:22.216529+0000","last_active":"2023-08-10T10:38:23.325297+0000","last_peered":"2023-08-10T10:38:23.325297+0000","last_clean":"2023-08-10T10:38:23.325297+0000","last_became_active":"2023-08-10T10:38:22.216258+0000","last_became_peered":"2023-08-10T10:38:22.216258+0000","last_unstale":"2023-08-10T10:38:23.325297+0000","last_undegraded":"2023-08-10T10:38:23.325297+0000","last_fullsized":"2023-08-10T10:38:23.325297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:54.894624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200984+0000","last_change":"2023-08-10T10:38:21.201020+0000","last_active":"2023-08-10T10:38:23.200984+0000","last_peered":"2023-08-10T10:38:23.200984+0000","last_clean":"2023-08-10T10:38:23.200984+0000","last_became_active":"2023-08-10T10:38:21.200776+0000","last_became_peered":"2023-08-10T10:38:21.200776+0000","last_unstale":"2023-08-10T10:38:23.200984+0000","last_undegraded":"2023-08-10T10:38:23.200984+0000","last_fullsized":"2023-08-10T10:38:23.200984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:33.596202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534460+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:38:23.534460+0000","last_peered":"2023-08-10T10:38:23.534460+0000","last_clean":"2023-08-10T10:38:23.534460+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:38:23.534460+0000","last_undegraded":"2023-08-10T10:38:23.534460+0000","last_fullsized":"2023-08-10T10:38:23.534460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:50.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200047+0000","last_change":"2023-08-10T10:38:22.218095+0000","last_active":"2023-08-10T10:38:23.200047+0000","last_peered":"2023-08-10T10:38:23.200047+0000","last_clean":"2023-08-10T10:38:23.200047+0000","last_became_active":"2023-08-10T10:38:22.216987+0000","last_became_peered":"2023-08-10T10:38:22.216987+0000","last_unstale":"2023-08-10T10:38:23.200047+0000","last_undegraded":"2023-08-10T10:38:23.200047+0000","last_fullsized":"2023-08-10T10:38:23.200047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:57.541200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.343733+0000","last_change":"2023-08-10T10:38:21.205196+0000","last_active":"2023-08-10T10:38:23.343733+0000","last_peered":"2023-08-10T10:38:23.343733+0000","last_clean":"2023-08-10T10:38:23.343733+0000","last_became_active":"2023-08-10T10:38:21.204571+0000","last_became_peered":"2023-08-10T10:38:21.204571+0000","last_unstale":"2023-08-10T10:38:23.343733+0000","last_undegraded":"2023-08-10T10:38:23.343733+0000","last_fullsized":"2023-08-10T10:38:23.343733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:58.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325403+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:38:23.325403+0000","last_peered":"2023-08-10T10:38:23.325403+0000","last_clean":"2023-08-10T10:38:23.325403+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:38:23.325403+0000","last_undegraded":"2023-08-10T10:38:23.325403+0000","last_fullsized":"2023-08-10T10:38:23.325403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:25:42.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202232+0000","last_change":"2023-08-10T10:38:22.220123+0000","last_active":"2023-08-10T10:38:23.202232+0000","last_peered":"2023-08-10T10:38:23.202232+0000","last_clean":"2023-08-10T10:38:23.202232+0000","last_became_active":"2023-08-10T10:38:22.214781+0000","last_became_peered":"2023-08-10T10:38:22.214781+0000","last_unstale":"2023-08-10T10:38:23.202232+0000","last_undegraded":"2023-08-10T10:38:23.202232+0000","last_fullsized":"2023-08-10T10:38:23.202232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203196+0000","last_change":"2023-08-10T10:38:22.222039+0000","last_active":"2023-08-10T10:38:23.203196+0000","last_peered":"2023-08-10T10:38:23.203196+0000","last_clean":"2023-08-10T10:38:23.203196+0000","last_became_active":"2023-08-10T10:38:22.220581+0000","last_became_peered":"2023-08-10T10:38:22.220581+0000","last_unstale":"2023-08-10T10:38:23.203196+0000","last_undegraded":"2023-08-10T10:38:23.203196+0000","last_fullsized":"2023-08-10T10:38:23.203196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:11.283723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201459+0000","last_change":"2023-08-10T10:38:21.203533+0000","last_active":"2023-08-10T10:38:23.201459+0000","last_peered":"2023-08-10T10:38:23.201459+0000","last_clean":"2023-08-10T10:38:23.201459+0000","last_became_active":"2023-08-10T10:38:21.203281+0000","last_became_peered":"2023-08-10T10:38:21.203281+0000","last_unstale":"2023-08-10T10:38:23.201459+0000","last_undegraded":"2023-08-10T10:38:23.201459+0000","last_fullsized":"2023-08-10T10:38:23.201459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:26.689515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.535765+0000","last_change":"2023-08-10T10:38:22.224954+0000","last_active":"2023-08-10T10:38:23.535765+0000","last_peered":"2023-08-10T10:38:23.535765+0000","last_clean":"2023-08-10T10:38:23.535765+0000","last_became_active":"2023-08-10T10:38:22.224681+0000","last_became_peered":"2023-08-10T10:38:22.224681+0000","last_unstale":"2023-08-10T10:38:23.535765+0000","last_undegraded":"2023-08-10T10:38:23.535765+0000","last_fullsized":"2023-08-10T10:38:23.535765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:25.523274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.326588+0000","last_change":"2023-08-10T10:38:21.203411+0000","last_active":"2023-08-10T10:38:23.326588+0000","last_peered":"2023-08-10T10:38:23.326588+0000","last_clean":"2023-08-10T10:38:23.326588+0000","last_became_active":"2023-08-10T10:38:21.203148+0000","last_became_peered":"2023-08-10T10:38:21.203148+0000","last_unstale":"2023-08-10T10:38:23.326588+0000","last_undegraded":"2023-08-10T10:38:23.326588+0000","last_fullsized":"2023-08-10T10:38:23.326588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:30.056821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202965+0000","last_change":"2023-08-10T10:38:21.201006+0000","last_active":"2023-08-10T10:38:23.202965+0000","last_peered":"2023-08-10T10:38:23.202965+0000","last_clean":"2023-08-10T10:38:23.202965+0000","last_became_active":"2023-08-10T10:38:21.200714+0000","last_became_peered":"2023-08-10T10:38:21.200714+0000","last_unstale":"2023-08-10T10:38:23.202965+0000","last_undegraded":"2023-08-10T10:38:23.202965+0000","last_fullsized":"2023-08-10T10:38:23.202965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:24.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200418+0000","last_change":"2023-08-10T10:38:22.215890+0000","last_active":"2023-08-10T10:38:23.200418+0000","last_peered":"2023-08-10T10:38:23.200418+0000","last_clean":"2023-08-10T10:38:23.200418+0000","last_became_active":"2023-08-10T10:38:22.215479+0000","last_became_peered":"2023-08-10T10:38:22.215479+0000","last_unstale":"2023-08-10T10:38:23.200418+0000","last_undegraded":"2023-08-10T10:38:23.200418+0000","last_fullsized":"2023-08-10T10:38:23.200418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325621+0000","last_change":"2023-08-10T10:38:21.202668+0000","last_active":"2023-08-10T10:38:23.325621+0000","last_peered":"2023-08-10T10:38:23.325621+0000","last_clean":"2023-08-10T10:38:23.325621+0000","last_became_active":"2023-08-10T10:38:21.202245+0000","last_became_peered":"2023-08-10T10:38:21.202245+0000","last_unstale":"2023-08-10T10:38:23.325621+0000","last_undegraded":"2023-08-10T10:38:23.325621+0000","last_fullsized":"2023-08-10T10:38:23.325621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:58.713819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200327+0000","last_change":"2023-08-10T10:38:22.206881+0000","last_active":"2023-08-10T10:38:23.200327+0000","last_peered":"2023-08-10T10:38:23.200327+0000","last_clean":"2023-08-10T10:38:23.200327+0000","last_became_active":"2023-08-10T10:38:22.206376+0000","last_became_peered":"2023-08-10T10:38:22.206376+0000","last_unstale":"2023-08-10T10:38:23.200327+0000","last_undegraded":"2023-08-10T10:38:23.200327+0000","last_fullsized":"2023-08-10T10:38:23.200327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:27.704576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325097+0000","last_change":"2023-08-10T10:38:22.219281+0000","last_active":"2023-08-10T10:38:23.325097+0000","last_peered":"2023-08-10T10:38:23.325097+0000","last_clean":"2023-08-10T10:38:23.325097+0000","last_became_active":"2023-08-10T10:38:22.219015+0000","last_became_peered":"2023-08-10T10:38:22.219015+0000","last_unstale":"2023-08-10T10:38:23.325097+0000","last_undegraded":"2023-08-10T10:38:23.325097+0000","last_fullsized":"2023-08-10T10:38:23.325097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:34.563995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.200334+0000","last_change":"2023-08-10T10:38:21.203137+0000","last_active":"2023-08-10T10:38:23.200334+0000","last_peered":"2023-08-10T10:38:23.200334+0000","last_clean":"2023-08-10T10:38:23.200334+0000","last_became_active":"2023-08-10T10:38:21.202879+0000","last_became_peered":"2023-08-10T10:38:21.202879+0000","last_unstale":"2023-08-10T10:38:23.200334+0000","last_undegraded":"2023-08-10T10:38:23.200334+0000","last_fullsized":"2023-08-10T10:38:23.200334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324925+0000","last_change":"2023-08-10T10:38:22.216641+0000","last_active":"2023-08-10T10:38:23.324925+0000","last_peered":"2023-08-10T10:38:23.324925+0000","last_clean":"2023-08-10T10:38:23.324925+0000","last_became_active":"2023-08-10T10:38:22.216326+0000","last_became_peered":"2023-08-10T10:38:22.216326+0000","last_unstale":"2023-08-10T10:38:23.324925+0000","last_undegraded":"2023-08-10T10:38:23.324925+0000","last_fullsized":"2023-08-10T10:38:23.324925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534753+0000","last_change":"2023-08-10T10:38:21.196362+0000","last_active":"2023-08-10T10:38:23.534753+0000","last_peered":"2023-08-10T10:38:23.534753+0000","last_clean":"2023-08-10T10:38:23.534753+0000","last_became_active":"2023-08-10T10:38:21.196026+0000","last_became_peered":"2023-08-10T10:38:21.196026+0000","last_unstale":"2023-08-10T10:38:23.534753+0000","last_undegraded":"2023-08-10T10:38:23.534753+0000","last_fullsized":"2023-08-10T10:38:23.534753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:31.727398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.199967+0000","last_change":"2023-08-10T10:38:22.211342+0000","last_active":"2023-08-10T10:38:23.199967+0000","last_peered":"2023-08-10T10:38:23.199967+0000","last_clean":"2023-08-10T10:38:23.199967+0000","last_became_active":"2023-08-10T10:38:22.210963+0000","last_became_peered":"2023-08-10T10:38:22.210963+0000","last_unstale":"2023-08-10T10:38:23.199967+0000","last_undegraded":"2023-08-10T10:38:23.199967+0000","last_fullsized":"2023-08-10T10:38:23.199967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:34.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202602+0000","last_change":"2023-08-10T10:38:21.192358+0000","last_active":"2023-08-10T10:38:23.202602+0000","last_peered":"2023-08-10T10:38:23.202602+0000","last_clean":"2023-08-10T10:38:23.202602+0000","last_became_active":"2023-08-10T10:38:21.188537+0000","last_became_peered":"2023-08-10T10:38:21.188537+0000","last_unstale":"2023-08-10T10:38:23.202602+0000","last_undegraded":"2023-08-10T10:38:23.202602+0000","last_fullsized":"2023-08-10T10:38:23.202602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:22.962266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.534112+0000","last_change":"2023-08-10T10:38:22.227114+0000","last_active":"2023-08-10T10:38:23.534112+0000","last_peered":"2023-08-10T10:38:23.534112+0000","last_clean":"2023-08-10T10:38:23.534112+0000","last_became_active":"2023-08-10T10:38:22.226785+0000","last_became_peered":"2023-08-10T10:38:22.226785+0000","last_unstale":"2023-08-10T10:38:23.534112+0000","last_undegraded":"2023-08-10T10:38:23.534112+0000","last_fullsized":"2023-08-10T10:38:23.534112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:12.508706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.324921+0000","last_change":"2023-08-10T10:38:21.205454+0000","last_active":"2023-08-10T10:38:23.324921+0000","last_peered":"2023-08-10T10:38:23.324921+0000","last_clean":"2023-08-10T10:38:23.324921+0000","last_became_active":"2023-08-10T10:38:21.204999+0000","last_became_peered":"2023-08-10T10:38:21.204999+0000","last_unstale":"2023-08-10T10:38:23.324921+0000","last_undegraded":"2023-08-10T10:38:23.324921+0000","last_fullsized":"2023-08-10T10:38:23.324921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:39.722282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201533+0000","last_change":"2023-08-10T10:38:22.204621+0000","last_active":"2023-08-10T10:38:23.201533+0000","last_peered":"2023-08-10T10:38:23.201533+0000","last_clean":"2023-08-10T10:38:23.201533+0000","last_became_active":"2023-08-10T10:38:22.203468+0000","last_became_peered":"2023-08-10T10:38:22.203468+0000","last_unstale":"2023-08-10T10:38:23.201533+0000","last_undegraded":"2023-08-10T10:38:23.201533+0000","last_fullsized":"2023-08-10T10:38:23.201533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:32.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.203621+0000","last_change":"2023-08-10T10:38:21.205716+0000","last_active":"2023-08-10T10:38:23.203621+0000","last_peered":"2023-08-10T10:38:23.203621+0000","last_clean":"2023-08-10T10:38:23.203621+0000","last_became_active":"2023-08-10T10:38:21.205452+0000","last_became_peered":"2023-08-10T10:38:21.205452+0000","last_unstale":"2023-08-10T10:38:23.203621+0000","last_undegraded":"2023-08-10T10:38:23.203621+0000","last_fullsized":"2023-08-10T10:38:23.203621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:48.677661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201532+0000","last_change":"2023-08-10T10:38:22.204384+0000","last_active":"2023-08-10T10:38:23.201532+0000","last_peered":"2023-08-10T10:38:23.201532+0000","last_clean":"2023-08-10T10:38:23.201532+0000","last_became_active":"2023-08-10T10:38:22.203734+0000","last_became_peered":"2023-08-10T10:38:22.203734+0000","last_unstale":"2023-08-10T10:38:23.201532+0000","last_undegraded":"2023-08-10T10:38:23.201532+0000","last_fullsized":"2023-08-10T10:38:23.201532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.737343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202837+0000","last_change":"2023-08-10T10:38:21.206125+0000","last_active":"2023-08-10T10:38:23.202837+0000","last_peered":"2023-08-10T10:38:23.202837+0000","last_clean":"2023-08-10T10:38:23.202837+0000","last_became_active":"2023-08-10T10:38:21.205886+0000","last_became_peered":"2023-08-10T10:38:21.205886+0000","last_unstale":"2023-08-10T10:38:23.202837+0000","last_undegraded":"2023-08-10T10:38:23.202837+0000","last_fullsized":"2023-08-10T10:38:23.202837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.602112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201042+0000","last_change":"2023-08-10T10:38:22.215801+0000","last_active":"2023-08-10T10:38:23.201042+0000","last_peered":"2023-08-10T10:38:23.201042+0000","last_clean":"2023-08-10T10:38:23.201042+0000","last_became_active":"2023-08-10T10:38:22.212123+0000","last_became_peered":"2023-08-10T10:38:22.212123+0000","last_unstale":"2023-08-10T10:38:23.201042+0000","last_undegraded":"2023-08-10T10:38:23.201042+0000","last_fullsized":"2023-08-10T10:38:23.201042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:27.617173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.201481+0000","last_change":"2023-08-10T10:38:21.201607+0000","last_active":"2023-08-10T10:38:23.201481+0000","last_peered":"2023-08-10T10:38:23.201481+0000","last_clean":"2023-08-10T10:38:23.201481+0000","last_became_active":"2023-08-10T10:38:21.201016+0000","last_became_peered":"2023-08-10T10:38:21.201016+0000","last_unstale":"2023-08-10T10:38:23.201481+0000","last_undegraded":"2023-08-10T10:38:23.201481+0000","last_fullsized":"2023-08-10T10:38:23.201481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:01.038512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.202358+0000","last_change":"2023-08-10T10:38:22.222200+0000","last_active":"2023-08-10T10:38:23.202358+0000","last_peered":"2023-08-10T10:38:23.202358+0000","last_clean":"2023-08-10T10:38:23.202358+0000","last_became_active":"2023-08-10T10:38:22.220969+0000","last_became_peered":"2023-08-10T10:38:22.220969+0000","last_unstale":"2023-08-10T10:38:23.202358+0000","last_undegraded":"2023-08-10T10:38:23.202358+0000","last_fullsized":"2023-08-10T10:38:23.202358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:21.162035+0000","last_clean_scrub_stamp":"2023-08-10T10:38:21.162035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:02.053573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-10T10:38:23.325410+0000","last_change":"2023-08-10T10:38:21.204806+0000","last_active":"2023-08-10T10:38:23.325410+0000","last_peered":"2023-08-10T10:38:23.325410+0000","last_clean":"2023-08-10T10:38:23.325410+0000","last_became_active":"2023-08-10T10:38:21.204098+0000","last_became_peered":"2023-08-10T10:38:21.204098+0000","last_unstale":"2023-08-10T10:38:23.325410+0000","last_undegraded":"2023-08-10T10:38:23.325410+0000","last_fullsized":"2023-08-10T10:38:23.325410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:20.146973+0000","last_clean_scrub_stamp":"2023-08-10T10:38:20.146973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:28.586804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194646,"statfs":{"total":200000000,"available":199318413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":86,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199908941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194649,"statfs":{"total":200000000,"available":199320630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:38:33.039 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-10T10:38:33.040 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-10T10:38:33.040 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-10T10:38:33.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-10T10:38:33.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.289+0000 7f1e34b47640 1 Processor -- start 2023-08-10T10:38:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.289+0000 7f1e34b47640 1 -- start start 2023-08-10T10:38:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e34b47640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e300ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e34b47640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e3006ea80 0x7f1e300cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e34b47640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3006a490 con 0x7f1e3006eee0 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e34b47640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3006c510 con 0x7f1e3006ea80 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e34b47640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3006bd00 con 0x7f1e30159760 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e2ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1e3006eee0 0x7f1e3006aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37340/0 (socket says 172.21.15.50:37340) 2023-08-10T10:38:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.290+0000 7f1e2ed9d640 1 -- 172.21.15.50:0/4062625448 learned_addr learned my addr 172.21.15.50:0/4062625448 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e300ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607856776 0 0) 0x7f1e3006a490 con 0x7f1e3006eee0 2023-08-10T10:38:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e18003520 con 0x7f1e3006eee0 2023-08-10T10:38:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/4062625448 >> v2:172.21.15.117:3300/0 conn(0x7f1e3006ea80 0x7f1e300cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300097308 0 0) 0x7f1e18003520 con 0x7f1e3006eee0 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 msgr2=0x7f1e300ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e300ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 >> v2:172.21.15.117:3300/0 conn(0x7f1e3006ea80 msgr2=0x7f1e300cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 --2- 172.21.15.50:0/4062625448 >> v2:172.21.15.117:3300/0 conn(0x7f1e3006ea80 0x7f1e300cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3006bf50 con 0x7f1e3006eee0 2023-08-10T10:38:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1e28001670 con 0x7f1e3006eee0 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 >> v1:172.21.15.50:6789/0 conn(0x7f1e3006eee0 legacy=0x7f1e3006aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e18003970 0x7f1e18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3006c510 con 0x7f1e180047c0 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3006bd00 con 0x7f1e18003970 2023-08-10T10:38:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.291+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1800b980 con 0x7f1e30159760 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2ed9d640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e18003970 0x7f1e18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 -- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 msgr2=0x7f1e18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 -- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e18003970 msgr2=0x7f1e18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e18003970 0x7f1e18003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2dd9b640 1 -- 172.21.15.50:0/4062625448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18003520 con 0x7f1e180047c0 2023-08-10T10:38:33.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2ed9d640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e30159760 0x7f1e18005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:33.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.292+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e18003970 0x7f1e18003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.293+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e18004c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ba30 tx=0x7f1e180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb52aaef736a43 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24032680 con 0x7f1e180047c0 2023-08-10T10:38:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e240327e0 con 0x7f1e180047c0 2023-08-10T10:38:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e2d59a640 1 -- 172.21.15.50:0/4062625448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24032b70 con 0x7f1e180047c0 2023-08-10T10:38:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 -- 172.21.15.50:0/4062625448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 msgr2=0x7f1e18004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 --2- 172.21.15.50:0/4062625448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e18004c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ba30 tx=0x7f1e180057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e2ed9d640 1 -- 172.21.15.50:0/4062625448 reap_dead start 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 -- 172.21.15.50:0/4062625448 shutdown_connections 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 -- 172.21.15.50:0/4062625448 >> 172.21.15.50:0/4062625448 conn(0x7f1e300cb7a0 msgr2=0x7f1e300ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 -- 172.21.15.50:0/4062625448 shutdown_connections 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.294+0000 7f1e34b47640 1 -- 172.21.15.50:0/4062625448 wait complete. 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.296+0000 7f1e34b47640 1 Processor -- start 2023-08-10T10:38:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.296+0000 7f1e34b47640 1 -- start start 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e30150530 0x7f1e30145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e301520b0 0x7f1e300bc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301525b0 con 0x7f1e180047c0 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300be760 con 0x7f1e30150530 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e34b47640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300be480 con 0x7f1e301520b0 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33812/0 (socket says 172.21.15.50:33812) 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.297+0000 7f1e2e59c640 1 -- 172.21.15.50:0/702152518 learned_addr learned my addr 172.21.15.50:0/702152518 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 -- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e301520b0 msgr2=0x7f1e300bc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e301520b0 0x7f1e300bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 -- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e30150530 msgr2=0x7f1e30145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e30150530 0x7f1e30145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 -- 172.21.15.50:0/702152518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30150ad0 con 0x7f1e180047c0 2023-08-10T10:38:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e2e59c640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000f350 tx=0x7f1e2000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20003b90 con 0x7f1e180047c0 2023-08-10T10:38:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e20011040 con 0x7f1e180047c0 2023-08-10T10:38:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20004020 con 0x7f1e180047c0 2023-08-10T10:38:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e30150db0 con 0x7f1e180047c0 2023-08-10T10:38:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.298+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e301460b0 con 0x7f1e180047c0 2023-08-10T10:38:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.299+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3004e270 con 0x7f1e180047c0 2023-08-10T10:38:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.300+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e20004180 con 0x7f1e180047c0 2023-08-10T10:38:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.301+0000 7f1e1effd640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 0x7f1e1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.301+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e20089c90 con 0x7f1e180047c0 2023-08-10T10:38:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.301+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 0x7f1e1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.302+0000 7f1e2dd9b640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 0x7f1e1006d110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ba00 tx=0x7f1e24032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.305+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e20054ca0 con 0x7f1e180047c0 2023-08-10T10:38:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.532+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e300cf530 con 0x7f1e180047c0 2023-08-10T10:38:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.533+0000 7f1e1effd640 1 -- 172.21.15.50:0/702152518 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1e200582c0 con 0x7f1e180047c0 2023-08-10T10:38:33.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:33.534 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-10T10:38:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 msgr2=0x7f1e1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 0x7f1e1006d110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ba00 tx=0x7f1e24032000 comp rx=0 tx=0).stop 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 msgr2=0x7f1e300ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000f350 tx=0x7f1e2000f810 comp rx=0 tx=0).stop 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 shutdown_connections 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e301520b0 0x7f1e300bc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e1006ac50 0x7f1e1006d110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e30150530 0x7f1e30145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 --2- 172.21.15.50:0/702152518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e180047c0 0x7f1e300ba370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 >> 172.21.15.50:0/702152518 conn(0x7f1e300cb7a0 msgr2=0x7f1e300c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:33.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 shutdown_connections 2023-08-10T10:38:33.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.535+0000 7f1e34b47640 1 -- 172.21.15.50:0/702152518 wait complete. 2023-08-10T10:38:33.555 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-10T10:38:33.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:33.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.785+0000 7fcfae9b2640 1 Processor -- start 2023-08-10T10:38:33.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.786+0000 7fcfae9b2640 1 -- start start 2023-08-10T10:38:33.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfae9b2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfa8159830 0x7fcfa80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfae9b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80c9d00 0x7fcfa815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfae9b2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80cc5a0 con 0x7fcfa815e0f0 2023-08-10T10:38:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfae9b2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80b4170 con 0x7fcfa80c9d00 2023-08-10T10:38:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfae9b2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815d720 con 0x7fcfa8159830 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.787+0000 7fcfad1af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80c9d00 0x7fcfa815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80c9d00 0x7fcfa815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33818/0 (socket says 172.21.15.50:33818) 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 -- 172.21.15.50:0/136334079 learned_addr learned my addr 172.21.15.50:0/136334079 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad9b0640 1 --2- 172.21.15.50:0/136334079 >> v2:172.21.15.117:3300/0 conn(0x7fcfa8159830 0x7fcfa80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 -- 172.21.15.50:0/136334079 >> v2:172.21.15.117:3300/0 conn(0x7fcfa8159830 msgr2=0x7fcfa80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 --2- 172.21.15.50:0/136334079 >> v2:172.21.15.117:3300/0 conn(0x7fcfa8159830 0x7fcfa80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 -- 172.21.15.50:0/136334079 >> v1:172.21.15.117:6789/0 conn(0x7fcfa815e0f0 legacy=0x7fcfa80cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:33.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.788+0000 7fcfad1af640 1 -- 172.21.15.50:0/136334079 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8159c10 con 0x7fcfa80c9d00 2023-08-10T10:38:33.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.789+0000 7fcfad1af640 1 --2- 172.21.15.50:0/136334079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa815dbb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cf590 tx=0x7fcf9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608d54bdbb39228f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfac9ae640 1 -- 172.21.15.50:0/136334079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98031870 con 0x7fcfa80c9d00 2023-08-10T10:38:33.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfac9ae640 1 -- 172.21.15.50:0/136334079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf980319d0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfac9ae640 1 -- 172.21.15.50:0/136334079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98031d60 con 0x7fcfa80c9d00 2023-08-10T10:38:33.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 -- 172.21.15.50:0/136334079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 msgr2=0x7fcfa815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/136334079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa815dbb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cf590 tx=0x7fcf9802b910 comp rx=0 tx=0).stop 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 -- 172.21.15.50:0/136334079 shutdown_connections 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/136334079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa815dbb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/136334079 >> v2:172.21.15.117:3300/0 conn(0x7fcfa8159830 0x7fcfa80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 -- 172.21.15.50:0/136334079 >> 172.21.15.50:0/136334079 conn(0x7fcfa806ab80 msgr2=0x7fcfa806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 -- 172.21.15.50:0/136334079 shutdown_connections 2023-08-10T10:38:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.790+0000 7fcfae9b2640 1 -- 172.21.15.50:0/136334079 wait complete. 2023-08-10T10:38:33.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.792+0000 7fcfae9b2640 1 Processor -- start 2023-08-10T10:38:33.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.792+0000 7fcfae9b2640 1 -- start start 2023-08-10T10:38:33.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 0x7fcfa80acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa80c3fb0 0x7fcfa8151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81f64e0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81f5860 con 0x7fcfa80c3fb0 2023-08-10T10:38:33.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.793+0000 7fcfae9b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81f5b40 con 0x7fcfa8159830 2023-08-10T10:38:33.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33832/0 (socket says 172.21.15.50:33832) 2023-08-10T10:38:33.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 -- 172.21.15.50:0/4103694163 learned_addr learned my addr 172.21.15.50:0/4103694163 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfae1b1640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa80c3fb0 0x7fcfa8151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad1af640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 0x7fcfa80acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 -- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 msgr2=0x7fcfa80acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 0x7fcfa80acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 -- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa80c3fb0 msgr2=0x7fcfa8151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa80c3fb0 0x7fcfa8151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 -- 172.21.15.50:0/4103694163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980094d0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad1af640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 0x7fcfa80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.794+0000 7fcfad9b0640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d800 tx=0x7fcfa400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.795+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400b6c0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.795+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400b820 con 0x7fcfa80c9d00 2023-08-10T10:38:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.795+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400bbb0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.795+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa81f5e20 con 0x7fcfa80c9d00 2023-08-10T10:38:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.795+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80c4de0 con 0x7fcfa80c9d00 2023-08-10T10:38:33.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.796+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa8066e30 con 0x7fcfa80c9d00 2023-08-10T10:38:33.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.797+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfa400bd10 con 0x7fcfa80c9d00 2023-08-10T10:38:33.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.798+0000 7fcf9e7fc640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 0x7fcf8c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:33.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.798+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfa4089a70 con 0x7fcfa80c9d00 2023-08-10T10:38:33.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.798+0000 7fcfad1af640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 0x7fcf8c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:33.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.799+0000 7fcfad1af640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 0x7fcf8c06d110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf98036000 tx=0x7fcf9803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:33.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.802+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcfa4054b10 con 0x7fcfa80c9d00 2023-08-10T10:38:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.995+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa815cc40 con 0x7fcfa80c9d00 2023-08-10T10:38:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.996+0000 7fcf9e7fc640 1 -- 172.21.15.50:0/4103694163 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fcfa4058130 con 0x7fcfa80c9d00 2023-08-10T10:38:33.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:33.999 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.999+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 msgr2=0x7fcf8c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.999+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 0x7fcf8c06d110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf98036000 tx=0x7fcf9803c040 comp rx=0 tx=0).stop 2023-08-10T10:38:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.999+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 msgr2=0x7fcfa80c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:33.999+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d800 tx=0x7fcfa400dcc0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 shutdown_connections 2023-08-10T10:38:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcf8c06ac50 0x7fcf8c06d110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa80c3fb0 0x7fcfa8151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfa8159830 0x7fcfa80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 --2- 172.21.15.50:0/4103694163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80c9d00 0x7fcfa80c48a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 >> 172.21.15.50:0/4103694163 conn(0x7fcfa806ab80 msgr2=0x7fcfa8158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 shutdown_connections 2023-08-10T10:38:34.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.000+0000 7fcfae9b2640 1 -- 172.21.15.50:0/4103694163 wait complete. 2023-08-10T10:38:34.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:34.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:34.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.247+0000 7fc0c3d4e640 1 Processor -- start 2023-08-10T10:38:34.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.247+0000 7fc0c3d4e640 1 -- start start 2023-08-10T10:38:34.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 0x7fc0bc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0cdc90 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0adcb0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c3d4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc06c320 con 0x7fc0bc06cb30 2023-08-10T10:38:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c22eb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.249+0000 7fc0c22eb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33836/0 (socket says 172.21.15.50:33836) 2023-08-10T10:38:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 -- 172.21.15.50:0/4257607725 learned_addr learned my addr 172.21.15.50:0/4257607725 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c12e9640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/4257607725 >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 0x7fc0bc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 -- 172.21.15.50:0/4257607725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 msgr2=0x7fc0bc0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 -- 172.21.15.50:0/4257607725 >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 msgr2=0x7fc0bc0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/4257607725 >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 0x7fc0bc0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c22eb640 1 -- 172.21.15.50:0/4257607725 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc06b770 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.250+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/4257607725 >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 0x7fc0bc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.252+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06e6f0 tx=0x7fc0b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641f6d4886035f67 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.252+0000 7fc0c0ae8640 1 -- 172.21.15.50:0/4257607725 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b402ca80 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.252+0000 7fc0c0ae8640 1 -- 172.21.15.50:0/4257607725 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b402cbe0 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.252+0000 7fc0c0ae8640 1 -- 172.21.15.50:0/4257607725 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40343f0 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/4257607725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc0cd2a0 msgr2=0x7fc0bc0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06e6f0 tx=0x7fc0b402bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/4257607725 shutdown_connections 2023-08-10T10:38:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc0cd750 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/4257607725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/4257607725 >> v2:172.21.15.117:3300/0 conn(0x7fc0bc15ae40 0x7fc0bc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/4257607725 >> 172.21.15.50:0/4257607725 conn(0x7fc0bc0b01b0 msgr2=0x7fc0bc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/4257607725 shutdown_connections 2023-08-10T10:38:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.253+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/4257607725 wait complete. 2023-08-10T10:38:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.255+0000 7fc0c3d4e640 1 Processor -- start 2023-08-10T10:38:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.255+0000 7fc0c3d4e640 1 -- start start 2023-08-10T10:38:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc15dd80 con 0x7fc0bc15ae40 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc15cea0 con 0x7fc0bc0cd2a0 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c3d4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc159260 con 0x7fc0bc06cb30 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c22eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c22eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33848/0 (socket says 172.21.15.50:33848) 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.256+0000 7fc0c22eb640 1 -- 172.21.15.50:0/3878927005 learned_addr learned my addr 172.21.15.50:0/3878927005 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c12e9640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 -- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 msgr2=0x7fc0bc0c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 -- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 msgr2=0x7fc0bc15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc15c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 -- 172.21.15.50:0/3878927005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4009b30 con 0x7fc0bc15ae40 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c12e9640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:34.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0c22eb640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4036040 tx=0x7fc0b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4009510 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.257+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b403e450 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.258+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b403e800 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.258+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc15d100 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.258+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc15d6c0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.259+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc15dec0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.260+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0b402cd50 con 0x7fc0bc15ae40 2023-08-10T10:38:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.261+0000 7fc0b27fc640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 0x7fc0a006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.261+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0b40abf90 con 0x7fc0bc15ae40 2023-08-10T10:38:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.261+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 0x7fc0a006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.262+0000 7fc0c1aea640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 0x7fc0a006d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06ac00 tx=0x7fc0b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.265+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc0bc15dec0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.465+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0bc15dec0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.466+0000 7fc0b27fc640 1 -- 172.21.15.50:0/3878927005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0bc15dec0 con 0x7fc0bc15ae40 2023-08-10T10:38:34.468 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:34.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 msgr2=0x7fc0a006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 0x7fc0a006d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06ac00 tx=0x7fc0b8008040 comp rx=0 tx=0).stop 2023-08-10T10:38:34.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 msgr2=0x7fc0bc158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4036040 tx=0x7fc0b4004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 shutdown_connections 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0bc15ae40 0x7fc0bc158d20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc0a006ac50 0x7fc0a006d110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0bc0cd2a0 0x7fc0bc15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 --2- 172.21.15.50:0/3878927005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0bc06cb30 0x7fc0bc0c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.469+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 >> 172.21.15.50:0/3878927005 conn(0x7fc0bc0b01b0 msgr2=0x7fc0bc159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.470+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 shutdown_connections 2023-08-10T10:38:34.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.470+0000 7fc0c3d4e640 1 -- 172.21.15.50:0/3878927005 wait complete. 2023-08-10T10:38:34.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:34.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.717+0000 7f940960d640 1 Processor -- start 2023-08-10T10:38:34.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.717+0000 7f940960d640 1 -- start start 2023-08-10T10:38:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f940960d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f940415cb90 0x7f94040b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f940960d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9404160a40 con 0x7f94041615e0 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f940960d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040b4bb0 con 0x7f940415cf70 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f940960d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040b4e90 con 0x7f940415cb90 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f9402ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f940415cb90 0x7f94040b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f94037fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94041615e0 0x7f940406fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37350/0 (socket says 172.21.15.50:37350) 2023-08-10T10:38:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.719+0000 7f94037fe640 1 -- 172.21.15.50:0/3509552558 learned_addr learned my addr 172.21.15.50:0/3509552558 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.720+0000 7f9402ffd640 1 -- 172.21.15.50:0/3509552558 >> v1:172.21.15.117:6789/0 conn(0x7f940415cf70 legacy=0x7f9404160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.720+0000 7f9402ffd640 1 -- 172.21.15.50:0/3509552558 >> v1:172.21.15.50:6789/0 conn(0x7f94041615e0 legacy=0x7f940406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.720+0000 7f9402ffd640 1 -- 172.21.15.50:0/3509552558 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040b5170 con 0x7f940415cb90 2023-08-10T10:38:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.720+0000 7f9401ffb640 1 -- 172.21.15.50:0/3509552558 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020774036 0 0) 0x7f9404160a40 con 0x7f94041615e0 2023-08-10T10:38:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.721+0000 7f9402ffd640 1 --2- 172.21.15.50:0/3509552558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f940415cb90 0x7f94040b5dd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097a0 tx=0x7f93f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e400c319cc122de1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.721+0000 7f9401ffb640 1 -- 172.21.15.50:0/3509552558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4030610 con 0x7f940415cb90 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.721+0000 7f9401ffb640 1 -- 172.21.15.50:0/3509552558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4030770 con 0x7f940415cb90 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.721+0000 7f9401ffb640 1 -- 172.21.15.50:0/3509552558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4030b00 con 0x7f940415cb90 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 -- 172.21.15.50:0/3509552558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f940415cb90 msgr2=0x7f94040b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 --2- 172.21.15.50:0/3509552558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f940415cb90 0x7f94040b5dd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097a0 tx=0x7f93f402b960 comp rx=0 tx=0).stop 2023-08-10T10:38:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 -- 172.21.15.50:0/3509552558 shutdown_connections 2023-08-10T10:38:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 --2- 172.21.15.50:0/3509552558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f940415cb90 0x7f94040b5dd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 -- 172.21.15.50:0/3509552558 >> 172.21.15.50:0/3509552558 conn(0x7f94040cf640 msgr2=0x7f94040cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 -- 172.21.15.50:0/3509552558 shutdown_connections 2023-08-10T10:38:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.722+0000 7f940960d640 1 -- 172.21.15.50:0/3509552558 wait complete. 2023-08-10T10:38:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.724+0000 7f940960d640 1 Processor -- start 2023-08-10T10:38:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.724+0000 7f940960d640 1 -- start start 2023-08-10T10:38:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940415cb90 0x7f94041f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940415cf70 0x7f940415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9404159f70 con 0x7f94041615e0 2023-08-10T10:38:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94041592f0 con 0x7f940415cf70 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f940960d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94041595d0 con 0x7f940415cb90 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f94037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f94037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33858/0 (socket says 172.21.15.50:33858) 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f94037fe640 1 -- 172.21.15.50:0/2321810089 learned_addr learned my addr 172.21.15.50:0/2321810089 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f9402ffd640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940415cb90 0x7f94041f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.725+0000 7f94027fc640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940415cf70 0x7f940415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 -- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940415cb90 msgr2=0x7f94041f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940415cb90 0x7f94041f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 -- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940415cf70 msgr2=0x7f940415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940415cf70 0x7f940415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 -- 172.21.15.50:0/2321810089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4009400 con 0x7f94041615e0 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f94037fe640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c700 tx=0x7f93fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00ce10 con 0x7f94041615e0 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc00a640 con 0x7f94041615e0 2023-08-10T10:38:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00aa70 con 0x7f94041615e0 2023-08-10T10:38:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94041598b0 con 0x7f94041615e0 2023-08-10T10:38:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.726+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94041f2220 con 0x7f94041615e0 2023-08-10T10:38:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.728+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404066390 con 0x7f94041615e0 2023-08-10T10:38:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.729+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93fc00abd0 con 0x7f94041615e0 2023-08-10T10:38:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.729+0000 7f93eb7fe640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 0x7f93f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.730+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93fc088ad0 con 0x7f94041615e0 2023-08-10T10:38:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.730+0000 7f9402ffd640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 0x7f93f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.731+0000 7f9402ffd640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 0x7f93f006d110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f4036000 tx=0x7f93f4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.734+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f93fc053ae0 con 0x7f94041615e0 2023-08-10T10:38:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.929+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94040612b0 con 0x7f94041615e0 2023-08-10T10:38:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.930+0000 7f93eb7fe640 1 -- 172.21.15.50:0/2321810089 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93fc057100 con 0x7f94041615e0 2023-08-10T10:38:34.932 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.934+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 msgr2=0x7f93f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.934+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 0x7f93f006d110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f4036000 tx=0x7f93f4008030 comp rx=0 tx=0).stop 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.934+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 msgr2=0x7f940415fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.934+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c700 tx=0x7f93fc00cbc0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 shutdown_connections 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94041615e0 0x7f940415fd30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93f006ac50 0x7f93f006d110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940415cf70 0x7f940415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 --2- 172.21.15.50:0/2321810089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940415cb90 0x7f94041f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:34.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 >> 172.21.15.50:0/2321810089 conn(0x7f94040cf640 msgr2=0x7f94040ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.935+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 shutdown_connections 2023-08-10T10:38:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:34.936+0000 7f940960d640 1 -- 172.21.15.50:0/2321810089 wait complete. 2023-08-10T10:38:34.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:38:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.176+0000 7f7a9f59e640 1 Processor -- start 2023-08-10T10:38:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.176+0000 7f7a9f59e640 1 -- start start 2023-08-10T10:38:35.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7aa01583c0 0x7f7aa00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7aa0069db0 0x7f7aa015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9f59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa015aee0 con 0x7f7aa00b1ba0 2023-08-10T10:38:35.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00b2100 con 0x7f7aa0069db0 2023-08-10T10:38:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa015b1a0 con 0x7f7aa01583c0 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7aa0069db0 0x7f7aa015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7aa0069db0 0x7f7aa015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36222/0 (socket says 172.21.15.50:36222) 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/3201044576 learned_addr learned my addr 172.21.15.50:0/3201044576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.178+0000 7f7a9e59c640 1 --2- 172.21.15.50:0/3201044576 >> v2:172.21.15.117:3300/0 conn(0x7f7aa01583c0 0x7f7aa00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.179+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/3201044576 >> v2:172.21.15.117:3300/0 conn(0x7f7aa01583c0 msgr2=0x7f7aa00b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.179+0000 7f7a9ed9d640 1 --2- 172.21.15.50:0/3201044576 >> v2:172.21.15.117:3300/0 conn(0x7f7aa01583c0 0x7f7aa00b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.179+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/3201044576 >> v1:172.21.15.117:6789/0 conn(0x7f7aa00b1ba0 legacy=0x7f7aa00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.179+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/3201044576 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa015b480 con 0x7f7aa0069db0 2023-08-10T10:38:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.180+0000 7f7a9ed9d640 1 --2- 172.21.15.50:0/3201044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0069db0 0x7f7aa015e4d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b1080 tx=0x7f7a9802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9055bba99a76d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.181+0000 7f7a9d59a640 1 -- 172.21.15.50:0/3201044576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9802ca80 con 0x7f7aa0069db0 2023-08-10T10:38:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.181+0000 7f7a9d59a640 1 -- 172.21.15.50:0/3201044576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9802cbe0 con 0x7f7aa0069db0 2023-08-10T10:38:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.181+0000 7f7a9d59a640 1 -- 172.21.15.50:0/3201044576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980343f0 con 0x7f7aa0069db0 2023-08-10T10:38:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.181+0000 7f7a9f59e640 1 -- 172.21.15.50:0/3201044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0069db0 msgr2=0x7f7aa015e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.181+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/3201044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0069db0 0x7f7aa015e4d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b1080 tx=0x7f7a9802bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 -- 172.21.15.50:0/3201044576 shutdown_connections 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/3201044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa0069db0 0x7f7aa015e4d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/3201044576 >> v2:172.21.15.117:3300/0 conn(0x7f7aa01583c0 0x7f7aa00b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 -- 172.21.15.50:0/3201044576 >> 172.21.15.50:0/3201044576 conn(0x7f7aa00caf80 msgr2=0x7f7aa00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 -- 172.21.15.50:0/3201044576 shutdown_connections 2023-08-10T10:38:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.182+0000 7f7a9f59e640 1 -- 172.21.15.50:0/3201044576 wait complete. 2023-08-10T10:38:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.183+0000 7f7a9f59e640 1 Processor -- start 2023-08-10T10:38:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.184+0000 7f7a9f59e640 1 -- start start 2023-08-10T10:38:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa0069db0 0x7f7aa00cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa00b1ba0 0x7f7aa0156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01f54e0 con 0x7f7aa01583c0 2023-08-10T10:38:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01588b0 con 0x7f7aa0069db0 2023-08-10T10:38:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0158b90 con 0x7f7aa00b1ba0 2023-08-10T10:38:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36236/0 (socket says 172.21.15.50:36236) 2023-08-10T10:38:35.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/1879184986 learned_addr learned my addr 172.21.15.50:0/1879184986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:35.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9e59c640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa0069db0 0x7f7aa00cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.185+0000 7f7a9dd9b640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa00b1ba0 0x7f7aa0156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa00b1ba0 msgr2=0x7f7aa0156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa00b1ba0 0x7f7aa0156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa0069db0 msgr2=0x7f7aa00cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa0069db0 0x7f7aa00cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 -- 172.21.15.50:0/1879184986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009b30 con 0x7f7aa01583c0 2023-08-10T10:38:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a9ed9d640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a98036040 tx=0x7f7a98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.186+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98009510 con 0x7f7aa01583c0 2023-08-10T10:38:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.187+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9803e450 con 0x7f7aa01583c0 2023-08-10T10:38:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.187+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9803e7e0 con 0x7f7aa01583c0 2023-08-10T10:38:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.187+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa0158e70 con 0x7f7aa01583c0 2023-08-10T10:38:35.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.187+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa00ccf90 con 0x7f7aa01583c0 2023-08-10T10:38:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.188+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa01f5650 con 0x7f7aa01583c0 2023-08-10T10:38:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.189+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a9802cd50 con 0x7f7aa01583c0 2023-08-10T10:38:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.190+0000 7f7a8effd640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 0x7f7a8006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.190+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a980ac020 con 0x7f7aa01583c0 2023-08-10T10:38:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.190+0000 7f7a9e59c640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 0x7f7a8006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.191+0000 7f7a9e59c640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 0x7f7a8006d110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a90006fd0 tx=0x7f7a90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.194+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7aa01f5650 con 0x7f7aa01583c0 2023-08-10T10:38:35.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.394+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7aa01f5620 con 0x7f7aa01583c0 2023-08-10T10:38:35.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.395+0000 7f7a8effd640 1 -- 172.21.15.50:0/1879184986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a98077030 con 0x7f7aa01583c0 2023-08-10T10:38:35.397 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:38:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 msgr2=0x7f7a8006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 0x7f7a8006d110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a90006fd0 tx=0x7f7a90008040 comp rx=0 tx=0).stop 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 msgr2=0x7f7aa006eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a98036040 tx=0x7f7a98004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 shutdown_connections 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7aa01583c0 0x7f7aa006eae0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa00b1ba0 0x7f7aa0156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a8006ac50 0x7f7a8006d110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 --2- 172.21.15.50:0/1879184986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa0069db0 0x7f7aa00cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 >> 172.21.15.50:0/1879184986 conn(0x7f7aa00caf80 msgr2=0x7f7aa00ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 shutdown_connections 2023-08-10T10:38:35.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.398+0000 7f7a9f59e640 1 -- 172.21.15.50:0/1879184986 wait complete. 2023-08-10T10:38:35.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:38:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.624+0000 7f40ca7cb640 1 Processor -- start 2023-08-10T10:38:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.624+0000 7f40ca7cb640 1 -- start start 2023-08-10T10:38:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40ca7cb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40c40696a0 0x7f40c4069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40ca7cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40ca7cb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c415aee0 con 0x7f40c41583c0 2023-08-10T10:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40ca7cb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c406a070 con 0x7f40c40696a0 2023-08-10T10:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40ca7cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40b2100 con 0x7f40c415e4d0 2023-08-10T10:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40c97c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f40c41583c0 0x7f40c40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53890/0 (socket says 172.21.15.50:53890) 2023-08-10T10:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40c97c9640 1 -- 172.21.15.50:0/266844197 learned_addr learned my addr 172.21.15.50:0/266844197 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40c8fc8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40c40696a0 0x7f40c4069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.626+0000 7f40c9fca640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.627+0000 7f40c8fc8640 1 -- 172.21.15.50:0/266844197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 msgr2=0x7f40c415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.627+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.627+0000 7f40c8fc8640 1 -- 172.21.15.50:0/266844197 >> v1:172.21.15.50:6789/0 conn(0x7f40c41583c0 legacy=0x7f40c40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.627+0000 7f40c8fc8640 1 -- 172.21.15.50:0/266844197 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c415b1a0 con 0x7f40c40696a0 2023-08-10T10:38:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.628+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4069b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d92770fbf5e854 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.628+0000 7f40bbfff640 1 -- 172.21.15.50:0/266844197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b402d040 con 0x7f40c40696a0 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.628+0000 7f40bbfff640 1 -- 172.21.15.50:0/266844197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4031810 con 0x7f40c40696a0 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.628+0000 7f40bbfff640 1 -- 172.21.15.50:0/266844197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4031ba0 con 0x7f40c40696a0 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 -- 172.21.15.50:0/266844197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 msgr2=0x7f40c4069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4069b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 -- 172.21.15.50:0/266844197 shutdown_connections 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4069b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/266844197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 -- 172.21.15.50:0/266844197 >> 172.21.15.50:0/266844197 conn(0x7f40c40caf80 msgr2=0x7f40c40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 -- 172.21.15.50:0/266844197 shutdown_connections 2023-08-10T10:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.629+0000 7f40ca7cb640 1 -- 172.21.15.50:0/266844197 wait complete. 2023-08-10T10:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.631+0000 7f40ca7cb640 1 Processor -- start 2023-08-10T10:38:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.631+0000 7f40ca7cb640 1 -- start start 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 0x7f40c40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c40ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41f5e50 con 0x7f40c40696a0 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40ad750 con 0x7f40c41583c0 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40ca7cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41f5540 con 0x7f40c415e4d0 2023-08-10T10:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36252/0 (socket says 172.21.15.50:36252) 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 -- 172.21.15.50:0/4115497772 learned_addr learned my addr 172.21.15.50:0/4115497772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c9fca640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c40ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 0x7f40c40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 -- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 msgr2=0x7f40c40ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c40ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 -- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 msgr2=0x7f40c40c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 0x7f40c40c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c97c9640 1 -- 172.21.15.50:0/4115497772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4009400 con 0x7f40c40696a0 2023-08-10T10:38:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.632+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 0x7f40c40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40c97c9640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40c000cb90 tx=0x7f40c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000ace0 con 0x7f40c40696a0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000ae40 con 0x7f40c40696a0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0012620 con 0x7f40c40696a0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c41f2ca0 con 0x7f40c40696a0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.633+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c41f5a70 con 0x7f40c40696a0 2023-08-10T10:38:35.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.634+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c41f5f90 con 0x7f40c40696a0 2023-08-10T10:38:35.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.635+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40c0007070 con 0x7f40c40696a0 2023-08-10T10:38:35.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.637+0000 7f40b9ffb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 0x7f40a806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:35.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.637+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40c0089480 con 0x7f40c40696a0 2023-08-10T10:38:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.637+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 0x7f40a806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.638+0000 7f40c8fc8640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 0x7f40a806d110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40b4036000 tx=0x7f40b403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:35.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.641+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40c41f5f90 con 0x7f40c40696a0 2023-08-10T10:38:35.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.828+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40c41f5f90 con 0x7f40c40696a0 2023-08-10T10:38:35.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.829+0000 7f40b9ffb640 1 -- 172.21.15.50:0/4115497772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40c41f5f90 con 0x7f40c40696a0 2023-08-10T10:38:35.831 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:38:35.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 msgr2=0x7f40a806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 0x7f40a806d110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40b4036000 tx=0x7f40b403c040 comp rx=0 tx=0).stop 2023-08-10T10:38:35.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 msgr2=0x7f40c4155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:35.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40c000cb90 tx=0x7f40c000a430 comp rx=0 tx=0).stop 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 shutdown_connections 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40c415e4d0 0x7f40c40ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40a806ac50 0x7f40a806d110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c41583c0 0x7f40c40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 --2- 172.21.15.50:0/4115497772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c40696a0 0x7f40c4155390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.831+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 >> 172.21.15.50:0/4115497772 conn(0x7f40c40caf80 msgr2=0x7f40c40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.832+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 shutdown_connections 2023-08-10T10:38:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:35.832+0000 7f40ca7cb640 1 -- 172.21.15.50:0/4115497772 wait complete. 2023-08-10T10:38:35.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:38:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.070+0000 7f32a6b01640 1 Processor -- start 2023-08-10T10:38:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.070+0000 7f32a6b01640 1 -- start start 2023-08-10T10:38:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a6b01640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32a015aa40 0x7f32a00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a6b01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a6b01640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a0071c70 con 0x7f32a00b0c60 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a6b01640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00713d0 con 0x7f32a015aa40 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a6b01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00716b0 con 0x7f32a00ca930 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a489d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32a015aa40 0x7f32a00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a489d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32a015aa40 0x7f32a00b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36256/0 (socket says 172.21.15.50:36256) 2023-08-10T10:38:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.072+0000 7f32a489d640 1 -- 172.21.15.50:0/3686159785 learned_addr learned my addr 172.21.15.50:0/3686159785 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a509e640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a489d640 1 -- 172.21.15.50:0/3686159785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 msgr2=0x7f32a00b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a489d640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a489d640 1 -- 172.21.15.50:0/3686159785 >> v1:172.21.15.117:6789/0 conn(0x7f32a00b0c60 legacy=0x7f32a00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a489d640 1 -- 172.21.15.50:0/3686159785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0071990 con 0x7f32a015aa40 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.073+0000 7f32a509e640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.074+0000 7f32a489d640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a00b3820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8f98bc9aac4641 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.074+0000 7f329f7fe640 1 -- 172.21.15.50:0/3686159785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940317c0 con 0x7f32a015aa40 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.074+0000 7f329f7fe640 1 -- 172.21.15.50:0/3686159785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3294031920 con 0x7f32a015aa40 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.074+0000 7f329f7fe640 1 -- 172.21.15.50:0/3686159785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294031cb0 con 0x7f32a015aa40 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 -- 172.21.15.50:0/3686159785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 msgr2=0x7f32a00b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a00b3820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329402b860 comp rx=0 tx=0).stop 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 -- 172.21.15.50:0/3686159785 shutdown_connections 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 --2- 172.21.15.50:0/3686159785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a00b3820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 -- 172.21.15.50:0/3686159785 >> 172.21.15.50:0/3686159785 conn(0x7f32a006b590 msgr2=0x7f32a00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:36.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 -- 172.21.15.50:0/3686159785 shutdown_connections 2023-08-10T10:38:36.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.075+0000 7f32a6b01640 1 -- 172.21.15.50:0/3686159785 wait complete. 2023-08-10T10:38:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.077+0000 7f32a6b01640 1 Processor -- start 2023-08-10T10:38:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.077+0000 7f32a6b01640 1 -- start start 2023-08-10T10:38:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a00b0c60 0x7f32a014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00c71b0 con 0x7f32a015aa40 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a014afd0 con 0x7f32a00b0c60 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a6b01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00c73c0 con 0x7f32a00ca930 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a509e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a509e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36258/0 (socket says 172.21.15.50:36258) 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a509e640 1 -- 172.21.15.50:0/1537563808 learned_addr learned my addr 172.21.15.50:0/1537563808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f329ffff640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.078+0000 7f32a489d640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a00b0c60 0x7f32a014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 -- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 msgr2=0x7f32a00cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 -- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a00b0c60 msgr2=0x7f32a014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a00b0c60 0x7f32a014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 -- 172.21.15.50:0/1537563808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940094d0 con 0x7f32a015aa40 2023-08-10T10:38:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f329ffff640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a509e640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f329800cf20 tx=0x7f329800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329800d840 con 0x7f32a015aa40 2023-08-10T10:38:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800d9a0 con 0x7f32a015aa40 2023-08-10T10:38:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329800dd50 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a00c76a0 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.079+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a00c7c60 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.080+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a00c7e80 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.081+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f329801e3b0 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.082+0000 7f329d7fa640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 0x7f328406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.082+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3298089ff0 con 0x7f32a015aa40 2023-08-10T10:38:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.082+0000 7f32a489d640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 0x7f328406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.083+0000 7f32a489d640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 0x7f328406d110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3294036000 tx=0x7f329403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.087+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3298055060 con 0x7f32a015aa40 2023-08-10T10:38:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.305+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32a004e270 con 0x7f32a015aa40 2023-08-10T10:38:36.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.306+0000 7f329d7fa640 1 -- 172.21.15.50:0/1537563808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f3298058680 con 0x7f32a015aa40 2023-08-10T10:38:36.307 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:36.308 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:38:36.308 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:38:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 msgr2=0x7f328406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 0x7f328406d110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3294036000 tx=0x7f329403d040 comp rx=0 tx=0).stop 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 msgr2=0x7f32a01573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f329800cf20 tx=0x7f329800a7d0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 shutdown_connections 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32a015aa40 0x7f32a01573a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a00ca930 0x7f32a00cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f328406ac50 0x7f328406d110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 --2- 172.21.15.50:0/1537563808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a00b0c60 0x7f32a014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.308+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 >> 172.21.15.50:0/1537563808 conn(0x7f32a006b590 msgr2=0x7f32a0159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.309+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 shutdown_connections 2023-08-10T10:38:36.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.309+0000 7f32a6b01640 1 -- 172.21.15.50:0/1537563808 wait complete. 2023-08-10T10:38:36.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.544+0000 7f107528e640 1 Processor -- start 2023-08-10T10:38:36.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.544+0000 7f107528e640 1 -- start start 2023-08-10T10:38:36.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f107528e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10700b3f30 0x7f10700ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f107528e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1070071c70 con 0x7f10700b0c60 2023-08-10T10:38:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f107528e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700713d0 con 0x7f107015aa40 2023-08-10T10:38:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f107528e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700716b0 con 0x7f10700b3f30 2023-08-10T10:38:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f106e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10700b0c60 0x7f10700c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53898/0 (socket says 172.21.15.50:53898) 2023-08-10T10:38:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.546+0000 7f106e7fc640 1 -- 172.21.15.50:0/2183888140 learned_addr learned my addr 172.21.15.50:0/2183888140 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106f7fe640 1 --2- 172.21.15.50:0/2183888140 >> v2:172.21.15.117:3300/0 conn(0x7f10700b3f30 0x7f10700ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406402850 0 0) 0x7f1070071c70 con 0x7f10700b0c60 2023-08-10T10:38:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1058003520 con 0x7f10700b0c60 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3444695757 0 0) 0x7f1058003520 con 0x7f10700b0c60 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 >> v2:172.21.15.117:3300/0 conn(0x7f10700b3f30 msgr2=0x7f10700ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 --2- 172.21.15.50:0/2183888140 >> v2:172.21.15.117:3300/0 conn(0x7f10700b3f30 0x7f10700ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 >> v1:172.21.15.117:6789/0 conn(0x7f107015aa40 legacy=0x7f10700b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070071990 con 0x7f10700b0c60 2023-08-10T10:38:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1064001670 con 0x7f10700b0c60 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 >> v1:172.21.15.50:6789/0 conn(0x7f10700b0c60 legacy=0x7f10700c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1058003970 0x7f1058003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10580047c0 0x7f1058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f105800fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700716b0 con 0x7f1058005180 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058010530 con 0x7f10580047c0 2023-08-10T10:38:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.547+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580106f0 con 0x7f1058003970 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f105800fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106effd640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1058003970 0x7f1058003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 -- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1058003970 msgr2=0x7f1058003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1058003970 0x7f1058003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106e7fc640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10580047c0 0x7f1058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 -- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10580047c0 msgr2=0x7f1058004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:36.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10580047c0 0x7f1058004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.548+0000 7f106f7fe640 1 -- 172.21.15.50:0/2183888140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058003520 con 0x7f1058005180 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.549+0000 7f106f7fe640 1 -- 172.21.15.50:0/2183888140 reap_dead start 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.549+0000 7f106f7fe640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f105800fd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1068009fc0 tx=0x7f10580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed35bb4d109f8d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.549+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106802cc60 con 0x7f1058005180 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.549+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800f040 con 0x7f1058005180 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.549+0000 7f106dffb640 1 -- 172.21.15.50:0/2183888140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068003990 con 0x7f1058005180 2023-08-10T10:38:36.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 -- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 msgr2=0x7f105800fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f105800fd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1068009fc0 tx=0x7f10580057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 -- 172.21.15.50:0/2183888140 shutdown_connections 2023-08-10T10:38:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 --2- 172.21.15.50:0/2183888140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f105800fd90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 -- 172.21.15.50:0/2183888140 >> 172.21.15.50:0/2183888140 conn(0x7f107006b590 msgr2=0x7f10700ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 -- 172.21.15.50:0/2183888140 shutdown_connections 2023-08-10T10:38:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.550+0000 7f107528e640 1 -- 172.21.15.50:0/2183888140 wait complete. 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.552+0000 7f107528e640 1 Processor -- start 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.552+0000 7f107528e640 1 -- start start 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107015b7f0 0x7f10700c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107015cd90 0x7f10701517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107015c970 con 0x7f1058005180 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107015bcf0 con 0x7f107015cd90 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f107528e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107015bfd0 con 0x7f107015b7f0 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f106effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f106effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36268/0 (socket says 172.21.15.50:36268) 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.553+0000 7f106effd640 1 -- 172.21.15.50:0/753666447 learned_addr learned my addr 172.21.15.50:0/753666447 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106e7fc640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107015b7f0 0x7f10700c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106f7fe640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107015cd90 0x7f10701517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 -- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107015b7f0 msgr2=0x7f10700c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107015b7f0 0x7f10700c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 -- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107015cd90 msgr2=0x7f10701517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107015cd90 0x7f10701517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 -- 172.21.15.50:0/753666447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107015c2b0 con 0x7f1058005180 2023-08-10T10:38:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f106effd640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f106000e4d0 tx=0x7f106000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600052e0 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060005440 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060003810 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107015c590 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.554+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10700c83c0 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.556+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700c85e0 con 0x7f1058005180 2023-08-10T10:38:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.557+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1060003970 con 0x7f1058005180 2023-08-10T10:38:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.557+0000 7f10577fe640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 0x7f105c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.558+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10600892b0 con 0x7f1058005180 2023-08-10T10:38:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.558+0000 7f106e7fc640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 0x7f105c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.559+0000 7f106e7fc640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 0x7f105c06d140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10640017a0 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.562+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10600542c0 con 0x7f1058005180 2023-08-10T10:38:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.761+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f107004e270 con 0x7f1058005180 2023-08-10T10:38:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.763+0000 7f10577fe640 1 -- 172.21.15.50:0/753666447 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f10600578e0 con 0x7f1058005180 2023-08-10T10:38:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:36.765 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 msgr2=0x7f105c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 0x7f105c06d140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10640017a0 tx=0x7f1064009040 comp rx=0 tx=0).stop 2023-08-10T10:38:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 msgr2=0x7f1070150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f106000e4d0 tx=0x7f106000e990 comp rx=0 tx=0).stop 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 shutdown_connections 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105c06ac80 0x7f105c06d140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107015cd90 0x7f10701517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107015b7f0 0x7f10700c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 --2- 172.21.15.50:0/753666447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1058005180 0x7f1070150580 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 >> 172.21.15.50:0/753666447 conn(0x7f107006b590 msgr2=0x7f1070150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 shutdown_connections 2023-08-10T10:38:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:36.766+0000 7f107528e640 1 -- 172.21.15.50:0/753666447 wait complete. 2023-08-10T10:38:36.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:36.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.019+0000 7fe43fe26640 1 Processor -- start 2023-08-10T10:38:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.020+0000 7fe43fe26640 1 -- start start 2023-08-10T10:38:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe438159c10 0x7fe4380b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4380ada90 0x7fe4380c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe4380cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380ca7f0 con 0x7fe438159c10 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380adf40 con 0x7fe4380ada90 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.021+0000 7fe43fe26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806ebb0 con 0x7fe4380ca360 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe438159c10 0x7fe4380b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe438159c10 0x7fe4380b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36270/0 (socket says 172.21.15.50:36270) 2023-08-10T10:38:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 -- 172.21.15.50:0/2647374076 learned_addr learned my addr 172.21.15.50:0/2647374076 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43e3c3640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe4380cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43d3c1640 1 --2- 172.21.15.50:0/2647374076 >> v2:172.21.15.117:3300/0 conn(0x7fe4380ada90 0x7fe4380c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 -- 172.21.15.50:0/2647374076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 msgr2=0x7fe4380cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe4380cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 -- 172.21.15.50:0/2647374076 >> v2:172.21.15.117:3300/0 conn(0x7fe4380ada90 msgr2=0x7fe4380c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2647374076 >> v2:172.21.15.117:3300/0 conn(0x7fe4380ada90 0x7fe4380c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.022+0000 7fe43dbc2640 1 -- 172.21.15.50:0/2647374076 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43806ee90 con 0x7fe438159c10 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.023+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380b0cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe438073e80 tx=0x7fe43402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a42f05598574084 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43cbc0640 1 -- 172.21.15.50:0/2647374076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340317c0 con 0x7fe438159c10 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43cbc0640 1 -- 172.21.15.50:0/2647374076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434031920 con 0x7fe438159c10 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43cbc0640 1 -- 172.21.15.50:0/2647374076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434031cb0 con 0x7fe438159c10 2023-08-10T10:38:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 -- 172.21.15.50:0/2647374076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 msgr2=0x7fe4380b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380b0cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe438073e80 tx=0x7fe43402b860 comp rx=0 tx=0).stop 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 -- 172.21.15.50:0/2647374076 shutdown_connections 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe4380cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2647374076 >> v2:172.21.15.117:3300/0 conn(0x7fe4380ada90 0x7fe4380c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2647374076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380b0cd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 -- 172.21.15.50:0/2647374076 >> 172.21.15.50:0/2647374076 conn(0x7fe4380b01b0 msgr2=0x7fe4380b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.024+0000 7fe43fe26640 1 -- 172.21.15.50:0/2647374076 shutdown_connections 2023-08-10T10:38:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.025+0000 7fe43fe26640 1 -- 172.21.15.50:0/2647374076 wait complete. 2023-08-10T10:38:37.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.026+0000 7fe43fe26640 1 Processor -- start 2023-08-10T10:38:37.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.026+0000 7fe43fe26640 1 -- start start 2023-08-10T10:38:37.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 0x7fe438148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe438148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe438151f10 con 0x7fe438159c10 2023-08-10T10:38:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c21f0 con 0x7fe4380ada90 2023-08-10T10:38:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.027+0000 7fe43fe26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c2440 con 0x7fe4380ca360 2023-08-10T10:38:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36280/0 (socket says 172.21.15.50:36280) 2023-08-10T10:38:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 -- 172.21.15.50:0/2910054743 learned_addr learned my addr 172.21.15.50:0/2910054743 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43d3c1640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe438148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 0x7fe438148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 -- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 msgr2=0x7fe438148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe438148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 -- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 msgr2=0x7fe438148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 0x7fe438148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43e3c3640 1 -- 172.21.15.50:0/2910054743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340094d0 con 0x7fe438159c10 2023-08-10T10:38:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.028+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 0x7fe438148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe43e3c3640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe430007e60 tx=0x7fe43000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430014420 con 0x7fe438159c10 2023-08-10T10:38:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300145a0 con 0x7fe438159c10 2023-08-10T10:38:37.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430014950 con 0x7fe438159c10 2023-08-10T10:38:37.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4381518c0 con 0x7fe438159c10 2023-08-10T10:38:37.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.029+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43814f560 con 0x7fe438159c10 2023-08-10T10:38:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.030+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43814f780 con 0x7fe438159c10 2023-08-10T10:38:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.031+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe430014ab0 con 0x7fe438159c10 2023-08-10T10:38:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.032+0000 7fe42e7fc640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 0x7fe41c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.032+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe430089d70 con 0x7fe438159c10 2023-08-10T10:38:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.032+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 0x7fe41c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.033+0000 7fe43dbc2640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 0x7fe41c06d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe434036000 tx=0x7fe43403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.037+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe430058920 con 0x7fe438159c10 2023-08-10T10:38:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.230+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4381520c0 con 0x7fe438159c10 2023-08-10T10:38:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.231+0000 7fe42e7fc640 1 -- 172.21.15.50:0/2910054743 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4381520c0 con 0x7fe438159c10 2023-08-10T10:38:37.233 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 msgr2=0x7fe41c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 0x7fe41c06d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe434036000 tx=0x7fe43403d040 comp rx=0 tx=0).stop 2023-08-10T10:38:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 msgr2=0x7fe4380c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe430007e60 tx=0x7fe43000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 shutdown_connections 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438159c10 0x7fe4380c2b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4380ca360 0x7fe438148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe41c06ac50 0x7fe41c06d110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 --2- 172.21.15.50:0/2910054743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4380ada90 0x7fe438148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 >> 172.21.15.50:0/2910054743 conn(0x7fe4380b01b0 msgr2=0x7fe43815c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 shutdown_connections 2023-08-10T10:38:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.234+0000 7fe43fe26640 1 -- 172.21.15.50:0/2910054743 wait complete. 2023-08-10T10:38:37.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.485+0000 7fea949a6640 1 Processor -- start 2023-08-10T10:38:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.485+0000 7fea949a6640 1 -- start start 2023-08-10T10:38:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.486+0000 7fea949a6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 0x7fea900b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.486+0000 7fea949a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 0x7fea90160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea949a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea90160a40 con 0x7fea900b4640 2023-08-10T10:38:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea949a6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea900b4bb0 con 0x7fea9015cb90 2023-08-10T10:38:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea949a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b4e90 con 0x7fea9015cf70 2023-08-10T10:38:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea8e59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 0x7fea900b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea8ed9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fea900b4640 0x7fea9006fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:55418/0 (socket says 172.21.15.50:55418) 2023-08-10T10:38:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea8ed9d640 1 -- 172.21.15.50:0/1987482566 learned_addr learned my addr 172.21.15.50:0/1987482566 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.487+0000 7fea87fff640 1 --2- 172.21.15.50:0/1987482566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 0x7fea90160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.488+0000 7fea87fff640 1 -- 172.21.15.50:0/1987482566 >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 msgr2=0x7fea900b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.488+0000 7fea87fff640 1 --2- 172.21.15.50:0/1987482566 >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 0x7fea900b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.488+0000 7fea87fff640 1 -- 172.21.15.50:0/1987482566 >> v1:172.21.15.117:6789/0 conn(0x7fea900b4640 legacy=0x7fea9006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.488+0000 7fea87fff640 1 -- 172.21.15.50:0/1987482566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900b5170 con 0x7fea9015cf70 2023-08-10T10:38:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.488+0000 7fea8e59c640 1 --2- 172.21.15.50:0/1987482566 >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 0x7fea900b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.490+0000 7fea87fff640 1 --2- 172.21.15.50:0/1987482566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 0x7fea90160ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea780097a0 tx=0x7fea7802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94de00e622a458ba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.490+0000 7fea8dd9b640 1 -- 172.21.15.50:0/1987482566 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7802d040 con 0x7fea9015cf70 2023-08-10T10:38:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.490+0000 7fea8dd9b640 1 -- 172.21.15.50:0/1987482566 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78031810 con 0x7fea9015cf70 2023-08-10T10:38:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.490+0000 7fea8dd9b640 1 -- 172.21.15.50:0/1987482566 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78031ba0 con 0x7fea9015cf70 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 -- 172.21.15.50:0/1987482566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 msgr2=0x7fea90160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 --2- 172.21.15.50:0/1987482566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 0x7fea90160ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea780097a0 tx=0x7fea7802b8b0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 -- 172.21.15.50:0/1987482566 shutdown_connections 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 --2- 172.21.15.50:0/1987482566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea9015cf70 0x7fea90160ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 --2- 172.21.15.50:0/1987482566 >> v2:172.21.15.117:3300/0 conn(0x7fea9015cb90 0x7fea900b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 -- 172.21.15.50:0/1987482566 >> 172.21.15.50:0/1987482566 conn(0x7fea900cf640 msgr2=0x7fea900cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 -- 172.21.15.50:0/1987482566 shutdown_connections 2023-08-10T10:38:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.491+0000 7fea949a6640 1 -- 172.21.15.50:0/1987482566 wait complete. 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.493+0000 7fea949a6640 1 Processor -- start 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.493+0000 7fea949a6640 1 -- start start 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea900b4640 0x7fea90155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 0x7fea901e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9015d6c0 con 0x7fea9015cb90 2023-08-10T10:38:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9015d9a0 con 0x7fea9015cf70 2023-08-10T10:38:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea949a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9015dc80 con 0x7fea900b4640 2023-08-10T10:38:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36292/0 (socket says 172.21.15.50:36292) 2023-08-10T10:38:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea87fff640 1 -- 172.21.15.50:0/703908305 learned_addr learned my addr 172.21.15.50:0/703908305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea8e59c640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea900b4640 0x7fea90155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea8ed9d640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 0x7fea901e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.494+0000 7fea87fff640 1 -- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea900b4640 msgr2=0x7fea90155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea87fff640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea900b4640 0x7fea90155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea87fff640 1 -- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 msgr2=0x7fea901e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea87fff640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 0x7fea901e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea87fff640 1 -- 172.21.15.50:0/703908305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80009400 con 0x7fea9015cb90 2023-08-10T10:38:37.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea8ed9d640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 0x7fea901e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea87fff640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea78000c00 tx=0x7fea780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78006e10 con 0x7fea9015cb90 2023-08-10T10:38:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7803ad60 con 0x7fea9015cb90 2023-08-10T10:38:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78044630 con 0x7fea9015cb90 2023-08-10T10:38:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea78009400 con 0x7fea9015cb90 2023-08-10T10:38:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.495+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9015e240 con 0x7fea9015cb90 2023-08-10T10:38:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.497+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea900612b0 con 0x7fea9015cb90 2023-08-10T10:38:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.498+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea7804d450 con 0x7fea9015cb90 2023-08-10T10:38:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.499+0000 7fea86ffd640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 0x7fea7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.499+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea780ab730 con 0x7fea9015cb90 2023-08-10T10:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.500+0000 7fea8e59c640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 0x7fea7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.500+0000 7fea8e59c640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 0x7fea7006d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea80009b80 tx=0x7fea80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.504+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fea78076860 con 0x7fea9015cb90 2023-08-10T10:38:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.695+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea900d0a10 con 0x7fea9015cb90 2023-08-10T10:38:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.696+0000 7fea86ffd640 1 -- 172.21.15.50:0/703908305 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea78079e80 con 0x7fea9015cb90 2023-08-10T10:38:37.697 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 msgr2=0x7fea7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 0x7fea7006d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea80009b80 tx=0x7fea80008040 comp rx=0 tx=0).stop 2023-08-10T10:38:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 msgr2=0x7fea9015f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea78000c00 tx=0x7fea780046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 shutdown_connections 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea7006ac50 0x7fea7006d110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9015cf70 0x7fea901e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9015cb90 0x7fea9015f2a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 --2- 172.21.15.50:0/703908305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea900b4640 0x7fea90155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.698+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 >> 172.21.15.50:0/703908305 conn(0x7fea900cf640 msgr2=0x7fea900d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.699+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 shutdown_connections 2023-08-10T10:38:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.699+0000 7fea949a6640 1 -- 172.21.15.50:0/703908305 wait complete. 2023-08-10T10:38:37.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:38:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.952+0000 7f8dd01fc640 1 Processor -- start 2023-08-10T10:38:37.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.952+0000 7f8dd01fc640 1 -- start start 2023-08-10T10:38:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.954+0000 7f8dd01fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8dc81615e0 0x7f8dc806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.954+0000 7f8dd01fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc8160a40 con 0x7f8dc815cb90 2023-08-10T10:38:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.954+0000 7f8dd01fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc80b4bb0 con 0x7f8dc815cf70 2023-08-10T10:38:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.954+0000 7f8dd01fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80b4e90 con 0x7f8dc81615e0 2023-08-10T10:38:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dcdf98640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8dc815cb90 0x7f8dc80b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53900/0 (socket says 172.21.15.50:53900) 2023-08-10T10:38:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dcdf98640 1 -- 172.21.15.50:0/107143803 learned_addr learned my addr 172.21.15.50:0/107143803 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:37.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dce799640 1 --2- 172.21.15.50:0/107143803 >> v2:172.21.15.117:3300/0 conn(0x7f8dc81615e0 0x7f8dc806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023942947 0 0) 0x7f8dc8160a40 con 0x7f8dc815cb90 2023-08-10T10:38:37.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db4003520 con 0x7f8dc815cb90 2023-08-10T10:38:37.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151511926 0 0) 0x7f8db4003520 con 0x7f8dc815cb90 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 >> v2:172.21.15.117:3300/0 conn(0x7f8dc81615e0 msgr2=0x7f8dc806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 --2- 172.21.15.50:0/107143803 >> v2:172.21.15.117:3300/0 conn(0x7f8dc81615e0 0x7f8dc806fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 >> v1:172.21.15.117:6789/0 conn(0x7f8dc815cf70 legacy=0x7f8dc8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80b5170 con 0x7f8dc815cb90 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f8dc40019f0 con 0x7f8dc815cb90 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.955+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 >> v1:172.21.15.50:6789/0 conn(0x7f8dc815cb90 legacy=0x7f8dc80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db4003970 0x7f8db4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db40047c0 0x7f8db4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 0x7f8db400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80b4e90 con 0x7f8db4005180 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db400c020 con 0x7f8db4003970 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db400c1e0 con 0x7f8db40047c0 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 0x7f8db400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dcdf98640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db4003970 0x7f8db4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dcd797640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db40047c0 0x7f8db4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 -- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db40047c0 msgr2=0x7f8db4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db40047c0 0x7f8db4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 -- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db4003970 msgr2=0x7f8db4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db4003970 0x7f8db4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.956+0000 7f8dce799640 1 -- 172.21.15.50:0/107143803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4003520 con 0x7f8db4005180 2023-08-10T10:38:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.957+0000 7f8dce799640 1 -- 172.21.15.50:0/107143803 reap_dead start 2023-08-10T10:38:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dce799640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 0x7f8db400b980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009ac0 tx=0x7f8db40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3b9551f2a37272 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0004020 con 0x7f8db4005180 2023-08-10T10:38:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0004180 con 0x7f8db4005180 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dccf96640 1 -- 172.21.15.50:0/107143803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00044f0 con 0x7f8db4005180 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dd01fc640 1 -- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 msgr2=0x7f8db400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.958+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 0x7f8db400b980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009ac0 tx=0x7f8db40057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.959+0000 7f8dd01fc640 1 -- 172.21.15.50:0/107143803 shutdown_connections 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.959+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/107143803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8db4005180 0x7f8db400b980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.959+0000 7f8dd01fc640 1 -- 172.21.15.50:0/107143803 >> 172.21.15.50:0/107143803 conn(0x7f8dc80cf640 msgr2=0x7f8dc80cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.959+0000 7f8dd01fc640 1 -- 172.21.15.50:0/107143803 shutdown_connections 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.959+0000 7f8dd01fc640 1 -- 172.21.15.50:0/107143803 wait complete. 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.961+0000 7f8dd01fc640 1 Processor -- start 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.961+0000 7f8dd01fc640 1 -- start start 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db4005180 0x7f8dc80c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 0x7f8dc80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc814e830 con 0x7f8dc814df90 2023-08-10T10:38:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81f65e0 con 0x7f8dc81f6a70 2023-08-10T10:38:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dd01fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c9750 con 0x7f8db4005180 2023-08-10T10:38:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dce799640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dce799640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36320/0 (socket says 172.21.15.50:36320) 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dce799640 1 -- 172.21.15.50:0/2118639224 learned_addr learned my addr 172.21.15.50:0/2118639224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dcdf98640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db4005180 0x7f8dc80c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dcd797640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 0x7f8dc80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dce799640 1 -- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db4005180 msgr2=0x7f8dc80c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.962+0000 7f8dce799640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db4005180 0x7f8dc80c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dce799640 1 -- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 msgr2=0x7f8dc80cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dce799640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 0x7f8dc80cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dce799640 1 -- 172.21.15.50:0/2118639224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc814e550 con 0x7f8dc814df90 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dcd797640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 0x7f8dc80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dce799640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8dc002c380 tx=0x7f8dc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0003810 con 0x7f8dc814df90 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0003990 con 0x7f8dc814df90 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0003d40 con 0x7f8dc814df90 2023-08-10T10:38:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc81f5f90 con 0x7f8dc814df90 2023-08-10T10:38:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.963+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8142540 con 0x7f8dc814df90 2023-08-10T10:38:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.964+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc81f5df0 con 0x7f8dc814df90 2023-08-10T10:38:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.966+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dc0003ea0 con 0x7f8dc814df90 2023-08-10T10:38:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.967+0000 7f8dbe7fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 0x7f8dac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.967+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8dc003b070 con 0x7f8dc814df90 2023-08-10T10:38:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.967+0000 7f8dcdf98640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 0x7f8dac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.968+0000 7f8dcdf98640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 0x7f8dac06d110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40013d0 tx=0x7f8dc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:37.971+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8dc81f5df0 con 0x7f8dc814df90 2023-08-10T10:38:38.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.162+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dc81f5df0 con 0x7f8dc814df90 2023-08-10T10:38:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.163+0000 7f8dbe7fc640 1 -- 172.21.15.50:0/2118639224 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dc81f5df0 con 0x7f8dc814df90 2023-08-10T10:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:38:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 msgr2=0x7f8dac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 0x7f8dac06d110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40013d0 tx=0x7f8dc4009040 comp rx=0 tx=0).stop 2023-08-10T10:38:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 msgr2=0x7f8dc80cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8dc002c380 tx=0x7f8dc0004730 comp rx=0 tx=0).stop 2023-08-10T10:38:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 shutdown_connections 2023-08-10T10:38:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dc814df90 0x7f8dc80cba10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dac06ac50 0x7f8dac06d110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc81f6a70 0x7f8dc80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 --2- 172.21.15.50:0/2118639224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db4005180 0x7f8dc80c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.165+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 >> 172.21.15.50:0/2118639224 conn(0x7f8dc80cf640 msgr2=0x7f8dc814d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.166+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 shutdown_connections 2023-08-10T10:38:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.166+0000 7f8dd01fc640 1 -- 172.21.15.50:0/2118639224 wait complete. 2023-08-10T10:38:38.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:38:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.427+0000 7ff6b2071640 1 Processor -- start 2023-08-10T10:38:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.427+0000 7ff6b2071640 1 -- start start 2023-08-10T10:38:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6b2071640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac15cbb0 0x7ff6ac1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6b2071640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6b2071640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac161800 con 0x7ff6ac0c98b0 2023-08-10T10:38:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6b2071640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac160870 con 0x7ff6ac0c9420 2023-08-10T10:38:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6b2071640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0ca370 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36332/0 (socket says 172.21.15.50:36332) 2023-08-10T10:38:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 -- 172.21.15.50:0/809017450 learned_addr learned my addr 172.21.15.50:0/809017450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6ab7fe640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac15cbb0 0x7ff6ac1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 -- 172.21.15.50:0/809017450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac15cbb0 msgr2=0x7ff6ac1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac15cbb0 0x7ff6ac1612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 -- 172.21.15.50:0/809017450 >> v1:172.21.15.117:6789/0 conn(0x7ff6ac0c98b0 legacy=0x7ff6ac0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.429+0000 7ff6abfff640 1 -- 172.21.15.50:0/809017450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0ca650 con 0x7ff6ac0c9420 2023-08-10T10:38:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.431+0000 7ff6abfff640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009e50 tx=0x7ff6a402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6948c5eaac8ad78 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.431+0000 7ff6aa7fc640 1 -- 172.21.15.50:0/809017450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402c9e0 con 0x7ff6ac0c9420 2023-08-10T10:38:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.431+0000 7ff6aa7fc640 1 -- 172.21.15.50:0/809017450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a402cb40 con 0x7ff6ac0c9420 2023-08-10T10:38:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.431+0000 7ff6aa7fc640 1 -- 172.21.15.50:0/809017450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40343f0 con 0x7ff6ac0c9420 2023-08-10T10:38:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 -- 172.21.15.50:0/809017450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac0c9420 msgr2=0x7ff6ac0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009e50 tx=0x7ff6a402be40 comp rx=0 tx=0).stop 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 -- 172.21.15.50:0/809017450 shutdown_connections 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac0c9d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 --2- 172.21.15.50:0/809017450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac15cbb0 0x7ff6ac1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 -- 172.21.15.50:0/809017450 >> 172.21.15.50:0/809017450 conn(0x7ff6ac0b01b0 msgr2=0x7ff6ac0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 -- 172.21.15.50:0/809017450 shutdown_connections 2023-08-10T10:38:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.432+0000 7ff6b2071640 1 -- 172.21.15.50:0/809017450 wait complete. 2023-08-10T10:38:38.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.434+0000 7ff6b2071640 1 Processor -- start 2023-08-10T10:38:38.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.435+0000 7ff6b2071640 1 -- start start 2023-08-10T10:38:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac0c98b0 0x7ff6ac14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0c50a0 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0c4dc0 con 0x7ff6ac0c9420 2023-08-10T10:38:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.436+0000 7ff6b2071640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0c7450 con 0x7ff6ac0c98b0 2023-08-10T10:38:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36338/0 (socket says 172.21.15.50:36338) 2023-08-10T10:38:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 -- 172.21.15.50:0/982352527 learned_addr learned my addr 172.21.15.50:0/982352527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6ab7fe640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6aaffd640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac0c98b0 0x7ff6ac14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 -- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac0c98b0 msgr2=0x7ff6ac14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac0c98b0 0x7ff6ac14c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 -- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6ac0c9420 msgr2=0x7ff6ac1f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac1f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.437+0000 7ff6abfff640 1 -- 172.21.15.50:0/982352527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009b30 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff6abfff640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4036040 tx=0x7ff6a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4009510 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a403e450 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a403e7e0 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac0c7730 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.438+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac1f2470 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.439+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac0c7c50 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.440+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6a403e940 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.441+0000 7ff693fff640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 0x7ff69806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.441+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6a40ac100 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.441+0000 7ff6ab7fe640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 0x7ff69806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.442+0000 7ff6ab7fe640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 0x7ff69806d110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff69c006fd0 tx=0x7ff69c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.445+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff6ac0c7c50 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.635+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6ac161800 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.635+0000 7ff693fff640 1 -- 172.21.15.50:0/982352527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6ac161800 con 0x7ff6ac15cbb0 2023-08-10T10:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:38:38.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 msgr2=0x7ff69806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 0x7ff69806d110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff69c006fd0 tx=0x7ff69c008040 comp rx=0 tx=0).stop 2023-08-10T10:38:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 msgr2=0x7ff6ac14ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4036040 tx=0x7ff6a4004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 shutdown_connections 2023-08-10T10:38:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.638+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ac15cbb0 0x7ff6ac14ce80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6ac0c98b0 0x7ff6ac14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69806ac50 0x7ff69806d110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 --2- 172.21.15.50:0/982352527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6ac0c9420 0x7ff6ac1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 >> 172.21.15.50:0/982352527 conn(0x7ff6ac0b01b0 msgr2=0x7ff6ac0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 shutdown_connections 2023-08-10T10:38:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.639+0000 7ff6b2071640 1 -- 172.21.15.50:0/982352527 wait complete. 2023-08-10T10:38:38.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:38:38.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.887+0000 7f1a23379640 1 Processor -- start 2023-08-10T10:38:38.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.888+0000 7f1a23379640 1 -- start start 2023-08-10T10:38:38.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a1c15aa40 0x7f1a1c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 0x7f1a1c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c071c70 con 0x7f1a1c15aa40 2023-08-10T10:38:38.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0713d0 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a23379640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0716b0 con 0x7f1a1c070e80 2023-08-10T10:38:38.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.889+0000 7f1a21115640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a1c15aa40 0x7f1a1c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a1c15aa40 0x7f1a1c0b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36350/0 (socket says 172.21.15.50:36350) 2023-08-10T10:38:38.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 -- 172.21.15.50:0/1002224815 learned_addr learned my addr 172.21.15.50:0/1002224815 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:38.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21916640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a20914640 1 --2- 172.21.15.50:0/1002224815 >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 0x7f1a1c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 -- 172.21.15.50:0/1002224815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 msgr2=0x7f1a1c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 -- 172.21.15.50:0/1002224815 >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 msgr2=0x7f1a1c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 --2- 172.21.15.50:0/1002224815 >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 0x7f1a1c0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a21115640 1 -- 172.21.15.50:0/1002224815 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c071990 con 0x7f1a1c15aa40 2023-08-10T10:38:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.890+0000 7f1a20914640 1 --2- 172.21.15.50:0/1002224815 >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 0x7f1a1c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:38.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.891+0000 7f1a21115640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c0b3820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c15e6e0 tx=0x7f1a1802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47e1377106b41e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a13fff640 1 -- 172.21.15.50:0/1002224815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180317d0 con 0x7f1a1c15aa40 2023-08-10T10:38:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a13fff640 1 -- 172.21.15.50:0/1002224815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18031930 con 0x7f1a1c15aa40 2023-08-10T10:38:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a13fff640 1 -- 172.21.15.50:0/1002224815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18031cc0 con 0x7f1a1c15aa40 2023-08-10T10:38:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 -- 172.21.15.50:0/1002224815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c15aa40 msgr2=0x7f1a1c0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c0b3820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c15e6e0 tx=0x7f1a1802b870 comp rx=0 tx=0).stop 2023-08-10T10:38:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 -- 172.21.15.50:0/1002224815 shutdown_connections 2023-08-10T10:38:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 --2- 172.21.15.50:0/1002224815 >> v2:172.21.15.117:3300/0 conn(0x7f1a1c0b0c60 0x7f1a1c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 --2- 172.21.15.50:0/1002224815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c0b3820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 -- 172.21.15.50:0/1002224815 >> 172.21.15.50:0/1002224815 conn(0x7f1a1c06b590 msgr2=0x7f1a1c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.892+0000 7f1a23379640 1 -- 172.21.15.50:0/1002224815 shutdown_connections 2023-08-10T10:38:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.893+0000 7f1a23379640 1 -- 172.21.15.50:0/1002224815 wait complete. 2023-08-10T10:38:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.894+0000 7f1a23379640 1 Processor -- start 2023-08-10T10:38:38.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.894+0000 7f1a23379640 1 -- start start 2023-08-10T10:38:38.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cbf80 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb370 con 0x7f1a1c15aa40 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.895+0000 7f1a23379640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0cb650 con 0x7f1a1c070e80 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36354/0 (socket says 172.21.15.50:36354) 2023-08-10T10:38:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 -- 172.21.15.50:0/1625363710 learned_addr learned my addr 172.21.15.50:0/1625363710 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a21916640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 -- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 msgr2=0x7f1a1c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a21115640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 -- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 msgr2=0x7f1a1c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a20914640 1 -- 172.21.15.50:0/1625363710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180094d0 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.896+0000 7f1a21916640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a20914640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c7f0 tx=0x7f1a0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c007a30 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c007b90 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00ce40 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c0cb930 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.897+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c0ca640 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.898+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c04e270 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.899+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a0c0113f0 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.900+0000 7f1a11ffb640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 0x7f1a0006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.900+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a0c0896c0 con 0x7f1a1c0b0c60 2023-08-10T10:38:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.901+0000 7f1a21115640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 0x7f1a0006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.901+0000 7f1a21115640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 0x7f1a0006d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a18036000 tx=0x7f1a1803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:38.904+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a0c054760 con 0x7f1a1c0b0c60 2023-08-10T10:38:39.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.132+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a1c1e5430 con 0x7f1a1c0b0c60 2023-08-10T10:38:39.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.134+0000 7f1a11ffb640 1 -- 172.21.15.50:0/1625363710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f1a0c057d80 con 0x7f1a1c0b0c60 2023-08-10T10:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:38:39.137 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:38:39.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 msgr2=0x7f1a0006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 0x7f1a0006d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a18036000 tx=0x7f1a1803d040 comp rx=0 tx=0).stop 2023-08-10T10:38:39.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 msgr2=0x7f1a1c151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c7f0 tx=0x7f1a0c00cbf0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 shutdown_connections 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a0006ac50 0x7f1a0006d110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c15aa40 0x7f1a1c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c0b0c60 0x7f1a1c151be0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 --2- 172.21.15.50:0/1625363710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c070e80 0x7f1a1c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.136+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 >> 172.21.15.50:0/1625363710 conn(0x7f1a1c06b590 msgr2=0x7f1a1c1e78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:39.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.137+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 shutdown_connections 2023-08-10T10:38:39.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.137+0000 7f1a23379640 1 -- 172.21.15.50:0/1625363710 wait complete. 2023-08-10T10:38:39.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:39.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.375+0000 7f40d1670640 1 Processor -- start 2023-08-10T10:38:39.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.375+0000 7f40d1670640 1 -- start start 2023-08-10T10:38:39.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.376+0000 7f40d1670640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d1670640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40cc0b19d0 0x7f40cc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d1670640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0b1f10 con 0x7f40cc15f2b0 2023-08-10T10:38:39.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d1670640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0b21f0 con 0x7f40cc0b19d0 2023-08-10T10:38:39.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d1670640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15e5c0 con 0x7f40cc15a940 2023-08-10T10:38:39.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40cc0b19d0 0x7f40cc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40cc0b19d0 0x7f40cc0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36362/0 (socket says 172.21.15.50:36362) 2023-08-10T10:38:39.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 -- 172.21.15.50:0/2416152133 learned_addr learned my addr 172.21.15.50:0/2416152133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40cbfff640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 -- 172.21.15.50:0/2416152133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 msgr2=0x7f40cc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 -- 172.21.15.50:0/2416152133 >> v1:172.21.15.117:6789/0 conn(0x7f40cc15f2b0 legacy=0x7f40cc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.377+0000 7f40d0e6f640 1 -- 172.21.15.50:0/2416152133 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc15e7d0 con 0x7f40cc0b19d0 2023-08-10T10:38:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.378+0000 7f40d0e6f640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc0b0450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0b0ad0 tx=0x7f40c402be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0046c69a4c51b54 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.379+0000 7f40caffd640 1 -- 172.21.15.50:0/2416152133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c402c9a0 con 0x7f40cc0b19d0 2023-08-10T10:38:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.379+0000 7f40caffd640 1 -- 172.21.15.50:0/2416152133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c402cb00 con 0x7f40cc0b19d0 2023-08-10T10:38:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.379+0000 7f40caffd640 1 -- 172.21.15.50:0/2416152133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c402ce90 con 0x7f40cc0b19d0 2023-08-10T10:38:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.379+0000 7f40d1670640 1 -- 172.21.15.50:0/2416152133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 msgr2=0x7f40cc0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.379+0000 7f40d1670640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc0b0450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0b0ad0 tx=0x7f40c402be00 comp rx=0 tx=0).stop 2023-08-10T10:38:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 -- 172.21.15.50:0/2416152133 shutdown_connections 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc0b0450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 --2- 172.21.15.50:0/2416152133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 -- 172.21.15.50:0/2416152133 >> 172.21.15.50:0/2416152133 conn(0x7f40cc06ab80 msgr2=0x7f40cc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 -- 172.21.15.50:0/2416152133 shutdown_connections 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.380+0000 7f40d1670640 1 -- 172.21.15.50:0/2416152133 wait complete. 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.381+0000 7f40d1670640 1 Processor -- start 2023-08-10T10:38:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.382+0000 7f40d1670640 1 -- start start 2023-08-10T10:38:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.382+0000 7f40d1670640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.382+0000 7f40d1670640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.382+0000 7f40d1670640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 0x7f40cc15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40d1670640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15bb20 con 0x7f40cc0b19d0 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40d1670640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15be00 con 0x7f40cc15f2b0 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40d1670640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15c0e0 con 0x7f40cc15a940 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36372/0 (socket says 172.21.15.50:36372) 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40cbfff640 1 -- 172.21.15.50:0/3422234114 learned_addr learned my addr 172.21.15.50:0/3422234114 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40d0e6f640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 0x7f40cc15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.383+0000 7f40cbfff640 1 -- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 msgr2=0x7f40cc154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40cbfff640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40cbfff640 1 -- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 msgr2=0x7f40cc15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40cbfff640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 0x7f40cc15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40cbfff640 1 -- 172.21.15.50:0/3422234114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009b30 con 0x7f40cc0b19d0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40d0e6f640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 0x7f40cc15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40cbfff640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00d5f0 tx=0x7f40bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0125f0 con 0x7f40cc0b19d0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc012750 con 0x7f40cc0b19d0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc012b00 con 0x7f40cc0b19d0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc15c3c0 con 0x7f40cc0b19d0 2023-08-10T10:38:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.384+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc0c7140 con 0x7f40cc0b19d0 2023-08-10T10:38:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.385+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc066e30 con 0x7f40cc0b19d0 2023-08-10T10:38:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.387+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40bc012c60 con 0x7f40cc0b19d0 2023-08-10T10:38:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.388+0000 7f40c8ff9640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.388+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40bc089a50 con 0x7f40cc0b19d0 2023-08-10T10:38:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.388+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.389+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40c0006fd0 tx=0x7f40c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.392+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40bc054a60 con 0x7f40cc0b19d0 2023-08-10T10:38:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.584+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40cc0c2600 con 0x7f40cc0b19d0 2023-08-10T10:38:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.588+0000 7f40c8ff9640 1 -- 172.21.15.50:0/3422234114 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f40bc058080 con 0x7f40cc0b19d0 2023-08-10T10:38:39.590 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:39.590 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.590+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 msgr2=0x7f40b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.590+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40c0006fd0 tx=0x7f40c0008040 comp rx=0 tx=0).stop 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.590+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 msgr2=0x7f40cc15cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.590+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00d5f0 tx=0x7f40bc00dab0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 shutdown_connections 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc15f2b0 0x7f40cc15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc15a940 0x7f40cc154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 --2- 172.21.15.50:0/3422234114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0b19d0 0x7f40cc15cbc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 >> 172.21.15.50:0/3422234114 conn(0x7f40cc06ab80 msgr2=0x7f40cc0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 shutdown_connections 2023-08-10T10:38:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.591+0000 7f40d1670640 1 -- 172.21.15.50:0/3422234114 wait complete. 2023-08-10T10:38:39.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:38:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.826+0000 7f3c74b24640 1 Processor -- start 2023-08-10T10:38:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.826+0000 7f3c74b24640 1 -- start start 2023-08-10T10:38:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c74b24640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c700b8430 0x7f3c700cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c74b24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c74b24640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c70161180 con 0x7f3c7015cd60 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c74b24640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700ce240 con 0x7f3c700b8430 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c74b24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700b5bd0 con 0x7f3c700cddb0 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c6e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c7015cd60 0x7f3c70160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53914/0 (socket says 172.21.15.50:53914) 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c6e59c640 1 -- 172.21.15.50:0/3220963573 learned_addr learned my addr 172.21.15.50:0/3220963573 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.828+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/3220963573 >> v2:172.21.15.50:3300/0 conn(0x7f3c700b8430 0x7f3c700cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c6ed9d640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c6dd9b640 1 -- 172.21.15.50:0/3220963573 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545720355 0 0) 0x7f3c70161180 con 0x7f3c7015cd60 2023-08-10T10:38:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c65d9b640 1 -- 172.21.15.50:0/3220963573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 msgr2=0x7f3c700d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c65d9b640 1 -- 172.21.15.50:0/3220963573 >> v1:172.21.15.50:6789/0 conn(0x7f3c7015cd60 legacy=0x7f3c70160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.829+0000 7f3c65d9b640 1 -- 172.21.15.50:0/3220963573 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70161460 con 0x7f3c700b8430 2023-08-10T10:38:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.830+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c700cd870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c580097a0 tx=0x7f3c5802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242e628531d331db server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c6dd9b640 1 -- 172.21.15.50:0/3220963573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58030610 con 0x7f3c700b8430 2023-08-10T10:38:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c6dd9b640 1 -- 172.21.15.50:0/3220963573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58030770 con 0x7f3c700b8430 2023-08-10T10:38:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c6dd9b640 1 -- 172.21.15.50:0/3220963573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58030b00 con 0x7f3c700b8430 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 -- 172.21.15.50:0/3220963573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 msgr2=0x7f3c700cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c700cd870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c580097a0 tx=0x7f3c5802b960 comp rx=0 tx=0).stop 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 -- 172.21.15.50:0/3220963573 shutdown_connections 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c700cd870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 --2- 172.21.15.50:0/3220963573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.831+0000 7f3c74b24640 1 -- 172.21.15.50:0/3220963573 >> 172.21.15.50:0/3220963573 conn(0x7f3c700d2ac0 msgr2=0x7f3c700d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.832+0000 7f3c74b24640 1 -- 172.21.15.50:0/3220963573 shutdown_connections 2023-08-10T10:38:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.832+0000 7f3c74b24640 1 -- 172.21.15.50:0/3220963573 wait complete. 2023-08-10T10:38:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.834+0000 7f3c74b24640 1 Processor -- start 2023-08-10T10:38:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.834+0000 7f3c74b24640 1 -- start start 2023-08-10T10:38:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.835+0000 7f3c74b24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c74b24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c74b24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7015cd60 0x7f3c701f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c74b24640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700b1100 con 0x7f3c700b8430 2023-08-10T10:38:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c74b24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cb780 con 0x7f3c7015cd60 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c74b24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701f2e60 con 0x7f3c700cddb0 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36382/0 (socket says 172.21.15.50:36382) 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 -- 172.21.15.50:0/2717523033 learned_addr learned my addr 172.21.15.50:0/2717523033 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6ed9d640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7015cd60 0x7f3c701f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 -- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 msgr2=0x7f3c700b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 -- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7015cd60 msgr2=0x7f3c701f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7015cd60 0x7f3c701f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.836+0000 7f3c6e59c640 1 -- 172.21.15.50:0/2717523033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009400 con 0x7f3c700b8430 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c6e59c640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000c4d0 tx=0x7f3c6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c600074e0 con 0x7f3c700b8430 2023-08-10T10:38:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60007660 con 0x7f3c700b8430 2023-08-10T10:38:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60004a20 con 0x7f3c700b8430 2023-08-10T10:38:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c701f3140 con 0x7f3c700b8430 2023-08-10T10:38:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.837+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700cb9d0 con 0x7f3c700b8430 2023-08-10T10:38:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.838+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7004e270 con 0x7f3c700b8430 2023-08-10T10:38:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.839+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c60004b80 con 0x7f3c700b8430 2023-08-10T10:38:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.841+0000 7f3c677fe640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 0x7f3c5006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.841+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c60088670 con 0x7f3c700b8430 2023-08-10T10:38:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.841+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 0x7f3c5006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.842+0000 7f3c65d9b640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 0x7f3c5006d110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c58036000 tx=0x7f3c5803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:39.847+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c60053710 con 0x7f3c700b8430 2023-08-10T10:38:40.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.079+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c700d3940 con 0x7f3c700b8430 2023-08-10T10:38:40.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.080+0000 7f3c677fe640 1 -- 172.21.15.50:0/2717523033 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f3c60056d30 con 0x7f3c700b8430 2023-08-10T10:38:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:40.082 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:38:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.082+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 msgr2=0x7f3c5006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.082+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 0x7f3c5006d110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c58036000 tx=0x7f3c5803b040 comp rx=0 tx=0).stop 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.082+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 msgr2=0x7f3c701f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.082+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000c4d0 tx=0x7f3c6000c990 comp rx=0 tx=0).stop 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.082+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 shutdown_connections 2023-08-10T10:38:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c5006ac50 0x7f3c5006d110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7015cd60 0x7f3c701f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c700cddb0 0x7f3c700b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 --2- 172.21.15.50:0/2717523033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c700b8430 0x7f3c701f6770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 >> 172.21.15.50:0/2717523033 conn(0x7f3c700d2ac0 msgr2=0x7f3c7015b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 shutdown_connections 2023-08-10T10:38:40.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.083+0000 7f3c74b24640 1 -- 172.21.15.50:0/2717523033 wait complete. 2023-08-10T10:38:40.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:38:21.683617+0000', 'modified': '2023-08-10T10:38:25.365469+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6834/3889640263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6832', 'nonce': 3889640263}, {'type': 'v1', 'addr': '172.21.15.117:6834', 'nonce': 3889640263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:38:40.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:38:40.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-10T10:38:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.747+0000 7f1a92542640 1 Processor -- start 2023-08-10T10:38:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.747+0000 7f1a92542640 1 -- start start 2023-08-10T10:38:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a92542640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a8c0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a92542640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a8c072730 0x7f1a8c072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a92542640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c06dbc0 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a92542640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c073100 con 0x7f1a8c072730 2023-08-10T10:38:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a92542640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15ae10 con 0x7f1a8c15aa30 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a837fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1a8c0ae9a0 0x7f1a8c0705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53920/0 (socket says 172.21.15.50:53920) 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.749+0000 7f1a837fe640 1 -- 172.21.15.50:0/1035228976 learned_addr learned my addr 172.21.15.50:0/1035228976 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a8c0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1035228976 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c072730 0x7f1a8c072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36941822 0 0) 0x7f1a74001110 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a78003520 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924398197 0 0) 0x7f1a78003520 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 msgr2=0x7f1a8c0cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a8c0cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c072730 msgr2=0x7f1a8c072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 --2- 172.21.15.50:0/1035228976 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c072730 0x7f1a8c072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0cbf90 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1035228976 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c072730 0x7f1a8c072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1a74001800 con 0x7f1a8c0ae9a0 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 >> v1:172.21.15.50:6789/0 conn(0x7f1a8c0ae9a0 legacy=0x7f1a8c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c073100 con 0x7f1a780047c0 2023-08-10T10:38:40.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15ae10 con 0x7f1a78003970 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.750+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7800fd90 con 0x7f1a8c15aa30 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 -- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 msgr2=0x7f1a78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 -- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 msgr2=0x7f1a78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a837fe640 1 -- 172.21.15.50:0/1035228976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78003520 con 0x7f1a780047c0 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c15aa30 0x7f1a78005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.751+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.752+0000 7f1a837fe640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a78004c40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c210 tx=0x7f1a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3408295f37888cc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.752+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7402cae0 con 0x7f1a780047c0 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.752+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7402cc60 con 0x7f1a780047c0 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.752+0000 7f1a8b7fe640 1 -- 172.21.15.50:0/1035228976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740058d0 con 0x7f1a780047c0 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 -- 172.21.15.50:0/1035228976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 msgr2=0x7f1a78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 --2- 172.21.15.50:0/1035228976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a78004c40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c210 tx=0x7f1a780057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a90adf640 1 -- 172.21.15.50:0/1035228976 reap_dead start 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 -- 172.21.15.50:0/1035228976 shutdown_connections 2023-08-10T10:38:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 -- 172.21.15.50:0/1035228976 >> 172.21.15.50:0/1035228976 conn(0x7f1a8c0cf780 msgr2=0x7f1a8c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 -- 172.21.15.50:0/1035228976 shutdown_connections 2023-08-10T10:38:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.753+0000 7f1a92542640 1 -- 172.21.15.50:0/1035228976 wait complete. 2023-08-10T10:38:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.755+0000 7f1a92542640 1 Processor -- start 2023-08-10T10:38:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.755+0000 7f1a92542640 1 -- start start 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c0b2630 0x7f1a8c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c14aad0 0x7f1a8c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b3f20 con 0x7f1a780047c0 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b33a0 con 0x7f1a8c0b2630 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a92542640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b3680 con 0x7f1a8c14aad0 2023-08-10T10:38:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.756+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36398/0 (socket says 172.21.15.50:36398) 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 -- 172.21.15.50:0/2529924092 learned_addr learned my addr 172.21.15.50:0/2529924092 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a837fe640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c0b2630 0x7f1a8c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 -- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c14aad0 msgr2=0x7f1a8c14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c14aad0 0x7f1a8c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 -- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c0b2630 msgr2=0x7f1a8c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c0b2630 0x7f1a8c0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 -- 172.21.15.50:0/2529924092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0b3960 con 0x7f1a780047c0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00f350 tx=0x7f1a7c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a897fa640 1 -- 172.21.15.50:0/2529924092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c003b90 con 0x7f1a780047c0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a897fa640 1 -- 172.21.15.50:0/2529924092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c011040 con 0x7f1a780047c0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.757+0000 7f1a897fa640 1 -- 172.21.15.50:0/2529924092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004020 con 0x7f1a780047c0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.758+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c0b3c40 con 0x7f1a780047c0 2023-08-10T10:38:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.758+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c0b2ff0 con 0x7f1a780047c0 2023-08-10T10:38:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.760+0000 7f1a897fa640 1 -- 172.21.15.50:0/2529924092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a7c004390 con 0x7f1a780047c0 2023-08-10T10:38:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.761+0000 7f1a897fa640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 0x7f1a6c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.761+0000 7f1a897fa640 1 -- 172.21.15.50:0/2529924092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a7c089de0 con 0x7f1a780047c0 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.761+0000 7f1a837fe640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 0x7f1a6c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.762+0000 7f1a9518a740 1 Processor -- start 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.762+0000 7f1a837fe640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 0x7f1a6c06d140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a74034000 tx=0x7f1a74007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.762+0000 7f1a9518a740 1 -- start start 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831b6b30 0x55f8831b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8831219d0 con 0x55f8831f2b30 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88311f0c0 con 0x55f8831f2f10 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88311a9b0 con 0x55f8831b6b30 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.763+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36400/0 (socket says 172.21.15.50:36400) 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1181030852 learned_addr learned my addr 172.21.15.50:0/1181030852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831b6b30 msgr2=0x55f8831b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831b6b30 0x55f8831b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 msgr2=0x55f8831b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1181030852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8830e7c10 con 0x55f8831f2b30 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c088050 tx=0x7f1a7c058520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89e5a57e604f698 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a81ffb640 1 -- 172.21.15.50:0/1181030852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c059ea0 con 0x55f8831f2b30 2023-08-10T10:38:40.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a81ffb640 1 -- 172.21.15.50:0/1181030852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0882e0 con 0x55f8831f2b30 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.764+0000 7f1a81ffb640 1 -- 172.21.15.50:0/1181030852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004640 con 0x55f8831f2b30 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 -- 172.21.15.50:0/1181030852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 msgr2=0x55f8831ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c088050 tx=0x7f1a7c058520 comp rx=0 tx=0).stop 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 -- 172.21.15.50:0/1181030852 shutdown_connections 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831b6b30 0x55f8831b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1181030852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831ff280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 -- 172.21.15.50:0/1181030852 >> 172.21.15.50:0/1181030852 conn(0x55f8831b3750 msgr2=0x55f8831fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 -- 172.21.15.50:0/1181030852 shutdown_connections 2023-08-10T10:38:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.765+0000 7f1a9518a740 1 -- 172.21.15.50:0/1181030852 wait complete. 2023-08-10T10:38:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.766+0000 7f1a9518a740 1 -- start start 2023-08-10T10:38:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.766+0000 7f1a9518a740 1 Processor -- start 2023-08-10T10:38:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8830bb940 con 0x55f8831f2b30 2023-08-10T10:38:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8830bb5e0 con 0x55f8831f2f10 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f882e81f20 con 0x55f8831eec10 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.767+0000 7f1a9518a740 10 client.0 _ll_register_callbacks cb 0x55f883114250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36404/0 (socket says 172.21.15.50:36404) 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 -- 172.21.15.50:0/388519817 learned_addr learned my addr 172.21.15.50:0/388519817 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 -- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 msgr2=0x55f8831dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a837fe640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 -- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 msgr2=0x55f8831ee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 -- 172.21.15.50:0/388519817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c0b2ff0 con 0x55f8831f2b30 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0608d0 tx=0x7f1a7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634b2c2c2b56f6d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.768+0000 7f1a6affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:38:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004840 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a7c057fa0 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f883144bf0 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a7c058160 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 10 client.4638 fetch_fsmap learned FSMap version 8 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f883119030 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f883144bf0 con 0x55f8831f2b30 2023-08-10T10:38:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1a7c014070 con 0x55f8831f2b30 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 10 client.4638 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 20 client.4638 populate_metadata read hostname 'smithi050' 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831f1910 0x55f8831df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 4 client.4638 mds_command: new command op to 4255 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.769+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 --> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f88310d7c0 con 0x55f8831f1910 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.770+0000 7f1a837fe640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831f1910 0x55f8831df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.771+0000 7f1a837fe640 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831f1910 0x55f8831df7f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaea0a2faadffcbc server_cookie=e4557cfc3faed131 in_seq=0 out_seq=0 2023-08-10T10:38:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.771+0000 7f1a6affd640 10 client.4638 ms_handle_connect on v2:172.21.15.117:6832/3889640263 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a6affd640 1 -- 172.21.15.50:0/388519817 <== mds.0 v2:172.21.15.117:6832/3889640263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f88310d7c0 con 0x55f8831f1910 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a6affd640 10 client.4638 handle_command_reply: tid=0 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 client.4638 shutdown 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 msgr2=0x55f8831dc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0608d0 tx=0x7f1a7c004ab0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 shutdown_connections 2023-08-10T10:38:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831f1910 0x55f8831df7f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 --2- 172.21.15.50:0/388519817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2b30 0x55f8831dc350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a6affd640 0 client.4638 ms_handle_reset on v2:172.21.15.117:6832/3889640263 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 >> 172.21.15.50:0/388519817 conn(0x55f8831b6b30 msgr2=0x55f8831b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.773+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 shutdown_connections 2023-08-10T10:38:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.774+0000 7f1a9518a740 1 -- 172.21.15.50:0/388519817 wait complete. 2023-08-10T10:38:40.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.774+0000 7f1a9518a740 20 client.4638 trim_cache size 0 max 16384 2023-08-10T10:38:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.791+0000 7f1a9518a740 1 Processor -- start 2023-08-10T10:38:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.791+0000 7f1a9518a740 1 -- start start 2023-08-10T10:38:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831f2b30 0x55f8831dc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8831b27a0 con 0x55f8831eec10 2023-08-10T10:38:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8831efaa0 con 0x55f8831f2f10 2023-08-10T10:38:40.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8831b77b0 con 0x55f8831f2b30 2023-08-10T10:38:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36414/0 (socket says 172.21.15.50:36414) 2023-08-10T10:38:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1557814148 learned_addr learned my addr 172.21.15.50:0/1557814148 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831f2b30 msgr2=0x55f8831dc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a837fe640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831f2b30 0x55f8831dc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831f2b30 0x55f8831dc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 msgr2=0x55f8831dc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831dc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a8bfff640 1 -- 172.21.15.50:0/1557814148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88314e8a0 con 0x55f8831eec10 2023-08-10T10:38:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.792+0000 7f1a90adf640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009940 tx=0x7f1a7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2ee035384b4f39 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a827fc640 1 -- 172.21.15.50:0/1557814148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004640 con 0x55f8831eec10 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a827fc640 1 -- 172.21.15.50:0/1557814148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0047e0 con 0x55f8831eec10 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a827fc640 1 -- 172.21.15.50:0/1557814148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c054c30 con 0x55f8831eec10 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 -- 172.21.15.50:0/1557814148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 msgr2=0x55f8832669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009940 tx=0x7f1a7c018000 comp rx=0 tx=0).stop 2023-08-10T10:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 -- 172.21.15.50:0/1557814148 shutdown_connections 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2f10 0x55f8831dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831f2b30 0x55f8831dc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 --2- 172.21.15.50:0/1557814148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831eec10 0x55f8832669f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.793+0000 7f1a9518a740 1 -- 172.21.15.50:0/1557814148 >> 172.21.15.50:0/1557814148 conn(0x55f8831b6b30 msgr2=0x55f8831e4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.794+0000 7f1a9518a740 1 -- 172.21.15.50:0/1557814148 shutdown_connections 2023-08-10T10:38:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.794+0000 7f1a9518a740 1 -- 172.21.15.50:0/1557814148 wait complete. 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.794+0000 7f1a9518a740 1 -- start start 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.794+0000 7f1a9518a740 1 Processor -- start 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 0x55f8831b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8831dcc20 con 0x55f8831f2f10 2023-08-10T10:38:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8831fc460 con 0x55f8831f2b30 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8831e0420 con 0x55f8831eec10 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.795+0000 7f1a9518a740 10 client.0 _ll_register_callbacks cb 0x7f1a7c007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36422/0 (socket says 172.21.15.50:36422) 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 -- 172.21.15.50:0/4097103811 learned_addr learned my addr 172.21.15.50:0/4097103811 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a837fe640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 0x55f8831b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 -- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 msgr2=0x55f8831fbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831fbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 -- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 msgr2=0x55f8831b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 0x55f8831b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 -- 172.21.15.50:0/4097103811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f883119030 con 0x55f8831f2f10 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831fbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a837fe640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 0x55f8831b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.796+0000 7f1a90adf640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0cf6b0 tx=0x7f1a84011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e7a841a213e251 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84015660 con 0x55f8831f2f10 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a840157c0 con 0x55f8831f2f10 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a7c0882e0 con 0x55f8831f2f10 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a84015980 con 0x55f8831f2f10 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 10 client.4644 fetch_fsmap learned FSMap version 8 2023-08-10T10:38:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f8830ba610 con 0x55f8831f2f10 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0882e0 con 0x55f8831f2f10 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1a84015ae0 con 0x55f8831f2f10 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 10 client.4644 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.797+0000 7f1a9518a740 20 client.4644 populate_metadata read hostname 'smithi050' 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.798+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831de500 0x55f8831de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.798+0000 7f1a9518a740 4 client.4644 mds_command: new command op to 4255 tid=0[{"prefix": "status"}] 2023-08-10T10:38:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.798+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 --> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f883113990 con 0x55f8831de500 2023-08-10T10:38:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.798+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831de500 0x55f8831de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.799+0000 7f1a8bfff640 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831de500 0x55f8831de8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5fc0b7b34d428a server_cookie=150e3c95df1e9c9c in_seq=0 out_seq=0 2023-08-10T10:38:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.799+0000 7f1a6affd640 10 client.4644 ms_handle_connect on v2:172.21.15.117:6832/3889640263 2023-08-10T10:38:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a6affd640 1 -- 172.21.15.50:0/4097103811 <== mds.0 v2:172.21.15.117:6832/3889640263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f883113990 con 0x55f8831de500 2023-08-10T10:38:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a6affd640 10 client.4644 handle_command_reply: tid=0 2023-08-10T10:38:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 client.4644 shutdown 2023-08-10T10:38:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 msgr2=0x55f8831b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0cf6b0 tx=0x7f1a84011630 comp rx=0 tx=0).stop 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 shutdown_connections 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:6832/3889640263,v1:172.21.15.117:6834/3889640263] conn(0x55f8831de500 0x55f8831de8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8831f2f10 0x55f8831b1e10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8831f2b30 0x55f8831b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 --2- 172.21.15.50:0/4097103811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8831eec10 0x55f8831fbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a6affd640 0 client.4644 ms_handle_reset on v2:172.21.15.117:6832/3889640263 2023-08-10T10:38:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.800+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 >> 172.21.15.50:0/4097103811 conn(0x55f8831b6b30 msgr2=0x55f88321e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 shutdown_connections 2023-08-10T10:38:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a9518a740 1 -- 172.21.15.50:0/4097103811 wait complete. 2023-08-10T10:38:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a9518a740 20 client.4644 trim_cache size 0 max 16384 2023-08-10T10:38:40.809 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:38:40.809 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4255, 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 18.447745331, 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 8, 2023-08-10T10:38:40.810 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 23, 2023-08-10T10:38:40.811 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 23, 2023-08-10T10:38:40.811 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 25.456735004999999 2023-08-10T10:38:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:38:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 msgr2=0x7f1a6c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 0x7f1a6c06d140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a74034000 tx=0x7f1a74007000 comp rx=0 tx=0).stop 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 msgr2=0x7f1a8c1ed8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00f350 tx=0x7f1a7c00f810 comp rx=0 tx=0).stop 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 shutdown_connections 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c14aad0 0x7f1a8c14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a6c06ac80 0x7f1a6c06d140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c0b2630 0x7f1a8c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 --2- 172.21.15.50:0/2529924092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a780047c0 0x7f1a8c1ed8a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.801+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 >> 172.21.15.50:0/2529924092 conn(0x7f1a8c0cf780 msgr2=0x7f1a8c0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.802+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 shutdown_connections 2023-08-10T10:38:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:40.802+0000 7f1a92542640 1 -- 172.21.15.50:0/2529924092 wait complete. 2023-08-10T10:38:40.822 INFO:teuthology.run_tasks:Running task kclient... 2023-08-10T10:38:40.845 INFO:tasks.kclient:Mounting kernel clients... 2023-08-10T10:38:40.846 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-10T10:38:40.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:40.847 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:38:40.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:40.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-08-10T10:38:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-08-10T10:38:41.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:38:41.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.023 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:38:41.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-08-10T10:38:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-08-10T10:38:41.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:38:41.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.185 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:38:41.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.247 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-10T10:38:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-10T10:38:41.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:38:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.356 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:38:41.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:41.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-10T10:38:41.505 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-10T10:38:41.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:38:41.510 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-10T10:38:41.510 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:38:41.510 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:38:41.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:38:41.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:41.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:38:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.738+0000 7fab628b8640 1 Processor -- start 2023-08-10T10:38:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.738+0000 7fab628b8640 1 -- start start 2023-08-10T10:38:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.739+0000 7fab628b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab5c159970 0x7fab5c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab628b8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab5c069db0 0x7fab5c0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab628b8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c15e1f0 con 0x7fab5c0b0f00 2023-08-10T10:38:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab628b8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c15d5e0 con 0x7fab5c069db0 2023-08-10T10:38:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab628b8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c15d8c0 con 0x7fab5c159970 2023-08-10T10:38:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab5c069db0 0x7fab5c0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab5c069db0 0x7fab5c0b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36430/0 (socket says 172.21.15.50:36430) 2023-08-10T10:38:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 -- 172.21.15.50:0/235082412 learned_addr learned my addr 172.21.15.50:0/235082412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab5bfff640 1 --2- 172.21.15.50:0/235082412 >> v2:172.21.15.117:3300/0 conn(0x7fab5c159970 0x7fab5c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 -- 172.21.15.50:0/235082412 >> v2:172.21.15.117:3300/0 conn(0x7fab5c159970 msgr2=0x7fab5c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 --2- 172.21.15.50:0/235082412 >> v2:172.21.15.117:3300/0 conn(0x7fab5c159970 0x7fab5c0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.740+0000 7fab60e55640 1 -- 172.21.15.50:0/235082412 >> v1:172.21.15.117:6789/0 conn(0x7fab5c0b0f00 legacy=0x7fab5c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.741+0000 7fab60e55640 1 -- 172.21.15.50:0/235082412 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c15dba0 con 0x7fab5c069db0 2023-08-10T10:38:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab60e55640 1 --2- 172.21.15.50:0/235082412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c069db0 0x7fab5c0b1ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0ce530 tx=0x7fab5402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51c7179c84cb02c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab5affd640 1 -- 172.21.15.50:0/235082412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5402ca80 con 0x7fab5c069db0 2023-08-10T10:38:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab5affd640 1 -- 172.21.15.50:0/235082412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5402cbe0 con 0x7fab5c069db0 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab5affd640 1 -- 172.21.15.50:0/235082412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540343f0 con 0x7fab5c069db0 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab628b8640 1 -- 172.21.15.50:0/235082412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c069db0 msgr2=0x7fab5c0b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.742+0000 7fab628b8640 1 --2- 172.21.15.50:0/235082412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c069db0 0x7fab5c0b1ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0ce530 tx=0x7fab5402bee0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 -- 172.21.15.50:0/235082412 shutdown_connections 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 --2- 172.21.15.50:0/235082412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c069db0 0x7fab5c0b1ae0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 --2- 172.21.15.50:0/235082412 >> v2:172.21.15.117:3300/0 conn(0x7fab5c159970 0x7fab5c0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 -- 172.21.15.50:0/235082412 >> 172.21.15.50:0/235082412 conn(0x7fab5c06b590 msgr2=0x7fab5c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 -- 172.21.15.50:0/235082412 shutdown_connections 2023-08-10T10:38:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.743+0000 7fab628b8640 1 -- 172.21.15.50:0/235082412 wait complete. 2023-08-10T10:38:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.744+0000 7fab628b8640 1 Processor -- start 2023-08-10T10:38:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.745+0000 7fab628b8640 1 -- start start 2023-08-10T10:38:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.745+0000 7fab628b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c069db0 0x7fab5c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab628b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab628b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c159970 0x7fab5c149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab628b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c14ca30 con 0x7fab5c0b0f00 2023-08-10T10:38:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab628b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c14dbf0 con 0x7fab5c069db0 2023-08-10T10:38:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab628b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0c6b40 con 0x7fab5c159970 2023-08-10T10:38:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36440/0 (socket says 172.21.15.50:36440) 2023-08-10T10:38:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 -- 172.21.15.50:0/274907142 learned_addr learned my addr 172.21.15.50:0/274907142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5bfff640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c069db0 0x7fab5c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab60e55640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c159970 0x7fab5c149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 -- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c159970 msgr2=0x7fab5c149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c159970 0x7fab5c149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 -- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c069db0 msgr2=0x7fab5c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c069db0 0x7fab5c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.746+0000 7fab5b7fe640 1 -- 172.21.15.50:0/274907142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54009b30 con 0x7fab5c0b0f00 2023-08-10T10:38:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab5b7fe640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c430 tx=0x7fab5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50011790 con 0x7fab5c0b0f00 2023-08-10T10:38:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab500118f0 con 0x7fab5c0b0f00 2023-08-10T10:38:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50011ce0 con 0x7fab5c0b0f00 2023-08-10T10:38:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c14beb0 con 0x7fab5c0b0f00 2023-08-10T10:38:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.747+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c14c470 con 0x7fab5c0b0f00 2023-08-10T10:38:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.748+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c04e270 con 0x7fab5c0b0f00 2023-08-10T10:38:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.749+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab5001c460 con 0x7fab5c0b0f00 2023-08-10T10:38:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.750+0000 7fab58ff9640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 0x7fab4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.750+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab50089510 con 0x7fab5c0b0f00 2023-08-10T10:38:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.750+0000 7fab5bfff640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 0x7fab4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.751+0000 7fab5bfff640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 0x7fab4806d110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fab4c006fd0 tx=0x7fab4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.755+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab50054520 con 0x7fab5c0b0f00 2023-08-10T10:38:41.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.987+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab5c0c6cd0 con 0x7fab5c0b0f00 2023-08-10T10:38:41.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.988+0000 7fab58ff9640 1 -- 172.21.15.50:0/274907142 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fab50057b40 con 0x7fab5c0b0f00 2023-08-10T10:38:41.990 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:38:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.990+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 msgr2=0x7fab4806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.990+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 0x7fab4806d110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fab4c006fd0 tx=0x7fab4c008040 comp rx=0 tx=0).stop 2023-08-10T10:38:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 msgr2=0x7fab5c0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c430 tx=0x7fab5000c8f0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 shutdown_connections 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c159970 0x7fab5c149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c0b0f00 0x7fab5c0c8c40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab4806ac50 0x7fab4806d110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 --2- 172.21.15.50:0/274907142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c069db0 0x7fab5c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 >> 172.21.15.50:0/274907142 conn(0x7fab5c06b590 msgr2=0x7fab5c0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:41.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 shutdown_connections 2023-08-10T10:38:41.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:41.991+0000 7fab628b8640 1 -- 172.21.15.50:0/274907142 wait complete. 2023-08-10T10:38:42.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:38:42.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:38:42.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:38:42.012 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:38:42.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:42.012 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:38:42.064 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:42.065 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:42.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:42.066 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:38:42.066 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:42.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:42.066 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41204sec preferred_lft 41204sec 2023-08-10T10:38:42.068 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:38:42.069 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:42.069 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:42.069 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:42.069 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:38:42.070 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:38:42.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:42.071 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:42.071 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:42.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:38:42.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-08-10T10:38:42.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-08-10T10:38:42.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:38:42.072 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:42.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:42.586 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:38:42.675 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:38:42.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:42.679 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:38:42.738 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:38:42.739 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:38:42.739 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:38:42.739 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:38:42.740 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:38:42.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:42.741 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:42.742 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:42.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:38:42.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:38:42.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:38:42.743 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:43.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:43.642 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:38:43.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:43.703 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-08-10T10:38:43.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:43.760 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:43.761 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:43.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:38:43.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-10T10:38:43.762 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:43.918 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-10T10:38:43.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:43.920 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:43.920 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:43.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-10T10:38:43.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:38:43.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-10T10:38:43.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-10T10:38:43.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-10T10:38:43.924 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:44.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:44.228 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:44.228 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:44.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:38:44.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:38:44.229 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:44.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:44.415 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:38:44.471 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:38:44.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:44.472 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:38:44.529 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:38:44.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:44.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:44.674 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:44.674 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:45.237 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:45.238 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:45.238 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:38:45.238 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:38:45.238 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:38:45.240 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:38:45.240 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:38:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:38:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:38:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:38:45.244 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:38:45.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:45.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:38:45.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:45.339 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:45.397 INFO:teuthology.orchestra.run.smithi050.stdout:client4653 2023-08-10T10:38:45.397 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:45.398 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:38:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:45.445 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:45.551 INFO:teuthology.orchestra.run.smithi050.stdout:client4653 2023-08-10T10:38:45.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:45.552 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:45.622 INFO:teuthology.orchestra.run.smithi050.stdout:client4653 2023-08-10T10:38:45.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:45.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4653/status') 2023-08-10T10:38:45.729 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4653 (3)192.168.0.1:0/3457013769 2023-08-10T10:38:45.730 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2023-08-10T10:38:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2023-08-10T10:38:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2023-08-10T10:38:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:69 bytes copied, 7.989e-05 s, 864 kB/s 2023-08-10T10:38:45.733 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-08-10T10:38:45.734 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:38:45.734 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:38:45.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:38:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.958+0000 7f19b06b4640 1 Processor -- start 2023-08-10T10:38:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.959+0000 7f19b06b4640 1 -- start start 2023-08-10T10:38:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.960+0000 7f19b06b4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19a815f370 0x7f19a80cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.960+0000 7f19b06b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a80cf810 con 0x7f19a80cf3c0 2023-08-10T10:38:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.960+0000 7f19b06b4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a80b0000 con 0x7f19a80afc20 2023-08-10T10:38:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.960+0000 7f19b06b4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a80cbe60 con 0x7f19a815f370 2023-08-10T10:38:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19aec51640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19a80cf3c0 0x7f19a815a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42964/0 (socket says 172.21.15.50:42964) 2023-08-10T10:38:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19aec51640 1 -- 172.21.15.50:0/2714625681 learned_addr learned my addr 172.21.15.50:0/2714625681 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19adc4f640 1 --2- 172.21.15.50:0/2714625681 >> v2:172.21.15.117:3300/0 conn(0x7f19a815f370 0x7f19a80cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195127766 0 0) 0x7f19a0001110 con 0x7f19a80cf3c0 2023-08-10T10:38:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1994003520 con 0x7f19a80cf3c0 2023-08-10T10:38:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830918109 0 0) 0x7f1994003520 con 0x7f19a80cf3c0 2023-08-10T10:38:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 >> v2:172.21.15.117:3300/0 conn(0x7f19a815f370 msgr2=0x7f19a80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 --2- 172.21.15.50:0/2714625681 >> v2:172.21.15.117:3300/0 conn(0x7f19a815f370 0x7f19a80cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 >> v1:172.21.15.117:6789/0 conn(0x7f19a80afc20 legacy=0x7f19a80cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80cc140 con 0x7f19a80cf3c0 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.961+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f19a0001800 con 0x7f19a80cf3c0 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 >> v1:172.21.15.50:6789/0 conn(0x7f19a80cf3c0 legacy=0x7f19a815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940039a0 0x7f1994003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 0x7f199400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80cbe60 con 0x7f1994005180 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199400bfd0 con 0x7f19940039a0 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199400c190 con 0x7f19940047c0 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19ae450640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940039a0 0x7f1994003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19aec51640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 0x7f199400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.962+0000 7f19adc4f640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.963+0000 7f19aec51640 1 -- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940047c0 msgr2=0x7f1994004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.963+0000 7f19aec51640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.963+0000 7f19aec51640 1 -- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940039a0 msgr2=0x7f1994003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:45.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.963+0000 7f19aec51640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940039a0 0x7f1994003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.963+0000 7f19aec51640 1 -- 172.21.15.50:0/2714625681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994003520 con 0x7f1994005180 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.964+0000 7f19aec51640 1 -- 172.21.15.50:0/2714625681 reap_dead start 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.964+0000 7f19aec51640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 0x7f199400b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c240 tx=0x7f19940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721c52b3fa83c153 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.964+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0005ad0 con 0x7f1994005180 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.964+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0005c50 con 0x7f1994005180 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.964+0000 7f19ad44e640 1 -- 172.21.15.50:0/2714625681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a002c8a0 con 0x7f1994005180 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 -- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 msgr2=0x7f199400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 0x7f199400b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c240 tx=0x7f19940057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 -- 172.21.15.50:0/2714625681 shutdown_connections 2023-08-10T10:38:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 --2- 172.21.15.50:0/2714625681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1994005180 0x7f199400b980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 -- 172.21.15.50:0/2714625681 >> 172.21.15.50:0/2714625681 conn(0x7f19a80d0930 msgr2=0x7f19a80d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 -- 172.21.15.50:0/2714625681 shutdown_connections 2023-08-10T10:38:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.965+0000 7f19b06b4640 1 -- 172.21.15.50:0/2714625681 wait complete. 2023-08-10T10:38:45.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.967+0000 7f19b06b4640 1 Processor -- start 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.967+0000 7f19b06b4640 1 -- start start 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1994005180 0x7f19a80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19a814f090 0x7f19a814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a81f4ab0 con 0x7f19a814bc90 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814c140 con 0x7f1994005180 2023-08-10T10:38:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19b06b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814ec00 con 0x7f19a814f090 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.968+0000 7f19aec51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49002/0 (socket says 172.21.15.50:49002) 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 -- 172.21.15.50:0/3455224038 learned_addr learned my addr 172.21.15.50:0/3455224038 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19ae450640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1994005180 0x7f19a80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19adc4f640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19a814f090 0x7f19a814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 -- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19a814f090 msgr2=0x7f19a814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19a814f090 0x7f19a814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 -- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1994005180 msgr2=0x7f19a80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1994005180 0x7f19a80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 -- 172.21.15.50:0/3455224038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a81f47d0 con 0x7f19a814bc90 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.969+0000 7f19aec51640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c330 tx=0x7f19a0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.970+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00049e0 con 0x7f19a814bc90 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.970+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0004b40 con 0x7f19a814bc90 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.970+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a814e5b0 con 0x7f19a814bc90 2023-08-10T10:38:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.970+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0001110 con 0x7f19a814bc90 2023-08-10T10:38:45.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.970+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a80b5ed0 con 0x7f19a814bc90 2023-08-10T10:38:45.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.971+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a804e270 con 0x7f19a814bc90 2023-08-10T10:38:45.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.972+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19a0032070 con 0x7f19a814bc90 2023-08-10T10:38:45.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.973+0000 7f199effd640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 0x7f198c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:45.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.973+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19a003c070 con 0x7f19a814bc90 2023-08-10T10:38:45.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.974+0000 7f19ae450640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 0x7f198c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:45.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.974+0000 7f19ae450640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 0x7f198c06d140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001a20 tx=0x7f19a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:45.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:45.978+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f19a0075640 con 0x7f19a814bc90 2023-08-10T10:38:46.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.209+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19a80cf810 con 0x7f19a814bc90 2023-08-10T10:38:46.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.209+0000 7f199effd640 1 -- 172.21.15.50:0/3455224038 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19a80cf810 con 0x7f19a814bc90 2023-08-10T10:38:46.210 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:38:46.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 msgr2=0x7f198c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:46.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 0x7f198c06d140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001a20 tx=0x7f19a4009040 comp rx=0 tx=0).stop 2023-08-10T10:38:46.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 msgr2=0x7f19a81f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:46.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c330 tx=0x7f19a0001b90 comp rx=0 tx=0).stop 2023-08-10T10:38:46.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 shutdown_connections 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a814bc90 0x7f19a81f3b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19a814f090 0x7f19a814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f198c06ac80 0x7f198c06d140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 --2- 172.21.15.50:0/3455224038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1994005180 0x7f19a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.212+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 >> 172.21.15.50:0/3455224038 conn(0x7f19a80d0930 msgr2=0x7f19a80cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.213+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 shutdown_connections 2023-08-10T10:38:46.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:46.213+0000 7f19b06b4640 1 -- 172.21.15.50:0/3455224038 wait complete. 2023-08-10T10:38:46.235 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:38:46.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:38:46.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:38:46.235 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-10T10:38:46.235 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:38:46.236 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:38:46.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:38:46.236 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:38:46.236 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:38:46.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.237 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:38:46.296 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.297 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:38:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41199sec preferred_lft 41199sec 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.300 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:38:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:38:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:38:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:46.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.302 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:38:46.402 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:38:46.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.407 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:38:46.469 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:38:46.470 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:38:46.470 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:38:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:38:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:38:46.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.472 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:46.473 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:46.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:38:46.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:38:46.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:38:46.475 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:46.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.681 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:38:46.735 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:38:46.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.736 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-08-10T10:38:46.792 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-10T10:38:46.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.794 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:46.794 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:46.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:38:46.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-10T10:38:46.795 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:46.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:46.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:38:47.053 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.054 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 56:17:64:d5:dc:06 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:38:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:38:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::5417:64ff:fed5:dc06/64 scope link 2023-08-10T10:38:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:47.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:38:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 56:17:64:d5:dc:06 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::5417:64ff:fed5:dc06/64 scope link 2023-08-10T10:38:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:47.161 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-10T10:38:47.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:47.161 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:47.162 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:47.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-10T10:38:47.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:38:47.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-10T10:38:47.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-10T10:38:47.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-10T10:38:47.163 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:47.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:47.460 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:38:47.460 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:38:47.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-08-10T10:38:47.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:38:47.461 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:38:47.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:47.635 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-10T10:38:47.692 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:38:47.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:47.693 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:38:47.745 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-08-10T10:38:47.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:47.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:47.880 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:47.881 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:47.916 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:47.917 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:47.917 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:38:47.918 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 2@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:38:47.918 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:38:47.919 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-08-10T10:38:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:38:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:38:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:38:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:38:47.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:38:47.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:47.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:38:48.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.027 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:48.093 INFO:teuthology.orchestra.run.smithi050.stdout:client4478 2023-08-10T10:38:48.094 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:38:48.094 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:38:48.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.150 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:48.215 INFO:teuthology.orchestra.run.smithi050.stdout:client4478 2023-08-10T10:38:48.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.216 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:48.284 INFO:teuthology.orchestra.run.smithi050.stdout:client4478 2023-08-10T10:38:48.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.285 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4478/status') 2023-08-10T10:38:48.388 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4478 (3)172.21.15.50:0/1731288642 2023-08-10T10:38:48.389 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2023-08-10T10:38:48.389 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2023-08-10T10:38:48.389 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2023-08-10T10:38:48.390 INFO:teuthology.orchestra.run.smithi050.stderr:70 bytes copied, 7.4448e-05 s, 940 kB/s 2023-08-10T10:38:48.392 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-10T10:38:48.392 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:38:48.393 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:38:48.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:38:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.618+0000 7fdfbf309640 1 Processor -- start 2023-08-10T10:38:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.618+0000 7fdfbf309640 1 -- start start 2023-08-10T10:38:48.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfb815ff90 0x7fdfb8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfb80cd960 0x7fdfb80d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb80d2370 0x7fdfb80d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80d0b90 con 0x7fdfb80cd960 2023-08-10T10:38:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb81614d0 con 0x7fdfb815ff90 2023-08-10T10:38:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.619+0000 7fdfbf309640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8160370 con 0x7fdfb80d2370 2023-08-10T10:38:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfb80cd960 0x7fdfb80d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfb80cd960 0x7fdfb80d1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49018/0 (socket says 172.21.15.50:49018) 2023-08-10T10:38:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 -- 172.21.15.50:0/1614359542 learned_addr learned my addr 172.21.15.50:0/1614359542 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbe307640 1 --2- 172.21.15.50:0/1614359542 >> v2:172.21.15.117:3300/0 conn(0x7fdfb815ff90 0x7fdfb8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbeb08640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb80d2370 0x7fdfb80d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 -- 172.21.15.50:0/1614359542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb80d2370 msgr2=0x7fdfb80d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb80d2370 0x7fdfb80d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 -- 172.21.15.50:0/1614359542 >> v2:172.21.15.117:3300/0 conn(0x7fdfb815ff90 msgr2=0x7fdfb8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.620+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/1614359542 >> v2:172.21.15.117:3300/0 conn(0x7fdfb815ff90 0x7fdfb8160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.621+0000 7fdfbdb06640 1 -- 172.21.15.50:0/1614359542 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80d0d90 con 0x7fdfb80cd960 2023-08-10T10:38:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.622+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb80d1e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8071330 tx=0x7fdfa802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9ad5739dfcd413 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.622+0000 7fdfbd305640 1 -- 172.21.15.50:0/1614359542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8031870 con 0x7fdfb80cd960 2023-08-10T10:38:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.622+0000 7fdfbd305640 1 -- 172.21.15.50:0/1614359542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa80319d0 con 0x7fdfb80cd960 2023-08-10T10:38:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.622+0000 7fdfbd305640 1 -- 172.21.15.50:0/1614359542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8031d60 con 0x7fdfb80cd960 2023-08-10T10:38:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 -- 172.21.15.50:0/1614359542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 msgr2=0x7fdfb80d1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb80d1e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8071330 tx=0x7fdfa802b910 comp rx=0 tx=0).stop 2023-08-10T10:38:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 -- 172.21.15.50:0/1614359542 shutdown_connections 2023-08-10T10:38:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb80d2370 0x7fdfb80d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 --2- 172.21.15.50:0/1614359542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb80d1e30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 --2- 172.21.15.50:0/1614359542 >> v2:172.21.15.117:3300/0 conn(0x7fdfb815ff90 0x7fdfb8160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 -- 172.21.15.50:0/1614359542 >> 172.21.15.50:0/1614359542 conn(0x7fdfb8069ac0 msgr2=0x7fdfb8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 -- 172.21.15.50:0/1614359542 shutdown_connections 2023-08-10T10:38:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.623+0000 7fdfbf309640 1 -- 172.21.15.50:0/1614359542 wait complete. 2023-08-10T10:38:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.625+0000 7fdfbf309640 1 Processor -- start 2023-08-10T10:38:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.625+0000 7fdfbf309640 1 -- start start 2023-08-10T10:38:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 0x7fdfb80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb815ff90 0x7fdfb815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815b880 con 0x7fdfb80cd960 2023-08-10T10:38:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815bad0 con 0x7fdfb80d2370 2023-08-10T10:38:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbf309640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815bdb0 con 0x7fdfb815ff90 2023-08-10T10:38:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbe307640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbe307640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49034/0 (socket says 172.21.15.50:49034) 2023-08-10T10:38:48.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbe307640 1 -- 172.21.15.50:0/3301662576 learned_addr learned my addr 172.21.15.50:0/3301662576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:48.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 0x7fdfb80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.626+0000 7fdfbeb08640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb815ff90 0x7fdfb815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 -- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb815ff90 msgr2=0x7fdfb815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb815ff90 0x7fdfb815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 -- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 msgr2=0x7fdfb80c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 0x7fdfb80c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 -- 172.21.15.50:0/3301662576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80094d0 con 0x7fdfb80cd960 2023-08-10T10:38:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 0x7fdfb80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbe307640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d5f0 tx=0x7fdfb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40125f0 con 0x7fdfb80cd960 2023-08-10T10:38:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4012750 con 0x7fdfb80cd960 2023-08-10T10:38:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4012b00 con 0x7fdfb80cd960 2023-08-10T10:38:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb815c090 con 0x7fdfb80cd960 2023-08-10T10:38:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.627+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb815db70 con 0x7fdfb80cd960 2023-08-10T10:38:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.629+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8066e30 con 0x7fdfb80cd960 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.630+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfb4012c60 con 0x7fdfb80cd960 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.631+0000 7fdfaeffd640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 0x7fdf9c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.631+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfb40899c0 con 0x7fdfb80cd960 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.631+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 0x7fdf9c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.632+0000 7fdfbdb06640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 0x7fdf9c06d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8036000 tx=0x7fdfa803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.636+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdfb4054a60 con 0x7fdfb80cd960 2023-08-10T10:38:48.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.873+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfb80d05c0 con 0x7fdfb80cd960 2023-08-10T10:38:48.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.874+0000 7fdfaeffd640 1 -- 172.21.15.50:0/3301662576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfb4058080 con 0x7fdfb80cd960 2023-08-10T10:38:48.875 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 msgr2=0x7fdf9c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 0x7fdf9c06d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8036000 tx=0x7fdfa803c040 comp rx=0 tx=0).stop 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 msgr2=0x7fdfb815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d5f0 tx=0x7fdfb400dab0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 shutdown_connections 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfb815ff90 0x7fdfb815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdf9c06ac50 0x7fdf9c06d110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb80d2370 0x7fdfb80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 --2- 172.21.15.50:0/3301662576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfb80cd960 0x7fdfb815d630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:48.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 >> 172.21.15.50:0/3301662576 conn(0x7fdfb8069ac0 msgr2=0x7fdfb80c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:48.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 shutdown_connections 2023-08-10T10:38:48.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:48.877+0000 7fdfbf309640 1 -- 172.21.15.50:0/3301662576 wait complete. 2023-08-10T10:38:48.896 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:38:48.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:38:48.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:38:48.897 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:38:48.897 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:38:48.897 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:38:48.898 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:38:48.898 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:38:48.898 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:38:48.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.898 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:38:48.960 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41368sec preferred_lft 41368sec 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:38:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:48.962 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:38:48.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:48.963 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:48.963 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:48.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:38:48.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2023-08-10T10:38:48.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2023-08-10T10:38:48.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:38:48.964 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:49.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:49.465 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:38:49.544 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:38:49.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:49.548 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:38:49.598 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:38:49.598 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:38:49.598 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:38:49.598 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:38:49.599 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:38:49.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:49.599 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:49.600 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:49.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:38:49.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:38:49.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:38:49.601 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:50.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:50.392 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:38:50.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:50.448 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-08-10T10:38:50.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:50.505 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:50.505 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:50.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:38:50.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-10T10:38:50.506 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:50.646 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-10T10:38:50.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:50.647 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:50.647 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:50.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-10T10:38:50.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:38:50.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-10T10:38:50.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-10T10:38:50.649 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-10T10:38:50.649 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:51.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:51.009 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:51.009 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:51.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:38:51.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:38:51.010 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:51.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:51.178 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:38:51.227 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:38:51.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:51.228 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:38:51.274 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:38:51.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:51.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:51.465 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:51.465 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:51.967 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:51.968 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:51.968 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:38:51.968 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:38:51.968 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:38:51.971 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:38:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:38:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:38:51.972 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:38:51.973 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:38:51.976 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:38:51.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:51.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:38:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.069 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:52.127 INFO:teuthology.orchestra.run.smithi117.stdout:client4591 2023-08-10T10:38:52.127 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:52.127 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:38:52.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.181 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:52.237 INFO:teuthology.orchestra.run.smithi117.stdout:client4591 2023-08-10T10:38:52.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.238 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:52.294 INFO:teuthology.orchestra.run.smithi117.stdout:client4591 2023-08-10T10:38:52.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.295 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4591/status') 2023-08-10T10:38:52.390 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4591 (3)192.168.0.1:0/2598806122 2023-08-10T10:38:52.390 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2023-08-10T10:38:52.390 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2023-08-10T10:38:52.390 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2023-08-10T10:38:52.391 INFO:teuthology.orchestra.run.smithi117.stderr:69 bytes copied, 6.6324e-05 s, 1.0 MB/s 2023-08-10T10:38:52.394 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-08-10T10:38:52.394 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:38:52.394 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:38:52.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:38:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.633+0000 7f507359e640 1 Processor -- start 2023-08-10T10:38:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.634+0000 7f507359e640 1 -- start start 2023-08-10T10:38:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f507359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50740c1a10 0x7f5074165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f507359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50740c8e80 0x7f50740696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f507359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740c9bb0 con 0x7f5074069be0 2023-08-10T10:38:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f507359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5074165a70 con 0x7f50740c8e80 2023-08-10T10:38:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f507359e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5074069ff0 con 0x7f50740c1a10 2023-08-10T10:38:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.635+0000 7f506bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50740c8e80 0x7f50740696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f5072d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5074069be0 0x7f507406ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42966/0 (socket says 172.21.15.50:42966) 2023-08-10T10:38:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f5072d9d640 1 -- 172.21.15.50:0/3246769596 learned_addr learned my addr 172.21.15.50:0/3246769596 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f507259c640 1 --2- 172.21.15.50:0/3246769596 >> v2:172.21.15.117:3300/0 conn(0x7f50740c1a10 0x7f5074165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f506bfff640 1 -- 172.21.15.50:0/3246769596 >> v2:172.21.15.117:3300/0 conn(0x7f50740c1a10 msgr2=0x7f5074165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f506bfff640 1 --2- 172.21.15.50:0/3246769596 >> v2:172.21.15.117:3300/0 conn(0x7f50740c1a10 0x7f5074165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f506bfff640 1 -- 172.21.15.50:0/3246769596 >> v1:172.21.15.50:6789/0 conn(0x7f5074069be0 legacy=0x7f507406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f506bfff640 1 -- 172.21.15.50:0/3246769596 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740c95f0 con 0x7f50740c8e80 2023-08-10T10:38:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.636+0000 7f5071d9b640 1 -- 172.21.15.50:0/3246769596 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101871507 0 0) 0x7f50740c9bb0 con 0x7f5074069be0 2023-08-10T10:38:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.637+0000 7f506bfff640 1 --2- 172.21.15.50:0/3246769596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50740c8e80 0x7f50740696a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f507406cc70 tx=0x7f505c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed47dba05c2d6a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.637+0000 7f5071d9b640 1 -- 172.21.15.50:0/3246769596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c031830 con 0x7f50740c8e80 2023-08-10T10:38:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f5071d9b640 1 -- 172.21.15.50:0/3246769596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c031990 con 0x7f50740c8e80 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f5071d9b640 1 -- 172.21.15.50:0/3246769596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c031d20 con 0x7f50740c8e80 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 -- 172.21.15.50:0/3246769596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50740c8e80 msgr2=0x7f50740696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 --2- 172.21.15.50:0/3246769596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50740c8e80 0x7f50740696a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f507406cc70 tx=0x7f505c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 -- 172.21.15.50:0/3246769596 shutdown_connections 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 --2- 172.21.15.50:0/3246769596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50740c8e80 0x7f50740696a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 --2- 172.21.15.50:0/3246769596 >> v2:172.21.15.117:3300/0 conn(0x7f50740c1a10 0x7f5074165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 -- 172.21.15.50:0/3246769596 >> 172.21.15.50:0/3246769596 conn(0x7f50740cafa0 msgr2=0x7f50740cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 -- 172.21.15.50:0/3246769596 shutdown_connections 2023-08-10T10:38:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.638+0000 7f507359e640 1 -- 172.21.15.50:0/3246769596 wait complete. 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.640+0000 7f507359e640 1 Processor -- start 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.640+0000 7f507359e640 1 -- start start 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50740c1a10 0x7f50740c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 0x7f50740aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50741f8140 con 0x7f5074069be0 2023-08-10T10:38:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507406f7f0 con 0x7f50740c8e80 2023-08-10T10:38:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740b2ab0 con 0x7f50740c1a10 2023-08-10T10:38:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.641+0000 7f507259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49054/0 (socket says 172.21.15.50:49054) 2023-08-10T10:38:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 -- 172.21.15.50:0/1264723376 learned_addr learned my addr 172.21.15.50:0/1264723376 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:52.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f506bfff640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50740c1a10 0x7f50740c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f5072d9d640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 0x7f50740aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 -- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50740c1a10 msgr2=0x7f50740c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50740c1a10 0x7f50740c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 -- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 msgr2=0x7f50740aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 0x7f50740aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 -- 172.21.15.50:0/1264723376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009400 con 0x7f5074069be0 2023-08-10T10:38:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f5072d9d640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 0x7f50740aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.642+0000 7f507259c640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f506400d800 tx=0x7f506400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.643+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400b6c0 con 0x7f5074069be0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.643+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400b820 con 0x7f5074069be0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.643+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400bbb0 con 0x7f5074069be0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.643+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50741f7c10 con 0x7f5074069be0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.643+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740b2210 con 0x7f5074069be0 2023-08-10T10:38:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.644+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740cc580 con 0x7f5074069be0 2023-08-10T10:38:52.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.645+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f506400bd10 con 0x7f5074069be0 2023-08-10T10:38:52.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.646+0000 7f506affd640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 0x7f505406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:52.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.646+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5064089b00 con 0x7f5074069be0 2023-08-10T10:38:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.646+0000 7f506bfff640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 0x7f505406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.647+0000 7f506bfff640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 0x7f505406d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f505c036000 tx=0x7f505c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:52.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.651+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50740cc580 con 0x7f5074069be0 2023-08-10T10:38:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.884+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50740cc580 con 0x7f5074069be0 2023-08-10T10:38:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.885+0000 7f506affd640 1 -- 172.21.15.50:0/1264723376 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50740cc580 con 0x7f5074069be0 2023-08-10T10:38:52.886 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:38:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 msgr2=0x7f505406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 0x7f505406d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f505c036000 tx=0x7f505c008030 comp rx=0 tx=0).stop 2023-08-10T10:38:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 msgr2=0x7f50741f76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f506400d800 tx=0x7f506400dcc0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 shutdown_connections 2023-08-10T10:38:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f505406ac50 0x7f505406d110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50740c8e80 0x7f50740aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50740c1a10 0x7f50740c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 --2- 172.21.15.50:0/1264723376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5074069be0 0x7f50741f76d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 >> 172.21.15.50:0/1264723376 conn(0x7f50740cafa0 msgr2=0x7f50740cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 shutdown_connections 2023-08-10T10:38:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:52.888+0000 7f507359e640 1 -- 172.21.15.50:0/1264723376 wait complete. 2023-08-10T10:38:52.909 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:38:52.909 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:38:52.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:38:52.910 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:38:52.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.911 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:38:52.971 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:52.971 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:52.972 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:52.972 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.972 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:52.973 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.973 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:52.973 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:52.973 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:38:52.974 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41364sec preferred_lft 41364sec 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:38:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:38:52.976 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link tentative 2023-08-10T10:38:52.977 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:52.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:52.978 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:38:53.075 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:38:53.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.080 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:38:53.134 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:38:53.135 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:38:53.135 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:38:53.135 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:38:53.135 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:38:53.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.136 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:53.136 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:53.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:38:53.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:38:53.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:38:53.137 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:53.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.321 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:38:53.371 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:38:53.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.372 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-08-10T10:38:53.420 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-10T10:38:53.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.421 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:53.421 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:53.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:38:53.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-10T10:38:53.422 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:53.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:38:53.655 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:53.655 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:53.656 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether ba:78:0f:c0:c9:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:38:53.657 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:38:53.657 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.657 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::b878:fff:fec0:c94d/64 scope link 2023-08-10T10:38:53.657 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.659 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether ba:78:0f:c0:c9:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:38:53.750 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:38:53.750 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.750 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::b878:fff:fec0:c94d/64 scope link 2023-08-10T10:38:53.750 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:38:53.752 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-10T10:38:53.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:53.752 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:53.753 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:53.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-10T10:38:53.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:38:53.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-10T10:38:53.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-10T10:38:53.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-10T10:38:53.754 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:54.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.022 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:38:54.022 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:38:54.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2023-08-10T10:38:54.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:38:54.023 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:38:54.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:54.193 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-10T10:38:54.244 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:38:54.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:38:54.244 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:38:54.291 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-08-10T10:38:54.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:54.430 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:54.431 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:54.463 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:38:54.464 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:38:54.464 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:38:54.464 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 3@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:38:54.465 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:38:54.466 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-08-10T10:38:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:38:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:38:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:38:54.467 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:38:54.470 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:38:54.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:38:54.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.560 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:54.620 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-10T10:38:54.620 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:38:54.621 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:38:54.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.674 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:54.729 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-10T10:38:54.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.730 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:38:54.783 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-10T10:38:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:38:54.784 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4677/status') 2023-08-10T10:38:54.871 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4677 (3)172.21.15.117:0/3061004147 2023-08-10T10:38:54.872 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2023-08-10T10:38:54.872 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2023-08-10T10:38:54.872 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2023-08-10T10:38:54.872 INFO:teuthology.orchestra.run.smithi117.stderr:71 bytes copied, 6.6521e-05 s, 1.1 MB/s 2023-08-10T10:38:54.875 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-10T10:38:54.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.135+0000 7fc7af9cf640 1 Processor -- start 2023-08-10T10:38:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.135+0000 7fc7af9cf640 1 -- start start 2023-08-10T10:38:55.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.136+0000 7fc7af9cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7a815cee0 0x7fc7a80d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.136+0000 7fc7af9cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a80ce590 con 0x7fc7a80cfc60 2023-08-10T10:38:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.136+0000 7fc7af9cf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a80d1630 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7af9cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80d1420 con 0x7fc7a815cee0 2023-08-10T10:38:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7a815cee0 0x7fc7a80d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7a815cee0 0x7fc7a80d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53178/0 (socket says 172.21.15.50:53178) 2023-08-10T10:38:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2288001816 learned_addr learned my addr 172.21.15.50:0/2288001816 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2288001816 >> v1:172.21.15.117:6789/0 conn(0x7fc7a80ce0e0 legacy=0x7fc7a80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2288001816 >> v1:172.21.15.50:6789/0 conn(0x7fc7a80cfc60 legacy=0x7fc7a80b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2288001816 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80d1910 con 0x7fc7a815cee0 2023-08-10T10:38:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.137+0000 7fc79bfff640 1 -- 172.21.15.50:0/2288001816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917911273 0 0) 0x7fc7a80ce590 con 0x7fc7a80cfc60 2023-08-10T10:38:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.139+0000 7fc7ad76b640 1 --2- 172.21.15.50:0/2288001816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a815cee0 0x7fc7a80d0ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab4e0cfe7541b3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.139+0000 7fc79bfff640 1 -- 172.21.15.50:0/2288001816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a402f840 con 0x7fc7a815cee0 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.139+0000 7fc79bfff640 1 -- 172.21.15.50:0/2288001816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a402f9a0 con 0x7fc7a815cee0 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.139+0000 7fc79bfff640 1 -- 172.21.15.50:0/2288001816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a402fd30 con 0x7fc7a815cee0 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2288001816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a815cee0 msgr2=0x7fc7a80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2288001816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a815cee0 0x7fc7a80d0ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a402ba20 comp rx=0 tx=0).stop 2023-08-10T10:38:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2288001816 shutdown_connections 2023-08-10T10:38:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2288001816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a815cee0 0x7fc7a80d0ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2288001816 >> 172.21.15.50:0/2288001816 conn(0x7fc7a806fcc0 msgr2=0x7fc7a80700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2288001816 shutdown_connections 2023-08-10T10:38:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.140+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2288001816 wait complete. 2023-08-10T10:38:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.142+0000 7fc7af9cf640 1 Processor -- start 2023-08-10T10:38:55.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.142+0000 7fc7af9cf640 1 -- start start 2023-08-10T10:38:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 0x7fc7a80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815cee0 0x7fc7a80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80b1f00 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80caad0 con 0x7fc7a80cfc60 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7af9cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80b13e0 con 0x7fc7a815cee0 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7ad76b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7ad76b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53186/0 (socket says 172.21.15.50:53186) 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2206370437 learned_addr learned my addr 172.21.15.50:0/2206370437 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.143+0000 7fc7acf6a640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 0x7fc7a80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815cee0 msgr2=0x7fc7a80cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815cee0 0x7fc7a80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 msgr2=0x7fc7a80ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 0x7fc7a80ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 -- 172.21.15.50:0/2206370437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40094d0 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7acf6a640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 0x7fc7a80ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7ad76b640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4000c00 tx=0x7fc7a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a403b040 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4037d50 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4004270 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a80b1630 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.144+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a80b2110 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.146+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a804e270 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.146+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7a40043d0 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.147+0000 7fc799ffb640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 0x7fc78c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.148+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7a40ac420 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.148+0000 7fc7acf6a640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 0x7fc78c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.148+0000 7fc7acf6a640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 0x7fc78c06d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80cd3f0 tx=0x7fc79c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.152+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc7a4077500 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.347+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7a80b4610 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.350+0000 7fc799ffb640 1 -- 172.21.15.50:0/2206370437 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fc7a407ab20 con 0x7fc7a80ce0e0 2023-08-10T10:38:55.351 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:55.351 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.352+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 msgr2=0x7fc78c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.352+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 0x7fc78c06d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80cd3f0 tx=0x7fc79c009040 comp rx=0 tx=0).stop 2023-08-10T10:38:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.352+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 msgr2=0x7fc7a80b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.352+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4000c00 tx=0x7fc7a40046c0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 shutdown_connections 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815cee0 0x7fc7a80cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc78c06ac50 0x7fc78c06d110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a80cfc60 0x7fc7a80ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 --2- 172.21.15.50:0/2206370437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7a80ce0e0 0x7fc7a80b4910 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 >> 172.21.15.50:0/2206370437 conn(0x7fc7a806fcc0 msgr2=0x7fc7a80d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 shutdown_connections 2023-08-10T10:38:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.353+0000 7fc7af9cf640 1 -- 172.21.15.50:0/2206370437 wait complete. 2023-08-10T10:38:55.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:55.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:55.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.593+0000 7f362c996640 1 Processor -- start 2023-08-10T10:38:55.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.594+0000 7f362c996640 1 -- start start 2023-08-10T10:38:55.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.595+0000 7f362c996640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 0x7f36281612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.595+0000 7f362c996640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36280c9420 0x7f36280c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.595+0000 7f362c996640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3628161800 con 0x7f36280c98b0 2023-08-10T10:38:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.595+0000 7f362c996640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3628160870 con 0x7f36280c9420 2023-08-10T10:38:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.595+0000 7f362c996640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280ca370 con 0x7f362815cbb0 2023-08-10T10:38:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f3625d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36280c98b0 0x7f36280c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37280/0 (socket says 172.21.15.50:37280) 2023-08-10T10:38:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f3625d9b640 1 -- 172.21.15.50:0/2024431458 learned_addr learned my addr 172.21.15.50:0/2024431458 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> v2:172.21.15.117:3300/0 conn(0x7f36280c9420 0x7f36280c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f362659c640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 0x7f36281612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781194504 0 0) 0x7f361c001110 con 0x7f36280c98b0 2023-08-10T10:38:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.596+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3610003520 con 0x7f36280c98b0 2023-08-10T10:38:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976406458 0 0) 0x7f3610003520 con 0x7f36280c98b0 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 msgr2=0x7f36281612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 0x7f36281612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 >> v2:172.21.15.117:3300/0 conn(0x7f36280c9420 msgr2=0x7f36280c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 --2- 172.21.15.50:0/2024431458 >> v2:172.21.15.117:3300/0 conn(0x7f36280c9420 0x7f36280c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280ca650 con 0x7f36280c98b0 2023-08-10T10:38:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f361c001800 con 0x7f36280c98b0 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 >> v1:172.21.15.50:6789/0 conn(0x7f36280c98b0 legacy=0x7f36280c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610003970 0x7f3610003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 0x7f36100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f3610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628160870 con 0x7f3610004d00 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280ca370 con 0x7f3610003970 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361000b980 con 0x7f362815cbb0 2023-08-10T10:38:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> v2:172.21.15.117:3300/0 conn(0x7f36280c9420 0x7f36280c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.597+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f3610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f362659c640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610003970 0x7f3610003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f3626d9d640 1 -- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 msgr2=0x7f36100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f362815cbb0 0x7f36100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f3626d9d640 1 -- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610003970 msgr2=0x7f3610003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610003970 0x7f3610003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.598+0000 7f3626d9d640 1 -- 172.21.15.50:0/2024431458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610003520 con 0x7f3610004d00 2023-08-10T10:38:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.599+0000 7f3626d9d640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f3610005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f362000e320 tx=0x7f36100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c42d6f41f5307e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.599+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362002cde0 con 0x7f3610004d00 2023-08-10T10:38:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362000f040 con 0x7f3610004d00 2023-08-10T10:38:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362559a640 1 -- 172.21.15.50:0/2024431458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620034680 con 0x7f3610004d00 2023-08-10T10:38:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 -- 172.21.15.50:0/2024431458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 msgr2=0x7f3610005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 --2- 172.21.15.50:0/2024431458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f3610005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f362000e320 tx=0x7f36100057f0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f3626d9d640 1 -- 172.21.15.50:0/2024431458 reap_dead start 2023-08-10T10:38:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 -- 172.21.15.50:0/2024431458 shutdown_connections 2023-08-10T10:38:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 -- 172.21.15.50:0/2024431458 >> 172.21.15.50:0/2024431458 conn(0x7f36280b01b0 msgr2=0x7f36280b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 -- 172.21.15.50:0/2024431458 shutdown_connections 2023-08-10T10:38:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.600+0000 7f362c996640 1 -- 172.21.15.50:0/2024431458 wait complete. 2023-08-10T10:38:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.602+0000 7f362c996640 1 Processor -- start 2023-08-10T10:38:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.602+0000 7f362c996640 1 -- start start 2023-08-10T10:38:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c5790 0x7f36280c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c7280 0x7f36280c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c50b0 con 0x7f3610004d00 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c6df0 con 0x7f36280c5790 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.603+0000 7f362c996640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c61e0 con 0x7f36280c7280 2023-08-10T10:38:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53194/0 (socket says 172.21.15.50:53194) 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 -- 172.21.15.50:0/3805754055 learned_addr learned my addr 172.21.15.50:0/3805754055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 -- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c7280 msgr2=0x7f36280c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c7280 0x7f36280c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 -- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c5790 msgr2=0x7f36280c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c5790 0x7f36280c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 -- 172.21.15.50:0/3805754055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280c64c0 con 0x7f3610004d00 2023-08-10T10:38:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.604+0000 7f362659c640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36180116d0 tx=0x7f3618011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.605+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800f940 con 0x7f3610004d00 2023-08-10T10:38:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.605+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361800faa0 con 0x7f3610004d00 2023-08-10T10:38:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.605+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800fe50 con 0x7f3610004d00 2023-08-10T10:38:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.605+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280c67a0 con 0x7f3610004d00 2023-08-10T10:38:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.605+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362814f090 con 0x7f3610004d00 2023-08-10T10:38:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.606+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280612b0 con 0x7f3610004d00 2023-08-10T10:38:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.607+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3618015460 con 0x7f3610004d00 2023-08-10T10:38:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.608+0000 7f3616ffd640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 0x7f360806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.608+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3618089a50 con 0x7f3610004d00 2023-08-10T10:38:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.608+0000 7f3625d9b640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 0x7f360806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.609+0000 7f3625d9b640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 0x7f360806d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f361c000f60 tx=0x7f361c001b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.612+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3618058460 con 0x7f3610004d00 2023-08-10T10:38:55.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.793+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36281615e0 con 0x7f3610004d00 2023-08-10T10:38:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.795+0000 7f3616ffd640 1 -- 172.21.15.50:0/3805754055 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3618022020 con 0x7f3610004d00 2023-08-10T10:38:55.795 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 msgr2=0x7f360806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 0x7f360806d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f361c000f60 tx=0x7f361c001b90 comp rx=0 tx=0).stop 2023-08-10T10:38:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 msgr2=0x7f36280c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36180116d0 tx=0x7f3618011b90 comp rx=0 tx=0).stop 2023-08-10T10:38:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 shutdown_connections 2023-08-10T10:38:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c7280 0x7f36280c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f360806ac80 0x7f360806d140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c5790 0x7f36280c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 --2- 172.21.15.50:0/3805754055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3610004d00 0x7f36280c4b70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 >> 172.21.15.50:0/3805754055 conn(0x7f36280b01b0 msgr2=0x7f362815a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 shutdown_connections 2023-08-10T10:38:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:55.797+0000 7f362c996640 1 -- 172.21.15.50:0/3805754055 wait complete. 2023-08-10T10:38:55.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:56.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.047+0000 7f9f042a7640 1 Processor -- start 2023-08-10T10:38:56.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.048+0000 7f9f042a7640 1 -- start start 2023-08-10T10:38:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.049+0000 7f9f042a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9efc15cb90 0x7f9efc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.049+0000 7f9f042a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc15cf70 0x7f9efc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.049+0000 7f9f042a7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc160a40 con 0x7f9efc0b4640 2023-08-10T10:38:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.049+0000 7f9f042a7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0b4bb0 con 0x7f9efc15cb90 2023-08-10T10:38:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.049+0000 7f9f042a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0b4e90 con 0x7f9efc15cf70 2023-08-10T10:38:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9efc15cb90 0x7f9efc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9efc15cb90 0x7f9efc0b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53200/0 (socket says 172.21.15.50:53200) 2023-08-10T10:38:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 -- 172.21.15.50:0/3316363131 learned_addr learned my addr 172.21.15.50:0/3316363131 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02844640 1 --1- 172.21.15.50:0/3316363131 >> v1:172.21.15.50:6789/0 conn(0x7f9efc0b4640 0x7f9efc06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37286/0 (socket says 172.21.15.50:37286) 2023-08-10T10:38:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f01842640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc15cf70 0x7f9efc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 -- 172.21.15.50:0/3316363131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc15cf70 msgr2=0x7f9efc160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc15cf70 0x7f9efc160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 -- 172.21.15.50:0/3316363131 >> v1:172.21.15.50:6789/0 conn(0x7f9efc0b4640 legacy=0x7f9efc06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f02043640 1 -- 172.21.15.50:0/3316363131 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0b5170 con 0x7f9efc15cb90 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.050+0000 7f9f01041640 1 -- 172.21.15.50:0/3316363131 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538579906 0 0) 0x7f9efc160a40 con 0x7f9efc0b4640 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.051+0000 7f9f02043640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc0b5dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009870 tx=0x7f9ef802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b3472c6b401d71 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f01041640 1 -- 172.21.15.50:0/3316363131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8030840 con 0x7f9efc15cb90 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f01041640 1 -- 172.21.15.50:0/3316363131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80309a0 con 0x7f9efc15cb90 2023-08-10T10:38:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f01041640 1 -- 172.21.15.50:0/3316363131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8030d30 con 0x7f9efc15cb90 2023-08-10T10:38:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 -- 172.21.15.50:0/3316363131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 msgr2=0x7f9efc0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc0b5dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009870 tx=0x7f9ef802b980 comp rx=0 tx=0).stop 2023-08-10T10:38:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 -- 172.21.15.50:0/3316363131 shutdown_connections 2023-08-10T10:38:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc15cf70 0x7f9efc160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 --2- 172.21.15.50:0/3316363131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc0b5dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.052+0000 7f9f042a7640 1 -- 172.21.15.50:0/3316363131 >> 172.21.15.50:0/3316363131 conn(0x7f9efc0cf640 msgr2=0x7f9efc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.053+0000 7f9f042a7640 1 -- 172.21.15.50:0/3316363131 shutdown_connections 2023-08-10T10:38:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.053+0000 7f9f042a7640 1 -- 172.21.15.50:0/3316363131 wait complete. 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.054+0000 7f9f042a7640 1 Processor -- start 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.054+0000 7f9f042a7640 1 -- start start 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc0b4640 0x7f9efc0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 0x7f9efc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0c96f0 con 0x7f9efc15cb90 2023-08-10T10:38:56.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0c70f0 con 0x7f9efc15cf70 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.055+0000 7f9f042a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0c73d0 con 0x7f9efc0b4640 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53212/0 (socket says 172.21.15.50:53212) 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 -- 172.21.15.50:0/1248444466 learned_addr learned my addr 172.21.15.50:0/1248444466 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f02043640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc0b4640 0x7f9efc0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f02844640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 0x7f9efc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 -- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc0b4640 msgr2=0x7f9efc0c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc0b4640 0x7f9efc0c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 -- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 msgr2=0x7f9efc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 0x7f9efc159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f01842640 1 -- 172.21.15.50:0/1248444466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80094d0 con 0x7f9efc15cb90 2023-08-10T10:38:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.056+0000 7f9f02844640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 0x7f9efc159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9f01842640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d5f0 tx=0x7f9eec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0125f0 con 0x7f9efc15cb90 2023-08-10T10:38:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec012750 con 0x7f9efc15cb90 2023-08-10T10:38:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc0c76b0 con 0x7f9efc15cb90 2023-08-10T10:38:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec012b00 con 0x7f9efc15cb90 2023-08-10T10:38:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.057+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc0c7a40 con 0x7f9efc15cb90 2023-08-10T10:38:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.058+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc0612b0 con 0x7f9efc15cb90 2023-08-10T10:38:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.059+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9eec012c60 con 0x7f9efc15cb90 2023-08-10T10:38:56.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.060+0000 7f9ef2ffd640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 0x7f9ee006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.061+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9eec0899c0 con 0x7f9efc15cb90 2023-08-10T10:38:56.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.061+0000 7f9f02043640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 0x7f9ee006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.062+0000 7f9f02043640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 0x7f9ee006d110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8036000 tx=0x7f9ef8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.065+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9eec054a60 con 0x7f9efc15cb90 2023-08-10T10:38:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.257+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9efc0d0a10 con 0x7f9efc15cb90 2023-08-10T10:38:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.258+0000 7f9ef2ffd640 1 -- 172.21.15.50:0/1248444466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9eec058080 con 0x7f9efc15cb90 2023-08-10T10:38:56.258 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:56.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 msgr2=0x7f9ee006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 0x7f9ee006d110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8036000 tx=0x7f9ef8008030 comp rx=0 tx=0).stop 2023-08-10T10:38:56.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 msgr2=0x7f9efc1596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d5f0 tx=0x7f9eec00dab0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 shutdown_connections 2023-08-10T10:38:56.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ee006ac50 0x7f9ee006d110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9efc15cf70 0x7f9efc159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9efc15cb90 0x7f9efc1596b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 --2- 172.21.15.50:0/1248444466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9efc0b4640 0x7f9efc0c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.260+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 >> 172.21.15.50:0/1248444466 conn(0x7f9efc0cf640 msgr2=0x7f9efc0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.261+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 shutdown_connections 2023-08-10T10:38:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.261+0000 7f9f042a7640 1 -- 172.21.15.50:0/1248444466 wait complete. 2023-08-10T10:38:56.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:38:56.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.524+0000 7f1374bb5640 1 Processor -- start 2023-08-10T10:38:56.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.525+0000 7f1374bb5640 1 -- start start 2023-08-10T10:38:56.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13700ce920 0x7f13700b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 0x7f137015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 0x7f13700b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137015bec0 con 0x7f13700ce920 2023-08-10T10:38:56.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13700b2330 con 0x7f137015f1c0 2023-08-10T10:38:56.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f1374bb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137015b900 con 0x7f137015b480 2023-08-10T10:38:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f136e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13700ce920 0x7f13700b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f136e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13700ce920 0x7f13700b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53218/0 (socket says 172.21.15.50:53218) 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.526+0000 7f136e59c640 1 -- 172.21.15.50:0/914779967 learned_addr learned my addr 172.21.15.50:0/914779967 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136dd9b640 1 --2- 172.21.15.50:0/914779967 >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 0x7f137015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136ed9d640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 0x7f13700b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136e59c640 1 -- 172.21.15.50:0/914779967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 msgr2=0x7f13700b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136e59c640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 0x7f13700b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136e59c640 1 -- 172.21.15.50:0/914779967 >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 msgr2=0x7f137015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136e59c640 1 --2- 172.21.15.50:0/914779967 >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 0x7f137015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136e59c640 1 -- 172.21.15.50:0/914779967 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137015bbe0 con 0x7f13700ce920 2023-08-10T10:38:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136dd9b640 1 --2- 172.21.15.50:0/914779967 >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 0x7f137015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:56.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.527+0000 7f136ed9d640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 0x7f13700b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.529+0000 7f136e59c640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13700ce920 0x7f13700b27c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13700716c0 tx=0x7f136002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b014891d68303bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.529+0000 7f136d59a640 1 -- 172.21.15.50:0/914779967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360031750 con 0x7f13700ce920 2023-08-10T10:38:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.529+0000 7f136d59a640 1 -- 172.21.15.50:0/914779967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600318b0 con 0x7f13700ce920 2023-08-10T10:38:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.529+0000 7f136d59a640 1 -- 172.21.15.50:0/914779967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360031c40 con 0x7f13700ce920 2023-08-10T10:38:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 -- 172.21.15.50:0/914779967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13700ce920 msgr2=0x7f13700b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13700ce920 0x7f13700b27c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13700716c0 tx=0x7f136002b7f0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 -- 172.21.15.50:0/914779967 shutdown_connections 2023-08-10T10:38:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137015b480 0x7f13700b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 --2- 172.21.15.50:0/914779967 >> v2:172.21.15.117:3300/0 conn(0x7f137015f1c0 0x7f137015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 --2- 172.21.15.50:0/914779967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13700ce920 0x7f13700b27c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 -- 172.21.15.50:0/914779967 >> 172.21.15.50:0/914779967 conn(0x7f1370069f00 msgr2=0x7f137006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:56.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 -- 172.21.15.50:0/914779967 shutdown_connections 2023-08-10T10:38:56.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.530+0000 7f1374bb5640 1 -- 172.21.15.50:0/914779967 wait complete. 2023-08-10T10:38:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.532+0000 7f1374bb5640 1 Processor -- start 2023-08-10T10:38:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.532+0000 7f1374bb5640 1 -- start start 2023-08-10T10:38:56.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13700ce920 0x7f13700adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137015b480 0x7f13701552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700ad770 con 0x7f137015f1c0 2023-08-10T10:38:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700ac880 con 0x7f137015b480 2023-08-10T10:38:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f1374bb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13700acb60 con 0x7f13700ce920 2023-08-10T10:38:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f136ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f136ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53224/0 (socket says 172.21.15.50:53224) 2023-08-10T10:38:56.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f136ed9d640 1 -- 172.21.15.50:0/1127404452 learned_addr learned my addr 172.21.15.50:0/1127404452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f136dd9b640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137015b480 0x7f13701552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.533+0000 7f136e59c640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13700ce920 0x7f13700adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 -- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13700ce920 msgr2=0x7f13700adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13700ce920 0x7f13700adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 -- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137015b480 msgr2=0x7f13701552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137015b480 0x7f13701552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 -- 172.21.15.50:0/1127404452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094d0 con 0x7f137015f1c0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f136ed9d640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f136800ce40 tx=0x7f136800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800d840 con 0x7f137015f1c0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800d9a0 con 0x7f137015f1c0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800dd50 con 0x7f137015f1c0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13700ace40 con 0x7f137015f1c0 2023-08-10T10:38:56.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.534+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13700ad400 con 0x7f137015f1c0 2023-08-10T10:38:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.536+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13700612b0 con 0x7f137015f1c0 2023-08-10T10:38:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.536+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f136801e3b0 con 0x7f137015f1c0 2023-08-10T10:38:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.537+0000 7f1366ffd640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 0x7f135006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.537+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1368089df0 con 0x7f137015f1c0 2023-08-10T10:38:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.538+0000 7f136e59c640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 0x7f135006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.539+0000 7f136e59c640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 0x7f135006d140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1360035000 tx=0x7f1360008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.542+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1368054f30 con 0x7f137015f1c0 2023-08-10T10:38:56.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.731+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1370066140 con 0x7f137015f1c0 2023-08-10T10:38:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.732+0000 7f1366ffd640 1 -- 172.21.15.50:0/1127404452 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f136801a020 con 0x7f137015f1c0 2023-08-10T10:38:56.733 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:38:56.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 msgr2=0x7f135006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 0x7f135006d140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1360035000 tx=0x7f1360008030 comp rx=0 tx=0).stop 2023-08-10T10:38:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 msgr2=0x7f137006f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f136800ce40 tx=0x7f136800a710 comp rx=0 tx=0).stop 2023-08-10T10:38:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 shutdown_connections 2023-08-10T10:38:56.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137015f1c0 0x7f137006f340 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f135006ac80 0x7f135006d140 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137015b480 0x7f13701552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 --2- 172.21.15.50:0/1127404452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13700ce920 0x7f13700adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 >> 172.21.15.50:0/1127404452 conn(0x7f1370069f00 msgr2=0x7f137015d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 shutdown_connections 2023-08-10T10:38:56.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.735+0000 7f1374bb5640 1 -- 172.21.15.50:0/1127404452 wait complete. 2023-08-10T10:38:56.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:38:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.985+0000 7f2e16907640 1 Processor -- start 2023-08-10T10:38:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.986+0000 7f2e16907640 1 -- start start 2023-08-10T10:38:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.987+0000 7f2e16907640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1015ae40 0x7f2e100b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.987+0000 7f2e16907640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e100cd9b0 0x7f2e100ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e16907640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100adcb0 con 0x7f2e1006cb30 2023-08-10T10:38:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e16907640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1006c320 con 0x7f2e100cd9b0 2023-08-10T10:38:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e16907640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1006b770 con 0x7f2e1015ae40 2023-08-10T10:38:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e14ea4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e100cd9b0 0x7f2e100ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e0f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e1006cb30 0x7f2e100cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37288/0 (socket says 172.21.15.50:37288) 2023-08-10T10:38:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e14ea4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e100cd9b0 0x7f2e100ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53238/0 (socket says 172.21.15.50:53238) 2023-08-10T10:38:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e0f7fe640 1 -- 172.21.15.50:0/3641836082 learned_addr learned my addr 172.21.15.50:0/3641836082 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.988+0000 7f2e0ffff640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1015ae40 0x7f2e100b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.989+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3641836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1015ae40 msgr2=0x7f2e100b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.989+0000 7f2e14ea4640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1015ae40 0x7f2e100b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.989+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3641836082 >> v1:172.21.15.50:6789/0 conn(0x7f2e1006cb30 legacy=0x7f2e100cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.989+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3641836082 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1006b9f0 con 0x7f2e100cd9b0 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.989+0000 7f2e0effd640 1 -- 172.21.15.50:0/3641836082 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745463377 0 0) 0x7f2e100adcb0 con 0x7f2e1006cb30 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.990+0000 7f2e14ea4640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e100cd9b0 0x7f2e100ad770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d90 tx=0x7f2e0802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbe2e1d36958cdc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.990+0000 7f2e0effd640 1 -- 172.21.15.50:0/3641836082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0802cc60 con 0x7f2e100cd9b0 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.990+0000 7f2e0effd640 1 -- 172.21.15.50:0/3641836082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0802cdc0 con 0x7f2e100cd9b0 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.990+0000 7f2e0effd640 1 -- 172.21.15.50:0/3641836082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08034660 con 0x7f2e100cd9b0 2023-08-10T10:38:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 -- 172.21.15.50:0/3641836082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e100cd9b0 msgr2=0x7f2e100ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e100cd9b0 0x7f2e100ad770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d90 tx=0x7f2e0802beb0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 -- 172.21.15.50:0/3641836082 shutdown_connections 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e100cd9b0 0x7f2e100ad770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 --2- 172.21.15.50:0/3641836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1015ae40 0x7f2e100b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 -- 172.21.15.50:0/3641836082 >> 172.21.15.50:0/3641836082 conn(0x7f2e100b01b0 msgr2=0x7f2e100b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 -- 172.21.15.50:0/3641836082 shutdown_connections 2023-08-10T10:38:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.991+0000 7f2e16907640 1 -- 172.21.15.50:0/3641836082 wait complete. 2023-08-10T10:38:56.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.993+0000 7f2e16907640 1 Processor -- start 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.993+0000 7f2e16907640 1 -- start start 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 0x7f2e10152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 0x7f2e1015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1015d390 con 0x7f2e1015ae40 2023-08-10T10:38:56.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c6320 con 0x7f2e100cd9b0 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.994+0000 7f2e16907640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c6600 con 0x7f2e1006cb30 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53248/0 (socket says 172.21.15.50:53248) 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3837612588 learned_addr learned my addr 172.21.15.50:0/3837612588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e0ffff640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 0x7f2e10152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e0f7fe640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 0x7f2e1015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 msgr2=0x7f2e10152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 0x7f2e10152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 msgr2=0x7f2e1015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 0x7f2e1015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 -- 172.21.15.50:0/3837612588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009a70 con 0x7f2e1015ae40 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e0ffff640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 0x7f2e10152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e0f7fe640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 0x7f2e1015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.995+0000 7f2e14ea4640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d90 tx=0x7f2e08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.996+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08040650 con 0x7f2e1015ae40 2023-08-10T10:38:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.996+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080407b0 con 0x7f2e1015ae40 2023-08-10T10:38:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.996+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e100c68e0 con 0x7f2e1015ae40 2023-08-10T10:38:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.996+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08040b60 con 0x7f2e1015ae40 2023-08-10T10:38:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.996+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100c70e0 con 0x7f2e1015ae40 2023-08-10T10:38:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.997+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e100ce4c0 con 0x7f2e1015ae40 2023-08-10T10:38:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.998+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e08040cc0 con 0x7f2e1015ae40 2023-08-10T10:38:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.999+0000 7f2e0cff9640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 0x7f2dfc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.999+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e080ac390 con 0x7f2e1015ae40 2023-08-10T10:38:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:56.999+0000 7f2e0ffff640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 0x7f2dfc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.000+0000 7f2e0ffff640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 0x7f2dfc06d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009a20 tx=0x7f2e00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.004+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e08077310 con 0x7f2e1015ae40 2023-08-10T10:38:57.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.197+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e100c6e00 con 0x7f2e1015ae40 2023-08-10T10:38:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.198+0000 7f2e0cff9640 1 -- 172.21.15.50:0/3837612588 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e100c6e00 con 0x7f2e1015ae40 2023-08-10T10:38:57.199 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:38:57.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 msgr2=0x7f2dfc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 0x7f2dfc06d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009a20 tx=0x7f2e00008040 comp rx=0 tx=0).stop 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 msgr2=0x7f2e1015ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d90 tx=0x7f2e08004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 shutdown_connections 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1015ae40 0x7f2e1015ce50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dfc06ac50 0x7f2dfc06d110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e100cd9b0 0x7f2e1015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 --2- 172.21.15.50:0/3837612588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e1006cb30 0x7f2e10152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 >> 172.21.15.50:0/3837612588 conn(0x7f2e100b01b0 msgr2=0x7f2e100698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:57.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 shutdown_connections 2023-08-10T10:38:57.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.201+0000 7f2e16907640 1 -- 172.21.15.50:0/3837612588 wait complete. 2023-08-10T10:38:57.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:57.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.441+0000 7f5935dea640 1 Processor -- start 2023-08-10T10:38:57.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.442+0000 7f5935dea640 1 -- start start 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f5935dea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5930159970 0x7f59300b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f5935dea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59300b0f00 0x7f59300696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f5935dea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593015e1f0 con 0x7f5930069be0 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f5935dea640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593006a070 con 0x7f5930159970 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f5935dea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593015d5e0 con 0x7f59300b0f00 2023-08-10T10:38:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f592f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5930159970 0x7f59300b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f592f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5930159970 0x7f59300b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53262/0 (socket says 172.21.15.50:53262) 2023-08-10T10:38:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.443+0000 7f592f7fe640 1 -- 172.21.15.50:0/4187031165 learned_addr learned my addr 172.21.15.50:0/4187031165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.444+0000 7f592f7fe640 1 -- 172.21.15.50:0/4187031165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59300b0f00 msgr2=0x7f59300696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.444+0000 7f592f7fe640 1 --2- 172.21.15.50:0/4187031165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59300b0f00 0x7f59300696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.444+0000 7f592f7fe640 1 -- 172.21.15.50:0/4187031165 >> v1:172.21.15.117:6789/0 conn(0x7f5930069be0 legacy=0x7f59300c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.444+0000 7f592f7fe640 1 -- 172.21.15.50:0/4187031165 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593015d8c0 con 0x7f5930159970 2023-08-10T10:38:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.445+0000 7f592f7fe640 1 --2- 172.21.15.50:0/4187031165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930159970 0x7f59300b09c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e50 tx=0x7f592002e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5a8365d969ea71 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.445+0000 7f592effd640 1 -- 172.21.15.50:0/4187031165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592002ec90 con 0x7f5930159970 2023-08-10T10:38:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.445+0000 7f592effd640 1 -- 172.21.15.50:0/4187031165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592002edf0 con 0x7f5930159970 2023-08-10T10:38:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f592effd640 1 -- 172.21.15.50:0/4187031165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920036610 con 0x7f5930159970 2023-08-10T10:38:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 -- 172.21.15.50:0/4187031165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930159970 msgr2=0x7f59300b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 --2- 172.21.15.50:0/4187031165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930159970 0x7f59300b09c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e50 tx=0x7f592002e0f0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 -- 172.21.15.50:0/4187031165 shutdown_connections 2023-08-10T10:38:57.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 --2- 172.21.15.50:0/4187031165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59300b0f00 0x7f59300696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 --2- 172.21.15.50:0/4187031165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930159970 0x7f59300b09c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 -- 172.21.15.50:0/4187031165 >> 172.21.15.50:0/4187031165 conn(0x7f593006b590 msgr2=0x7f59300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:57.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 -- 172.21.15.50:0/4187031165 shutdown_connections 2023-08-10T10:38:57.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.446+0000 7f5935dea640 1 -- 172.21.15.50:0/4187031165 wait complete. 2023-08-10T10:38:57.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.448+0000 7f5935dea640 1 Processor -- start 2023-08-10T10:38:57.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.448+0000 7f5935dea640 1 -- start start 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 0x7f59300c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5930159970 0x7f5930153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c7d40 con 0x7f5930069be0 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c7130 con 0x7f59300b0f00 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.449+0000 7f5935dea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c7410 con 0x7f5930159970 2023-08-10T10:38:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53268/0 (socket says 172.21.15.50:53268) 2023-08-10T10:38:57.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 -- 172.21.15.50:0/292896368 learned_addr learned my addr 172.21.15.50:0/292896368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:57.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 -- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5930159970 msgr2=0x7f5930153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5930159970 0x7f5930153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f5926ffd640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 0x7f59300c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 -- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 msgr2=0x7f59300c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 0x7f59300c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 -- 172.21.15.50:0/292896368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009b30 con 0x7f5930069be0 2023-08-10T10:38:57.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f5926ffd640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 0x7f59300c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:57.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.450+0000 7f592f7fe640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e50 tx=0x7f5920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.451+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920040450 con 0x7f5930069be0 2023-08-10T10:38:57.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.451+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200405b0 con 0x7f5930069be0 2023-08-10T10:38:57.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.451+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920040960 con 0x7f5930069be0 2023-08-10T10:38:57.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.451+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59300c76f0 con 0x7f5930069be0 2023-08-10T10:38:57.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.451+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59300c6de0 con 0x7f5930069be0 2023-08-10T10:38:57.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.452+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593004e270 con 0x7f5930069be0 2023-08-10T10:38:57.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.453+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5920040ac0 con 0x7f5930069be0 2023-08-10T10:38:57.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.455+0000 7f592cff9640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 0x7f591006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.455+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59200ae3c0 con 0x7f5930069be0 2023-08-10T10:38:57.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.455+0000 7f5926ffd640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 0x7f591006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.456+0000 7f5926ffd640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 0x7f591006d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5918006fd0 tx=0x7f5918008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.459+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5920079490 con 0x7f5930069be0 2023-08-10T10:38:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.649+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59300b3160 con 0x7f5930069be0 2023-08-10T10:38:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.652+0000 7f592cff9640 1 -- 172.21.15.50:0/292896368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f5920051300 con 0x7f5930069be0 2023-08-10T10:38:57.653 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:57.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 msgr2=0x7f591006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 0x7f591006d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5918006fd0 tx=0x7f5918008040 comp rx=0 tx=0).stop 2023-08-10T10:38:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 msgr2=0x7f593014e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e50 tx=0x7f5920004a40 comp rx=0 tx=0).stop 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 shutdown_connections 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5930159970 0x7f5930153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f591006ac50 0x7f591006d110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59300b0f00 0x7f59300c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 --2- 172.21.15.50:0/292896368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930069be0 0x7f593014e940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.655+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 >> 172.21.15.50:0/292896368 conn(0x7f593006b590 msgr2=0x7f59300ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.656+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 shutdown_connections 2023-08-10T10:38:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.656+0000 7f5935dea640 1 -- 172.21.15.50:0/292896368 wait complete. 2023-08-10T10:38:57.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:57.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:38:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.898+0000 7f427f94e640 1 Processor -- start 2023-08-10T10:38:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.898+0000 7f427f94e640 1 -- start start 2023-08-10T10:38:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427f94e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f427815cb90 0x7f42780b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427f94e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 0x7f427806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427f94e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278160a40 con 0x7f427815cf70 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427f94e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780b4bb0 con 0x7f427815cb90 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427f94e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780b4e90 con 0x7f42781615e0 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f427815cb90 0x7f42780b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f427815cb90 0x7f42780b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53280/0 (socket says 172.21.15.50:53280) 2023-08-10T10:38:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 -- 172.21.15.50:0/4205895145 learned_addr learned my addr 172.21.15.50:0/4205895145 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427cee9640 1 --1- 172.21.15.50:0/4205895145 >> v1:172.21.15.50:6789/0 conn(0x7f427815cf70 0x7f4278160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37302/0 (socket says 172.21.15.50:37302) 2023-08-10T10:38:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427deeb640 1 --2- 172.21.15.50:0/4205895145 >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 0x7f427806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 -- 172.21.15.50:0/4205895145 >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 msgr2=0x7f427806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 --2- 172.21.15.50:0/4205895145 >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 0x7f427806fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.900+0000 7f427d6ea640 1 -- 172.21.15.50:0/4205895145 >> v1:172.21.15.50:6789/0 conn(0x7f427815cf70 legacy=0x7f4278160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.901+0000 7f427d6ea640 1 -- 172.21.15.50:0/4205895145 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780b5170 con 0x7f427815cb90 2023-08-10T10:38:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.901+0000 7f427deeb640 1 --2- 172.21.15.50:0/4205895145 >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 0x7f427806fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.902+0000 7f427d6ea640 1 --2- 172.21.15.50:0/4205895145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cb90 0x7f42780b5dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42781609b0 tx=0x7f427402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f911e36226a6a5a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.902+0000 7f426ffff640 1 -- 172.21.15.50:0/4205895145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427402cb10 con 0x7f427815cb90 2023-08-10T10:38:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.902+0000 7f426ffff640 1 -- 172.21.15.50:0/4205895145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427402cc70 con 0x7f427815cb90 2023-08-10T10:38:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.902+0000 7f426ffff640 1 -- 172.21.15.50:0/4205895145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740343f0 con 0x7f427815cb90 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 -- 172.21.15.50:0/4205895145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cb90 msgr2=0x7f42780b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 --2- 172.21.15.50:0/4205895145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cb90 0x7f42780b5dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42781609b0 tx=0x7f427402bf70 comp rx=0 tx=0).stop 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 -- 172.21.15.50:0/4205895145 shutdown_connections 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 --2- 172.21.15.50:0/4205895145 >> v2:172.21.15.117:3300/0 conn(0x7f42781615e0 0x7f427806fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 --2- 172.21.15.50:0/4205895145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cb90 0x7f42780b5dd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 -- 172.21.15.50:0/4205895145 >> 172.21.15.50:0/4205895145 conn(0x7f42780cf640 msgr2=0x7f42780cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 -- 172.21.15.50:0/4205895145 shutdown_connections 2023-08-10T10:38:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.903+0000 7f427f94e640 1 -- 172.21.15.50:0/4205895145 wait complete. 2023-08-10T10:38:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.905+0000 7f427f94e640 1 Processor -- start 2023-08-10T10:38:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.905+0000 7f427f94e640 1 -- start start 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 0x7f427814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42781615e0 0x7f427814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c87e0 con 0x7f427815cf70 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c8220 con 0x7f427815cb90 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427f94e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c8500 con 0x7f42781615e0 2023-08-10T10:38:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427cee9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427cee9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53292/0 (socket says 172.21.15.50:53292) 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427cee9640 1 -- 172.21.15.50:0/239247756 learned_addr learned my addr 172.21.15.50:0/239247756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427d6ea640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 0x7f427814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.907+0000 7f427deeb640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42781615e0 0x7f427814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 -- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42781615e0 msgr2=0x7f427814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42781615e0 0x7f427814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 -- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 msgr2=0x7f427814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 0x7f427814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 -- 172.21.15.50:0/239247756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009b30 con 0x7f427815cf70 2023-08-10T10:38:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427d6ea640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 0x7f427814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427cee9640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f426800c4d0 tx=0x7f426800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268007480 con 0x7f427815cf70 2023-08-10T10:38:57.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42680075e0 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680049e0 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.908+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427815e440 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.909+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780c7e60 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.910+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427815e960 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.910+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4268004b40 con 0x7f427815cf70 2023-08-10T10:38:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.911+0000 7f426dffb640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 0x7f425c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.911+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4268088540 con 0x7f427815cf70 2023-08-10T10:38:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.912+0000 7f427d6ea640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 0x7f425c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.913+0000 7f427d6ea640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 0x7f425c06d110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4274035000 tx=0x7f4274030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:57.916+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f427815e960 con 0x7f427815cf70 2023-08-10T10:38:58.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.118+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f427815e960 con 0x7f427815cf70 2023-08-10T10:38:58.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.119+0000 7f426dffb640 1 -- 172.21.15.50:0/239247756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f427815e960 con 0x7f427815cf70 2023-08-10T10:38:58.119 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:38:58.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 msgr2=0x7f425c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 0x7f425c06d110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4274035000 tx=0x7f4274030000 comp rx=0 tx=0).stop 2023-08-10T10:38:58.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 msgr2=0x7f42780c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f426800c4d0 tx=0x7f426800c990 comp rx=0 tx=0).stop 2023-08-10T10:38:58.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 shutdown_connections 2023-08-10T10:38:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42781615e0 0x7f427814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f427815cf70 0x7f42780c7920 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f425c06ac50 0x7f425c06d110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 --2- 172.21.15.50:0/239247756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427815cb90 0x7f427814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 >> 172.21.15.50:0/239247756 conn(0x7f42780cf640 msgr2=0x7f42780cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:58.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 shutdown_connections 2023-08-10T10:38:58.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.122+0000 7f427f94e640 1 -- 172.21.15.50:0/239247756 wait complete. 2023-08-10T10:38:58.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:38:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.373+0000 7fdb0e999640 1 Processor -- start 2023-08-10T10:38:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.373+0000 7fdb0e999640 1 -- start start 2023-08-10T10:38:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.374+0000 7fdb0e999640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 0x7fdb080b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.374+0000 7fdb0e999640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb080cd9b0 0x7fdb080ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.374+0000 7fdb0e999640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb080adcb0 con 0x7fdb0806cb30 2023-08-10T10:38:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.374+0000 7fdb0e999640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0806c320 con 0x7fdb080cd9b0 2023-08-10T10:38:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.374+0000 7fdb0e999640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0806b770 con 0x7fdb0815ae40 2023-08-10T10:38:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb080cd9b0 0x7fdb080ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb077fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdb0806cb30 0x7fdb080cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37304/0 (socket says 172.21.15.50:37304) 2023-08-10T10:38:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb080cd9b0 0x7fdb080ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53296/0 (socket says 172.21.15.50:53296) 2023-08-10T10:38:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb077fe640 1 -- 172.21.15.50:0/2367796491 learned_addr learned my addr 172.21.15.50:0/2367796491 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb07fff640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 0x7fdb080b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 -- 172.21.15.50:0/2367796491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 msgr2=0x7fdb080b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 0x7fdb080b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 -- 172.21.15.50:0/2367796491 >> v1:172.21.15.50:6789/0 conn(0x7fdb0806cb30 legacy=0x7fdb080cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb0cf36640 1 -- 172.21.15.50:0/2367796491 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0806b9f0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb06ffd640 1 -- 172.21.15.50:0/2367796491 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404435953 0 0) 0x7fdb080adcb0 con 0x7fdb0806cb30 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.375+0000 7fdb07fff640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 0x7fdb080b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.376+0000 7fdb0cf36640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080ad770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009d90 tx=0x7fdb0002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0e417753a28334 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.377+0000 7fdb06ffd640 1 -- 172.21.15.50:0/2367796491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0002cc50 con 0x7fdb080cd9b0 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.377+0000 7fdb06ffd640 1 -- 172.21.15.50:0/2367796491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0002cdb0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.377+0000 7fdb06ffd640 1 -- 172.21.15.50:0/2367796491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00034660 con 0x7fdb080cd9b0 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.377+0000 7fdb0e999640 1 -- 172.21.15.50:0/2367796491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 msgr2=0x7fdb080ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.377+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080ad770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009d90 tx=0x7fdb0002bea0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 -- 172.21.15.50:0/2367796491 shutdown_connections 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080ad770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2367796491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0815ae40 0x7fdb080b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 -- 172.21.15.50:0/2367796491 >> 172.21.15.50:0/2367796491 conn(0x7fdb080b01b0 msgr2=0x7fdb080b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 -- 172.21.15.50:0/2367796491 shutdown_connections 2023-08-10T10:38:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.378+0000 7fdb0e999640 1 -- 172.21.15.50:0/2367796491 wait complete. 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.379+0000 7fdb0e999640 1 Processor -- start 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.380+0000 7fdb0e999640 1 -- start start 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.380+0000 7fdb0e999640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0806cb30 0x7fdb080c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.380+0000 7fdb0e999640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.380+0000 7fdb0e999640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0815ae40 0x7fdb080af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb0e999640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080c5790 con 0x7fdb080cd9b0 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb0e999640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080c5a70 con 0x7fdb0815ae40 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb0e999640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080c4e20 con 0x7fdb0806cb30 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53310/0 (socket says 172.21.15.50:53310) 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 -- 172.21.15.50:0/2496805269 learned_addr learned my addr 172.21.15.50:0/2496805269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb07fff640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0806cb30 0x7fdb080c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb0cf36640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0815ae40 0x7fdb080af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 -- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0806cb30 msgr2=0x7fdb080c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0806cb30 0x7fdb080c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 -- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0815ae40 msgr2=0x7fdb080af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0815ae40 0x7fdb080af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.381+0000 7fdb077fe640 1 -- 172.21.15.50:0/2496805269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009a70 con 0x7fdb080cd9b0 2023-08-10T10:38:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb077fe640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c440 tx=0x7fdaf000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00074e0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf0007640 con 0x7fdb080cd9b0 2023-08-10T10:38:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb080c50c0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0004a20 con 0x7fdb080cd9b0 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.382+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb080c2730 con 0x7fdb080cd9b0 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.383+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb080612b0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.384+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdaf0004b80 con 0x7fdb080cd9b0 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.385+0000 7fdb04ff9640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 0x7fdae806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.385+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdaf00889f0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.386+0000 7fdb07fff640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 0x7fdae806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.386+0000 7fdb07fff640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 0x7fdae806d110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a950 tx=0x7fdaf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.390+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdaf0057490 con 0x7fdb080cd9b0 2023-08-10T10:38:58.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.582+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb080cde30 con 0x7fdb080cd9b0 2023-08-10T10:38:58.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.583+0000 7fdb04ff9640 1 -- 172.21.15.50:0/2496805269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdaf00180a0 con 0x7fdb080cd9b0 2023-08-10T10:38:58.584 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:38:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 msgr2=0x7fdae806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 0x7fdae806d110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a950 tx=0x7fdaf8008040 comp rx=0 tx=0).stop 2023-08-10T10:38:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 msgr2=0x7fdb080c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c440 tx=0x7fdaf000c900 comp rx=0 tx=0).stop 2023-08-10T10:38:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 shutdown_connections 2023-08-10T10:38:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdae806ac50 0x7fdae806d110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0815ae40 0x7fdb080af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb080cd9b0 0x7fdb080c21f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 --2- 172.21.15.50:0/2496805269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0806cb30 0x7fdb080c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.586+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 >> 172.21.15.50:0/2496805269 conn(0x7fdb080b01b0 msgr2=0x7fdb081596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:58.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.587+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 shutdown_connections 2023-08-10T10:38:58.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.587+0000 7fdb0e999640 1 -- 172.21.15.50:0/2496805269 wait complete. 2023-08-10T10:38:58.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:38:58.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.837+0000 7f0bc43b1640 1 Processor -- start 2023-08-10T10:38:58.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.838+0000 7f0bc43b1640 1 -- start start 2023-08-10T10:38:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.839+0000 7f0bc43b1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bbc15ae40 0x7f0bbc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.839+0000 7f0bc43b1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bbc0cd9b0 0x7f0bbc0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.839+0000 7f0bc43b1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0adcb0 con 0x7f0bbc06cb30 2023-08-10T10:38:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.839+0000 7f0bc43b1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc06c320 con 0x7f0bbc15ae40 2023-08-10T10:38:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.839+0000 7f0bc43b1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc06b770 con 0x7f0bbc0cd9b0 2023-08-10T10:38:58.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bbc15ae40 0x7f0bbc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bbc15ae40 0x7f0bbc0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53326/0 (socket says 172.21.15.50:53326) 2023-08-10T10:38:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 -- 172.21.15.50:0/1457401127 learned_addr learned my addr 172.21.15.50:0/1457401127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc194c640 1 --1- 172.21.15.50:0/1457401127 >> v1:172.21.15.50:6789/0 conn(0x7f0bbc06cb30 0x7f0bbc0cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37316/0 (socket says 172.21.15.50:37316) 2023-08-10T10:38:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc294e640 1 --2- 172.21.15.50:0/1457401127 >> v2:172.21.15.117:3300/0 conn(0x7f0bbc0cd9b0 0x7f0bbc0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 -- 172.21.15.50:0/1457401127 >> v2:172.21.15.117:3300/0 conn(0x7f0bbc0cd9b0 msgr2=0x7f0bbc0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 --2- 172.21.15.50:0/1457401127 >> v2:172.21.15.117:3300/0 conn(0x7f0bbc0cd9b0 0x7f0bbc0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 -- 172.21.15.50:0/1457401127 >> v1:172.21.15.50:6789/0 conn(0x7f0bbc06cb30 legacy=0x7f0bbc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc214d640 1 -- 172.21.15.50:0/1457401127 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc06b9f0 con 0x7f0bbc15ae40 2023-08-10T10:38:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.840+0000 7f0bc114b640 1 -- 172.21.15.50:0/1457401127 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192012791 0 0) 0x7f0bbc0adcb0 con 0x7f0bbc06cb30 2023-08-10T10:38:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.842+0000 7f0bc214d640 1 --2- 172.21.15.50:0/1457401127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc0b1510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0b0d60 tx=0x7f0bb802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c0ef3e9c32d9e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.842+0000 7f0bc114b640 1 -- 172.21.15.50:0/1457401127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8030880 con 0x7f0bbc15ae40 2023-08-10T10:38:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.842+0000 7f0bc114b640 1 -- 172.21.15.50:0/1457401127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb80309e0 con 0x7f0bbc15ae40 2023-08-10T10:38:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.842+0000 7f0bc114b640 1 -- 172.21.15.50:0/1457401127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8030d70 con 0x7f0bbc15ae40 2023-08-10T10:38:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 -- 172.21.15.50:0/1457401127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 msgr2=0x7f0bbc0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/1457401127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc0b1510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0b0d60 tx=0x7f0bb802b9c0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 -- 172.21.15.50:0/1457401127 shutdown_connections 2023-08-10T10:38:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/1457401127 >> v2:172.21.15.117:3300/0 conn(0x7f0bbc0cd9b0 0x7f0bbc0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/1457401127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc0b1510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 -- 172.21.15.50:0/1457401127 >> 172.21.15.50:0/1457401127 conn(0x7f0bbc0b01b0 msgr2=0x7f0bbc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 -- 172.21.15.50:0/1457401127 shutdown_connections 2023-08-10T10:38:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.843+0000 7f0bc43b1640 1 -- 172.21.15.50:0/1457401127 wait complete. 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.845+0000 7f0bc43b1640 1 Processor -- start 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.845+0000 7f0bc43b1640 1 -- start start 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bbc06cb30 0x7f0bbc15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bbc0cd9b0 0x7f0bbc0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc14d440 con 0x7f0bbc15ae40 2023-08-10T10:38:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc15d920 con 0x7f0bbc0cd9b0 2023-08-10T10:38:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc43b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc15e290 con 0x7f0bbc06cb30 2023-08-10T10:38:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc294e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc294e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53336/0 (socket says 172.21.15.50:53336) 2023-08-10T10:38:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc294e640 1 -- 172.21.15.50:0/3913962885 learned_addr learned my addr 172.21.15.50:0/3913962885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc214d640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bbc06cb30 0x7f0bbc15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc194c640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bbc0cd9b0 0x7f0bbc0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.846+0000 7f0bc294e640 1 -- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bbc06cb30 msgr2=0x7f0bbc15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc294e640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bbc06cb30 0x7f0bbc15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc294e640 1 -- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bbc0cd9b0 msgr2=0x7f0bbc0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc294e640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bbc0cd9b0 0x7f0bbc0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc294e640 1 -- 172.21.15.50:0/3913962885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80094d0 con 0x7f0bbc15ae40 2023-08-10T10:38:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc294e640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009fd0 tx=0x7f0bb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4014420 con 0x7f0bbc15ae40 2023-08-10T10:38:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4014580 con 0x7f0bbc15ae40 2023-08-10T10:38:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4014930 con 0x7f0bbc15ae40 2023-08-10T10:38:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0c7220 con 0x7f0bbc15ae40 2023-08-10T10:38:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.847+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc0c77e0 con 0x7f0bbc15ae40 2023-08-10T10:38:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.849+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc0612b0 con 0x7f0bbc15ae40 2023-08-10T10:38:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.850+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bb4014a90 con 0x7f0bbc15ae40 2023-08-10T10:38:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.851+0000 7f0bb2ffd640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 0x7f0ba006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.851+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bb4089f80 con 0x7f0bbc15ae40 2023-08-10T10:38:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.851+0000 7f0bc214d640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 0x7f0ba006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.852+0000 7f0bc214d640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 0x7f0ba006d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8036000 tx=0x7f0bb803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:58.855+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0bb4058990 con 0x7f0bbc15ae40 2023-08-10T10:38:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.047+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bbc06bca0 con 0x7f0bbc15ae40 2023-08-10T10:38:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.048+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/3913962885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bb4058520 con 0x7f0bbc15ae40 2023-08-10T10:38:59.048 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:38:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 msgr2=0x7f0ba006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 0x7f0ba006d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8036000 tx=0x7f0bb803b040 comp rx=0 tx=0).stop 2023-08-10T10:38:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 msgr2=0x7f0bbc15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009fd0 tx=0x7f0bb400e4b0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 shutdown_connections 2023-08-10T10:38:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bbc15ae40 0x7f0bbc15d3e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ba006ac50 0x7f0ba006d110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bbc0cd9b0 0x7f0bbc0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 --2- 172.21.15.50:0/3913962885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bbc06cb30 0x7f0bbc15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.050+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 >> 172.21.15.50:0/3913962885 conn(0x7f0bbc0b01b0 msgr2=0x7f0bbc15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.051+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 shutdown_connections 2023-08-10T10:38:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.051+0000 7f0bc43b1640 1 -- 172.21.15.50:0/3913962885 wait complete. 2023-08-10T10:38:59.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:38:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.278+0000 7f7180c1a640 1 Processor -- start 2023-08-10T10:38:59.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.278+0000 7f7180c1a640 1 -- start start 2023-08-10T10:38:59.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.280+0000 7f7180c1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.280+0000 7f7180c1a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f717c0696a0 0x7f717c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.280+0000 7f7180c1a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0cc8d0 con 0x7f717c160fa0 2023-08-10T10:38:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.280+0000 7f7180c1a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c06a070 con 0x7f717c0696a0 2023-08-10T10:38:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.280+0000 7f7180c1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0ccbb0 con 0x7f717c0c15e0 2023-08-10T10:38:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:55104/0 (socket says 172.21.15.50:55104) 2023-08-10T10:38:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 -- 172.21.15.50:0/3690551098 learned_addr learned my addr 172.21.15.50:0/3690551098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f717bfff640 1 --2- 172.21.15.50:0/3690551098 >> v2:172.21.15.117:3300/0 conn(0x7f717c0696a0 0x7f717c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 -- 172.21.15.50:0/3690551098 >> v2:172.21.15.117:3300/0 conn(0x7f717c0696a0 msgr2=0x7f717c069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:59.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 --2- 172.21.15.50:0/3690551098 >> v2:172.21.15.117:3300/0 conn(0x7f717c0696a0 0x7f717c069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 -- 172.21.15.50:0/3690551098 >> v1:172.21.15.117:6789/0 conn(0x7f717c160fa0 legacy=0x7f717c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.281+0000 7f7172ffd640 1 -- 172.21.15.50:0/3690551098 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0cce90 con 0x7f717c0c15e0 2023-08-10T10:38:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.283+0000 7f7172ffd640 1 --2- 172.21.15.50:0/3690551098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7164009e50 tx=0x7f716402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdfb1102e44a43ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.283+0000 7f717affd640 1 -- 172.21.15.50:0/3690551098 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716402cb00 con 0x7f717c0c15e0 2023-08-10T10:38:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.283+0000 7f717affd640 1 -- 172.21.15.50:0/3690551098 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716402cc60 con 0x7f717c0c15e0 2023-08-10T10:38:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.283+0000 7f717affd640 1 -- 172.21.15.50:0/3690551098 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640343f0 con 0x7f717c0c15e0 2023-08-10T10:38:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 -- 172.21.15.50:0/3690551098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 msgr2=0x7f717c0c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 --2- 172.21.15.50:0/3690551098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7164009e50 tx=0x7f716402bf60 comp rx=0 tx=0).stop 2023-08-10T10:38:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 -- 172.21.15.50:0/3690551098 shutdown_connections 2023-08-10T10:38:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 --2- 172.21.15.50:0/3690551098 >> v2:172.21.15.117:3300/0 conn(0x7f717c0696a0 0x7f717c069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 --2- 172.21.15.50:0/3690551098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0c15e0 0x7f717c0c97b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 -- 172.21.15.50:0/3690551098 >> 172.21.15.50:0/3690551098 conn(0x7f717c0caf80 msgr2=0x7f717c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 -- 172.21.15.50:0/3690551098 shutdown_connections 2023-08-10T10:38:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.284+0000 7f7180c1a640 1 -- 172.21.15.50:0/3690551098 wait complete. 2023-08-10T10:38:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.286+0000 7f7180c1a640 1 Processor -- start 2023-08-10T10:38:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.287+0000 7f7180c1a640 1 -- start start 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 0x7f717c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f717c0c15e0 0x7f717c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c158320 con 0x7f717c160fa0 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0c6510 con 0x7f717c0c15e0 2023-08-10T10:38:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f7180c1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0c5900 con 0x7f717c0696a0 2023-08-10T10:38:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f717bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f717bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53342/0 (socket says 172.21.15.50:53342) 2023-08-10T10:38:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.288+0000 7f717bfff640 1 -- 172.21.15.50:0/2464116832 learned_addr learned my addr 172.21.15.50:0/2464116832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717b7fe640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 0x7f717c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f7172ffd640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f717c0c15e0 0x7f717c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 -- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 msgr2=0x7f717c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 0x7f717c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 -- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f717c0c15e0 msgr2=0x7f717c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f717c0c15e0 0x7f717c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 -- 172.21.15.50:0/2464116832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009b30 con 0x7f717c160fa0 2023-08-10T10:38:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717b7fe640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 0x7f717c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.289+0000 7f717bfff640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f717400e930 tx=0x7f717400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.290+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174009690 con 0x7f717c160fa0 2023-08-10T10:38:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.290+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717400c980 con 0x7f717c160fa0 2023-08-10T10:38:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.290+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717400cd30 con 0x7f717c160fa0 2023-08-10T10:38:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.290+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0c5be0 con 0x7f717c160fa0 2023-08-10T10:38:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.290+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c0c61a0 con 0x7f717c160fa0 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.291+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c06cc20 con 0x7f717c160fa0 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.292+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7174013470 con 0x7f717c160fa0 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.293+0000 7f7178ff9640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 0x7f715c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.293+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7174089720 con 0x7f717c160fa0 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.294+0000 7f717b7fe640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 0x7f715c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.294+0000 7f717b7fe640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 0x7f715c06d110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f716c007fd0 tx=0x7f716c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.298+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7174058320 con 0x7f717c160fa0 2023-08-10T10:38:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.488+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f717c066e30 con 0x7f717c160fa0 2023-08-10T10:38:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.489+0000 7f7178ff9640 1 -- 172.21.15.50:0/2464116832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7174057eb0 con 0x7f717c160fa0 2023-08-10T10:38:59.490 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:38:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.491+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 msgr2=0x7f715c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.491+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 0x7f715c06d110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f716c007fd0 tx=0x7f716c009040 comp rx=0 tx=0).stop 2023-08-10T10:38:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.491+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 msgr2=0x7f717c0c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.491+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f717400e930 tx=0x7f717400edf0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 shutdown_connections 2023-08-10T10:38:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f717c160fa0 0x7f717c0c3900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f715c06ac50 0x7f715c06d110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f717c0c15e0 0x7f717c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 --2- 172.21.15.50:0/2464116832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f717c0696a0 0x7f717c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 >> 172.21.15.50:0/2464116832 conn(0x7f717c0caf80 msgr2=0x7f717c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 shutdown_connections 2023-08-10T10:38:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.492+0000 7f7180c1a640 1 -- 172.21.15.50:0/2464116832 wait complete. 2023-08-10T10:38:59.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:38:59.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.732+0000 7f9524a8a640 1 Processor -- start 2023-08-10T10:38:59.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.733+0000 7f9524a8a640 1 -- start start 2023-08-10T10:38:59.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.734+0000 7f9524a8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f95200b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.734+0000 7f9524a8a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95200cfd40 0x7f95200b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.734+0000 7f9524a8a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952015d010 con 0x7f9520153c30 2023-08-10T10:38:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.734+0000 7f9524a8a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952015d290 con 0x7f95200cfd40 2023-08-10T10:38:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.734+0000 7f9524a8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952015d570 con 0x7f9520153850 2023-08-10T10:38:59.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95200cfd40 0x7f95200b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9520153c30 0x7f95200cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37328/0 (socket says 172.21.15.50:37328) 2023-08-10T10:38:59.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951effd640 1 -- 172.21.15.50:0/3800636807 learned_addr learned my addr 172.21.15.50:0/3800636807 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951f7fe640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f95200b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951ffff640 1 -- 172.21.15.50:0/3800636807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 msgr2=0x7f95200b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951ffff640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f95200b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951ffff640 1 -- 172.21.15.50:0/3800636807 >> v1:172.21.15.50:6789/0 conn(0x7f9520153c30 legacy=0x7f95200cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951ffff640 1 -- 172.21.15.50:0/3800636807 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952015d850 con 0x7f95200cfd40 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951e7fc640 1 -- 172.21.15.50:0/3800636807 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926465957 0 0) 0x7f952015d010 con 0x7f9520153c30 2023-08-10T10:38:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.735+0000 7f951f7fe640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f95200b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:38:59.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f951ffff640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95200cfd40 0x7f95200b1bd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9518009d90 tx=0x7f951802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eba52d53a4c65d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f951e7fc640 1 -- 172.21.15.50:0/3800636807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951802cc60 con 0x7f95200cfd40 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f951e7fc640 1 -- 172.21.15.50:0/3800636807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951802cdc0 con 0x7f95200cfd40 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f951e7fc640 1 -- 172.21.15.50:0/3800636807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518034660 con 0x7f95200cfd40 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f9524a8a640 1 -- 172.21.15.50:0/3800636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95200cfd40 msgr2=0x7f95200b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.737+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95200cfd40 0x7f95200b1bd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9518009d90 tx=0x7f951802beb0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 -- 172.21.15.50:0/3800636807 shutdown_connections 2023-08-10T10:38:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95200cfd40 0x7f95200b1bd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3800636807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f95200b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 -- 172.21.15.50:0/3800636807 >> 172.21.15.50:0/3800636807 conn(0x7f9520069880 msgr2=0x7f9520069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 -- 172.21.15.50:0/3800636807 shutdown_connections 2023-08-10T10:38:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.738+0000 7f9524a8a640 1 -- 172.21.15.50:0/3800636807 wait complete. 2023-08-10T10:38:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.739+0000 7f9524a8a640 1 Processor -- start 2023-08-10T10:38:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.740+0000 7f9524a8a640 1 -- start start 2023-08-10T10:38:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95200cfd40 0x7f952014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f9520156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9520155a30 con 0x7f9520153c30 2023-08-10T10:38:59.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9520154e20 con 0x7f95200cfd40 2023-08-10T10:38:59.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f9524a8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9520155100 con 0x7f9520153850 2023-08-10T10:38:59.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53348/0 (socket says 172.21.15.50:53348) 2023-08-10T10:38:59.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 -- 172.21.15.50:0/3887503484 learned_addr learned my addr 172.21.15.50:0/3887503484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951f7fe640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95200cfd40 0x7f952014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951effd640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f9520156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 -- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 msgr2=0x7f9520156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f9520156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 -- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95200cfd40 msgr2=0x7f952014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95200cfd40 0x7f952014ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.741+0000 7f951ffff640 1 -- 172.21.15.50:0/3887503484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009a70 con 0x7f9520153c30 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f951ffff640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9518009d90 tx=0x7f9518004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518003be0 con 0x7f9520153c30 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518003d40 con 0x7f9520153c30 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518004270 con 0x7f9520153c30 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95201553e0 con 0x7f9520153c30 2023-08-10T10:38:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.742+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9520154a70 con 0x7f9520153c30 2023-08-10T10:38:59.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.743+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95200c63b0 con 0x7f9520153c30 2023-08-10T10:38:59.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.745+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f951803b050 con 0x7f9520153c30 2023-08-10T10:38:59.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.745+0000 7f9507fff640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 0x7f950c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:38:59.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.746+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95180abad0 con 0x7f9520153c30 2023-08-10T10:38:59.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.746+0000 7f951f7fe640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 0x7f950c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:38:59.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.747+0000 7f951f7fe640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 0x7f950c06d110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95200d3830 tx=0x7f9510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:38:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.750+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9518076ae0 con 0x7f9520153c30 2023-08-10T10:38:59.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.945+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95200cea00 con 0x7f9520153c30 2023-08-10T10:38:59.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.948+0000 7f9507fff640 1 -- 172.21.15.50:0/3887503484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f9518039020 con 0x7f9520153c30 2023-08-10T10:38:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:38:59.949 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:38:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 msgr2=0x7f950c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 0x7f950c06d110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95200d3830 tx=0x7f9510008040 comp rx=0 tx=0).stop 2023-08-10T10:38:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 msgr2=0x7f95200c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:38:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9518009d90 tx=0x7f9518004a90 comp rx=0 tx=0).stop 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 shutdown_connections 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9520153c30 0x7f95200c8770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9520153850 0x7f9520156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac50 0x7f950c06d110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 --2- 172.21.15.50:0/3887503484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95200cfd40 0x7f952014ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.951+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 >> 172.21.15.50:0/3887503484 conn(0x7f9520069880 msgr2=0x7f9520160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:38:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.952+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 shutdown_connections 2023-08-10T10:38:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:38:59.952+0000 7f9524a8a640 1 -- 172.21.15.50:0/3887503484 wait complete. 2023-08-10T10:38:59.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:38:59.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.196+0000 7fe5f1781640 1 Processor -- start 2023-08-10T10:39:00.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.197+0000 7fe5f1781640 1 -- start start 2023-08-10T10:39:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.198+0000 7fe5f1781640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.198+0000 7fe5f1781640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5ec0c94e0 0x7fe5ec0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.198+0000 7fe5f1781640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec164bf0 con 0x7fe5ec0b0440 2023-08-10T10:39:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.198+0000 7fe5f1781640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec0b08d0 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.198+0000 7fe5f1781640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec164e40 con 0x7fe5ec161070 2023-08-10T10:39:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.199+0000 7fe5ebfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.199+0000 7fe5eb7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5ec0c94e0 0x7fe5ec0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.199+0000 7fe5ebfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:55148/0 (socket says 172.21.15.50:55148) 2023-08-10T10:39:00.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.199+0000 7fe5ebfff640 1 -- 172.21.15.50:0/3259454470 learned_addr learned my addr 172.21.15.50:0/3259454470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5eb7fe640 1 -- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 msgr2=0x7fe5ec0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5eb7fe640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5eb7fe640 1 -- 172.21.15.50:0/3259454470 >> v1:172.21.15.117:6789/0 conn(0x7fe5ec0b0440 legacy=0x7fe5ec06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5eb7fe640 1 -- 172.21.15.50:0/3259454470 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec165120 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5eaffd640 1 -- 172.21.15.50:0/3259454470 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978953668 0 0) 0x7fe5ec164bf0 con 0x7fe5ec0b0440 2023-08-10T10:39:00.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.200+0000 7fe5ebfff640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:39:00.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.202+0000 7fe5eb7fe640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0c94e0 0x7fe5ec0aff00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00097a0 tx=0x7fe5e002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d17c47cf26d1f67 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.203+0000 7fe5eaffd640 1 -- 172.21.15.50:0/3259454470 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e002d040 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.203+0000 7fe5eaffd640 1 -- 172.21.15.50:0/3259454470 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0031810 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.203+0000 7fe5eaffd640 1 -- 172.21.15.50:0/3259454470 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0031ba0 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 -- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0c94e0 msgr2=0x7fe5ec0aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0c94e0 0x7fe5ec0aff00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00097a0 tx=0x7fe5e002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 -- 172.21.15.50:0/3259454470 shutdown_connections 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0c94e0 0x7fe5ec0aff00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 --2- 172.21.15.50:0/3259454470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec161070 0x7fe5ec0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 -- 172.21.15.50:0/3259454470 >> 172.21.15.50:0/3259454470 conn(0x7fe5ec069cd0 msgr2=0x7fe5ec0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 -- 172.21.15.50:0/3259454470 shutdown_connections 2023-08-10T10:39:00.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.204+0000 7fe5f1781640 1 -- 172.21.15.50:0/3259454470 wait complete. 2023-08-10T10:39:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.206+0000 7fe5f1781640 1 Processor -- start 2023-08-10T10:39:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.206+0000 7fe5f1781640 1 -- start start 2023-08-10T10:39:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec0c94e0 0x7fe5ec14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0c7790 con 0x7fe5ec161070 2023-08-10T10:39:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0c6b80 con 0x7fe5ec0b0440 2023-08-10T10:39:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.207+0000 7fe5f1781640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0c6e60 con 0x7fe5ec0c94e0 2023-08-10T10:39:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53350/0 (socket says 172.21.15.50:53350) 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 -- 172.21.15.50:0/703244182 learned_addr learned my addr 172.21.15.50:0/703244182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5ebfff640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5eb7fe640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec0c94e0 0x7fe5ec14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 -- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec0c94e0 msgr2=0x7fe5ec14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec0c94e0 0x7fe5ec14cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 -- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 msgr2=0x7fe5ec0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5f0f80640 1 -- 172.21.15.50:0/703244182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0094d0 con 0x7fe5ec161070 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.208+0000 7fe5ebfff640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5f0f80640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c780 tx=0x7fe5e400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003b70 con 0x7fe5ec161070 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4003cd0 con 0x7fe5ec161070 2023-08-10T10:39:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e0009400 con 0x7fe5ec161070 2023-08-10T10:39:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4005270 con 0x7fe5ec161070 2023-08-10T10:39:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.209+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec0c7420 con 0x7fe5ec161070 2023-08-10T10:39:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.210+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec0c7900 con 0x7fe5ec161070 2023-08-10T10:39:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.212+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5e40053d0 con 0x7fe5ec161070 2023-08-10T10:39:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.213+0000 7fe5e8ff9640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 0x7fe5d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.213+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5e4089210 con 0x7fe5ec161070 2023-08-10T10:39:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.213+0000 7fe5ebfff640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 0x7fe5d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.214+0000 7fe5ebfff640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 0x7fe5d806d110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009db0 tx=0x7fe5dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.217+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe5e4054350 con 0x7fe5ec161070 2023-08-10T10:39:00.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.411+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5ec066e30 con 0x7fe5ec161070 2023-08-10T10:39:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.413+0000 7fe5e8ff9640 1 -- 172.21.15.50:0/703244182 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5e4057970 con 0x7fe5ec161070 2023-08-10T10:39:00.414 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 msgr2=0x7fe5d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 0x7fe5d806d110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009db0 tx=0x7fe5dc008040 comp rx=0 tx=0).stop 2023-08-10T10:39:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 msgr2=0x7fe5ec0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c780 tx=0x7fe5e400cb80 comp rx=0 tx=0).stop 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 shutdown_connections 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5ec161070 0x7fe5ec0c4d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5ec0c94e0 0x7fe5ec14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5d806ac50 0x7fe5d806d110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 --2- 172.21.15.50:0/703244182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 >> 172.21.15.50:0/703244182 conn(0x7fe5ec069cd0 msgr2=0x7fe5ec15b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 shutdown_connections 2023-08-10T10:39:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.416+0000 7fe5f1781640 1 -- 172.21.15.50:0/703244182 wait complete. 2023-08-10T10:39:00.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:00.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.668+0000 7ff177c67640 1 Processor -- start 2023-08-10T10:39:00.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.668+0000 7ff177c67640 1 -- start start 2023-08-10T10:39:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.669+0000 7ff177c67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff17015ae40 0x7ff1700b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.669+0000 7ff177c67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17006c320 con 0x7ff1700cd9b0 2023-08-10T10:39:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.669+0000 7ff177c67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17006b770 con 0x7ff17006cb30 2023-08-10T10:39:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.669+0000 7ff177c67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17006b9f0 con 0x7ff17015ae40 2023-08-10T10:39:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.670+0000 7ff176204640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1700cd9b0 0x7ff1700c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37332/0 (socket says 172.21.15.50:37332) 2023-08-10T10:39:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.670+0000 7ff176204640 1 -- 172.21.15.50:0/1002535805 learned_addr learned my addr 172.21.15.50:0/1002535805 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.670+0000 7ff175a03640 1 --2- 172.21.15.50:0/1002535805 >> v2:172.21.15.117:3300/0 conn(0x7ff17015ae40 0x7ff1700b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.670+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513290374 0 0) 0x7ff17006c320 con 0x7ff1700cd9b0 2023-08-10T10:39:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.670+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c003520 con 0x7ff1700cd9b0 2023-08-10T10:39:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769958282 0 0) 0x7ff15c003520 con 0x7ff1700cd9b0 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 >> v2:172.21.15.117:3300/0 conn(0x7ff17015ae40 msgr2=0x7ff1700b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 --2- 172.21.15.50:0/1002535805 >> v2:172.21.15.117:3300/0 conn(0x7ff17015ae40 0x7ff1700b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 >> v1:172.21.15.117:6789/0 conn(0x7ff17006cb30 legacy=0x7ff1700cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17006bcd0 con 0x7ff1700cd9b0 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff1680019f0 con 0x7ff1700cd9b0 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 >> v1:172.21.15.50:6789/0 conn(0x7ff1700cd9b0 legacy=0x7ff1700c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c003970 0x7ff15c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff15c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c005180 0x7ff15c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17006b9f0 con 0x7ff15c0047c0 2023-08-10T10:39:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c00c020 con 0x7ff15c005180 2023-08-10T10:39:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c00c1e0 con 0x7ff15c003970 2023-08-10T10:39:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff175202640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff15c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.671+0000 7ff175a03640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c003970 0x7ff15c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff176204640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c005180 0x7ff15c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff175202640 1 -- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c003970 msgr2=0x7ff15c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff175202640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c003970 0x7ff15c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff175202640 1 -- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c005180 msgr2=0x7ff15c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff175202640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c005180 0x7ff15c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff175202640 1 -- 172.21.15.50:0/1002535805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c003520 con 0x7ff15c0047c0 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.672+0000 7ff176204640 1 -- 172.21.15.50:0/1002535805 reap_dead start 2023-08-10T10:39:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.673+0000 7ff175202640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff15c004c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff160001720 tx=0x7ff15c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26358495ee51bfda server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.673+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600052d0 con 0x7ff15c0047c0 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.673+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16002e050 con 0x7ff15c0047c0 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.673+0000 7ff174a01640 1 -- 172.21.15.50:0/1002535805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160003830 con 0x7ff15c0047c0 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 -- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 msgr2=0x7ff15c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff15c004c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff160001720 tx=0x7ff15c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 -- 172.21.15.50:0/1002535805 shutdown_connections 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 --2- 172.21.15.50:0/1002535805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff15c004c40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 -- 172.21.15.50:0/1002535805 >> 172.21.15.50:0/1002535805 conn(0x7ff1700b01b0 msgr2=0x7ff1700b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 -- 172.21.15.50:0/1002535805 shutdown_connections 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.674+0000 7ff177c67640 1 -- 172.21.15.50:0/1002535805 wait complete. 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.676+0000 7ff177c67640 1 Processor -- start 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.676+0000 7ff177c67640 1 -- start start 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 0x7ff1701f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 0x7ff1700ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170156480 con 0x7ff15c0047c0 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701f28a0 con 0x7ff1700c7650 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff177c67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701f5ff0 con 0x7ff1701f2d30 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff175a03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff175a03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53380/0 (socket says 172.21.15.50:53380) 2023-08-10T10:39:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff175a03640 1 -- 172.21.15.50:0/807873851 learned_addr learned my addr 172.21.15.50:0/807873851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff175202640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 0x7ff1701f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff176204640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 0x7ff1700ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.677+0000 7ff175a03640 1 -- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 msgr2=0x7ff1700ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175a03640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 0x7ff1700ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175a03640 1 -- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 msgr2=0x7ff1701f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175a03640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 0x7ff1701f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175a03640 1 -- 172.21.15.50:0/807873851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1701f6250 con 0x7ff15c0047c0 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff176204640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 0x7ff1700ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175202640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 0x7ff1701f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff175a03640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0114e0 tx=0x7ff16c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c015870 con 0x7ff15c0047c0 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c0159d0 con 0x7ff15c0047c0 2023-08-10T10:39:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c015d40 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.678+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1701f6530 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.679+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1701f2470 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.680+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1701f2660 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.681+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff16c013400 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.682+0000 7ff1667fc640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 0x7ff15406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.682+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff16c0899a0 con 0x7ff15c0047c0 2023-08-10T10:39:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.682+0000 7ff175202640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 0x7ff15406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.683+0000 7ff175202640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 0x7ff15406d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff160033000 tx=0x7ff160009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.686+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff16c058440 con 0x7ff15c0047c0 2023-08-10T10:39:00.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.878+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1700612b0 con 0x7ff15c0047c0 2023-08-10T10:39:00.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.879+0000 7ff1667fc640 1 -- 172.21.15.50:0/807873851 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff16c057fd0 con 0x7ff15c0047c0 2023-08-10T10:39:00.880 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.881+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 msgr2=0x7ff15406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.881+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 0x7ff15406d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff160033000 tx=0x7ff160009030 comp rx=0 tx=0).stop 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 msgr2=0x7ff170158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0114e0 tx=0x7ff16c0119a0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 shutdown_connections 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1701f2d30 0x7ff1700ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff15406ac50 0x7ff15406d110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1700c7650 0x7ff1701f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 --2- 172.21.15.50:0/807873851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff15c0047c0 0x7ff170158780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 >> 172.21.15.50:0/807873851 conn(0x7ff1700b01b0 msgr2=0x7ff1700c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 shutdown_connections 2023-08-10T10:39:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:00.882+0000 7ff177c67640 1 -- 172.21.15.50:0/807873851 wait complete. 2023-08-10T10:39:00.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.132+0000 7f10f4b15640 1 Processor -- start 2023-08-10T10:39:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.132+0000 7f10f4b15640 1 -- start start 2023-08-10T10:39:01.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.133+0000 7f10f4b15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10f015cb90 0x7f10f00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.133+0000 7f10f4b15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10f4b15640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f0160a40 con 0x7f10f00b4640 2023-08-10T10:39:01.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10f4b15640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00b4bb0 con 0x7f10f015cb90 2023-08-10T10:39:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10f4b15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00b4e90 con 0x7f10f015cf70 2023-08-10T10:39:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10f015cb90 0x7f10f00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10f015cb90 0x7f10f00b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53386/0 (socket says 172.21.15.50:53386) 2023-08-10T10:39:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 -- 172.21.15.50:0/3244594800 learned_addr learned my addr 172.21.15.50:0/3244594800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 -- 172.21.15.50:0/3244594800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 msgr2=0x7f10f0160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:01.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 --2- 172.21.15.50:0/3244594800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 -- 172.21.15.50:0/3244594800 >> v1:172.21.15.50:6789/0 conn(0x7f10f00b4640 legacy=0x7f10f006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.134+0000 7f10ee59c640 1 -- 172.21.15.50:0/3244594800 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00b5170 con 0x7f10f015cb90 2023-08-10T10:39:01.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10ee59c640 1 --2- 172.21.15.50:0/3244594800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f00b5dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009870 tx=0x7f10d802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaba951f545b1e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10ed59a640 1 -- 172.21.15.50:0/3244594800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8030840 con 0x7f10f015cb90 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10ed59a640 1 -- 172.21.15.50:0/3244594800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80309a0 con 0x7f10f015cb90 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10ed59a640 1 -- 172.21.15.50:0/3244594800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8030d30 con 0x7f10f015cb90 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10f4b15640 1 -- 172.21.15.50:0/3244594800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 msgr2=0x7f10f00b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.136+0000 7f10f4b15640 1 --2- 172.21.15.50:0/3244594800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f00b5dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009870 tx=0x7f10d802b980 comp rx=0 tx=0).stop 2023-08-10T10:39:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 -- 172.21.15.50:0/3244594800 shutdown_connections 2023-08-10T10:39:01.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 --2- 172.21.15.50:0/3244594800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f0160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 --2- 172.21.15.50:0/3244594800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f00b5dd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 -- 172.21.15.50:0/3244594800 >> 172.21.15.50:0/3244594800 conn(0x7f10f00cf640 msgr2=0x7f10f00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 -- 172.21.15.50:0/3244594800 shutdown_connections 2023-08-10T10:39:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.137+0000 7f10f4b15640 1 -- 172.21.15.50:0/3244594800 wait complete. 2023-08-10T10:39:01.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.138+0000 7f10f4b15640 1 Processor -- start 2023-08-10T10:39:01.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.139+0000 7f10f4b15640 1 -- start start 2023-08-10T10:39:01.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f00b4640 0x7f10f015f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015f6a0 con 0x7f10f015cb90 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015f980 con 0x7f10f00b4640 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10f4b15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015fc60 con 0x7f10f015cf70 2023-08-10T10:39:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10edd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10edd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53388/0 (socket says 172.21.15.50:53388) 2023-08-10T10:39:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10edd9b640 1 -- 172.21.15.50:0/384540303 learned_addr learned my addr 172.21.15.50:0/384540303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10ee59c640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f00b4640 0x7f10f015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10edd9b640 1 -- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 msgr2=0x7f10f00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10eed9d640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.140+0000 7f10edd9b640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f00cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10edd9b640 1 -- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f00b4640 msgr2=0x7f10f015f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10edd9b640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f00b4640 0x7f10f015f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10edd9b640 1 -- 172.21.15.50:0/384540303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80094d0 con 0x7f10f015cb90 2023-08-10T10:39:01.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10eed9d640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:01.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10edd9b640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10e000ba50 tx=0x7f10e000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000cbe0 con 0x7f10f015cb90 2023-08-10T10:39:01.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000cd60 con 0x7f10f015cb90 2023-08-10T10:39:01.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0014680 con 0x7f10f015cb90 2023-08-10T10:39:01.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f015ff40 con 0x7f10f015cb90 2023-08-10T10:39:01.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.141+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f015da90 con 0x7f10f015cb90 2023-08-10T10:39:01.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.142+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f0160460 con 0x7f10f015cb90 2023-08-10T10:39:01.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.143+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10e001d3b0 con 0x7f10f015cb90 2023-08-10T10:39:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.144+0000 7f10e6ffd640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 0x7f10d006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.144+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10e0089470 con 0x7f10f015cb90 2023-08-10T10:39:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.145+0000 7f10ee59c640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 0x7f10d006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.146+0000 7f10ee59c640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 0x7f10d006d110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10d8036000 tx=0x7f10d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.149+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10f0160460 con 0x7f10f015cb90 2023-08-10T10:39:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.340+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10f0160460 con 0x7f10f015cb90 2023-08-10T10:39:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.341+0000 7f10e6ffd640 1 -- 172.21.15.50:0/384540303 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10f0160460 con 0x7f10f015cb90 2023-08-10T10:39:01.342 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:01.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.343+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 msgr2=0x7f10d006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.343+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 0x7f10d006d110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10d8036000 tx=0x7f10d8008030 comp rx=0 tx=0).stop 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.343+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 msgr2=0x7f10f015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.343+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10e000ba50 tx=0x7f10e000bf10 comp rx=0 tx=0).stop 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 shutdown_connections 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f015cf70 0x7f10f00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10f015cb90 0x7f10f015d550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10d006ac50 0x7f10d006d110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 --2- 172.21.15.50:0/384540303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f00b4640 0x7f10f015f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 >> 172.21.15.50:0/384540303 conn(0x7f10f00cf640 msgr2=0x7f10f00b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:01.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 shutdown_connections 2023-08-10T10:39:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.344+0000 7f10f4b15640 1 -- 172.21.15.50:0/384540303 wait complete. 2023-08-10T10:39:01.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.597+0000 7f9db1d42640 1 Processor -- start 2023-08-10T10:39:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.597+0000 7f9db1d42640 1 -- start start 2023-08-10T10:39:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9db1d42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9dac15ca80 0x7f9dac0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9db1d42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dac161360 0x7f9dac0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9db1d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0cdb20 con 0x7f9dac0696a0 2023-08-10T10:39:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9db1d42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cde00 con 0x7f9dac161360 2023-08-10T10:39:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9db1d42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cc0d0 con 0x7f9dac15ca80 2023-08-10T10:39:01.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9da3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dac161360 0x7f9dac0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9da3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dac161360 0x7f9dac0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53400/0 (socket says 172.21.15.50:53400) 2023-08-10T10:39:01.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.599+0000 7f9da3fff640 1 -- 172.21.15.50:0/761320407 learned_addr learned my addr 172.21.15.50:0/761320407 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:01.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.600+0000 7f9db0d40640 1 --2- 172.21.15.50:0/761320407 >> v2:172.21.15.117:3300/0 conn(0x7f9dac15ca80 0x7f9dac0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.600+0000 7f9da3fff640 1 -- 172.21.15.50:0/761320407 >> v2:172.21.15.117:3300/0 conn(0x7f9dac15ca80 msgr2=0x7f9dac0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:01.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.600+0000 7f9da3fff640 1 --2- 172.21.15.50:0/761320407 >> v2:172.21.15.117:3300/0 conn(0x7f9dac15ca80 0x7f9dac0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.600+0000 7f9da3fff640 1 -- 172.21.15.50:0/761320407 >> v1:172.21.15.117:6789/0 conn(0x7f9dac0696a0 legacy=0x7f9dac0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:01.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.600+0000 7f9da3fff640 1 -- 172.21.15.50:0/761320407 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0cc3b0 con 0x7f9dac161360 2023-08-10T10:39:01.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.601+0000 7f9da3fff640 1 --2- 172.21.15.50:0/761320407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac161360 0x7f9dac0cd2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9dac06a7a0 tx=0x7f9d9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94890fe112c11df1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.601+0000 7f9da37fe640 1 -- 172.21.15.50:0/761320407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0317e0 con 0x7f9dac161360 2023-08-10T10:39:01.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.601+0000 7f9da37fe640 1 -- 172.21.15.50:0/761320407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c031940 con 0x7f9dac161360 2023-08-10T10:39:01.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.601+0000 7f9da37fe640 1 -- 172.21.15.50:0/761320407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c031cd0 con 0x7f9dac161360 2023-08-10T10:39:01.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 -- 172.21.15.50:0/761320407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac161360 msgr2=0x7f9dac0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 --2- 172.21.15.50:0/761320407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac161360 0x7f9dac0cd2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9dac06a7a0 tx=0x7f9d9c02b880 comp rx=0 tx=0).stop 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 -- 172.21.15.50:0/761320407 shutdown_connections 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 --2- 172.21.15.50:0/761320407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac161360 0x7f9dac0cd2d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 --2- 172.21.15.50:0/761320407 >> v2:172.21.15.117:3300/0 conn(0x7f9dac15ca80 0x7f9dac0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 -- 172.21.15.50:0/761320407 >> 172.21.15.50:0/761320407 conn(0x7f9dac0caf80 msgr2=0x7f9dac0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.602+0000 7f9db1d42640 1 -- 172.21.15.50:0/761320407 shutdown_connections 2023-08-10T10:39:01.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.603+0000 7f9db1d42640 1 -- 172.21.15.50:0/761320407 wait complete. 2023-08-10T10:39:01.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.604+0000 7f9db1d42640 1 Processor -- start 2023-08-10T10:39:01.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.604+0000 7f9db1d42640 1 -- start start 2023-08-10T10:39:01.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac0696a0 0x7f9dac15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 0x7f9dac1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c2d00 con 0x7f9dac15ca80 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c2080 con 0x7f9dac161360 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.605+0000 7f9db1d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c2360 con 0x7f9dac0696a0 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53408/0 (socket says 172.21.15.50:53408) 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 -- 172.21.15.50:0/4061443262 learned_addr learned my addr 172.21.15.50:0/4061443262 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 -- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac0696a0 msgr2=0x7f9dac15fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac0696a0 0x7f9dac15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 -- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 msgr2=0x7f9dac1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9db1541640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 0x7f9dac1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 0x7f9dac1589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9da3fff640 1 -- 172.21.15.50:0/4061443262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0094d0 con 0x7f9dac15ca80 2023-08-10T10:39:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.606+0000 7f9db1541640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 0x7f9dac1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9da3fff640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c02b8c0 tx=0x7f9d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c032880 con 0x7f9dac15ca80 2023-08-10T10:39:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c032a00 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c032db0 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0c2640 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.607+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac06f300 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.608+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac066e30 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.609+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d9c04d3f0 con 0x7f9dac15ca80 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.610+0000 7f9da17fa640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 0x7f9d9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.610+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d9c0ab2f0 con 0x7f9dac15ca80 2023-08-10T10:39:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.610+0000 7f9db0d40640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 0x7f9d9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.611+0000 7f9db0d40640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 0x7f9d9806d110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9da80070b0 tx=0x7f9da8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.615+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9d9c0763c0 con 0x7f9dac15ca80 2023-08-10T10:39:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.803+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9dac0c2e40 con 0x7f9dac15ca80 2023-08-10T10:39:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.804+0000 7f9da17fa640 1 -- 172.21.15.50:0/4061443262 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d9c0799e0 con 0x7f9dac15ca80 2023-08-10T10:39:01.804 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 msgr2=0x7f9d9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 0x7f9d9806d110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9da80070b0 tx=0x7f9da8007040 comp rx=0 tx=0).stop 2023-08-10T10:39:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 msgr2=0x7f9dac06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c02b8c0 tx=0x7f9d9c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 shutdown_connections 2023-08-10T10:39:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9806ac50 0x7f9d9806d110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac161360 0x7f9dac1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac15ca80 0x7f9dac06edc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 --2- 172.21.15.50:0/4061443262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac0696a0 0x7f9dac15fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.806+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 >> 172.21.15.50:0/4061443262 conn(0x7f9dac0caf80 msgr2=0x7f9dac160480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.807+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 shutdown_connections 2023-08-10T10:39:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:01.807+0000 7f9db1d42640 1 -- 172.21.15.50:0/4061443262 wait complete. 2023-08-10T10:39:01.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.051+0000 7fd4d2feb640 1 Processor -- start 2023-08-10T10:39:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.052+0000 7fd4d2feb640 1 -- start start 2023-08-10T10:39:02.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.053+0000 7fd4d2feb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.053+0000 7fd4d2feb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc0cc5a0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.053+0000 7fd4d2feb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc15d720 con 0x7fd4cc159830 2023-08-10T10:39:02.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.053+0000 7fd4d2feb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc0b4170 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53412/0 (socket says 172.21.15.50:53412) 2023-08-10T10:39:02.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 -- 172.21.15.50:0/2802365294 learned_addr learned my addr 172.21.15.50:0/2802365294 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:02.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d17e8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd4cc0c9d00 0x7fd4cc0cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37358/0 (socket says 172.21.15.50:37358) 2023-08-10T10:39:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 -- 172.21.15.50:0/2802365294 >> v1:172.21.15.117:6789/0 conn(0x7fd4cc159830 legacy=0x7fd4cc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 -- 172.21.15.50:0/2802365294 >> v1:172.21.15.50:6789/0 conn(0x7fd4cc0c9d00 legacy=0x7fd4cc0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.054+0000 7fd4d27ea640 1 -- 172.21.15.50:0/2802365294 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc159c10 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.055+0000 7fd4d27ea640 1 --2- 172.21.15.50:0/2802365294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009e50 tx=0x7fd4c402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fe605b12d71386 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d0fe7640 1 -- 172.21.15.50:0/2802365294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c402cbb0 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d0fe7640 1 -- 172.21.15.50:0/2802365294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c402cd10 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d0fe7640 1 -- 172.21.15.50:0/2802365294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4034610 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 -- 172.21.15.50:0/2802365294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0cd9a0 msgr2=0x7fd4cc0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/2802365294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009e50 tx=0x7fd4c402c010 comp rx=0 tx=0).stop 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 -- 172.21.15.50:0/2802365294 shutdown_connections 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/2802365294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0cd9a0 0x7fd4cc0cc060 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 -- 172.21.15.50:0/2802365294 >> 172.21.15.50:0/2802365294 conn(0x7fd4cc06ab80 msgr2=0x7fd4cc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 -- 172.21.15.50:0/2802365294 shutdown_connections 2023-08-10T10:39:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.056+0000 7fd4d2feb640 1 -- 172.21.15.50:0/2802365294 wait complete. 2023-08-10T10:39:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.058+0000 7fd4d2feb640 1 Processor -- start 2023-08-10T10:39:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.058+0000 7fd4d2feb640 1 -- start start 2023-08-10T10:39:02.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4cc0cd9a0 0x7fd4cc1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4cc159830 0x7fd4cc1f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0716e0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc1f3170 con 0x7fd4cc159830 2023-08-10T10:39:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.059+0000 7fd4d2feb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc15b5f0 con 0x7fd4cc0cd9a0 2023-08-10T10:39:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53426/0 (socket says 172.21.15.50:53426) 2023-08-10T10:39:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 -- 172.21.15.50:0/3943223313 learned_addr learned my addr 172.21.15.50:0/3943223313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:02.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 -- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4cc0cd9a0 msgr2=0x7fd4cc1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4cc0cd9a0 0x7fd4cc1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 -- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4cc159830 msgr2=0x7fd4cc1f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4cc159830 0x7fd4cc1f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 -- 172.21.15.50:0/3943223313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4009b30 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.060+0000 7fd4d1fe9640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c450 tx=0x7fd4c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.061+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80052d0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.061+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8005430 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.061+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8012870 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.061+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc15b8d0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.061+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc15be90 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.062+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc066e30 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.063+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4c80129d0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.064+0000 7fd4c27fc640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 0x7fd4b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.064+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4c8088ff0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.064+0000 7fd4d17e8640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 0x7fd4b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.065+0000 7fd4d17e8640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 0x7fd4b006d110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0c1f30 tx=0x7fd4bc0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.068+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd4c80bb330 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.267+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4cc0cd070 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.270+0000 7fd4c27fc640 1 -- 172.21.15.50:0/3943223313 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fd4c80540b0 con 0x7fd4cc0c9d00 2023-08-10T10:39:02.271 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:02.272 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:02.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 msgr2=0x7fd4b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 0x7fd4b006d110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0c1f30 tx=0x7fd4bc0079c0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 msgr2=0x7fd4cc15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c450 tx=0x7fd4c800c910 comp rx=0 tx=0).stop 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 shutdown_connections 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4b006ac50 0x7fd4b006d110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4cc159830 0x7fd4cc1f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4cc0cd9a0 0x7fd4cc1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 --2- 172.21.15.50:0/3943223313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4cc0c9d00 0x7fd4cc15c690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 >> 172.21.15.50:0/3943223313 conn(0x7fd4cc06ab80 msgr2=0x7fd4cc0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 shutdown_connections 2023-08-10T10:39:02.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.273+0000 7fd4d2feb640 1 -- 172.21.15.50:0/3943223313 wait complete. 2023-08-10T10:39:02.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:02.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.527+0000 7fd9a4942640 1 Processor -- start 2023-08-10T10:39:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.527+0000 7fd9a4942640 1 -- start start 2023-08-10T10:39:02.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.528+0000 7fd9a4942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0160f70 0x7fd9a015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.528+0000 7fd9a4942640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9a015dd10 0x7fd9a00aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd9a4942640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a00ad6e0 con 0x7fd9a0161350 2023-08-10T10:39:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd9a4942640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a00cdaf0 con 0x7fd9a015dd10 2023-08-10T10:39:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd9a4942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00acb10 con 0x7fd9a0160f70 2023-08-10T10:39:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9a015dd10 0x7fd9a00aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9a015dd10 0x7fd9a00aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53428/0 (socket says 172.21.15.50:53428) 2023-08-10T10:39:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 -- 172.21.15.50:0/1225035670 learned_addr learned my addr 172.21.15.50:0/1225035670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99f7fe640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0160f70 0x7fd9a015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 -- 172.21.15.50:0/1225035670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0160f70 msgr2=0x7fd9a015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0160f70 0x7fd9a015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 -- 172.21.15.50:0/1225035670 >> v1:172.21.15.117:6789/0 conn(0x7fd9a0161350 legacy=0x7fd9a006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.529+0000 7fd99effd640 1 -- 172.21.15.50:0/1225035670 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00acdb0 con 0x7fd9a015dd10 2023-08-10T10:39:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.531+0000 7fd99effd640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00aff00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd994009870 tx=0x7fd99402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaef07d05a4ecf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.531+0000 7fd99e7fc640 1 -- 172.21.15.50:0/1225035670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994031640 con 0x7fd9a015dd10 2023-08-10T10:39:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.531+0000 7fd99e7fc640 1 -- 172.21.15.50:0/1225035670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9940317a0 con 0x7fd9a015dd10 2023-08-10T10:39:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.531+0000 7fd99e7fc640 1 -- 172.21.15.50:0/1225035670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994031b30 con 0x7fd9a015dd10 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 -- 172.21.15.50:0/1225035670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 msgr2=0x7fd9a00aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00aff00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd994009870 tx=0x7fd99402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 -- 172.21.15.50:0/1225035670 shutdown_connections 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00aff00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 --2- 172.21.15.50:0/1225035670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0160f70 0x7fd9a015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 -- 172.21.15.50:0/1225035670 >> 172.21.15.50:0/1225035670 conn(0x7fd9a0069cd0 msgr2=0x7fd9a00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 -- 172.21.15.50:0/1225035670 shutdown_connections 2023-08-10T10:39:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.532+0000 7fd9a4942640 1 -- 172.21.15.50:0/1225035670 wait complete. 2023-08-10T10:39:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.534+0000 7fd9a4942640 1 Processor -- start 2023-08-10T10:39:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.535+0000 7fd9a4942640 1 -- start start 2023-08-10T10:39:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9a0160f70 0x7fd9a00c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 0x7fd9a006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0156450 con 0x7fd9a015dd10 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00c8420 con 0x7fd9a0160f70 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd9a4942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0070090 con 0x7fd9a0161350 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53430/0 (socket says 172.21.15.50:53430) 2023-08-10T10:39:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.536+0000 7fd99f7fe640 1 -- 172.21.15.50:0/2856820047 learned_addr learned my addr 172.21.15.50:0/2856820047 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99effd640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9a0160f70 0x7fd9a00c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99ffff640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 0x7fd9a006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 -- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 msgr2=0x7fd9a006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 0x7fd9a006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 -- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9a0160f70 msgr2=0x7fd9a00c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9a0160f70 0x7fd9a00c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 -- 172.21.15.50:0/2856820047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940094d0 con 0x7fd9a015dd10 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99ffff640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 0x7fd9a006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd99f7fe640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd99000d800 tx=0x7fd99000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99000b6c0 con 0x7fd9a015dd10 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99000b820 con 0x7fd9a015dd10 2023-08-10T10:39:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99000bbb0 con 0x7fd9a015dd10 2023-08-10T10:39:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.537+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a006fad0 con 0x7fd9a015dd10 2023-08-10T10:39:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.538+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a00c56f0 con 0x7fd9a015dd10 2023-08-10T10:39:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.539+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a00c5530 con 0x7fd9a015dd10 2023-08-10T10:39:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.540+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd99000bd10 con 0x7fd9a015dd10 2023-08-10T10:39:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.540+0000 7fd987fff640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 0x7fd98c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.541+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd990089a60 con 0x7fd9a015dd10 2023-08-10T10:39:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.541+0000 7fd99effd640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 0x7fd98c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.542+0000 7fd99effd640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 0x7fd98c06d110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd994036000 tx=0x7fd99403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.544+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd990054b00 con 0x7fd9a015dd10 2023-08-10T10:39:02.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.738+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9a0066e30 con 0x7fd9a015dd10 2023-08-10T10:39:02.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.739+0000 7fd987fff640 1 -- 172.21.15.50:0/2856820047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd990058120 con 0x7fd9a015dd10 2023-08-10T10:39:02.740 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:02.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.741+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 msgr2=0x7fd98c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.741+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 0x7fd98c06d110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd994036000 tx=0x7fd99403c040 comp rx=0 tx=0).stop 2023-08-10T10:39:02.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.741+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 msgr2=0x7fd9a00c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd99000d800 tx=0x7fd99000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 shutdown_connections 2023-08-10T10:39:02.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9a0161350 0x7fd9a006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd98c06ac50 0x7fd98c06d110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9a0160f70 0x7fd9a00c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 --2- 172.21.15.50:0/2856820047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9a015dd10 0x7fd9a00c7ee0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 >> 172.21.15.50:0/2856820047 conn(0x7fd9a0069cd0 msgr2=0x7fd9a015ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 shutdown_connections 2023-08-10T10:39:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.742+0000 7fd9a4942640 1 -- 172.21.15.50:0/2856820047 wait complete. 2023-08-10T10:39:02.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.990+0000 7fe6118fa640 1 Processor -- start 2023-08-10T10:39:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.990+0000 7fe6118fa640 1 -- start start 2023-08-10T10:39:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe6118fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe60c15ae40 0x7fe60c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe6118fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe6118fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0adcb0 con 0x7fe60c06cb30 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe6118fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c06c320 con 0x7fe60c15ae40 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe6118fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c06b770 con 0x7fe60c0cd9b0 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe60affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe60c15ae40 0x7fe60c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe60affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe60c15ae40 0x7fe60c0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53440/0 (socket says 172.21.15.50:53440) 2023-08-10T10:39:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.992+0000 7fe60affd640 1 -- 172.21.15.50:0/1280667451 learned_addr learned my addr 172.21.15.50:0/1280667451 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.993+0000 7fe60b7fe640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.993+0000 7fe60affd640 1 -- 172.21.15.50:0/1280667451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 msgr2=0x7fe60c0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.993+0000 7fe60affd640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.993+0000 7fe60affd640 1 -- 172.21.15.50:0/1280667451 >> v1:172.21.15.117:6789/0 conn(0x7fe60c06cb30 legacy=0x7fe60c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.993+0000 7fe60affd640 1 -- 172.21.15.50:0/1280667451 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c06b9f0 con 0x7fe60c15ae40 2023-08-10T10:39:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.994+0000 7fe60affd640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0b1510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f6f70c8dd09269 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.994+0000 7fe609ffb640 1 -- 172.21.15.50:0/1280667451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc031640 con 0x7fe60c15ae40 2023-08-10T10:39:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.994+0000 7fe609ffb640 1 -- 172.21.15.50:0/1280667451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc0317a0 con 0x7fe60c15ae40 2023-08-10T10:39:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe609ffb640 1 -- 172.21.15.50:0/1280667451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc031b30 con 0x7fe60c15ae40 2023-08-10T10:39:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 -- 172.21.15.50:0/1280667451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 msgr2=0x7fe60c0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0b1510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 -- 172.21.15.50:0/1280667451 shutdown_connections 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 --2- 172.21.15.50:0/1280667451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0b1510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 -- 172.21.15.50:0/1280667451 >> 172.21.15.50:0/1280667451 conn(0x7fe60c0b01b0 msgr2=0x7fe60c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 -- 172.21.15.50:0/1280667451 shutdown_connections 2023-08-10T10:39:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.995+0000 7fe6118fa640 1 -- 172.21.15.50:0/1280667451 wait complete. 2023-08-10T10:39:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.997+0000 7fe6118fa640 1 Processor -- start 2023-08-10T10:39:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.997+0000 7fe6118fa640 1 -- start start 2023-08-10T10:39:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 0x7fe60c0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c3c50 con 0x7fe60c15ae40 2023-08-10T10:39:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c06ec20 con 0x7fe60c06cb30 2023-08-10T10:39:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.998+0000 7fe6118fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c06fa50 con 0x7fe60c0cd9b0 2023-08-10T10:39:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53452/0 (socket says 172.21.15.50:53452) 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 -- 172.21.15.50:0/2918585801 learned_addr learned my addr 172.21.15.50:0/2918585801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60affd640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 0x7fe60c0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60a7fc640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 -- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 msgr2=0x7fe60c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 -- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 msgr2=0x7fe60c0c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 0x7fe60c0c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 -- 172.21.15.50:0/2918585801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094d0 con 0x7fe60c15ae40 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60affd640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 0x7fe60c0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:02.999+0000 7fe60b7fe640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe604007d40 tx=0x7fe60400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.000+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604014420 con 0x7fe60c15ae40 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.000+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6040145a0 con 0x7fe60c15ae40 2023-08-10T10:39:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.000+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604014950 con 0x7fe60c15ae40 2023-08-10T10:39:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.000+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c06f770 con 0x7fe60c15ae40 2023-08-10T10:39:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.000+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c06f400 con 0x7fe60c15ae40 2023-08-10T10:39:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.001+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c06f100 con 0x7fe60c15ae40 2023-08-10T10:39:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.002+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe604014ab0 con 0x7fe60c15ae40 2023-08-10T10:39:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.003+0000 7fe5f3fff640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 0x7fe5f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.003+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe604089e70 con 0x7fe60c15ae40 2023-08-10T10:39:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.003+0000 7fe60affd640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 0x7fe5f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.004+0000 7fe60affd640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 0x7fe5f806d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc036000 tx=0x7fe5fc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.007+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe604054e80 con 0x7fe60c15ae40 2023-08-10T10:39:03.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.201+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe60c06ea80 con 0x7fe60c15ae40 2023-08-10T10:39:03.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.202+0000 7fe5f3fff640 1 -- 172.21.15.50:0/2918585801 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe60c06ea80 con 0x7fe60c15ae40 2023-08-10T10:39:03.203 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.204+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 msgr2=0x7fe5f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.204+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 0x7fe5f806d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc036000 tx=0x7fe5fc03c040 comp rx=0 tx=0).stop 2023-08-10T10:39:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.204+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 msgr2=0x7fe60c0c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.204+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe604007d40 tx=0x7fe60400e4b0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 shutdown_connections 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe60c15ae40 0x7fe60c0c40e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c0cd9b0 0x7fe60c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5f806ac50 0x7fe5f806d110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 --2- 172.21.15.50:0/2918585801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c06cb30 0x7fe60c0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 >> 172.21.15.50:0/2918585801 conn(0x7fe60c0b01b0 msgr2=0x7fe60c0c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:03.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 shutdown_connections 2023-08-10T10:39:03.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.205+0000 7fe6118fa640 1 -- 172.21.15.50:0/2918585801 wait complete. 2023-08-10T10:39:03.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.458+0000 7fca61f67640 1 Processor -- start 2023-08-10T10:39:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.458+0000 7fca61f67640 1 -- start start 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.460+0000 7fca61f67640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca5c0696a0 0x7fca5c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.460+0000 7fca61f67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 0x7fca5c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.460+0000 7fca61f67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c15aee0 con 0x7fca5c1583c0 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.460+0000 7fca61f67640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c06a070 con 0x7fca5c0696a0 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.460+0000 7fca61f67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c0b2100 con 0x7fca5c15e4d0 2023-08-10T10:39:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca5c0696a0 0x7fca5c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca5c0696a0 0x7fca5c069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53456/0 (socket says 172.21.15.50:53456) 2023-08-10T10:39:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 -- 172.21.15.50:0/903229571 learned_addr learned my addr 172.21.15.50:0/903229571 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca61766640 1 --2- 172.21.15.50:0/903229571 >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 0x7fca5c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 -- 172.21.15.50:0/903229571 >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 msgr2=0x7fca5c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 --2- 172.21.15.50:0/903229571 >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 0x7fca5c15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 -- 172.21.15.50:0/903229571 >> v1:172.21.15.50:6789/0 conn(0x7fca5c1583c0 legacy=0x7fca5c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5b7fe640 1 -- 172.21.15.50:0/903229571 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159609584 0 0) 0x7fca5c15aee0 con 0x7fca5c1583c0 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca5bfff640 1 -- 172.21.15.50:0/903229571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c15b1a0 con 0x7fca5c0696a0 2023-08-10T10:39:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.461+0000 7fca61766640 1 --2- 172.21.15.50:0/903229571 >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 0x7fca5c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.462+0000 7fca5bfff640 1 --2- 172.21.15.50:0/903229571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c069b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0c5550 tx=0x7fca4802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85dacc9fa82bed1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca5b7fe640 1 -- 172.21.15.50:0/903229571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48030880 con 0x7fca5c0696a0 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca5b7fe640 1 -- 172.21.15.50:0/903229571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca480309e0 con 0x7fca5c0696a0 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca5b7fe640 1 -- 172.21.15.50:0/903229571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48030d70 con 0x7fca5c0696a0 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 -- 172.21.15.50:0/903229571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 msgr2=0x7fca5c069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 --2- 172.21.15.50:0/903229571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c069b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0c5550 tx=0x7fca4802b9c0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 -- 172.21.15.50:0/903229571 shutdown_connections 2023-08-10T10:39:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 --2- 172.21.15.50:0/903229571 >> v2:172.21.15.117:3300/0 conn(0x7fca5c15e4d0 0x7fca5c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 --2- 172.21.15.50:0/903229571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c069b30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 -- 172.21.15.50:0/903229571 >> 172.21.15.50:0/903229571 conn(0x7fca5c0caf80 msgr2=0x7fca5c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.463+0000 7fca61f67640 1 -- 172.21.15.50:0/903229571 shutdown_connections 2023-08-10T10:39:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.464+0000 7fca61f67640 1 -- 172.21.15.50:0/903229571 wait complete. 2023-08-10T10:39:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.465+0000 7fca61f67640 1 Processor -- start 2023-08-10T10:39:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.465+0000 7fca61f67640 1 -- start start 2023-08-10T10:39:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 0x7fca5c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 0x7fca5c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0caad0 con 0x7fca5c0696a0 2023-08-10T10:39:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c15cef0 con 0x7fca5c1583c0 2023-08-10T10:39:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.466+0000 7fca61f67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0ca510 con 0x7fca5c15e4d0 2023-08-10T10:39:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53472/0 (socket says 172.21.15.50:53472) 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 -- 172.21.15.50:0/3173776198 learned_addr learned my addr 172.21.15.50:0/3173776198 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca5bfff640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 0x7fca5c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca61766640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 0x7fca5c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 -- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 msgr2=0x7fca5c15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 0x7fca5c15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 -- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 msgr2=0x7fca5c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 0x7fca5c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 -- 172.21.15.50:0/3173776198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480094d0 con 0x7fca5c0696a0 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca5bfff640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 0x7fca5c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca61766640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 0x7fca5c15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.467+0000 7fca60f65640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c4b0 tx=0x7fca5000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.468+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50005480 con 0x7fca5c0696a0 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.468+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca500035f0 con 0x7fca5c0696a0 2023-08-10T10:39:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.468+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500039e0 con 0x7fca5c0696a0 2023-08-10T10:39:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.468+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c0ca7f0 con 0x7fca5c0696a0 2023-08-10T10:39:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.468+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c15c490 con 0x7fca5c0696a0 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.470+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c15c010 con 0x7fca5c0696a0 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.470+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca50003b40 con 0x7fca5c0696a0 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.471+0000 7fca597fa640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 0x7fca4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.471+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca50088ad0 con 0x7fca5c0696a0 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.471+0000 7fca5bfff640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 0x7fca4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.472+0000 7fca5bfff640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 0x7fca4006d110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca48036000 tx=0x7fca4803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.476+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fca5c15c010 con 0x7fca5c0696a0 2023-08-10T10:39:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.665+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca5c15c010 con 0x7fca5c0696a0 2023-08-10T10:39:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.666+0000 7fca597fa640 1 -- 172.21.15.50:0/3173776198 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca5c15c010 con 0x7fca5c0696a0 2023-08-10T10:39:03.667 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 msgr2=0x7fca4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 0x7fca4006d110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca48036000 tx=0x7fca4803b040 comp rx=0 tx=0).stop 2023-08-10T10:39:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 msgr2=0x7fca5c154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c4b0 tx=0x7fca5000c970 comp rx=0 tx=0).stop 2023-08-10T10:39:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 shutdown_connections 2023-08-10T10:39:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca5c15e4d0 0x7fca5c15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca4006ac50 0x7fca4006d110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca5c1583c0 0x7fca5c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 --2- 172.21.15.50:0/3173776198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca5c0696a0 0x7fca5c154740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 >> 172.21.15.50:0/3173776198 conn(0x7fca5c0caf80 msgr2=0x7fca5c0adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.669+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 shutdown_connections 2023-08-10T10:39:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.670+0000 7fca61f67640 1 -- 172.21.15.50:0/3173776198 wait complete. 2023-08-10T10:39:03.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.930+0000 7f160e542640 1 Processor -- start 2023-08-10T10:39:03.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.930+0000 7f160e542640 1 -- start start 2023-08-10T10:39:03.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160e542640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16081612c0 0x7f16080c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160e542640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1608160870 con 0x7f16080c9250 2023-08-10T10:39:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160e542640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16080c9630 con 0x7f160815cbb0 2023-08-10T10:39:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160e542640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16080ca370 con 0x7f16081612c0 2023-08-10T10:39:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160cadf640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16080c9250 0x7f160806f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37370/0 (socket says 172.21.15.50:37370) 2023-08-10T10:39:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.932+0000 7f160cadf640 1 -- 172.21.15.50:0/936767938 learned_addr learned my addr 172.21.15.50:0/936767938 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:03.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f16077fe640 1 --2- 172.21.15.50:0/936767938 >> v2:172.21.15.117:3300/0 conn(0x7f16081612c0 0x7f16080c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259029638 0 0) 0x7f1608160870 con 0x7f16080c9250 2023-08-10T10:39:03.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f0003520 con 0x7f16080c9250 2023-08-10T10:39:03.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926954236 0 0) 0x7f15f0003520 con 0x7f16080c9250 2023-08-10T10:39:03.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 >> v2:172.21.15.117:3300/0 conn(0x7f16081612c0 msgr2=0x7f16080c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 --2- 172.21.15.50:0/936767938 >> v2:172.21.15.117:3300/0 conn(0x7f16081612c0 0x7f16080c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 >> v1:172.21.15.117:6789/0 conn(0x7f160815cbb0 legacy=0x7f16080c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080ca650 con 0x7f16080c9250 2023-08-10T10:39:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f16000019f0 con 0x7f16080c9250 2023-08-10T10:39:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 >> v1:172.21.15.50:6789/0 conn(0x7f16080c9250 legacy=0x7f160806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15f0003970 0x7f15f0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 0x7f15f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.933+0000 7f1606ffd640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f0005180 0x7f15f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080ca370 con 0x7f15f00047c0 2023-08-10T10:39:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f000c080 con 0x7f15f0003970 2023-08-10T10:39:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f000c240 con 0x7f15f0005180 2023-08-10T10:39:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 0x7f15f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f1607fff640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15f0003970 0x7f15f0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f160cadf640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f0005180 0x7f15f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 -- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f0005180 msgr2=0x7f15f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f0005180 0x7f15f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 -- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15f0003970 msgr2=0x7f15f0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15f0003970 0x7f15f0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f16077fe640 1 -- 172.21.15.50:0/936767938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0003520 con 0x7f15f00047c0 2023-08-10T10:39:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f160cadf640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f0005180 0x7f15f000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f1607fff640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15f0003970 0x7f15f0003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.934+0000 7f160cadf640 1 -- 172.21.15.50:0/936767938 reap_dead start 2023-08-10T10:39:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.935+0000 7f16077fe640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 0x7f15f0004c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009ac0 tx=0x7f15f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7474e08c78b28dd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc02c6b0 con 0x7f15f00047c0 2023-08-10T10:39:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc02c810 con 0x7f15f00047c0 2023-08-10T10:39:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f1606ffd640 1 -- 172.21.15.50:0/936767938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc02cba0 con 0x7f15f00047c0 2023-08-10T10:39:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f160e542640 1 -- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 msgr2=0x7f15f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f160e542640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 0x7f15f0004c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009ac0 tx=0x7f15f00057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f160e542640 1 -- 172.21.15.50:0/936767938 shutdown_connections 2023-08-10T10:39:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f160e542640 1 --2- 172.21.15.50:0/936767938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f00047c0 0x7f15f0004c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.936+0000 7f160e542640 1 -- 172.21.15.50:0/936767938 >> 172.21.15.50:0/936767938 conn(0x7f16080b01b0 msgr2=0x7f16080b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.937+0000 7f160e542640 1 -- 172.21.15.50:0/936767938 shutdown_connections 2023-08-10T10:39:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.937+0000 7f160e542640 1 -- 172.21.15.50:0/936767938 wait complete. 2023-08-10T10:39:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.938+0000 7f160e542640 1 Processor -- start 2023-08-10T10:39:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.939+0000 7f160e542640 1 -- start start 2023-08-10T10:39:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.939+0000 7f160e542640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 0x7f160806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160e542640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160e542640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c2730 0x7f16080c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160e542640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16081566b0 con 0x7f160806af50 2023-08-10T10:39:03.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160e542640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160815f780 con 0x7f16080c2730 2023-08-10T10:39:03.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160e542640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160815fc10 con 0x7f15f00047c0 2023-08-10T10:39:03.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53480/0 (socket says 172.21.15.50:53480) 2023-08-10T10:39:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 -- 172.21.15.50:0/1699943165 learned_addr learned my addr 172.21.15.50:0/1699943165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f1607fff640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 0x7f160806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 -- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 msgr2=0x7f160806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f160cadf640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c2730 0x7f16080c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 0x7f160806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 -- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c2730 msgr2=0x7f16080c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:03.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c2730 0x7f16080c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:03.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f16077fe640 1 -- 172.21.15.50:0/1699943165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160815eb70 con 0x7f160806af50 2023-08-10T10:39:03.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.940+0000 7f1607fff640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 0x7f160806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:03.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f16077fe640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009ac0 tx=0x7f15fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc003810 con 0x7f160806af50 2023-08-10T10:39:03.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc003970 con 0x7f160806af50 2023-08-10T10:39:03.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc003d00 con 0x7f160806af50 2023-08-10T10:39:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160815ee50 con 0x7f160806af50 2023-08-10T10:39:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.941+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160815f410 con 0x7f160806af50 2023-08-10T10:39:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.942+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160815f5d0 con 0x7f160806af50 2023-08-10T10:39:03.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.943+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15fc040450 con 0x7f160806af50 2023-08-10T10:39:03.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.944+0000 7f1604ff9640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 0x7f15f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:03.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.944+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15fc0ab510 con 0x7f160806af50 2023-08-10T10:39:03.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.944+0000 7f1607fff640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 0x7f15f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:03.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.945+0000 7f1607fff640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 0x7f15f406d110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16080684d0 tx=0x7f15f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:03.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:03.948+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15fc076520 con 0x7f160806af50 2023-08-10T10:39:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.138+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16080612b0 con 0x7f160806af50 2023-08-10T10:39:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.140+0000 7f1604ff9640 1 -- 172.21.15.50:0/1699943165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15fc003e60 con 0x7f160806af50 2023-08-10T10:39:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 msgr2=0x7f15f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 0x7f15f406d110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16080684d0 tx=0x7f15f8009040 comp rx=0 tx=0).stop 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 msgr2=0x7f16080c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009ac0 tx=0x7f15fc004730 comp rx=0 tx=0).stop 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 shutdown_connections 2023-08-10T10:39:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15f406ac50 0x7f15f406d110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c2730 0x7f16080c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160806af50 0x7f16080c21f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 --2- 172.21.15.50:0/1699943165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15f00047c0 0x7f160806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 >> 172.21.15.50:0/1699943165 conn(0x7f16080b01b0 msgr2=0x7f16080ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.142+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 shutdown_connections 2023-08-10T10:39:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.143+0000 7f160e542640 1 -- 172.21.15.50:0/1699943165 wait complete. 2023-08-10T10:39:04.167 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-08-10T10:39:04.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-08-10T10:39:04.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.397+0000 7f3358d42640 1 Processor -- start 2023-08-10T10:39:04.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.398+0000 7f3358d42640 1 -- start start 2023-08-10T10:39:04.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.399+0000 7f3358d42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33541600f0 0x7f33540ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.399+0000 7f3358d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540b0390 0x7f33540cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.399+0000 7f3358d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33541604d0 con 0x7f33540aff10 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.399+0000 7f3358d42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540cca30 con 0x7f33541600f0 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.399+0000 7f3358d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cc100 con 0x7f33540b0390 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33541600f0 0x7f33540ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33541600f0 0x7f33540ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53484/0 (socket says 172.21.15.50:53484) 2023-08-10T10:39:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f334bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33540aff10 0x7f33540ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37386/0 (socket says 172.21.15.50:37386) 2023-08-10T10:39:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 -- 172.21.15.50:0/392255450 learned_addr learned my addr 172.21.15.50:0/392255450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f3353fff640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540b0390 0x7f33540cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 -- 172.21.15.50:0/392255450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540b0390 msgr2=0x7f33540cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540b0390 0x7f33540cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 -- 172.21.15.50:0/392255450 >> v1:172.21.15.50:6789/0 conn(0x7f33540aff10 legacy=0x7f33540ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f33537fe640 1 -- 172.21.15.50:0/392255450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540cc3e0 con 0x7f33541600f0 2023-08-10T10:39:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.400+0000 7f3352ffd640 1 -- 172.21.15.50:0/392255450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992068473 0 0) 0x7f33541604d0 con 0x7f33540aff10 2023-08-10T10:39:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.402+0000 7f33537fe640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33541600f0 0x7f33540ac890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f334402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2ac7797471321d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.402+0000 7f3352ffd640 1 -- 172.21.15.50:0/392255450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344031640 con 0x7f33541600f0 2023-08-10T10:39:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3352ffd640 1 -- 172.21.15.50:0/392255450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33440317a0 con 0x7f33541600f0 2023-08-10T10:39:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3352ffd640 1 -- 172.21.15.50:0/392255450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344031b30 con 0x7f33541600f0 2023-08-10T10:39:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 -- 172.21.15.50:0/392255450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33541600f0 msgr2=0x7f33540ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33541600f0 0x7f33540ac890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f334402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 -- 172.21.15.50:0/392255450 shutdown_connections 2023-08-10T10:39:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540b0390 0x7f33540cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 --2- 172.21.15.50:0/392255450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33541600f0 0x7f33540ac890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 -- 172.21.15.50:0/392255450 >> 172.21.15.50:0/392255450 conn(0x7f335406ab80 msgr2=0x7f335406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 -- 172.21.15.50:0/392255450 shutdown_connections 2023-08-10T10:39:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.403+0000 7f3358d42640 1 -- 172.21.15.50:0/392255450 wait complete. 2023-08-10T10:39:04.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.405+0000 7f3358d42640 1 Processor -- start 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.405+0000 7f3358d42640 1 -- start start 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540aff10 0x7f33540b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33541600f0 0x7f33540b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b34d0 con 0x7f33540b0390 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b1230 con 0x7f33541600f0 2023-08-10T10:39:04.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.406+0000 7f3358d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b1510 con 0x7f33540aff10 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53486/0 (socket says 172.21.15.50:53486) 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 -- 172.21.15.50:0/557838618 learned_addr learned my addr 172.21.15.50:0/557838618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f33537fe640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540aff10 0x7f33540b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f3353fff640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33541600f0 0x7f33540b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 -- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540aff10 msgr2=0x7f33540b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540aff10 0x7f33540b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 -- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33541600f0 msgr2=0x7f33540b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33541600f0 0x7f33540b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 -- 172.21.15.50:0/557838618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094d0 con 0x7f33540b0390 2023-08-10T10:39:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.407+0000 7f334bfff640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c430 tx=0x7f333c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.408+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0074e0 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.408+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c007660 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.408+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c004a20 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.408+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540b17f0 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.408+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354155400 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.409+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540b1d10 con 0x7f33540b0390 2023-08-10T10:39:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.410+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f333c004b80 con 0x7f33540b0390 2023-08-10T10:39:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.411+0000 7f3350ff9640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 0x7f333406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.411+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f333c0892d0 con 0x7f33540b0390 2023-08-10T10:39:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.411+0000 7f33537fe640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 0x7f333406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.412+0000 7f33537fe640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 0x7f333406d110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3344036000 tx=0x7f334403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.415+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33540b1d10 con 0x7f33540b0390 2023-08-10T10:39:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:04.684+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f33540b1d10 con 0x7f33540b0390 2023-08-10T10:39:05.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.440+0000 7f3350ff9640 1 -- 172.21.15.50:0/557838618 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v59) v1 ==== 133+0+0 (secure 0 0 0) 0x7f33540b1d10 con 0x7f33540b0390 2023-08-10T10:39:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 msgr2=0x7f333406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 0x7f333406d110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3344036000 tx=0x7f334403c040 comp rx=0 tx=0).stop 2023-08-10T10:39:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 msgr2=0x7f3354154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c430 tx=0x7f333c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 shutdown_connections 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f333406ac50 0x7f333406d110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33541600f0 0x7f33540b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33540b0390 0x7f3354154ec0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 --2- 172.21.15.50:0/557838618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33540aff10 0x7f33540b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 >> 172.21.15.50:0/557838618 conn(0x7f335406ab80 msgr2=0x7f33540af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 shutdown_connections 2023-08-10T10:39:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.444+0000 7f3358d42640 1 -- 172.21.15.50:0/557838618 wait complete. 2023-08-10T10:39:05.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-10T10:39:05.724 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_objectstore":"memstore"} 2023-08-10T10:39:05.725 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-10T10:39:05.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.956+0000 7ff756c6a640 1 Processor -- start 2023-08-10T10:39:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.956+0000 7ff756c6a640 1 -- start start 2023-08-10T10:39:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.957+0000 7ff756c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.957+0000 7ff756c6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7500b3f30 0x7ff7500c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.957+0000 7ff756c6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff750071c70 con 0x7ff75015aa40 2023-08-10T10:39:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.957+0000 7ff756c6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500713d0 con 0x7ff7500b3f30 2023-08-10T10:39:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.957+0000 7ff756c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500716b0 con 0x7ff7500b0c60 2023-08-10T10:39:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.958+0000 7ff74ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.958+0000 7ff74ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:36132/0 (socket says 172.21.15.50:36132) 2023-08-10T10:39:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.958+0000 7ff74ffff640 1 -- 172.21.15.50:0/1673485115 learned_addr learned my addr 172.21.15.50:0/1673485115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.958+0000 7ff755207640 1 --2- 172.21.15.50:0/1673485115 >> v2:172.21.15.117:3300/0 conn(0x7ff7500b3f30 0x7ff7500c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.958+0000 7ff754a06640 1 --1- 172.21.15.50:0/1673485115 >> v1:172.21.15.117:6789/0 conn(0x7ff75015aa40 0x7ff7500b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:56470/0 (socket says 172.21.15.50:56470) 2023-08-10T10:39:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.959+0000 7ff755207640 1 -- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 msgr2=0x7ff7500c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.959+0000 7ff755207640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.959+0000 7ff755207640 1 -- 172.21.15.50:0/1673485115 >> v1:172.21.15.117:6789/0 conn(0x7ff75015aa40 legacy=0x7ff7500b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.959+0000 7ff755207640 1 -- 172.21.15.50:0/1673485115 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750071990 con 0x7ff7500b3f30 2023-08-10T10:39:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.959+0000 7ff74ffff640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:39:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.960+0000 7ff755207640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b3f30 0x7ff7500c9e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff74802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c826897d138212ed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.961+0000 7ff74f7fe640 1 -- 172.21.15.50:0/1673485115 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74802cbc0 con 0x7ff7500b3f30 2023-08-10T10:39:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.961+0000 7ff74f7fe640 1 -- 172.21.15.50:0/1673485115 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74802cd20 con 0x7ff7500b3f30 2023-08-10T10:39:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.961+0000 7ff74f7fe640 1 -- 172.21.15.50:0/1673485115 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748034660 con 0x7ff7500b3f30 2023-08-10T10:39:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 -- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b3f30 msgr2=0x7ff7500c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b3f30 0x7ff7500c9e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff74802be10 comp rx=0 tx=0).stop 2023-08-10T10:39:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 -- 172.21.15.50:0/1673485115 shutdown_connections 2023-08-10T10:39:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b3f30 0x7ff7500c9e60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 --2- 172.21.15.50:0/1673485115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b0c60 0x7ff7500c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 -- 172.21.15.50:0/1673485115 >> 172.21.15.50:0/1673485115 conn(0x7ff75006b590 msgr2=0x7ff7500ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 -- 172.21.15.50:0/1673485115 shutdown_connections 2023-08-10T10:39:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.962+0000 7ff756c6a640 1 -- 172.21.15.50:0/1673485115 wait complete. 2023-08-10T10:39:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.964+0000 7ff756c6a640 1 Processor -- start 2023-08-10T10:39:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.965+0000 7ff756c6a640 1 -- start start 2023-08-10T10:39:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b0c60 0x7ff7501f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b3f30 0x7ff7501531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501558d0 con 0x7ff75015aa40 2023-08-10T10:39:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501fad30 con 0x7ff7500b0c60 2023-08-10T10:39:05.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff756c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501fb010 con 0x7ff7500b3f30 2023-08-10T10:39:05.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.966+0000 7ff755207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49216/0 (socket says 172.21.15.50:49216) 2023-08-10T10:39:05.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 -- 172.21.15.50:0/421999206 learned_addr learned my addr 172.21.15.50:0/421999206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:05.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff754a06640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b0c60 0x7ff7501f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff74ffff640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b3f30 0x7ff7501531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 -- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b3f30 msgr2=0x7ff7501531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b3f30 0x7ff7501531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 -- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b0c60 msgr2=0x7ff7501f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b0c60 0x7ff7501f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 -- 172.21.15.50:0/421999206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400094d0 con 0x7ff75015aa40 2023-08-10T10:39:05.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.967+0000 7ff755207640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff748009eb0 tx=0x7ff748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.968+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74803e610 con 0x7ff75015aa40 2023-08-10T10:39:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.968+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74802ce90 con 0x7ff75015aa40 2023-08-10T10:39:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.968+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74803e9b0 con 0x7ff75015aa40 2023-08-10T10:39:05.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.968+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff748009a70 con 0x7ff75015aa40 2023-08-10T10:39:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.968+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7501f7290 con 0x7ff75015aa40 2023-08-10T10:39:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.969+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75004e270 con 0x7ff75015aa40 2023-08-10T10:39:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.970+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff74803b050 con 0x7ff75015aa40 2023-08-10T10:39:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.971+0000 7ff74d7fa640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 0x7ff73c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.972+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7480abcc0 con 0x7ff75015aa40 2023-08-10T10:39:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.972+0000 7ff754a06640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 0x7ff73c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.973+0000 7ff754a06640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 0x7ff73c06d110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff744000f60 tx=0x7ff744007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:05.976+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7480b2080 con 0x7ff75015aa40 2023-08-10T10:39:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.169+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7501586f0 con 0x7ff75015aa40 2023-08-10T10:39:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.171+0000 7ff74d7fa640 1 -- 172.21.15.50:0/421999206 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7ff748076cd0 con 0x7ff75015aa40 2023-08-10T10:39:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:06.173 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:38:23.187392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 msgr2=0x7ff73c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 0x7ff73c06d110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff744000f60 tx=0x7ff744007ce0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 msgr2=0x7ff7501fa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff748009eb0 tx=0x7ff748004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 shutdown_connections 2023-08-10T10:39:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75015aa40 0x7ff7501fa290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7500b3f30 0x7ff7501531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff73c06ac50 0x7ff73c06d110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 --2- 172.21.15.50:0/421999206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500b0c60 0x7ff7501f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 >> 172.21.15.50:0/421999206 conn(0x7ff75006b590 msgr2=0x7ff7500cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.174+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 shutdown_connections 2023-08-10T10:39:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.175+0000 7ff756c6a640 1 -- 172.21.15.50:0/421999206 wait complete. 2023-08-10T10:39:06.195 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:06.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.431+0000 7fa3ad979640 1 Processor -- start 2023-08-10T10:39:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.431+0000 7fa3ad979640 1 -- start start 2023-08-10T10:39:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.432+0000 7fa3ad979640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3a815cb90 0x7fa3a80b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.432+0000 7fa3ad979640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a815cf70 0x7fa3a8160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.432+0000 7fa3ad979640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8160a40 con 0x7fa3a80b4640 2023-08-10T10:39:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.432+0000 7fa3ad979640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80b4bb0 con 0x7fa3a815cf70 2023-08-10T10:39:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.432+0000 7fa3ad979640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80b4e90 con 0x7fa3a815cb90 2023-08-10T10:39:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a815cf70 0x7fa3a8160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a815cf70 0x7fa3a8160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49232/0 (socket says 172.21.15.50:49232) 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 -- 172.21.15.50:0/185816374 learned_addr learned my addr 172.21.15.50:0/185816374 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a6ffd640 1 --2- 172.21.15.50:0/185816374 >> v2:172.21.15.117:3300/0 conn(0x7fa3a815cb90 0x7fa3a80b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 -- 172.21.15.50:0/185816374 >> v2:172.21.15.117:3300/0 conn(0x7fa3a815cb90 msgr2=0x7fa3a80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 --2- 172.21.15.50:0/185816374 >> v2:172.21.15.117:3300/0 conn(0x7fa3a815cb90 0x7fa3a80b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 -- 172.21.15.50:0/185816374 >> v1:172.21.15.117:6789/0 conn(0x7fa3a80b4640 legacy=0x7fa3a806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.433+0000 7fa3a67fc640 1 -- 172.21.15.50:0/185816374 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80b5170 con 0x7fa3a815cf70 2023-08-10T10:39:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.435+0000 7fa3a67fc640 1 --2- 172.21.15.50:0/185816374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cf70 0x7fa3a8160ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80d02c0 tx=0x7fa39c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b8bb3d853a02f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3a5ffb640 1 -- 172.21.15.50:0/185816374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c031870 con 0x7fa3a815cf70 2023-08-10T10:39:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3a5ffb640 1 -- 172.21.15.50:0/185816374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0319d0 con 0x7fa3a815cf70 2023-08-10T10:39:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3a5ffb640 1 -- 172.21.15.50:0/185816374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c031d60 con 0x7fa3a815cf70 2023-08-10T10:39:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 -- 172.21.15.50:0/185816374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cf70 msgr2=0x7fa3a8160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 --2- 172.21.15.50:0/185816374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cf70 0x7fa3a8160ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80d02c0 tx=0x7fa39c02b910 comp rx=0 tx=0).stop 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 -- 172.21.15.50:0/185816374 shutdown_connections 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 --2- 172.21.15.50:0/185816374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cf70 0x7fa3a8160ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 --2- 172.21.15.50:0/185816374 >> v2:172.21.15.117:3300/0 conn(0x7fa3a815cb90 0x7fa3a80b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 -- 172.21.15.50:0/185816374 >> 172.21.15.50:0/185816374 conn(0x7fa3a80cf640 msgr2=0x7fa3a80cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.436+0000 7fa3ad979640 1 -- 172.21.15.50:0/185816374 shutdown_connections 2023-08-10T10:39:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.437+0000 7fa3ad979640 1 -- 172.21.15.50:0/185816374 wait complete. 2023-08-10T10:39:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.439+0000 7fa3ad979640 1 Processor -- start 2023-08-10T10:39:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.439+0000 7fa3ad979640 1 -- start start 2023-08-10T10:39:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3a80b4640 0x7fa3a80c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a815cf70 0x7fa3a80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81f2730 con 0x7fa3a815cb90 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81f2910 con 0x7fa3a815cf70 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3ad979640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81f2bf0 con 0x7fa3a80b4640 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3a67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3a67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49236/0 (socket says 172.21.15.50:49236) 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.440+0000 7fa3a67fc640 1 -- 172.21.15.50:0/1139779649 learned_addr learned my addr 172.21.15.50:0/1139779649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a77fe640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a815cf70 0x7fa3a80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 -- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3a80b4640 msgr2=0x7fa3a80c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3a80b4640 0x7fa3a80c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 -- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a815cf70 msgr2=0x7fa3a80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a815cf70 0x7fa3a80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 -- 172.21.15.50:0/1139779649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0094d0 con 0x7fa3a815cb90 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3a67fc640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa39c02b950 tx=0x7fa39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c031820 con 0x7fa3a815cb90 2023-08-10T10:39:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0443f0 con 0x7fa3a815cb90 2023-08-10T10:39:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0447a0 con 0x7fa3a815cb90 2023-08-10T10:39:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.441+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a81f2ed0 con 0x7fa3a815cb90 2023-08-10T10:39:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.442+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a81f3490 con 0x7fa3a815cb90 2023-08-10T10:39:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.443+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a81f2d30 con 0x7fa3a815cb90 2023-08-10T10:39:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.445+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa39c04d450 con 0x7fa3a815cb90 2023-08-10T10:39:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.446+0000 7fa38ffff640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 0x7fa39406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.447+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa39c02d040 con 0x7fa3a815cb90 2023-08-10T10:39:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.448+0000 7fa3a6ffd640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 0x7fa39406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.449+0000 7fa3a6ffd640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 0x7fa39406d110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa398007e60 tx=0x7fa398007390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.454+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3a81f2d30 con 0x7fa3a815cb90 2023-08-10T10:39:06.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.644+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3a81f2d30 con 0x7fa3a815cb90 2023-08-10T10:39:06.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.645+0000 7fa38ffff640 1 -- 172.21.15.50:0/1139779649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3a81f2d30 con 0x7fa3a815cb90 2023-08-10T10:39:06.645 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:06.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 msgr2=0x7fa39406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 0x7fa39406d110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa398007e60 tx=0x7fa398007390 comp rx=0 tx=0).stop 2023-08-10T10:39:06.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 msgr2=0x7fa3a80c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa39c02b950 tx=0x7fa39c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 shutdown_connections 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa39406ac50 0x7fa39406d110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.647+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a815cf70 0x7fa3a80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.648+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a815cb90 0x7fa3a80c69c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.648+0000 7fa3ad979640 1 --2- 172.21.15.50:0/1139779649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3a80b4640 0x7fa3a80c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.648+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 >> 172.21.15.50:0/1139779649 conn(0x7fa3a80cf640 msgr2=0x7fa3a80cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:06.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.648+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 shutdown_connections 2023-08-10T10:39:06.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.648+0000 7fa3ad979640 1 -- 172.21.15.50:0/1139779649 wait complete. 2023-08-10T10:39:06.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.893+0000 7fa529656640 1 Processor -- start 2023-08-10T10:39:06.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.893+0000 7fa529656640 1 -- start start 2023-08-10T10:39:06.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa529656640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa52406cb30 0x7fa5240b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa529656640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52406c320 con 0x7fa5240cd9b0 2023-08-10T10:39:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa529656640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52406b770 con 0x7fa52415ae40 2023-08-10T10:39:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa529656640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52406b9f0 con 0x7fa52406cb30 2023-08-10T10:39:06.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa5227fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5240cd9b0 0x7fa5240c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43994/0 (socket says 172.21.15.50:43994) 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.895+0000 7fa5227fc640 1 -- 172.21.15.50:0/1617844938 learned_addr learned my addr 172.21.15.50:0/1617844938 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa5237fe640 1 --2- 172.21.15.50:0/1617844938 >> v2:172.21.15.117:3300/0 conn(0x7fa52406cb30 0x7fa5240b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056014635 0 0) 0x7fa52406c320 con 0x7fa5240cd9b0 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003520 con 0x7fa5240cd9b0 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2388172631 0 0) 0x7fa50c003520 con 0x7fa5240cd9b0 2023-08-10T10:39:06.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 >> v2:172.21.15.117:3300/0 conn(0x7fa52406cb30 msgr2=0x7fa5240b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 --2- 172.21.15.50:0/1617844938 >> v2:172.21.15.117:3300/0 conn(0x7fa52406cb30 0x7fa5240b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 >> v1:172.21.15.117:6789/0 conn(0x7fa52415ae40 legacy=0x7fa5240cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52406bcd0 con 0x7fa5240cd9b0 2023-08-10T10:39:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa518001670 con 0x7fa5240cd9b0 2023-08-10T10:39:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 >> v1:172.21.15.50:6789/0 conn(0x7fa5240cd9b0 legacy=0x7fa5240c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52406b9f0 con 0x7fa50c0047c0 2023-08-10T10:39:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.896+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c020 con 0x7fa50c003970 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c1e0 con 0x7fa50c005180 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa522ffd640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 -- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa50c005180 msgr2=0x7fa50c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5237fe640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 -- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c003970 msgr2=0x7fa50c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5227fc640 1 -- 172.21.15.50:0/1617844938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c003520 con 0x7fa50c0047c0 2023-08-10T10:39:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.897+0000 7fa5237fe640 1 -- 172.21.15.50:0/1617844938 reap_dead start 2023-08-10T10:39:06.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.899+0000 7fa5227fc640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c240 tx=0x7fa50c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56b577b9eef790 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.899+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518005ad0 con 0x7fa50c0047c0 2023-08-10T10:39:06.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.899+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518005c50 con 0x7fa50c0047c0 2023-08-10T10:39:06.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.899+0000 7fa521ffb640 1 -- 172.21.15.50:0/1617844938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51802c7c0 con 0x7fa50c0047c0 2023-08-10T10:39:06.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 -- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 msgr2=0x7fa50c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c240 tx=0x7fa50c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 -- 172.21.15.50:0/1617844938 shutdown_connections 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 --2- 172.21.15.50:0/1617844938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 -- 172.21.15.50:0/1617844938 >> 172.21.15.50:0/1617844938 conn(0x7fa5240b01b0 msgr2=0x7fa5240b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 -- 172.21.15.50:0/1617844938 shutdown_connections 2023-08-10T10:39:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.900+0000 7fa529656640 1 -- 172.21.15.50:0/1617844938 wait complete. 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.902+0000 7fa529656640 1 Processor -- start 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.903+0000 7fa529656640 1 -- start start 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c0047c0 0x7fa5241f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa52414b0b0 0x7fa5241f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241e5360 con 0x7fa52415dfd0 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241483a0 con 0x7fa50c0047c0 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa529656640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52415cf30 con 0x7fa52414b0b0 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49248/0 (socket says 172.21.15.50:49248) 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 -- 172.21.15.50:0/703161334 learned_addr learned my addr 172.21.15.50:0/703161334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 -- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa52414b0b0 msgr2=0x7fa5241f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa52414b0b0 0x7fa5241f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 -- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c0047c0 msgr2=0x7fa5241f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c0047c0 0x7fa5241f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.904+0000 7fa5227fc640 1 -- 172.21.15.50:0/703161334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52415d210 con 0x7fa52415dfd0 2023-08-10T10:39:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa5227fc640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa518001930 tx=0x7fa51802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51803c040 con 0x7fa52415dfd0 2023-08-10T10:39:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51802cc90 con 0x7fa52415dfd0 2023-08-10T10:39:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518007070 con 0x7fa52415dfd0 2023-08-10T10:39:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52415d4f0 con 0x7fa52415dfd0 2023-08-10T10:39:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.905+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52415dab0 con 0x7fa52415dfd0 2023-08-10T10:39:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.906+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52415dc40 con 0x7fa52415dfd0 2023-08-10T10:39:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.907+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa518032070 con 0x7fa52415dfd0 2023-08-10T10:39:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.908+0000 7fa50b7fe640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 0x7fa51006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.909+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa5180aa970 con 0x7fa52415dfd0 2023-08-10T10:39:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.909+0000 7fa522ffd640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 0x7fa51006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.909+0000 7fa522ffd640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 0x7fa51006d110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa514007fd0 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:06.912+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa518075940 con 0x7fa52415dfd0 2023-08-10T10:39:07.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.093+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5240612b0 con 0x7fa52415dfd0 2023-08-10T10:39:07.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.094+0000 7fa50b7fe640 1 -- 172.21.15.50:0/703161334 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa518078f60 con 0x7fa52415dfd0 2023-08-10T10:39:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:07.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 msgr2=0x7fa51006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 0x7fa51006d110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa514007fd0 tx=0x7fa514009040 comp rx=0 tx=0).stop 2023-08-10T10:39:07.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 msgr2=0x7fa5241e4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa518001930 tx=0x7fa51802e070 comp rx=0 tx=0).stop 2023-08-10T10:39:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 shutdown_connections 2023-08-10T10:39:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa52414b0b0 0x7fa5241f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.096+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa52415dfd0 0x7fa5241e4e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.097+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa51006ac50 0x7fa51006d110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.097+0000 7fa529656640 1 --2- 172.21.15.50:0/703161334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50c0047c0 0x7fa5241f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.097+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 >> 172.21.15.50:0/703161334 conn(0x7fa5240b01b0 msgr2=0x7fa5240ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.097+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 shutdown_connections 2023-08-10T10:39:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.097+0000 7fa529656640 1 -- 172.21.15.50:0/703161334 wait complete. 2023-08-10T10:39:07.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.338+0000 7f5ab8ec9640 1 Processor -- start 2023-08-10T10:39:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.338+0000 7f5ab8ec9640 1 -- start start 2023-08-10T10:39:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.339+0000 7f5ab8ec9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ab40696a0 0x7f5ab4069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab8ec9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ab415e4d0 0x7f5ab415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab8ec9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab415aee0 con 0x7f5ab41583c0 2023-08-10T10:39:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab8ec9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab406a070 con 0x7f5ab415e4d0 2023-08-10T10:39:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab8ec9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40b2100 con 0x7f5ab40696a0 2023-08-10T10:39:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5ab41583c0 0x7f5ab40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44004/0 (socket says 172.21.15.50:44004) 2023-08-10T10:39:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab37fe640 1 -- 172.21.15.50:0/2199359486 learned_addr learned my addr 172.21.15.50:0/2199359486 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab3fff640 1 --2- 172.21.15.50:0/2199359486 >> v2:172.21.15.50:3300/0 conn(0x7f5ab415e4d0 0x7f5ab415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5aabfff640 1 --2- 172.21.15.50:0/2199359486 >> v2:172.21.15.117:3300/0 conn(0x7f5ab40696a0 0x7f5ab4069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab2ffd640 1 -- 172.21.15.50:0/2199359486 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028955418 0 0) 0x7f5ab415aee0 con 0x7f5ab41583c0 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.340+0000 7f5ab2ffd640 1 -- 172.21.15.50:0/2199359486 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa0003520 con 0x7f5ab41583c0 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.341+0000 7f5ab3fff640 1 -- 172.21.15.50:0/2199359486 >> v2:172.21.15.117:3300/0 conn(0x7f5ab40696a0 msgr2=0x7f5ab4069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.341+0000 7f5ab3fff640 1 --2- 172.21.15.50:0/2199359486 >> v2:172.21.15.117:3300/0 conn(0x7f5ab40696a0 0x7f5ab4069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.341+0000 7f5ab3fff640 1 -- 172.21.15.50:0/2199359486 >> v1:172.21.15.50:6789/0 conn(0x7f5ab41583c0 legacy=0x7f5ab40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.341+0000 7f5ab3fff640 1 -- 172.21.15.50:0/2199359486 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab415b1a0 con 0x7f5ab415e4d0 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.342+0000 7f5ab3fff640 1 --2- 172.21.15.50:0/2199359486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab415e4d0 0x7f5ab415e8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40b1400 tx=0x7f5aac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6708c73146795918 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.342+0000 7f5ab2ffd640 1 -- 172.21.15.50:0/2199359486 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac02cc80 con 0x7f5ab415e4d0 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.342+0000 7f5ab2ffd640 1 -- 172.21.15.50:0/2199359486 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac02cde0 con 0x7f5ab415e4d0 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.342+0000 7f5ab2ffd640 1 -- 172.21.15.50:0/2199359486 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac034640 con 0x7f5ab415e4d0 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/2199359486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab415e4d0 msgr2=0x7f5ab415e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/2199359486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab415e4d0 0x7f5ab415e8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40b1400 tx=0x7f5aac02bed0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/2199359486 shutdown_connections 2023-08-10T10:39:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/2199359486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab415e4d0 0x7f5ab415e8d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/2199359486 >> v2:172.21.15.117:3300/0 conn(0x7f5ab40696a0 0x7f5ab4069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/2199359486 >> 172.21.15.50:0/2199359486 conn(0x7f5ab40caf80 msgr2=0x7f5ab40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:07.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/2199359486 shutdown_connections 2023-08-10T10:39:07.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.343+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/2199359486 wait complete. 2023-08-10T10:39:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.345+0000 7f5ab8ec9640 1 Processor -- start 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.345+0000 7f5ab8ec9640 1 -- start start 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab40696a0 0x7f5ab4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab415e4d0 0x7f5ab406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4159110 con 0x7f5ab41583c0 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab415a3e0 con 0x7f5ab415e4d0 2023-08-10T10:39:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.346+0000 7f5ab8ec9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab415a6c0 con 0x7f5ab40696a0 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49264/0 (socket says 172.21.15.50:49264) 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 -- 172.21.15.50:0/1519672910 learned_addr learned my addr 172.21.15.50:0/1519672910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5ab37fe640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab40696a0 0x7f5ab4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 -- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab40696a0 msgr2=0x7f5ab4159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab40696a0 0x7f5ab4159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 -- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab415e4d0 msgr2=0x7f5ab406ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab415e4d0 0x7f5ab406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 -- 172.21.15.50:0/1519672910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac009a70 con 0x7f5ab41583c0 2023-08-10T10:39:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.347+0000 7f5aabfff640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00e9b0 tx=0x7f5a9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.348+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c009670 con 0x7f5ab41583c0 2023-08-10T10:39:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.348+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00c9a0 con 0x7f5ab41583c0 2023-08-10T10:39:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.348+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab415a9a0 con 0x7f5ab41583c0 2023-08-10T10:39:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.348+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00cd50 con 0x7f5ab41583c0 2023-08-10T10:39:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.348+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40c8e10 con 0x7f5ab41583c0 2023-08-10T10:39:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.349+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab40c8fd0 con 0x7f5ab41583c0 2023-08-10T10:39:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.350+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a9c013470 con 0x7f5ab41583c0 2023-08-10T10:39:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.351+0000 7f5ab0ff9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 0x7f5a9406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.351+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a9c089760 con 0x7f5ab41583c0 2023-08-10T10:39:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.351+0000 7f5ab37fe640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 0x7f5a9406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.352+0000 7f5ab37fe640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 0x7f5a9406d140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40011e0 tx=0x7f5aa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.355+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5a9c054730 con 0x7f5ab41583c0 2023-08-10T10:39:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.555+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ab40cad80 con 0x7f5ab41583c0 2023-08-10T10:39:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.556+0000 7f5ab0ff9640 1 -- 172.21.15.50:0/1519672910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a9c057d50 con 0x7f5ab41583c0 2023-08-10T10:39:07.557 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 msgr2=0x7f5a9406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 0x7f5a9406d140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40011e0 tx=0x7f5aa4009040 comp rx=0 tx=0).stop 2023-08-10T10:39:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 msgr2=0x7f5ab4158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00e9b0 tx=0x7f5a9c00ee70 comp rx=0 tx=0).stop 2023-08-10T10:39:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 shutdown_connections 2023-08-10T10:39:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9406ac80 0x7f5a9406d140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab415e4d0 0x7f5ab406ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab41583c0 0x7f5ab4158bd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 --2- 172.21.15.50:0/1519672910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab40696a0 0x7f5ab4159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 >> 172.21.15.50:0/1519672910 conn(0x7f5ab40caf80 msgr2=0x7f5ab4156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.559+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 shutdown_connections 2023-08-10T10:39:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.560+0000 7f5ab8ec9640 1 -- 172.21.15.50:0/1519672910 wait complete. 2023-08-10T10:39:07.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.804+0000 7f9d58cc2640 1 Processor -- start 2023-08-10T10:39:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.804+0000 7f9d58cc2640 1 -- start start 2023-08-10T10:39:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d541583c0 0x7f9d540b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 0x7f9d540696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d54069be0 0x7f9d5406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5406a050 con 0x7f9d54069be0 2023-08-10T10:39:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5415aee0 con 0x7f9d540b1ba0 2023-08-10T10:39:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d58cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540b2100 con 0x7f9d541583c0 2023-08-10T10:39:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.806+0000 7f9d53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d54069be0 0x7f9d5406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d54069be0 0x7f9d5406ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49266/0 (socket says 172.21.15.50:49266) 2023-08-10T10:39:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 -- 172.21.15.50:0/2871139989 learned_addr learned my addr 172.21.15.50:0/2871139989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d537fe640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d541583c0 0x7f9d540b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d52ffd640 1 --2- 172.21.15.50:0/2871139989 >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 0x7f9d540696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 -- 172.21.15.50:0/2871139989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d541583c0 msgr2=0x7f9d540b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d541583c0 0x7f9d540b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 -- 172.21.15.50:0/2871139989 >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 msgr2=0x7f9d540696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 --2- 172.21.15.50:0/2871139989 >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 0x7f9d540696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d53fff640 1 -- 172.21.15.50:0/2871139989 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5415b1a0 con 0x7f9d54069be0 2023-08-10T10:39:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.807+0000 7f9d52ffd640 1 --2- 172.21.15.50:0/2871139989 >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 0x7f9d540696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:07.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.809+0000 7f9d53fff640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54069be0 0x7f9d5406ab80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d540b0f90 tx=0x7f9d4c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee6f6feff2a40d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.809+0000 7f9d527fc640 1 -- 172.21.15.50:0/2871139989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c02ca80 con 0x7f9d54069be0 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.809+0000 7f9d527fc640 1 -- 172.21.15.50:0/2871139989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c02cbe0 con 0x7f9d54069be0 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.809+0000 7f9d527fc640 1 -- 172.21.15.50:0/2871139989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0343f0 con 0x7f9d54069be0 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 -- 172.21.15.50:0/2871139989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54069be0 msgr2=0x7f9d5406ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54069be0 0x7f9d5406ab80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d540b0f90 tx=0x7f9d4c02bee0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 -- 172.21.15.50:0/2871139989 shutdown_connections 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54069be0 0x7f9d5406ab80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/2871139989 >> v2:172.21.15.117:3300/0 conn(0x7f9d540b1ba0 0x7f9d540696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/2871139989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d541583c0 0x7f9d540b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 -- 172.21.15.50:0/2871139989 >> 172.21.15.50:0/2871139989 conn(0x7f9d540caf80 msgr2=0x7f9d540cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 -- 172.21.15.50:0/2871139989 shutdown_connections 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.810+0000 7f9d58cc2640 1 -- 172.21.15.50:0/2871139989 wait complete. 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.812+0000 7f9d58cc2640 1 Processor -- start 2023-08-10T10:39:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.812+0000 7f9d58cc2640 1 -- start start 2023-08-10T10:39:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 0x7f9d541e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 0x7f9d540c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c3c90 con 0x7f9d540b1ba0 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c36e0 con 0x7f9d541583c0 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d58cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c39b0 con 0x7f9d54069be0 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d52ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d52ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49270/0 (socket says 172.21.15.50:49270) 2023-08-10T10:39:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.813+0000 7f9d52ffd640 1 -- 172.21.15.50:0/404957841 learned_addr learned my addr 172.21.15.50:0/404957841 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d53fff640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 0x7f9d540c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d537fe640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 0x7f9d541e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 -- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 msgr2=0x7f9d541e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 0x7f9d541e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 -- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 msgr2=0x7f9d540c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 0x7f9d540c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 -- 172.21.15.50:0/404957841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c009b30 con 0x7f9d540b1ba0 2023-08-10T10:39:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d53fff640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 0x7f9d540c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d537fe640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 0x7f9d541e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d52ffd640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800e810 tx=0x7f9d4800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.814+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48004030 con 0x7f9d540b1ba0 2023-08-10T10:39:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.815+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48004190 con 0x7f9d540b1ba0 2023-08-10T10:39:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.815+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d541e4420 con 0x7f9d540b1ba0 2023-08-10T10:39:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.815+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48004520 con 0x7f9d540b1ba0 2023-08-10T10:39:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.815+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541e49e0 con 0x7f9d540b1ba0 2023-08-10T10:39:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.816+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54066e30 con 0x7f9d540b1ba0 2023-08-10T10:39:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.817+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d4800c6d0 con 0x7f9d540b1ba0 2023-08-10T10:39:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.819+0000 7f9d3bfff640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 0x7f9d4006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.819+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9d480890d0 con 0x7f9d540b1ba0 2023-08-10T10:39:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.819+0000 7f9d537fe640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 0x7f9d4006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.820+0000 7f9d537fe640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 0x7f9d4006d140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009ac0 tx=0x7f9d44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:07.823+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9d48054140 con 0x7f9d540b1ba0 2023-08-10T10:39:08.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.011+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d540b30f0 con 0x7f9d540b1ba0 2023-08-10T10:39:08.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.012+0000 7f9d3bfff640 1 -- 172.21.15.50:0/404957841 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d48057760 con 0x7f9d540b1ba0 2023-08-10T10:39:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:08.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.014+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 msgr2=0x7f9d4006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.014+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 0x7f9d4006d140 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009ac0 tx=0x7f9d44008040 comp rx=0 tx=0).stop 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.014+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 msgr2=0x7f9d541e5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.014+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800e810 tx=0x7f9d4800ecd0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 shutdown_connections 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d4006ac80 0x7f9d4006d140 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d541583c0 0x7f9d540c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d540b1ba0 0x7f9d541e5f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 --2- 172.21.15.50:0/404957841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d54069be0 0x7f9d541e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 >> 172.21.15.50:0/404957841 conn(0x7f9d540caf80 msgr2=0x7f9d54157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 shutdown_connections 2023-08-10T10:39:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.015+0000 7f9d58cc2640 1 -- 172.21.15.50:0/404957841 wait complete. 2023-08-10T10:39:08.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:39:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.271+0000 7fb74aa71640 1 Processor -- start 2023-08-10T10:39:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.272+0000 7fb74aa71640 1 -- start start 2023-08-10T10:39:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.273+0000 7fb74aa71640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7441583c0 0x7fb7440b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.273+0000 7fb74aa71640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb744069db0 0x7fb74415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74aa71640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74415aee0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74aa71640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440b2100 con 0x7fb744069db0 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74aa71640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74415b1a0 con 0x7fb7441583c0 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74a270640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb744069db0 0x7fb74415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74a270640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb744069db0 0x7fb74415e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49278/0 (socket says 172.21.15.50:49278) 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb74a270640 1 -- 172.21.15.50:0/1304583014 learned_addr learned my addr 172.21.15.50:0/1304583014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.274+0000 7fb749a6f640 1 --2- 172.21.15.50:0/1304583014 >> v2:172.21.15.117:3300/0 conn(0x7fb7441583c0 0x7fb7440b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.275+0000 7fb74a270640 1 -- 172.21.15.50:0/1304583014 >> v2:172.21.15.117:3300/0 conn(0x7fb7441583c0 msgr2=0x7fb7440b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.275+0000 7fb74a270640 1 --2- 172.21.15.50:0/1304583014 >> v2:172.21.15.117:3300/0 conn(0x7fb7441583c0 0x7fb7440b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.275+0000 7fb74a270640 1 -- 172.21.15.50:0/1304583014 >> v1:172.21.15.50:6789/0 conn(0x7fb7440b1ba0 legacy=0x7fb7440696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.275+0000 7fb74a270640 1 -- 172.21.15.50:0/1304583014 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74415b480 con 0x7fb744069db0 2023-08-10T10:39:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.276+0000 7fb74a270640 1 --2- 172.21.15.50:0/1304583014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb744069db0 0x7fb74415e4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b1080 tx=0x7fb73c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d6e57b67900472 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.277+0000 7fb748a6d640 1 -- 172.21.15.50:0/1304583014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c02cb10 con 0x7fb744069db0 2023-08-10T10:39:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.277+0000 7fb748a6d640 1 -- 172.21.15.50:0/1304583014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c02cc70 con 0x7fb744069db0 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.277+0000 7fb748a6d640 1 -- 172.21.15.50:0/1304583014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0343f0 con 0x7fb744069db0 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.277+0000 7fb74aa71640 1 -- 172.21.15.50:0/1304583014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb744069db0 msgr2=0x7fb74415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.277+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1304583014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb744069db0 0x7fb74415e4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b1080 tx=0x7fb73c02bf70 comp rx=0 tx=0).stop 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 -- 172.21.15.50:0/1304583014 shutdown_connections 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1304583014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb744069db0 0x7fb74415e4d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1304583014 >> v2:172.21.15.117:3300/0 conn(0x7fb7441583c0 0x7fb7440b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 -- 172.21.15.50:0/1304583014 >> 172.21.15.50:0/1304583014 conn(0x7fb7440caf80 msgr2=0x7fb7440cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 -- 172.21.15.50:0/1304583014 shutdown_connections 2023-08-10T10:39:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.278+0000 7fb74aa71640 1 -- 172.21.15.50:0/1304583014 wait complete. 2023-08-10T10:39:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.279+0000 7fb74aa71640 1 Processor -- start 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.280+0000 7fb74aa71640 1 -- start start 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.280+0000 7fb74aa71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb744069db0 0x7fb7441f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.280+0000 7fb74aa71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74aa71640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7441583c0 0x7fb7441f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74aa71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441f3480 con 0x7fb7440b1ba0 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74aa71640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441f69b0 con 0x7fb744069db0 2023-08-10T10:39:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74aa71640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441f2ec0 con 0x7fb7441583c0 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49284/0 (socket says 172.21.15.50:49284) 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 -- 172.21.15.50:0/1719636957 learned_addr learned my addr 172.21.15.50:0/1719636957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74a270640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7441583c0 0x7fb7441f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 -- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7441583c0 msgr2=0x7fb7441f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7441583c0 0x7fb7441f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 -- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb744069db0 msgr2=0x7fb7441f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb744069db0 0x7fb7441f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.281+0000 7fb74926e640 1 -- 172.21.15.50:0/1719636957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c009b30 con 0x7fb7440b1ba0 2023-08-10T10:39:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb74926e640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c3c0 tx=0x7fb73400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340052d0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734005450 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734003830 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7441f31a0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.282+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7441f5f50 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.283+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7441f5ad0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.284+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb734003990 con 0x7fb7440b1ba0 2023-08-10T10:39:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.285+0000 7fb73a7fc640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 0x7fb72806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.285+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb734088ac0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.286+0000 7fb749a6f640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 0x7fb72806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:08.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.286+0000 7fb749a6f640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 0x7fb72806d110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098f0 tx=0x7fb740008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:08.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.289+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb7441f5ad0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.483+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb7441f5ad0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.491+0000 7fb73a7fc640 1 -- 172.21.15.50:0/1719636957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7441f5ad0 con 0x7fb7440b1ba0 2023-08-10T10:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 msgr2=0x7fb72806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 0x7fb72806d110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098f0 tx=0x7fb740008040 comp rx=0 tx=0).stop 2023-08-10T10:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 msgr2=0x7fb7440c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c3c0 tx=0x7fb73400c880 comp rx=0 tx=0).stop 2023-08-10T10:39:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 shutdown_connections 2023-08-10T10:39:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7441583c0 0x7fb7441f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7440b1ba0 0x7fb7440c4800 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72806ac50 0x7fb72806d110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 --2- 172.21.15.50:0/1719636957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb744069db0 0x7fb7441f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 >> 172.21.15.50:0/1719636957 conn(0x7fb7440caf80 msgr2=0x7fb74415a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 shutdown_connections 2023-08-10T10:39:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:08.494+0000 7fb74aa71640 1 -- 172.21.15.50:0/1719636957 wait complete. 2023-08-10T10:39:08.516 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:39:08.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:39:08.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:39:08.774 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:39:08.775 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:08.776 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:08.839 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:08.840 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:08.891 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:08.891 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:08.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:09.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.217+0000 7efe23fff640 1 Processor -- start 2023-08-10T10:39:09.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.217+0000 7efe23fff640 1 -- start start 2023-08-10T10:39:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe23fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe240b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe23fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe24153c30 0x7efe240b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe23fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2415d010 con 0x7efe240cf630 2023-08-10T10:39:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe23fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2415d290 con 0x7efe24153c30 2023-08-10T10:39:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe23fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415d570 con 0x7efe24153850 2023-08-10T10:39:09.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe237fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efe240cf630 0x7efe240ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44036/0 (socket says 172.21.15.50:44036) 2023-08-10T10:39:09.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe237fe640 1 -- 172.21.15.50:0/345406123 learned_addr learned my addr 172.21.15.50:0/345406123 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe22ffd640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe240b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.219+0000 7efe227fc640 1 --2- 172.21.15.50:0/345406123 >> v2:172.21.15.117:3300/0 conn(0x7efe24153c30 0x7efe240b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167454555 0 0) 0x7efe2415d010 con 0x7efe240cf630 2023-08-10T10:39:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003520 con 0x7efe240cf630 2023-08-10T10:39:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204856788 0 0) 0x7efe0c003520 con 0x7efe240cf630 2023-08-10T10:39:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 msgr2=0x7efe240b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe240b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 >> v2:172.21.15.117:3300/0 conn(0x7efe24153c30 msgr2=0x7efe240b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 --2- 172.21.15.50:0/345406123 >> v2:172.21.15.117:3300/0 conn(0x7efe24153c30 0x7efe240b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2415d850 con 0x7efe240cf630 2023-08-10T10:39:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7efe1c001a40 con 0x7efe240cf630 2023-08-10T10:39:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 >> v1:172.21.15.50:6789/0 conn(0x7efe240cf630 legacy=0x7efe240ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c003fb0 0x7efe0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0c004d00 0x7efe0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415d290 con 0x7efe0c004d00 2023-08-10T10:39:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415d570 con 0x7efe0c003fb0 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.220+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00ba00 con 0x7efe24153850 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0c004d00 0x7efe0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe22ffd640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 -- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 msgr2=0x7efe0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe24153850 0x7efe0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 -- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c003fb0 msgr2=0x7efe0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c003fb0 0x7efe0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.221+0000 7efe237fe640 1 -- 172.21.15.50:0/345406123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c003520 con 0x7efe0c004d00 2023-08-10T10:39:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.222+0000 7efe237fe640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0c004d00 0x7efe0c005180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00a720 tx=0x7efe0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6334f382c5ebd93a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.222+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c034630 con 0x7efe0c004d00 2023-08-10T10:39:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.222+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c02f070 con 0x7efe0c004d00 2023-08-10T10:39:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.222+0000 7efe21ffb640 1 -- 172.21.15.50:0/345406123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c034a10 con 0x7efe0c004d00 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 -- 172.21.15.50:0/345406123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0c004d00 msgr2=0x7efe0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 --2- 172.21.15.50:0/345406123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0c004d00 0x7efe0c005180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00a720 tx=0x7efe0c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe237fe640 1 -- 172.21.15.50:0/345406123 reap_dead start 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 -- 172.21.15.50:0/345406123 shutdown_connections 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 -- 172.21.15.50:0/345406123 >> 172.21.15.50:0/345406123 conn(0x7efe24069880 msgr2=0x7efe24069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 -- 172.21.15.50:0/345406123 shutdown_connections 2023-08-10T10:39:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.223+0000 7efe23fff640 1 -- 172.21.15.50:0/345406123 wait complete. 2023-08-10T10:39:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.226+0000 7efe23fff640 1 Processor -- start 2023-08-10T10:39:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.226+0000 7efe23fff640 1 -- start start 2023-08-10T10:39:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.227+0000 7efe23fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c004d00 0x7efe241f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe23fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe240b6c40 0x7efe240ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe23fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe23fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240cd700 con 0x7efe240b70a0 2023-08-10T10:39:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe23fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241f89d0 con 0x7efe0c004d00 2023-08-10T10:39:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe23fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe241f8cb0 con 0x7efe240b6c40 2023-08-10T10:39:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49308/0 (socket says 172.21.15.50:49308) 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 -- 172.21.15.50:0/1869220136 learned_addr learned my addr 172.21.15.50:0/1869220136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe227fc640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe240b6c40 0x7efe240ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe22ffd640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c004d00 0x7efe241f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 -- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe240b6c40 msgr2=0x7efe240ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe240b6c40 0x7efe240ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 -- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c004d00 msgr2=0x7efe241f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c004d00 0x7efe241f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.228+0000 7efe237fe640 1 -- 172.21.15.50:0/1869220136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe241f8f90 con 0x7efe240b70a0 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe237fe640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe1c02ca60 tx=0x7efe1c0013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c034640 con 0x7efe240b70a0 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0347a0 con 0x7efe240b70a0 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c034b10 con 0x7efe240b70a0 2023-08-10T10:39:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe241f9270 con 0x7efe240b70a0 2023-08-10T10:39:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.229+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe241f7ca0 con 0x7efe240b70a0 2023-08-10T10:39:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.231+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe241f9790 con 0x7efe240b70a0 2023-08-10T10:39:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.232+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe1c031030 con 0x7efe240b70a0 2023-08-10T10:39:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.233+0000 7efe0b7fe640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 0x7efe1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.233+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efe1c0ab8e0 con 0x7efe240b70a0 2023-08-10T10:39:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.233+0000 7efe22ffd640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 0x7efe1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.234+0000 7efe22ffd640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 0x7efe1006d110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe14009a10 tx=0x7efe14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.237+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efe241f9790 con 0x7efe240b70a0 2023-08-10T10:39:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.429+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe241f9790 con 0x7efe240b70a0 2023-08-10T10:39:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.431+0000 7efe0b7fe640 1 -- 172.21.15.50:0/1869220136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7efe241f9790 con 0x7efe240b70a0 2023-08-10T10:39:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:09.434 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 msgr2=0x7efe1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 0x7efe1006d110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe14009a10 tx=0x7efe14008040 comp rx=0 tx=0).stop 2023-08-10T10:39:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 msgr2=0x7efe240cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efe1c02ca60 tx=0x7efe1c0013b0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 shutdown_connections 2023-08-10T10:39:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe240b70a0 0x7efe240cd1c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe240b6c40 0x7efe240ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efe1006ac50 0x7efe1006d110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 --2- 172.21.15.50:0/1869220136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c004d00 0x7efe241f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 >> 172.21.15.50:0/1869220136 conn(0x7efe24069880 msgr2=0x7efe240b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 shutdown_connections 2023-08-10T10:39:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.434+0000 7efe23fff640 1 -- 172.21.15.50:0/1869220136 wait complete. 2023-08-10T10:39:09.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:09.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.694+0000 7febd8f0c640 1 Processor -- start 2023-08-10T10:39:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.694+0000 7febd8f0c640 1 -- start start 2023-08-10T10:39:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.695+0000 7febd8f0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7febd415ae40 0x7febd40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.695+0000 7febd8f0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febd406cb30 0x7febd40ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febd8f0c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40adcb0 con 0x7febd40cd2a0 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febd8f0c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406c320 con 0x7febd406cb30 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febd8f0c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406b770 con 0x7febd415ae40 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febd406cb30 0x7febd40ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febd406cb30 0x7febd40ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49310/0 (socket says 172.21.15.50:49310) 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 -- 172.21.15.50:0/1155385101 learned_addr learned my addr 172.21.15.50:0/1155385101 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 -- 172.21.15.50:0/1155385101 >> v2:172.21.15.117:3300/0 conn(0x7febd415ae40 msgr2=0x7febd40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 --2- 172.21.15.50:0/1155385101 >> v2:172.21.15.117:3300/0 conn(0x7febd415ae40 0x7febd40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 -- 172.21.15.50:0/1155385101 >> v1:172.21.15.117:6789/0 conn(0x7febd40cd2a0 legacy=0x7febd40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.696+0000 7febc9d9b640 1 -- 172.21.15.50:0/1155385101 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd406b9f0 con 0x7febd406cb30 2023-08-10T10:39:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.698+0000 7febc9d9b640 1 --2- 172.21.15.50:0/1155385101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd406cb30 0x7febd40ad770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7febd406e6f0 tx=0x7febbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9f381c9dbf7ea9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.698+0000 7febd1d9b640 1 -- 172.21.15.50:0/1155385101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc031870 con 0x7febd406cb30 2023-08-10T10:39:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.698+0000 7febd1d9b640 1 -- 172.21.15.50:0/1155385101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0319d0 con 0x7febd406cb30 2023-08-10T10:39:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.698+0000 7febd1d9b640 1 -- 172.21.15.50:0/1155385101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc031d60 con 0x7febd406cb30 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 -- 172.21.15.50:0/1155385101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd406cb30 msgr2=0x7febd40ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1155385101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd406cb30 0x7febd40ad770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7febd406e6f0 tx=0x7febbc02b910 comp rx=0 tx=0).stop 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 -- 172.21.15.50:0/1155385101 shutdown_connections 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1155385101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd406cb30 0x7febd40ad770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1155385101 >> v2:172.21.15.117:3300/0 conn(0x7febd415ae40 0x7febd40b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 -- 172.21.15.50:0/1155385101 >> 172.21.15.50:0/1155385101 conn(0x7febd40b01b0 msgr2=0x7febd40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 -- 172.21.15.50:0/1155385101 shutdown_connections 2023-08-10T10:39:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.699+0000 7febd8f0c640 1 -- 172.21.15.50:0/1155385101 wait complete. 2023-08-10T10:39:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.701+0000 7febd8f0c640 1 Processor -- start 2023-08-10T10:39:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.701+0000 7febd8f0c640 1 -- start start 2023-08-10T10:39:09.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 0x7febd414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 0x7febd415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40c3170 con 0x7febd415ae40 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40c3600 con 0x7febd40cd2a0 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd8f0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40c2560 con 0x7febd406cb30 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49312/0 (socket says 172.21.15.50:49312) 2023-08-10T10:39:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd2d9d640 1 -- 172.21.15.50:0/1455085138 learned_addr learned my addr 172.21.15.50:0/1455085138 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febd259c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 0x7febd414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.703+0000 7febc9d9b640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 0x7febd415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 -- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 msgr2=0x7febd414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 0x7febd414fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 -- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 msgr2=0x7febd415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 0x7febd415ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 -- 172.21.15.50:0/1455085138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0094d0 con 0x7febd415ae40 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd259c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 0x7febd414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febc9d9b640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 0x7febd415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd2d9d640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b4c0 tx=0x7febcc00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011830 con 0x7febd415ae40 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0119b0 con 0x7febd415ae40 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011d60 con 0x7febd415ae40 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.704+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd40c2840 con 0x7febd415ae40 2023-08-10T10:39:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.705+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd40c2e00 con 0x7febd415ae40 2023-08-10T10:39:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.706+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd40c32e0 con 0x7febd415ae40 2023-08-10T10:39:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.706+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febcc01a400 con 0x7febd415ae40 2023-08-10T10:39:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.707+0000 7febcb7fe640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 0x7febb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.708+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7febcc0895a0 con 0x7febd415ae40 2023-08-10T10:39:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.708+0000 7febd259c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 0x7febb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.708+0000 7febd259c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 0x7febb406d110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7febc4007eb0 tx=0x7febc40073c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:09.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.712+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febcc054600 con 0x7febd415ae40 2023-08-10T10:39:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.904+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febd40612b0 con 0x7febd415ae40 2023-08-10T10:39:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.905+0000 7febcb7fe640 1 -- 172.21.15.50:0/1455085138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7febcc057c20 con 0x7febd415ae40 2023-08-10T10:39:09.906 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.907+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 msgr2=0x7febb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.907+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 0x7febb406d110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7febc4007eb0 tx=0x7febc40073c0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.907+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 msgr2=0x7febd41587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.907+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b4c0 tx=0x7febcc00b980 comp rx=0 tx=0).stop 2023-08-10T10:39:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 shutdown_connections 2023-08-10T10:39:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd415ae40 0x7febd41587f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7febb406ac50 0x7febb406d110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febd40cd2a0 0x7febd415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 --2- 172.21.15.50:0/1455085138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febd406cb30 0x7febd414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 >> 172.21.15.50:0/1455085138 conn(0x7febd40b01b0 msgr2=0x7febd40c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 shutdown_connections 2023-08-10T10:39:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:09.908+0000 7febd8f0c640 1 -- 172.21.15.50:0/1455085138 wait complete. 2023-08-10T10:39:09.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:10.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.162+0000 7f279f6ec640 1 Processor -- start 2023-08-10T10:39:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.162+0000 7f279f6ec640 1 -- start start 2023-08-10T10:39:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279f6ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27980cebd0 0x7f279815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279f6ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 0x7f279815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279f6ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2798070ea0 con 0x7f27980afcb0 2023-08-10T10:39:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279f6ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980cddc0 con 0x7f27980cebd0 2023-08-10T10:39:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279f6ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2798071180 con 0x7f27980cf030 2023-08-10T10:39:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279d488640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27980afcb0 0x7f27980ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44048/0 (socket says 172.21.15.50:44048) 2023-08-10T10:39:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279d488640 1 -- 172.21.15.50:0/2136758099 learned_addr learned my addr 172.21.15.50:0/2136758099 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279dc89640 1 --2- 172.21.15.50:0/2136758099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 0x7f279815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f279cc87640 1 --2- 172.21.15.50:0/2136758099 >> v2:172.21.15.117:3300/0 conn(0x7f27980cebd0 0x7f279815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.164+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942751412 0 0) 0x7f2798070ea0 con 0x7f27980afcb0 2023-08-10T10:39:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2784003520 con 0x7f27980afcb0 2023-08-10T10:39:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667470055 0 0) 0x7f2784003520 con 0x7f27980afcb0 2023-08-10T10:39:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f279dc89640 1 -- 172.21.15.50:0/2136758099 >> v2:172.21.15.117:3300/0 conn(0x7f27980cebd0 msgr2=0x7f279815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f279dc89640 1 --2- 172.21.15.50:0/2136758099 >> v2:172.21.15.117:3300/0 conn(0x7f27980cebd0 0x7f279815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f279dc89640 1 -- 172.21.15.50:0/2136758099 >> v1:172.21.15.50:6789/0 conn(0x7f27980afcb0 legacy=0x7f27980ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.165+0000 7f279dc89640 1 -- 172.21.15.50:0/2136758099 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798071460 con 0x7f27980cf030 2023-08-10T10:39:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.166+0000 7f279dc89640 1 --2- 172.21.15.50:0/2136758099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 0x7f279815efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f279002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05e72a70ffbff7f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.167+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794001670 con 0x7f27980cf030 2023-08-10T10:39:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.167+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279002c8a0 con 0x7f27980cf030 2023-08-10T10:39:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.167+0000 7f278ffff640 1 -- 172.21.15.50:0/2136758099 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279002cc30 con 0x7f27980cf030 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.167+0000 7f279f6ec640 1 -- 172.21.15.50:0/2136758099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 msgr2=0x7f279815efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.167+0000 7f279f6ec640 1 --2- 172.21.15.50:0/2136758099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 0x7f279815efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f279002bd70 comp rx=0 tx=0).stop 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 -- 172.21.15.50:0/2136758099 shutdown_connections 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 --2- 172.21.15.50:0/2136758099 >> v2:172.21.15.117:3300/0 conn(0x7f27980cebd0 0x7f279815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 --2- 172.21.15.50:0/2136758099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980cf030 0x7f279815efd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 -- 172.21.15.50:0/2136758099 >> 172.21.15.50:0/2136758099 conn(0x7f27980b23e0 msgr2=0x7f27980b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 -- 172.21.15.50:0/2136758099 shutdown_connections 2023-08-10T10:39:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.168+0000 7f279f6ec640 1 -- 172.21.15.50:0/2136758099 wait complete. 2023-08-10T10:39:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.170+0000 7f279f6ec640 1 Processor -- start 2023-08-10T10:39:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.170+0000 7f279f6ec640 1 -- start start 2023-08-10T10:39:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980afcb0 0x7f2798156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 0x7f27981f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c8940 con 0x7f27980cf030 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c8c20 con 0x7f27980cebd0 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279f6ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c8f00 con 0x7f27980afcb0 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279dc89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279dc89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49326/0 (socket says 172.21.15.50:49326) 2023-08-10T10:39:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279dc89640 1 -- 172.21.15.50:0/3346862824 learned_addr learned my addr 172.21.15.50:0/3346862824 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.171+0000 7f279d488640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980afcb0 0x7f2798156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279cc87640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 0x7f27981f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 -- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980afcb0 msgr2=0x7f2798156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980afcb0 0x7f2798156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 -- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 msgr2=0x7f27981f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 0x7f27981f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 -- 172.21.15.50:0/3346862824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790009a70 con 0x7f27980cf030 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279cc87640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 0x7f27981f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f279dc89640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f2790004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.172+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790034e50 con 0x7f27980cf030 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.173+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279002ce90 con 0x7f27980cf030 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.173+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790040690 con 0x7f27980cf030 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.173+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27980c91e0 con 0x7f27980cf030 2023-08-10T10:39:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.173+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27980b88e0 con 0x7f27980cf030 2023-08-10T10:39:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.174+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27980c9700 con 0x7f27980cf030 2023-08-10T10:39:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.175+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27900407f0 con 0x7f27980cf030 2023-08-10T10:39:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.176+0000 7f278dffb640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 0x7f277c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.177+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f27900abf90 con 0x7f27980cf030 2023-08-10T10:39:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.177+0000 7f279d488640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 0x7f277c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.177+0000 7f279d488640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 0x7f277c06d110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2794001eb0 tx=0x7f2794001a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.181+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27980c9700 con 0x7f27980cf030 2023-08-10T10:39:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.384+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27980c9700 con 0x7f27980cf030 2023-08-10T10:39:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.385+0000 7f278dffb640 1 -- 172.21.15.50:0/3346862824 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27980c9700 con 0x7f27980cf030 2023-08-10T10:39:10.387 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 msgr2=0x7f277c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 0x7f277c06d110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2794001eb0 tx=0x7f2794001a50 comp rx=0 tx=0).stop 2023-08-10T10:39:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 msgr2=0x7f27981f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f2790004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 shutdown_connections 2023-08-10T10:39:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27980cf030 0x7f27981f3120 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f277c06ac50 0x7f277c06d110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27980cebd0 0x7f27981f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 --2- 172.21.15.50:0/3346862824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27980afcb0 0x7f2798156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 >> 172.21.15.50:0/3346862824 conn(0x7f27980b23e0 msgr2=0x7f27980b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 shutdown_connections 2023-08-10T10:39:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.388+0000 7f279f6ec640 1 -- 172.21.15.50:0/3346862824 wait complete. 2023-08-10T10:39:10.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.645+0000 7fcec6342640 1 Processor -- start 2023-08-10T10:39:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.646+0000 7fcec6342640 1 -- start start 2023-08-10T10:39:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec0159c10 0x7fcec00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 0x7fcec00c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcec00ca360 0x7fcec00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00ca7f0 con 0x7fcec00ca360 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00adf10 con 0x7fcec00ada90 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec6342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec006ebb0 con 0x7fcec0159c10 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec48df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcec00ca360 0x7fcec00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec48df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcec00ca360 0x7fcec00cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49328/0 (socket says 172.21.15.50:49328) 2023-08-10T10:39:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.647+0000 7fcec48df640 1 -- 172.21.15.50:0/2039146976 learned_addr learned my addr 172.21.15.50:0/2039146976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcebffff640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec0159c10 0x7fcec00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcebf7fe640 1 --2- 172.21.15.50:0/2039146976 >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 0x7fcec00c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcec48df640 1 -- 172.21.15.50:0/2039146976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec0159c10 msgr2=0x7fcec00b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcec48df640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec0159c10 0x7fcec00b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcec48df640 1 -- 172.21.15.50:0/2039146976 >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 msgr2=0x7fcec00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcec48df640 1 --2- 172.21.15.50:0/2039146976 >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 0x7fcec00c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcec48df640 1 -- 172.21.15.50:0/2039146976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec006ee90 con 0x7fcec00ca360 2023-08-10T10:39:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.648+0000 7fcebf7fe640 1 --2- 172.21.15.50:0/2039146976 >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 0x7fcec00c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.649+0000 7fcec48df640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00cd2a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcec0073eb0 tx=0x7fceb802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad9162299150ec8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.649+0000 7fcebeffd640 1 -- 172.21.15.50:0/2039146976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb802e9f0 con 0x7fcec00ca360 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.649+0000 7fcebeffd640 1 -- 172.21.15.50:0/2039146976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb802eb50 con 0x7fcec00ca360 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.649+0000 7fcebeffd640 1 -- 172.21.15.50:0/2039146976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8009600 con 0x7fcec00ca360 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 -- 172.21.15.50:0/2039146976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 msgr2=0x7fcec00cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00cd2a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcec0073eb0 tx=0x7fceb802e050 comp rx=0 tx=0).stop 2023-08-10T10:39:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 -- 172.21.15.50:0/2039146976 shutdown_connections 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00cd2a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 --2- 172.21.15.50:0/2039146976 >> v2:172.21.15.117:3300/0 conn(0x7fcec00ada90 0x7fcec00c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 --2- 172.21.15.50:0/2039146976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec0159c10 0x7fcec00b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 -- 172.21.15.50:0/2039146976 >> 172.21.15.50:0/2039146976 conn(0x7fcec00b01b0 msgr2=0x7fcec00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 -- 172.21.15.50:0/2039146976 shutdown_connections 2023-08-10T10:39:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.650+0000 7fcec6342640 1 -- 172.21.15.50:0/2039146976 wait complete. 2023-08-10T10:39:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.652+0000 7fcec6342640 1 Processor -- start 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.652+0000 7fcec6342640 1 -- start start 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec00ada90 0x7fcec0148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcec0159c10 0x7fcec015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00c3510 con 0x7fcec00ca360 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00c37f0 con 0x7fcec0159c10 2023-08-10T10:39:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcec6342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00c3ad0 con 0x7fcec00ada90 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.653+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49340/0 (socket says 172.21.15.50:49340) 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 -- 172.21.15.50:0/3203721654 learned_addr learned my addr 172.21.15.50:0/3203721654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebffff640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec00ada90 0x7fcec0148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 -- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec00ada90 msgr2=0x7fcec0148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec00ada90 0x7fcec0148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 -- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcec0159c10 msgr2=0x7fcec015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcec0159c10 0x7fcec015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 -- 172.21.15.50:0/3203721654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb800bd40 con 0x7fcec00ca360 2023-08-10T10:39:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.654+0000 7fcebf7fe640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c7f0 tx=0x7fceb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.655+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007820 con 0x7fcec00ca360 2023-08-10T10:39:10.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.655+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb4007980 con 0x7fcec00ca360 2023-08-10T10:39:10.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.655+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007d30 con 0x7fcec00ca360 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.655+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec00c3db0 con 0x7fcec00ca360 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.655+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec00c4370 con 0x7fcec00ca360 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.656+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec00c4590 con 0x7fcec00ca360 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.657+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fceb40113f0 con 0x7fcec00ca360 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.658+0000 7fcebcff9640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 0x7fceac06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.658+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fceb40898a0 con 0x7fcec00ca360 2023-08-10T10:39:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.658+0000 7fcebffff640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 0x7fceac06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.659+0000 7fcebffff640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 0x7fceac06d140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006fd0 tx=0x7fceb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.662+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fceb40547f0 con 0x7fcec00ca360 2023-08-10T10:39:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.856+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcec00612b0 con 0x7fcec00ca360 2023-08-10T10:39:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.857+0000 7fcebcff9640 1 -- 172.21.15.50:0/3203721654 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fceb4057e10 con 0x7fcec00ca360 2023-08-10T10:39:10.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 msgr2=0x7fceac06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 0x7fceac06d140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006fd0 tx=0x7fceb0008040 comp rx=0 tx=0).stop 2023-08-10T10:39:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 msgr2=0x7fcec00c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c7f0 tx=0x7fceb400ccb0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 shutdown_connections 2023-08-10T10:39:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fceac06ac80 0x7fceac06d140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcec0159c10 0x7fcec015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec00ca360 0x7fcec00c4890 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 --2- 172.21.15.50:0/3203721654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcec00ada90 0x7fcec0148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.860+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 >> 172.21.15.50:0/3203721654 conn(0x7fcec00b01b0 msgr2=0x7fcec0158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.861+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 shutdown_connections 2023-08-10T10:39:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:10.861+0000 7fcec6342640 1 -- 172.21.15.50:0/3203721654 wait complete. 2023-08-10T10:39:10.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.091+0000 7fddabfff640 1 Processor -- start 2023-08-10T10:39:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.092+0000 7fddabfff640 1 -- start start 2023-08-10T10:39:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.093+0000 7fddabfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fddac15ff90 0x7fddac160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.093+0000 7fddabfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddac0cd960 0x7fddac0d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.093+0000 7fddabfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac160370 con 0x7fddac0d2370 2023-08-10T10:39:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.093+0000 7fddabfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0d0b90 con 0x7fddac0cd960 2023-08-10T10:39:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.093+0000 7fddabfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac1614d0 con 0x7fddac15ff90 2023-08-10T10:39:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddac0cd960 0x7fddac0d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fddac15ff90 0x7fddac160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddac0cd960 0x7fddac0d1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49356/0 (socket says 172.21.15.50:49356) 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 -- 172.21.15.50:0/3956082683 learned_addr learned my addr 172.21.15.50:0/3956082683 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 -- 172.21.15.50:0/3956082683 >> v2:172.21.15.117:3300/0 conn(0x7fddac15ff90 msgr2=0x7fddac160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 --2- 172.21.15.50:0/3956082683 >> v2:172.21.15.117:3300/0 conn(0x7fddac15ff90 0x7fddac160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 -- 172.21.15.50:0/3956082683 >> v1:172.21.15.50:6789/0 conn(0x7fddac0d2370 legacy=0x7fddac0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.094+0000 7fddaa7fc640 1 -- 172.21.15.50:0/3956082683 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0d0d90 con 0x7fddac0cd960 2023-08-10T10:39:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fddaa7fc640 1 --2- 172.21.15.50:0/3956082683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac0d1e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fddac071330 tx=0x7fdd9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b4f108a9a75899 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fdda9ffb640 1 -- 172.21.15.50:0/3956082683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94030860 con 0x7fddac0cd960 2023-08-10T10:39:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fdda9ffb640 1 -- 172.21.15.50:0/3956082683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940309c0 con 0x7fddac0cd960 2023-08-10T10:39:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fdda9ffb640 1 -- 172.21.15.50:0/3956082683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94030d50 con 0x7fddac0cd960 2023-08-10T10:39:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fddabfff640 1 -- 172.21.15.50:0/3956082683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 msgr2=0x7fddac0d1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.096+0000 7fddabfff640 1 --2- 172.21.15.50:0/3956082683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac0d1e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fddac071330 tx=0x7fdd9402b9a0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 -- 172.21.15.50:0/3956082683 shutdown_connections 2023-08-10T10:39:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 --2- 172.21.15.50:0/3956082683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac0d1e30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 --2- 172.21.15.50:0/3956082683 >> v2:172.21.15.117:3300/0 conn(0x7fddac15ff90 0x7fddac160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 -- 172.21.15.50:0/3956082683 >> 172.21.15.50:0/3956082683 conn(0x7fddac069ac0 msgr2=0x7fddac069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 -- 172.21.15.50:0/3956082683 shutdown_connections 2023-08-10T10:39:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.097+0000 7fddabfff640 1 -- 172.21.15.50:0/3956082683 wait complete. 2023-08-10T10:39:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.098+0000 7fddabfff640 1 Processor -- start 2023-08-10T10:39:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.099+0000 7fddabfff640 1 -- start start 2023-08-10T10:39:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.099+0000 7fddabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddabfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddac0d2370 0x7fddac15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddabfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 0x7fddac15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddabfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0b51f0 con 0x7fddac0cd960 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddabfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0b4950 con 0x7fddac15ff90 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddabfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0b4c30 con 0x7fddac0d2370 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49366/0 (socket says 172.21.15.50:49366) 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 -- 172.21.15.50:0/2210124134 learned_addr learned my addr 172.21.15.50:0/2210124134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaa7fc640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddac0d2370 0x7fddac15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddab7fe640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 0x7fddac15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 -- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddac0d2370 msgr2=0x7fddac15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddac0d2370 0x7fddac15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 -- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 msgr2=0x7fddac15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 0x7fddac15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddaaffd640 1 -- 172.21.15.50:0/2210124134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940094d0 con 0x7fddac0cd960 2023-08-10T10:39:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.100+0000 7fddab7fe640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 0x7fddac15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fddaaffd640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00efc0 tx=0x7fdd9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c014480 con 0x7fddac0cd960 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00f040 con 0x7fddac0cd960 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c014800 con 0x7fddac0cd960 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac0b4f10 con 0x7fddac0cd960 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.101+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac149d90 con 0x7fddac0cd960 2023-08-10T10:39:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.103+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac066e30 con 0x7fddac0cd960 2023-08-10T10:39:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.104+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd9c014960 con 0x7fddac0cd960 2023-08-10T10:39:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.105+0000 7fdda37fe640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 0x7fdd8c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.105+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdd9c08a110 con 0x7fddac0cd960 2023-08-10T10:39:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.105+0000 7fddaa7fc640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 0x7fdd8c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.106+0000 7fddaa7fc640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 0x7fdd8c06d110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd94036000 tx=0x7fdd9403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.109+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdd9c058c00 con 0x7fddac0cd960 2023-08-10T10:39:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.299+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddac0d05c0 con 0x7fddac0cd960 2023-08-10T10:39:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.300+0000 7fdda37fe640 1 -- 172.21.15.50:0/2210124134 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd9c058790 con 0x7fddac0cd960 2023-08-10T10:39:11.306 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 msgr2=0x7fdd8c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 0x7fdd8c06d110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd94036000 tx=0x7fdd9403b040 comp rx=0 tx=0).stop 2023-08-10T10:39:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 msgr2=0x7fddac149850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00efc0 tx=0x7fdd9c00c490 comp rx=0 tx=0).stop 2023-08-10T10:39:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 shutdown_connections 2023-08-10T10:39:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd8c06ac50 0x7fdd8c06d110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddac15ff90 0x7fddac15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddac0d2370 0x7fddac15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 --2- 172.21.15.50:0/2210124134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddac0cd960 0x7fddac149850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 >> 172.21.15.50:0/2210124134 conn(0x7fddac069ac0 msgr2=0x7fddac0b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 shutdown_connections 2023-08-10T10:39:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.303+0000 7fddabfff640 1 -- 172.21.15.50:0/2210124134 wait complete. 2023-08-10T10:39:11.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:39:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.541+0000 7f1d240ad640 1 Processor -- start 2023-08-10T10:39:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.542+0000 7f1d240ad640 1 -- start start 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.543+0000 7f1d240ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d1c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.543+0000 7f1d240ad640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0d1220 con 0x7f1d1c0cd730 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.543+0000 7f1d240ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0b8a30 con 0x7f1d1c0b5af0 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.543+0000 7f1d240ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d2930 con 0x7f1d1c15ce00 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.544+0000 7f1d21e49640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1d1c0cd730 0x7f1d1c0cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44070/0 (socket says 172.21.15.50:44070) 2023-08-10T10:39:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.544+0000 7f1d21e49640 1 -- 172.21.15.50:0/1677696921 learned_addr learned my addr 172.21.15.50:0/1677696921 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.544+0000 7f1d21648640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d1c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.544+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572712647 0 0) 0x7f1d1c0d1220 con 0x7f1d1c0cd730 2023-08-10T10:39:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.544+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d08003520 con 0x7f1d1c0cd730 2023-08-10T10:39:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118243581 0 0) 0x7f1d08003520 con 0x7f1d1c0cd730 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 msgr2=0x7f1d1c0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d1c0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 >> v1:172.21.15.117:6789/0 conn(0x7f1d1c0b5af0 legacy=0x7f1d1c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0b1e70 con 0x7f1d1c0cd730 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1d180019f0 con 0x7f1d1c0cd730 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 >> v1:172.21.15.50:6789/0 conn(0x7f1d1c0cd730 legacy=0x7f1d1c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d080039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d08004d00 0x7f1d08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800ba30 con 0x7f1d08003f20 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800bba0 con 0x7f1d08004d00 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800bd60 con 0x7f1d1c15ce00 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d21648640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.545+0000 7f1d21e49640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d080039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d2264a640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d08004d00 0x7f1d08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d21648640 1 -- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 msgr2=0x7f1d080039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d21648640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c15ce00 0x7f1d080039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d21648640 1 -- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d08004d00 msgr2=0x7f1d08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d21648640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d08004d00 0x7f1d08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.546+0000 7f1d21648640 1 -- 172.21.15.50:0/1677696921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08003520 con 0x7f1d08003f20 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.547+0000 7f1d21648640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d080047c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009ac0 tx=0x7f1d080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfac24691e79170 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.547+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c02c6b0 con 0x7f1d08003f20 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.547+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c02c810 con 0x7f1d08003f20 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.547+0000 7f1d20e47640 1 -- 172.21.15.50:0/1677696921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c02cba0 con 0x7f1d08003f20 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 -- 172.21.15.50:0/1677696921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 msgr2=0x7f1d080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 --2- 172.21.15.50:0/1677696921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d080047c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009ac0 tx=0x7f1d080057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d2264a640 1 -- 172.21.15.50:0/1677696921 reap_dead start 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 -- 172.21.15.50:0/1677696921 shutdown_connections 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 -- 172.21.15.50:0/1677696921 >> 172.21.15.50:0/1677696921 conn(0x7f1d1c0d2c60 msgr2=0x7f1d1c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 -- 172.21.15.50:0/1677696921 shutdown_connections 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.548+0000 7f1d240ad640 1 -- 172.21.15.50:0/1677696921 wait complete. 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.550+0000 7f1d240ad640 1 Processor -- start 2023-08-10T10:39:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.550+0000 7f1d240ad640 1 -- start start 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c0b0ec0 0x7f1d1c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 0x7f1d1c0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0659c0 con 0x7f1d08003f20 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0656e0 con 0x7f1d1c15e320 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d240ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b3c30 con 0x7f1d1c0b0ec0 2023-08-10T10:39:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d21e49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d21e49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49396/0 (socket says 172.21.15.50:49396) 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.551+0000 7f1d21e49640 1 -- 172.21.15.50:0/608393022 learned_addr learned my addr 172.21.15.50:0/608393022 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d2264a640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 0x7f1d1c0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 -- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c0b0ec0 msgr2=0x7f1d1c15a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c0b0ec0 0x7f1d1c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 -- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 msgr2=0x7f1d1c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 0x7f1d1c0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 -- 172.21.15.50:0/608393022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0b3f10 con 0x7f1d08003f20 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d2264a640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 0x7f1d1c0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d21e49640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007a90 tx=0x7f1d1800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.552+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180133f0 con 0x7f1d08003f20 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.553+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18013570 con 0x7f1d08003f20 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.553+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18013920 con 0x7f1d08003f20 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.553+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c15a590 con 0x7f1d08003f20 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.553+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c15e7d0 con 0x7f1d08003f20 2023-08-10T10:39:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.554+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c15e9f0 con 0x7f1d08003f20 2023-08-10T10:39:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.555+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d18013a80 con 0x7f1d08003f20 2023-08-10T10:39:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.556+0000 7f1d127fc640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 0x7f1d0006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.556+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1d1808a350 con 0x7f1d08003f20 2023-08-10T10:39:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.556+0000 7f1d21648640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 0x7f1d0006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.557+0000 7f1d21648640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 0x7f1d0006d140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c036000 tx=0x7f1d0c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.561+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d180553b0 con 0x7f1d08003f20 2023-08-10T10:39:11.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:11.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.769+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1d1c0d0e80 con 0x7f1d08003f20 2023-08-10T10:39:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.770+0000 7f1d127fc640 1 -- 172.21.15.50:0/608393022 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1d18017080 con 0x7f1d08003f20 2023-08-10T10:39:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:39:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 msgr2=0x7f1d0006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 0x7f1d0006d140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c036000 tx=0x7f1d0c02e000 comp rx=0 tx=0).stop 2023-08-10T10:39:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 msgr2=0x7f1d1c15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007a90 tx=0x7f1d1800a6e0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 shutdown_connections 2023-08-10T10:39:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d0006ac80 0x7f1d0006d140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d1c15e320 0x7f1d1c0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d1c0b0ec0 0x7f1d1c15a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 --2- 172.21.15.50:0/608393022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d08003f20 0x7f1d1c15a820 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 >> 172.21.15.50:0/608393022 conn(0x7f1d1c0d2c60 msgr2=0x7f1d1c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 shutdown_connections 2023-08-10T10:39:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:11.773+0000 7f1d240ad640 1 -- 172.21.15.50:0/608393022 wait complete. 2023-08-10T10:39:11.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:39:11.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:11.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-10T10:39:11.902 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:39:11.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:11.903 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:39:11.965 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:11.965 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:12.026 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:12.027 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:12.079 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:12.079 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:12.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.343+0000 7f1cf30c2640 1 Processor -- start 2023-08-10T10:39:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.343+0000 7f1cf30c2640 1 -- start start 2023-08-10T10:39:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf30c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cec153850 0x7f1cec0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf30c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cec153c30 0x7f1cec0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf30c2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec15d010 con 0x7f1cec0cf630 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf30c2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec15d290 con 0x7f1cec153c30 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf30c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec15d570 con 0x7f1cec153850 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf28c1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cec0cf630 0x7f1cec0ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44076/0 (socket says 172.21.15.50:44076) 2023-08-10T10:39:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.345+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1585553008 learned_addr learned my addr 172.21.15.50:0/1585553008 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf18bf640 1 --2- 172.21.15.50:0/1585553008 >> v2:172.21.15.117:3300/0 conn(0x7f1cec153c30 0x7f1cec0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cec153850 0x7f1cec0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157968965 0 0) 0x7f1cec15d010 con 0x7f1cec0cf630 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003520 con 0x7f1cec0cf630 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052831228 0 0) 0x7f1cd8003520 con 0x7f1cec0cf630 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cec153850 msgr2=0x7f1cec0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cec153850 0x7f1cec0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 >> v2:172.21.15.117:3300/0 conn(0x7f1cec153c30 msgr2=0x7f1cec0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 --2- 172.21.15.50:0/1585553008 >> v2:172.21.15.117:3300/0 conn(0x7f1cec153c30 0x7f1cec0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec15d850 con 0x7f1cec0cf630 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1ce4001a40 con 0x7f1cec0cf630 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 >> v1:172.21.15.50:6789/0 conn(0x7f1cec0cf630 legacy=0x7f1cec0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80039e0 0x7f1cd8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd80047c0 0x7f1cd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd8005180 0x7f1cd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec15d290 con 0x7f1cd80039e0 2023-08-10T10:39:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec15d570 con 0x7f1cd80047c0 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd800c020 con 0x7f1cd8005180 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf18bf640 1 --2- 172.21.15.50:0/1585553008 >> v2:172.21.15.117:3300/0 conn(0x7f1cec153c30 0x7f1cec0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.346+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cec153850 0x7f1cec0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80039e0 0x7f1cd8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf28c1640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd8005180 0x7f1cd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 -- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd8005180 msgr2=0x7f1cd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd8005180 0x7f1cd800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 -- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd80047c0 msgr2=0x7f1cd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd80047c0 0x7f1cd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.347+0000 7f1cf20c0640 1 -- 172.21.15.50:0/1585553008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8003520 con 0x7f1cd80039e0 2023-08-10T10:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.349+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80039e0 0x7f1cd8003e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8006fd0 tx=0x7f1cd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8deb700a83c1b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.349+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8033600 con 0x7f1cd80039e0 2023-08-10T10:39:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.349+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce802f050 con 0x7f1cd80039e0 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.349+0000 7f1cf10be640 1 -- 172.21.15.50:0/1585553008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8033980 con 0x7f1cd80039e0 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1585553008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80039e0 msgr2=0x7f1cd8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1585553008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80039e0 0x7f1cd8003e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8006fd0 tx=0x7f1cd80057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1585553008 reap_dead start 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1585553008 shutdown_connections 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1585553008 >> 172.21.15.50:0/1585553008 conn(0x7f1cec069880 msgr2=0x7f1cec069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1585553008 shutdown_connections 2023-08-10T10:39:12.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.350+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1585553008 wait complete. 2023-08-10T10:39:12.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.352+0000 7f1cf30c2640 1 Processor -- start 2023-08-10T10:39:12.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.352+0000 7f1cf30c2640 1 -- start start 2023-08-10T10:39:12.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd80039e0 0x7f1cec0d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cec0c9970 0x7f1cec0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0a9250 con 0x7f1cec0cd120 2023-08-10T10:39:12.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cab40 con 0x7f1cec0c9970 2023-08-10T10:39:12.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf30c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c9f30 con 0x7f1cd80039e0 2023-08-10T10:39:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf28c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf28c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49416/0 (socket says 172.21.15.50:49416) 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1668982569 learned_addr learned my addr 172.21.15.50:0/1668982569 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.353+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd80039e0 0x7f1cec0d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf18bf640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cec0c9970 0x7f1cec0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd80039e0 msgr2=0x7f1cec0d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd80039e0 0x7f1cec0d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cec0c9970 msgr2=0x7f1cec0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cec0c9970 0x7f1cec0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 -- 172.21.15.50:0/1668982569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0ca210 con 0x7f1cec0cd120 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf28c1640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cec08b960 tx=0x7f1ce4007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400e9e0 con 0x7f1cec0cd120 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400eb40 con 0x7f1cec0cd120 2023-08-10T10:39:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4013420 con 0x7f1cec0cd120 2023-08-10T10:39:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.354+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0ca4f0 con 0x7f1cec0cd120 2023-08-10T10:39:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.355+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec0d3630 con 0x7f1cec0cd120 2023-08-10T10:39:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.356+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0cacd0 con 0x7f1cec0cd120 2023-08-10T10:39:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.357+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ce4013580 con 0x7f1cec0cd120 2023-08-10T10:39:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.358+0000 7f1ce2ffd640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 0x7f1cd006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.358+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ce40898e0 con 0x7f1cec0cd120 2023-08-10T10:39:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.358+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 0x7f1cd006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.359+0000 7f1cf20c0640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 0x7f1cd006d110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8036000 tx=0x7f1ce8031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.362+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ce4054820 con 0x7f1cec0cd120 2023-08-10T10:39:12.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.556+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cec066e30 con 0x7f1cec0cd120 2023-08-10T10:39:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.558+0000 7f1ce2ffd640 1 -- 172.21.15.50:0/1668982569 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f1ce4057e40 con 0x7f1cec0cd120 2023-08-10T10:39:12.560 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:12.560 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 msgr2=0x7f1cd006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 0x7f1cd006d110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8036000 tx=0x7f1ce8031000 comp rx=0 tx=0).stop 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 msgr2=0x7f1cec0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cec08b960 tx=0x7f1ce4007af0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 shutdown_connections 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cec0cd120 0x7f1cec0b0450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cd006ac50 0x7f1cd006d110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cec0c9970 0x7f1cec0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 --2- 172.21.15.50:0/1668982569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd80039e0 0x7f1cec0d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 >> 172.21.15.50:0/1668982569 conn(0x7f1cec069880 msgr2=0x7f1cec069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 shutdown_connections 2023-08-10T10:39:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.561+0000 7f1cf30c2640 1 -- 172.21.15.50:0/1668982569 wait complete. 2023-08-10T10:39:12.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:12.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.811+0000 7ffa06767640 1 Processor -- start 2023-08-10T10:39:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.811+0000 7ffa06767640 1 -- start start 2023-08-10T10:39:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.812+0000 7ffa06767640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa00160300 0x7ffa0006a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.812+0000 7ffa06767640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0006aa90 con 0x7ffa0006a5f0 2023-08-10T10:39:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.812+0000 7ffa06767640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0006ad70 con 0x7ffa000cd8d0 2023-08-10T10:39:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.812+0000 7ffa06767640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0006b050 con 0x7ffa00160300 2023-08-10T10:39:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.813+0000 7ffa04f64640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffa0006a5f0 0x7ffa000cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44086/0 (socket says 172.21.15.50:44086) 2023-08-10T10:39:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.813+0000 7ffa04f64640 1 -- 172.21.15.50:0/300603769 learned_addr learned my addr 172.21.15.50:0/300603769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.813+0000 7ffa05765640 1 --2- 172.21.15.50:0/300603769 >> v2:172.21.15.117:3300/0 conn(0x7ffa00160300 0x7ffa0006a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.813+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600584241 0 0) 0x7ffa0006aa90 con 0x7ffa0006a5f0 2023-08-10T10:39:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.813+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ec003520 con 0x7ffa0006a5f0 2023-08-10T10:39:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698075953 0 0) 0x7ff9ec003520 con 0x7ffa0006a5f0 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 >> v2:172.21.15.117:3300/0 conn(0x7ffa00160300 msgr2=0x7ffa0006a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 --2- 172.21.15.50:0/300603769 >> v2:172.21.15.117:3300/0 conn(0x7ffa00160300 0x7ffa0006a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 >> v1:172.21.15.117:6789/0 conn(0x7ffa000cd8d0 legacy=0x7ffa000b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa000b5dd0 con 0x7ffa0006a5f0 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff9f0001670 con 0x7ffa0006a5f0 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 >> v1:172.21.15.50:6789/0 conn(0x7ffa0006a5f0 legacy=0x7ffa000cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 0x7ff9ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0047c0 0x7ff9ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9ec005180 0x7ff9ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0006b050 con 0x7ff9ec0039e0 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec00c000 con 0x7ff9ec0047c0 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec00c1c0 con 0x7ff9ec005180 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.814+0000 7ffa05765640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 0x7ff9ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05765640 1 -- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9ec005180 msgr2=0x7ff9ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05f66640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9ec005180 0x7ff9ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05765640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9ec005180 0x7ff9ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05765640 1 -- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0047c0 msgr2=0x7ff9ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05765640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0047c0 0x7ff9ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05765640 1 -- 172.21.15.50:0/300603769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec003520 con 0x7ff9ec0039e0 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05f66640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9ec005180 0x7ff9ec00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.815+0000 7ffa05f66640 1 -- 172.21.15.50:0/300603769 reap_dead start 2023-08-10T10:39:12.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.816+0000 7ffa05765640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 0x7ff9ec003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009ac0 tx=0x7ff9ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c9c90262343287 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.816+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc02c6b0 con 0x7ff9ec0039e0 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.816+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc02c810 con 0x7ff9ec0039e0 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.816+0000 7ff9f7fff640 1 -- 172.21.15.50:0/300603769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc02cba0 con 0x7ff9ec0039e0 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 -- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 msgr2=0x7ff9ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 0x7ff9ec003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009ac0 tx=0x7ff9ec0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 -- 172.21.15.50:0/300603769 shutdown_connections 2023-08-10T10:39:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 --2- 172.21.15.50:0/300603769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9ec0039e0 0x7ff9ec003dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 -- 172.21.15.50:0/300603769 >> 172.21.15.50:0/300603769 conn(0x7ffa000d2960 msgr2=0x7ffa000d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 -- 172.21.15.50:0/300603769 shutdown_connections 2023-08-10T10:39:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.817+0000 7ffa06767640 1 -- 172.21.15.50:0/300603769 wait complete. 2023-08-10T10:39:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.819+0000 7ffa06767640 1 Processor -- start 2023-08-10T10:39:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.819+0000 7ffa06767640 1 -- start start 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0039e0 0x7ffa000c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0015cd70 0x7ffa00147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00147590 con 0x7ffa0015e2a0 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0015d200 con 0x7ff9ec0039e0 2023-08-10T10:39:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa06767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0015d4e0 con 0x7ffa0015cd70 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa05f66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa05f66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49426/0 (socket says 172.21.15.50:49426) 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa05f66640 1 -- 172.21.15.50:0/3803001857 learned_addr learned my addr 172.21.15.50:0/3803001857 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa05765640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0039e0 0x7ffa000c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.821+0000 7ffa04f64640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0015cd70 0x7ffa00147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 -- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0015cd70 msgr2=0x7ffa00147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0015cd70 0x7ffa00147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 -- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0039e0 msgr2=0x7ffa000c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0039e0 0x7ffa000c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 -- 172.21.15.50:0/3803001857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0015d7c0 con 0x7ffa0015e2a0 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa05f66640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec004740 tx=0x7ff9f800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8003b70 con 0x7ffa0015e2a0 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f8003cd0 con 0x7ffa0015e2a0 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8005270 con 0x7ffa0015e2a0 2023-08-10T10:39:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.822+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0015daa0 con 0x7ffa0015e2a0 2023-08-10T10:39:12.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.823+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa00153340 con 0x7ffa0015e2a0 2023-08-10T10:39:12.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.824+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa00066e30 con 0x7ffa0015e2a0 2023-08-10T10:39:12.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.825+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9f80053d0 con 0x7ffa0015e2a0 2023-08-10T10:39:12.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.826+0000 7ff9f5ffb640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 0x7ff9e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:12.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.826+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff9f8088e30 con 0x7ffa0015e2a0 2023-08-10T10:39:12.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.826+0000 7ffa05765640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 0x7ff9e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:12.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.827+0000 7ffa05765640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 0x7ff9e406d110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc036000 tx=0x7ff9fc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:12.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:12.830+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9f8053f40 con 0x7ffa0015e2a0 2023-08-10T10:39:13.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.024+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa000caff0 con 0x7ffa0015e2a0 2023-08-10T10:39:13.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.026+0000 7ff9f5ffb640 1 -- 172.21.15.50:0/3803001857 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9f8018020 con 0x7ffa0015e2a0 2023-08-10T10:39:13.027 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:13.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 msgr2=0x7ff9e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 0x7ff9e406d110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc036000 tx=0x7ff9fc030000 comp rx=0 tx=0).stop 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 msgr2=0x7ffa0015ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec004740 tx=0x7ff9f800db60 comp rx=0 tx=0).stop 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 shutdown_connections 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa0015e2a0 0x7ffa0015ea80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0015cd70 0x7ffa00147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e406ac50 0x7ff9e406d110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 --2- 172.21.15.50:0/3803001857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9ec0039e0 0x7ffa000c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 >> 172.21.15.50:0/3803001857 conn(0x7ffa000d2960 msgr2=0x7ffa000d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:13.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 shutdown_connections 2023-08-10T10:39:13.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.028+0000 7ffa06767640 1 -- 172.21.15.50:0/3803001857 wait complete. 2023-08-10T10:39:13.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:13.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.281+0000 7f06436b8640 1 Processor -- start 2023-08-10T10:39:13.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.281+0000 7f06436b8640 1 -- start start 2023-08-10T10:39:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.282+0000 7f06436b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.282+0000 7f06436b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f063c1615e0 0x7f063c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f06436b8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c160a40 con 0x7f063c15cf70 2023-08-10T10:39:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f06436b8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0b4bb0 con 0x7f063c1615e0 2023-08-10T10:39:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f06436b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b4e90 con 0x7f063c15cb90 2023-08-10T10:39:13.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f0640c53640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f063c15cf70 0x7f063c160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44088/0 (socket says 172.21.15.50:44088) 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f0640c53640 1 -- 172.21.15.50:0/212337209 learned_addr learned my addr 172.21.15.50:0/212337209 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f0641454640 1 --2- 172.21.15.50:0/212337209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.283+0000 7f0641c55640 1 --2- 172.21.15.50:0/212337209 >> v2:172.21.15.117:3300/0 conn(0x7f063c1615e0 0x7f063c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857518488 0 0) 0x7f063c160a40 con 0x7f063c15cf70 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0628003520 con 0x7f063c15cf70 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044169164 0 0) 0x7f0628003520 con 0x7f063c15cf70 2023-08-10T10:39:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0641454640 1 -- 172.21.15.50:0/212337209 >> v2:172.21.15.117:3300/0 conn(0x7f063c1615e0 msgr2=0x7f063c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:13.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0641454640 1 --2- 172.21.15.50:0/212337209 >> v2:172.21.15.117:3300/0 conn(0x7f063c1615e0 0x7f063c06fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0641454640 1 -- 172.21.15.50:0/212337209 >> v1:172.21.15.50:6789/0 conn(0x7f063c15cf70 legacy=0x7f063c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.284+0000 7f0641454640 1 -- 172.21.15.50:0/212337209 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0b5170 con 0x7f063c15cb90 2023-08-10T10:39:13.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.285+0000 7f0641454640 1 --2- 172.21.15.50:0/212337209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c0b5dd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06380097a0 tx=0x7f063802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29129027df22d0fe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.286+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c001670 con 0x7f063c15cb90 2023-08-10T10:39:13.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.286+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063802e050 con 0x7f063c15cb90 2023-08-10T10:39:13.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.286+0000 7f0633fff640 1 -- 172.21.15.50:0/212337209 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638030730 con 0x7f063c15cb90 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 -- 172.21.15.50:0/212337209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 msgr2=0x7f063c0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 --2- 172.21.15.50:0/212337209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c0b5dd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06380097a0 tx=0x7f063802b790 comp rx=0 tx=0).stop 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 -- 172.21.15.50:0/212337209 shutdown_connections 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 --2- 172.21.15.50:0/212337209 >> v2:172.21.15.117:3300/0 conn(0x7f063c1615e0 0x7f063c06fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 --2- 172.21.15.50:0/212337209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c0b5dd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 -- 172.21.15.50:0/212337209 >> 172.21.15.50:0/212337209 conn(0x7f063c0cf640 msgr2=0x7f063c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 -- 172.21.15.50:0/212337209 shutdown_connections 2023-08-10T10:39:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.287+0000 7f06436b8640 1 -- 172.21.15.50:0/212337209 wait complete. 2023-08-10T10:39:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.289+0000 7f06436b8640 1 Processor -- start 2023-08-10T10:39:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.289+0000 7f06436b8640 1 -- start start 2023-08-10T10:39:13.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f063c15cf70 0x7f063c0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c1531e0 con 0x7f063c1615e0 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c6ff0 con 0x7f063c15cf70 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f06436b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c160560 con 0x7f063c15cb90 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f0641c55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f0641c55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49438/0 (socket says 172.21.15.50:49438) 2023-08-10T10:39:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.290+0000 7f0641c55640 1 -- 172.21.15.50:0/998222961 learned_addr learned my addr 172.21.15.50:0/998222961 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641454640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0640c53640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f063c15cf70 0x7f063c0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 -- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 msgr2=0x7f063c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 -- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f063c15cf70 msgr2=0x7f063c0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f063c15cf70 0x7f063c0cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 -- 172.21.15.50:0/998222961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638009400 con 0x7f063c1615e0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0641c55640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f063400ef90 tx=0x7f063400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634009b20 con 0x7f063c1615e0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400f040 con 0x7f063c1615e0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.291+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340146c0 con 0x7f063c1615e0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.292+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0c66c0 con 0x7f063c1615e0 2023-08-10T10:39:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.292+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0c6c80 con 0x7f063c1615e0 2023-08-10T10:39:13.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.293+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c0612b0 con 0x7f063c1615e0 2023-08-10T10:39:13.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.294+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0634014820 con 0x7f063c1615e0 2023-08-10T10:39:13.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.295+0000 7f0631ffb640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 0x7f062006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.295+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f063408a390 con 0x7f063c1615e0 2023-08-10T10:39:13.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.295+0000 7f0641454640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 0x7f062006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.296+0000 7f0641454640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 0x7f062006d140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0638034000 tx=0x7f063802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.299+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0634055360 con 0x7f063c1615e0 2023-08-10T10:39:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.492+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f063c0d11d0 con 0x7f063c1615e0 2023-08-10T10:39:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.493+0000 7f0631ffb640 1 -- 172.21.15.50:0/998222961 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0634009e60 con 0x7f063c1615e0 2023-08-10T10:39:13.494 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:13.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 msgr2=0x7f062006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 0x7f062006d140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0638034000 tx=0x7f063802f000 comp rx=0 tx=0).stop 2023-08-10T10:39:13.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 msgr2=0x7f063c0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f063400ef90 tx=0x7f063400c490 comp rx=0 tx=0).stop 2023-08-10T10:39:13.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 shutdown_connections 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c1615e0 0x7f063c0cb190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f062006ac80 0x7f062006d140 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f063c15cf70 0x7f063c0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 --2- 172.21.15.50:0/998222961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f063c15cb90 0x7f063c152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.495+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 >> 172.21.15.50:0/998222961 conn(0x7f063c0cf640 msgr2=0x7f063c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.496+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 shutdown_connections 2023-08-10T10:39:13.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.496+0000 7f06436b8640 1 -- 172.21.15.50:0/998222961 wait complete. 2023-08-10T10:39:13.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.744+0000 7fdbe0e77640 1 Processor -- start 2023-08-10T10:39:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.744+0000 7fdbe0e77640 1 -- start start 2023-08-10T10:39:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.745+0000 7fdbe0e77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbdc160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.745+0000 7fdbe0e77640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc160370 con 0x7fdbdc15ff90 2023-08-10T10:39:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbe0e77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0d0d90 con 0x7fdbdc0d28b0 2023-08-10T10:39:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbe0e77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0d0b90 con 0x7fdbdc0cd960 2023-08-10T10:39:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbdb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdbdc15ff90 0x7fdbdc0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44102/0 (socket says 172.21.15.50:44102) 2023-08-10T10:39:13.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbdb7fe640 1 -- 172.21.15.50:0/2747465586 learned_addr learned my addr 172.21.15.50:0/2747465586 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbdaffd640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbdc160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565688087 0 0) 0x7fdbcc001490 con 0x7fdbdc15ff90 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.746+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc8003520 con 0x7fdbdc15ff90 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192934711 0 0) 0x7fdbc8003520 con 0x7fdbdc15ff90 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 msgr2=0x7fdbdc160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbdc160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 >> v1:172.21.15.117:6789/0 conn(0x7fdbdc0d28b0 legacy=0x7fdbdc0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0d1070 con 0x7fdbdc15ff90 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fdbcc001b80 con 0x7fdbdc15ff90 2023-08-10T10:39:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 >> v1:172.21.15.50:6789/0 conn(0x7fdbdc15ff90 legacy=0x7fdbdc0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbc8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc8003f90 0x7fdbc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0d0b90 con 0x7fdbc8004d00 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc800bae0 con 0x7fdbc8003f90 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc800bca0 con 0x7fdbdc0cd960 2023-08-10T10:39:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.747+0000 7fdbdbfff640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdaffd640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc8003f90 0x7fdbc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdb7fe640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbc8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdbfff640 1 -- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 msgr2=0x7fdbc8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdbfff640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cd960 0x7fdbc8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdbfff640 1 -- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc8003f90 msgr2=0x7fdbc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdbfff640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc8003f90 0x7fdbc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.748+0000 7fdbdbfff640 1 -- 172.21.15.50:0/2747465586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8003520 con 0x7fdbc8004d00 2023-08-10T10:39:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.749+0000 7fdbdbfff640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbc8005180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001750 tx=0x7fdbc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464a0fb737747e98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.749+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40052d0 con 0x7fdbc8004d00 2023-08-10T10:39:13.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.749+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd402e050 con 0x7fdbc8004d00 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.749+0000 7fdbda7fc640 1 -- 172.21.15.50:0/2747465586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4003830 con 0x7fdbc8004d00 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 -- 172.21.15.50:0/2747465586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 msgr2=0x7fdbc8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/2747465586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbc8005180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001750 tx=0x7fdbc80057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbdbfff640 1 -- 172.21.15.50:0/2747465586 reap_dead start 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 -- 172.21.15.50:0/2747465586 shutdown_connections 2023-08-10T10:39:13.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 -- 172.21.15.50:0/2747465586 >> 172.21.15.50:0/2747465586 conn(0x7fdbdc069ac0 msgr2=0x7fdbdc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 -- 172.21.15.50:0/2747465586 shutdown_connections 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.750+0000 7fdbe0e77640 1 -- 172.21.15.50:0/2747465586 wait complete. 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.752+0000 7fdbe0e77640 1 Processor -- start 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.752+0000 7fdbe0e77640 1 -- start start 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cab30 0x7fdbdc0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc0c6970 0x7fdbdc0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0caf90 con 0x7fdbc8004d00 2023-08-10T10:39:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0c6df0 con 0x7fdbdc0c6970 2023-08-10T10:39:13.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbe0e77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15b5a0 con 0x7fdbdc0cab30 2023-08-10T10:39:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbdb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbdb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49456/0 (socket says 172.21.15.50:49456) 2023-08-10T10:39:13.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.753+0000 7fdbdb7fe640 1 -- 172.21.15.50:0/3856158745 learned_addr learned my addr 172.21.15.50:0/3856158745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdaffd640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cab30 0x7fdbdc0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdbfff640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc0c6970 0x7fdbdc0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 -- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cab30 msgr2=0x7fdbdc0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cab30 0x7fdbdc0c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 -- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc0c6970 msgr2=0x7fdbdc0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc0c6970 0x7fdbdc0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 -- 172.21.15.50:0/3856158745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0c9a90 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbdb7fe640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005fd0 tx=0x7fdbcc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00edf0 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc013420 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0137d0 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.754+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc0c9d70 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.755+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc0ca330 con 0x7fdbc8004d00 2023-08-10T10:39:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.756+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc066e30 con 0x7fdbc8004d00 2023-08-10T10:39:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.757+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbcc013930 con 0x7fdbc8004d00 2023-08-10T10:39:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.758+0000 7fdbd3fff640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 0x7fdbbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.758+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdbcc089c80 con 0x7fdbc8004d00 2023-08-10T10:39:13.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.758+0000 7fdbdaffd640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 0x7fdbbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:13.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.759+0000 7fdbdaffd640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 0x7fdbbc06d110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0c71d0 tx=0x7fdbc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.762+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdbcc054bc0 con 0x7fdbc8004d00 2023-08-10T10:39:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.950+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbdc160370 con 0x7fdbc8004d00 2023-08-10T10:39:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.951+0000 7fdbd3fff640 1 -- 172.21.15.50:0/3856158745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbdc160370 con 0x7fdbc8004d00 2023-08-10T10:39:13.953 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:13.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 msgr2=0x7fdbbc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 0x7fdbbc06d110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0c71d0 tx=0x7fdbc4008040 comp rx=0 tx=0).stop 2023-08-10T10:39:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 msgr2=0x7fdbdc1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005fd0 tx=0x7fdbcc00e530 comp rx=0 tx=0).stop 2023-08-10T10:39:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 shutdown_connections 2023-08-10T10:39:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbbc06ac50 0x7fdbbc06d110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc0c6970 0x7fdbdc0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0cab30 0x7fdbdc0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 --2- 172.21.15.50:0/3856158745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbc8004d00 0x7fdbdc1579c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.954+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 >> 172.21.15.50:0/3856158745 conn(0x7fdbdc069ac0 msgr2=0x7fdbdc0c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.955+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 shutdown_connections 2023-08-10T10:39:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:13.955+0000 7fdbe0e77640 1 -- 172.21.15.50:0/3856158745 wait complete. 2023-08-10T10:39:13.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:14.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.221+0000 7f3c79648640 1 Processor -- start 2023-08-10T10:39:14.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.221+0000 7f3c79648640 1 -- start start 2023-08-10T10:39:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.222+0000 7f3c79648640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c7415cb90 0x7f3c740b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.222+0000 7f3c79648640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cf70 0x7f3c74160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c79648640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c74160a40 con 0x7f3c740b4640 2023-08-10T10:39:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c79648640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c740b4bb0 con 0x7f3c7415cb90 2023-08-10T10:39:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c79648640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740b4e90 con 0x7f3c7415cf70 2023-08-10T10:39:14.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c72ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c7415cb90 0x7f3c740b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c727fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cf70 0x7f3c74160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c72ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c7415cb90 0x7f3c740b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:59808/0 (socket says 172.21.15.50:59808) 2023-08-10T10:39:14.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c737fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3c740b4640 0x7f3c7406fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:56514/0 (socket says 172.21.15.50:56514) 2023-08-10T10:39:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.223+0000 7f3c72ffd640 1 -- 172.21.15.50:0/4292931323 learned_addr learned my addr 172.21.15.50:0/4292931323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.224+0000 7f3c72ffd640 1 -- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cf70 msgr2=0x7f3c74160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.224+0000 7f3c72ffd640 1 --2- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cf70 0x7f3c74160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.224+0000 7f3c72ffd640 1 -- 172.21.15.50:0/4292931323 >> v1:172.21.15.117:6789/0 conn(0x7f3c740b4640 legacy=0x7f3c7406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.224+0000 7f3c72ffd640 1 -- 172.21.15.50:0/4292931323 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740b5170 con 0x7f3c7415cb90 2023-08-10T10:39:14.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.226+0000 7f3c72ffd640 1 --2- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cb90 0x7f3c740b5dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009e50 tx=0x7f3c6402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1cbf4954320fde0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.226+0000 7f3c71ffb640 1 -- 172.21.15.50:0/4292931323 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6402cb00 con 0x7f3c7415cb90 2023-08-10T10:39:14.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.226+0000 7f3c71ffb640 1 -- 172.21.15.50:0/4292931323 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6402cc60 con 0x7f3c7415cb90 2023-08-10T10:39:14.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.226+0000 7f3c71ffb640 1 -- 172.21.15.50:0/4292931323 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640343f0 con 0x7f3c7415cb90 2023-08-10T10:39:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 -- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cb90 msgr2=0x7f3c740b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 --2- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cb90 0x7f3c740b5dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009e50 tx=0x7f3c6402bf60 comp rx=0 tx=0).stop 2023-08-10T10:39:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 -- 172.21.15.50:0/4292931323 shutdown_connections 2023-08-10T10:39:14.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 --2- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cf70 0x7f3c74160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 --2- 172.21.15.50:0/4292931323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cb90 0x7f3c740b5dd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 -- 172.21.15.50:0/4292931323 >> 172.21.15.50:0/4292931323 conn(0x7f3c740cf640 msgr2=0x7f3c740cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:14.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 -- 172.21.15.50:0/4292931323 shutdown_connections 2023-08-10T10:39:14.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.227+0000 7f3c79648640 1 -- 172.21.15.50:0/4292931323 wait complete. 2023-08-10T10:39:14.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.230+0000 7f3c79648640 1 Processor -- start 2023-08-10T10:39:14.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.230+0000 7f3c79648640 1 -- start start 2023-08-10T10:39:14.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cb90 0x7f3c7415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 0x7f3c7415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7414a850 con 0x7f3c740b4640 2023-08-10T10:39:14.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7415d700 con 0x7f3c7415cf70 2023-08-10T10:39:14.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c79648640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7415d9e0 con 0x7f3c7415cb90 2023-08-10T10:39:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.231+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49460/0 (socket says 172.21.15.50:49460) 2023-08-10T10:39:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 -- 172.21.15.50:0/354134481 learned_addr learned my addr 172.21.15.50:0/354134481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c737fe640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 0x7f3c7415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c727fc640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cb90 0x7f3c7415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 -- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cb90 msgr2=0x7f3c7415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cb90 0x7f3c7415fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 -- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 msgr2=0x7f3c7415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 0x7f3c7415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 -- 172.21.15.50:0/354134481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009b30 con 0x7f3c740b4640 2023-08-10T10:39:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c737fe640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 0x7f3c7415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.232+0000 7f3c72ffd640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000f80 tx=0x7f3c64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.233+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64009510 con 0x7f3c740b4640 2023-08-10T10:39:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.233+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6403e450 con 0x7f3c740b4640 2023-08-10T10:39:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.233+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6403e800 con 0x7f3c740b4640 2023-08-10T10:39:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.233+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7415dcc0 con 0x7f3c740b4640 2023-08-10T10:39:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.233+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7415e280 con 0x7f3c740b4640 2023-08-10T10:39:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.234+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c740ce920 con 0x7f3c740b4640 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.235+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c6403e960 con 0x7f3c740b4640 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.236+0000 7f3c5b7fe640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 0x7f3c6006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.237+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c640ac280 con 0x7f3c740b4640 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.237+0000 7f3c727fc640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 0x7f3c6006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.238+0000 7f3c727fc640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 0x7f3c6006d110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c74157a90 tx=0x7f3c68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.241+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c64077260 con 0x7f3c740b4640 2023-08-10T10:39:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.432+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c740612b0 con 0x7f3c740b4640 2023-08-10T10:39:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.432+0000 7f3c5b7fe640 1 -- 172.21.15.50:0/354134481 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c6407a880 con 0x7f3c740b4640 2023-08-10T10:39:14.434 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 msgr2=0x7f3c6006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 0x7f3c6006d110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c74157a90 tx=0x7f3c68008040 comp rx=0 tx=0).stop 2023-08-10T10:39:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 msgr2=0x7f3c74146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000f80 tx=0x7f3c64004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 shutdown_connections 2023-08-10T10:39:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6006ac50 0x7f3c6006d110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c7415cf70 0x7f3c7415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c7415cb90 0x7f3c7415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 --2- 172.21.15.50:0/354134481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c740b4640 0x7f3c74146f10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 >> 172.21.15.50:0/354134481 conn(0x7f3c740cf640 msgr2=0x7f3c740d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 shutdown_connections 2023-08-10T10:39:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.435+0000 7f3c79648640 1 -- 172.21.15.50:0/354134481 wait complete. 2023-08-10T10:39:14.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:39:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.671+0000 7f0058c45640 1 Processor -- start 2023-08-10T10:39:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.671+0000 7f0058c45640 1 -- start start 2023-08-10T10:39:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00540696a0 0x7f00540b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f005415ad00 0x7f00540cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540b2280 con 0x7f005415ad00 2023-08-10T10:39:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540ce240 con 0x7f00540696a0 2023-08-10T10:39:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0058c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540b19e0 con 0x7f0054069a80 2023-08-10T10:39:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0052ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f005415ad00 0x7f00540cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.673+0000 7f0052ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f005415ad00 0x7f00540cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49462/0 (socket says 172.21.15.50:49462) 2023-08-10T10:39:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 -- 172.21.15.50:0/2334279558 learned_addr learned my addr 172.21.15.50:0/2334279558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:14.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f00537fe640 1 --2- 172.21.15.50:0/2334279558 >> v2:172.21.15.117:3300/0 conn(0x7f00540696a0 0x7f00540b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 -- 172.21.15.50:0/2334279558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 msgr2=0x7f00540ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:14.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0053fff640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 -- 172.21.15.50:0/2334279558 >> v2:172.21.15.117:3300/0 conn(0x7f00540696a0 msgr2=0x7f00540b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 --2- 172.21.15.50:0/2334279558 >> v2:172.21.15.117:3300/0 conn(0x7f00540696a0 0x7f00540b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0052ffd640 1 -- 172.21.15.50:0/2334279558 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540b1cc0 con 0x7f005415ad00 2023-08-10T10:39:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.674+0000 7f0053fff640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.675+0000 7f0052ffd640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540cdd00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f005406ce50 tx=0x7f004802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c06613bbda293c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.675+0000 7f00527fc640 1 -- 172.21.15.50:0/2334279558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480317f0 con 0x7f005415ad00 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.675+0000 7f00527fc640 1 -- 172.21.15.50:0/2334279558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0048031950 con 0x7f005415ad00 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.675+0000 7f00527fc640 1 -- 172.21.15.50:0/2334279558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048031ce0 con 0x7f005415ad00 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 -- 172.21.15.50:0/2334279558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 msgr2=0x7f00540cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540cdd00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f005406ce50 tx=0x7f004802b890 comp rx=0 tx=0).stop 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 -- 172.21.15.50:0/2334279558 shutdown_connections 2023-08-10T10:39:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 --2- 172.21.15.50:0/2334279558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540cdd00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 --2- 172.21.15.50:0/2334279558 >> v2:172.21.15.117:3300/0 conn(0x7f00540696a0 0x7f00540b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.676+0000 7f0058c45640 1 -- 172.21.15.50:0/2334279558 >> 172.21.15.50:0/2334279558 conn(0x7f00540cafa0 msgr2=0x7f00540cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.677+0000 7f0058c45640 1 -- 172.21.15.50:0/2334279558 shutdown_connections 2023-08-10T10:39:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.677+0000 7f0058c45640 1 -- 172.21.15.50:0/2334279558 wait complete. 2023-08-10T10:39:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.679+0000 7f0058c45640 1 Processor -- start 2023-08-10T10:39:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.679+0000 7f0058c45640 1 -- start start 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00540696a0 0x7f0054150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c9e60 con 0x7f005415ad00 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540ca140 con 0x7f00540696a0 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.680+0000 7f0058c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540ca420 con 0x7f0054069a80 2023-08-10T10:39:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49470/0 (socket says 172.21.15.50:49470) 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 -- 172.21.15.50:0/2682322581 learned_addr learned my addr 172.21.15.50:0/2682322581 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0052ffd640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f00537fe640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00540696a0 0x7f0054150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 -- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 msgr2=0x7f00540c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 -- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00540696a0 msgr2=0x7f0054150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00540696a0 0x7f0054150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.681+0000 7f0053fff640 1 -- 172.21.15.50:0/2682322581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480094d0 con 0x7f005415ad00 2023-08-10T10:39:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f0053fff640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cef0 tx=0x7f004c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00d840 con 0x7f005415ad00 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00d9c0 con 0x7f005415ad00 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540ca700 con 0x7f005415ad00 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00dd70 con 0x7f005415ad00 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.682+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005406e9d0 con 0x7f005415ad00 2023-08-10T10:39:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.683+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00540ca940 con 0x7f005415ad00 2023-08-10T10:39:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.685+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f004c01e3b0 con 0x7f005415ad00 2023-08-10T10:39:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.686+0000 7f003bfff640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 0x7f004006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.686+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f004c08a0e0 con 0x7f005415ad00 2023-08-10T10:39:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.686+0000 7f00537fe640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 0x7f004006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.687+0000 7f00537fe640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 0x7f004006d110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0044006fd0 tx=0x7f0044008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.690+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00540ca940 con 0x7f005415ad00 2023-08-10T10:39:14.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.889+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00540ca940 con 0x7f005415ad00 2023-08-10T10:39:14.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.889+0000 7f003bfff640 1 -- 172.21.15.50:0/2682322581 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00540ca940 con 0x7f005415ad00 2023-08-10T10:39:14.892 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:39:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 msgr2=0x7f004006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 0x7f004006d110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0044006fd0 tx=0x7f0044008040 comp rx=0 tx=0).stop 2023-08-10T10:39:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 msgr2=0x7f00540ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cef0 tx=0x7f004c00a710 comp rx=0 tx=0).stop 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 shutdown_connections 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005415ad00 0x7f00540ac890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0054069a80 0x7f00540c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f004006ac50 0x7f004006d110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 --2- 172.21.15.50:0/2682322581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00540696a0 0x7f0054150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 >> 172.21.15.50:0/2682322581 conn(0x7f00540cafa0 msgr2=0x7f00540af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 shutdown_connections 2023-08-10T10:39:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:14.893+0000 7f0058c45640 1 -- 172.21.15.50:0/2682322581 wait complete. 2023-08-10T10:39:14.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:39:14.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:14.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-10T10:39:15.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:39:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:15.041 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:39:15.107 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:15.108 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:15.168 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:15.168 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:15.225 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:15.226 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:15.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:15.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.510+0000 7f8449fca640 1 Processor -- start 2023-08-10T10:39:15.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.511+0000 7f8449fca640 1 -- start start 2023-08-10T10:39:15.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84440c9d00 0x7f844415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f844415e0f0 0x7f84440cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84440b4170 con 0x7f844415e0f0 2023-08-10T10:39:15.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84440cc5a0 con 0x7f84440c9d00 2023-08-10T10:39:15.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.512+0000 7f8449fca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844415d720 con 0x7f8444159830 2023-08-10T10:39:15.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f844415e0f0 0x7f84440cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f844415e0f0 0x7f84440cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39496/0 (socket says 172.21.15.50:39496) 2023-08-10T10:39:15.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 -- 172.21.15.50:0/1507706889 learned_addr learned my addr 172.21.15.50:0/1507706889 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f8448fc8640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f8443fff640 1 --2- 172.21.15.50:0/1507706889 >> v2:172.21.15.117:3300/0 conn(0x7f84440c9d00 0x7f844415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 -- 172.21.15.50:0/1507706889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 msgr2=0x7f84440cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 -- 172.21.15.50:0/1507706889 >> v2:172.21.15.117:3300/0 conn(0x7f84440c9d00 msgr2=0x7f844415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:15.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 --2- 172.21.15.50:0/1507706889 >> v2:172.21.15.117:3300/0 conn(0x7f84440c9d00 0x7f844415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.513+0000 7f84497c9640 1 -- 172.21.15.50:0/1507706889 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444159c10 con 0x7f844415e0f0 2023-08-10T10:39:15.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.514+0000 7f84497c9640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f844415e0f0 0x7f84440cd290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f844406bc30 tx=0x7f843c02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ba8cd255ff2fd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:15.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f84437fe640 1 -- 172.21.15.50:0/1507706889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c02ec90 con 0x7f844415e0f0 2023-08-10T10:39:15.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f84437fe640 1 -- 172.21.15.50:0/1507706889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c02edf0 con 0x7f844415e0f0 2023-08-10T10:39:15.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f84437fe640 1 -- 172.21.15.50:0/1507706889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c036610 con 0x7f844415e0f0 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 -- 172.21.15.50:0/1507706889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f844415e0f0 msgr2=0x7f84440cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f844415e0f0 0x7f84440cd290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f844406bc30 tx=0x7f843c02e0f0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 -- 172.21.15.50:0/1507706889 shutdown_connections 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f844415e0f0 0x7f84440cd290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 --2- 172.21.15.50:0/1507706889 >> v2:172.21.15.117:3300/0 conn(0x7f84440c9d00 0x7f844415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 --2- 172.21.15.50:0/1507706889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.515+0000 7f8449fca640 1 -- 172.21.15.50:0/1507706889 >> 172.21.15.50:0/1507706889 conn(0x7f844406ab80 msgr2=0x7f844406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.516+0000 7f8449fca640 1 -- 172.21.15.50:0/1507706889 shutdown_connections 2023-08-10T10:39:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.516+0000 7f8449fca640 1 -- 172.21.15.50:0/1507706889 wait complete. 2023-08-10T10:39:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.517+0000 7f8449fca640 1 Processor -- start 2023-08-10T10:39:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.517+0000 7f8449fca640 1 -- start start 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.518+0000 7f8449fca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.518+0000 7f8449fca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8449fca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84440c5560 0x7f8444157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8449fca640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440c3660 con 0x7f84440c9d00 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8449fca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440c67c0 con 0x7f84440c5560 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8449fca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84441f25f0 con 0x7f8444159830 2023-08-10T10:39:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39502/0 (socket says 172.21.15.50:39502) 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 -- 172.21.15.50:0/2420870257 learned_addr learned my addr 172.21.15.50:0/2420870257 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8443fff640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 -- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 msgr2=0x7f84440c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 -- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84440c5560 msgr2=0x7f8444157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84440c5560 0x7f8444157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8448fc8640 1 -- 172.21.15.50:0/2420870257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009b30 con 0x7f84440c9d00 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.519+0000 7f8443fff640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f8448fc8640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f843800d5f0 tx=0x7f843800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380125f0 con 0x7f84440c9d00 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438012750 con 0x7f84440c9d00 2023-08-10T10:39:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438012b00 con 0x7f84440c9d00 2023-08-10T10:39:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84440c69f0 con 0x7f84440c9d00 2023-08-10T10:39:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.520+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84441f2b70 con 0x7f84440c9d00 2023-08-10T10:39:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.521+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84441f2d00 con 0x7f84440c9d00 2023-08-10T10:39:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.522+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8438012c60 con 0x7f84440c9d00 2023-08-10T10:39:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.524+0000 7f84417fa640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 0x7f842806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.524+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8438089a90 con 0x7f84440c9d00 2023-08-10T10:39:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.524+0000 7f8443fff640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 0x7f842806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.525+0000 7f8443fff640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 0x7f842806d110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8430006fd0 tx=0x7f8430008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:15.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.528+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8438054a60 con 0x7f84440c9d00 2023-08-10T10:39:15.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.727+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8444066e30 con 0x7f84440c9d00 2023-08-10T10:39:15.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.730+0000 7f84417fa640 1 -- 172.21.15.50:0/2420870257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f8438058080 con 0x7f84440c9d00 2023-08-10T10:39:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:15.732 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:15.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 msgr2=0x7f842806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 0x7f842806d110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8430006fd0 tx=0x7f8430008040 comp rx=0 tx=0).stop 2023-08-10T10:39:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 msgr2=0x7f84441f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f843800d5f0 tx=0x7f843800dab0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 shutdown_connections 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f842806ac50 0x7f842806d110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84440c5560 0x7f8444157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.732+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8444159830 0x7f84440c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.733+0000 7f8449fca640 1 --2- 172.21.15.50:0/2420870257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84440c9d00 0x7f84441f3090 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.733+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 >> 172.21.15.50:0/2420870257 conn(0x7f844406ab80 msgr2=0x7f84440ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:15.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.733+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 shutdown_connections 2023-08-10T10:39:15.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.733+0000 7f8449fca640 1 -- 172.21.15.50:0/2420870257 wait complete. 2023-08-10T10:39:15.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:15.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.982+0000 7f703ab78640 1 Processor -- start 2023-08-10T10:39:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.983+0000 7f703ab78640 1 -- start start 2023-08-10T10:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.984+0000 7f703ab78640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70340718a0 0x7f70340ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f703ab78640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340cca70 con 0x7f70340af9b0 2023-08-10T10:39:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f703ab78640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340cf8a0 con 0x7f7034070d00 2023-08-10T10:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f703ab78640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340cfb80 con 0x7f70340718a0 2023-08-10T10:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f702bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70340718a0 0x7f70340ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f702bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70340718a0 0x7f70340ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39512/0 (socket says 172.21.15.50:39512) 2023-08-10T10:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f702bfff640 1 -- 172.21.15.50:0/2790777810 learned_addr learned my addr 172.21.15.50:0/2790777810 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f7039115640 1 --1- 172.21.15.50:0/2790777810 >> v1:172.21.15.50:6789/0 conn(0x7f70340af9b0 0x7f70340cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41124/0 (socket says 172.21.15.50:41124) 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.985+0000 7f702bfff640 1 -- 172.21.15.50:0/2790777810 >> v1:172.21.15.117:6789/0 conn(0x7f7034070d00 legacy=0x7f70340710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.986+0000 7f702bfff640 1 -- 172.21.15.50:0/2790777810 >> v1:172.21.15.50:6789/0 conn(0x7f70340af9b0 legacy=0x7f70340cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.986+0000 7f702bfff640 1 -- 172.21.15.50:0/2790777810 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340b3280 con 0x7f70340718a0 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.986+0000 7f702b7fe640 1 -- 172.21.15.50:0/2790777810 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593979356 0 0) 0x7f70340cca70 con 0x7f70340af9b0 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.987+0000 7f702bfff640 1 --2- 172.21.15.50:0/2790777810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f70340ccf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7024009870 tx=0x7f702402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad266750b42393b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:15.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.987+0000 7f702b7fe640 1 -- 172.21.15.50:0/2790777810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024030860 con 0x7f70340718a0 2023-08-10T10:39:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.987+0000 7f702b7fe640 1 -- 172.21.15.50:0/2790777810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70240309c0 con 0x7f70340718a0 2023-08-10T10:39:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.987+0000 7f702b7fe640 1 -- 172.21.15.50:0/2790777810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024030d50 con 0x7f70340718a0 2023-08-10T10:39:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 -- 172.21.15.50:0/2790777810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 msgr2=0x7f70340ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 --2- 172.21.15.50:0/2790777810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f70340ccf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7024009870 tx=0x7f702402b9a0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 -- 172.21.15.50:0/2790777810 shutdown_connections 2023-08-10T10:39:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 --2- 172.21.15.50:0/2790777810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f70340ccf00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 -- 172.21.15.50:0/2790777810 >> 172.21.15.50:0/2790777810 conn(0x7f70340b23e0 msgr2=0x7f70340b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 -- 172.21.15.50:0/2790777810 shutdown_connections 2023-08-10T10:39:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.988+0000 7f703ab78640 1 -- 172.21.15.50:0/2790777810 wait complete. 2023-08-10T10:39:15.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.990+0000 7f703ab78640 1 Processor -- start 2023-08-10T10:39:15.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.990+0000 7f703ab78640 1 -- start start 2023-08-10T10:39:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7034070d00 0x7f7034154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70340af9b0 0x7f70340ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340c9fb0 con 0x7f70340718a0 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340c8d20 con 0x7f7034070d00 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f703ab78640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340c9330 con 0x7f70340af9b0 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f702bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f702bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39526/0 (socket says 172.21.15.50:39526) 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f702bfff640 1 -- 172.21.15.50:0/157571888 learned_addr learned my addr 172.21.15.50:0/157571888 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f7039115640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70340af9b0 0x7f70340ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.991+0000 7f7038914640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7034070d00 0x7f7034154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 -- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70340af9b0 msgr2=0x7f70340ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70340af9b0 0x7f70340ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 -- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7034070d00 msgr2=0x7f7034154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7034070d00 0x7f7034154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 -- 172.21.15.50:0/157571888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240094d0 con 0x7f70340718a0 2023-08-10T10:39:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f702bfff640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f70240090b0 tx=0x7f7024004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702403e040 con 0x7f70340718a0 2023-08-10T10:39:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024039da0 con 0x7f70340718a0 2023-08-10T10:39:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024004270 con 0x7f70340718a0 2023-08-10T10:39:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.992+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70340c9610 con 0x7f70340718a0 2023-08-10T10:39:15.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.993+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70340c9bd0 con 0x7f70340718a0 2023-08-10T10:39:15.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.994+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70340ca0f0 con 0x7f70340718a0 2023-08-10T10:39:15.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.995+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70240043d0 con 0x7f70340718a0 2023-08-10T10:39:15.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.996+0000 7f70297fa640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 0x7f702006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:15.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.996+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f70240abb70 con 0x7f70340718a0 2023-08-10T10:39:15.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.996+0000 7f7038914640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 0x7f702006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:15.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:15.997+0000 7f7038914640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 0x7f702006d110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7030000f60 tx=0x7f7030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.000+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f70340ca0f0 con 0x7f70340718a0 2023-08-10T10:39:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.192+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70340ca0f0 con 0x7f70340718a0 2023-08-10T10:39:16.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.193+0000 7f70297fa640 1 -- 172.21.15.50:0/157571888 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70340ca0f0 con 0x7f70340718a0 2023-08-10T10:39:16.194 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 msgr2=0x7f702006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 0x7f702006d110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7030000f60 tx=0x7f7030009040 comp rx=0 tx=0).stop 2023-08-10T10:39:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 msgr2=0x7f703415d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f70240090b0 tx=0x7f7024004730 comp rx=0 tx=0).stop 2023-08-10T10:39:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 shutdown_connections 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70340af9b0 0x7f70340ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70340718a0 0x7f703415d940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702006ac50 0x7f702006d110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 --2- 172.21.15.50:0/157571888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7034070d00 0x7f7034154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 >> 172.21.15.50:0/157571888 conn(0x7f70340b23e0 msgr2=0x7f70340cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.195+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 shutdown_connections 2023-08-10T10:39:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.196+0000 7f703ab78640 1 -- 172.21.15.50:0/157571888 wait complete. 2023-08-10T10:39:16.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:16.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.461+0000 7f185f9e1640 1 Processor -- start 2023-08-10T10:39:16.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.461+0000 7f185f9e1640 1 -- start start 2023-08-10T10:39:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185f9e1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f185815cf70 0x7f1858160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185f9e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f1858161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185f9e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1858160a40 con 0x7f185815cb90 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185f9e1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18580b4bb0 con 0x7f185815cf70 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185f9e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18580b4e90 con 0x7f18580b4640 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185cf7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f185815cf70 0x7f1858160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185cf7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f185815cf70 0x7f1858160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39540/0 (socket says 172.21.15.50:39540) 2023-08-10T10:39:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185cf7c640 1 -- 172.21.15.50:0/12481165 learned_addr learned my addr 172.21.15.50:0/12481165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.463+0000 7f185df7e640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f1858161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.464+0000 7f185cf7c640 1 -- 172.21.15.50:0/12481165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 msgr2=0x7f1858161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.464+0000 7f185cf7c640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f1858161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.464+0000 7f185cf7c640 1 -- 172.21.15.50:0/12481165 >> v1:172.21.15.117:6789/0 conn(0x7f185815cb90 legacy=0x7f18580b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.464+0000 7f185cf7c640 1 -- 172.21.15.50:0/12481165 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580b5170 con 0x7f185815cf70 2023-08-10T10:39:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.465+0000 7f185cf7c640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cf70 0x7f1858160ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1848009870 tx=0x7f184802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95faaea121d542ec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.465+0000 7f184ffff640 1 -- 172.21.15.50:0/12481165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848031640 con 0x7f185815cf70 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.465+0000 7f184ffff640 1 -- 172.21.15.50:0/12481165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18480317a0 con 0x7f185815cf70 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.465+0000 7f184ffff640 1 -- 172.21.15.50:0/12481165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848031b30 con 0x7f185815cf70 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 -- 172.21.15.50:0/12481165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cf70 msgr2=0x7f1858160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cf70 0x7f1858160ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1848009870 tx=0x7f184802b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 -- 172.21.15.50:0/12481165 shutdown_connections 2023-08-10T10:39:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f1858161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 --2- 172.21.15.50:0/12481165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cf70 0x7f1858160ed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 -- 172.21.15.50:0/12481165 >> 172.21.15.50:0/12481165 conn(0x7f18580cf640 msgr2=0x7f18580cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 -- 172.21.15.50:0/12481165 shutdown_connections 2023-08-10T10:39:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.466+0000 7f185f9e1640 1 -- 172.21.15.50:0/12481165 wait complete. 2023-08-10T10:39:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.468+0000 7f185f9e1640 1 Processor -- start 2023-08-10T10:39:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.468+0000 7f185f9e1640 1 -- start start 2023-08-10T10:39:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f185815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185815cf70 0x7f1858158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185815a2a0 con 0x7f185815cb90 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185815e730 con 0x7f185815cf70 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185f9e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185815ea10 con 0x7f18580b4640 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185cf7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185cf7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39556/0 (socket says 172.21.15.50:39556) 2023-08-10T10:39:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.469+0000 7f185cf7c640 1 -- 172.21.15.50:0/4129971325 learned_addr learned my addr 172.21.15.50:0/4129971325 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185d77d640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f185815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 -- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 msgr2=0x7f185815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f185815e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185df7e640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185815cf70 0x7f1858158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 -- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185815cf70 msgr2=0x7f1858158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185815cf70 0x7f1858158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 -- 172.21.15.50:0/4129971325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480094d0 con 0x7f185815cb90 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f185cf7c640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f18480090b0 tx=0x7f18480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.470+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184803ac60 con 0x7f185815cb90 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.471+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184803ade0 con 0x7f185815cb90 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.471+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185815ecf0 con 0x7f185815cb90 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.471+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848044630 con 0x7f185815cb90 2023-08-10T10:39:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.471+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1858154720 con 0x7f185815cb90 2023-08-10T10:39:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.472+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185815a410 con 0x7f185815cb90 2023-08-10T10:39:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.473+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f184802f050 con 0x7f185815cb90 2023-08-10T10:39:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.474+0000 7f184dffb640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 0x7f183c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.474+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f18480ab420 con 0x7f185815cb90 2023-08-10T10:39:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.474+0000 7f185d77d640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 0x7f183c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.475+0000 7f185d77d640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 0x7f183c06d110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1854007fd0 tx=0x7f1854009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.478+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f18480764a0 con 0x7f185815cb90 2023-08-10T10:39:16.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.676+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18580612b0 con 0x7f185815cb90 2023-08-10T10:39:16.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.677+0000 7f184dffb640 1 -- 172.21.15.50:0/4129971325 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1848079ac0 con 0x7f185815cb90 2023-08-10T10:39:16.679 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:16.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 msgr2=0x7f183c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 0x7f183c06d110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1854007fd0 tx=0x7f1854009040 comp rx=0 tx=0).stop 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 msgr2=0x7f18581541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f18480090b0 tx=0x7f18480046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 shutdown_connections 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f183c06ac50 0x7f183c06d110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185815cf70 0x7f1858158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185815cb90 0x7f18581541e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 --2- 172.21.15.50:0/4129971325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18580b4640 0x7f185815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 >> 172.21.15.50:0/4129971325 conn(0x7f18580cf640 msgr2=0x7f18580c8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 shutdown_connections 2023-08-10T10:39:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.680+0000 7f185f9e1640 1 -- 172.21.15.50:0/4129971325 wait complete. 2023-08-10T10:39:16.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:16.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.926+0000 7fac2359e640 1 Processor -- start 2023-08-10T10:39:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.926+0000 7fac2359e640 1 -- start start 2023-08-10T10:39:16.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac2359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cb2f0 0x7fac24072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac2359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240cb780 con 0x7fac240aedd0 2023-08-10T10:39:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac2359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240cbf70 con 0x7fac240ae9f0 2023-08-10T10:39:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac2359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac240cb9b0 con 0x7fac240cb2f0 2023-08-10T10:39:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac22d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cb2f0 0x7fac24072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac22d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cb2f0 0x7fac24072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39564/0 (socket says 172.21.15.50:39564) 2023-08-10T10:39:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac22d9d640 1 -- 172.21.15.50:0/194363871 learned_addr learned my addr 172.21.15.50:0/194363871 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.928+0000 7fac19d9b640 1 --1- 172.21.15.50:0/194363871 >> v1:172.21.15.50:6789/0 conn(0x7fac240aedd0 0x7fac2406aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41130/0 (socket says 172.21.15.50:41130) 2023-08-10T10:39:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.929+0000 7fac22d9d640 1 -- 172.21.15.50:0/194363871 >> v1:172.21.15.117:6789/0 conn(0x7fac240ae9f0 legacy=0x7fac24070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.929+0000 7fac22d9d640 1 -- 172.21.15.50:0/194363871 >> v1:172.21.15.50:6789/0 conn(0x7fac240aedd0 legacy=0x7fac2406aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.929+0000 7fac22d9d640 1 -- 172.21.15.50:0/194363871 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240cbc90 con 0x7fac240cb2f0 2023-08-10T10:39:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.929+0000 7fac21d9b640 1 -- 172.21.15.50:0/194363871 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547843097 0 0) 0x7fac240cb780 con 0x7fac240aedd0 2023-08-10T10:39:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.930+0000 7fac22d9d640 1 --2- 172.21.15.50:0/194363871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cb2f0 0x7fac24072730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009e50 tx=0x7fac1c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c87470b589f03c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.930+0000 7fac21d9b640 1 -- 172.21.15.50:0/194363871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c02cb10 con 0x7fac240cb2f0 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.930+0000 7fac21d9b640 1 -- 172.21.15.50:0/194363871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c02cc70 con 0x7fac240cb2f0 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.930+0000 7fac21d9b640 1 -- 172.21.15.50:0/194363871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0343f0 con 0x7fac240cb2f0 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 -- 172.21.15.50:0/194363871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cb2f0 msgr2=0x7fac24072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 --2- 172.21.15.50:0/194363871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cb2f0 0x7fac24072730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009e50 tx=0x7fac1c02bf70 comp rx=0 tx=0).stop 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 -- 172.21.15.50:0/194363871 shutdown_connections 2023-08-10T10:39:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 --2- 172.21.15.50:0/194363871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cb2f0 0x7fac24072730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 -- 172.21.15.50:0/194363871 >> 172.21.15.50:0/194363871 conn(0x7fac240cf8a0 msgr2=0x7fac240cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 -- 172.21.15.50:0/194363871 shutdown_connections 2023-08-10T10:39:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.931+0000 7fac2359e640 1 -- 172.21.15.50:0/194363871 wait complete. 2023-08-10T10:39:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.933+0000 7fac2359e640 1 Processor -- start 2023-08-10T10:39:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.933+0000 7fac2359e640 1 -- start start 2023-08-10T10:39:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 0x7fac24157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac240cb2f0 0x7fac24159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241560a0 con 0x7fac240ae9f0 2023-08-10T10:39:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241f3060 con 0x7fac240aedd0 2023-08-10T10:39:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac241efc90 con 0x7fac240cb2f0 2023-08-10T10:39:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39574/0 (socket says 172.21.15.50:39574) 2023-08-10T10:39:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 -- 172.21.15.50:0/3943632404 learned_addr learned my addr 172.21.15.50:0/3943632404 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 -- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac240cb2f0 msgr2=0x7fac24159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac240cb2f0 0x7fac24159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac2259c640 1 -- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 msgr2=0x7fac24157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.934+0000 7fac19d9b640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 0x7fac24157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac2259c640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 0x7fac24157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac2259c640 1 -- 172.21.15.50:0/3943632404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009b30 con 0x7fac240ae9f0 2023-08-10T10:39:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac19d9b640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 0x7fac24157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac2259c640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c450 tx=0x7fac1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140052d0 con 0x7fac240ae9f0 2023-08-10T10:39:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14005430 con 0x7fac240ae9f0 2023-08-10T10:39:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14003830 con 0x7fac240ae9f0 2023-08-10T10:39:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24155520 con 0x7fac240ae9f0 2023-08-10T10:39:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.935+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac24155ae0 con 0x7fac240ae9f0 2023-08-10T10:39:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.936+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac241efe30 con 0x7fac240ae9f0 2023-08-10T10:39:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.938+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac14003990 con 0x7fac240ae9f0 2023-08-10T10:39:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.939+0000 7fac1b7fe640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 0x7fac04071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.939+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fac14088b80 con 0x7fac240ae9f0 2023-08-10T10:39:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.939+0000 7fac19d9b640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 0x7fac04071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.940+0000 7fac19d9b640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 0x7fac04071520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac240cd7e0 tx=0x7fac0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:16.943+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac241efe30 con 0x7fac240ae9f0 2023-08-10T10:39:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.143+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac24066e30 con 0x7fac240ae9f0 2023-08-10T10:39:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.144+0000 7fac1b7fe640 1 -- 172.21.15.50:0/3943632404 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac14053b50 con 0x7fac240ae9f0 2023-08-10T10:39:17.146 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 msgr2=0x7fac04071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 0x7fac04071520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac240cd7e0 tx=0x7fac0c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 msgr2=0x7fac241f2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c450 tx=0x7fac1400c910 comp rx=0 tx=0).stop 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 shutdown_connections 2023-08-10T10:39:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac240cb2f0 0x7fac24159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac0406f060 0x7fac04071520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac240aedd0 0x7fac24157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 --2- 172.21.15.50:0/3943632404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240ae9f0 0x7fac241f2b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 >> 172.21.15.50:0/3943632404 conn(0x7fac240cf8a0 msgr2=0x7fac240b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 shutdown_connections 2023-08-10T10:39:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.147+0000 7fac2359e640 1 -- 172.21.15.50:0/3943632404 wait complete. 2023-08-10T10:39:17.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:17.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.398+0000 7f3298e67640 1 Processor -- start 2023-08-10T10:39:17.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.398+0000 7f3298e67640 1 -- start start 2023-08-10T10:39:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3298e67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f3294160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3298e67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3294160a40 con 0x7f32940b4640 2023-08-10T10:39:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3298e67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940b4bb0 con 0x7f329415cb90 2023-08-10T10:39:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3298e67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940b4e90 con 0x7f329415cf70 2023-08-10T10:39:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3292d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32940b4640 0x7f329406fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41144/0 (socket says 172.21.15.50:41144) 2023-08-10T10:39:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3292d9d640 1 -- 172.21.15.50:0/2654376646 learned_addr learned my addr 172.21.15.50:0/2654376646 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:17.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f3291d9b640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f3294160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.400+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291772779 0 0) 0x7f3294160a40 con 0x7f32940b4640 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f327c003520 con 0x7f32940b4640 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2461050145 0 0) 0x7f327c003520 con 0x7f32940b4640 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 msgr2=0x7f3294160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f3294160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 >> v1:172.21.15.117:6789/0 conn(0x7f329415cb90 legacy=0x7f32940b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940b5170 con 0x7f32940b4640 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f328c001670 con 0x7f32940b4640 2023-08-10T10:39:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 >> v1:172.21.15.50:6789/0 conn(0x7f32940b4640 legacy=0x7f329406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f327c0039a0 0x7f327c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f327c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f327c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940b4e90 con 0x7f327c004d00 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00ba60 con 0x7f327c0039a0 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00bc20 con 0x7f329415cf70 2023-08-10T10:39:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.401+0000 7f3292d9d640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f327c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f329259c640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f327c0039a0 0x7f327c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3291d9b640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f327c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3292d9d640 1 -- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 msgr2=0x7f327c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3292d9d640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f329415cf70 0x7f327c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3292d9d640 1 -- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f327c0039a0 msgr2=0x7f327c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3292d9d640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f327c0039a0 0x7f327c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.402+0000 7f3292d9d640 1 -- 172.21.15.50:0/2654376646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c003520 con 0x7f327c004d00 2023-08-10T10:39:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.403+0000 7f3292d9d640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f327c005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c210 tx=0x7f327c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd93862eca51a63c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.403+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c005ad0 con 0x7f327c004d00 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.403+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c005c30 con 0x7f327c004d00 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.403+0000 7f329159a640 1 -- 172.21.15.50:0/2654376646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c02c890 con 0x7f327c004d00 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 -- 172.21.15.50:0/2654376646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 msgr2=0x7f327c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 --2- 172.21.15.50:0/2654376646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f327c005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c210 tx=0x7f327c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3292d9d640 1 -- 172.21.15.50:0/2654376646 reap_dead start 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 -- 172.21.15.50:0/2654376646 shutdown_connections 2023-08-10T10:39:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 -- 172.21.15.50:0/2654376646 >> 172.21.15.50:0/2654376646 conn(0x7f32940cf640 msgr2=0x7f32940cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 -- 172.21.15.50:0/2654376646 shutdown_connections 2023-08-10T10:39:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.404+0000 7f3298e67640 1 -- 172.21.15.50:0/2654376646 wait complete. 2023-08-10T10:39:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.406+0000 7f3298e67640 1 Processor -- start 2023-08-10T10:39:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.406+0000 7f3298e67640 1 -- start start 2023-08-10T10:39:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 0x7f32941f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32941f62e0 0x7f329414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329414ee10 con 0x7f327c004d00 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32941f6760 con 0x7f329415f1d0 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.407+0000 7f3298e67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329414cec0 con 0x7f32941f62e0 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39596/0 (socket says 172.21.15.50:39596) 2023-08-10T10:39:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 -- 172.21.15.50:0/887183653 learned_addr learned my addr 172.21.15.50:0/887183653 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f3291d9b640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 0x7f32941f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 -- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32941f62e0 msgr2=0x7f329414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32941f62e0 0x7f329414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 -- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 msgr2=0x7f32941f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 0x7f32941f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f329259c640 1 -- 172.21.15.50:0/887183653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32941f2690 con 0x7f327c004d00 2023-08-10T10:39:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.408+0000 7f3291d9b640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 0x7f32941f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f329259c640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f328400e8c0 tx=0x7f328400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284003b80 con 0x7f327c004d00 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284003ce0 con 0x7f327c004d00 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840052f0 con 0x7f327c004d00 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329415e140 con 0x7f327c004d00 2023-08-10T10:39:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.409+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329415e700 con 0x7f327c004d00 2023-08-10T10:39:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.410+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32940612b0 con 0x7f327c004d00 2023-08-10T10:39:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.412+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3284005450 con 0x7f327c004d00 2023-08-10T10:39:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.412+0000 7f3282ffd640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 0x7f327406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.413+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3284089620 con 0x7f327c004d00 2023-08-10T10:39:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.413+0000 7f3291d9b640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 0x7f327406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.414+0000 7f3291d9b640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 0x7f327406d110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32940c9a70 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.417+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3284054690 con 0x7f327c004d00 2023-08-10T10:39:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.611+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f329415f940 con 0x7f327c004d00 2023-08-10T10:39:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.612+0000 7f3282ffd640 1 -- 172.21.15.50:0/887183653 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3284057cb0 con 0x7f327c004d00 2023-08-10T10:39:17.614 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.615+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 msgr2=0x7f327406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.615+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 0x7f327406d110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32940c9a70 tx=0x7f3288008040 comp rx=0 tx=0).stop 2023-08-10T10:39:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.615+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 msgr2=0x7f329414c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.615+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f328400e8c0 tx=0x7f328400ed80 comp rx=0 tx=0).stop 2023-08-10T10:39:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 shutdown_connections 2023-08-10T10:39:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32941f62e0 0x7f329414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f327406ac50 0x7f327406d110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f329415f1d0 0x7f32941f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 --2- 172.21.15.50:0/887183653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f327c004d00 0x7f329414c980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 >> 172.21.15.50:0/887183653 conn(0x7f32940cf640 msgr2=0x7f32941e7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 shutdown_connections 2023-08-10T10:39:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.616+0000 7f3298e67640 1 -- 172.21.15.50:0/887183653 wait complete. 2023-08-10T10:39:17.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:39:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.866+0000 7faf0acd3640 1 Processor -- start 2023-08-10T10:39:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.866+0000 7faf0acd3640 1 -- start start 2023-08-10T10:39:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.867+0000 7faf0acd3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf040d0160 0x7faf040cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.867+0000 7faf0acd3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040d2230 con 0x7faf040b1c70 2023-08-10T10:39:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.867+0000 7faf0acd3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040b2310 con 0x7faf04160130 2023-08-10T10:39:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.867+0000 7faf0acd3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040b5c60 con 0x7faf040d0160 2023-08-10T10:39:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faf09270640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf040b1c70 0x7faf040d26c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41146/0 (socket says 172.21.15.50:41146) 2023-08-10T10:39:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faf09270640 1 -- 172.21.15.50:0/2882489256 learned_addr learned my addr 172.21.15.50:0/2882489256 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefbfff640 1 --2- 172.21.15.50:0/2882489256 >> v2:172.21.15.50:3300/0 conn(0x7faf040d0160 0x7faf040cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefb7fe640 1 -- 172.21.15.50:0/2882489256 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274592264 0 0) 0x7faf040d2230 con 0x7faf040b1c70 2023-08-10T10:39:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefb7fe640 1 -- 172.21.15.50:0/2882489256 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec003520 con 0x7faf040b1c70 2023-08-10T10:39:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefbfff640 1 -- 172.21.15.50:0/2882489256 >> v1:172.21.15.117:6789/0 conn(0x7faf04160130 legacy=0x7faf040cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefbfff640 1 -- 172.21.15.50:0/2882489256 >> v1:172.21.15.50:6789/0 conn(0x7faf040b1c70 legacy=0x7faf040d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.868+0000 7faefbfff640 1 -- 172.21.15.50:0/2882489256 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040ce1b0 con 0x7faf040d0160 2023-08-10T10:39:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.870+0000 7faefbfff640 1 --2- 172.21.15.50:0/2882489256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf040d0160 0x7faf040cdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d2ea49a8debf83 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.870+0000 7faefb7fe640 1 -- 172.21.15.50:0/2882489256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4031830 con 0x7faf040d0160 2023-08-10T10:39:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.870+0000 7faefb7fe640 1 -- 172.21.15.50:0/2882489256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4031990 con 0x7faf040d0160 2023-08-10T10:39:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.870+0000 7faefb7fe640 1 -- 172.21.15.50:0/2882489256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4031d00 con 0x7faf040d0160 2023-08-10T10:39:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 -- 172.21.15.50:0/2882489256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf040d0160 msgr2=0x7faf040cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2882489256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf040d0160 0x7faf040cdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402b8d0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 -- 172.21.15.50:0/2882489256 shutdown_connections 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2882489256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf040d0160 0x7faf040cdb20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 -- 172.21.15.50:0/2882489256 >> 172.21.15.50:0/2882489256 conn(0x7faf04069ac0 msgr2=0x7faf04069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 -- 172.21.15.50:0/2882489256 shutdown_connections 2023-08-10T10:39:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.871+0000 7faf0acd3640 1 -- 172.21.15.50:0/2882489256 wait complete. 2023-08-10T10:39:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.873+0000 7faf0acd3640 1 Processor -- start 2023-08-10T10:39:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.873+0000 7faf0acd3640 1 -- start start 2023-08-10T10:39:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b1c70 0x7faf040ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf040d0160 0x7faf040cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041f5700 con 0x7faf04160130 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ccb30 con 0x7faf040b1c70 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf0acd3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ab200 con 0x7faf040d0160 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf09270640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf09270640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39614/0 (socket says 172.21.15.50:39614) 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.874+0000 7faf09270640 1 -- 172.21.15.50:0/2010770011 learned_addr learned my addr 172.21.15.50:0/2010770011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf08a6f640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b1c70 0x7faf040ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 -- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf040d0160 msgr2=0x7faf040cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf040d0160 0x7faf040cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 -- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b1c70 msgr2=0x7faf040ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b1c70 0x7faf040ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 -- 172.21.15.50:0/2010770011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009400 con 0x7faf04160130 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf09270640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c3c0 tx=0x7faefc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc005ce0 con 0x7faf04160130 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc005e40 con 0x7faf04160130 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0072f0 con 0x7faf04160130 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.875+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf041f2570 con 0x7faf04160130 2023-08-10T10:39:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.876+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf041f2b30 con 0x7faf04160130 2023-08-10T10:39:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.877+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf041f5840 con 0x7faf04160130 2023-08-10T10:39:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.878+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faefc007510 con 0x7faf04160130 2023-08-10T10:39:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.879+0000 7faef97fa640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 0x7faef006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.879+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faefc088a20 con 0x7faf04160130 2023-08-10T10:39:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.879+0000 7faf08a6f640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 0x7faef006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.880+0000 7faf08a6f640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 0x7faef006d110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf00007fd0 tx=0x7faf00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:17.883+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faefc053a80 con 0x7faf04160130 2023-08-10T10:39:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.093+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf0404e270 con 0x7faf04160130 2023-08-10T10:39:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.095+0000 7faef97fa640 1 -- 172.21.15.50:0/2010770011 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7faefc0570a0 con 0x7faf04160130 2023-08-10T10:39:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:39:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 msgr2=0x7faef006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 0x7faef006d110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf00007fd0 tx=0x7faf00009040 comp rx=0 tx=0).stop 2023-08-10T10:39:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 msgr2=0x7faf040a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c3c0 tx=0x7faefc00c880 comp rx=0 tx=0).stop 2023-08-10T10:39:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 shutdown_connections 2023-08-10T10:39:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.097+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf04160130 0x7faf040a9480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf040d0160 0x7faf040cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faef006ac50 0x7faef006d110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 --2- 172.21.15.50:0/2010770011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf040b1c70 0x7faf040ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 >> 172.21.15.50:0/2010770011 conn(0x7faf04069ac0 msgr2=0x7faf040d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 shutdown_connections 2023-08-10T10:39:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.098+0000 7faf0acd3640 1 -- 172.21.15.50:0/2010770011 wait complete. 2023-08-10T10:39:18.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-10T10:39:18.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:18.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-10T10:39:18.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:39:18.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:18.222 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-10T10:39:18.273 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:18.274 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:18.332 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:18.333 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:18.388 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:18.389 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:18.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.683+0000 7f8959894640 1 Processor -- start 2023-08-10T10:39:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.683+0000 7f8959894640 1 -- start start 2023-08-10T10:39:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f8959894640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540696a0 0x7f8954069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f8959894640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89540b1ae0 0x7f89540b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f8959894640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895415e1f0 con 0x7f8954159970 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f8959894640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89540b10d0 con 0x7f89540b1ae0 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f8959894640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895415d5e0 con 0x7f89540696a0 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f89537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89540b1ae0 0x7f89540b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f89537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89540b1ae0 0x7f89540b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39630/0 (socket says 172.21.15.50:39630) 2023-08-10T10:39:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f89537fe640 1 -- 172.21.15.50:0/360500750 learned_addr learned my addr 172.21.15.50:0/360500750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.685+0000 7f89527fc640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540696a0 0x7f8954069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.686+0000 7f89537fe640 1 -- 172.21.15.50:0/360500750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540696a0 msgr2=0x7f8954069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.686+0000 7f89537fe640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540696a0 0x7f8954069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.686+0000 7f89537fe640 1 -- 172.21.15.50:0/360500750 >> v1:172.21.15.117:6789/0 conn(0x7f8954159970 legacy=0x7f89540b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.686+0000 7f89537fe640 1 -- 172.21.15.50:0/360500750 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895406a040 con 0x7f89540b1ae0 2023-08-10T10:39:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.687+0000 7f89537fe640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540b1ae0 0x7f89540b1f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c2a120dab6dad2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.687+0000 7f8951ffb640 1 -- 172.21.15.50:0/360500750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c031640 con 0x7f89540b1ae0 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.687+0000 7f8951ffb640 1 -- 172.21.15.50:0/360500750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0317a0 con 0x7f89540b1ae0 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.687+0000 7f8951ffb640 1 -- 172.21.15.50:0/360500750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c031b30 con 0x7f89540b1ae0 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 -- 172.21.15.50:0/360500750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540b1ae0 msgr2=0x7f89540b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540b1ae0 0x7f89540b1f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 -- 172.21.15.50:0/360500750 shutdown_connections 2023-08-10T10:39:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540b1ae0 0x7f89540b1f70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 --2- 172.21.15.50:0/360500750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540696a0 0x7f8954069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 -- 172.21.15.50:0/360500750 >> 172.21.15.50:0/360500750 conn(0x7f895406b590 msgr2=0x7f89540ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 -- 172.21.15.50:0/360500750 shutdown_connections 2023-08-10T10:39:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.688+0000 7f8959894640 1 -- 172.21.15.50:0/360500750 wait complete. 2023-08-10T10:39:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.690+0000 7f8959894640 1 Processor -- start 2023-08-10T10:39:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.690+0000 7f8959894640 1 -- start start 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540b1ae0 0x7f89540c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8954159970 0x7f895415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895415a960 con 0x7f89540696a0 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954159d50 con 0x7f8954159970 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8959894640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895415a030 con 0x7f89540b1ae0 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39640/0 (socket says 172.21.15.50:39640) 2023-08-10T10:39:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 -- 172.21.15.50:0/3290872537 learned_addr learned my addr 172.21.15.50:0/3290872537 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 -- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540b1ae0 msgr2=0x7f89540c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540b1ae0 0x7f89540c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 -- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8954159970 msgr2=0x7f895415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f89537fe640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8954159970 0x7f895415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.691+0000 7f8952ffd640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8954159970 0x7f895415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f8952ffd640 1 -- 172.21.15.50:0/3290872537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0094d0 con 0x7f89540696a0 2023-08-10T10:39:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f8952ffd640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f893c00b3f0 tx=0x7f893c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c011830 con 0x7f89540696a0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c011990 con 0x7f89540696a0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c011d40 con 0x7f89540696a0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895415a310 con 0x7f89540696a0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.692+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89540c8400 con 0x7f89540696a0 2023-08-10T10:39:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.693+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8954157400 con 0x7f89540696a0 2023-08-10T10:39:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.695+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f893c01a400 con 0x7f89540696a0 2023-08-10T10:39:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.696+0000 7f894bfff640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 0x7f893406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.696+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f893c089350 con 0x7f89540696a0 2023-08-10T10:39:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.696+0000 7f89527fc640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 0x7f893406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.697+0000 7f89527fc640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 0x7f893406d140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89440070b0 tx=0x7f8944007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.701+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f893c0543b0 con 0x7f89540696a0 2023-08-10T10:39:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.897+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f895404e270 con 0x7f89540696a0 2023-08-10T10:39:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.899+0000 7f894bfff640 1 -- 172.21.15.50:0/3290872537 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f893c0579d0 con 0x7f89540696a0 2023-08-10T10:39:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:18.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 msgr2=0x7f893406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 0x7f893406d140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89440070b0 tx=0x7f8944007040 comp rx=0 tx=0).stop 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 msgr2=0x7f89540c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f893c00b3f0 tx=0x7f893c00b8b0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 shutdown_connections 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f893406ac80 0x7f893406d140 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8954159970 0x7f895415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89540b1ae0 0x7f89540c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 --2- 172.21.15.50:0/3290872537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89540696a0 0x7f89540c4240 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 >> 172.21.15.50:0/3290872537 conn(0x7f895406b590 msgr2=0x7f8954071200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 shutdown_connections 2023-08-10T10:39:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:18.902+0000 7f8959894640 1 -- 172.21.15.50:0/3290872537 wait complete. 2023-08-10T10:39:18.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:18.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.158+0000 7f0700ed9640 1 Processor -- start 2023-08-10T10:39:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.158+0000 7f0700ed9640 1 -- start start 2023-08-10T10:39:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.159+0000 7f0700ed9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06fc15cb90 0x7f06fc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.159+0000 7f0700ed9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06fc1615e0 0x7f06fc06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.159+0000 7f0700ed9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc160a40 con 0x7f06fc15cf70 2023-08-10T10:39:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.159+0000 7f0700ed9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0b4bb0 con 0x7f06fc15cb90 2023-08-10T10:39:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.159+0000 7f0700ed9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0b4e90 con 0x7f06fc1615e0 2023-08-10T10:39:19.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fa59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06fc15cb90 0x7f06fc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06f9d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06fc15cf70 0x7f06fc160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41150/0 (socket says 172.21.15.50:41150) 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06f9d9b640 1 -- 172.21.15.50:0/3115580079 learned_addr learned my addr 172.21.15.50:0/3115580079 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fad9d640 1 --2- 172.21.15.50:0/3115580079 >> v2:172.21.15.117:3300/0 conn(0x7f06fc1615e0 0x7f06fc06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fa59c640 1 -- 172.21.15.50:0/3115580079 >> v2:172.21.15.117:3300/0 conn(0x7f06fc1615e0 msgr2=0x7f06fc06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fa59c640 1 --2- 172.21.15.50:0/3115580079 >> v2:172.21.15.117:3300/0 conn(0x7f06fc1615e0 0x7f06fc06fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fa59c640 1 -- 172.21.15.50:0/3115580079 >> v1:172.21.15.50:6789/0 conn(0x7f06fc15cf70 legacy=0x7f06fc160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06fa59c640 1 -- 172.21.15.50:0/3115580079 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0b5170 con 0x7f06fc15cb90 2023-08-10T10:39:19.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.160+0000 7f06f959a640 1 -- 172.21.15.50:0/3115580079 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316338378 0 0) 0x7f06fc160a40 con 0x7f06fc15cf70 2023-08-10T10:39:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f06fa59c640 1 --2- 172.21.15.50:0/3115580079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cb90 0x7f06fc0b5dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06fc1609b0 tx=0x7f06ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3236f4b8231d9bfe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f06f959a640 1 -- 172.21.15.50:0/3115580079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec031830 con 0x7f06fc15cb90 2023-08-10T10:39:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f06f959a640 1 -- 172.21.15.50:0/3115580079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec031990 con 0x7f06fc15cb90 2023-08-10T10:39:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f06f959a640 1 -- 172.21.15.50:0/3115580079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec031d20 con 0x7f06fc15cb90 2023-08-10T10:39:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f0700ed9640 1 -- 172.21.15.50:0/3115580079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cb90 msgr2=0x7f06fc0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.162+0000 7f0700ed9640 1 --2- 172.21.15.50:0/3115580079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cb90 0x7f06fc0b5dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06fc1609b0 tx=0x7f06ec02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 -- 172.21.15.50:0/3115580079 shutdown_connections 2023-08-10T10:39:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 --2- 172.21.15.50:0/3115580079 >> v2:172.21.15.117:3300/0 conn(0x7f06fc1615e0 0x7f06fc06fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 --2- 172.21.15.50:0/3115580079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cb90 0x7f06fc0b5dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 -- 172.21.15.50:0/3115580079 >> 172.21.15.50:0/3115580079 conn(0x7f06fc0cf640 msgr2=0x7f06fc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 -- 172.21.15.50:0/3115580079 shutdown_connections 2023-08-10T10:39:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.163+0000 7f0700ed9640 1 -- 172.21.15.50:0/3115580079 wait complete. 2023-08-10T10:39:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.164+0000 7f0700ed9640 1 Processor -- start 2023-08-10T10:39:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.165+0000 7f0700ed9640 1 -- start start 2023-08-10T10:39:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 0x7f06fc0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06fc1615e0 0x7f06fc0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc158680 con 0x7f06fc15cf70 2023-08-10T10:39:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0c5d50 con 0x7f06fc1615e0 2023-08-10T10:39:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f0700ed9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc15c290 con 0x7f06fc15cb90 2023-08-10T10:39:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39670/0 (socket says 172.21.15.50:39670) 2023-08-10T10:39:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 -- 172.21.15.50:0/1360880526 learned_addr learned my addr 172.21.15.50:0/1360880526 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:19.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06fa59c640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 0x7f06fc0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06fad9d640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06fc1615e0 0x7f06fc0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 -- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 msgr2=0x7f06fc0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 0x7f06fc0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 -- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06fc1615e0 msgr2=0x7f06fc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.166+0000 7f06f9d9b640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06fc1615e0 0x7f06fc0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06f9d9b640 1 -- 172.21.15.50:0/1360880526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009400 con 0x7f06fc15cf70 2023-08-10T10:39:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06fa59c640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 0x7f06fc0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06f9d9b640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c4d0 tx=0x7f06e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40074e0 con 0x7f06fc15cf70 2023-08-10T10:39:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4007660 con 0x7f06fc15cf70 2023-08-10T10:39:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004a20 con 0x7f06fc15cf70 2023-08-10T10:39:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc15b610 con 0x7f06fc15cf70 2023-08-10T10:39:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.167+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc15beb0 con 0x7f06fc15cf70 2023-08-10T10:39:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.169+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc15c3d0 con 0x7f06fc15cf70 2023-08-10T10:39:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.170+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06e4004b80 con 0x7f06fc15cf70 2023-08-10T10:39:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.170+0000 7f06f2ffd640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 0x7f06dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.171+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f06e4088710 con 0x7f06fc15cf70 2023-08-10T10:39:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.171+0000 7f06fa59c640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 0x7f06dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.172+0000 7f06fa59c640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 0x7f06dc06d110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06ec036000 tx=0x7f06ec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.175+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f06fc15c3d0 con 0x7f06fc15cf70 2023-08-10T10:39:19.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.366+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06fc15c3d0 con 0x7f06fc15cf70 2023-08-10T10:39:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.367+0000 7f06f2ffd640 1 -- 172.21.15.50:0/1360880526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06fc15c3d0 con 0x7f06fc15cf70 2023-08-10T10:39:19.369 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:19.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 msgr2=0x7f06dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 0x7f06dc06d110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06ec036000 tx=0x7f06ec008030 comp rx=0 tx=0).stop 2023-08-10T10:39:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 msgr2=0x7f06fc0c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c4d0 tx=0x7f06e400c990 comp rx=0 tx=0).stop 2023-08-10T10:39:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 shutdown_connections 2023-08-10T10:39:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06dc06ac50 0x7f06dc06d110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06fc1615e0 0x7f06fc0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06fc15cf70 0x7f06fc0c52d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 --2- 172.21.15.50:0/1360880526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06fc15cb90 0x7f06fc0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.370+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 >> 172.21.15.50:0/1360880526 conn(0x7f06fc0cf640 msgr2=0x7f06fc156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.371+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 shutdown_connections 2023-08-10T10:39:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.371+0000 7f0700ed9640 1 -- 172.21.15.50:0/1360880526 wait complete. 2023-08-10T10:39:19.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:19.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.618+0000 7efd37887640 1 Processor -- start 2023-08-10T10:39:19.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.618+0000 7efd37887640 1 -- start start 2023-08-10T10:39:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.619+0000 7efd37887640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd3015cb90 0x7efd300b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.619+0000 7efd37887640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd30160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.619+0000 7efd37887640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd30160a40 con 0x7efd300b4640 2023-08-10T10:39:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.619+0000 7efd37887640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300b4bb0 con 0x7efd3015cb90 2023-08-10T10:39:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.619+0000 7efd37887640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300b4e90 con 0x7efd3015cf70 2023-08-10T10:39:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd3015cb90 0x7efd300b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd3015cb90 0x7efd300b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39680/0 (socket says 172.21.15.50:39680) 2023-08-10T10:39:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 -- 172.21.15.50:0/2229906975 learned_addr learned my addr 172.21.15.50:0/2229906975 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd34e22640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd30160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 -- 172.21.15.50:0/2229906975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 msgr2=0x7efd30160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd30160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 -- 172.21.15.50:0/2229906975 >> v1:172.21.15.117:6789/0 conn(0x7efd300b4640 legacy=0x7efd3006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.620+0000 7efd35623640 1 -- 172.21.15.50:0/2229906975 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300b5170 con 0x7efd3015cb90 2023-08-10T10:39:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.622+0000 7efd35623640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd3015cb90 0x7efd300b5dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009e50 tx=0x7efd2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b30c71b3216927 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.622+0000 7efd27fff640 1 -- 172.21.15.50:0/2229906975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c02ca70 con 0x7efd3015cb90 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.622+0000 7efd27fff640 1 -- 172.21.15.50:0/2229906975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c02cbd0 con 0x7efd3015cb90 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.622+0000 7efd27fff640 1 -- 172.21.15.50:0/2229906975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0343f0 con 0x7efd3015cb90 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 -- 172.21.15.50:0/2229906975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd3015cb90 msgr2=0x7efd300b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd3015cb90 0x7efd300b5dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009e50 tx=0x7efd2c02bed0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 -- 172.21.15.50:0/2229906975 shutdown_connections 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd30160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 --2- 172.21.15.50:0/2229906975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd3015cb90 0x7efd300b5dd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 -- 172.21.15.50:0/2229906975 >> 172.21.15.50:0/2229906975 conn(0x7efd300cf640 msgr2=0x7efd300cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 -- 172.21.15.50:0/2229906975 shutdown_connections 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.623+0000 7efd37887640 1 -- 172.21.15.50:0/2229906975 wait complete. 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.625+0000 7efd37887640 1 Processor -- start 2023-08-10T10:39:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.625+0000 7efd37887640 1 -- start start 2023-08-10T10:39:19.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3015cb90 0x7efd300b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd300c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cbba0 con 0x7efd300b4640 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cb590 con 0x7efd3015cb90 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd37887640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c7090 con 0x7efd3015cf70 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd35623640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd35623640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39690/0 (socket says 172.21.15.50:39690) 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.626+0000 7efd35623640 1 -- 172.21.15.50:0/44215935 learned_addr learned my addr 172.21.15.50:0/44215935 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 -- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 msgr2=0x7efd300c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd300c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 -- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3015cb90 msgr2=0x7efd300b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3015cb90 0x7efd300b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 -- 172.21.15.50:0/44215935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009b30 con 0x7efd300b4640 2023-08-10T10:39:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.627+0000 7efd35623640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000f80 tx=0x7efd2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.628+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c009510 con 0x7efd300b4640 2023-08-10T10:39:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.628+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c03e450 con 0x7efd300b4640 2023-08-10T10:39:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.628+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c03e800 con 0x7efd300b4640 2023-08-10T10:39:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.628+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300cb830 con 0x7efd300b4640 2023-08-10T10:39:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.628+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300c7370 con 0x7efd300b4640 2023-08-10T10:39:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.629+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300c7500 con 0x7efd300b4640 2023-08-10T10:39:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.630+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd2c03e960 con 0x7efd300b4640 2023-08-10T10:39:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.631+0000 7efd25ffb640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 0x7efd1406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.631+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd2c0ac340 con 0x7efd300b4640 2023-08-10T10:39:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.631+0000 7efd34e22640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 0x7efd1406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.632+0000 7efd34e22640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 0x7efd1406d110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd20006fd0 tx=0x7efd20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.635+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd2c0773a0 con 0x7efd300b4640 2023-08-10T10:39:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.826+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd300612b0 con 0x7efd300b4640 2023-08-10T10:39:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.827+0000 7efd25ffb640 1 -- 172.21.15.50:0/44215935 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd2c07a9c0 con 0x7efd300b4640 2023-08-10T10:39:19.828 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 msgr2=0x7efd1406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 0x7efd1406d110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd20006fd0 tx=0x7efd20008040 comp rx=0 tx=0).stop 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 msgr2=0x7efd300cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000f80 tx=0x7efd2c004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 shutdown_connections 2023-08-10T10:39:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3015cf70 0x7efd300c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd1406ac50 0x7efd1406d110 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3015cb90 0x7efd300b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 --2- 172.21.15.50:0/44215935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd300b4640 0x7efd300cc030 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.829+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 >> 172.21.15.50:0/44215935 conn(0x7efd300cf640 msgr2=0x7efd301570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.830+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 shutdown_connections 2023-08-10T10:39:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:19.830+0000 7efd37887640 1 -- 172.21.15.50:0/44215935 wait complete. 2023-08-10T10:39:19.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:20.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.084+0000 7f311eef9640 1 Processor -- start 2023-08-10T10:39:20.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.084+0000 7f311eef9640 1 -- start start 2023-08-10T10:39:20.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.085+0000 7f311eef9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31180ce2e0 0x7f311815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.085+0000 7f311eef9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118157b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.085+0000 7f311eef9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180ae7b0 con 0x7f31180abd40 2023-08-10T10:39:20.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.085+0000 7f311eef9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180ac260 con 0x7f31180ce2e0 2023-08-10T10:39:20.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.085+0000 7f311eef9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311806dda0 con 0x7f3118071360 2023-08-10T10:39:20.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31180ce2e0 0x7f311815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31180ce2e0 0x7f311815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39700/0 (socket says 172.21.15.50:39700) 2023-08-10T10:39:20.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 -- 172.21.15.50:0/4245411525 learned_addr learned my addr 172.21.15.50:0/4245411525 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:20.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311d496640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 -- 172.21.15.50:0/4245411525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 msgr2=0x7f3118157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 -- 172.21.15.50:0/4245411525 >> v1:172.21.15.117:6789/0 conn(0x7f31180abd40 legacy=0x7f3118070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.086+0000 7f311cc95640 1 -- 172.21.15.50:0/4245411525 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180ad9f0 con 0x7f31180ce2e0 2023-08-10T10:39:20.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.087+0000 7f311cc95640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180ce2e0 0x7f311815b9c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3114009ea0 tx=0x7f311402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c07647b02a78cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f310f7fe640 1 -- 172.21.15.50:0/4245411525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311402cac0 con 0x7f31180ce2e0 2023-08-10T10:39:20.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f310f7fe640 1 -- 172.21.15.50:0/4245411525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311402cc20 con 0x7f31180ce2e0 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f310f7fe640 1 -- 172.21.15.50:0/4245411525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31140343f0 con 0x7f31180ce2e0 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 -- 172.21.15.50:0/4245411525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180ce2e0 msgr2=0x7f311815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180ce2e0 0x7f311815b9c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3114009ea0 tx=0x7f311402bf20 comp rx=0 tx=0).stop 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 -- 172.21.15.50:0/4245411525 shutdown_connections 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 --2- 172.21.15.50:0/4245411525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180ce2e0 0x7f311815b9c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.088+0000 7f311eef9640 1 -- 172.21.15.50:0/4245411525 >> 172.21.15.50:0/4245411525 conn(0x7f31180cef40 msgr2=0x7f31180cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:20.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.089+0000 7f311eef9640 1 -- 172.21.15.50:0/4245411525 shutdown_connections 2023-08-10T10:39:20.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.089+0000 7f311eef9640 1 -- 172.21.15.50:0/4245411525 wait complete. 2023-08-10T10:39:20.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.090+0000 7f311eef9640 1 Processor -- start 2023-08-10T10:39:20.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.091+0000 7f311eef9640 1 -- start start 2023-08-10T10:39:20.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.091+0000 7f311eef9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.091+0000 7f311eef9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.091+0000 7f311eef9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31180ce2e0 0x7f31180c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f311eef9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311809ac20 con 0x7f31180abd40 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f311eef9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311809c1e0 con 0x7f31180ce2e0 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f311eef9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311809a0a0 con 0x7f3118071360 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39704/0 (socket says 172.21.15.50:39704) 2023-08-10T10:39:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 -- 172.21.15.50:0/1855538676 learned_addr learned my addr 172.21.15.50:0/1855538676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:20.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 -- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 msgr2=0x7f3118099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 -- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31180ce2e0 msgr2=0x7f31180c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31180ce2e0 0x7f31180c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.092+0000 7f310ffff640 1 -- 172.21.15.50:0/1855538676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009b30 con 0x7f31180abd40 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f310ffff640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f310800c460 tx=0x7f310800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108012830 con 0x7f31180abd40 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080129d0 con 0x7f31180abd40 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108012d80 con 0x7f31180abd40 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311809a380 con 0x7f31180abd40 2023-08-10T10:39:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.093+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311809a940 con 0x7f31180abd40 2023-08-10T10:39:20.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.094+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31180612b0 con 0x7f31180abd40 2023-08-10T10:39:20.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.095+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f310801b400 con 0x7f31180abd40 2023-08-10T10:39:20.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.097+0000 7f310d7fa640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 0x7f310406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.097+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f31080894b0 con 0x7f31180abd40 2023-08-10T10:39:20.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.097+0000 7f311cc95640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 0x7f310406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.098+0000 7f311cc95640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 0x7f310406d110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3114035000 tx=0x7f311402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.101+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3108054480 con 0x7f31180abd40 2023-08-10T10:39:20.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.291+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31180cec30 con 0x7f31180abd40 2023-08-10T10:39:20.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.292+0000 7f310d7fa640 1 -- 172.21.15.50:0/1855538676 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3108057aa0 con 0x7f31180abd40 2023-08-10T10:39:20.294 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 msgr2=0x7f310406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 0x7f310406d110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3114035000 tx=0x7f311402e000 comp rx=0 tx=0).stop 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 msgr2=0x7f311809bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f310800c460 tx=0x7f310800c920 comp rx=0 tx=0).stop 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 shutdown_connections 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f310406ac50 0x7f310406d110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31180ce2e0 0x7f31180c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31180abd40 0x7f311809bca0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 --2- 172.21.15.50:0/1855538676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3118071360 0x7f3118099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 >> 172.21.15.50:0/1855538676 conn(0x7f31180cef40 msgr2=0x7f3118070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 shutdown_connections 2023-08-10T10:39:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.295+0000 7f311eef9640 1 -- 172.21.15.50:0/1855538676 wait complete. 2023-08-10T10:39:20.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.540+0000 7fe8b359e640 1 Processor -- start 2023-08-10T10:39:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.541+0000 7fe8b359e640 1 -- start start 2023-08-10T10:39:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.542+0000 7fe8b359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe8b40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.542+0000 7fe8b359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe8b4069db0 0x7fe8b415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.542+0000 7fe8b359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b415aee0 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.542+0000 7fe8b359e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b40b2100 con 0x7fe8b4069db0 2023-08-10T10:39:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.542+0000 7fe8b359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b415b1a0 con 0x7fe8b41583c0 2023-08-10T10:39:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8b40b1ba0 0x7fe8b40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41156/0 (socket says 172.21.15.50:41156) 2023-08-10T10:39:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b1d9b640 1 -- 172.21.15.50:0/4239836526 learned_addr learned my addr 172.21.15.50:0/4239836526 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b259c640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe8b40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/4239836526 >> v2:172.21.15.117:3300/0 conn(0x7fe8b4069db0 0x7fe8b415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937587016 0 0) 0x7fe8b415aee0 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.543+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe89c003520 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1626547041 0 0) 0x7fe89c003520 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 msgr2=0x7fe8b40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe8b40b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 >> v2:172.21.15.117:3300/0 conn(0x7fe8b4069db0 msgr2=0x7fe8b415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 --2- 172.21.15.50:0/4239836526 >> v2:172.21.15.117:3300/0 conn(0x7fe8b4069db0 0x7fe8b415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b415b480 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe8a8001670 con 0x7fe8b40b1ba0 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 >> v1:172.21.15.50:6789/0 conn(0x7fe8b40b1ba0 legacy=0x7fe8b40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe89c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c003f60 0x7fe89c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89c004d00 0x7fe89c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40b2100 con 0x7fe89c004d00 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b415b1a0 con 0x7fe89c003f60 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c00b9b0 con 0x7fe8b41583c0 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89c004d00 0x7fe89c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b259c640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe89c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.544+0000 7fe8b1d9b640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c003f60 0x7fe89c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.545+0000 7fe8b2d9d640 1 -- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 msgr2=0x7fe89c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.545+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8b41583c0 0x7fe89c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.545+0000 7fe8b2d9d640 1 -- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c003f60 msgr2=0x7fe89c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.545+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c003f60 0x7fe89c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.545+0000 7fe8b2d9d640 1 -- 172.21.15.50:0/4239836526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c003520 con 0x7fe89c004d00 2023-08-10T10:39:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.546+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89c004d00 0x7fe89c005180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8b406ce10 tx=0x7fe89c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ede5992b457385 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.546+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac02cbd0 con 0x7fe89c004d00 2023-08-10T10:39:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.546+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac00f040 con 0x7fe89c004d00 2023-08-10T10:39:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.546+0000 7fe8b159a640 1 -- 172.21.15.50:0/4239836526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac034440 con 0x7fe89c004d00 2023-08-10T10:39:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 -- 172.21.15.50:0/4239836526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89c004d00 msgr2=0x7fe89c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 --2- 172.21.15.50:0/4239836526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe89c004d00 0x7fe89c005180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8b406ce10 tx=0x7fe89c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b2d9d640 1 -- 172.21.15.50:0/4239836526 reap_dead start 2023-08-10T10:39:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 -- 172.21.15.50:0/4239836526 shutdown_connections 2023-08-10T10:39:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 -- 172.21.15.50:0/4239836526 >> 172.21.15.50:0/4239836526 conn(0x7fe8b40caf80 msgr2=0x7fe8b40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 -- 172.21.15.50:0/4239836526 shutdown_connections 2023-08-10T10:39:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.547+0000 7fe8b359e640 1 -- 172.21.15.50:0/4239836526 wait complete. 2023-08-10T10:39:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.549+0000 7fe8b359e640 1 Processor -- start 2023-08-10T10:39:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.549+0000 7fe8b359e640 1 -- start start 2023-08-10T10:39:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 0x7fe8b4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b41f2010 0x7fe8b41f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41f30c0 con 0x7fe8b40c6410 2023-08-10T10:39:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41f2b00 con 0x7fe8b41f2010 2023-08-10T10:39:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41f2de0 con 0x7fe89c004d00 2023-08-10T10:39:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39720/0 (socket says 172.21.15.50:39720) 2023-08-10T10:39:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.550+0000 7fe8b1d9b640 1 -- 172.21.15.50:0/414067531 learned_addr learned my addr 172.21.15.50:0/414067531 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b259c640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 0x7fe8b4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b2d9d640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b41f2010 0x7fe8b41f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 -- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 msgr2=0x7fe8b4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 0x7fe8b4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 -- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b41f2010 msgr2=0x7fe8b41f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b41f2010 0x7fe8b41f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 -- 172.21.15.50:0/414067531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40c5c10 con 0x7fe8b40c6410 2023-08-10T10:39:20.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b259c640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 0x7fe8b4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b1d9b640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800e7f0 tx=0x7fe8a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800c8d0 con 0x7fe8b40c6410 2023-08-10T10:39:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800ca50 con 0x7fe8b40c6410 2023-08-10T10:39:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800ce00 con 0x7fe8b40c6410 2023-08-10T10:39:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.551+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b40c5ef0 con 0x7fe8b40c6410 2023-08-10T10:39:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.552+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b40c83b0 con 0x7fe8b40c6410 2023-08-10T10:39:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.553+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b40c5a70 con 0x7fe8b40c6410 2023-08-10T10:39:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.554+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8a801d460 con 0x7fe8b40c6410 2023-08-10T10:39:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.554+0000 7fe8a2ffd640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 0x7fe89406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.555+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe8a8089490 con 0x7fe8b40c6410 2023-08-10T10:39:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.555+0000 7fe8b259c640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 0x7fe89406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.555+0000 7fe8b259c640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 0x7fe89406d110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009a00 tx=0x7fe8a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.559+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8b40c5a70 con 0x7fe8b40c6410 2023-08-10T10:39:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.750+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8b40c5a70 con 0x7fe8b40c6410 2023-08-10T10:39:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.751+0000 7fe8a2ffd640 1 -- 172.21.15.50:0/414067531 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8b40c5a70 con 0x7fe8b40c6410 2023-08-10T10:39:20.752 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:20.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 msgr2=0x7fe89406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 0x7fe89406d110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009a00 tx=0x7fe8a4008040 comp rx=0 tx=0).stop 2023-08-10T10:39:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 msgr2=0x7fe8b40c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800e7f0 tx=0x7fe8a800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 shutdown_connections 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe89406ac50 0x7fe89406d110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b41f2010 0x7fe8b41f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b40c6410 0x7fe8b40c6890 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.753+0000 7fe8b359e640 1 --2- 172.21.15.50:0/414067531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c004d00 0x7fe8b4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.754+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 >> 172.21.15.50:0/414067531 conn(0x7fe8b40caf80 msgr2=0x7fe8b40696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.754+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 shutdown_connections 2023-08-10T10:39:20.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.754+0000 7fe8b359e640 1 -- 172.21.15.50:0/414067531 wait complete. 2023-08-10T10:39:20.774 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:39:20.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.994+0000 7f38ba991640 1 Processor -- start 2023-08-10T10:39:20.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.994+0000 7f38ba991640 1 -- start start 2023-08-10T10:39:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.996+0000 7f38ba991640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38b40cd960 0x7f38b4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.996+0000 7f38ba991640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b40d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.996+0000 7f38ba991640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b4160370 con 0x7f38b415ff90 2023-08-10T10:39:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.996+0000 7f38ba991640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b40d0b90 con 0x7f38b40cd960 2023-08-10T10:39:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.996+0000 7f38ba991640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b41614d0 con 0x7f38b40d28b0 2023-08-10T10:39:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.997+0000 7f38b918e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38b40cd960 0x7f38b4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.997+0000 7f38ba190640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b40d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.997+0000 7f38b918e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38b40cd960 0x7f38b4160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:33232/0 (socket says 172.21.15.50:33232) 2023-08-10T10:39:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.997+0000 7f38b918e640 1 -- 172.21.15.50:0/2316115666 learned_addr learned my addr 172.21.15.50:0/2316115666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.998+0000 7f38b918e640 1 -- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 msgr2=0x7f38b40d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.998+0000 7f38b918e640 1 --2- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b40d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.998+0000 7f38b918e640 1 -- 172.21.15.50:0/2316115666 >> v1:172.21.15.117:6789/0 conn(0x7f38b415ff90 legacy=0x7f38b40d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.998+0000 7f38b918e640 1 -- 172.21.15.50:0/2316115666 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40d3240 con 0x7f38b40cd960 2023-08-10T10:39:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:20.999+0000 7f38b918e640 1 --2- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b4160f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009870 tx=0x7f38a402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd06ad1d2e87442d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.000+0000 7f38b898d640 1 -- 172.21.15.50:0/2316115666 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4030840 con 0x7f38b40cd960 2023-08-10T10:39:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.000+0000 7f38b898d640 1 -- 172.21.15.50:0/2316115666 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a40309a0 con 0x7f38b40cd960 2023-08-10T10:39:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.000+0000 7f38b898d640 1 -- 172.21.15.50:0/2316115666 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4030d30 con 0x7f38b40cd960 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 -- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 msgr2=0x7f38b4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 --2- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b4160f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009870 tx=0x7f38a402b980 comp rx=0 tx=0).stop 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 -- 172.21.15.50:0/2316115666 shutdown_connections 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 --2- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b40d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 --2- 172.21.15.50:0/2316115666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b4160f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 -- 172.21.15.50:0/2316115666 >> 172.21.15.50:0/2316115666 conn(0x7f38b4069ac0 msgr2=0x7f38b4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 -- 172.21.15.50:0/2316115666 shutdown_connections 2023-08-10T10:39:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.001+0000 7f38ba991640 1 -- 172.21.15.50:0/2316115666 wait complete. 2023-08-10T10:39:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.003+0000 7f38ba991640 1 Processor -- start 2023-08-10T10:39:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.003+0000 7f38ba991640 1 -- start start 2023-08-10T10:39:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b41f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b41f6880 con 0x7f38b415ff90 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40b3330 con 0x7f38b40cd960 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba991640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40b35a0 con 0x7f38b40d28b0 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba190640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba190640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39724/0 (socket says 172.21.15.50:39724) 2023-08-10T10:39:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.004+0000 7f38ba190640 1 -- 172.21.15.50:0/3254000441 learned_addr learned my addr 172.21.15.50:0/3254000441 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38b998f640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38b918e640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b41f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 -- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 msgr2=0x7f38b41f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b41f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 -- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 msgr2=0x7f38b414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b414b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 -- 172.21.15.50:0/3254000441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40094d0 con 0x7f38b415ff90 2023-08-10T10:39:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38b918e640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b41f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba190640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00efc0 tx=0x7f38ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac014480 con 0x7f38b415ff90 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00f040 con 0x7f38b415ff90 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac014820 con 0x7f38b415ff90 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.005+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b40b3880 con 0x7f38b415ff90 2023-08-10T10:39:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.006+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b41f3200 con 0x7f38b415ff90 2023-08-10T10:39:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.007+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b40b3da0 con 0x7f38b415ff90 2023-08-10T10:39:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.008+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38ac014980 con 0x7f38b415ff90 2023-08-10T10:39:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.009+0000 7f38aa7fc640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 0x7f389806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.009+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f38ac08a170 con 0x7f38b415ff90 2023-08-10T10:39:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.009+0000 7f38b998f640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 0x7f389806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.010+0000 7f38b998f640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 0x7f389806d110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000f60 tx=0x7f38b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.013+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38b40b3da0 con 0x7f38b415ff90 2023-08-10T10:39:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.220+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38b40b3da0 con 0x7f38b415ff90 2023-08-10T10:39:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.220+0000 7f38aa7fc640 1 -- 172.21.15.50:0/3254000441 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f38b40b3da0 con 0x7f38b415ff90 2023-08-10T10:39:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:39:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 msgr2=0x7f389806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 0x7f389806d110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000f60 tx=0x7f38b0009040 comp rx=0 tx=0).stop 2023-08-10T10:39:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 msgr2=0x7f38b40cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00efc0 tx=0x7f38ac00c490 comp rx=0 tx=0).stop 2023-08-10T10:39:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 shutdown_connections 2023-08-10T10:39:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b415ff90 0x7f38b40cc060 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38b40d28b0 0x7f38b41f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f389806ac50 0x7f389806d110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 --2- 172.21.15.50:0/3254000441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38b40cd960 0x7f38b414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 >> 172.21.15.50:0/3254000441 conn(0x7f38b4069ac0 msgr2=0x7f38b40b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 shutdown_connections 2023-08-10T10:39:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.223+0000 7f38ba991640 1 -- 172.21.15.50:0/3254000441 wait complete. 2023-08-10T10:39:21.242 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-10T10:39:21.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:21.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-10T10:39:21.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:39:21.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:21.379 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-10T10:39:21.434 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:39:21.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:21.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.673+0000 7f1a9ffff640 1 Processor -- start 2023-08-10T10:39:21.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.674+0000 7f1a9ffff640 1 -- start start 2023-08-10T10:39:21.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.675+0000 7f1a9ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aa00c9d00 0x7f1aa00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.675+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa00cd290 0x7f1aa00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.675+0000 7f1a9ffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00cc5a0 con 0x7f1aa0159830 2023-08-10T10:39:21.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.675+0000 7f1a9ffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00b4170 con 0x7f1aa00c9d00 2023-08-10T10:39:21.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.675+0000 7f1a9ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015d720 con 0x7f1aa00cd290 2023-08-10T10:39:21.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a9effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1aa0159830 0x7f1aa015dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41170/0 (socket says 172.21.15.50:41170) 2023-08-10T10:39:21.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a9effd640 1 -- 172.21.15.50:0/897489113 learned_addr learned my addr 172.21.15.50:0/897489113 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:21.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a967fc640 1 --2- 172.21.15.50:0/897489113 >> v2:172.21.15.50:3300/0 conn(0x7f1aa00c9d00 0x7f1aa00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a9f7fe640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa00cd290 0x7f1aa00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a967fc640 1 -- 172.21.15.50:0/897489113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa00cd290 msgr2=0x7f1aa00cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a967fc640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa00cd290 0x7f1aa00cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a967fc640 1 -- 172.21.15.50:0/897489113 >> v1:172.21.15.50:6789/0 conn(0x7f1aa0159830 legacy=0x7f1aa015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a9e7fc640 1 -- 172.21.15.50:0/897489113 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996605836 0 0) 0x7f1aa00cc5a0 con 0x7f1aa0159830 2023-08-10T10:39:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.676+0000 7f1a967fc640 1 -- 172.21.15.50:0/897489113 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00cdc20 con 0x7f1aa00c9d00 2023-08-10T10:39:21.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.677+0000 7f1a967fc640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00cc060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a880097a0 tx=0x7f1a8802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67de9ba0effe1254 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.678+0000 7f1a9e7fc640 1 -- 172.21.15.50:0/897489113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8802d040 con 0x7f1aa00c9d00 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.678+0000 7f1a9e7fc640 1 -- 172.21.15.50:0/897489113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88031810 con 0x7f1aa00c9d00 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.678+0000 7f1a9e7fc640 1 -- 172.21.15.50:0/897489113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031ba0 con 0x7f1aa00c9d00 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.678+0000 7f1a9ffff640 1 -- 172.21.15.50:0/897489113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00c9d00 msgr2=0x7f1aa00cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.678+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00cc060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a880097a0 tx=0x7f1a8802b8b0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 -- 172.21.15.50:0/897489113 shutdown_connections 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00cc060 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/897489113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa00cd290 0x7f1aa00cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 -- 172.21.15.50:0/897489113 >> 172.21.15.50:0/897489113 conn(0x7f1aa006ab80 msgr2=0x7f1aa006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 -- 172.21.15.50:0/897489113 shutdown_connections 2023-08-10T10:39:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.679+0000 7f1a9ffff640 1 -- 172.21.15.50:0/897489113 wait complete. 2023-08-10T10:39:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.680+0000 7f1a9ffff640 1 Processor -- start 2023-08-10T10:39:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 -- start start 2023-08-10T10:39:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 0x7f1aa00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00703e0 con 0x7f1aa00cd290 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c2c50 con 0x7f1aa00c9d00 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.681+0000 7f1a9ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa014fd90 con 0x7f1aa0159830 2023-08-10T10:39:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39746/0 (socket says 172.21.15.50:39746) 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 -- 172.21.15.50:0/1897707553 learned_addr learned my addr 172.21.15.50:0/1897707553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a9f7fe640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 0x7f1aa00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a9effd640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 -- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 msgr2=0x7f1aa00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 0x7f1aa00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 -- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 msgr2=0x7f1aa00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a967fc640 1 -- 172.21.15.50:0/1897707553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009400 con 0x7f1aa00cd290 2023-08-10T10:39:21.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a9f7fe640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 0x7f1aa00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:21.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.682+0000 7f1a9effd640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a967fc640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a88000c00 tx=0x7f1a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8803aa50 con 0x7f1aa00cd290 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8803abb0 con 0x7f1aa00cd290 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88004030 con 0x7f1aa00cd290 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa00c2040 con 0x7f1aa00cd290 2023-08-10T10:39:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.683+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00c2600 con 0x7f1aa00cd290 2023-08-10T10:39:21.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.684+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00c2e00 con 0x7f1aa00cd290 2023-08-10T10:39:21.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.685+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a88042070 con 0x7f1aa00cd290 2023-08-10T10:39:21.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.686+0000 7f1a97fff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 0x7f1a8006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.686+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1a880ab3e0 con 0x7f1aa00cd290 2023-08-10T10:39:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.686+0000 7f1a9effd640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 0x7f1a8006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.687+0000 7f1a9effd640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 0x7f1a8006d140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a900012e0 tx=0x7f1a90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.691+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a880764d0 con 0x7f1aa00cd290 2023-08-10T10:39:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.923+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aa0066e30 con 0x7f1aa00cd290 2023-08-10T10:39:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.924+0000 7f1a97fff640 1 -- 172.21.15.50:0/1897707553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f1a88079af0 con 0x7f1aa00cd290 2023-08-10T10:39:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:21.926 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:39:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:39:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 msgr2=0x7f1a8006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 0x7f1a8006d140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a900012e0 tx=0x7f1a90009040 comp rx=0 tx=0).stop 2023-08-10T10:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 msgr2=0x7f1aa00c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a88000c00 tx=0x7f1a880046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 shutdown_connections 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa0159830 0x7f1aa00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa00cd290 0x7f1aa00c7ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.927+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a8006ac80 0x7f1a8006d140 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.928+0000 7f1a9ffff640 1 --2- 172.21.15.50:0/1897707553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa00c9d00 0x7f1aa00ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.928+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 >> 172.21.15.50:0/1897707553 conn(0x7f1aa006ab80 msgr2=0x7f1aa00cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.928+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 shutdown_connections 2023-08-10T10:39:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:21.928+0000 7f1a9ffff640 1 -- 172.21.15.50:0/1897707553 wait complete. 2023-08-10T10:39:21.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.175+0000 7f174fe0d640 1 Processor -- start 2023-08-10T10:39:22.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.176+0000 7f174fe0d640 1 -- start start 2023-08-10T10:39:22.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174fe0d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17480b0c60 0x7f17480c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174fe0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17480c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174fe0d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1748071c70 con 0x7f174815aa40 2023-08-10T10:39:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174fe0d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480713d0 con 0x7f17480b0c60 2023-08-10T10:39:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174fe0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480716b0 con 0x7f17480b3f30 2023-08-10T10:39:22.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174dba9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f174815aa40 0x7f17480b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41182/0 (socket says 172.21.15.50:41182) 2023-08-10T10:39:22.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.177+0000 7f174dba9640 1 -- 172.21.15.50:0/403764400 learned_addr learned my addr 172.21.15.50:0/403764400 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174d3a8640 1 --2- 172.21.15.50:0/403764400 >> v2:172.21.15.117:3300/0 conn(0x7f17480b0c60 0x7f17480c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248311328 0 0) 0x7f1748071c70 con 0x7f174815aa40 2023-08-10T10:39:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1734003520 con 0x7f174815aa40 2023-08-10T10:39:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174e3aa640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17480c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984423702 0 0) 0x7f1734003520 con 0x7f174815aa40 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 msgr2=0x7f17480c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17480c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 >> v2:172.21.15.117:3300/0 conn(0x7f17480b0c60 msgr2=0x7f17480c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 --2- 172.21.15.50:0/403764400 >> v2:172.21.15.117:3300/0 conn(0x7f17480b0c60 0x7f17480c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748071990 con 0x7f174815aa40 2023-08-10T10:39:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1744001670 con 0x7f174815aa40 2023-08-10T10:39:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 >> v1:172.21.15.50:6789/0 conn(0x7f174815aa40 legacy=0x7f17480b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.178+0000 7f174cba7640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f1734003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174cba7640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174cba7640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1734004d00 0x7f1734005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480713d0 con 0x7f1734003970 2023-08-10T10:39:22.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480716b0 con 0x7f1734004d00 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173400ba60 con 0x7f17480b3f30 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f1734003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174d3a8640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174e3aa640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1734004d00 0x7f1734005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 -- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 msgr2=0x7f17340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:22.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17480b3f30 0x7f17340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 -- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1734004d00 msgr2=0x7f1734005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1734004d00 0x7f1734005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174dba9640 1 -- 172.21.15.50:0/403764400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734003520 con 0x7f1734003970 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.179+0000 7f174e3aa640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1734004d00 0x7f1734005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174dba9640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f1734003d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f174400c240 tx=0x7f17340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ea97c02177d81a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174402cb00 con 0x7f1734003970 2023-08-10T10:39:22.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174402cc60 con 0x7f1734003970 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174cba7640 1 -- 172.21.15.50:0/403764400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744005af0 con 0x7f1734003970 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174fe0d640 1 -- 172.21.15.50:0/403764400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 msgr2=0x7f1734003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174fe0d640 1 --2- 172.21.15.50:0/403764400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f1734003d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f174400c240 tx=0x7f17340057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.181+0000 7f174e3aa640 1 -- 172.21.15.50:0/403764400 reap_dead start 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.182+0000 7f174fe0d640 1 -- 172.21.15.50:0/403764400 shutdown_connections 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.182+0000 7f174fe0d640 1 -- 172.21.15.50:0/403764400 >> 172.21.15.50:0/403764400 conn(0x7f174806b590 msgr2=0x7f17480ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:22.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.182+0000 7f174fe0d640 1 -- 172.21.15.50:0/403764400 shutdown_connections 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.182+0000 7f174fe0d640 1 -- 172.21.15.50:0/403764400 wait complete. 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.183+0000 7f174fe0d640 1 Processor -- start 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.184+0000 7f174fe0d640 1 -- start start 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.184+0000 7f174fe0d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.184+0000 7f174fe0d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17480b2cb0 0x7f17480c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.184+0000 7f174fe0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1748149ba0 0x7f17480c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174fe0d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c81e0 con 0x7f1734003970 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174fe0d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c84c0 con 0x7f17480b2cb0 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174fe0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c87a0 con 0x7f1748149ba0 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39760/0 (socket says 172.21.15.50:39760) 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 -- 172.21.15.50:0/4240012690 learned_addr learned my addr 172.21.15.50:0/4240012690 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:22.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174d3a8640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17480b2cb0 0x7f17480c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174e3aa640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1748149ba0 0x7f17480c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 -- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1748149ba0 msgr2=0x7f17480c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1748149ba0 0x7f17480c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 -- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17480b2cb0 msgr2=0x7f17480c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17480b2cb0 0x7f17480c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.185+0000 7f174dba9640 1 -- 172.21.15.50:0/4240012690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174815b480 con 0x7f1734003970 2023-08-10T10:39:22.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f174dba9640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f174400c240 tx=0x7f1744001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744039070 con 0x7f1734003970 2023-08-10T10:39:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744001630 con 0x7f1734003970 2023-08-10T10:39:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174403c040 con 0x7f1734003970 2023-08-10T10:39:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174815b760 con 0x7f1734003970 2023-08-10T10:39:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.186+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480c7f50 con 0x7f1734003970 2023-08-10T10:39:22.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.187+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174815b920 con 0x7f1734003970 2023-08-10T10:39:22.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.188+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1744032070 con 0x7f1734003970 2023-08-10T10:39:22.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.189+0000 7f173e7fc640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 0x7f172c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.190+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f17440aab50 con 0x7f1734003970 2023-08-10T10:39:22.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.190+0000 7f174d3a8640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 0x7f172c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.191+0000 7f174d3a8640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 0x7f172c06d140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f17480c5720 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.193+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1744075d80 con 0x7f1734003970 2023-08-10T10:39:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.387+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174804e270 con 0x7f1734003970 2023-08-10T10:39:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.389+0000 7f173e7fc640 1 -- 172.21.15.50:0/4240012690 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f1744046020 con 0x7f1734003970 2023-08-10T10:39:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:22.392 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 msgr2=0x7f172c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 0x7f172c06d140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f17480c5720 tx=0x7f1738008040 comp rx=0 tx=0).stop 2023-08-10T10:39:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 msgr2=0x7f17480b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f174400c240 tx=0x7f1744001a00 comp rx=0 tx=0).stop 2023-08-10T10:39:22.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 shutdown_connections 2023-08-10T10:39:22.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1748149ba0 0x7f17480c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172c06ac80 0x7f172c06d140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17480b2cb0 0x7f17480c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 --2- 172.21.15.50:0/4240012690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1734003970 0x7f17480b2770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 >> 172.21.15.50:0/4240012690 conn(0x7f174806b590 msgr2=0x7f17481578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 shutdown_connections 2023-08-10T10:39:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.392+0000 7f174fe0d640 1 -- 172.21.15.50:0/4240012690 wait complete. 2023-08-10T10:39:22.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:38:19.418051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:38:20.699927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:22.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.647+0000 7f5407fff640 1 Processor -- start 2023-08-10T10:39:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.647+0000 7f5407fff640 1 -- start start 2023-08-10T10:39:22.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.648+0000 7f5407fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54080b4130 0x7f54080c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.648+0000 7f5407fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54080aff00 0x7f54080b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.648+0000 7f5407fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080b0890 con 0x7f540815aa50 2023-08-10T10:39:22.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.648+0000 7f5407fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540815ae30 con 0x7f54080aff00 2023-08-10T10:39:22.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.648+0000 7f5407fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080b1370 con 0x7f54080b4130 2023-08-10T10:39:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54080aff00 0x7f54080b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54080aff00 0x7f54080b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39776/0 (socket says 172.21.15.50:39776) 2023-08-10T10:39:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 -- 172.21.15.50:0/4171470729 learned_addr learned my addr 172.21.15.50:0/4171470729 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54067fc640 1 --2- 172.21.15.50:0/4171470729 >> v2:172.21.15.117:3300/0 conn(0x7f54080b4130 0x7f54080c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 -- 172.21.15.50:0/4171470729 >> v2:172.21.15.117:3300/0 conn(0x7f54080b4130 msgr2=0x7f54080c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:22.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 --2- 172.21.15.50:0/4171470729 >> v2:172.21.15.117:3300/0 conn(0x7f54080b4130 0x7f54080c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.649+0000 7f54077fe640 1 -- 172.21.15.50:0/4171470729 >> v1:172.21.15.50:6789/0 conn(0x7f540815aa50 legacy=0x7f54080cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.650+0000 7f54077fe640 1 -- 172.21.15.50:0/4171470729 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080b1650 con 0x7f54080aff00 2023-08-10T10:39:22.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f54077fe640 1 --2- 172.21.15.50:0/4171470729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f54080b0350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f540806bc00 tx=0x7f540002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78447a05ce6f164 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f5405ffb640 1 -- 172.21.15.50:0/4171470729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540002ca80 con 0x7f54080aff00 2023-08-10T10:39:22.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f5405ffb640 1 -- 172.21.15.50:0/4171470729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540002cbe0 con 0x7f54080aff00 2023-08-10T10:39:22.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f5405ffb640 1 -- 172.21.15.50:0/4171470729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000343f0 con 0x7f54080aff00 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f5407fff640 1 -- 172.21.15.50:0/4171470729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 msgr2=0x7f54080b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.651+0000 7f5407fff640 1 --2- 172.21.15.50:0/4171470729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f54080b0350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f540806bc00 tx=0x7f540002bee0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 -- 172.21.15.50:0/4171470729 shutdown_connections 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 --2- 172.21.15.50:0/4171470729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f54080b0350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 --2- 172.21.15.50:0/4171470729 >> v2:172.21.15.117:3300/0 conn(0x7f54080b4130 0x7f54080c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 -- 172.21.15.50:0/4171470729 >> 172.21.15.50:0/4171470729 conn(0x7f5408069cd0 msgr2=0x7f54080caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 -- 172.21.15.50:0/4171470729 shutdown_connections 2023-08-10T10:39:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.652+0000 7f5407fff640 1 -- 172.21.15.50:0/4171470729 wait complete. 2023-08-10T10:39:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.654+0000 7f5407fff640 1 Processor -- start 2023-08-10T10:39:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.654+0000 7f5407fff640 1 -- start start 2023-08-10T10:39:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54080b4130 0x7f54081f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540815aa50 0x7f54080ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080c4e40 con 0x7f54080aff00 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540815bc40 con 0x7f540815aa50 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5407fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540815bf20 con 0x7f54080b4130 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39790/0 (socket says 172.21.15.50:39790) 2023-08-10T10:39:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.655+0000 7f5406ffd640 1 -- 172.21.15.50:0/3233438117 learned_addr learned my addr 172.21.15.50:0/3233438117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f54067fc640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54080b4130 0x7f54081f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 -- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54080b4130 msgr2=0x7f54081f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54080b4130 0x7f54081f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 -- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540815aa50 msgr2=0x7f54080ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540815aa50 0x7f54080ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 -- 172.21.15.50:0/3233438117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009b30 con 0x7f54080aff00 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5406ffd640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c450 tx=0x7f53f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00052d0 con 0x7f54080aff00 2023-08-10T10:39:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0005430 con 0x7f54080aff00 2023-08-10T10:39:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0012870 con 0x7f54080aff00 2023-08-10T10:39:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.656+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540815c200 con 0x7f54080aff00 2023-08-10T10:39:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.657+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540815c7c0 con 0x7f54080aff00 2023-08-10T10:39:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.658+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540815d220 con 0x7f54080aff00 2023-08-10T10:39:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.659+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53f00129d0 con 0x7f54080aff00 2023-08-10T10:39:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.659+0000 7f53ff7fe640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 0x7f53e806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.660+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f53f0088f30 con 0x7f54080aff00 2023-08-10T10:39:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.660+0000 7f54067fc640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 0x7f53e806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:22.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.660+0000 7f54067fc640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 0x7f53e806d140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53f8006fd0 tx=0x7f53f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:22.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.663+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53f0053f00 con 0x7f54080aff00 2023-08-10T10:39:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.858+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54080b1bf0 con 0x7f54080aff00 2023-08-10T10:39:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.859+0000 7f53ff7fe640 1 -- 172.21.15.50:0/3233438117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54080b1bf0 con 0x7f54080aff00 2023-08-10T10:39:22.861 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 msgr2=0x7f53e806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 0x7f53e806d140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53f8006fd0 tx=0x7f53f8008040 comp rx=0 tx=0).stop 2023-08-10T10:39:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 msgr2=0x7f540815cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c450 tx=0x7f53f000c910 comp rx=0 tx=0).stop 2023-08-10T10:39:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 shutdown_connections 2023-08-10T10:39:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac80 0x7f53e806d140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540815aa50 0x7f54080ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54080b4130 0x7f54081f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 --2- 172.21.15.50:0/3233438117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54080aff00 0x7f540815cce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 >> 172.21.15.50:0/3233438117 conn(0x7f5408069cd0 msgr2=0x7f54080af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 shutdown_connections 2023-08-10T10:39:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:22.862+0000 7f5407fff640 1 -- 172.21.15.50:0/3233438117 wait complete. 2023-08-10T10:39:22.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.118+0000 7f3d9f7a4640 1 Processor -- start 2023-08-10T10:39:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.118+0000 7f3d9f7a4640 1 -- start start 2023-08-10T10:39:23.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9f7a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d9815cb90 0x7f3d980b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9f7a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d98160a40 con 0x7f3d9815cf70 2023-08-10T10:39:23.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9f7a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980b4bb0 con 0x7f3d981615e0 2023-08-10T10:39:23.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9f7a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980b4e90 con 0x7f3d9815cb90 2023-08-10T10:39:23.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9cd3f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d9815cf70 0x7f3d98160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41204/0 (socket says 172.21.15.50:41204) 2023-08-10T10:39:23.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.120+0000 7f3d9cd3f640 1 -- 172.21.15.50:0/391581148 learned_addr learned my addr 172.21.15.50:0/391581148 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:23.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d9d540640 1 --2- 172.21.15.50:0/391581148 >> v2:172.21.15.117:3300/0 conn(0x7f3d9815cb90 0x7f3d980b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568285045 0 0) 0x7f3d98160a40 con 0x7f3d9815cf70 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d84003520 con 0x7f3d9815cf70 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912976615 0 0) 0x7f3d84003520 con 0x7f3d9815cf70 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 >> v2:172.21.15.117:3300/0 conn(0x7f3d9815cb90 msgr2=0x7f3d980b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 --2- 172.21.15.50:0/391581148 >> v2:172.21.15.117:3300/0 conn(0x7f3d9815cb90 0x7f3d980b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 >> v1:172.21.15.117:6789/0 conn(0x7f3d981615e0 legacy=0x7f3d9806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980b5170 con 0x7f3d9815cf70 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3d88001670 con 0x7f3d9815cf70 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 >> v1:172.21.15.50:6789/0 conn(0x7f3d9815cf70 legacy=0x7f3d98160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.121+0000 7f3d8ffff640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d8ffff640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d840047c0 0x7f3d84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d8ffff640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d84005180 0x7f3d8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980b4e90 con 0x7f3d84003970 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8400c020 con 0x7f3d84005180 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8400c1e0 con 0x7f3d840047c0 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d9d540640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d9cd3f640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d840047c0 0x7f3d84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.122+0000 7f3d9dd41640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d84005180 0x7f3d8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9d540640 1 -- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d840047c0 msgr2=0x7f3d84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9d540640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d840047c0 0x7f3d84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9d540640 1 -- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d84005180 msgr2=0x7f3d8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9d540640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d84005180 0x7f3d8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9d540640 1 -- 172.21.15.50:0/391581148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84003520 con 0x7f3d84003970 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9cd3f640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d840047c0 0x7f3d84004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9dd41640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d84005180 0x7f3d8400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:23.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.123+0000 7f3d9dd41640 1 -- 172.21.15.50:0/391581148 reap_dead start 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.124+0000 7f3d9d540640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d84003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009ac0 tx=0x7f3d840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c166629dcc1270e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.124+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9402c6b0 con 0x7f3d84003970 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.124+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9402c810 con 0x7f3d84003970 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.124+0000 7f3d8ffff640 1 -- 172.21.15.50:0/391581148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9402cba0 con 0x7f3d84003970 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 msgr2=0x7f3d84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d84003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009ac0 tx=0x7f3d840057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/391581148 shutdown_connections 2023-08-10T10:39:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/391581148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d84003d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/391581148 >> 172.21.15.50:0/391581148 conn(0x7f3d980cf640 msgr2=0x7f3d980cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/391581148 shutdown_connections 2023-08-10T10:39:23.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.125+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/391581148 wait complete. 2023-08-10T10:39:23.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.127+0000 7f3d9f7a4640 1 Processor -- start 2023-08-10T10:39:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.127+0000 7f3d9f7a4640 1 -- start start 2023-08-10T10:39:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d98154080 0x7f3d980c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d980c7090 0x7f3d980cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980c6640 con 0x7f3d84003970 2023-08-10T10:39:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980c8770 con 0x7f3d98154080 2023-08-10T10:39:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.128+0000 7f3d9f7a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980c8a50 con 0x7f3d980c7090 2023-08-10T10:39:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39812/0 (socket says 172.21.15.50:39812) 2023-08-10T10:39:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 -- 172.21.15.50:0/1454215382 learned_addr learned my addr 172.21.15.50:0/1454215382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9cd3f640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d98154080 0x7f3d980c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9dd41640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d980c7090 0x7f3d980cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 -- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d980c7090 msgr2=0x7f3d980cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d980c7090 0x7f3d980cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 -- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d98154080 msgr2=0x7f3d980c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d98154080 0x7f3d980c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.129+0000 7f3d9d540640 1 -- 172.21.15.50:0/1454215382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980c6890 con 0x7f3d84003970 2023-08-10T10:39:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d9d540640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3d9402c250 tx=0x7f3d94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94003810 con 0x7f3d84003970 2023-08-10T10:39:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94003970 con 0x7f3d84003970 2023-08-10T10:39:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d980c6b70 con 0x7f3d84003970 2023-08-10T10:39:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94003d00 con 0x7f3d84003970 2023-08-10T10:39:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.130+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d980c83b0 con 0x7f3d84003970 2023-08-10T10:39:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.131+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d980c8c10 con 0x7f3d84003970 2023-08-10T10:39:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.132+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d94047450 con 0x7f3d84003970 2023-08-10T10:39:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.133+0000 7f3d8dffb640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 0x7f3d7c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.133+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3d940ab7b0 con 0x7f3d84003970 2023-08-10T10:39:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.133+0000 7f3d9cd3f640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 0x7f3d7c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.134+0000 7f3d9cd3f640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 0x7f3d7c06d140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001eb0 tx=0x7f3d88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.137+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3d980c8c10 con 0x7f3d84003970 2023-08-10T10:39:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.338+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d980c8c10 con 0x7f3d84003970 2023-08-10T10:39:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.339+0000 7f3d8dffb640 1 -- 172.21.15.50:0/1454215382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d980c8c10 con 0x7f3d84003970 2023-08-10T10:39:23.341 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 msgr2=0x7f3d7c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 0x7f3d7c06d140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001eb0 tx=0x7f3d88009040 comp rx=0 tx=0).stop 2023-08-10T10:39:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 msgr2=0x7f3d98149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3d9402c250 tx=0x7f3d94004730 comp rx=0 tx=0).stop 2023-08-10T10:39:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 shutdown_connections 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d980c7090 0x7f3d980cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d7c06ac80 0x7f3d7c06d140 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d98154080 0x7f3d980c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 --2- 172.21.15.50:0/1454215382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d84003970 0x7f3d98149f40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.341+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 >> 172.21.15.50:0/1454215382 conn(0x7f3d980cf640 msgr2=0x7f3d980d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.342+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 shutdown_connections 2023-08-10T10:39:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.342+0000 7f3d9f7a4640 1 -- 172.21.15.50:0/1454215382 wait complete. 2023-08-10T10:39:23.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.584+0000 7f9eb5f29640 1 Processor -- start 2023-08-10T10:39:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.584+0000 7f9eb5f29640 1 -- start start 2023-08-10T10:39:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.586+0000 7f9eb5f29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb00ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.586+0000 7f9eb5f29640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9eb00696a0 0x7f9eb0069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.586+0000 7f9eb5f29640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00cdb20 con 0x7f9eb0161360 2023-08-10T10:39:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.586+0000 7f9eb5f29640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb006a070 con 0x7f9eb00696a0 2023-08-10T10:39:23.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.586+0000 7f9eb5f29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00cde00 con 0x7f9eb015ca80 2023-08-10T10:39:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.587+0000 7f9eb4f27640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb00ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.587+0000 7f9eb5728640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9eb00696a0 0x7f9eb0069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.587+0000 7f9eb4f27640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb00ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:44948/0 (socket says 172.21.15.50:44948) 2023-08-10T10:39:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.587+0000 7f9eb4f27640 1 -- 172.21.15.50:0/304817183 learned_addr learned my addr 172.21.15.50:0/304817183 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.588+0000 7f9eb5728640 1 -- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 msgr2=0x7f9eb00ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.588+0000 7f9eb5728640 1 --2- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb00ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.588+0000 7f9eb5728640 1 -- 172.21.15.50:0/304817183 >> v1:172.21.15.117:6789/0 conn(0x7f9eb0161360 legacy=0x7f9eb00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.588+0000 7f9eb5728640 1 -- 172.21.15.50:0/304817183 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00cc0d0 con 0x7f9eb00696a0 2023-08-10T10:39:23.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.589+0000 7f9eb5728640 1 --2- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb00696a0 0x7f9eb0069b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf2346bdada2e5a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.591+0000 7f9eaf7fe640 1 -- 172.21.15.50:0/304817183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea802cc60 con 0x7f9eb00696a0 2023-08-10T10:39:23.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eaf7fe640 1 -- 172.21.15.50:0/304817183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea802cdc0 con 0x7f9eb00696a0 2023-08-10T10:39:23.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eaf7fe640 1 -- 172.21.15.50:0/304817183 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8034660 con 0x7f9eb00696a0 2023-08-10T10:39:23.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 -- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb00696a0 msgr2=0x7f9eb0069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb00696a0 0x7f9eb0069b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802beb0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 -- 172.21.15.50:0/304817183 shutdown_connections 2023-08-10T10:39:23.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb00696a0 0x7f9eb0069b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/304817183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb00ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.592+0000 7f9eb5f29640 1 -- 172.21.15.50:0/304817183 >> 172.21.15.50:0/304817183 conn(0x7f9eb00caf80 msgr2=0x7f9eb00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:23.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.593+0000 7f9eb5f29640 1 -- 172.21.15.50:0/304817183 shutdown_connections 2023-08-10T10:39:23.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.593+0000 7f9eb5f29640 1 -- 172.21.15.50:0/304817183 wait complete. 2023-08-10T10:39:23.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.595+0000 7f9eb5f29640 1 Processor -- start 2023-08-10T10:39:23.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.595+0000 7f9eb5f29640 1 -- start start 2023-08-10T10:39:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.596+0000 7f9eb5f29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.596+0000 7f9eb5f29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb01f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb5f29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 0x7f9eb00c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb5f29640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01f5970 con 0x7f9eb00696a0 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb5f29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01f5c50 con 0x7f9eb0161360 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb5f29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01f2bf0 con 0x7f9eb015ca80 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb4f27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb4f27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39828/0 (socket says 172.21.15.50:39828) 2023-08-10T10:39:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb4f27640 1 -- 172.21.15.50:0/1035216302 learned_addr learned my addr 172.21.15.50:0/1035216302 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eb5728640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 0x7f9eb00c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.597+0000 7f9eaffff640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb01f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 -- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 msgr2=0x7f9eb01f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb01f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 -- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 msgr2=0x7f9eb00c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 0x7f9eb00c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 -- 172.21.15.50:0/1035216302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8009a70 con 0x7f9eb00696a0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb5728640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 0x7f9eb00c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eaffff640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb01f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb4f27640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e8b0 tx=0x7f9ea400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400c940 con 0x7f9eb00696a0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400caa0 con 0x7f9eb00696a0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400ce30 con 0x7f9eb00696a0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.598+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb01f2ed0 con 0x7f9eb00696a0 2023-08-10T10:39:23.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.599+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb01f6620 con 0x7f9eb00696a0 2023-08-10T10:39:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.600+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0066e30 con 0x7f9eb00696a0 2023-08-10T10:39:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.601+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ea4013470 con 0x7f9eb00696a0 2023-08-10T10:39:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.602+0000 7f9ead7fa640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 0x7f9e9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.602+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9ea40896a0 con 0x7f9eb00696a0 2023-08-10T10:39:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.602+0000 7f9eaffff640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 0x7f9e9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.603+0000 7f9eaffff640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 0x7f9e9406d110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007fd0 tx=0x7f9e9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:23.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.606+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9ea4054700 con 0x7f9eb00696a0 2023-08-10T10:39:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.800+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eb00ac960 con 0x7f9eb00696a0 2023-08-10T10:39:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.800+0000 7f9ead7fa640 1 -- 172.21.15.50:0/1035216302 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ea4057d20 con 0x7f9eb00696a0 2023-08-10T10:39:23.802 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:39:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 msgr2=0x7f9e9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 0x7f9e9406d110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007fd0 tx=0x7f9e9c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 msgr2=0x7f9eb0070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e8b0 tx=0x7f9ea400ed70 comp rx=0 tx=0).stop 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 shutdown_connections 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e9406ac50 0x7f9e9406d110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eb0161360 0x7f9eb00c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9eb015ca80 0x7f9eb01f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 --2- 172.21.15.50:0/1035216302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9eb00696a0 0x7f9eb0070420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 >> 172.21.15.50:0/1035216302 conn(0x7f9eb00caf80 msgr2=0x7f9eb00c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 shutdown_connections 2023-08-10T10:39:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:23.803+0000 7f9eb5f29640 1 -- 172.21.15.50:0/1035216302 wait complete. 2023-08-10T10:39:23.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:39:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.055+0000 7f0d5bfff640 1 Processor -- start 2023-08-10T10:39:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.055+0000 7f0d5bfff640 1 -- start start 2023-08-10T10:39:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 0x7f0d5c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 0x7f0d5c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c15aee0 con 0x7f0d5c069be0 2023-08-10T10:39:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c06a050 con 0x7f0d5c1583c0 2023-08-10T10:39:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0b2100 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 0x7f0d5c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0d5c069be0 0x7f0d5c06ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:45850/0 (socket says 172.21.15.50:45850) 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d527fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 0x7f0d5c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5b7fe640 1 -- 172.21.15.50:0/1976920718 learned_addr learned my addr 172.21.15.50:0/1976920718 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.057+0000 7f0d5affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 0x7f0d5c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:33334/0 (socket says 172.21.15.50:33334) 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.058+0000 7f0d527fc640 1 -- 172.21.15.50:0/1976920718 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 msgr2=0x7f0d5c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.058+0000 7f0d527fc640 1 --2- 172.21.15.50:0/1976920718 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 0x7f0d5c0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.058+0000 7f0d527fc640 1 -- 172.21.15.50:0/1976920718 >> v1:172.21.15.117:6789/0 conn(0x7f0d5c069be0 legacy=0x7f0d5c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.058+0000 7f0d527fc640 1 -- 172.21.15.50:0/1976920718 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c15b1a0 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.060+0000 7f0d527fc640 1 --2- 172.21.15.50:0/1976920718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 0x7f0d5c0696a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d440097a0 tx=0x7f0d4402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4df8edfaebfba11 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.060+0000 7f0d5a7fc640 1 -- 172.21.15.50:0/1976920718 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4402e070 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.060+0000 7f0d5a7fc640 1 -- 172.21.15.50:0/1976920718 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d440315a0 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.060+0000 7f0d5a7fc640 1 -- 172.21.15.50:0/1976920718 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44031930 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 -- 172.21.15.50:0/1976920718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 msgr2=0x7f0d5c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/1976920718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 0x7f0d5c0696a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d440097a0 tx=0x7f0d4402b840 comp rx=0 tx=0).stop 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 -- 172.21.15.50:0/1976920718 shutdown_connections 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/1976920718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c0b1ba0 0x7f0d5c0696a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/1976920718 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c1583c0 0x7f0d5c0b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 -- 172.21.15.50:0/1976920718 >> 172.21.15.50:0/1976920718 conn(0x7f0d5c0caf80 msgr2=0x7f0d5c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 -- 172.21.15.50:0/1976920718 shutdown_connections 2023-08-10T10:39:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.061+0000 7f0d5bfff640 1 -- 172.21.15.50:0/1976920718 wait complete. 2023-08-10T10:39:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.063+0000 7f0d5bfff640 1 Processor -- start 2023-08-10T10:39:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.064+0000 7f0d5bfff640 1 -- start start 2023-08-10T10:39:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c069be0 0x7f0d5c070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c1583c0 0x7f0d5c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c155630 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c071600 con 0x7f0d5c069be0 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d5bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c070d70 con 0x7f0d5c1583c0 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39838/0 (socket says 172.21.15.50:39838) 2023-08-10T10:39:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.065+0000 7f0d527fc640 1 -- 172.21.15.50:0/3890403841 learned_addr learned my addr 172.21.15.50:0/3890403841 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d5affd640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c069be0 0x7f0d5c070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d5b7fe640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c1583c0 0x7f0d5c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 -- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c1583c0 msgr2=0x7f0d5c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c1583c0 0x7f0d5c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 -- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c069be0 msgr2=0x7f0d5c070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c069be0 0x7f0d5c070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 -- 172.21.15.50:0/3890403841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009400 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d527fc640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0d44034040 tx=0x7f0d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.066+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44032840 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.067+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d440329c0 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.067+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44032d70 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.067+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c071040 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.067+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c155250 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.068+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c0cad80 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.069+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d4404e430 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.070+0000 7f0d53fff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 0x7f0d3c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.070+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d440ab640 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.070+0000 7f0d5affd640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 0x7f0d3c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.071+0000 7f0d5affd640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 0x7f0d3c06d110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0073f0 tx=0x7f0d4c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.074+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0d44076610 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.274+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d5c15b730 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.275+0000 7f0d53fff640 1 -- 172.21.15.50:0/3890403841 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d44079c30 con 0x7f0d5c0b1ba0 2023-08-10T10:39:24.277 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:39:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.277+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 msgr2=0x7f0d3c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.277+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 0x7f0d3c06d110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0073f0 tx=0x7f0d4c00b040 comp rx=0 tx=0).stop 2023-08-10T10:39:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.277+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 msgr2=0x7f0d5c15e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.277+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0d44034040 tx=0x7f0d440046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 shutdown_connections 2023-08-10T10:39:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c1583c0 0x7f0d5c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c0b1ba0 0x7f0d5c15e7e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d3c06ac50 0x7f0d3c06d110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 --2- 172.21.15.50:0/3890403841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c069be0 0x7f0d5c070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 >> 172.21.15.50:0/3890403841 conn(0x7f0d5c0caf80 msgr2=0x7f0d5c0af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 shutdown_connections 2023-08-10T10:39:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.278+0000 7f0d5bfff640 1 -- 172.21.15.50:0/3890403841 wait complete. 2023-08-10T10:39:24.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.518+0000 7f31aa9fc640 1 Processor -- start 2023-08-10T10:39:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.518+0000 7f31aa9fc640 1 -- start start 2023-08-10T10:39:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.519+0000 7f31aa9fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 0x7f31a40b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.519+0000 7f31aa9fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 0x7f31a40b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.519+0000 7f31aa9fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a40719f0 con 0x7f31a40c9b30 2023-08-10T10:39:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.519+0000 7f31aa9fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a40c8db0 con 0x7f31a4069db0 2023-08-10T10:39:24.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.519+0000 7f31aa9fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40c9050 con 0x7f31a415ccb0 2023-08-10T10:39:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.520+0000 7f31a8f99640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 0x7f31a40b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.520+0000 7f31a3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 0x7f31a40b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.520+0000 7f31a37fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f31a40c9b30 0x7f31a40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:45856/0 (socket says 172.21.15.50:45856) 2023-08-10T10:39:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.520+0000 7f31a37fe640 1 -- 172.21.15.50:0/4176371895 learned_addr learned my addr 172.21.15.50:0/4176371895 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.521+0000 7f31a3fff640 1 -- 172.21.15.50:0/4176371895 >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 msgr2=0x7f31a40b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:24.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.521+0000 7f31a3fff640 1 --2- 172.21.15.50:0/4176371895 >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 0x7f31a40b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.521+0000 7f31a3fff640 1 -- 172.21.15.50:0/4176371895 >> v1:172.21.15.117:6789/0 conn(0x7f31a40c9b30 legacy=0x7f31a40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.521+0000 7f31a3fff640 1 -- 172.21.15.50:0/4176371895 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40c9330 con 0x7f31a415ccb0 2023-08-10T10:39:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.521+0000 7f31a8f99640 1 --2- 172.21.15.50:0/4176371895 >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 0x7f31a40b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:39:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.524+0000 7f31a3fff640 1 --2- 172.21.15.50:0/4176371895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 0x7f31a40b2900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ac487c4ee8748c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31a2ffd640 1 -- 172.21.15.50:0/4176371895 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319402cc50 con 0x7f31a415ccb0 2023-08-10T10:39:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31a2ffd640 1 -- 172.21.15.50:0/4176371895 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319402cdb0 con 0x7f31a415ccb0 2023-08-10T10:39:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31a2ffd640 1 -- 172.21.15.50:0/4176371895 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194034660 con 0x7f31a415ccb0 2023-08-10T10:39:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 -- 172.21.15.50:0/4176371895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 msgr2=0x7f31a40b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/4176371895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 0x7f31a40b2900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402bea0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 -- 172.21.15.50:0/4176371895 shutdown_connections 2023-08-10T10:39:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/4176371895 >> v2:172.21.15.117:3300/0 conn(0x7f31a4069db0 0x7f31a40b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/4176371895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a415ccb0 0x7f31a40b2900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 -- 172.21.15.50:0/4176371895 >> 172.21.15.50:0/4176371895 conn(0x7f31a406b590 msgr2=0x7f31a40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 -- 172.21.15.50:0/4176371895 shutdown_connections 2023-08-10T10:39:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.525+0000 7f31aa9fc640 1 -- 172.21.15.50:0/4176371895 wait complete. 2023-08-10T10:39:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.526+0000 7f31aa9fc640 1 Processor -- start 2023-08-10T10:39:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.527+0000 7f31aa9fc640 1 -- start start 2023-08-10T10:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.527+0000 7f31aa9fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.527+0000 7f31aa9fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a40c9b30 0x7f31a40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31aa9fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 0x7f31a40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31aa9fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a414d0f0 con 0x7f31a4069db0 2023-08-10T10:39:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31aa9fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40ad200 con 0x7f31a415ccb0 2023-08-10T10:39:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31aa9fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40ad4e0 con 0x7f31a40c9b30 2023-08-10T10:39:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39840/0 (socket says 172.21.15.50:39840) 2023-08-10T10:39:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 -- 172.21.15.50:0/2806061805 learned_addr learned my addr 172.21.15.50:0/2806061805 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a37fe640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a40c9b30 0x7f31a40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a8f99640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 0x7f31a40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 -- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a40c9b30 msgr2=0x7f31a40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a40c9b30 0x7f31a40ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 -- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 msgr2=0x7f31a40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 0x7f31a40ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a3fff640 1 -- 172.21.15.50:0/2806061805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c009400 con 0x7f31a4069db0 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.528+0000 7f31a8f99640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 0x7f31a40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31a3fff640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3194009eb0 tx=0x7f3194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319403e610 con 0x7f31a4069db0 2023-08-10T10:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319403e770 con 0x7f31a4069db0 2023-08-10T10:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319403eae0 con 0x7f31a4069db0 2023-08-10T10:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3194009a70 con 0x7f31a4069db0 2023-08-10T10:39:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.529+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a40adaa0 con 0x7f31a4069db0 2023-08-10T10:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.531+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a404e270 con 0x7f31a4069db0 2023-08-10T10:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.532+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f319403b050 con 0x7f31a4069db0 2023-08-10T10:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.533+0000 7f31a0ff9640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 0x7f318406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.533+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f31940abf20 con 0x7f31a4069db0 2023-08-10T10:39:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.533+0000 7f31a37fe640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 0x7f318406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.533+0000 7f31a37fe640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 0x7f318406d110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31a40cce80 tx=0x7f318c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.537+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3194076ef0 con 0x7f31a4069db0 2023-08-10T10:39:24.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.768+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31a415b170 con 0x7f31a4069db0 2023-08-10T10:39:24.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.769+0000 7f31a0ff9640 1 -- 172.21.15.50:0/2806061805 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f3194039090 con 0x7f31a4069db0 2023-08-10T10:39:24.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:24.771 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:39:24.771 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:39:24.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.771+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 msgr2=0x7f318406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.771+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 0x7f318406d110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31a40cce80 tx=0x7f318c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.771+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 msgr2=0x7f31a414cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.771+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3194009eb0 tx=0x7f3194004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 shutdown_connections 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f318406ac50 0x7f318406d110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a415ccb0 0x7f31a40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a40c9b30 0x7f31a40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 --2- 172.21.15.50:0/2806061805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a4069db0 0x7f31a414cbb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:24.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 >> 172.21.15.50:0/2806061805 conn(0x7f31a406b590 msgr2=0x7f31a40cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:24.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 shutdown_connections 2023-08-10T10:39:24.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:24.772+0000 7f31aa9fc640 1 -- 172.21.15.50:0/2806061805 wait complete. 2023-08-10T10:39:24.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.022+0000 7fe28a762640 1 Processor -- start 2023-08-10T10:39:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe28a762640 1 -- start start 2023-08-10T10:39:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe28a762640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe284159830 0x7fe2840cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe28a762640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840cc5a0 con 0x7fe2840cd290 2023-08-10T10:39:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe28a762640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28415d720 con 0x7fe2840c9d00 2023-08-10T10:39:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe28a762640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840b4170 con 0x7fe284159830 2023-08-10T10:39:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe289f61640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2840cd290 0x7fe2840cd6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57774/0 (socket says 172.21.15.50:57774) 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.023+0000 7fe289f61640 1 -- 172.21.15.50:0/1133786905 learned_addr learned my addr 172.21.15.50:0/1133786905 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe289760640 1 --2- 172.21.15.50:0/1133786905 >> v2:172.21.15.117:3300/0 conn(0x7fe284159830 0x7fe2840cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474790294 0 0) 0x7fe2840cc5a0 con 0x7fe2840cd290 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe270003520 con 0x7fe2840cd290 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054783689 0 0) 0x7fe270003520 con 0x7fe2840cd290 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 >> v2:172.21.15.117:3300/0 conn(0x7fe284159830 msgr2=0x7fe2840cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 --2- 172.21.15.50:0/1133786905 >> v2:172.21.15.117:3300/0 conn(0x7fe284159830 0x7fe2840cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 >> v1:172.21.15.117:6789/0 conn(0x7fe2840c9d00 legacy=0x7fe28415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284159c10 con 0x7fe2840cd290 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe27c001670 con 0x7fe2840cd290 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.024+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 >> v1:172.21.15.50:6789/0 conn(0x7fe2840cd290 legacy=0x7fe2840cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2700039e0 0x7fe270003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 0x7fe270004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700051f0 0x7fe27000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27000c120 con 0x7fe2700047c0 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27000c290 con 0x7fe2700039e0 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27000c450 con 0x7fe2700051f0 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 0x7fe270004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe289760640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2700039e0 0x7fe270003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 -- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700051f0 msgr2=0x7fe27000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe289f61640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700051f0 0x7fe27000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700051f0 0x7fe27000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 -- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2700039e0 msgr2=0x7fe270003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2700039e0 0x7fe270003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.025+0000 7fe288f5f640 1 -- 172.21.15.50:0/1133786905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270003520 con 0x7fe2700047c0 2023-08-10T10:39:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.026+0000 7fe289f61640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700051f0 0x7fe27000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.026+0000 7fe289760640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2700039e0 0x7fe270003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.026+0000 7fe289f61640 1 -- 172.21.15.50:0/1133786905 reap_dead start 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.027+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 0x7fe270004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe274001750 tx=0x7fe2700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed29623cbb485bc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.027+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2740052d0 con 0x7fe2700047c0 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.027+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27402e050 con 0x7fe2700047c0 2023-08-10T10:39:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.027+0000 7fe27bfff640 1 -- 172.21.15.50:0/1133786905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274003830 con 0x7fe2700047c0 2023-08-10T10:39:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 -- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 msgr2=0x7fe270004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 0x7fe270004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe274001750 tx=0x7fe2700057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 -- 172.21.15.50:0/1133786905 shutdown_connections 2023-08-10T10:39:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 --2- 172.21.15.50:0/1133786905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2700047c0 0x7fe270004c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 -- 172.21.15.50:0/1133786905 >> 172.21.15.50:0/1133786905 conn(0x7fe28406ab80 msgr2=0x7fe28406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 -- 172.21.15.50:0/1133786905 shutdown_connections 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.028+0000 7fe28a762640 1 -- 172.21.15.50:0/1133786905 wait complete. 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.030+0000 7fe28a762640 1 Processor -- start 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.030+0000 7fe28a762640 1 -- start start 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700047c0 0x7fe284154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 0x7fe2840ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840c1e10 con 0x7fe2840c4b70 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840adbb0 con 0x7fe2840ad1f0 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28406e700 con 0x7fe2700047c0 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47956/0 (socket says 172.21.15.50:47956) 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 -- 172.21.15.50:0/1879065202 learned_addr learned my addr 172.21.15.50:0/1879065202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe289760640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700047c0 0x7fe284154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe289f61640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 0x7fe2840ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 -- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700047c0 msgr2=0x7fe284154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700047c0 0x7fe284154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 -- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 msgr2=0x7fe2840ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 0x7fe2840ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 -- 172.21.15.50:0/1879065202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28406e950 con 0x7fe2840c4b70 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe289f61640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 0x7fe2840ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe288f5f640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe27402bc10 tx=0x7fe274001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2740076c0 con 0x7fe2840c4b70 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe274007a30 con 0x7fe2840c4b70 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274006be0 con 0x7fe2840c4b70 2023-08-10T10:39:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.032+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28406ec30 con 0x7fe2840c4b70 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.033+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28406f1f0 con 0x7fe2840c4b70 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.034+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2840cc040 con 0x7fe2840c4b70 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.035+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe274006d40 con 0x7fe2840c4b70 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.037+0000 7fe279ffb640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 0x7fe26806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.037+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe2740ab1c0 con 0x7fe2840c4b70 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.037+0000 7fe289760640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 0x7fe26806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.037+0000 7fe289760640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 0x7fe26806d110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe284158930 tx=0x7fe28000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.041+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe274079c20 con 0x7fe2840c4b70 2023-08-10T10:39:25.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.236+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe284066e30 con 0x7fe2840c4b70 2023-08-10T10:39:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.239+0000 7fe279ffb640 1 -- 172.21.15.50:0/1879065202 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fe2740797b0 con 0x7fe2840c4b70 2023-08-10T10:39:25.240 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:25.240 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:25.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 msgr2=0x7fe26806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 0x7fe26806d110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe284158930 tx=0x7fe28000b040 comp rx=0 tx=0).stop 2023-08-10T10:39:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 msgr2=0x7fe284154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe27402bc10 tx=0x7fe274001120 comp rx=0 tx=0).stop 2023-08-10T10:39:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 shutdown_connections 2023-08-10T10:39:25.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe26806ac50 0x7fe26806d110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2840ad1f0 0x7fe2840ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2840c4b70 0x7fe284154150 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 --2- 172.21.15.50:0/1879065202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2700047c0 0x7fe284154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 >> 172.21.15.50:0/1879065202 conn(0x7fe28406ab80 msgr2=0x7fe2840c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 shutdown_connections 2023-08-10T10:39:25.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.242+0000 7fe28a762640 1 -- 172.21.15.50:0/1879065202 wait complete. 2023-08-10T10:39:25.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:39:25.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:25.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.492+0000 7f6c9759e640 1 Processor -- start 2023-08-10T10:39:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.493+0000 7f6c9759e640 1 -- start start 2023-08-10T10:39:25.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c9759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c9815a940 0x7f6c980aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c9759e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980b1f10 con 0x7f6c9815f2b0 2023-08-10T10:39:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c9759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9815e7d0 con 0x7f6c980b19d0 2023-08-10T10:39:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c9759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980b21f0 con 0x7f6c9815a940 2023-08-10T10:39:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c9659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c9815a940 0x7f6c980aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c8dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c9815f2b0 0x7f6c980b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57778/0 (socket says 172.21.15.50:57778) 2023-08-10T10:39:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.494+0000 7f6c8dd9b640 1 -- 172.21.15.50:0/3764369339 learned_addr learned my addr 172.21.15.50:0/3764369339 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.495+0000 7f6c95d9b640 1 -- 172.21.15.50:0/3764369339 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296955896 0 0) 0x7f6c980b1f10 con 0x7f6c9815f2b0 2023-08-10T10:39:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.495+0000 7f6c95d9b640 1 -- 172.21.15.50:0/3764369339 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84003520 con 0x7f6c9815f2b0 2023-08-10T10:39:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.495+0000 7f6c9659c640 1 -- 172.21.15.50:0/3764369339 >> v1:172.21.15.117:6789/0 conn(0x7f6c980b19d0 legacy=0x7f6c980ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.495+0000 7f6c9659c640 1 -- 172.21.15.50:0/3764369339 >> v1:172.21.15.50:6789/0 conn(0x7f6c9815f2b0 legacy=0x7f6c980b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.495+0000 7f6c9659c640 1 -- 172.21.15.50:0/3764369339 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9815eab0 con 0x7f6c9815a940 2023-08-10T10:39:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.496+0000 7f6c9659c640 1 --2- 172.21.15.50:0/3764369339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815a940 0x7f6c980aff10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097a0 tx=0x7f6c8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd243d56b81a459 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.496+0000 7f6c95d9b640 1 -- 172.21.15.50:0/3764369339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88031830 con 0x7f6c9815a940 2023-08-10T10:39:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.496+0000 7f6c95d9b640 1 -- 172.21.15.50:0/3764369339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88031990 con 0x7f6c9815a940 2023-08-10T10:39:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.496+0000 7f6c95d9b640 1 -- 172.21.15.50:0/3764369339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88031d20 con 0x7f6c9815a940 2023-08-10T10:39:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 -- 172.21.15.50:0/3764369339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815a940 msgr2=0x7f6c980aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 --2- 172.21.15.50:0/3764369339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815a940 0x7f6c980aff10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097a0 tx=0x7f6c8802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 -- 172.21.15.50:0/3764369339 shutdown_connections 2023-08-10T10:39:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 --2- 172.21.15.50:0/3764369339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815a940 0x7f6c980aff10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 -- 172.21.15.50:0/3764369339 >> 172.21.15.50:0/3764369339 conn(0x7f6c9806ab80 msgr2=0x7f6c9806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 -- 172.21.15.50:0/3764369339 shutdown_connections 2023-08-10T10:39:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.497+0000 7f6c9759e640 1 -- 172.21.15.50:0/3764369339 wait complete. 2023-08-10T10:39:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.499+0000 7f6c9759e640 1 Processor -- start 2023-08-10T10:39:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.499+0000 7f6c9759e640 1 -- start start 2023-08-10T10:39:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 0x7f6c980c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 0x7f6c980b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c4e80 con 0x7f6c9815f2b0 2023-08-10T10:39:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c3850 con 0x7f6c980b19d0 2023-08-10T10:39:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.500+0000 7f6c9759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c4ba0 con 0x7f6c9815a940 2023-08-10T10:39:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47976/0 (socket says 172.21.15.50:47976) 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 -- 172.21.15.50:0/2451352794 learned_addr learned my addr 172.21.15.50:0/2451352794 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c8dd9b640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 0x7f6c980b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c9659c640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 0x7f6c980c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 -- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 msgr2=0x7f6c980b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 0x7f6c980b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 -- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 msgr2=0x7f6c980c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 0x7f6c980c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c96d9d640 1 -- 172.21.15.50:0/2451352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88009400 con 0x7f6c9815f2b0 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c8dd9b640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 0x7f6c980b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.501+0000 7f6c9659c640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 0x7f6c980c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c96d9d640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c90001eb0 tx=0x7f6c9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900052d0 con 0x7f6c9815f2b0 2023-08-10T10:39:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90005430 con 0x7f6c9815f2b0 2023-08-10T10:39:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90003810 con 0x7f6c9815f2b0 2023-08-10T10:39:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980c3190 con 0x7f6c9815f2b0 2023-08-10T10:39:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.502+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c980c8110 con 0x7f6c9815f2b0 2023-08-10T10:39:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.503+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c980c2ff0 con 0x7f6c9815f2b0 2023-08-10T10:39:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.504+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c90003970 con 0x7f6c9815f2b0 2023-08-10T10:39:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.505+0000 7f6c8f7fe640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 0x7f6c7806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.505+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c90088ad0 con 0x7f6c9815f2b0 2023-08-10T10:39:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.505+0000 7f6c9659c640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 0x7f6c7806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.506+0000 7f6c9659c640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 0x7f6c7806d110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c88036000 tx=0x7f6c88008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.510+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6c980c2ff0 con 0x7f6c9815f2b0 2023-08-10T10:39:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.740+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c980c3990 con 0x7f6c9815f2b0 2023-08-10T10:39:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.741+0000 7f6c8f7fe640 1 -- 172.21.15.50:0/2451352794 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f6c980c3990 con 0x7f6c9815f2b0 2023-08-10T10:39:25.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:25.742 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:39:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:39:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 msgr2=0x7f6c7806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 0x7f6c7806d110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c88036000 tx=0x7f6c88008030 comp rx=0 tx=0).stop 2023-08-10T10:39:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 msgr2=0x7f6c98150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c90001eb0 tx=0x7f6c9000c890 comp rx=0 tx=0).stop 2023-08-10T10:39:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 shutdown_connections 2023-08-10T10:39:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815f2b0 0x7f6c98150860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c9815a940 0x7f6c980b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6c7806ac50 0x7f6c7806d110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 --2- 172.21.15.50:0/2451352794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c980b19d0 0x7f6c980c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 >> 172.21.15.50:0/2451352794 conn(0x7f6c9806ab80 msgr2=0x7f6c98159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 shutdown_connections 2023-08-10T10:39:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.744+0000 7f6c9759e640 1 -- 172.21.15.50:0/2451352794 wait complete. 2023-08-10T10:39:25.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.973+0000 7f88c022d640 1 Processor -- start 2023-08-10T10:39:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.973+0000 7f88c022d640 1 -- start start 2023-08-10T10:39:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88c022d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88b80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88c022d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b8071c70 con 0x7f88b80b0c60 2023-08-10T10:39:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88c022d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80713d0 con 0x7f88b815aa40 2023-08-10T10:39:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88c022d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80716b0 con 0x7f88b80b3f30 2023-08-10T10:39:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88bd7c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88b80b0c60 0x7f88b80c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57794/0 (socket says 172.21.15.50:57794) 2023-08-10T10:39:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.975+0000 7f88bd7c8640 1 -- 172.21.15.50:0/2734679146 learned_addr learned my addr 172.21.15.50:0/2734679146 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.976+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888976474 0 0) 0x7f88b8071c70 con 0x7f88b80b0c60 2023-08-10T10:39:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.976+0000 7f88be7ca640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88b80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.976+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a4003520 con 0x7f88b80b0c60 2023-08-10T10:39:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.976+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778297894 0 0) 0x7f88a4003520 con 0x7f88b80b0c60 2023-08-10T10:39:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.976+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 msgr2=0x7f88b80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88b80ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 >> v1:172.21.15.117:6789/0 conn(0x7f88b815aa40 legacy=0x7f88b80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8071990 con 0x7f88b80b0c60 2023-08-10T10:39:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f88a8001670 con 0x7f88b80b0c60 2023-08-10T10:39:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 >> v1:172.21.15.50:6789/0 conn(0x7f88b80b0c60 legacy=0x7f88b80c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40039a0 0x7f88a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a40047c0 0x7f88a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80716b0 con 0x7f88a40047c0 2023-08-10T10:39:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a400bae0 con 0x7f88a40039a0 2023-08-10T10:39:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a400bca0 con 0x7f88b80b3f30 2023-08-10T10:39:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a40047c0 0x7f88a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bdfc9640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40039a0 0x7f88a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88be7ca640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.977+0000 7f88bd7c8640 1 -- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 msgr2=0x7f88a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.978+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.978+0000 7f88bd7c8640 1 -- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40039a0 msgr2=0x7f88a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.978+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40039a0 0x7f88a4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.978+0000 7f88bd7c8640 1 -- 172.21.15.50:0/2734679146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a4003520 con 0x7f88a40047c0 2023-08-10T10:39:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.978+0000 7f88be7ca640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b80b3f30 0x7f88a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a40047c0 0x7f88a4004c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c240 tx=0x7f88a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7146cbc5fbfa7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8005ad0 con 0x7f88a40047c0 2023-08-10T10:39:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8005c30 con 0x7f88a40047c0 2023-08-10T10:39:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88bcfc7640 1 -- 172.21.15.50:0/2734679146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a802c8b0 con 0x7f88a40047c0 2023-08-10T10:39:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88c022d640 1 -- 172.21.15.50:0/2734679146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a40047c0 msgr2=0x7f88a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.979+0000 7f88c022d640 1 --2- 172.21.15.50:0/2734679146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88a40047c0 0x7f88a4004c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c240 tx=0x7f88a40057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.980+0000 7f88be7ca640 1 -- 172.21.15.50:0/2734679146 reap_dead start 2023-08-10T10:39:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.980+0000 7f88c022d640 1 -- 172.21.15.50:0/2734679146 shutdown_connections 2023-08-10T10:39:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.980+0000 7f88c022d640 1 -- 172.21.15.50:0/2734679146 >> 172.21.15.50:0/2734679146 conn(0x7f88b806b590 msgr2=0x7f88b80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.980+0000 7f88c022d640 1 -- 172.21.15.50:0/2734679146 shutdown_connections 2023-08-10T10:39:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.980+0000 7f88c022d640 1 -- 172.21.15.50:0/2734679146 wait complete. 2023-08-10T10:39:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.982+0000 7f88c022d640 1 Processor -- start 2023-08-10T10:39:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.982+0000 7f88c022d640 1 -- start start 2023-08-10T10:39:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 0x7f88b80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 0x7f88b806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81493b0 con 0x7f88b80c74a0 2023-08-10T10:39:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b806f300 con 0x7f88a40047c0 2023-08-10T10:39:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88c022d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b814cac0 con 0x7f88b806e940 2023-08-10T10:39:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88bd7c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88bd7c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48006/0 (socket says 172.21.15.50:48006) 2023-08-10T10:39:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88bd7c8640 1 -- 172.21.15.50:0/4180189335 learned_addr learned my addr 172.21.15.50:0/4180189335 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.983+0000 7f88bdfc9640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 0x7f88b80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88be7ca640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 0x7f88b806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 -- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 msgr2=0x7f88b806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 0x7f88b806edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 -- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 msgr2=0x7f88b80c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 0x7f88b80c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 -- 172.21.15.50:0/4180189335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80c7c60 con 0x7f88b80c74a0 2023-08-10T10:39:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88be7ca640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 0x7f88b806edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bdfc9640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 0x7f88b80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88bd7c8640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c240 tx=0x7f88a8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a803c040 con 0x7f88b80c74a0 2023-08-10T10:39:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a802ccc0 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b81525e0 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.984+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80072b0 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.985+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b8152ba0 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.986+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b804e270 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.987+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88a8032070 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.989+0000 7f88ae7fc640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 0x7f889c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.989+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f88a80aa9d0 con 0x7f88b80c74a0 2023-08-10T10:39:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.989+0000 7f88bdfc9640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 0x7f889c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.990+0000 7f88bdfc9640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 0x7f889c06d140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001630 tx=0x7f88b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:25.993+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88a80759a0 con 0x7f88b80c74a0 2023-08-10T10:39:26.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.224+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b80cf3a0 con 0x7f88b80c74a0 2023-08-10T10:39:26.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.226+0000 7f88ae7fc640 1 -- 172.21.15.50:0/4180189335 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f88a8078fc0 con 0x7f88b80c74a0 2023-08-10T10:39:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:26.227 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3445929869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3445929869},{"type":"v1","addr":"172.21.15.50:6835","nonce":3445929869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1892373877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1892373877},{"type":"v1","addr":"172.21.15.50:6837","nonce":1892373877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4183572441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":4183572441},{"type":"v1","addr":"172.21.15.117:6835","nonce":4183572441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:38:21.683617+0000","modified":"2023-08-10T10:38:25.365469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3889640263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3889640263},{"type":"v1","addr":"172.21.15.117:6834","nonce":3889640263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:39:26.227 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-08-10T10:39:26.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 msgr2=0x7f889c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 0x7f889c06d140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001630 tx=0x7f88b4009040 comp rx=0 tx=0).stop 2023-08-10T10:39:26.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 msgr2=0x7f88b81efc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c240 tx=0x7f88a8001a00 comp rx=0 tx=0).stop 2023-08-10T10:39:26.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 shutdown_connections 2023-08-10T10:39:26.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88b806e940 0x7f88b806edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b80c74a0 0x7f88b81efc10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f889c06ac80 0x7f889c06d140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 --2- 172.21.15.50:0/4180189335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88a40047c0 0x7f88b80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 >> 172.21.15.50:0/4180189335 conn(0x7f88b806b590 msgr2=0x7f88b80cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:26.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 shutdown_connections 2023-08-10T10:39:26.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.229+0000 7f88c022d640 1 -- 172.21.15.50:0/4180189335 wait complete. 2023-08-10T10:39:26.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:26.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.482+0000 7f3f3330f640 1 Processor -- start 2023-08-10T10:39:26.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.482+0000 7f3f3330f640 1 -- start start 2023-08-10T10:39:26.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f3330f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3f2c0cad30 0x7f3f2c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f3330f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c0c93f0 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f3330f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c0c96d0 con 0x7f3f2c15aa00 2023-08-10T10:39:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f3330f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c071450 con 0x7f3f2c0cad30 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f32b0e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f2c0ca1b0 0x7f3f2c06b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57800/0 (socket says 172.21.15.50:57800) 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f32b0e640 1 -- 172.21.15.50:0/1143852225 learned_addr learned my addr 172.21.15.50:0/1143852225 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.484+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/1143852225 >> v2:172.21.15.117:3300/0 conn(0x7f3f2c0cad30 0x7f3f2c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363389627 0 0) 0x7f3f2c0c93f0 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f18003520 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646782254 0 0) 0x7f3f18003520 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 >> v2:172.21.15.117:3300/0 conn(0x7f3f2c0cad30 msgr2=0x7f3f2c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 --2- 172.21.15.50:0/1143852225 >> v2:172.21.15.117:3300/0 conn(0x7f3f2c0cad30 0x7f3f2c070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 >> v1:172.21.15.117:6789/0 conn(0x7f3f2c15aa00 legacy=0x7f3f2c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0c99b0 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3f240019f0 con 0x7f3f2c0ca1b0 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 >> v1:172.21.15.50:6789/0 conn(0x7f3f2c0ca1b0 legacy=0x7f3f2c06b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f180039e0 0x7f3f18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f180047c0 0x7f3f18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 0x7f3f1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c071450 con 0x7f3f18005180 2023-08-10T10:39:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800c0b0 con 0x7f3f180039e0 2023-08-10T10:39:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.485+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800c270 con 0x7f3f180047c0 2023-08-10T10:39:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 0x7f3f1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f3230d640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f180039e0 0x7f3f18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f180047c0 0x7f3f18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 -- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f180047c0 msgr2=0x7f3f18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f180047c0 0x7f3f18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 -- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f180039e0 msgr2=0x7f3f18003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f180039e0 0x7f3f18003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f32b0e640 1 -- 172.21.15.50:0/1143852225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18003520 con 0x7f3f18005180 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f180047c0 0x7f3f18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.486+0000 7f3f3230d640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f180039e0 0x7f3f18003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.487+0000 7f3f32b0e640 1 -- 172.21.15.50:0/1143852225 reap_dead start 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.487+0000 7f3f32b0e640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 0x7f3f1800b980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a800 tx=0x7f3f180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c541346d62b984b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240072d0 con 0x7f3f18005180 2023-08-10T10:39:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2402f070 con 0x7f3f18005180 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3130b640 1 -- 172.21.15.50:0/1143852225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24007670 con 0x7f3f18005180 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 -- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 msgr2=0x7f3f1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 0x7f3f1800b980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a800 tx=0x7f3f180057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 -- 172.21.15.50:0/1143852225 shutdown_connections 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 --2- 172.21.15.50:0/1143852225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f18005180 0x7f3f1800b980 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 -- 172.21.15.50:0/1143852225 >> 172.21.15.50:0/1143852225 conn(0x7f3f2c0cb710 msgr2=0x7f3f2c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 -- 172.21.15.50:0/1143852225 shutdown_connections 2023-08-10T10:39:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.488+0000 7f3f3330f640 1 -- 172.21.15.50:0/1143852225 wait complete. 2023-08-10T10:39:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.490+0000 7f3f3330f640 1 Processor -- start 2023-08-10T10:39:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.490+0000 7f3f3330f640 1 -- start start 2023-08-10T10:39:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f18005180 0x7f3f2c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2c1515c0 0x7f3f2c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c13dc30 con 0x7f3f2c13d270 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c152f60 con 0x7f3f2c1515c0 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.491+0000 7f3f3330f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c152820 con 0x7f3f18005180 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48032/0 (socket says 172.21.15.50:48032) 2023-08-10T10:39:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 -- 172.21.15.50:0/984787518 learned_addr learned my addr 172.21.15.50:0/984787518 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 -- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f18005180 msgr2=0x7f3f2c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f18005180 0x7f3f2c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 -- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2c1515c0 msgr2=0x7f3f2c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f32b0e640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2c1515c0 0x7f3f2c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2c1515c0 0x7f3f2c151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.492+0000 7f3f31b0c640 1 -- 172.21.15.50:0/984787518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c152260 con 0x7f3f2c13d270 2023-08-10T10:39:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f31b0c640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0108b0 tx=0x7f3f1c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00eb60 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c00ecc0 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c01c400 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c152540 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.493+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c151f60 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.494+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c04e910 con 0x7f3f2c13d270 2023-08-10T10:39:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.495+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f1c01c560 con 0x7f3f2c13d270 2023-08-10T10:39:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.497+0000 7f3f22ffd640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 0x7f3f1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.497+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3f1c089ba0 con 0x7f3f2c13d270 2023-08-10T10:39:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.497+0000 7f3f3230d640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 0x7f3f1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.498+0000 7f3f3230d640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 0x7f3f1006d110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f28001510 tx=0x7f3f28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.501+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f1c0586b0 con 0x7f3f2c13d270 2023-08-10T10:39:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.697+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f2c066e30 con 0x7f3f2c13d270 2023-08-10T10:39:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.699+0000 7f3f22ffd640 1 -- 172.21.15.50:0/984787518 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f3f1c058240 con 0x7f3f2c13d270 2023-08-10T10:39:26.700 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:26.700 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:07.444299+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:38:19.418051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:38:20.699927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:26.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 msgr2=0x7f3f1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 0x7f3f1006d110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f28001510 tx=0x7f3f28009040 comp rx=0 tx=0).stop 2023-08-10T10:39:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 msgr2=0x7f3f2c13d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0108b0 tx=0x7f3f1c010d70 comp rx=0 tx=0).stop 2023-08-10T10:39:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 shutdown_connections 2023-08-10T10:39:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f1006ac50 0x7f3f1006d110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2c1515c0 0x7f3f2c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f2c13d270 0x7f3f2c13d6f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 --2- 172.21.15.50:0/984787518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f18005180 0x7f3f2c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 >> 172.21.15.50:0/984787518 conn(0x7f3f2c0cb710 msgr2=0x7f3f2c158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 shutdown_connections 2023-08-10T10:39:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.702+0000 7f3f3330f640 1 -- 172.21.15.50:0/984787518 wait complete. 2023-08-10T10:39:26.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:39:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.938+0000 7f7a8daf5640 1 Processor -- start 2023-08-10T10:39:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.938+0000 7f7a8daf5640 1 -- start start 2023-08-10T10:39:26.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.939+0000 7f7a8daf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a880ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a8daf5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8815def0 con 0x7f7a880696a0 2023-08-10T10:39:26.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a8daf5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880ce350 con 0x7f7a88159830 2023-08-10T10:39:26.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a8daf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815e380 con 0x7f7a88069b30 2023-08-10T10:39:26.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a87fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a880696a0 0x7f7a880cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57810/0 (socket says 172.21.15.50:57810) 2023-08-10T10:39:26.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a87fff640 1 -- 172.21.15.50:0/2959846252 learned_addr learned my addr 172.21.15.50:0/2959846252 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:26.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a880ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201586640 0 0) 0x7f7a8815def0 con 0x7f7a880696a0 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.940+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a78003520 con 0x7f7a880696a0 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229676630 0 0) 0x7f7a78003520 con 0x7f7a880696a0 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 msgr2=0x7f7a880ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a880ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 >> v1:172.21.15.117:6789/0 conn(0x7f7a88159830 legacy=0x7f7a880cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8815d5c0 con 0x7f7a880696a0 2023-08-10T10:39:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7a74001670 con 0x7f7a880696a0 2023-08-10T10:39:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 >> v1:172.21.15.50:6789/0 conn(0x7f7a880696a0 legacy=0x7f7a880cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a78003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78003f90 0x7f7a780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a78004d00 0x7f7a78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815e380 con 0x7f7a78004d00 2023-08-10T10:39:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800dcf0 con 0x7f7a78003f90 2023-08-10T10:39:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7800deb0 con 0x7f7a88069b30 2023-08-10T10:39:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.941+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a78004d00 0x7f7a78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8caf3640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a78003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a87fff640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78003f90 0x7f7a780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 msgr2=0x7f7a78003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88069b30 0x7f7a78003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78003f90 msgr2=0x7f7a780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78003f90 0x7f7a780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.942+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/2959846252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78003520 con 0x7f7a78004d00 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.943+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a78004d00 0x7f7a78005180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009fc0 tx=0x7f7a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80593b58432b7ea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.943+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8002cc20 con 0x7f7a78004d00 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.943+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000f040 con 0x7f7a78004d00 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.943+0000 7f7a877fe640 1 -- 172.21.15.50:0/2959846252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80034440 con 0x7f7a78004d00 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 -- 172.21.15.50:0/2959846252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a78004d00 msgr2=0x7f7a78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/2959846252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a78004d00 0x7f7a78005180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009fc0 tx=0x7f7a780057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/2959846252 reap_dead start 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 -- 172.21.15.50:0/2959846252 shutdown_connections 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 -- 172.21.15.50:0/2959846252 >> 172.21.15.50:0/2959846252 conn(0x7f7a880cafa0 msgr2=0x7f7a880cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 -- 172.21.15.50:0/2959846252 shutdown_connections 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.944+0000 7f7a8daf5640 1 -- 172.21.15.50:0/2959846252 wait complete. 2023-08-10T10:39:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.946+0000 7f7a8daf5640 1 Processor -- start 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.946+0000 7f7a8daf5640 1 -- start start 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 0x7f7a88148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88156160 0x7f7a88159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815ba70 con 0x7f7a881484f0 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815bd50 con 0x7f7a78004d00 2023-08-10T10:39:26.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8daf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815c030 con 0x7f7a88156160 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.947+0000 7f7a8d2f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48062/0 (socket says 172.21.15.50:48062) 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/3438087517 learned_addr learned my addr 172.21.15.50:0/3438087517 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8caf3640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 0x7f7a88148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a87fff640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88156160 0x7f7a88159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88156160 msgr2=0x7f7a88159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88156160 0x7f7a88159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 msgr2=0x7f7a88148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 0x7f7a88148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 -- 172.21.15.50:0/3438087517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8815c310 con 0x7f7a881484f0 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8caf3640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 0x7f7a88148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:26.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.948+0000 7f7a8d2f4640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a80037040 tx=0x7f7a80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.949+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80034ad0 con 0x7f7a881484f0 2023-08-10T10:39:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.949+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80034c30 con 0x7f7a881484f0 2023-08-10T10:39:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.949+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80003990 con 0x7f7a881484f0 2023-08-10T10:39:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.949+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8815c5f0 con 0x7f7a881484f0 2023-08-10T10:39:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.949+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a88149140 con 0x7f7a881484f0 2023-08-10T10:39:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.950+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a88066e30 con 0x7f7a881484f0 2023-08-10T10:39:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.951+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a80047460 con 0x7f7a881484f0 2023-08-10T10:39:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.952+0000 7f7a857fa640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 0x7f7a6c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.953+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7a800ab460 con 0x7f7a881484f0 2023-08-10T10:39:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.953+0000 7f7a8caf3640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 0x7f7a6c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.954+0000 7f7a8caf3640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 0x7f7a6c06d110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a881f5b10 tx=0x7f7a7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:26.957+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a800764c0 con 0x7f7a881484f0 2023-08-10T10:39:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.187+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a880ca520 con 0x7f7a881484f0 2023-08-10T10:39:27.188 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:39:27.188+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:39:27.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.197+0000 7f7a857fa640 1 -- 172.21.15.50:0/3438087517 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a80079ae0 con 0x7f7a881484f0 2023-08-10T10:39:27.197 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:39:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 msgr2=0x7f7a6c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 0x7f7a6c06d110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a881f5b10 tx=0x7f7a7c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 msgr2=0x7f7a8815cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a80037040 tx=0x7f7a80009750 comp rx=0 tx=0).stop 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 shutdown_connections 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.199+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a881484f0 0x7f7a8815cb10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a88156160 0x7f7a88159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6c06ac50 0x7f7a6c06d110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 --2- 172.21.15.50:0/3438087517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a78004d00 0x7f7a88148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 >> 172.21.15.50:0/3438087517 conn(0x7f7a880cafa0 msgr2=0x7f7a8806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 shutdown_connections 2023-08-10T10:39:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.200+0000 7f7a8daf5640 1 -- 172.21.15.50:0/3438087517 wait complete. 2023-08-10T10:39:27.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:39:27.223 INFO:tasks.ceph.mds.d.smithi117.stderr: -4394> 2023-08-10T10:38:26.346+0000 7ff9e2115640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:39:27.325 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:39:27.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.439+0000 7fe70226a640 1 Processor -- start 2023-08-10T10:39:27.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.439+0000 7fe70226a640 1 -- start start 2023-08-10T10:39:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.440+0000 7fe70226a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.440+0000 7fe70226a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6fc0b5af0 0x7fe6fc0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.440+0000 7fe70226a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc0d1220 con 0x7fe6fc15ce00 2023-08-10T10:39:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.440+0000 7fe70226a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0d2930 con 0x7fe6fc0cd730 2023-08-10T10:39:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.440+0000 7fe70226a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0b8a30 con 0x7fe6fc0b5af0 2023-08-10T10:39:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48074/0 (socket says 172.21.15.50:48074) 2023-08-10T10:39:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 -- 172.21.15.50:0/965237501 learned_addr learned my addr 172.21.15.50:0/965237501 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 -- 172.21.15.50:0/965237501 >> v2:172.21.15.117:3300/0 conn(0x7fe6fc0b5af0 msgr2=0x7fe6fc0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:27.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/965237501 >> v2:172.21.15.117:3300/0 conn(0x7fe6fc0b5af0 0x7fe6fc0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 -- 172.21.15.50:0/965237501 >> v1:172.21.15.50:6789/0 conn(0x7fe6fc15ce00 legacy=0x7fe6fc0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.441+0000 7fe6fbfff640 1 -- 172.21.15.50:0/965237501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0b1e70 con 0x7fe6fc0cd730 2023-08-10T10:39:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.442+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/965237501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070bd0 tx=0x7fe6ec02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312a5585e0010077 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe6faffd640 1 -- 172.21.15.50:0/965237501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec02cb10 con 0x7fe6fc0cd730 2023-08-10T10:39:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe6faffd640 1 -- 172.21.15.50:0/965237501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec02cc70 con 0x7fe6fc0cd730 2023-08-10T10:39:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe6faffd640 1 -- 172.21.15.50:0/965237501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0343f0 con 0x7fe6fc0cd730 2023-08-10T10:39:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 -- 172.21.15.50:0/965237501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc0cd730 msgr2=0x7fe6fc0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 --2- 172.21.15.50:0/965237501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070bd0 tx=0x7fe6ec02bf70 comp rx=0 tx=0).stop 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 -- 172.21.15.50:0/965237501 shutdown_connections 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 --2- 172.21.15.50:0/965237501 >> v2:172.21.15.117:3300/0 conn(0x7fe6fc0b5af0 0x7fe6fc0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 --2- 172.21.15.50:0/965237501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc0cd730 0x7fe6fc0d23f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 -- 172.21.15.50:0/965237501 >> 172.21.15.50:0/965237501 conn(0x7fe6fc0d2c60 msgr2=0x7fe6fc0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 -- 172.21.15.50:0/965237501 shutdown_connections 2023-08-10T10:39:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.443+0000 7fe70226a640 1 -- 172.21.15.50:0/965237501 wait complete. 2023-08-10T10:39:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.445+0000 7fe70226a640 1 Processor -- start 2023-08-10T10:39:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.445+0000 7fe70226a640 1 -- start start 2023-08-10T10:39:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6fc0b5af0 0x7fe6fc0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6fc0cd730 0x7fe6fc15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc15d1e0 con 0x7fe6fc15ce00 2023-08-10T10:39:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc15d4c0 con 0x7fe6fc0b5af0 2023-08-10T10:39:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.446+0000 7fe70226a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc15d7a0 con 0x7fe6fc0cd730 2023-08-10T10:39:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48088/0 (socket says 172.21.15.50:48088) 2023-08-10T10:39:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 -- 172.21.15.50:0/2919201651 learned_addr learned my addr 172.21.15.50:0/2919201651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6fc0b5af0 0x7fe6fc0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe6fb7fe640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6fc0cd730 0x7fe6fc15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 -- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6fc0cd730 msgr2=0x7fe6fc15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6fc0cd730 0x7fe6fc15ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 -- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6fc0b5af0 msgr2=0x7fe6fc0b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6fc0b5af0 0x7fe6fc0b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.447+0000 7fe700807640 1 -- 172.21.15.50:0/2919201651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009b30 con 0x7fe6fc15ce00 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe700807640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b3e0 tx=0x7fe6f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4011830 con 0x7fe6fc15ce00 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4011990 con 0x7fe6fc15ce00 2023-08-10T10:39:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4011d20 con 0x7fe6fc15ce00 2023-08-10T10:39:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc15da80 con 0x7fe6fc15ce00 2023-08-10T10:39:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.448+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc15e040 con 0x7fe6fc15ce00 2023-08-10T10:39:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.449+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc04e270 con 0x7fe6fc15ce00 2023-08-10T10:39:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.450+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6f401a400 con 0x7fe6fc15ce00 2023-08-10T10:39:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.451+0000 7fe6f8ff9640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 0x7fe6dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.452+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe6f4089640 con 0x7fe6fc15ce00 2023-08-10T10:39:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.452+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 0x7fe6dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.453+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 0x7fe6dc06d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec035000 tx=0x7fe6ec030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.456+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe6f4054650 con 0x7fe6fc15ce00 2023-08-10T10:39:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:27.694+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe6fc0b2a40 con 0x7fe6fc15ce00 2023-08-10T10:39:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.199+0000 7fe6f8ff9640 1 -- 172.21.15.50:0/2919201651 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6f4057c70 con 0x7fe6fc15ce00 2023-08-10T10:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 msgr2=0x7fe6dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 0x7fe6dc06d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec035000 tx=0x7fe6ec030000 comp rx=0 tx=0).stop 2023-08-10T10:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 msgr2=0x7fe6fc15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b3e0 tx=0x7fe6f4009f90 comp rx=0 tx=0).stop 2023-08-10T10:39:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 shutdown_connections 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc15ce00 0x7fe6fc15f440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6fc0cd730 0x7fe6fc15ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6dc06ac50 0x7fe6dc06d110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 --2- 172.21.15.50:0/2919201651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6fc0b5af0 0x7fe6fc0b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.203+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 >> 172.21.15.50:0/2919201651 conn(0x7fe6fc0d2c60 msgr2=0x7fe6fc0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.204+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 shutdown_connections 2023-08-10T10:39:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.204+0000 7fe70226a640 1 -- 172.21.15.50:0/2919201651 wait complete. 2023-08-10T10:39:28.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:39:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.472+0000 7fe3dd698640 1 Processor -- start 2023-08-10T10:39:28.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.472+0000 7fe3dd698640 1 -- start start 2023-08-10T10:39:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3dd698640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3d80cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3dd698640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d80b3ed0 con 0x7fe3d8159810 2023-08-10T10:39:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3dd698640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d80cd940 con 0x7fe3d80c9d70 2023-08-10T10:39:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3dd698640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80cc160 con 0x7fe3d80cd3c0 2023-08-10T10:39:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3d7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3d8159810 0x7fe3d80b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57818/0 (socket says 172.21.15.50:57818) 2023-08-10T10:39:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.474+0000 7fe3d7fff640 1 -- 172.21.15.50:0/1427657753 learned_addr learned my addr 172.21.15.50:0/1427657753 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3d80cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518137286 0 0) 0x7fe3d80b3ed0 con 0x7fe3d8159810 2023-08-10T10:39:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c0003520 con 0x7fe3d8159810 2023-08-10T10:39:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 607571447 0 0) 0x7fe3c0003520 con 0x7fe3d8159810 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 msgr2=0x7fe3d80cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3d80cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 >> v1:172.21.15.117:6789/0 conn(0x7fe3d80c9d70 legacy=0x7fe3d80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d80cdc20 con 0x7fe3d8159810 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe3c80019f0 con 0x7fe3d8159810 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 >> v1:172.21.15.50:6789/0 conn(0x7fe3d8159810 legacy=0x7fe3d80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c0003a10 0x7fe3c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c00047c0 0x7fe3c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80cc160 con 0x7fe3c00047c0 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c000dcc0 con 0x7fe3c0003a10 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.475+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c000de80 con 0x7fe3d80cd3c0 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c00047c0 0x7fe3c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c0003a10 0x7fe3c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3dce97640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 -- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 msgr2=0x7fe3c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 -- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c0003a10 msgr2=0x7fe3c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c0003a10 0x7fe3c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d77fe640 1 -- 172.21.15.50:0/1427657753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0003520 con 0x7fe3c00047c0 2023-08-10T10:39:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c0003a10 0x7fe3c0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.476+0000 7fe3dce97640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d80cd3c0 0x7fe3c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.477+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c00047c0 0x7fe3c0004c40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ac0 tx=0x7fe3c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27e5d1da2330c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc02c6b0 con 0x7fe3c00047c0 2023-08-10T10:39:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc02c810 con 0x7fe3c00047c0 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3d6ffd640 1 -- 172.21.15.50:0/1427657753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc02cba0 con 0x7fe3c00047c0 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3dd698640 1 -- 172.21.15.50:0/1427657753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c00047c0 msgr2=0x7fe3c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3dd698640 1 --2- 172.21.15.50:0/1427657753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c00047c0 0x7fe3c0004c40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ac0 tx=0x7fe3c00057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3dce97640 1 -- 172.21.15.50:0/1427657753 reap_dead start 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3dd698640 1 -- 172.21.15.50:0/1427657753 shutdown_connections 2023-08-10T10:39:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.478+0000 7fe3dd698640 1 -- 172.21.15.50:0/1427657753 >> 172.21.15.50:0/1427657753 conn(0x7fe3d80b0050 msgr2=0x7fe3d80b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.479+0000 7fe3dd698640 1 -- 172.21.15.50:0/1427657753 shutdown_connections 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.479+0000 7fe3dd698640 1 -- 172.21.15.50:0/1427657753 wait complete. 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.480+0000 7fe3dd698640 1 Processor -- start 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.480+0000 7fe3dd698640 1 -- start start 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 0x7fe3d80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d8158b40 0x7fe3d8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d806ffe0 con 0x7fe3d806f620 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80c84f0 con 0x7fe3c00047c0 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.481+0000 7fe3dd698640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80ceef0 con 0x7fe3d8158b40 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48100/0 (socket says 172.21.15.50:48100) 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 -- 172.21.15.50:0/2422669983 learned_addr learned my addr 172.21.15.50:0/2422669983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3d77fe640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d8158b40 0x7fe3d8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 0x7fe3d80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 -- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d8158b40 msgr2=0x7fe3d8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d8158b40 0x7fe3d8156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 -- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 msgr2=0x7fe3d80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 0x7fe3d80c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 -- 172.21.15.50:0/2422669983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d80c8270 con 0x7fe3d806f620 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 0x7fe3d80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.482+0000 7fe3dce97640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80c5560 tx=0x7fe3d000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.483+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000b070 con 0x7fe3d806f620 2023-08-10T10:39:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.483+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0005270 con 0x7fe3d806f620 2023-08-10T10:39:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.483+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0007030 con 0x7fe3d806f620 2023-08-10T10:39:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.483+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d8156ed0 con 0x7fe3d806f620 2023-08-10T10:39:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.483+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80ce8a0 con 0x7fe3d806f620 2023-08-10T10:39:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.484+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d8066e30 con 0x7fe3d806f620 2023-08-10T10:39:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.485+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3d0007190 con 0x7fe3d806f620 2023-08-10T10:39:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.487+0000 7fe3d4ff9640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 0x7fe3c406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.487+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe3d0088f70 con 0x7fe3d806f620 2023-08-10T10:39:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.487+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 0x7fe3c406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.488+0000 7fe3d7fff640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 0x7fe3c406d0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8002230 tx=0x7fe3c80012d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.491+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe3d0053e60 con 0x7fe3d806f620 2023-08-10T10:39:28.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:28.683+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3d80cf030 con 0x7fe3d806f620 2023-08-10T10:39:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.629+0000 7fe3d4ff9640 1 -- 172.21.15.50:0/2422669983 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe3d0057480 con 0x7fe3d806f620 2023-08-10T10:39:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:39:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.633+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 msgr2=0x7fe3c406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.633+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 0x7fe3c406d0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8002230 tx=0x7fe3c80012d0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.633+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 msgr2=0x7fe3d806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.633+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80c5560 tx=0x7fe3d000d890 comp rx=0 tx=0).stop 2023-08-10T10:39:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 shutdown_connections 2023-08-10T10:39:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d806f620 0x7fe3d806faa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3d8158b40 0x7fe3d8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3c406abe0 0x7fe3c406d0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 --2- 172.21.15.50:0/2422669983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3c00047c0 0x7fe3d80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 >> 172.21.15.50:0/2422669983 conn(0x7fe3d80b0050 msgr2=0x7fe3d80adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 shutdown_connections 2023-08-10T10:39:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.634+0000 7fe3dd698640 1 -- 172.21.15.50:0/2422669983 wait complete. 2023-08-10T10:39:29.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:39:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.891+0000 7f4555ac9640 1 Processor -- start 2023-08-10T10:39:29.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.891+0000 7f4555ac9640 1 -- start start 2023-08-10T10:39:29.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.892+0000 7f4555ac9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f455006e570 0x7f455006e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4555ac9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 0x7f4550162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4555ac9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4550162770 con 0x7f45500c3a10 2023-08-10T10:39:29.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4555ac9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006ee90 con 0x7f455006e570 2023-08-10T10:39:29.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4555ac9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4550164ba0 con 0x7f45500b6060 2023-08-10T10:39:29.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f455006e570 0x7f455006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:29.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f455006e570 0x7f455006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48116/0 (socket says 172.21.15.50:48116) 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 -- 172.21.15.50:0/3850990335 learned_addr learned my addr 172.21.15.50:0/3850990335 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f45552c8640 1 --2- 172.21.15.50:0/3850990335 >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 0x7f4550162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 -- 172.21.15.50:0/3850990335 >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 msgr2=0x7f4550162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3850990335 >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 0x7f4550162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 -- 172.21.15.50:0/3850990335 >> v1:172.21.15.50:6789/0 conn(0x7f45500c3a10 legacy=0x7f4550070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f4554ac7640 1 -- 172.21.15.50:0/3850990335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550164e80 con 0x7f455006e570 2023-08-10T10:39:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.893+0000 7f454f7fe640 1 -- 172.21.15.50:0/3850990335 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474955482 0 0) 0x7f4550162770 con 0x7f45500c3a10 2023-08-10T10:39:29.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.894+0000 7f45552c8640 1 --2- 172.21.15.50:0/3850990335 >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 0x7f4550162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.895+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3850990335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455006e570 0x7f455006e950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45500b59b0 tx=0x7f454002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ce9083cbb15cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.895+0000 7f454f7fe640 1 -- 172.21.15.50:0/3850990335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540030860 con 0x7f455006e570 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.895+0000 7f454f7fe640 1 -- 172.21.15.50:0/3850990335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45400309c0 con 0x7f455006e570 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.895+0000 7f454f7fe640 1 -- 172.21.15.50:0/3850990335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540030d50 con 0x7f455006e570 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 -- 172.21.15.50:0/3850990335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455006e570 msgr2=0x7f455006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3850990335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455006e570 0x7f455006e950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45500b59b0 tx=0x7f454002b9a0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 -- 172.21.15.50:0/3850990335 shutdown_connections 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3850990335 >> v2:172.21.15.117:3300/0 conn(0x7f45500b6060 0x7f4550162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3850990335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455006e570 0x7f455006e950 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 -- 172.21.15.50:0/3850990335 >> 172.21.15.50:0/3850990335 conn(0x7f45500d0650 msgr2=0x7f45500d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 -- 172.21.15.50:0/3850990335 shutdown_connections 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.896+0000 7f4555ac9640 1 -- 172.21.15.50:0/3850990335 wait complete. 2023-08-10T10:39:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.898+0000 7f4555ac9640 1 Processor -- start 2023-08-10T10:39:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.898+0000 7f4555ac9640 1 -- start start 2023-08-10T10:39:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 0x7f45500c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45500c3a10 0x7f45500b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b4c40 con 0x7f45500b6060 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c8320 con 0x7f455006e570 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4555ac9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c8600 con 0x7f45500c3a10 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48130/0 (socket says 172.21.15.50:48130) 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 -- 172.21.15.50:0/3250332704 learned_addr learned my addr 172.21.15.50:0/3250332704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 -- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45500c3a10 msgr2=0x7f45500b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45500c3a10 0x7f45500b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 -- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 msgr2=0x7f45500c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 0x7f45500c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.899+0000 7f454ffff640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 0x7f45500c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f454ffff640 1 -- 172.21.15.50:0/3250332704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400094d0 con 0x7f45500b6060 2023-08-10T10:39:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 0x7f45500c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f454ffff640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f453800c7f0 tx=0x7f453800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538003da0 con 0x7f45500b6060 2023-08-10T10:39:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538005070 con 0x7f45500b6060 2023-08-10T10:39:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538005400 con 0x7f45500b6060 2023-08-10T10:39:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500c88e0 con 0x7f45500b6060 2023-08-10T10:39:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.900+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500c8ea0 con 0x7f45500b6060 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.901+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455006c840 con 0x7f45500b6060 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.902+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4538005560 con 0x7f45500b6060 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.903+0000 7f454d7fa640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 0x7f453006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.904+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f4538088ca0 con 0x7f45500b6060 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.904+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 0x7f453006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.904+0000 7f4554ac7640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 0x7f453006d110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4540036000 tx=0x7f454003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:29.908+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4538053e60 con 0x7f45500b6060 2023-08-10T10:39:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.102+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45500c90b0 con 0x7f45500b6060 2023-08-10T10:39:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.644+0000 7f454d7fa640 1 -- 172.21.15.50:0/3250332704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4538017020 con 0x7f45500b6060 2023-08-10T10:39:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:39:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.657+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 msgr2=0x7f453006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.657+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 0x7f453006d110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4540036000 tx=0x7f454003b040 comp rx=0 tx=0).stop 2023-08-10T10:39:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.657+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 msgr2=0x7f455006a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.657+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f453800c7f0 tx=0x7f453800ccb0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 shutdown_connections 2023-08-10T10:39:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45500c3a10 0x7f45500b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45500b6060 0x7f455006a0b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453006ac50 0x7f453006d110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 --2- 172.21.15.50:0/3250332704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006e570 0x7f45500c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 >> 172.21.15.50:0/3250332704 conn(0x7f45500d0650 msgr2=0x7f45500b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 shutdown_connections 2023-08-10T10:39:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.658+0000 7f4555ac9640 1 -- 172.21.15.50:0/3250332704 wait complete. 2023-08-10T10:39:30.683 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:39:30.683 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:39:30.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:39:30.684 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:39:30.685 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:39:30.685 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:39:30.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:39:30.686 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:39:30.686 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:39:30.687 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:39:30.687 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:39:30.687 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:39:30.687 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:39:30.688 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:39:30.688 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:39:30.688 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:39:30.704 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:39:30.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:39:30.707 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:39:30.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:39:30.712 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:39:30.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:39:30.716 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:39:30.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:39:30.755 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:39:30.756 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:30.763 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:39:30.763 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:30.764 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:39:30.765 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:30.771 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:39:30.772 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:30.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:39:30.927 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:39:30.928 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:39:30.934 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:39:30.936 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:39:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.975+0000 7f450ce48640 1 Processor -- start 2023-08-10T10:39:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.975+0000 7f450ce48640 1 -- start start 2023-08-10T10:39:30.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.976+0000 7f450ce48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45080c8c40 0x7f45080cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450ce48640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45080c9b30 0x7f45080cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450ce48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080cc6d0 con 0x7f450806ea80 2023-08-10T10:39:30.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450ce48640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080ca0d0 con 0x7f45080c8c40 2023-08-10T10:39:30.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450ce48640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080ca3b0 con 0x7f45080c9b30 2023-08-10T10:39:30.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f450806ea80 0x7f450806ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57830/0 (socket says 172.21.15.50:57830) 2023-08-10T10:39:30.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f450659c640 1 -- 172.21.15.50:0/3083094429 learned_addr learned my addr 172.21.15.50:0/3083094429 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f44fffff640 1 --2- 172.21.15.50:0/3083094429 >> v2:172.21.15.50:3300/0 conn(0x7f45080c8c40 0x7f45080cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.977+0000 7f4506d9d640 1 --2- 172.21.15.50:0/3083094429 >> v2:172.21.15.117:3300/0 conn(0x7f45080c9b30 0x7f45080cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.978+0000 7f44fffff640 1 -- 172.21.15.50:0/3083094429 >> v2:172.21.15.117:3300/0 conn(0x7f45080c9b30 msgr2=0x7f45080cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.978+0000 7f44fffff640 1 --2- 172.21.15.50:0/3083094429 >> v2:172.21.15.117:3300/0 conn(0x7f45080c9b30 0x7f45080cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.978+0000 7f44fffff640 1 -- 172.21.15.50:0/3083094429 >> v1:172.21.15.50:6789/0 conn(0x7f450806ea80 legacy=0x7f450806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.978+0000 7f4505d9b640 1 -- 172.21.15.50:0/3083094429 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600275181 0 0) 0x7f45080cc6d0 con 0x7f450806ea80 2023-08-10T10:39:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.978+0000 7f44fffff640 1 -- 172.21.15.50:0/3083094429 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080cc920 con 0x7f45080c8c40 2023-08-10T10:39:30.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.979+0000 7f44fffff640 1 --2- 172.21.15.50:0/3083094429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45080c8c40 0x7f45080cd120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f450806ea10 tx=0x7f44f002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1a385f546e9034 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f4505d9b640 1 -- 172.21.15.50:0/3083094429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0030610 con 0x7f45080c8c40 2023-08-10T10:39:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f4505d9b640 1 -- 172.21.15.50:0/3083094429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0030770 con 0x7f45080c8c40 2023-08-10T10:39:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f4505d9b640 1 -- 172.21.15.50:0/3083094429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0030b00 con 0x7f45080c8c40 2023-08-10T10:39:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 -- 172.21.15.50:0/3083094429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45080c8c40 msgr2=0x7f45080cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 --2- 172.21.15.50:0/3083094429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45080c8c40 0x7f45080cd120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f450806ea10 tx=0x7f44f002b960 comp rx=0 tx=0).stop 2023-08-10T10:39:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 -- 172.21.15.50:0/3083094429 shutdown_connections 2023-08-10T10:39:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 --2- 172.21.15.50:0/3083094429 >> v2:172.21.15.117:3300/0 conn(0x7f45080c9b30 0x7f45080cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 --2- 172.21.15.50:0/3083094429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45080c8c40 0x7f45080cd120 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.980+0000 7f450ce48640 1 -- 172.21.15.50:0/3083094429 >> 172.21.15.50:0/3083094429 conn(0x7f45080b08e0 msgr2=0x7f45080ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.981+0000 7f450ce48640 1 -- 172.21.15.50:0/3083094429 shutdown_connections 2023-08-10T10:39:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.981+0000 7f450ce48640 1 -- 172.21.15.50:0/3083094429 wait complete. 2023-08-10T10:39:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.982+0000 7f450ce48640 1 Processor -- start 2023-08-10T10:39:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.983+0000 7f450ce48640 1 -- start start 2023-08-10T10:39:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.983+0000 7f450ce48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.983+0000 7f450ce48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45080c8c40 0x7f45080c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450ce48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 0x7f45080c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450ce48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081563d0 con 0x7f450806ea80 2023-08-10T10:39:30.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450ce48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c3e60 con 0x7f45080c9b30 2023-08-10T10:39:30.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450ce48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c4140 con 0x7f45080c8c40 2023-08-10T10:39:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48172/0 (socket says 172.21.15.50:48172) 2023-08-10T10:39:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 -- 172.21.15.50:0/2299092666 learned_addr learned my addr 172.21.15.50:0/2299092666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f4506d9d640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 0x7f45080c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f44fffff640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45080c8c40 0x7f45080c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 -- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45080c8c40 msgr2=0x7f45080c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45080c8c40 0x7f45080c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 -- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 msgr2=0x7f45080c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 0x7f45080c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f450659c640 1 -- 172.21.15.50:0/2299092666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009400 con 0x7f450806ea80 2023-08-10T10:39:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.984+0000 7f4506d9d640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 0x7f45080c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:39:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f450659c640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c4d0 tx=0x7f44f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80074e0 con 0x7f450806ea80 2023-08-10T10:39:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8007660 con 0x7f450806ea80 2023-08-10T10:39:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004a20 con 0x7f450806ea80 2023-08-10T10:39:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508161870 con 0x7f450806ea80 2023-08-10T10:39:30.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.985+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080c5c00 con 0x7f450806ea80 2023-08-10T10:39:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.986+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508161d90 con 0x7f450806ea80 2023-08-10T10:39:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.987+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44f8004b80 con 0x7f450806ea80 2023-08-10T10:39:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.988+0000 7f44feffd640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 0x7f44e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.988+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f44f80882a0 con 0x7f450806ea80 2023-08-10T10:39:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.989+0000 7f44fffff640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 0x7f44e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.989+0000 7f44fffff640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 0x7f44e806d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:30.992+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4508161d90 con 0x7f450806ea80 2023-08-10T10:39:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:31.209+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4508161d90 con 0x7f450806ea80 2023-08-10T10:39:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.412+0000 7f44feffd640 1 -- 172.21.15.50:0/2299092666 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44f8053710 con 0x7f450806ea80 2023-08-10T10:39:32.413 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:39:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 msgr2=0x7f44e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 0x7f44e806d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0008030 comp rx=0 tx=0).stop 2023-08-10T10:39:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 msgr2=0x7f4508155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c4d0 tx=0x7f44f800c990 comp rx=0 tx=0).stop 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 shutdown_connections 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f44e806ac50 0x7f44e806d110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45080c9b30 0x7f45080c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45080c8c40 0x7f45080c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 --2- 172.21.15.50:0/2299092666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f450806ea80 0x7f4508155e90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.415+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 >> 172.21.15.50:0/2299092666 conn(0x7f45080b08e0 msgr2=0x7f45080af910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.416+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 shutdown_connections 2023-08-10T10:39:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.416+0000 7f450ce48640 1 -- 172.21.15.50:0/2299092666 wait complete. 2023-08-10T10:39:32.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:39:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.669+0000 7f976dbcf640 1 Processor -- start 2023-08-10T10:39:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.669+0000 7f976dbcf640 1 -- start start 2023-08-10T10:39:32.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.670+0000 7f976dbcf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97680cf590 0x7f976815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:32.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.670+0000 7f976dbcf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680b0000 con 0x7f976815f370 2023-08-10T10:39:32.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.670+0000 7f976dbcf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680cbe60 con 0x7f97680afc20 2023-08-10T10:39:32.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.670+0000 7f976dbcf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680cc140 con 0x7f97680cf590 2023-08-10T10:39:32.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9766ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f976815f370 0x7f97680cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57836/0 (socket says 172.21.15.50:57836) 2023-08-10T10:39:32.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9766ffd640 1 -- 172.21.15.50:0/2417600731 learned_addr learned my addr 172.21.15.50:0/2417600731 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:32.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9767fff640 1 --2- 172.21.15.50:0/2417600731 >> v2:172.21.15.50:3300/0 conn(0x7f97680cf590 0x7f976815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:32.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f97667fc640 1 -- 172.21.15.50:0/2417600731 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663692956 0 0) 0x7f97680b0000 con 0x7f976815f370 2023-08-10T10:39:32.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9767fff640 1 -- 172.21.15.50:0/2417600731 >> v1:172.21.15.117:6789/0 conn(0x7f97680afc20 legacy=0x7f97680cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:32.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9767fff640 1 -- 172.21.15.50:0/2417600731 >> v1:172.21.15.50:6789/0 conn(0x7f976815f370 legacy=0x7f97680cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.671+0000 7f9767fff640 1 -- 172.21.15.50:0/2417600731 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cc420 con 0x7f97680cf590 2023-08-10T10:39:32.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.673+0000 7f9767fff640 1 --2- 172.21.15.50:0/2417600731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97680cf590 0x7f976815a580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f976002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6d4a2fa48f6748 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:32.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.673+0000 7f97667fc640 1 -- 172.21.15.50:0/2417600731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976002ccd0 con 0x7f97680cf590 2023-08-10T10:39:32.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.673+0000 7f97667fc640 1 -- 172.21.15.50:0/2417600731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976002ce30 con 0x7f97680cf590 2023-08-10T10:39:32.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.673+0000 7f97667fc640 1 -- 172.21.15.50:0/2417600731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760034660 con 0x7f97680cf590 2023-08-10T10:39:32.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 -- 172.21.15.50:0/2417600731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97680cf590 msgr2=0x7f976815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 --2- 172.21.15.50:0/2417600731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97680cf590 0x7f976815a580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f976002bf20 comp rx=0 tx=0).stop 2023-08-10T10:39:32.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 -- 172.21.15.50:0/2417600731 shutdown_connections 2023-08-10T10:39:32.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 --2- 172.21.15.50:0/2417600731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97680cf590 0x7f976815a580 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 -- 172.21.15.50:0/2417600731 >> 172.21.15.50:0/2417600731 conn(0x7f97680d0930 msgr2=0x7f97680d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:32.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 -- 172.21.15.50:0/2417600731 shutdown_connections 2023-08-10T10:39:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.674+0000 7f976dbcf640 1 -- 172.21.15.50:0/2417600731 wait complete. 2023-08-10T10:39:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.676+0000 7f976dbcf640 1 Processor -- start 2023-08-10T10:39:32.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.676+0000 7f976dbcf640 1 -- start start 2023-08-10T10:39:32.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97680afc20 0x7f97680b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:32.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 0x7f976815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:32.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b68b0 con 0x7f976815f370 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680c7970 con 0x7f97680cf590 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f976dbcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680c7bc0 con 0x7f97680afc20 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f9767fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f9767fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48188/0 (socket says 172.21.15.50:48188) 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f9767fff640 1 -- 172.21.15.50:0/3763617397 learned_addr learned my addr 172.21.15.50:0/3763617397 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.677+0000 7f97677fe640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97680afc20 0x7f97680b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9766ffd640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 0x7f976815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 -- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97680afc20 msgr2=0x7f97680b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97680afc20 0x7f97680b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 -- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 msgr2=0x7f976815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 0x7f976815bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 -- 172.21.15.50:0/3763617397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a70 con 0x7f976815f370 2023-08-10T10:39:32.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9766ffd640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 0x7f976815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:32.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f9767fff640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f9760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:32.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760003b90 con 0x7f976815f370 2023-08-10T10:39:32.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9760003cf0 con 0x7f976815f370 2023-08-10T10:39:32.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680c7ea0 con 0x7f976815f370 2023-08-10T10:39:32.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.678+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760004230 con 0x7f976815f370 2023-08-10T10:39:32.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.679+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97680c8460 con 0x7f976815f370 2023-08-10T10:39:32.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.680+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97680c8650 con 0x7f976815f370 2023-08-10T10:39:32.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.681+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f976003b050 con 0x7f976815f370 2023-08-10T10:39:32.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.682+0000 7f975ffff640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 0x7f974806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:32.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.682+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f97600abb90 con 0x7f976815f370 2023-08-10T10:39:32.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.682+0000 7f97677fe640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 0x7f974806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:32.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.683+0000 7f97677fe640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 0x7f974806d140 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9750001630 tx=0x7f9750009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:32.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.686+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9760076ef0 con 0x7f976815f370 2023-08-10T10:39:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.947+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f976804e270 con 0x7f976815f370 2023-08-10T10:39:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.948+0000 7f975ffff640 1 -- 172.21.15.50:0/3763617397 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f976007a510 con 0x7f976815f370 2023-08-10T10:39:32.949 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:32.949 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:39:32.949 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:39:32.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.949 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:39:32.951 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:39:32.952 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.953 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.955 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.956 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:39:32.957 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.958 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.961 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:39:32.963 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:39:32.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:39:32.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:39:32.968 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRkEp16FRAALL456n9x1eBepMubQZlYCw==", 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRk06Z6FRAAoBy+rAOd3759446m0Hj8Rg==", 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRkFK96FRAAQD8LwmzEc09pzorcIef9Rg==", 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRkbrd6FRAAQIeyOcMNNpU5abzxGesTQA==", 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.974 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRk7L96FRAANSfRKhTHvVCjd2yYWMhQ1w==", 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2023-08-10T10:39:32.975 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAJvtRkjMh6FRAAnaZesjZwH4MrX93V7MOAAw==", 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:39:32.976 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:32.977 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:32.978 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:39:32.979 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:39:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 msgr2=0x7f974806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 0x7f974806d140 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9750001630 tx=0x7f9750009040 comp rx=0 tx=0).stop 2023-08-10T10:39:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 msgr2=0x7f97680b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f9760004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 shutdown_connections 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976815f370 0x7f97680b1d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f974806ac80 0x7f974806d140 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97680cf590 0x7f976815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 --2- 172.21.15.50:0/3763617397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97680afc20 0x7f97680b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 >> 172.21.15.50:0/3763617397 conn(0x7f97680d0930 msgr2=0x7f97680aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 shutdown_connections 2023-08-10T10:39:32.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:32.951+0000 7f976dbcf640 1 -- 172.21.15.50:0/3763617397 wait complete. 2023-08-10T10:39:32.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-10T10:39:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.214+0000 7fed7abbd640 1 Processor -- start 2023-08-10T10:39:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.215+0000 7fed7abbd640 1 -- start start 2023-08-10T10:39:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.216+0000 7fed7abbd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd960 0x7fed74160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.216+0000 7fed7abbd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed740d28b0 0x7fed740d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.216+0000 7fed7abbd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed74160370 con 0x7fed7415ff90 2023-08-10T10:39:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.216+0000 7fed7abbd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740d0b90 con 0x7fed740cd960 2023-08-10T10:39:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.216+0000 7fed7abbd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed741614d0 con 0x7fed740d28b0 2023-08-10T10:39:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd960 0x7fed74160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd960 0x7fed74160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48192/0 (socket says 172.21.15.50:48192) 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 -- 172.21.15.50:0/1201630004 learned_addr learned my addr 172.21.15.50:0/1201630004 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed7a3bc640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed740d28b0 0x7fed740d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 -- 172.21.15.50:0/1201630004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed740d28b0 msgr2=0x7fed740d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed740d28b0 0x7fed740d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 -- 172.21.15.50:0/1201630004 >> v1:172.21.15.117:6789/0 conn(0x7fed7415ff90 legacy=0x7fed740d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.217+0000 7fed793ba640 1 -- 172.21.15.50:0/1201630004 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740d3240 con 0x7fed740cd960 2023-08-10T10:39:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.218+0000 7fed793ba640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed74160f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fed64009870 tx=0x7fed6402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17b2bd5350b5d66 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed78bb9640 1 -- 172.21.15.50:0/1201630004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64031640 con 0x7fed740cd960 2023-08-10T10:39:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed78bb9640 1 -- 172.21.15.50:0/1201630004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed640317a0 con 0x7fed740cd960 2023-08-10T10:39:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed78bb9640 1 -- 172.21.15.50:0/1201630004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64031b30 con 0x7fed740cd960 2023-08-10T10:39:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 -- 172.21.15.50:0/1201630004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 msgr2=0x7fed74160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed74160f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fed64009870 tx=0x7fed6402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 -- 172.21.15.50:0/1201630004 shutdown_connections 2023-08-10T10:39:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed740d28b0 0x7fed740d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1201630004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed74160f90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 -- 172.21.15.50:0/1201630004 >> 172.21.15.50:0/1201630004 conn(0x7fed74069ac0 msgr2=0x7fed74069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 -- 172.21.15.50:0/1201630004 shutdown_connections 2023-08-10T10:39:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.219+0000 7fed7abbd640 1 -- 172.21.15.50:0/1201630004 wait complete. 2023-08-10T10:39:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.221+0000 7fed7abbd640 1 Processor -- start 2023-08-10T10:39:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.221+0000 7fed7abbd640 1 -- start start 2023-08-10T10:39:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740d28b0 0x7fed7415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7415ff90 0x7fed740b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7415b480 con 0x7fed740cd960 2023-08-10T10:39:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c99f0 con 0x7fed740d28b0 2023-08-10T10:39:33.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed7abbd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740b0be0 con 0x7fed7415ff90 2023-08-10T10:39:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.222+0000 7fed79bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48196/0 (socket says 172.21.15.50:48196) 2023-08-10T10:39:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 -- 172.21.15.50:0/1777576832 learned_addr learned my addr 172.21.15.50:0/1777576832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 -- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7415ff90 msgr2=0x7fed740b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7415ff90 0x7fed740b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 -- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740d28b0 msgr2=0x7fed7415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740d28b0 0x7fed7415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 -- 172.21.15.50:0/1777576832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640094d0 con 0x7fed740cd960 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.223+0000 7fed79bbb640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c430 tx=0x7fed7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.224+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011790 con 0x7fed740cd960 2023-08-10T10:39:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.224+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700118f0 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.224+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011ce0 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.224+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740b0ec0 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.224+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed740c9c90 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.225+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74066e30 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.226+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed7001c460 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.227+0000 7fed6a7fc640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 0x7fed5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.227+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fed70089260 con 0x7fed740cd960 2023-08-10T10:39:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.227+0000 7fed793ba640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 0x7fed5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.228+0000 7fed793ba640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 0x7fed5806d110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed64036000 tx=0x7fed64030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.231+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed70054530 con 0x7fed740cd960 2023-08-10T10:39:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.498+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fed740b4910 con 0x7fed740cd960 2023-08-10T10:39:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.505+0000 7fed6a7fc640 1 -- 172.21.15.50:0/1777576832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fed70057b50 con 0x7fed740cd960 2023-08-10T10:39:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 msgr2=0x7fed5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 0x7fed5806d110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed64036000 tx=0x7fed64030000 comp rx=0 tx=0).stop 2023-08-10T10:39:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 msgr2=0x7fed740b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c430 tx=0x7fed7000c8f0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 shutdown_connections 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7415ff90 0x7fed740b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed5806ac50 0x7fed5806d110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740d28b0 0x7fed7415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 --2- 172.21.15.50:0/1777576832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd960 0x7fed740b2240 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 >> 172.21.15.50:0/1777576832 conn(0x7fed74069ac0 msgr2=0x7fed740c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 shutdown_connections 2023-08-10T10:39:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.508+0000 7fed7abbd640 1 -- 172.21.15.50:0/1777576832 wait complete. 2023-08-10T10:39:33.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-10T10:39:33.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.751+0000 7fcca359e640 1 Processor -- start 2023-08-10T10:39:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.752+0000 7fcca359e640 1 -- start start 2023-08-10T10:39:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.753+0000 7fcca359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcca415ad00 0x7fcca40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.753+0000 7fcca359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 0x7fcca40ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.753+0000 7fcca359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40b2280 con 0x7fcca40696a0 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.753+0000 7fcca359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40b19e0 con 0x7fcca415ad00 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.753+0000 7fcca359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b1cc0 con 0x7fcca4069a80 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcca415ad00 0x7fcca40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcca415ad00 0x7fcca40b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48210/0 (socket says 172.21.15.50:48210) 2023-08-10T10:39:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 -- 172.21.15.50:0/1096492369 learned_addr learned my addr 172.21.15.50:0/1096492369 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:33.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 -- 172.21.15.50:0/1096492369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 msgr2=0x7fcca40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:33.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcca2d9d640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 0x7fcca40ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 0x7fcca40ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 -- 172.21.15.50:0/1096492369 >> v1:172.21.15.117:6789/0 conn(0x7fcca40696a0 legacy=0x7fcca40cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:33.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.754+0000 7fcc9bfff640 1 -- 172.21.15.50:0/1096492369 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40b1fa0 con 0x7fcca415ad00 2023-08-10T10:39:33.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.755+0000 7fcca2d9d640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 0x7fcca40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:33.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcc9bfff640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca40b1370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009870 tx=0x7fcc8c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c20d47e4e3c41b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcca1d9b640 1 -- 172.21.15.50:0/1096492369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c0317c0 con 0x7fcca415ad00 2023-08-10T10:39:33.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcca1d9b640 1 -- 172.21.15.50:0/1096492369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c031920 con 0x7fcca415ad00 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcca1d9b640 1 -- 172.21.15.50:0/1096492369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c031cb0 con 0x7fcca415ad00 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcca359e640 1 -- 172.21.15.50:0/1096492369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 msgr2=0x7fcca40b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.756+0000 7fcca359e640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca40b1370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009870 tx=0x7fcc8c02b860 comp rx=0 tx=0).stop 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 -- 172.21.15.50:0/1096492369 shutdown_connections 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4069a80 0x7fcca40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 --2- 172.21.15.50:0/1096492369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca40b1370 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 -- 172.21.15.50:0/1096492369 >> 172.21.15.50:0/1096492369 conn(0x7fcca40cafa0 msgr2=0x7fcca40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 -- 172.21.15.50:0/1096492369 shutdown_connections 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.757+0000 7fcca359e640 1 -- 172.21.15.50:0/1096492369 wait complete. 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.758+0000 7fcca359e640 1 Processor -- start 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.759+0000 7fcca359e640 1 -- start start 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.759+0000 7fcca359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40696a0 0x7fcca4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.759+0000 7fcca359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 0x7fcca406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.759+0000 7fcca359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40719e0 con 0x7fcca415ad00 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca41efd90 con 0x7fcca4069a80 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca41f0030 con 0x7fcca40696a0 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48222/0 (socket says 172.21.15.50:48222) 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 -- 172.21.15.50:0/891667967 learned_addr learned my addr 172.21.15.50:0/891667967 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca259c640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40696a0 0x7fcca4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcc9bfff640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 0x7fcca406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 -- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40696a0 msgr2=0x7fcca4070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40696a0 0x7fcca4070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 -- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 msgr2=0x7fcca406eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 0x7fcca406eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcca2d9d640 1 -- 172.21.15.50:0/891667967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0094d0 con 0x7fcca415ad00 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.760+0000 7fcc9bfff640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 0x7fcca406eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcca2d9d640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00cf20 tx=0x7fcc9c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00d840 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00d9a0 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00dd50 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca4071140 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.761+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca4071700 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.762+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca41f01e0 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.763+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc9c01e3b0 con 0x7fcca415ad00 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.764+0000 7fcc9affd640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 0x7fcc8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:33.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.764+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcc9c089c70 con 0x7fcca415ad00 2023-08-10T10:39:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.765+0000 7fcca259c640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 0x7fcc8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.765+0000 7fcca259c640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 0x7fcc8406d110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcca4159f90 tx=0x7fcc94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:33.769+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcca41f01e0 con 0x7fcca415ad00 2023-08-10T10:39:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.032+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcca41f01e0 con 0x7fcca415ad00 2023-08-10T10:39:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.039+0000 7fcc9affd640 1 -- 172.21.15.50:0/891667967 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcca41f01e0 con 0x7fcca415ad00 2023-08-10T10:39:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 msgr2=0x7fcc8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 0x7fcc8406d110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcca4159f90 tx=0x7fcc94009040 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 msgr2=0x7fcca41f04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00cf20 tx=0x7fcc9c00a7d0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 shutdown_connections 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca415ad00 0x7fcca41f04c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcc8406ac50 0x7fcc8406d110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca4069a80 0x7fcca406eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 --2- 172.21.15.50:0/891667967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40696a0 0x7fcca4070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 >> 172.21.15.50:0/891667967 conn(0x7fcca40cafa0 msgr2=0x7fcca40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 shutdown_connections 2023-08-10T10:39:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.042+0000 7fcca359e640 1 -- 172.21.15.50:0/891667967 wait complete. 2023-08-10T10:39:34.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-10T10:39:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.289+0000 7fb9215d2640 1 Processor -- start 2023-08-10T10:39:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.289+0000 7fb9215d2640 1 -- start start 2023-08-10T10:39:34.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb9215d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb91c15ad00 0x7fb91c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb9215d2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c0b2280 con 0x7fb91c069a80 2023-08-10T10:39:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb9215d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c0b19e0 con 0x7fb91c0696a0 2023-08-10T10:39:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb9215d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c0b1cc0 con 0x7fb91c15ad00 2023-08-10T10:39:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb920dd1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb91c069a80 0x7fb91c0ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57842/0 (socket says 172.21.15.50:57842) 2023-08-10T10:39:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.291+0000 7fb920dd1640 1 -- 172.21.15.50:0/838116776 learned_addr learned my addr 172.21.15.50:0/838116776 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/838116776 >> v2:172.21.15.117:3300/0 conn(0x7fb91c15ad00 0x7fb91c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788998157 0 0) 0x7fb91c0b2280 con 0x7fb91c069a80 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb904003520 con 0x7fb91c069a80 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176241741 0 0) 0x7fb904003520 con 0x7fb91c069a80 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 >> v2:172.21.15.117:3300/0 conn(0x7fb91c15ad00 msgr2=0x7fb91c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 --2- 172.21.15.50:0/838116776 >> v2:172.21.15.117:3300/0 conn(0x7fb91c15ad00 0x7fb91c0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 >> v1:172.21.15.117:6789/0 conn(0x7fb91c0696a0 legacy=0x7fb91c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0b1fa0 con 0x7fb91c069a80 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb9140019f0 con 0x7fb91c069a80 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 >> v1:172.21.15.50:6789/0 conn(0x7fb91c069a80 legacy=0x7fb91c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040039e0 0x7fb904003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 0x7fb904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9040051f0 0x7fb90400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0b1cc0 con 0x7fb9040047c0 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90400c150 con 0x7fb9040051f0 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.292+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90400c310 con 0x7fb9040039e0 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 0x7fb904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91bfff640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040039e0 0x7fb904003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 -- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040039e0 msgr2=0x7fb904003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040039e0 0x7fb904003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 -- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9040051f0 msgr2=0x7fb90400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9040051f0 0x7fb90400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91b7fe640 1 -- 172.21.15.50:0/838116776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904003520 con 0x7fb9040047c0 2023-08-10T10:39:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb920dd1640 1 -- 172.21.15.50:0/838116776 reap_dead start 2023-08-10T10:39:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.293+0000 7fb91bfff640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040039e0 0x7fb904003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.294+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 0x7fb904004c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb910009ac0 tx=0x7fb9040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e6bca3153da8f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91002c710 con 0x7fb9040047c0 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91002c870 con 0x7fb9040047c0 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb91affd640 1 -- 172.21.15.50:0/838116776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91002cc00 con 0x7fb9040047c0 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 -- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 msgr2=0x7fb904004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 0x7fb904004c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb910009ac0 tx=0x7fb9040057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 -- 172.21.15.50:0/838116776 shutdown_connections 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 --2- 172.21.15.50:0/838116776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9040047c0 0x7fb904004c40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 -- 172.21.15.50:0/838116776 >> 172.21.15.50:0/838116776 conn(0x7fb91c0cafa0 msgr2=0x7fb91c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.295+0000 7fb9215d2640 1 -- 172.21.15.50:0/838116776 shutdown_connections 2023-08-10T10:39:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.296+0000 7fb9215d2640 1 -- 172.21.15.50:0/838116776 wait complete. 2023-08-10T10:39:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.297+0000 7fb9215d2640 1 Processor -- start 2023-08-10T10:39:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.297+0000 7fb9215d2640 1 -- start start 2023-08-10T10:39:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040047c0 0x7fb91c1edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 0x7fb91c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c071800 con 0x7fb91c070e10 2023-08-10T10:39:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0701f0 con 0x7fb91c1f10f0 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.298+0000 7fb9215d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c06f150 con 0x7fb9040047c0 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48248/0 (socket says 172.21.15.50:48248) 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 -- 172.21.15.50:0/547359111 learned_addr learned my addr 172.21.15.50:0/547359111 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb91bfff640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040047c0 0x7fb91c1edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 0x7fb91c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 -- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040047c0 msgr2=0x7fb91c1edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040047c0 0x7fb91c1edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 -- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 msgr2=0x7fb91c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 0x7fb91c06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb920dd1640 1 -- 172.21.15.50:0/547359111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c06f430 con 0x7fb91c070e10 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.299+0000 7fb91b7fe640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 0x7fb91c06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb920dd1640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb914001370 tx=0x7fb91400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914004d60 con 0x7fb91c070e10 2023-08-10T10:39:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91400a610 con 0x7fb91c070e10 2023-08-10T10:39:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400a9c0 con 0x7fb91c070e10 2023-08-10T10:39:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c06f710 con 0x7fb91c070e10 2023-08-10T10:39:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.300+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c06fcd0 con 0x7fb91c070e10 2023-08-10T10:39:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.301+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c06fec0 con 0x7fb91c070e10 2023-08-10T10:39:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.302+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb91400ab20 con 0x7fb91c070e10 2023-08-10T10:39:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.303+0000 7fb918ff9640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 0x7fb90806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.303+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb914088970 con 0x7fb91c070e10 2023-08-10T10:39:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.304+0000 7fb91bfff640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 0x7fb90806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.304+0000 7fb91bfff640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 0x7fb90806d140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb91c15dc70 tx=0x7fb90c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.307+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb914053cd0 con 0x7fb91c070e10 2023-08-10T10:39:34.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.568+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb91c066e30 con 0x7fb91c070e10 2023-08-10T10:39:34.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.575+0000 7fb918ff9640 1 -- 172.21.15.50:0/547359111 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb9140572f0 con 0x7fb91c070e10 2023-08-10T10:39:34.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 msgr2=0x7fb90806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 0x7fb90806d140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb91c15dc70 tx=0x7fb90c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 msgr2=0x7fb91c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb914001370 tx=0x7fb91400cb90 comp rx=0 tx=0).stop 2023-08-10T10:39:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 shutdown_connections 2023-08-10T10:39:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb91c070e10 0x7fb91c0712c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb90806ac80 0x7fb90806d140 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c1f10f0 0x7fb91c06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 --2- 172.21.15.50:0/547359111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9040047c0 0x7fb91c1edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 >> 172.21.15.50:0/547359111 conn(0x7fb91c0cafa0 msgr2=0x7fb91c0ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 shutdown_connections 2023-08-10T10:39:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.578+0000 7fb9215d2640 1 -- 172.21.15.50:0/547359111 wait complete. 2023-08-10T10:39:34.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-10T10:39:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.826+0000 7fcda9bf3640 1 Processor -- start 2023-08-10T10:39:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.826+0000 7fcda9bf3640 1 -- start start 2023-08-10T10:39:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.827+0000 7fcda9bf3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcda40afcb0 0x7fcda415e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda9bf3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40b0090 con 0x7fcda4071770 2023-08-10T10:39:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda9bf3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40cc390 con 0x7fcda40b29a0 2023-08-10T10:39:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda9bf3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4071130 con 0x7fcda40afcb0 2023-08-10T10:39:34.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcda4071770 0x7fcda40b2290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57856/0 (socket says 172.21.15.50:57856) 2023-08-10T10:39:34.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda2ffd640 1 -- 172.21.15.50:0/990088827 learned_addr learned my addr 172.21.15.50:0/990088827 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:34.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.828+0000 7fcda37fe640 1 --2- 172.21.15.50:0/990088827 >> v2:172.21.15.117:3300/0 conn(0x7fcda40afcb0 0x7fcda415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425499207 0 0) 0x7fcda40b0090 con 0x7fcda4071770 2023-08-10T10:39:34.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c003520 con 0x7fcda4071770 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889368376 0 0) 0x7fcd8c003520 con 0x7fcda4071770 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 >> v2:172.21.15.117:3300/0 conn(0x7fcda40afcb0 msgr2=0x7fcda415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 --2- 172.21.15.50:0/990088827 >> v2:172.21.15.117:3300/0 conn(0x7fcda40afcb0 0x7fcda415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 >> v1:172.21.15.117:6789/0 conn(0x7fcda40b29a0 legacy=0x7fcda406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40cc610 con 0x7fcda4071770 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fcd98001670 con 0x7fcda4071770 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 >> v1:172.21.15.50:6789/0 conn(0x7fcda4071770 legacy=0x7fcda40b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 0x7fcd8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8c0047c0 0x7fcd8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c005180 0x7fcd8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c00bff0 con 0x7fcd8c003970 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c00c160 con 0x7fcd8c005180 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.829+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c00c320 con 0x7fcd8c0047c0 2023-08-10T10:39:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 0x7fcd8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda2ffd640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8c0047c0 0x7fcd8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda3fff640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c005180 0x7fcd8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 -- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8c0047c0 msgr2=0x7fcd8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8c0047c0 0x7fcd8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 -- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c005180 msgr2=0x7fcd8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c005180 0x7fcd8c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda3fff640 1 -- 172.21.15.50:0/990088827 reap_dead start 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda37fe640 1 -- 172.21.15.50:0/990088827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c003520 con 0x7fcd8c003970 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.830+0000 7fcda2ffd640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8c0047c0 0x7fcd8c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.831+0000 7fcda37fe640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 0x7fcd8c003d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009fc0 tx=0x7fcd8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4c95455e861545 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.831+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9402cc20 con 0x7fcd8c003970 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.831+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400f040 con 0x7fcd8c003970 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.831+0000 7fcda27fc640 1 -- 172.21.15.50:0/990088827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94034440 con 0x7fcd8c003970 2023-08-10T10:39:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 -- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 msgr2=0x7fcd8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 0x7fcd8c003d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009fc0 tx=0x7fcd8c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 -- 172.21.15.50:0/990088827 shutdown_connections 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/990088827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd8c003970 0x7fcd8c003d90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 -- 172.21.15.50:0/990088827 >> 172.21.15.50:0/990088827 conn(0x7fcda40cd290 msgr2=0x7fcda40cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 -- 172.21.15.50:0/990088827 shutdown_connections 2023-08-10T10:39:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.832+0000 7fcda9bf3640 1 -- 172.21.15.50:0/990088827 wait complete. 2023-08-10T10:39:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.834+0000 7fcda9bf3640 1 Processor -- start 2023-08-10T10:39:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.834+0000 7fcda9bf3640 1 -- start start 2023-08-10T10:39:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 0x7fcda415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda40c59a0 0x7fcda41f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40ca2c0 con 0x7fcda40c5520 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40ca560 con 0x7fcd8c003970 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda9bf3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40c4d20 con 0x7fcda40c59a0 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48274/0 (socket says 172.21.15.50:48274) 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.835+0000 7fcda2ffd640 1 -- 172.21.15.50:0/3469961787 learned_addr learned my addr 172.21.15.50:0/3469961787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda3fff640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda40c59a0 0x7fcda41f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda37fe640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 0x7fcda415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 -- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda40c59a0 msgr2=0x7fcda41f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda40c59a0 0x7fcda41f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 -- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 msgr2=0x7fcda415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 0x7fcda415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 -- 172.21.15.50:0/3469961787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40c5000 con 0x7fcda40c5520 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda37fe640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 0x7fcda415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda2ffd640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d6c0 tx=0x7fcd9800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd980072d0 con 0x7fcda40c5520 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98007430 con 0x7fcda40c5520 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd980047e0 con 0x7fcda40c5520 2023-08-10T10:39:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.836+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda415d290 con 0x7fcda40c5520 2023-08-10T10:39:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.837+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda41f69a0 con 0x7fcda40c5520 2023-08-10T10:39:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.838+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda40c5190 con 0x7fcda40c5520 2023-08-10T10:39:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.839+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd98004940 con 0x7fcda40c5520 2023-08-10T10:39:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.840+0000 7fcd8bfff640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 0x7fcd9006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.840+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcd98088d40 con 0x7fcda40c5520 2023-08-10T10:39:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.840+0000 7fcda37fe640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 0x7fcd9006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.841+0000 7fcda37fe640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 0x7fcd9006d110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd94036000 tx=0x7fcd9402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:34.846+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcd98054150 con 0x7fcda40c5520 2023-08-10T10:39:35.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.113+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fcda404e270 con 0x7fcda40c5520 2023-08-10T10:39:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.121+0000 7fcd8bfff640 1 -- 172.21.15.50:0/3469961787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd98057770 con 0x7fcda40c5520 2023-08-10T10:39:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 msgr2=0x7fcd9006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 0x7fcd9006d110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd94036000 tx=0x7fcd9402e000 comp rx=0 tx=0).stop 2023-08-10T10:39:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 msgr2=0x7fcda40c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d6c0 tx=0x7fcd9800db80 comp rx=0 tx=0).stop 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 shutdown_connections 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda40c59a0 0x7fcda41f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcda40c5520 0x7fcda40c6a30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcd9006ac50 0x7fcd9006d110 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 --2- 172.21.15.50:0/3469961787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd8c003970 0x7fcda415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 >> 172.21.15.50:0/3469961787 conn(0x7fcda40cd290 msgr2=0x7fcda40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.124+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 shutdown_connections 2023-08-10T10:39:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.125+0000 7fcda9bf3640 1 -- 172.21.15.50:0/3469961787 wait complete. 2023-08-10T10:39:35.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-10T10:39:35.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.364+0000 7f1e5a47e640 1 Processor -- start 2023-08-10T10:39:35.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.364+0000 7f1e5a47e640 1 -- start start 2023-08-10T10:39:35.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e5a47e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e540cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e5a47e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5415d2a0 con 0x7f1e540adb20 2023-08-10T10:39:35.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e5a47e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5415d580 con 0x7f1e541570f0 2023-08-10T10:39:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e5a47e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540cfb00 con 0x7f1e540cf140 2023-08-10T10:39:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e58a1b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1e540adb20 0x7f1e540adf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36854/0 (socket says 172.21.15.50:36854) 2023-08-10T10:39:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e58a1b640 1 -- 172.21.15.50:0/1515264483 learned_addr learned my addr 172.21.15.50:0/1515264483 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.366+0000 7f1e537fe640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e540cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610674578 0 0) 0x7f1e5415d2a0 con 0x7f1e540adb20 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e3c003520 con 0x7f1e540adb20 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 633848323 0 0) 0x7f1e3c003520 con 0x7f1e540adb20 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 msgr2=0x7f1e540cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e540cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 >> v1:172.21.15.117:6789/0 conn(0x7f1e541570f0 legacy=0x7f1e540ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5415d860 con 0x7f1e540adb20 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1e4c001670 con 0x7f1e540adb20 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 >> v1:172.21.15.50:6789/0 conn(0x7f1e540adb20 legacy=0x7f1e540adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c0039a0 0x7f1e3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e3c004d00 0x7f1e3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540cfb00 con 0x7f1e3c004d00 2023-08-10T10:39:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c00bae0 con 0x7f1e3c0039a0 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.367+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c00bca0 con 0x7f1e540cf140 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e3c004d00 0x7f1e3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e537fe640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e53fff640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c0039a0 0x7f1e3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 -- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 msgr2=0x7f1e3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cf140 0x7f1e3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 -- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c0039a0 msgr2=0x7f1e3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c0039a0 0x7f1e3c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.368+0000 7f1e58a1b640 1 -- 172.21.15.50:0/1515264483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c003520 con 0x7f1e3c004d00 2023-08-10T10:39:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.369+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e3c004d00 0x7f1e3c005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c240 tx=0x7f1e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c8c9cdb7518527 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.369+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c005ad0 con 0x7f1e3c004d00 2023-08-10T10:39:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.369+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c005c30 con 0x7f1e3c004d00 2023-08-10T10:39:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.369+0000 7f1e52ffd640 1 -- 172.21.15.50:0/1515264483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c02c8b0 con 0x7f1e3c004d00 2023-08-10T10:39:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 -- 172.21.15.50:0/1515264483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e3c004d00 msgr2=0x7f1e3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/1515264483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e3c004d00 0x7f1e3c005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c240 tx=0x7f1e3c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e58a1b640 1 -- 172.21.15.50:0/1515264483 reap_dead start 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 -- 172.21.15.50:0/1515264483 shutdown_connections 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 -- 172.21.15.50:0/1515264483 >> 172.21.15.50:0/1515264483 conn(0x7f1e540698b0 msgr2=0x7f1e54069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 -- 172.21.15.50:0/1515264483 shutdown_connections 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.370+0000 7f1e5a47e640 1 -- 172.21.15.50:0/1515264483 wait complete. 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.372+0000 7f1e5a47e640 1 Processor -- start 2023-08-10T10:39:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.372+0000 7f1e5a47e640 1 -- start start 2023-08-10T10:39:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c004d00 0x7f1e5415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cadf0 0x7f1e540cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540cb7b0 con 0x7f1e541f2850 2023-08-10T10:39:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540c9530 con 0x7f1e3c004d00 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e5a47e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540ca070 con 0x7f1e540cadf0 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e58a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e58a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36118/0 (socket says 172.21.15.50:36118) 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.373+0000 7f1e58a1b640 1 -- 172.21.15.50:0/2908280238 learned_addr learned my addr 172.21.15.50:0/2908280238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e537fe640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cadf0 0x7f1e540cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e53fff640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c004d00 0x7f1e5415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 -- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cadf0 msgr2=0x7f1e540cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cadf0 0x7f1e540cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 -- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c004d00 msgr2=0x7f1e5415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c004d00 0x7f1e5415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 -- 172.21.15.50:0/2908280238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540ae820 con 0x7f1e541f2850 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.374+0000 7f1e58a1b640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c000c00 tx=0x7f1e4c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.375+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c03c040 con 0x7f1e541f2850 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.375+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c001760 con 0x7f1e541f2850 2023-08-10T10:39:35.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.375+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c000ed0 con 0x7f1e541f2850 2023-08-10T10:39:35.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.375+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e540ca500 con 0x7f1e541f2850 2023-08-10T10:39:35.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.375+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540c9a20 con 0x7f1e541f2850 2023-08-10T10:39:35.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.376+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e540ca1e0 con 0x7f1e541f2850 2023-08-10T10:39:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.377+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e4c032070 con 0x7f1e541f2850 2023-08-10T10:39:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.378+0000 7f1e50ff9640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 0x7f1e4006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.378+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e4c0a9a40 con 0x7f1e541f2850 2023-08-10T10:39:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.378+0000 7f1e53fff640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 0x7f1e4006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.379+0000 7f1e53fff640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 0x7f1e4006d140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007fd0 tx=0x7f1e44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.382+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e4c074e50 con 0x7f1e541f2850 2023-08-10T10:39:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.643+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1e5404e270 con 0x7f1e541f2850 2023-08-10T10:39:35.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.650+0000 7f1e50ff9640 1 -- 172.21.15.50:0/2908280238 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e4c078470 con 0x7f1e541f2850 2023-08-10T10:39:35.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 msgr2=0x7f1e4006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 0x7f1e4006d140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007fd0 tx=0x7f1e44009040 comp rx=0 tx=0).stop 2023-08-10T10:39:35.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 msgr2=0x7f1e541f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c000c00 tx=0x7f1e4c02e070 comp rx=0 tx=0).stop 2023-08-10T10:39:35.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 shutdown_connections 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e541f2850 0x7f1e541f2cb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540cadf0 0x7f1e540cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4006ac80 0x7f1e4006d140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 --2- 172.21.15.50:0/2908280238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c004d00 0x7f1e5415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 >> 172.21.15.50:0/2908280238 conn(0x7f1e540698b0 msgr2=0x7f1e540adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 shutdown_connections 2023-08-10T10:39:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.653+0000 7f1e5a47e640 1 -- 172.21.15.50:0/2908280238 wait complete. 2023-08-10T10:39:35.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-10T10:39:35.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.897+0000 7f084bfff640 1 Processor -- start 2023-08-10T10:39:35.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.897+0000 7f084bfff640 1 -- start start 2023-08-10T10:39:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.898+0000 7f084bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f084c15aa60 0x7f084c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.898+0000 7f084bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f084c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.898+0000 7f084bfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c06e8c0 con 0x7f084c0b1f70 2023-08-10T10:39:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.898+0000 7f084bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c15ae40 con 0x7f084c15aa60 2023-08-10T10:39:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.898+0000 7f084bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0b3a00 con 0x7f084c071590 2023-08-10T10:39:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f084b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f084c0b1f70 0x7f084c15e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36870/0 (socket says 172.21.15.50:36870) 2023-08-10T10:39:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f084b7fe640 1 -- 172.21.15.50:0/3870967514 learned_addr learned my addr 172.21.15.50:0/3870967514 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f0843fff640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f084c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f084affd640 1 --2- 172.21.15.50:0/3870967514 >> v2:172.21.15.117:3300/0 conn(0x7f084c15aa60 0x7f084c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529828604 0 0) 0x7f084c06e8c0 con 0x7f084c0b1f70 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.899+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0838003520 con 0x7f084c0b1f70 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453699418 0 0) 0x7f0838003520 con 0x7f084c0b1f70 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 msgr2=0x7f084c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f084c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 >> v2:172.21.15.117:3300/0 conn(0x7f084c15aa60 msgr2=0x7f084c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 --2- 172.21.15.50:0/3870967514 >> v2:172.21.15.117:3300/0 conn(0x7f084c15aa60 0x7f084c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0b3ce0 con 0x7f084c0b1f70 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f08440019f0 con 0x7f084c0b1f70 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 >> v1:172.21.15.50:6789/0 conn(0x7f084c0b1f70 legacy=0x7f084c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0838003970 0x7f0838003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f08380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c15ae40 con 0x7f0838003970 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0b3a00 con 0x7f0838004d00 2023-08-10T10:39:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083800b980 con 0x7f084c071590 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.900+0000 7f084affd640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0838003970 0x7f0838003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084b7fe640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f0843fff640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f08380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084affd640 1 -- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 msgr2=0x7f08380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084affd640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c071590 0x7f08380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084affd640 1 -- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838004d00 msgr2=0x7f0838005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084affd640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.901+0000 7f084affd640 1 -- 172.21.15.50:0/3870967514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838003520 con 0x7f0838003970 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.902+0000 7f084affd640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0838003970 0x7f0838003d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21651d74654d8515 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.902+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c02c710 con 0x7f0838003970 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.902+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c02c870 con 0x7f0838003970 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.902+0000 7f084a7fc640 1 -- 172.21.15.50:0/3870967514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c02cc00 con 0x7f0838003970 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 -- 172.21.15.50:0/3870967514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0838003970 msgr2=0x7f0838003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 --2- 172.21.15.50:0/3870967514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0838003970 0x7f0838003d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084b7fe640 1 -- 172.21.15.50:0/3870967514 reap_dead start 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 -- 172.21.15.50:0/3870967514 shutdown_connections 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 -- 172.21.15.50:0/3870967514 >> 172.21.15.50:0/3870967514 conn(0x7f084c06ab80 msgr2=0x7f084c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 -- 172.21.15.50:0/3870967514 shutdown_connections 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.903+0000 7f084bfff640 1 -- 172.21.15.50:0/3870967514 wait complete. 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.905+0000 7f084bfff640 1 Processor -- start 2023-08-10T10:39:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.905+0000 7f084bfff640 1 -- start start 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838003970 0x7f084c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c0acb80 0x7f084c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0cd790 con 0x7f084c0ad000 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c1f1f70 con 0x7f0838003970 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ccb80 con 0x7f084c0acb80 2023-08-10T10:39:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36134/0 (socket says 172.21.15.50:36134) 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f084b7fe640 1 -- 172.21.15.50:0/2766811412 learned_addr learned my addr 172.21.15.50:0/2766811412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.906+0000 7f0843fff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c0acb80 0x7f084c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 -- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c0acb80 msgr2=0x7f084c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c0acb80 0x7f084c0b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 -- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838003970 msgr2=0x7f084c1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084affd640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838003970 0x7f084c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838003970 0x7f084c1564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 -- 172.21.15.50:0/2766811412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0cce60 con 0x7f084c0ad000 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084b7fe640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f80 tx=0x7f084400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400ec10 con 0x7f084c0ad000 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084400ed70 con 0x7f084c0ad000 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c0cd140 con 0x7f084c0ad000 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400eee0 con 0x7f084c0ad000 2023-08-10T10:39:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.907+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c156d40 con 0x7f084c0ad000 2023-08-10T10:39:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.908+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c0b27c0 con 0x7f084c0ad000 2023-08-10T10:39:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.910+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0844013660 con 0x7f084c0ad000 2023-08-10T10:39:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.910+0000 7f08437fe640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 0x7f082c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.911+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0844089590 con 0x7f084c0ad000 2023-08-10T10:39:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.911+0000 7f084affd640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 0x7f082c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.911+0000 7f084affd640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 0x7f082c06d110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f083c036000 tx=0x7f083c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:35.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:35.915+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0844054980 con 0x7f084c0ad000 2023-08-10T10:39:36.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.183+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f084c066e30 con 0x7f084c0ad000 2023-08-10T10:39:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.190+0000 7f08437fe640 1 -- 172.21.15.50:0/2766811412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0844057fa0 con 0x7f084c0ad000 2023-08-10T10:39:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 msgr2=0x7f082c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 0x7f082c06d110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f083c036000 tx=0x7f083c030000 comp rx=0 tx=0).stop 2023-08-10T10:39:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 msgr2=0x7f084c0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f80 tx=0x7f084400e530 comp rx=0 tx=0).stop 2023-08-10T10:39:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 shutdown_connections 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f084c0ad000 0x7f084c0b1870 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f084c0acb80 0x7f084c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f082c06ac50 0x7f082c06d110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 --2- 172.21.15.50:0/2766811412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838003970 0x7f084c1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.193+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 >> 172.21.15.50:0/2766811412 conn(0x7f084c06ab80 msgr2=0x7f084c0c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.194+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 shutdown_connections 2023-08-10T10:39:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.194+0000 7f084bfff640 1 -- 172.21.15.50:0/2766811412 wait complete. 2023-08-10T10:39:36.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:36.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.439+0000 7f7003a8e640 1 Processor -- start 2023-08-10T10:39:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.439+0000 7f7003a8e640 1 -- start start 2023-08-10T10:39:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.441+0000 7f7003a8e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ffc15aa40 0x7f6ffc0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.441+0000 7f7003a8e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc071c70 con 0x7f6ffc0b0c60 2023-08-10T10:39:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.441+0000 7f7003a8e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc06a4c0 con 0x7f6ffc0ca930 2023-08-10T10:39:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.441+0000 7f7003a8e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0713d0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f7001029640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ffc0b0c60 0x7f6ffc0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36884/0 (socket says 172.21.15.50:36884) 2023-08-10T10:39:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f7001029640 1 -- 172.21.15.50:0/2129938036 learned_addr learned my addr 172.21.15.50:0/2129938036 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f700182a640 1 --2- 172.21.15.50:0/2129938036 >> v2:172.21.15.50:3300/0 conn(0x7f6ffc15aa40 0x7f6ffc0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f7000828640 1 -- 172.21.15.50:0/2129938036 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269761385 0 0) 0x7f6ffc071c70 con 0x7f6ffc0b0c60 2023-08-10T10:39:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f7000828640 1 -- 172.21.15.50:0/2129938036 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe8003520 con 0x7f6ffc0b0c60 2023-08-10T10:39:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f700182a640 1 -- 172.21.15.50:0/2129938036 >> v1:172.21.15.117:6789/0 conn(0x7f6ffc0ca930 legacy=0x7f6ffc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f700182a640 1 -- 172.21.15.50:0/2129938036 >> v1:172.21.15.50:6789/0 conn(0x7f6ffc0b0c60 legacy=0x7f6ffc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.442+0000 7f700182a640 1 -- 172.21.15.50:0/2129938036 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0716b0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.443+0000 7f700182a640 1 --2- 172.21.15.50:0/2129938036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc0b3820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80097a0 tx=0x7f6ff802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8d76b55aa49579 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7000828640 1 -- 172.21.15.50:0/2129938036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff802e070 con 0x7f6ffc15aa40 2023-08-10T10:39:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7000828640 1 -- 172.21.15.50:0/2129938036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff80315a0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7000828640 1 -- 172.21.15.50:0/2129938036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8031910 con 0x7f6ffc15aa40 2023-08-10T10:39:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7003a8e640 1 -- 172.21.15.50:0/2129938036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 msgr2=0x7f6ffc0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7003a8e640 1 --2- 172.21.15.50:0/2129938036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc0b3820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80097a0 tx=0x7f6ff802b840 comp rx=0 tx=0).stop 2023-08-10T10:39:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7003a8e640 1 -- 172.21.15.50:0/2129938036 shutdown_connections 2023-08-10T10:39:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7003a8e640 1 --2- 172.21.15.50:0/2129938036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc0b3820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.444+0000 7f7003a8e640 1 -- 172.21.15.50:0/2129938036 >> 172.21.15.50:0/2129938036 conn(0x7f6ffc06b590 msgr2=0x7f6ffc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.445+0000 7f7003a8e640 1 -- 172.21.15.50:0/2129938036 shutdown_connections 2023-08-10T10:39:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.445+0000 7f7003a8e640 1 -- 172.21.15.50:0/2129938036 wait complete. 2023-08-10T10:39:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.446+0000 7f7003a8e640 1 Processor -- start 2023-08-10T10:39:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.446+0000 7f7003a8e640 1 -- start start 2023-08-10T10:39:36.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 0x7f6ffc0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 0x7f6ffc0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0c7fa0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0c6830 con 0x7f6ffc0b0c60 2023-08-10T10:39:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.447+0000 7f7003a8e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0c6b10 con 0x7f6ffc0ca930 2023-08-10T10:39:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36154/0 (socket says 172.21.15.50:36154) 2023-08-10T10:39:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 -- 172.21.15.50:0/840059236 learned_addr learned my addr 172.21.15.50:0/840059236 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f7001029640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 0x7f6ffc0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700182a640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 0x7f6ffc0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 -- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 msgr2=0x7f6ffc0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 0x7f6ffc0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 -- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 msgr2=0x7f6ffc0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 0x7f6ffc0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700202b640 1 -- 172.21.15.50:0/840059236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009400 con 0x7f6ffc15aa40 2023-08-10T10:39:36.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f7001029640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 0x7f6ffc0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:36.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.448+0000 7f700182a640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 0x7f6ffc0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:36.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f700202b640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c780 tx=0x7f6ff400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4004b60 con 0x7f6ffc15aa40 2023-08-10T10:39:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400ce90 con 0x7f6ffc15aa40 2023-08-10T10:39:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400a850 con 0x7f6ffc15aa40 2023-08-10T10:39:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc0c6df0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.449+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc1f2210 con 0x7f6ffc15aa40 2023-08-10T10:39:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.450+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc04e270 con 0x7f6ffc15aa40 2023-08-10T10:39:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.452+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ff400a9b0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.452+0000 7f6ff27fc640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 0x7f6fe006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.453+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6ff4089430 con 0x7f6ffc15aa40 2023-08-10T10:39:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.453+0000 7f700182a640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 0x7f6fe006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.454+0000 7f700182a640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 0x7f6fe006d140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8036000 tx=0x7f6ff803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.457+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6ff4054790 con 0x7f6ffc15aa40 2023-08-10T10:39:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.651+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ffc0b4120 con 0x7f6ffc15aa40 2023-08-10T10:39:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.653+0000 7f6ff27fc640 1 -- 172.21.15.50:0/840059236 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f6ff4057db0 con 0x7f6ffc15aa40 2023-08-10T10:39:36.654 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:32.403775+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 msgr2=0x7f6fe006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 0x7f6fe006d140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8036000 tx=0x7f6ff803d040 comp rx=0 tx=0).stop 2023-08-10T10:39:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 msgr2=0x7f6ffc1f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c780 tx=0x7f6ff400cc40 comp rx=0 tx=0).stop 2023-08-10T10:39:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 shutdown_connections 2023-08-10T10:39:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc15aa40 0x7f6ffc1f1cd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ffc0ca930 0x7f6ffc0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fe006ac80 0x7f6fe006d140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 --2- 172.21.15.50:0/840059236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc0b0c60 0x7f6ffc0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 >> 172.21.15.50:0/840059236 conn(0x7f6ffc06b590 msgr2=0x7f6ffc0cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 shutdown_connections 2023-08-10T10:39:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.657+0000 7f7003a8e640 1 -- 172.21.15.50:0/840059236 wait complete. 2023-08-10T10:39:36.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:36.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:36.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.907+0000 7f53ccffd640 1 Processor -- start 2023-08-10T10:39:36.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.907+0000 7f53ccffd640 1 -- start start 2023-08-10T10:39:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53ccffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53c8158800 0x7f53c8071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53ccffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53c806b270 0x7f53c80b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53ccffd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c815c0d0 con 0x7f53c815b0e0 2023-08-10T10:39:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53ccffd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c815bb10 con 0x7f53c8158800 2023-08-10T10:39:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53ccffd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c815bdf0 con 0x7f53c806b270 2023-08-10T10:39:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53c659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53c8158800 0x7f53c8071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53c659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53c8158800 0x7f53c8071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36166/0 (socket says 172.21.15.50:36166) 2023-08-10T10:39:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.909+0000 7f53c659c640 1 -- 172.21.15.50:0/1136024343 learned_addr learned my addr 172.21.15.50:0/1136024343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:36.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.910+0000 7f53c6d9d640 1 --2- 172.21.15.50:0/1136024343 >> v2:172.21.15.117:3300/0 conn(0x7f53c806b270 0x7f53c80b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.910+0000 7f53c659c640 1 -- 172.21.15.50:0/1136024343 >> v2:172.21.15.117:3300/0 conn(0x7f53c806b270 msgr2=0x7f53c80b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:36.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.910+0000 7f53c659c640 1 --2- 172.21.15.50:0/1136024343 >> v2:172.21.15.117:3300/0 conn(0x7f53c806b270 0x7f53c80b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.910+0000 7f53c659c640 1 -- 172.21.15.50:0/1136024343 >> v1:172.21.15.117:6789/0 conn(0x7f53c815b0e0 legacy=0x7f53c806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:36.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.910+0000 7f53c659c640 1 -- 172.21.15.50:0/1136024343 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8070d80 con 0x7f53c8158800 2023-08-10T10:39:36.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.911+0000 7f53c659c640 1 --2- 172.21.15.50:0/1136024343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c8158800 0x7f53c8071580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f53c815e610 tx=0x7f53b802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7047f813c8c1ad33 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.912+0000 7f53c5d9b640 1 -- 172.21.15.50:0/1136024343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8031750 con 0x7f53c8158800 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.912+0000 7f53c5d9b640 1 -- 172.21.15.50:0/1136024343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b80318b0 con 0x7f53c8158800 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.912+0000 7f53c5d9b640 1 -- 172.21.15.50:0/1136024343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8031c40 con 0x7f53c8158800 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.912+0000 7f53ccffd640 1 -- 172.21.15.50:0/1136024343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c8158800 msgr2=0x7f53c8071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.912+0000 7f53ccffd640 1 --2- 172.21.15.50:0/1136024343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c8158800 0x7f53c8071580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f53c815e610 tx=0x7f53b802b7f0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 -- 172.21.15.50:0/1136024343 shutdown_connections 2023-08-10T10:39:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 --2- 172.21.15.50:0/1136024343 >> v2:172.21.15.117:3300/0 conn(0x7f53c806b270 0x7f53c80b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 --2- 172.21.15.50:0/1136024343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c8158800 0x7f53c8071580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 -- 172.21.15.50:0/1136024343 >> 172.21.15.50:0/1136024343 conn(0x7f53c80b16f0 msgr2=0x7f53c80b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 -- 172.21.15.50:0/1136024343 shutdown_connections 2023-08-10T10:39:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.913+0000 7f53ccffd640 1 -- 172.21.15.50:0/1136024343 wait complete. 2023-08-10T10:39:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.915+0000 7f53ccffd640 1 Processor -- start 2023-08-10T10:39:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.915+0000 7f53ccffd640 1 -- start start 2023-08-10T10:39:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 0x7f53c8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53c815b0e0 0x7f53c8154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80af790 con 0x7f53c806b270 2023-08-10T10:39:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80b0310 con 0x7f53c8158800 2023-08-10T10:39:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53ccffd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80af9e0 con 0x7f53c815b0e0 2023-08-10T10:39:36.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36170/0 (socket says 172.21.15.50:36170) 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c659c640 1 -- 172.21.15.50:0/4109141336 learned_addr learned my addr 172.21.15.50:0/4109141336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53bffff640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 0x7f53c8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c659c640 1 -- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53c815b0e0 msgr2=0x7f53c8154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c6d9d640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53c815b0e0 0x7f53c8154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.916+0000 7f53c659c640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53c815b0e0 0x7f53c8154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53c659c640 1 -- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 msgr2=0x7f53c8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:36.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53c659c640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 0x7f53c8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:36.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53c659c640 1 -- 172.21.15.50:0/4109141336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80094d0 con 0x7f53c806b270 2023-08-10T10:39:36.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53bffff640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 0x7f53c8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:36.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53c659c640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53b802b830 tx=0x7f53b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8033c80 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8033de0 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b803c620 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c8071c40 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.917+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80affa0 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.919+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80612b0 con 0x7f53c806b270 2023-08-10T10:39:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.919+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53b803a040 con 0x7f53c806b270 2023-08-10T10:39:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.920+0000 7f53beffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 0x7f53a806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.921+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f53b80aaf00 con 0x7f53c806b270 2023-08-10T10:39:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.921+0000 7f53bffff640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 0x7f53a806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.921+0000 7f53bffff640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 0x7f53a806d110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53c8150730 tx=0x7f53b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:36.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:36.925+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53b8076380 con 0x7f53c806b270 2023-08-10T10:39:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.119+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53c80ceee0 con 0x7f53c806b270 2023-08-10T10:39:37.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.119+0000 7f53beffd640 1 -- 172.21.15.50:0/4109141336 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53b8038020 con 0x7f53c806b270 2023-08-10T10:39:37.120 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 msgr2=0x7f53a806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 0x7f53a806d110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53c8150730 tx=0x7f53b0008040 comp rx=0 tx=0).stop 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 msgr2=0x7f53c814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53b802b830 tx=0x7f53b80046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 shutdown_connections 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53c815b0e0 0x7f53c8154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53a806ac50 0x7f53a806d110 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c8158800 0x7f53c8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 --2- 172.21.15.50:0/4109141336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53c806b270 0x7f53c814fab0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 >> 172.21.15.50:0/4109141336 conn(0x7f53c80b16f0 msgr2=0x7f53c806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:37.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 shutdown_connections 2023-08-10T10:39:37.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.122+0000 7f53ccffd640 1 -- 172.21.15.50:0/4109141336 wait complete. 2023-08-10T10:39:37.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.376+0000 7f39104ad640 1 Processor -- start 2023-08-10T10:39:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.376+0000 7f39104ad640 1 -- start start 2023-08-10T10:39:37.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f39104ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 0x7f39080ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f39104ad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390806a070 0x7f39080cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f39104ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080c9c00 con 0x7f390806ec90 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f39104ad640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39080b1090 con 0x7f390806a070 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f39104ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c8d10 con 0x7f390806cb30 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f390ea4a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390806a070 0x7f39080cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f390ea4a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f390806a070 0x7f39080cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36184/0 (socket says 172.21.15.50:36184) 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.378+0000 7f390ea4a640 1 -- 172.21.15.50:0/1669118111 learned_addr learned my addr 172.21.15.50:0/1669118111 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390ea4a640 1 -- 172.21.15.50:0/1669118111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 msgr2=0x7f39080ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390e249640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 0x7f39080ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390ea4a640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 0x7f39080ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390ea4a640 1 -- 172.21.15.50:0/1669118111 >> v1:172.21.15.117:6789/0 conn(0x7f390806ec90 legacy=0x7f3908069960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390ea4a640 1 -- 172.21.15.50:0/1669118111 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080c8ff0 con 0x7f390806a070 2023-08-10T10:39:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.379+0000 7f390e249640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 0x7f39080ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.381+0000 7f390ea4a640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806a070 0x7f39080cd2a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f390000bb10 tx=0x7f390002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ce2b7d75dd3aae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.381+0000 7f390d247640 1 -- 172.21.15.50:0/1669118111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390002ee80 con 0x7f390806a070 2023-08-10T10:39:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.381+0000 7f390d247640 1 -- 172.21.15.50:0/1669118111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900036440 con 0x7f390806a070 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.381+0000 7f390d247640 1 -- 172.21.15.50:0/1669118111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000367b0 con 0x7f390806a070 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.381+0000 7f39104ad640 1 -- 172.21.15.50:0/1669118111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806a070 msgr2=0x7f39080cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806a070 0x7f39080cd2a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f390000bb10 tx=0x7f390002e0d0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 -- 172.21.15.50:0/1669118111 shutdown_connections 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806a070 0x7f39080cd2a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 --2- 172.21.15.50:0/1669118111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806cb30 0x7f39080ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 -- 172.21.15.50:0/1669118111 >> 172.21.15.50:0/1669118111 conn(0x7f39080b01b0 msgr2=0x7f39080b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:37.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 -- 172.21.15.50:0/1669118111 shutdown_connections 2023-08-10T10:39:37.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.382+0000 7f39104ad640 1 -- 172.21.15.50:0/1669118111 wait complete. 2023-08-10T10:39:37.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.384+0000 7f39104ad640 1 Processor -- start 2023-08-10T10:39:37.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.384+0000 7f39104ad640 1 -- start start 2023-08-10T10:39:37.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806a070 0x7f39080c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390806cb30 0x7f39080ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c21f0 con 0x7f390806ec90 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c2a50 con 0x7f390806cb30 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f39104ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39081ef370 con 0x7f390806a070 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.385+0000 7f390ea4a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36192/0 (socket says 172.21.15.50:36192) 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 -- 172.21.15.50:0/3194740588 learned_addr learned my addr 172.21.15.50:0/3194740588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 -- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806a070 msgr2=0x7f39080c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806a070 0x7f39080c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390da48640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390806cb30 0x7f39080ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 -- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390806cb30 msgr2=0x7f39080ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390806cb30 0x7f39080ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 -- 172.21.15.50:0/3194740588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390000b770 con 0x7f390806ec90 2023-08-10T10:39:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.386+0000 7f390ea4a640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f390000b2c0 tx=0x7f39000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.387+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900034b80 con 0x7f390806ec90 2023-08-10T10:39:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.387+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900034ce0 con 0x7f390806ec90 2023-08-10T10:39:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.387+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900041680 con 0x7f390806ec90 2023-08-10T10:39:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.387+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39080c2400 con 0x7f390806ec90 2023-08-10T10:39:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.387+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39080cd150 con 0x7f390806ec90 2023-08-10T10:39:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.388+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39080612b0 con 0x7f390806ec90 2023-08-10T10:39:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.389+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f390003d040 con 0x7f390806ec90 2023-08-10T10:39:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.390+0000 7f38feffd640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 0x7f38ec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.390+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f39000ae110 con 0x7f390806ec90 2023-08-10T10:39:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.390+0000 7f390e249640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 0x7f38ec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.391+0000 7f390e249640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 0x7f38ec06d140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3904008ea0 tx=0x7f39040083d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.395+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39000795b0 con 0x7f390806ec90 2023-08-10T10:39:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.589+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39080c2b90 con 0x7f390806ec90 2023-08-10T10:39:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.591+0000 7f38feffd640 1 -- 172.21.15.50:0/3194740588 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f390007cbd0 con 0x7f390806ec90 2023-08-10T10:39:37.591 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 msgr2=0x7f38ec06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 0x7f38ec06d140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3904008ea0 tx=0x7f39040083d0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 msgr2=0x7f39080c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f390000b2c0 tx=0x7f39000046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 shutdown_connections 2023-08-10T10:39:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390806ec90 0x7f39080c3bb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38ec06ac80 0x7f38ec06d140 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390806cb30 0x7f39080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 --2- 172.21.15.50:0/3194740588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390806a070 0x7f39080c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.593+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 >> 172.21.15.50:0/3194740588 conn(0x7f39080b01b0 msgr2=0x7f390815c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.594+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 shutdown_connections 2023-08-10T10:39:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.594+0000 7f39104ad640 1 -- 172.21.15.50:0/3194740588 wait complete. 2023-08-10T10:39:37.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:39:37.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.839+0000 7f8563fff640 1 Processor -- start 2023-08-10T10:39:37.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.839+0000 7f8563fff640 1 -- start start 2023-08-10T10:39:37.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8563fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85640b0620 0x7f85640b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8563fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640b1f10 con 0x7f856415a940 2023-08-10T10:39:37.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8563fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856415e7d0 con 0x7f856415f2b0 2023-08-10T10:39:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8563fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85640b21f0 con 0x7f85640b0620 2023-08-10T10:39:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f85627fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85640b0620 0x7f85640b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8562ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f856415a940 0x7f85640aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36888/0 (socket says 172.21.15.50:36888) 2023-08-10T10:39:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.841+0000 7f8562ffd640 1 -- 172.21.15.50:0/3092709594 learned_addr learned my addr 172.21.15.50:0/3092709594 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.842+0000 7f85627fc640 1 -- 172.21.15.50:0/3092709594 >> v1:172.21.15.117:6789/0 conn(0x7f856415f2b0 legacy=0x7f85640ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.842+0000 7f85627fc640 1 -- 172.21.15.50:0/3092709594 >> v1:172.21.15.50:6789/0 conn(0x7f856415a940 legacy=0x7f85640aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.842+0000 7f8561ffb640 1 -- 172.21.15.50:0/3092709594 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68215844 0 0) 0x7f85640b1f10 con 0x7f856415a940 2023-08-10T10:39:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.842+0000 7f85627fc640 1 -- 172.21.15.50:0/3092709594 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856415eab0 con 0x7f85640b0620 2023-08-10T10:39:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.843+0000 7f85627fc640 1 --2- 172.21.15.50:0/3092709594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f85640b12c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85580097a0 tx=0x7f855802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64259f0cb3450e15 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.843+0000 7f8561ffb640 1 -- 172.21.15.50:0/3092709594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855802e070 con 0x7f85640b0620 2023-08-10T10:39:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.843+0000 7f8561ffb640 1 -- 172.21.15.50:0/3092709594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85580315a0 con 0x7f85640b0620 2023-08-10T10:39:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.843+0000 7f8561ffb640 1 -- 172.21.15.50:0/3092709594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558031930 con 0x7f85640b0620 2023-08-10T10:39:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 -- 172.21.15.50:0/3092709594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 msgr2=0x7f85640b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 --2- 172.21.15.50:0/3092709594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f85640b12c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85580097a0 tx=0x7f855802b840 comp rx=0 tx=0).stop 2023-08-10T10:39:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 -- 172.21.15.50:0/3092709594 shutdown_connections 2023-08-10T10:39:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 --2- 172.21.15.50:0/3092709594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f85640b12c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 -- 172.21.15.50:0/3092709594 >> 172.21.15.50:0/3092709594 conn(0x7f856406ab80 msgr2=0x7f856406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:37.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 -- 172.21.15.50:0/3092709594 shutdown_connections 2023-08-10T10:39:37.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.844+0000 7f8563fff640 1 -- 172.21.15.50:0/3092709594 wait complete. 2023-08-10T10:39:37.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.846+0000 7f8563fff640 1 Processor -- start 2023-08-10T10:39:37.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.846+0000 7f8563fff640 1 -- start start 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856415a940 0x7f8564070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856415f2b0 0x7f8564146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856415c320 con 0x7f85640b0620 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564146fe0 con 0x7f856415a940 2023-08-10T10:39:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8563fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856415b6a0 con 0x7f856415f2b0 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8562ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8562ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36202/0 (socket says 172.21.15.50:36202) 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.847+0000 7f8562ffd640 1 -- 172.21.15.50:0/4112838717 learned_addr learned my addr 172.21.15.50:0/4112838717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 -- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856415f2b0 msgr2=0x7f8564146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856415f2b0 0x7f8564146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f85627fc640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856415a940 0x7f8564070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 -- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856415a940 msgr2=0x7f8564070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856415a940 0x7f8564070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 -- 172.21.15.50:0/4112838717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558009400 con 0x7f85640b0620 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8562ffd640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f855400c4d0 tx=0x7f855400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540074e0 con 0x7f85640b0620 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554007660 con 0x7f85640b0620 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554004a20 con 0x7f85640b0620 2023-08-10T10:39:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.848+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856415b980 con 0x7f85640b0620 2023-08-10T10:39:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.849+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856415bf40 con 0x7f85640b0620 2023-08-10T10:39:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.850+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8564066e30 con 0x7f85640b0620 2023-08-10T10:39:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.851+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8554004b80 con 0x7f85640b0620 2023-08-10T10:39:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.851+0000 7f854b7fe640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 0x7f855006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.852+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8554088280 con 0x7f85640b0620 2023-08-10T10:39:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.852+0000 7f85627fc640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 0x7f855006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.853+0000 7f85627fc640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 0x7f855006d110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8558036000 tx=0x7f8558008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:37.856+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8554053710 con 0x7f85640b0620 2023-08-10T10:39:38.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.048+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f85640b0dc0 con 0x7f85640b0620 2023-08-10T10:39:38.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.051+0000 7f854b7fe640 1 -- 172.21.15.50:0/4112838717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8554056d30 con 0x7f85640b0620 2023-08-10T10:39:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:38.052 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:39:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:38.053 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:39:38.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 msgr2=0x7f855006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 0x7f855006d110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8558036000 tx=0x7f8558008030 comp rx=0 tx=0).stop 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 msgr2=0x7f856415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f855400c4d0 tx=0x7f855400c990 comp rx=0 tx=0).stop 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 shutdown_connections 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856415f2b0 0x7f8564146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f855006ac50 0x7f855006d110 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856415a940 0x7f8564070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 --2- 172.21.15.50:0/4112838717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85640b0620 0x7f856415b050 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 >> 172.21.15.50:0/4112838717 conn(0x7f856406ab80 msgr2=0x7f856406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:38.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 shutdown_connections 2023-08-10T10:39:38.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.054+0000 7f8563fff640 1 -- 172.21.15.50:0/4112838717 wait complete. 2023-08-10T10:39:38.074 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:39:38.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:39:38.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.299+0000 7f2fcd098640 1 Processor -- start 2023-08-10T10:39:38.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.299+0000 7f2fcd098640 1 -- start start 2023-08-10T10:39:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fc80cd260 0x7f2fc815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80ac900 0x7f2fc815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fc8160700 0x7f2fc80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80ade40 con 0x7f2fc8160700 2023-08-10T10:39:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80acda0 con 0x7f2fc80cd260 2023-08-10T10:39:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcd098640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80ad080 con 0x7f2fc80ac900 2023-08-10T10:39:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.301+0000 7f2fcc897640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fc8160700 0x7f2fc80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fc8160700 0x7f2fc80696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36212/0 (socket says 172.21.15.50:36212) 2023-08-10T10:39:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 -- 172.21.15.50:0/3339834381 learned_addr learned my addr 172.21.15.50:0/3339834381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fbffff640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80ac900 0x7f2fc815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fc7fff640 1 --2- 172.21.15.50:0/3339834381 >> v2:172.21.15.117:3300/0 conn(0x7f2fc80cd260 0x7f2fc815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 -- 172.21.15.50:0/3339834381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80ac900 msgr2=0x7f2fc815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80ac900 0x7f2fc815cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 -- 172.21.15.50:0/3339834381 >> v2:172.21.15.117:3300/0 conn(0x7f2fc80cd260 msgr2=0x7f2fc815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 --2- 172.21.15.50:0/3339834381 >> v2:172.21.15.117:3300/0 conn(0x7f2fc80cd260 0x7f2fc815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.302+0000 7f2fcc897640 1 -- 172.21.15.50:0/3339834381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80ad360 con 0x7f2fc8160700 2023-08-10T10:39:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.304+0000 7f2fcc897640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc8160700 0x7f2fc80696a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806bb70 tx=0x7f2fc002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f1422c0c9a5f59 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.304+0000 7f2fc77fe640 1 -- 172.21.15.50:0/3339834381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc002ca70 con 0x7f2fc8160700 2023-08-10T10:39:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.304+0000 7f2fc77fe640 1 -- 172.21.15.50:0/3339834381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc002cbd0 con 0x7f2fc8160700 2023-08-10T10:39:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.304+0000 7f2fc77fe640 1 -- 172.21.15.50:0/3339834381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00343f0 con 0x7f2fc8160700 2023-08-10T10:39:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 -- 172.21.15.50:0/3339834381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc8160700 msgr2=0x7f2fc80696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc8160700 0x7f2fc80696a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806bb70 tx=0x7f2fc002bed0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 -- 172.21.15.50:0/3339834381 shutdown_connections 2023-08-10T10:39:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc8160700 0x7f2fc80696a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 --2- 172.21.15.50:0/3339834381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80ac900 0x7f2fc815cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 --2- 172.21.15.50:0/3339834381 >> v2:172.21.15.117:3300/0 conn(0x7f2fc80cd260 0x7f2fc815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 -- 172.21.15.50:0/3339834381 >> 172.21.15.50:0/3339834381 conn(0x7f2fc80b0050 msgr2=0x7f2fc80b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 -- 172.21.15.50:0/3339834381 shutdown_connections 2023-08-10T10:39:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.305+0000 7f2fcd098640 1 -- 172.21.15.50:0/3339834381 wait complete. 2023-08-10T10:39:38.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.307+0000 7f2fcd098640 1 Processor -- start 2023-08-10T10:39:38.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.307+0000 7f2fcd098640 1 -- start start 2023-08-10T10:39:38.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80cd260 0x7f2fc8070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc8160700 0x7f2fc80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc806ed40 con 0x7f2fc80ac900 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc806f020 con 0x7f2fc8160700 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fcd098640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc806f300 con 0x7f2fc80cd260 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.308+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36220/0 (socket says 172.21.15.50:36220) 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 -- 172.21.15.50:0/400173666 learned_addr learned my addr 172.21.15.50:0/400173666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 -- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80cd260 msgr2=0x7f2fc8070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80cd260 0x7f2fc8070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 -- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc8160700 msgr2=0x7f2fc80b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc8160700 0x7f2fc80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 -- 172.21.15.50:0/400173666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0009b30 con 0x7f2fc80ac900 2023-08-10T10:39:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.309+0000 7f2fc7fff640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800e9b0 tx=0x7f2fb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.310+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8009670 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.310+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800c9a0 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.310+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800cd50 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.310+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc806f5e0 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.310+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc80c80b0 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.311+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80cf650 con 0x7f2fc80ac900 2023-08-10T10:39:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.312+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fb8013470 con 0x7f2fc80ac900 2023-08-10T10:39:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.313+0000 7f2fc57fa640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 0x7f2fa806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.314+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2fb8089360 con 0x7f2fc80ac900 2023-08-10T10:39:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.314+0000 7f2fbffff640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 0x7f2fa806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.314+0000 7f2fbffff640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 0x7f2fa806d110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2fc815dca0 tx=0x7f2fb0009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.318+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2fb8054760 con 0x7f2fc80ac900 2023-08-10T10:39:38.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:38.512+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2fc8066e30 con 0x7f2fc80ac900 2023-08-10T10:39:39.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.069+0000 7f2fc57fa640 1 -- 172.21.15.50:0/400173666 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2fb8057d80 con 0x7f2fc80ac900 2023-08-10T10:39:39.071 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:39:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.076+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 msgr2=0x7f2fa806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.076+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 0x7f2fa806d110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2fc815dca0 tx=0x7f2fb0009500 comp rx=0 tx=0).stop 2023-08-10T10:39:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.076+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 msgr2=0x7f2fc81f1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.076+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800e9b0 tx=0x7f2fb800ee70 comp rx=0 tx=0).stop 2023-08-10T10:39:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 shutdown_connections 2023-08-10T10:39:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2fa806ac50 0x7f2fa806d110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc8160700 0x7f2fc80b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fc80cd260 0x7f2fc8070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 --2- 172.21.15.50:0/400173666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc80ac900 0x7f2fc81f1fc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 >> 172.21.15.50:0/400173666 conn(0x7f2fc80b0050 msgr2=0x7f2fc80c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:39.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 shutdown_connections 2023-08-10T10:39:39.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.077+0000 7f2fcd098640 1 -- 172.21.15.50:0/400173666 wait complete. 2023-08-10T10:39:39.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:39:39.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.328+0000 7f9f32542640 1 Processor -- start 2023-08-10T10:39:39.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.329+0000 7f9f32542640 1 -- start start 2023-08-10T10:39:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f32542640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9f2c15cf70 0x7f9f2c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f32542640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c160a40 con 0x7f9f2c0b4640 2023-08-10T10:39:39.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f32542640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0b4bb0 con 0x7f9f2c15cb90 2023-08-10T10:39:39.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f32542640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b4e90 con 0x7f9f2c15cf70 2023-08-10T10:39:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f30adf640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f2c0b4640 0x7f9f2c06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36894/0 (socket says 172.21.15.50:36894) 2023-08-10T10:39:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.330+0000 7f9f30adf640 1 -- 172.21.15.50:0/38179042 learned_addr learned my addr 172.21.15.50:0/38179042 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2b7fe640 1 --2- 172.21.15.50:0/38179042 >> v2:172.21.15.117:3300/0 conn(0x7f9f2c15cf70 0x7f9f2c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189585306 0 0) 0x7f9f2c160a40 con 0x7f9f2c0b4640 2023-08-10T10:39:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14003520 con 0x7f9f2c0b4640 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2675269591 0 0) 0x7f9f14003520 con 0x7f9f2c0b4640 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 >> v2:172.21.15.117:3300/0 conn(0x7f9f2c15cf70 msgr2=0x7f9f2c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 --2- 172.21.15.50:0/38179042 >> v2:172.21.15.117:3300/0 conn(0x7f9f2c15cf70 0x7f9f2c160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 >> v1:172.21.15.117:6789/0 conn(0x7f9f2c15cb90 legacy=0x7f9f2c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0b5170 con 0x7f9f2c0b4640 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9f240019f0 con 0x7f9f2c0b4640 2023-08-10T10:39:39.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 >> v1:172.21.15.50:6789/0 conn(0x7f9f2c0b4640 legacy=0x7f9f2c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14003970 0x7f9f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.331+0000 7f9f2affd640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f140047c0 0x7f9f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2affd640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 0x7f9f1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b4e90 con 0x7f9f14005180 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400c020 con 0x7f9f14003970 2023-08-10T10:39:39.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400c1e0 con 0x7f9f140047c0 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 0x7f9f1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2b7fe640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f140047c0 0x7f9f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14003970 0x7f9f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 -- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f140047c0 msgr2=0x7f9f14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f140047c0 0x7f9f14004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 -- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14003970 msgr2=0x7f9f14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:39.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14003970 0x7f9f14003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f30adf640 1 -- 172.21.15.50:0/38179042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14003520 con 0x7f9f14005180 2023-08-10T10:39:39.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.332+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14003970 0x7f9f14003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:39.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.333+0000 7f9f30adf640 1 -- 172.21.15.50:0/38179042 reap_dead start 2023-08-10T10:39:39.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.333+0000 7f9f30adf640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 0x7f9f1400b980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400a830 tx=0x7f9f140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71450e5f1455d66 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:39.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240072d0 con 0x7f9f14005180 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2402f070 con 0x7f9f14005180 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f2affd640 1 -- 172.21.15.50:0/38179042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240076b0 con 0x7f9f14005180 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 -- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 msgr2=0x7f9f1400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 0x7f9f1400b980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400a830 tx=0x7f9f140057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 -- 172.21.15.50:0/38179042 shutdown_connections 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 --2- 172.21.15.50:0/38179042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f14005180 0x7f9f1400b980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 -- 172.21.15.50:0/38179042 >> 172.21.15.50:0/38179042 conn(0x7f9f2c0cf640 msgr2=0x7f9f2c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:39.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.334+0000 7f9f32542640 1 -- 172.21.15.50:0/38179042 shutdown_connections 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.335+0000 7f9f32542640 1 -- 172.21.15.50:0/38179042 wait complete. 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.336+0000 7f9f32542640 1 Processor -- start 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.336+0000 7f9f32542640 1 -- start start 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 0x7f9f2c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 0x7f9f2c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c152170 con 0x7f9f2c156be0 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c152410 con 0x7f9f14005180 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.337+0000 7f9f32542640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c1526f0 con 0x7f9f2c144440 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36236/0 (socket says 172.21.15.50:36236) 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 -- 172.21.15.50:0/3860908836 learned_addr learned my addr 172.21.15.50:0/3860908836 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f30adf640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 0x7f9f2c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 0x7f9f2c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 -- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 msgr2=0x7f9f2c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 0x7f9f2c0c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 -- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 msgr2=0x7f9f2c141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 0x7f9f2c141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2b7fe640 1 -- 172.21.15.50:0/3860908836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c1529d0 con 0x7f9f2c156be0 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 0x7f9f2c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.338+0000 7f9f30adf640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 0x7f9f2c0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f2b7fe640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9f20010860 tx=0x7f9f20010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20009610 con 0x7f9f2c156be0 2023-08-10T10:39:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000eb60 con 0x7f9f2c156be0 2023-08-10T10:39:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2001c400 con 0x7f9f2c156be0 2023-08-10T10:39:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c152cb0 con 0x7f9f2c156be0 2023-08-10T10:39:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.339+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c141db0 con 0x7f9f2c156be0 2023-08-10T10:39:39.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.340+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c0612b0 con 0x7f9f2c156be0 2023-08-10T10:39:39.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.342+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f2001c560 con 0x7f9f2c156be0 2023-08-10T10:39:39.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.343+0000 7f9f28ff9640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 0x7f9f1806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:39.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.343+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f9f200899e0 con 0x7f9f2c156be0 2023-08-10T10:39:39.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.343+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 0x7f9f1806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:39.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.344+0000 7f9f2bfff640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 0x7f9f1806d110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001690 tx=0x7f9f1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:39.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.347+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9f20054d90 con 0x7f9f2c156be0 2023-08-10T10:39:39.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:39.537+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f2c0d0a10 con 0x7f9f2c156be0 2023-08-10T10:39:40.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.080+0000 7f9f28ff9640 1 -- 172.21.15.50:0/3860908836 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f200583b0 con 0x7f9f2c156be0 2023-08-10T10:39:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:39:40.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.092+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 msgr2=0x7f9f1806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.092+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 0x7f9f1806d110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001690 tx=0x7f9f1c009040 comp rx=0 tx=0).stop 2023-08-10T10:39:40.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.092+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 msgr2=0x7f9f2c0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.092+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9f20010860 tx=0x7f9f20010d20 comp rx=0 tx=0).stop 2023-08-10T10:39:40.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 shutdown_connections 2023-08-10T10:39:40.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c144440 0x7f9f2c0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f2c156be0 0x7f9f2c0cd6a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f1806ac50 0x7f9f1806d110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 --2- 172.21.15.50:0/3860908836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f14005180 0x7f9f2c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.094+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 >> 172.21.15.50:0/3860908836 conn(0x7f9f2c0cf640 msgr2=0x7f9f2c158340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.096+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 shutdown_connections 2023-08-10T10:39:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.096+0000 7f9f32542640 1 -- 172.21.15.50:0/3860908836 wait complete. 2023-08-10T10:39:40.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:39:40.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.329+0000 7fd1bc083640 1 Processor -- start 2023-08-10T10:39:40.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.329+0000 7fd1bc083640 1 -- start start 2023-08-10T10:39:40.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.330+0000 7fd1bc083640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1b415cf70 0x7fd1b4160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.330+0000 7fd1bc083640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b4160a40 con 0x7fd1b415cb90 2023-08-10T10:39:40.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1bc083640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40b4bb0 con 0x7fd1b40b4640 2023-08-10T10:39:40.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1bc083640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40b4e90 con 0x7fd1b415cf70 2023-08-10T10:39:40.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1b9e1f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1b415cb90 0x7fd1b40b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36902/0 (socket says 172.21.15.50:36902) 2023-08-10T10:39:40.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/470599723 learned_addr learned my addr 172.21.15.50:0/470599723 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:40.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1b961e640 1 --2- 172.21.15.50:0/470599723 >> v2:172.21.15.117:3300/0 conn(0x7fd1b415cf70 0x7fd1b4160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721648641 0 0) 0x7fd1b4160a40 con 0x7fd1b415cb90 2023-08-10T10:39:40.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.331+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0003520 con 0x7fd1b415cb90 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422082129 0 0) 0x7fd1a0003520 con 0x7fd1b415cb90 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 >> v2:172.21.15.117:3300/0 conn(0x7fd1b415cf70 msgr2=0x7fd1b4160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 --2- 172.21.15.50:0/470599723 >> v2:172.21.15.117:3300/0 conn(0x7fd1b415cf70 0x7fd1b4160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 >> v1:172.21.15.117:6789/0 conn(0x7fd1b40b4640 legacy=0x7fd1b406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40b5170 con 0x7fd1b415cb90 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd1b00019f0 con 0x7fd1b415cb90 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 >> v1:172.21.15.50:6789/0 conn(0x7fd1b415cb90 legacy=0x7fd1b40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1a0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a00047c0 0x7fd1a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1a0005180 0x7fd1a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40b4e90 con 0x7fd1a0003970 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a000c000 con 0x7fd1a00047c0 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a000c1c0 con 0x7fd1a0005180 2023-08-10T10:39:40.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.332+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1a0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b961e640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a00047c0 0x7fd1a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1a0005180 msgr2=0x7fd1a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1a0005180 0x7fd1a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a00047c0 msgr2=0x7fd1a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a00047c0 0x7fd1a0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/470599723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0003520 con 0x7fd1a0003970 2023-08-10T10:39:40.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.333+0000 7fd1ba620640 1 -- 172.21.15.50:0/470599723 reap_dead start 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.334+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1a0003d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000a830 tx=0x7fd1a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fade714e5865648 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.334+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0034630 con 0x7fd1a0003970 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.334+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b002f070 con 0x7fd1a0003970 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.334+0000 7fd1b8e1d640 1 -- 172.21.15.50:0/470599723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0034a30 con 0x7fd1a0003970 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 -- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 msgr2=0x7fd1a0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1a0003d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000a830 tx=0x7fd1a00057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 -- 172.21.15.50:0/470599723 shutdown_connections 2023-08-10T10:39:40.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 --2- 172.21.15.50:0/470599723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1a0003d70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 -- 172.21.15.50:0/470599723 >> 172.21.15.50:0/470599723 conn(0x7fd1b40cf640 msgr2=0x7fd1b40cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:40.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 -- 172.21.15.50:0/470599723 shutdown_connections 2023-08-10T10:39:40.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.335+0000 7fd1bc083640 1 -- 172.21.15.50:0/470599723 wait complete. 2023-08-10T10:39:40.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.337+0000 7fd1bc083640 1 Processor -- start 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.337+0000 7fd1bc083640 1 -- start start 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b414dbc0 0x7fd1b4152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 0x7fd1b40ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4152ac0 con 0x7fd1a0003970 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4153320 con 0x7fd1b414dbc0 2023-08-10T10:39:40.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1bc083640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4154f30 con 0x7fd1b4152640 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1b9e1f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1b9e1f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36256/0 (socket says 172.21.15.50:36256) 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.338+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/47179569 learned_addr learned my addr 172.21.15.50:0/47179569 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b961e640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b414dbc0 0x7fd1b4152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1ba620640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 0x7fd1b40ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 msgr2=0x7fd1b40ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 0x7fd1b40ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b414dbc0 msgr2=0x7fd1b4152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b414dbc0 0x7fd1b4152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 -- 172.21.15.50:0/47179569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b41519c0 con 0x7fd1a0003970 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1ba620640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 0x7fd1b40ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.339+0000 7fd1b9e1f640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000a950 tx=0x7fd1b0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.340+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0004e20 con 0x7fd1a0003970 2023-08-10T10:39:40.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.340+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0034430 con 0x7fd1a0003970 2023-08-10T10:39:40.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.340+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00347a0 con 0x7fd1a0003970 2023-08-10T10:39:40.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.340+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4151ca0 con 0x7fd1a0003970 2023-08-10T10:39:40.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.340+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b4152fb0 con 0x7fd1a0003970 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.341+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b4152a20 con 0x7fd1a0003970 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.342+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1b0031030 con 0x7fd1a0003970 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.343+0000 7fd1aa7fc640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 0x7fd19806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.343+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd1b00ab490 con 0x7fd1a0003970 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.343+0000 7fd1b961e640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 0x7fd19806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:40.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.344+0000 7fd1b961e640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 0x7fd19806d110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40cc1b0 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:40.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.348+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd1b0076500 con 0x7fd1a0003970 2023-08-10T10:39:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:40.576+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd1b4152a20 con 0x7fd1a0003970 2023-08-10T10:39:41.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.144+0000 7fd1aa7fc640 1 -- 172.21.15.50:0/47179569 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd1b0079b20 con 0x7fd1a0003970 2023-08-10T10:39:41.145 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 5 and data pool 6 2023-08-10T10:39:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.148+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 msgr2=0x7fd19806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.148+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 0x7fd19806d110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40cc1b0 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-08-10T10:39:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.148+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 msgr2=0x7fd1b41549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.148+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000a950 tx=0x7fd1b0001d80 comp rx=0 tx=0).stop 2023-08-10T10:39:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.148+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 shutdown_connections 2023-08-10T10:39:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b4152640 0x7fd1b40ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd19806ac50 0x7fd19806d110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b414dbc0 0x7fd1b4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 --2- 172.21.15.50:0/47179569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0003970 0x7fd1b41549f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 >> 172.21.15.50:0/47179569 conn(0x7fd1b40cf640 msgr2=0x7fd1b40c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:41.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 shutdown_connections 2023-08-10T10:39:41.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.149+0000 7fd1bc083640 1 -- 172.21.15.50:0/47179569 wait complete. 2023-08-10T10:39:41.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:41.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.376+0000 7ff8fb2fb640 1 Processor -- start 2023-08-10T10:39:41.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.377+0000 7ff8fb2fb640 1 -- start start 2023-08-10T10:39:41.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.378+0000 7ff8fb2fb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f4071450 0x7ff8f40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.378+0000 7ff8fb2fb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 0x7ff8f40cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.378+0000 7ff8fb2fb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40ce200 con 0x7ff8f406e550 2023-08-10T10:39:41.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.378+0000 7ff8fb2fb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f415bb30 con 0x7ff8f4071450 2023-08-10T10:39:41.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.378+0000 7ff8fb2fb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f415aeb0 con 0x7ff8f40cbc20 2023-08-10T10:39:41.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f4071450 0x7ff8f40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f4071450 0x7ff8f40718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36272/0 (socket says 172.21.15.50:36272) 2023-08-10T10:39:41.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 -- 172.21.15.50:0/2429407768 learned_addr learned my addr 172.21.15.50:0/2429407768 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8faafa640 1 --2- 172.21.15.50:0/2429407768 >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 0x7ff8f40cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 -- 172.21.15.50:0/2429407768 >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 msgr2=0x7ff8f40cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 --2- 172.21.15.50:0/2429407768 >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 0x7ff8f40cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 -- 172.21.15.50:0/2429407768 >> v1:172.21.15.117:6789/0 conn(0x7ff8f406e550 legacy=0x7ff8f406e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8f9af8640 1 -- 172.21.15.50:0/2429407768 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f415b190 con 0x7ff8f4071450 2023-08-10T10:39:41.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.379+0000 7ff8faafa640 1 --2- 172.21.15.50:0/2429407768 >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 0x7ff8f40cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:41.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.380+0000 7ff8f9af8640 1 --2- 172.21.15.50:0/2429407768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4071450 0x7ff8f40718d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40c7450 tx=0x7ff8e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a2fc7edc526405 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.381+0000 7ff8f92f7640 1 -- 172.21.15.50:0/2429407768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4031870 con 0x7ff8f4071450 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.381+0000 7ff8f92f7640 1 -- 172.21.15.50:0/2429407768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40319d0 con 0x7ff8f4071450 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.381+0000 7ff8f92f7640 1 -- 172.21.15.50:0/2429407768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4031d60 con 0x7ff8f4071450 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.381+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/2429407768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4071450 msgr2=0x7ff8f40718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.381+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/2429407768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4071450 0x7ff8f40718d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40c7450 tx=0x7ff8e402b910 comp rx=0 tx=0).stop 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/2429407768 shutdown_connections 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/2429407768 >> v2:172.21.15.117:3300/0 conn(0x7ff8f40cbc20 0x7ff8f40cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/2429407768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4071450 0x7ff8f40718d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/2429407768 >> 172.21.15.50:0/2429407768 conn(0x7ff8f40d0630 msgr2=0x7ff8f40d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:41.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/2429407768 shutdown_connections 2023-08-10T10:39:41.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.382+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/2429407768 wait complete. 2023-08-10T10:39:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.384+0000 7ff8fb2fb640 1 Processor -- start 2023-08-10T10:39:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.384+0000 7ff8fb2fb640 1 -- start start 2023-08-10T10:39:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f406e550 0x7ff8f415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4071450 0x7ff8f40c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40c6f90 con 0x7ff8f40cbc20 2023-08-10T10:39:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40c6410 con 0x7ff8f4071450 2023-08-10T10:39:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fb2fb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40c66f0 con 0x7ff8f406e550 2023-08-10T10:39:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8faafa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8faafa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36278/0 (socket says 172.21.15.50:36278) 2023-08-10T10:39:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8faafa640 1 -- 172.21.15.50:0/3659917780 learned_addr learned my addr 172.21.15.50:0/3659917780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8f9af8640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4071450 0x7ff8f40c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.385+0000 7ff8fa2f9640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f406e550 0x7ff8f415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 -- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f406e550 msgr2=0x7ff8f415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f406e550 0x7ff8f415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 -- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4071450 msgr2=0x7ff8f40c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4071450 0x7ff8f40c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 -- 172.21.15.50:0/3659917780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40094d0 con 0x7ff8f40cbc20 2023-08-10T10:39:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8faafa640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c7f0 tx=0x7ff8ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec007820 con 0x7ff8f40cbc20 2023-08-10T10:39:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec007980 con 0x7ff8f40cbc20 2023-08-10T10:39:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec007d70 con 0x7ff8f40cbc20 2023-08-10T10:39:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.386+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40c69d0 con 0x7ff8f40cbc20 2023-08-10T10:39:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.387+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f40c6100 con 0x7ff8f40cbc20 2023-08-10T10:39:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.388+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4066e30 con 0x7ff8f40cbc20 2023-08-10T10:39:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.389+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8ec0113f0 con 0x7ff8f40cbc20 2023-08-10T10:39:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.389+0000 7ff8eaffd640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 0x7ff8d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.390+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8ec089820 con 0x7ff8f40cbc20 2023-08-10T10:39:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.390+0000 7ff8fa2f9640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 0x7ff8d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.390+0000 7ff8fa2f9640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 0x7ff8d806d110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009f60 tx=0x7ff8f00094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.394+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff8ec0548e0 con 0x7ff8f40cbc20 2023-08-10T10:39:41.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.588+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8f406f470 con 0x7ff8f40cbc20 2023-08-10T10:39:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.591+0000 7ff8eaffd640 1 -- 172.21.15.50:0/3659917780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7ff8ec057f00 con 0x7ff8f40cbc20 2023-08-10T10:39:41.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:41.592 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:40.578008+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:41.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.593+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 msgr2=0x7ff8d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.593+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 0x7ff8d806d110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009f60 tx=0x7ff8f00094f0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.593+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 msgr2=0x7ff8f41ed6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.593+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c7f0 tx=0x7ff8ec00ccb0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 shutdown_connections 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f40cbc20 0x7ff8f41ed6f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8d806ac50 0x7ff8d806d110 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4071450 0x7ff8f40c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 --2- 172.21.15.50:0/3659917780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8f406e550 0x7ff8f415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 >> 172.21.15.50:0/3659917780 conn(0x7ff8f40d0630 msgr2=0x7ff8f40b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:41.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 shutdown_connections 2023-08-10T10:39:41.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.594+0000 7ff8fb2fb640 1 -- 172.21.15.50:0/3659917780 wait complete. 2023-08-10T10:39:41.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:41.655 INFO:tasks.ceph.mds.b.smithi117.stderr:2023-08-10T10:39:41.655+0000 7fafbcaa3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:39:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.846+0000 7f4f2d396640 1 Processor -- start 2023-08-10T10:39:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.846+0000 7f4f2d396640 1 -- start start 2023-08-10T10:39:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f2d396640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 0x7f4f280cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f2d396640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f280cddb0 0x7f4f280d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f2d396640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f28161180 con 0x7f4f2815cd60 2023-08-10T10:39:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f2d396640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280ce240 con 0x7f4f280cddb0 2023-08-10T10:39:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f2d396640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b5bd0 con 0x7f4f280b8430 2023-08-10T10:39:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 0x7f4f280cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.848+0000 7f4f277fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f280cddb0 0x7f4f280d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 0x7f4f280cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:42016/0 (socket says 172.21.15.50:42016) 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f277fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f280cddb0 0x7f4f280d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:51056/0 (socket says 172.21.15.50:51056) 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f267fc640 1 -- 172.21.15.50:0/218509417 learned_addr learned my addr 172.21.15.50:0/218509417 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f277fe640 1 -- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 msgr2=0x7f4f280cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f277fe640 1 --2- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 0x7f4f280cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f277fe640 1 -- 172.21.15.50:0/218509417 >> v1:172.21.15.117:6789/0 conn(0x7f4f2815cd60 legacy=0x7f4f28160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.849+0000 7f4f277fe640 1 -- 172.21.15.50:0/218509417 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28161460 con 0x7f4f280cddb0 2023-08-10T10:39:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.850+0000 7f4f277fe640 1 --2- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f280cddb0 0x7f4f280d1400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f2002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce04bd58fa46aa8a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.851+0000 7f4f25ffb640 1 -- 172.21.15.50:0/218509417 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20030800 con 0x7f4f280cddb0 2023-08-10T10:39:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.851+0000 7f4f25ffb640 1 -- 172.21.15.50:0/218509417 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20030960 con 0x7f4f280cddb0 2023-08-10T10:39:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.851+0000 7f4f25ffb640 1 -- 172.21.15.50:0/218509417 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20030cf0 con 0x7f4f280cddb0 2023-08-10T10:39:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 -- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f280cddb0 msgr2=0x7f4f280d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 --2- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f280cddb0 0x7f4f280d1400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097a0 tx=0x7f4f2002b940 comp rx=0 tx=0).stop 2023-08-10T10:39:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 -- 172.21.15.50:0/218509417 shutdown_connections 2023-08-10T10:39:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 --2- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f280cddb0 0x7f4f280d1400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 --2- 172.21.15.50:0/218509417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280b8430 0x7f4f280cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 -- 172.21.15.50:0/218509417 >> 172.21.15.50:0/218509417 conn(0x7f4f280d2ac0 msgr2=0x7f4f280d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 -- 172.21.15.50:0/218509417 shutdown_connections 2023-08-10T10:39:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.852+0000 7f4f2d396640 1 -- 172.21.15.50:0/218509417 wait complete. 2023-08-10T10:39:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.854+0000 7f4f2d396640 1 Processor -- start 2023-08-10T10:39:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.854+0000 7f4f2d396640 1 -- start start 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280cddb0 0x7f4f280b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2815cd60 0x7f4f28148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280ca540 con 0x7f4f280b8430 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280ccd00 con 0x7f4f2815cd60 2023-08-10T10:39:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.855+0000 7f4f2d396640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280cc110 con 0x7f4f280cddb0 2023-08-10T10:39:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36288/0 (socket says 172.21.15.50:36288) 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 -- 172.21.15.50:0/3510031905 learned_addr learned my addr 172.21.15.50:0/3510031905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f277fe640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2815cd60 0x7f4f28148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f267fc640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280cddb0 0x7f4f280b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 -- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280cddb0 msgr2=0x7f4f280b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280cddb0 0x7f4f280b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 -- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2815cd60 msgr2=0x7f4f28148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2815cd60 0x7f4f28148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.856+0000 7f4f26ffd640 1 -- 172.21.15.50:0/3510031905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009400 con 0x7f4f280b8430 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f26ffd640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c870 tx=0x7f4f1800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18003b70 con 0x7f4f280b8430 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18003cf0 con 0x7f4f280b8430 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800aa90 con 0x7f4f280b8430 2023-08-10T10:39:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280cbe40 con 0x7f4f280b8430 2023-08-10T10:39:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.857+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280cc6b0 con 0x7f4f280b8430 2023-08-10T10:39:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.859+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2806ad10 con 0x7f4f280b8430 2023-08-10T10:39:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.860+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f1800abf0 con 0x7f4f280b8430 2023-08-10T10:39:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.860+0000 7f4f1f7fe640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 0x7f4f0806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.861+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f18089410 con 0x7f4f280b8430 2023-08-10T10:39:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.861+0000 7f4f267fc640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 0x7f4f0806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.862+0000 7f4f267fc640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 0x7f4f0806d110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f2815c480 tx=0x7f4f10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:41.865+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f18054420 con 0x7f4f280b8430 2023-08-10T10:39:41.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:41.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:39:42.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.059+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f280b5830 con 0x7f4f280b8430 2023-08-10T10:39:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.061+0000 7f4f1f7fe640 1 -- 172.21.15.50:0/3510031905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f4f18003e60 con 0x7f4f280b8430 2023-08-10T10:39:42.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:42.063 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:40.578008+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 msgr2=0x7f4f0806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 0x7f4f0806d110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f2815c480 tx=0x7f4f10008040 comp rx=0 tx=0).stop 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 msgr2=0x7f4f280cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c870 tx=0x7f4f1800cd30 comp rx=0 tx=0).stop 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 shutdown_connections 2023-08-10T10:39:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f0806ac50 0x7f4f0806d110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2815cd60 0x7f4f28148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f280cddb0 0x7f4f280b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 --2- 172.21.15.50:0/3510031905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280b8430 0x7f4f280cb900 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 >> 172.21.15.50:0/3510031905 conn(0x7f4f280d2ac0 msgr2=0x7f4f280d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 shutdown_connections 2023-08-10T10:39:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.064+0000 7f4f2d396640 1 -- 172.21.15.50:0/3510031905 wait complete. 2023-08-10T10:39:42.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:39:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.305+0000 7fd6846a7640 1 Processor -- start 2023-08-10T10:39:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.305+0000 7fd6846a7640 1 -- start start 2023-08-10T10:39:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd6846a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd67c1612c0 0x7fd67c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd6846a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd6846a7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c160870 con 0x7fd67c15cbb0 2023-08-10T10:39:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd6846a7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0c9660 con 0x7fd67c1612c0 2023-08-10T10:39:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd6846a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0ca370 con 0x7fd67c0c9250 2023-08-10T10:39:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd682443640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd67c15cbb0 0x7fd67c0c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36906/0 (socket says 172.21.15.50:36906) 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd682443640 1 -- 172.21.15.50:0/2652612846 learned_addr learned my addr 172.21.15.50:0/2652612846 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd681c42640 1 --2- 172.21.15.50:0/2652612846 >> v2:172.21.15.50:3300/0 conn(0x7fd67c1612c0 0x7fd67c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd682c44640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.307+0000 7fd681441640 1 -- 172.21.15.50:0/2652612846 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784542291 0 0) 0x7fd67c160870 con 0x7fd67c15cbb0 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.308+0000 7fd681441640 1 -- 172.21.15.50:0/2652612846 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd668003520 con 0x7fd67c15cbb0 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.308+0000 7fd681c42640 1 -- 172.21.15.50:0/2652612846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 msgr2=0x7fd67c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.308+0000 7fd681c42640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c06f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.308+0000 7fd681c42640 1 -- 172.21.15.50:0/2652612846 >> v1:172.21.15.50:6789/0 conn(0x7fd67c15cbb0 legacy=0x7fd67c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.308+0000 7fd681c42640 1 -- 172.21.15.50:0/2652612846 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0ca650 con 0x7fd67c1612c0 2023-08-10T10:39:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.309+0000 7fd681c42640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c1612c0 0x7fd67c0c8d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0097a0 tx=0x7fd66c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eb462ffaed947b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.309+0000 7fd681441640 1 -- 172.21.15.50:0/2652612846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c031780 con 0x7fd67c1612c0 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.309+0000 7fd681441640 1 -- 172.21.15.50:0/2652612846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0318e0 con 0x7fd67c1612c0 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.309+0000 7fd681441640 1 -- 172.21.15.50:0/2652612846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c031c50 con 0x7fd67c1612c0 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 -- 172.21.15.50:0/2652612846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c1612c0 msgr2=0x7fd67c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c1612c0 0x7fd67c0c8d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0097a0 tx=0x7fd66c02b820 comp rx=0 tx=0).stop 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 -- 172.21.15.50:0/2652612846 shutdown_connections 2023-08-10T10:39:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c1612c0 0x7fd67c0c8d10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2652612846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c06f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 -- 172.21.15.50:0/2652612846 >> 172.21.15.50:0/2652612846 conn(0x7fd67c0b01b0 msgr2=0x7fd67c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 -- 172.21.15.50:0/2652612846 shutdown_connections 2023-08-10T10:39:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.310+0000 7fd6846a7640 1 -- 172.21.15.50:0/2652612846 wait complete. 2023-08-10T10:39:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.312+0000 7fd6846a7640 1 Processor -- start 2023-08-10T10:39:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.312+0000 7fd6846a7640 1 -- start start 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd67c1612c0 0x7fd67c1f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0c8580 con 0x7fd67c15cbb0 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0c5b00 con 0x7fd67c1612c0 2023-08-10T10:39:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd6846a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0c5de0 con 0x7fd67c0c9250 2023-08-10T10:39:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.313+0000 7fd681c42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36312/0 (socket says 172.21.15.50:36312) 2023-08-10T10:39:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 -- 172.21.15.50:0/2395886261 learned_addr learned my addr 172.21.15.50:0/2395886261 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd682c44640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd67c1612c0 0x7fd67c1f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd682443640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 -- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 msgr2=0x7fd67c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 -- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd67c1612c0 msgr2=0x7fd67c1f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd67c1612c0 0x7fd67c1f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 -- 172.21.15.50:0/2395886261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c009400 con 0x7fd67c15cbb0 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd682443640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.314+0000 7fd681c42640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0098c0 tx=0x7fd66c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.315+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c003810 con 0x7fd67c15cbb0 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.315+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c040070 con 0x7fd67c15cbb0 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.315+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c003b90 con 0x7fd67c15cbb0 2023-08-10T10:39:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.315+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c0c60c0 con 0x7fd67c15cbb0 2023-08-10T10:39:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.315+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c0c6680 con 0x7fd67c15cbb0 2023-08-10T10:39:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.316+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0c6870 con 0x7fd67c15cbb0 2023-08-10T10:39:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.317+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd66c003cf0 con 0x7fd67c15cbb0 2023-08-10T10:39:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.318+0000 7fd672ffd640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 0x7fd66006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.318+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd66c042070 con 0x7fd67c15cbb0 2023-08-10T10:39:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.318+0000 7fd682443640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 0x7fd66006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.319+0000 7fd682443640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 0x7fd66006d110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd678005880 tx=0x7fd678009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.323+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd66c076d90 con 0x7fd67c15cbb0 2023-08-10T10:39:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:42.562+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd67c160a90 con 0x7fd67c15cbb0 2023-08-10T10:39:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.148+0000 7fd672ffd640 1 -- 172.21.15.50:0/2395886261 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd66c006e10 con 0x7fd67c15cbb0 2023-08-10T10:39:43.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 msgr2=0x7fd66006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 0x7fd66006d110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd678005880 tx=0x7fd678009040 comp rx=0 tx=0).stop 2023-08-10T10:39:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 msgr2=0x7fd67c06ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0098c0 tx=0x7fd66c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 shutdown_connections 2023-08-10T10:39:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd66006ac50 0x7fd66006d110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd67c1612c0 0x7fd67c1f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd67c15cbb0 0x7fd67c06ad00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 --2- 172.21.15.50:0/2395886261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd67c0c9250 0x7fd67c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 >> 172.21.15.50:0/2395886261 conn(0x7fd67c0b01b0 msgr2=0x7fd67c0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:43.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 shutdown_connections 2023-08-10T10:39:43.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.153+0000 7fd6846a7640 1 -- 172.21.15.50:0/2395886261 wait complete. 2023-08-10T10:39:43.179 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:39:43.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:39:43.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.408+0000 7f67d4d42640 1 Processor -- start 2023-08-10T10:39:43.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.408+0000 7f67d4d42640 1 -- start start 2023-08-10T10:39:43.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67d4d42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d015ae40 0x7f67d00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67d4d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 0x7f67d00ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67d4d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d00adcb0 con 0x7f67d00cd2a0 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67d4d42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d006c320 con 0x7f67d015ae40 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67d4d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d006b770 con 0x7f67d006cb30 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d015ae40 0x7f67d00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d015ae40 0x7f67d00b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36318/0 (socket says 172.21.15.50:36318) 2023-08-10T10:39:43.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 -- 172.21.15.50:0/1196863224 learned_addr learned my addr 172.21.15.50:0/1196863224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:43.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 0x7f67d00ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 -- 172.21.15.50:0/1196863224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 msgr2=0x7f67d00ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 0x7f67d00ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.410+0000 7f67ce59c640 1 -- 172.21.15.50:0/1196863224 >> v1:172.21.15.50:6789/0 conn(0x7f67d00cd2a0 legacy=0x7f67d00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.411+0000 7f67ce59c640 1 -- 172.21.15.50:0/1196863224 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d006b9f0 con 0x7f67d015ae40 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.411+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 0x7f67d00ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.412+0000 7f67ce59c640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d015ae40 0x7f67d00b1510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009870 tx=0x7f67c002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc404ab1f108f04 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:43.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.412+0000 7f67cd59a640 1 -- 172.21.15.50:0/1196863224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0030840 con 0x7f67d015ae40 2023-08-10T10:39:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.412+0000 7f67cd59a640 1 -- 172.21.15.50:0/1196863224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c00309a0 con 0x7f67d015ae40 2023-08-10T10:39:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.412+0000 7f67cd59a640 1 -- 172.21.15.50:0/1196863224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0030d30 con 0x7f67d015ae40 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 -- 172.21.15.50:0/1196863224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d015ae40 msgr2=0x7f67d00b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d015ae40 0x7f67d00b1510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009870 tx=0x7f67c002b980 comp rx=0 tx=0).stop 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 -- 172.21.15.50:0/1196863224 shutdown_connections 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d006cb30 0x7f67d00ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1196863224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d015ae40 0x7f67d00b1510 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 -- 172.21.15.50:0/1196863224 >> 172.21.15.50:0/1196863224 conn(0x7f67d00b01b0 msgr2=0x7f67d00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 -- 172.21.15.50:0/1196863224 shutdown_connections 2023-08-10T10:39:43.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.413+0000 7f67d4d42640 1 -- 172.21.15.50:0/1196863224 wait complete. 2023-08-10T10:39:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.415+0000 7f67d4d42640 1 Processor -- start 2023-08-10T10:39:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.415+0000 7f67d4d42640 1 -- start start 2023-08-10T10:39:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 0x7f67d00c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d015ae40 0x7f67d00ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c77e0 con 0x7f67d006cb30 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d015c270 con 0x7f67d015ae40 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67d4d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c6f40 con 0x7f67d00cd2a0 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36330/0 (socket says 172.21.15.50:36330) 2023-08-10T10:39:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.416+0000 7f67ce59c640 1 -- 172.21.15.50:0/1465115739 learned_addr learned my addr 172.21.15.50:0/1465115739 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 0x7f67d00c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ced9d640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d015ae40 0x7f67d00ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 -- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 msgr2=0x7f67d00c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 0x7f67d00c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 -- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d015ae40 msgr2=0x7f67d00ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d015ae40 0x7f67d00ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 -- 172.21.15.50:0/1465115739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c00094d0 con 0x7f67d006cb30 2023-08-10T10:39:43.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 0x7f67d00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:43.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67ce59c640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f67c0000c00 tx=0x7f67c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c00307d0 con 0x7f67d006cb30 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.417+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0039d90 con 0x7f67d006cb30 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.418+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0043650 con 0x7f67d006cb30 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.418+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d00c7220 con 0x7f67d006cb30 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.418+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d015c4c0 con 0x7f67d006cb30 2023-08-10T10:39:43.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.419+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d00612b0 con 0x7f67d006cb30 2023-08-10T10:39:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.420+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67c002f390 con 0x7f67d006cb30 2023-08-10T10:39:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.421+0000 7f67beffd640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 0x7f67b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.421+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67c00ab8d0 con 0x7f67d006cb30 2023-08-10T10:39:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.421+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 0x7f67b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.422+0000 7f67cdd9b640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 0x7f67b006d110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67c4006fd0 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.425+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f67c0076a00 con 0x7f67d006cb30 2023-08-10T10:39:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:43.655+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f67d00ae330 con 0x7f67d006cb30 2023-08-10T10:39:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.170+0000 7f67beffd640 1 -- 172.21.15.50:0/1465115739 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67c007a020 con 0x7f67d006cb30 2023-08-10T10:39:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 msgr2=0x7f67b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 0x7f67b006d110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67c4006fd0 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2023-08-10T10:39:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 msgr2=0x7f67d0158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f67c0000c00 tx=0x7f67c0004730 comp rx=0 tx=0).stop 2023-08-10T10:39:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 shutdown_connections 2023-08-10T10:39:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67b006ac50 0x7f67b006d110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d015ae40 0x7f67d00ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d00cd2a0 0x7f67d00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 --2- 172.21.15.50:0/1465115739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d006cb30 0x7f67d0158e00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 >> 172.21.15.50:0/1465115739 conn(0x7f67d00b01b0 msgr2=0x7f67d00b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 shutdown_connections 2023-08-10T10:39:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.174+0000 7f67d4d42640 1 -- 172.21.15.50:0/1465115739 wait complete. 2023-08-10T10:39:44.196 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:39:44.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.428+0000 7f91a9157640 1 Processor -- start 2023-08-10T10:39:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.428+0000 7f91a9157640 1 -- start start 2023-08-10T10:39:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a9157640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a40696a0 0x7f91a4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a9157640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91a40b1ae0 0x7f91a40b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a9157640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a415e1f0 con 0x7f91a4159970 2023-08-10T10:39:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a9157640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40b10d0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a9157640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415d5e0 con 0x7f91a40696a0 2023-08-10T10:39:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f91a4159970 0x7f91a40b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36924/0 (socket says 172.21.15.50:36924) 2023-08-10T10:39:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a2d9d640 1 -- 172.21.15.50:0/187486898 learned_addr learned my addr 172.21.15.50:0/187486898 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a359e640 1 --2- 172.21.15.50:0/187486898 >> v2:172.21.15.50:3300/0 conn(0x7f91a40b1ae0 0x7f91a40b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.430+0000 7f91a259c640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a40696a0 0x7f91a4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.431+0000 7f91a359e640 1 -- 172.21.15.50:0/187486898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a40696a0 msgr2=0x7f91a4069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.431+0000 7f91a359e640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a40696a0 0x7f91a4069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.431+0000 7f91a359e640 1 -- 172.21.15.50:0/187486898 >> v1:172.21.15.50:6789/0 conn(0x7f91a4159970 legacy=0x7f91a40b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.431+0000 7f91a359e640 1 -- 172.21.15.50:0/187486898 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a406a040 con 0x7f91a40b1ae0 2023-08-10T10:39:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.431+0000 7f91a1d9b640 1 -- 172.21.15.50:0/187486898 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097414802 0 0) 0x7f91a415e1f0 con 0x7f91a4159970 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.432+0000 7f91a359e640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a40b1f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f919c009d90 tx=0x7f919c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0bf38a0317771e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.432+0000 7f91a1d9b640 1 -- 172.21.15.50:0/187486898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c02cc50 con 0x7f91a40b1ae0 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.432+0000 7f91a1d9b640 1 -- 172.21.15.50:0/187486898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c02cdb0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.432+0000 7f91a1d9b640 1 -- 172.21.15.50:0/187486898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c034660 con 0x7f91a40b1ae0 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 -- 172.21.15.50:0/187486898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 msgr2=0x7f91a40b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a40b1f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f919c009d90 tx=0x7f919c02bea0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 -- 172.21.15.50:0/187486898 shutdown_connections 2023-08-10T10:39:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a40b1f70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 --2- 172.21.15.50:0/187486898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a40696a0 0x7f91a4069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 -- 172.21.15.50:0/187486898 >> 172.21.15.50:0/187486898 conn(0x7f91a406b590 msgr2=0x7f91a40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 -- 172.21.15.50:0/187486898 shutdown_connections 2023-08-10T10:39:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.433+0000 7f91a9157640 1 -- 172.21.15.50:0/187486898 wait complete. 2023-08-10T10:39:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.435+0000 7f91a9157640 1 Processor -- start 2023-08-10T10:39:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.435+0000 7f91a9157640 1 -- start start 2023-08-10T10:39:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 0x7f91a40cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 0x7f91a40c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c43a0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4158300 con 0x7f91a40696a0 2023-08-10T10:39:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a9157640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c3720 con 0x7f91a4159970 2023-08-10T10:39:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.436+0000 7f91a259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36334/0 (socket says 172.21.15.50:36334) 2023-08-10T10:39:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 -- 172.21.15.50:0/3085945595 learned_addr learned my addr 172.21.15.50:0/3085945595 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a2d9d640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 0x7f91a40cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a359e640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 0x7f91a40c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 -- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 msgr2=0x7f91a40c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 0x7f91a40c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 -- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 msgr2=0x7f91a40cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 0x7f91a40cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 -- 172.21.15.50:0/3085945595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c009a70 con 0x7f91a40b1ae0 2023-08-10T10:39:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a359e640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 0x7f91a40c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a2d9d640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 0x7f91a40cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.437+0000 7f91a259c640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f919800d800 tx=0x7f919800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.438+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800b6c0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.438+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800b820 con 0x7f91a40b1ae0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.438+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800bbb0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.438+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a40c3a00 con 0x7f91a40b1ae0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.438+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a40c3fc0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.439+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a404e270 con 0x7f91a40b1ae0 2023-08-10T10:39:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.440+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f919800bd10 con 0x7f91a40b1ae0 2023-08-10T10:39:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.441+0000 7f918b7fe640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 0x7f919006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.441+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9198089a30 con 0x7f91a40b1ae0 2023-08-10T10:39:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.441+0000 7f91a2d9d640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 0x7f919006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.442+0000 7f91a2d9d640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 0x7f919006d110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9194000f60 tx=0x7f9194009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.445+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9198054ad0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.676+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91a40b18c0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.677+0000 7f918b7fe640 1 -- 172.21.15.50:0/3085945595 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f91980580f0 con 0x7f91a40b1ae0 2023-08-10T10:39:44.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:44.678 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:39:44.678 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 msgr2=0x7f919006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 0x7f919006d110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9194000f60 tx=0x7f9194009040 comp rx=0 tx=0).stop 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 msgr2=0x7f91a414e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f919800d800 tx=0x7f919800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 shutdown_connections 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a4159970 0x7f91a40c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91a40b1ae0 0x7f91a414e480 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f919006ac50 0x7f919006d110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 --2- 172.21.15.50:0/3085945595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a40696a0 0x7f91a40cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 >> 172.21.15.50:0/3085945595 conn(0x7f91a406b590 msgr2=0x7f91a40cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 shutdown_connections 2023-08-10T10:39:44.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.681+0000 7f91a9157640 1 -- 172.21.15.50:0/3085945595 wait complete. 2023-08-10T10:39:44.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.929+0000 7ff68540f640 1 Processor -- start 2023-08-10T10:39:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.929+0000 7ff68540f640 1 -- start start 2023-08-10T10:39:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff68540f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff6800b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff68540f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68015e1f0 con 0x7ff680069db0 2023-08-10T10:39:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff68540f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68015d5e0 con 0x7ff6800b0f00 2023-08-10T10:39:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff68540f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68015d8c0 con 0x7ff680159970 2023-08-10T10:39:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff67f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff680069db0 0x7ff6800b1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49046/0 (socket says 172.21.15.50:49046) 2023-08-10T10:39:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.931+0000 7ff67f7fe640 1 -- 172.21.15.50:0/836902177 learned_addr learned my addr 172.21.15.50:0/836902177 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67effd640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff6800b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029522317 0 0) 0x7ff68015e1f0 con 0x7ff680069db0 2023-08-10T10:39:44.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c005730 con 0x7ff680069db0 2023-08-10T10:39:44.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140206178 0 0) 0x7ff66c005730 con 0x7ff680069db0 2023-08-10T10:39:44.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 msgr2=0x7ff6800b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff6800b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 >> v1:172.21.15.117:6789/0 conn(0x7ff6800b0f00 legacy=0x7ff6800696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68015dba0 con 0x7ff680069db0 2023-08-10T10:39:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff6780019f0 con 0x7ff680069db0 2023-08-10T10:39:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 >> v1:172.21.15.50:6789/0 conn(0x7ff680069db0 legacy=0x7ff6800b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c005bb0 0x7ff66c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff66c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff66c006f10 0x7ff66c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68015d8c0 con 0x7ff66c006f10 2023-08-10T10:39:44.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c00dc40 con 0x7ff66c005bb0 2023-08-10T10:39:44.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.932+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c00de00 con 0x7ff680159970 2023-08-10T10:39:44.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff66c006f10 0x7ff66c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67effd640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c005bb0 0x7ff66c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff677fff640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff66c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 -- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 msgr2=0x7ff66c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff680159970 0x7ff66c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 -- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c005bb0 msgr2=0x7ff66c005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c005bb0 0x7ff66c005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67f7fe640 1 -- 172.21.15.50:0/836902177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c005730 con 0x7ff66c006f10 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.933+0000 7ff67effd640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c005bb0 0x7ff66c005fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.934+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff66c006f10 0x7ff66c007390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff680071e50 tx=0x7ff66c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80862dd9d074a33 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780072d0 con 0x7ff66c006f10 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67802f070 con 0x7ff66c006f10 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff67e7fc640 1 -- 172.21.15.50:0/836902177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780076b0 con 0x7ff66c006f10 2023-08-10T10:39:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff68540f640 1 -- 172.21.15.50:0/836902177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff66c006f10 msgr2=0x7ff66c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff68540f640 1 --2- 172.21.15.50:0/836902177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff66c006f10 0x7ff66c007390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff680071e50 tx=0x7ff66c007a00 comp rx=0 tx=0).stop 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff67f7fe640 1 -- 172.21.15.50:0/836902177 reap_dead start 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff68540f640 1 -- 172.21.15.50:0/836902177 shutdown_connections 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.935+0000 7ff68540f640 1 -- 172.21.15.50:0/836902177 >> 172.21.15.50:0/836902177 conn(0x7ff68006b590 msgr2=0x7ff6800ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.936+0000 7ff68540f640 1 -- 172.21.15.50:0/836902177 shutdown_connections 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.936+0000 7ff68540f640 1 -- 172.21.15.50:0/836902177 wait complete. 2023-08-10T10:39:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.937+0000 7ff68540f640 1 Processor -- start 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.938+0000 7ff68540f640 1 -- start start 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.938+0000 7ff68540f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c006f10 0x7ff6801f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff68540f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6801f3840 0x7ff68015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff68540f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff68540f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff680156d80 con 0x7ff68015c710 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff68540f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68015cc90 con 0x7ff66c006f10 2023-08-10T10:39:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff68540f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68015cf70 con 0x7ff6801f3840 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42132/0 (socket says 172.21.15.50:42132) 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 -- 172.21.15.50:0/2834212672 learned_addr learned my addr 172.21.15.50:0/2834212672 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff677fff640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6801f3840 0x7ff68015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67effd640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c006f10 0x7ff6801f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 -- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6801f3840 msgr2=0x7ff68015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6801f3840 0x7ff68015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 -- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c006f10 msgr2=0x7ff6801f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c006f10 0x7ff6801f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.939+0000 7ff67f7fe640 1 -- 172.21.15.50:0/2834212672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680156730 con 0x7ff68015c710 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff67f7fe640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff678000f80 tx=0x7ff678001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678042070 con 0x7ff68015c710 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678001250 con 0x7ff68015c710 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678004d60 con 0x7ff68015c710 2023-08-10T10:39:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff680156a10 con 0x7ff68015c710 2023-08-10T10:39:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.940+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6801f6a50 con 0x7ff68015c710 2023-08-10T10:39:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.941+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68004e270 con 0x7ff68015c710 2023-08-10T10:39:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.942+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff678031030 con 0x7ff68015c710 2023-08-10T10:39:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.944+0000 7ff6777fe640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 0x7ff66006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.944+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6780aaa60 con 0x7ff68015c710 2023-08-10T10:39:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.944+0000 7ff67effd640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 0x7ff66006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.945+0000 7ff67effd640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 0x7ff66006d140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6800710e0 tx=0x7ff670008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:44.949+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff678075a70 con 0x7ff68015c710 2023-08-10T10:39:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.134+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff68004e270 con 0x7ff68015c710 2023-08-10T10:39:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.137+0000 7ff6777fe640 1 -- 172.21.15.50:0/2834212672 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7ff678079090 con 0x7ff68015c710 2023-08-10T10:39:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:45.139 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:42.104228+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 msgr2=0x7ff66006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 0x7ff66006d140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6800710e0 tx=0x7ff670008040 comp rx=0 tx=0).stop 2023-08-10T10:39:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 msgr2=0x7ff6801f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff678000f80 tx=0x7ff678001d80 comp rx=0 tx=0).stop 2023-08-10T10:39:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 shutdown_connections 2023-08-10T10:39:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68015c710 0x7ff6801f5d20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6801f3840 0x7ff68015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff66006ac80 0x7ff66006d140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 --2- 172.21.15.50:0/2834212672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff66c006f10 0x7ff6801f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 >> 172.21.15.50:0/2834212672 conn(0x7ff68006b590 msgr2=0x7ff6800b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 shutdown_connections 2023-08-10T10:39:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.140+0000 7ff68540f640 1 -- 172.21.15.50:0/2834212672 wait complete. 2023-08-10T10:39:45.158 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:39:45.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:39:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.382+0000 7f3bb3fff640 1 Processor -- start 2023-08-10T10:39:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.382+0000 7f3bb3fff640 1 -- start start 2023-08-10T10:39:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.383+0000 7f3bb3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3bb415a940 0x7f3bb40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.383+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3bb40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.383+0000 7f3bb3fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40b1f10 con 0x7f3bb40b12c0 2023-08-10T10:39:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.383+0000 7f3bb3fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40b21f0 con 0x7f3bb415a940 2023-08-10T10:39:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.383+0000 7f3bb3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb415e5c0 con 0x7f3bb415f2b0 2023-08-10T10:39:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bb40b12c0 0x7f3bb40b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49056/0 (socket says 172.21.15.50:49056) 2023-08-10T10:39:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb37fe640 1 -- 172.21.15.50:0/253913871 learned_addr learned my addr 172.21.15.50:0/253913871 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb27fc640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3bb40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415a940 0x7f3bb40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188064216 0 0) 0x7f3bb40b1f10 con 0x7f3bb40b12c0 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.384+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba0003520 con 0x7f3bb40b12c0 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184998520 0 0) 0x7f3ba0003520 con 0x7f3bb40b12c0 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 msgr2=0x7f3bb40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3bb40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415a940 msgr2=0x7f3bb40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 --2- 172.21.15.50:0/253913871 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415a940 0x7f3bb40aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb415e7d0 con 0x7f3bb40b12c0 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3bac001690 con 0x7f3bb40b12c0 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 >> v1:172.21.15.50:6789/0 conn(0x7f3bb40b12c0 legacy=0x7f3bb40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3ba0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba00047c0 0x7f3ba0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3ba0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb415e5c0 con 0x7f3ba00039e0 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba000ba60 con 0x7f3ba00047c0 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba000bc20 con 0x7f3bb415f2b0 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415a940 0x7f3bb40aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3ba0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb27fc640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba00047c0 0x7f3ba0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.385+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3ba0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.386+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 msgr2=0x7f3ba0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.386+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb415f2b0 0x7f3ba0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.386+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba00047c0 msgr2=0x7f3ba0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.386+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba00047c0 0x7f3ba0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.386+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/253913871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0003520 con 0x7f3ba00039e0 2023-08-10T10:39:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.387+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3ba0003e00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006fd0 tx=0x7f3ba00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e5bbfa859ae18a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.387+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4030660 con 0x7f3ba00039e0 2023-08-10T10:39:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.387+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba40307c0 con 0x7f3ba00039e0 2023-08-10T10:39:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.387+0000 7f3bb1ffb640 1 -- 172.21.15.50:0/253913871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4030b30 con 0x7f3ba00039e0 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 -- 172.21.15.50:0/253913871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 msgr2=0x7f3ba0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/253913871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3ba0003e00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006fd0 tx=0x7f3ba00057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb37fe640 1 -- 172.21.15.50:0/253913871 reap_dead start 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 -- 172.21.15.50:0/253913871 shutdown_connections 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 -- 172.21.15.50:0/253913871 >> 172.21.15.50:0/253913871 conn(0x7f3bb406ab80 msgr2=0x7f3bb406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:45.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 -- 172.21.15.50:0/253913871 shutdown_connections 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.388+0000 7f3bb3fff640 1 -- 172.21.15.50:0/253913871 wait complete. 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.390+0000 7f3bb3fff640 1 Processor -- start 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.390+0000 7f3bb3fff640 1 -- start start 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb4158800 0x7f3bb40c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb40c5dc0 0x7f3bb40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40c8780 con 0x7f3ba00039e0 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40ad150 con 0x7f3bb40c5dc0 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40ad430 con 0x7f3bb4158800 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42138/0 (socket says 172.21.15.50:42138) 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/1563944909 learned_addr learned my addr 172.21.15.50:0/1563944909 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb27fc640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb4158800 0x7f3bb40c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb40c5dc0 0x7f3bb40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb4158800 msgr2=0x7f3bb40c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb4158800 0x7f3bb40c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb40c5dc0 msgr2=0x7f3bb40c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb40c5dc0 0x7f3bb40c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.391+0000 7f3bb2ffd640 1 -- 172.21.15.50:0/1563944909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40ad710 con 0x7f3ba00039e0 2023-08-10T10:39:45.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bb2ffd640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3ba402bef0 tx=0x7f3ba4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4039a60 con 0x7f3ba00039e0 2023-08-10T10:39:45.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba403f040 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4039de0 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb40ad9f0 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.392+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb41f31a0 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.393+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4066e30 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.394+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ba404c400 con 0x7f3ba00039e0 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.395+0000 7f3bab7fe640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 0x7f3b9406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.395+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ba40abb30 con 0x7f3ba00039e0 2023-08-10T10:39:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.396+0000 7f3bb27fc640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 0x7f3b9406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.396+0000 7f3bb27fc640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 0x7f3b9406d140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406b5b0 tx=0x7f3b9c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.399+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3ba4076b40 con 0x7f3ba00039e0 2023-08-10T10:39:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.583+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bb415ed90 con 0x7f3b9406ac80 2023-08-10T10:39:45.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.611+0000 7f3bab7fe640 1 -- 172.21.15.50:0/1563944909 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302950 (secure 0 0 0) 0x7f3b9c00f040 con 0x7f3b9406ac80 2023-08-10T10:39:45.615 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:45.616 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:39:45.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 msgr2=0x7f3b9406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 0x7f3b9406d140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406b5b0 tx=0x7f3b9c00b040 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 msgr2=0x7f3bb40c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3ba402bef0 tx=0x7f3ba4004730 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 shutdown_connections 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9406ac80 0x7f3b9406d140 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb40c5dc0 0x7f3bb40c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb4158800 0x7f3bb40c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1563944909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba00039e0 0x7f3bb40c7d00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 >> 172.21.15.50:0/1563944909 conn(0x7f3bb406ab80 msgr2=0x7f3bb40c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:45.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 shutdown_connections 2023-08-10T10:39:45.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.617+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1563944909 wait complete. 2023-08-10T10:39:45.637 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-08-10T10:39:44.345383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559994,"statfs":{"total":1600000000,"available":1597434713,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.280297"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108925+0000","last_change":"2023-08-10T10:39:41.132323+0000","last_active":"2023-08-10T10:39:42.108925+0000","last_peered":"2023-08-10T10:39:42.108925+0000","last_clean":"2023-08-10T10:39:42.108925+0000","last_became_active":"2023-08-10T10:39:41.131787+0000","last_became_peered":"2023-08-10T10:39:41.131787+0000","last_unstale":"2023-08-10T10:39:42.108925+0000","last_undegraded":"2023-08-10T10:39:42.108925+0000","last_fullsized":"2023-08-10T10:39:42.108925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:01:07.595013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109580+0000","last_change":"2023-08-10T10:39:41.141871+0000","last_active":"2023-08-10T10:39:42.109580+0000","last_peered":"2023-08-10T10:39:42.109580+0000","last_clean":"2023-08-10T10:39:42.109580+0000","last_became_active":"2023-08-10T10:39:41.140196+0000","last_became_peered":"2023-08-10T10:39:41.140196+0000","last_unstale":"2023-08-10T10:39:42.109580+0000","last_undegraded":"2023-08-10T10:39:42.109580+0000","last_fullsized":"2023-08-10T10:39:42.109580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:09.111602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110024+0000","last_change":"2023-08-10T10:39:41.131095+0000","last_active":"2023-08-10T10:39:42.110024+0000","last_peered":"2023-08-10T10:39:42.110024+0000","last_clean":"2023-08-10T10:39:42.110024+0000","last_became_active":"2023-08-10T10:39:41.130741+0000","last_became_peered":"2023-08-10T10:39:41.130741+0000","last_unstale":"2023-08-10T10:39:42.110024+0000","last_undegraded":"2023-08-10T10:39:42.110024+0000","last_fullsized":"2023-08-10T10:39:42.110024+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:24:05.551593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110835+0000","last_change":"2023-08-10T10:39:41.141073+0000","last_active":"2023-08-10T10:39:42.110835+0000","last_peered":"2023-08-10T10:39:42.110835+0000","last_clean":"2023-08-10T10:39:42.110835+0000","last_became_active":"2023-08-10T10:39:41.139449+0000","last_became_peered":"2023-08-10T10:39:41.139449+0000","last_unstale":"2023-08-10T10:39:42.110835+0000","last_undegraded":"2023-08-10T10:39:42.110835+0000","last_fullsized":"2023-08-10T10:39:42.110835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:25.596002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111449+0000","last_change":"2023-08-10T10:39:41.134708+0000","last_active":"2023-08-10T10:39:42.111449+0000","last_peered":"2023-08-10T10:39:42.111449+0000","last_clean":"2023-08-10T10:39:42.111449+0000","last_became_active":"2023-08-10T10:39:41.134393+0000","last_became_peered":"2023-08-10T10:39:41.134393+0000","last_unstale":"2023-08-10T10:39:42.111449+0000","last_undegraded":"2023-08-10T10:39:42.111449+0000","last_fullsized":"2023-08-10T10:39:42.111449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:13.729558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854335+0000","last_change":"2023-08-10T10:39:41.121982+0000","last_active":"2023-08-10T10:39:42.854335+0000","last_peered":"2023-08-10T10:39:42.854335+0000","last_clean":"2023-08-10T10:39:42.854335+0000","last_became_active":"2023-08-10T10:39:41.121208+0000","last_became_peered":"2023-08-10T10:39:41.121208+0000","last_unstale":"2023-08-10T10:39:42.854335+0000","last_undegraded":"2023-08-10T10:39:42.854335+0000","last_fullsized":"2023-08-10T10:39:42.854335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:41.504604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.042856+0000","last_change":"2023-08-10T10:39:41.139500+0000","last_active":"2023-08-10T10:39:43.042856+0000","last_peered":"2023-08-10T10:39:43.042856+0000","last_clean":"2023-08-10T10:39:43.042856+0000","last_became_active":"2023-08-10T10:39:41.139315+0000","last_became_peered":"2023-08-10T10:39:41.139315+0000","last_unstale":"2023-08-10T10:39:43.042856+0000","last_undegraded":"2023-08-10T10:39:43.042856+0000","last_fullsized":"2023-08-10T10:39:43.042856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:29.688301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108626+0000","last_change":"2023-08-10T10:39:41.138206+0000","last_active":"2023-08-10T10:39:42.108626+0000","last_peered":"2023-08-10T10:39:42.108626+0000","last_clean":"2023-08-10T10:39:42.108626+0000","last_became_active":"2023-08-10T10:39:41.133198+0000","last_became_peered":"2023-08-10T10:39:41.133198+0000","last_unstale":"2023-08-10T10:39:42.108626+0000","last_undegraded":"2023-08-10T10:39:42.108626+0000","last_fullsized":"2023-08-10T10:39:42.108626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:13.281657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109899+0000","last_change":"2023-08-10T10:39:41.131947+0000","last_active":"2023-08-10T10:39:42.109899+0000","last_peered":"2023-08-10T10:39:42.109899+0000","last_clean":"2023-08-10T10:39:42.109899+0000","last_became_active":"2023-08-10T10:39:41.131581+0000","last_became_peered":"2023-08-10T10:39:41.131581+0000","last_unstale":"2023-08-10T10:39:42.109899+0000","last_undegraded":"2023-08-10T10:39:42.109899+0000","last_fullsized":"2023-08-10T10:39:42.109899+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:46.512302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043198+0000","last_change":"2023-08-10T10:39:41.132453+0000","last_active":"2023-08-10T10:39:43.043198+0000","last_peered":"2023-08-10T10:39:43.043198+0000","last_clean":"2023-08-10T10:39:43.043198+0000","last_became_active":"2023-08-10T10:39:41.132154+0000","last_became_peered":"2023-08-10T10:39:41.132154+0000","last_unstale":"2023-08-10T10:39:43.043198+0000","last_undegraded":"2023-08-10T10:39:43.043198+0000","last_fullsized":"2023-08-10T10:39:43.043198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:46.634315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043228+0000","last_change":"2023-08-10T10:39:41.126168+0000","last_active":"2023-08-10T10:39:43.043228+0000","last_peered":"2023-08-10T10:39:43.043228+0000","last_clean":"2023-08-10T10:39:43.043228+0000","last_became_active":"2023-08-10T10:39:41.125523+0000","last_became_peered":"2023-08-10T10:39:41.125523+0000","last_unstale":"2023-08-10T10:39:43.043228+0000","last_undegraded":"2023-08-10T10:39:43.043228+0000","last_fullsized":"2023-08-10T10:39:43.043228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:55.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110378+0000","last_change":"2023-08-10T10:39:41.136319+0000","last_active":"2023-08-10T10:39:42.110378+0000","last_peered":"2023-08-10T10:39:42.110378+0000","last_clean":"2023-08-10T10:39:42.110378+0000","last_became_active":"2023-08-10T10:39:41.136046+0000","last_became_peered":"2023-08-10T10:39:41.136046+0000","last_unstale":"2023-08-10T10:39:42.110378+0000","last_undegraded":"2023-08-10T10:39:42.110378+0000","last_fullsized":"2023-08-10T10:39:42.110378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:46:17.120921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043570+0000","last_change":"2023-08-10T10:39:41.135860+0000","last_active":"2023-08-10T10:39:43.043570+0000","last_peered":"2023-08-10T10:39:43.043570+0000","last_clean":"2023-08-10T10:39:43.043570+0000","last_became_active":"2023-08-10T10:39:41.132922+0000","last_became_peered":"2023-08-10T10:39:41.132922+0000","last_unstale":"2023-08-10T10:39:43.043570+0000","last_undegraded":"2023-08-10T10:39:43.043570+0000","last_fullsized":"2023-08-10T10:39:43.043570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:40.775578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855834+0000","last_change":"2023-08-10T10:39:41.121729+0000","last_active":"2023-08-10T10:39:42.855834+0000","last_peered":"2023-08-10T10:39:42.855834+0000","last_clean":"2023-08-10T10:39:42.855834+0000","last_became_active":"2023-08-10T10:39:41.120763+0000","last_became_peered":"2023-08-10T10:39:41.120763+0000","last_unstale":"2023-08-10T10:39:42.855834+0000","last_undegraded":"2023-08-10T10:39:42.855834+0000","last_fullsized":"2023-08-10T10:39:42.855834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:55.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043402+0000","last_change":"2023-08-10T10:39:41.131736+0000","last_active":"2023-08-10T10:39:43.043402+0000","last_peered":"2023-08-10T10:39:43.043402+0000","last_clean":"2023-08-10T10:39:43.043402+0000","last_became_active":"2023-08-10T10:39:41.131432+0000","last_became_peered":"2023-08-10T10:39:41.131432+0000","last_unstale":"2023-08-10T10:39:43.043402+0000","last_undegraded":"2023-08-10T10:39:43.043402+0000","last_fullsized":"2023-08-10T10:39:43.043402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:41:52.724087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856455+0000","last_change":"2023-08-10T10:39:41.131917+0000","last_active":"2023-08-10T10:39:42.856455+0000","last_peered":"2023-08-10T10:39:42.856455+0000","last_clean":"2023-08-10T10:39:42.856455+0000","last_became_active":"2023-08-10T10:39:41.131309+0000","last_became_peered":"2023-08-10T10:39:41.131309+0000","last_unstale":"2023-08-10T10:39:42.856455+0000","last_undegraded":"2023-08-10T10:39:42.856455+0000","last_fullsized":"2023-08-10T10:39:42.856455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857043+0000","last_change":"2023-08-10T10:39:41.134130+0000","last_active":"2023-08-10T10:39:42.857043+0000","last_peered":"2023-08-10T10:39:42.857043+0000","last_clean":"2023-08-10T10:39:42.857043+0000","last_became_active":"2023-08-10T10:39:41.133846+0000","last_became_peered":"2023-08-10T10:39:41.133846+0000","last_unstale":"2023-08-10T10:39:42.857043+0000","last_undegraded":"2023-08-10T10:39:42.857043+0000","last_fullsized":"2023-08-10T10:39:42.857043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:13.993598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855689+0000","last_change":"2023-08-10T10:39:41.119799+0000","last_active":"2023-08-10T10:39:42.855689+0000","last_peered":"2023-08-10T10:39:42.855689+0000","last_clean":"2023-08-10T10:39:42.855689+0000","last_became_active":"2023-08-10T10:39:41.119066+0000","last_became_peered":"2023-08-10T10:39:41.119066+0000","last_unstale":"2023-08-10T10:39:42.855689+0000","last_undegraded":"2023-08-10T10:39:42.855689+0000","last_fullsized":"2023-08-10T10:39:42.855689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:50.561005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110967+0000","last_change":"2023-08-10T10:39:41.141636+0000","last_active":"2023-08-10T10:39:42.110967+0000","last_peered":"2023-08-10T10:39:42.110967+0000","last_clean":"2023-08-10T10:39:42.110967+0000","last_became_active":"2023-08-10T10:39:41.140633+0000","last_became_peered":"2023-08-10T10:39:41.140633+0000","last_unstale":"2023-08-10T10:39:42.110967+0000","last_undegraded":"2023-08-10T10:39:42.110967+0000","last_fullsized":"2023-08-10T10:39:42.110967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:13.736833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858330+0000","last_change":"2023-08-10T10:39:41.125931+0000","last_active":"2023-08-10T10:39:42.858330+0000","last_peered":"2023-08-10T10:39:42.858330+0000","last_clean":"2023-08-10T10:39:42.858330+0000","last_became_active":"2023-08-10T10:39:41.125538+0000","last_became_peered":"2023-08-10T10:39:41.125538+0000","last_unstale":"2023-08-10T10:39:42.858330+0000","last_undegraded":"2023-08-10T10:39:42.858330+0000","last_fullsized":"2023-08-10T10:39:42.858330+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:27.832635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043556+0000","last_change":"2023-08-10T10:39:41.137148+0000","last_active":"2023-08-10T10:39:43.043556+0000","last_peered":"2023-08-10T10:39:43.043556+0000","last_clean":"2023-08-10T10:39:43.043556+0000","last_became_active":"2023-08-10T10:39:41.136421+0000","last_became_peered":"2023-08-10T10:39:41.136421+0000","last_unstale":"2023-08-10T10:39:43.043556+0000","last_undegraded":"2023-08-10T10:39:43.043556+0000","last_fullsized":"2023-08-10T10:39:43.043556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856943+0000","last_change":"2023-08-10T10:39:41.134239+0000","last_active":"2023-08-10T10:39:42.856943+0000","last_peered":"2023-08-10T10:39:42.856943+0000","last_clean":"2023-08-10T10:39:42.856943+0000","last_became_active":"2023-08-10T10:39:41.133976+0000","last_became_peered":"2023-08-10T10:39:41.133976+0000","last_unstale":"2023-08-10T10:39:42.856943+0000","last_undegraded":"2023-08-10T10:39:42.856943+0000","last_fullsized":"2023-08-10T10:39:42.856943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858651+0000","last_change":"2023-08-10T10:39:41.133842+0000","last_active":"2023-08-10T10:39:42.858651+0000","last_peered":"2023-08-10T10:39:42.858651+0000","last_clean":"2023-08-10T10:39:42.858651+0000","last_became_active":"2023-08-10T10:39:41.132429+0000","last_became_peered":"2023-08-10T10:39:41.132429+0000","last_unstale":"2023-08-10T10:39:42.858651+0000","last_undegraded":"2023-08-10T10:39:42.858651+0000","last_fullsized":"2023-08-10T10:39:42.858651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:48.465218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111109+0000","last_change":"2023-08-10T10:39:41.141246+0000","last_active":"2023-08-10T10:39:42.111109+0000","last_peered":"2023-08-10T10:39:42.111109+0000","last_clean":"2023-08-10T10:39:42.111109+0000","last_became_active":"2023-08-10T10:39:41.139865+0000","last_became_peered":"2023-08-10T10:39:41.139865+0000","last_unstale":"2023-08-10T10:39:42.111109+0000","last_undegraded":"2023-08-10T10:39:42.111109+0000","last_fullsized":"2023-08-10T10:39:42.111109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:02.665640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857997+0000","last_change":"2023-08-10T10:39:41.137343+0000","last_active":"2023-08-10T10:39:42.857997+0000","last_peered":"2023-08-10T10:39:42.857997+0000","last_clean":"2023-08-10T10:39:42.857997+0000","last_became_active":"2023-08-10T10:39:41.137060+0000","last_became_peered":"2023-08-10T10:39:41.137060+0000","last_unstale":"2023-08-10T10:39:42.857997+0000","last_undegraded":"2023-08-10T10:39:42.857997+0000","last_fullsized":"2023-08-10T10:39:42.857997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:35.273156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854922+0000","last_change":"2023-08-10T10:39:41.131888+0000","last_active":"2023-08-10T10:39:42.854922+0000","last_peered":"2023-08-10T10:39:42.854922+0000","last_clean":"2023-08-10T10:39:42.854922+0000","last_became_active":"2023-08-10T10:39:41.131115+0000","last_became_peered":"2023-08-10T10:39:41.131115+0000","last_unstale":"2023-08-10T10:39:42.854922+0000","last_undegraded":"2023-08-10T10:39:42.854922+0000","last_fullsized":"2023-08-10T10:39:42.854922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:01.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855439+0000","last_change":"2023-08-10T10:39:41.134853+0000","last_active":"2023-08-10T10:39:42.855439+0000","last_peered":"2023-08-10T10:39:42.855439+0000","last_clean":"2023-08-10T10:39:42.855439+0000","last_became_active":"2023-08-10T10:39:41.134519+0000","last_became_peered":"2023-08-10T10:39:41.134519+0000","last_unstale":"2023-08-10T10:39:42.855439+0000","last_undegraded":"2023-08-10T10:39:42.855439+0000","last_fullsized":"2023-08-10T10:39:42.855439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:30:11.960242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043931+0000","last_change":"2023-08-10T10:39:41.137221+0000","last_active":"2023-08-10T10:39:43.043931+0000","last_peered":"2023-08-10T10:39:43.043931+0000","last_clean":"2023-08-10T10:39:43.043931+0000","last_became_active":"2023-08-10T10:39:41.136138+0000","last_became_peered":"2023-08-10T10:39:41.136138+0000","last_unstale":"2023-08-10T10:39:43.043931+0000","last_undegraded":"2023-08-10T10:39:43.043931+0000","last_fullsized":"2023-08-10T10:39:43.043931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:59.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855430+0000","last_change":"2023-08-10T10:39:41.124225+0000","last_active":"2023-08-10T10:39:42.855430+0000","last_peered":"2023-08-10T10:39:42.855430+0000","last_clean":"2023-08-10T10:39:42.855430+0000","last_became_active":"2023-08-10T10:39:41.123791+0000","last_became_peered":"2023-08-10T10:39:41.123791+0000","last_unstale":"2023-08-10T10:39:42.855430+0000","last_undegraded":"2023-08-10T10:39:42.855430+0000","last_fullsized":"2023-08-10T10:39:42.855430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:58.232438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858168+0000","last_change":"2023-08-10T10:39:41.119589+0000","last_active":"2023-08-10T10:39:42.858168+0000","last_peered":"2023-08-10T10:39:42.858168+0000","last_clean":"2023-08-10T10:39:42.858168+0000","last_became_active":"2023-08-10T10:39:41.119165+0000","last_became_peered":"2023-08-10T10:39:41.119165+0000","last_unstale":"2023-08-10T10:39:42.858168+0000","last_undegraded":"2023-08-10T10:39:42.858168+0000","last_fullsized":"2023-08-10T10:39:42.858168+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:25.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856809+0000","last_change":"2023-08-10T10:39:41.135374+0000","last_active":"2023-08-10T10:39:42.856809+0000","last_peered":"2023-08-10T10:39:42.856809+0000","last_clean":"2023-08-10T10:39:42.856809+0000","last_became_active":"2023-08-10T10:39:41.134185+0000","last_became_peered":"2023-08-10T10:39:41.134185+0000","last_unstale":"2023-08-10T10:39:42.856809+0000","last_undegraded":"2023-08-10T10:39:42.856809+0000","last_fullsized":"2023-08-10T10:39:42.856809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:28.802663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854173+0000","last_change":"2023-08-10T10:39:41.136279+0000","last_active":"2023-08-10T10:39:42.854173+0000","last_peered":"2023-08-10T10:39:42.854173+0000","last_clean":"2023-08-10T10:39:42.854173+0000","last_became_active":"2023-08-10T10:39:41.135923+0000","last_became_peered":"2023-08-10T10:39:41.135923+0000","last_unstale":"2023-08-10T10:39:42.854173+0000","last_undegraded":"2023-08-10T10:39:42.854173+0000","last_fullsized":"2023-08-10T10:39:42.854173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:49.839194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857140+0000","last_change":"2023-08-10T10:39:41.132713+0000","last_active":"2023-08-10T10:39:42.857140+0000","last_peered":"2023-08-10T10:39:42.857140+0000","last_clean":"2023-08-10T10:39:42.857140+0000","last_became_active":"2023-08-10T10:39:41.132359+0000","last_became_peered":"2023-08-10T10:39:41.132359+0000","last_unstale":"2023-08-10T10:39:42.857140+0000","last_undegraded":"2023-08-10T10:39:42.857140+0000","last_fullsized":"2023-08-10T10:39:42.857140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:59.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856044+0000","last_change":"2023-08-10T10:39:40.092104+0000","last_active":"2023-08-10T10:39:42.856044+0000","last_peered":"2023-08-10T10:39:42.856044+0000","last_clean":"2023-08-10T10:39:42.856044+0000","last_became_active":"2023-08-10T10:39:40.091706+0000","last_became_peered":"2023-08-10T10:39:40.091706+0000","last_unstale":"2023-08-10T10:39:42.856044+0000","last_undegraded":"2023-08-10T10:39:42.856044+0000","last_fullsized":"2023-08-10T10:39:42.856044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:08.389560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854428+0000","last_change":"2023-08-10T10:39:41.133359+0000","last_active":"2023-08-10T10:39:42.854428+0000","last_peered":"2023-08-10T10:39:42.854428+0000","last_clean":"2023-08-10T10:39:42.854428+0000","last_became_active":"2023-08-10T10:39:41.132833+0000","last_became_peered":"2023-08-10T10:39:41.132833+0000","last_unstale":"2023-08-10T10:39:42.854428+0000","last_undegraded":"2023-08-10T10:39:42.854428+0000","last_fullsized":"2023-08-10T10:39:42.854428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:42.811823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110522+0000","last_change":"2023-08-10T10:39:40.099342+0000","last_active":"2023-08-10T10:39:42.110522+0000","last_peered":"2023-08-10T10:39:42.110522+0000","last_clean":"2023-08-10T10:39:42.110522+0000","last_became_active":"2023-08-10T10:39:40.098764+0000","last_became_peered":"2023-08-10T10:39:40.098764+0000","last_unstale":"2023-08-10T10:39:42.110522+0000","last_undegraded":"2023-08-10T10:39:42.110522+0000","last_fullsized":"2023-08-10T10:39:42.110522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:24.499593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856172+0000","last_change":"2023-08-10T10:39:41.122083+0000","last_active":"2023-08-10T10:39:42.856172+0000","last_peered":"2023-08-10T10:39:42.856172+0000","last_clean":"2023-08-10T10:39:42.856172+0000","last_became_active":"2023-08-10T10:39:41.121320+0000","last_became_peered":"2023-08-10T10:39:41.121320+0000","last_unstale":"2023-08-10T10:39:42.856172+0000","last_undegraded":"2023-08-10T10:39:42.856172+0000","last_fullsized":"2023-08-10T10:39:42.856172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:41:52.724087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855338+0000","last_change":"2023-08-10T10:39:40.084710+0000","last_active":"2023-08-10T10:39:42.855338+0000","last_peered":"2023-08-10T10:39:42.855338+0000","last_clean":"2023-08-10T10:39:42.855338+0000","last_became_active":"2023-08-10T10:39:40.084391+0000","last_became_peered":"2023-08-10T10:39:40.084391+0000","last_unstale":"2023-08-10T10:39:42.855338+0000","last_undegraded":"2023-08-10T10:39:42.855338+0000","last_fullsized":"2023-08-10T10:39:42.855338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:16.702362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108776+0000","last_change":"2023-08-10T10:39:41.120758+0000","last_active":"2023-08-10T10:39:42.108776+0000","last_peered":"2023-08-10T10:39:42.108776+0000","last_clean":"2023-08-10T10:39:42.108776+0000","last_became_active":"2023-08-10T10:39:41.120076+0000","last_became_peered":"2023-08-10T10:39:41.120076+0000","last_unstale":"2023-08-10T10:39:42.108776+0000","last_undegraded":"2023-08-10T10:39:42.108776+0000","last_fullsized":"2023-08-10T10:39:42.108776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:49.839194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857369+0000","last_change":"2023-08-10T10:39:40.093164+0000","last_active":"2023-08-10T10:39:42.857369+0000","last_peered":"2023-08-10T10:39:42.857369+0000","last_clean":"2023-08-10T10:39:42.857369+0000","last_became_active":"2023-08-10T10:39:40.092670+0000","last_became_peered":"2023-08-10T10:39:40.092670+0000","last_unstale":"2023-08-10T10:39:42.857369+0000","last_undegraded":"2023-08-10T10:39:42.857369+0000","last_fullsized":"2023-08-10T10:39:42.857369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:58.830424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110509+0000","last_change":"2023-08-10T10:39:41.135807+0000","last_active":"2023-08-10T10:39:42.110509+0000","last_peered":"2023-08-10T10:39:42.110509+0000","last_clean":"2023-08-10T10:39:42.110509+0000","last_became_active":"2023-08-10T10:39:41.135255+0000","last_became_peered":"2023-08-10T10:39:41.135255+0000","last_unstale":"2023-08-10T10:39:42.110509+0000","last_undegraded":"2023-08-10T10:39:42.110509+0000","last_fullsized":"2023-08-10T10:39:42.110509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:38.642354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043549+0000","last_change":"2023-08-10T10:39:40.101378+0000","last_active":"2023-08-10T10:39:43.043549+0000","last_peered":"2023-08-10T10:39:43.043549+0000","last_clean":"2023-08-10T10:39:43.043549+0000","last_became_active":"2023-08-10T10:39:40.100666+0000","last_became_peered":"2023-08-10T10:39:40.100666+0000","last_unstale":"2023-08-10T10:39:43.043549+0000","last_undegraded":"2023-08-10T10:39:43.043549+0000","last_fullsized":"2023-08-10T10:39:43.043549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:44.199947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.042776+0000","last_change":"2023-08-10T10:39:41.135531+0000","last_active":"2023-08-10T10:39:43.042776+0000","last_peered":"2023-08-10T10:39:43.042776+0000","last_clean":"2023-08-10T10:39:43.042776+0000","last_became_active":"2023-08-10T10:39:41.133122+0000","last_became_peered":"2023-08-10T10:39:41.133122+0000","last_unstale":"2023-08-10T10:39:43.042776+0000","last_undegraded":"2023-08-10T10:39:43.042776+0000","last_fullsized":"2023-08-10T10:39:43.042776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:23:07.948507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858325+0000","last_change":"2023-08-10T10:39:40.099355+0000","last_active":"2023-08-10T10:39:42.858325+0000","last_peered":"2023-08-10T10:39:42.858325+0000","last_clean":"2023-08-10T10:39:42.858325+0000","last_became_active":"2023-08-10T10:39:40.098842+0000","last_became_peered":"2023-08-10T10:39:40.098842+0000","last_unstale":"2023-08-10T10:39:42.858325+0000","last_undegraded":"2023-08-10T10:39:42.858325+0000","last_fullsized":"2023-08-10T10:39:42.858325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:41.952856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858730+0000","last_change":"2023-08-10T10:39:41.128082+0000","last_active":"2023-08-10T10:39:42.858730+0000","last_peered":"2023-08-10T10:39:42.858730+0000","last_clean":"2023-08-10T10:39:42.858730+0000","last_became_active":"2023-08-10T10:39:41.127804+0000","last_became_peered":"2023-08-10T10:39:41.127804+0000","last_unstale":"2023-08-10T10:39:42.858730+0000","last_undegraded":"2023-08-10T10:39:42.858730+0000","last_fullsized":"2023-08-10T10:39:42.858730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:15.434545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854944+0000","last_change":"2023-08-10T10:39:40.091229+0000","last_active":"2023-08-10T10:39:42.854944+0000","last_peered":"2023-08-10T10:39:42.854944+0000","last_clean":"2023-08-10T10:39:42.854944+0000","last_became_active":"2023-08-10T10:39:40.090509+0000","last_became_peered":"2023-08-10T10:39:40.090509+0000","last_unstale":"2023-08-10T10:39:42.854944+0000","last_undegraded":"2023-08-10T10:39:42.854944+0000","last_fullsized":"2023-08-10T10:39:42.854944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:43.215141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108946+0000","last_change":"2023-08-10T10:39:41.141359+0000","last_active":"2023-08-10T10:39:42.108946+0000","last_peered":"2023-08-10T10:39:42.108946+0000","last_clean":"2023-08-10T10:39:42.108946+0000","last_became_active":"2023-08-10T10:39:41.139586+0000","last_became_peered":"2023-08-10T10:39:41.139586+0000","last_unstale":"2023-08-10T10:39:42.108946+0000","last_undegraded":"2023-08-10T10:39:42.108946+0000","last_fullsized":"2023-08-10T10:39:42.108946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:01:10.034688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857242+0000","last_change":"2023-08-10T10:39:40.099541+0000","last_active":"2023-08-10T10:39:42.857242+0000","last_peered":"2023-08-10T10:39:42.857242+0000","last_clean":"2023-08-10T10:39:42.857242+0000","last_became_active":"2023-08-10T10:39:40.099208+0000","last_became_peered":"2023-08-10T10:39:40.099208+0000","last_unstale":"2023-08-10T10:39:42.857242+0000","last_undegraded":"2023-08-10T10:39:42.857242+0000","last_fullsized":"2023-08-10T10:39:42.857242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:27.789578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111249+0000","last_change":"2023-08-10T10:39:41.140884+0000","last_active":"2023-08-10T10:39:42.111249+0000","last_peered":"2023-08-10T10:39:42.111249+0000","last_clean":"2023-08-10T10:39:42.111249+0000","last_became_active":"2023-08-10T10:39:41.139053+0000","last_became_peered":"2023-08-10T10:39:41.139053+0000","last_unstale":"2023-08-10T10:39:42.111249+0000","last_undegraded":"2023-08-10T10:39:42.111249+0000","last_fullsized":"2023-08-10T10:39:42.111249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:58.232438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109066+0000","last_change":"2023-08-10T10:39:40.093838+0000","last_active":"2023-08-10T10:39:42.109066+0000","last_peered":"2023-08-10T10:39:42.109066+0000","last_clean":"2023-08-10T10:39:42.109066+0000","last_became_active":"2023-08-10T10:39:40.093237+0000","last_became_peered":"2023-08-10T10:39:40.093237+0000","last_unstale":"2023-08-10T10:39:42.109066+0000","last_undegraded":"2023-08-10T10:39:42.109066+0000","last_fullsized":"2023-08-10T10:39:42.109066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:16.702362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857996+0000","last_change":"2023-08-10T10:39:41.134030+0000","last_active":"2023-08-10T10:39:42.857996+0000","last_peered":"2023-08-10T10:39:42.857996+0000","last_clean":"2023-08-10T10:39:42.857996+0000","last_became_active":"2023-08-10T10:39:41.133553+0000","last_became_peered":"2023-08-10T10:39:41.133553+0000","last_unstale":"2023-08-10T10:39:42.857996+0000","last_undegraded":"2023-08-10T10:39:42.857996+0000","last_fullsized":"2023-08-10T10:39:42.857996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:18.494187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043918+0000","last_change":"2023-08-10T10:39:40.100913+0000","last_active":"2023-08-10T10:39:43.043918+0000","last_peered":"2023-08-10T10:39:43.043918+0000","last_clean":"2023-08-10T10:39:43.043918+0000","last_became_active":"2023-08-10T10:39:40.099181+0000","last_became_peered":"2023-08-10T10:39:40.099181+0000","last_unstale":"2023-08-10T10:39:43.043918+0000","last_undegraded":"2023-08-10T10:39:43.043918+0000","last_fullsized":"2023-08-10T10:39:43.043918+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:12.980512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110535+0000","last_change":"2023-08-10T10:39:41.134193+0000","last_active":"2023-08-10T10:39:42.110535+0000","last_peered":"2023-08-10T10:39:42.110535+0000","last_clean":"2023-08-10T10:39:42.110535+0000","last_became_active":"2023-08-10T10:39:41.133930+0000","last_became_peered":"2023-08-10T10:39:41.133930+0000","last_unstale":"2023-08-10T10:39:42.110535+0000","last_undegraded":"2023-08-10T10:39:42.110535+0000","last_fullsized":"2023-08-10T10:39:42.110535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:12.330440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044394+0000","last_change":"2023-08-10T10:39:40.084058+0000","last_active":"2023-08-10T10:39:43.044394+0000","last_peered":"2023-08-10T10:39:43.044394+0000","last_clean":"2023-08-10T10:39:43.044394+0000","last_became_active":"2023-08-10T10:39:40.083397+0000","last_became_peered":"2023-08-10T10:39:40.083397+0000","last_unstale":"2023-08-10T10:39:43.044394+0000","last_undegraded":"2023-08-10T10:39:43.044394+0000","last_fullsized":"2023-08-10T10:39:43.044394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:17.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856846+0000","last_change":"2023-08-10T10:39:41.131913+0000","last_active":"2023-08-10T10:39:42.856846+0000","last_peered":"2023-08-10T10:39:42.856846+0000","last_clean":"2023-08-10T10:39:42.856846+0000","last_became_active":"2023-08-10T10:39:41.131626+0000","last_became_peered":"2023-08-10T10:39:41.131626+0000","last_unstale":"2023-08-10T10:39:42.856846+0000","last_undegraded":"2023-08-10T10:39:42.856846+0000","last_fullsized":"2023-08-10T10:39:42.856846+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:40.775578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108759+0000","last_change":"2023-08-10T10:39:40.100069+0000","last_active":"2023-08-10T10:39:42.108759+0000","last_peered":"2023-08-10T10:39:42.108759+0000","last_clean":"2023-08-10T10:39:42.108759+0000","last_became_active":"2023-08-10T10:39:40.099838+0000","last_became_peered":"2023-08-10T10:39:40.099838+0000","last_unstale":"2023-08-10T10:39:42.108759+0000","last_undegraded":"2023-08-10T10:39:42.108759+0000","last_fullsized":"2023-08-10T10:39:42.108759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:13.903191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110179+0000","last_change":"2023-08-10T10:39:41.129611+0000","last_active":"2023-08-10T10:39:42.110179+0000","last_peered":"2023-08-10T10:39:42.110179+0000","last_clean":"2023-08-10T10:39:42.110179+0000","last_became_active":"2023-08-10T10:39:41.129155+0000","last_became_peered":"2023-08-10T10:39:41.129155+0000","last_unstale":"2023-08-10T10:39:42.110179+0000","last_undegraded":"2023-08-10T10:39:42.110179+0000","last_fullsized":"2023-08-10T10:39:42.110179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:57.009671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108976+0000","last_change":"2023-08-10T10:39:40.097519+0000","last_active":"2023-08-10T10:39:42.108976+0000","last_peered":"2023-08-10T10:39:42.108976+0000","last_clean":"2023-08-10T10:39:42.108976+0000","last_became_active":"2023-08-10T10:39:40.097193+0000","last_became_peered":"2023-08-10T10:39:40.097193+0000","last_unstale":"2023-08-10T10:39:42.108976+0000","last_undegraded":"2023-08-10T10:39:42.108976+0000","last_fullsized":"2023-08-10T10:39:42.108976+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:00.061319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109134+0000","last_change":"2023-08-10T10:39:41.140583+0000","last_active":"2023-08-10T10:39:42.109134+0000","last_peered":"2023-08-10T10:39:42.109134+0000","last_clean":"2023-08-10T10:39:42.109134+0000","last_became_active":"2023-08-10T10:39:41.136243+0000","last_became_peered":"2023-08-10T10:39:41.136243+0000","last_unstale":"2023-08-10T10:39:42.109134+0000","last_undegraded":"2023-08-10T10:39:42.109134+0000","last_fullsized":"2023-08-10T10:39:42.109134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:51.219828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855396+0000","last_change":"2023-08-10T10:39:40.090709+0000","last_active":"2023-08-10T10:39:42.855396+0000","last_peered":"2023-08-10T10:39:42.855396+0000","last_clean":"2023-08-10T10:39:42.855396+0000","last_became_active":"2023-08-10T10:39:40.090362+0000","last_became_peered":"2023-08-10T10:39:40.090362+0000","last_unstale":"2023-08-10T10:39:42.855396+0000","last_undegraded":"2023-08-10T10:39:42.855396+0000","last_fullsized":"2023-08-10T10:39:42.855396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:50.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857469+0000","last_change":"2023-08-10T10:39:41.135690+0000","last_active":"2023-08-10T10:39:42.857469+0000","last_peered":"2023-08-10T10:39:42.857469+0000","last_clean":"2023-08-10T10:39:42.857469+0000","last_became_active":"2023-08-10T10:39:41.134738+0000","last_became_peered":"2023-08-10T10:39:41.134738+0000","last_unstale":"2023-08-10T10:39:42.857469+0000","last_undegraded":"2023-08-10T10:39:42.857469+0000","last_fullsized":"2023-08-10T10:39:42.857469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:38.578221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855774+0000","last_change":"2023-08-10T10:39:40.096672+0000","last_active":"2023-08-10T10:39:42.855774+0000","last_peered":"2023-08-10T10:39:42.855774+0000","last_clean":"2023-08-10T10:39:42.855774+0000","last_became_active":"2023-08-10T10:39:40.096187+0000","last_became_peered":"2023-08-10T10:39:40.096187+0000","last_unstale":"2023-08-10T10:39:42.855774+0000","last_undegraded":"2023-08-10T10:39:42.855774+0000","last_fullsized":"2023-08-10T10:39:42.855774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:12.716472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108829+0000","last_change":"2023-08-10T10:39:41.136543+0000","last_active":"2023-08-10T10:39:42.108829+0000","last_peered":"2023-08-10T10:39:42.108829+0000","last_clean":"2023-08-10T10:39:42.108829+0000","last_became_active":"2023-08-10T10:39:41.136231+0000","last_became_peered":"2023-08-10T10:39:41.136231+0000","last_unstale":"2023-08-10T10:39:42.108829+0000","last_undegraded":"2023-08-10T10:39:42.108829+0000","last_fullsized":"2023-08-10T10:39:42.108829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:41.504604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858978+0000","last_change":"2023-08-10T10:39:40.099520+0000","last_active":"2023-08-10T10:39:42.858978+0000","last_peered":"2023-08-10T10:39:42.858978+0000","last_clean":"2023-08-10T10:39:42.858978+0000","last_became_active":"2023-08-10T10:39:40.099132+0000","last_became_peered":"2023-08-10T10:39:40.099132+0000","last_unstale":"2023-08-10T10:39:42.858978+0000","last_undegraded":"2023-08-10T10:39:42.858978+0000","last_fullsized":"2023-08-10T10:39:42.858978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:29:01.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109291+0000","last_change":"2023-08-10T10:39:41.118929+0000","last_active":"2023-08-10T10:39:42.109291+0000","last_peered":"2023-08-10T10:39:42.109291+0000","last_clean":"2023-08-10T10:39:42.109291+0000","last_became_active":"2023-08-10T10:39:41.117939+0000","last_became_peered":"2023-08-10T10:39:41.117939+0000","last_unstale":"2023-08-10T10:39:42.109291+0000","last_undegraded":"2023-08-10T10:39:42.109291+0000","last_fullsized":"2023-08-10T10:39:42.109291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:51.917761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043967+0000","last_change":"2023-08-10T10:39:40.100281+0000","last_active":"2023-08-10T10:39:43.043967+0000","last_peered":"2023-08-10T10:39:43.043967+0000","last_clean":"2023-08-10T10:39:43.043967+0000","last_became_active":"2023-08-10T10:39:40.099949+0000","last_became_peered":"2023-08-10T10:39:40.099949+0000","last_unstale":"2023-08-10T10:39:43.043967+0000","last_undegraded":"2023-08-10T10:39:43.043967+0000","last_fullsized":"2023-08-10T10:39:43.043967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:37.565135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043777+0000","last_change":"2023-08-10T10:39:41.136986+0000","last_active":"2023-08-10T10:39:43.043777+0000","last_peered":"2023-08-10T10:39:43.043777+0000","last_clean":"2023-08-10T10:39:43.043777+0000","last_became_active":"2023-08-10T10:39:41.136041+0000","last_became_peered":"2023-08-10T10:39:41.136041+0000","last_unstale":"2023-08-10T10:39:43.043777+0000","last_undegraded":"2023-08-10T10:39:43.043777+0000","last_fullsized":"2023-08-10T10:39:43.043777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:28.802663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857812+0000","last_change":"2023-08-10T10:39:40.094888+0000","last_active":"2023-08-10T10:39:42.857812+0000","last_peered":"2023-08-10T10:39:42.857812+0000","last_clean":"2023-08-10T10:39:42.857812+0000","last_became_active":"2023-08-10T10:39:40.094487+0000","last_became_peered":"2023-08-10T10:39:40.094487+0000","last_unstale":"2023-08-10T10:39:42.857812+0000","last_undegraded":"2023-08-10T10:39:42.857812+0000","last_fullsized":"2023-08-10T10:39:42.857812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:37.565135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856750+0000","last_change":"2023-08-10T10:39:41.124151+0000","last_active":"2023-08-10T10:39:42.856750+0000","last_peered":"2023-08-10T10:39:42.856750+0000","last_clean":"2023-08-10T10:39:42.856750+0000","last_became_active":"2023-08-10T10:39:41.123610+0000","last_became_peered":"2023-08-10T10:39:41.123610+0000","last_unstale":"2023-08-10T10:39:42.856750+0000","last_undegraded":"2023-08-10T10:39:42.856750+0000","last_fullsized":"2023-08-10T10:39:42.856750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:45.213033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111804+0000","last_change":"2023-08-10T10:39:40.101173+0000","last_active":"2023-08-10T10:39:42.111804+0000","last_peered":"2023-08-10T10:39:42.111804+0000","last_clean":"2023-08-10T10:39:42.111804+0000","last_became_active":"2023-08-10T10:39:40.100924+0000","last_became_peered":"2023-08-10T10:39:40.100924+0000","last_unstale":"2023-08-10T10:39:42.111804+0000","last_undegraded":"2023-08-10T10:39:42.111804+0000","last_fullsized":"2023-08-10T10:39:42.111804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:20.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111385+0000","last_change":"2023-08-10T10:39:41.141445+0000","last_active":"2023-08-10T10:39:42.111385+0000","last_peered":"2023-08-10T10:39:42.111385+0000","last_clean":"2023-08-10T10:39:42.111385+0000","last_became_active":"2023-08-10T10:39:41.140234+0000","last_became_peered":"2023-08-10T10:39:41.140234+0000","last_unstale":"2023-08-10T10:39:42.111385+0000","last_undegraded":"2023-08-10T10:39:42.111385+0000","last_fullsized":"2023-08-10T10:39:42.111385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:50.561005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854502+0000","last_change":"2023-08-10T10:39:40.083932+0000","last_active":"2023-08-10T10:39:42.854502+0000","last_peered":"2023-08-10T10:39:42.854502+0000","last_clean":"2023-08-10T10:39:42.854502+0000","last_became_active":"2023-08-10T10:39:40.083685+0000","last_became_peered":"2023-08-10T10:39:40.083685+0000","last_unstale":"2023-08-10T10:39:42.854502+0000","last_undegraded":"2023-08-10T10:39:42.854502+0000","last_fullsized":"2023-08-10T10:39:42.854502+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:01:06.581927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857837+0000","last_change":"2023-08-10T10:39:41.135917+0000","last_active":"2023-08-10T10:39:42.857837+0000","last_peered":"2023-08-10T10:39:42.857837+0000","last_clean":"2023-08-10T10:39:42.857837+0000","last_became_active":"2023-08-10T10:39:41.135097+0000","last_became_peered":"2023-08-10T10:39:41.135097+0000","last_unstale":"2023-08-10T10:39:42.857837+0000","last_undegraded":"2023-08-10T10:39:42.857837+0000","last_fullsized":"2023-08-10T10:39:42.857837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:15.434545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110980+0000","last_change":"2023-08-10T10:39:40.099456+0000","last_active":"2023-08-10T10:39:42.110980+0000","last_peered":"2023-08-10T10:39:42.110980+0000","last_clean":"2023-08-10T10:39:42.110980+0000","last_became_active":"2023-08-10T10:39:40.099201+0000","last_became_peered":"2023-08-10T10:39:40.099201+0000","last_unstale":"2023-08-10T10:39:42.110980+0000","last_undegraded":"2023-08-10T10:39:42.110980+0000","last_fullsized":"2023-08-10T10:39:42.110980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:32.115740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110656+0000","last_change":"2023-08-10T10:39:41.135544+0000","last_active":"2023-08-10T10:39:42.110656+0000","last_peered":"2023-08-10T10:39:42.110656+0000","last_clean":"2023-08-10T10:39:42.110656+0000","last_became_active":"2023-08-10T10:39:41.134846+0000","last_became_peered":"2023-08-10T10:39:41.134846+0000","last_unstale":"2023-08-10T10:39:42.110656+0000","last_undegraded":"2023-08-10T10:39:42.110656+0000","last_fullsized":"2023-08-10T10:39:42.110656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:23.653287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111497+0000","last_change":"2023-08-10T10:39:40.094147+0000","last_active":"2023-08-10T10:39:42.111497+0000","last_peered":"2023-08-10T10:39:42.111497+0000","last_clean":"2023-08-10T10:39:42.111497+0000","last_became_active":"2023-08-10T10:39:40.093662+0000","last_became_peered":"2023-08-10T10:39:40.093662+0000","last_unstale":"2023-08-10T10:39:42.111497+0000","last_undegraded":"2023-08-10T10:39:42.111497+0000","last_fullsized":"2023-08-10T10:39:42.111497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:08.389560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043163+0000","last_change":"2023-08-10T10:39:41.126449+0000","last_active":"2023-08-10T10:39:43.043163+0000","last_peered":"2023-08-10T10:39:43.043163+0000","last_clean":"2023-08-10T10:39:43.043163+0000","last_became_active":"2023-08-10T10:39:41.125915+0000","last_became_peered":"2023-08-10T10:39:41.125915+0000","last_unstale":"2023-08-10T10:39:43.043163+0000","last_undegraded":"2023-08-10T10:39:43.043163+0000","last_fullsized":"2023-08-10T10:39:43.043163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:56.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855576+0000","last_change":"2023-08-10T10:39:40.100124+0000","last_active":"2023-08-10T10:39:42.855576+0000","last_peered":"2023-08-10T10:39:42.855576+0000","last_clean":"2023-08-10T10:39:42.855576+0000","last_became_active":"2023-08-10T10:39:40.099887+0000","last_became_peered":"2023-08-10T10:39:40.099887+0000","last_unstale":"2023-08-10T10:39:42.855576+0000","last_undegraded":"2023-08-10T10:39:42.855576+0000","last_fullsized":"2023-08-10T10:39:42.855576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:54.313451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108915+0000","last_change":"2023-08-10T10:39:41.138847+0000","last_active":"2023-08-10T10:39:42.108915+0000","last_peered":"2023-08-10T10:39:42.108915+0000","last_clean":"2023-08-10T10:39:42.108915+0000","last_became_active":"2023-08-10T10:39:41.137230+0000","last_became_peered":"2023-08-10T10:39:41.137230+0000","last_unstale":"2023-08-10T10:39:42.108915+0000","last_undegraded":"2023-08-10T10:39:42.108915+0000","last_fullsized":"2023-08-10T10:39:42.108915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:58.714314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.112056+0000","last_change":"2023-08-10T10:39:40.098748+0000","last_active":"2023-08-10T10:39:42.112056+0000","last_peered":"2023-08-10T10:39:42.112056+0000","last_clean":"2023-08-10T10:39:42.112056+0000","last_became_active":"2023-08-10T10:39:40.098420+0000","last_became_peered":"2023-08-10T10:39:40.098420+0000","last_unstale":"2023-08-10T10:39:42.112056+0000","last_undegraded":"2023-08-10T10:39:42.112056+0000","last_fullsized":"2023-08-10T10:39:42.112056+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:25.345716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043178+0000","last_change":"2023-08-10T10:39:41.138047+0000","last_active":"2023-08-10T10:39:43.043178+0000","last_peered":"2023-08-10T10:39:43.043178+0000","last_clean":"2023-08-10T10:39:43.043178+0000","last_became_active":"2023-08-10T10:39:41.137787+0000","last_became_peered":"2023-08-10T10:39:41.137787+0000","last_unstale":"2023-08-10T10:39:43.043178+0000","last_undegraded":"2023-08-10T10:39:43.043178+0000","last_fullsized":"2023-08-10T10:39:43.043178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:35:15.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855914+0000","last_change":"2023-08-10T10:39:40.102255+0000","last_active":"2023-08-10T10:39:42.855914+0000","last_peered":"2023-08-10T10:39:42.855914+0000","last_clean":"2023-08-10T10:39:42.855914+0000","last_became_active":"2023-08-10T10:39:40.101269+0000","last_became_peered":"2023-08-10T10:39:40.101269+0000","last_unstale":"2023-08-10T10:39:42.855914+0000","last_undegraded":"2023-08-10T10:39:42.855914+0000","last_fullsized":"2023-08-10T10:39:42.855914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:44.199947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856179+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:39:42.856179+0000","last_peered":"2023-08-10T10:39:42.856179+0000","last_clean":"2023-08-10T10:39:42.856179+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:39:42.856179+0000","last_undegraded":"2023-08-10T10:39:42.856179+0000","last_fullsized":"2023-08-10T10:39:42.856179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:09.584566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043990+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:39:43.043990+0000","last_peered":"2023-08-10T10:39:43.043990+0000","last_clean":"2023-08-10T10:39:43.043990+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:39:43.043990+0000","last_undegraded":"2023-08-10T10:39:43.043990+0000","last_fullsized":"2023-08-10T10:39:43.043990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:49.473117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854817+0000","last_change":"2023-08-10T10:39:41.133114+0000","last_active":"2023-08-10T10:39:42.854817+0000","last_peered":"2023-08-10T10:39:42.854817+0000","last_clean":"2023-08-10T10:39:42.854817+0000","last_became_active":"2023-08-10T10:39:41.132343+0000","last_became_peered":"2023-08-10T10:39:41.132343+0000","last_unstale":"2023-08-10T10:39:42.854817+0000","last_undegraded":"2023-08-10T10:39:42.854817+0000","last_fullsized":"2023-08-10T10:39:42.854817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:01:10.034688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044398+0000","last_change":"2023-08-10T10:39:40.101128+0000","last_active":"2023-08-10T10:39:43.044398+0000","last_peered":"2023-08-10T10:39:43.044398+0000","last_clean":"2023-08-10T10:39:43.044398+0000","last_became_active":"2023-08-10T10:39:40.099485+0000","last_became_peered":"2023-08-10T10:39:40.099485+0000","last_unstale":"2023-08-10T10:39:43.044398+0000","last_undegraded":"2023-08-10T10:39:43.044398+0000","last_fullsized":"2023-08-10T10:39:43.044398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:40.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855663+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:39:42.855663+0000","last_peered":"2023-08-10T10:39:42.855663+0000","last_clean":"2023-08-10T10:39:42.855663+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:39:42.855663+0000","last_undegraded":"2023-08-10T10:39:42.855663+0000","last_fullsized":"2023-08-10T10:39:42.855663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:40:26.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854711+0000","last_change":"2023-08-10T10:39:41.133539+0000","last_active":"2023-08-10T10:39:42.854711+0000","last_peered":"2023-08-10T10:39:42.854711+0000","last_clean":"2023-08-10T10:39:42.854711+0000","last_became_active":"2023-08-10T10:39:41.133162+0000","last_became_peered":"2023-08-10T10:39:41.133162+0000","last_unstale":"2023-08-10T10:39:42.854711+0000","last_undegraded":"2023-08-10T10:39:42.854711+0000","last_fullsized":"2023-08-10T10:39:42.854711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:35:15.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111158+0000","last_change":"2023-08-10T10:39:40.096375+0000","last_active":"2023-08-10T10:39:42.111158+0000","last_peered":"2023-08-10T10:39:42.111158+0000","last_clean":"2023-08-10T10:39:42.111158+0000","last_became_active":"2023-08-10T10:39:40.096033+0000","last_became_peered":"2023-08-10T10:39:40.096033+0000","last_unstale":"2023-08-10T10:39:42.111158+0000","last_undegraded":"2023-08-10T10:39:42.111158+0000","last_fullsized":"2023-08-10T10:39:42.111158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:46:43.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111276+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:39:42.111276+0000","last_peered":"2023-08-10T10:39:42.111276+0000","last_clean":"2023-08-10T10:39:42.111276+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:39:42.111276+0000","last_undegraded":"2023-08-10T10:39:42.111276+0000","last_fullsized":"2023-08-10T10:39:42.111276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:28:45.998814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109055+0000","last_change":"2023-08-10T10:39:41.115948+0000","last_active":"2023-08-10T10:39:42.109055+0000","last_peered":"2023-08-10T10:39:42.109055+0000","last_clean":"2023-08-10T10:39:42.109055+0000","last_became_active":"2023-08-10T10:39:41.115286+0000","last_became_peered":"2023-08-10T10:39:41.115286+0000","last_unstale":"2023-08-10T10:39:42.109055+0000","last_undegraded":"2023-08-10T10:39:42.109055+0000","last_fullsized":"2023-08-10T10:39:42.109055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:44.228226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110238+0000","last_change":"2023-08-10T10:39:40.099099+0000","last_active":"2023-08-10T10:39:42.110238+0000","last_peered":"2023-08-10T10:39:42.110238+0000","last_clean":"2023-08-10T10:39:42.110238+0000","last_became_active":"2023-08-10T10:39:40.098233+0000","last_became_peered":"2023-08-10T10:39:40.098233+0000","last_unstale":"2023-08-10T10:39:42.110238+0000","last_undegraded":"2023-08-10T10:39:42.110238+0000","last_fullsized":"2023-08-10T10:39:42.110238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:38.204428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044544+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:39:43.044544+0000","last_peered":"2023-08-10T10:39:43.044544+0000","last_clean":"2023-08-10T10:39:43.044544+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:39:43.044544+0000","last_undegraded":"2023-08-10T10:39:43.044544+0000","last_fullsized":"2023-08-10T10:39:43.044544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:17.004514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110072+0000","last_change":"2023-08-10T10:39:41.138673+0000","last_active":"2023-08-10T10:39:42.110072+0000","last_peered":"2023-08-10T10:39:42.110072+0000","last_clean":"2023-08-10T10:39:42.110072+0000","last_became_active":"2023-08-10T10:39:41.138391+0000","last_became_peered":"2023-08-10T10:39:41.138391+0000","last_unstale":"2023-08-10T10:39:42.110072+0000","last_undegraded":"2023-08-10T10:39:42.110072+0000","last_fullsized":"2023-08-10T10:39:42.110072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:47.781932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111340+0000","last_change":"2023-08-10T10:39:40.095107+0000","last_active":"2023-08-10T10:39:42.111340+0000","last_peered":"2023-08-10T10:39:42.111340+0000","last_clean":"2023-08-10T10:39:42.111340+0000","last_became_active":"2023-08-10T10:39:40.094790+0000","last_became_peered":"2023-08-10T10:39:40.094790+0000","last_unstale":"2023-08-10T10:39:42.111340+0000","last_undegraded":"2023-08-10T10:39:42.111340+0000","last_fullsized":"2023-08-10T10:39:42.111340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:12.268571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855547+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:39:42.855547+0000","last_peered":"2023-08-10T10:39:42.855547+0000","last_clean":"2023-08-10T10:39:42.855547+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:39:42.855547+0000","last_undegraded":"2023-08-10T10:39:42.855547+0000","last_fullsized":"2023-08-10T10:39:42.855547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:25.956334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.853794+0000","last_change":"2023-08-10T10:39:41.129013+0000","last_active":"2023-08-10T10:39:42.853794+0000","last_peered":"2023-08-10T10:39:42.853794+0000","last_clean":"2023-08-10T10:39:42.853794+0000","last_became_active":"2023-08-10T10:39:41.128320+0000","last_became_peered":"2023-08-10T10:39:41.128320+0000","last_unstale":"2023-08-10T10:39:42.853794+0000","last_undegraded":"2023-08-10T10:39:42.853794+0000","last_fullsized":"2023-08-10T10:39:42.853794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:14.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856077+0000","last_change":"2023-08-10T10:39:40.096453+0000","last_active":"2023-08-10T10:39:42.856077+0000","last_peered":"2023-08-10T10:39:42.856077+0000","last_clean":"2023-08-10T10:39:42.856077+0000","last_became_active":"2023-08-10T10:39:40.095863+0000","last_became_peered":"2023-08-10T10:39:40.095863+0000","last_unstale":"2023-08-10T10:39:42.856077+0000","last_undegraded":"2023-08-10T10:39:42.856077+0000","last_fullsized":"2023-08-10T10:39:42.856077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:20.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855334+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:39:42.855334+0000","last_peered":"2023-08-10T10:39:42.855334+0000","last_clean":"2023-08-10T10:39:42.855334+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:39:42.855334+0000","last_undegraded":"2023-08-10T10:39:42.855334+0000","last_fullsized":"2023-08-10T10:39:42.855334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:00:20.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857260+0000","last_change":"2023-08-10T10:39:41.125747+0000","last_active":"2023-08-10T10:39:42.857260+0000","last_peered":"2023-08-10T10:39:42.857260+0000","last_clean":"2023-08-10T10:39:42.857260+0000","last_became_active":"2023-08-10T10:39:41.125114+0000","last_became_peered":"2023-08-10T10:39:41.125114+0000","last_unstale":"2023-08-10T10:39:42.857260+0000","last_undegraded":"2023-08-10T10:39:42.857260+0000","last_fullsized":"2023-08-10T10:39:42.857260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:13.993598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.859016+0000","last_change":"2023-08-10T10:39:40.093357+0000","last_active":"2023-08-10T10:39:42.859016+0000","last_peered":"2023-08-10T10:39:42.859016+0000","last_clean":"2023-08-10T10:39:42.859016+0000","last_became_active":"2023-08-10T10:39:40.092709+0000","last_became_peered":"2023-08-10T10:39:40.092709+0000","last_unstale":"2023-08-10T10:39:42.859016+0000","last_undegraded":"2023-08-10T10:39:42.859016+0000","last_fullsized":"2023-08-10T10:39:42.859016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:17.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854249+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:39:42.854249+0000","last_peered":"2023-08-10T10:39:42.854249+0000","last_clean":"2023-08-10T10:39:42.854249+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:39:42.854249+0000","last_undegraded":"2023-08-10T10:39:42.854249+0000","last_fullsized":"2023-08-10T10:39:42.854249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:32.752886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858164+0000","last_change":"2023-08-10T10:39:41.132075+0000","last_active":"2023-08-10T10:39:42.858164+0000","last_peered":"2023-08-10T10:39:42.858164+0000","last_clean":"2023-08-10T10:39:42.858164+0000","last_became_active":"2023-08-10T10:39:41.131662+0000","last_became_peered":"2023-08-10T10:39:41.131662+0000","last_unstale":"2023-08-10T10:39:42.858164+0000","last_undegraded":"2023-08-10T10:39:42.858164+0000","last_fullsized":"2023-08-10T10:39:42.858164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:41.326407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108925+0000","last_change":"2023-08-10T10:39:40.096943+0000","last_active":"2023-08-10T10:39:42.108925+0000","last_peered":"2023-08-10T10:39:42.108925+0000","last_clean":"2023-08-10T10:39:42.108925+0000","last_became_active":"2023-08-10T10:39:40.096664+0000","last_became_peered":"2023-08-10T10:39:40.096664+0000","last_unstale":"2023-08-10T10:39:42.108925+0000","last_undegraded":"2023-08-10T10:39:42.108925+0000","last_fullsized":"2023-08-10T10:39:42.108925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:41.798737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856278+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:39:42.856278+0000","last_peered":"2023-08-10T10:39:42.856278+0000","last_clean":"2023-08-10T10:39:42.856278+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:39:42.856278+0000","last_undegraded":"2023-08-10T10:39:42.856278+0000","last_fullsized":"2023-08-10T10:39:42.856278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:00.397374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194569,"statfs":{"total":200000000,"available":199239423,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.3620000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.548}]},{"osd":2,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.319}]},{"osd":3,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.403},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.159}]},{"osd":4,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.26}]},{"osd":5,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.238},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.206}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195140,"statfs":{"total":200000000,"available":199824190,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014}]},{"osd":1,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.27}]},{"osd":3,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.585}]},{"osd":4,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.79}]},{"osd":5,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.9790000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":2.2690000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":2.0259999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195142,"statfs":{"total":200000000,"available":199825679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.486},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.391}]},{"osd":1,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.034},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":4.0620000000000003,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.4590000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.137},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.5800000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.165},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":165,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195147,"statfs":{"total":200000000,"available":199830821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.042}]},{"osd":3,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.196}]},{"osd":5,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.2490000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.427},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.54}]},{"osd":7,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5860000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":172,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195139,"statfs":{"total":200000000,"available":199823174,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1950000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.006}]},{"osd":2,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.302},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.105}]},{"osd":4,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.335}]},{"osd":5,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.389},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.776}]},{"osd":6,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":2.0230000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.9830000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.4039999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195141,"statfs":{"total":200000000,"available":199824702,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":1.4430000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.589}]},{"osd":6,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.369},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.266}]},{"osd":7,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.097},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.4019999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195147,"statfs":{"total":200000000,"available":199831335,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.296},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.369},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.702},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.629}]},{"osd":4,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":2.0470000000000002},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":2.3010000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.752}]},{"osd":6,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":2.2469999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":2.742},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.802}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.127}]},{"osd":2,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.071}]},{"osd":4,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.623},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4570000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.647},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.4890000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.423}]},{"osd":7,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.6839999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:39:45.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:39:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.912+0000 7fa10e9dd640 1 Processor -- start 2023-08-10T10:39:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.912+0000 7fa10e9dd640 1 -- start start 2023-08-10T10:39:45.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.913+0000 7fa10e9dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 0x7fa1080cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.913+0000 7fa10e9dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1080b58e0 0x7fa1080b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.913+0000 7fa10e9dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080d1630 con 0x7fa10815cb90 2023-08-10T10:39:45.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.913+0000 7fa10e9dd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1080d00a0 con 0x7fa1080b58e0 2023-08-10T10:39:45.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.913+0000 7fa10e9dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1080d0a20 con 0x7fa1080cf6e0 2023-08-10T10:39:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1080b58e0 0x7fa1080b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1080b58e0 0x7fa1080b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42152/0 (socket says 172.21.15.50:42152) 2023-08-10T10:39:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 -- 172.21.15.50:0/2621214664 learned_addr learned my addr 172.21.15.50:0/2621214664 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10d1da640 1 --2- 172.21.15.50:0/2621214664 >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 0x7fa1080cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 -- 172.21.15.50:0/2621214664 >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 msgr2=0x7fa1080cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:45.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 --2- 172.21.15.50:0/2621214664 >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 0x7fa1080cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 -- 172.21.15.50:0/2621214664 >> v1:172.21.15.117:6789/0 conn(0x7fa10815cb90 legacy=0x7fa1080d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.914+0000 7fa10e1dc640 1 -- 172.21.15.50:0/2621214664 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080d0d00 con 0x7fa1080b58e0 2023-08-10T10:39:45.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.915+0000 7fa10d1da640 1 --2- 172.21.15.50:0/2621214664 >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 0x7fa1080cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:45.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.916+0000 7fa10e1dc640 1 --2- 172.21.15.50:0/2621214664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b5d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ce3c0 tx=0x7fa10002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cc63da6c2efef5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.916+0000 7fa10c9d9640 1 -- 172.21.15.50:0/2621214664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10002ca80 con 0x7fa1080b58e0 2023-08-10T10:39:45.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.916+0000 7fa10c9d9640 1 -- 172.21.15.50:0/2621214664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10002cbe0 con 0x7fa1080b58e0 2023-08-10T10:39:45.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.916+0000 7fa10c9d9640 1 -- 172.21.15.50:0/2621214664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000343f0 con 0x7fa1080b58e0 2023-08-10T10:39:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2621214664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 msgr2=0x7fa1080b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2621214664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b5d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ce3c0 tx=0x7fa10002bee0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2621214664 shutdown_connections 2023-08-10T10:39:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2621214664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b5d70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2621214664 >> v2:172.21.15.117:3300/0 conn(0x7fa1080cf6e0 0x7fa1080cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2621214664 >> 172.21.15.50:0/2621214664 conn(0x7fa108069880 msgr2=0x7fa108069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2621214664 shutdown_connections 2023-08-10T10:39:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.917+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2621214664 wait complete. 2023-08-10T10:39:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.919+0000 7fa10e9dd640 1 Processor -- start 2023-08-10T10:39:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.919+0000 7fa10e9dd640 1 -- start start 2023-08-10T10:39:45.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1080cf6e0 0x7fa1081f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa10815cb90 0x7fa1080b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1080a9300 con 0x7fa1080b58e0 2023-08-10T10:39:45.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081f5f60 con 0x7fa10815cb90 2023-08-10T10:39:45.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.920+0000 7fa10e9dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081f6240 con 0x7fa1080cf6e0 2023-08-10T10:39:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42168/0 (socket says 172.21.15.50:42168) 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 -- 172.21.15.50:0/2529762674 learned_addr learned my addr 172.21.15.50:0/2529762674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 -- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1080cf6e0 msgr2=0x7fa1081f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1080cf6e0 0x7fa1081f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 -- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa10815cb90 msgr2=0x7fa1080b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa10815cb90 0x7fa1080b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 -- 172.21.15.50:0/2529762674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100009b30 con 0x7fa1080b58e0 2023-08-10T10:39:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.921+0000 7fa10d9db640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c400 tx=0x7fa10400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.922+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040052d0 con 0x7fa1080b58e0 2023-08-10T10:39:45.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.922+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104005430 con 0x7fa1080b58e0 2023-08-10T10:39:45.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.922+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104003830 con 0x7fa1080b58e0 2023-08-10T10:39:45.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.922+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1080c9a00 con 0x7fa1080b58e0 2023-08-10T10:39:45.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.922+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1081f6520 con 0x7fa1080b58e0 2023-08-10T10:39:45.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.923+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1080c9f20 con 0x7fa1080b58e0 2023-08-10T10:39:45.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.924+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa104003990 con 0x7fa1080b58e0 2023-08-10T10:39:45.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.926+0000 7fa0fe7fc640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 0x7fa0ec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:45.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.926+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa104088ae0 con 0x7fa1080b58e0 2023-08-10T10:39:45.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.926+0000 7fa10d1da640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 0x7fa0ec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:45.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.927+0000 7fa10d1da640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 0x7fa0ec06d110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006fd0 tx=0x7fa0f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:45.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:45.930+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa1080c9f20 con 0x7fa1080b58e0 2023-08-10T10:39:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.119+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1080d12c0 con 0x7fa0ec06ac50 2023-08-10T10:39:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.143+0000 7fa0fe7fc640 1 -- 172.21.15.50:0/2529762674 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302950 (secure 0 0 0) 0x7fa0f800c7a0 con 0x7fa0ec06ac50 2023-08-10T10:39:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:39:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 msgr2=0x7fa0ec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 0x7fa0ec06d110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006fd0 tx=0x7fa0f8008040 comp rx=0 tx=0).stop 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 msgr2=0x7fa1080b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c400 tx=0x7fa10400c8c0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 shutdown_connections 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0ec06ac50 0x7fa0ec06d110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa10815cb90 0x7fa1080b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1080cf6e0 0x7fa1081f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 --2- 172.21.15.50:0/2529762674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1080b58e0 0x7fa1080b0b30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 >> 172.21.15.50:0/2529762674 conn(0x7fa108069880 msgr2=0x7fa1080b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.150+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 shutdown_connections 2023-08-10T10:39:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.151+0000 7fa10e9dd640 1 -- 172.21.15.50:0/2529762674 wait complete. 2023-08-10T10:39:46.171 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-08-10T10:39:44.345383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559994,"statfs":{"total":1600000000,"available":1597434713,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.280297"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108925+0000","last_change":"2023-08-10T10:39:41.132323+0000","last_active":"2023-08-10T10:39:42.108925+0000","last_peered":"2023-08-10T10:39:42.108925+0000","last_clean":"2023-08-10T10:39:42.108925+0000","last_became_active":"2023-08-10T10:39:41.131787+0000","last_became_peered":"2023-08-10T10:39:41.131787+0000","last_unstale":"2023-08-10T10:39:42.108925+0000","last_undegraded":"2023-08-10T10:39:42.108925+0000","last_fullsized":"2023-08-10T10:39:42.108925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:01:07.595013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109580+0000","last_change":"2023-08-10T10:39:41.141871+0000","last_active":"2023-08-10T10:39:42.109580+0000","last_peered":"2023-08-10T10:39:42.109580+0000","last_clean":"2023-08-10T10:39:42.109580+0000","last_became_active":"2023-08-10T10:39:41.140196+0000","last_became_peered":"2023-08-10T10:39:41.140196+0000","last_unstale":"2023-08-10T10:39:42.109580+0000","last_undegraded":"2023-08-10T10:39:42.109580+0000","last_fullsized":"2023-08-10T10:39:42.109580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:09.111602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110024+0000","last_change":"2023-08-10T10:39:41.131095+0000","last_active":"2023-08-10T10:39:42.110024+0000","last_peered":"2023-08-10T10:39:42.110024+0000","last_clean":"2023-08-10T10:39:42.110024+0000","last_became_active":"2023-08-10T10:39:41.130741+0000","last_became_peered":"2023-08-10T10:39:41.130741+0000","last_unstale":"2023-08-10T10:39:42.110024+0000","last_undegraded":"2023-08-10T10:39:42.110024+0000","last_fullsized":"2023-08-10T10:39:42.110024+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:24:05.551593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110835+0000","last_change":"2023-08-10T10:39:41.141073+0000","last_active":"2023-08-10T10:39:42.110835+0000","last_peered":"2023-08-10T10:39:42.110835+0000","last_clean":"2023-08-10T10:39:42.110835+0000","last_became_active":"2023-08-10T10:39:41.139449+0000","last_became_peered":"2023-08-10T10:39:41.139449+0000","last_unstale":"2023-08-10T10:39:42.110835+0000","last_undegraded":"2023-08-10T10:39:42.110835+0000","last_fullsized":"2023-08-10T10:39:42.110835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:25.596002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111449+0000","last_change":"2023-08-10T10:39:41.134708+0000","last_active":"2023-08-10T10:39:42.111449+0000","last_peered":"2023-08-10T10:39:42.111449+0000","last_clean":"2023-08-10T10:39:42.111449+0000","last_became_active":"2023-08-10T10:39:41.134393+0000","last_became_peered":"2023-08-10T10:39:41.134393+0000","last_unstale":"2023-08-10T10:39:42.111449+0000","last_undegraded":"2023-08-10T10:39:42.111449+0000","last_fullsized":"2023-08-10T10:39:42.111449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:13.729558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854335+0000","last_change":"2023-08-10T10:39:41.121982+0000","last_active":"2023-08-10T10:39:42.854335+0000","last_peered":"2023-08-10T10:39:42.854335+0000","last_clean":"2023-08-10T10:39:42.854335+0000","last_became_active":"2023-08-10T10:39:41.121208+0000","last_became_peered":"2023-08-10T10:39:41.121208+0000","last_unstale":"2023-08-10T10:39:42.854335+0000","last_undegraded":"2023-08-10T10:39:42.854335+0000","last_fullsized":"2023-08-10T10:39:42.854335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:41.504604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.042856+0000","last_change":"2023-08-10T10:39:41.139500+0000","last_active":"2023-08-10T10:39:43.042856+0000","last_peered":"2023-08-10T10:39:43.042856+0000","last_clean":"2023-08-10T10:39:43.042856+0000","last_became_active":"2023-08-10T10:39:41.139315+0000","last_became_peered":"2023-08-10T10:39:41.139315+0000","last_unstale":"2023-08-10T10:39:43.042856+0000","last_undegraded":"2023-08-10T10:39:43.042856+0000","last_fullsized":"2023-08-10T10:39:43.042856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:29.688301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108626+0000","last_change":"2023-08-10T10:39:41.138206+0000","last_active":"2023-08-10T10:39:42.108626+0000","last_peered":"2023-08-10T10:39:42.108626+0000","last_clean":"2023-08-10T10:39:42.108626+0000","last_became_active":"2023-08-10T10:39:41.133198+0000","last_became_peered":"2023-08-10T10:39:41.133198+0000","last_unstale":"2023-08-10T10:39:42.108626+0000","last_undegraded":"2023-08-10T10:39:42.108626+0000","last_fullsized":"2023-08-10T10:39:42.108626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:13.281657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109899+0000","last_change":"2023-08-10T10:39:41.131947+0000","last_active":"2023-08-10T10:39:42.109899+0000","last_peered":"2023-08-10T10:39:42.109899+0000","last_clean":"2023-08-10T10:39:42.109899+0000","last_became_active":"2023-08-10T10:39:41.131581+0000","last_became_peered":"2023-08-10T10:39:41.131581+0000","last_unstale":"2023-08-10T10:39:42.109899+0000","last_undegraded":"2023-08-10T10:39:42.109899+0000","last_fullsized":"2023-08-10T10:39:42.109899+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:46.512302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043198+0000","last_change":"2023-08-10T10:39:41.132453+0000","last_active":"2023-08-10T10:39:43.043198+0000","last_peered":"2023-08-10T10:39:43.043198+0000","last_clean":"2023-08-10T10:39:43.043198+0000","last_became_active":"2023-08-10T10:39:41.132154+0000","last_became_peered":"2023-08-10T10:39:41.132154+0000","last_unstale":"2023-08-10T10:39:43.043198+0000","last_undegraded":"2023-08-10T10:39:43.043198+0000","last_fullsized":"2023-08-10T10:39:43.043198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:46.634315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043228+0000","last_change":"2023-08-10T10:39:41.126168+0000","last_active":"2023-08-10T10:39:43.043228+0000","last_peered":"2023-08-10T10:39:43.043228+0000","last_clean":"2023-08-10T10:39:43.043228+0000","last_became_active":"2023-08-10T10:39:41.125523+0000","last_became_peered":"2023-08-10T10:39:41.125523+0000","last_unstale":"2023-08-10T10:39:43.043228+0000","last_undegraded":"2023-08-10T10:39:43.043228+0000","last_fullsized":"2023-08-10T10:39:43.043228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:55.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110378+0000","last_change":"2023-08-10T10:39:41.136319+0000","last_active":"2023-08-10T10:39:42.110378+0000","last_peered":"2023-08-10T10:39:42.110378+0000","last_clean":"2023-08-10T10:39:42.110378+0000","last_became_active":"2023-08-10T10:39:41.136046+0000","last_became_peered":"2023-08-10T10:39:41.136046+0000","last_unstale":"2023-08-10T10:39:42.110378+0000","last_undegraded":"2023-08-10T10:39:42.110378+0000","last_fullsized":"2023-08-10T10:39:42.110378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:46:17.120921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043570+0000","last_change":"2023-08-10T10:39:41.135860+0000","last_active":"2023-08-10T10:39:43.043570+0000","last_peered":"2023-08-10T10:39:43.043570+0000","last_clean":"2023-08-10T10:39:43.043570+0000","last_became_active":"2023-08-10T10:39:41.132922+0000","last_became_peered":"2023-08-10T10:39:41.132922+0000","last_unstale":"2023-08-10T10:39:43.043570+0000","last_undegraded":"2023-08-10T10:39:43.043570+0000","last_fullsized":"2023-08-10T10:39:43.043570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:40.775578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855834+0000","last_change":"2023-08-10T10:39:41.121729+0000","last_active":"2023-08-10T10:39:42.855834+0000","last_peered":"2023-08-10T10:39:42.855834+0000","last_clean":"2023-08-10T10:39:42.855834+0000","last_became_active":"2023-08-10T10:39:41.120763+0000","last_became_peered":"2023-08-10T10:39:41.120763+0000","last_unstale":"2023-08-10T10:39:42.855834+0000","last_undegraded":"2023-08-10T10:39:42.855834+0000","last_fullsized":"2023-08-10T10:39:42.855834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:55.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043402+0000","last_change":"2023-08-10T10:39:41.131736+0000","last_active":"2023-08-10T10:39:43.043402+0000","last_peered":"2023-08-10T10:39:43.043402+0000","last_clean":"2023-08-10T10:39:43.043402+0000","last_became_active":"2023-08-10T10:39:41.131432+0000","last_became_peered":"2023-08-10T10:39:41.131432+0000","last_unstale":"2023-08-10T10:39:43.043402+0000","last_undegraded":"2023-08-10T10:39:43.043402+0000","last_fullsized":"2023-08-10T10:39:43.043402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:41:52.724087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856455+0000","last_change":"2023-08-10T10:39:41.131917+0000","last_active":"2023-08-10T10:39:42.856455+0000","last_peered":"2023-08-10T10:39:42.856455+0000","last_clean":"2023-08-10T10:39:42.856455+0000","last_became_active":"2023-08-10T10:39:41.131309+0000","last_became_peered":"2023-08-10T10:39:41.131309+0000","last_unstale":"2023-08-10T10:39:42.856455+0000","last_undegraded":"2023-08-10T10:39:42.856455+0000","last_fullsized":"2023-08-10T10:39:42.856455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857043+0000","last_change":"2023-08-10T10:39:41.134130+0000","last_active":"2023-08-10T10:39:42.857043+0000","last_peered":"2023-08-10T10:39:42.857043+0000","last_clean":"2023-08-10T10:39:42.857043+0000","last_became_active":"2023-08-10T10:39:41.133846+0000","last_became_peered":"2023-08-10T10:39:41.133846+0000","last_unstale":"2023-08-10T10:39:42.857043+0000","last_undegraded":"2023-08-10T10:39:42.857043+0000","last_fullsized":"2023-08-10T10:39:42.857043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:13.993598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855689+0000","last_change":"2023-08-10T10:39:41.119799+0000","last_active":"2023-08-10T10:39:42.855689+0000","last_peered":"2023-08-10T10:39:42.855689+0000","last_clean":"2023-08-10T10:39:42.855689+0000","last_became_active":"2023-08-10T10:39:41.119066+0000","last_became_peered":"2023-08-10T10:39:41.119066+0000","last_unstale":"2023-08-10T10:39:42.855689+0000","last_undegraded":"2023-08-10T10:39:42.855689+0000","last_fullsized":"2023-08-10T10:39:42.855689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:50.561005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110967+0000","last_change":"2023-08-10T10:39:41.141636+0000","last_active":"2023-08-10T10:39:42.110967+0000","last_peered":"2023-08-10T10:39:42.110967+0000","last_clean":"2023-08-10T10:39:42.110967+0000","last_became_active":"2023-08-10T10:39:41.140633+0000","last_became_peered":"2023-08-10T10:39:41.140633+0000","last_unstale":"2023-08-10T10:39:42.110967+0000","last_undegraded":"2023-08-10T10:39:42.110967+0000","last_fullsized":"2023-08-10T10:39:42.110967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:13.736833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858330+0000","last_change":"2023-08-10T10:39:41.125931+0000","last_active":"2023-08-10T10:39:42.858330+0000","last_peered":"2023-08-10T10:39:42.858330+0000","last_clean":"2023-08-10T10:39:42.858330+0000","last_became_active":"2023-08-10T10:39:41.125538+0000","last_became_peered":"2023-08-10T10:39:41.125538+0000","last_unstale":"2023-08-10T10:39:42.858330+0000","last_undegraded":"2023-08-10T10:39:42.858330+0000","last_fullsized":"2023-08-10T10:39:42.858330+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:27.832635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043556+0000","last_change":"2023-08-10T10:39:41.137148+0000","last_active":"2023-08-10T10:39:43.043556+0000","last_peered":"2023-08-10T10:39:43.043556+0000","last_clean":"2023-08-10T10:39:43.043556+0000","last_became_active":"2023-08-10T10:39:41.136421+0000","last_became_peered":"2023-08-10T10:39:41.136421+0000","last_unstale":"2023-08-10T10:39:43.043556+0000","last_undegraded":"2023-08-10T10:39:43.043556+0000","last_fullsized":"2023-08-10T10:39:43.043556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856943+0000","last_change":"2023-08-10T10:39:41.134239+0000","last_active":"2023-08-10T10:39:42.856943+0000","last_peered":"2023-08-10T10:39:42.856943+0000","last_clean":"2023-08-10T10:39:42.856943+0000","last_became_active":"2023-08-10T10:39:41.133976+0000","last_became_peered":"2023-08-10T10:39:41.133976+0000","last_unstale":"2023-08-10T10:39:42.856943+0000","last_undegraded":"2023-08-10T10:39:42.856943+0000","last_fullsized":"2023-08-10T10:39:42.856943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:24.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858651+0000","last_change":"2023-08-10T10:39:41.133842+0000","last_active":"2023-08-10T10:39:42.858651+0000","last_peered":"2023-08-10T10:39:42.858651+0000","last_clean":"2023-08-10T10:39:42.858651+0000","last_became_active":"2023-08-10T10:39:41.132429+0000","last_became_peered":"2023-08-10T10:39:41.132429+0000","last_unstale":"2023-08-10T10:39:42.858651+0000","last_undegraded":"2023-08-10T10:39:42.858651+0000","last_fullsized":"2023-08-10T10:39:42.858651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:48.465218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111109+0000","last_change":"2023-08-10T10:39:41.141246+0000","last_active":"2023-08-10T10:39:42.111109+0000","last_peered":"2023-08-10T10:39:42.111109+0000","last_clean":"2023-08-10T10:39:42.111109+0000","last_became_active":"2023-08-10T10:39:41.139865+0000","last_became_peered":"2023-08-10T10:39:41.139865+0000","last_unstale":"2023-08-10T10:39:42.111109+0000","last_undegraded":"2023-08-10T10:39:42.111109+0000","last_fullsized":"2023-08-10T10:39:42.111109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:02.665640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857997+0000","last_change":"2023-08-10T10:39:41.137343+0000","last_active":"2023-08-10T10:39:42.857997+0000","last_peered":"2023-08-10T10:39:42.857997+0000","last_clean":"2023-08-10T10:39:42.857997+0000","last_became_active":"2023-08-10T10:39:41.137060+0000","last_became_peered":"2023-08-10T10:39:41.137060+0000","last_unstale":"2023-08-10T10:39:42.857997+0000","last_undegraded":"2023-08-10T10:39:42.857997+0000","last_fullsized":"2023-08-10T10:39:42.857997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:35.273156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854922+0000","last_change":"2023-08-10T10:39:41.131888+0000","last_active":"2023-08-10T10:39:42.854922+0000","last_peered":"2023-08-10T10:39:42.854922+0000","last_clean":"2023-08-10T10:39:42.854922+0000","last_became_active":"2023-08-10T10:39:41.131115+0000","last_became_peered":"2023-08-10T10:39:41.131115+0000","last_unstale":"2023-08-10T10:39:42.854922+0000","last_undegraded":"2023-08-10T10:39:42.854922+0000","last_fullsized":"2023-08-10T10:39:42.854922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:01.074405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855439+0000","last_change":"2023-08-10T10:39:41.134853+0000","last_active":"2023-08-10T10:39:42.855439+0000","last_peered":"2023-08-10T10:39:42.855439+0000","last_clean":"2023-08-10T10:39:42.855439+0000","last_became_active":"2023-08-10T10:39:41.134519+0000","last_became_peered":"2023-08-10T10:39:41.134519+0000","last_unstale":"2023-08-10T10:39:42.855439+0000","last_undegraded":"2023-08-10T10:39:42.855439+0000","last_fullsized":"2023-08-10T10:39:42.855439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:30:11.960242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043931+0000","last_change":"2023-08-10T10:39:41.137221+0000","last_active":"2023-08-10T10:39:43.043931+0000","last_peered":"2023-08-10T10:39:43.043931+0000","last_clean":"2023-08-10T10:39:43.043931+0000","last_became_active":"2023-08-10T10:39:41.136138+0000","last_became_peered":"2023-08-10T10:39:41.136138+0000","last_unstale":"2023-08-10T10:39:43.043931+0000","last_undegraded":"2023-08-10T10:39:43.043931+0000","last_fullsized":"2023-08-10T10:39:43.043931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:59.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855430+0000","last_change":"2023-08-10T10:39:41.124225+0000","last_active":"2023-08-10T10:39:42.855430+0000","last_peered":"2023-08-10T10:39:42.855430+0000","last_clean":"2023-08-10T10:39:42.855430+0000","last_became_active":"2023-08-10T10:39:41.123791+0000","last_became_peered":"2023-08-10T10:39:41.123791+0000","last_unstale":"2023-08-10T10:39:42.855430+0000","last_undegraded":"2023-08-10T10:39:42.855430+0000","last_fullsized":"2023-08-10T10:39:42.855430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:58.232438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858168+0000","last_change":"2023-08-10T10:39:41.119589+0000","last_active":"2023-08-10T10:39:42.858168+0000","last_peered":"2023-08-10T10:39:42.858168+0000","last_clean":"2023-08-10T10:39:42.858168+0000","last_became_active":"2023-08-10T10:39:41.119165+0000","last_became_peered":"2023-08-10T10:39:41.119165+0000","last_unstale":"2023-08-10T10:39:42.858168+0000","last_undegraded":"2023-08-10T10:39:42.858168+0000","last_fullsized":"2023-08-10T10:39:42.858168+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:25.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856809+0000","last_change":"2023-08-10T10:39:41.135374+0000","last_active":"2023-08-10T10:39:42.856809+0000","last_peered":"2023-08-10T10:39:42.856809+0000","last_clean":"2023-08-10T10:39:42.856809+0000","last_became_active":"2023-08-10T10:39:41.134185+0000","last_became_peered":"2023-08-10T10:39:41.134185+0000","last_unstale":"2023-08-10T10:39:42.856809+0000","last_undegraded":"2023-08-10T10:39:42.856809+0000","last_fullsized":"2023-08-10T10:39:42.856809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:28.802663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854173+0000","last_change":"2023-08-10T10:39:41.136279+0000","last_active":"2023-08-10T10:39:42.854173+0000","last_peered":"2023-08-10T10:39:42.854173+0000","last_clean":"2023-08-10T10:39:42.854173+0000","last_became_active":"2023-08-10T10:39:41.135923+0000","last_became_peered":"2023-08-10T10:39:41.135923+0000","last_unstale":"2023-08-10T10:39:42.854173+0000","last_undegraded":"2023-08-10T10:39:42.854173+0000","last_fullsized":"2023-08-10T10:39:42.854173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:49.839194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857140+0000","last_change":"2023-08-10T10:39:41.132713+0000","last_active":"2023-08-10T10:39:42.857140+0000","last_peered":"2023-08-10T10:39:42.857140+0000","last_clean":"2023-08-10T10:39:42.857140+0000","last_became_active":"2023-08-10T10:39:41.132359+0000","last_became_peered":"2023-08-10T10:39:41.132359+0000","last_unstale":"2023-08-10T10:39:42.857140+0000","last_undegraded":"2023-08-10T10:39:42.857140+0000","last_fullsized":"2023-08-10T10:39:42.857140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:59.843510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856044+0000","last_change":"2023-08-10T10:39:40.092104+0000","last_active":"2023-08-10T10:39:42.856044+0000","last_peered":"2023-08-10T10:39:42.856044+0000","last_clean":"2023-08-10T10:39:42.856044+0000","last_became_active":"2023-08-10T10:39:40.091706+0000","last_became_peered":"2023-08-10T10:39:40.091706+0000","last_unstale":"2023-08-10T10:39:42.856044+0000","last_undegraded":"2023-08-10T10:39:42.856044+0000","last_fullsized":"2023-08-10T10:39:42.856044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:08.389560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854428+0000","last_change":"2023-08-10T10:39:41.133359+0000","last_active":"2023-08-10T10:39:42.854428+0000","last_peered":"2023-08-10T10:39:42.854428+0000","last_clean":"2023-08-10T10:39:42.854428+0000","last_became_active":"2023-08-10T10:39:41.132833+0000","last_became_peered":"2023-08-10T10:39:41.132833+0000","last_unstale":"2023-08-10T10:39:42.854428+0000","last_undegraded":"2023-08-10T10:39:42.854428+0000","last_fullsized":"2023-08-10T10:39:42.854428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:42.811823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110522+0000","last_change":"2023-08-10T10:39:40.099342+0000","last_active":"2023-08-10T10:39:42.110522+0000","last_peered":"2023-08-10T10:39:42.110522+0000","last_clean":"2023-08-10T10:39:42.110522+0000","last_became_active":"2023-08-10T10:39:40.098764+0000","last_became_peered":"2023-08-10T10:39:40.098764+0000","last_unstale":"2023-08-10T10:39:42.110522+0000","last_undegraded":"2023-08-10T10:39:42.110522+0000","last_fullsized":"2023-08-10T10:39:42.110522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:24.499593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856172+0000","last_change":"2023-08-10T10:39:41.122083+0000","last_active":"2023-08-10T10:39:42.856172+0000","last_peered":"2023-08-10T10:39:42.856172+0000","last_clean":"2023-08-10T10:39:42.856172+0000","last_became_active":"2023-08-10T10:39:41.121320+0000","last_became_peered":"2023-08-10T10:39:41.121320+0000","last_unstale":"2023-08-10T10:39:42.856172+0000","last_undegraded":"2023-08-10T10:39:42.856172+0000","last_fullsized":"2023-08-10T10:39:42.856172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:41:52.724087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855338+0000","last_change":"2023-08-10T10:39:40.084710+0000","last_active":"2023-08-10T10:39:42.855338+0000","last_peered":"2023-08-10T10:39:42.855338+0000","last_clean":"2023-08-10T10:39:42.855338+0000","last_became_active":"2023-08-10T10:39:40.084391+0000","last_became_peered":"2023-08-10T10:39:40.084391+0000","last_unstale":"2023-08-10T10:39:42.855338+0000","last_undegraded":"2023-08-10T10:39:42.855338+0000","last_fullsized":"2023-08-10T10:39:42.855338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:16.702362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108776+0000","last_change":"2023-08-10T10:39:41.120758+0000","last_active":"2023-08-10T10:39:42.108776+0000","last_peered":"2023-08-10T10:39:42.108776+0000","last_clean":"2023-08-10T10:39:42.108776+0000","last_became_active":"2023-08-10T10:39:41.120076+0000","last_became_peered":"2023-08-10T10:39:41.120076+0000","last_unstale":"2023-08-10T10:39:42.108776+0000","last_undegraded":"2023-08-10T10:39:42.108776+0000","last_fullsized":"2023-08-10T10:39:42.108776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:49.839194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857369+0000","last_change":"2023-08-10T10:39:40.093164+0000","last_active":"2023-08-10T10:39:42.857369+0000","last_peered":"2023-08-10T10:39:42.857369+0000","last_clean":"2023-08-10T10:39:42.857369+0000","last_became_active":"2023-08-10T10:39:40.092670+0000","last_became_peered":"2023-08-10T10:39:40.092670+0000","last_unstale":"2023-08-10T10:39:42.857369+0000","last_undegraded":"2023-08-10T10:39:42.857369+0000","last_fullsized":"2023-08-10T10:39:42.857369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:58.830424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110509+0000","last_change":"2023-08-10T10:39:41.135807+0000","last_active":"2023-08-10T10:39:42.110509+0000","last_peered":"2023-08-10T10:39:42.110509+0000","last_clean":"2023-08-10T10:39:42.110509+0000","last_became_active":"2023-08-10T10:39:41.135255+0000","last_became_peered":"2023-08-10T10:39:41.135255+0000","last_unstale":"2023-08-10T10:39:42.110509+0000","last_undegraded":"2023-08-10T10:39:42.110509+0000","last_fullsized":"2023-08-10T10:39:42.110509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:38.642354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043549+0000","last_change":"2023-08-10T10:39:40.101378+0000","last_active":"2023-08-10T10:39:43.043549+0000","last_peered":"2023-08-10T10:39:43.043549+0000","last_clean":"2023-08-10T10:39:43.043549+0000","last_became_active":"2023-08-10T10:39:40.100666+0000","last_became_peered":"2023-08-10T10:39:40.100666+0000","last_unstale":"2023-08-10T10:39:43.043549+0000","last_undegraded":"2023-08-10T10:39:43.043549+0000","last_fullsized":"2023-08-10T10:39:43.043549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:44.199947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.042776+0000","last_change":"2023-08-10T10:39:41.135531+0000","last_active":"2023-08-10T10:39:43.042776+0000","last_peered":"2023-08-10T10:39:43.042776+0000","last_clean":"2023-08-10T10:39:43.042776+0000","last_became_active":"2023-08-10T10:39:41.133122+0000","last_became_peered":"2023-08-10T10:39:41.133122+0000","last_unstale":"2023-08-10T10:39:43.042776+0000","last_undegraded":"2023-08-10T10:39:43.042776+0000","last_fullsized":"2023-08-10T10:39:43.042776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:23:07.948507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858325+0000","last_change":"2023-08-10T10:39:40.099355+0000","last_active":"2023-08-10T10:39:42.858325+0000","last_peered":"2023-08-10T10:39:42.858325+0000","last_clean":"2023-08-10T10:39:42.858325+0000","last_became_active":"2023-08-10T10:39:40.098842+0000","last_became_peered":"2023-08-10T10:39:40.098842+0000","last_unstale":"2023-08-10T10:39:42.858325+0000","last_undegraded":"2023-08-10T10:39:42.858325+0000","last_fullsized":"2023-08-10T10:39:42.858325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:41.952856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858730+0000","last_change":"2023-08-10T10:39:41.128082+0000","last_active":"2023-08-10T10:39:42.858730+0000","last_peered":"2023-08-10T10:39:42.858730+0000","last_clean":"2023-08-10T10:39:42.858730+0000","last_became_active":"2023-08-10T10:39:41.127804+0000","last_became_peered":"2023-08-10T10:39:41.127804+0000","last_unstale":"2023-08-10T10:39:42.858730+0000","last_undegraded":"2023-08-10T10:39:42.858730+0000","last_fullsized":"2023-08-10T10:39:42.858730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:15.434545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854944+0000","last_change":"2023-08-10T10:39:40.091229+0000","last_active":"2023-08-10T10:39:42.854944+0000","last_peered":"2023-08-10T10:39:42.854944+0000","last_clean":"2023-08-10T10:39:42.854944+0000","last_became_active":"2023-08-10T10:39:40.090509+0000","last_became_peered":"2023-08-10T10:39:40.090509+0000","last_unstale":"2023-08-10T10:39:42.854944+0000","last_undegraded":"2023-08-10T10:39:42.854944+0000","last_fullsized":"2023-08-10T10:39:42.854944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:43.215141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108946+0000","last_change":"2023-08-10T10:39:41.141359+0000","last_active":"2023-08-10T10:39:42.108946+0000","last_peered":"2023-08-10T10:39:42.108946+0000","last_clean":"2023-08-10T10:39:42.108946+0000","last_became_active":"2023-08-10T10:39:41.139586+0000","last_became_peered":"2023-08-10T10:39:41.139586+0000","last_unstale":"2023-08-10T10:39:42.108946+0000","last_undegraded":"2023-08-10T10:39:42.108946+0000","last_fullsized":"2023-08-10T10:39:42.108946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:01:10.034688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857242+0000","last_change":"2023-08-10T10:39:40.099541+0000","last_active":"2023-08-10T10:39:42.857242+0000","last_peered":"2023-08-10T10:39:42.857242+0000","last_clean":"2023-08-10T10:39:42.857242+0000","last_became_active":"2023-08-10T10:39:40.099208+0000","last_became_peered":"2023-08-10T10:39:40.099208+0000","last_unstale":"2023-08-10T10:39:42.857242+0000","last_undegraded":"2023-08-10T10:39:42.857242+0000","last_fullsized":"2023-08-10T10:39:42.857242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:27.789578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111249+0000","last_change":"2023-08-10T10:39:41.140884+0000","last_active":"2023-08-10T10:39:42.111249+0000","last_peered":"2023-08-10T10:39:42.111249+0000","last_clean":"2023-08-10T10:39:42.111249+0000","last_became_active":"2023-08-10T10:39:41.139053+0000","last_became_peered":"2023-08-10T10:39:41.139053+0000","last_unstale":"2023-08-10T10:39:42.111249+0000","last_undegraded":"2023-08-10T10:39:42.111249+0000","last_fullsized":"2023-08-10T10:39:42.111249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:58.232438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109066+0000","last_change":"2023-08-10T10:39:40.093838+0000","last_active":"2023-08-10T10:39:42.109066+0000","last_peered":"2023-08-10T10:39:42.109066+0000","last_clean":"2023-08-10T10:39:42.109066+0000","last_became_active":"2023-08-10T10:39:40.093237+0000","last_became_peered":"2023-08-10T10:39:40.093237+0000","last_unstale":"2023-08-10T10:39:42.109066+0000","last_undegraded":"2023-08-10T10:39:42.109066+0000","last_fullsized":"2023-08-10T10:39:42.109066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:16.702362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857996+0000","last_change":"2023-08-10T10:39:41.134030+0000","last_active":"2023-08-10T10:39:42.857996+0000","last_peered":"2023-08-10T10:39:42.857996+0000","last_clean":"2023-08-10T10:39:42.857996+0000","last_became_active":"2023-08-10T10:39:41.133553+0000","last_became_peered":"2023-08-10T10:39:41.133553+0000","last_unstale":"2023-08-10T10:39:42.857996+0000","last_undegraded":"2023-08-10T10:39:42.857996+0000","last_fullsized":"2023-08-10T10:39:42.857996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:18.494187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043918+0000","last_change":"2023-08-10T10:39:40.100913+0000","last_active":"2023-08-10T10:39:43.043918+0000","last_peered":"2023-08-10T10:39:43.043918+0000","last_clean":"2023-08-10T10:39:43.043918+0000","last_became_active":"2023-08-10T10:39:40.099181+0000","last_became_peered":"2023-08-10T10:39:40.099181+0000","last_unstale":"2023-08-10T10:39:43.043918+0000","last_undegraded":"2023-08-10T10:39:43.043918+0000","last_fullsized":"2023-08-10T10:39:43.043918+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:12.980512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110535+0000","last_change":"2023-08-10T10:39:41.134193+0000","last_active":"2023-08-10T10:39:42.110535+0000","last_peered":"2023-08-10T10:39:42.110535+0000","last_clean":"2023-08-10T10:39:42.110535+0000","last_became_active":"2023-08-10T10:39:41.133930+0000","last_became_peered":"2023-08-10T10:39:41.133930+0000","last_unstale":"2023-08-10T10:39:42.110535+0000","last_undegraded":"2023-08-10T10:39:42.110535+0000","last_fullsized":"2023-08-10T10:39:42.110535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:12.330440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044394+0000","last_change":"2023-08-10T10:39:40.084058+0000","last_active":"2023-08-10T10:39:43.044394+0000","last_peered":"2023-08-10T10:39:43.044394+0000","last_clean":"2023-08-10T10:39:43.044394+0000","last_became_active":"2023-08-10T10:39:40.083397+0000","last_became_peered":"2023-08-10T10:39:40.083397+0000","last_unstale":"2023-08-10T10:39:43.044394+0000","last_undegraded":"2023-08-10T10:39:43.044394+0000","last_fullsized":"2023-08-10T10:39:43.044394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:17.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856846+0000","last_change":"2023-08-10T10:39:41.131913+0000","last_active":"2023-08-10T10:39:42.856846+0000","last_peered":"2023-08-10T10:39:42.856846+0000","last_clean":"2023-08-10T10:39:42.856846+0000","last_became_active":"2023-08-10T10:39:41.131626+0000","last_became_peered":"2023-08-10T10:39:41.131626+0000","last_unstale":"2023-08-10T10:39:42.856846+0000","last_undegraded":"2023-08-10T10:39:42.856846+0000","last_fullsized":"2023-08-10T10:39:42.856846+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:40.775578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108759+0000","last_change":"2023-08-10T10:39:40.100069+0000","last_active":"2023-08-10T10:39:42.108759+0000","last_peered":"2023-08-10T10:39:42.108759+0000","last_clean":"2023-08-10T10:39:42.108759+0000","last_became_active":"2023-08-10T10:39:40.099838+0000","last_became_peered":"2023-08-10T10:39:40.099838+0000","last_unstale":"2023-08-10T10:39:42.108759+0000","last_undegraded":"2023-08-10T10:39:42.108759+0000","last_fullsized":"2023-08-10T10:39:42.108759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:13.903191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110179+0000","last_change":"2023-08-10T10:39:41.129611+0000","last_active":"2023-08-10T10:39:42.110179+0000","last_peered":"2023-08-10T10:39:42.110179+0000","last_clean":"2023-08-10T10:39:42.110179+0000","last_became_active":"2023-08-10T10:39:41.129155+0000","last_became_peered":"2023-08-10T10:39:41.129155+0000","last_unstale":"2023-08-10T10:39:42.110179+0000","last_undegraded":"2023-08-10T10:39:42.110179+0000","last_fullsized":"2023-08-10T10:39:42.110179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:57.009671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108976+0000","last_change":"2023-08-10T10:39:40.097519+0000","last_active":"2023-08-10T10:39:42.108976+0000","last_peered":"2023-08-10T10:39:42.108976+0000","last_clean":"2023-08-10T10:39:42.108976+0000","last_became_active":"2023-08-10T10:39:40.097193+0000","last_became_peered":"2023-08-10T10:39:40.097193+0000","last_unstale":"2023-08-10T10:39:42.108976+0000","last_undegraded":"2023-08-10T10:39:42.108976+0000","last_fullsized":"2023-08-10T10:39:42.108976+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:00.061319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109134+0000","last_change":"2023-08-10T10:39:41.140583+0000","last_active":"2023-08-10T10:39:42.109134+0000","last_peered":"2023-08-10T10:39:42.109134+0000","last_clean":"2023-08-10T10:39:42.109134+0000","last_became_active":"2023-08-10T10:39:41.136243+0000","last_became_peered":"2023-08-10T10:39:41.136243+0000","last_unstale":"2023-08-10T10:39:42.109134+0000","last_undegraded":"2023-08-10T10:39:42.109134+0000","last_fullsized":"2023-08-10T10:39:42.109134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:51.219828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855396+0000","last_change":"2023-08-10T10:39:40.090709+0000","last_active":"2023-08-10T10:39:42.855396+0000","last_peered":"2023-08-10T10:39:42.855396+0000","last_clean":"2023-08-10T10:39:42.855396+0000","last_became_active":"2023-08-10T10:39:40.090362+0000","last_became_peered":"2023-08-10T10:39:40.090362+0000","last_unstale":"2023-08-10T10:39:42.855396+0000","last_undegraded":"2023-08-10T10:39:42.855396+0000","last_fullsized":"2023-08-10T10:39:42.855396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:50.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857469+0000","last_change":"2023-08-10T10:39:41.135690+0000","last_active":"2023-08-10T10:39:42.857469+0000","last_peered":"2023-08-10T10:39:42.857469+0000","last_clean":"2023-08-10T10:39:42.857469+0000","last_became_active":"2023-08-10T10:39:41.134738+0000","last_became_peered":"2023-08-10T10:39:41.134738+0000","last_unstale":"2023-08-10T10:39:42.857469+0000","last_undegraded":"2023-08-10T10:39:42.857469+0000","last_fullsized":"2023-08-10T10:39:42.857469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:38.578221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855774+0000","last_change":"2023-08-10T10:39:40.096672+0000","last_active":"2023-08-10T10:39:42.855774+0000","last_peered":"2023-08-10T10:39:42.855774+0000","last_clean":"2023-08-10T10:39:42.855774+0000","last_became_active":"2023-08-10T10:39:40.096187+0000","last_became_peered":"2023-08-10T10:39:40.096187+0000","last_unstale":"2023-08-10T10:39:42.855774+0000","last_undegraded":"2023-08-10T10:39:42.855774+0000","last_fullsized":"2023-08-10T10:39:42.855774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:12.716472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108829+0000","last_change":"2023-08-10T10:39:41.136543+0000","last_active":"2023-08-10T10:39:42.108829+0000","last_peered":"2023-08-10T10:39:42.108829+0000","last_clean":"2023-08-10T10:39:42.108829+0000","last_became_active":"2023-08-10T10:39:41.136231+0000","last_became_peered":"2023-08-10T10:39:41.136231+0000","last_unstale":"2023-08-10T10:39:42.108829+0000","last_undegraded":"2023-08-10T10:39:42.108829+0000","last_fullsized":"2023-08-10T10:39:42.108829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:27:41.504604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858978+0000","last_change":"2023-08-10T10:39:40.099520+0000","last_active":"2023-08-10T10:39:42.858978+0000","last_peered":"2023-08-10T10:39:42.858978+0000","last_clean":"2023-08-10T10:39:42.858978+0000","last_became_active":"2023-08-10T10:39:40.099132+0000","last_became_peered":"2023-08-10T10:39:40.099132+0000","last_unstale":"2023-08-10T10:39:42.858978+0000","last_undegraded":"2023-08-10T10:39:42.858978+0000","last_fullsized":"2023-08-10T10:39:42.858978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:29:01.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109291+0000","last_change":"2023-08-10T10:39:41.118929+0000","last_active":"2023-08-10T10:39:42.109291+0000","last_peered":"2023-08-10T10:39:42.109291+0000","last_clean":"2023-08-10T10:39:42.109291+0000","last_became_active":"2023-08-10T10:39:41.117939+0000","last_became_peered":"2023-08-10T10:39:41.117939+0000","last_unstale":"2023-08-10T10:39:42.109291+0000","last_undegraded":"2023-08-10T10:39:42.109291+0000","last_fullsized":"2023-08-10T10:39:42.109291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:51.917761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043967+0000","last_change":"2023-08-10T10:39:40.100281+0000","last_active":"2023-08-10T10:39:43.043967+0000","last_peered":"2023-08-10T10:39:43.043967+0000","last_clean":"2023-08-10T10:39:43.043967+0000","last_became_active":"2023-08-10T10:39:40.099949+0000","last_became_peered":"2023-08-10T10:39:40.099949+0000","last_unstale":"2023-08-10T10:39:43.043967+0000","last_undegraded":"2023-08-10T10:39:43.043967+0000","last_fullsized":"2023-08-10T10:39:43.043967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:37.565135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043777+0000","last_change":"2023-08-10T10:39:41.136986+0000","last_active":"2023-08-10T10:39:43.043777+0000","last_peered":"2023-08-10T10:39:43.043777+0000","last_clean":"2023-08-10T10:39:43.043777+0000","last_became_active":"2023-08-10T10:39:41.136041+0000","last_became_peered":"2023-08-10T10:39:41.136041+0000","last_unstale":"2023-08-10T10:39:43.043777+0000","last_undegraded":"2023-08-10T10:39:43.043777+0000","last_fullsized":"2023-08-10T10:39:43.043777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:08:28.802663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857812+0000","last_change":"2023-08-10T10:39:40.094888+0000","last_active":"2023-08-10T10:39:42.857812+0000","last_peered":"2023-08-10T10:39:42.857812+0000","last_clean":"2023-08-10T10:39:42.857812+0000","last_became_active":"2023-08-10T10:39:40.094487+0000","last_became_peered":"2023-08-10T10:39:40.094487+0000","last_unstale":"2023-08-10T10:39:42.857812+0000","last_undegraded":"2023-08-10T10:39:42.857812+0000","last_fullsized":"2023-08-10T10:39:42.857812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:37.565135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856750+0000","last_change":"2023-08-10T10:39:41.124151+0000","last_active":"2023-08-10T10:39:42.856750+0000","last_peered":"2023-08-10T10:39:42.856750+0000","last_clean":"2023-08-10T10:39:42.856750+0000","last_became_active":"2023-08-10T10:39:41.123610+0000","last_became_peered":"2023-08-10T10:39:41.123610+0000","last_unstale":"2023-08-10T10:39:42.856750+0000","last_undegraded":"2023-08-10T10:39:42.856750+0000","last_fullsized":"2023-08-10T10:39:42.856750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:45.213033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111804+0000","last_change":"2023-08-10T10:39:40.101173+0000","last_active":"2023-08-10T10:39:42.111804+0000","last_peered":"2023-08-10T10:39:42.111804+0000","last_clean":"2023-08-10T10:39:42.111804+0000","last_became_active":"2023-08-10T10:39:40.100924+0000","last_became_peered":"2023-08-10T10:39:40.100924+0000","last_unstale":"2023-08-10T10:39:42.111804+0000","last_undegraded":"2023-08-10T10:39:42.111804+0000","last_fullsized":"2023-08-10T10:39:42.111804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:20.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111385+0000","last_change":"2023-08-10T10:39:41.141445+0000","last_active":"2023-08-10T10:39:42.111385+0000","last_peered":"2023-08-10T10:39:42.111385+0000","last_clean":"2023-08-10T10:39:42.111385+0000","last_became_active":"2023-08-10T10:39:41.140234+0000","last_became_peered":"2023-08-10T10:39:41.140234+0000","last_unstale":"2023-08-10T10:39:42.111385+0000","last_undegraded":"2023-08-10T10:39:42.111385+0000","last_fullsized":"2023-08-10T10:39:42.111385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:50.561005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854502+0000","last_change":"2023-08-10T10:39:40.083932+0000","last_active":"2023-08-10T10:39:42.854502+0000","last_peered":"2023-08-10T10:39:42.854502+0000","last_clean":"2023-08-10T10:39:42.854502+0000","last_became_active":"2023-08-10T10:39:40.083685+0000","last_became_peered":"2023-08-10T10:39:40.083685+0000","last_unstale":"2023-08-10T10:39:42.854502+0000","last_undegraded":"2023-08-10T10:39:42.854502+0000","last_fullsized":"2023-08-10T10:39:42.854502+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:01:06.581927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857837+0000","last_change":"2023-08-10T10:39:41.135917+0000","last_active":"2023-08-10T10:39:42.857837+0000","last_peered":"2023-08-10T10:39:42.857837+0000","last_clean":"2023-08-10T10:39:42.857837+0000","last_became_active":"2023-08-10T10:39:41.135097+0000","last_became_peered":"2023-08-10T10:39:41.135097+0000","last_unstale":"2023-08-10T10:39:42.857837+0000","last_undegraded":"2023-08-10T10:39:42.857837+0000","last_fullsized":"2023-08-10T10:39:42.857837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:15.434545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110980+0000","last_change":"2023-08-10T10:39:40.099456+0000","last_active":"2023-08-10T10:39:42.110980+0000","last_peered":"2023-08-10T10:39:42.110980+0000","last_clean":"2023-08-10T10:39:42.110980+0000","last_became_active":"2023-08-10T10:39:40.099201+0000","last_became_peered":"2023-08-10T10:39:40.099201+0000","last_unstale":"2023-08-10T10:39:42.110980+0000","last_undegraded":"2023-08-10T10:39:42.110980+0000","last_fullsized":"2023-08-10T10:39:42.110980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:32.115740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110656+0000","last_change":"2023-08-10T10:39:41.135544+0000","last_active":"2023-08-10T10:39:42.110656+0000","last_peered":"2023-08-10T10:39:42.110656+0000","last_clean":"2023-08-10T10:39:42.110656+0000","last_became_active":"2023-08-10T10:39:41.134846+0000","last_became_peered":"2023-08-10T10:39:41.134846+0000","last_unstale":"2023-08-10T10:39:42.110656+0000","last_undegraded":"2023-08-10T10:39:42.110656+0000","last_fullsized":"2023-08-10T10:39:42.110656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:23.653287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111497+0000","last_change":"2023-08-10T10:39:40.094147+0000","last_active":"2023-08-10T10:39:42.111497+0000","last_peered":"2023-08-10T10:39:42.111497+0000","last_clean":"2023-08-10T10:39:42.111497+0000","last_became_active":"2023-08-10T10:39:40.093662+0000","last_became_peered":"2023-08-10T10:39:40.093662+0000","last_unstale":"2023-08-10T10:39:42.111497+0000","last_undegraded":"2023-08-10T10:39:42.111497+0000","last_fullsized":"2023-08-10T10:39:42.111497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:08.389560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043163+0000","last_change":"2023-08-10T10:39:41.126449+0000","last_active":"2023-08-10T10:39:43.043163+0000","last_peered":"2023-08-10T10:39:43.043163+0000","last_clean":"2023-08-10T10:39:43.043163+0000","last_became_active":"2023-08-10T10:39:41.125915+0000","last_became_peered":"2023-08-10T10:39:41.125915+0000","last_unstale":"2023-08-10T10:39:43.043163+0000","last_undegraded":"2023-08-10T10:39:43.043163+0000","last_fullsized":"2023-08-10T10:39:43.043163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:56.172659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855576+0000","last_change":"2023-08-10T10:39:40.100124+0000","last_active":"2023-08-10T10:39:42.855576+0000","last_peered":"2023-08-10T10:39:42.855576+0000","last_clean":"2023-08-10T10:39:42.855576+0000","last_became_active":"2023-08-10T10:39:40.099887+0000","last_became_peered":"2023-08-10T10:39:40.099887+0000","last_unstale":"2023-08-10T10:39:42.855576+0000","last_undegraded":"2023-08-10T10:39:42.855576+0000","last_fullsized":"2023-08-10T10:39:42.855576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:54.313451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108915+0000","last_change":"2023-08-10T10:39:41.138847+0000","last_active":"2023-08-10T10:39:42.108915+0000","last_peered":"2023-08-10T10:39:42.108915+0000","last_clean":"2023-08-10T10:39:42.108915+0000","last_became_active":"2023-08-10T10:39:41.137230+0000","last_became_peered":"2023-08-10T10:39:41.137230+0000","last_unstale":"2023-08-10T10:39:42.108915+0000","last_undegraded":"2023-08-10T10:39:42.108915+0000","last_fullsized":"2023-08-10T10:39:42.108915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:58.714314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.112056+0000","last_change":"2023-08-10T10:39:40.098748+0000","last_active":"2023-08-10T10:39:42.112056+0000","last_peered":"2023-08-10T10:39:42.112056+0000","last_clean":"2023-08-10T10:39:42.112056+0000","last_became_active":"2023-08-10T10:39:40.098420+0000","last_became_peered":"2023-08-10T10:39:40.098420+0000","last_unstale":"2023-08-10T10:39:42.112056+0000","last_undegraded":"2023-08-10T10:39:42.112056+0000","last_fullsized":"2023-08-10T10:39:42.112056+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:25.345716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043178+0000","last_change":"2023-08-10T10:39:41.138047+0000","last_active":"2023-08-10T10:39:43.043178+0000","last_peered":"2023-08-10T10:39:43.043178+0000","last_clean":"2023-08-10T10:39:43.043178+0000","last_became_active":"2023-08-10T10:39:41.137787+0000","last_became_peered":"2023-08-10T10:39:41.137787+0000","last_unstale":"2023-08-10T10:39:43.043178+0000","last_undegraded":"2023-08-10T10:39:43.043178+0000","last_fullsized":"2023-08-10T10:39:43.043178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:35:15.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855914+0000","last_change":"2023-08-10T10:39:40.102255+0000","last_active":"2023-08-10T10:39:42.855914+0000","last_peered":"2023-08-10T10:39:42.855914+0000","last_clean":"2023-08-10T10:39:42.855914+0000","last_became_active":"2023-08-10T10:39:40.101269+0000","last_became_peered":"2023-08-10T10:39:40.101269+0000","last_unstale":"2023-08-10T10:39:42.855914+0000","last_undegraded":"2023-08-10T10:39:42.855914+0000","last_fullsized":"2023-08-10T10:39:42.855914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:44.199947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856179+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:39:42.856179+0000","last_peered":"2023-08-10T10:39:42.856179+0000","last_clean":"2023-08-10T10:39:42.856179+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:39:42.856179+0000","last_undegraded":"2023-08-10T10:39:42.856179+0000","last_fullsized":"2023-08-10T10:39:42.856179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:09.584566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.043990+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:39:43.043990+0000","last_peered":"2023-08-10T10:39:43.043990+0000","last_clean":"2023-08-10T10:39:43.043990+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:39:43.043990+0000","last_undegraded":"2023-08-10T10:39:43.043990+0000","last_fullsized":"2023-08-10T10:39:43.043990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:49.473117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854817+0000","last_change":"2023-08-10T10:39:41.133114+0000","last_active":"2023-08-10T10:39:42.854817+0000","last_peered":"2023-08-10T10:39:42.854817+0000","last_clean":"2023-08-10T10:39:42.854817+0000","last_became_active":"2023-08-10T10:39:41.132343+0000","last_became_peered":"2023-08-10T10:39:41.132343+0000","last_unstale":"2023-08-10T10:39:42.854817+0000","last_undegraded":"2023-08-10T10:39:42.854817+0000","last_fullsized":"2023-08-10T10:39:42.854817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:01:10.034688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044398+0000","last_change":"2023-08-10T10:39:40.101128+0000","last_active":"2023-08-10T10:39:43.044398+0000","last_peered":"2023-08-10T10:39:43.044398+0000","last_clean":"2023-08-10T10:39:43.044398+0000","last_became_active":"2023-08-10T10:39:40.099485+0000","last_became_peered":"2023-08-10T10:39:40.099485+0000","last_unstale":"2023-08-10T10:39:43.044398+0000","last_undegraded":"2023-08-10T10:39:43.044398+0000","last_fullsized":"2023-08-10T10:39:43.044398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:40.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855663+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:39:42.855663+0000","last_peered":"2023-08-10T10:39:42.855663+0000","last_clean":"2023-08-10T10:39:42.855663+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:39:42.855663+0000","last_undegraded":"2023-08-10T10:39:42.855663+0000","last_fullsized":"2023-08-10T10:39:42.855663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:40:26.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854711+0000","last_change":"2023-08-10T10:39:41.133539+0000","last_active":"2023-08-10T10:39:42.854711+0000","last_peered":"2023-08-10T10:39:42.854711+0000","last_clean":"2023-08-10T10:39:42.854711+0000","last_became_active":"2023-08-10T10:39:41.133162+0000","last_became_peered":"2023-08-10T10:39:41.133162+0000","last_unstale":"2023-08-10T10:39:42.854711+0000","last_undegraded":"2023-08-10T10:39:42.854711+0000","last_fullsized":"2023-08-10T10:39:42.854711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:35:15.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111158+0000","last_change":"2023-08-10T10:39:40.096375+0000","last_active":"2023-08-10T10:39:42.111158+0000","last_peered":"2023-08-10T10:39:42.111158+0000","last_clean":"2023-08-10T10:39:42.111158+0000","last_became_active":"2023-08-10T10:39:40.096033+0000","last_became_peered":"2023-08-10T10:39:40.096033+0000","last_unstale":"2023-08-10T10:39:42.111158+0000","last_undegraded":"2023-08-10T10:39:42.111158+0000","last_fullsized":"2023-08-10T10:39:42.111158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:46:43.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111276+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:39:42.111276+0000","last_peered":"2023-08-10T10:39:42.111276+0000","last_clean":"2023-08-10T10:39:42.111276+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:39:42.111276+0000","last_undegraded":"2023-08-10T10:39:42.111276+0000","last_fullsized":"2023-08-10T10:39:42.111276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:28:45.998814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.109055+0000","last_change":"2023-08-10T10:39:41.115948+0000","last_active":"2023-08-10T10:39:42.109055+0000","last_peered":"2023-08-10T10:39:42.109055+0000","last_clean":"2023-08-10T10:39:42.109055+0000","last_became_active":"2023-08-10T10:39:41.115286+0000","last_became_peered":"2023-08-10T10:39:41.115286+0000","last_unstale":"2023-08-10T10:39:42.109055+0000","last_undegraded":"2023-08-10T10:39:42.109055+0000","last_fullsized":"2023-08-10T10:39:42.109055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:44.228226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110238+0000","last_change":"2023-08-10T10:39:40.099099+0000","last_active":"2023-08-10T10:39:42.110238+0000","last_peered":"2023-08-10T10:39:42.110238+0000","last_clean":"2023-08-10T10:39:42.110238+0000","last_became_active":"2023-08-10T10:39:40.098233+0000","last_became_peered":"2023-08-10T10:39:40.098233+0000","last_unstale":"2023-08-10T10:39:42.110238+0000","last_undegraded":"2023-08-10T10:39:42.110238+0000","last_fullsized":"2023-08-10T10:39:42.110238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:38.204428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:43.044544+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:39:43.044544+0000","last_peered":"2023-08-10T10:39:43.044544+0000","last_clean":"2023-08-10T10:39:43.044544+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:39:43.044544+0000","last_undegraded":"2023-08-10T10:39:43.044544+0000","last_fullsized":"2023-08-10T10:39:43.044544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:17.004514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.110072+0000","last_change":"2023-08-10T10:39:41.138673+0000","last_active":"2023-08-10T10:39:42.110072+0000","last_peered":"2023-08-10T10:39:42.110072+0000","last_clean":"2023-08-10T10:39:42.110072+0000","last_became_active":"2023-08-10T10:39:41.138391+0000","last_became_peered":"2023-08-10T10:39:41.138391+0000","last_unstale":"2023-08-10T10:39:42.110072+0000","last_undegraded":"2023-08-10T10:39:42.110072+0000","last_fullsized":"2023-08-10T10:39:42.110072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:47.781932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.111340+0000","last_change":"2023-08-10T10:39:40.095107+0000","last_active":"2023-08-10T10:39:42.111340+0000","last_peered":"2023-08-10T10:39:42.111340+0000","last_clean":"2023-08-10T10:39:42.111340+0000","last_became_active":"2023-08-10T10:39:40.094790+0000","last_became_peered":"2023-08-10T10:39:40.094790+0000","last_unstale":"2023-08-10T10:39:42.111340+0000","last_undegraded":"2023-08-10T10:39:42.111340+0000","last_fullsized":"2023-08-10T10:39:42.111340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:12.268571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855547+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:39:42.855547+0000","last_peered":"2023-08-10T10:39:42.855547+0000","last_clean":"2023-08-10T10:39:42.855547+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:39:42.855547+0000","last_undegraded":"2023-08-10T10:39:42.855547+0000","last_fullsized":"2023-08-10T10:39:42.855547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:25.956334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.853794+0000","last_change":"2023-08-10T10:39:41.129013+0000","last_active":"2023-08-10T10:39:42.853794+0000","last_peered":"2023-08-10T10:39:42.853794+0000","last_clean":"2023-08-10T10:39:42.853794+0000","last_became_active":"2023-08-10T10:39:41.128320+0000","last_became_peered":"2023-08-10T10:39:41.128320+0000","last_unstale":"2023-08-10T10:39:42.853794+0000","last_undegraded":"2023-08-10T10:39:42.853794+0000","last_fullsized":"2023-08-10T10:39:42.853794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:14.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856077+0000","last_change":"2023-08-10T10:39:40.096453+0000","last_active":"2023-08-10T10:39:42.856077+0000","last_peered":"2023-08-10T10:39:42.856077+0000","last_clean":"2023-08-10T10:39:42.856077+0000","last_became_active":"2023-08-10T10:39:40.095863+0000","last_became_peered":"2023-08-10T10:39:40.095863+0000","last_unstale":"2023-08-10T10:39:42.856077+0000","last_undegraded":"2023-08-10T10:39:42.856077+0000","last_fullsized":"2023-08-10T10:39:42.856077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:20.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.855334+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:39:42.855334+0000","last_peered":"2023-08-10T10:39:42.855334+0000","last_clean":"2023-08-10T10:39:42.855334+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:39:42.855334+0000","last_undegraded":"2023-08-10T10:39:42.855334+0000","last_fullsized":"2023-08-10T10:39:42.855334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:00:20.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.857260+0000","last_change":"2023-08-10T10:39:41.125747+0000","last_active":"2023-08-10T10:39:42.857260+0000","last_peered":"2023-08-10T10:39:42.857260+0000","last_clean":"2023-08-10T10:39:42.857260+0000","last_became_active":"2023-08-10T10:39:41.125114+0000","last_became_peered":"2023-08-10T10:39:41.125114+0000","last_unstale":"2023-08-10T10:39:42.857260+0000","last_undegraded":"2023-08-10T10:39:42.857260+0000","last_fullsized":"2023-08-10T10:39:42.857260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:13.993598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.859016+0000","last_change":"2023-08-10T10:39:40.093357+0000","last_active":"2023-08-10T10:39:42.859016+0000","last_peered":"2023-08-10T10:39:42.859016+0000","last_clean":"2023-08-10T10:39:42.859016+0000","last_became_active":"2023-08-10T10:39:40.092709+0000","last_became_peered":"2023-08-10T10:39:40.092709+0000","last_unstale":"2023-08-10T10:39:42.859016+0000","last_undegraded":"2023-08-10T10:39:42.859016+0000","last_fullsized":"2023-08-10T10:39:42.859016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:17.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.854249+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:39:42.854249+0000","last_peered":"2023-08-10T10:39:42.854249+0000","last_clean":"2023-08-10T10:39:42.854249+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:39:42.854249+0000","last_undegraded":"2023-08-10T10:39:42.854249+0000","last_fullsized":"2023-08-10T10:39:42.854249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:32.752886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.858164+0000","last_change":"2023-08-10T10:39:41.132075+0000","last_active":"2023-08-10T10:39:42.858164+0000","last_peered":"2023-08-10T10:39:42.858164+0000","last_clean":"2023-08-10T10:39:42.858164+0000","last_became_active":"2023-08-10T10:39:41.131662+0000","last_became_peered":"2023-08-10T10:39:41.131662+0000","last_unstale":"2023-08-10T10:39:42.858164+0000","last_undegraded":"2023-08-10T10:39:42.858164+0000","last_fullsized":"2023-08-10T10:39:42.858164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:40.063637+0000","last_clean_scrub_stamp":"2023-08-10T10:39:40.063637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:41.326407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.108925+0000","last_change":"2023-08-10T10:39:40.096943+0000","last_active":"2023-08-10T10:39:42.108925+0000","last_peered":"2023-08-10T10:39:42.108925+0000","last_clean":"2023-08-10T10:39:42.108925+0000","last_became_active":"2023-08-10T10:39:40.096664+0000","last_became_peered":"2023-08-10T10:39:40.096664+0000","last_unstale":"2023-08-10T10:39:42.108925+0000","last_undegraded":"2023-08-10T10:39:42.108925+0000","last_fullsized":"2023-08-10T10:39:42.108925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:39:39.050551+0000","last_clean_scrub_stamp":"2023-08-10T10:39:39.050551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:41.798737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-10T10:39:42.856278+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:39:42.856278+0000","last_peered":"2023-08-10T10:39:42.856278+0000","last_clean":"2023-08-10T10:39:42.856278+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:39:42.856278+0000","last_undegraded":"2023-08-10T10:39:42.856278+0000","last_fullsized":"2023-08-10T10:39:42.856278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:00.397374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194569,"statfs":{"total":200000000,"available":199239423,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.3620000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.548}]},{"osd":2,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.319}]},{"osd":3,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.403},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.159}]},{"osd":4,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.26}]},{"osd":5,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.238},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:39:09 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.206}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195140,"statfs":{"total":200000000,"available":199824190,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014}]},{"osd":1,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.27}]},{"osd":3,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.585}]},{"osd":4,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.79}]},{"osd":5,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.9790000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":2.2690000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":2.0259999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195142,"statfs":{"total":200000000,"available":199825679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.486},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.391}]},{"osd":1,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.034},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":4.0620000000000003,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.4590000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.137},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.5800000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.165},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":165,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195147,"statfs":{"total":200000000,"available":199830821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.042}]},{"osd":3,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.196}]},{"osd":5,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.2490000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.427},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.54}]},{"osd":7,"last update":"Thu Aug 10 10:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5860000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":172,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195139,"statfs":{"total":200000000,"available":199823174,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1950000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.006}]},{"osd":2,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.302},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.105}]},{"osd":4,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.335}]},{"osd":5,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.389},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.776}]},{"osd":6,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":2.0230000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.9830000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.4039999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195141,"statfs":{"total":200000000,"available":199824702,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":1.4430000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.589}]},{"osd":6,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.369},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.266}]},{"osd":7,"last update":"Thu Aug 10 10:39:10 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.097},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.4019999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195147,"statfs":{"total":200000000,"available":199831335,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.296},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.369},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.702},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.629}]},{"osd":4,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":2.0470000000000002},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":2.3010000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.752}]},{"osd":6,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":2.2469999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:39:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":2.742},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.802}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.127}]},{"osd":2,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.071}]},{"osd":4,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.623},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4570000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.647},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.4890000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.423}]},{"osd":7,"last update":"Thu Aug 10 10:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.6839999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:39:46.178 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:39:46.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:39:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.442+0000 7fe507cc5640 1 Processor -- start 2023-08-10T10:39:46.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.443+0000 7fe507cc5640 1 -- start start 2023-08-10T10:39:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.444+0000 7fe507cc5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe50006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.444+0000 7fe507cc5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe500160a40 con 0x7fe50015cf70 2023-08-10T10:39:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.444+0000 7fe507cc5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5000b4bb0 con 0x7fe50015cb90 2023-08-10T10:39:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.444+0000 7fe507cc5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000b4e90 con 0x7fe5001615e0 2023-08-10T10:39:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.445+0000 7fe505260640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe50015cf70 0x7fe500160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49068/0 (socket says 172.21.15.50:49068) 2023-08-10T10:39:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.445+0000 7fe505260640 1 -- 172.21.15.50:0/1864574300 learned_addr learned my addr 172.21.15.50:0/1864574300 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.445+0000 7fe506262640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe50006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.445+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828274401 0 0) 0x7fe500160a40 con 0x7fe50015cf70 2023-08-10T10:39:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.445+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4ec003520 con 0x7fe50015cf70 2023-08-10T10:39:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751590614 0 0) 0x7fe4ec003520 con 0x7fe50015cf70 2023-08-10T10:39:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 msgr2=0x7fe50006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe50006fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 >> v1:172.21.15.117:6789/0 conn(0x7fe50015cb90 legacy=0x7fe5000b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5000b5170 con 0x7fe50015cf70 2023-08-10T10:39:46.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe4f0001670 con 0x7fe50015cf70 2023-08-10T10:39:46.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 >> v1:172.21.15.50:6789/0 conn(0x7fe50015cf70 legacy=0x7fe500160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe4ec0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe4ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4ec004d00 0x7fe4ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000b4e90 con 0x7fe4ec003f20 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec00ba60 con 0x7fe4ec004d00 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec00bc20 con 0x7fe5001615e0 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.446+0000 7fe505260640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe4ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe506262640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4ec004d00 0x7fe4ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505a61640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe4ec0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505260640 1 -- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 msgr2=0x7fe4ec0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505260640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5001615e0 0x7fe4ec0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505260640 1 -- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4ec004d00 msgr2=0x7fe4ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505260640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4ec004d00 0x7fe4ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.447+0000 7fe505260640 1 -- 172.21.15.50:0/1864574300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec003520 con 0x7fe4ec003f20 2023-08-10T10:39:46.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.448+0000 7fe505260640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe4ec0047c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c240 tx=0x7fe4ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e10bb5020b27264 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:46.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.448+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0005ad0 con 0x7fe4ec003f20 2023-08-10T10:39:46.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.448+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0005c30 con 0x7fe4ec003f20 2023-08-10T10:39:46.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.448+0000 7fe504a5f640 1 -- 172.21.15.50:0/1864574300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002caf0 con 0x7fe4ec003f20 2023-08-10T10:39:46.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 -- 172.21.15.50:0/1864574300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 msgr2=0x7fe4ec0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 --2- 172.21.15.50:0/1864574300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe4ec0047c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c240 tx=0x7fe4ec0057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe506262640 1 -- 172.21.15.50:0/1864574300 reap_dead start 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 -- 172.21.15.50:0/1864574300 shutdown_connections 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 -- 172.21.15.50:0/1864574300 >> 172.21.15.50:0/1864574300 conn(0x7fe5000cf640 msgr2=0x7fe5000cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 -- 172.21.15.50:0/1864574300 shutdown_connections 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.449+0000 7fe507cc5640 1 -- 172.21.15.50:0/1864574300 wait complete. 2023-08-10T10:39:46.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.451+0000 7fe507cc5640 1 Processor -- start 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.451+0000 7fe507cc5640 1 -- start start 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 0x7fe500153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe50015aa80 0x7fe50015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500158920 con 0x7fe4ec003f20 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50015b440 con 0x7fe5001584a0 2023-08-10T10:39:46.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe507cc5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50015ea90 con 0x7fe50015aa80 2023-08-10T10:39:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe505a61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe505a61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42186/0 (socket says 172.21.15.50:42186) 2023-08-10T10:39:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.452+0000 7fe505a61640 1 -- 172.21.15.50:0/3095087826 learned_addr learned my addr 172.21.15.50:0/3095087826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505260640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 0x7fe500153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe506262640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe50015aa80 0x7fe50015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 -- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe50015aa80 msgr2=0x7fe50015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe50015aa80 0x7fe50015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 -- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 msgr2=0x7fe500153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 0x7fe500153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 -- 172.21.15.50:0/3095087826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50015b8d0 con 0x7fe4ec003f20 2023-08-10T10:39:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505260640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 0x7fe500153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.453+0000 7fe505a61640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e550 tx=0x7fe4fc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.454+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0052e0 con 0x7fe4ec003f20 2023-08-10T10:39:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.454+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc005440 con 0x7fe4ec003f20 2023-08-10T10:39:46.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.454+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe500159ae0 con 0x7fe4ec003f20 2023-08-10T10:39:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.454+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc003810 con 0x7fe4ec003f20 2023-08-10T10:39:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.454+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50015e720 con 0x7fe4ec003f20 2023-08-10T10:39:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.455+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5000612b0 con 0x7fe4ec003f20 2023-08-10T10:39:46.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.456+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4fc003970 con 0x7fe4ec003f20 2023-08-10T10:39:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.457+0000 7fe4f67fc640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 0x7fe4e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.457+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4fc089280 con 0x7fe4ec003f20 2023-08-10T10:39:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.457+0000 7fe505260640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 0x7fe4e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.458+0000 7fe505260640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 0x7fe4e406d110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.462+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe4fc054320 con 0x7fe4ec003f20 2023-08-10T10:39:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.726+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe5000d2e60 con 0x7fe4ec003f20 2023-08-10T10:39:46.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.734+0000 7fe4f67fc640 1 -- 172.21.15.50:0/3095087826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe4fc057940 con 0x7fe4ec003f20 2023-08-10T10:39:46.737 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:39:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:39:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:39:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:39:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:39:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 msgr2=0x7fe4e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 0x7fe4e406d110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f0009030 comp rx=0 tx=0).stop 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 msgr2=0x7fe5001594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e550 tx=0x7fe4fc00ea10 comp rx=0 tx=0).stop 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 shutdown_connections 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe50015aa80 0x7fe50015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4e406ac50 0x7fe4e406d110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5001584a0 0x7fe500153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 --2- 172.21.15.50:0/3095087826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4ec003f20 0x7fe5001594c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 >> 172.21.15.50:0/3095087826 conn(0x7fe5000cf640 msgr2=0x7fe5000d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 shutdown_connections 2023-08-10T10:39:46.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.738+0000 7fe507cc5640 1 -- 172.21.15.50:0/3095087826 wait complete. 2023-08-10T10:39:46.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:46.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.984+0000 7f33c0a3f640 1 Processor -- start 2023-08-10T10:39:46.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.985+0000 7f33c0a3f640 1 -- start start 2023-08-10T10:39:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.986+0000 7f33c0a3f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33bc0b0c60 0x7f33bc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.986+0000 7f33c0a3f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33bc0b3f30 0x7f33bc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.986+0000 7f33c0a3f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc071c70 con 0x7f33bc15aa40 2023-08-10T10:39:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.986+0000 7f33c0a3f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0713d0 con 0x7f33bc0b0c60 2023-08-10T10:39:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.986+0000 7f33c0a3f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0716b0 con 0x7f33bc0b3f30 2023-08-10T10:39:46.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b9d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33bc0b0c60 0x7f33bc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33ba59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33bc15aa40 0x7f33bc0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49074/0 (socket says 172.21.15.50:49074) 2023-08-10T10:39:46.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33ba59c640 1 -- 172.21.15.50:0/1435317531 learned_addr learned my addr 172.21.15.50:0/1435317531 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33bad9d640 1 --2- 172.21.15.50:0/1435317531 >> v2:172.21.15.117:3300/0 conn(0x7f33bc0b3f30 0x7f33bc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b959a640 1 -- 172.21.15.50:0/1435317531 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439724740 0 0) 0x7f33bc071c70 con 0x7f33bc15aa40 2023-08-10T10:39:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b9d9b640 1 -- 172.21.15.50:0/1435317531 >> v2:172.21.15.117:3300/0 conn(0x7f33bc0b3f30 msgr2=0x7f33bc0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b9d9b640 1 --2- 172.21.15.50:0/1435317531 >> v2:172.21.15.117:3300/0 conn(0x7f33bc0b3f30 0x7f33bc0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b9d9b640 1 -- 172.21.15.50:0/1435317531 >> v1:172.21.15.50:6789/0 conn(0x7f33bc15aa40 legacy=0x7f33bc0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.987+0000 7f33b9d9b640 1 -- 172.21.15.50:0/1435317531 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc071990 con 0x7f33bc0b0c60 2023-08-10T10:39:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.988+0000 7f33b9d9b640 1 --2- 172.21.15.50:0/1435317531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b0c60 0x7f33bc0c9920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cb110 tx=0x7f33b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9067fd3bf4a74703 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33b959a640 1 -- 172.21.15.50:0/1435317531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b002e070 con 0x7f33bc0b0c60 2023-08-10T10:39:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33b959a640 1 -- 172.21.15.50:0/1435317531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b00315a0 con 0x7f33bc0b0c60 2023-08-10T10:39:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33b959a640 1 -- 172.21.15.50:0/1435317531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0031930 con 0x7f33bc0b0c60 2023-08-10T10:39:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 -- 172.21.15.50:0/1435317531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b0c60 msgr2=0x7f33bc0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/1435317531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b0c60 0x7f33bc0c9920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cb110 tx=0x7f33b002b840 comp rx=0 tx=0).stop 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 -- 172.21.15.50:0/1435317531 shutdown_connections 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/1435317531 >> v2:172.21.15.117:3300/0 conn(0x7f33bc0b3f30 0x7f33bc0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/1435317531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b0c60 0x7f33bc0c9920 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.989+0000 7f33c0a3f640 1 -- 172.21.15.50:0/1435317531 >> 172.21.15.50:0/1435317531 conn(0x7f33bc06b590 msgr2=0x7f33bc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.990+0000 7f33c0a3f640 1 -- 172.21.15.50:0/1435317531 shutdown_connections 2023-08-10T10:39:46.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.990+0000 7f33c0a3f640 1 -- 172.21.15.50:0/1435317531 wait complete. 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.991+0000 7f33c0a3f640 1 Processor -- start 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.991+0000 7f33c0a3f640 1 -- start start 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33bc0b0c60 0x7f33bc151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33bc15aa40 0x7f33bc1e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1f5a90 con 0x7f33bc0b3f30 2023-08-10T10:39:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1f6610 con 0x7f33bc15aa40 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.992+0000 7f33c0a3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1f5ce0 con 0x7f33bc0b0c60 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42198/0 (socket says 172.21.15.50:42198) 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 -- 172.21.15.50:0/134231656 learned_addr learned my addr 172.21.15.50:0/134231656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33ba59c640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33bc0b0c60 0x7f33bc151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 -- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33bc0b0c60 msgr2=0x7f33bc151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33bad9d640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33bc15aa40 0x7f33bc1e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33bc0b0c60 0x7f33bc151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 -- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33bc15aa40 msgr2=0x7f33bc1e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33bc15aa40 0x7f33bc1e3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.993+0000 7f33b9d9b640 1 -- 172.21.15.50:0/134231656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0009400 con 0x7f33bc0b3f30 2023-08-10T10:39:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33b9d9b640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034040 tx=0x7f33b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0004230 con 0x7f33bc0b3f30 2023-08-10T10:39:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0031f00 con 0x7f33bc0b3f30 2023-08-10T10:39:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0032640 con 0x7f33bc0b3f30 2023-08-10T10:39:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc1f5fc0 con 0x7f33bc0b3f30 2023-08-10T10:39:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.994+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc0b2a60 con 0x7f33bc0b3f30 2023-08-10T10:39:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.995+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc1f6780 con 0x7f33bc0b3f30 2023-08-10T10:39:46.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.996+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33b00327a0 con 0x7f33bc0b3f30 2023-08-10T10:39:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.997+0000 7f33aaffd640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 0x7f339c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.997+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33b00ab560 con 0x7f33bc0b3f30 2023-08-10T10:39:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.998+0000 7f33ba59c640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 0x7f339c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:46.998+0000 7f33ba59c640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 0x7f339c06d110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000f60 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.002+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33b0076600 con 0x7f33bc0b3f30 2023-08-10T10:39:47.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.250+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33bc04e270 con 0x7f33bc0b3f30 2023-08-10T10:39:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.252+0000 7f33aaffd640 1 -- 172.21.15.50:0/134231656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f33b0079c20 con 0x7f33bc0b3f30 2023-08-10T10:39:47.252 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:47.253 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:39:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:39:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 msgr2=0x7f339c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 0x7f339c06d110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000f60 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2023-08-10T10:39:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 msgr2=0x7f33bc1e33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034040 tx=0x7f33b00046c0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 shutdown_connections 2023-08-10T10:39:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f339c06ac50 0x7f339c06d110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33bc15aa40 0x7f33bc1e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33bc0b3f30 0x7f33bc1e33f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 --2- 172.21.15.50:0/134231656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33bc0b0c60 0x7f33bc151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.254+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 >> 172.21.15.50:0/134231656 conn(0x7f33bc06b590 msgr2=0x7f33bc069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.255+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 shutdown_connections 2023-08-10T10:39:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.255+0000 7f33c0a3f640 1 -- 172.21.15.50:0/134231656 wait complete. 2023-08-10T10:39:47.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:39:40.578847+0000', 'modified': '2023-08-10T10:39:44.153086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4861': {'gid': 4861, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6834/1990431155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6832', 'nonce': 1990431155}, {'type': 'v1', 'addr': '172.21.15.117:6834', 'nonce': 1990431155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:39:47.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:39:47.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:39:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.924+0000 7f1cdb2ec640 1 Processor -- start 2023-08-10T10:39:47.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.925+0000 7f1cdb2ec640 1 -- start start 2023-08-10T10:39:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.926+0000 7f1cdb2ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cd406ac90 0x7f1cd406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.926+0000 7f1cdb2ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cd40696a0 0x7f1cd4069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.926+0000 7f1cdb2ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40b00d0 con 0x7f1cd415ced0 2023-08-10T10:39:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.926+0000 7f1cdb2ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd406b660 con 0x7f1cd40696a0 2023-08-10T10:39:47.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.926+0000 7f1cdb2ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd415d2b0 con 0x7f1cd406ac90 2023-08-10T10:39:47.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd9088640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cd415ced0 0x7f1cd40b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49090/0 (socket says 172.21.15.50:49090) 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd9088640 1 -- 172.21.15.50:0/1411037709 learned_addr learned my addr 172.21.15.50:0/1411037709 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd9889640 1 --2- 172.21.15.50:0/1411037709 >> v2:172.21.15.50:3300/0 conn(0x7f1cd40696a0 0x7f1cd4069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd8887640 1 --2- 172.21.15.50:0/1411037709 >> v2:172.21.15.117:3300/0 conn(0x7f1cd406ac90 0x7f1cd406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1ccbfff640 1 -- 172.21.15.50:0/1411037709 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740436978 0 0) 0x7f1cd40b00d0 con 0x7f1cd415ced0 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1ccbfff640 1 -- 172.21.15.50:0/1411037709 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc0003520 con 0x7f1cd415ced0 2023-08-10T10:39:47.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd9889640 1 -- 172.21.15.50:0/1411037709 >> v2:172.21.15.117:3300/0 conn(0x7f1cd406ac90 msgr2=0x7f1cd406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.927+0000 7f1cd9889640 1 --2- 172.21.15.50:0/1411037709 >> v2:172.21.15.117:3300/0 conn(0x7f1cd406ac90 0x7f1cd406b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.928+0000 7f1cd9889640 1 -- 172.21.15.50:0/1411037709 >> v1:172.21.15.50:6789/0 conn(0x7f1cd415ced0 legacy=0x7f1cd40b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.928+0000 7f1cd9889640 1 -- 172.21.15.50:0/1411037709 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd41609c0 con 0x7f1cd40696a0 2023-08-10T10:39:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.929+0000 7f1cd9889640 1 --2- 172.21.15.50:0/1411037709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd40696a0 0x7f1cd4069ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1cd406dc90 tx=0x7f1ccc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31be1eb3aaab70b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.929+0000 7f1ccbfff640 1 -- 172.21.15.50:0/1411037709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc02cc80 con 0x7f1cd40696a0 2023-08-10T10:39:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1ccbfff640 1 -- 172.21.15.50:0/1411037709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc02cde0 con 0x7f1cd40696a0 2023-08-10T10:39:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1ccbfff640 1 -- 172.21.15.50:0/1411037709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc034640 con 0x7f1cd40696a0 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/1411037709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd40696a0 msgr2=0x7f1cd4069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/1411037709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd40696a0 0x7f1cd4069ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1cd406dc90 tx=0x7f1ccc02bed0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/1411037709 shutdown_connections 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/1411037709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd40696a0 0x7f1cd4069ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/1411037709 >> v2:172.21.15.117:3300/0 conn(0x7f1cd406ac90 0x7f1cd406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.930+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/1411037709 >> 172.21.15.50:0/1411037709 conn(0x7f1cd40cd2f0 msgr2=0x7f1cd40cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.931+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/1411037709 shutdown_connections 2023-08-10T10:39:47.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.931+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/1411037709 wait complete. 2023-08-10T10:39:47.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.932+0000 7f1cdb2ec640 1 Processor -- start 2023-08-10T10:39:47.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.932+0000 7f1cdb2ec640 1 -- start start 2023-08-10T10:39:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 0x7f1cd40aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd415ced0 0x7f1cd414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c5920 con 0x7f1cd406ac90 2023-08-10T10:39:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c4d10 con 0x7f1cd40696a0 2023-08-10T10:39:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.933+0000 7f1cdb2ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c4ff0 con 0x7f1cd415ced0 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42224/0 (socket says 172.21.15.50:42224) 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 -- 172.21.15.50:0/2110291844 learned_addr learned my addr 172.21.15.50:0/2110291844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd9889640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd415ced0 0x7f1cd414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 0x7f1cd40aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 -- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd415ced0 msgr2=0x7f1cd414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd415ced0 0x7f1cd414b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 -- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 msgr2=0x7f1cd40aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 0x7f1cd40aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd8887640 1 -- 172.21.15.50:0/2110291844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009a70 con 0x7f1cd406ac90 2023-08-10T10:39:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.934+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 0x7f1cd40aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400e9b0 tx=0x7f1cc400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cc9ffb640 1 -- 172.21.15.50:0/2110291844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4009670 con 0x7f1cd406ac90 2023-08-10T10:39:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cc9ffb640 1 -- 172.21.15.50:0/2110291844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400c9a0 con 0x7f1cd406ac90 2023-08-10T10:39:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cc9ffb640 1 -- 172.21.15.50:0/2110291844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400cd50 con 0x7f1cd406ac90 2023-08-10T10:39:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd40c52d0 con 0x7f1cd406ac90 2023-08-10T10:39:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.935+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd40c5db0 con 0x7f1cd406ac90 2023-08-10T10:39:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.937+0000 7f1cc9ffb640 1 -- 172.21.15.50:0/2110291844 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cc4013470 con 0x7f1cd406ac90 2023-08-10T10:39:47.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.939+0000 7f1cc9ffb640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 0x7f1cb806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.939+0000 7f1cc9ffb640 1 -- 172.21.15.50:0/2110291844 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cc4089750 con 0x7f1cd406ac90 2023-08-10T10:39:47.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.939+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 0x7f1cb806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.940+0000 7f1cdde62740 1 Processor -- start 2023-08-10T10:39:47.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.940+0000 7f1cdde62740 1 -- start start 2023-08-10T10:39:47.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.940+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 0x7f1cb806d140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0005880 tx=0x7f1cd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x5585978858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558597859040 0x558597882c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585977c59d0 con 0x558597855440 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585977c30c0 con 0x558597859040 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585977be9b0 con 0x5585978854c0 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cd8887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cd8887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42236/0 (socket says 172.21.15.50:42236) 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.941+0000 7f1cd8887640 1 -- 172.21.15.50:0/1132982899 learned_addr learned my addr 172.21.15.50:0/1132982899 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd9889640 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558597859040 0x558597882c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd9088640 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x5585978858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 -- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 msgr2=0x5585978858a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x5585978858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 -- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558597859040 msgr2=0x558597882c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558597859040 0x558597882c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 -- 172.21.15.50:0/1132982899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55859778bc10 con 0x558597855440 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cd8887640 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c520 tx=0x7f1cc405c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06418cb95a305a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cb6ffd640 1 -- 172.21.15.50:0/1132982899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40567c0 con 0x558597855440 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cb6ffd640 1 -- 172.21.15.50:0/1132982899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4054b30 con 0x558597855440 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.942+0000 7f1cb6ffd640 1 -- 172.21.15.50:0/1132982899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4054ca0 con 0x558597855440 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 -- 172.21.15.50:0/1132982899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 msgr2=0x558597882730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c520 tx=0x7f1cc405c4a0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 -- 172.21.15.50:0/1132982899 shutdown_connections 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558597859040 0x558597882c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597855440 0x558597882730 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 --2- 172.21.15.50:0/1132982899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x5585978858a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 -- 172.21.15.50:0/1132982899 >> 172.21.15.50:0/1132982899 conn(0x558597857750 msgr2=0x5585978a02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 -- 172.21.15.50:0/1132982899 shutdown_connections 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.943+0000 7f1cdde62740 1 -- 172.21.15.50:0/1132982899 wait complete. 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.944+0000 7f1cdde62740 1 -- start start 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.944+0000 7f1cdde62740 1 Processor -- start 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x558597869730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859787b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859775f940 con 0x558597859040 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859775f5e0 con 0x55859787d540 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558597525f20 con 0x5585978854c0 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cdde62740 10 client.0 _ll_register_callbacks cb 0x5585977b8250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42252/0 (socket says 172.21.15.50:42252) 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.945+0000 7f1cd9088640 1 -- 172.21.15.50:0/4094662598 learned_addr learned my addr 172.21.15.50:0/4094662598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd8887640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x558597869730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9889640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859787b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 -- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 msgr2=0x558597869730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x558597869730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 -- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 msgr2=0x55859787b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859787b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 -- 172.21.15.50:0/4094662598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd40c5db0 con 0x558597859040 2023-08-10T10:39:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1cd9088640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00076b0 tx=0x7f1cd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217d9cfcf5a53c23 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1caffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:39:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.946+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0021630 con 0x558597859040 2023-08-10T10:39:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585977e8bf0 con 0x558597859040 2023-08-10T10:39:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cd0005e40 con 0x558597859040 2023-08-10T10:39:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd0021790 con 0x558597859040 2023-08-10T10:39:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 10 client.5328 fetch_fsmap learned FSMap version 15 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5585977bd030 con 0x558597859040 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585977e8bf0 con 0x558597859040 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1cd00218f0 con 0x558597859040 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 10 client.5328 fetch_fsmap finished waiting for FSMap version 15 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 10 client.5328 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 20 client.5328 populate_metadata read hostname 'smithi050' 2023-08-10T10:39:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859786a9d0 0x55859786c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 4 client.5328 mds_command: new command op to 4861 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.947+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 --> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585977b17c0 con 0x55859786a9d0 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.948+0000 7f1cd8887640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859786a9d0 0x55859786c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.949+0000 7f1cd8887640 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859786a9d0 0x55859786c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c7985e1aaa52141 server_cookie=755d9da654bd8643 in_seq=0 out_seq=0 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.949+0000 7f1caffff640 10 client.5328 ms_handle_connect on v2:172.21.15.117:6832/1990431155 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1caffff640 1 -- 172.21.15.50:0/4094662598 <== mds.0 v2:172.21.15.117:6832/1990431155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5585977b17c0 con 0x55859786a9d0 2023-08-10T10:39:47.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1caffff640 10 client.5328 handle_command_reply: tid=0 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 client.5328 shutdown 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 msgr2=0x55859787e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00076b0 tx=0x7f1cd0000bc0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 shutdown_connections 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859786a9d0 0x55859786c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859787b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x558597869730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 --2- 172.21.15.50:0/4094662598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859787e810 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1caffff640 0 client.5328 ms_handle_reset on v2:172.21.15.117:6832/1990431155 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 >> 172.21.15.50:0/4094662598 conn(0x558597855440 msgr2=0x558597889160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 shutdown_connections 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.951+0000 7f1cdde62740 1 -- 172.21.15.50:0/4094662598 wait complete. 2023-08-10T10:39:47.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.952+0000 7f1cdde62740 20 client.5328 trim_cache size 0 max 16384 2023-08-10T10:39:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.969+0000 7f1cdde62740 1 Processor -- start 2023-08-10T10:39:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.969+0000 7f1cdde62740 1 -- start start 2023-08-10T10:39:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55859787d540 0x558597859a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585978854c0 0x5585978808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859787b630 con 0x558597859040 2023-08-10T10:39:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585978a33f0 con 0x5585978854c0 2023-08-10T10:39:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558597880230 con 0x55859787d540 2023-08-10T10:39:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42254/0 (socket says 172.21.15.50:42254) 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 -- 172.21.15.50:0/805147142 learned_addr learned my addr 172.21.15.50:0/805147142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 -- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55859787d540 msgr2=0x558597859a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55859787d540 0x558597859a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 -- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585978854c0 msgr2=0x5585978808e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585978854c0 0x5585978808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.970+0000 7f1cd9088640 1 -- 172.21.15.50:0/805147142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585977f28a0 con 0x558597859040 2023-08-10T10:39:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cd9088640 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0001580 tx=0x7f1cd001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1118ca84a0ccaafd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cb77fe640 1 -- 172.21.15.50:0/805147142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000dd50 con 0x558597859040 2023-08-10T10:39:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cb77fe640 1 -- 172.21.15.50:0/805147142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd001a050 con 0x558597859040 2023-08-10T10:39:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cb77fe640 1 -- 172.21.15.50:0/805147142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0021430 con 0x558597859040 2023-08-10T10:39:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cdde62740 1 -- 172.21.15.50:0/805147142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 msgr2=0x558597859540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.971+0000 7f1cdde62740 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0001580 tx=0x7f1cd001d000 comp rx=0 tx=0).stop 2023-08-10T10:39:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 -- 172.21.15.50:0/805147142 shutdown_connections 2023-08-10T10:39:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585978854c0 0x5585978808e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55859787d540 0x558597859a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 --2- 172.21.15.50:0/805147142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x558597859540 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 -- 172.21.15.50:0/805147142 >> 172.21.15.50:0/805147142 conn(0x558597855440 msgr2=0x55859787c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 -- 172.21.15.50:0/805147142 shutdown_connections 2023-08-10T10:39:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 -- 172.21.15.50:0/805147142 wait complete. 2023-08-10T10:39:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.972+0000 7f1cdde62740 1 -- start start 2023-08-10T10:39:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.973+0000 7f1cdde62740 1 Processor -- start 2023-08-10T10:39:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859785a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x55859787a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859787e8d0 con 0x558597859040 2023-08-10T10:39:47.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585978bb7b0 con 0x55859787d540 2023-08-10T10:39:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55859787b080 con 0x5585978854c0 2023-08-10T10:39:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cdde62740 10 client.0 _ll_register_callbacks cb 0x7f1cd0007300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:39:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42264/0 (socket says 172.21.15.50:42264) 2023-08-10T10:39:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 -- 172.21.15.50:0/2339182964 learned_addr learned my addr 172.21.15.50:0/2339182964 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859785a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 -- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 msgr2=0x55859787a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9889640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x55859787a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x55859787a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 -- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 msgr2=0x55859785a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859785a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9088640 1 -- 172.21.15.50:0/2339182964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585977bd030 con 0x558597859040 2023-08-10T10:39:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd9889640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x55859787a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.974+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859785a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1cd9088640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00076b0 tx=0x7f1cd0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afd096e68fd929 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1caffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd002b430 con 0x558597859040 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cd002b590 con 0x558597859040 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cc4054b30 con 0x558597859040 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd002b750 con 0x558597859040 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1cdde62740 10 client.5334 fetch_fsmap learned FSMap version 15 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.975+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55859775e610 con 0x558597859040 2023-08-10T10:39:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4054b30 con 0x558597859040 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1cd002b8b0 con 0x558597859040 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 10 client.5334 fetch_fsmap finished waiting for FSMap version 15 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 10 client.5334 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 20 client.5334 populate_metadata read hostname 'smithi050' 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859787a950 0x55859787da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 4 client.5334 mds_command: new command op to 4861 tid=0[{"prefix": "status"}] 2023-08-10T10:39:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.976+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 --> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585977b7990 con 0x55859787a950 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.977+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859787a950 0x55859787da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.977+0000 7f1cd8887640 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859787a950 0x55859787da20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2979bda3493be7f5 server_cookie=8ec5d0cfff0b2a1e in_seq=0 out_seq=0 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.977+0000 7f1caffff640 10 client.5334 ms_handle_connect on v2:172.21.15.117:6832/1990431155 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1caffff640 1 -- 172.21.15.50:0/2339182964 <== mds.0 v2:172.21.15.117:6832/1990431155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5585977b7990 con 0x55859787a950 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1caffff640 10 client.5334 handle_command_reply: tid=0 2023-08-10T10:39:47.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 client.5334 shutdown 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 msgr2=0x55859790c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00076b0 tx=0x7f1cd0007000 comp rx=0 tx=0).stop 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 shutdown_connections 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:6832/1990431155,v1:172.21.15.117:6834/1990431155] conn(0x55859787a950 0x55859787da20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585978854c0 0x55859787a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55859787d540 0x55859785a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 --2- 172.21.15.50:0/2339182964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558597859040 0x55859790c000 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1caffff640 0 client.5334 ms_handle_reset on v2:172.21.15.117:6832/1990431155 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.978+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 >> 172.21.15.50:0/2339182964 conn(0x558597855440 msgr2=0x5585978a37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 shutdown_connections 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdde62740 1 -- 172.21.15.50:0/2339182964 wait complete. 2023-08-10T10:39:47.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdde62740 20 client.5334 trim_cache size 0 max 16384 2023-08-10T10:39:47.994 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:39:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:39:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:39:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4861, 2023-08-10T10:39:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.8386796370000003, 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 15, 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 37, 2023-08-10T10:39:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 37, 2023-08-10T10:39:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.040097901999999 2023-08-10T10:39:47.996 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:39:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 msgr2=0x7f1cb806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 0x7f1cb806d140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0005880 tx=0x7f1cd0009040 comp rx=0 tx=0).stop 2023-08-10T10:39:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 msgr2=0x7f1cd40c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400e9b0 tx=0x7f1cc400ee70 comp rx=0 tx=0).stop 2023-08-10T10:39:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 shutdown_connections 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd415ced0 0x7f1cd414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd406ac90 0x7f1cd40c43a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cb806ac80 0x7f1cb806d140 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 --2- 172.21.15.50:0/2110291844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cd40696a0 0x7f1cd40aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.979+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 >> 172.21.15.50:0/2110291844 conn(0x7f1cd40cd2f0 msgr2=0x7f1cd415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.980+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 shutdown_connections 2023-08-10T10:39:47.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:47.980+0000 7f1cdb2ec640 1 -- 172.21.15.50:0/2110291844 wait complete. 2023-08-10T10:39:48.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:39:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.214+0000 7fa391457640 1 Processor -- start 2023-08-10T10:39:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.214+0000 7fa391457640 1 -- start start 2023-08-10T10:39:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa391457640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 0x7fa38c167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa391457640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c161180 con 0x7fa38c0b8430 2023-08-10T10:39:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa391457640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c161460 con 0x7fa38c15cd60 2023-08-10T10:39:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa391457640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0b5bd0 con 0x7fa38c0cdf80 2023-08-10T10:39:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa3827fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa38c0b8430 0x7fa38c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49106/0 (socket says 172.21.15.50:49106) 2023-08-10T10:39:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa3827fc640 1 -- 172.21.15.50:0/166209422 learned_addr learned my addr 172.21.15.50:0/166209422 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.216+0000 7fa38b7fe640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 0x7fa38c167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298130805 0 0) 0x7fa38c161180 con 0x7fa38c0b8430 2023-08-10T10:39:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa378003520 con 0x7fa38c0b8430 2023-08-10T10:39:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 534433087 0 0) 0x7fa378003520 con 0x7fa38c0b8430 2023-08-10T10:39:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 msgr2=0x7fa38c167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 0x7fa38c167c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 >> v1:172.21.15.117:6789/0 conn(0x7fa38c15cd60 legacy=0x7fa38c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c161740 con 0x7fa38c0b8430 2023-08-10T10:39:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa374001670 con 0x7fa38c0b8430 2023-08-10T10:39:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 >> v1:172.21.15.50:6789/0 conn(0x7fa38c0b8430 legacy=0x7fa38c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa378003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780047c0 0x7fa378004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 0x7fa378005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0b5bd0 con 0x7fa3780039a0 2023-08-10T10:39:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37800baf0 con 0x7fa3780047c0 2023-08-10T10:39:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37800bcb0 con 0x7fa38c0cdf80 2023-08-10T10:39:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.217+0000 7fa38affd640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa378003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa38affd640 1 -- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 msgr2=0x7fa378005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa38affd640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0cdf80 0x7fa378005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa3827fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780047c0 0x7fa378004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa38affd640 1 -- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780047c0 msgr2=0x7fa378004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa38affd640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780047c0 0x7fa378004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa38affd640 1 -- 172.21.15.50:0/166209422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378003520 con 0x7fa3780039a0 2023-08-10T10:39:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.218+0000 7fa3827fc640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780047c0 0x7fa378004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.219+0000 7fa38affd640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa378003dc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa37c001720 tx=0x7fa3780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c5602ab945db6a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.219+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0052d0 con 0x7fa3780039a0 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.219+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c02e050 con 0x7fa3780039a0 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.219+0000 7fa38a7fc640 1 -- 172.21.15.50:0/166209422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0035f0 con 0x7fa3780039a0 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 -- 172.21.15.50:0/166209422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 msgr2=0x7fa378003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 --2- 172.21.15.50:0/166209422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa378003dc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa37c001720 tx=0x7fa3780057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa38b7fe640 1 -- 172.21.15.50:0/166209422 reap_dead start 2023-08-10T10:39:48.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 -- 172.21.15.50:0/166209422 shutdown_connections 2023-08-10T10:39:48.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 -- 172.21.15.50:0/166209422 >> 172.21.15.50:0/166209422 conn(0x7fa38c0d2ac0 msgr2=0x7fa38c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:48.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 -- 172.21.15.50:0/166209422 shutdown_connections 2023-08-10T10:39:48.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.220+0000 7fa391457640 1 -- 172.21.15.50:0/166209422 wait complete. 2023-08-10T10:39:48.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.222+0000 7fa391457640 1 Processor -- start 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.222+0000 7fa391457640 1 -- start start 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38c15d3e0 0x7fa38c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 0x7fa38c0aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0ab000 con 0x7fa3780039a0 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1f2510 con 0x7fa38c15d3e0 2023-08-10T10:39:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa391457640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c15eb50 con 0x7fa38c0aa640 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa38affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa38affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42280/0 (socket says 172.21.15.50:42280) 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.223+0000 7fa38affd640 1 -- 172.21.15.50:0/2852992832 learned_addr learned my addr 172.21.15.50:0/2852992832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa3827fc640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38c15d3e0 0x7fa38c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38b7fe640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 0x7fa38c0aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 -- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 msgr2=0x7fa38c0aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 0x7fa38c0aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 -- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38c15d3e0 msgr2=0x7fa38c0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38c15d3e0 0x7fa38c0b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 -- 172.21.15.50:0/2852992832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c15ee30 con 0x7fa3780039a0 2023-08-10T10:39:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38b7fe640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 0x7fa38c0aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.224+0000 7fa38affd640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa37c008fd0 tx=0x7fa37c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.225+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0076c0 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.225+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c007a30 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.225+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c006be0 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.225+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c15f110 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.225+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c15e810 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.226+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c1f2680 con 0x7fa3780039a0 2023-08-10T10:39:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.227+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa37c006d40 con 0x7fa3780039a0 2023-08-10T10:39:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.228+0000 7fa383fff640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 0x7fa36c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.228+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa37c0ab6c0 con 0x7fa3780039a0 2023-08-10T10:39:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.228+0000 7fa3827fc640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 0x7fa36c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.229+0000 7fa3827fc640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 0x7fa36c06d110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa38c15f7b0 tx=0x7fa374001b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.233+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa38c1f2680 con 0x7fa3780039a0 2023-08-10T10:39:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.465+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa38c1f2680 con 0x7fa3780039a0 2023-08-10T10:39:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.466+0000 7fa383fff640 1 -- 172.21.15.50:0/2852992832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa37c04b060 con 0x7fa3780039a0 2023-08-10T10:39:48.468 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:39:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 msgr2=0x7fa36c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 0x7fa36c06d110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa38c15f7b0 tx=0x7fa374001b20 comp rx=0 tx=0).stop 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 msgr2=0x7fa38c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa37c008fd0 tx=0x7fa37c001120 comp rx=0 tx=0).stop 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 shutdown_connections 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38c0aa640 0x7fa38c0aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa36c06ac50 0x7fa36c06d110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38c15d3e0 0x7fa38c0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 --2- 172.21.15.50:0/2852992832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3780039a0 0x7fa38c15e2d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 >> 172.21.15.50:0/2852992832 conn(0x7fa38c0d2ac0 msgr2=0x7fa38c0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 shutdown_connections 2023-08-10T10:39:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:48.469+0000 7fa391457640 1 -- 172.21.15.50:0/2852992832 wait complete. 2023-08-10T10:39:48.490 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:39:48.490 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:39:48.491 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:39:48.491 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:39:48.491 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:39:48.491 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:39:48.492 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:39:48.492 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:39:48.492 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:39:48.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.493 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:39:48.547 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:39:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:39:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:39:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:39:48.548 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:39:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41137sec preferred_lft 41137sec 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:39:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.552 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:39:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:39:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:39:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:48.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.554 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:39:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:39:48.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.659 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:39:48.717 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:39:48.717 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:39:48.718 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:39:48.718 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:39:48.718 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:39:48.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.719 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:39:48.719 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:39:48.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:39:48.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:39:48.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:39:48.721 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:39:48.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.924 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:39:48.981 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:39:48.981 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:39:48.982 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:39:48.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:48.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:39:49.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:39:49.087 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:39:49.146 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:39:49.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:39:49.210 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:39:49.273 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:39:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:49.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:49.432 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:49.432 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:39:49.468 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:49.468 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:39:49.468 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:39:49.469 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:39:49.469 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:39:49.472 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:39:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:39:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:39:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:39:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:39:49.476 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:39:49.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:49.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:39:49.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:49.569 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:client4751 2023-08-10T10:39:49.653 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:49.654 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:49.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:39:49.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.940+0000 7f41eefb5640 1 Processor -- start 2023-08-10T10:39:49.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.940+0000 7f41eefb5640 1 -- start start 2023-08-10T10:39:49.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41eefb5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41e80c1af0 0x7f41e80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41eefb5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e80b2f40 0x7f41e806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41eefb5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e806f6f0 con 0x7f41e8069be0 2023-08-10T10:39:49.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41eefb5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e81617f0 con 0x7f41e80b2f40 2023-08-10T10:39:49.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41eefb5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e806a050 con 0x7f41e80c1af0 2023-08-10T10:39:49.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41ed552640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e80b2f40 0x7f41e806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41e7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41e8069be0 0x7f41e80b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49122/0 (socket says 172.21.15.50:49122) 2023-08-10T10:39:49.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.942+0000 7f41e7fff640 1 -- 172.21.15.50:0/2856203267 learned_addr learned my addr 172.21.15.50:0/2856203267 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:49.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41ecd51640 1 --2- 172.21.15.50:0/2856203267 >> v2:172.21.15.117:3300/0 conn(0x7f41e80c1af0 0x7f41e80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41ed552640 1 -- 172.21.15.50:0/2856203267 >> v2:172.21.15.117:3300/0 conn(0x7f41e80c1af0 msgr2=0x7f41e80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41ed552640 1 --2- 172.21.15.50:0/2856203267 >> v2:172.21.15.117:3300/0 conn(0x7f41e80c1af0 0x7f41e80696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41ed552640 1 -- 172.21.15.50:0/2856203267 >> v1:172.21.15.50:6789/0 conn(0x7f41e8069be0 legacy=0x7f41e80b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41ed552640 1 -- 172.21.15.50:0/2856203267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e806edc0 con 0x7f41e80b2f40 2023-08-10T10:39:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.943+0000 7f41e77fe640 1 -- 172.21.15.50:0/2856203267 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119886662 0 0) 0x7f41e806f6f0 con 0x7f41e8069be0 2023-08-10T10:39:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.944+0000 7f41ed552640 1 --2- 172.21.15.50:0/2856203267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e80b2f40 0x7f41e806fb80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41e806bba0 tx=0x7f41e002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4625dc2fa6ca996 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.944+0000 7f41e77fe640 1 -- 172.21.15.50:0/2856203267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e002ccf0 con 0x7f41e80b2f40 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41e77fe640 1 -- 172.21.15.50:0/2856203267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e002ce50 con 0x7f41e80b2f40 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41e77fe640 1 -- 172.21.15.50:0/2856203267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0034660 con 0x7f41e80b2f40 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 -- 172.21.15.50:0/2856203267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e80b2f40 msgr2=0x7f41e806fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2856203267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e80b2f40 0x7f41e806fb80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41e806bba0 tx=0x7f41e002bf40 comp rx=0 tx=0).stop 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 -- 172.21.15.50:0/2856203267 shutdown_connections 2023-08-10T10:39:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2856203267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e80b2f40 0x7f41e806fb80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2856203267 >> v2:172.21.15.117:3300/0 conn(0x7f41e80c1af0 0x7f41e80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 -- 172.21.15.50:0/2856203267 >> 172.21.15.50:0/2856203267 conn(0x7f41e806b590 msgr2=0x7f41e80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 -- 172.21.15.50:0/2856203267 shutdown_connections 2023-08-10T10:39:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.945+0000 7f41eefb5640 1 -- 172.21.15.50:0/2856203267 wait complete. 2023-08-10T10:39:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.947+0000 7f41eefb5640 1 Processor -- start 2023-08-10T10:39:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.947+0000 7f41eefb5640 1 -- start start 2023-08-10T10:39:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 0x7f41e81faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e80c1af0 0x7f41e8164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81fb030 con 0x7f41e8069be0 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80c5070 con 0x7f41e80c1af0 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.948+0000 7f41eefb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8157830 con 0x7f41e80b2f40 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42302/0 (socket says 172.21.15.50:42302) 2023-08-10T10:39:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 -- 172.21.15.50:0/2657654910 learned_addr learned my addr 172.21.15.50:0/2657654910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41e7fff640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 0x7f41e81faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 -- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 msgr2=0x7f41e81faaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 0x7f41e81faaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 -- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e80c1af0 msgr2=0x7f41e8164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ed552640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e80c1af0 0x7f41e8164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e80c1af0 0x7f41e8164260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41ecd51640 1 -- 172.21.15.50:0/2657654910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009a70 con 0x7f41e8069be0 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.949+0000 7f41e7fff640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 0x7f41e81faaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41ecd51640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00d5f0 tx=0x7f41dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0125f0 con 0x7f41e8069be0 2023-08-10T10:39:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc012750 con 0x7f41e8069be0 2023-08-10T10:39:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc012b00 con 0x7f41e8069be0 2023-08-10T10:39:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e80c4d90 con 0x7f41e8069be0 2023-08-10T10:39:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.950+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e81574c0 con 0x7f41e8069be0 2023-08-10T10:39:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.951+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e80caf40 con 0x7f41e8069be0 2023-08-10T10:39:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.952+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41dc012c60 con 0x7f41e8069be0 2023-08-10T10:39:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.953+0000 7f41e57fa640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 0x7f41cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.953+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41dc0899c0 con 0x7f41e8069be0 2023-08-10T10:39:49.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.953+0000 7f41e7fff640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 0x7f41cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:49.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.954+0000 7f41e7fff640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 0x7f41cc06d110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41e815fb40 tx=0x7f41d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:49.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:49.957+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f41dc054a60 con 0x7f41e8069be0 2023-08-10T10:39:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.189+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41e8157040 con 0x7f41e8069be0 2023-08-10T10:39:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.190+0000 7f41e57fa640 1 -- 172.21.15.50:0/2657654910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f41e8157040 con 0x7f41e8069be0 2023-08-10T10:39:50.191 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:39:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.192+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 msgr2=0x7f41cc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.192+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 0x7f41cc06d110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41e815fb40 tx=0x7f41d4009040 comp rx=0 tx=0).stop 2023-08-10T10:39:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.192+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 msgr2=0x7f41e80c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.192+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00d5f0 tx=0x7f41dc00dab0 comp rx=0 tx=0).stop 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 shutdown_connections 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41cc06ac50 0x7f41cc06d110 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e80c1af0 0x7f41e8164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e80b2f40 0x7f41e81faaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 --2- 172.21.15.50:0/2657654910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e8069be0 0x7f41e80c4680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 >> 172.21.15.50:0/2657654910 conn(0x7f41e806b590 msgr2=0x7f41e8159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 shutdown_connections 2023-08-10T10:39:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:50.193+0000 7f41eefb5640 1 -- 172.21.15.50:0/2657654910 wait complete. 2023-08-10T10:39:50.213 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:39:50.214 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:39:50.214 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:39:50.214 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:39:50.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:39:50.215 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:39:50.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:39:50.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:39:50.216 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:39:50.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.216 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:39:50.276 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:39:50.276 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:39:50.276 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:39:50.276 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:50.277 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:50.278 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41307sec preferred_lft 41307sec 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:39:50.279 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.280 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:39:50.281 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:39:50.281 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:39:50.281 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:39:50.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.283 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:39:50.377 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:39:50.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.381 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:39:50.440 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:39:50.441 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:39:50.441 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:39:50.441 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:39:50.441 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:39:50.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.443 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:39:50.444 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:39:50.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:39:50.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:39:50.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:39:50.446 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:39:50.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.632 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:39:50.680 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:39:50.681 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:39:50.681 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:39:50.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:39:50.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:39:50.769 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:39:50.822 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:39:50.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:39:50.823 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:39:50.875 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:39:50.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:50.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:51.004 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:51.005 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:39:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:39:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:39:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:39:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:39:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:39:51.036 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:39:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:39:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:39:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:39:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:39:51.040 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:39:51.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:51.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:39:51.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:51.118 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:51.173 INFO:teuthology.orchestra.run.smithi117.stdout:client4754 2023-08-10T10:39:51.173 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:39:51.174 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:51.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.454+0000 7fac8e258640 1 Processor -- start 2023-08-10T10:39:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.454+0000 7fac8e258640 1 -- start start 2023-08-10T10:39:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8e258640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac880b0620 0x7fac880ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8e258640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac881646f0 0x7fac88166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8e258640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac881604d0 con 0x7fac881600f0 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8e258640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac880cca30 con 0x7fac881646f0 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8e258640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880cc100 con 0x7fac880b0620 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8d256640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac881600f0 0x7fac880aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49132/0 (socket says 172.21.15.50:49132) 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8d256640 1 -- 172.21.15.50:0/1754643386 learned_addr learned my addr 172.21.15.50:0/1754643386 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8da57640 1 --2- 172.21.15.50:0/1754643386 >> v2:172.21.15.50:3300/0 conn(0x7fac881646f0 0x7fac88166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.456+0000 7fac8ca55640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac880b0620 0x7fac880ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac7ffff640 1 -- 172.21.15.50:0/1754643386 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914112381 0 0) 0x7fac881604d0 con 0x7fac881600f0 2023-08-10T10:39:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac7ffff640 1 -- 172.21.15.50:0/1754643386 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac74003520 con 0x7fac881600f0 2023-08-10T10:39:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac8da57640 1 -- 172.21.15.50:0/1754643386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac880b0620 msgr2=0x7fac880ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac8da57640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac880b0620 0x7fac880ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac8da57640 1 -- 172.21.15.50:0/1754643386 >> v1:172.21.15.50:6789/0 conn(0x7fac881600f0 legacy=0x7fac880aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.457+0000 7fac8da57640 1 -- 172.21.15.50:0/1754643386 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880cc3e0 con 0x7fac881646f0 2023-08-10T10:39:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.458+0000 7fac8da57640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88166ae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac80009d90 tx=0x7fac8002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da57a858f87fa52e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.458+0000 7fac7ffff640 1 -- 172.21.15.50:0/1754643386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8002cbd0 con 0x7fac881646f0 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.458+0000 7fac7ffff640 1 -- 172.21.15.50:0/1754643386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8002cd30 con 0x7fac881646f0 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.458+0000 7fac7ffff640 1 -- 172.21.15.50:0/1754643386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8002cea0 con 0x7fac881646f0 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 -- 172.21.15.50:0/1754643386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 msgr2=0x7fac88166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88166ae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac80009d90 tx=0x7fac8002be20 comp rx=0 tx=0).stop 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 -- 172.21.15.50:0/1754643386 shutdown_connections 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88166ae0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 --2- 172.21.15.50:0/1754643386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac880b0620 0x7fac880ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 -- 172.21.15.50:0/1754643386 >> 172.21.15.50:0/1754643386 conn(0x7fac8806ab80 msgr2=0x7fac8806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 -- 172.21.15.50:0/1754643386 shutdown_connections 2023-08-10T10:39:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.459+0000 7fac8e258640 1 -- 172.21.15.50:0/1754643386 wait complete. 2023-08-10T10:39:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.461+0000 7fac8e258640 1 Processor -- start 2023-08-10T10:39:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.461+0000 7fac8e258640 1 -- start start 2023-08-10T10:39:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 0x7fac88151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac881600f0 0x7fac88156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac881521d0 con 0x7fac881646f0 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880c2950 con 0x7fac880b0620 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8e258640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880c2c30 con 0x7fac881600f0 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8da57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8da57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42328/0 (socket says 172.21.15.50:42328) 2023-08-10T10:39:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.462+0000 7fac8da57640 1 -- 172.21.15.50:0/2562044342 learned_addr learned my addr 172.21.15.50:0/2562044342 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8ca55640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac881600f0 0x7fac88156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8d256640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 0x7fac88151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 -- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac881600f0 msgr2=0x7fac88156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac881600f0 0x7fac88156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 -- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 msgr2=0x7fac88151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 0x7fac88151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 -- 172.21.15.50:0/2562044342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009a70 con 0x7fac881646f0 2023-08-10T10:39:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8d256640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 0x7fac88151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac8da57640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fac80009eb0 tx=0x7fac80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.463+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8002cea0 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.464+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8003e610 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.464+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8003ea00 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.464+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac880c2f10 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.464+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac88152430 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.465+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880c3430 con 0x7fac881646f0 2023-08-10T10:39:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.466+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac8003b050 con 0x7fac881646f0 2023-08-10T10:39:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.467+0000 7fac7dffb640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 0x7fac6c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.467+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac800ab590 con 0x7fac881646f0 2023-08-10T10:39:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.467+0000 7fac8d256640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 0x7fac6c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.468+0000 7fac8d256640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 0x7fac6c06d110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac84005880 tx=0x7fac84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.471+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac880c3430 con 0x7fac881646f0 2023-08-10T10:39:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.700+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac880c3430 con 0x7fac881646f0 2023-08-10T10:39:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.701+0000 7fac7dffb640 1 -- 172.21.15.50:0/2562044342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fac880c3430 con 0x7fac881646f0 2023-08-10T10:39:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:51.703 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:39:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:39:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.703+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 msgr2=0x7fac6c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.703+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 0x7fac6c06d110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac84005880 tx=0x7fac84009040 comp rx=0 tx=0).stop 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.703+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 msgr2=0x7fac88156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fac80009eb0 tx=0x7fac80004a40 comp rx=0 tx=0).stop 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 shutdown_connections 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac881646f0 0x7fac88156880 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac881600f0 0x7fac88156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac6c06ac50 0x7fac6c06d110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 --2- 172.21.15.50:0/2562044342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac880b0620 0x7fac88151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 >> 172.21.15.50:0/2562044342 conn(0x7fac8806ab80 msgr2=0x7fac880cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 shutdown_connections 2023-08-10T10:39:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:51.704+0000 7fac8e258640 1 -- 172.21.15.50:0/2562044342 wait complete. 2023-08-10T10:39:51.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-08-10T10:39:51.967 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":4861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.811137421,"mdsmap_epoch":15,"osdmap_epoch":37,"osdmap_epoch_barrier":37,"uptime":21.012509231999999} 2023-08-10T10:39:51.967 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 4861, "mdsmap_epoch": 15, "osdmap_epoch": 37, "osdmap_epoch_barrier": 37, "rank_uptime": 10.811137421, "state": "up:active", "uptime": 21.012509232, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:39:51.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-08-10T10:39:52.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.208+0000 7f898e360640 1 Processor -- start 2023-08-10T10:39:52.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.208+0000 7f898e360640 1 -- start start 2023-08-10T10:39:52.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898e360640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89880b0620 0x7f89880b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:52.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898e360640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880b1f10 con 0x7f898815f2b0 2023-08-10T10:39:52.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898e360640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898815e7d0 con 0x7f898815a940 2023-08-10T10:39:52.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898e360640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880b21f0 con 0x7f89880b0620 2023-08-10T10:39:52.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898db5f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f898815f2b0 0x7f89880ca740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898db5f640 1 -- 172.21.15.50:0/978627393 learned_addr learned my addr 172.21.15.50:0/978627393 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.210+0000 7f898cb5d640 1 --2- 172.21.15.50:0/978627393 >> v2:172.21.15.50:3300/0 conn(0x7f89880b0620 0x7f89880b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.211+0000 7f898cb5d640 1 -- 172.21.15.50:0/978627393 >> v1:172.21.15.117:6789/0 conn(0x7f898815a940 legacy=0x7f89880aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.211+0000 7f898cb5d640 1 -- 172.21.15.50:0/978627393 >> v1:172.21.15.50:6789/0 conn(0x7f898815f2b0 legacy=0x7f89880ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.211+0000 7f898cb5d640 1 -- 172.21.15.50:0/978627393 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898815eab0 con 0x7f89880b0620 2023-08-10T10:39:52.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.211+0000 7f897ffff640 1 -- 172.21.15.50:0/978627393 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265649262 0 0) 0x7f89880b1f10 con 0x7f898815f2b0 2023-08-10T10:39:52.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.212+0000 7f898cb5d640 1 --2- 172.21.15.50:0/978627393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89880b0620 0x7f89880b12c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d7e6f0ab9827da server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:52.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.212+0000 7f897ffff640 1 -- 172.21.15.50:0/978627393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897802e070 con 0x7f89880b0620 2023-08-10T10:39:52.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.212+0000 7f897ffff640 1 -- 172.21.15.50:0/978627393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780315a0 con 0x7f89880b0620 2023-08-10T10:39:52.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.212+0000 7f897ffff640 1 -- 172.21.15.50:0/978627393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978031930 con 0x7f89880b0620 2023-08-10T10:39:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 -- 172.21.15.50:0/978627393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89880b0620 msgr2=0x7f89880b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 --2- 172.21.15.50:0/978627393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89880b0620 0x7f89880b12c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802b840 comp rx=0 tx=0).stop 2023-08-10T10:39:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 -- 172.21.15.50:0/978627393 shutdown_connections 2023-08-10T10:39:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 --2- 172.21.15.50:0/978627393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89880b0620 0x7f89880b12c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 -- 172.21.15.50:0/978627393 >> 172.21.15.50:0/978627393 conn(0x7f898806ab80 msgr2=0x7f898806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:52.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 -- 172.21.15.50:0/978627393 shutdown_connections 2023-08-10T10:39:52.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.213+0000 7f898e360640 1 -- 172.21.15.50:0/978627393 wait complete. 2023-08-10T10:39:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.215+0000 7f898e360640 1 Processor -- start 2023-08-10T10:39:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.215+0000 7f898e360640 1 -- start start 2023-08-10T10:39:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89880b0620 0x7f89881549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898815a940 0x7f89880c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880c7070 con 0x7f898815f2b0 2023-08-10T10:39:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988154f20 con 0x7f898815a940 2023-08-10T10:39:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.216+0000 7f898e360640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89880c8360 con 0x7f89880b0620 2023-08-10T10:39:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42344/0 (socket says 172.21.15.50:42344) 2023-08-10T10:39:52.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 -- 172.21.15.50:0/1806130576 learned_addr learned my addr 172.21.15.50:0/1806130576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:52.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 -- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89880b0620 msgr2=0x7f89881549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89880b0620 0x7f89881549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 -- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898815a940 msgr2=0x7f89880c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898815a940 0x7f89880c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 -- 172.21.15.50:0/1806130576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009400 con 0x7f898815f2b0 2023-08-10T10:39:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.217+0000 7f898db5f640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f898000c700 tx=0x7f898000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.218+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000ce10 con 0x7f898815f2b0 2023-08-10T10:39:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.218+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000a640 con 0x7f898815f2b0 2023-08-10T10:39:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.218+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000a9f0 con 0x7f898815f2b0 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.218+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89880c72c0 con 0x7f898815f2b0 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.218+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89880c7880 con 0x7f898815f2b0 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.219+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8988066e30 con 0x7f898815f2b0 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.220+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f898000ab50 con 0x7f898815f2b0 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.221+0000 7f897dffb640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 0x7f896c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.221+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8980088970 con 0x7f898815f2b0 2023-08-10T10:39:52.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.221+0000 7f898d35e640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 0x7f896c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:52.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.222+0000 7f898d35e640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 0x7f896c06d110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8984003cc0 tx=0x7f89840079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:52.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.225+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8980053980 con 0x7f898815f2b0 2023-08-10T10:39:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.490+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f89880b0dc0 con 0x7f898815f2b0 2023-08-10T10:39:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.491+0000 7f897dffb640 1 -- 172.21.15.50:0/1806130576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1922 (secure 0 0 0) 0x7f8980018090 con 0x7f898815f2b0 2023-08-10T10:39:52.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:52.493 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:39:52.493 INFO:teuthology.orchestra.run.smithi050.stdout: "stats": { 2023-08-10T10:39:52.493 INFO:teuthology.orchestra.run.smithi050.stdout: "total_bytes": 1600000000, 2023-08-10T10:39:52.493 INFO:teuthology.orchestra.run.smithi050.stdout: "total_avail_bytes": 1597414754, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_bytes": 2585246, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_raw_bytes": 2585246, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_raw_ratio": 0.0016157787758857012, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "num_osds": 8, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "num_per_pool_osds": 0, 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: "num_per_pool_omap_osds": 0 2023-08-10T10:39:52.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "stats_by_class": { 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "hdd": { 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "total_bytes": 1600000000, 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "total_avail_bytes": 1597414754, 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_bytes": 2585246, 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_raw_bytes": 2585246, 2023-08-10T10:39:52.495 INFO:teuthology.orchestra.run.smithi050.stdout: "total_used_raw_ratio": 0.0016157787758857012 2023-08-10T10:39:52.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:52.496 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:39:52.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": ".mgr", 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1, 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "stats": { 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "stored": 590368, 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "objects": 2, 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "kb_used": 577, 2023-08-10T10:39:52.497 INFO:teuthology.orchestra.run.smithi050.stdout: "bytes_used": 590368, 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: "percent_used": 0.00052973860874772072, 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: "max_avail": 556930624 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd", 2023-08-10T10:39:52.498 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2, 2023-08-10T10:39:52.499 INFO:teuthology.orchestra.run.smithi050.stdout: "stats": { 2023-08-10T10:39:52.499 INFO:teuthology.orchestra.run.smithi050.stdout: "stored": 0, 2023-08-10T10:39:52.499 INFO:teuthology.orchestra.run.smithi050.stdout: "objects": 0, 2023-08-10T10:39:52.499 INFO:teuthology.orchestra.run.smithi050.stdout: "kb_used": 0, 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bytes_used": 0, 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: "percent_used": 0, 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: "max_avail": 556930624 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:52.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs_metadata", 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5, 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "stats": { 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "stored": 2362, 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "objects": 22, 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "kb_used": 3, 2023-08-10T10:39:52.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bytes_used": 2362, 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: "percent_used": 2.1205469238338992e-06, 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: "max_avail": 556930624 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephfs_data", 2023-08-10T10:39:52.502 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "stats": { 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "stored": 0, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "objects": 0, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "kb_used": 0, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "bytes_used": 0, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "percent_used": 0, 2023-08-10T10:39:52.503 INFO:teuthology.orchestra.run.smithi050.stdout: "max_avail": 556930624 2023-08-10T10:39:52.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:39:52.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:39:52.504 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:39:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.493+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 msgr2=0x7f896c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.493+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 0x7f896c06d110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8984003cc0 tx=0x7f89840079b0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.493+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 msgr2=0x7f89880c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.493+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f898000c700 tx=0x7f898000cbc0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 shutdown_connections 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f898815f2b0 0x7f89880c64b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f896c06ac50 0x7f896c06d110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898815a940 0x7f89880c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 --2- 172.21.15.50:0/1806130576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89880b0620 0x7f89881549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 >> 172.21.15.50:0/1806130576 conn(0x7f898806ab80 msgr2=0x7f898806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 shutdown_connections 2023-08-10T10:39:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:52.494+0000 7f898e360640 1 -- 172.21.15.50:0/1806130576 wait complete. 2023-08-10T10:39:52.516 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:39:52.517 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:39:52.518 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:39:52.518 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:39:52.519 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:39:52.520 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:39:52.520 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:39:52.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:52.855 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:52.965 INFO:teuthology.orchestra.run.smithi050.stdout:client4751 2023-08-10T10:39:52.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:52.966 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4751/osdmap') 2023-08-10T10:39:53.062 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 37 barrier 37 flags 0x588000 2023-08-10T10:39:53.063 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:53.063 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:53.064 INFO:teuthology.orchestra.run.smithi050.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:53.064 INFO:teuthology.orchestra.run.smithi050.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:53.064 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:39:53.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:39:53.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:39:53.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:39:53.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:39:53.066 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:39:53.066 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:39:53.066 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:39:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:39:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:39:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:900 bytes copied, 0.00015569 s, 5.8 MB/s 2023-08-10T10:39:53.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-08-10T10:39:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.299+0000 7f1cc6ef5640 1 Processor -- start 2023-08-10T10:39:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.300+0000 7f1cc6ef5640 1 -- start start 2023-08-10T10:39:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.301+0000 7f1cc6ef5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1cc015a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.301+0000 7f1cc6ef5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc006fa90 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.301+0000 7f1cc6ef5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc015e1b0 con 0x7f1cc00cd730 2023-08-10T10:39:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.301+0000 7f1cc6ef5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc015ad60 con 0x7f1cc0157460 2023-08-10T10:39:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.302+0000 7f1cb7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cc00cd2d0 0x7f1cc015d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49146/0 (socket says 172.21.15.50:49146) 2023-08-10T10:39:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.302+0000 7f1cb7fff640 1 -- 172.21.15.50:0/3103089651 learned_addr learned my addr 172.21.15.50:0/3103089651 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.302+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1cc015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.302+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558820525 0 0) 0x7f1cc006fa90 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.302+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca8003520 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845290875 0 0) 0x7f1ca8003520 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 msgr2=0x7f1cc015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1cc015a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 >> v1:172.21.15.117:6789/0 conn(0x7f1cc00cd730 legacy=0x7f1cc015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:53.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc006a970 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1cb0001670 con 0x7f1cc00cd2d0 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 >> v1:172.21.15.50:6789/0 conn(0x7f1cc00cd2d0 legacy=0x7f1cc015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca80039a0 0x7f1ca8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca80047c0 0x7f1ca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1ca8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc015ad60 con 0x7f1ca80039a0 2023-08-10T10:39:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800ba30 con 0x7f1ca80047c0 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800bbf0 con 0x7f1cc0157460 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.303+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca80039a0 0x7f1ca8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cb7fff640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca80047c0 0x7f1ca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc5492640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1ca8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc4c91640 1 -- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 msgr2=0x7f1ca8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1ca8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc4c91640 1 -- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca80047c0 msgr2=0x7f1ca8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca80047c0 0x7f1ca8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc4c91640 1 -- 172.21.15.50:0/3103089651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8003520 con 0x7f1ca80039a0 2023-08-10T10:39:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cb7fff640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca80047c0 0x7f1ca8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.304+0000 7f1cc5492640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc0157460 0x7f1ca8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.305+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca80039a0 0x7f1ca8003dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009a90 tx=0x7f1ca80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae32078ff48befd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.305+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc02c660 con 0x7f1ca80039a0 2023-08-10T10:39:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.305+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc02c7c0 con 0x7f1ca80039a0 2023-08-10T10:39:53.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.305+0000 7f1cb77fe640 1 -- 172.21.15.50:0/3103089651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc02cb50 con 0x7f1ca80039a0 2023-08-10T10:39:53.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/3103089651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca80039a0 msgr2=0x7f1ca8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:53.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/3103089651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca80039a0 0x7f1ca8003dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009a90 tx=0x7f1ca80057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc5492640 1 -- 172.21.15.50:0/3103089651 reap_dead start 2023-08-10T10:39:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/3103089651 shutdown_connections 2023-08-10T10:39:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/3103089651 >> 172.21.15.50:0/3103089651 conn(0x7f1cc00b08e0 msgr2=0x7f1cc00ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/3103089651 shutdown_connections 2023-08-10T10:39:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.306+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/3103089651 wait complete. 2023-08-10T10:39:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.308+0000 7f1cc6ef5640 1 Processor -- start 2023-08-10T10:39:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.308+0000 7f1cc6ef5640 1 -- start start 2023-08-10T10:39:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 0x7f1cc0154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 0x7f1cc01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01565e0 con 0x7f1cc00abcb0 2023-08-10T10:39:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00aca30 con 0x7f1cc0155c20 2023-08-10T10:39:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc6ef5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00acd10 con 0x7f1ca80039a0 2023-08-10T10:39:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc5492640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc5492640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42368/0 (socket says 172.21.15.50:42368) 2023-08-10T10:39:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc5492640 1 -- 172.21.15.50:0/595094018 learned_addr learned my addr 172.21.15.50:0/595094018 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.309+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 0x7f1cc0154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cb7fff640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 0x7f1cc01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 -- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 msgr2=0x7f1cc0154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 0x7f1cc0154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 -- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 msgr2=0x7f1cc01560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 0x7f1cc01560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 -- 172.21.15.50:0/595094018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00acff0 con 0x7f1cc00abcb0 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 0x7f1cc0154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cb7fff640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 0x7f1cc01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc5492640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006cc20 tx=0x7f1cb800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8006d50 con 0x7f1cc00abcb0 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8003970 con 0x7f1cc00abcb0 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8003d60 con 0x7f1cc00abcb0 2023-08-10T10:39:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00ad2d0 con 0x7f1cc00abcb0 2023-08-10T10:39:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.310+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0154a50 con 0x7f1cc00abcb0 2023-08-10T10:39:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.311+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00c3450 con 0x7f1cc00abcb0 2023-08-10T10:39:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.312+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cb8005070 con 0x7f1cc00abcb0 2023-08-10T10:39:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.314+0000 7f1cb57fa640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 0x7f1cac06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.314+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cb80892b0 con 0x7f1cc00abcb0 2023-08-10T10:39:53.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.314+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 0x7f1cac06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:53.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.315+0000 7f1cc4c91640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 0x7f1cac06d140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc036000 tx=0x7f1cbc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:53.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.318+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1cc00c3450 con 0x7f1cc00abcb0 2023-08-10T10:39:53.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:53.523+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f1cc00c3450 con 0x7f1cc00abcb0 2023-08-10T10:39:54.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.410+0000 7f1cb57fa640 1 -- 172.21.15.50:0/595094018 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v38) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1cc00c3450 con 0x7f1cc00abcb0 2023-08-10T10:39:54.412 INFO:teuthology.orchestra.run.smithi050.stderr:pauserd,pausewr is set 2023-08-10T10:39:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 msgr2=0x7f1cac06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 0x7f1cac06d140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc036000 tx=0x7f1cbc030000 comp rx=0 tx=0).stop 2023-08-10T10:39:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 msgr2=0x7f1cc00ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006cc20 tx=0x7f1cb800dc00 comp rx=0 tx=0).stop 2023-08-10T10:39:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 shutdown_connections 2023-08-10T10:39:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cc00abcb0 0x7f1cc00ac160 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1cac06ac80 0x7f1cac06d140 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc0155c20 0x7f1cc01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 --2- 172.21.15.50:0/595094018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca80039a0 0x7f1cc0154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 >> 172.21.15.50:0/595094018 conn(0x7f1cc00b08e0 msgr2=0x7f1cc006b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 shutdown_connections 2023-08-10T10:39:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.416+0000 7f1cc6ef5640 1 -- 172.21.15.50:0/595094018 wait complete. 2023-08-10T10:39:54.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-08-10T10:39:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.677+0000 7f8c0abcf640 1 Processor -- start 2023-08-10T10:39:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.677+0000 7f8c0abcf640 1 -- start start 2023-08-10T10:39:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c04159210 0x7f8c040ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c040ad780 0x7f8c040ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0406f490 0x7f8c0406f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0406fe60 con 0x7f8c04159210 2023-08-10T10:39:54.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040cc1c0 con 0x7f8c040ad780 2023-08-10T10:39:54.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0abcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040cc460 con 0x7f8c0406f490 2023-08-10T10:39:54.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0896b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c04159210 0x7f8c040ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0896b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c04159210 0x7f8c040ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42380/0 (socket says 172.21.15.50:42380) 2023-08-10T10:39:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0896b640 1 -- 172.21.15.50:0/3301332773 learned_addr learned my addr 172.21.15.50:0/3301332773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c0916c640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0406f490 0x7f8c0406f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.679+0000 7f8c03fff640 1 --2- 172.21.15.50:0/3301332773 >> v2:172.21.15.117:3300/0 conn(0x7f8c040ad780 0x7f8c040ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.680+0000 7f8c0896b640 1 -- 172.21.15.50:0/3301332773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0406f490 msgr2=0x7f8c0406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.680+0000 7f8c0896b640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0406f490 0x7f8c0406f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.680+0000 7f8c0896b640 1 -- 172.21.15.50:0/3301332773 >> v2:172.21.15.117:3300/0 conn(0x7f8c040ad780 msgr2=0x7f8c040ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.680+0000 7f8c0896b640 1 --2- 172.21.15.50:0/3301332773 >> v2:172.21.15.117:3300/0 conn(0x7f8c040ad780 0x7f8c040ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.680+0000 7f8c0896b640 1 -- 172.21.15.50:0/3301332773 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04069ca0 con 0x7f8c04159210 2023-08-10T10:39:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.681+0000 7f8c0896b640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c040ca0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c0415dc20 tx=0x7f8bf402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bfa828e87503c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.681+0000 7f8c037fe640 1 -- 172.21.15.50:0/3301332773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4031870 con 0x7f8c04159210 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.681+0000 7f8c037fe640 1 -- 172.21.15.50:0/3301332773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40319d0 con 0x7f8c04159210 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.681+0000 7f8c037fe640 1 -- 172.21.15.50:0/3301332773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4031d60 con 0x7f8c04159210 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 -- 172.21.15.50:0/3301332773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 msgr2=0x7f8c040ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c040ca0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c0415dc20 tx=0x7f8bf402b910 comp rx=0 tx=0).stop 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 -- 172.21.15.50:0/3301332773 shutdown_connections 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0406f490 0x7f8c0406f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/3301332773 >> v2:172.21.15.117:3300/0 conn(0x7f8c040ad780 0x7f8c040ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/3301332773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c040ca0f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 -- 172.21.15.50:0/3301332773 >> 172.21.15.50:0/3301332773 conn(0x7f8c040b08e0 msgr2=0x7f8c040ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 -- 172.21.15.50:0/3301332773 shutdown_connections 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.682+0000 7f8c0abcf640 1 -- 172.21.15.50:0/3301332773 wait complete. 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.684+0000 7f8c0abcf640 1 Processor -- start 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.684+0000 7f8c0abcf640 1 -- start start 2023-08-10T10:39:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 0x7f8c04152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 0x7f8c04154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041534f0 con 0x7f8c04159210 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c56c0 con 0x7f8c0406f490 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.685+0000 7f8c0abcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c5910 con 0x7f8c040ad780 2023-08-10T10:39:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42394/0 (socket says 172.21.15.50:42394) 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 -- 172.21.15.50:0/2982911373 learned_addr learned my addr 172.21.15.50:0/2982911373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c03fff640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 0x7f8c04154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0896b640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 0x7f8c04152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 -- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 msgr2=0x7f8c04154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 0x7f8c04154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 -- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 msgr2=0x7f8c04152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 0x7f8c04152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40094d0 con 0x7f8c04159210 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0896b640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 0x7f8c04152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c03fff640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 0x7f8c04154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.686+0000 7f8c0916c640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00d5d0 tx=0x7f8bfc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.687+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc014620 con 0x7f8c04159210 2023-08-10T10:39:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.687+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0147a0 con 0x7f8c04159210 2023-08-10T10:39:54.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.687+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc014b50 con 0x7f8c04159210 2023-08-10T10:39:54.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.687+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040c5bf0 con 0x7f8c04159210 2023-08-10T10:39:54.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.687+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040c61b0 con 0x7f8c04159210 2023-08-10T10:39:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.688+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c04070670 con 0x7f8c04159210 2023-08-10T10:39:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.689+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bfc014cb0 con 0x7f8c04159210 2023-08-10T10:39:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.690+0000 7f8c017fa640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 0x7f8bf006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.690+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bfc089bd0 con 0x7f8c04159210 2023-08-10T10:39:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.690+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=39+}) v3 -- 0x7f8bf0072dd0 con 0x7f8c04159210 2023-08-10T10:39:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.690+0000 7f8c0896b640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 0x7f8bf006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.691+0000 7f8c0896b640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 0x7f8bf006d140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4036000 tx=0x7f8bf403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.694+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8bfc054be0 con 0x7f8c04159210 2023-08-10T10:39:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:54.896+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f8c040c63d0 con 0x7f8c04159210 2023-08-10T10:39:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.410+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(39..39 src has 1..39) v4 ==== 288+0+0 (secure 0 0 0) 0x7f8bfc05c860 con 0x7f8c04159210 2023-08-10T10:39:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.410+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=40}) v3 -- 0x7f8bf0073680 con 0x7f8c04159210 2023-08-10T10:39:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.415+0000 7f8c017fa640 1 -- 172.21.15.50:0/2982911373 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8bfc018020 con 0x7f8c04159210 2023-08-10T10:39:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:pauserd,pausewr is unset 2023-08-10T10:39:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 msgr2=0x7f8bf006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 0x7f8bf006d140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4036000 tx=0x7f8bf403c040 comp rx=0 tx=0).stop 2023-08-10T10:39:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 msgr2=0x7f8c0406af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00d5d0 tx=0x7f8bfc00da90 comp rx=0 tx=0).stop 2023-08-10T10:39:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 shutdown_connections 2023-08-10T10:39:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c04159210 0x7f8c0406af50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c040ad780 0x7f8c04154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bf006ac80 0x7f8bf006d140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 --2- 172.21.15.50:0/2982911373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c0406f490 0x7f8c04152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.420+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 >> 172.21.15.50:0/2982911373 conn(0x7f8c040b08e0 msgr2=0x7f8c04158270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.421+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 shutdown_connections 2023-08-10T10:39:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.421+0000 7f8c0abcf640 1 -- 172.21.15.50:0/2982911373 wait complete. 2023-08-10T10:39:55.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.668+0000 7f83eacb0640 1 Processor -- start 2023-08-10T10:39:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.668+0000 7f83eacb0640 1 -- start start 2023-08-10T10:39:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.669+0000 7f83eacb0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e415f510 0x7f83e40ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83eacb0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e415d010 con 0x7f83e40b1da0 2023-08-10T10:39:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83eacb0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e415d290 con 0x7f83e4153850 2023-08-10T10:39:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83eacb0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e415d570 con 0x7f83e415f510 2023-08-10T10:39:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83ea4af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e415f510 0x7f83e40ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83e94ad640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83e40b1da0 0x7f83e40cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38212/0 (socket says 172.21.15.50:38212) 2023-08-10T10:39:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.670+0000 7f83e94ad640 1 -- 172.21.15.50:0/857827980 learned_addr learned my addr 172.21.15.50:0/857827980 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.671+0000 7f83ea4af640 1 -- 172.21.15.50:0/857827980 >> v1:172.21.15.117:6789/0 conn(0x7f83e4153850 legacy=0x7f83e40b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.671+0000 7f83ea4af640 1 -- 172.21.15.50:0/857827980 >> v1:172.21.15.50:6789/0 conn(0x7f83e40b1da0 legacy=0x7f83e40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.671+0000 7f83ea4af640 1 -- 172.21.15.50:0/857827980 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e415d850 con 0x7f83e415f510 2023-08-10T10:39:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.671+0000 7f83e8cac640 1 -- 172.21.15.50:0/857827980 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786181744 0 0) 0x7f83e415d010 con 0x7f83e40b1da0 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.672+0000 7f83ea4af640 1 --2- 172.21.15.50:0/857827980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415f510 0x7f83e40ccef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ac66b8b46764cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.672+0000 7f83e8cac640 1 -- 172.21.15.50:0/857827980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc02cd00 con 0x7f83e415f510 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.672+0000 7f83e8cac640 1 -- 172.21.15.50:0/857827980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc02ce60 con 0x7f83e415f510 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.672+0000 7f83e8cac640 1 -- 172.21.15.50:0/857827980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc034660 con 0x7f83e415f510 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 -- 172.21.15.50:0/857827980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415f510 msgr2=0x7f83e40ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 --2- 172.21.15.50:0/857827980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415f510 0x7f83e40ccef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc02bf50 comp rx=0 tx=0).stop 2023-08-10T10:39:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 -- 172.21.15.50:0/857827980 shutdown_connections 2023-08-10T10:39:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 --2- 172.21.15.50:0/857827980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415f510 0x7f83e40ccef0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 -- 172.21.15.50:0/857827980 >> 172.21.15.50:0/857827980 conn(0x7f83e4069880 msgr2=0x7f83e4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 -- 172.21.15.50:0/857827980 shutdown_connections 2023-08-10T10:39:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.673+0000 7f83eacb0640 1 -- 172.21.15.50:0/857827980 wait complete. 2023-08-10T10:39:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.675+0000 7f83eacb0640 1 Processor -- start 2023-08-10T10:39:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.675+0000 7f83eacb0640 1 -- start start 2023-08-10T10:39:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83e415f510 0x7f83e41e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83e4160800 0x7f83e41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e72f0 con 0x7f83e4153850 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e6420 con 0x7f83e4160800 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83eacb0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e6670 con 0x7f83e415f510 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41712/0 (socket says 172.21.15.50:41712) 2023-08-10T10:39:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 -- 172.21.15.50:0/3087626024 learned_addr learned my addr 172.21.15.50:0/3087626024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 -- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83e415f510 msgr2=0x7f83e41e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83e415f510 0x7f83e41e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 -- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83e4160800 msgr2=0x7f83e41521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.676+0000 7f83e9cae640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83e4160800 0x7f83e41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83e9cae640 1 -- 172.21.15.50:0/3087626024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009a70 con 0x7f83e4153850 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83e9cae640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c450 tx=0x7f83e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00052d0 con 0x7f83e4153850 2023-08-10T10:39:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0005430 con 0x7f83e4153850 2023-08-10T10:39:55.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e41e6950 con 0x7f83e4153850 2023-08-10T10:39:55.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0012870 con 0x7f83e4153850 2023-08-10T10:39:55.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.677+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e41e6f10 con 0x7f83e4153850 2023-08-10T10:39:55.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.678+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e4066e30 con 0x7f83e4153850 2023-08-10T10:39:55.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.679+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83e00129d0 con 0x7f83e4153850 2023-08-10T10:39:55.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.680+0000 7f83da7fc640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 0x7f83c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:55.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.680+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83e00890b0 con 0x7f83e4153850 2023-08-10T10:39:55.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.681+0000 7f83e94ad640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 0x7f83c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:55.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.682+0000 7f83e94ad640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 0x7f83c806d110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83d4007fd0 tx=0x7f83d4007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.685+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f83e00540c0 con 0x7f83e4153850 2023-08-10T10:39:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.877+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e40b4880 con 0x7f83e4153850 2023-08-10T10:39:55.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.880+0000 7f83da7fc640 1 -- 172.21.15.50:0/3087626024 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f83e00576e0 con 0x7f83e4153850 2023-08-10T10:39:55.883 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:55.883 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:55.406923+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 msgr2=0x7f83c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 0x7f83c806d110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83d4007fd0 tx=0x7f83d4007900 comp rx=0 tx=0).stop 2023-08-10T10:39:55.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 msgr2=0x7f83e41e7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:55.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c450 tx=0x7f83e000c910 comp rx=0 tx=0).stop 2023-08-10T10:39:55.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 shutdown_connections 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83c806ac50 0x7f83c806d110 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83e4160800 0x7f83e41521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83e415f510 0x7f83e41e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 --2- 172.21.15.50:0/3087626024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e4153850 0x7f83e41e7710 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 >> 172.21.15.50:0/3087626024 conn(0x7f83e4069880 msgr2=0x7f83e40b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 shutdown_connections 2023-08-10T10:39:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:55.883+0000 7f83eacb0640 1 -- 172.21.15.50:0/3087626024 wait complete. 2023-08-10T10:39:55.905 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:39:55.906 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:39:55.906 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:39:55.906 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:39:55.907 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:39:55.907 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:39:55.907 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:39:56.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:56.241 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:56.350 INFO:teuthology.orchestra.run.smithi050.stdout:client4751 2023-08-10T10:39:56.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:56.351 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4751/osdmap') 2023-08-10T10:39:56.451 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 37 barrier 37 flags 0x588000 2023-08-10T10:39:56.451 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:56.451 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:56.452 INFO:teuthology.orchestra.run.smithi050.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:56.452 INFO:teuthology.orchestra.run.smithi050.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:56.452 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:39:56.453 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:39:56.453 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:39:56.453 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:39:56.454 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:39:56.454 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:39:56.454 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:39:56.455 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:39:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:39:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:39:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:900 bytes copied, 7.6623e-05 s, 11.7 MB/s 2023-08-10T10:39:56.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:39:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.687+0000 7f81fc5c9640 1 Processor -- start 2023-08-10T10:39:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.687+0000 7f81fc5c9640 1 -- start start 2023-08-10T10:39:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.689+0000 7f81fc5c9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81f415ccb0 0x7f81f40b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.689+0000 7f81fc5c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.689+0000 7f81fc5c9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f40719f0 con 0x7f81f40696a0 2023-08-10T10:39:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.689+0000 7f81fc5c9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40c8db0 con 0x7f81f415ccb0 2023-08-10T10:39:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.689+0000 7f81fc5c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40c9050 con 0x7f81f40c9b30 2023-08-10T10:39:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.690+0000 7f81f9b64640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.690+0000 7f81f9b64640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:48332/0 (socket says 172.21.15.50:48332) 2023-08-10T10:39:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.690+0000 7f81fa365640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81f415ccb0 0x7f81f40b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.690+0000 7f81f9b64640 1 -- 172.21.15.50:0/1005262701 learned_addr learned my addr 172.21.15.50:0/1005262701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.691+0000 7f81f9b64640 1 -- 172.21.15.50:0/1005262701 >> v2:172.21.15.117:3300/0 conn(0x7f81f415ccb0 msgr2=0x7f81f40b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.691+0000 7f81f9b64640 1 --2- 172.21.15.50:0/1005262701 >> v2:172.21.15.117:3300/0 conn(0x7f81f415ccb0 0x7f81f40b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.691+0000 7f81f9b64640 1 -- 172.21.15.50:0/1005262701 >> v1:172.21.15.117:6789/0 conn(0x7f81f40696a0 legacy=0x7f81f40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.691+0000 7f81f9b64640 1 -- 172.21.15.50:0/1005262701 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40c9330 con 0x7f81f40c9b30 2023-08-10T10:39:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.692+0000 7f81f9b64640 1 --2- 172.21.15.50:0/1005262701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009870 tx=0x7f81e402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c73e38487203a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81f9363640 1 -- 172.21.15.50:0/1005262701 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4030840 con 0x7f81f40c9b30 2023-08-10T10:39:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81f9363640 1 -- 172.21.15.50:0/1005262701 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40309a0 con 0x7f81f40c9b30 2023-08-10T10:39:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81f9363640 1 -- 172.21.15.50:0/1005262701 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4030d30 con 0x7f81f40c9b30 2023-08-10T10:39:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1005262701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 msgr2=0x7f81f40b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1005262701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009870 tx=0x7f81e402b980 comp rx=0 tx=0).stop 2023-08-10T10:39:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1005262701 shutdown_connections 2023-08-10T10:39:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1005262701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f40c9b30 0x7f81f40b2e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1005262701 >> v2:172.21.15.117:3300/0 conn(0x7f81f415ccb0 0x7f81f40b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.693+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1005262701 >> 172.21.15.50:0/1005262701 conn(0x7f81f406b590 msgr2=0x7f81f40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.694+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1005262701 shutdown_connections 2023-08-10T10:39:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.694+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1005262701 wait complete. 2023-08-10T10:39:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.695+0000 7f81fc5c9640 1 Processor -- start 2023-08-10T10:39:56.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.696+0000 7f81fc5c9640 1 -- start start 2023-08-10T10:39:56.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f40c9b30 0x7f81f4143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f415ccb0 0x7f81f41439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4156b10 con 0x7f81f40696a0 2023-08-10T10:39:56.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4156220 con 0x7f81f40c9b30 2023-08-10T10:39:56.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fc5c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f41472c0 con 0x7f81f415ccb0 2023-08-10T10:39:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fa365640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fa365640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41726/0 (socket says 172.21.15.50:41726) 2023-08-10T10:39:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fa365640 1 -- 172.21.15.50:0/1076490269 learned_addr learned my addr 172.21.15.50:0/1076490269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81f9b64640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f40c9b30 0x7f81f4143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.697+0000 7f81fab66640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f415ccb0 0x7f81f41439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 -- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f415ccb0 msgr2=0x7f81f41439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f415ccb0 0x7f81f41439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 -- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f40c9b30 msgr2=0x7f81f4143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f40c9b30 0x7f81f4143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 -- 172.21.15.50:0/1076490269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40094d0 con 0x7f81f40696a0 2023-08-10T10:39:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fa365640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e870 tx=0x7f81f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00094f0 con 0x7f81f40696a0 2023-08-10T10:39:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000c940 con 0x7f81f40696a0 2023-08-10T10:39:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000ccf0 con 0x7f81f40696a0 2023-08-10T10:39:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.698+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f40c7880 con 0x7f81f40696a0 2023-08-10T10:39:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.699+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f4156450 con 0x7f81f40696a0 2023-08-10T10:39:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.700+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f4156d80 con 0x7f81f40696a0 2023-08-10T10:39:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.701+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81f0013470 con 0x7f81f40696a0 2023-08-10T10:39:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.702+0000 7f81eaffd640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 0x7f81d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.702+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81f00895c0 con 0x7f81f40696a0 2023-08-10T10:39:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.702+0000 7f81f9b64640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 0x7f81d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.703+0000 7f81f9b64640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 0x7f81d806d110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:56.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.707+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f81f0054660 con 0x7f81f40696a0 2023-08-10T10:39:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.939+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81f404e270 con 0x7f81f40696a0 2023-08-10T10:39:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.940+0000 7f81eaffd640 1 -- 172.21.15.50:0/1076490269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f81f0057c80 con 0x7f81f40696a0 2023-08-10T10:39:56.942 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:56.942 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:39:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:39:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 msgr2=0x7f81d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 0x7f81d806d110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).stop 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 msgr2=0x7f81f4146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e870 tx=0x7f81f000ed30 comp rx=0 tx=0).stop 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 shutdown_connections 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81f415ccb0 0x7f81f41439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f81d806ac50 0x7f81d806d110 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f40c9b30 0x7f81f4143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 --2- 172.21.15.50:0/1076490269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f40696a0 0x7f81f4146d80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 >> 172.21.15.50:0/1076490269 conn(0x7f81f406b590 msgr2=0x7f81f40cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 shutdown_connections 2023-08-10T10:39:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:56.944+0000 7f81fc5c9640 1 -- 172.21.15.50:0/1076490269 wait complete. 2023-08-10T10:39:56.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json osdmap barrier 39 2023-08-10T10:39:57.210 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-08-10T10:39:57.210 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:39:57.211 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:39:57.211 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:39:57.211 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:39:57.212 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:39:57.212 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:39:57.212 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:39:57.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:57.553 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:57.667 INFO:teuthology.orchestra.run.smithi050.stdout:client4751 2023-08-10T10:39:57.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:57.668 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4751/osdmap') 2023-08-10T10:39:57.775 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 39 barrier 39 flags 0x588000 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:39:57.776 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:39:57.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:39:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:39:57.778 INFO:teuthology.orchestra.run.smithi050.stderr:900 bytes copied, 0.000131271 s, 6.9 MB/s 2023-08-10T10:39:57.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:57.780 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:39:57.840 INFO:teuthology.orchestra.run.smithi050.stdout:client4751 2023-08-10T10:39:57.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:39:57.841 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client4751/osdmap') 2023-08-10T10:39:57.943 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 39 barrier 39 flags 0x588000 2023-08-10T10:39:57.944 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.944 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.944 INFO:teuthology.orchestra.run.smithi050.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.944 INFO:teuthology.orchestra.run.smithi050.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:39:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:39:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:39:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:39:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:39:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:39:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:900 bytes copied, 8.9165e-05 s, 10.1 MB/s 2023-08-10T10:39:57.947 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:39:57.948 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:39:57.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:39:58.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:39:58.197 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:39:58.198 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:58.198 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:58.263 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:39:58.264 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:39:58.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:39:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.552+0000 7f092717f640 1 Processor -- start 2023-08-10T10:39:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.552+0000 7f092717f640 1 -- start start 2023-08-10T10:39:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.553+0000 7f092717f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09200b1da0 0x7f09200cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.553+0000 7f092717f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 0x7f09200cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.553+0000 7f092717f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092015d010 con 0x7f0920153850 2023-08-10T10:39:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.553+0000 7f092717f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092015d290 con 0x7f09200b1da0 2023-08-10T10:39:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.553+0000 7f092717f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092015d570 con 0x7f0920153c30 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092617d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0920153850 0x7f09200b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38224/0 (socket says 172.21.15.50:38224) 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092617d640 1 -- 172.21.15.50:0/926373666 learned_addr learned my addr 172.21.15.50:0/926373666 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092597c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09200b1da0 0x7f09200cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092697e640 1 --2- 172.21.15.50:0/926373666 >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 0x7f09200cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092597c640 1 -- 172.21.15.50:0/926373666 >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 msgr2=0x7f09200cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092597c640 1 --2- 172.21.15.50:0/926373666 >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 0x7f09200cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092597c640 1 -- 172.21.15.50:0/926373666 >> v1:172.21.15.50:6789/0 conn(0x7f0920153850 legacy=0x7f09200b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092597c640 1 -- 172.21.15.50:0/926373666 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092015d850 con 0x7f09200b1da0 2023-08-10T10:39:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.554+0000 7f092697e640 1 --2- 172.21.15.50:0/926373666 >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 0x7f09200cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.556+0000 7f092597c640 1 --2- 172.21.15.50:0/926373666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09200b1da0 0x7f09200cf630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09200b5090 tx=0x7f091002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a375ae3e7bb778 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.556+0000 7f092517b640 1 -- 172.21.15.50:0/926373666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910031830 con 0x7f09200b1da0 2023-08-10T10:39:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.556+0000 7f092517b640 1 -- 172.21.15.50:0/926373666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910031990 con 0x7f09200b1da0 2023-08-10T10:39:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.556+0000 7f092517b640 1 -- 172.21.15.50:0/926373666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910031d20 con 0x7f09200b1da0 2023-08-10T10:39:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 -- 172.21.15.50:0/926373666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09200b1da0 msgr2=0x7f09200cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 --2- 172.21.15.50:0/926373666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09200b1da0 0x7f09200cf630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09200b5090 tx=0x7f091002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 -- 172.21.15.50:0/926373666 shutdown_connections 2023-08-10T10:39:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 --2- 172.21.15.50:0/926373666 >> v2:172.21.15.117:3300/0 conn(0x7f0920153c30 0x7f09200cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 --2- 172.21.15.50:0/926373666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09200b1da0 0x7f09200cf630 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 -- 172.21.15.50:0/926373666 >> 172.21.15.50:0/926373666 conn(0x7f0920069880 msgr2=0x7f0920069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 -- 172.21.15.50:0/926373666 shutdown_connections 2023-08-10T10:39:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.557+0000 7f092717f640 1 -- 172.21.15.50:0/926373666 wait complete. 2023-08-10T10:39:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.559+0000 7f092717f640 1 Processor -- start 2023-08-10T10:39:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.559+0000 7f092717f640 1 -- start start 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0920153c30 0x7f09201f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09200a9bf0 0x7f09200ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920152ab0 con 0x7f0920153850 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200aa640 con 0x7f0920153c30 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092717f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200aa920 con 0x7f09200a9bf0 2023-08-10T10:39:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41754/0 (socket says 172.21.15.50:41754) 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 -- 172.21.15.50:0/3420721307 learned_addr learned my addr 172.21.15.50:0/3420721307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092597c640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0920153c30 0x7f09201f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 -- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09200a9bf0 msgr2=0x7f09200ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09200a9bf0 0x7f09200ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.560+0000 7f092617d640 1 -- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0920153c30 msgr2=0x7f09201f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f092617d640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0920153c30 0x7f09201f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f092617d640 1 -- 172.21.15.50:0/3420721307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009400 con 0x7f0920153850 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f092617d640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f091c002230 tx=0x7f091c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00ad40 con 0x7f0920153850 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c012400 con 0x7f0920153850 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00aea0 con 0x7f0920153850 2023-08-10T10:39:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200aac00 con 0x7f0920153850 2023-08-10T10:39:58.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.561+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200ab1c0 con 0x7f0920153850 2023-08-10T10:39:58.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.563+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200ab3b0 con 0x7f0920153850 2023-08-10T10:39:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.563+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f091c007070 con 0x7f0920153850 2023-08-10T10:39:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.564+0000 7f0916ffd640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 0x7f090406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.564+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f091c089560 con 0x7f0920153850 2023-08-10T10:39:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.565+0000 7f092597c640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 0x7f090406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:58.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.566+0000 7f092597c640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 0x7f090406d140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0910036000 tx=0x7f0910008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:58.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.569+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f091c054570 con 0x7f0920153850 2023-08-10T10:39:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.766+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0920066e30 con 0x7f0920153850 2023-08-10T10:39:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.768+0000 7f0916ffd640 1 -- 172.21.15.50:0/3420721307 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f091c057b90 con 0x7f0920153850 2023-08-10T10:39:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:39:58.771 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:55.406923+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:39:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 msgr2=0x7f090406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 0x7f090406d140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0910036000 tx=0x7f0910008030 comp rx=0 tx=0).stop 2023-08-10T10:39:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 msgr2=0x7f09200b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f091c002230 tx=0x7f091c00a430 comp rx=0 tx=0).stop 2023-08-10T10:39:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 shutdown_connections 2023-08-10T10:39:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09200a9bf0 0x7f09200ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090406ac80 0x7f090406d140 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0920153c30 0x7f09201f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 --2- 172.21.15.50:0/3420721307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920153850 0x7f09200b10f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 >> 172.21.15.50:0/3420721307 conn(0x7f0920069880 msgr2=0x7f09200b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 shutdown_connections 2023-08-10T10:39:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:58.771+0000 7f092717f640 1 -- 172.21.15.50:0/3420721307 wait complete. 2023-08-10T10:39:58.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:39:38.563848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:39:39.595203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:39:58.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:39:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.020+0000 7f6fdff39640 1 Processor -- start 2023-08-10T10:39:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.020+0000 7f6fdff39640 1 -- start start 2023-08-10T10:39:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fdff39640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fd80ca530 0x7f6fd80b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fdff39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fd806a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fdff39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80adf00 con 0x7f6fd8159c10 2023-08-10T10:39:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fdff39640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd806ebb0 con 0x7f6fd80ca530 2023-08-10T10:39:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fdff39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd806ee90 con 0x7f6fd80ada90 2023-08-10T10:39:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fddcd5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fd8159c10 0x7f6fd80c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38232/0 (socket says 172.21.15.50:38232) 2023-08-10T10:39:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.022+0000 7f6fddcd5640 1 -- 172.21.15.50:0/1143514770 learned_addr learned my addr 172.21.15.50:0/1143514770 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fd806a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdd4d4640 1 --2- 172.21.15.50:0/1143514770 >> v2:172.21.15.117:3300/0 conn(0x7f6fd80ca530 0x7f6fd80b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287268298 0 0) 0x7f6fd80adf00 con 0x7f6fd8159c10 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc4003520 con 0x7f6fd8159c10 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191957738 0 0) 0x7f6fc4003520 con 0x7f6fd8159c10 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 msgr2=0x7f6fd806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fd806a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 >> v2:172.21.15.117:3300/0 conn(0x7f6fd80ca530 msgr2=0x7f6fd80b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 --2- 172.21.15.50:0/1143514770 >> v2:172.21.15.117:3300/0 conn(0x7f6fd80ca530 0x7f6fd80b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd806f170 con 0x7f6fd8159c10 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6fd40019f0 con 0x7f6fd8159c10 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 >> v1:172.21.15.50:6789/0 conn(0x7f6fd8159c10 legacy=0x7f6fd80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fc4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4003ef0 0x7f6fc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4004d00 0x7f6fc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd806ebb0 con 0x7f6fc4004d00 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd806ee90 con 0x7f6fc4003ef0 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.023+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc400dbe0 con 0x7f6fd80ada90 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4004d00 0x7f6fc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fdd4d4640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4003ef0 0x7f6fc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fddcd5640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fc4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 msgr2=0x7f6fc4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fc4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4003ef0 msgr2=0x7f6fc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4003ef0 0x7f6fc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1143514770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4003520 con 0x7f6fc4004d00 2023-08-10T10:39:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.024+0000 7f6fddcd5640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80ada90 0x7f6fc4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:39:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.025+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4004d00 0x7f6fc4005180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009af0 tx=0x7f6fc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1724f94c9fde41 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.025+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd002c6b0 con 0x7f6fc4004d00 2023-08-10T10:39:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.025+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd002c810 con 0x7f6fc4004d00 2023-08-10T10:39:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.025+0000 7f6fdccd3640 1 -- 172.21.15.50:0/1143514770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd002cba0 con 0x7f6fc4004d00 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 -- 172.21.15.50:0/1143514770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4004d00 msgr2=0x7f6fc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1143514770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4004d00 0x7f6fc4005180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009af0 tx=0x7f6fc40057f0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1143514770 reap_dead start 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 -- 172.21.15.50:0/1143514770 shutdown_connections 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 -- 172.21.15.50:0/1143514770 >> 172.21.15.50:0/1143514770 conn(0x7f6fd80b01b0 msgr2=0x7f6fd80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:59.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 -- 172.21.15.50:0/1143514770 shutdown_connections 2023-08-10T10:39:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.026+0000 7f6fdff39640 1 -- 172.21.15.50:0/1143514770 wait complete. 2023-08-10T10:39:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.028+0000 7f6fdff39640 1 Processor -- start 2023-08-10T10:39:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.028+0000 7f6fdff39640 1 -- start start 2023-08-10T10:39:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4004d00 0x7f6fd8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80cd660 0x7f6fd80b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8156530 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80ce320 con 0x7f6fc4004d00 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.029+0000 7f6fdff39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cdbe0 con 0x7f6fd80cd660 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41762/0 (socket says 172.21.15.50:41762) 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1475315656 learned_addr learned my addr 172.21.15.50:0/1475315656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fddcd5640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4004d00 0x7f6fd8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fdd4d4640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80cd660 0x7f6fd80b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80cd660 msgr2=0x7f6fd80b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80cd660 0x7f6fd80b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4004d00 msgr2=0x7f6fd8155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4004d00 0x7f6fd8155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.030+0000 7f6fde4d6640 1 -- 172.21.15.50:0/1475315656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80b1750 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fde4d6640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009af0 tx=0x7f6fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd002c6b0 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0003810 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0003bc0 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80b2b70 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.031+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80b30f0 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.032+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd8071290 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.033+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fd0003d20 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.035+0000 7f6fce7fc640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 0x7f6fbc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.035+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fd00aac00 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.035+0000 7f6fddcd5640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 0x7f6fbc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.036+0000 7f6fddcd5640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 0x7f6fbc06d140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4001b20 tx=0x7f6fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.039+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6fd0075c10 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.232+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fd80b1750 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.233+0000 7f6fce7fc640 1 -- 172.21.15.50:0/1475315656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fd80b1750 con 0x7f6fd80b3bd0 2023-08-10T10:39:59.234 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:39:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.235+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 msgr2=0x7f6fbc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.235+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 0x7f6fbc06d140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4001b20 tx=0x7f6fd4009040 comp rx=0 tx=0).stop 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.235+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 msgr2=0x7f6fd80ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.235+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009af0 tx=0x7f6fd0004730 comp rx=0 tx=0).stop 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 shutdown_connections 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd80b3bd0 0x7f6fd80ac890 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd80cd660 0x7f6fd80b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6fbc06ac80 0x7f6fbc06d140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 --2- 172.21.15.50:0/1475315656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc4004d00 0x7f6fd8155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 >> 172.21.15.50:0/1475315656 conn(0x7f6fd80b01b0 msgr2=0x7f6fd80cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 shutdown_connections 2023-08-10T10:39:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.236+0000 7f6fdff39640 1 -- 172.21.15.50:0/1475315656 wait complete. 2023-08-10T10:39:59.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:39:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.486+0000 7f5d5b256640 1 Processor -- start 2023-08-10T10:39:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.486+0000 7f5d5b256640 1 -- start start 2023-08-10T10:39:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.487+0000 7f5d5b256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5b256640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5406cc80 con 0x7f5d540cf640 2023-08-10T10:39:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5b256640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5406dae0 con 0x7f5d5406e470 2023-08-10T10:39:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5b256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415f540 con 0x7f5d5415ac30 2023-08-10T10:39:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5aa55640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d540cf640 0x7f5d5415ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38240/0 (socket says 172.21.15.50:38240) 2023-08-10T10:39:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5aa55640 1 -- 172.21.15.50:0/2067044820 learned_addr learned my addr 172.21.15.50:0/2067044820 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.488+0000 7f5d5a254640 1 --2- 172.21.15.50:0/2067044820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.489+0000 7f5d59252640 1 -- 172.21.15.50:0/2067044820 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509883334 0 0) 0x7f5d5406cc80 con 0x7f5d540cf640 2023-08-10T10:39:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.489+0000 7f5d59252640 1 -- 172.21.15.50:0/2067044820 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d40003520 con 0x7f5d540cf640 2023-08-10T10:39:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.489+0000 7f5d5a254640 1 -- 172.21.15.50:0/2067044820 >> v1:172.21.15.117:6789/0 conn(0x7f5d5406e470 legacy=0x7f5d5415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.489+0000 7f5d5a254640 1 -- 172.21.15.50:0/2067044820 >> v1:172.21.15.50:6789/0 conn(0x7f5d540cf640 legacy=0x7f5d5415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.489+0000 7f5d5a254640 1 -- 172.21.15.50:0/2067044820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5415b010 con 0x7f5d5415ac30 2023-08-10T10:39:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.490+0000 7f5d5a254640 1 --2- 172.21.15.50:0/2067044820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540cc8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009dc0 tx=0x7f5d5002bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b124e960981a9a4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.491+0000 7f5d59252640 1 -- 172.21.15.50:0/2067044820 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5002cd60 con 0x7f5d5415ac30 2023-08-10T10:39:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.491+0000 7f5d59252640 1 -- 172.21.15.50:0/2067044820 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50034440 con 0x7f5d5415ac30 2023-08-10T10:39:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.491+0000 7f5d59252640 1 -- 172.21.15.50:0/2067044820 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500347d0 con 0x7f5d5415ac30 2023-08-10T10:39:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.491+0000 7f5d5b256640 1 -- 172.21.15.50:0/2067044820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 msgr2=0x7f5d540cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.491+0000 7f5d5b256640 1 --2- 172.21.15.50:0/2067044820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540cc8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009dc0 tx=0x7f5d5002bfb0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.492+0000 7f5d5b256640 1 -- 172.21.15.50:0/2067044820 shutdown_connections 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.492+0000 7f5d5b256640 1 --2- 172.21.15.50:0/2067044820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540cc8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.492+0000 7f5d5b256640 1 -- 172.21.15.50:0/2067044820 >> 172.21.15.50:0/2067044820 conn(0x7f5d540d06a0 msgr2=0x7f5d540d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.492+0000 7f5d5b256640 1 -- 172.21.15.50:0/2067044820 shutdown_connections 2023-08-10T10:39:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.492+0000 7f5d5b256640 1 -- 172.21.15.50:0/2067044820 wait complete. 2023-08-10T10:39:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.493+0000 7f5d5b256640 1 Processor -- start 2023-08-10T10:39:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.494+0000 7f5d5b256640 1 -- start start 2023-08-10T10:39:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d5406e470 0x7f5d540b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540b3b50 con 0x7f5d540cf640 2023-08-10T10:39:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540b4490 con 0x7f5d5406e470 2023-08-10T10:39:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5b256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540b1550 con 0x7f5d5415ac30 2023-08-10T10:39:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d59a53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d59a53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41778/0 (socket says 172.21.15.50:41778) 2023-08-10T10:39:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d59a53640 1 -- 172.21.15.50:0/1399345972 learned_addr learned my addr 172.21.15.50:0/1399345972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5a254640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d5406e470 0x7f5d540b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.495+0000 7f5d5aa55640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 -- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 msgr2=0x7f5d540b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 -- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d5406e470 msgr2=0x7f5d540b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d5406e470 0x7f5d540b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 -- 172.21.15.50:0/1399345972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50009a70 con 0x7f5d540cf640 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d59a53640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c450 tx=0x7f5d4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d440052d0 con 0x7f5d540cf640 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44005430 con 0x7f5d540cf640 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012870 con 0x7f5d540cf640 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d540b1830 con 0x7f5d540cf640 2023-08-10T10:39:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.496+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d540b1df0 con 0x7f5d540cf640 2023-08-10T10:39:59.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.498+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54066e30 con 0x7f5d540cf640 2023-08-10T10:39:59.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.499+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d440129d0 con 0x7f5d540cf640 2023-08-10T10:39:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.500+0000 7f5d4affd640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 0x7f5d3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.501+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d44088ff0 con 0x7f5d540cf640 2023-08-10T10:39:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.501+0000 7f5d5a254640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 0x7f5d3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.502+0000 7f5d5a254640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 0x7f5d3806d110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d50036000 tx=0x7f5d50030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.504+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5d44054090 con 0x7f5d540cf640 2023-08-10T10:39:59.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.695+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d5406f2b0 con 0x7f5d540cf640 2023-08-10T10:39:59.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.696+0000 7f5d4affd640 1 -- 172.21.15.50:0/1399345972 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d440576b0 con 0x7f5d540cf640 2023-08-10T10:39:59.698 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:39:59.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.699+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 msgr2=0x7f5d3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.699+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 0x7f5d3806d110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d50036000 tx=0x7f5d50030000 comp rx=0 tx=0).stop 2023-08-10T10:39:59.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 msgr2=0x7f5d54159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c450 tx=0x7f5d4400c910 comp rx=0 tx=0).stop 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 shutdown_connections 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d5415ac30 0x7f5d540b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d540cf640 0x7f5d54159900 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3806ac50 0x7f5d3806d110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 --2- 172.21.15.50:0/1399345972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d5406e470 0x7f5d540b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 >> 172.21.15.50:0/1399345972 conn(0x7f5d540d06a0 msgr2=0x7f5d540cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:59.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 shutdown_connections 2023-08-10T10:39:59.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.700+0000 7f5d5b256640 1 -- 172.21.15.50:0/1399345972 wait complete. 2023-08-10T10:39:59.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:39:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.939+0000 7fd8971a4640 1 Processor -- start 2023-08-10T10:39:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.939+0000 7fd8971a4640 1 -- start start 2023-08-10T10:39:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd8971a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd89015cb90 0x7fd8900b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd8971a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd890160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd8971a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd890160a40 con 0x7fd8900b4640 2023-08-10T10:39:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd8971a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8900b4bb0 con 0x7fd89015cb90 2023-08-10T10:39:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd8971a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900b4e90 con 0x7fd89015cf70 2023-08-10T10:39:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd894f40640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd89015cb90 0x7fd8900b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.940+0000 7fd895741640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8900b4640 0x7fd89006fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38246/0 (socket says 172.21.15.50:38246) 2023-08-10T10:39:59.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd895741640 1 -- 172.21.15.50:0/383114786 learned_addr learned my addr 172.21.15.50:0/383114786 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:39:59.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd88ffff640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd890160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd88f7fe640 1 -- 172.21.15.50:0/383114786 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256909794 0 0) 0x7fd890160a40 con 0x7fd8900b4640 2023-08-10T10:39:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd894f40640 1 -- 172.21.15.50:0/383114786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 msgr2=0x7fd890160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:39:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd894f40640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd890160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd894f40640 1 -- 172.21.15.50:0/383114786 >> v1:172.21.15.50:6789/0 conn(0x7fd8900b4640 legacy=0x7fd89006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.941+0000 7fd894f40640 1 -- 172.21.15.50:0/383114786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900b5170 con 0x7fd89015cb90 2023-08-10T10:39:59.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd894f40640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b5dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd8800097a0 tx=0x7fd88002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d20dd277cb6ecd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd88f7fe640 1 -- 172.21.15.50:0/383114786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88002d040 con 0x7fd89015cb90 2023-08-10T10:39:59.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd88f7fe640 1 -- 172.21.15.50:0/383114786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd880031810 con 0x7fd89015cb90 2023-08-10T10:39:59.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd88f7fe640 1 -- 172.21.15.50:0/383114786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880031ba0 con 0x7fd89015cb90 2023-08-10T10:39:59.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd8971a4640 1 -- 172.21.15.50:0/383114786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 msgr2=0x7fd8900b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.943+0000 7fd8971a4640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b5dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd8800097a0 tx=0x7fd88002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 -- 172.21.15.50:0/383114786 shutdown_connections 2023-08-10T10:39:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd890160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 --2- 172.21.15.50:0/383114786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b5dd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 -- 172.21.15.50:0/383114786 >> 172.21.15.50:0/383114786 conn(0x7fd8900cf640 msgr2=0x7fd8900cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:39:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 -- 172.21.15.50:0/383114786 shutdown_connections 2023-08-10T10:39:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.944+0000 7fd8971a4640 1 -- 172.21.15.50:0/383114786 wait complete. 2023-08-10T10:39:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.946+0000 7fd8971a4640 1 Processor -- start 2023-08-10T10:39:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.946+0000 7fd8971a4640 1 -- start start 2023-08-10T10:39:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8900b4640 0x7fd89014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd8900b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89014f590 con 0x7fd89015cb90 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901586f0 con 0x7fd8900b4640 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd8971a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901509e0 con 0x7fd89015cf70 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41788/0 (socket says 172.21.15.50:41788) 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd88ffff640 1 -- 172.21.15.50:0/2907841617 learned_addr learned my addr 172.21.15.50:0/2907841617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:39:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd895741640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd8900b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd894f40640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8900b4640 0x7fd89014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd88ffff640 1 -- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 msgr2=0x7fd8900b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.947+0000 7fd88ffff640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd8900b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88ffff640 1 -- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8900b4640 msgr2=0x7fd89014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88ffff640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8900b4640 0x7fd89014dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:39:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88ffff640 1 -- 172.21.15.50:0/2907841617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880009400 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88ffff640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd878007e70 tx=0x7fd87800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878014620 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878014780 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878014b30 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89014e100 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.948+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89014eed0 con 0x7fd89015cb90 2023-08-10T10:39:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.950+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8900612b0 con 0x7fd89015cb90 2023-08-10T10:39:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.950+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd878014c90 con 0x7fd89015cb90 2023-08-10T10:39:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.952+0000 7fd88d7fa640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 0x7fd87006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:39:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.952+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd878089e70 con 0x7fd89015cb90 2023-08-10T10:39:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.952+0000 7fd894f40640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 0x7fd87006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:39:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.953+0000 7fd894f40640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 0x7fd87006d140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd880036000 tx=0x7fd88003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:39:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:39:59.956+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd878054e80 con 0x7fd89015cb90 2023-08-10T10:40:00.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.149+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8900d0a10 con 0x7fd89015cb90 2023-08-10T10:40:00.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.150+0000 7fd88d7fa640 1 -- 172.21.15.50:0/2907841617 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8780584a0 con 0x7fd89015cb90 2023-08-10T10:40:00.151 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:40:00.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 msgr2=0x7fd87006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 0x7fd87006d140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd880036000 tx=0x7fd88003c040 comp rx=0 tx=0).stop 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 msgr2=0x7fd8900b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd878007e70 tx=0x7fd87800e4b0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 shutdown_connections 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd89015cf70 0x7fd8900b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd89015cb90 0x7fd8900b70d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd87006ac80 0x7fd87006d140 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 --2- 172.21.15.50:0/2907841617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8900b4640 0x7fd89014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.152+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 >> 172.21.15.50:0/2907841617 conn(0x7fd8900cf640 msgr2=0x7fd8900cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.153+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 shutdown_connections 2023-08-10T10:40:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.153+0000 7fd8971a4640 1 -- 172.21.15.50:0/2907841617 wait complete. 2023-08-10T10:40:00.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:40:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.409+0000 7ff4dee2d640 1 Processor -- start 2023-08-10T10:40:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.410+0000 7ff4dee2d640 1 -- start start 2023-08-10T10:40:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.411+0000 7ff4dee2d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4d815ae40 0x7ff4d80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4dee2d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d806cb30 0x7ff4d80ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4dee2d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d80adcb0 con 0x7ff4d80cd2a0 2023-08-10T10:40:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4dee2d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d806c320 con 0x7ff4d806cb30 2023-08-10T10:40:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4dee2d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d806b770 con 0x7ff4d815ae40 2023-08-10T10:40:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4d7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d806cb30 0x7ff4d80ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4d7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d806cb30 0x7ff4d80ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41792/0 (socket says 172.21.15.50:41792) 2023-08-10T10:40:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4d7fff640 1 -- 172.21.15.50:0/136286140 learned_addr learned my addr 172.21.15.50:0/136286140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.412+0000 7ff4dcbc9640 1 --2- 172.21.15.50:0/136286140 >> v2:172.21.15.117:3300/0 conn(0x7ff4d815ae40 0x7ff4d80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.413+0000 7ff4d7fff640 1 -- 172.21.15.50:0/136286140 >> v2:172.21.15.117:3300/0 conn(0x7ff4d815ae40 msgr2=0x7ff4d80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.413+0000 7ff4d7fff640 1 --2- 172.21.15.50:0/136286140 >> v2:172.21.15.117:3300/0 conn(0x7ff4d815ae40 0x7ff4d80b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.413+0000 7ff4d7fff640 1 -- 172.21.15.50:0/136286140 >> v1:172.21.15.117:6789/0 conn(0x7ff4d80cd2a0 legacy=0x7ff4d80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.413+0000 7ff4d7fff640 1 -- 172.21.15.50:0/136286140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d806b9f0 con 0x7ff4d806cb30 2023-08-10T10:40:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.414+0000 7ff4d7fff640 1 --2- 172.21.15.50:0/136286140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d806cb30 0x7ff4d80ad770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4d806e6f0 tx=0x7ff4c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad562e9734c37ba3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.415+0000 7ff4d77fe640 1 -- 172.21.15.50:0/136286140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4031870 con 0x7ff4d806cb30 2023-08-10T10:40:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.415+0000 7ff4d77fe640 1 -- 172.21.15.50:0/136286140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c40319d0 con 0x7ff4d806cb30 2023-08-10T10:40:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.415+0000 7ff4d77fe640 1 -- 172.21.15.50:0/136286140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4031d60 con 0x7ff4d806cb30 2023-08-10T10:40:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.415+0000 7ff4dee2d640 1 -- 172.21.15.50:0/136286140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d806cb30 msgr2=0x7ff4d80ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.415+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/136286140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d806cb30 0x7ff4d80ad770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4d806e6f0 tx=0x7ff4c402b910 comp rx=0 tx=0).stop 2023-08-10T10:40:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 -- 172.21.15.50:0/136286140 shutdown_connections 2023-08-10T10:40:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/136286140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d806cb30 0x7ff4d80ad770 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/136286140 >> v2:172.21.15.117:3300/0 conn(0x7ff4d815ae40 0x7ff4d80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 -- 172.21.15.50:0/136286140 >> 172.21.15.50:0/136286140 conn(0x7ff4d80b01b0 msgr2=0x7ff4d80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 -- 172.21.15.50:0/136286140 shutdown_connections 2023-08-10T10:40:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.416+0000 7ff4dee2d640 1 -- 172.21.15.50:0/136286140 wait complete. 2023-08-10T10:40:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.418+0000 7ff4dee2d640 1 Processor -- start 2023-08-10T10:40:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.418+0000 7ff4dee2d640 1 -- start start 2023-08-10T10:40:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 0x7ff4d815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d80cd2a0 0x7ff4d8147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80c5ee0 con 0x7ff4d815ae40 2023-08-10T10:40:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81481d0 con 0x7ff4d80cd2a0 2023-08-10T10:40:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dee2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80c5c00 con 0x7ff4d806cb30 2023-08-10T10:40:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dd3ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dd3ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41808/0 (socket says 172.21.15.50:41808) 2023-08-10T10:40:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.419+0000 7ff4dd3ca640 1 -- 172.21.15.50:0/1968019834 learned_addr learned my addr 172.21.15.50:0/1968019834 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dcbc9640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 0x7ff4d815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4d7fff640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d80cd2a0 0x7ff4d8147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 -- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 msgr2=0x7ff4d815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 0x7ff4d815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 -- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d80cd2a0 msgr2=0x7ff4d8147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d80cd2a0 0x7ff4d8147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 -- 172.21.15.50:0/1968019834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40094d0 con 0x7ff4d815ae40 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dcbc9640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 0x7ff4d815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.420+0000 7ff4dd3ca640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b970 tx=0x7ff4d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.421+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000cb40 con 0x7ff4d815ae40 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.421+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000cca0 con 0x7ff4d815ae40 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.421+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0014680 con 0x7ff4d815ae40 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.421+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d81f36c0 con 0x7ff4d815ae40 2023-08-10T10:40:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.421+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81f3c80 con 0x7ff4d815ae40 2023-08-10T10:40:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.422+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d81f3520 con 0x7ff4d815ae40 2023-08-10T10:40:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.423+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4d001d3b0 con 0x7ff4d815ae40 2023-08-10T10:40:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.424+0000 7ff4d57fa640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 0x7ff4bc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.425+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4d00892a0 con 0x7ff4d815ae40 2023-08-10T10:40:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.425+0000 7ff4dcbc9640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 0x7ff4bc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.425+0000 7ff4dcbc9640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 0x7ff4bc06d140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009af0 tx=0x7ff4cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.429+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff4d81f3520 con 0x7ff4d815ae40 2023-08-10T10:40:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.622+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4d81f3520 con 0x7ff4d815ae40 2023-08-10T10:40:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.623+0000 7ff4d57fa640 1 -- 172.21.15.50:0/1968019834 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4d81f3520 con 0x7ff4d815ae40 2023-08-10T10:40:00.625 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 msgr2=0x7ff4bc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 0x7ff4bc06d140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009af0 tx=0x7ff4cc008040 comp rx=0 tx=0).stop 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 msgr2=0x7ff4d8147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b970 tx=0x7ff4d000be30 comp rx=0 tx=0).stop 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 shutdown_connections 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d815ae40 0x7ff4d8147c90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4bc06ac80 0x7ff4bc06d140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d80cd2a0 0x7ff4d8147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 --2- 172.21.15.50:0/1968019834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d806cb30 0x7ff4d815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 >> 172.21.15.50:0/1968019834 conn(0x7ff4d80b01b0 msgr2=0x7ff4d8159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 shutdown_connections 2023-08-10T10:40:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.625+0000 7ff4dee2d640 1 -- 172.21.15.50:0/1968019834 wait complete. 2023-08-10T10:40:00.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:40:00.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.834+0000 7fb08b025640 1 Processor -- start 2023-08-10T10:40:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.835+0000 7fb08b025640 1 -- start start 2023-08-10T10:40:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.836+0000 7fb08b025640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb08415cc30 0x7fb0840d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.836+0000 7fb08b025640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb0840b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.836+0000 7fb08b025640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840d2630 con 0x7fb0840d08e0 2023-08-10T10:40:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.836+0000 7fb08b025640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840b8010 con 0x7fb08415cc30 2023-08-10T10:40:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.836+0000 7fb08b025640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840d0ea0 con 0x7fb0840cfe10 2023-08-10T10:40:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb089822640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0840d08e0 0x7fb0840cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38252/0 (socket says 172.21.15.50:38252) 2023-08-10T10:40:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb089822640 1 -- 172.21.15.50:0/265497252 learned_addr learned my addr 172.21.15.50:0/265497252 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a023640 1 --2- 172.21.15.50:0/265497252 >> v2:172.21.15.50:3300/0 conn(0x7fb08415cc30 0x7fb0840d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a824640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb0840b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a023640 1 -- 172.21.15.50:0/265497252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 msgr2=0x7fb0840b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a023640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb0840b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a023640 1 -- 172.21.15.50:0/265497252 >> v1:172.21.15.50:6789/0 conn(0x7fb0840d08e0 legacy=0x7fb0840cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a023640 1 -- 172.21.15.50:0/265497252 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840d1180 con 0x7fb08415cc30 2023-08-10T10:40:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.837+0000 7fb08a824640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb0840b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.838+0000 7fb08a023640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08415cc30 0x7fb0840d1d20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0800097a0 tx=0x7fb08002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dfaccd6a167782 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb089021640 1 -- 172.21.15.50:0/265497252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08002d040 con 0x7fb08415cc30 2023-08-10T10:40:00.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb089021640 1 -- 172.21.15.50:0/265497252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080031810 con 0x7fb08415cc30 2023-08-10T10:40:00.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb089021640 1 -- 172.21.15.50:0/265497252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080031ba0 con 0x7fb08415cc30 2023-08-10T10:40:00.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 -- 172.21.15.50:0/265497252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08415cc30 msgr2=0x7fb0840d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08415cc30 0x7fb0840d1d20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0800097a0 tx=0x7fb08002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 -- 172.21.15.50:0/265497252 shutdown_connections 2023-08-10T10:40:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb0840b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 --2- 172.21.15.50:0/265497252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08415cc30 0x7fb0840d1d20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.839+0000 7fb08b025640 1 -- 172.21.15.50:0/265497252 >> 172.21.15.50:0/265497252 conn(0x7fb084069880 msgr2=0x7fb084069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:00.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.840+0000 7fb08b025640 1 -- 172.21.15.50:0/265497252 shutdown_connections 2023-08-10T10:40:00.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.840+0000 7fb08b025640 1 -- 172.21.15.50:0/265497252 wait complete. 2023-08-10T10:40:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.841+0000 7fb08b025640 1 Processor -- start 2023-08-10T10:40:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.841+0000 7fb08b025640 1 -- start start 2023-08-10T10:40:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb084157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08415cc30 0x7fb084159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084158440 con 0x7fb0840d08e0 2023-08-10T10:40:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841f67b0 con 0x7fb08415cc30 2023-08-10T10:40:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.842+0000 7fb08b025640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084158690 con 0x7fb0840cfe10 2023-08-10T10:40:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41832/0 (socket says 172.21.15.50:41832) 2023-08-10T10:40:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 -- 172.21.15.50:0/2851208428 learned_addr learned my addr 172.21.15.50:0/2851208428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:00.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb08a023640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb084157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb08a824640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08415cc30 0x7fb084159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 -- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 msgr2=0x7fb084157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb084157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 -- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08415cc30 msgr2=0x7fb084159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08415cc30 0x7fb084159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb089822640 1 -- 172.21.15.50:0/2851208428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009400 con 0x7fb0840d08e0 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.843+0000 7fb08a023640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb084157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb089822640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c480 tx=0x7fb07400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005ce0 con 0x7fb0840d08e0 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074005e40 con 0x7fb0840d08e0 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740072f0 con 0x7fb0840d08e0 2023-08-10T10:40:00.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb084158970 con 0x7fb0840d08e0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.844+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb084158f30 con 0x7fb0840d08e0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.845+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb084066e30 con 0x7fb0840d08e0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.846+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb074007510 con 0x7fb0840d08e0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.847+0000 7fb07affd640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 0x7fb06806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.847+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0740889c0 con 0x7fb0840d08e0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.848+0000 7fb08a023640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 0x7fb06806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.849+0000 7fb08a023640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 0x7fb06806d110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb080036000 tx=0x7fb08003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:00.852+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb074053b10 con 0x7fb0840d08e0 2023-08-10T10:40:01.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.049+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0840b6470 con 0x7fb0840d08e0 2023-08-10T10:40:01.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.050+0000 7fb07affd640 1 -- 172.21.15.50:0/2851208428 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb074017080 con 0x7fb0840d08e0 2023-08-10T10:40:01.051 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 msgr2=0x7fb06806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 0x7fb06806d110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb080036000 tx=0x7fb08003c040 comp rx=0 tx=0).stop 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 msgr2=0x7fb0841f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c480 tx=0x7fb07400c940 comp rx=0 tx=0).stop 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 shutdown_connections 2023-08-10T10:40:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac50 0x7fb06806d110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08415cc30 0x7fb084159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0840d08e0 0x7fb0841f6270 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 --2- 172.21.15.50:0/2851208428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0840cfe10 0x7fb084157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.052+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 >> 172.21.15.50:0/2851208428 conn(0x7fb084069880 msgr2=0x7fb08415f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.053+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 shutdown_connections 2023-08-10T10:40:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.053+0000 7fb08b025640 1 -- 172.21.15.50:0/2851208428 wait complete. 2023-08-10T10:40:01.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:40:01.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:01.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:40:01.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:40:01.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:01.247 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:40:01.287 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:01.287 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:01.335 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:01.336 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:01.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.668+0000 7f24d8c97640 1 Processor -- start 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.669+0000 7f24d8c97640 1 -- start start 2023-08-10T10:40:01.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d4160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24d40b8430 0x7f24d40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24d40cddb0 0x7f24d40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40ce240 con 0x7f24d40b8430 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40b5bd0 con 0x7f24d40cddb0 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24d8c97640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4161180 con 0x7f24d415cd60 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.670+0000 7f24cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24d40b8430 0x7f24d40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24d40b8430 0x7f24d40cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41834/0 (socket says 172.21.15.50:41834) 2023-08-10T10:40:01.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 -- 172.21.15.50:0/38559911 learned_addr learned my addr 172.21.15.50:0/38559911 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 -- 172.21.15.50:0/38559911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 msgr2=0x7f24d4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 --2- 172.21.15.50:0/38559911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 -- 172.21.15.50:0/38559911 >> v2:172.21.15.117:3300/0 conn(0x7f24d40cddb0 msgr2=0x7f24d40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 --2- 172.21.15.50:0/38559911 >> v2:172.21.15.117:3300/0 conn(0x7f24d40cddb0 0x7f24d40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.671+0000 7f24cbfff640 1 -- 172.21.15.50:0/38559911 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4161460 con 0x7f24d40b8430 2023-08-10T10:40:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.672+0000 7f24cbfff640 1 --2- 172.21.15.50:0/38559911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40b8430 0x7f24d40cd870 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f24d40b5490 tx=0x7f24bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95574d6e57de522c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.672+0000 7f24d1d9b640 1 -- 172.21.15.50:0/38559911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc030860 con 0x7f24d40b8430 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.672+0000 7f24d1d9b640 1 -- 172.21.15.50:0/38559911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc0309c0 con 0x7f24d40b8430 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.672+0000 7f24d1d9b640 1 -- 172.21.15.50:0/38559911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc030d50 con 0x7f24d40b8430 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 -- 172.21.15.50:0/38559911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40b8430 msgr2=0x7f24d40cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 --2- 172.21.15.50:0/38559911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40b8430 0x7f24d40cd870 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f24d40b5490 tx=0x7f24bc02b9a0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 -- 172.21.15.50:0/38559911 shutdown_connections 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 --2- 172.21.15.50:0/38559911 >> v2:172.21.15.117:3300/0 conn(0x7f24d40cddb0 0x7f24d40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 --2- 172.21.15.50:0/38559911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40b8430 0x7f24d40cd870 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 --2- 172.21.15.50:0/38559911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d4160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 -- 172.21.15.50:0/38559911 >> 172.21.15.50:0/38559911 conn(0x7f24d40d2ac0 msgr2=0x7f24d40d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 -- 172.21.15.50:0/38559911 shutdown_connections 2023-08-10T10:40:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.673+0000 7f24d8c97640 1 -- 172.21.15.50:0/38559911 wait complete. 2023-08-10T10:40:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.675+0000 7f24d8c97640 1 Processor -- start 2023-08-10T10:40:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.675+0000 7f24d8c97640 1 -- start start 2023-08-10T10:40:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 0x7f24d415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d41516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4151540 con 0x7f24d40cddb0 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415e6b0 con 0x7f24d40b8430 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.676+0000 7f24d8c97640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4152170 con 0x7f24d415cd60 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41836/0 (socket says 172.21.15.50:41836) 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 -- 172.21.15.50:0/2405547866 learned_addr learned my addr 172.21.15.50:0/2405547866 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24d2d9d640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d41516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24d259c640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 0x7f24d415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 -- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 msgr2=0x7f24d41516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d41516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 -- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 msgr2=0x7f24d415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 0x7f24d415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24cbfff640 1 -- 172.21.15.50:0/2405547866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094d0 con 0x7f24d40cddb0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.677+0000 7f24d259c640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 0x7f24d415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24cbfff640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f24bc02b9e0 tx=0x7f24bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc030830 con 0x7f24d40cddb0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc039d90 con 0x7f24d40cddb0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc043650 con 0x7f24d40cddb0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d415e920 con 0x7f24d40cddb0 2023-08-10T10:40:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.678+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d415ecb0 con 0x7f24d40cddb0 2023-08-10T10:40:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.679+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d404e270 con 0x7f24d40cddb0 2023-08-10T10:40:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.680+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24bc04c3b0 con 0x7f24d40cddb0 2023-08-10T10:40:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.681+0000 7f24caffd640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 0x7f24b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.681+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24bc0abd10 con 0x7f24d40cddb0 2023-08-10T10:40:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.682+0000 7f24d259c640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 0x7f24b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.682+0000 7f24d259c640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 0x7f24b406d110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f24c4006fd0 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.686+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f24bc0b1020 con 0x7f24d40cddb0 2023-08-10T10:40:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.869+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24d40d3940 con 0x7f24d40cddb0 2023-08-10T10:40:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.873+0000 7f24caffd640 1 -- 172.21.15.50:0/2405547866 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f24bc034090 con 0x7f24d40cddb0 2023-08-10T10:40:01.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:01.875 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:55.406923+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.875+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 msgr2=0x7f24b406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.875+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 0x7f24b406d110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f24c4006fd0 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2023-08-10T10:40:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.875+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 msgr2=0x7f24d4151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.875+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f24bc02b9e0 tx=0x7f24bc004730 comp rx=0 tx=0).stop 2023-08-10T10:40:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 shutdown_connections 2023-08-10T10:40:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d415cd60 0x7f24d41516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d40cddb0 0x7f24d4151000 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f24b406ac50 0x7f24b406d110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 --2- 172.21.15.50:0/2405547866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d40b8430 0x7f24d415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 >> 172.21.15.50:0/2405547866 conn(0x7f24d40d2ac0 msgr2=0x7f24d40cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 shutdown_connections 2023-08-10T10:40:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:01.876+0000 7f24d8c97640 1 -- 172.21.15.50:0/2405547866 wait complete. 2023-08-10T10:40:01.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:39:38.563848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:39:39.595203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:40:01.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:40:02.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.124+0000 7fd31b59e640 1 Processor -- start 2023-08-10T10:40:02.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.124+0000 7fd31b59e640 1 -- start start 2023-08-10T10:40:02.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.125+0000 7fd31b59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd31c161070 0x7fd31c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.125+0000 7fd31b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c164bf0 con 0x7fd31c0c94e0 2023-08-10T10:40:02.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31b59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c164e40 con 0x7fd31c161070 2023-08-10T10:40:02.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c165120 con 0x7fd31c0b0610 2023-08-10T10:40:02.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd31c161070 0x7fd31c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:48450/0 (socket says 172.21.15.50:48450) 2023-08-10T10:40:02.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.126+0000 7fd31ad9d640 1 -- 172.21.15.50:0/1074140303 learned_addr learned my addr 172.21.15.50:0/1074140303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:02.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.127+0000 7fd31ad9d640 1 -- 172.21.15.50:0/1074140303 >> v2:172.21.15.117:3300/0 conn(0x7fd31c161070 msgr2=0x7fd31c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:02.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.127+0000 7fd31ad9d640 1 --2- 172.21.15.50:0/1074140303 >> v2:172.21.15.117:3300/0 conn(0x7fd31c161070 0x7fd31c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.127+0000 7fd31ad9d640 1 -- 172.21.15.50:0/1074140303 >> v1:172.21.15.117:6789/0 conn(0x7fd31c0c94e0 legacy=0x7fd31c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.127+0000 7fd31ad9d640 1 -- 172.21.15.50:0/1074140303 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c165400 con 0x7fd31c0b0610 2023-08-10T10:40:02.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.129+0000 7fd31ad9d640 1 --2- 172.21.15.50:0/1074140303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd31402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=715070a9eae94b9e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.129+0000 7fd319d9b640 1 -- 172.21.15.50:0/1074140303 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31402cb00 con 0x7fd31c0b0610 2023-08-10T10:40:02.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.129+0000 7fd319d9b640 1 -- 172.21.15.50:0/1074140303 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31402cc60 con 0x7fd31c0b0610 2023-08-10T10:40:02.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.129+0000 7fd319d9b640 1 -- 172.21.15.50:0/1074140303 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140343f0 con 0x7fd31c0b0610 2023-08-10T10:40:02.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 -- 172.21.15.50:0/1074140303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 msgr2=0x7fd31c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 --2- 172.21.15.50:0/1074140303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd31402bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 -- 172.21.15.50:0/1074140303 shutdown_connections 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 --2- 172.21.15.50:0/1074140303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c0cc590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 --2- 172.21.15.50:0/1074140303 >> v2:172.21.15.117:3300/0 conn(0x7fd31c161070 0x7fd31c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 -- 172.21.15.50:0/1074140303 >> 172.21.15.50:0/1074140303 conn(0x7fd31c069cd0 msgr2=0x7fd31c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 -- 172.21.15.50:0/1074140303 shutdown_connections 2023-08-10T10:40:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.130+0000 7fd31b59e640 1 -- 172.21.15.50:0/1074140303 wait complete. 2023-08-10T10:40:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.132+0000 7fd31b59e640 1 Processor -- start 2023-08-10T10:40:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.132+0000 7fd31b59e640 1 -- start start 2023-08-10T10:40:02.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd31c0c94e0 0x7fd31c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c60c0 con 0x7fd31c161070 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c63a0 con 0x7fd31c0c94e0 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c6680 con 0x7fd31c0b0610 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41840/0 (socket says 172.21.15.50:41840) 2023-08-10T10:40:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31ad9d640 1 -- 172.21.15.50:0/575745147 learned_addr learned my addr 172.21.15.50:0/575745147 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd31a59c640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.133+0000 7fd313fff640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd31c0c94e0 0x7fd31c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 -- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 msgr2=0x7fd31c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 -- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd31c0c94e0 msgr2=0x7fd31c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd31c0c94e0 0x7fd31c0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 -- 172.21.15.50:0/575745147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314009b30 con 0x7fd31c161070 2023-08-10T10:40:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31ad9d640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd314004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314009510 con 0x7fd31c161070 2023-08-10T10:40:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31403e450 con 0x7fd31c161070 2023-08-10T10:40:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31403e800 con 0x7fd31c161070 2023-08-10T10:40:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.134+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0c6960 con 0x7fd31c161070 2023-08-10T10:40:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.135+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c15b0c0 con 0x7fd31c161070 2023-08-10T10:40:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.136+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c0c6b80 con 0x7fd31c161070 2023-08-10T10:40:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.137+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd31403e960 con 0x7fd31c161070 2023-08-10T10:40:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.137+0000 7fd312ffd640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 0x7fd30006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.138+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3140ac250 con 0x7fd31c161070 2023-08-10T10:40:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.138+0000 7fd31a59c640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 0x7fd30006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.138+0000 7fd31a59c640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 0x7fd30006d110 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd31c071580 tx=0x7fd30c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.142+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd314077260 con 0x7fd31c161070 2023-08-10T10:40:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.323+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd31c066e30 con 0x7fd31c161070 2023-08-10T10:40:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.324+0000 7fd312ffd640 1 -- 172.21.15.50:0/575745147 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd31407a880 con 0x7fd31c161070 2023-08-10T10:40:02.325 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:40:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 msgr2=0x7fd30006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 0x7fd30006d110 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd31c071580 tx=0x7fd30c008040 comp rx=0 tx=0).stop 2023-08-10T10:40:02.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 msgr2=0x7fd31c0c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd314004a40 comp rx=0 tx=0).stop 2023-08-10T10:40:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 shutdown_connections 2023-08-10T10:40:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c161070 0x7fd31c0c5a90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd30006ac50 0x7fd30006d110 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd31c0c94e0 0x7fd31c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 --2- 172.21.15.50:0/575745147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd31c0b0610 0x7fd31c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 >> 172.21.15.50:0/575745147 conn(0x7fd31c069cd0 msgr2=0x7fd31c15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:02.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 shutdown_connections 2023-08-10T10:40:02.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.326+0000 7fd31b59e640 1 -- 172.21.15.50:0/575745147 wait complete. 2023-08-10T10:40:02.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:40:02.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.574+0000 7f9450e57640 1 Processor -- start 2023-08-10T10:40:02.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.575+0000 7f9450e57640 1 -- start start 2023-08-10T10:40:02.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.576+0000 7f9450e57640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 0x7f944c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.576+0000 7f9450e57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.576+0000 7f9450e57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c0adcb0 con 0x7f944c15ae40 2023-08-10T10:40:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.576+0000 7f9450e57640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c06c320 con 0x7f944c0cd9b0 2023-08-10T10:40:02.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.576+0000 7f9450e57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c06b770 con 0x7f944c06cb30 2023-08-10T10:40:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.577+0000 7f944ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.577+0000 7f9443fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 0x7f944c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.577+0000 7f944ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:48454/0 (socket says 172.21.15.50:48454) 2023-08-10T10:40:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.577+0000 7f944ad9d640 1 -- 172.21.15.50:0/1938999035 learned_addr learned my addr 172.21.15.50:0/1938999035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:02.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f944ad9d640 1 -- 172.21.15.50:0/1938999035 >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 msgr2=0x7f944c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:02.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f944ad9d640 1 --2- 172.21.15.50:0/1938999035 >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 0x7f944c0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f944ad9d640 1 -- 172.21.15.50:0/1938999035 >> v1:172.21.15.117:6789/0 conn(0x7f944c15ae40 legacy=0x7f944c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f944ad9d640 1 -- 172.21.15.50:0/1938999035 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c06b9f0 con 0x7f944c06cb30 2023-08-10T10:40:02.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f9449d9b640 1 -- 172.21.15.50:0/1938999035 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581511606 0 0) 0x7f944c0adcb0 con 0x7f944c15ae40 2023-08-10T10:40:02.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.578+0000 7f9443fff640 1 --2- 172.21.15.50:0/1938999035 >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 0x7f944c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:40:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.580+0000 7f944ad9d640 1 --2- 172.21.15.50:0/1938999035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f944402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812779d508c38698 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.580+0000 7f9449d9b640 1 -- 172.21.15.50:0/1938999035 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944402cb00 con 0x7f944c06cb30 2023-08-10T10:40:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9449d9b640 1 -- 172.21.15.50:0/1938999035 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944402cc60 con 0x7f944c06cb30 2023-08-10T10:40:02.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9449d9b640 1 -- 172.21.15.50:0/1938999035 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94440343f0 con 0x7f944c06cb30 2023-08-10T10:40:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 -- 172.21.15.50:0/1938999035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 msgr2=0x7f944c0ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 --2- 172.21.15.50:0/1938999035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f944402bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 -- 172.21.15.50:0/1938999035 shutdown_connections 2023-08-10T10:40:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 --2- 172.21.15.50:0/1938999035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c06cb30 0x7f944c0ad770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 --2- 172.21.15.50:0/1938999035 >> v2:172.21.15.117:3300/0 conn(0x7f944c0cd9b0 0x7f944c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 -- 172.21.15.50:0/1938999035 >> 172.21.15.50:0/1938999035 conn(0x7f944c0b01b0 msgr2=0x7f944c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 -- 172.21.15.50:0/1938999035 shutdown_connections 2023-08-10T10:40:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.581+0000 7f9450e57640 1 -- 172.21.15.50:0/1938999035 wait complete. 2023-08-10T10:40:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.583+0000 7f9450e57640 1 Processor -- start 2023-08-10T10:40:02.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.583+0000 7f9450e57640 1 -- start start 2023-08-10T10:40:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c0cd9b0 0x7f944c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f944c15ae40 0x7f944c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c156e80 con 0x7f944c06cb30 2023-08-10T10:40:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c15d9b0 con 0x7f944c15ae40 2023-08-10T10:40:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.584+0000 7f9450e57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c15cda0 con 0x7f944c0cd9b0 2023-08-10T10:40:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41856/0 (socket says 172.21.15.50:41856) 2023-08-10T10:40:02.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 -- 172.21.15.50:0/494572912 learned_addr learned my addr 172.21.15.50:0/494572912 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 -- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c0cd9b0 msgr2=0x7f944c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c0cd9b0 0x7f944c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 -- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f944c15ae40 msgr2=0x7f944c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f944c15ae40 0x7f944c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 -- 172.21.15.50:0/494572912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009400 con 0x7f944c06cb30 2023-08-10T10:40:02.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.585+0000 7f944a59c640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c3c0 tx=0x7f943c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.586+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0035f0 con 0x7f944c06cb30 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.586+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c003770 con 0x7f944c06cb30 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.586+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c003b20 con 0x7f944c06cb30 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.586+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9444009b30 con 0x7f944c06cb30 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.586+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c15d360 con 0x7f944c06cb30 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.587+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c0612b0 con 0x7f944c06cb30 2023-08-10T10:40:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.588+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f943c003c80 con 0x7f944c06cb30 2023-08-10T10:40:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.589+0000 7f9442ffd640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 0x7f942c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.589+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f943c088a30 con 0x7f944c06cb30 2023-08-10T10:40:02.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.589+0000 7f9443fff640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 0x7f942c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:02.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.590+0000 7f9443fff640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 0x7f942c06d110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9434006e80 tx=0x7f9434006dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:02.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.593+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f943c053ad0 con 0x7f944c06cb30 2023-08-10T10:40:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.774+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f944c0cd5e0 con 0x7f944c06cb30 2023-08-10T10:40:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.775+0000 7f9442ffd640 1 -- 172.21.15.50:0/494572912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f943c0570f0 con 0x7f944c06cb30 2023-08-10T10:40:02.777 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:40:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.777+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 msgr2=0x7f942c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.777+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 0x7f942c06d110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9434006e80 tx=0x7f9434006dd0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 msgr2=0x7f944c15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c3c0 tx=0x7f943c00c880 comp rx=0 tx=0).stop 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 shutdown_connections 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f942c06ac50 0x7f942c06d110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f944c15ae40 0x7f944c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f944c0cd9b0 0x7f944c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 --2- 172.21.15.50:0/494572912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c06cb30 0x7f944c15de40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 >> 172.21.15.50:0/494572912 conn(0x7f944c0b01b0 msgr2=0x7f944c158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 shutdown_connections 2023-08-10T10:40:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:02.778+0000 7f9450e57640 1 -- 172.21.15.50:0/494572912 wait complete. 2023-08-10T10:40:02.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:40:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.023+0000 7f7b7007c640 1 Processor -- start 2023-08-10T10:40:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.024+0000 7f7b7007c640 1 -- start start 2023-08-10T10:40:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.025+0000 7f7b7007c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b680ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b7007c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b68161640 con 0x7f7b680b0cd0 2023-08-10T10:40:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b7007c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680adb30 con 0x7f7b6806f3a0 2023-08-10T10:40:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b7007c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680c1bb0 con 0x7f7b68161260 2023-08-10T10:40:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b6d617640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b680b0cd0 0x7f7b6806ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38254/0 (socket says 172.21.15.50:38254) 2023-08-10T10:40:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b6d617640 1 -- 172.21.15.50:0/2253484253 learned_addr learned my addr 172.21.15.50:0/2253484253 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b6de18640 1 --2- 172.21.15.50:0/2253484253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b680ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.026+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764131399 0 0) 0x7f7b68161640 con 0x7f7b680b0cd0 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.027+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b54003520 con 0x7f7b680b0cd0 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.027+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2094040209 0 0) 0x7f7b54003520 con 0x7f7b680b0cd0 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.027+0000 7f7b6de18640 1 -- 172.21.15.50:0/2253484253 >> v1:172.21.15.117:6789/0 conn(0x7f7b6806f3a0 legacy=0x7f7b680696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.027+0000 7f7b6de18640 1 -- 172.21.15.50:0/2253484253 >> v1:172.21.15.50:6789/0 conn(0x7f7b680b0cd0 legacy=0x7f7b6806ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.027+0000 7f7b6de18640 1 -- 172.21.15.50:0/2253484253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680ade10 con 0x7f7b68161260 2023-08-10T10:40:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.028+0000 7f7b6de18640 1 --2- 172.21.15.50:0/2253484253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b680ca520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009dc0 tx=0x7f7b6402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113176e3c8235d32 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.029+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58001670 con 0x7f7b68161260 2023-08-10T10:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.029+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6402c880 con 0x7f7b68161260 2023-08-10T10:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.029+0000 7f7b6ce16640 1 -- 172.21.15.50:0/2253484253 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6402cc10 con 0x7f7b68161260 2023-08-10T10:40:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 -- 172.21.15.50:0/2253484253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 msgr2=0x7f7b680ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 --2- 172.21.15.50:0/2253484253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b680ca520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009dc0 tx=0x7f7b6402bd50 comp rx=0 tx=0).stop 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 -- 172.21.15.50:0/2253484253 shutdown_connections 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 --2- 172.21.15.50:0/2253484253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b680ca520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 -- 172.21.15.50:0/2253484253 >> 172.21.15.50:0/2253484253 conn(0x7f7b680b01b0 msgr2=0x7f7b680b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 -- 172.21.15.50:0/2253484253 shutdown_connections 2023-08-10T10:40:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.030+0000 7f7b7007c640 1 -- 172.21.15.50:0/2253484253 wait complete. 2023-08-10T10:40:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.032+0000 7f7b7007c640 1 Processor -- start 2023-08-10T10:40:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.032+0000 7f7b7007c640 1 -- start start 2023-08-10T10:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 0x7f7b681f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b681f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680b2150 con 0x7f7b6806f3a0 2023-08-10T10:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680c3740 con 0x7f7b680b0cd0 2023-08-10T10:40:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b7007c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680c3a20 con 0x7f7b68161260 2023-08-10T10:40:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b6de18640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b6de18640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41858/0 (socket says 172.21.15.50:41858) 2023-08-10T10:40:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.033+0000 7f7b6de18640 1 -- 172.21.15.50:0/3255299259 learned_addr learned my addr 172.21.15.50:0/3255299259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6d617640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 0x7f7b681f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6e619640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b681f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 -- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 msgr2=0x7f7b681f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b681f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 -- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 msgr2=0x7f7b681f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 0x7f7b681f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 -- 172.21.15.50:0/3255299259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009a70 con 0x7f7b6806f3a0 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6d617640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 0x7f7b681f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b6de18640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7b64037040 tx=0x7f7b64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6402ce70 con 0x7f7b6806f3a0 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.034+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64009450 con 0x7f7b6806f3a0 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.035+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003bd0 con 0x7f7b6806f3a0 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.035+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680c3d00 con 0x7f7b6806f3a0 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.035+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b680c3380 con 0x7f7b6806f3a0 2023-08-10T10:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.036+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b680612b0 con 0x7f7b6806f3a0 2023-08-10T10:40:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.037+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b6403b050 con 0x7f7b6806f3a0 2023-08-10T10:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.039+0000 7f7b5e7fc640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 0x7f7b4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.039+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b640abd40 con 0x7f7b6806f3a0 2023-08-10T10:40:03.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.039+0000 7f7b6d617640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 0x7f7b4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.040+0000 7f7b6d617640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 0x7f7b4c06d110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b580011e0 tx=0x7f7b58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.043+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7b64076e70 con 0x7f7b6806f3a0 2023-08-10T10:40:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.239+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b680c95b0 con 0x7f7b6806f3a0 2023-08-10T10:40:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.240+0000 7f7b5e7fc640 1 -- 172.21.15.50:0/3255299259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b64039020 con 0x7f7b6806f3a0 2023-08-10T10:40:03.242 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:40:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 msgr2=0x7f7b4c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 0x7f7b4c06d110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b580011e0 tx=0x7f7b58009040 comp rx=0 tx=0).stop 2023-08-10T10:40:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 msgr2=0x7f7b680c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7b64037040 tx=0x7f7b64004a40 comp rx=0 tx=0).stop 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 shutdown_connections 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b68161260 0x7f7b681f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b4c06ac50 0x7f7b4c06d110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b680b0cd0 0x7f7b681f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 --2- 172.21.15.50:0/3255299259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b6806f3a0 0x7f7b680c4db0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 >> 172.21.15.50:0/3255299259 conn(0x7f7b680b01b0 msgr2=0x7f7b680af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:03.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 shutdown_connections 2023-08-10T10:40:03.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.243+0000 7f7b7007c640 1 -- 172.21.15.50:0/3255299259 wait complete. 2023-08-10T10:40:03.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:40:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.495+0000 7f753605e640 1 Processor -- start 2023-08-10T10:40:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.496+0000 7f753605e640 1 -- start start 2023-08-10T10:40:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.497+0000 7f753605e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f753006b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.497+0000 7f753605e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530073320 con 0x7f75300cb930 2023-08-10T10:40:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.497+0000 7f753605e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300cb720 con 0x7f753006bcc0 2023-08-10T10:40:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.497+0000 7f753605e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7530160a90 con 0x7f75300cb340 2023-08-10T10:40:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.498+0000 7f7527fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75300cb930 0x7f7530160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38256/0 (socket says 172.21.15.50:38256) 2023-08-10T10:40:03.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.498+0000 7f7527fff640 1 -- 172.21.15.50:0/2841705003 learned_addr learned my addr 172.21.15.50:0/2841705003 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:03.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.498+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274610311 0 0) 0x7f7530073320 con 0x7f75300cb930 2023-08-10T10:40:03.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.498+0000 7f752f7fe640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f753006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.498+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f751c003520 con 0x7f75300cb930 2023-08-10T10:40:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369762722 0 0) 0x7f751c003520 con 0x7f75300cb930 2023-08-10T10:40:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 msgr2=0x7f753006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f753006b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 >> v1:172.21.15.117:6789/0 conn(0x7f753006bcc0 legacy=0x7f75300ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530072a80 con 0x7f75300cb930 2023-08-10T10:40:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7518001670 con 0x7f75300cb930 2023-08-10T10:40:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 >> v1:172.21.15.50:6789/0 conn(0x7f75300cb930 legacy=0x7f7530160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f751c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f751c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c004d00 0x7f751c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530160a90 con 0x7f751c003f20 2023-08-10T10:40:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00bbc0 con 0x7f751c004d00 2023-08-10T10:40:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00bd80 con 0x7f75300cb340 2023-08-10T10:40:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f7527fff640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f751c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.499+0000 7f752f7fe640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f751c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f752ffff640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c004d00 0x7f751c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f7527fff640 1 -- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 msgr2=0x7f751c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f7527fff640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f751c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f7527fff640 1 -- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c004d00 msgr2=0x7f751c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:03.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f7527fff640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c004d00 0x7f751c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f7527fff640 1 -- 172.21.15.50:0/2841705003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c003520 con 0x7f751c003f20 2023-08-10T10:40:03.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.500+0000 7f752f7fe640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75300cb340 0x7f751c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:03.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.501+0000 7f7527fff640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f751c0047c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f751800c240 tx=0x7f751c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1475602a7a23e26c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.501+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518005ad0 con 0x7f751c003f20 2023-08-10T10:40:03.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.501+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7518005c50 con 0x7f751c003f20 2023-08-10T10:40:03.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.501+0000 7f752effd640 1 -- 172.21.15.50:0/2841705003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751802c8b0 con 0x7f751c003f20 2023-08-10T10:40:03.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 -- 172.21.15.50:0/2841705003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 msgr2=0x7f751c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 --2- 172.21.15.50:0/2841705003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f751c0047c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f751800c240 tx=0x7f751c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f752ffff640 1 -- 172.21.15.50:0/2841705003 reap_dead start 2023-08-10T10:40:03.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 -- 172.21.15.50:0/2841705003 shutdown_connections 2023-08-10T10:40:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 -- 172.21.15.50:0/2841705003 >> 172.21.15.50:0/2841705003 conn(0x7f75300b12a0 msgr2=0x7f75300b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 -- 172.21.15.50:0/2841705003 shutdown_connections 2023-08-10T10:40:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.502+0000 7f753605e640 1 -- 172.21.15.50:0/2841705003 wait complete. 2023-08-10T10:40:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.504+0000 7f753605e640 1 Processor -- start 2023-08-10T10:40:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.504+0000 7f753605e640 1 -- start start 2023-08-10T10:40:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300ac890 0x7f753015ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75301f65c0 0x7f75300b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301f5de0 con 0x7f751c003f20 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301f3040 con 0x7f75300ac890 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.505+0000 7f753605e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75301f3320 con 0x7f75301f65c0 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41870/0 (socket says 172.21.15.50:41870) 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 -- 172.21.15.50:0/3743986059 learned_addr learned my addr 172.21.15.50:0/3743986059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752ffff640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75301f65c0 0x7f75300b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f7527fff640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300ac890 0x7f753015ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 -- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75301f65c0 msgr2=0x7f75300b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75301f65c0 0x7f75300b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 -- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300ac890 msgr2=0x7f753015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300ac890 0x7f753015ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 -- 172.21.15.50:0/3743986059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75301f3600 con 0x7f751c003f20 2023-08-10T10:40:03.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.506+0000 7f752f7fe640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f75200116d0 tx=0x7f7520011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.507+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000f9c0 con 0x7f751c003f20 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.507+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000fb20 con 0x7f751c003f20 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.507+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000fed0 con 0x7f751c003f20 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.507+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75301f60a0 con 0x7f751c003f20 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.507+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753015d3f0 con 0x7f751c003f20 2023-08-10T10:40:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.508+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75300cdcb0 con 0x7f751c003f20 2023-08-10T10:40:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.509+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7520015460 con 0x7f751c003f20 2023-08-10T10:40:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.510+0000 7f752cff9640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 0x7f751006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.510+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7520089e80 con 0x7f751c003f20 2023-08-10T10:40:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.510+0000 7f7527fff640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 0x7f751006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.511+0000 7f7527fff640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 0x7f751006d140 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7518034000 tx=0x7f7518009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.514+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7520054e90 con 0x7f751c003f20 2023-08-10T10:40:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.713+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75300612b0 con 0x7f751c003f20 2023-08-10T10:40:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.713+0000 7f752cff9640 1 -- 172.21.15.50:0/3743986059 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75200584b0 con 0x7f751c003f20 2023-08-10T10:40:03.715 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:40:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.716+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 msgr2=0x7f751006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.716+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 0x7f751006d140 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7518034000 tx=0x7f7518009030 comp rx=0 tx=0).stop 2023-08-10T10:40:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.716+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 msgr2=0x7f75301f2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.716+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f75200116d0 tx=0x7f7520011b90 comp rx=0 tx=0).stop 2023-08-10T10:40:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 shutdown_connections 2023-08-10T10:40:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75301f65c0 0x7f75300b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751006ac80 0x7f751006d140 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300ac890 0x7f753015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 --2- 172.21.15.50:0/3743986059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c003f20 0x7f75301f2810 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 >> 172.21.15.50:0/3743986059 conn(0x7f75300b12a0 msgr2=0x7f753015fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 shutdown_connections 2023-08-10T10:40:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.717+0000 7f753605e640 1 -- 172.21.15.50:0/3743986059 wait complete. 2023-08-10T10:40:03.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:40:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.958+0000 7f0a766e7640 1 Processor -- start 2023-08-10T10:40:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.958+0000 7f0a766e7640 1 -- start start 2023-08-10T10:40:03.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a7015a820 0x7f0a7006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a700696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a700b40e0 0x7f0a70069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a700c5540 con 0x7f0a700b40e0 2023-08-10T10:40:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7015bcb0 con 0x7f0a7015a820 2023-08-10T10:40:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a766e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7015b0a0 con 0x7f0a7015ac00 2023-08-10T10:40:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.960+0000 7f0a74c84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a700b40e0 0x7f0a70069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a700b40e0 0x7f0a70069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41872/0 (socket says 172.21.15.50:41872) 2023-08-10T10:40:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 -- 172.21.15.50:0/716920543 learned_addr learned my addr 172.21.15.50:0/716920543 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a6f7fe640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a700696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a6ffff640 1 --2- 172.21.15.50:0/716920543 >> v2:172.21.15.117:3300/0 conn(0x7f0a7015a820 0x7f0a7006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 -- 172.21.15.50:0/716920543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 msgr2=0x7f0a700696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a700696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 -- 172.21.15.50:0/716920543 >> v2:172.21.15.117:3300/0 conn(0x7f0a7015a820 msgr2=0x7f0a7006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 --2- 172.21.15.50:0/716920543 >> v2:172.21.15.117:3300/0 conn(0x7f0a7015a820 0x7f0a7006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.961+0000 7f0a74c84640 1 -- 172.21.15.50:0/716920543 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7015b380 con 0x7f0a700b40e0 2023-08-10T10:40:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.962+0000 7f0a74c84640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a700b40e0 0x7f0a70069be0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cee20 tx=0x7f0a6802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fea83497afd2d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a6effd640 1 -- 172.21.15.50:0/716920543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68031860 con 0x7f0a700b40e0 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a6effd640 1 -- 172.21.15.50:0/716920543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a680319c0 con 0x7f0a700b40e0 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a6effd640 1 -- 172.21.15.50:0/716920543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68031d50 con 0x7f0a700b40e0 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 -- 172.21.15.50:0/716920543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a700b40e0 msgr2=0x7f0a70069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a700b40e0 0x7f0a70069be0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cee20 tx=0x7f0a6802b900 comp rx=0 tx=0).stop 2023-08-10T10:40:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 -- 172.21.15.50:0/716920543 shutdown_connections 2023-08-10T10:40:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a700b40e0 0x7f0a70069be0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 --2- 172.21.15.50:0/716920543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a700696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 --2- 172.21.15.50:0/716920543 >> v2:172.21.15.117:3300/0 conn(0x7f0a7015a820 0x7f0a7006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 -- 172.21.15.50:0/716920543 >> 172.21.15.50:0/716920543 conn(0x7f0a700b08e0 msgr2=0x7f0a700ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 -- 172.21.15.50:0/716920543 shutdown_connections 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.963+0000 7f0a766e7640 1 -- 172.21.15.50:0/716920543 wait complete. 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.965+0000 7f0a766e7640 1 Processor -- start 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.965+0000 7f0a766e7640 1 -- start start 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a700b40e0 0x7f0a700adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a7006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700c2dd0 con 0x7f0a7015a820 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70070da0 con 0x7f0a700b40e0 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a766e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70159e30 con 0x7f0a7015ac00 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.966+0000 7f0a6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41876/0 (socket says 172.21.15.50:41876) 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 -- 172.21.15.50:0/2798769631 learned_addr learned my addr 172.21.15.50:0/2798769631 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a74c84640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a7006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 -- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 msgr2=0x7f0a7006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6ffff640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a700b40e0 0x7f0a700adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a7006fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 -- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a700b40e0 msgr2=0x7f0a700adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a700b40e0 0x7f0a700adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 -- 172.21.15.50:0/2798769631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680094d0 con 0x7f0a7015a820 2023-08-10T10:40:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.967+0000 7f0a6f7fe640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400d5f0 tx=0x7f0a6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.968+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640125f0 con 0x7f0a7015a820 2023-08-10T10:40:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.968+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64012750 con 0x7f0a7015a820 2023-08-10T10:40:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.968+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64012b00 con 0x7f0a7015a820 2023-08-10T10:40:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.968+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a700c4610 con 0x7f0a7015a820 2023-08-10T10:40:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.968+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a700c4bd0 con 0x7f0a7015a820 2023-08-10T10:40:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.969+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7004e270 con 0x7f0a7015a820 2023-08-10T10:40:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.970+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a64012c60 con 0x7f0a7015a820 2023-08-10T10:40:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.971+0000 7f0a6cff9640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 0x7f0a5c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.972+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a640898a0 con 0x7f0a7015a820 2023-08-10T10:40:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.972+0000 7f0a6ffff640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 0x7f0a5c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.973+0000 7f0a6ffff640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 0x7f0a5c06d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cece0 tx=0x7f0a6000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:03.976+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0a640549e0 con 0x7f0a7015a820 2023-08-10T10:40:04.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.178+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0a701655f0 con 0x7f0a7015a820 2023-08-10T10:40:04.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.178+0000 7f0a6cff9640 1 -- 172.21.15.50:0/2798769631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0a64058000 con 0x7f0a7015a820 2023-08-10T10:40:04.180 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:40:04.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 msgr2=0x7f0a5c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 0x7f0a5c06d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cece0 tx=0x7f0a6000b040 comp rx=0 tx=0).stop 2023-08-10T10:40:04.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 msgr2=0x7f0a701598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400d5f0 tx=0x7f0a6400dab0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 shutdown_connections 2023-08-10T10:40:04.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a7015ac00 0x7f0a7006fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7015a820 0x7f0a701598f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a5c06ac50 0x7f0a5c06d110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 --2- 172.21.15.50:0/2798769631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a700b40e0 0x7f0a700adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 >> 172.21.15.50:0/2798769631 conn(0x7f0a700b08e0 msgr2=0x7f0a7015d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.181+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 shutdown_connections 2023-08-10T10:40:04.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.182+0000 7f0a766e7640 1 -- 172.21.15.50:0/2798769631 wait complete. 2023-08-10T10:40:04.202 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:40:04.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:04.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:40:04.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:40:04.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:04.337 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:40:04.382 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:04.382 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:04.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:40:04.444 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:04.444 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:04.489 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:40:04.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:04.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.730+0000 7fb4f34f9640 1 Processor -- start 2023-08-10T10:40:04.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.730+0000 7fb4f34f9640 1 -- start start 2023-08-10T10:40:04.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f34f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4ec160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f34f9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec161180 con 0x7fb4ec0b8430 2023-08-10T10:40:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f34f9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec161460 con 0x7fb4ec0cdf80 2023-08-10T10:40:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f34f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0b5bd0 con 0x7fb4ec15cd60 2023-08-10T10:40:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f0a94640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4ec0b8430 0x7fb4ec0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38262/0 (socket says 172.21.15.50:38262) 2023-08-10T10:40:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f0a94640 1 -- 172.21.15.50:0/3025656152 learned_addr learned my addr 172.21.15.50:0/3025656152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4f1295640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4ec160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212949505 0 0) 0x7fb4ec161180 con 0x7fb4ec0b8430 2023-08-10T10:40:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.732+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d8003520 con 0x7fb4ec0b8430 2023-08-10T10:40:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142979632 0 0) 0x7fb4d8003520 con 0x7fb4ec0b8430 2023-08-10T10:40:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 msgr2=0x7fb4ec160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4ec160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 >> v1:172.21.15.117:6789/0 conn(0x7fb4ec0cdf80 legacy=0x7fb4ec0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec161740 con 0x7fb4ec0b8430 2023-08-10T10:40:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb4dc001670 con 0x7fb4ec0b8430 2023-08-10T10:40:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 >> v1:172.21.15.50:6789/0 conn(0x7fb4ec0b8430 legacy=0x7fb4ec0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0b5bd0 con 0x7fb4d80039a0 2023-08-10T10:40:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bac0 con 0x7fb4d8004d00 2023-08-10T10:40:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bc80 con 0x7fb4ec15cd60 2023-08-10T10:40:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4f1295640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4f0a94640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.733+0000 7fb4f1a96640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.734+0000 7fb4f1295640 1 -- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 msgr2=0x7fb4d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:04.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.734+0000 7fb4f1295640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4ec15cd60 0x7fb4d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.734+0000 7fb4f1295640 1 -- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d8004d00 msgr2=0x7fb4d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:04.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.734+0000 7fb4f1295640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d8004d00 0x7fb4d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.734+0000 7fb4f1295640 1 -- 172.21.15.50:0/3025656152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8003520 con 0x7fb4d80039a0 2023-08-10T10:40:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.735+0000 7fb4f1295640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009f90 tx=0x7fb4d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde05f02d37d6389 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:04.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.735+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e802cbd0 con 0x7fb4d80039a0 2023-08-10T10:40:04.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.735+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800f040 con 0x7fb4d80039a0 2023-08-10T10:40:04.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.735+0000 7fb4e3fff640 1 -- 172.21.15.50:0/3025656152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8034440 con 0x7fb4d80039a0 2023-08-10T10:40:04.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 -- 172.21.15.50:0/3025656152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d80039a0 msgr2=0x7fb4d8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/3025656152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4d80039a0 0x7fb4d8003dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009f90 tx=0x7fb4d80057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f1a96640 1 -- 172.21.15.50:0/3025656152 reap_dead start 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 -- 172.21.15.50:0/3025656152 shutdown_connections 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 -- 172.21.15.50:0/3025656152 >> 172.21.15.50:0/3025656152 conn(0x7fb4ec0d2ac0 msgr2=0x7fb4ec0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 -- 172.21.15.50:0/3025656152 shutdown_connections 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.737+0000 7fb4f34f9640 1 -- 172.21.15.50:0/3025656152 wait complete. 2023-08-10T10:40:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.739+0000 7fb4f34f9640 1 Processor -- start 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.739+0000 7fb4f34f9640 1 -- start start 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 0x7fb4ec15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4ec15e2f0 0x7fb4ec1f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f3200 con 0x7fb4ec1f2810 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c9b00 con 0x7fb4ec15e2f0 2023-08-10T10:40:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0ca0c0 con 0x7fb4d80039a0 2023-08-10T10:40:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41886/0 (socket says 172.21.15.50:41886) 2023-08-10T10:40:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 -- 172.21.15.50:0/2682775295 learned_addr learned my addr 172.21.15.50:0/2682775295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f0a94640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4ec15e2f0 0x7fb4ec1f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1295640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 0x7fb4ec15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 -- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 msgr2=0x7fb4ec15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 0x7fb4ec15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 -- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4ec15e2f0 msgr2=0x7fb4ec1f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4ec15e2f0 0x7fb4ec1f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 -- 172.21.15.50:0/2682775295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec15e770 con 0x7fb4ec1f2810 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1295640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 0x7fb4ec15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f1a96640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0b5490 tx=0x7fb4e400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40052e0 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4005440 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec160230 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4003830 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.740+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec15eca0 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.742+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec0ca250 con 0x7fb4ec1f2810 2023-08-10T10:40:04.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.742+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4e4003990 con 0x7fb4ec1f2810 2023-08-10T10:40:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.743+0000 7fb4e1ffb640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 0x7fb4d006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.743+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4e4088aa0 con 0x7fb4ec1f2810 2023-08-10T10:40:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.744+0000 7fb4f1295640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 0x7fb4d006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.744+0000 7fb4f1295640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 0x7fb4d006d110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8036000 tx=0x7fb4e802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.748+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4e4053b40 con 0x7fb4ec1f2810 2023-08-10T10:40:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.972+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4ec04e270 con 0x7fb4ec1f2810 2023-08-10T10:40:04.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.972+0000 7fb4e1ffb640 1 -- 172.21.15.50:0/2682775295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fb4e4019090 con 0x7fb4ec1f2810 2023-08-10T10:40:04.973 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:04.974 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:40:04.974 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:40:04.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.974+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 msgr2=0x7fb4d006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.974+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 0x7fb4d006d110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8036000 tx=0x7fb4e802e000 comp rx=0 tx=0).stop 2023-08-10T10:40:04.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.974+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 msgr2=0x7fb4ec1f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:04.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.974+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0b5490 tx=0x7fb4e400e8a0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 shutdown_connections 2023-08-10T10:40:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec1f2810 0x7fb4ec1f2cc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4d006ac50 0x7fb4d006d110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4ec15e2f0 0x7fb4ec1f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 --2- 172.21.15.50:0/2682775295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d80039a0 0x7fb4ec15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:04.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 >> 172.21.15.50:0/2682775295 conn(0x7fb4ec0d2ac0 msgr2=0x7fb4ec0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:04.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 shutdown_connections 2023-08-10T10:40:04.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:04.976+0000 7fb4f34f9640 1 -- 172.21.15.50:0/2682775295 wait complete. 2023-08-10T10:40:04.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.212+0000 7f61c3f57640 1 Processor -- start 2023-08-10T10:40:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.212+0000 7f61c3f57640 1 -- start start 2023-08-10T10:40:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c3f57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc0b0c60 0x7f61bc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c3f57640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61bc0b3f30 0x7f61bc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c3f57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc071c70 con 0x7f61bc15aa40 2023-08-10T10:40:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c3f57640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0713d0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c3f57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0716b0 con 0x7f61bc0b0c60 2023-08-10T10:40:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c24f4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61bc0b3f30 0x7f61bc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c24f4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61bc0b3f30 0x7f61bc0c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50574/0 (socket says 172.21.15.50:50574) 2023-08-10T10:40:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.214+0000 7f61c24f4640 1 -- 172.21.15.50:0/58712381 learned_addr learned my addr 172.21.15.50:0/58712381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.215+0000 7f61c14f2640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc0b0c60 0x7f61bc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.215+0000 7f61c24f4640 1 -- 172.21.15.50:0/58712381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc0b0c60 msgr2=0x7f61bc0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.215+0000 7f61c24f4640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc0b0c60 0x7f61bc0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.215+0000 7f61c24f4640 1 -- 172.21.15.50:0/58712381 >> v1:172.21.15.117:6789/0 conn(0x7f61bc15aa40 legacy=0x7f61bc0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.215+0000 7f61c24f4640 1 -- 172.21.15.50:0/58712381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc071990 con 0x7f61bc0b3f30 2023-08-10T10:40:05.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.216+0000 7f61c24f4640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc0c9e60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009870 tx=0x7f61b402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9ac4c3176e6103 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.216+0000 7f61c0cf1640 1 -- 172.21.15.50:0/58712381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40317c0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.216+0000 7f61c0cf1640 1 -- 172.21.15.50:0/58712381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4031920 con 0x7f61bc0b3f30 2023-08-10T10:40:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.216+0000 7f61c0cf1640 1 -- 172.21.15.50:0/58712381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4031cb0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 -- 172.21.15.50:0/58712381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 msgr2=0x7f61bc0c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc0c9e60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009870 tx=0x7f61b402b860 comp rx=0 tx=0).stop 2023-08-10T10:40:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 -- 172.21.15.50:0/58712381 shutdown_connections 2023-08-10T10:40:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc0c9e60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 --2- 172.21.15.50:0/58712381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc0b0c60 0x7f61bc0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 -- 172.21.15.50:0/58712381 >> 172.21.15.50:0/58712381 conn(0x7f61bc06b590 msgr2=0x7f61bc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:05.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 -- 172.21.15.50:0/58712381 shutdown_connections 2023-08-10T10:40:05.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.217+0000 7f61c3f57640 1 -- 172.21.15.50:0/58712381 wait complete. 2023-08-10T10:40:05.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.219+0000 7f61c3f57640 1 Processor -- start 2023-08-10T10:40:05.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.219+0000 7f61c3f57640 1 -- start start 2023-08-10T10:40:05.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61bc0b0c60 0x7f61bc1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc15aa40 0x7f61bc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1f2510 con 0x7f61bc0b3f30 2023-08-10T10:40:05.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1f27d0 con 0x7f61bc0b0c60 2023-08-10T10:40:05.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c3f57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1f2ab0 con 0x7f61bc15aa40 2023-08-10T10:40:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c14f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c14f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50580/0 (socket says 172.21.15.50:50580) 2023-08-10T10:40:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.220+0000 7f61c14f2640 1 -- 172.21.15.50:0/61655575 learned_addr learned my addr 172.21.15.50:0/61655575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 -- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc15aa40 msgr2=0x7f61bc153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc15aa40 0x7f61bc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 -- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61bc0b0c60 msgr2=0x7f61bc1f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61bc0b0c60 0x7f61bc1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 -- 172.21.15.50:0/61655575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b40094d0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c14f2640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c7f0 tx=0x7f61ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac004220 con 0x7f61bc0b3f30 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0043a0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac007860 con 0x7f61bc0b3f30 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.221+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc1f2d90 con 0x7f61bc0b3f30 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.222+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc1f5800 con 0x7f61bc0b3f30 2023-08-10T10:40:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.223+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc1f32b0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.224+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61ac007bd0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.224+0000 7f61b27fc640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 0x7f61a006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.225+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61ac089440 con 0x7f61bc0b3f30 2023-08-10T10:40:05.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.225+0000 7f61c1cf3640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 0x7f61a006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.225+0000 7f61c1cf3640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 0x7f61a006d110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b32a0 tx=0x7f61b8009230 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.229+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f61bc1f32b0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.425+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61bc1f32b0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.428+0000 7f61b27fc640 1 -- 172.21.15.50:0/61655575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f61bc1f32b0 con 0x7f61bc0b3f30 2023-08-10T10:40:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:05.429 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:39:55.406923+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 msgr2=0x7f61a006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 0x7f61a006d110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b32a0 tx=0x7f61b8009230 comp rx=0 tx=0).stop 2023-08-10T10:40:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 msgr2=0x7f61bc152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c7f0 tx=0x7f61ac00ccb0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 shutdown_connections 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61bc15aa40 0x7f61bc153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61bc0b3f30 0x7f61bc152ed0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f61a006ac50 0x7f61a006d110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 --2- 172.21.15.50:0/61655575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61bc0b0c60 0x7f61bc1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.430+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 >> 172.21.15.50:0/61655575 conn(0x7f61bc06b590 msgr2=0x7f61bc0696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.431+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 shutdown_connections 2023-08-10T10:40:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.431+0000 7f61c3f57640 1 -- 172.21.15.50:0/61655575 wait complete. 2023-08-10T10:40:05.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:39:38.563848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:39:39.595203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:40:05.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:40:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.686+0000 7f2c02b34640 1 Processor -- start 2023-08-10T10:40:05.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.687+0000 7f2c02b34640 1 -- start start 2023-08-10T10:40:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.688+0000 7f2c02b34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bfc0cd660 0x7f2bfc06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.688+0000 7f2c02b34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2bfc0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.688+0000 7f2c02b34640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc06a5c0 con 0x7f2bfc15fde0 2023-08-10T10:40:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.688+0000 7f2c02b34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc06b0c0 con 0x7f2bfc0cd660 2023-08-10T10:40:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.688+0000 7f2c02b34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06a820 con 0x7f2bfc0b1e00 2023-08-10T10:40:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c01b32640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2bfc15fde0 0x7f2bfc0ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46616/0 (socket says 172.21.15.50:46616) 2023-08-10T10:40:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c01b32640 1 -- 172.21.15.50:0/3858211236 learned_addr learned my addr 172.21.15.50:0/3858211236 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c01331640 1 --2- 172.21.15.50:0/3858211236 >> v2:172.21.15.117:3300/0 conn(0x7f2bfc0cd660 0x7f2bfc06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c02333640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2bfc0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605300228 0 0) 0x7f2bfc06a5c0 con 0x7f2bfc15fde0 2023-08-10T10:40:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.689+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be8003520 con 0x7f2bfc15fde0 2023-08-10T10:40:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762731806 0 0) 0x7f2be8003520 con 0x7f2bfc15fde0 2023-08-10T10:40:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 msgr2=0x7f2bfc0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2bfc0d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 >> v2:172.21.15.117:3300/0 conn(0x7f2bfc0cd660 msgr2=0x7f2bfc06a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 --2- 172.21.15.50:0/3858211236 >> v2:172.21.15.117:3300/0 conn(0x7f2bfc0cd660 0x7f2bfc06a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc06ab00 con 0x7f2bfc15fde0 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f2bf8001690 con 0x7f2bfc15fde0 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 >> v1:172.21.15.50:6789/0 conn(0x7f2bfc15fde0 legacy=0x7f2bfc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2be8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2be80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be8004d00 0x7f2be8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06b0c0 con 0x7f2be80039e0 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06a820 con 0x7f2be8004d00 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be800ba80 con 0x7f2bfc0b1e00 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.690+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2be8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c02333640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be8004d00 0x7f2be8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01331640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2be80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01b32640 1 -- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 msgr2=0x7f2be80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2be80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01b32640 1 -- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be8004d00 msgr2=0x7f2be8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be8004d00 0x7f2be8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01b32640 1 -- 172.21.15.50:0/3858211236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8003520 con 0x7f2be80039e0 2023-08-10T10:40:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c01331640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc0b1e00 0x7f2be80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.691+0000 7f2c02333640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be8004d00 0x7f2be8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:05.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.692+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2be8003e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c290 tx=0x7f2be80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a27d498930574 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.692+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8005ad0 con 0x7f2be80039e0 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.692+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8005c50 con 0x7f2be80039e0 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.692+0000 7f2c00b30640 1 -- 172.21.15.50:0/3858211236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf802c8b0 con 0x7f2be80039e0 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 -- 172.21.15.50:0/3858211236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 msgr2=0x7f2be8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3858211236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2be8003e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c290 tx=0x7f2be80057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02333640 1 -- 172.21.15.50:0/3858211236 reap_dead start 2023-08-10T10:40:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 -- 172.21.15.50:0/3858211236 shutdown_connections 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 -- 172.21.15.50:0/3858211236 >> 172.21.15.50:0/3858211236 conn(0x7f2bfc0d2900 msgr2=0x7f2bfc0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 -- 172.21.15.50:0/3858211236 shutdown_connections 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.693+0000 7f2c02b34640 1 -- 172.21.15.50:0/3858211236 wait complete. 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.695+0000 7f2c02b34640 1 Processor -- start 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.695+0000 7f2c02b34640 1 -- start start 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc150fd0 0x7f2bfc14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bfc14f900 0x7f2bfc15d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b1500 con 0x7f2be80039e0 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc14ff30 con 0x7f2bfc14f900 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c02b34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc150210 con 0x7f2bfc150fd0 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c01b32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c01b32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50606/0 (socket says 172.21.15.50:50606) 2023-08-10T10:40:05.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.696+0000 7f2c01b32640 1 -- 172.21.15.50:0/3356660270 learned_addr learned my addr 172.21.15.50:0/3356660270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:05.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 -- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc150fd0 msgr2=0x7f2bfc14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01331640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc150fd0 0x7f2bfc14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c02333640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bfc14f900 0x7f2bfc15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc150fd0 0x7f2bfc14f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 -- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bfc14f900 msgr2=0x7f2bfc15d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bfc14f900 0x7f2bfc15d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 -- 172.21.15.50:0/3356660270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc1504f0 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.697+0000 7f2c01b32640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2bf802c520 tx=0x7f2bf8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.698+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf802cab0 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.698+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf802cc10 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.698+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc1507d0 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.698+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8007070 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.698+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc151790 con 0x7f2be80039e0 2023-08-10T10:40:05.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.699+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc066e30 con 0x7f2be80039e0 2023-08-10T10:40:05.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.700+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bf8032070 con 0x7f2be80039e0 2023-08-10T10:40:05.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.701+0000 7f2bf27fc640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 0x7f2be006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:05.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.701+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bf80aa920 con 0x7f2be80039e0 2023-08-10T10:40:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.701+0000 7f2c01331640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 0x7f2be006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.702+0000 7f2c01331640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 0x7f2be006d140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc15e640 tx=0x7f2bec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:05.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.706+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2bf80759d0 con 0x7f2be80039e0 2023-08-10T10:40:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.899+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2bfc0d3730 con 0x7f2be80039e0 2023-08-10T10:40:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.900+0000 7f2bf27fc640 1 -- 172.21.15.50:0/3356660270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bf8045020 con 0x7f2be80039e0 2023-08-10T10:40:05.901 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:40:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 msgr2=0x7f2be006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 0x7f2be006d140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc15e640 tx=0x7f2bec008040 comp rx=0 tx=0).stop 2023-08-10T10:40:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 msgr2=0x7f2bfc0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2bf802c520 tx=0x7f2bf8001a20 comp rx=0 tx=0).stop 2023-08-10T10:40:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 shutdown_connections 2023-08-10T10:40:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2be006ac80 0x7f2be006d140 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bfc14f900 0x7f2bfc15d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bfc150fd0 0x7f2bfc14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 --2- 172.21.15.50:0/3356660270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2be80039e0 0x7f2bfc0b0fc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.903+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 >> 172.21.15.50:0/3356660270 conn(0x7f2bfc0d2900 msgr2=0x7f2bfc0b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.904+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 shutdown_connections 2023-08-10T10:40:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:05.904+0000 7f2c02b34640 1 -- 172.21.15.50:0/3356660270 wait complete. 2023-08-10T10:40:05.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:40:06.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.150+0000 7f5246a14640 1 Processor -- start 2023-08-10T10:40:06.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.150+0000 7f5246a14640 1 -- start start 2023-08-10T10:40:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5246a14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f524015cb90 0x7f52400b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5246a14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f524015cf70 0x7f5240160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5246a14640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5240160a40 con 0x7f52400b4640 2023-08-10T10:40:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5246a14640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400b4bb0 con 0x7f524015cb90 2023-08-10T10:40:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5246a14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400b4e90 con 0x7f524015cf70 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5244fb1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f52400b4640 0x7f524006fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46628/0 (socket says 172.21.15.50:46628) 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f5244fb1640 1 -- 172.21.15.50:0/2085502378 learned_addr learned my addr 172.21.15.50:0/2085502378 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f523f7fe640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f524015cf70 0x7f5240160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.152+0000 7f523ffff640 1 --2- 172.21.15.50:0/2085502378 >> v2:172.21.15.117:3300/0 conn(0x7f524015cb90 0x7f52400b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202370581 0 0) 0x7f5240160a40 con 0x7f52400b4640 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5228003520 con 0x7f52400b4640 2023-08-10T10:40:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250603776 0 0) 0x7f5228003520 con 0x7f52400b4640 2023-08-10T10:40:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523ffff640 1 -- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f524015cf70 msgr2=0x7f5240160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523ffff640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f524015cf70 0x7f5240160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523ffff640 1 -- 172.21.15.50:0/2085502378 >> v1:172.21.15.50:6789/0 conn(0x7f52400b4640 legacy=0x7f524006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.153+0000 7f523ffff640 1 -- 172.21.15.50:0/2085502378 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400b5170 con 0x7f524015cb90 2023-08-10T10:40:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.155+0000 7f523ffff640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400b5dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52300097a0 tx=0x7f523002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2edbcc540541442 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.156+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238001670 con 0x7f524015cb90 2023-08-10T10:40:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.156+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523002e050 con 0x7f524015cb90 2023-08-10T10:40:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.156+0000 7f523effd640 1 -- 172.21.15.50:0/2085502378 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230030730 con 0x7f524015cb90 2023-08-10T10:40:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.156+0000 7f5246a14640 1 -- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 msgr2=0x7f52400b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.156+0000 7f5246a14640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400b5dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52300097a0 tx=0x7f523002b790 comp rx=0 tx=0).stop 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 -- 172.21.15.50:0/2085502378 shutdown_connections 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f524015cf70 0x7f5240160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 --2- 172.21.15.50:0/2085502378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400b5dd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 -- 172.21.15.50:0/2085502378 >> 172.21.15.50:0/2085502378 conn(0x7f52400cf640 msgr2=0x7f52400cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 -- 172.21.15.50:0/2085502378 shutdown_connections 2023-08-10T10:40:06.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.157+0000 7f5246a14640 1 -- 172.21.15.50:0/2085502378 wait complete. 2023-08-10T10:40:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.158+0000 7f5246a14640 1 Processor -- start 2023-08-10T10:40:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.159+0000 7f5246a14640 1 -- start start 2023-08-10T10:40:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52400b4640 0x7f5240159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52401f38d0 con 0x7f524015cf70 2023-08-10T10:40:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524015fe50 con 0x7f524015cb90 2023-08-10T10:40:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5246a14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52401f35f0 con 0x7f52400b4640 2023-08-10T10:40:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5244fb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5244fb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50610/0 (socket says 172.21.15.50:50610) 2023-08-10T10:40:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f5244fb1640 1 -- 172.21.15.50:0/820359 learned_addr learned my addr 172.21.15.50:0/820359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f523f7fe640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.160+0000 7f523ffff640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52400b4640 0x7f5240159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 -- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52400b4640 msgr2=0x7f5240159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52400b4640 0x7f5240159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 -- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 msgr2=0x7f52400c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 -- 172.21.15.50:0/820359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009400 con 0x7f524015cf70 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5244fb1640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f523800c750 tx=0x7f523800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238005ad0 con 0x7f524015cf70 2023-08-10T10:40:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005c30 con 0x7f524015cf70 2023-08-10T10:40:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400c6cb0 con 0x7f524015cf70 2023-08-10T10:40:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.161+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007070 con 0x7f524015cf70 2023-08-10T10:40:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.162+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52400c7270 con 0x7f524015cf70 2023-08-10T10:40:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.163+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400612b0 con 0x7f524015cf70 2023-08-10T10:40:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.164+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52380071d0 con 0x7f524015cf70 2023-08-10T10:40:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.165+0000 7f523cff9640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 0x7f522c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.165+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5238089260 con 0x7f524015cf70 2023-08-10T10:40:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.165+0000 7f523ffff640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 0x7f522c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.166+0000 7f523ffff640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 0x7f522c06d110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5230034000 tx=0x7f523002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.169+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5238054270 con 0x7f524015cf70 2023-08-10T10:40:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.364+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52400d0a10 con 0x7f524015cf70 2023-08-10T10:40:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.365+0000 7f523cff9640 1 -- 172.21.15.50:0/820359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5238057890 con 0x7f524015cf70 2023-08-10T10:40:06.366 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:40:06.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.368+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 msgr2=0x7f522c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.368+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 0x7f522c06d110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5230034000 tx=0x7f523002f000 comp rx=0 tx=0).stop 2023-08-10T10:40:06.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.368+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 msgr2=0x7f52400c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.368+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f523800c750 tx=0x7f523800cc10 comp rx=0 tx=0).stop 2023-08-10T10:40:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 shutdown_connections 2023-08-10T10:40:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524015cf70 0x7f52400c8600 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f522c06ac50 0x7f522c06d110 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524015cb90 0x7f52400c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 --2- 172.21.15.50:0/820359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52400b4640 0x7f5240159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 >> 172.21.15.50:0/820359 conn(0x7f52400cf640 msgr2=0x7f524015bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 shutdown_connections 2023-08-10T10:40:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.369+0000 7f5246a14640 1 -- 172.21.15.50:0/820359 wait complete. 2023-08-10T10:40:06.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:40:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.604+0000 7f4a9ac21640 1 Processor -- start 2023-08-10T10:40:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.604+0000 7f4a9ac21640 1 -- start start 2023-08-10T10:40:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.606+0000 7f4a9ac21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.606+0000 7f4a9ac21640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 0x7f4a9415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.606+0000 7f4a9ac21640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9406a040 con 0x7f4a941583c0 2023-08-10T10:40:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.606+0000 7f4a9ac21640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9415aee0 con 0x7f4a9415e4d0 2023-08-10T10:40:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.606+0000 7f4a9ac21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940b2100 con 0x7f4a940696a0 2023-08-10T10:40:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.607+0000 7f4a9941e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.607+0000 7f4a9a420640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 0x7f4a9415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.607+0000 7f4a9941e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:34928/0 (socket says 172.21.15.50:34928) 2023-08-10T10:40:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.607+0000 7f4a9941e640 1 -- 172.21.15.50:0/61458743 learned_addr learned my addr 172.21.15.50:0/61458743 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.608+0000 7f4a9941e640 1 -- 172.21.15.50:0/61458743 >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 msgr2=0x7f4a9415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.608+0000 7f4a9941e640 1 --2- 172.21.15.50:0/61458743 >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 0x7f4a9415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.608+0000 7f4a9941e640 1 -- 172.21.15.50:0/61458743 >> v1:172.21.15.117:6789/0 conn(0x7f4a941583c0 legacy=0x7f4a940b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.608+0000 7f4a9941e640 1 -- 172.21.15.50:0/61458743 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9415b1a0 con 0x7f4a940696a0 2023-08-10T10:40:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.608+0000 7f4a9a420640 1 --2- 172.21.15.50:0/61458743 >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 0x7f4a9415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:40:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.609+0000 7f4a9941e640 1 --2- 172.21.15.50:0/61458743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009870 tx=0x7f4a8402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85ff94b88531059 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.610+0000 7f4a98c1d640 1 -- 172.21.15.50:0/61458743 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84030840 con 0x7f4a940696a0 2023-08-10T10:40:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.610+0000 7f4a98c1d640 1 -- 172.21.15.50:0/61458743 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a840309a0 con 0x7f4a940696a0 2023-08-10T10:40:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.610+0000 7f4a98c1d640 1 -- 172.21.15.50:0/61458743 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84030d30 con 0x7f4a940696a0 2023-08-10T10:40:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.610+0000 7f4a9ac21640 1 -- 172.21.15.50:0/61458743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 msgr2=0x7f4a94069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.610+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/61458743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009870 tx=0x7f4a8402b980 comp rx=0 tx=0).stop 2023-08-10T10:40:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 -- 172.21.15.50:0/61458743 shutdown_connections 2023-08-10T10:40:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/61458743 >> v2:172.21.15.117:3300/0 conn(0x7f4a9415e4d0 0x7f4a9415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/61458743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a94069b00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 -- 172.21.15.50:0/61458743 >> 172.21.15.50:0/61458743 conn(0x7f4a940caf80 msgr2=0x7f4a940cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 -- 172.21.15.50:0/61458743 shutdown_connections 2023-08-10T10:40:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.611+0000 7f4a9ac21640 1 -- 172.21.15.50:0/61458743 wait complete. 2023-08-10T10:40:06.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.612+0000 7f4a9ac21640 1 Processor -- start 2023-08-10T10:40:06.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.613+0000 7f4a9ac21640 1 -- start start 2023-08-10T10:40:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.613+0000 7f4a9ac21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a941527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9ac21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9ac21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 0x7f4a941597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9ac21640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940cab20 con 0x7f4a941583c0 2023-08-10T10:40:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9ac21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a94152cf0 con 0x7f4a9415e4d0 2023-08-10T10:40:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9ac21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a940c9b10 con 0x7f4a940696a0 2023-08-10T10:40:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50626/0 (socket says 172.21.15.50:50626) 2023-08-10T10:40:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 -- 172.21.15.50:0/1610963905 learned_addr learned my addr 172.21.15.50:0/1610963905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9a420640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 0x7f4a941597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a99c1f640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a941527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 -- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 msgr2=0x7f4a941527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a941527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 -- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 msgr2=0x7f4a941597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 0x7f4a941597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9941e640 1 -- 172.21.15.50:0/1610963905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c009a70 con 0x7f4a941583c0 2023-08-10T10:40:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a99c1f640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a941527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.614+0000 7f4a9a420640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 0x7f4a941597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a9941e640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c00 tx=0x7f4a84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84039a90 con 0x7f4a941583c0 2023-08-10T10:40:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84039bf0 con 0x7f4a941583c0 2023-08-10T10:40:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84043410 con 0x7f4a941583c0 2023-08-10T10:40:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a840094d0 con 0x7f4a941583c0 2023-08-10T10:40:06.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.615+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a940c6cd0 con 0x7f4a941583c0 2023-08-10T10:40:06.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.616+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a94066e30 con 0x7f4a941583c0 2023-08-10T10:40:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.618+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a8402f390 con 0x7f4a941583c0 2023-08-10T10:40:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.619+0000 7f4a8a7fc640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:06.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.619+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a840ab660 con 0x7f4a941583c0 2023-08-10T10:40:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.619+0000 7f4a99c1f640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.620+0000 7f4a99c1f640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 0x7f4a7806d110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a940c1f80 tx=0x7f4a90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.623+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4a84076790 con 0x7f4a941583c0 2023-08-10T10:40:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.816+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a940aec00 con 0x7f4a941583c0 2023-08-10T10:40:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.817+0000 7f4a8a7fc640 1 -- 172.21.15.50:0/1610963905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a84079db0 con 0x7f4a941583c0 2023-08-10T10:40:06.818 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:40:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.819+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 msgr2=0x7f4a7806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.819+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 0x7f4a7806d110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a940c1f80 tx=0x7f4a90009040 comp rx=0 tx=0).stop 2023-08-10T10:40:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.819+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 msgr2=0x7f4a940c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.819+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c00 tx=0x7f4a84004730 comp rx=0 tx=0).stop 2023-08-10T10:40:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 shutdown_connections 2023-08-10T10:40:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9415e4d0 0x7f4a941597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a941583c0 0x7f4a940c95d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 --2- 172.21.15.50:0/1610963905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a940696a0 0x7f4a941527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 >> 172.21.15.50:0/1610963905 conn(0x7f4a940caf80 msgr2=0x7f4a940b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 shutdown_connections 2023-08-10T10:40:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:06.820+0000 7f4a9ac21640 1 -- 172.21.15.50:0/1610963905 wait complete. 2023-08-10T10:40:06.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:40:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.073+0000 7fea4054f640 1 Processor -- start 2023-08-10T10:40:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.074+0000 7fea4054f640 1 -- start start 2023-08-10T10:40:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.075+0000 7fea4054f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea3815ae40 0x7fea380b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.075+0000 7fea4054f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea380ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea4054f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380adcb0 con 0x7fea380cd2a0 2023-08-10T10:40:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea4054f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3806c320 con 0x7fea3815ae40 2023-08-10T10:40:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea4054f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3806b770 con 0x7fea3806cb30 2023-08-10T10:40:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea3eaec640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea380cd2a0 0x7fea380c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46642/0 (socket says 172.21.15.50:46642) 2023-08-10T10:40:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea3eaec640 1 -- 172.21.15.50:0/1127050576 learned_addr learned my addr 172.21.15.50:0/1127050576 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/1127050576 >> v2:172.21.15.117:3300/0 conn(0x7fea3815ae40 0x7fea380b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.076+0000 7fea3daea640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea380ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541487087 0 0) 0x7fea380adcb0 con 0x7fea380cd2a0 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003520 con 0x7fea380cd2a0 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061124856 0 0) 0x7fea24003520 con 0x7fea380cd2a0 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 msgr2=0x7fea380ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea380ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 >> v2:172.21.15.117:3300/0 conn(0x7fea3815ae40 msgr2=0x7fea380b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 --2- 172.21.15.50:0/1127050576 >> v2:172.21.15.117:3300/0 conn(0x7fea3815ae40 0x7fea380b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3806b9f0 con 0x7fea380cd2a0 2023-08-10T10:40:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fea300019f0 con 0x7fea380cd2a0 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 >> v1:172.21.15.50:6789/0 conn(0x7fea380cd2a0 legacy=0x7fea380c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea24003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24003ef0 0x7fea240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004d00 0x7fea24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3806c320 con 0x7fea24004d00 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3806b770 con 0x7fea24003ef0 2023-08-10T10:40:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.077+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400b980 con 0x7fea3806cb30 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004d00 0x7fea24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea24003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3daea640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24003ef0 0x7fea240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 -- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 msgr2=0x7fea24003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806cb30 0x7fea24003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 -- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24003ef0 msgr2=0x7fea240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24003ef0 0x7fea240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.078+0000 7fea3eaec640 1 -- 172.21.15.50:0/1127050576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24003520 con 0x7fea24004d00 2023-08-10T10:40:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.079+0000 7fea3eaec640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004d00 0x7fea24005180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea3000a860 tx=0x7fea240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d653debae06b20 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30034630 con 0x7fea24004d00 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3002f070 con 0x7fea24004d00 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea3d2e9640 1 -- 172.21.15.50:0/1127050576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30034a30 con 0x7fea24004d00 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 -- 172.21.15.50:0/1127050576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004d00 msgr2=0x7fea24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 --2- 172.21.15.50:0/1127050576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004d00 0x7fea24005180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea3000a860 tx=0x7fea240057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea3eaec640 1 -- 172.21.15.50:0/1127050576 reap_dead start 2023-08-10T10:40:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 -- 172.21.15.50:0/1127050576 shutdown_connections 2023-08-10T10:40:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 -- 172.21.15.50:0/1127050576 >> 172.21.15.50:0/1127050576 conn(0x7fea380b01b0 msgr2=0x7fea380b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 -- 172.21.15.50:0/1127050576 shutdown_connections 2023-08-10T10:40:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.080+0000 7fea4054f640 1 -- 172.21.15.50:0/1127050576 wait complete. 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.082+0000 7fea4054f640 1 Processor -- start 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.083+0000 7fea4054f640 1 -- start start 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 0x7fea380afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806f5e0 0x7fea38154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380aff40 con 0x7fea380c17e0 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c4bf0 con 0x7fea24004d00 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea4054f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c4ed0 con 0x7fea3806f5e0 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3daea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3daea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50656/0 (socket says 172.21.15.50:50656) 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3daea640 1 -- 172.21.15.50:0/112795641 learned_addr learned my addr 172.21.15.50:0/112795641 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3eaec640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806f5e0 0x7fea38154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 0x7fea380afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.084+0000 7fea3daea640 1 -- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806f5e0 msgr2=0x7fea38154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3daea640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806f5e0 0x7fea38154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3daea640 1 -- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 msgr2=0x7fea380afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3daea640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 0x7fea380afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3daea640 1 -- 172.21.15.50:0/112795641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380c51b0 con 0x7fea380c17e0 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 0x7fea380afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea3daea640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fea28011560 tx=0x7fea28011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28004220 con 0x7fea380c17e0 2023-08-10T10:40:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea28004380 con 0x7fea380c17e0 2023-08-10T10:40:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28015870 con 0x7fea380c17e0 2023-08-10T10:40:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea380c5490 con 0x7fea380c17e0 2023-08-10T10:40:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.085+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea380c3050 con 0x7fea380c17e0 2023-08-10T10:40:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.087+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea380612b0 con 0x7fea380c17e0 2023-08-10T10:40:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.088+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea280159d0 con 0x7fea380c17e0 2023-08-10T10:40:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.089+0000 7fea2effd640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 0x7fea1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.089+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea28089740 con 0x7fea380c17e0 2023-08-10T10:40:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.089+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 0x7fea1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.090+0000 7fea3e2eb640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 0x7fea1c06d110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea34009b30 tx=0x7fea34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.093+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fea28054750 con 0x7fea380c17e0 2023-08-10T10:40:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.284+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea380aedd0 con 0x7fea380c17e0 2023-08-10T10:40:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.285+0000 7fea2effd640 1 -- 172.21.15.50:0/112795641 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea28057d70 con 0x7fea380c17e0 2023-08-10T10:40:07.286 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:40:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 msgr2=0x7fea1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 0x7fea1c06d110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea34009b30 tx=0x7fea34008040 comp rx=0 tx=0).stop 2023-08-10T10:40:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 msgr2=0x7fea381549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fea28011560 tx=0x7fea28011a20 comp rx=0 tx=0).stop 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 shutdown_connections 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea3806f5e0 0x7fea38154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea380c17e0 0x7fea381549d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea1c06ac50 0x7fea1c06d110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 --2- 172.21.15.50:0/112795641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea24004d00 0x7fea380afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.287+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 >> 172.21.15.50:0/112795641 conn(0x7fea380b01b0 msgr2=0x7fea3806ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.288+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 shutdown_connections 2023-08-10T10:40:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.288+0000 7fea4054f640 1 -- 172.21.15.50:0/112795641 wait complete. 2023-08-10T10:40:07.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.536+0000 7fd597fab640 1 Processor -- start 2023-08-10T10:40:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.537+0000 7fd597fab640 1 -- start start 2023-08-10T10:40:07.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd597fab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5900cdf80 0x7fd590167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd597fab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd590161180 con 0x7fd59015cd60 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd597fab640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd590161460 con 0x7fd5900b8430 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd597fab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900b5bd0 con 0x7fd5900cdf80 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd595d47640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd59015cd60 0x7fd590160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46658/0 (socket says 172.21.15.50:46658) 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.538+0000 7fd595d47640 1 -- 172.21.15.50:0/2949240082 learned_addr learned my addr 172.21.15.50:0/2949240082 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241187610 0 0) 0x7fd590161180 con 0x7fd59015cd60 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd57c003520 con 0x7fd59015cd60 2023-08-10T10:40:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd596548640 1 --2- 172.21.15.50:0/2949240082 >> v2:172.21.15.117:3300/0 conn(0x7fd5900cdf80 0x7fd590167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011619668 0 0) 0x7fd57c003520 con 0x7fd59015cd60 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 >> v2:172.21.15.117:3300/0 conn(0x7fd5900cdf80 msgr2=0x7fd590167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 --2- 172.21.15.50:0/2949240082 >> v2:172.21.15.117:3300/0 conn(0x7fd5900cdf80 0x7fd590167c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 >> v1:172.21.15.117:6789/0 conn(0x7fd5900b8430 legacy=0x7fd5900cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590161740 con 0x7fd59015cd60 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd58c0019f0 con 0x7fd59015cd60 2023-08-10T10:40:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 >> v1:172.21.15.50:6789/0 conn(0x7fd59015cd60 legacy=0x7fd590160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd57c003970 0x7fd57c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.539+0000 7fd594d45640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd57c0047c0 0x7fd57c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd594d45640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd57c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900b5bd0 con 0x7fd57c005180 2023-08-10T10:40:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c00c090 con 0x7fd57c003970 2023-08-10T10:40:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c00c250 con 0x7fd57c0047c0 2023-08-10T10:40:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd57c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd595546640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd57c0047c0 0x7fd57c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd595d47640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd57c003970 0x7fd57c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 -- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd57c0047c0 msgr2=0x7fd57c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd57c0047c0 0x7fd57c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 -- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd57c003970 msgr2=0x7fd57c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd57c003970 0x7fd57c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd596548640 1 -- 172.21.15.50:0/2949240082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c003520 con 0x7fd57c005180 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.540+0000 7fd595d47640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd57c003970 0x7fd57c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.541+0000 7fd596548640 1 -- 172.21.15.50:0/2949240082 reap_dead start 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.541+0000 7fd596548640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd57c00b980 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd58800ba00 tx=0x7fd57c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62fbe4f58331dac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.542+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588004020 con 0x7fd57c005180 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.542+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588004180 con 0x7fd57c005180 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.542+0000 7fd594d45640 1 -- 172.21.15.50:0/2949240082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588003610 con 0x7fd57c005180 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.542+0000 7fd597fab640 1 -- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 msgr2=0x7fd57c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.542+0000 7fd597fab640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd57c00b980 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd58800ba00 tx=0x7fd57c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.543+0000 7fd597fab640 1 -- 172.21.15.50:0/2949240082 shutdown_connections 2023-08-10T10:40:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.543+0000 7fd597fab640 1 --2- 172.21.15.50:0/2949240082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd57c00b980 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.543+0000 7fd597fab640 1 -- 172.21.15.50:0/2949240082 >> 172.21.15.50:0/2949240082 conn(0x7fd5900d2ac0 msgr2=0x7fd5900d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.543+0000 7fd597fab640 1 -- 172.21.15.50:0/2949240082 shutdown_connections 2023-08-10T10:40:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.543+0000 7fd597fab640 1 -- 172.21.15.50:0/2949240082 wait complete. 2023-08-10T10:40:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.545+0000 7fd597fab640 1 Processor -- start 2023-08-10T10:40:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.545+0000 7fd597fab640 1 -- start start 2023-08-10T10:40:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd590159120 0x7fd590159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900c9b00 0x7fd5900c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590159ac0 con 0x7fd57c005180 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900ca4c0 con 0x7fd590159120 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd597fab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901514e0 con 0x7fd5900c9b00 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd595d47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd595d47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50670/0 (socket says 172.21.15.50:50670) 2023-08-10T10:40:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.546+0000 7fd595d47640 1 -- 172.21.15.50:0/168486570 learned_addr learned my addr 172.21.15.50:0/168486570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 -- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900c9b00 msgr2=0x7fd5900c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595546640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd590159120 0x7fd590159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd596548640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900c9b00 0x7fd5900c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900c9b00 0x7fd5900c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 -- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd590159120 msgr2=0x7fd590159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd590159120 0x7fd590159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 -- 172.21.15.50:0/168486570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590159cc0 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd595d47640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0019e0 tx=0x7fd58c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004b60 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c004cc0 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0072d0 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590159fa0 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.547+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59015dcf0 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.549+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59004e270 con 0x7fd57c005180 2023-08-10T10:40:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.550+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd58c007430 con 0x7fd57c005180 2023-08-10T10:40:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.550+0000 7fd5867fc640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 0x7fd57406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.551+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd58c089630 con 0x7fd57c005180 2023-08-10T10:40:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.551+0000 7fd595546640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 0x7fd57406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.552+0000 7fd595546640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 0x7fd57406d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5901f50a0 tx=0x7fd580009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.555+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd58c058020 con 0x7fd57c005180 2023-08-10T10:40:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.783+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5900d3940 con 0x7fd57c005180 2023-08-10T10:40:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.785+0000 7fd5867fc640 1 -- 172.21.15.50:0/168486570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fd58c019090 con 0x7fd57c005180 2023-08-10T10:40:07.786 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:07.786 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:40:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:40:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.787+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 msgr2=0x7fd57406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.787+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 0x7fd57406d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5901f50a0 tx=0x7fd580009040 comp rx=0 tx=0).stop 2023-08-10T10:40:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.787+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 msgr2=0x7fd5900c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.787+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0019e0 tx=0x7fd58c00b4a0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 shutdown_connections 2023-08-10T10:40:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900c9b00 0x7fd5900c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57406ac50 0x7fd57406d110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd590159120 0x7fd590159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 --2- 172.21.15.50:0/168486570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57c005180 0x7fd5900c7e00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 >> 172.21.15.50:0/168486570 conn(0x7fd5900d2ac0 msgr2=0x7fd5900d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 shutdown_connections 2023-08-10T10:40:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:07.788+0000 7fd597fab640 1 -- 172.21.15.50:0/168486570 wait complete. 2023-08-10T10:40:07.808 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:08.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.024+0000 7f3d15e08640 1 Processor -- start 2023-08-10T10:40:08.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.024+0000 7f3d15e08640 1 -- start start 2023-08-10T10:40:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.026+0000 7f3d15e08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d100aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.026+0000 7f3d15e08640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d100b19d0 0x7f3d100b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.026+0000 7f3d15e08640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d100b1f10 con 0x7f3d1015f2b0 2023-08-10T10:40:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.026+0000 7f3d15e08640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100b21f0 con 0x7f3d100b19d0 2023-08-10T10:40:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.026+0000 7f3d15e08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1015e5c0 con 0x7f3d1015a940 2023-08-10T10:40:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.027+0000 7f3d15607640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d100b19d0 0x7f3d100b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.027+0000 7f3d14e06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d100aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.027+0000 7f3d15607640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d100b19d0 0x7f3d100b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:47278/0 (socket says 172.21.15.50:47278) 2023-08-10T10:40:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.027+0000 7f3d15607640 1 -- 172.21.15.50:0/3482799640 learned_addr learned my addr 172.21.15.50:0/3482799640 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.027+0000 7f3d0ffff640 1 --1- 172.21.15.50:0/3482799640 >> v1:172.21.15.117:6789/0 conn(0x7f3d1015f2b0 0x7f3d100b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:59946/0 (socket says 172.21.15.50:59946) 2023-08-10T10:40:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.028+0000 7f3d15607640 1 -- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 msgr2=0x7f3d100aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.028+0000 7f3d15607640 1 --2- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d100aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.028+0000 7f3d15607640 1 -- 172.21.15.50:0/3482799640 >> v1:172.21.15.117:6789/0 conn(0x7f3d1015f2b0 legacy=0x7f3d100b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.028+0000 7f3d15607640 1 -- 172.21.15.50:0/3482799640 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1015e7d0 con 0x7f3d100b19d0 2023-08-10T10:40:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.029+0000 7f3d15607640 1 --2- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d100b19d0 0x7f3d100b0450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009e50 tx=0x7f3d0802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45af5da2e1d6bcc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.030+0000 7f3d0f7fe640 1 -- 172.21.15.50:0/3482799640 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802ca80 con 0x7f3d100b19d0 2023-08-10T10:40:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.030+0000 7f3d0f7fe640 1 -- 172.21.15.50:0/3482799640 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0802cbe0 con 0x7f3d100b19d0 2023-08-10T10:40:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.030+0000 7f3d0f7fe640 1 -- 172.21.15.50:0/3482799640 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080343f0 con 0x7f3d100b19d0 2023-08-10T10:40:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.030+0000 7f3d15e08640 1 -- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d100b19d0 msgr2=0x7f3d100b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.030+0000 7f3d15e08640 1 --2- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d100b19d0 0x7f3d100b0450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009e50 tx=0x7f3d0802bee0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 -- 172.21.15.50:0/3482799640 shutdown_connections 2023-08-10T10:40:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 --2- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d100b19d0 0x7f3d100b0450 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 --2- 172.21.15.50:0/3482799640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d100aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 -- 172.21.15.50:0/3482799640 >> 172.21.15.50:0/3482799640 conn(0x7f3d1006ab80 msgr2=0x7f3d1006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 -- 172.21.15.50:0/3482799640 shutdown_connections 2023-08-10T10:40:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.031+0000 7f3d15e08640 1 -- 172.21.15.50:0/3482799640 wait complete. 2023-08-10T10:40:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.033+0000 7f3d15e08640 1 Processor -- start 2023-08-10T10:40:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.033+0000 7f3d15e08640 1 -- start start 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.034+0000 7f3d15e08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15e08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d101f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15e08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d1015f2b0 0x7f3d1006e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15e08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10158340 con 0x7f3d100b19d0 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15e08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101576c0 con 0x7f3d1015f2b0 2023-08-10T10:40:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15e08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101579a0 con 0x7f3d1015a940 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50680/0 (socket says 172.21.15.50:50680) 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 -- 172.21.15.50:0/215874606 learned_addr learned my addr 172.21.15.50:0/215874606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d15607640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d1015f2b0 0x7f3d1006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d0ffff640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d101f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 -- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 msgr2=0x7f3d101f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d101f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 -- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d1015f2b0 msgr2=0x7f3d1006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d1015f2b0 0x7f3d1006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d14e06640 1 -- 172.21.15.50:0/215874606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009b30 con 0x7f3d100b19d0 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.035+0000 7f3d0ffff640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d101f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d14e06640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e870 tx=0x7f3d0400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040094f0 con 0x7f3d100b19d0 2023-08-10T10:40:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400c940 con 0x7f3d100b19d0 2023-08-10T10:40:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400ccf0 con 0x7f3d100b19d0 2023-08-10T10:40:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10157c80 con 0x7f3d100b19d0 2023-08-10T10:40:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.036+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d100c4cd0 con 0x7f3d100b19d0 2023-08-10T10:40:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.038+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10066e30 con 0x7f3d100b19d0 2023-08-10T10:40:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.039+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d04013470 con 0x7f3d100b19d0 2023-08-10T10:40:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.040+0000 7f3d0d7fa640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 0x7f3cf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.040+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3d04089510 con 0x7f3d100b19d0 2023-08-10T10:40:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.040+0000 7f3d0ffff640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 0x7f3cf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.041+0000 7f3d0ffff640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 0x7f3cf406d110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3d10070410 tx=0x7f3cfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.044+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3d04054630 con 0x7f3d100b19d0 2023-08-10T10:40:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.239+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d100b0dc0 con 0x7f3d100b19d0 2023-08-10T10:40:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.241+0000 7f3d0d7fa640 1 -- 172.21.15.50:0/215874606 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18332 (secure 0 0 0) 0x7f3d04057c50 con 0x7f3d100b19d0 2023-08-10T10:40:08.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:08.242 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:07.386468+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 msgr2=0x7f3cf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 0x7f3cf406d110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3d10070410 tx=0x7f3cfc009040 comp rx=0 tx=0).stop 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 msgr2=0x7f3d100c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e870 tx=0x7f3d0400ed30 comp rx=0 tx=0).stop 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 shutdown_connections 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3cf406ac50 0x7f3cf406d110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d1015f2b0 0x7f3d1006e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d1015a940 0x7f3d101f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 --2- 172.21.15.50:0/215874606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d100b19d0 0x7f3d100c4790 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 >> 172.21.15.50:0/215874606 conn(0x7f3d1006ab80 msgr2=0x7f3d10159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 shutdown_connections 2023-08-10T10:40:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.244+0000 7f3d15e08640 1 -- 172.21.15.50:0/215874606 wait complete. 2023-08-10T10:40:08.262 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:40:08.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.496+0000 7f13ef142640 1 Processor -- start 2023-08-10T10:40:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.496+0000 7f13ef142640 1 -- start start 2023-08-10T10:40:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ef142640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13e815cd60 0x7f13e8160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ef142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13e80b8430 0x7f13e80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ef142640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e80ce200 con 0x7f13e80cddb0 2023-08-10T10:40:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ef142640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e80b5bd0 con 0x7f13e815cd60 2023-08-10T10:40:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ef142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e8161180 con 0x7f13e80b8430 2023-08-10T10:40:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ecede640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13e815cd60 0x7f13e8160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ed6df640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13e80cddb0 0x7f13e80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46664/0 (socket says 172.21.15.50:46664) 2023-08-10T10:40:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.498+0000 7f13ed6df640 1 -- 172.21.15.50:0/3256311545 learned_addr learned my addr 172.21.15.50:0/3256311545 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.499+0000 7f13e7fff640 1 --2- 172.21.15.50:0/3256311545 >> v2:172.21.15.117:3300/0 conn(0x7f13e80b8430 0x7f13e80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.499+0000 7f13ecede640 1 -- 172.21.15.50:0/3256311545 >> v2:172.21.15.117:3300/0 conn(0x7f13e80b8430 msgr2=0x7f13e80cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:08.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.499+0000 7f13ecede640 1 --2- 172.21.15.50:0/3256311545 >> v2:172.21.15.117:3300/0 conn(0x7f13e80b8430 0x7f13e80cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.499+0000 7f13ecede640 1 -- 172.21.15.50:0/3256311545 >> v1:172.21.15.50:6789/0 conn(0x7f13e80cddb0 legacy=0x7f13e80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.499+0000 7f13ecede640 1 -- 172.21.15.50:0/3256311545 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8161460 con 0x7f13e815cd60 2023-08-10T10:40:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.500+0000 7f13ecede640 1 --2- 172.21.15.50:0/3256311545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e8160930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ceeb0 tx=0x7f13dc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664ab31dcb419032 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.500+0000 7f13e77fe640 1 -- 172.21.15.50:0/3256311545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc02cd10 con 0x7f13e815cd60 2023-08-10T10:40:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13e77fe640 1 -- 172.21.15.50:0/3256311545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc02ce70 con 0x7f13e815cd60 2023-08-10T10:40:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13e77fe640 1 -- 172.21.15.50:0/3256311545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc034640 con 0x7f13e815cd60 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 -- 172.21.15.50:0/3256311545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 msgr2=0x7f13e8160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 --2- 172.21.15.50:0/3256311545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e8160930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ceeb0 tx=0x7f13dc02bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 -- 172.21.15.50:0/3256311545 shutdown_connections 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 --2- 172.21.15.50:0/3256311545 >> v2:172.21.15.117:3300/0 conn(0x7f13e80b8430 0x7f13e80cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 --2- 172.21.15.50:0/3256311545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e8160930 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 -- 172.21.15.50:0/3256311545 >> 172.21.15.50:0/3256311545 conn(0x7f13e80d2ac0 msgr2=0x7f13e80d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 -- 172.21.15.50:0/3256311545 shutdown_connections 2023-08-10T10:40:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.501+0000 7f13ef142640 1 -- 172.21.15.50:0/3256311545 wait complete. 2023-08-10T10:40:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.503+0000 7f13ef142640 1 Processor -- start 2023-08-10T10:40:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.503+0000 7f13ef142640 1 -- start start 2023-08-10T10:40:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80b8430 0x7f13e8156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e80cddb0 0x7f13e8151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8156870 con 0x7f13e815cd60 2023-08-10T10:40:08.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81519b0 con 0x7f13e80cddb0 2023-08-10T10:40:08.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.504+0000 7f13ef142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81552b0 con 0x7f13e80b8430 2023-08-10T10:40:08.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50698/0 (socket says 172.21.15.50:50698) 2023-08-10T10:40:08.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 -- 172.21.15.50:0/1266576646 learned_addr learned my addr 172.21.15.50:0/1266576646 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:08.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ecede640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80b8430 0x7f13e8156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13e7fff640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e80cddb0 0x7f13e8151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 -- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80b8430 msgr2=0x7f13e8156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80b8430 0x7f13e8156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 -- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e80cddb0 msgr2=0x7f13e8151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e80cddb0 0x7f13e8151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.505+0000 7f13ed6df640 1 -- 172.21.15.50:0/1266576646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc009a70 con 0x7f13e815cd60 2023-08-10T10:40:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13ed6df640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c420 tx=0x7f13e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0005ce0 con 0x7f13e815cd60 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0005e40 con 0x7f13e815cd60 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00072d0 con 0x7f13e815cd60 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e8155570 con 0x7f13e815cd60 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.506+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8155b30 con 0x7f13e815cd60 2023-08-10T10:40:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.507+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e804e270 con 0x7f13e815cd60 2023-08-10T10:40:08.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.508+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13e00074f0 con 0x7f13e815cd60 2023-08-10T10:40:08.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.509+0000 7f13e57fa640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 0x7f13cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.509+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f13e0088830 con 0x7f13e815cd60 2023-08-10T10:40:08.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.510+0000 7f13ecede640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 0x7f13cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.510+0000 7f13ecede640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 0x7f13cc06d110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f13dc036000 tx=0x7f13dc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.514+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13e00538d0 con 0x7f13e815cd60 2023-08-10T10:40:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.743+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13e80ce200 con 0x7f13e815cd60 2023-08-10T10:40:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.744+0000 7f13e57fa640 1 -- 172.21.15.50:0/1266576646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f13e80ce200 con 0x7f13e815cd60 2023-08-10T10:40:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:08.745 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:40:08.745 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:40:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 msgr2=0x7f13cc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 0x7f13cc06d110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f13dc036000 tx=0x7f13dc030000 comp rx=0 tx=0).stop 2023-08-10T10:40:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 msgr2=0x7f13e80b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c420 tx=0x7f13e000c8e0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 shutdown_connections 2023-08-10T10:40:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e815cd60 0x7f13e80b6ae0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13cc06ac50 0x7f13cc06d110 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e80cddb0 0x7f13e8151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 --2- 172.21.15.50:0/1266576646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80b8430 0x7f13e8156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 >> 172.21.15.50:0/1266576646 conn(0x7f13e80d2ac0 msgr2=0x7f13e80b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 shutdown_connections 2023-08-10T10:40:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.747+0000 7f13ef142640 1 -- 172.21.15.50:0/1266576646 wait complete. 2023-08-10T10:40:08.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.991+0000 7f060ab29640 1 Processor -- start 2023-08-10T10:40:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.991+0000 7f060ab29640 1 -- start start 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.992+0000 7f060ab29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f06040ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.992+0000 7f060ab29640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06041604d0 con 0x7f06041646f0 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.992+0000 7f060ab29640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040cca30 con 0x7f06041600f0 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.992+0000 7f060ab29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040cc100 con 0x7f06040b0620 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f060a328640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06041646f0 0x7f0604166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46676/0 (socket says 172.21.15.50:46676) 2023-08-10T10:40:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f060a328640 1 -- 172.21.15.50:0/3348528376 learned_addr learned my addr 172.21.15.50:0/3348528376 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0609326640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f06040ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262105194 0 0) 0x7f06041604d0 con 0x7f06041646f0 2023-08-10T10:40:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f0003520 con 0x7f06041646f0 2023-08-10T10:40:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667903421 0 0) 0x7f05f0003520 con 0x7f06041646f0 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 msgr2=0x7f06040ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f06040ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 >> v1:172.21.15.117:6789/0 conn(0x7f06041600f0 legacy=0x7f06040aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040cc3e0 con 0x7f06041646f0 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.993+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f05fc0019f0 con 0x7f06041646f0 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 >> v1:172.21.15.50:6789/0 conn(0x7f06041646f0 legacy=0x7f0604166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f05f0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0003f90 0x7f05f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05f0004d00 0x7f05f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06040cc100 con 0x7f05f0004d00 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f000bb70 con 0x7f05f0003f90 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f000bd30 con 0x7f06040b0620 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05f0004d00 0x7f05f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0609b27640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f05f0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 -- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 msgr2=0x7f05f0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f05f0003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 -- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0003f90 msgr2=0x7f05f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0003f90 0x7f05f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f060a328640 1 -- 172.21.15.50:0/3348528376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0003520 con 0x7f05f0004d00 2023-08-10T10:40:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.994+0000 7f0609b27640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06040b0620 0x7f05f0003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060a328640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05f0004d00 0x7f05f0005180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0013d0 tx=0x7f05f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6131df319da284c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc034630 con 0x7f05f0004d00 2023-08-10T10:40:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc02f070 con 0x7f05f0004d00 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f0608b25640 1 -- 172.21.15.50:0/3348528376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc034a50 con 0x7f05f0004d00 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060ab29640 1 -- 172.21.15.50:0/3348528376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05f0004d00 msgr2=0x7f05f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060ab29640 1 --2- 172.21.15.50:0/3348528376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05f0004d00 0x7f05f0005180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0013d0 tx=0x7f05f00057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060a328640 1 -- 172.21.15.50:0/3348528376 reap_dead start 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060ab29640 1 -- 172.21.15.50:0/3348528376 shutdown_connections 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.996+0000 7f060ab29640 1 -- 172.21.15.50:0/3348528376 >> 172.21.15.50:0/3348528376 conn(0x7f060406ab80 msgr2=0x7f060406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.997+0000 7f060ab29640 1 -- 172.21.15.50:0/3348528376 shutdown_connections 2023-08-10T10:40:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.997+0000 7f060ab29640 1 -- 172.21.15.50:0/3348528376 wait complete. 2023-08-10T10:40:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.998+0000 7f060ab29640 1 Processor -- start 2023-08-10T10:40:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.998+0000 7f060ab29640 1 -- start start 2023-08-10T10:40:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0004d00 0x7f06040b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060415e8d0 0x7f060415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060415f290 con 0x7f06040b10b0 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041545a0 con 0x7f05f0004d00 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:08.999+0000 7f060ab29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040af380 con 0x7f060415e8d0 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.000+0000 7f060a328640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.000+0000 7f0609b27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0004d00 0x7f06040b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.000+0000 7f060a328640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50714/0 (socket says 172.21.15.50:50714) 2023-08-10T10:40:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.000+0000 7f060a328640 1 -- 172.21.15.50:0/3969015484 learned_addr learned my addr 172.21.15.50:0/3969015484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.000+0000 7f0609326640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060415e8d0 0x7f060415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 -- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060415e8d0 msgr2=0x7f060415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060415e8d0 0x7f060415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 -- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0004d00 msgr2=0x7f06040b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0004d00 0x7f06040b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 -- 172.21.15.50:0/3969015484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040b1a80 con 0x7f06040b10b0 2023-08-10T10:40:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060a328640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f05fc000f80 tx=0x7f05fc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc034630 con 0x7f06040b10b0 2023-08-10T10:40:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc034790 con 0x7f06040b10b0 2023-08-10T10:40:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc034b00 con 0x7f06040b10b0 2023-08-10T10:40:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.001+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06040ae300 con 0x7f06040b10b0 2023-08-10T10:40:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.002+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06040ae8c0 con 0x7f06040b10b0 2023-08-10T10:40:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.003+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604066e30 con 0x7f06040b10b0 2023-08-10T10:40:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.004+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05fc031030 con 0x7f06040b10b0 2023-08-10T10:40:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.004+0000 7f05fa7fc640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 0x7f05e806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.005+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f05fc0aad80 con 0x7f06040b10b0 2023-08-10T10:40:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.005+0000 7f0609b27640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 0x7f05e806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.006+0000 7f0609b27640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 0x7f05e806d140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0600001970 tx=0x7f0600001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.009+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f05fc075eb0 con 0x7f06040b10b0 2023-08-10T10:40:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.236+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0604066e30 con 0x7f06040b10b0 2023-08-10T10:40:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.237+0000 7f05fa7fc640 1 -- 172.21.15.50:0/3969015484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f05fc0011c0 con 0x7f06040b10b0 2023-08-10T10:40:09.237 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:09.238 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:39:40.578847+0000","modified":"2023-08-10T10:39:44.153086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6834/1990431155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1990431155},{"type":"v1","addr":"172.21.15.117:6834","nonce":1990431155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-10T10:40:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-08-10T10:40:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 msgr2=0x7f05e806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 0x7f05e806d140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0600001970 tx=0x7f0600001190 comp rx=0 tx=0).stop 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 msgr2=0x7f06040b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f05fc000f80 tx=0x7f05fc001360 comp rx=0 tx=0).stop 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 shutdown_connections 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06040b10b0 0x7f06040b1540 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060415e8d0 0x7f060415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05e806ac80 0x7f05e806d140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 --2- 172.21.15.50:0/3969015484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05f0004d00 0x7f06040b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 >> 172.21.15.50:0/3969015484 conn(0x7f060406ab80 msgr2=0x7f06041565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 shutdown_connections 2023-08-10T10:40:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.240+0000 7f060ab29640 1 -- 172.21.15.50:0/3969015484 wait complete. 2023-08-10T10:40:09.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.480+0000 7f149f204640 1 Processor -- start 2023-08-10T10:40:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.480+0000 7f149f204640 1 -- start start 2023-08-10T10:40:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 0x7f14980696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1498069be0 0x7f14980b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f14980b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14981617f0 con 0x7f1498069be0 2023-08-10T10:40:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149806a050 con 0x7f14980c1af0 2023-08-10T10:40:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.482+0000 7f149f204640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149806f6f0 con 0x7f14980b2d70 2023-08-10T10:40:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1498069be0 0x7f14980b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1498069be0 0x7f14980b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50728/0 (socket says 172.21.15.50:50728) 2023-08-10T10:40:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 -- 172.21.15.50:0/2018700941 learned_addr learned my addr 172.21.15.50:0/2018700941 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f149d7a1640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f14980b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f149cfa0640 1 --2- 172.21.15.50:0/2018700941 >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 0x7f14980696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 -- 172.21.15.50:0/2018700941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 msgr2=0x7f14980b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f14980b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 -- 172.21.15.50:0/2018700941 >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 msgr2=0x7f14980696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 --2- 172.21.15.50:0/2018700941 >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 0x7f14980696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f1497fff640 1 -- 172.21.15.50:0/2018700941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980b31e0 con 0x7f1498069be0 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.483+0000 7f149cfa0640 1 --2- 172.21.15.50:0/2018700941 >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 0x7f14980696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.484+0000 7f1497fff640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14980b2830 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f149806bba0 tx=0x7f148402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39252fc68c5c6b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.485+0000 7f14977fe640 1 -- 172.21.15.50:0/2018700941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484030840 con 0x7f1498069be0 2023-08-10T10:40:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.485+0000 7f14977fe640 1 -- 172.21.15.50:0/2018700941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840309a0 con 0x7f1498069be0 2023-08-10T10:40:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.485+0000 7f14977fe640 1 -- 172.21.15.50:0/2018700941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484030d30 con 0x7f1498069be0 2023-08-10T10:40:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.485+0000 7f149f204640 1 -- 172.21.15.50:0/2018700941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 msgr2=0x7f14980b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.485+0000 7f149f204640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14980b2830 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f149806bba0 tx=0x7f148402b980 comp rx=0 tx=0).stop 2023-08-10T10:40:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 -- 172.21.15.50:0/2018700941 shutdown_connections 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f14980b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 --2- 172.21.15.50:0/2018700941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14980b2830 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 --2- 172.21.15.50:0/2018700941 >> v2:172.21.15.117:3300/0 conn(0x7f14980c1af0 0x7f14980696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 -- 172.21.15.50:0/2018700941 >> 172.21.15.50:0/2018700941 conn(0x7f149806b590 msgr2=0x7f14980ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 -- 172.21.15.50:0/2018700941 shutdown_connections 2023-08-10T10:40:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.486+0000 7f149f204640 1 -- 172.21.15.50:0/2018700941 wait complete. 2023-08-10T10:40:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.488+0000 7f149f204640 1 Processor -- start 2023-08-10T10:40:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.488+0000 7f149f204640 1 -- start start 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f149815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14980c1af0 0x7f149815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149815cd80 con 0x7f1498069be0 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149815d900 con 0x7f14980c1af0 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149f204640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149815cfd0 con 0x7f14980b2d70 2023-08-10T10:40:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149cfa0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149cfa0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50744/0 (socket says 172.21.15.50:50744) 2023-08-10T10:40:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149cfa0640 1 -- 172.21.15.50:0/775772576 learned_addr learned my addr 172.21.15.50:0/775772576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149cfa0640 1 -- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 msgr2=0x7f149815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f149d7a1640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14980c1af0 0x7f149815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.489+0000 7f1497fff640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f149815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149cfa0640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f149815dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149cfa0640 1 -- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14980c1af0 msgr2=0x7f149815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149cfa0640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14980c1af0 0x7f149815e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149cfa0640 1 -- 172.21.15.50:0/775772576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840094d0 con 0x7f1498069be0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149cfa0640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c820 tx=0x7f148c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c007a30 con 0x7f1498069be0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c007b90 con 0x7f1498069be0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149815d2b0 con 0x7f1498069be0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00ce10 con 0x7f1498069be0 2023-08-10T10:40:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.490+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14981f7e30 con 0x7f1498069be0 2023-08-10T10:40:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.491+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149804e270 con 0x7f1498069be0 2023-08-10T10:40:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.493+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f148c0113f0 con 0x7f1498069be0 2023-08-10T10:40:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.493+0000 7f14957fa640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 0x7f147c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.494+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f148c0895d0 con 0x7f1498069be0 2023-08-10T10:40:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.494+0000 7f1497fff640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 0x7f147c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.494+0000 7f1497fff640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 0x7f147c06d110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1484036000 tx=0x7f148403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.498+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f148c054650 con 0x7f1498069be0 2023-08-10T10:40:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.691+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14981f8020 con 0x7f1498069be0 2023-08-10T10:40:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.694+0000 7f14957fa640 1 -- 172.21.15.50:0/775772576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18332 (secure 0 0 0) 0x7f148c057c70 con 0x7f1498069be0 2023-08-10T10:40:09.696 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:09.696 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:08.390289+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:39:38.563848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-10T10:39:39.595203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 msgr2=0x7f147c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 0x7f147c06d110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1484036000 tx=0x7f148403b040 comp rx=0 tx=0).stop 2023-08-10T10:40:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 msgr2=0x7f14981f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c820 tx=0x7f148c00cce0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 shutdown_connections 2023-08-10T10:40:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147c06ac50 0x7f147c06d110 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14980c1af0 0x7f149815e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14980b2d70 0x7f149815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 --2- 172.21.15.50:0/775772576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1498069be0 0x7f14981f78f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 >> 172.21.15.50:0/775772576 conn(0x7f149806b590 msgr2=0x7f149806fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 shutdown_connections 2023-08-10T10:40:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.697+0000 7f149f204640 1 -- 172.21.15.50:0/775772576 wait complete. 2023-08-10T10:40:09.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:40:09.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.939+0000 7f40d223f640 1 Processor -- start 2023-08-10T10:40:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.939+0000 7f40d223f640 1 -- start start 2023-08-10T10:40:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40d223f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40cc15a820 0x7f40cc06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40d223f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 0x7f40cc0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40d223f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc15bcb0 con 0x7f40cc15ac00 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40d223f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0c5540 con 0x7f40cc15a820 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40d223f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15b0a0 con 0x7f40cc069db0 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40caffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f40cc15ac00 0x7f40cc0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46690/0 (socket says 172.21.15.50:46690) 2023-08-10T10:40:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40caffd640 1 -- 172.21.15.50:0/2137123289 learned_addr learned my addr 172.21.15.50:0/2137123289 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.941+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/2137123289 >> v2:172.21.15.117:3300/0 conn(0x7f40cc15a820 0x7f40cc06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40cbfff640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 0x7f40cc0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148695745 0 0) 0x7f40cc15bcb0 con 0x7f40cc15ac00 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b4003520 con 0x7f40cc15ac00 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760424531 0 0) 0x7f40b4003520 con 0x7f40cc15ac00 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 msgr2=0x7f40cc0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 0x7f40cc0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 >> v2:172.21.15.117:3300/0 conn(0x7f40cc15a820 msgr2=0x7f40cc06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 --2- 172.21.15.50:0/2137123289 >> v2:172.21.15.117:3300/0 conn(0x7f40cc15a820 0x7f40cc06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc15b380 con 0x7f40cc15ac00 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f40c0001670 con 0x7f40cc15ac00 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 >> v1:172.21.15.50:6789/0 conn(0x7f40cc15ac00 legacy=0x7f40cc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40b40047c0 0x7f40b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 0x7f40b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0c5540 con 0x7f40b4003970 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15b0a0 con 0x7f40b40047c0 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.942+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b400b980 con 0x7f40cc069db0 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40caffd640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40b40047c0 0x7f40b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 -- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 msgr2=0x7f40b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc069db0 0x7f40b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 -- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40b40047c0 msgr2=0x7f40b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40b40047c0 0x7f40b4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.943+0000 7f40cb7fe640 1 -- 172.21.15.50:0/2137123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4003520 con 0x7f40b4003970 2023-08-10T10:40:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.944+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40b4003d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009ac0 tx=0x7f40b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6699397e90b80b8d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.944+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc02c710 con 0x7f40b4003970 2023-08-10T10:40:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc02c870 con 0x7f40b4003970 2023-08-10T10:40:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40ca7fc640 1 -- 172.21.15.50:0/2137123289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc02cc00 con 0x7f40b4003970 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 -- 172.21.15.50:0/2137123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 msgr2=0x7f40b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 --2- 172.21.15.50:0/2137123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40b4003d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009ac0 tx=0x7f40b40057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40cbfff640 1 -- 172.21.15.50:0/2137123289 reap_dead start 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 -- 172.21.15.50:0/2137123289 shutdown_connections 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 -- 172.21.15.50:0/2137123289 >> 172.21.15.50:0/2137123289 conn(0x7f40cc0b08e0 msgr2=0x7f40cc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 -- 172.21.15.50:0/2137123289 shutdown_connections 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.945+0000 7f40d223f640 1 -- 172.21.15.50:0/2137123289 wait complete. 2023-08-10T10:40:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.947+0000 7f40d223f640 1 Processor -- start 2023-08-10T10:40:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.947+0000 7f40d223f640 1 -- start start 2023-08-10T10:40:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc0c3500 0x7f40cc0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc0b17d0 0x7f40cc15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b28f0 con 0x7f40b4003970 2023-08-10T10:40:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b1ce0 con 0x7f40cc0c3500 2023-08-10T10:40:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.948+0000 7f40d223f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b1fc0 con 0x7f40cc0b17d0 2023-08-10T10:40:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50774/0 (socket says 172.21.15.50:50774) 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 -- 172.21.15.50:0/1668336238 learned_addr learned my addr 172.21.15.50:0/1668336238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 -- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc0b17d0 msgr2=0x7f40cc15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc0b17d0 0x7f40cc15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 -- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc0c3500 msgr2=0x7f40cc0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc0c3500 0x7f40cc0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 -- 172.21.15.50:0/1668336238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0b22a0 con 0x7f40b4003970 2023-08-10T10:40:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.949+0000 7f40cb7fe640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f40bc02c2b0 tx=0x7f40bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.950+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc003810 con 0x7f40b4003970 2023-08-10T10:40:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.950+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc003970 con 0x7f40b4003970 2023-08-10T10:40:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.950+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc003d00 con 0x7f40b4003970 2023-08-10T10:40:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.950+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc0b2580 con 0x7f40b4003970 2023-08-10T10:40:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.950+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc0c2a20 con 0x7f40b4003970 2023-08-10T10:40:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.951+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc04e270 con 0x7f40b4003970 2023-08-10T10:40:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.952+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40bc040450 con 0x7f40b4003970 2023-08-10T10:40:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.953+0000 7f40b3fff640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.953+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f40bc0ab3d0 con 0x7f40b4003970 2023-08-10T10:40:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.953+0000 7f40caffd640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.954+0000 7f40caffd640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f40c00018e0 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:09.958+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40bc0763c0 con 0x7f40b4003970 2023-08-10T10:40:10.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.191+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40cc0735f0 con 0x7f40b4003970 2023-08-10T10:40:10.192 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:40:10.192+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:40:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.202+0000 7f40b3fff640 1 -- 172.21.15.50:0/1668336238 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40bc003e60 con 0x7f40b4003970 2023-08-10T10:40:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:40:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.204+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 msgr2=0x7f40b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.204+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f40c00018e0 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.204+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 msgr2=0x7f40cc1f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.204+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f40bc02c2b0 tx=0x7f40bc004730 comp rx=0 tx=0).stop 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 shutdown_connections 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40cc0b17d0 0x7f40cc15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f40b806ac50 0x7f40b806d110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40cc0c3500 0x7f40cc0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 --2- 172.21.15.50:0/1668336238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40b4003970 0x7f40cc1f2130 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 >> 172.21.15.50:0/1668336238 conn(0x7f40cc0b08e0 msgr2=0x7f40cc158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 shutdown_connections 2023-08-10T10:40:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.205+0000 7f40d223f640 1 -- 172.21.15.50:0/1668336238 wait complete. 2023-08-10T10:40:10.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:40:10.228 INFO:tasks.ceph.mds.b.smithi117.stderr: -5082> 2023-08-10T10:39:41.655+0000 7fafbcaa3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:40:10.316 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:40:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.450+0000 7f14d4e2d640 1 Processor -- start 2023-08-10T10:40:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.451+0000 7f14d4e2d640 1 -- start start 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.452+0000 7f14d4e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14d00d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.452+0000 7f14d4e2d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d00d1220 con 0x7f14d015ce00 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.452+0000 7f14d4e2d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d00d28a0 con 0x7f14d00cd730 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.452+0000 7f14d4e2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b8a30 con 0x7f14d00d23f0 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14cdd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14d015ce00 0x7f14d00b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46698/0 (socket says 172.21.15.50:46698) 2023-08-10T10:40:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14cdd9b640 1 -- 172.21.15.50:0/3355736564 learned_addr learned my addr 172.21.15.50:0/3355736564 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:10.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14ced9d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14d00d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551181103 0 0) 0x7f14d00d1220 con 0x7f14d015ce00 2023-08-10T10:40:10.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b8003520 con 0x7f14d015ce00 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.453+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224818093 0 0) 0x7f14b8003520 con 0x7f14d015ce00 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 msgr2=0x7f14d00d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14d00d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 >> v1:172.21.15.117:6789/0 conn(0x7f14d00cd730 legacy=0x7f14d00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00b1e70 con 0x7f14d015ce00 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f14c4001670 con 0x7f14d015ce00 2023-08-10T10:40:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 >> v1:172.21.15.50:6789/0 conn(0x7f14d015ce00 legacy=0x7f14d00b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b80039a0 0x7f14b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b8004d00 0x7f14b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b8a30 con 0x7f14b8004d00 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b800ba30 con 0x7f14b80039a0 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b800bbf0 con 0x7f14d00d23f0 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14ced9d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b8004d00 0x7f14b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14cdd9b640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.454+0000 7f14ce59c640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b80039a0 0x7f14b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ced9d640 1 -- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 msgr2=0x7f14b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ced9d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00d23f0 0x7f14b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ced9d640 1 -- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b80039a0 msgr2=0x7f14b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ced9d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b80039a0 0x7f14b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ced9d640 1 -- 172.21.15.50:0/3355736564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8003520 con 0x7f14b8004d00 2023-08-10T10:40:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.455+0000 7f14ce59c640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b80039a0 0x7f14b8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.456+0000 7f14ced9d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b8004d00 0x7f14b8005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009f90 tx=0x7f14b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc0184edbf93c0b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.456+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c802cbd0 con 0x7f14b8004d00 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.456+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800f040 con 0x7f14b8004d00 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.456+0000 7f14cd59a640 1 -- 172.21.15.50:0/3355736564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8034440 con 0x7f14b8004d00 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 -- 172.21.15.50:0/3355736564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b8004d00 msgr2=0x7f14b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/3355736564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b8004d00 0x7f14b8005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009f90 tx=0x7f14b80057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14ced9d640 1 -- 172.21.15.50:0/3355736564 reap_dead start 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 -- 172.21.15.50:0/3355736564 shutdown_connections 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 -- 172.21.15.50:0/3355736564 >> 172.21.15.50:0/3355736564 conn(0x7f14d00d2c60 msgr2=0x7f14d00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 -- 172.21.15.50:0/3355736564 shutdown_connections 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.457+0000 7f14d4e2d640 1 -- 172.21.15.50:0/3355736564 wait complete. 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.459+0000 7f14d4e2d640 1 Processor -- start 2023-08-10T10:40:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.459+0000 7f14d4e2d640 1 -- start start 2023-08-10T10:40:10.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b8004d00 0x7f14d01f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d01f4e80 0x7f14d00c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d015d3a0 con 0x7f14d00c6a60 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00c7880 con 0x7f14b8004d00 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14d4e2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00c6fe0 con 0x7f14d01f4e80 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14ced9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14ced9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50782/0 (socket says 172.21.15.50:50782) 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.460+0000 7f14ced9d640 1 -- 172.21.15.50:0/1187963440 learned_addr learned my addr 172.21.15.50:0/1187963440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14cdd9b640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d01f4e80 0x7f14d00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ce59c640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b8004d00 0x7f14d01f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 -- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d01f4e80 msgr2=0x7f14d00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d01f4e80 0x7f14d00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 -- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b8004d00 msgr2=0x7f14d01f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b8004d00 0x7f14d01f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 -- 172.21.15.50:0/1187963440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00c72c0 con 0x7f14d00c6a60 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14ced9d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f14c8037040 tx=0x7f14c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.461+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c802ce30 con 0x7f14d00c6a60 2023-08-10T10:40:10.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.462+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8034ad0 con 0x7f14d00c6a60 2023-08-10T10:40:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.462+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d00c75a0 con 0x7f14d00c6a60 2023-08-10T10:40:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.462+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8034e80 con 0x7f14d00c6a60 2023-08-10T10:40:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.462+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d01f5300 con 0x7f14d00c6a60 2023-08-10T10:40:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.463+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d015d510 con 0x7f14d00c6a60 2023-08-10T10:40:10.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.464+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14c8047460 con 0x7f14d00c6a60 2023-08-10T10:40:10.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.465+0000 7f14beffd640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 0x7f14b006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:10.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.465+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f14c80aac80 con 0x7f14d00c6a60 2023-08-10T10:40:10.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.465+0000 7f14ce59c640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 0x7f14b006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:10.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.466+0000 7f14ce59c640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 0x7f14b006d140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f14c0001750 tx=0x7f14c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.469+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f14d015d510 con 0x7f14d00c6a60 2023-08-10T10:40:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:10.701+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14d015d4e0 con 0x7f14d00c6a60 2023-08-10T10:40:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.212+0000 7f14beffd640 1 -- 172.21.15.50:0/1187963440 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f14c8075d50 con 0x7f14d00c6a60 2023-08-10T10:40:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.215+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 msgr2=0x7f14b006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.215+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 0x7f14b006d140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f14c0001750 tx=0x7f14c0009040 comp rx=0 tx=0).stop 2023-08-10T10:40:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.215+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 msgr2=0x7f14d00b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.215+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f14c8037040 tx=0x7f14c8009750 comp rx=0 tx=0).stop 2023-08-10T10:40:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 shutdown_connections 2023-08-10T10:40:11.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14d00c6a60 0x7f14d00b26c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d01f4e80 0x7f14d00c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14b006ac80 0x7f14b006d140 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 --2- 172.21.15.50:0/1187963440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14b8004d00 0x7f14d01f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 >> 172.21.15.50:0/1187963440 conn(0x7f14d00d2c60 msgr2=0x7f14d00d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:11.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 shutdown_connections 2023-08-10T10:40:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.216+0000 7f14d4e2d640 1 -- 172.21.15.50:0/1187963440 wait complete. 2023-08-10T10:40:11.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:40:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.480+0000 7fdc17799640 1 Processor -- start 2023-08-10T10:40:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.481+0000 7fdc17799640 1 -- start start 2023-08-10T10:40:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.482+0000 7fdc17799640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc100cd9e0 0x7fdc1015a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.482+0000 7fdc17799640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc1006ea80 0x7fdc1006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.482+0000 7fdc17799640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1006a970 con 0x7fdc10157460 2023-08-10T10:40:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.482+0000 7fdc17799640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1015ad60 con 0x7fdc100cd9e0 2023-08-10T10:40:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.482+0000 7fdc17799640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10157840 con 0x7fdc1006ea80 2023-08-10T10:40:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc100cd9e0 0x7fdc1015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc100cd9e0 0x7fdc1015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50796/0 (socket says 172.21.15.50:50796) 2023-08-10T10:40:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 -- 172.21.15.50:0/2362923654 learned_addr learned my addr 172.21.15.50:0/2362923654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:11.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc15d36640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc1006ea80 0x7fdc1006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 -- 172.21.15.50:0/2362923654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc1006ea80 msgr2=0x7fdc1006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:11.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc1006ea80 0x7fdc1006ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 -- 172.21.15.50:0/2362923654 >> v1:172.21.15.117:6789/0 conn(0x7fdc10157460 legacy=0x7fdc100cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:11.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.483+0000 7fdc14d34640 1 -- 172.21.15.50:0/2362923654 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1006ac50 con 0x7fdc100cd9e0 2023-08-10T10:40:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.485+0000 7fdc14d34640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015a820 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdc000098a0 tx=0x7fdc0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7a8ac77073a6d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.485+0000 7fdc07fff640 1 -- 172.21.15.50:0/2362923654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00031640 con 0x7fdc100cd9e0 2023-08-10T10:40:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.485+0000 7fdc07fff640 1 -- 172.21.15.50:0/2362923654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc000317a0 con 0x7fdc100cd9e0 2023-08-10T10:40:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.485+0000 7fdc07fff640 1 -- 172.21.15.50:0/2362923654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00031b30 con 0x7fdc100cd9e0 2023-08-10T10:40:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 -- 172.21.15.50:0/2362923654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc100cd9e0 msgr2=0x7fdc1015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015a820 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdc000098a0 tx=0x7fdc0002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 -- 172.21.15.50:0/2362923654 shutdown_connections 2023-08-10T10:40:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc1006ea80 0x7fdc1006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 --2- 172.21.15.50:0/2362923654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015a820 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 -- 172.21.15.50:0/2362923654 >> 172.21.15.50:0/2362923654 conn(0x7fdc100b08e0 msgr2=0x7fdc100ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 -- 172.21.15.50:0/2362923654 shutdown_connections 2023-08-10T10:40:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.486+0000 7fdc17799640 1 -- 172.21.15.50:0/2362923654 wait complete. 2023-08-10T10:40:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.488+0000 7fdc17799640 1 Processor -- start 2023-08-10T10:40:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.488+0000 7fdc17799640 1 -- start start 2023-08-10T10:40:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 0x7fdc100ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10158aa0 con 0x7fdc1006ea80 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10151f70 con 0x7fdc100cd9e0 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc17799640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1015b800 con 0x7fdc10157460 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc15535640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc15535640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50804/0 (socket says 172.21.15.50:50804) 2023-08-10T10:40:11.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.489+0000 7fdc15535640 1 -- 172.21.15.50:0/3496270327 learned_addr learned my addr 172.21.15.50:0/3496270327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc14d34640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15d36640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 0x7fdc100ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 -- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 msgr2=0x7fdc100ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 0x7fdc100ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 -- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc100cd9e0 msgr2=0x7fdc1015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 -- 172.21.15.50:0/3496270327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000094d0 con 0x7fdc1006ea80 2023-08-10T10:40:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15d36640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 0x7fdc100ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.490+0000 7fdc15535640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c430 tx=0x7fdc0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.491+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c011790 con 0x7fdc1006ea80 2023-08-10T10:40:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.491+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c0118f0 con 0x7fdc1006ea80 2023-08-10T10:40:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.491+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c011ce0 con 0x7fdc1006ea80 2023-08-10T10:40:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.491+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc10158170 con 0x7fdc1006ea80 2023-08-10T10:40:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.491+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc10158730 con 0x7fdc1006ea80 2023-08-10T10:40:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.492+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1004e270 con 0x7fdc1006ea80 2023-08-10T10:40:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.493+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc0c01c460 con 0x7fdc1006ea80 2023-08-10T10:40:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.494+0000 7fdc05ffb640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 0x7fdbf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.494+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fdc0c0895c0 con 0x7fdc1006ea80 2023-08-10T10:40:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.494+0000 7fdc14d34640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 0x7fdbf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.495+0000 7fdc14d34640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 0x7fdbf406d110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdc00036000 tx=0x7fdc0003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.498+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc0c054550 con 0x7fdc1006ea80 2023-08-10T10:40:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:11.690+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc100cee00 con 0x7fdc1006ea80 2023-08-10T10:40:12.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:12.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.553+0000 7fdc05ffb640 1 -- 172.21.15.50:0/3496270327 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdc0c057b70 con 0x7fdc1006ea80 2023-08-10T10:40:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:40:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 msgr2=0x7fdbf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 0x7fdbf406d110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdc00036000 tx=0x7fdc0003c040 comp rx=0 tx=0).stop 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 msgr2=0x7fdc10151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c430 tx=0x7fdc0c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 shutdown_connections 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc10157460 0x7fdc100ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbf406ac50 0x7fdbf406d110 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc100cd9e0 0x7fdc1015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 --2- 172.21.15.50:0/3496270327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1006ea80 0x7fdc10151a30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 >> 172.21.15.50:0/3496270327 conn(0x7fdc100b08e0 msgr2=0x7fdc1006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 shutdown_connections 2023-08-10T10:40:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.560+0000 7fdc17799640 1 -- 172.21.15.50:0/3496270327 wait complete. 2023-08-10T10:40:12.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:40:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.806+0000 7f540baba640 1 Processor -- start 2023-08-10T10:40:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.806+0000 7f540baba640 1 -- start start 2023-08-10T10:40:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f540baba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f540415cbe0 0x7f54040d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f540baba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040d20d0 con 0x7f54040b4c10 2023-08-10T10:40:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f540baba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540415cfc0 con 0x7f54040d2560 2023-08-10T10:40:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f540baba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54040d14c0 con 0x7f540415cbe0 2023-08-10T10:40:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f540a057640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54040b4c10 0x7f54040b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46714/0 (socket says 172.21.15.50:46714) 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.809+0000 7f540a057640 1 -- 172.21.15.50:0/2306441114 learned_addr learned my addr 172.21.15.50:0/2306441114 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.808+0000 7f5409856640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f540415cbe0 0x7f54040d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.809+0000 7f5409856640 1 -- 172.21.15.50:0/2306441114 >> v1:172.21.15.117:6789/0 conn(0x7f54040d2560 legacy=0x7f54040b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.809+0000 7f5409856640 1 -- 172.21.15.50:0/2306441114 >> v1:172.21.15.50:6789/0 conn(0x7f54040b4c10 legacy=0x7f54040b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.809+0000 7f5408854640 1 -- 172.21.15.50:0/2306441114 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474072531 0 0) 0x7f54040d20d0 con 0x7f54040b4c10 2023-08-10T10:40:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.809+0000 7f5409856640 1 -- 172.21.15.50:0/2306441114 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040d17a0 con 0x7f540415cbe0 2023-08-10T10:40:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.810+0000 7f5409856640 1 --2- 172.21.15.50:0/2306441114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540415cbe0 0x7f54040d0bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5400009d90 tx=0x7f540002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c6a5db284c5fdc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.811+0000 7f5408854640 1 -- 172.21.15.50:0/2306441114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540002cd80 con 0x7f540415cbe0 2023-08-10T10:40:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.811+0000 7f5408854640 1 -- 172.21.15.50:0/2306441114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400034440 con 0x7f540415cbe0 2023-08-10T10:40:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.811+0000 7f5408854640 1 -- 172.21.15.50:0/2306441114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000347d0 con 0x7f540415cbe0 2023-08-10T10:40:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.811+0000 7f540baba640 1 -- 172.21.15.50:0/2306441114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540415cbe0 msgr2=0x7f54040d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.811+0000 7f540baba640 1 --2- 172.21.15.50:0/2306441114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540415cbe0 0x7f54040d0bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5400009d90 tx=0x7f540002bfd0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.812+0000 7f540baba640 1 -- 172.21.15.50:0/2306441114 shutdown_connections 2023-08-10T10:40:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.812+0000 7f540baba640 1 --2- 172.21.15.50:0/2306441114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f540415cbe0 0x7f54040d0bc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.812+0000 7f540baba640 1 -- 172.21.15.50:0/2306441114 >> 172.21.15.50:0/2306441114 conn(0x7f54040702f0 msgr2=0x7f54040d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.812+0000 7f540baba640 1 -- 172.21.15.50:0/2306441114 shutdown_connections 2023-08-10T10:40:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.812+0000 7f540baba640 1 -- 172.21.15.50:0/2306441114 wait complete. 2023-08-10T10:40:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.813+0000 7f540baba640 1 Processor -- start 2023-08-10T10:40:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.814+0000 7f540baba640 1 -- start start 2023-08-10T10:40:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 0x7f54040ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 0x7f54040c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540415df90 con 0x7f54040b4c10 2023-08-10T10:40:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041f1f70 con 0x7f5404153220 2023-08-10T10:40:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540baba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540415d380 con 0x7f54040d2560 2023-08-10T10:40:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409856640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409856640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50820/0 (socket says 172.21.15.50:50820) 2023-08-10T10:40:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409856640 1 -- 172.21.15.50:0/3367506684 learned_addr learned my addr 172.21.15.50:0/3367506684 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f540a057640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 0x7f54040c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:12.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409055640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 0x7f54040ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:12.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409856640 1 -- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 msgr2=0x7f54040ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.815+0000 7f5409856640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 0x7f54040ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f5409856640 1 -- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 msgr2=0x7f54040c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f5409856640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 0x7f54040c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f5409856640 1 -- 172.21.15.50:0/3367506684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009a70 con 0x7f54040b4c10 2023-08-10T10:40:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f5409055640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 0x7f54040ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f540a057640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 0x7f54040c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f5409856640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5400037040 tx=0x7f5400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540003e610 con 0x7f54040b4c10 2023-08-10T10:40:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540003e790 con 0x7f54040b4c10 2023-08-10T10:40:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540003eb40 con 0x7f54040b4c10 2023-08-10T10:40:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.816+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540415d660 con 0x7f54040b4c10 2023-08-10T10:40:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.817+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540415dc20 con 0x7f54040b4c10 2023-08-10T10:40:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.817+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5404065b50 con 0x7f54040b4c10 2023-08-10T10:40:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.818+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f540003b050 con 0x7f54040b4c10 2023-08-10T10:40:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.820+0000 7f53fa7fc640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 0x7f53e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.820+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f54000abeb0 con 0x7f54040b4c10 2023-08-10T10:40:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.820+0000 7f5409055640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 0x7f53e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:12.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.821+0000 7f5409055640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 0x7f53e806d110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f54041602e0 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:12.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:12.824+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5400077120 con 0x7f54040b4c10 2023-08-10T10:40:13.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.019+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f540404e270 con 0x7f54040b4c10 2023-08-10T10:40:13.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.564+0000 7f53fa7fc640 1 -- 172.21.15.50:0/3367506684 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54000390d0 con 0x7f54040b4c10 2023-08-10T10:40:13.565 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:40:13.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 msgr2=0x7f53e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 0x7f53e806d110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f54041602e0 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2023-08-10T10:40:13.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 msgr2=0x7f5404152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5400037040 tx=0x7f5400004a40 comp rx=0 tx=0).stop 2023-08-10T10:40:13.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 shutdown_connections 2023-08-10T10:40:13.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53e806ac50 0x7f53e806d110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5404153220 0x7f54040c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54040d2560 0x7f54040ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 --2- 172.21.15.50:0/3367506684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54040b4c10 0x7f5404152ad0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 >> 172.21.15.50:0/3367506684 conn(0x7f54040702f0 msgr2=0x7f5404159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.568+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 shutdown_connections 2023-08-10T10:40:13.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.569+0000 7f540baba640 1 -- 172.21.15.50:0/3367506684 wait complete. 2023-08-10T10:40:13.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:40:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.819+0000 7f7a87f12640 1 Processor -- start 2023-08-10T10:40:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.819+0000 7f7a87f12640 1 -- start start 2023-08-10T10:40:13.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a87f12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a8015a820 0x7f7a8006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a87f12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a800cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a87f12640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8015bcb0 con 0x7f7a8015ac00 2023-08-10T10:40:13.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a87f12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a800c5540 con 0x7f7a8015a820 2023-08-10T10:40:13.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a87f12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015b0a0 con 0x7f7a80069db0 2023-08-10T10:40:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a854ad640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a8015ac00 0x7f7a800696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46716/0 (socket says 172.21.15.50:46716) 2023-08-10T10:40:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.821+0000 7f7a854ad640 1 -- 172.21.15.50:0/959510769 learned_addr learned my addr 172.21.15.50:0/959510769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a864af640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a800cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a85cae640 1 --2- 172.21.15.50:0/959510769 >> v2:172.21.15.117:3300/0 conn(0x7f7a8015a820 0x7f7a8006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018450608 0 0) 0x7f7a8015bcb0 con 0x7f7a8015ac00 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a6c003520 con 0x7f7a8015ac00 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444364417 0 0) 0x7f7a6c003520 con 0x7f7a8015ac00 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 msgr2=0x7f7a800cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a800cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 >> v2:172.21.15.117:3300/0 conn(0x7f7a8015a820 msgr2=0x7f7a8006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 --2- 172.21.15.50:0/959510769 >> v2:172.21.15.117:3300/0 conn(0x7f7a8015a820 0x7f7a8006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8015b380 con 0x7f7a8015ac00 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7a70001670 con 0x7f7a8015ac00 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 >> v1:172.21.15.50:6789/0 conn(0x7f7a8015ac00 legacy=0x7f7a800696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a6c003970 0x7f7a6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c5540 con 0x7f7a6c0047c0 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015b0a0 con 0x7f7a6c003970 2023-08-10T10:40:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.822+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c00b980 con 0x7f7a80069db0 2023-08-10T10:40:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a864af640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a85cae640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a6c003970 0x7f7a6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 -- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 msgr2=0x7f7a6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 -- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a6c003970 msgr2=0x7f7a6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a6c003970 0x7f7a6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a854ad640 1 -- 172.21.15.50:0/959510769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c003520 con 0x7f7a6c0047c0 2023-08-10T10:40:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.823+0000 7f7a864af640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a80069db0 0x7f7a6c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a854ad640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a6c004c40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c240 tx=0x7f7a6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c7a6f42228eab9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7002cb00 con 0x7f7a6c0047c0 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7002cc60 con 0x7f7a6c0047c0 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a84cac640 1 -- 172.21.15.50:0/959510769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700058d0 con 0x7f7a6c0047c0 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a87f12640 1 -- 172.21.15.50:0/959510769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 msgr2=0x7f7a6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a87f12640 1 --2- 172.21.15.50:0/959510769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a6c004c40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c240 tx=0x7f7a6c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a864af640 1 -- 172.21.15.50:0/959510769 reap_dead start 2023-08-10T10:40:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a87f12640 1 -- 172.21.15.50:0/959510769 shutdown_connections 2023-08-10T10:40:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.825+0000 7f7a87f12640 1 -- 172.21.15.50:0/959510769 >> 172.21.15.50:0/959510769 conn(0x7f7a800b08e0 msgr2=0x7f7a800ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.826+0000 7f7a87f12640 1 -- 172.21.15.50:0/959510769 shutdown_connections 2023-08-10T10:40:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.826+0000 7f7a87f12640 1 -- 172.21.15.50:0/959510769 wait complete. 2023-08-10T10:40:13.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.827+0000 7f7a87f12640 1 Processor -- start 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 -- start start 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 0x7f7a800c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a800b16a0 0x7f7a800c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80157450 con 0x7f7a6c0047c0 2023-08-10T10:40:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c3a30 con 0x7f7a800b16a0 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.828+0000 7f7a87f12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a801ef970 con 0x7f7a800b1220 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50844/0 (socket says 172.21.15.50:50844) 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 -- 172.21.15.50:0/4255931402 learned_addr learned my addr 172.21.15.50:0/4255931402 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a864af640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a800b16a0 0x7f7a800c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a854ad640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 0x7f7a800c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 -- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 msgr2=0x7f7a800c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 0x7f7a800c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 -- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a800b16a0 msgr2=0x7f7a800c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a800b16a0 0x7f7a800c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a85cae640 1 -- 172.21.15.50:0/4255931402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a801efc50 con 0x7f7a6c0047c0 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.829+0000 7f7a854ad640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 0x7f7a800c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a85cae640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c011600 tx=0x7f7a7c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00f920 con 0x7f7a6c0047c0 2023-08-10T10:40:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00fa80 con 0x7f7a6c0047c0 2023-08-10T10:40:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00fdf0 con 0x7f7a6c0047c0 2023-08-10T10:40:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a801eff30 con 0x7f7a6c0047c0 2023-08-10T10:40:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.830+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a80157750 con 0x7f7a6c0047c0 2023-08-10T10:40:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.831+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a800b4060 con 0x7f7a6c0047c0 2023-08-10T10:40:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.832+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a7c015460 con 0x7f7a6c0047c0 2023-08-10T10:40:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.833+0000 7f7a767fc640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 0x7f7a6406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.833+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7a7c0896f0 con 0x7f7a6c0047c0 2023-08-10T10:40:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.833+0000 7f7a854ad640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 0x7f7a6406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.834+0000 7f7a854ad640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 0x7f7a6406d140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034000 tx=0x7f7a70007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:13.837+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a7c054a20 con 0x7f7a6c0047c0 2023-08-10T10:40:14.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.032+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7a8004e270 con 0x7f7a6c0047c0 2023-08-10T10:40:14.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.039+0000 7f7a767fc640 1 -- 172.21.15.50:0/4255931402 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7a7c058040 con 0x7f7a6c0047c0 2023-08-10T10:40:14.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 msgr2=0x7f7a6406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 0x7f7a6406d140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034000 tx=0x7f7a70007000 comp rx=0 tx=0).stop 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 msgr2=0x7f7a800ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c011600 tx=0x7f7a7c011ac0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 shutdown_connections 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a6406ac80 0x7f7a6406d140 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a800b16a0 0x7f7a800c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a800b1220 0x7f7a800c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 --2- 172.21.15.50:0/4255931402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6c0047c0 0x7f7a800ca180 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 >> 172.21.15.50:0/4255931402 conn(0x7f7a800b08e0 msgr2=0x7f7a8006f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 shutdown_connections 2023-08-10T10:40:14.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.042+0000 7f7a87f12640 1 -- 172.21.15.50:0/4255931402 wait complete. 2023-08-10T10:40:14.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-08-10T10:40:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.278+0000 7f1e6afd6640 1 Processor -- start 2023-08-10T10:40:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.278+0000 7f1e6afd6640 1 -- start start 2023-08-10T10:40:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.279+0000 7f1e6afd6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e640b8430 0x7f1e640cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e6afd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640cddb0 0x7f1e640d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e6afd6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e64161180 con 0x7f1e6415cd60 2023-08-10T10:40:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e6afd6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640ce240 con 0x7f1e640b8430 2023-08-10T10:40:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e6afd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640b5bd0 con 0x7f1e640cddb0 2023-08-10T10:40:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e68d72640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1e6415cd60 0x7f1e64160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46720/0 (socket says 172.21.15.50:46720) 2023-08-10T10:40:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e68d72640 1 -- 172.21.15.50:0/2274567941 learned_addr learned my addr 172.21.15.50:0/2274567941 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e63fff640 1 --2- 172.21.15.50:0/2274567941 >> v2:172.21.15.50:3300/0 conn(0x7f1e640b8430 0x7f1e640cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.280+0000 7f1e637fe640 1 -- 172.21.15.50:0/2274567941 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311749884 0 0) 0x7f1e64161180 con 0x7f1e6415cd60 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e69573640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640cddb0 0x7f1e640d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e637fe640 1 -- 172.21.15.50:0/2274567941 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e50003520 con 0x7f1e6415cd60 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e63fff640 1 -- 172.21.15.50:0/2274567941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640cddb0 msgr2=0x7f1e640d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e63fff640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640cddb0 0x7f1e640d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e63fff640 1 -- 172.21.15.50:0/2274567941 >> v1:172.21.15.50:6789/0 conn(0x7f1e6415cd60 legacy=0x7f1e64160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.281+0000 7f1e63fff640 1 -- 172.21.15.50:0/2274567941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64161460 con 0x7f1e640b8430 2023-08-10T10:40:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.282+0000 7f1e63fff640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640b8430 0x7f1e640cd870 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0097a0 tx=0x7f1e4c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3d00d1b51189a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.282+0000 7f1e637fe640 1 -- 172.21.15.50:0/2274567941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c030800 con 0x7f1e640b8430 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.282+0000 7f1e637fe640 1 -- 172.21.15.50:0/2274567941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c030960 con 0x7f1e640b8430 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.282+0000 7f1e637fe640 1 -- 172.21.15.50:0/2274567941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c030cf0 con 0x7f1e640b8430 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 -- 172.21.15.50:0/2274567941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640b8430 msgr2=0x7f1e640cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640b8430 0x7f1e640cd870 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0097a0 tx=0x7f1e4c02b940 comp rx=0 tx=0).stop 2023-08-10T10:40:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 -- 172.21.15.50:0/2274567941 shutdown_connections 2023-08-10T10:40:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640b8430 0x7f1e640cd870 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/2274567941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640cddb0 0x7f1e640d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 -- 172.21.15.50:0/2274567941 >> 172.21.15.50:0/2274567941 conn(0x7f1e640d2ac0 msgr2=0x7f1e640d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 -- 172.21.15.50:0/2274567941 shutdown_connections 2023-08-10T10:40:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.283+0000 7f1e6afd6640 1 -- 172.21.15.50:0/2274567941 wait complete. 2023-08-10T10:40:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.285+0000 7f1e6afd6640 1 Processor -- start 2023-08-10T10:40:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.285+0000 7f1e6afd6640 1 -- start start 2023-08-10T10:40:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 0x7f1e640c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6415cd60 0x7f1e640b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640cacf0 con 0x7f1e640cddb0 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64158880 con 0x7f1e6415cd60 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e6afd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640ca0e0 con 0x7f1e640b8430 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50860/0 (socket says 172.21.15.50:50860) 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.286+0000 7f1e63fff640 1 -- 172.21.15.50:0/816401122 learned_addr learned my addr 172.21.15.50:0/816401122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e68d72640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 0x7f1e640c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e69573640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6415cd60 0x7f1e640b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 -- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 msgr2=0x7f1e640c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 0x7f1e640c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 -- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6415cd60 msgr2=0x7f1e640b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6415cd60 0x7f1e640b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 -- 172.21.15.50:0/816401122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009400 con 0x7f1e640cddb0 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e68d72640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 0x7f1e640c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.287+0000 7f1e63fff640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c02bf50 tx=0x7f1e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.288+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c03e070 con 0x7f1e640cddb0 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.288+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c039a10 con 0x7f1e640cddb0 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.288+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c039da0 con 0x7f1e640cddb0 2023-08-10T10:40:14.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.288+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640ca3c0 con 0x7f1e640cddb0 2023-08-10T10:40:14.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.288+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e640ca980 con 0x7f1e640cddb0 2023-08-10T10:40:14.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.289+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e640cae60 con 0x7f1e640cddb0 2023-08-10T10:40:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.290+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e4c0423f0 con 0x7f1e640cddb0 2023-08-10T10:40:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.291+0000 7f1e617fa640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 0x7f1e4406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.291+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1e4c0aacf0 con 0x7f1e640cddb0 2023-08-10T10:40:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.291+0000 7f1e68d72640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 0x7f1e4406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.292+0000 7f1e68d72640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 0x7f1e4406d110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e54001560 tx=0x7f1e54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.295+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e4c0af070 con 0x7f1e640cddb0 2023-08-10T10:40:14.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.555+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f1e6404e270 con 0x7f1e640cddb0 2023-08-10T10:40:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.564+0000 7f1e617fa640 1 -- 172.21.15.50:0/816401122 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v125) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1e4c0340c0 con 0x7f1e640cddb0 2023-08-10T10:40:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 msgr2=0x7f1e4406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 0x7f1e4406d110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e54001560 tx=0x7f1e54009040 comp rx=0 tx=0).stop 2023-08-10T10:40:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 msgr2=0x7f1e640cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c02bf50 tx=0x7f1e4c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 shutdown_connections 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e4406ac50 0x7f1e4406d110 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6415cd60 0x7f1e640b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e640cddb0 0x7f1e640cc550 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 --2- 172.21.15.50:0/816401122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e640b8430 0x7f1e640c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 >> 172.21.15.50:0/816401122 conn(0x7f1e640d2ac0 msgr2=0x7f1e640d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 shutdown_connections 2023-08-10T10:40:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.567+0000 7f1e6afd6640 1 -- 172.21.15.50:0/816401122 wait complete. 2023-08-10T10:40:14.588 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-10T10:40:14.589 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-08-10T10:40:14.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-08-10T10:40:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.817+0000 7f4693fff640 1 Processor -- start 2023-08-10T10:40:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.818+0000 7f4693fff640 1 -- start start 2023-08-10T10:40:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.819+0000 7f4693fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46940b1da0 0x7f46940cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.819+0000 7f4693fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46940cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.819+0000 7f4693fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469415d010 con 0x7f4694153850 2023-08-10T10:40:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.819+0000 7f4693fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469415d290 con 0x7f46940b1da0 2023-08-10T10:40:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.819+0000 7f4693fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469415d570 con 0x7f4694153c30 2023-08-10T10:40:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.820+0000 7f46937fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46940cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.820+0000 7f46927fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46940b1da0 0x7f46940cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.820+0000 7f4692ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4694153850 0x7f46940b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:59972/0 (socket says 172.21.15.50:59972) 2023-08-10T10:40:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.820+0000 7f4692ffd640 1 -- 172.21.15.50:0/178887487 learned_addr learned my addr 172.21.15.50:0/178887487 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.821+0000 7f46927fc640 1 -- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 msgr2=0x7f46940cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.821+0000 7f46927fc640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46940cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.821+0000 7f46927fc640 1 -- 172.21.15.50:0/178887487 >> v1:172.21.15.117:6789/0 conn(0x7f4694153850 legacy=0x7f46940b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.821+0000 7f46927fc640 1 -- 172.21.15.50:0/178887487 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469415d850 con 0x7f46940b1da0 2023-08-10T10:40:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.821+0000 7f46937fe640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46940cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:40:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.823+0000 7f46927fc640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46940b1da0 0x7f46940cf630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f467c0097a0 tx=0x7f467c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e0d52b5012dee64 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.823+0000 7f4691ffb640 1 -- 172.21.15.50:0/178887487 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c02d040 con 0x7f46940b1da0 2023-08-10T10:40:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.823+0000 7f4691ffb640 1 -- 172.21.15.50:0/178887487 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c031810 con 0x7f46940b1da0 2023-08-10T10:40:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.823+0000 7f4691ffb640 1 -- 172.21.15.50:0/178887487 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c031ba0 con 0x7f46940b1da0 2023-08-10T10:40:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 -- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46940b1da0 msgr2=0x7f46940cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46940b1da0 0x7f46940cf630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f467c0097a0 tx=0x7f467c02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 -- 172.21.15.50:0/178887487 shutdown_connections 2023-08-10T10:40:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46940cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 --2- 172.21.15.50:0/178887487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46940b1da0 0x7f46940cf630 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 -- 172.21.15.50:0/178887487 >> 172.21.15.50:0/178887487 conn(0x7f4694069880 msgr2=0x7f4694069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 -- 172.21.15.50:0/178887487 shutdown_connections 2023-08-10T10:40:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.824+0000 7f4693fff640 1 -- 172.21.15.50:0/178887487 wait complete. 2023-08-10T10:40:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.827+0000 7f4693fff640 1 Processor -- start 2023-08-10T10:40:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.827+0000 7f4693fff640 1 -- start start 2023-08-10T10:40:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 0x7f46940c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46941f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940cc340 con 0x7f46940cb980 2023-08-10T10:40:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46941f6940 con 0x7f4694153850 2023-08-10T10:40:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f4693fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c7f90 con 0x7f4694153c30 2023-08-10T10:40:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f46937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f46937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50868/0 (socket says 172.21.15.50:50868) 2023-08-10T10:40:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.828+0000 7f46937fe640 1 -- 172.21.15.50:0/2276315305 learned_addr learned my addr 172.21.15.50:0/2276315305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f4692ffd640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 0x7f46940c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46927fc640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46941f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 -- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 msgr2=0x7f46941f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46941f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 -- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 msgr2=0x7f46940c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 0x7f46940c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 -- 172.21.15.50:0/2276315305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009400 con 0x7f46940cb980 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f4692ffd640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 0x7f46940c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.829+0000 7f46937fe640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f468c00e880 tx=0x7f468c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.830+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c009660 con 0x7f46940cb980 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.830+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c004030 con 0x7f46940cb980 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.830+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0043c0 con 0x7f46940cb980 2023-08-10T10:40:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.830+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c009400 con 0x7f46940cb980 2023-08-10T10:40:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.830+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940c8550 con 0x7f46940cb980 2023-08-10T10:40:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.831+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4694066e30 con 0x7f46940cb980 2023-08-10T10:40:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.832+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f468c00c940 con 0x7f46940cb980 2023-08-10T10:40:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.834+0000 7f468b7fe640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 0x7f467406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.834+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f468c0895e0 con 0x7f46940cb980 2023-08-10T10:40:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.834+0000 7f4692ffd640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 0x7f467406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.835+0000 7f4692ffd640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 0x7f467406d110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4684005c00 tx=0x7f4684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:14.838+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f468c0583a0 con 0x7f46940cb980 2023-08-10T10:40:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.103+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f46940b50f0 con 0x7f46940cb980 2023-08-10T10:40:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.571+0000 7f468b7fe640 1 -- 172.21.15.50:0/2276315305 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v126) v1 ==== 145+0+0 (secure 0 0 0) 0x7f468c057f30 con 0x7f46940cb980 2023-08-10T10:40:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 msgr2=0x7f467406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 0x7f467406d110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4684005c00 tx=0x7f4684009040 comp rx=0 tx=0).stop 2023-08-10T10:40:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 msgr2=0x7f46940cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f468c00e880 tx=0x7f468c00ed40 comp rx=0 tx=0).stop 2023-08-10T10:40:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 shutdown_connections 2023-08-10T10:40:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46940cb980 0x7f46940cbe00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4694153c30 0x7f46941f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f467406ac50 0x7f467406d110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 --2- 172.21.15.50:0/2276315305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4694153850 0x7f46940c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 >> 172.21.15.50:0/2276315305 conn(0x7f4694069880 msgr2=0x7f46940b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.574+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 shutdown_connections 2023-08-10T10:40:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:15.575+0000 7f4693fff640 1 -- 172.21.15.50:0/2276315305 wait complete. 2023-08-10T10:40:15.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-10T10:40:15.840 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_objectstore":"memstore"} 2023-08-10T10:40:15.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-10T10:40:15.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:16.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.071+0000 7f2001244640 1 Processor -- start 2023-08-10T10:40:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.071+0000 7f2001244640 1 -- start start 2023-08-10T10:40:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f2001244640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ffc153850 0x7f1ffc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f2001244640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ffc0cfd40 0x7f1ffc0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f2001244640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc15d010 con 0x7f1ffc153c30 2023-08-10T10:40:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f2001244640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc15d290 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f2001244640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc15d570 con 0x7f1ffc153850 2023-08-10T10:40:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.072+0000 7f1ffb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ffc153c30 0x7f1ffc0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55100/0 (socket says 172.21.15.50:55100) 2023-08-10T10:40:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f1ffb7fe640 1 -- 172.21.15.50:0/986929081 learned_addr learned my addr 172.21.15.50:0/986929081 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:16.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f2000a43640 1 --2- 172.21.15.50:0/986929081 >> v2:172.21.15.50:3300/0 conn(0x7f1ffc0cfd40 0x7f1ffc0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f1ffbfff640 1 --2- 172.21.15.50:0/986929081 >> v2:172.21.15.117:3300/0 conn(0x7f1ffc153850 0x7f1ffc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f1ffaffd640 1 -- 172.21.15.50:0/986929081 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962420387 0 0) 0x7f1ffc15d010 con 0x7f1ffc153c30 2023-08-10T10:40:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f1ffaffd640 1 -- 172.21.15.50:0/986929081 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe8003520 con 0x7f1ffc153c30 2023-08-10T10:40:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f2000a43640 1 -- 172.21.15.50:0/986929081 >> v2:172.21.15.117:3300/0 conn(0x7f1ffc153850 msgr2=0x7f1ffc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:16.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f2000a43640 1 --2- 172.21.15.50:0/986929081 >> v2:172.21.15.117:3300/0 conn(0x7f1ffc153850 0x7f1ffc0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f2000a43640 1 -- 172.21.15.50:0/986929081 >> v1:172.21.15.50:6789/0 conn(0x7f1ffc153c30 legacy=0x7f1ffc0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.073+0000 7f2000a43640 1 -- 172.21.15.50:0/986929081 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc15d850 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.074+0000 7f2000a43640 1 --2- 172.21.15.50:0/986929081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc0cfd40 0x7f1ffc0b1bd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc070d30 tx=0x7f1ff402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13232bf487d1abf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f1ffaffd640 1 -- 172.21.15.50:0/986929081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4031830 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f1ffaffd640 1 -- 172.21.15.50:0/986929081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4031990 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f1ffaffd640 1 -- 172.21.15.50:0/986929081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4031d00 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 -- 172.21.15.50:0/986929081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc0cfd40 msgr2=0x7f1ffc0b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 --2- 172.21.15.50:0/986929081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc0cfd40 0x7f1ffc0b1bd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc070d30 tx=0x7f1ff402b8d0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 -- 172.21.15.50:0/986929081 shutdown_connections 2023-08-10T10:40:16.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 --2- 172.21.15.50:0/986929081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc0cfd40 0x7f1ffc0b1bd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 --2- 172.21.15.50:0/986929081 >> v2:172.21.15.117:3300/0 conn(0x7f1ffc153850 0x7f1ffc0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 -- 172.21.15.50:0/986929081 >> 172.21.15.50:0/986929081 conn(0x7f1ffc069880 msgr2=0x7f1ffc069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 -- 172.21.15.50:0/986929081 shutdown_connections 2023-08-10T10:40:16.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.075+0000 7f2001244640 1 -- 172.21.15.50:0/986929081 wait complete. 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.077+0000 7f2001244640 1 Processor -- start 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.077+0000 7f2001244640 1 -- start start 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ffc0cfd40 0x7f1ffc0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ffc153c30 0x7f1ffc0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1507d0 con 0x7f1ffc153850 2023-08-10T10:40:16.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c83a0 con 0x7f1ffc153c30 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.078+0000 7f2001244640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c7de0 con 0x7f1ffc0cfd40 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53990/0 (socket says 172.21.15.50:53990) 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 -- 172.21.15.50:0/1024452187 learned_addr learned my addr 172.21.15.50:0/1024452187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffbfff640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ffc0cfd40 0x7f1ffc0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f2000a43640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ffc153c30 0x7f1ffc0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 -- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ffc0cfd40 msgr2=0x7f1ffc0d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ffc0cfd40 0x7f1ffc0d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 -- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ffc153c30 msgr2=0x7f1ffc0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ffc153c30 0x7f1ffc0c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 -- 172.21.15.50:0/1024452187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009400 con 0x7f1ffc153850 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.079+0000 7f1ffb7fe640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00cbb0 tx=0x7f1fec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.080+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00ad40 con 0x7f1ffc153850 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.080+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec012400 con 0x7f1ffc153850 2023-08-10T10:40:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.080+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00aea0 con 0x7f1ffc153850 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.080+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc0c80c0 con 0x7f1ffc153850 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.080+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc0caef0 con 0x7f1ffc153850 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.081+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc0cb0e0 con 0x7f1ffc153850 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.082+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fec0127b0 con 0x7f1ffc153850 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.083+0000 7f1ff8ff9640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 0x7f1fdc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.083+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1fec089100 con 0x7f1ffc153850 2023-08-10T10:40:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.083+0000 7f1ffbfff640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 0x7f1fdc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.084+0000 7f1ffbfff640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 0x7f1fdc06d110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4006fd0 tx=0x7f1fe4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.087+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1fec0544e0 con 0x7f1ffc153850 2023-08-10T10:40:16.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.279+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ffc066e30 con 0x7f1ffc153850 2023-08-10T10:40:16.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.281+0000 7f1ff8ff9640 1 -- 172.21.15.50:0/1024452187 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14758 (secure 0 0 0) 0x7f1fec057b00 con 0x7f1ffc153850 2023-08-10T10:40:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:16.283 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:13.548932+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6834/1990431155":"2023-08-11T10:40:10.192586+0000","172.21.15.117:6832/1990431155":"2023-08-11T10:40:10.192586+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 msgr2=0x7f1fdc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 0x7f1fdc06d110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4006fd0 tx=0x7f1fe4008040 comp rx=0 tx=0).stop 2023-08-10T10:40:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 msgr2=0x7f1ffc1f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00cbb0 tx=0x7f1fec00a430 comp rx=0 tx=0).stop 2023-08-10T10:40:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 shutdown_connections 2023-08-10T10:40:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fdc06ac50 0x7f1fdc06d110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ffc153c30 0x7f1ffc0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ffc153850 0x7f1ffc1f35b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 --2- 172.21.15.50:0/1024452187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ffc0cfd40 0x7f1ffc0d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 >> 172.21.15.50:0/1024452187 conn(0x7f1ffc069880 msgr2=0x7f1ffc160590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 shutdown_connections 2023-08-10T10:40:16.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.284+0000 7f2001244640 1 -- 172.21.15.50:0/1024452187 wait complete. 2023-08-10T10:40:16.305 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:40:16.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.543+0000 7fd85d5f1640 1 Processor -- start 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.544+0000 7fd85d5f1640 1 -- start start 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815fde0 0x7fd85806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8580b1e00 0x7fd8580ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580cd490 0x7fd8581604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85806b0c0 con 0x7fd85815fde0 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8580cd920 con 0x7fd8580b1e00 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.545+0000 7fd85d5f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85806a5c0 con 0x7fd8580cd490 2023-08-10T10:40:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815fde0 0x7fd85806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815fde0 0x7fd85806a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53994/0 (socket says 172.21.15.50:53994) 2023-08-10T10:40:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 -- 172.21.15.50:0/2636760881 learned_addr learned my addr 172.21.15.50:0/2636760881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd84ffff640 1 --2- 172.21.15.50:0/2636760881 >> v2:172.21.15.117:3300/0 conn(0x7fd8580b1e00 0x7fd8580ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 -- 172.21.15.50:0/2636760881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580cd490 msgr2=0x7fd8581604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 --2- 172.21.15.50:0/2636760881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580cd490 0x7fd8581604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 -- 172.21.15.50:0/2636760881 >> v2:172.21.15.117:3300/0 conn(0x7fd8580b1e00 msgr2=0x7fd8580ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 --2- 172.21.15.50:0/2636760881 >> v2:172.21.15.117:3300/0 conn(0x7fd8580b1e00 0x7fd8580ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.546+0000 7fd857fff640 1 -- 172.21.15.50:0/2636760881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85806a820 con 0x7fd85815fde0 2023-08-10T10:40:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.547+0000 7fd857fff640 1 --2- 172.21.15.50:0/2636760881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85806a080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8580b1b90 tx=0x7fd84802b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f63891c6211e62 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd8577fe640 1 -- 172.21.15.50:0/2636760881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848031760 con 0x7fd85815fde0 2023-08-10T10:40:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd8577fe640 1 -- 172.21.15.50:0/2636760881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8480318c0 con 0x7fd85815fde0 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd8577fe640 1 -- 172.21.15.50:0/2636760881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848031c50 con 0x7fd85815fde0 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 -- 172.21.15.50:0/2636760881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 msgr2=0x7fd85806a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/2636760881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85806a080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8580b1b90 tx=0x7fd84802b800 comp rx=0 tx=0).stop 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 -- 172.21.15.50:0/2636760881 shutdown_connections 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/2636760881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580cd490 0x7fd8581604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/2636760881 >> v2:172.21.15.117:3300/0 conn(0x7fd8580b1e00 0x7fd8580ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/2636760881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85806a080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.548+0000 7fd85d5f1640 1 -- 172.21.15.50:0/2636760881 >> 172.21.15.50:0/2636760881 conn(0x7fd8580d2900 msgr2=0x7fd8580d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.549+0000 7fd85d5f1640 1 -- 172.21.15.50:0/2636760881 shutdown_connections 2023-08-10T10:40:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.549+0000 7fd85d5f1640 1 -- 172.21.15.50:0/2636760881 wait complete. 2023-08-10T10:40:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.550+0000 7fd85d5f1640 1 Processor -- start 2023-08-10T10:40:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.551+0000 7fd85d5f1640 1 -- start start 2023-08-10T10:40:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580b1e00 0x7fd85814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8580cd490 0x7fd85815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85815a2c0 con 0x7fd85815fde0 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85815a5a0 con 0x7fd8580cd490 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85d5f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85815a880 con 0x7fd8580b1e00 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85cdf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85cdf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53998/0 (socket says 172.21.15.50:53998) 2023-08-10T10:40:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd85cdf0640 1 -- 172.21.15.50:0/1085838027 learned_addr learned my addr 172.21.15.50:0/1085838027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:16.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd84ffff640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8580cd490 0x7fd85815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.552+0000 7fd857fff640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580b1e00 0x7fd85814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 -- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580b1e00 msgr2=0x7fd85814bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580b1e00 0x7fd85814bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 -- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8580cd490 msgr2=0x7fd85815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8580cd490 0x7fd85815dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 -- 172.21.15.50:0/1085838027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480094d0 con 0x7fd85815fde0 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85cdf0640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd85000b970 tx=0x7fd85000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000cb40 con 0x7fd85815fde0 2023-08-10T10:40:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000ccc0 con 0x7fd85815fde0 2023-08-10T10:40:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850014680 con 0x7fd85815fde0 2023-08-10T10:40:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85815ab60 con 0x7fd85815fde0 2023-08-10T10:40:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.553+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85815b360 con 0x7fd85815fde0 2023-08-10T10:40:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.555+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85815b080 con 0x7fd85815fde0 2023-08-10T10:40:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.556+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd85001d3b0 con 0x7fd85815fde0 2023-08-10T10:40:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.556+0000 7fd8557fa640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 0x7fd83806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.557+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd850089230 con 0x7fd85815fde0 2023-08-10T10:40:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.557+0000 7fd857fff640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 0x7fd83806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.558+0000 7fd857fff640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 0x7fd83806d110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd848036000 tx=0x7fd84803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.561+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd85815b080 con 0x7fd85815fde0 2023-08-10T10:40:16.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.761+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd85815b080 con 0x7fd85815fde0 2023-08-10T10:40:16.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.762+0000 7fd8557fa640 1 -- 172.21.15.50:0/1085838027 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd85815b080 con 0x7fd85815fde0 2023-08-10T10:40:16.763 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:40:16.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.764+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 msgr2=0x7fd83806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.764+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 0x7fd83806d110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd848036000 tx=0x7fd84803d040 comp rx=0 tx=0).stop 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.764+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 msgr2=0x7fd85815e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.764+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd85000b970 tx=0x7fd85000be30 comp rx=0 tx=0).stop 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 shutdown_connections 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815fde0 0x7fd85815e3e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd83806ac50 0x7fd83806d110 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8580cd490 0x7fd85815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 --2- 172.21.15.50:0/1085838027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8580b1e00 0x7fd85814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 >> 172.21.15.50:0/1085838027 conn(0x7fd8580d2900 msgr2=0x7fd8580b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 shutdown_connections 2023-08-10T10:40:16.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:16.765+0000 7fd85d5f1640 1 -- 172.21.15.50:0/1085838027 wait complete. 2023-08-10T10:40:16.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:40:17.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.018+0000 7f5816578640 1 Processor -- start 2023-08-10T10:40:17.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.019+0000 7f5816578640 1 -- start start 2023-08-10T10:40:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.020+0000 7f5816578640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581015cf70 0x7f5810160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.020+0000 7f5816578640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58100b4640 0x7f5810161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.020+0000 7f5816578640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5810160a40 con 0x7f581015cb90 2023-08-10T10:40:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.020+0000 7f5816578640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100b4bb0 con 0x7f58100b4640 2023-08-10T10:40:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.020+0000 7f5816578640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b4e90 con 0x7f581015cf70 2023-08-10T10:40:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58100b4640 0x7f5810161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58100b4640 0x7f5810161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54004/0 (socket says 172.21.15.50:54004) 2023-08-10T10:40:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 -- 172.21.15.50:0/1376843298 learned_addr learned my addr 172.21.15.50:0/1376843298 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5807fff640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581015cf70 0x7f5810160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 -- 172.21.15.50:0/1376843298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581015cf70 msgr2=0x7f5810160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581015cf70 0x7f5810160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 -- 172.21.15.50:0/1376843298 >> v1:172.21.15.117:6789/0 conn(0x7f581015cb90 legacy=0x7f58100b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.021+0000 7f5814b15640 1 -- 172.21.15.50:0/1376843298 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100b5170 con 0x7f58100b4640 2023-08-10T10:40:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.022+0000 7f5814b15640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58100b4640 0x7f5810161410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5808009e50 tx=0x7f580802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d07b2e3d5200d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f580f7fe640 1 -- 172.21.15.50:0/1376843298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580802cb00 con 0x7f58100b4640 2023-08-10T10:40:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f580f7fe640 1 -- 172.21.15.50:0/1376843298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580802cc60 con 0x7f58100b4640 2023-08-10T10:40:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f580f7fe640 1 -- 172.21.15.50:0/1376843298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080343f0 con 0x7f58100b4640 2023-08-10T10:40:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 -- 172.21.15.50:0/1376843298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58100b4640 msgr2=0x7f5810161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58100b4640 0x7f5810161410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5808009e50 tx=0x7f580802bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 -- 172.21.15.50:0/1376843298 shutdown_connections 2023-08-10T10:40:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58100b4640 0x7f5810161410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 --2- 172.21.15.50:0/1376843298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581015cf70 0x7f5810160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.023+0000 7f5816578640 1 -- 172.21.15.50:0/1376843298 >> 172.21.15.50:0/1376843298 conn(0x7f58100cf640 msgr2=0x7f58100cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.024+0000 7f5816578640 1 -- 172.21.15.50:0/1376843298 shutdown_connections 2023-08-10T10:40:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.024+0000 7f5816578640 1 -- 172.21.15.50:0/1376843298 wait complete. 2023-08-10T10:40:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.025+0000 7f5816578640 1 Processor -- start 2023-08-10T10:40:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.025+0000 7f5816578640 1 -- start start 2023-08-10T10:40:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58100b4640 0x7f58100b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f581015cf70 0x7f5810156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100ce380 con 0x7f581015cb90 2023-08-10T10:40:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581015a3f0 con 0x7f581015cf70 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.026+0000 7f5816578640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581015a0f0 con 0x7f58100b4640 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.027+0000 7f5807fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.027+0000 7f5807fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54008/0 (socket says 172.21.15.50:54008) 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.027+0000 7f5807fff640 1 -- 172.21.15.50:0/4288340704 learned_addr learned my addr 172.21.15.50:0/4288340704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.027+0000 7f5814b15640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f581015cf70 0x7f5810156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.027+0000 7f580ffff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58100b4640 0x7f58100b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 -- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58100b4640 msgr2=0x7f58100b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58100b4640 0x7f58100b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 -- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f581015cf70 msgr2=0x7f5810156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f581015cf70 0x7f5810156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 -- 172.21.15.50:0/4288340704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808009b30 con 0x7f581015cb90 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5807fff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d5f0 tx=0x7f57f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80125f0 con 0x7f581015cb90 2023-08-10T10:40:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8012750 con 0x7f581015cb90 2023-08-10T10:40:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8012b00 con 0x7f581015cb90 2023-08-10T10:40:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5810156860 con 0x7f581015cb90 2023-08-10T10:40:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.028+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58100b7b30 con 0x7f581015cb90 2023-08-10T10:40:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.030+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58100663b0 con 0x7f581015cb90 2023-08-10T10:40:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.031+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57f8012c60 con 0x7f581015cb90 2023-08-10T10:40:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.031+0000 7f580d7fa640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 0x7f57f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.032+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f57f8089590 con 0x7f581015cb90 2023-08-10T10:40:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.032+0000 7f580ffff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 0x7f57f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.032+0000 7f580ffff640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 0x7f57f006d110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5800000f60 tx=0x7f5800009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.036+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f57f8054a00 con 0x7f581015cb90 2023-08-10T10:40:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.228+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5810159f50 con 0x7f581015cb90 2023-08-10T10:40:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.229+0000 7f580d7fa640 1 -- 172.21.15.50:0/4288340704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5810159f50 con 0x7f581015cb90 2023-08-10T10:40:17.229 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:40:17.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 msgr2=0x7f57f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 0x7f57f006d110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5800000f60 tx=0x7f5800009040 comp rx=0 tx=0).stop 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 msgr2=0x7f581015fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d5f0 tx=0x7f57f800dab0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 shutdown_connections 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57f006ac50 0x7f57f006d110 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f581015cf70 0x7f5810156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581015cb90 0x7f581015fee0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 --2- 172.21.15.50:0/4288340704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58100b4640 0x7f58100b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 >> 172.21.15.50:0/4288340704 conn(0x7f58100cf640 msgr2=0x7f5810157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:17.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 shutdown_connections 2023-08-10T10:40:17.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.232+0000 7f5816578640 1 -- 172.21.15.50:0/4288340704 wait complete. 2023-08-10T10:40:17.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:40:17.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.483+0000 7f4ee1d49640 1 Processor -- start 2023-08-10T10:40:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.483+0000 7f4ee1d49640 1 -- start start 2023-08-10T10:40:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.484+0000 7f4ee1d49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4edc069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4ee1d49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc06a040 con 0x7f4edc15e4d0 2023-08-10T10:40:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4ee1d49640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc15aee0 con 0x7f4edc1583c0 2023-08-10T10:40:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4ee1d49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0b2100 con 0x7f4edc0696a0 2023-08-10T10:40:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4ee1548640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4edc15e4d0 0x7f4edc15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55110/0 (socket says 172.21.15.50:55110) 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4ee1548640 1 -- 172.21.15.50:0/3112971715 learned_addr learned my addr 172.21.15.50:0/3112971715 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.485+0000 7f4edbfff640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4edc069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953619043 0 0) 0x7f4edc06a040 con 0x7f4edc15e4d0 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ecc003520 con 0x7f4edc15e4d0 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302654908 0 0) 0x7f4edc15aee0 con 0x7f4edc1583c0 2023-08-10T10:40:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc06a040 con 0x7f4edc1583c0 2023-08-10T10:40:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881209864 0 0) 0x7f4ecc003520 con 0x7f4edc15e4d0 2023-08-10T10:40:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 msgr2=0x7f4edc069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4edc069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 >> v1:172.21.15.117:6789/0 conn(0x7f4edc1583c0 legacy=0x7f4edc0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc15b1a0 con 0x7f4edc15e4d0 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4ed40019f0 con 0x7f4edc15e4d0 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 >> v1:172.21.15.50:6789/0 conn(0x7f4edc15e4d0 legacy=0x7f4edc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4ecc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc004100 0x7f4ecc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004d00 0x7f4ecc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0b2100 con 0x7f4ecc004100 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc00bac0 con 0x7f4ecc004d00 2023-08-10T10:40:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.486+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc00bc80 con 0x7f4edc0696a0 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc004100 0x7f4ecc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4ee0d47640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4ecc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4ee1548640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004d00 0x7f4ecc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 -- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 msgr2=0x7f4ecc003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc0696a0 0x7f4ecc003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 -- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004d00 msgr2=0x7f4ecc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004d00 0x7f4ecc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.487+0000 7f4edbfff640 1 -- 172.21.15.50:0/3112971715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc003520 con 0x7f4ecc004100 2023-08-10T10:40:17.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.488+0000 7f4edbfff640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc004100 0x7f4ecc0047c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009ac0 tx=0x7f4ecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe8071374b16884 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec802c600 con 0x7f4ecc004100 2023-08-10T10:40:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec802c760 con 0x7f4ecc004100 2023-08-10T10:40:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4edb7fe640 1 -- 172.21.15.50:0/3112971715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec802caf0 con 0x7f4ecc004100 2023-08-10T10:40:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 -- 172.21.15.50:0/3112971715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc004100 msgr2=0x7f4ecc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/3112971715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc004100 0x7f4ecc0047c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009ac0 tx=0x7f4ecc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1548640 1 -- 172.21.15.50:0/3112971715 reap_dead start 2023-08-10T10:40:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 -- 172.21.15.50:0/3112971715 shutdown_connections 2023-08-10T10:40:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 -- 172.21.15.50:0/3112971715 >> 172.21.15.50:0/3112971715 conn(0x7f4edc0caf80 msgr2=0x7f4edc0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 -- 172.21.15.50:0/3112971715 shutdown_connections 2023-08-10T10:40:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.489+0000 7f4ee1d49640 1 -- 172.21.15.50:0/3112971715 wait complete. 2023-08-10T10:40:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.491+0000 7f4ee1d49640 1 Processor -- start 2023-08-10T10:40:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.491+0000 7f4ee1d49640 1 -- start start 2023-08-10T10:40:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004100 0x7f4edc1e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc155830 0x7f4edc155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1565c0 con 0x7f4edc150a50 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1568a0 con 0x7f4ecc004100 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.492+0000 7f4ee1d49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc156b80 con 0x7f4edc155830 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54028/0 (socket says 172.21.15.50:54028) 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 -- 172.21.15.50:0/2497455239 learned_addr learned my addr 172.21.15.50:0/2497455239 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4ee0d47640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004100 0x7f4edc1e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 -- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc155830 msgr2=0x7f4edc155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc155830 0x7f4edc155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 -- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004100 msgr2=0x7f4edc1e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004100 0x7f4edc1e3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 -- 172.21.15.50:0/2497455239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0cc0d0 con 0x7f4edc150a50 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.493+0000 7f4edbfff640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4ec802c1a0 tx=0x7f4ec8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.494+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8003810 con 0x7f4edc150a50 2023-08-10T10:40:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.494+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8003970 con 0x7f4edc150a50 2023-08-10T10:40:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.494+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8003ce0 con 0x7f4edc150a50 2023-08-10T10:40:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.494+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0cc3b0 con 0x7f4edc150a50 2023-08-10T10:40:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.494+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc1561f0 con 0x7f4edc150a50 2023-08-10T10:40:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.495+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc156380 con 0x7f4edc150a50 2023-08-10T10:40:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.496+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ec8034440 con 0x7f4edc150a50 2023-08-10T10:40:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.497+0000 7f4ed97fa640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 0x7f4ec006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.497+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4ec80ab220 con 0x7f4edc150a50 2023-08-10T10:40:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.497+0000 7f4ee0d47640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 0x7f4ec006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.498+0000 7f4ee0d47640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 0x7f4ec006d110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0007fd0 tx=0x7f4ed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.501+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4edc156380 con 0x7f4edc150a50 2023-08-10T10:40:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.694+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4edc156cc0 con 0x7f4edc150a50 2023-08-10T10:40:17.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.700+0000 7f4ed97fa640 1 -- 172.21.15.50:0/2497455239 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4edc156cc0 con 0x7f4edc150a50 2023-08-10T10:40:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 msgr2=0x7f4ec006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 0x7f4ec006d110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0007fd0 tx=0x7f4ed0009040 comp rx=0 tx=0).stop 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 msgr2=0x7f4edc1e43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4ec802c1a0 tx=0x7f4ec8004730 comp rx=0 tx=0).stop 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 shutdown_connections 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4edc155830 0x7f4edc155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4edc150a50 0x7f4edc1e43a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4ec006ac50 0x7f4ec006d110 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 --2- 172.21.15.50:0/2497455239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ecc004100 0x7f4edc1e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 >> 172.21.15.50:0/2497455239 conn(0x7f4edc0caf80 msgr2=0x7f4edc0af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 shutdown_connections 2023-08-10T10:40:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:17.703+0000 7f4ee1d49640 1 -- 172.21.15.50:0/2497455239 wait complete. 2023-08-10T10:40:17.724 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:40:17.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:40:17.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:40:17.980 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:40:17.980 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:17.981 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:18.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:40:18.045 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:18.046 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:18.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:40:18.105 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:18.105 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:18.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:40:18.170 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:18.171 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:18.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:40:18.227 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:40:18.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.464+0000 7f4eadc57640 1 Processor -- start 2023-08-10T10:40:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.465+0000 7f4eadc57640 1 -- start start 2023-08-10T10:40:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.466+0000 7f4eadc57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b2370 0x7f4ea80ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.466+0000 7f4eadc57640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ea8069f30 0x7f4ea80b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.466+0000 7f4eadc57640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea81596e0 con 0x7f4ea80b1510 2023-08-10T10:40:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.466+0000 7f4eadc57640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80c90b0 con 0x7f4ea8069f30 2023-08-10T10:40:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.466+0000 7f4eadc57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80c9390 con 0x7f4ea80b2370 2023-08-10T10:40:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4e9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ea8069f30 0x7f4ea80b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4ea7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ea80b1510 0x7f4ea806f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55114/0 (socket says 172.21.15.50:55114) 2023-08-10T10:40:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4ea7fff640 1 -- 172.21.15.50:0/2745226544 learned_addr learned my addr 172.21.15.50:0/2745226544 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4ea77fe640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b2370 0x7f4ea80ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4e9effd640 1 -- 172.21.15.50:0/2745226544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b2370 msgr2=0x7f4ea80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4e9effd640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b2370 0x7f4ea80ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4e9effd640 1 -- 172.21.15.50:0/2745226544 >> v1:172.21.15.50:6789/0 conn(0x7f4ea80b1510 legacy=0x7f4ea806f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4e9effd640 1 -- 172.21.15.50:0/2745226544 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80c9670 con 0x7f4ea8069f30 2023-08-10T10:40:18.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.467+0000 7f4ea6ffd640 1 -- 172.21.15.50:0/2745226544 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137184674 0 0) 0x7f4ea81596e0 con 0x7f4ea80b1510 2023-08-10T10:40:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4e9effd640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea8069f30 0x7f4ea80b3140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097a0 tx=0x7f4e9002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18383c95c779c25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4ea6ffd640 1 -- 172.21.15.50:0/2745226544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9002d040 con 0x7f4ea8069f30 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4ea6ffd640 1 -- 172.21.15.50:0/2745226544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90031810 con 0x7f4ea8069f30 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4ea6ffd640 1 -- 172.21.15.50:0/2745226544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90031ba0 con 0x7f4ea8069f30 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4eadc57640 1 -- 172.21.15.50:0/2745226544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea8069f30 msgr2=0x7f4ea80b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.469+0000 7f4eadc57640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea8069f30 0x7f4ea80b3140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097a0 tx=0x7f4e9002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 -- 172.21.15.50:0/2745226544 shutdown_connections 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea8069f30 0x7f4ea80b3140 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 --2- 172.21.15.50:0/2745226544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b2370 0x7f4ea80ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 -- 172.21.15.50:0/2745226544 >> 172.21.15.50:0/2745226544 conn(0x7f4ea806b590 msgr2=0x7f4ea80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:18.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 -- 172.21.15.50:0/2745226544 shutdown_connections 2023-08-10T10:40:18.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.470+0000 7f4eadc57640 1 -- 172.21.15.50:0/2745226544 wait complete. 2023-08-10T10:40:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.471+0000 7f4eadc57640 1 Processor -- start 2023-08-10T10:40:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.472+0000 7f4eadc57640 1 -- start start 2023-08-10T10:40:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ea8069f30 0x7f4ea8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b1510 0x7f4ea80af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8154d40 con 0x7f4ea80b2370 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea815b830 con 0x7f4ea8069f30 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4eadc57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81f6010 con 0x7f4ea80b1510 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54046/0 (socket says 172.21.15.50:54046) 2023-08-10T10:40:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4ea7fff640 1 -- 172.21.15.50:0/4221564193 learned_addr learned my addr 172.21.15.50:0/4221564193 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4e9effd640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b1510 0x7f4ea80af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.473+0000 7f4ea77fe640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ea8069f30 0x7f4ea8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 -- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b1510 msgr2=0x7f4ea80af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b1510 0x7f4ea80af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 -- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ea8069f30 msgr2=0x7f4ea8154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ea8069f30 0x7f4ea8154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 -- 172.21.15.50:0/4221564193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90009400 con 0x7f4ea80b2370 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea7fff640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c450 tx=0x7f4ea000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00074e0 con 0x7f4ea80b2370 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea0007660 con 0x7f4ea80b2370 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0004a20 con 0x7f4ea80b2370 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.474+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea81f62f0 con 0x7f4ea80b2370 2023-08-10T10:40:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.475+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea81f68b0 con 0x7f4ea80b2370 2023-08-10T10:40:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.476+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea815ba50 con 0x7f4ea80b2370 2023-08-10T10:40:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.477+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ea0004b80 con 0x7f4ea80b2370 2023-08-10T10:40:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.478+0000 7f4ea4ff9640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 0x7f4e8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.478+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4ea00882e0 con 0x7f4ea80b2370 2023-08-10T10:40:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.478+0000 7f4ea77fe640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 0x7f4e8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.479+0000 7f4ea77fe640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 0x7f4e8806d110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e980099c0 tx=0x7f4e98003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.483+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4ea815ba50 con 0x7f4ea80b2370 2023-08-10T10:40:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.716+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ea815ba50 con 0x7f4ea80b2370 2023-08-10T10:40:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.717+0000 7f4ea4ff9640 1 -- 172.21.15.50:0/4221564193 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f4ea0018de0 con 0x7f4ea80b2370 2023-08-10T10:40:18.718 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:18.718 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3945599048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3945599048},{"type":"v1","addr":"172.21.15.117:6835","nonce":3945599048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1196270352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1196270352},{"type":"v1","addr":"172.21.15.50:6836","nonce":1196270352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/299369878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":299369878},{"type":"v1","addr":"172.21.15.50:6837","nonce":299369878}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1508840799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1508840799},{"type":"v1","addr":"172.21.15.117:6834","nonce":1508840799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2023-08-10T10:40:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-08-10T10:40:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 msgr2=0x7f4e8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 0x7f4e8806d110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e980099c0 tx=0x7f4e98003990 comp rx=0 tx=0).stop 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 msgr2=0x7f4ea80c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c450 tx=0x7f4ea000c910 comp rx=0 tx=0).stop 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 shutdown_connections 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ea80b2370 0x7f4ea80c5790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ea80b1510 0x7f4ea80af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e8806ac50 0x7f4e8806d110 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 --2- 172.21.15.50:0/4221564193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ea8069f30 0x7f4ea8154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.720+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 >> 172.21.15.50:0/4221564193 conn(0x7f4ea806b590 msgr2=0x7f4ea8071200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.721+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 shutdown_connections 2023-08-10T10:40:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:18.721+0000 7f4eadc57640 1 -- 172.21.15.50:0/4221564193 wait complete. 2023-08-10T10:40:18.739 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:40:18.739 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:40:18.740 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:40:18.740 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:40:18.740 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:40:18.740 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:40:18.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:40:18.741 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:40:18.741 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:40:18.741 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:40:18.741 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:40:18.742 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:40:18.742 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:40:18.742 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:40:18.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:40:18.742 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:40:18.762 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:40:18.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:40:18.768 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:40:18.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:40:18.769 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:40:18.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:40:18.773 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:40:18.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:40:18.816 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:40:18.817 DEBUG:teuthology.parallel:result is None 2023-08-10T10:40:18.821 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:40:18.822 DEBUG:teuthology.parallel:result is None 2023-08-10T10:40:18.824 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:40:18.825 DEBUG:teuthology.parallel:result is None 2023-08-10T10:40:18.828 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:40:18.828 DEBUG:teuthology.parallel:result is None 2023-08-10T10:40:18.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:40:18.981 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:40:18.981 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:40:18.983 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-08-10T10:40:18.982+0000 7f3c968d9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-10T10:40:18.987 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:40:18.988 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:40:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.025+0000 7f2ea7aa7640 1 Processor -- start 2023-08-10T10:40:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.026+0000 7f2ea7aa7640 1 -- start start 2023-08-10T10:40:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea7aa7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ea015ce00 0x7f2ea00d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea7aa7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea00d1220 con 0x7f2ea00cd730 2023-08-10T10:40:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea7aa7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea00b8a30 con 0x7f2ea00b5af0 2023-08-10T10:40:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea7aa7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00d2930 con 0x7f2ea015ce00 2023-08-10T10:40:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea5042640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ea015ce00 0x7f2ea00d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea5843640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ea00cd730 0x7f2ea00cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55140/0 (socket says 172.21.15.50:55140) 2023-08-10T10:40:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.027+0000 7f2ea5843640 1 -- 172.21.15.50:0/3594412098 learned_addr learned my addr 172.21.15.50:0/3594412098 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.028+0000 7f2ea5042640 1 -- 172.21.15.50:0/3594412098 >> v1:172.21.15.117:6789/0 conn(0x7f2ea00b5af0 legacy=0x7f2ea00d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.028+0000 7f2ea5042640 1 -- 172.21.15.50:0/3594412098 >> v1:172.21.15.50:6789/0 conn(0x7f2ea00cd730 legacy=0x7f2ea00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.028+0000 7f2ea5042640 1 -- 172.21.15.50:0/3594412098 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00b1e70 con 0x7f2ea015ce00 2023-08-10T10:40:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.028+0000 7f2ea4841640 1 -- 172.21.15.50:0/3594412098 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652505502 0 0) 0x7f2ea00d1220 con 0x7f2ea00cd730 2023-08-10T10:40:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.029+0000 7f2ea5042640 1 --2- 172.21.15.50:0/3594412098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea015ce00 0x7f2ea00d23f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097a0 tx=0x7f2e9002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3904e497fc9a73f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.029+0000 7f2ea4841640 1 -- 172.21.15.50:0/3594412098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90030610 con 0x7f2ea015ce00 2023-08-10T10:40:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.029+0000 7f2ea4841640 1 -- 172.21.15.50:0/3594412098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90030770 con 0x7f2ea015ce00 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.029+0000 7f2ea4841640 1 -- 172.21.15.50:0/3594412098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90030b00 con 0x7f2ea015ce00 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/3594412098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea015ce00 msgr2=0x7f2ea00d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/3594412098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea015ce00 0x7f2ea00d23f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097a0 tx=0x7f2e9002b960 comp rx=0 tx=0).stop 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/3594412098 shutdown_connections 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/3594412098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea015ce00 0x7f2ea00d23f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/3594412098 >> 172.21.15.50:0/3594412098 conn(0x7f2ea00d2c60 msgr2=0x7f2ea00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/3594412098 shutdown_connections 2023-08-10T10:40:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.030+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/3594412098 wait complete. 2023-08-10T10:40:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.032+0000 7f2ea7aa7640 1 Processor -- start 2023-08-10T10:40:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.032+0000 7f2ea7aa7640 1 -- start start 2023-08-10T10:40:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea00b5af0 0x7f2ea01f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea015ce00 0x7f2ea00b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea015e5d0 con 0x7f2ea00cd730 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c7710 con 0x7f2ea00b5af0 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea7aa7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c79f0 con 0x7f2ea015ce00 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea5042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea5042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54074/0 (socket says 172.21.15.50:54074) 2023-08-10T10:40:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea5042640 1 -- 172.21.15.50:0/1787867842 learned_addr learned my addr 172.21.15.50:0/1787867842 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea5843640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea00b5af0 0x7f2ea01f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.033+0000 7f2ea6044640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea015ce00 0x7f2ea00b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 -- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea015ce00 msgr2=0x7f2ea00b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea015ce00 0x7f2ea00b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 -- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea00b5af0 msgr2=0x7f2ea01f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea00b5af0 0x7f2ea01f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 -- 172.21.15.50:0/1787867842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90009400 con 0x7f2ea00cd730 2023-08-10T10:40:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2ea5042640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90039c90 con 0x7f2ea00cd730 2023-08-10T10:40:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9003f040 con 0x7f2ea00cd730 2023-08-10T10:40:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.034+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004030 con 0x7f2ea00cd730 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.035+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea00c7cd0 con 0x7f2ea00cd730 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.035+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea015ecb0 con 0x7f2ea00cd730 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.036+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea004e270 con 0x7f2ea00cd730 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.037+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e90004190 con 0x7f2ea00cd730 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.038+0000 7f2e967fc640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 0x7f2e8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.038+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e900aafa0 con 0x7f2ea00cd730 2023-08-10T10:40:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.038+0000 7f2ea5843640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 0x7f2e8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.039+0000 7f2ea5843640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 0x7f2e8406d110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007f70 tx=0x7f2e9c007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.042+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e900764a0 con 0x7f2ea00cd730 2023-08-10T10:40:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.245+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2ea0066830 con 0x7f2ea00cd730 2023-08-10T10:40:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.734+0000 7f2e967fc640 1 -- 172.21.15.50:0/1787867842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e90034080 con 0x7f2ea00cd730 2023-08-10T10:40:19.735 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:40:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 msgr2=0x7f2e8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 0x7f2e8406d110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007f70 tx=0x7f2e9c007f00 comp rx=0 tx=0).stop 2023-08-10T10:40:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 msgr2=0x7f2ea015dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e900046c0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 shutdown_connections 2023-08-10T10:40:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea015ce00 0x7f2ea00b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea00cd730 0x7f2ea015dbc0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8406ac50 0x7f2e8406d110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 --2- 172.21.15.50:0/1787867842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea00b5af0 0x7f2ea01f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 >> 172.21.15.50:0/1787867842 conn(0x7f2ea00d2c60 msgr2=0x7f2ea00cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 shutdown_connections 2023-08-10T10:40:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.738+0000 7f2ea7aa7640 1 -- 172.21.15.50:0/1787867842 wait complete. 2023-08-10T10:40:19.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:40:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.985+0000 7f243e95d640 1 Processor -- start 2023-08-10T10:40:19.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.985+0000 7f243e95d640 1 -- start start 2023-08-10T10:40:19.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.986+0000 7f243e95d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f243815cd60 0x7f2438160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.986+0000 7f243e95d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 0x7f24380cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.986+0000 7f243e95d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2438161180 con 0x7f24380cddb0 2023-08-10T10:40:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.986+0000 7f243e95d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380ce240 con 0x7f243815cd60 2023-08-10T10:40:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.986+0000 7f243e95d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b5bd0 con 0x7f24380b8430 2023-08-10T10:40:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f243815cd60 0x7f2438160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f243815cd60 0x7f2438160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54082/0 (socket says 172.21.15.50:54082) 2023-08-10T10:40:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 -- 172.21.15.50:0/3936137029 learned_addr learned my addr 172.21.15.50:0/3936137029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f24377fe640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 0x7f24380cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 -- 172.21.15.50:0/3936137029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 msgr2=0x7f24380cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 0x7f24380cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 -- 172.21.15.50:0/3936137029 >> v1:172.21.15.50:6789/0 conn(0x7f24380cddb0 legacy=0x7f24380696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2437fff640 1 -- 172.21.15.50:0/3936137029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438161460 con 0x7f243815cd60 2023-08-10T10:40:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f2436ffd640 1 -- 172.21.15.50:0/3936137029 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485782829 0 0) 0x7f2438161180 con 0x7f24380cddb0 2023-08-10T10:40:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.987+0000 7f24377fe640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 0x7f24380cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f2437fff640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f243815cd60 0x7f2438160930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2428009e50 tx=0x7f242802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773b2bcf3e879b07 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f2436ffd640 1 -- 172.21.15.50:0/3936137029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242802cb90 con 0x7f243815cd60 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f2436ffd640 1 -- 172.21.15.50:0/3936137029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242802ccf0 con 0x7f243815cd60 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f2436ffd640 1 -- 172.21.15.50:0/3936137029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428034610 con 0x7f243815cd60 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f243e95d640 1 -- 172.21.15.50:0/3936137029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f243815cd60 msgr2=0x7f2438160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.989+0000 7f243e95d640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f243815cd60 0x7f2438160930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2428009e50 tx=0x7f242802bff0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 -- 172.21.15.50:0/3936137029 shutdown_connections 2023-08-10T10:40:19.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380b8430 0x7f24380cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 --2- 172.21.15.50:0/3936137029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f243815cd60 0x7f2438160930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 -- 172.21.15.50:0/3936137029 >> 172.21.15.50:0/3936137029 conn(0x7f24380d2ac0 msgr2=0x7f24380d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:19.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 -- 172.21.15.50:0/3936137029 shutdown_connections 2023-08-10T10:40:19.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.990+0000 7f243e95d640 1 -- 172.21.15.50:0/3936137029 wait complete. 2023-08-10T10:40:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.991+0000 7f243e95d640 1 Processor -- start 2023-08-10T10:40:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.992+0000 7f243e95d640 1 -- start start 2023-08-10T10:40:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 0x7f243814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815cd60 0x7f243814c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24381f61b0 con 0x7f24380b8430 2023-08-10T10:40:19.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24381f3210 con 0x7f24380cddb0 2023-08-10T10:40:19.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f243e95d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24381f34f0 con 0x7f243815cd60 2023-08-10T10:40:19.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54086/0 (socket says 172.21.15.50:54086) 2023-08-10T10:40:20.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 -- 172.21.15.50:0/3103742285 learned_addr learned my addr 172.21.15.50:0/3103742285 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:20.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f24377fe640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 0x7f243814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 -- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815cd60 msgr2=0x7f243814c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815cd60 0x7f243814c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 -- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 msgr2=0x7f243814bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 0x7f243814bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f2437fff640 1 -- 172.21.15.50:0/3103742285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009b30 con 0x7f24380b8430 2023-08-10T10:40:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.993+0000 7f24377fe640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 0x7f243814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f2437fff640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2428036040 tx=0x7f2428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242803e450 con 0x7f24380b8430 2023-08-10T10:40:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242803e5b0 con 0x7f24380b8430 2023-08-10T10:40:20.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242803e940 con 0x7f24380b8430 2023-08-10T10:40:20.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24381f37d0 con 0x7f24380b8430 2023-08-10T10:40:20.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.994+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24380cfcf0 con 0x7f24380b8430 2023-08-10T10:40:20.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.996+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24381f39c0 con 0x7f24380b8430 2023-08-10T10:40:20.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.996+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f242803eaa0 con 0x7f24380b8430 2023-08-10T10:40:20.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.998+0000 7f2434ff9640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.998+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f24280ac080 con 0x7f24380b8430 2023-08-10T10:40:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.998+0000 7f24377fe640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:19.999+0000 7f24377fe640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.002+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f24280de330 con 0x7f24380b8430 2023-08-10T10:40:20.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.261+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f243804e270 con 0x7f24380b8430 2023-08-10T10:40:20.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.262+0000 7f2434ff9640 1 -- 172.21.15.50:0/3103742285 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f24280773e0 con 0x7f24380b8430 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:40:20.263 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.266 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:40:20.267 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.268 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.270 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:40:20.273 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:40:20.274 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:40:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:40:20.280 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:40:20.282 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:40:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:40:20.284 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:40:20.285 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:20.286 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 msgr2=0x7f241806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420008040 comp rx=0 tx=0).stop 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 msgr2=0x7f24380cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2428036040 tx=0x7f2428004a40 comp rx=0 tx=0).stop 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 shutdown_connections 2023-08-10T10:40:20.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815cd60 0x7f243814c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24380cddb0 0x7f243814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 --2- 172.21.15.50:0/3103742285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380b8430 0x7f24380cf7b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.264+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 >> 172.21.15.50:0/3103742285 conn(0x7f24380d2ac0 msgr2=0x7f24380b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.265+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 shutdown_connections 2023-08-10T10:40:20.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.265+0000 7f243e95d640 1 -- 172.21.15.50:0/3103742285 wait complete. 2023-08-10T10:40:20.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.521+0000 7fd144339640 1 Processor -- start 2023-08-10T10:40:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.521+0000 7fd144339640 1 -- start start 2023-08-10T10:40:20.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd144339640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd13c0b0c60 0x7fd13c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd144339640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c071c70 con 0x7fd13c15aa40 2023-08-10T10:40:20.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd144339640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c0713d0 con 0x7fd13c0b3f30 2023-08-10T10:40:20.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd144339640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0716b0 con 0x7fd13c0b0c60 2023-08-10T10:40:20.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd1420d5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd13c15aa40 0x7fd13c0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55166/0 (socket says 172.21.15.50:55166) 2023-08-10T10:40:20.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.523+0000 7fd1420d5640 1 -- 172.21.15.50:0/3009876796 learned_addr learned my addr 172.21.15.50:0/3009876796 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1418d4640 1 --2- 172.21.15.50:0/3009876796 >> v2:172.21.15.117:3300/0 conn(0x7fd13c0b0c60 0x7fd13c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328524882 0 0) 0x7fd13c071c70 con 0x7fd13c15aa40 2023-08-10T10:40:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd128003520 con 0x7fd13c15aa40 2023-08-10T10:40:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744863851 0 0) 0x7fd128003520 con 0x7fd13c15aa40 2023-08-10T10:40:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 >> v2:172.21.15.117:3300/0 conn(0x7fd13c0b0c60 msgr2=0x7fd13c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 --2- 172.21.15.50:0/3009876796 >> v2:172.21.15.117:3300/0 conn(0x7fd13c0b0c60 0x7fd13c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 >> v1:172.21.15.117:6789/0 conn(0x7fd13c0b3f30 legacy=0x7fd13c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c071990 con 0x7fd13c15aa40 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.524+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd138001670 con 0x7fd13c15aa40 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 >> v1:172.21.15.50:6789/0 conn(0x7fd13c15aa40 legacy=0x7fd13c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd128003970 0x7fd128003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280047c0 0x7fd128004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 0x7fd12800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0716b0 con 0x7fd128005180 2023-08-10T10:40:20.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12800c120 con 0x7fd128003970 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12800c2e0 con 0x7fd1280047c0 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 0x7fd12800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1420d5640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd128003970 0x7fd128003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1418d4640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280047c0 0x7fd128004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 -- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280047c0 msgr2=0x7fd128004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280047c0 0x7fd128004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 -- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd128003970 msgr2=0x7fd128003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd128003970 0x7fd128003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.525+0000 7fd1428d6640 1 -- 172.21.15.50:0/3009876796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128003520 con 0x7fd128005180 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.526+0000 7fd1428d6640 1 -- 172.21.15.50:0/3009876796 reap_dead start 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd1428d6640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 0x7fd12800b980 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e50 tx=0x7fd1280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae22f0d0376a494 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134003b70 con 0x7fd128005180 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134003d10 con 0x7fd128005180 2023-08-10T10:40:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd1410d3640 1 -- 172.21.15.50:0/3009876796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134005310 con 0x7fd128005180 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd144339640 1 -- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 msgr2=0x7fd12800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.527+0000 7fd144339640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 0x7fd12800b980 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e50 tx=0x7fd1280057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.528+0000 7fd144339640 1 -- 172.21.15.50:0/3009876796 shutdown_connections 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.528+0000 7fd144339640 1 --2- 172.21.15.50:0/3009876796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128005180 0x7fd12800b980 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.528+0000 7fd144339640 1 -- 172.21.15.50:0/3009876796 >> 172.21.15.50:0/3009876796 conn(0x7fd13c06b590 msgr2=0x7fd13c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.528+0000 7fd144339640 1 -- 172.21.15.50:0/3009876796 shutdown_connections 2023-08-10T10:40:20.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.528+0000 7fd144339640 1 -- 172.21.15.50:0/3009876796 wait complete. 2023-08-10T10:40:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.530+0000 7fd144339640 1 Processor -- start 2023-08-10T10:40:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.530+0000 7fd144339640 1 -- start start 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 0x7fd13c148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd13c0ca870 0x7fd13c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0cb230 con 0x7fd13c15b830 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c148b10 con 0x7fd13c0ca870 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd144339640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c1f5840 con 0x7fd128005180 2023-08-10T10:40:20.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd1418d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd1418d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54102/0 (socket says 172.21.15.50:54102) 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd1418d4640 1 -- 172.21.15.50:0/3645833789 learned_addr learned my addr 172.21.15.50:0/3645833789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.531+0000 7fd1420d5640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 0x7fd13c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 -- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 msgr2=0x7fd13c148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 0x7fd13c148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 -- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd13c0ca870 msgr2=0x7fd13c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1428d6640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd13c0ca870 0x7fd13c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd13c0ca870 0x7fd13c0cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 -- 172.21.15.50:0/3645833789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c1f5a90 con 0x7fd13c15b830 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1420d5640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 0x7fd13c148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd1418d4640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd12c010890 tx=0x7fd12c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c009610 con 0x7fd13c15b830 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00eb60 con 0x7fd13c15b830 2023-08-10T10:40:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c01c400 con 0x7fd13c15b830 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.532+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c1f5d70 con 0x7fd13c15b830 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.533+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c1f6330 con 0x7fd13c15b830 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.534+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c04e270 con 0x7fd13c15b830 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.535+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd12c01c560 con 0x7fd13c15b830 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.535+0000 7fd132ffd640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 0x7fd12006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.536+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd12c089690 con 0x7fd13c15b830 2023-08-10T10:40:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.536+0000 7fd1420d5640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 0x7fd12006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.536+0000 7fd1420d5640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 0x7fd12006d140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd138001eb0 tx=0x7fd138000f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.540+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd12c054b30 con 0x7fd13c15b830 2023-08-10T10:40:20.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.744+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd13c152130 con 0x7fd13c15b830 2023-08-10T10:40:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.745+0000 7fd132ffd640 1 -- 172.21.15.50:0/3645833789 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14627 (secure 0 0 0) 0x7fd12c058150 con 0x7fd13c15b830 2023-08-10T10:40:20.746 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:20.747 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":48,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:19.744083+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 msgr2=0x7fd12006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 0x7fd12006d140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd138001eb0 tx=0x7fd138000f50 comp rx=0 tx=0).stop 2023-08-10T10:40:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 msgr2=0x7fd13c1f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd12c010890 tx=0x7fd12c010d50 comp rx=0 tx=0).stop 2023-08-10T10:40:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 shutdown_connections 2023-08-10T10:40:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd12006ac80 0x7fd12006d140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd13c0ca870 0x7fd13c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c15b830 0x7fd13c1f1aa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 --2- 172.21.15.50:0/3645833789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd128005180 0x7fd13c148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 >> 172.21.15.50:0/3645833789 conn(0x7fd13c06b590 msgr2=0x7fd13c1594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 shutdown_connections 2023-08-10T10:40:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:20.749+0000 7fd144339640 1 -- 172.21.15.50:0/3645833789 wait complete. 2023-08-10T10:40:20.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:40:20.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:40:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.001+0000 7f73d08aa640 1 Processor -- start 2023-08-10T10:40:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.001+0000 7f73d08aa640 1 -- start start 2023-08-10T10:40:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73d08aa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73cc0b4130 0x7f73cc0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73d08aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73cc0aff00 0x7f73cc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73d08aa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0b0890 con 0x7f73cc15aa50 2023-08-10T10:40:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73d08aa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc15ae30 con 0x7f73cc0aff00 2023-08-10T10:40:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73d08aa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc0b1370 con 0x7f73cc0b4130 2023-08-10T10:40:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73cc0aff00 0x7f73cc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73cc0aff00 0x7f73cc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54110/0 (socket says 172.21.15.50:54110) 2023-08-10T10:40:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.003+0000 7f73cbfff640 1 -- 172.21.15.50:0/2014830574 learned_addr learned my addr 172.21.15.50:0/2014830574 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.004+0000 7f73caffd640 1 --2- 172.21.15.50:0/2014830574 >> v2:172.21.15.117:3300/0 conn(0x7f73cc0b4130 0x7f73cc0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.004+0000 7f73cbfff640 1 -- 172.21.15.50:0/2014830574 >> v2:172.21.15.117:3300/0 conn(0x7f73cc0b4130 msgr2=0x7f73cc0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.004+0000 7f73cbfff640 1 --2- 172.21.15.50:0/2014830574 >> v2:172.21.15.117:3300/0 conn(0x7f73cc0b4130 0x7f73cc0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.004+0000 7f73cbfff640 1 -- 172.21.15.50:0/2014830574 >> v1:172.21.15.50:6789/0 conn(0x7f73cc15aa50 legacy=0x7f73cc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.004+0000 7f73cbfff640 1 -- 172.21.15.50:0/2014830574 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0b1650 con 0x7f73cc0aff00 2023-08-10T10:40:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.006+0000 7f73cbfff640 1 --2- 172.21.15.50:0/2014830574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc0b0350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f73cc06bc00 tx=0x7f73c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b794e3c6430f4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.006+0000 7f73ca7fc640 1 -- 172.21.15.50:0/2014830574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c402ca80 con 0x7f73cc0aff00 2023-08-10T10:40:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.006+0000 7f73ca7fc640 1 -- 172.21.15.50:0/2014830574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c402cbe0 con 0x7f73cc0aff00 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.006+0000 7f73ca7fc640 1 -- 172.21.15.50:0/2014830574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40343f0 con 0x7f73cc0aff00 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 -- 172.21.15.50:0/2014830574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 msgr2=0x7f73cc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 --2- 172.21.15.50:0/2014830574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc0b0350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f73cc06bc00 tx=0x7f73c402bee0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 -- 172.21.15.50:0/2014830574 shutdown_connections 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 --2- 172.21.15.50:0/2014830574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc0b0350 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 --2- 172.21.15.50:0/2014830574 >> v2:172.21.15.117:3300/0 conn(0x7f73cc0b4130 0x7f73cc0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 -- 172.21.15.50:0/2014830574 >> 172.21.15.50:0/2014830574 conn(0x7f73cc069cd0 msgr2=0x7f73cc0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 -- 172.21.15.50:0/2014830574 shutdown_connections 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.007+0000 7f73d08aa640 1 -- 172.21.15.50:0/2014830574 wait complete. 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.009+0000 7f73d08aa640 1 Processor -- start 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.009+0000 7f73d08aa640 1 -- start start 2023-08-10T10:40:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73cc0b4130 0x7f73cc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73cc15aa50 0x7f73cc0af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0c44a0 con 0x7f73cc0aff00 2023-08-10T10:40:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc15be20 con 0x7f73cc0b4130 2023-08-10T10:40:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73d08aa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc15c100 con 0x7f73cc15aa50 2023-08-10T10:40:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54122/0 (socket says 172.21.15.50:54122) 2023-08-10T10:40:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.010+0000 7f73cb7fe640 1 -- 172.21.15.50:0/4086909589 learned_addr learned my addr 172.21.15.50:0/4086909589 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73caffd640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73cc0b4130 0x7f73cc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cbfff640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73cc15aa50 0x7f73cc0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 -- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73cc15aa50 msgr2=0x7f73cc0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73cc15aa50 0x7f73cc0af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 -- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73cc0b4130 msgr2=0x7f73cc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73cc0b4130 0x7f73cc0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 -- 172.21.15.50:0/4086909589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4009b30 con 0x7f73cc0aff00 2023-08-10T10:40:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73cb7fe640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c450 tx=0x7f73bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.011+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0052d0 con 0x7f73cc0aff00 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.012+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc005430 con 0x7f73cc0aff00 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.012+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc012870 con 0x7f73cc0aff00 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.012+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc15c3e0 con 0x7f73cc0aff00 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.012+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc0c3770 con 0x7f73cc0aff00 2023-08-10T10:40:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.013+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc15bc60 con 0x7f73cc0aff00 2023-08-10T10:40:21.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.014+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73bc0129d0 con 0x7f73cc0aff00 2023-08-10T10:40:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.015+0000 7f73b3fff640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 0x7f73b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.015+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73bc088af0 con 0x7f73cc0aff00 2023-08-10T10:40:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.015+0000 7f73caffd640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 0x7f73b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.016+0000 7f73caffd640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 0x7f73b806d110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006fd0 tx=0x7f73c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.019+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f73bc053ee0 con 0x7f73cc0aff00 2023-08-10T10:40:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.215+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73cc0b0890 con 0x7f73cc0aff00 2023-08-10T10:40:21.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.216+0000 7f73b3fff640 1 -- 172.21.15.50:0/4086909589 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73cc0b0890 con 0x7f73cc0aff00 2023-08-10T10:40:21.217 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:40:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 msgr2=0x7f73b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 0x7f73b806d110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006fd0 tx=0x7f73c0008040 comp rx=0 tx=0).stop 2023-08-10T10:40:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 msgr2=0x7f73cc1518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c450 tx=0x7f73bc00c910 comp rx=0 tx=0).stop 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 shutdown_connections 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73cc15aa50 0x7f73cc0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73b806ac50 0x7f73b806d110 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73cc0b4130 0x7f73cc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 --2- 172.21.15.50:0/4086909589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc0aff00 0x7f73cc1518a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 >> 172.21.15.50:0/4086909589 conn(0x7f73cc069cd0 msgr2=0x7f73cc06ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 shutdown_connections 2023-08-10T10:40:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.219+0000 7f73d08aa640 1 -- 172.21.15.50:0/4086909589 wait complete. 2023-08-10T10:40:21.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:40:21.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.470+0000 7fdc642d3640 1 Processor -- start 2023-08-10T10:40:21.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.471+0000 7fdc642d3640 1 -- start start 2023-08-10T10:40:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.472+0000 7fdc642d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc5c0b0cd0 0x7fdc5c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.472+0000 7fdc642d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c161640 con 0x7fdc5c0cdcb0 2023-08-10T10:40:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.472+0000 7fdc642d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c0adb30 con 0x7fdc5c161260 2023-08-10T10:40:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.472+0000 7fdc642d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c1bb0 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.473+0000 7fdc62870640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc5c0cdcb0 0x7fdc5c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55190/0 (socket says 172.21.15.50:55190) 2023-08-10T10:40:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.473+0000 7fdc62870640 1 -- 172.21.15.50:0/1432129459 learned_addr learned my addr 172.21.15.50:0/1432129459 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.473+0000 7fdc6186e640 1 --2- 172.21.15.50:0/1432129459 >> v2:172.21.15.50:3300/0 conn(0x7fdc5c0b0cd0 0x7fdc5c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.473+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793423054 0 0) 0x7fdc5c161640 con 0x7fdc5c0cdcb0 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.473+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc48003520 con 0x7fdc5c0cdcb0 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.474+0000 7fdc6186e640 1 -- 172.21.15.50:0/1432129459 >> v1:172.21.15.117:6789/0 conn(0x7fdc5c161260 legacy=0x7fdc5c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.474+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665983875 0 0) 0x7fdc5c0adb30 con 0x7fdc5c161260 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.474+0000 7fdc6186e640 1 -- 172.21.15.50:0/1432129459 >> v1:172.21.15.50:6789/0 conn(0x7fdc5c0cdcb0 legacy=0x7fdc5c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.474+0000 7fdc6186e640 1 -- 172.21.15.50:0/1432129459 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0ade10 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.475+0000 7fdc6186e640 1 --2- 172.21.15.50:0/1432129459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06ec90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a94c1f1ce404977 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.475+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c031830 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.475+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c031990 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.475+0000 7fdc6106d640 1 -- 172.21.15.50:0/1432129459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c031d00 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 -- 172.21.15.50:0/1432129459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0b0cd0 msgr2=0x7fdc5c06ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 --2- 172.21.15.50:0/1432129459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06ec90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 -- 172.21.15.50:0/1432129459 shutdown_connections 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 --2- 172.21.15.50:0/1432129459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06ec90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 -- 172.21.15.50:0/1432129459 >> 172.21.15.50:0/1432129459 conn(0x7fdc5c0b01b0 msgr2=0x7fdc5c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 -- 172.21.15.50:0/1432129459 shutdown_connections 2023-08-10T10:40:21.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.476+0000 7fdc642d3640 1 -- 172.21.15.50:0/1432129459 wait complete. 2023-08-10T10:40:21.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.478+0000 7fdc642d3640 1 Processor -- start 2023-08-10T10:40:21.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.478+0000 7fdc642d3640 1 -- start start 2023-08-10T10:40:21.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc5c0cdcb0 0x7fdc5c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c3370 con 0x7fdc5c161260 2023-08-10T10:40:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c3790 con 0x7fdc5c0b0cd0 2023-08-10T10:40:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc642d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c26f0 con 0x7fdc5c0cdcb0 2023-08-10T10:40:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54148/0 (socket says 172.21.15.50:54148) 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 -- 172.21.15.50:0/4206091108 learned_addr learned my addr 172.21.15.50:0/4206091108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc6206f640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc6186e640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc5c0cdcb0 0x7fdc5c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 -- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc5c0cdcb0 msgr2=0x7fdc5c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc5c0cdcb0 0x7fdc5c15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 -- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 msgr2=0x7fdc5c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc62870640 1 -- 172.21.15.50:0/4206091108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009400 con 0x7fdc5c161260 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.479+0000 7fdc6206f640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc62870640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cb40 tx=0x7fdc5400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400aca0 con 0x7fdc5c161260 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5400ae00 con 0x7fdc5c161260 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54012620 con 0x7fdc5c161260 2023-08-10T10:40:21.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c0c29d0 con 0x7fdc5c161260 2023-08-10T10:40:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.480+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c0c2f90 con 0x7fdc5c161260 2023-08-10T10:40:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.481+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5c0c34b0 con 0x7fdc5c161260 2023-08-10T10:40:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.482+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc54007070 con 0x7fdc5c161260 2023-08-10T10:40:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.483+0000 7fdc52ffd640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 0x7fdc4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.483+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc540891d0 con 0x7fdc5c161260 2023-08-10T10:40:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.484+0000 7fdc6206f640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 0x7fdc4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.484+0000 7fdc6206f640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 0x7fdc4006d110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007fd0 tx=0x7fdc58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.488+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc5c0c34b0 con 0x7fdc5c161260 2023-08-10T10:40:21.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.678+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdc5c0c34b0 con 0x7fdc5c161260 2023-08-10T10:40:21.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.679+0000 7fdc52ffd640 1 -- 172.21.15.50:0/4206091108 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc5c0c34b0 con 0x7fdc5c161260 2023-08-10T10:40:21.679 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 msgr2=0x7fdc4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 0x7fdc4006d110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007fd0 tx=0x7fdc58009040 comp rx=0 tx=0).stop 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 msgr2=0x7fdc5c15f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cb40 tx=0x7fdc5400a060 comp rx=0 tx=0).stop 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 shutdown_connections 2023-08-10T10:40:21.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c161260 0x7fdc5c15f860 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc5c0cdcb0 0x7fdc5c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc4006ac50 0x7fdc4006d110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 --2- 172.21.15.50:0/4206091108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc5c0b0cd0 0x7fdc5c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.681+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 >> 172.21.15.50:0/4206091108 conn(0x7fdc5c0b01b0 msgr2=0x7fdc5c0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.682+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 shutdown_connections 2023-08-10T10:40:21.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.682+0000 7fdc642d3640 1 -- 172.21.15.50:0/4206091108 wait complete. 2023-08-10T10:40:21.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:40:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.929+0000 7fe281f5d640 1 Processor -- start 2023-08-10T10:40:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.929+0000 7fe281f5d640 1 -- start start 2023-08-10T10:40:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.930+0000 7fe281f5d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe27c15cd60 0x7fe27c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.930+0000 7fe281f5d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe27c0b8430 0x7fe27c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.930+0000 7fe281f5d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c0ce200 con 0x7fe27c0cddb0 2023-08-10T10:40:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.930+0000 7fe281f5d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0b5bd0 con 0x7fe27c0b8430 2023-08-10T10:40:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.930+0000 7fe281f5d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c161180 con 0x7fe27c15cd60 2023-08-10T10:40:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe27c0b8430 0x7fe27c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe27c0b8430 0x7fe27c0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54152/0 (socket says 172.21.15.50:54152) 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 -- 172.21.15.50:0/2432097222 learned_addr learned my addr 172.21.15.50:0/2432097222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe27bfff640 1 --1- 172.21.15.50:0/2432097222 >> v1:172.21.15.50:6789/0 conn(0x7fe27c0cddb0 0x7fe27c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55202/0 (socket says 172.21.15.50:55202) 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe27b7fe640 1 --2- 172.21.15.50:0/2432097222 >> v2:172.21.15.117:3300/0 conn(0x7fe27c15cd60 0x7fe27c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 -- 172.21.15.50:0/2432097222 >> v2:172.21.15.117:3300/0 conn(0x7fe27c15cd60 msgr2=0x7fe27c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 --2- 172.21.15.50:0/2432097222 >> v2:172.21.15.117:3300/0 conn(0x7fe27c15cd60 0x7fe27c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 -- 172.21.15.50:0/2432097222 >> v1:172.21.15.50:6789/0 conn(0x7fe27c0cddb0 legacy=0x7fe27c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.931+0000 7fe272ffd640 1 -- 172.21.15.50:0/2432097222 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c161460 con 0x7fe27c0b8430 2023-08-10T10:40:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe272ffd640 1 --2- 172.21.15.50:0/2432097222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cd870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0b24f0 tx=0x7fe26402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2876564840600cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe27affd640 1 -- 172.21.15.50:0/2432097222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402f850 con 0x7fe27c0b8430 2023-08-10T10:40:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe27affd640 1 -- 172.21.15.50:0/2432097222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26402f9b0 con 0x7fe27c0b8430 2023-08-10T10:40:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe27affd640 1 -- 172.21.15.50:0/2432097222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402fd40 con 0x7fe27c0b8430 2023-08-10T10:40:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe281f5d640 1 -- 172.21.15.50:0/2432097222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c0b8430 msgr2=0x7fe27c0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.933+0000 7fe281f5d640 1 --2- 172.21.15.50:0/2432097222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cd870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0b24f0 tx=0x7fe26402ba30 comp rx=0 tx=0).stop 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 -- 172.21.15.50:0/2432097222 shutdown_connections 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 --2- 172.21.15.50:0/2432097222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cd870 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 --2- 172.21.15.50:0/2432097222 >> v2:172.21.15.117:3300/0 conn(0x7fe27c15cd60 0x7fe27c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 -- 172.21.15.50:0/2432097222 >> 172.21.15.50:0/2432097222 conn(0x7fe27c0d2ac0 msgr2=0x7fe27c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 -- 172.21.15.50:0/2432097222 shutdown_connections 2023-08-10T10:40:21.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.934+0000 7fe281f5d640 1 -- 172.21.15.50:0/2432097222 wait complete. 2023-08-10T10:40:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.935+0000 7fe281f5d640 1 Processor -- start 2023-08-10T10:40:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.936+0000 7fe281f5d640 1 -- start start 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe27c0cddb0 0x7fe27c0aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0cd7b0 con 0x7fe27c15cd60 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0a9ea0 con 0x7fe27c0b8430 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe281f5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0aa180 con 0x7fe27c0cddb0 2023-08-10T10:40:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe27bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe27bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54156/0 (socket says 172.21.15.50:54156) 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe27bfff640 1 -- 172.21.15.50:0/3805640156 learned_addr learned my addr 172.21.15.50:0/3805640156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe27b7fe640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.937+0000 7fe272ffd640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe27c0cddb0 0x7fe27c0aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 -- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe27c0cddb0 msgr2=0x7fe27c0aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe27c0cddb0 0x7fe27c0aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 -- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 msgr2=0x7fe27c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 -- 172.21.15.50:0/3805640156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640094d0 con 0x7fe27c15cd60 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27b7fe640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe27bfff640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c780 tx=0x7fe27400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400ce90 con 0x7fe27c15cd60 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27400a640 con 0x7fe27c15cd60 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400a9f0 con 0x7fe27c15cd60 2023-08-10T10:40:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c0aa460 con 0x7fe27c15cd60 2023-08-10T10:40:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.938+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c0cd390 con 0x7fe27c15cd60 2023-08-10T10:40:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.940+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c066390 con 0x7fe27c15cd60 2023-08-10T10:40:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.940+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe27400ab50 con 0x7fe27c15cd60 2023-08-10T10:40:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.941+0000 7fe278ff9640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 0x7fe25c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.942+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe2740886d0 con 0x7fe27c15cd60 2023-08-10T10:40:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.942+0000 7fe27b7fe640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 0x7fe25c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.942+0000 7fe27b7fe640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 0x7fe25c06d110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe26c006fd0 tx=0x7fe26c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:21.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:21.946+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe2740576a0 con 0x7fe27c15cd60 2023-08-10T10:40:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.140+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe27c0ce200 con 0x7fe27c15cd60 2023-08-10T10:40:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.141+0000 7fe278ff9640 1 -- 172.21.15.50:0/3805640156 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe274017090 con 0x7fe27c15cd60 2023-08-10T10:40:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:22.142 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:40:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:40:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:22.143 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:40:22.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 msgr2=0x7fe25c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 0x7fe25c06d110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe26c006fd0 tx=0x7fe26c008040 comp rx=0 tx=0).stop 2023-08-10T10:40:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 msgr2=0x7fe27c159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c780 tx=0x7fe27400cc40 comp rx=0 tx=0).stop 2023-08-10T10:40:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 shutdown_connections 2023-08-10T10:40:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe27c15cd60 0x7fe27c159b80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe27c0cddb0 0x7fe27c0aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe25c06ac50 0x7fe25c06d110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 --2- 172.21.15.50:0/3805640156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe27c0b8430 0x7fe27c0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 >> 172.21.15.50:0/3805640156 conn(0x7fe27c0d2ac0 msgr2=0x7fe27c0b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 shutdown_connections 2023-08-10T10:40:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.144+0000 7fe281f5d640 1 -- 172.21.15.50:0/3805640156 wait complete. 2023-08-10T10:40:22.163 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:40:22.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:40:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.388+0000 7fe7dd87e640 1 Processor -- start 2023-08-10T10:40:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.389+0000 7fe7dd87e640 1 -- start start 2023-08-10T10:40:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.390+0000 7fe7dd87e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d80cf330 0x7fe7d8160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7dd87e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d8072e40 0x7fe7d8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7dd87e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d806a980 con 0x7fe7d815cb50 2023-08-10T10:40:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7dd87e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d806ac60 con 0x7fe7d8072e40 2023-08-10T10:40:22.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7dd87e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80ceb30 con 0x7fe7d80cf330 2023-08-10T10:40:22.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d8072e40 0x7fe7d8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d8072e40 0x7fe7d8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54166/0 (socket says 172.21.15.50:54166) 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 -- 172.21.15.50:0/435661644 learned_addr learned my addr 172.21.15.50:0/435661644 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d67fc640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d80cf330 0x7fe7d8160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 -- 172.21.15.50:0/435661644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d80cf330 msgr2=0x7fe7d8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d80cf330 0x7fe7d8160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.391+0000 7fe7d77fe640 1 -- 172.21.15.50:0/435661644 >> v1:172.21.15.117:6789/0 conn(0x7fe7d815cb50 legacy=0x7fe7d8072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:22.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.392+0000 7fe7d77fe640 1 -- 172.21.15.50:0/435661644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80cee10 con 0x7fe7d8072e40 2023-08-10T10:40:22.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.393+0000 7fe7d77fe640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8072e40 0x7fe7d8160c70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009e50 tx=0x7fe7d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fed8eb30ac9355 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.393+0000 7fe7d5ffb640 1 -- 172.21.15.50:0/435661644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d002ca80 con 0x7fe7d8072e40 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.393+0000 7fe7d5ffb640 1 -- 172.21.15.50:0/435661644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d002cbe0 con 0x7fe7d8072e40 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.393+0000 7fe7d5ffb640 1 -- 172.21.15.50:0/435661644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00343f0 con 0x7fe7d8072e40 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 -- 172.21.15.50:0/435661644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8072e40 msgr2=0x7fe7d8160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8072e40 0x7fe7d8160c70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009e50 tx=0x7fe7d002bee0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 -- 172.21.15.50:0/435661644 shutdown_connections 2023-08-10T10:40:22.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8072e40 0x7fe7d8160c70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/435661644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d80cf330 0x7fe7d8160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 -- 172.21.15.50:0/435661644 >> 172.21.15.50:0/435661644 conn(0x7fe7d80cf780 msgr2=0x7fe7d80cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 -- 172.21.15.50:0/435661644 shutdown_connections 2023-08-10T10:40:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.394+0000 7fe7dd87e640 1 -- 172.21.15.50:0/435661644 wait complete. 2023-08-10T10:40:22.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.396+0000 7fe7dd87e640 1 Processor -- start 2023-08-10T10:40:22.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.396+0000 7fe7dd87e640 1 -- start start 2023-08-10T10:40:22.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d8072e40 0x7fe7d80c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7d815cb50 0x7fe7d8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d815e100 con 0x7fe7d80cf330 2023-08-10T10:40:22.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d815d1a0 con 0x7fe7d815cb50 2023-08-10T10:40:22.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.397+0000 7fe7dd87e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d815d480 con 0x7fe7d8072e40 2023-08-10T10:40:22.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54172/0 (socket says 172.21.15.50:54172) 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 -- 172.21.15.50:0/2945117535 learned_addr learned my addr 172.21.15.50:0/2945117535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d77fe640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7d815cb50 0x7fe7d8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d6ffd640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d8072e40 0x7fe7d80c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 -- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d8072e40 msgr2=0x7fe7d80c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d8072e40 0x7fe7d80c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 -- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7d815cb50 msgr2=0x7fe7d8150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7d815cb50 0x7fe7d8150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 -- 172.21.15.50:0/2945117535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0009b30 con 0x7fe7d80cf330 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.398+0000 7fe7d67fc640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d800 tx=0x7fe7cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.399+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00b6c0 con 0x7fe7d80cf330 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.399+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00b820 con 0x7fe7d80cf330 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.399+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00bbb0 con 0x7fe7d80cf330 2023-08-10T10:40:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.399+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d815d760 con 0x7fe7d80cf330 2023-08-10T10:40:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.399+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d815dd20 con 0x7fe7d80cf330 2023-08-10T10:40:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.400+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d804e270 con 0x7fe7d80cf330 2023-08-10T10:40:22.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.401+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7cc00bd10 con 0x7fe7d80cf330 2023-08-10T10:40:22.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.403+0000 7fe7bffff640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 0x7fe7c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.403+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe7cc089710 con 0x7fe7d80cf330 2023-08-10T10:40:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.403+0000 7fe7d6ffd640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 0x7fe7c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.404+0000 7fe7d6ffd640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 0x7fe7c406d110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.407+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7cc054b00 con 0x7fe7d80cf330 2023-08-10T10:40:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.599+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe7d8069f60 con 0x7fe7d80cf330 2023-08-10T10:40:22.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.753+0000 7fe7bffff640 1 -- 172.21.15.50:0/2945117535 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe7cc058120 con 0x7fe7d80cf330 2023-08-10T10:40:22.755 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:40:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 msgr2=0x7fe7c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 0x7fe7c406d110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8008040 comp rx=0 tx=0).stop 2023-08-10T10:40:22.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 msgr2=0x7fe7d8150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d800 tx=0x7fe7cc00dcc0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 shutdown_connections 2023-08-10T10:40:22.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe7c406ac50 0x7fe7c406d110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7d815cb50 0x7fe7d8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80cf330 0x7fe7d8150860 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 --2- 172.21.15.50:0/2945117535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7d8072e40 0x7fe7d80c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 >> 172.21.15.50:0/2945117535 conn(0x7fe7d80cf780 msgr2=0x7fe7d8072730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:22.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.760+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 shutdown_connections 2023-08-10T10:40:22.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:22.761+0000 7fe7dd87e640 1 -- 172.21.15.50:0/2945117535 wait complete. 2023-08-10T10:40:22.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:40:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.013+0000 7fb771d7f640 1 Processor -- start 2023-08-10T10:40:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.013+0000 7fb771d7f640 1 -- start start 2023-08-10T10:40:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.015+0000 7fb771d7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 0x7fb76c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.015+0000 7fb771d7f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb76c06f3a0 0x7fb76c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.015+0000 7fb771d7f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c161640 con 0x7fb76c0b0cd0 2023-08-10T10:40:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.015+0000 7fb771d7f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c0c1bb0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.015+0000 7fb771d7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0adb30 con 0x7fb76c161260 2023-08-10T10:40:23.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb763fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb76c0b0cd0 0x7fb76c06ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55212/0 (socket says 172.21.15.50:55212) 2023-08-10T10:40:23.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb763fff640 1 -- 172.21.15.50:0/2544751689 learned_addr learned my addr 172.21.15.50:0/2544751689 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:23.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb76bfff640 1 --2- 172.21.15.50:0/2544751689 >> v2:172.21.15.117:3300/0 conn(0x7fb76c06f3a0 0x7fb76c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb76b7fe640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 0x7fb76c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb76affd640 1 -- 172.21.15.50:0/2544751689 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87970505 0 0) 0x7fb76c161640 con 0x7fb76c0b0cd0 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.016+0000 7fb76affd640 1 -- 172.21.15.50:0/2544751689 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb758003520 con 0x7fb76c0b0cd0 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.017+0000 7fb76bfff640 1 -- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 msgr2=0x7fb76c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.017+0000 7fb76bfff640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 0x7fb76c0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.017+0000 7fb76bfff640 1 -- 172.21.15.50:0/2544751689 >> v1:172.21.15.50:6789/0 conn(0x7fb76c0b0cd0 legacy=0x7fb76c06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.017+0000 7fb76bfff640 1 -- 172.21.15.50:0/2544751689 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0ade10 con 0x7fb76c06f3a0 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.017+0000 7fb76b7fe640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 0x7fb76c0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:40:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.018+0000 7fb76bfff640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c06f3a0 0x7fb76c0696a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb764009d90 tx=0x7fb76402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa70a8c80af2f4d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.019+0000 7fb76affd640 1 -- 172.21.15.50:0/2544751689 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76402cbd0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.019+0000 7fb76affd640 1 -- 172.21.15.50:0/2544751689 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76402cd30 con 0x7fb76c06f3a0 2023-08-10T10:40:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.019+0000 7fb76affd640 1 -- 172.21.15.50:0/2544751689 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76402cea0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 -- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c06f3a0 msgr2=0x7fb76c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c06f3a0 0x7fb76c0696a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb764009d90 tx=0x7fb76402be20 comp rx=0 tx=0).stop 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 -- 172.21.15.50:0/2544751689 shutdown_connections 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c06f3a0 0x7fb76c0696a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 --2- 172.21.15.50:0/2544751689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c161260 0x7fb76c0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 -- 172.21.15.50:0/2544751689 >> 172.21.15.50:0/2544751689 conn(0x7fb76c0b01b0 msgr2=0x7fb76c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 -- 172.21.15.50:0/2544751689 shutdown_connections 2023-08-10T10:40:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.020+0000 7fb771d7f640 1 -- 172.21.15.50:0/2544751689 wait complete. 2023-08-10T10:40:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.022+0000 7fb771d7f640 1 Processor -- start 2023-08-10T10:40:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.023+0000 7fb771d7f640 1 -- start start 2023-08-10T10:40:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c0b0cd0 0x7fb76c1e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c161260 0x7fb76c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1e9c50 con 0x7fb76c06f3a0 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c15e200 con 0x7fb76c161260 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb771d7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1ea960 con 0x7fb76c0b0cd0 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb76b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb76b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54178/0 (socket says 172.21.15.50:54178) 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.024+0000 7fb76b7fe640 1 -- 172.21.15.50:0/392875989 learned_addr learned my addr 172.21.15.50:0/392875989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76bfff640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c161260 0x7fb76c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb763fff640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c0b0cd0 0x7fb76c1e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 -- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c0b0cd0 msgr2=0x7fb76c1e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c0b0cd0 0x7fb76c1e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 -- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c161260 msgr2=0x7fb76c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c161260 0x7fb76c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 -- 172.21.15.50:0/392875989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009400 con 0x7fb76c06f3a0 2023-08-10T10:40:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.025+0000 7fb76b7fe640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e960 tx=0x7fb75c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.026+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00ca00 con 0x7fb76c06f3a0 2023-08-10T10:40:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.026+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c00cb60 con 0x7fb76c06f3a0 2023-08-10T10:40:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.026+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb764009a70 con 0x7fb76c06f3a0 2023-08-10T10:40:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.026+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c013470 con 0x7fb76c06f3a0 2023-08-10T10:40:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.026+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c1eaf20 con 0x7fb76c06f3a0 2023-08-10T10:40:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.027+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c0612b0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.029+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb75c0135d0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.030+0000 7fb768ff9640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 0x7fb74c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:23.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.030+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb75c089df0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.031+0000 7fb763fff640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 0x7fb74c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.031+0000 7fb763fff640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 0x7fb74c06d140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0b4480 tx=0x7fb754009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.036+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb75c054fe0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.231+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb76c0ad8c0 con 0x7fb76c06f3a0 2023-08-10T10:40:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.764+0000 7fb768ff9640 1 -- 172.21.15.50:0/392875989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb75c058600 con 0x7fb76c06f3a0 2023-08-10T10:40:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:40:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.777+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 msgr2=0x7fb74c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.777+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 0x7fb74c06d140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0b4480 tx=0x7fb754009040 comp rx=0 tx=0).stop 2023-08-10T10:40:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.777+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 msgr2=0x7fb76c1ea260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.777+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e960 tx=0x7fb75c00ee20 comp rx=0 tx=0).stop 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 shutdown_connections 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb74c06ac80 0x7fb74c06d140 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76c161260 0x7fb76c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb76c0b0cd0 0x7fb76c1e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 --2- 172.21.15.50:0/392875989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb76c06f3a0 0x7fb76c1ea260 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.780+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 >> 172.21.15.50:0/392875989 conn(0x7fb76c0b01b0 msgr2=0x7fb76c0aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.782+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 shutdown_connections 2023-08-10T10:40:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:23.783+0000 7fb771d7f640 1 -- 172.21.15.50:0/392875989 wait complete. 2023-08-10T10:40:23.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:40:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.008+0000 7fa594e93640 1 Processor -- start 2023-08-10T10:40:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.009+0000 7fa594e93640 1 -- start start 2023-08-10T10:40:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.010+0000 7fa594e93640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5901583c0 0x7fa5900b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.010+0000 7fa594e93640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa590069db0 0x7fa59015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.010+0000 7fa594e93640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59015aee0 con 0x7fa5900b1ba0 2023-08-10T10:40:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.010+0000 7fa594e93640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5900b2100 con 0x7fa590069db0 2023-08-10T10:40:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.010+0000 7fa594e93640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59015b1a0 con 0x7fa5901583c0 2023-08-10T10:40:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa590069db0 0x7fa59015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa587fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5900b1ba0 0x7fa5900696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55222/0 (socket says 172.21.15.50:55222) 2023-08-10T10:40:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa590069db0 0x7fa59015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54180/0 (socket says 172.21.15.50:54180) 2023-08-10T10:40:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa587fff640 1 -- 172.21.15.50:0/1569956461 learned_addr learned my addr 172.21.15.50:0/1569956461 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58f7fe640 1 --2- 172.21.15.50:0/1569956461 >> v2:172.21.15.117:3300/0 conn(0x7fa5901583c0 0x7fa5900b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 -- 172.21.15.50:0/1569956461 >> v2:172.21.15.117:3300/0 conn(0x7fa5901583c0 msgr2=0x7fa5900b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 --2- 172.21.15.50:0/1569956461 >> v2:172.21.15.117:3300/0 conn(0x7fa5901583c0 0x7fa5900b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 -- 172.21.15.50:0/1569956461 >> v1:172.21.15.50:6789/0 conn(0x7fa5900b1ba0 legacy=0x7fa5900696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58effd640 1 -- 172.21.15.50:0/1569956461 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112757697 0 0) 0x7fa59015aee0 con 0x7fa5900b1ba0 2023-08-10T10:40:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.011+0000 7fa58ffff640 1 -- 172.21.15.50:0/1569956461 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59015b480 con 0x7fa590069db0 2023-08-10T10:40:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.013+0000 7fa58ffff640 1 --2- 172.21.15.50:0/1569956461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa590069db0 0x7fa59015e4d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa5900b1080 tx=0x7fa58802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f399b34214c1ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.013+0000 7fa58effd640 1 -- 172.21.15.50:0/1569956461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58802cc80 con 0x7fa590069db0 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.013+0000 7fa58effd640 1 -- 172.21.15.50:0/1569956461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58802cde0 con 0x7fa590069db0 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.013+0000 7fa58effd640 1 -- 172.21.15.50:0/1569956461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588034660 con 0x7fa590069db0 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 -- 172.21.15.50:0/1569956461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa590069db0 msgr2=0x7fa59015e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 --2- 172.21.15.50:0/1569956461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa590069db0 0x7fa59015e4d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa5900b1080 tx=0x7fa58802bed0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 -- 172.21.15.50:0/1569956461 shutdown_connections 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 --2- 172.21.15.50:0/1569956461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa590069db0 0x7fa59015e4d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 --2- 172.21.15.50:0/1569956461 >> v2:172.21.15.117:3300/0 conn(0x7fa5901583c0 0x7fa5900b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 -- 172.21.15.50:0/1569956461 >> 172.21.15.50:0/1569956461 conn(0x7fa5900caf80 msgr2=0x7fa5900cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 -- 172.21.15.50:0/1569956461 shutdown_connections 2023-08-10T10:40:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.014+0000 7fa594e93640 1 -- 172.21.15.50:0/1569956461 wait complete. 2023-08-10T10:40:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.016+0000 7fa594e93640 1 Processor -- start 2023-08-10T10:40:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.016+0000 7fa594e93640 1 -- start start 2023-08-10T10:40:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa590069db0 0x7fa590152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 0x7fa5900c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900c4570 con 0x7fa5900b1ba0 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900ce0f0 con 0x7fa5901583c0 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa594e93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900c31f0 con 0x7fa590069db0 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54188/0 (socket says 172.21.15.50:54188) 2023-08-10T10:40:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 -- 172.21.15.50:0/2077915075 learned_addr learned my addr 172.21.15.50:0/2077915075 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa58ffff640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 0x7fa5900c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 -- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa590069db0 msgr2=0x7fa590152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa590069db0 0x7fa590152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 -- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 msgr2=0x7fa5900c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.017+0000 7fa587fff640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 0x7fa5900c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa587fff640 1 -- 172.21.15.50:0/2077915075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588009a70 con 0x7fa5900b1ba0 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa58ffff640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 0x7fa5900c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa587fff640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa57800c4b0 tx=0x7fa57800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780074e0 con 0x7fa5900b1ba0 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578007660 con 0x7fa5900b1ba0 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578004a20 con 0x7fa5900b1ba0 2023-08-10T10:40:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5900c4810 con 0x7fa5900b1ba0 2023-08-10T10:40:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.018+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5900c4dd0 con 0x7fa5900b1ba0 2023-08-10T10:40:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.020+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590066e30 con 0x7fa5900b1ba0 2023-08-10T10:40:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.021+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa578004b80 con 0x7fa5900b1ba0 2023-08-10T10:40:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.022+0000 7fa58cff9640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 0x7fa57006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.022+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa578088670 con 0x7fa5900b1ba0 2023-08-10T10:40:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.022+0000 7fa58f7fe640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 0x7fa57006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.023+0000 7fa58f7fe640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 0x7fa57006d110 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5900c7910 tx=0x7fa580008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.029+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa578053830 con 0x7fa5900b1ba0 2023-08-10T10:40:24.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.260+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa5900adb20 con 0x7fa5900b1ba0 2023-08-10T10:40:24.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.807+0000 7fa58cff9640 1 -- 172.21.15.50:0/2077915075 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa578056e50 con 0x7fa5900b1ba0 2023-08-10T10:40:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 7 and data pool 8 2023-08-10T10:40:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.827+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 msgr2=0x7fa57006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 0x7fa57006d110 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5900c7910 tx=0x7fa580008040 comp rx=0 tx=0).stop 2023-08-10T10:40:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 msgr2=0x7fa5900c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa57800c4b0 tx=0x7fa57800c970 comp rx=0 tx=0).stop 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 shutdown_connections 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa57006ac50 0x7fa57006d110 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5901583c0 0x7fa5900c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5900b1ba0 0x7fa5900c2030 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.828+0000 7fa594e93640 1 --2- 172.21.15.50:0/2077915075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa590069db0 0x7fa590152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.829+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 >> 172.21.15.50:0/2077915075 conn(0x7fa5900caf80 msgr2=0x7fa5900696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.829+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 shutdown_connections 2023-08-10T10:40:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:24.829+0000 7fa594e93640 1 -- 172.21.15.50:0/2077915075 wait complete. 2023-08-10T10:40:24.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.043+0000 7f311180f640 1 Processor -- start 2023-08-10T10:40:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.043+0000 7f311180f640 1 -- start start 2023-08-10T10:40:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.044+0000 7f311180f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311180f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f310c0c9d00 0x7f310c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311180f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310c0cc5a0 con 0x7f310c15e0f0 2023-08-10T10:40:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311180f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c0b4170 con 0x7f310c0c9d00 2023-08-10T10:40:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311180f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c15d720 con 0x7f310c159830 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311080d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311080d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:59372/0 (socket says 172.21.15.50:59372) 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f311080d640 1 -- 172.21.15.50:0/1862872441 learned_addr learned my addr 172.21.15.50:0/1862872441 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.045+0000 7f3103fff640 1 --2- 172.21.15.50:0/1862872441 >> v2:172.21.15.117:3300/0 conn(0x7f310c0c9d00 0x7f310c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.046+0000 7f311080d640 1 -- 172.21.15.50:0/1862872441 >> v2:172.21.15.117:3300/0 conn(0x7f310c0c9d00 msgr2=0x7f310c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.046+0000 7f311080d640 1 --2- 172.21.15.50:0/1862872441 >> v2:172.21.15.117:3300/0 conn(0x7f310c0c9d00 0x7f310c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.046+0000 7f311080d640 1 -- 172.21.15.50:0/1862872441 >> v1:172.21.15.117:6789/0 conn(0x7f310c15e0f0 legacy=0x7f310c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.046+0000 7f311080d640 1 -- 172.21.15.50:0/1862872441 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c159c10 con 0x7f310c159830 2023-08-10T10:40:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.047+0000 7f311080d640 1 --2- 172.21.15.50:0/1862872441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3108009e50 tx=0x7f310802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cca307ba9595e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.048+0000 7f31037fe640 1 -- 172.21.15.50:0/1862872441 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310802cb00 con 0x7f310c159830 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.048+0000 7f31037fe640 1 -- 172.21.15.50:0/1862872441 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310802cc60 con 0x7f310c159830 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.048+0000 7f31037fe640 1 -- 172.21.15.50:0/1862872441 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080343f0 con 0x7f310c159830 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 -- 172.21.15.50:0/1862872441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 msgr2=0x7f310c0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 --2- 172.21.15.50:0/1862872441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3108009e50 tx=0x7f310802bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 -- 172.21.15.50:0/1862872441 shutdown_connections 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 --2- 172.21.15.50:0/1862872441 >> v2:172.21.15.117:3300/0 conn(0x7f310c0c9d00 0x7f310c15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 --2- 172.21.15.50:0/1862872441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c159830 0x7f310c0cc060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 -- 172.21.15.50:0/1862872441 >> 172.21.15.50:0/1862872441 conn(0x7f310c06ab80 msgr2=0x7f310c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 -- 172.21.15.50:0/1862872441 shutdown_connections 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.049+0000 7f311180f640 1 -- 172.21.15.50:0/1862872441 wait complete. 2023-08-10T10:40:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.051+0000 7f311180f640 1 Processor -- start 2023-08-10T10:40:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.052+0000 7f311180f640 1 -- start start 2023-08-10T10:40:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310c0c9d00 0x7f310c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c1360d0 0x7f310c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c1391e0 con 0x7f310c159830 2023-08-10T10:40:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c06ff70 con 0x7f310c0c9d00 2023-08-10T10:40:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311180f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0c39a0 con 0x7f310c1360d0 2023-08-10T10:40:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f3103fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f3103fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59568/0 (socket says 172.21.15.50:59568) 2023-08-10T10:40:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f3103fff640 1 -- 172.21.15.50:0/3683281982 learned_addr learned my addr 172.21.15.50:0/3683281982 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.053+0000 7f311080d640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310c0c9d00 0x7f310c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f311100e640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c1360d0 0x7f310c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 -- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c1360d0 msgr2=0x7f310c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c1360d0 0x7f310c070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 -- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310c0c9d00 msgr2=0x7f310c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310c0c9d00 0x7f310c0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 -- 172.21.15.50:0/3683281982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009b30 con 0x7f310c159830 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f3103fff640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00e870 tx=0x7f30fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0094f0 con 0x7f310c159830 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00c940 con 0x7f310c159830 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00ccf0 con 0x7f310c159830 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.054+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c0701c0 con 0x7f310c159830 2023-08-10T10:40:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.055+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c070780 con 0x7f310c159830 2023-08-10T10:40:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.056+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c0b1860 con 0x7f310c159830 2023-08-10T10:40:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.057+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30fc013470 con 0x7f310c159830 2023-08-10T10:40:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.058+0000 7f31017fa640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 0x7f30f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.058+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30fc089600 con 0x7f310c159830 2023-08-10T10:40:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.059+0000 7f311080d640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 0x7f30f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.059+0000 7f311080d640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 0x7f30f806d110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3108035000 tx=0x7f3108030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.063+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f30fc0546a0 con 0x7f310c159830 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.254+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310c066e30 con 0x7f310c159830 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.258+0000 7f31017fa640 1 -- 172.21.15.50:0/3683281982 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f30fc057cc0 con 0x7f310c159830 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:24.262045+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 msgr2=0x7f30f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 0x7f30f806d110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3108035000 tx=0x7f3108030000 comp rx=0 tx=0).stop 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 msgr2=0x7f310c0c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00e870 tx=0x7f30fc00ed30 comp rx=0 tx=0).stop 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 shutdown_connections 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f310c1360d0 0x7f310c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f310c159830 0x7f310c0c3000 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30f806ac50 0x7f30f806d110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 --2- 172.21.15.50:0/3683281982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310c0c9d00 0x7f310c0b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 >> 172.21.15.50:0/3683281982 conn(0x7f310c06ab80 msgr2=0x7f310c0af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 shutdown_connections 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.262+0000 7f311180f640 1 -- 172.21.15.50:0/3683281982 wait complete. 2023-08-10T10:40:25.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.498+0000 7f8402739640 1 Processor -- start 2023-08-10T10:40:25.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.498+0000 7f8402739640 1 -- start start 2023-08-10T10:40:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f8402739640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 0x7f83fc160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f8402739640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83fc0b8430 0x7f83fc0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f8402739640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0ce200 con 0x7f83fc0cddb0 2023-08-10T10:40:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f8402739640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0b5bd0 con 0x7f83fc0b8430 2023-08-10T10:40:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f8402739640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc161180 con 0x7f83fc15cd60 2023-08-10T10:40:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f83fb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83fc0b8430 0x7f83fc0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f83fb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83fc0b8430 0x7f83fc0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59584/0 (socket says 172.21.15.50:59584) 2023-08-10T10:40:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.500+0000 7f83fb7fe640 1 -- 172.21.15.50:0/433575981 learned_addr learned my addr 172.21.15.50:0/433575981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fbfff640 1 --2- 172.21.15.50:0/433575981 >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 0x7f83fc160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fb7fe640 1 -- 172.21.15.50:0/433575981 >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 msgr2=0x7f83fc160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fb7fe640 1 --2- 172.21.15.50:0/433575981 >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 0x7f83fc160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fb7fe640 1 -- 172.21.15.50:0/433575981 >> v1:172.21.15.117:6789/0 conn(0x7f83fc0cddb0 legacy=0x7f83fc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fb7fe640 1 -- 172.21.15.50:0/433575981 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc161460 con 0x7f83fc0b8430 2023-08-10T10:40:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.501+0000 7f83fbfff640 1 --2- 172.21.15.50:0/433575981 >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 0x7f83fc160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:40:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.502+0000 7f83fb7fe640 1 --2- 172.21.15.50:0/433575981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0b8430 0x7f83fc0cd870 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0b24f0 tx=0x7f83e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58df3e85edbe640 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.503+0000 7f83faffd640 1 -- 172.21.15.50:0/433575981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4030860 con 0x7f83fc0b8430 2023-08-10T10:40:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.503+0000 7f83faffd640 1 -- 172.21.15.50:0/433575981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e40309c0 con 0x7f83fc0b8430 2023-08-10T10:40:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.503+0000 7f83faffd640 1 -- 172.21.15.50:0/433575981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4030d50 con 0x7f83fc0b8430 2023-08-10T10:40:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 -- 172.21.15.50:0/433575981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0b8430 msgr2=0x7f83fc0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 --2- 172.21.15.50:0/433575981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0b8430 0x7f83fc0cd870 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0b24f0 tx=0x7f83e402b9a0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 -- 172.21.15.50:0/433575981 shutdown_connections 2023-08-10T10:40:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 --2- 172.21.15.50:0/433575981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0b8430 0x7f83fc0cd870 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 --2- 172.21.15.50:0/433575981 >> v2:172.21.15.117:3300/0 conn(0x7f83fc15cd60 0x7f83fc160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 -- 172.21.15.50:0/433575981 >> 172.21.15.50:0/433575981 conn(0x7f83fc0d2ac0 msgr2=0x7f83fc0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 -- 172.21.15.50:0/433575981 shutdown_connections 2023-08-10T10:40:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.504+0000 7f8402739640 1 -- 172.21.15.50:0/433575981 wait complete. 2023-08-10T10:40:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.506+0000 7f8402739640 1 Processor -- start 2023-08-10T10:40:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.506+0000 7f8402739640 1 -- start start 2023-08-10T10:40:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83fc0b8430 0x7f83fc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83fc15cd60 0x7f83fc0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1f42b0 con 0x7f83fc0cddb0 2023-08-10T10:40:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1f3c10 con 0x7f83fc0b8430 2023-08-10T10:40:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.507+0000 7f8402739640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1f3670 con 0x7f83fc15cd60 2023-08-10T10:40:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59600/0 (socket says 172.21.15.50:59600) 2023-08-10T10:40:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 -- 172.21.15.50:0/2761450680 learned_addr learned my addr 172.21.15.50:0/2761450680 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fbfff640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83fc0b8430 0x7f83fc0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f8400cd6640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83fc15cd60 0x7f83fc0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 -- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83fc15cd60 msgr2=0x7f83fc0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83fc15cd60 0x7f83fc0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 -- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83fc0b8430 msgr2=0x7f83fc0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83fc0b8430 0x7f83fc0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.508+0000 7f83fb7fe640 1 -- 172.21.15.50:0/2761450680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40094d0 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f83fb7fe640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f83e4000c00 tx=0x7f83e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4039c90 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4039df0 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc1f3ed0 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4043620 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.509+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc1f28d0 con 0x7f83fc0cddb0 2023-08-10T10:40:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.510+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc04e270 con 0x7f83fc0cddb0 2023-08-10T10:40:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.511+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83e4043780 con 0x7f83fc0cddb0 2023-08-10T10:40:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.512+0000 7f83f8ff9640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 0x7f83dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.513+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83e403e070 con 0x7f83fc0cddb0 2023-08-10T10:40:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.513+0000 7f83fbfff640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 0x7f83dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.513+0000 7f83fbfff640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 0x7f83dc06d110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83ec003fd0 tx=0x7f83ec003ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.517+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f83e4077690 con 0x7f83fc0cddb0 2023-08-10T10:40:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.717+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83fc0ce200 con 0x7f83fc0cddb0 2023-08-10T10:40:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.720+0000 7f83f8ff9640 1 -- 172.21.15.50:0/2761450680 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f83fc0ce200 con 0x7f83fc0cddb0 2023-08-10T10:40:25.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:25.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:24.262045+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 msgr2=0x7f83dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 0x7f83dc06d110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83ec003fd0 tx=0x7f83ec003ce0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 msgr2=0x7f83fc0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f83e4000c00 tx=0x7f83e4004730 comp rx=0 tx=0).stop 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 shutdown_connections 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83fc15cd60 0x7f83fc0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83fc0cddb0 0x7f83fc0b2c30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f83dc06ac50 0x7f83dc06d110 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 --2- 172.21.15.50:0/2761450680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83fc0b8430 0x7f83fc0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 >> 172.21.15.50:0/2761450680 conn(0x7f83fc0d2ac0 msgr2=0x7f83fc0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 shutdown_connections 2023-08-10T10:40:25.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.723+0000 7f8402739640 1 -- 172.21.15.50:0/2761450680 wait complete. 2023-08-10T10:40:25.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:40:25.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.961+0000 7f1a94256640 1 Processor -- start 2023-08-10T10:40:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.961+0000 7f1a94256640 1 -- start start 2023-08-10T10:40:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.962+0000 7f1a94256640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a8c15ce10 0x7f1a8c0d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.962+0000 7f1a94256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a8c0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.962+0000 7f1a94256640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c0d0640 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a94256640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c15d1f0 con 0x7f1a8c15ce10 2023-08-10T10:40:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a94256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b8870 con 0x7f1a8c0b8390 2023-08-10T10:40:25.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a927f3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1a8c0cdfc0 0x7f1a8c0d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38996/0 (socket says 172.21.15.50:38996) 2023-08-10T10:40:25.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a927f3640 1 -- 172.21.15.50:0/3689563205 learned_addr learned my addr 172.21.15.50:0/3689563205 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a91ff2640 1 --2- 172.21.15.50:0/3689563205 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c15ce10 0x7f1a8c0d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.963+0000 7f1a917f1640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a8c0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437931032 0 0) 0x7f1a8c0d0640 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a78003520 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3255104371 0 0) 0x7f1a78003520 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 msgr2=0x7f1a8c0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a8c0cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c15ce10 msgr2=0x7f1a8c0d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 --2- 172.21.15.50:0/3689563205 >> v2:172.21.15.117:3300/0 conn(0x7f1a8c15ce10 0x7f1a8c0d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0d0890 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1a840019f0 con 0x7f1a8c0cdfc0 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 >> v1:172.21.15.50:6789/0 conn(0x7f1a8c0cdfc0 legacy=0x7f1a8c0d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004d00 0x7f1a78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15d1f0 con 0x7f1a78004d00 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b8870 con 0x7f1a78003970 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7800b980 con 0x7f1a8c0b8390 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.964+0000 7f1a927f3640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004d00 0x7f1a78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a917f1640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a927f3640 1 -- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 msgr2=0x7f1a780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a927f3640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a927f3640 1 -- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 msgr2=0x7f1a78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a927f3640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a78003970 0x7f1a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a927f3640 1 -- 172.21.15.50:0/3689563205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78003520 con 0x7f1a78004d00 2023-08-10T10:40:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.965+0000 7f1a917f1640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a8c0b8390 0x7f1a780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.966+0000 7f1a927f3640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004d00 0x7f1a78005180 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c08bde0 tx=0x7f1a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820050913d53cdce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.966+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84034630 con 0x7f1a78004d00 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.966+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8402f070 con 0x7f1a78004d00 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.966+0000 7f1a90ff0640 1 -- 172.21.15.50:0/3689563205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840349f0 con 0x7f1a78004d00 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 -- 172.21.15.50:0/3689563205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004d00 msgr2=0x7f1a78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 --2- 172.21.15.50:0/3689563205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a78004d00 0x7f1a78005180 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c08bde0 tx=0x7f1a780057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a927f3640 1 -- 172.21.15.50:0/3689563205 reap_dead start 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 -- 172.21.15.50:0/3689563205 shutdown_connections 2023-08-10T10:40:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 -- 172.21.15.50:0/3689563205 >> 172.21.15.50:0/3689563205 conn(0x7f1a8c06fcc0 msgr2=0x7f1a8c0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 -- 172.21.15.50:0/3689563205 shutdown_connections 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.967+0000 7f1a94256640 1 -- 172.21.15.50:0/3689563205 wait complete. 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.969+0000 7f1a94256640 1 Processor -- start 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.969+0000 7f1a94256640 1 -- start start 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a78004d00 0x7f1a8c1f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c1570e0 0x7f1a8c0a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1539f0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0aaa30 con 0x7f1a8c1570e0 2023-08-10T10:40:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a94256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15e820 con 0x7f1a78004d00 2023-08-10T10:40:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a927f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a927f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59614/0 (socket says 172.21.15.50:59614) 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.970+0000 7f1a927f3640 1 -- 172.21.15.50:0/489887959 learned_addr learned my addr 172.21.15.50:0/489887959 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a91ff2640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a78004d00 0x7f1a8c1f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a917f1640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c1570e0 0x7f1a8c0a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 -- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a78004d00 msgr2=0x7f1a8c1f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a78004d00 0x7f1a8c1f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 -- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c1570e0 msgr2=0x7f1a8c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c1570e0 0x7f1a8c0a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 -- 172.21.15.50:0/489887959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c15eb00 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a927f3640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1a8402cb40 tx=0x7f1a84001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84001fd0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84034640 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840349b0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.971+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c15ede0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.972+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c1f21a0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.973+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c15efd0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.974+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a84031030 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.975+0000 7f1a827fc640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 0x7f1a7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.975+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a840ab810 con 0x7f1a8c0aa4b0 2023-08-10T10:40:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.975+0000 7f1a91ff2640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 0x7f1a7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.976+0000 7f1a91ff2640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 0x7f1a7006d110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a88004770 tx=0x7f1a88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:25.979+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a8407a470 con 0x7f1a8c0aa4b0 2023-08-10T10:40:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.217+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1a8c15efd0 con 0x7f1a8c0aa4b0 2023-08-10T10:40:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.863+0000 7f1a827fc640 1 -- 172.21.15.50:0/489887959 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a8403e350 con 0x7f1a8c0aa4b0 2023-08-10T10:40:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 msgr2=0x7f1a7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 0x7f1a7006d110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a88004770 tx=0x7f1a88008040 comp rx=0 tx=0).stop 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 msgr2=0x7f1a8c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1a8402cb40 tx=0x7f1a84001d80 comp rx=0 tx=0).stop 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 shutdown_connections 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a8c0aa4b0 0x7f1a8c0b24f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7006ac50 0x7f1a7006d110 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a8c1570e0 0x7f1a8c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 --2- 172.21.15.50:0/489887959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a78004d00 0x7f1a8c1f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 >> 172.21.15.50:0/489887959 conn(0x7f1a8c06fcc0 msgr2=0x7f1a8c0d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 shutdown_connections 2023-08-10T10:40:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:26.867+0000 7f1a94256640 1 -- 172.21.15.50:0/489887959 wait complete. 2023-08-10T10:40:26.889 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:40:26.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:40:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.149+0000 7f5399e2d640 1 Processor -- start 2023-08-10T10:40:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.149+0000 7f5399e2d640 1 -- start start 2023-08-10T10:40:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5399e2d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53940c9d20 0x7f539406a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5399e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f539406ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5399e2d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940ade50 con 0x7f53940ada70 2023-08-10T10:40:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5399e2d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5394159750 con 0x7f53940c9d20 2023-08-10T10:40:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5399e2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53940ca220 con 0x7f539406fba0 2023-08-10T10:40:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f53937fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f53940ada70 0x7f539406f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39004/0 (socket says 172.21.15.50:39004) 2023-08-10T10:40:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f53937fe640 1 -- 172.21.15.50:0/1120313617 learned_addr learned my addr 172.21.15.50:0/1120313617 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.151+0000 7f5393fff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f539406ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f538bfff640 1 --2- 172.21.15.50:0/1120313617 >> v2:172.21.15.117:3300/0 conn(0x7f53940c9d20 0x7f539406a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846553759 0 0) 0x7f53940ade50 con 0x7f53940ada70 2023-08-10T10:40:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5380003520 con 0x7f53940ada70 2023-08-10T10:40:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2765342768 0 0) 0x7f5380003520 con 0x7f53940ada70 2023-08-10T10:40:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 msgr2=0x7f539406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f539406ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 >> v2:172.21.15.117:3300/0 conn(0x7f53940c9d20 msgr2=0x7f539406a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 --2- 172.21.15.50:0/1120313617 >> v2:172.21.15.117:3300/0 conn(0x7f53940c9d20 0x7f539406a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940ca500 con 0x7f53940ada70 2023-08-10T10:40:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5384001670 con 0x7f53940ada70 2023-08-10T10:40:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 >> v1:172.21.15.50:6789/0 conn(0x7f53940ada70 legacy=0x7f539406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380003970 0x7f5380003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f53800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5380004d00 0x7f5380005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394159750 con 0x7f5380004d00 2023-08-10T10:40:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940ca220 con 0x7f5380003970 2023-08-10T10:40:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.152+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538000db90 con 0x7f539406fba0 2023-08-10T10:40:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5380004d00 0x7f5380005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f538bfff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f53800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f53937fe640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380003970 0x7f5380003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 -- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 msgr2=0x7f53800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539406fba0 0x7f53800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 -- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380003970 msgr2=0x7f5380003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380003970 0x7f5380003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f5393fff640 1 -- 172.21.15.50:0/1120313617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380003520 con 0x7f5380004d00 2023-08-10T10:40:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.153+0000 7f53937fe640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380003970 0x7f5380003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.154+0000 7f5393fff640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5380004d00 0x7f5380005180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f538c009fc0 tx=0x7f53800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bf55af882942d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c02cc20 con 0x7f5380004d00 2023-08-10T10:40:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c00f040 con 0x7f5380004d00 2023-08-10T10:40:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5392ffd640 1 -- 172.21.15.50:0/1120313617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c034440 con 0x7f5380004d00 2023-08-10T10:40:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 -- 172.21.15.50:0/1120313617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5380004d00 msgr2=0x7f5380005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 --2- 172.21.15.50:0/1120313617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5380004d00 0x7f5380005180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f538c009fc0 tx=0x7f53800057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5393fff640 1 -- 172.21.15.50:0/1120313617 reap_dead start 2023-08-10T10:40:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 -- 172.21.15.50:0/1120313617 shutdown_connections 2023-08-10T10:40:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 -- 172.21.15.50:0/1120313617 >> 172.21.15.50:0/1120313617 conn(0x7f53940b01b0 msgr2=0x7f53940b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 -- 172.21.15.50:0/1120313617 shutdown_connections 2023-08-10T10:40:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.155+0000 7f5399e2d640 1 -- 172.21.15.50:0/1120313617 wait complete. 2023-08-10T10:40:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.157+0000 7f5399e2d640 1 Processor -- start 2023-08-10T10:40:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.157+0000 7f5399e2d640 1 -- start start 2023-08-10T10:40:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 0x7f53940b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5394155780 0x7f53940c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940ace80 con 0x7f53940c45e0 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940c4a40 con 0x7f5380004d00 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.158+0000 7f5399e2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5394156f50 con 0x7f5394155780 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59628/0 (socket says 172.21.15.50:59628) 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 -- 172.21.15.50:0/3947828574 learned_addr learned my addr 172.21.15.50:0/3947828574 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 -- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5394155780 msgr2=0x7f53940c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5394155780 0x7f53940c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 -- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 msgr2=0x7f53940b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f53937fe640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 0x7f53940b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 0x7f53940b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f5393fff640 1 -- 172.21.15.50:0/3947828574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394156340 con 0x7f53940c45e0 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.159+0000 7f53937fe640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 0x7f53940b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5393fff640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e230 tx=0x7f538c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:27.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c02cea0 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c034ad0 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c034e80 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394156620 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.160+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5394156be0 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.162+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5394157100 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.163+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f538c047460 con 0x7f53940c45e0 2023-08-10T10:40:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.164+0000 7f5390ff9640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 0x7f537406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.164+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f538c0aafe0 con 0x7f53940c45e0 2023-08-10T10:40:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.165+0000 7f53937fe640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 0x7f537406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.165+0000 7f53937fe640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 0x7f537406d140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53840017a0 tx=0x7f5384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.169+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5394157100 con 0x7f53940c45e0 2023-08-10T10:40:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.396+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5394069d60 con 0x7f53940c45e0 2023-08-10T10:40:27.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.867+0000 7f5390ff9640 1 -- 172.21.15.50:0/3947828574 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f538c0760a0 con 0x7f53940c45e0 2023-08-10T10:40:27.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.870+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 msgr2=0x7f537406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.870+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 0x7f537406d140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53840017a0 tx=0x7f5384009040 comp rx=0 tx=0).stop 2023-08-10T10:40:27.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.870+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 msgr2=0x7f53940c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:27.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.870+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e230 tx=0x7f538c009750 comp rx=0 tx=0).stop 2023-08-10T10:40:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 shutdown_connections 2023-08-10T10:40:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53940c45e0 0x7f53940c5790 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5394155780 0x7f53940c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f537406ac80 0x7f537406d140 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 --2- 172.21.15.50:0/3947828574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5380004d00 0x7f53940b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 >> 172.21.15.50:0/3947828574 conn(0x7f53940b01b0 msgr2=0x7f53940af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 shutdown_connections 2023-08-10T10:40:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:27.871+0000 7f5399e2d640 1 -- 172.21.15.50:0/3947828574 wait complete. 2023-08-10T10:40:27.896 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:40:27.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.126+0000 7f3a416b8640 1 Processor -- start 2023-08-10T10:40:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.127+0000 7f3a416b8640 1 -- start start 2023-08-10T10:40:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.128+0000 7f3a416b8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a3c0b8430 0x7f3a3c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.128+0000 7f3a416b8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3c0ce200 con 0x7f3a3c15cd60 2023-08-10T10:40:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.128+0000 7f3a416b8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3c161180 con 0x7f3a3c0cddb0 2023-08-10T10:40:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.128+0000 7f3a416b8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b5bd0 con 0x7f3a3c0b8430 2023-08-10T10:40:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a3c15cd60 0x7f3a3c160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39008/0 (socket says 172.21.15.50:39008) 2023-08-10T10:40:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3affd640 1 -- 172.21.15.50:0/3457779408 learned_addr learned my addr 172.21.15.50:0/3457779408 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3a7fc640 1 --2- 172.21.15.50:0/3457779408 >> v2:172.21.15.50:3300/0 conn(0x7f3a3c0b8430 0x7f3a3c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a39ffb640 1 -- 172.21.15.50:0/3457779408 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899891248 0 0) 0x7f3a2c001490 con 0x7f3a3c15cd60 2023-08-10T10:40:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3a7fc640 1 -- 172.21.15.50:0/3457779408 >> v1:172.21.15.117:6789/0 conn(0x7f3a3c0cddb0 legacy=0x7f3a3c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3a7fc640 1 -- 172.21.15.50:0/3457779408 >> v1:172.21.15.50:6789/0 conn(0x7f3a3c15cd60 legacy=0x7f3a3c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.129+0000 7f3a3a7fc640 1 -- 172.21.15.50:0/3457779408 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c161460 con 0x7f3a3c0b8430 2023-08-10T10:40:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a3a7fc640 1 --2- 172.21.15.50:0/3457779408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0cd870 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee8a1ab59fce2cd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a39ffb640 1 -- 172.21.15.50:0/3457779408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24030610 con 0x7f3a3c0b8430 2023-08-10T10:40:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a39ffb640 1 -- 172.21.15.50:0/3457779408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24030770 con 0x7f3a3c0b8430 2023-08-10T10:40:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a39ffb640 1 -- 172.21.15.50:0/3457779408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24030b00 con 0x7f3a3c0b8430 2023-08-10T10:40:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a416b8640 1 -- 172.21.15.50:0/3457779408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 msgr2=0x7f3a3c0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.131+0000 7f3a416b8640 1 --2- 172.21.15.50:0/3457779408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0cd870 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402b960 comp rx=0 tx=0).stop 2023-08-10T10:40:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.132+0000 7f3a416b8640 1 -- 172.21.15.50:0/3457779408 shutdown_connections 2023-08-10T10:40:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.132+0000 7f3a416b8640 1 --2- 172.21.15.50:0/3457779408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0cd870 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.132+0000 7f3a416b8640 1 -- 172.21.15.50:0/3457779408 >> 172.21.15.50:0/3457779408 conn(0x7f3a3c0d2ac0 msgr2=0x7f3a3c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.132+0000 7f3a416b8640 1 -- 172.21.15.50:0/3457779408 shutdown_connections 2023-08-10T10:40:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.132+0000 7f3a416b8640 1 -- 172.21.15.50:0/3457779408 wait complete. 2023-08-10T10:40:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.133+0000 7f3a416b8640 1 Processor -- start 2023-08-10T10:40:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.134+0000 7f3a416b8640 1 -- start start 2023-08-10T10:40:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a3c0cddb0 0x7f3a3c14e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a3c15cd60 0x7f3a3c14e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c159690 con 0x7f3a3c0b8430 2023-08-10T10:40:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b0ed0 con 0x7f3a3c0cddb0 2023-08-10T10:40:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a416b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1f2cc0 con 0x7f3a3c15cd60 2023-08-10T10:40:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59658/0 (socket says 172.21.15.50:59658) 2023-08-10T10:40:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 -- 172.21.15.50:0/750615781 learned_addr learned my addr 172.21.15.50:0/750615781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3a7fc640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a3c0cddb0 0x7f3a3c14e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 -- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a3c15cd60 msgr2=0x7f3a3c14e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a3c15cd60 0x7f3a3c14e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 -- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a3c0cddb0 msgr2=0x7f3a3c14e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a3c0cddb0 0x7f3a3c14e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.135+0000 7f3a3affd640 1 -- 172.21.15.50:0/750615781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24009400 con 0x7f3a3c0b8430 2023-08-10T10:40:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a3affd640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c890 tx=0x7f3a2c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00a640 con 0x7f3a3c0b8430 2023-08-10T10:40:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00a7a0 con 0x7f3a3c0b8430 2023-08-10T10:40:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00ab30 con 0x7f3a3c0b8430 2023-08-10T10:40:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c14edb0 con 0x7f3a3c0b8430 2023-08-10T10:40:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.136+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c14f370 con 0x7f3a3c0b8430 2023-08-10T10:40:28.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.138+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c1f2ee0 con 0x7f3a3c0b8430 2023-08-10T10:40:28.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.138+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a2c00ac90 con 0x7f3a3c0b8430 2023-08-10T10:40:28.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.139+0000 7f3a337fe640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 0x7f3a1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.139+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a2c088880 con 0x7f3a3c0b8430 2023-08-10T10:40:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.140+0000 7f3a3a7fc640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 0x7f3a1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.140+0000 7f3a3a7fc640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 0x7f3a1c06d110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a24036000 tx=0x7f3a24008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.144+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a2c053930 con 0x7f3a3c0b8430 2023-08-10T10:40:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.373+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a3c0ce200 con 0x7f3a3c0b8430 2023-08-10T10:40:28.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.375+0000 7f3a337fe640 1 -- 172.21.15.50:0/750615781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f3a3c0ce200 con 0x7f3a3c0b8430 2023-08-10T10:40:28.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:28.377 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:40:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:40:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.377+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 msgr2=0x7f3a1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.377+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 0x7f3a1c06d110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a24036000 tx=0x7f3a24008030 comp rx=0 tx=0).stop 2023-08-10T10:40:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.377+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 msgr2=0x7f3a3c0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.377+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c890 tx=0x7f3a2c00cd50 comp rx=0 tx=0).stop 2023-08-10T10:40:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 shutdown_connections 2023-08-10T10:40:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a3c15cd60 0x7f3a3c14e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a1c06ac50 0x7f3a1c06d110 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a3c0cddb0 0x7f3a3c14e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 --2- 172.21.15.50:0/750615781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3c0b8430 0x7f3a3c0b0990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 >> 172.21.15.50:0/750615781 conn(0x7f3a3c0d2ac0 msgr2=0x7f3a3c0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 shutdown_connections 2023-08-10T10:40:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.378+0000 7f3a416b8640 1 -- 172.21.15.50:0/750615781 wait complete. 2023-08-10T10:40:28.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:40:28.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.629+0000 7fc076a85640 1 Processor -- start 2023-08-10T10:40:28.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.629+0000 7fc076a85640 1 -- start start 2023-08-10T10:40:28.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc076a85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc070159830 0x7fc0700cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc076a85640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700cc5a0 con 0x7fc0700c9d00 2023-08-10T10:40:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc076a85640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07015d720 con 0x7fc0700cd290 2023-08-10T10:40:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc076a85640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700b4170 con 0x7fc070159830 2023-08-10T10:40:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc075a83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc070159830 0x7fc0700cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc075a83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc070159830 0x7fc0700cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59670/0 (socket says 172.21.15.50:59670) 2023-08-10T10:40:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc075a83640 1 -- 172.21.15.50:0/3853582009 learned_addr learned my addr 172.21.15.50:0/3853582009 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.631+0000 7fc075282640 1 --1- 172.21.15.50:0/3853582009 >> v1:172.21.15.50:6789/0 conn(0x7fc0700c9d00 0x7fc07015dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39012/0 (socket says 172.21.15.50:39012) 2023-08-10T10:40:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.632+0000 7fc075a83640 1 -- 172.21.15.50:0/3853582009 >> v1:172.21.15.117:6789/0 conn(0x7fc0700cd290 legacy=0x7fc0700cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.632+0000 7fc075a83640 1 -- 172.21.15.50:0/3853582009 >> v1:172.21.15.50:6789/0 conn(0x7fc0700c9d00 legacy=0x7fc07015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.632+0000 7fc075a83640 1 -- 172.21.15.50:0/3853582009 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070159c10 con 0x7fc070159830 2023-08-10T10:40:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.633+0000 7fc075a83640 1 --2- 172.21.15.50:0/3853582009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc070159830 0x7fc0700cc060 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5072176fa2fa2dd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.633+0000 7fc074a81640 1 -- 172.21.15.50:0/3853582009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c030860 con 0x7fc070159830 2023-08-10T10:40:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.633+0000 7fc074a81640 1 -- 172.21.15.50:0/3853582009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0309c0 con 0x7fc070159830 2023-08-10T10:40:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.633+0000 7fc074a81640 1 -- 172.21.15.50:0/3853582009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c030d50 con 0x7fc070159830 2023-08-10T10:40:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 -- 172.21.15.50:0/3853582009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc070159830 msgr2=0x7fc0700cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 --2- 172.21.15.50:0/3853582009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc070159830 0x7fc0700cc060 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c02b9a0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 -- 172.21.15.50:0/3853582009 shutdown_connections 2023-08-10T10:40:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 --2- 172.21.15.50:0/3853582009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc070159830 0x7fc0700cc060 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 -- 172.21.15.50:0/3853582009 >> 172.21.15.50:0/3853582009 conn(0x7fc07006ab80 msgr2=0x7fc07006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 -- 172.21.15.50:0/3853582009 shutdown_connections 2023-08-10T10:40:28.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.634+0000 7fc076a85640 1 -- 172.21.15.50:0/3853582009 wait complete. 2023-08-10T10:40:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.636+0000 7fc076a85640 1 Processor -- start 2023-08-10T10:40:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.636+0000 7fc076a85640 1 -- start start 2023-08-10T10:40:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c9d00 0x7fc07014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc070159830 0x7fc0700c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07014ce90 con 0x7fc0700cd290 2023-08-10T10:40:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c2b10 con 0x7fc070159830 2023-08-10T10:40:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc076a85640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c2df0 con 0x7fc0700c9d00 2023-08-10T10:40:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc075282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc075282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59684/0 (socket says 172.21.15.50:59684) 2023-08-10T10:40:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc075282640 1 -- 172.21.15.50:0/962426086 learned_addr learned my addr 172.21.15.50:0/962426086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.637+0000 7fc075a83640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c9d00 0x7fc07014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc076284640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc070159830 0x7fc0700c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 -- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c9d00 msgr2=0x7fc07014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c9d00 0x7fc07014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 -- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc070159830 msgr2=0x7fc0700c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc070159830 0x7fc0700c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 -- 172.21.15.50:0/962426086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0094d0 con 0x7fc0700cd290 2023-08-10T10:40:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc075282640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c3e0 tx=0x7fc06000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600074e0 con 0x7fc0700cd290 2023-08-10T10:40:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060007640 con 0x7fc0700cd290 2023-08-10T10:40:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600049e0 con 0x7fc0700cd290 2023-08-10T10:40:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.638+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0700c30d0 con 0x7fc0700cd290 2023-08-10T10:40:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.639+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0700c3690 con 0x7fc0700cd290 2023-08-10T10:40:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.640+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0700cec40 con 0x7fc0700cd290 2023-08-10T10:40:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.641+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc060004b40 con 0x7fc0700cd290 2023-08-10T10:40:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.642+0000 7fc0667fc640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 0x7fc05406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.642+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc060088f80 con 0x7fc0700cd290 2023-08-10T10:40:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.642+0000 7fc075a83640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 0x7fc05406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.643+0000 7fc075a83640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 0x7fc05406d110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc06c036000 tx=0x7fc06c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:28.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.646+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc060053f90 con 0x7fc0700cd290 2023-08-10T10:40:28.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.839+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc07006b590 con 0x7fc0700cd290 2023-08-10T10:40:28.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.841+0000 7fc0667fc640 1 -- 172.21.15.50:0/962426086 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fc0600575b0 con 0x7fc0700cd290 2023-08-10T10:40:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:28.843 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":52,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:40:25.789277+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:40:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 msgr2=0x7fc05406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 0x7fc05406d110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc06c036000 tx=0x7fc06c008030 comp rx=0 tx=0).stop 2023-08-10T10:40:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 msgr2=0x7fc0700c1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c3e0 tx=0x7fc06000c8a0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 shutdown_connections 2023-08-10T10:40:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc05406ac50 0x7fc05406d110 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc070159830 0x7fc0700c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0700cd290 0x7fc0700c1fa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 --2- 172.21.15.50:0/962426086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c9d00 0x7fc07014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.843+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 >> 172.21.15.50:0/962426086 conn(0x7fc07006ab80 msgr2=0x7fc0700cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.844+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 shutdown_connections 2023-08-10T10:40:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:28.844+0000 7fc076a85640 1 -- 172.21.15.50:0/962426086 wait complete. 2023-08-10T10:40:28.865 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:40:28.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:40:29.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.095+0000 7fb47911f640 1 Processor -- start 2023-08-10T10:40:29.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.096+0000 7fb47911f640 1 -- start start 2023-08-10T10:40:29.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.097+0000 7fb47911f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb474160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.097+0000 7fb47911f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4740cdf80 0x7fb4740d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.097+0000 7fb47911f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb474161180 con 0x7fb4740b8430 2023-08-10T10:40:29.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.097+0000 7fb47911f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740b5bd0 con 0x7fb4740cdf80 2023-08-10T10:40:29.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.097+0000 7fb47911f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb474161460 con 0x7fb47415cd60 2023-08-10T10:40:29.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb47259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4740b8430 0x7fb4740cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39024/0 (socket says 172.21.15.50:39024) 2023-08-10T10:40:29.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb47259c640 1 -- 172.21.15.50:0/3921969874 learned_addr learned my addr 172.21.15.50:0/3921969874 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:29.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb472d9d640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb474160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb47359e640 1 --2- 172.21.15.50:0/3921969874 >> v2:172.21.15.117:3300/0 conn(0x7fb4740cdf80 0x7fb4740d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914347990 0 0) 0x7fb474161180 con 0x7fb4740b8430 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.098+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c003520 con 0x7fb4740b8430 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032041158 0 0) 0x7fb45c003520 con 0x7fb4740b8430 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 msgr2=0x7fb474160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb474160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 >> v2:172.21.15.117:3300/0 conn(0x7fb4740cdf80 msgr2=0x7fb4740d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 --2- 172.21.15.50:0/3921969874 >> v2:172.21.15.117:3300/0 conn(0x7fb4740cdf80 0x7fb4740d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474161740 con 0x7fb4740b8430 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb468001670 con 0x7fb4740b8430 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 >> v1:172.21.15.50:6789/0 conn(0x7fb4740b8430 legacy=0x7fb4740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb45c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45c0047c0 0x7fb45c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb45c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740b5bd0 con 0x7fb45c003970 2023-08-10T10:40:29.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb474161460 con 0x7fb45c0047c0 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c00b980 con 0x7fb47415cd60 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb472d9d640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb45c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.099+0000 7fb47259c640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45c0047c0 0x7fb45c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb472d9d640 1 -- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 msgr2=0x7fb45c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb47359e640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb45c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb472d9d640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb45c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb472d9d640 1 -- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45c0047c0 msgr2=0x7fb45c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb472d9d640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45c0047c0 0x7fb45c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb472d9d640 1 -- 172.21.15.50:0/3921969874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c003520 con 0x7fb45c003970 2023-08-10T10:40:29.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb47259c640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45c0047c0 0x7fb45c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:29.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.100+0000 7fb47359e640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb47415cd60 0x7fb45c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.101+0000 7fb472d9d640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb45c003d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb464009ac0 tx=0x7fb45c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cb7bd619310649 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.101+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46402c6b0 con 0x7fb45c003970 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.101+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46402c810 con 0x7fb45c003970 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.101+0000 7fb471d9b640 1 -- 172.21.15.50:0/3921969874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46402cba0 con 0x7fb45c003970 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 -- 172.21.15.50:0/3921969874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 msgr2=0x7fb45c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 --2- 172.21.15.50:0/3921969874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb45c003d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb464009ac0 tx=0x7fb45c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47359e640 1 -- 172.21.15.50:0/3921969874 reap_dead start 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 -- 172.21.15.50:0/3921969874 shutdown_connections 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 -- 172.21.15.50:0/3921969874 >> 172.21.15.50:0/3921969874 conn(0x7fb4740d2ac0 msgr2=0x7fb4740d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 -- 172.21.15.50:0/3921969874 shutdown_connections 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.102+0000 7fb47911f640 1 -- 172.21.15.50:0/3921969874 wait complete. 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.104+0000 7fb47911f640 1 Processor -- start 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.104+0000 7fb47911f640 1 -- start start 2023-08-10T10:40:29.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4740b6ff0 0x7fb4740b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4740cb2b0 0x7fb4740cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740cd100 con 0x7fb45c003970 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740b7990 con 0x7fb4740cb2b0 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb47911f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740cc060 con 0x7fb4740b6ff0 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb472d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb472d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59690/0 (socket says 172.21.15.50:59690) 2023-08-10T10:40:29.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.105+0000 7fb472d9d640 1 -- 172.21.15.50:0/415105837 learned_addr learned my addr 172.21.15.50:0/415105837 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:29.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb47259c640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4740b6ff0 0x7fb4740b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb47359e640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4740cb2b0 0x7fb4740cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 -- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4740b6ff0 msgr2=0x7fb4740b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4740b6ff0 0x7fb4740b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 -- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4740cb2b0 msgr2=0x7fb4740cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4740cb2b0 0x7fb4740cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 -- 172.21.15.50:0/415105837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740cc340 con 0x7fb45c003970 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb472d9d640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb464037040 tx=0x7fb464004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464003810 con 0x7fb45c003970 2023-08-10T10:40:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464003970 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.106+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464003ce0 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.107+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4740cc620 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.107+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4740ccbe0 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.108+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4740d0be0 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.109+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb464034440 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.110+0000 7fb45b7fe640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 0x7fb46006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.110+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4640ab4f0 con 0x7fb45c003970 2023-08-10T10:40:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.110+0000 7fb47259c640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 0x7fb46006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.111+0000 7fb47259c640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 0x7fb46006d140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb4740c8bf0 tx=0x7fb468009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.114+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4740d0be0 con 0x7fb45c003970 2023-08-10T10:40:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.300+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4740d0ee0 con 0x7fb46006ac80 2023-08-10T10:40:29.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.315+0000 7fb45b7fe640 1 -- 172.21.15.50:0/415105837 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296356 (secure 0 0 0) 0x7fb46800d050 con 0x7fb46006ac80 2023-08-10T10:40:29.322 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:29.324 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:40:29.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 msgr2=0x7fb46006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 0x7fb46006d140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb4740c8bf0 tx=0x7fb468009040 comp rx=0 tx=0).stop 2023-08-10T10:40:29.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 msgr2=0x7fb4740c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb464037040 tx=0x7fb464004730 comp rx=0 tx=0).stop 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 shutdown_connections 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb46006ac80 0x7fb46006d140 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4740cb2b0 0x7fb4740cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4740b6ff0 0x7fb4740b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 --2- 172.21.15.50:0/415105837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c003970 0x7fb4740c82d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 >> 172.21.15.50:0/415105837 conn(0x7fb4740d2ac0 msgr2=0x7fb47415f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:29.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 shutdown_connections 2023-08-10T10:40:29.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.321+0000 7fb47911f640 1 -- 172.21.15.50:0/415105837 wait complete. 2023-08-10T10:40:29.343 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-10T10:40:28.358765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3139,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559360,"statfs":{"total":1600000000,"available":1596785279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.610904"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793647+0000","last_change":"2023-08-10T10:40:24.819297+0000","last_active":"2023-08-10T10:40:25.793647+0000","last_peered":"2023-08-10T10:40:25.793647+0000","last_clean":"2023-08-10T10:40:25.793647+0000","last_became_active":"2023-08-10T10:40:24.818707+0000","last_became_peered":"2023-08-10T10:40:24.818707+0000","last_unstale":"2023-08-10T10:40:25.793647+0000","last_undegraded":"2023-08-10T10:40:25.793647+0000","last_fullsized":"2023-08-10T10:40:25.793647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:47.566051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794029+0000","last_change":"2023-08-10T10:40:24.825555+0000","last_active":"2023-08-10T10:40:25.794029+0000","last_peered":"2023-08-10T10:40:25.794029+0000","last_clean":"2023-08-10T10:40:25.794029+0000","last_became_active":"2023-08-10T10:40:24.825326+0000","last_became_peered":"2023-08-10T10:40:24.825326+0000","last_unstale":"2023-08-10T10:40:25.794029+0000","last_undegraded":"2023-08-10T10:40:25.794029+0000","last_fullsized":"2023-08-10T10:40:25.794029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925958+0000","last_change":"2023-08-10T10:40:24.809581+0000","last_active":"2023-08-10T10:40:26.925958+0000","last_peered":"2023-08-10T10:40:26.925958+0000","last_clean":"2023-08-10T10:40:26.925958+0000","last_became_active":"2023-08-10T10:40:24.809207+0000","last_became_peered":"2023-08-10T10:40:24.809207+0000","last_unstale":"2023-08-10T10:40:26.925958+0000","last_undegraded":"2023-08-10T10:40:26.925958+0000","last_fullsized":"2023-08-10T10:40:26.925958+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.319464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925985+0000","last_change":"2023-08-10T10:40:24.809021+0000","last_active":"2023-08-10T10:40:26.925985+0000","last_peered":"2023-08-10T10:40:26.925985+0000","last_clean":"2023-08-10T10:40:26.925985+0000","last_became_active":"2023-08-10T10:40:24.808722+0000","last_became_peered":"2023-08-10T10:40:24.808722+0000","last_unstale":"2023-08-10T10:40:26.925985+0000","last_undegraded":"2023-08-10T10:40:26.925985+0000","last_fullsized":"2023-08-10T10:40:26.925985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793886+0000","last_change":"2023-08-10T10:40:24.822453+0000","last_active":"2023-08-10T10:40:25.793886+0000","last_peered":"2023-08-10T10:40:25.793886+0000","last_clean":"2023-08-10T10:40:25.793886+0000","last_became_active":"2023-08-10T10:40:24.822211+0000","last_became_peered":"2023-08-10T10:40:24.822211+0000","last_unstale":"2023-08-10T10:40:25.793886+0000","last_undegraded":"2023-08-10T10:40:25.793886+0000","last_fullsized":"2023-08-10T10:40:25.793886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:43.869883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029126+0000","last_change":"2023-08-10T10:40:24.824743+0000","last_active":"2023-08-10T10:40:27.029126+0000","last_peered":"2023-08-10T10:40:27.029126+0000","last_clean":"2023-08-10T10:40:27.029126+0000","last_became_active":"2023-08-10T10:40:24.824477+0000","last_became_peered":"2023-08-10T10:40:24.824477+0000","last_unstale":"2023-08-10T10:40:27.029126+0000","last_undegraded":"2023-08-10T10:40:27.029126+0000","last_fullsized":"2023-08-10T10:40:27.029126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:48.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926255+0000","last_change":"2023-08-10T10:40:24.811049+0000","last_active":"2023-08-10T10:40:26.926255+0000","last_peered":"2023-08-10T10:40:26.926255+0000","last_clean":"2023-08-10T10:40:26.926255+0000","last_became_active":"2023-08-10T10:40:24.810393+0000","last_became_peered":"2023-08-10T10:40:24.810393+0000","last_unstale":"2023-08-10T10:40:26.926255+0000","last_undegraded":"2023-08-10T10:40:26.926255+0000","last_fullsized":"2023-08-10T10:40:26.926255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:47.992472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793741+0000","last_change":"2023-08-10T10:40:24.817177+0000","last_active":"2023-08-10T10:40:25.793741+0000","last_peered":"2023-08-10T10:40:25.793741+0000","last_clean":"2023-08-10T10:40:25.793741+0000","last_became_active":"2023-08-10T10:40:24.816897+0000","last_became_peered":"2023-08-10T10:40:24.816897+0000","last_unstale":"2023-08-10T10:40:25.793741+0000","last_undegraded":"2023-08-10T10:40:25.793741+0000","last_fullsized":"2023-08-10T10:40:25.793741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793852+0000","last_change":"2023-08-10T10:40:24.816495+0000","last_active":"2023-08-10T10:40:25.793852+0000","last_peered":"2023-08-10T10:40:25.793852+0000","last_clean":"2023-08-10T10:40:25.793852+0000","last_became_active":"2023-08-10T10:40:24.816236+0000","last_became_peered":"2023-08-10T10:40:24.816236+0000","last_unstale":"2023-08-10T10:40:25.793852+0000","last_undegraded":"2023-08-10T10:40:25.793852+0000","last_fullsized":"2023-08-10T10:40:25.793852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:59.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926412+0000","last_change":"2023-08-10T10:40:24.810755+0000","last_active":"2023-08-10T10:40:26.926412+0000","last_peered":"2023-08-10T10:40:26.926412+0000","last_clean":"2023-08-10T10:40:26.926412+0000","last_became_active":"2023-08-10T10:40:24.809982+0000","last_became_peered":"2023-08-10T10:40:24.809982+0000","last_unstale":"2023-08-10T10:40:26.926412+0000","last_undegraded":"2023-08-10T10:40:26.926412+0000","last_fullsized":"2023-08-10T10:40:26.926412+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:00.816162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029140+0000","last_change":"2023-08-10T10:40:24.818772+0000","last_active":"2023-08-10T10:40:27.029140+0000","last_peered":"2023-08-10T10:40:27.029140+0000","last_clean":"2023-08-10T10:40:27.029140+0000","last_became_active":"2023-08-10T10:40:24.818516+0000","last_became_peered":"2023-08-10T10:40:24.818516+0000","last_unstale":"2023-08-10T10:40:27.029140+0000","last_undegraded":"2023-08-10T10:40:27.029140+0000","last_fullsized":"2023-08-10T10:40:27.029140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:18.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926222+0000","last_change":"2023-08-10T10:40:24.800429+0000","last_active":"2023-08-10T10:40:26.926222+0000","last_peered":"2023-08-10T10:40:26.926222+0000","last_clean":"2023-08-10T10:40:26.926222+0000","last_became_active":"2023-08-10T10:40:24.800143+0000","last_became_peered":"2023-08-10T10:40:24.800143+0000","last_unstale":"2023-08-10T10:40:26.926222+0000","last_undegraded":"2023-08-10T10:40:26.926222+0000","last_fullsized":"2023-08-10T10:40:26.926222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793511+0000","last_change":"2023-08-10T10:40:24.813750+0000","last_active":"2023-08-10T10:40:25.793511+0000","last_peered":"2023-08-10T10:40:25.793511+0000","last_clean":"2023-08-10T10:40:25.793511+0000","last_became_active":"2023-08-10T10:40:24.813465+0000","last_became_peered":"2023-08-10T10:40:24.813465+0000","last_unstale":"2023-08-10T10:40:25.793511+0000","last_undegraded":"2023-08-10T10:40:25.793511+0000","last_fullsized":"2023-08-10T10:40:25.793511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.892628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755163+0000","last_change":"2023-08-10T10:40:22.755163+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755163+0000","last_undegraded":"2023-08-10T10:40:22.755163+0000","last_fullsized":"2023-08-10T10:40:22.755163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793409+0000","last_change":"2023-08-10T10:40:23.784500+0000","last_active":"2023-08-10T10:40:25.793409+0000","last_peered":"2023-08-10T10:40:25.793409+0000","last_clean":"2023-08-10T10:40:25.793409+0000","last_became_active":"2023-08-10T10:40:23.784247+0000","last_became_peered":"2023-08-10T10:40:23.784247+0000","last_unstale":"2023-08-10T10:40:25.793409+0000","last_undegraded":"2023-08-10T10:40:25.793409+0000","last_fullsized":"2023-08-10T10:40:25.793409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793986+0000","last_change":"2023-08-10T10:40:23.775943+0000","last_active":"2023-08-10T10:40:25.793986+0000","last_peered":"2023-08-10T10:40:25.793986+0000","last_clean":"2023-08-10T10:40:25.793986+0000","last_became_active":"2023-08-10T10:40:23.775676+0000","last_became_peered":"2023-08-10T10:40:23.775676+0000","last_unstale":"2023-08-10T10:40:25.793986+0000","last_undegraded":"2023-08-10T10:40:25.793986+0000","last_fullsized":"2023-08-10T10:40:25.793986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926384+0000","last_change":"2023-08-10T10:40:24.800430+0000","last_active":"2023-08-10T10:40:26.926384+0000","last_peered":"2023-08-10T10:40:26.926384+0000","last_clean":"2023-08-10T10:40:26.926384+0000","last_became_active":"2023-08-10T10:40:24.800197+0000","last_became_peered":"2023-08-10T10:40:24.800197+0000","last_unstale":"2023-08-10T10:40:26.926384+0000","last_undegraded":"2023-08-10T10:40:26.926384+0000","last_fullsized":"2023-08-10T10:40:26.926384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:44.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.759949+0000","last_change":"2023-08-10T10:40:22.759949+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.759949+0000","last_undegraded":"2023-08-10T10:40:22.759949+0000","last_fullsized":"2023-08-10T10:40:22.759949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754036+0000","last_change":"2023-08-10T10:40:22.754036+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754036+0000","last_undegraded":"2023-08-10T10:40:22.754036+0000","last_fullsized":"2023-08-10T10:40:22.754036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.752333+0000","last_change":"2023-08-10T10:40:22.752333+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.752333+0000","last_undegraded":"2023-08-10T10:40:22.752333+0000","last_fullsized":"2023-08-10T10:40:22.752333+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926588+0000","last_change":"2023-08-10T10:40:24.800790+0000","last_active":"2023-08-10T10:40:26.926588+0000","last_peered":"2023-08-10T10:40:26.926588+0000","last_clean":"2023-08-10T10:40:26.926588+0000","last_became_active":"2023-08-10T10:40:24.800146+0000","last_became_peered":"2023-08-10T10:40:24.800146+0000","last_unstale":"2023-08-10T10:40:26.926588+0000","last_undegraded":"2023-08-10T10:40:26.926588+0000","last_fullsized":"2023-08-10T10:40:26.926588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:13.348931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756334+0000","last_change":"2023-08-10T10:40:22.756334+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756334+0000","last_undegraded":"2023-08-10T10:40:22.756334+0000","last_fullsized":"2023-08-10T10:40:22.756334+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.757445+0000","last_change":"2023-08-10T10:40:22.757445+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.757445+0000","last_undegraded":"2023-08-10T10:40:22.757445+0000","last_fullsized":"2023-08-10T10:40:22.757445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.760054+0000","last_change":"2023-08-10T10:40:22.760054+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.760054+0000","last_undegraded":"2023-08-10T10:40:22.760054+0000","last_fullsized":"2023-08-10T10:40:22.760054+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.751594+0000","last_change":"2023-08-10T10:40:22.751594+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.751594+0000","last_undegraded":"2023-08-10T10:40:22.751594+0000","last_fullsized":"2023-08-10T10:40:22.751594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758782+0000","last_change":"2023-08-10T10:40:22.758782+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758782+0000","last_undegraded":"2023-08-10T10:40:22.758782+0000","last_fullsized":"2023-08-10T10:40:22.758782+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926772+0000","last_change":"2023-08-10T10:40:23.783755+0000","last_active":"2023-08-10T10:40:26.926772+0000","last_peered":"2023-08-10T10:40:26.926772+0000","last_clean":"2023-08-10T10:40:26.926772+0000","last_became_active":"2023-08-10T10:40:23.782575+0000","last_became_peered":"2023-08-10T10:40:23.782575+0000","last_unstale":"2023-08-10T10:40:26.926772+0000","last_undegraded":"2023-08-10T10:40:26.926772+0000","last_fullsized":"2023-08-10T10:40:26.926772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:55:37.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756552+0000","last_change":"2023-08-10T10:40:22.756552+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756552+0000","last_undegraded":"2023-08-10T10:40:22.756552+0000","last_fullsized":"2023-08-10T10:40:22.756552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756811+0000","last_change":"2023-08-10T10:40:22.756811+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756811+0000","last_undegraded":"2023-08-10T10:40:22.756811+0000","last_fullsized":"2023-08-10T10:40:22.756811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926168+0000","last_change":"2023-08-10T10:40:24.823798+0000","last_active":"2023-08-10T10:40:26.926168+0000","last_peered":"2023-08-10T10:40:26.926168+0000","last_clean":"2023-08-10T10:40:26.926168+0000","last_became_active":"2023-08-10T10:40:24.823248+0000","last_became_peered":"2023-08-10T10:40:24.823248+0000","last_unstale":"2023-08-10T10:40:26.926168+0000","last_undegraded":"2023-08-10T10:40:26.926168+0000","last_fullsized":"2023-08-10T10:40:26.926168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758912+0000","last_change":"2023-08-10T10:40:22.758912+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758912+0000","last_undegraded":"2023-08-10T10:40:22.758912+0000","last_fullsized":"2023-08-10T10:40:22.758912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926176+0000","last_change":"2023-08-10T10:40:23.781989+0000","last_active":"2023-08-10T10:40:26.926176+0000","last_peered":"2023-08-10T10:40:26.926176+0000","last_clean":"2023-08-10T10:40:26.926176+0000","last_became_active":"2023-08-10T10:40:23.781505+0000","last_became_peered":"2023-08-10T10:40:23.781505+0000","last_unstale":"2023-08-10T10:40:26.926176+0000","last_undegraded":"2023-08-10T10:40:26.926176+0000","last_fullsized":"2023-08-10T10:40:26.926176+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:04.870677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926663+0000","last_change":"2023-08-10T10:40:24.811687+0000","last_active":"2023-08-10T10:40:26.926663+0000","last_peered":"2023-08-10T10:40:26.926663+0000","last_clean":"2023-08-10T10:40:26.926663+0000","last_became_active":"2023-08-10T10:40:24.811405+0000","last_became_peered":"2023-08-10T10:40:24.811405+0000","last_unstale":"2023-08-10T10:40:26.926663+0000","last_undegraded":"2023-08-10T10:40:26.926663+0000","last_fullsized":"2023-08-10T10:40:26.926663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:20:11.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754064+0000","last_change":"2023-08-10T10:40:22.754064+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754064+0000","last_undegraded":"2023-08-10T10:40:22.754064+0000","last_fullsized":"2023-08-10T10:40:22.754064+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793945+0000","last_change":"2023-08-10T10:40:24.814150+0000","last_active":"2023-08-10T10:40:25.793945+0000","last_peered":"2023-08-10T10:40:25.793945+0000","last_clean":"2023-08-10T10:40:25.793945+0000","last_became_active":"2023-08-10T10:40:24.813918+0000","last_became_peered":"2023-08-10T10:40:24.813918+0000","last_unstale":"2023-08-10T10:40:25.793945+0000","last_undegraded":"2023-08-10T10:40:25.793945+0000","last_fullsized":"2023-08-10T10:40:25.793945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029984+0000","last_change":"2023-08-10T10:40:23.780905+0000","last_active":"2023-08-10T10:40:27.029984+0000","last_peered":"2023-08-10T10:40:27.029984+0000","last_clean":"2023-08-10T10:40:27.029984+0000","last_became_active":"2023-08-10T10:40:23.780610+0000","last_became_peered":"2023-08-10T10:40:23.780610+0000","last_unstale":"2023-08-10T10:40:27.029984+0000","last_undegraded":"2023-08-10T10:40:27.029984+0000","last_fullsized":"2023-08-10T10:40:27.029984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:17.908346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755209+0000","last_change":"2023-08-10T10:40:22.755209+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755209+0000","last_undegraded":"2023-08-10T10:40:22.755209+0000","last_fullsized":"2023-08-10T10:40:22.755209+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794197+0000","last_change":"2023-08-10T10:40:24.819437+0000","last_active":"2023-08-10T10:40:25.794197+0000","last_peered":"2023-08-10T10:40:25.794197+0000","last_clean":"2023-08-10T10:40:25.794197+0000","last_became_active":"2023-08-10T10:40:24.819044+0000","last_became_peered":"2023-08-10T10:40:24.819044+0000","last_unstale":"2023-08-10T10:40:25.794197+0000","last_undegraded":"2023-08-10T10:40:25.794197+0000","last_fullsized":"2023-08-10T10:40:25.794197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756973+0000","last_change":"2023-08-10T10:40:22.756973+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756973+0000","last_undegraded":"2023-08-10T10:40:22.756973+0000","last_fullsized":"2023-08-10T10:40:22.756973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794071+0000","last_change":"2023-08-10T10:40:23.779688+0000","last_active":"2023-08-10T10:40:25.794071+0000","last_peered":"2023-08-10T10:40:25.794071+0000","last_clean":"2023-08-10T10:40:25.794071+0000","last_became_active":"2023-08-10T10:40:23.779280+0000","last_became_peered":"2023-08-10T10:40:23.779280+0000","last_unstale":"2023-08-10T10:40:25.794071+0000","last_undegraded":"2023-08-10T10:40:25.794071+0000","last_fullsized":"2023-08-10T10:40:25.794071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:56.873303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926986+0000","last_change":"2023-08-10T10:40:23.783433+0000","last_active":"2023-08-10T10:40:26.926986+0000","last_peered":"2023-08-10T10:40:26.926986+0000","last_clean":"2023-08-10T10:40:26.926986+0000","last_became_active":"2023-08-10T10:40:23.782240+0000","last_became_peered":"2023-08-10T10:40:23.782240+0000","last_unstale":"2023-08-10T10:40:26.926986+0000","last_undegraded":"2023-08-10T10:40:26.926986+0000","last_fullsized":"2023-08-10T10:40:26.926986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:29.656096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755714+0000","last_change":"2023-08-10T10:40:22.755714+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755714+0000","last_undegraded":"2023-08-10T10:40:22.755714+0000","last_fullsized":"2023-08-10T10:40:22.755714+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793716+0000","last_change":"2023-08-10T10:40:24.812696+0000","last_active":"2023-08-10T10:40:25.793716+0000","last_peered":"2023-08-10T10:40:25.793716+0000","last_clean":"2023-08-10T10:40:25.793716+0000","last_became_active":"2023-08-10T10:40:24.812441+0000","last_became_peered":"2023-08-10T10:40:24.812441+0000","last_unstale":"2023-08-10T10:40:25.793716+0000","last_undegraded":"2023-08-10T10:40:25.793716+0000","last_fullsized":"2023-08-10T10:40:25.793716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:07.596425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029662+0000","last_change":"2023-08-10T10:40:23.778707+0000","last_active":"2023-08-10T10:40:27.029662+0000","last_peered":"2023-08-10T10:40:27.029662+0000","last_clean":"2023-08-10T10:40:27.029662+0000","last_became_active":"2023-08-10T10:40:23.778449+0000","last_became_peered":"2023-08-10T10:40:23.778449+0000","last_unstale":"2023-08-10T10:40:27.029662+0000","last_undegraded":"2023-08-10T10:40:27.029662+0000","last_fullsized":"2023-08-10T10:40:27.029662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:28.984610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754404+0000","last_change":"2023-08-10T10:40:22.754404+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754404+0000","last_undegraded":"2023-08-10T10:40:22.754404+0000","last_fullsized":"2023-08-10T10:40:22.754404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.759063+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:40:22.759063+0000","last_peered":"2023-08-10T10:40:22.759063+0000","last_clean":"2023-08-10T10:40:22.759063+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:40:22.759063+0000","last_undegraded":"2023-08-10T10:40:22.759063+0000","last_fullsized":"2023-08-10T10:40:22.759063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:50.796224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.760431+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:40:22.760431+0000","last_peered":"2023-08-10T10:40:22.760431+0000","last_clean":"2023-08-10T10:40:22.760431+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:40:22.760431+0000","last_undegraded":"2023-08-10T10:40:22.760431+0000","last_fullsized":"2023-08-10T10:40:22.760431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:12.347252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793626+0000","last_change":"2023-08-10T10:40:24.808340+0000","last_active":"2023-08-10T10:40:25.793626+0000","last_peered":"2023-08-10T10:40:25.793626+0000","last_clean":"2023-08-10T10:40:25.793626+0000","last_became_active":"2023-08-10T10:40:24.807791+0000","last_became_peered":"2023-08-10T10:40:24.807791+0000","last_unstale":"2023-08-10T10:40:25.793626+0000","last_undegraded":"2023-08-10T10:40:25.793626+0000","last_fullsized":"2023-08-10T10:40:25.793626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:31.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.757586+0000","last_change":"2023-08-10T10:40:22.757586+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.757586+0000","last_undegraded":"2023-08-10T10:40:22.757586+0000","last_fullsized":"2023-08-10T10:40:22.757586+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.758555+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:40:22.758555+0000","last_peered":"2023-08-10T10:40:22.758555+0000","last_clean":"2023-08-10T10:40:22.758555+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:40:22.758555+0000","last_undegraded":"2023-08-10T10:40:22.758555+0000","last_fullsized":"2023-08-10T10:40:22.758555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:11.898190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926387+0000","last_change":"2023-08-10T10:40:24.798884+0000","last_active":"2023-08-10T10:40:26.926387+0000","last_peered":"2023-08-10T10:40:26.926387+0000","last_clean":"2023-08-10T10:40:26.926387+0000","last_became_active":"2023-08-10T10:40:24.798630+0000","last_became_peered":"2023-08-10T10:40:24.798630+0000","last_unstale":"2023-08-10T10:40:26.926387+0000","last_undegraded":"2023-08-10T10:40:26.926387+0000","last_fullsized":"2023-08-10T10:40:26.926387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:30.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754783+0000","last_change":"2023-08-10T10:40:22.754783+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754783+0000","last_undegraded":"2023-08-10T10:40:22.754783+0000","last_fullsized":"2023-08-10T10:40:22.754783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029590+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:40:27.029590+0000","last_peered":"2023-08-10T10:40:27.029590+0000","last_clean":"2023-08-10T10:40:27.029590+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:40:27.029590+0000","last_undegraded":"2023-08-10T10:40:27.029590+0000","last_fullsized":"2023-08-10T10:40:27.029590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:16.949185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754989+0000","last_change":"2023-08-10T10:40:22.754989+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754989+0000","last_undegraded":"2023-08-10T10:40:22.754989+0000","last_fullsized":"2023-08-10T10:40:22.754989+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.757961+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:40:22.757961+0000","last_peered":"2023-08-10T10:40:22.757961+0000","last_clean":"2023-08-10T10:40:22.757961+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:40:22.757961+0000","last_undegraded":"2023-08-10T10:40:22.757961+0000","last_fullsized":"2023-08-10T10:40:22.757961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:15.380803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.751595+0000","last_change":"2023-08-10T10:40:22.751595+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.751595+0000","last_undegraded":"2023-08-10T10:40:22.751595+0000","last_fullsized":"2023-08-10T10:40:22.751595+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794122+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:40:25.794122+0000","last_peered":"2023-08-10T10:40:25.794122+0000","last_clean":"2023-08-10T10:40:25.794122+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:40:25.794122+0000","last_undegraded":"2023-08-10T10:40:25.794122+0000","last_fullsized":"2023-08-10T10:40:25.794122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:46.486996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926361+0000","last_change":"2023-08-10T10:40:24.800161+0000","last_active":"2023-08-10T10:40:26.926361+0000","last_peered":"2023-08-10T10:40:26.926361+0000","last_clean":"2023-08-10T10:40:26.926361+0000","last_became_active":"2023-08-10T10:40:24.799202+0000","last_became_peered":"2023-08-10T10:40:24.799202+0000","last_unstale":"2023-08-10T10:40:26.926361+0000","last_undegraded":"2023-08-10T10:40:26.926361+0000","last_fullsized":"2023-08-10T10:40:26.926361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:47.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758708+0000","last_change":"2023-08-10T10:40:22.758708+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758708+0000","last_undegraded":"2023-08-10T10:40:22.758708+0000","last_fullsized":"2023-08-10T10:40:22.758708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.758337+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:40:22.758337+0000","last_peered":"2023-08-10T10:40:22.758337+0000","last_clean":"2023-08-10T10:40:22.758337+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:40:22.758337+0000","last_undegraded":"2023-08-10T10:40:22.758337+0000","last_fullsized":"2023-08-10T10:40:22.758337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:31.641300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926425+0000","last_change":"2023-08-10T10:40:23.781205+0000","last_active":"2023-08-10T10:40:26.926425+0000","last_peered":"2023-08-10T10:40:26.926425+0000","last_clean":"2023-08-10T10:40:26.926425+0000","last_became_active":"2023-08-10T10:40:23.780651+0000","last_became_peered":"2023-08-10T10:40:23.780651+0000","last_unstale":"2023-08-10T10:40:26.926425+0000","last_undegraded":"2023-08-10T10:40:26.926425+0000","last_fullsized":"2023-08-10T10:40:26.926425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:43.237165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794275+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:40:25.794275+0000","last_peered":"2023-08-10T10:40:25.794275+0000","last_clean":"2023-08-10T10:40:25.794275+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:40:25.794275+0000","last_undegraded":"2023-08-10T10:40:25.794275+0000","last_fullsized":"2023-08-10T10:40:25.794275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:56.240684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926695+0000","last_change":"2023-08-10T10:40:23.783410+0000","last_active":"2023-08-10T10:40:26.926695+0000","last_peered":"2023-08-10T10:40:26.926695+0000","last_clean":"2023-08-10T10:40:26.926695+0000","last_became_active":"2023-08-10T10:40:23.780450+0000","last_became_peered":"2023-08-10T10:40:23.780450+0000","last_unstale":"2023-08-10T10:40:26.926695+0000","last_undegraded":"2023-08-10T10:40:26.926695+0000","last_fullsized":"2023-08-10T10:40:26.926695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:20.582917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.757419+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:40:22.757419+0000","last_peered":"2023-08-10T10:40:22.757419+0000","last_clean":"2023-08-10T10:40:22.757419+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:40:22.757419+0000","last_undegraded":"2023-08-10T10:40:22.757419+0000","last_fullsized":"2023-08-10T10:40:22.757419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:42.442019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168595,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.486,"5min":1.613,"15min":1.613},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.427,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.133,"15min":1.1259999999999999},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4370000000000001,"5min":2.742,"15min":2.742},"last":1.367},{"interface":"front","average":{"1min":1.151,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.71299999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4570000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.206,"15min":1.216},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.548,"5min":1.704,"15min":1.704},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.371,"15min":1.395},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.593,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.103}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6180000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.258},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.244,"15min":1.258},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.611,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.202}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.409,"15min":1.4339999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8240000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.5700000000000001,"15min":1.601},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.78,"5min":2.25,"15min":2.25},"last":1.522},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.484,"15min":1.51},"min":{"1min":0.84299999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.865,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.407}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":241,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199752793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6200000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.486,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.878},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.141,"15min":1.149},"min":{"1min":0.79700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6739999999999999,"5min":1.96,"15min":1.96},"last":1.4339999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.119,"15min":1.107},"min":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.214},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.206,"15min":1.202},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5589999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.173,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6100000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.232},"min":{"1min":0.90900000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.732,"15min":1.732},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1919999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8420000000000001,"5min":2.04,"15min":2.04},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.385,"15min":1.381},"min":{"1min":0.88800000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.79,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.5329999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.383,"15min":1.367},"min":{"1min":0.97199999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8340000000000001,"5min":2.028,"15min":2.028},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9790000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.345,"15min":1.341},"min":{"1min":0.81399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.2690000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.462,"15min":1.448},"min":{"1min":0.93300000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0259999999999998,"5min":2.698,"15min":2.698},"last":1.8100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195072,"statfs":{"total":200000000,"available":199753812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.093,"15min":1.0640000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.833,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.014,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.484,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.2170000000000001,"15min":1.232},"min":{"1min":0.81999999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5589999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2130000000000001,"15min":1.2350000000000001},"min":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6379999999999999,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3460000000000001,"15min":1.3700000000000001},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.032},{"interface":"front","average":{"1min":1.27,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.246,"15min":1.25},"min":{"1min":0.91100000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3899999999999999,"15min":1.391},"min":{"1min":0.96199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7989999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.151}]},{"osd":4,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.875,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9039999999999999,"5min":2.399,"15min":2.399},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.617,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.343}]},{"osd":6,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.88600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.399,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.49,"15min":1.49},"min":{"1min":1.165,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6990000000000001,"5min":1.885,"15min":1.885},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.484},"min":{"1min":1.161,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.516}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":241,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199752793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4650000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.262},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.181,"15min":1.1930000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.637,"5min":1.667,"15min":1.667},"last":1.4470000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7110000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.119,"15min":1.137},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.365,"5min":1.677,"15min":1.677},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1220000000000001,"15min":1.1299999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.758,"5min":2.004,"15min":2.004},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.272,"15min":1.286},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5409999999999999,"5min":1.893,"15min":1.893},"last":1.141}]},{"osd":3,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5469999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2450000000000001,"15min":1.2549999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":1.863,"15min":1.863},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.343,"15min":1.3540000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8049999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.038},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2749999999999999,"15min":1.2809999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3109999999999999,"15min":1.3160000000000001},"min":{"1min":0.92900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.393,"5min":1.4410000000000001,"15min":1.4490000000000001},"min":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7210000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3939999999999999,"15min":1.401},"min":{"1min":0.68999999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7989999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.29},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4750000000000001,"15min":1.4870000000000001},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.21}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730798,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.93500000000000005,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.93300000000000005,"15min":0.88900000000000001},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.268,"5min":1.042,"15min":1.004},"min":{"1min":0.58299999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.84799999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.079},{"interface":"front","average":{"1min":1.298,"5min":1.1839999999999999,"15min":1.165},"min":{"1min":0.92700000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.2989999999999999,"15min":1.2809999999999999},"min":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0059999999999998,"5min":2.125,"15min":2.125},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.3580000000000001,"15min":1.331},"min":{"1min":0.84499999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.01}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.248,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.3899999999999999,"15min":1.3640000000000001},"min":{"1min":1.002,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.427,"15min":1.403},"min":{"1min":0.94899999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.325,"15min":1.2949999999999999},"min":{"1min":0.96899999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.873},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4359999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.073,"15min":1.0740000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.502,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4199999999999999,"5min":1.639,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2370000000000001,"15min":1.2629999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6259999999999999,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.8069999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.276,"15min":1.282},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6759999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.226}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2490000000000001,"15min":1.254},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.696,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.018},{"interface":"front","average":{"1min":1.391,"5min":1.4630000000000001,"15min":1.4750000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8500000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.351},"min":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.325,"15min":1.329},"min":{"1min":0.85499999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.766,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.371,"15min":1.361},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.405,"15min":1.403},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.2789999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195051,"statfs":{"total":200000000,"available":199732224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.441,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.296,"5min":1.548,"15min":1.548},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6339999999999999,"5min":2.246,"15min":2.246},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.742,"5min":1.913,"15min":1.913},"last":1.105}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0049999999999999,"15min":0.997},"min":{"1min":0.51100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.01},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1399999999999999,"15min":1.119},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.431},{"interface":"front","average":{"1min":1.403,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.629}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3400000000000001,"15min":1.3340000000000001},"min":{"1min":1.0580000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.333},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.752,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.363}]},{"osd":6,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.87,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.232},{"interface":"front","average":{"1min":1.25,"5min":1.204,"15min":1.196},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.294}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.403,"15min":1.411},"min":{"1min":0.81299999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.351,"15min":1.343},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":816,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194495,"statfs":{"total":200000000,"available":199163444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97399999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.442},"max":{"1min":1.387,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0209999999999999,"15min":1.0149999999999999},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4630000000000001,"5min":1.853,"15min":1.853},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.028,"15min":1.018},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.516,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.016}]},{"osd":3,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.62,"5min":0.496,"15min":0.496},"max":{"1min":1.393,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0660000000000001,"15min":1.0820000000000001},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.536,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.054}]},{"osd":4,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.98599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.623,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.04},{"interface":"front","average":{"1min":1.393,"5min":1.377,"15min":1.3740000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.214}]},{"osd":5,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.0069999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":1.986},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.258},"min":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.085}]},{"osd":6,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4350000000000001,"15min":1.4450000000000001},"min":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.0129999999999999,"5min":2.04,"15min":2.04},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.4299999999999999},"min":{"1min":0.95699999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.7869999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.454}]},{"osd":7,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5249999999999999,"15min":1.5329999999999999},"min":{"1min":1.093,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8799999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.389,"15min":1.383},"min":{"1min":0.94499999999999995,"5min":0.879,"15min":0.879},"max":{"1min":1.9610000000000001,"5min":2.601,"15min":2.601},"last":1.6100000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:40:29.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:40:29.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.619+0000 7f0a21e98640 1 Processor -- start 2023-08-10T10:40:29.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.619+0000 7f0a21e98640 1 -- start start 2023-08-10T10:40:29.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a21e98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a1c165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a21e98640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c0b1f10 con 0x7f0a1c15a940 2023-08-10T10:40:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a21e98640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c15e7d0 con 0x7f0a1c0b0620 2023-08-10T10:40:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a21e98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0b21f0 con 0x7f0a1c15f2b0 2023-08-10T10:40:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a20e96640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a1c15a940 0x7f0a1c0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39040/0 (socket says 172.21.15.50:39040) 2023-08-10T10:40:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.621+0000 7f0a20e96640 1 -- 172.21.15.50:0/2661492232 learned_addr learned my addr 172.21.15.50:0/2661492232 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a21697640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a1c165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721424062 0 0) 0x7f0a1c0b1f10 con 0x7f0a1c15a940 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a0c003520 con 0x7f0a1c15a940 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390989296 0 0) 0x7f0a0c003520 con 0x7f0a1c15a940 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 msgr2=0x7f0a1c165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a1c165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 >> v1:172.21.15.117:6789/0 conn(0x7f0a1c0b0620 legacy=0x7f0a1c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c15eab0 con 0x7f0a1c15a940 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0a10001670 con 0x7f0a1c15a940 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 >> v1:172.21.15.50:6789/0 conn(0x7f0a1c15a940 legacy=0x7f0a1c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c003a10 0x7f0a0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0c0047c0 0x7f0a0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a0c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c00bb10 con 0x7f0a0c0047c0 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c00bc80 con 0x7f0a0c003a10 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.622+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c00be40 con 0x7f0a1c15f2b0 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0c0047c0 0x7f0a0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a20e96640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c003a10 0x7f0a0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a21697640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a0c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 -- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 msgr2=0x7f0a0c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c15f2b0 0x7f0a0c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 -- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c003a10 msgr2=0x7f0a0c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c003a10 0x7f0a0c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.623+0000 7f0a1bfff640 1 -- 172.21.15.50:0/2661492232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c003520 con 0x7f0a0c0047c0 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.624+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0c0047c0 0x7f0a0c004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001720 tx=0x7f0a0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba9adf31313b72b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080052d0 con 0x7f0a0c0047c0 2023-08-10T10:40:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0802e050 con 0x7f0a0c0047c0 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a1b7fe640 1 -- 172.21.15.50:0/2661492232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080035f0 con 0x7f0a0c0047c0 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21e98640 1 -- 172.21.15.50:0/2661492232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0c0047c0 msgr2=0x7f0a0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21e98640 1 --2- 172.21.15.50:0/2661492232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0c0047c0 0x7f0a0c004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001720 tx=0x7f0a0c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21697640 1 -- 172.21.15.50:0/2661492232 reap_dead start 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21e98640 1 -- 172.21.15.50:0/2661492232 shutdown_connections 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21e98640 1 -- 172.21.15.50:0/2661492232 >> 172.21.15.50:0/2661492232 conn(0x7f0a1c06ab80 msgr2=0x7f0a1c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.625+0000 7f0a21e98640 1 -- 172.21.15.50:0/2661492232 shutdown_connections 2023-08-10T10:40:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.626+0000 7f0a21e98640 1 -- 172.21.15.50:0/2661492232 wait complete. 2023-08-10T10:40:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.627+0000 7f0a21e98640 1 Processor -- start 2023-08-10T10:40:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.627+0000 7f0a21e98640 1 -- start start 2023-08-10T10:40:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c0047c0 0x7f0a1c0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c154050 0x7f0a1c0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c6020 con 0x7f0a1c1532a0 2023-08-10T10:40:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c15b410 con 0x7f0a0c0047c0 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.628+0000 7f0a21e98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c15b6f0 con 0x7f0a1c154050 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59700/0 (socket says 172.21.15.50:59700) 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 -- 172.21.15.50:0/1655825201 learned_addr learned my addr 172.21.15.50:0/1655825201 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a20e96640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c0047c0 0x7f0a1c0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a21697640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c154050 0x7f0a1c0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 -- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c154050 msgr2=0x7f0a1c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c154050 0x7f0a1c0ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 -- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c0047c0 msgr2=0x7f0a1c0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c0047c0 0x7f0a1c0c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 -- 172.21.15.50:0/1655825201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c15b9d0 con 0x7f0a1c1532a0 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.629+0000 7f0a1bfff640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a08008fd0 tx=0x7f0a08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.630+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08007a30 con 0x7f0a1c1532a0 2023-08-10T10:40:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.630+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08000ed0 con 0x7f0a1c1532a0 2023-08-10T10:40:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.630+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08006c00 con 0x7f0a1c1532a0 2023-08-10T10:40:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.630+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c0c6020 con 0x7f0a1c1532a0 2023-08-10T10:40:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.630+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c15bf90 con 0x7f0a1c1532a0 2023-08-10T10:40:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.631+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c15c120 con 0x7f0a1c1532a0 2023-08-10T10:40:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.632+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a080035f0 con 0x7f0a1c1532a0 2023-08-10T10:40:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.633+0000 7f0a197fa640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 0x7f0a0006d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.633+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a080ab5a0 con 0x7f0a1c1532a0 2023-08-10T10:40:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.633+0000 7f0a20e96640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 0x7f0a0006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.634+0000 7f0a20e96640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 0x7f0a0006d040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a10001050 tx=0x7f0a10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.640+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0a08076640 con 0x7f0a1c1532a0 2023-08-10T10:40:29.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.836+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a1c15ed90 con 0x7f0a0006ab80 2023-08-10T10:40:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.859+0000 7f0a197fa640 1 -- 172.21.15.50:0/1655825201 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296356 (secure 0 0 0) 0x7f0a10001ca0 con 0x7f0a0006ab80 2023-08-10T10:40:29.865 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:40:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 msgr2=0x7f0a0006d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 0x7f0a0006d040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a10001050 tx=0x7f0a10009040 comp rx=0 tx=0).stop 2023-08-10T10:40:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 msgr2=0x7f0a1c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a08008fd0 tx=0x7f0a08001120 comp rx=0 tx=0).stop 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 shutdown_connections 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a1c154050 0x7f0a1c0ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a1c1532a0 0x7f0a1c153b10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a0006ab80 0x7f0a0006d040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 --2- 172.21.15.50:0/1655825201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a0c0047c0 0x7f0a1c0c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.866+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 >> 172.21.15.50:0/1655825201 conn(0x7f0a1c06ab80 msgr2=0x7f0a1c070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.867+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 shutdown_connections 2023-08-10T10:40:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:29.867+0000 7f0a21e98640 1 -- 172.21.15.50:0/1655825201 wait complete. 2023-08-10T10:40:29.890 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-10T10:40:28.358765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3139,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559360,"statfs":{"total":1600000000,"available":1596785279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.610904"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793647+0000","last_change":"2023-08-10T10:40:24.819297+0000","last_active":"2023-08-10T10:40:25.793647+0000","last_peered":"2023-08-10T10:40:25.793647+0000","last_clean":"2023-08-10T10:40:25.793647+0000","last_became_active":"2023-08-10T10:40:24.818707+0000","last_became_peered":"2023-08-10T10:40:24.818707+0000","last_unstale":"2023-08-10T10:40:25.793647+0000","last_undegraded":"2023-08-10T10:40:25.793647+0000","last_fullsized":"2023-08-10T10:40:25.793647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:47.566051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794029+0000","last_change":"2023-08-10T10:40:24.825555+0000","last_active":"2023-08-10T10:40:25.794029+0000","last_peered":"2023-08-10T10:40:25.794029+0000","last_clean":"2023-08-10T10:40:25.794029+0000","last_became_active":"2023-08-10T10:40:24.825326+0000","last_became_peered":"2023-08-10T10:40:24.825326+0000","last_unstale":"2023-08-10T10:40:25.794029+0000","last_undegraded":"2023-08-10T10:40:25.794029+0000","last_fullsized":"2023-08-10T10:40:25.794029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925958+0000","last_change":"2023-08-10T10:40:24.809581+0000","last_active":"2023-08-10T10:40:26.925958+0000","last_peered":"2023-08-10T10:40:26.925958+0000","last_clean":"2023-08-10T10:40:26.925958+0000","last_became_active":"2023-08-10T10:40:24.809207+0000","last_became_peered":"2023-08-10T10:40:24.809207+0000","last_unstale":"2023-08-10T10:40:26.925958+0000","last_undegraded":"2023-08-10T10:40:26.925958+0000","last_fullsized":"2023-08-10T10:40:26.925958+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.319464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925985+0000","last_change":"2023-08-10T10:40:24.809021+0000","last_active":"2023-08-10T10:40:26.925985+0000","last_peered":"2023-08-10T10:40:26.925985+0000","last_clean":"2023-08-10T10:40:26.925985+0000","last_became_active":"2023-08-10T10:40:24.808722+0000","last_became_peered":"2023-08-10T10:40:24.808722+0000","last_unstale":"2023-08-10T10:40:26.925985+0000","last_undegraded":"2023-08-10T10:40:26.925985+0000","last_fullsized":"2023-08-10T10:40:26.925985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793886+0000","last_change":"2023-08-10T10:40:24.822453+0000","last_active":"2023-08-10T10:40:25.793886+0000","last_peered":"2023-08-10T10:40:25.793886+0000","last_clean":"2023-08-10T10:40:25.793886+0000","last_became_active":"2023-08-10T10:40:24.822211+0000","last_became_peered":"2023-08-10T10:40:24.822211+0000","last_unstale":"2023-08-10T10:40:25.793886+0000","last_undegraded":"2023-08-10T10:40:25.793886+0000","last_fullsized":"2023-08-10T10:40:25.793886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:43.869883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029126+0000","last_change":"2023-08-10T10:40:24.824743+0000","last_active":"2023-08-10T10:40:27.029126+0000","last_peered":"2023-08-10T10:40:27.029126+0000","last_clean":"2023-08-10T10:40:27.029126+0000","last_became_active":"2023-08-10T10:40:24.824477+0000","last_became_peered":"2023-08-10T10:40:24.824477+0000","last_unstale":"2023-08-10T10:40:27.029126+0000","last_undegraded":"2023-08-10T10:40:27.029126+0000","last_fullsized":"2023-08-10T10:40:27.029126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:48.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926255+0000","last_change":"2023-08-10T10:40:24.811049+0000","last_active":"2023-08-10T10:40:26.926255+0000","last_peered":"2023-08-10T10:40:26.926255+0000","last_clean":"2023-08-10T10:40:26.926255+0000","last_became_active":"2023-08-10T10:40:24.810393+0000","last_became_peered":"2023-08-10T10:40:24.810393+0000","last_unstale":"2023-08-10T10:40:26.926255+0000","last_undegraded":"2023-08-10T10:40:26.926255+0000","last_fullsized":"2023-08-10T10:40:26.926255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:47.992472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793741+0000","last_change":"2023-08-10T10:40:24.817177+0000","last_active":"2023-08-10T10:40:25.793741+0000","last_peered":"2023-08-10T10:40:25.793741+0000","last_clean":"2023-08-10T10:40:25.793741+0000","last_became_active":"2023-08-10T10:40:24.816897+0000","last_became_peered":"2023-08-10T10:40:24.816897+0000","last_unstale":"2023-08-10T10:40:25.793741+0000","last_undegraded":"2023-08-10T10:40:25.793741+0000","last_fullsized":"2023-08-10T10:40:25.793741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793852+0000","last_change":"2023-08-10T10:40:24.816495+0000","last_active":"2023-08-10T10:40:25.793852+0000","last_peered":"2023-08-10T10:40:25.793852+0000","last_clean":"2023-08-10T10:40:25.793852+0000","last_became_active":"2023-08-10T10:40:24.816236+0000","last_became_peered":"2023-08-10T10:40:24.816236+0000","last_unstale":"2023-08-10T10:40:25.793852+0000","last_undegraded":"2023-08-10T10:40:25.793852+0000","last_fullsized":"2023-08-10T10:40:25.793852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:59.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926412+0000","last_change":"2023-08-10T10:40:24.810755+0000","last_active":"2023-08-10T10:40:26.926412+0000","last_peered":"2023-08-10T10:40:26.926412+0000","last_clean":"2023-08-10T10:40:26.926412+0000","last_became_active":"2023-08-10T10:40:24.809982+0000","last_became_peered":"2023-08-10T10:40:24.809982+0000","last_unstale":"2023-08-10T10:40:26.926412+0000","last_undegraded":"2023-08-10T10:40:26.926412+0000","last_fullsized":"2023-08-10T10:40:26.926412+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:00.816162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029140+0000","last_change":"2023-08-10T10:40:24.818772+0000","last_active":"2023-08-10T10:40:27.029140+0000","last_peered":"2023-08-10T10:40:27.029140+0000","last_clean":"2023-08-10T10:40:27.029140+0000","last_became_active":"2023-08-10T10:40:24.818516+0000","last_became_peered":"2023-08-10T10:40:24.818516+0000","last_unstale":"2023-08-10T10:40:27.029140+0000","last_undegraded":"2023-08-10T10:40:27.029140+0000","last_fullsized":"2023-08-10T10:40:27.029140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:18.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926222+0000","last_change":"2023-08-10T10:40:24.800429+0000","last_active":"2023-08-10T10:40:26.926222+0000","last_peered":"2023-08-10T10:40:26.926222+0000","last_clean":"2023-08-10T10:40:26.926222+0000","last_became_active":"2023-08-10T10:40:24.800143+0000","last_became_peered":"2023-08-10T10:40:24.800143+0000","last_unstale":"2023-08-10T10:40:26.926222+0000","last_undegraded":"2023-08-10T10:40:26.926222+0000","last_fullsized":"2023-08-10T10:40:26.926222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793511+0000","last_change":"2023-08-10T10:40:24.813750+0000","last_active":"2023-08-10T10:40:25.793511+0000","last_peered":"2023-08-10T10:40:25.793511+0000","last_clean":"2023-08-10T10:40:25.793511+0000","last_became_active":"2023-08-10T10:40:24.813465+0000","last_became_peered":"2023-08-10T10:40:24.813465+0000","last_unstale":"2023-08-10T10:40:25.793511+0000","last_undegraded":"2023-08-10T10:40:25.793511+0000","last_fullsized":"2023-08-10T10:40:25.793511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.892628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755163+0000","last_change":"2023-08-10T10:40:22.755163+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755163+0000","last_undegraded":"2023-08-10T10:40:22.755163+0000","last_fullsized":"2023-08-10T10:40:22.755163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793409+0000","last_change":"2023-08-10T10:40:23.784500+0000","last_active":"2023-08-10T10:40:25.793409+0000","last_peered":"2023-08-10T10:40:25.793409+0000","last_clean":"2023-08-10T10:40:25.793409+0000","last_became_active":"2023-08-10T10:40:23.784247+0000","last_became_peered":"2023-08-10T10:40:23.784247+0000","last_unstale":"2023-08-10T10:40:25.793409+0000","last_undegraded":"2023-08-10T10:40:25.793409+0000","last_fullsized":"2023-08-10T10:40:25.793409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793986+0000","last_change":"2023-08-10T10:40:23.775943+0000","last_active":"2023-08-10T10:40:25.793986+0000","last_peered":"2023-08-10T10:40:25.793986+0000","last_clean":"2023-08-10T10:40:25.793986+0000","last_became_active":"2023-08-10T10:40:23.775676+0000","last_became_peered":"2023-08-10T10:40:23.775676+0000","last_unstale":"2023-08-10T10:40:25.793986+0000","last_undegraded":"2023-08-10T10:40:25.793986+0000","last_fullsized":"2023-08-10T10:40:25.793986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926384+0000","last_change":"2023-08-10T10:40:24.800430+0000","last_active":"2023-08-10T10:40:26.926384+0000","last_peered":"2023-08-10T10:40:26.926384+0000","last_clean":"2023-08-10T10:40:26.926384+0000","last_became_active":"2023-08-10T10:40:24.800197+0000","last_became_peered":"2023-08-10T10:40:24.800197+0000","last_unstale":"2023-08-10T10:40:26.926384+0000","last_undegraded":"2023-08-10T10:40:26.926384+0000","last_fullsized":"2023-08-10T10:40:26.926384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:44.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.759949+0000","last_change":"2023-08-10T10:40:22.759949+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.759949+0000","last_undegraded":"2023-08-10T10:40:22.759949+0000","last_fullsized":"2023-08-10T10:40:22.759949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754036+0000","last_change":"2023-08-10T10:40:22.754036+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754036+0000","last_undegraded":"2023-08-10T10:40:22.754036+0000","last_fullsized":"2023-08-10T10:40:22.754036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.752333+0000","last_change":"2023-08-10T10:40:22.752333+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.752333+0000","last_undegraded":"2023-08-10T10:40:22.752333+0000","last_fullsized":"2023-08-10T10:40:22.752333+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926588+0000","last_change":"2023-08-10T10:40:24.800790+0000","last_active":"2023-08-10T10:40:26.926588+0000","last_peered":"2023-08-10T10:40:26.926588+0000","last_clean":"2023-08-10T10:40:26.926588+0000","last_became_active":"2023-08-10T10:40:24.800146+0000","last_became_peered":"2023-08-10T10:40:24.800146+0000","last_unstale":"2023-08-10T10:40:26.926588+0000","last_undegraded":"2023-08-10T10:40:26.926588+0000","last_fullsized":"2023-08-10T10:40:26.926588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:13.348931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756334+0000","last_change":"2023-08-10T10:40:22.756334+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756334+0000","last_undegraded":"2023-08-10T10:40:22.756334+0000","last_fullsized":"2023-08-10T10:40:22.756334+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.757445+0000","last_change":"2023-08-10T10:40:22.757445+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.757445+0000","last_undegraded":"2023-08-10T10:40:22.757445+0000","last_fullsized":"2023-08-10T10:40:22.757445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.760054+0000","last_change":"2023-08-10T10:40:22.760054+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.760054+0000","last_undegraded":"2023-08-10T10:40:22.760054+0000","last_fullsized":"2023-08-10T10:40:22.760054+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.751594+0000","last_change":"2023-08-10T10:40:22.751594+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.751594+0000","last_undegraded":"2023-08-10T10:40:22.751594+0000","last_fullsized":"2023-08-10T10:40:22.751594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758782+0000","last_change":"2023-08-10T10:40:22.758782+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758782+0000","last_undegraded":"2023-08-10T10:40:22.758782+0000","last_fullsized":"2023-08-10T10:40:22.758782+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926772+0000","last_change":"2023-08-10T10:40:23.783755+0000","last_active":"2023-08-10T10:40:26.926772+0000","last_peered":"2023-08-10T10:40:26.926772+0000","last_clean":"2023-08-10T10:40:26.926772+0000","last_became_active":"2023-08-10T10:40:23.782575+0000","last_became_peered":"2023-08-10T10:40:23.782575+0000","last_unstale":"2023-08-10T10:40:26.926772+0000","last_undegraded":"2023-08-10T10:40:26.926772+0000","last_fullsized":"2023-08-10T10:40:26.926772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:55:37.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756552+0000","last_change":"2023-08-10T10:40:22.756552+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756552+0000","last_undegraded":"2023-08-10T10:40:22.756552+0000","last_fullsized":"2023-08-10T10:40:22.756552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756811+0000","last_change":"2023-08-10T10:40:22.756811+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756811+0000","last_undegraded":"2023-08-10T10:40:22.756811+0000","last_fullsized":"2023-08-10T10:40:22.756811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926168+0000","last_change":"2023-08-10T10:40:24.823798+0000","last_active":"2023-08-10T10:40:26.926168+0000","last_peered":"2023-08-10T10:40:26.926168+0000","last_clean":"2023-08-10T10:40:26.926168+0000","last_became_active":"2023-08-10T10:40:24.823248+0000","last_became_peered":"2023-08-10T10:40:24.823248+0000","last_unstale":"2023-08-10T10:40:26.926168+0000","last_undegraded":"2023-08-10T10:40:26.926168+0000","last_fullsized":"2023-08-10T10:40:26.926168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758912+0000","last_change":"2023-08-10T10:40:22.758912+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758912+0000","last_undegraded":"2023-08-10T10:40:22.758912+0000","last_fullsized":"2023-08-10T10:40:22.758912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926176+0000","last_change":"2023-08-10T10:40:23.781989+0000","last_active":"2023-08-10T10:40:26.926176+0000","last_peered":"2023-08-10T10:40:26.926176+0000","last_clean":"2023-08-10T10:40:26.926176+0000","last_became_active":"2023-08-10T10:40:23.781505+0000","last_became_peered":"2023-08-10T10:40:23.781505+0000","last_unstale":"2023-08-10T10:40:26.926176+0000","last_undegraded":"2023-08-10T10:40:26.926176+0000","last_fullsized":"2023-08-10T10:40:26.926176+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:04.870677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926663+0000","last_change":"2023-08-10T10:40:24.811687+0000","last_active":"2023-08-10T10:40:26.926663+0000","last_peered":"2023-08-10T10:40:26.926663+0000","last_clean":"2023-08-10T10:40:26.926663+0000","last_became_active":"2023-08-10T10:40:24.811405+0000","last_became_peered":"2023-08-10T10:40:24.811405+0000","last_unstale":"2023-08-10T10:40:26.926663+0000","last_undegraded":"2023-08-10T10:40:26.926663+0000","last_fullsized":"2023-08-10T10:40:26.926663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:20:11.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754064+0000","last_change":"2023-08-10T10:40:22.754064+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754064+0000","last_undegraded":"2023-08-10T10:40:22.754064+0000","last_fullsized":"2023-08-10T10:40:22.754064+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793945+0000","last_change":"2023-08-10T10:40:24.814150+0000","last_active":"2023-08-10T10:40:25.793945+0000","last_peered":"2023-08-10T10:40:25.793945+0000","last_clean":"2023-08-10T10:40:25.793945+0000","last_became_active":"2023-08-10T10:40:24.813918+0000","last_became_peered":"2023-08-10T10:40:24.813918+0000","last_unstale":"2023-08-10T10:40:25.793945+0000","last_undegraded":"2023-08-10T10:40:25.793945+0000","last_fullsized":"2023-08-10T10:40:25.793945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029984+0000","last_change":"2023-08-10T10:40:23.780905+0000","last_active":"2023-08-10T10:40:27.029984+0000","last_peered":"2023-08-10T10:40:27.029984+0000","last_clean":"2023-08-10T10:40:27.029984+0000","last_became_active":"2023-08-10T10:40:23.780610+0000","last_became_peered":"2023-08-10T10:40:23.780610+0000","last_unstale":"2023-08-10T10:40:27.029984+0000","last_undegraded":"2023-08-10T10:40:27.029984+0000","last_fullsized":"2023-08-10T10:40:27.029984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:17.908346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755209+0000","last_change":"2023-08-10T10:40:22.755209+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755209+0000","last_undegraded":"2023-08-10T10:40:22.755209+0000","last_fullsized":"2023-08-10T10:40:22.755209+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794197+0000","last_change":"2023-08-10T10:40:24.819437+0000","last_active":"2023-08-10T10:40:25.794197+0000","last_peered":"2023-08-10T10:40:25.794197+0000","last_clean":"2023-08-10T10:40:25.794197+0000","last_became_active":"2023-08-10T10:40:24.819044+0000","last_became_peered":"2023-08-10T10:40:24.819044+0000","last_unstale":"2023-08-10T10:40:25.794197+0000","last_undegraded":"2023-08-10T10:40:25.794197+0000","last_fullsized":"2023-08-10T10:40:25.794197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.756973+0000","last_change":"2023-08-10T10:40:22.756973+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.756973+0000","last_undegraded":"2023-08-10T10:40:22.756973+0000","last_fullsized":"2023-08-10T10:40:22.756973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794071+0000","last_change":"2023-08-10T10:40:23.779688+0000","last_active":"2023-08-10T10:40:25.794071+0000","last_peered":"2023-08-10T10:40:25.794071+0000","last_clean":"2023-08-10T10:40:25.794071+0000","last_became_active":"2023-08-10T10:40:23.779280+0000","last_became_peered":"2023-08-10T10:40:23.779280+0000","last_unstale":"2023-08-10T10:40:25.794071+0000","last_undegraded":"2023-08-10T10:40:25.794071+0000","last_fullsized":"2023-08-10T10:40:25.794071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:56.873303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926986+0000","last_change":"2023-08-10T10:40:23.783433+0000","last_active":"2023-08-10T10:40:26.926986+0000","last_peered":"2023-08-10T10:40:26.926986+0000","last_clean":"2023-08-10T10:40:26.926986+0000","last_became_active":"2023-08-10T10:40:23.782240+0000","last_became_peered":"2023-08-10T10:40:23.782240+0000","last_unstale":"2023-08-10T10:40:26.926986+0000","last_undegraded":"2023-08-10T10:40:26.926986+0000","last_fullsized":"2023-08-10T10:40:26.926986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:29.656096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.755714+0000","last_change":"2023-08-10T10:40:22.755714+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.755714+0000","last_undegraded":"2023-08-10T10:40:22.755714+0000","last_fullsized":"2023-08-10T10:40:22.755714+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793716+0000","last_change":"2023-08-10T10:40:24.812696+0000","last_active":"2023-08-10T10:40:25.793716+0000","last_peered":"2023-08-10T10:40:25.793716+0000","last_clean":"2023-08-10T10:40:25.793716+0000","last_became_active":"2023-08-10T10:40:24.812441+0000","last_became_peered":"2023-08-10T10:40:24.812441+0000","last_unstale":"2023-08-10T10:40:25.793716+0000","last_undegraded":"2023-08-10T10:40:25.793716+0000","last_fullsized":"2023-08-10T10:40:25.793716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:07.596425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029662+0000","last_change":"2023-08-10T10:40:23.778707+0000","last_active":"2023-08-10T10:40:27.029662+0000","last_peered":"2023-08-10T10:40:27.029662+0000","last_clean":"2023-08-10T10:40:27.029662+0000","last_became_active":"2023-08-10T10:40:23.778449+0000","last_became_peered":"2023-08-10T10:40:23.778449+0000","last_unstale":"2023-08-10T10:40:27.029662+0000","last_undegraded":"2023-08-10T10:40:27.029662+0000","last_fullsized":"2023-08-10T10:40:27.029662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:28.984610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754404+0000","last_change":"2023-08-10T10:40:22.754404+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754404+0000","last_undegraded":"2023-08-10T10:40:22.754404+0000","last_fullsized":"2023-08-10T10:40:22.754404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.759063+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:40:22.759063+0000","last_peered":"2023-08-10T10:40:22.759063+0000","last_clean":"2023-08-10T10:40:22.759063+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:40:22.759063+0000","last_undegraded":"2023-08-10T10:40:22.759063+0000","last_fullsized":"2023-08-10T10:40:22.759063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:50.796224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.760431+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:40:22.760431+0000","last_peered":"2023-08-10T10:40:22.760431+0000","last_clean":"2023-08-10T10:40:22.760431+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:40:22.760431+0000","last_undegraded":"2023-08-10T10:40:22.760431+0000","last_fullsized":"2023-08-10T10:40:22.760431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:12.347252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793626+0000","last_change":"2023-08-10T10:40:24.808340+0000","last_active":"2023-08-10T10:40:25.793626+0000","last_peered":"2023-08-10T10:40:25.793626+0000","last_clean":"2023-08-10T10:40:25.793626+0000","last_became_active":"2023-08-10T10:40:24.807791+0000","last_became_peered":"2023-08-10T10:40:24.807791+0000","last_unstale":"2023-08-10T10:40:25.793626+0000","last_undegraded":"2023-08-10T10:40:25.793626+0000","last_fullsized":"2023-08-10T10:40:25.793626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:31.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.757586+0000","last_change":"2023-08-10T10:40:22.757586+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.757586+0000","last_undegraded":"2023-08-10T10:40:22.757586+0000","last_fullsized":"2023-08-10T10:40:22.757586+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.758555+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:40:22.758555+0000","last_peered":"2023-08-10T10:40:22.758555+0000","last_clean":"2023-08-10T10:40:22.758555+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:40:22.758555+0000","last_undegraded":"2023-08-10T10:40:22.758555+0000","last_fullsized":"2023-08-10T10:40:22.758555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:11.898190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926387+0000","last_change":"2023-08-10T10:40:24.798884+0000","last_active":"2023-08-10T10:40:26.926387+0000","last_peered":"2023-08-10T10:40:26.926387+0000","last_clean":"2023-08-10T10:40:26.926387+0000","last_became_active":"2023-08-10T10:40:24.798630+0000","last_became_peered":"2023-08-10T10:40:24.798630+0000","last_unstale":"2023-08-10T10:40:26.926387+0000","last_undegraded":"2023-08-10T10:40:26.926387+0000","last_fullsized":"2023-08-10T10:40:26.926387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:30.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754783+0000","last_change":"2023-08-10T10:40:22.754783+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754783+0000","last_undegraded":"2023-08-10T10:40:22.754783+0000","last_fullsized":"2023-08-10T10:40:22.754783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029590+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:40:27.029590+0000","last_peered":"2023-08-10T10:40:27.029590+0000","last_clean":"2023-08-10T10:40:27.029590+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:40:27.029590+0000","last_undegraded":"2023-08-10T10:40:27.029590+0000","last_fullsized":"2023-08-10T10:40:27.029590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:16.949185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.754989+0000","last_change":"2023-08-10T10:40:22.754989+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.754989+0000","last_undegraded":"2023-08-10T10:40:22.754989+0000","last_fullsized":"2023-08-10T10:40:22.754989+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.757961+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:40:22.757961+0000","last_peered":"2023-08-10T10:40:22.757961+0000","last_clean":"2023-08-10T10:40:22.757961+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:40:22.757961+0000","last_undegraded":"2023-08-10T10:40:22.757961+0000","last_fullsized":"2023-08-10T10:40:22.757961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:15.380803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.751595+0000","last_change":"2023-08-10T10:40:22.751595+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.751595+0000","last_undegraded":"2023-08-10T10:40:22.751595+0000","last_fullsized":"2023-08-10T10:40:22.751595+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794122+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:40:25.794122+0000","last_peered":"2023-08-10T10:40:25.794122+0000","last_clean":"2023-08-10T10:40:25.794122+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:40:25.794122+0000","last_undegraded":"2023-08-10T10:40:25.794122+0000","last_fullsized":"2023-08-10T10:40:25.794122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:46.486996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926361+0000","last_change":"2023-08-10T10:40:24.800161+0000","last_active":"2023-08-10T10:40:26.926361+0000","last_peered":"2023-08-10T10:40:26.926361+0000","last_clean":"2023-08-10T10:40:26.926361+0000","last_became_active":"2023-08-10T10:40:24.799202+0000","last_became_peered":"2023-08-10T10:40:24.799202+0000","last_unstale":"2023-08-10T10:40:26.926361+0000","last_undegraded":"2023-08-10T10:40:26.926361+0000","last_fullsized":"2023-08-10T10:40:26.926361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:47.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-10T10:40:22.758708+0000","last_change":"2023-08-10T10:40:22.758708+0000","last_active":"2023-08-10T10:40:22.732202+0000","last_peered":"2023-08-10T10:40:22.732202+0000","last_clean":"2023-08-10T10:40:22.732202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:22.758708+0000","last_undegraded":"2023-08-10T10:40:22.758708+0000","last_fullsized":"2023-08-10T10:40:22.758708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.758337+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:40:22.758337+0000","last_peered":"2023-08-10T10:40:22.758337+0000","last_clean":"2023-08-10T10:40:22.758337+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:40:22.758337+0000","last_undegraded":"2023-08-10T10:40:22.758337+0000","last_fullsized":"2023-08-10T10:40:22.758337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:31.641300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926425+0000","last_change":"2023-08-10T10:40:23.781205+0000","last_active":"2023-08-10T10:40:26.926425+0000","last_peered":"2023-08-10T10:40:26.926425+0000","last_clean":"2023-08-10T10:40:26.926425+0000","last_became_active":"2023-08-10T10:40:23.780651+0000","last_became_peered":"2023-08-10T10:40:23.780651+0000","last_unstale":"2023-08-10T10:40:26.926425+0000","last_undegraded":"2023-08-10T10:40:26.926425+0000","last_fullsized":"2023-08-10T10:40:26.926425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:43.237165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794275+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:40:25.794275+0000","last_peered":"2023-08-10T10:40:25.794275+0000","last_clean":"2023-08-10T10:40:25.794275+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:40:25.794275+0000","last_undegraded":"2023-08-10T10:40:25.794275+0000","last_fullsized":"2023-08-10T10:40:25.794275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:56.240684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:40:23.746186+0000","last_change":"2023-08-10T10:40:23.746186+0000","last_active":"2023-08-10T10:40:23.746186+0000","last_peered":"2023-08-10T10:40:23.746186+0000","last_clean":"2023-08-10T10:40:23.746186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:40:23.746186+0000","last_undegraded":"2023-08-10T10:40:23.746186+0000","last_fullsized":"2023-08-10T10:40:23.746186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926695+0000","last_change":"2023-08-10T10:40:23.783410+0000","last_active":"2023-08-10T10:40:26.926695+0000","last_peered":"2023-08-10T10:40:26.926695+0000","last_clean":"2023-08-10T10:40:26.926695+0000","last_became_active":"2023-08-10T10:40:23.780450+0000","last_became_peered":"2023-08-10T10:40:23.780450+0000","last_unstale":"2023-08-10T10:40:26.926695+0000","last_undegraded":"2023-08-10T10:40:26.926695+0000","last_fullsized":"2023-08-10T10:40:26.926695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:20.582917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-10T10:40:22.757419+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:40:22.757419+0000","last_peered":"2023-08-10T10:40:22.757419+0000","last_clean":"2023-08-10T10:40:22.757419+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:40:22.757419+0000","last_undegraded":"2023-08-10T10:40:22.757419+0000","last_fullsized":"2023-08-10T10:40:22.757419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:42.442019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168595,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.486,"5min":1.613,"15min":1.613},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.427,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.133,"15min":1.1259999999999999},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4370000000000001,"5min":2.742,"15min":2.742},"last":1.367},{"interface":"front","average":{"1min":1.151,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.71299999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4570000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.206,"15min":1.216},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.548,"5min":1.704,"15min":1.704},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.371,"15min":1.395},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.593,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.103}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6180000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.258},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.244,"15min":1.258},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.611,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.202}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.409,"15min":1.4339999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8240000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.5700000000000001,"15min":1.601},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.78,"5min":2.25,"15min":2.25},"last":1.522},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.484,"15min":1.51},"min":{"1min":0.84299999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.865,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.407}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":241,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199752793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6200000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.486,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.878},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.141,"15min":1.149},"min":{"1min":0.79700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6739999999999999,"5min":1.96,"15min":1.96},"last":1.4339999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.119,"15min":1.107},"min":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.214},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.206,"15min":1.202},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5589999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.173,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6100000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.232},"min":{"1min":0.90900000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.732,"15min":1.732},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1919999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8420000000000001,"5min":2.04,"15min":2.04},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.385,"15min":1.381},"min":{"1min":0.88800000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.79,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.5329999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.383,"15min":1.367},"min":{"1min":0.97199999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8340000000000001,"5min":2.028,"15min":2.028},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9790000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.345,"15min":1.341},"min":{"1min":0.81399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.2690000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.462,"15min":1.448},"min":{"1min":0.93300000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0259999999999998,"5min":2.698,"15min":2.698},"last":1.8100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195072,"statfs":{"total":200000000,"available":199753812,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.093,"15min":1.0640000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.833,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.014,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.484,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.2170000000000001,"15min":1.232},"min":{"1min":0.81999999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5589999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2130000000000001,"15min":1.2350000000000001},"min":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6379999999999999,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3460000000000001,"15min":1.3700000000000001},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.032},{"interface":"front","average":{"1min":1.27,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.246,"15min":1.25},"min":{"1min":0.91100000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3899999999999999,"15min":1.391},"min":{"1min":0.96199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7989999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.151}]},{"osd":4,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.875,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9039999999999999,"5min":2.399,"15min":2.399},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.617,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.343}]},{"osd":6,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.88600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.399,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.49,"15min":1.49},"min":{"1min":1.165,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6990000000000001,"5min":1.885,"15min":1.885},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.484},"min":{"1min":1.161,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.516}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":241,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199752793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4650000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.262},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.181,"15min":1.1930000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.637,"5min":1.667,"15min":1.667},"last":1.4470000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7110000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.119,"15min":1.137},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.365,"5min":1.677,"15min":1.677},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1220000000000001,"15min":1.1299999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.758,"5min":2.004,"15min":2.004},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.272,"15min":1.286},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5409999999999999,"5min":1.893,"15min":1.893},"last":1.141}]},{"osd":3,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5469999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2450000000000001,"15min":1.2549999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":1.863,"15min":1.863},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.343,"15min":1.3540000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8049999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.038},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2749999999999999,"15min":1.2809999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3109999999999999,"15min":1.3160000000000001},"min":{"1min":0.92900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.393,"5min":1.4410000000000001,"15min":1.4490000000000001},"min":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7210000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3939999999999999,"15min":1.401},"min":{"1min":0.68999999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7989999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.29},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4750000000000001,"15min":1.4870000000000001},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.21}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730798,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.93500000000000005,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.93300000000000005,"15min":0.88900000000000001},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.268,"5min":1.042,"15min":1.004},"min":{"1min":0.58299999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.84799999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.079},{"interface":"front","average":{"1min":1.298,"5min":1.1839999999999999,"15min":1.165},"min":{"1min":0.92700000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.2989999999999999,"15min":1.2809999999999999},"min":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0059999999999998,"5min":2.125,"15min":2.125},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.3580000000000001,"15min":1.331},"min":{"1min":0.84499999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.01}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.248,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.3899999999999999,"15min":1.3640000000000001},"min":{"1min":1.002,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.427,"15min":1.403},"min":{"1min":0.94899999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.325,"15min":1.2949999999999999},"min":{"1min":0.96899999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.873},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4359999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.073,"15min":1.0740000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.502,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4199999999999999,"5min":1.639,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2370000000000001,"15min":1.2629999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6259999999999999,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.8069999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.276,"15min":1.282},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6759999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.226}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2490000000000001,"15min":1.254},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.696,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.018},{"interface":"front","average":{"1min":1.391,"5min":1.4630000000000001,"15min":1.4750000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8500000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.351},"min":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.325,"15min":1.329},"min":{"1min":0.85499999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.766,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.371,"15min":1.361},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.405,"15min":1.403},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.2789999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195051,"statfs":{"total":200000000,"available":199732224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.441,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.296,"5min":1.548,"15min":1.548},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6339999999999999,"5min":2.246,"15min":2.246},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.742,"5min":1.913,"15min":1.913},"last":1.105}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0049999999999999,"15min":0.997},"min":{"1min":0.51100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.01},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1399999999999999,"15min":1.119},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.431},{"interface":"front","average":{"1min":1.403,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.629}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3400000000000001,"15min":1.3340000000000001},"min":{"1min":1.0580000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.333},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.752,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.363}]},{"osd":6,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.87,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.232},{"interface":"front","average":{"1min":1.25,"5min":1.204,"15min":1.196},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.294}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.403,"15min":1.411},"min":{"1min":0.81299999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.351,"15min":1.343},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":816,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194495,"statfs":{"total":200000000,"available":199163444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97399999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.442},"max":{"1min":1.387,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0209999999999999,"15min":1.0149999999999999},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4630000000000001,"5min":1.853,"15min":1.853},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.028,"15min":1.018},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.516,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.016}]},{"osd":3,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.62,"5min":0.496,"15min":0.496},"max":{"1min":1.393,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0660000000000001,"15min":1.0820000000000001},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.536,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.054}]},{"osd":4,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.98599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.623,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.04},{"interface":"front","average":{"1min":1.393,"5min":1.377,"15min":1.3740000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.214}]},{"osd":5,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.0069999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":1.986},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.258},"min":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.085}]},{"osd":6,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4350000000000001,"15min":1.4450000000000001},"min":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.0129999999999999,"5min":2.04,"15min":2.04},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.4299999999999999},"min":{"1min":0.95699999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.7869999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.454}]},{"osd":7,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5249999999999999,"15min":1.5329999999999999},"min":{"1min":1.093,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8799999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.389,"15min":1.383},"min":{"1min":0.94499999999999995,"5min":0.879,"15min":0.879},"max":{"1min":1.9610000000000001,"5min":2.601,"15min":2.601},"last":1.6100000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:40:29.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:40:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.164+0000 7f64e9e5e640 1 Processor -- start 2023-08-10T10:40:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.164+0000 7f64e9e5e640 1 -- start start 2023-08-10T10:40:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.165+0000 7f64e9e5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e40b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e9e5e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64e4069db0 0x7f64e40b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e9e5e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e415e1f0 con 0x7f64e40b0f00 2023-08-10T10:40:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e9e5e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e415d5e0 con 0x7f64e4069db0 2023-08-10T10:40:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e9e5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e415d8c0 con 0x7f64e4159970 2023-08-10T10:40:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64e4069db0 0x7f64e40b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64e4069db0 0x7f64e40b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59714/0 (socket says 172.21.15.50:59714) 2023-08-10T10:40:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e3fff640 1 -- 172.21.15.50:0/25059055 learned_addr learned my addr 172.21.15.50:0/25059055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.166+0000 7f64e37fe640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e40b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.167+0000 7f64e3fff640 1 -- 172.21.15.50:0/25059055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 msgr2=0x7f64e40b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.167+0000 7f64e3fff640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e40b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.167+0000 7f64e3fff640 1 -- 172.21.15.50:0/25059055 >> v1:172.21.15.117:6789/0 conn(0x7f64e40b0f00 legacy=0x7f64e40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.167+0000 7f64e3fff640 1 -- 172.21.15.50:0/25059055 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e415dba0 con 0x7f64e4069db0 2023-08-10T10:40:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.168+0000 7f64e3fff640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e4069db0 0x7f64e40b1ae0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bb02c4ce7c6599 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.168+0000 7f64e27fc640 1 -- 172.21.15.50:0/25059055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc031640 con 0x7f64e4069db0 2023-08-10T10:40:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.168+0000 7f64e27fc640 1 -- 172.21.15.50:0/25059055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc0317a0 con 0x7f64e4069db0 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.168+0000 7f64e27fc640 1 -- 172.21.15.50:0/25059055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc031b30 con 0x7f64e4069db0 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 -- 172.21.15.50:0/25059055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e4069db0 msgr2=0x7f64e40b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e4069db0 0x7f64e40b1ae0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 -- 172.21.15.50:0/25059055 shutdown_connections 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e4069db0 0x7f64e40b1ae0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/25059055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e40b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 -- 172.21.15.50:0/25059055 >> 172.21.15.50:0/25059055 conn(0x7f64e406b590 msgr2=0x7f64e40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 -- 172.21.15.50:0/25059055 shutdown_connections 2023-08-10T10:40:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.169+0000 7f64e9e5e640 1 -- 172.21.15.50:0/25059055 wait complete. 2023-08-10T10:40:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.171+0000 7f64e9e5e640 1 Processor -- start 2023-08-10T10:40:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.171+0000 7f64e9e5e640 1 -- start start 2023-08-10T10:40:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e4069db0 0x7f64e40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c4070 con 0x7f64e40b0f00 2023-08-10T10:40:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40b06f0 con 0x7f64e4069db0 2023-08-10T10:40:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e9e5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c2fd0 con 0x7f64e4159970 2023-08-10T10:40:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59720/0 (socket says 172.21.15.50:59720) 2023-08-10T10:40:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e2ffd640 1 -- 172.21.15.50:0/1227443119 learned_addr learned my addr 172.21.15.50:0/1227443119 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.172+0000 7f64e37fe640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e4069db0 0x7f64e40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e3fff640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 -- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 msgr2=0x7f64e4150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e4150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 -- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e4069db0 msgr2=0x7f64e40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e4069db0 0x7f64e40b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 -- 172.21.15.50:0/1227443119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0094d0 con 0x7f64e40b0f00 2023-08-10T10:40:30.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e2ffd640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c430 tx=0x7f64cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc011790 con 0x7f64e40b0f00 2023-08-10T10:40:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0118f0 con 0x7f64e40b0f00 2023-08-10T10:40:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc011ce0 con 0x7f64e40b0f00 2023-08-10T10:40:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.173+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40c32b0 con 0x7f64e40b0f00 2023-08-10T10:40:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.174+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e40c3870 con 0x7f64e40b0f00 2023-08-10T10:40:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.175+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e404e270 con 0x7f64e40b0f00 2023-08-10T10:40:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.176+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64cc01c460 con 0x7f64e40b0f00 2023-08-10T10:40:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.176+0000 7f64dbfff640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 0x7f64c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.177+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64cc089520 con 0x7f64e40b0f00 2023-08-10T10:40:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.177+0000 7f64e37fe640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 0x7f64c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.177+0000 7f64e37fe640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 0x7f64c406d110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64d40099c0 tx=0x7f64d4003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.181+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f64cc054530 con 0x7f64e40b0f00 2023-08-10T10:40:30.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.369+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64e4159d50 con 0x7f64c406ac50 2023-08-10T10:40:30.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.393+0000 7f64dbfff640 1 -- 172.21.15.50:0/1227443119 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302932 (secure 0 0 0) 0x7f64d40046c0 con 0x7f64c406ac50 2023-08-10T10:40:30.400 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:30.402 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:40:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 msgr2=0x7f64c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 0x7f64c406d110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64d40099c0 tx=0x7f64d4003990 comp rx=0 tx=0).stop 2023-08-10T10:40:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 msgr2=0x7f64e41500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c430 tx=0x7f64cc00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 shutdown_connections 2023-08-10T10:40:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64e4159970 0x7f64e4150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e40b0f00 0x7f64e41500d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c406ac50 0x7f64c406d110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 --2- 172.21.15.50:0/1227443119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e4069db0 0x7f64e40b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.400+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 >> 172.21.15.50:0/1227443119 conn(0x7f64e406b590 msgr2=0x7f64e40cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.401+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 shutdown_connections 2023-08-10T10:40:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.401+0000 7f64e9e5e640 1 -- 172.21.15.50:0/1227443119 wait complete. 2023-08-10T10:40:30.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-08-10T10:40:30.359508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3246,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559253,"statfs":{"total":1600000000,"available":1596675650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.605165"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793647+0000","last_change":"2023-08-10T10:40:24.819297+0000","last_active":"2023-08-10T10:40:25.793647+0000","last_peered":"2023-08-10T10:40:25.793647+0000","last_clean":"2023-08-10T10:40:25.793647+0000","last_became_active":"2023-08-10T10:40:24.818707+0000","last_became_peered":"2023-08-10T10:40:24.818707+0000","last_unstale":"2023-08-10T10:40:25.793647+0000","last_undegraded":"2023-08-10T10:40:25.793647+0000","last_fullsized":"2023-08-10T10:40:25.793647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:47.566051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927741+0000","last_change":"2023-08-10T10:40:24.826025+0000","last_active":"2023-08-10T10:40:26.927741+0000","last_peered":"2023-08-10T10:40:26.927741+0000","last_clean":"2023-08-10T10:40:26.927741+0000","last_became_active":"2023-08-10T10:40:24.825801+0000","last_became_peered":"2023-08-10T10:40:24.825801+0000","last_unstale":"2023-08-10T10:40:26.927741+0000","last_undegraded":"2023-08-10T10:40:26.927741+0000","last_fullsized":"2023-08-10T10:40:26.927741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:26.431836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950498+0000","last_change":"2023-08-10T10:40:24.810909+0000","last_active":"2023-08-10T10:40:26.950498+0000","last_peered":"2023-08-10T10:40:26.950498+0000","last_clean":"2023-08-10T10:40:26.950498+0000","last_became_active":"2023-08-10T10:40:24.809876+0000","last_became_peered":"2023-08-10T10:40:24.809876+0000","last_unstale":"2023-08-10T10:40:26.950498+0000","last_undegraded":"2023-08-10T10:40:26.950498+0000","last_fullsized":"2023-08-10T10:40:26.950498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:23.622167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927461+0000","last_change":"2023-08-10T10:40:24.821547+0000","last_active":"2023-08-10T10:40:26.927461+0000","last_peered":"2023-08-10T10:40:26.927461+0000","last_clean":"2023-08-10T10:40:26.927461+0000","last_became_active":"2023-08-10T10:40:24.821285+0000","last_became_peered":"2023-08-10T10:40:24.821285+0000","last_unstale":"2023-08-10T10:40:26.927461+0000","last_undegraded":"2023-08-10T10:40:26.927461+0000","last_fullsized":"2023-08-10T10:40:26.927461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:57.962021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800370+0000","last_change":"2023-08-10T10:40:24.821946+0000","last_active":"2023-08-10T10:40:25.800370+0000","last_peered":"2023-08-10T10:40:25.800370+0000","last_clean":"2023-08-10T10:40:25.800370+0000","last_became_active":"2023-08-10T10:40:24.821611+0000","last_became_peered":"2023-08-10T10:40:24.821611+0000","last_unstale":"2023-08-10T10:40:25.800370+0000","last_undegraded":"2023-08-10T10:40:25.800370+0000","last_fullsized":"2023-08-10T10:40:25.800370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794029+0000","last_change":"2023-08-10T10:40:24.825555+0000","last_active":"2023-08-10T10:40:25.794029+0000","last_peered":"2023-08-10T10:40:25.794029+0000","last_clean":"2023-08-10T10:40:25.794029+0000","last_became_active":"2023-08-10T10:40:24.825326+0000","last_became_peered":"2023-08-10T10:40:24.825326+0000","last_unstale":"2023-08-10T10:40:25.794029+0000","last_undegraded":"2023-08-10T10:40:25.794029+0000","last_fullsized":"2023-08-10T10:40:25.794029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950462+0000","last_change":"2023-08-10T10:40:24.810497+0000","last_active":"2023-08-10T10:40:26.950462+0000","last_peered":"2023-08-10T10:40:26.950462+0000","last_clean":"2023-08-10T10:40:26.950462+0000","last_became_active":"2023-08-10T10:40:24.809819+0000","last_became_peered":"2023-08-10T10:40:24.809819+0000","last_unstale":"2023-08-10T10:40:26.950462+0000","last_undegraded":"2023-08-10T10:40:26.950462+0000","last_fullsized":"2023-08-10T10:40:26.950462+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:37.459852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925958+0000","last_change":"2023-08-10T10:40:24.809581+0000","last_active":"2023-08-10T10:40:26.925958+0000","last_peered":"2023-08-10T10:40:26.925958+0000","last_clean":"2023-08-10T10:40:26.925958+0000","last_became_active":"2023-08-10T10:40:24.809207+0000","last_became_peered":"2023-08-10T10:40:24.809207+0000","last_unstale":"2023-08-10T10:40:26.925958+0000","last_undegraded":"2023-08-10T10:40:26.925958+0000","last_fullsized":"2023-08-10T10:40:26.925958+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.319464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925985+0000","last_change":"2023-08-10T10:40:24.809021+0000","last_active":"2023-08-10T10:40:26.925985+0000","last_peered":"2023-08-10T10:40:26.925985+0000","last_clean":"2023-08-10T10:40:26.925985+0000","last_became_active":"2023-08-10T10:40:24.808722+0000","last_became_peered":"2023-08-10T10:40:24.808722+0000","last_unstale":"2023-08-10T10:40:26.925985+0000","last_undegraded":"2023-08-10T10:40:26.925985+0000","last_fullsized":"2023-08-10T10:40:26.925985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793886+0000","last_change":"2023-08-10T10:40:24.822453+0000","last_active":"2023-08-10T10:40:25.793886+0000","last_peered":"2023-08-10T10:40:25.793886+0000","last_clean":"2023-08-10T10:40:25.793886+0000","last_became_active":"2023-08-10T10:40:24.822211+0000","last_became_peered":"2023-08-10T10:40:24.822211+0000","last_unstale":"2023-08-10T10:40:25.793886+0000","last_undegraded":"2023-08-10T10:40:25.793886+0000","last_fullsized":"2023-08-10T10:40:25.793886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:43.869883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029126+0000","last_change":"2023-08-10T10:40:24.824743+0000","last_active":"2023-08-10T10:40:27.029126+0000","last_peered":"2023-08-10T10:40:27.029126+0000","last_clean":"2023-08-10T10:40:27.029126+0000","last_became_active":"2023-08-10T10:40:24.824477+0000","last_became_peered":"2023-08-10T10:40:24.824477+0000","last_unstale":"2023-08-10T10:40:27.029126+0000","last_undegraded":"2023-08-10T10:40:27.029126+0000","last_fullsized":"2023-08-10T10:40:27.029126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:48.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926255+0000","last_change":"2023-08-10T10:40:24.811049+0000","last_active":"2023-08-10T10:40:26.926255+0000","last_peered":"2023-08-10T10:40:26.926255+0000","last_clean":"2023-08-10T10:40:26.926255+0000","last_became_active":"2023-08-10T10:40:24.810393+0000","last_became_peered":"2023-08-10T10:40:24.810393+0000","last_unstale":"2023-08-10T10:40:26.926255+0000","last_undegraded":"2023-08-10T10:40:26.926255+0000","last_fullsized":"2023-08-10T10:40:26.926255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:47.992472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793741+0000","last_change":"2023-08-10T10:40:24.817177+0000","last_active":"2023-08-10T10:40:25.793741+0000","last_peered":"2023-08-10T10:40:25.793741+0000","last_clean":"2023-08-10T10:40:25.793741+0000","last_became_active":"2023-08-10T10:40:24.816897+0000","last_became_peered":"2023-08-10T10:40:24.816897+0000","last_unstale":"2023-08-10T10:40:25.793741+0000","last_undegraded":"2023-08-10T10:40:25.793741+0000","last_fullsized":"2023-08-10T10:40:25.793741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950439+0000","last_change":"2023-08-10T10:40:24.813196+0000","last_active":"2023-08-10T10:40:26.950439+0000","last_peered":"2023-08-10T10:40:26.950439+0000","last_clean":"2023-08-10T10:40:26.950439+0000","last_became_active":"2023-08-10T10:40:24.812791+0000","last_became_peered":"2023-08-10T10:40:24.812791+0000","last_unstale":"2023-08-10T10:40:26.950439+0000","last_undegraded":"2023-08-10T10:40:26.950439+0000","last_fullsized":"2023-08-10T10:40:26.950439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:06.144104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928356+0000","last_change":"2023-08-10T10:40:24.823572+0000","last_active":"2023-08-10T10:40:26.928356+0000","last_peered":"2023-08-10T10:40:26.928356+0000","last_clean":"2023-08-10T10:40:26.928356+0000","last_became_active":"2023-08-10T10:40:24.823304+0000","last_became_peered":"2023-08-10T10:40:24.823304+0000","last_unstale":"2023-08-10T10:40:26.928356+0000","last_undegraded":"2023-08-10T10:40:26.928356+0000","last_fullsized":"2023-08-10T10:40:26.928356+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:47.448633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793852+0000","last_change":"2023-08-10T10:40:24.816495+0000","last_active":"2023-08-10T10:40:25.793852+0000","last_peered":"2023-08-10T10:40:25.793852+0000","last_clean":"2023-08-10T10:40:25.793852+0000","last_became_active":"2023-08-10T10:40:24.816236+0000","last_became_peered":"2023-08-10T10:40:24.816236+0000","last_unstale":"2023-08-10T10:40:25.793852+0000","last_undegraded":"2023-08-10T10:40:25.793852+0000","last_fullsized":"2023-08-10T10:40:25.793852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:59.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950825+0000","last_change":"2023-08-10T10:40:24.825629+0000","last_active":"2023-08-10T10:40:26.950825+0000","last_peered":"2023-08-10T10:40:26.950825+0000","last_clean":"2023-08-10T10:40:26.950825+0000","last_became_active":"2023-08-10T10:40:24.825189+0000","last_became_peered":"2023-08-10T10:40:24.825189+0000","last_unstale":"2023-08-10T10:40:26.950825+0000","last_undegraded":"2023-08-10T10:40:26.950825+0000","last_fullsized":"2023-08-10T10:40:26.950825+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:44.656604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927540+0000","last_change":"2023-08-10T10:40:24.820809+0000","last_active":"2023-08-10T10:40:26.927540+0000","last_peered":"2023-08-10T10:40:26.927540+0000","last_clean":"2023-08-10T10:40:26.927540+0000","last_became_active":"2023-08-10T10:40:24.819946+0000","last_became_peered":"2023-08-10T10:40:24.819946+0000","last_unstale":"2023-08-10T10:40:26.927540+0000","last_undegraded":"2023-08-10T10:40:26.927540+0000","last_fullsized":"2023-08-10T10:40:26.927540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:55.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950222+0000","last_change":"2023-08-10T10:40:24.820089+0000","last_active":"2023-08-10T10:40:26.950222+0000","last_peered":"2023-08-10T10:40:26.950222+0000","last_clean":"2023-08-10T10:40:26.950222+0000","last_became_active":"2023-08-10T10:40:24.819656+0000","last_became_peered":"2023-08-10T10:40:24.819656+0000","last_unstale":"2023-08-10T10:40:26.950222+0000","last_undegraded":"2023-08-10T10:40:26.950222+0000","last_fullsized":"2023-08-10T10:40:26.950222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:02.236304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928603+0000","last_change":"2023-08-10T10:40:24.825090+0000","last_active":"2023-08-10T10:40:26.928603+0000","last_peered":"2023-08-10T10:40:26.928603+0000","last_clean":"2023-08-10T10:40:26.928603+0000","last_became_active":"2023-08-10T10:40:24.824657+0000","last_became_peered":"2023-08-10T10:40:24.824657+0000","last_unstale":"2023-08-10T10:40:26.928603+0000","last_undegraded":"2023-08-10T10:40:26.928603+0000","last_fullsized":"2023-08-10T10:40:26.928603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:26.593162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927498+0000","last_change":"2023-08-10T10:40:24.827481+0000","last_active":"2023-08-10T10:40:26.927498+0000","last_peered":"2023-08-10T10:40:26.927498+0000","last_clean":"2023-08-10T10:40:26.927498+0000","last_became_active":"2023-08-10T10:40:24.827080+0000","last_became_peered":"2023-08-10T10:40:24.827080+0000","last_unstale":"2023-08-10T10:40:26.927498+0000","last_undegraded":"2023-08-10T10:40:26.927498+0000","last_fullsized":"2023-08-10T10:40:26.927498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:57:50.126890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926412+0000","last_change":"2023-08-10T10:40:24.810755+0000","last_active":"2023-08-10T10:40:26.926412+0000","last_peered":"2023-08-10T10:40:26.926412+0000","last_clean":"2023-08-10T10:40:26.926412+0000","last_became_active":"2023-08-10T10:40:24.809982+0000","last_became_peered":"2023-08-10T10:40:24.809982+0000","last_unstale":"2023-08-10T10:40:26.926412+0000","last_undegraded":"2023-08-10T10:40:26.926412+0000","last_fullsized":"2023-08-10T10:40:26.926412+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:00.816162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029140+0000","last_change":"2023-08-10T10:40:24.818772+0000","last_active":"2023-08-10T10:40:27.029140+0000","last_peered":"2023-08-10T10:40:27.029140+0000","last_clean":"2023-08-10T10:40:27.029140+0000","last_became_active":"2023-08-10T10:40:24.818516+0000","last_became_peered":"2023-08-10T10:40:24.818516+0000","last_unstale":"2023-08-10T10:40:27.029140+0000","last_undegraded":"2023-08-10T10:40:27.029140+0000","last_fullsized":"2023-08-10T10:40:27.029140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:18.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950658+0000","last_change":"2023-08-10T10:40:24.813047+0000","last_active":"2023-08-10T10:40:26.950658+0000","last_peered":"2023-08-10T10:40:26.950658+0000","last_clean":"2023-08-10T10:40:26.950658+0000","last_became_active":"2023-08-10T10:40:24.812364+0000","last_became_peered":"2023-08-10T10:40:24.812364+0000","last_unstale":"2023-08-10T10:40:26.950658+0000","last_undegraded":"2023-08-10T10:40:26.950658+0000","last_fullsized":"2023-08-10T10:40:26.950658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:48.663407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950191+0000","last_change":"2023-08-10T10:40:24.813194+0000","last_active":"2023-08-10T10:40:26.950191+0000","last_peered":"2023-08-10T10:40:26.950191+0000","last_clean":"2023-08-10T10:40:26.950191+0000","last_became_active":"2023-08-10T10:40:24.812949+0000","last_became_peered":"2023-08-10T10:40:24.812949+0000","last_unstale":"2023-08-10T10:40:26.950191+0000","last_undegraded":"2023-08-10T10:40:26.950191+0000","last_fullsized":"2023-08-10T10:40:26.950191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:46.730566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926222+0000","last_change":"2023-08-10T10:40:24.800429+0000","last_active":"2023-08-10T10:40:26.926222+0000","last_peered":"2023-08-10T10:40:26.926222+0000","last_clean":"2023-08-10T10:40:26.926222+0000","last_became_active":"2023-08-10T10:40:24.800143+0000","last_became_peered":"2023-08-10T10:40:24.800143+0000","last_unstale":"2023-08-10T10:40:26.926222+0000","last_undegraded":"2023-08-10T10:40:26.926222+0000","last_fullsized":"2023-08-10T10:40:26.926222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793511+0000","last_change":"2023-08-10T10:40:24.813750+0000","last_active":"2023-08-10T10:40:25.793511+0000","last_peered":"2023-08-10T10:40:25.793511+0000","last_clean":"2023-08-10T10:40:25.793511+0000","last_became_active":"2023-08-10T10:40:24.813465+0000","last_became_peered":"2023-08-10T10:40:24.813465+0000","last_unstale":"2023-08-10T10:40:25.793511+0000","last_undegraded":"2023-08-10T10:40:25.793511+0000","last_fullsized":"2023-08-10T10:40:25.793511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.892628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927452+0000","last_change":"2023-08-10T10:40:24.810252+0000","last_active":"2023-08-10T10:40:26.927452+0000","last_peered":"2023-08-10T10:40:26.927452+0000","last_clean":"2023-08-10T10:40:26.927452+0000","last_became_active":"2023-08-10T10:40:24.809664+0000","last_became_peered":"2023-08-10T10:40:24.809664+0000","last_unstale":"2023-08-10T10:40:26.927452+0000","last_undegraded":"2023-08-10T10:40:26.927452+0000","last_fullsized":"2023-08-10T10:40:26.927452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:55.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950865+0000","last_change":"2023-08-10T10:40:24.816841+0000","last_active":"2023-08-10T10:40:26.950865+0000","last_peered":"2023-08-10T10:40:26.950865+0000","last_clean":"2023-08-10T10:40:26.950865+0000","last_became_active":"2023-08-10T10:40:24.816426+0000","last_became_peered":"2023-08-10T10:40:24.816426+0000","last_unstale":"2023-08-10T10:40:26.950865+0000","last_undegraded":"2023-08-10T10:40:26.950865+0000","last_fullsized":"2023-08-10T10:40:26.950865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:27.176324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928716+0000","last_change":"2023-08-10T10:40:24.817678+0000","last_active":"2023-08-10T10:40:26.928716+0000","last_peered":"2023-08-10T10:40:26.928716+0000","last_clean":"2023-08-10T10:40:26.928716+0000","last_became_active":"2023-08-10T10:40:24.817364+0000","last_became_peered":"2023-08-10T10:40:24.817364+0000","last_unstale":"2023-08-10T10:40:26.928716+0000","last_undegraded":"2023-08-10T10:40:26.928716+0000","last_fullsized":"2023-08-10T10:40:26.928716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:11.524071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950305+0000","last_change":"2023-08-10T10:40:24.810723+0000","last_active":"2023-08-10T10:40:26.950305+0000","last_peered":"2023-08-10T10:40:26.950305+0000","last_clean":"2023-08-10T10:40:26.950305+0000","last_became_active":"2023-08-10T10:40:24.810513+0000","last_became_peered":"2023-08-10T10:40:24.810513+0000","last_unstale":"2023-08-10T10:40:26.950305+0000","last_undegraded":"2023-08-10T10:40:26.950305+0000","last_fullsized":"2023-08-10T10:40:26.950305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:31.743560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799135+0000","last_change":"2023-08-10T10:40:24.821404+0000","last_active":"2023-08-10T10:40:25.799135+0000","last_peered":"2023-08-10T10:40:25.799135+0000","last_clean":"2023-08-10T10:40:25.799135+0000","last_became_active":"2023-08-10T10:40:24.820416+0000","last_became_peered":"2023-08-10T10:40:24.820416+0000","last_unstale":"2023-08-10T10:40:25.799135+0000","last_undegraded":"2023-08-10T10:40:25.799135+0000","last_fullsized":"2023-08-10T10:40:25.799135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:08.314818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929000+0000","last_change":"2023-08-10T10:40:24.822019+0000","last_active":"2023-08-10T10:40:26.929000+0000","last_peered":"2023-08-10T10:40:26.929000+0000","last_clean":"2023-08-10T10:40:26.929000+0000","last_became_active":"2023-08-10T10:40:24.820481+0000","last_became_peered":"2023-08-10T10:40:24.820481+0000","last_unstale":"2023-08-10T10:40:26.929000+0000","last_undegraded":"2023-08-10T10:40:26.929000+0000","last_fullsized":"2023-08-10T10:40:26.929000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:42.939869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927747+0000","last_change":"2023-08-10T10:40:23.781267+0000","last_active":"2023-08-10T10:40:26.927747+0000","last_peered":"2023-08-10T10:40:26.927747+0000","last_clean":"2023-08-10T10:40:26.927747+0000","last_became_active":"2023-08-10T10:40:23.779166+0000","last_became_peered":"2023-08-10T10:40:23.779166+0000","last_unstale":"2023-08-10T10:40:26.927747+0000","last_undegraded":"2023-08-10T10:40:26.927747+0000","last_fullsized":"2023-08-10T10:40:26.927747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:48.412032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799486+0000","last_change":"2023-08-10T10:40:24.821563+0000","last_active":"2023-08-10T10:40:25.799486+0000","last_peered":"2023-08-10T10:40:25.799486+0000","last_clean":"2023-08-10T10:40:25.799486+0000","last_became_active":"2023-08-10T10:40:24.821153+0000","last_became_peered":"2023-08-10T10:40:24.821153+0000","last_unstale":"2023-08-10T10:40:25.799486+0000","last_undegraded":"2023-08-10T10:40:25.799486+0000","last_fullsized":"2023-08-10T10:40:25.799486+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:06:08.970227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793409+0000","last_change":"2023-08-10T10:40:23.784500+0000","last_active":"2023-08-10T10:40:25.793409+0000","last_peered":"2023-08-10T10:40:25.793409+0000","last_clean":"2023-08-10T10:40:25.793409+0000","last_became_active":"2023-08-10T10:40:23.784247+0000","last_became_peered":"2023-08-10T10:40:23.784247+0000","last_unstale":"2023-08-10T10:40:25.793409+0000","last_undegraded":"2023-08-10T10:40:25.793409+0000","last_fullsized":"2023-08-10T10:40:25.793409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927888+0000","last_change":"2023-08-10T10:40:24.826402+0000","last_active":"2023-08-10T10:40:26.927888+0000","last_peered":"2023-08-10T10:40:26.927888+0000","last_clean":"2023-08-10T10:40:26.927888+0000","last_became_active":"2023-08-10T10:40:24.826145+0000","last_became_peered":"2023-08-10T10:40:24.826145+0000","last_unstale":"2023-08-10T10:40:26.927888+0000","last_undegraded":"2023-08-10T10:40:26.927888+0000","last_fullsized":"2023-08-10T10:40:26.927888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:12:06.733699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793986+0000","last_change":"2023-08-10T10:40:23.775943+0000","last_active":"2023-08-10T10:40:25.793986+0000","last_peered":"2023-08-10T10:40:25.793986+0000","last_clean":"2023-08-10T10:40:25.793986+0000","last_became_active":"2023-08-10T10:40:23.775676+0000","last_became_peered":"2023-08-10T10:40:23.775676+0000","last_unstale":"2023-08-10T10:40:25.793986+0000","last_undegraded":"2023-08-10T10:40:25.793986+0000","last_fullsized":"2023-08-10T10:40:25.793986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926384+0000","last_change":"2023-08-10T10:40:24.800430+0000","last_active":"2023-08-10T10:40:26.926384+0000","last_peered":"2023-08-10T10:40:26.926384+0000","last_clean":"2023-08-10T10:40:26.926384+0000","last_became_active":"2023-08-10T10:40:24.800197+0000","last_became_peered":"2023-08-10T10:40:24.800197+0000","last_unstale":"2023-08-10T10:40:26.926384+0000","last_undegraded":"2023-08-10T10:40:26.926384+0000","last_fullsized":"2023-08-10T10:40:26.926384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:44.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800957+0000","last_change":"2023-08-10T10:40:23.767248+0000","last_active":"2023-08-10T10:40:25.800957+0000","last_peered":"2023-08-10T10:40:25.800957+0000","last_clean":"2023-08-10T10:40:25.800957+0000","last_became_active":"2023-08-10T10:40:23.766543+0000","last_became_peered":"2023-08-10T10:40:23.766543+0000","last_unstale":"2023-08-10T10:40:25.800957+0000","last_undegraded":"2023-08-10T10:40:25.800957+0000","last_fullsized":"2023-08-10T10:40:25.800957+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:19:36.638106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799121+0000","last_change":"2023-08-10T10:40:24.817065+0000","last_active":"2023-08-10T10:40:25.799121+0000","last_peered":"2023-08-10T10:40:25.799121+0000","last_clean":"2023-08-10T10:40:25.799121+0000","last_became_active":"2023-08-10T10:40:24.815962+0000","last_became_peered":"2023-08-10T10:40:24.815962+0000","last_unstale":"2023-08-10T10:40:25.799121+0000","last_undegraded":"2023-08-10T10:40:25.799121+0000","last_fullsized":"2023-08-10T10:40:25.799121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.951166+0000","last_change":"2023-08-10T10:40:23.778353+0000","last_active":"2023-08-10T10:40:26.951166+0000","last_peered":"2023-08-10T10:40:26.951166+0000","last_clean":"2023-08-10T10:40:26.951166+0000","last_became_active":"2023-08-10T10:40:23.778082+0000","last_became_peered":"2023-08-10T10:40:23.778082+0000","last_unstale":"2023-08-10T10:40:26.951166+0000","last_undegraded":"2023-08-10T10:40:26.951166+0000","last_fullsized":"2023-08-10T10:40:26.951166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:24.878645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928609+0000","last_change":"2023-08-10T10:40:24.818529+0000","last_active":"2023-08-10T10:40:26.928609+0000","last_peered":"2023-08-10T10:40:26.928609+0000","last_clean":"2023-08-10T10:40:26.928609+0000","last_became_active":"2023-08-10T10:40:24.816469+0000","last_became_peered":"2023-08-10T10:40:24.816469+0000","last_unstale":"2023-08-10T10:40:26.928609+0000","last_undegraded":"2023-08-10T10:40:26.928609+0000","last_fullsized":"2023-08-10T10:40:26.928609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:41:57.964501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799100+0000","last_change":"2023-08-10T10:40:23.773137+0000","last_active":"2023-08-10T10:40:25.799100+0000","last_peered":"2023-08-10T10:40:25.799100+0000","last_clean":"2023-08-10T10:40:25.799100+0000","last_became_active":"2023-08-10T10:40:23.772367+0000","last_became_peered":"2023-08-10T10:40:23.772367+0000","last_unstale":"2023-08-10T10:40:25.799100+0000","last_undegraded":"2023-08-10T10:40:25.799100+0000","last_fullsized":"2023-08-10T10:40:25.799100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:58.463276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926588+0000","last_change":"2023-08-10T10:40:24.800790+0000","last_active":"2023-08-10T10:40:26.926588+0000","last_peered":"2023-08-10T10:40:26.926588+0000","last_clean":"2023-08-10T10:40:26.926588+0000","last_became_active":"2023-08-10T10:40:24.800146+0000","last_became_peered":"2023-08-10T10:40:24.800146+0000","last_unstale":"2023-08-10T10:40:26.926588+0000","last_undegraded":"2023-08-10T10:40:26.926588+0000","last_fullsized":"2023-08-10T10:40:26.926588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:13.348931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927516+0000","last_change":"2023-08-10T10:40:23.781681+0000","last_active":"2023-08-10T10:40:26.927516+0000","last_peered":"2023-08-10T10:40:26.927516+0000","last_clean":"2023-08-10T10:40:26.927516+0000","last_became_active":"2023-08-10T10:40:23.781336+0000","last_became_peered":"2023-08-10T10:40:23.781336+0000","last_unstale":"2023-08-10T10:40:26.927516+0000","last_undegraded":"2023-08-10T10:40:26.927516+0000","last_fullsized":"2023-08-10T10:40:26.927516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:52.540797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929349+0000","last_change":"2023-08-10T10:40:24.828683+0000","last_active":"2023-08-10T10:40:26.929349+0000","last_peered":"2023-08-10T10:40:26.929349+0000","last_clean":"2023-08-10T10:40:26.929349+0000","last_became_active":"2023-08-10T10:40:24.828132+0000","last_became_peered":"2023-08-10T10:40:24.828132+0000","last_unstale":"2023-08-10T10:40:26.929349+0000","last_undegraded":"2023-08-10T10:40:26.929349+0000","last_fullsized":"2023-08-10T10:40:26.929349+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:29.280310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950400+0000","last_change":"2023-08-10T10:40:23.783973+0000","last_active":"2023-08-10T10:40:26.950400+0000","last_peered":"2023-08-10T10:40:26.950400+0000","last_clean":"2023-08-10T10:40:26.950400+0000","last_became_active":"2023-08-10T10:40:23.783129+0000","last_became_peered":"2023-08-10T10:40:23.783129+0000","last_unstale":"2023-08-10T10:40:26.950400+0000","last_undegraded":"2023-08-10T10:40:26.950400+0000","last_fullsized":"2023-08-10T10:40:26.950400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:01.222729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800860+0000","last_change":"2023-08-10T10:40:24.801603+0000","last_active":"2023-08-10T10:40:25.800860+0000","last_peered":"2023-08-10T10:40:25.800860+0000","last_clean":"2023-08-10T10:40:25.800860+0000","last_became_active":"2023-08-10T10:40:24.800967+0000","last_became_peered":"2023-08-10T10:40:24.800967+0000","last_unstale":"2023-08-10T10:40:25.800860+0000","last_undegraded":"2023-08-10T10:40:25.800860+0000","last_fullsized":"2023-08-10T10:40:25.800860+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929456+0000","last_change":"2023-08-10T10:40:23.781796+0000","last_active":"2023-08-10T10:40:26.929456+0000","last_peered":"2023-08-10T10:40:26.929456+0000","last_clean":"2023-08-10T10:40:26.929456+0000","last_became_active":"2023-08-10T10:40:23.779727+0000","last_became_peered":"2023-08-10T10:40:23.779727+0000","last_unstale":"2023-08-10T10:40:26.929456+0000","last_undegraded":"2023-08-10T10:40:26.929456+0000","last_fullsized":"2023-08-10T10:40:26.929456+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:47.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.798767+0000","last_change":"2023-08-10T10:40:24.820149+0000","last_active":"2023-08-10T10:40:25.798767+0000","last_peered":"2023-08-10T10:40:25.798767+0000","last_clean":"2023-08-10T10:40:25.798767+0000","last_became_active":"2023-08-10T10:40:24.818757+0000","last_became_peered":"2023-08-10T10:40:24.818757+0000","last_unstale":"2023-08-10T10:40:25.798767+0000","last_undegraded":"2023-08-10T10:40:25.798767+0000","last_fullsized":"2023-08-10T10:40:25.798767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:21.608151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800191+0000","last_change":"2023-08-10T10:40:23.778598+0000","last_active":"2023-08-10T10:40:25.800191+0000","last_peered":"2023-08-10T10:40:25.800191+0000","last_clean":"2023-08-10T10:40:25.800191+0000","last_became_active":"2023-08-10T10:40:23.778175+0000","last_became_peered":"2023-08-10T10:40:23.778175+0000","last_unstale":"2023-08-10T10:40:25.800191+0000","last_undegraded":"2023-08-10T10:40:25.800191+0000","last_fullsized":"2023-08-10T10:40:25.800191+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950387+0000","last_change":"2023-08-10T10:40:24.826194+0000","last_active":"2023-08-10T10:40:26.950387+0000","last_peered":"2023-08-10T10:40:26.950387+0000","last_clean":"2023-08-10T10:40:26.950387+0000","last_became_active":"2023-08-10T10:40:24.822969+0000","last_became_peered":"2023-08-10T10:40:24.822969+0000","last_unstale":"2023-08-10T10:40:26.950387+0000","last_undegraded":"2023-08-10T10:40:26.950387+0000","last_fullsized":"2023-08-10T10:40:26.950387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:23.163693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929247+0000","last_change":"2023-08-10T10:40:23.782294+0000","last_active":"2023-08-10T10:40:26.929247+0000","last_peered":"2023-08-10T10:40:26.929247+0000","last_clean":"2023-08-10T10:40:26.929247+0000","last_became_active":"2023-08-10T10:40:23.778805+0000","last_became_peered":"2023-08-10T10:40:23.778805+0000","last_unstale":"2023-08-10T10:40:26.929247+0000","last_undegraded":"2023-08-10T10:40:26.929247+0000","last_fullsized":"2023-08-10T10:40:26.929247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:06:58.831750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799655+0000","last_change":"2023-08-10T10:40:24.801153+0000","last_active":"2023-08-10T10:40:25.799655+0000","last_peered":"2023-08-10T10:40:25.799655+0000","last_clean":"2023-08-10T10:40:25.799655+0000","last_became_active":"2023-08-10T10:40:24.800508+0000","last_became_peered":"2023-08-10T10:40:24.800508+0000","last_unstale":"2023-08-10T10:40:25.799655+0000","last_undegraded":"2023-08-10T10:40:25.799655+0000","last_fullsized":"2023-08-10T10:40:25.799655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926772+0000","last_change":"2023-08-10T10:40:23.783755+0000","last_active":"2023-08-10T10:40:26.926772+0000","last_peered":"2023-08-10T10:40:26.926772+0000","last_clean":"2023-08-10T10:40:26.926772+0000","last_became_active":"2023-08-10T10:40:23.782575+0000","last_became_peered":"2023-08-10T10:40:23.782575+0000","last_unstale":"2023-08-10T10:40:26.926772+0000","last_undegraded":"2023-08-10T10:40:26.926772+0000","last_fullsized":"2023-08-10T10:40:26.926772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:55:37.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800419+0000","last_change":"2023-08-10T10:40:24.828401+0000","last_active":"2023-08-10T10:40:25.800419+0000","last_peered":"2023-08-10T10:40:25.800419+0000","last_clean":"2023-08-10T10:40:25.800419+0000","last_became_active":"2023-08-10T10:40:24.827989+0000","last_became_peered":"2023-08-10T10:40:24.827989+0000","last_unstale":"2023-08-10T10:40:25.800419+0000","last_undegraded":"2023-08-10T10:40:25.800419+0000","last_fullsized":"2023-08-10T10:40:25.800419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:15.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950495+0000","last_change":"2023-08-10T10:40:23.783373+0000","last_active":"2023-08-10T10:40:26.950495+0000","last_peered":"2023-08-10T10:40:26.950495+0000","last_clean":"2023-08-10T10:40:26.950495+0000","last_became_active":"2023-08-10T10:40:23.782348+0000","last_became_peered":"2023-08-10T10:40:23.782348+0000","last_unstale":"2023-08-10T10:40:26.950495+0000","last_undegraded":"2023-08-10T10:40:26.950495+0000","last_fullsized":"2023-08-10T10:40:26.950495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:48:05.690784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950321+0000","last_change":"2023-08-10T10:40:24.811792+0000","last_active":"2023-08-10T10:40:26.950321+0000","last_peered":"2023-08-10T10:40:26.950321+0000","last_clean":"2023-08-10T10:40:26.950321+0000","last_became_active":"2023-08-10T10:40:24.811530+0000","last_became_peered":"2023-08-10T10:40:24.811530+0000","last_unstale":"2023-08-10T10:40:26.950321+0000","last_undegraded":"2023-08-10T10:40:26.950321+0000","last_fullsized":"2023-08-10T10:40:26.950321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:15.607685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928142+0000","last_change":"2023-08-10T10:40:23.781482+0000","last_active":"2023-08-10T10:40:26.928142+0000","last_peered":"2023-08-10T10:40:26.928142+0000","last_clean":"2023-08-10T10:40:26.928142+0000","last_became_active":"2023-08-10T10:40:23.779712+0000","last_became_peered":"2023-08-10T10:40:23.779712+0000","last_unstale":"2023-08-10T10:40:26.928142+0000","last_undegraded":"2023-08-10T10:40:26.928142+0000","last_fullsized":"2023-08-10T10:40:26.928142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:47.310601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926168+0000","last_change":"2023-08-10T10:40:24.823798+0000","last_active":"2023-08-10T10:40:26.926168+0000","last_peered":"2023-08-10T10:40:26.926168+0000","last_clean":"2023-08-10T10:40:26.926168+0000","last_became_active":"2023-08-10T10:40:24.823248+0000","last_became_peered":"2023-08-10T10:40:24.823248+0000","last_unstale":"2023-08-10T10:40:26.926168+0000","last_undegraded":"2023-08-10T10:40:26.926168+0000","last_fullsized":"2023-08-10T10:40:26.926168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927945+0000","last_change":"2023-08-10T10:40:23.780297+0000","last_active":"2023-08-10T10:40:26.927945+0000","last_peered":"2023-08-10T10:40:26.927945+0000","last_clean":"2023-08-10T10:40:26.927945+0000","last_became_active":"2023-08-10T10:40:23.779830+0000","last_became_peered":"2023-08-10T10:40:23.779830+0000","last_unstale":"2023-08-10T10:40:26.927945+0000","last_undegraded":"2023-08-10T10:40:26.927945+0000","last_fullsized":"2023-08-10T10:40:26.927945+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:36.541780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950238+0000","last_change":"2023-08-10T10:40:24.814662+0000","last_active":"2023-08-10T10:40:26.950238+0000","last_peered":"2023-08-10T10:40:26.950238+0000","last_clean":"2023-08-10T10:40:26.950238+0000","last_became_active":"2023-08-10T10:40:24.814402+0000","last_became_peered":"2023-08-10T10:40:24.814402+0000","last_unstale":"2023-08-10T10:40:26.950238+0000","last_undegraded":"2023-08-10T10:40:26.950238+0000","last_fullsized":"2023-08-10T10:40:26.950238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:50:56.111731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926176+0000","last_change":"2023-08-10T10:40:23.781989+0000","last_active":"2023-08-10T10:40:26.926176+0000","last_peered":"2023-08-10T10:40:26.926176+0000","last_clean":"2023-08-10T10:40:26.926176+0000","last_became_active":"2023-08-10T10:40:23.781505+0000","last_became_peered":"2023-08-10T10:40:23.781505+0000","last_unstale":"2023-08-10T10:40:26.926176+0000","last_undegraded":"2023-08-10T10:40:26.926176+0000","last_fullsized":"2023-08-10T10:40:26.926176+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:04.870677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926663+0000","last_change":"2023-08-10T10:40:24.811687+0000","last_active":"2023-08-10T10:40:26.926663+0000","last_peered":"2023-08-10T10:40:26.926663+0000","last_clean":"2023-08-10T10:40:26.926663+0000","last_became_active":"2023-08-10T10:40:24.811405+0000","last_became_peered":"2023-08-10T10:40:24.811405+0000","last_unstale":"2023-08-10T10:40:26.926663+0000","last_undegraded":"2023-08-10T10:40:26.926663+0000","last_fullsized":"2023-08-10T10:40:26.926663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:20:11.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950993+0000","last_change":"2023-08-10T10:40:23.784794+0000","last_active":"2023-08-10T10:40:26.950993+0000","last_peered":"2023-08-10T10:40:26.950993+0000","last_clean":"2023-08-10T10:40:26.950993+0000","last_became_active":"2023-08-10T10:40:23.784256+0000","last_became_peered":"2023-08-10T10:40:23.784256+0000","last_unstale":"2023-08-10T10:40:26.950993+0000","last_undegraded":"2023-08-10T10:40:26.950993+0000","last_fullsized":"2023-08-10T10:40:26.950993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793945+0000","last_change":"2023-08-10T10:40:24.814150+0000","last_active":"2023-08-10T10:40:25.793945+0000","last_peered":"2023-08-10T10:40:25.793945+0000","last_clean":"2023-08-10T10:40:25.793945+0000","last_became_active":"2023-08-10T10:40:24.813918+0000","last_became_peered":"2023-08-10T10:40:24.813918+0000","last_unstale":"2023-08-10T10:40:25.793945+0000","last_undegraded":"2023-08-10T10:40:25.793945+0000","last_fullsized":"2023-08-10T10:40:25.793945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029984+0000","last_change":"2023-08-10T10:40:23.780905+0000","last_active":"2023-08-10T10:40:27.029984+0000","last_peered":"2023-08-10T10:40:27.029984+0000","last_clean":"2023-08-10T10:40:27.029984+0000","last_became_active":"2023-08-10T10:40:23.780610+0000","last_became_peered":"2023-08-10T10:40:23.780610+0000","last_unstale":"2023-08-10T10:40:27.029984+0000","last_undegraded":"2023-08-10T10:40:27.029984+0000","last_fullsized":"2023-08-10T10:40:27.029984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:17.908346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799985+0000","last_change":"2023-08-10T10:40:24.814932+0000","last_active":"2023-08-10T10:40:25.799985+0000","last_peered":"2023-08-10T10:40:25.799985+0000","last_clean":"2023-08-10T10:40:25.799985+0000","last_became_active":"2023-08-10T10:40:24.814425+0000","last_became_peered":"2023-08-10T10:40:24.814425+0000","last_unstale":"2023-08-10T10:40:25.799985+0000","last_undegraded":"2023-08-10T10:40:25.799985+0000","last_fullsized":"2023-08-10T10:40:25.799985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928460+0000","last_change":"2023-08-10T10:40:23.777530+0000","last_active":"2023-08-10T10:40:26.928460+0000","last_peered":"2023-08-10T10:40:26.928460+0000","last_clean":"2023-08-10T10:40:26.928460+0000","last_became_active":"2023-08-10T10:40:23.777083+0000","last_became_peered":"2023-08-10T10:40:23.777083+0000","last_unstale":"2023-08-10T10:40:26.928460+0000","last_undegraded":"2023-08-10T10:40:26.928460+0000","last_fullsized":"2023-08-10T10:40:26.928460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:17.301863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794197+0000","last_change":"2023-08-10T10:40:24.819437+0000","last_active":"2023-08-10T10:40:25.794197+0000","last_peered":"2023-08-10T10:40:25.794197+0000","last_clean":"2023-08-10T10:40:25.794197+0000","last_became_active":"2023-08-10T10:40:24.819044+0000","last_became_peered":"2023-08-10T10:40:24.819044+0000","last_unstale":"2023-08-10T10:40:25.794197+0000","last_undegraded":"2023-08-10T10:40:25.794197+0000","last_fullsized":"2023-08-10T10:40:25.794197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927387+0000","last_change":"2023-08-10T10:40:23.775506+0000","last_active":"2023-08-10T10:40:26.927387+0000","last_peered":"2023-08-10T10:40:26.927387+0000","last_clean":"2023-08-10T10:40:26.927387+0000","last_became_active":"2023-08-10T10:40:23.774895+0000","last_became_peered":"2023-08-10T10:40:23.774895+0000","last_unstale":"2023-08-10T10:40:26.927387+0000","last_undegraded":"2023-08-10T10:40:26.927387+0000","last_fullsized":"2023-08-10T10:40:26.927387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:31.676819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799877+0000","last_change":"2023-08-10T10:40:24.822943+0000","last_active":"2023-08-10T10:40:25.799877+0000","last_peered":"2023-08-10T10:40:25.799877+0000","last_clean":"2023-08-10T10:40:25.799877+0000","last_became_active":"2023-08-10T10:40:24.822668+0000","last_became_peered":"2023-08-10T10:40:24.822668+0000","last_unstale":"2023-08-10T10:40:25.799877+0000","last_undegraded":"2023-08-10T10:40:25.799877+0000","last_fullsized":"2023-08-10T10:40:25.799877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:47.706213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794071+0000","last_change":"2023-08-10T10:40:23.779688+0000","last_active":"2023-08-10T10:40:25.794071+0000","last_peered":"2023-08-10T10:40:25.794071+0000","last_clean":"2023-08-10T10:40:25.794071+0000","last_became_active":"2023-08-10T10:40:23.779280+0000","last_became_peered":"2023-08-10T10:40:23.779280+0000","last_unstale":"2023-08-10T10:40:25.794071+0000","last_undegraded":"2023-08-10T10:40:25.794071+0000","last_fullsized":"2023-08-10T10:40:25.794071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:56.873303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927073+0000","last_change":"2023-08-10T10:40:24.820029+0000","last_active":"2023-08-10T10:40:26.927073+0000","last_peered":"2023-08-10T10:40:26.927073+0000","last_clean":"2023-08-10T10:40:26.927073+0000","last_became_active":"2023-08-10T10:40:24.819120+0000","last_became_peered":"2023-08-10T10:40:24.819120+0000","last_unstale":"2023-08-10T10:40:26.927073+0000","last_undegraded":"2023-08-10T10:40:26.927073+0000","last_fullsized":"2023-08-10T10:40:26.927073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:09.748763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926986+0000","last_change":"2023-08-10T10:40:23.783433+0000","last_active":"2023-08-10T10:40:26.926986+0000","last_peered":"2023-08-10T10:40:26.926986+0000","last_clean":"2023-08-10T10:40:26.926986+0000","last_became_active":"2023-08-10T10:40:23.782240+0000","last_became_peered":"2023-08-10T10:40:23.782240+0000","last_unstale":"2023-08-10T10:40:26.926986+0000","last_undegraded":"2023-08-10T10:40:26.926986+0000","last_fullsized":"2023-08-10T10:40:26.926986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:29.656096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950637+0000","last_change":"2023-08-10T10:40:24.823492+0000","last_active":"2023-08-10T10:40:26.950637+0000","last_peered":"2023-08-10T10:40:26.950637+0000","last_clean":"2023-08-10T10:40:26.950637+0000","last_became_active":"2023-08-10T10:40:24.822087+0000","last_became_peered":"2023-08-10T10:40:24.822087+0000","last_unstale":"2023-08-10T10:40:26.950637+0000","last_undegraded":"2023-08-10T10:40:26.950637+0000","last_fullsized":"2023-08-10T10:40:26.950637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:34.038306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950615+0000","last_change":"2023-08-10T10:40:23.780308+0000","last_active":"2023-08-10T10:40:26.950615+0000","last_peered":"2023-08-10T10:40:26.950615+0000","last_clean":"2023-08-10T10:40:26.950615+0000","last_became_active":"2023-08-10T10:40:23.779723+0000","last_became_peered":"2023-08-10T10:40:23.779723+0000","last_unstale":"2023-08-10T10:40:26.950615+0000","last_undegraded":"2023-08-10T10:40:26.950615+0000","last_fullsized":"2023-08-10T10:40:26.950615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:00.077955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793716+0000","last_change":"2023-08-10T10:40:24.812696+0000","last_active":"2023-08-10T10:40:25.793716+0000","last_peered":"2023-08-10T10:40:25.793716+0000","last_clean":"2023-08-10T10:40:25.793716+0000","last_became_active":"2023-08-10T10:40:24.812441+0000","last_became_peered":"2023-08-10T10:40:24.812441+0000","last_unstale":"2023-08-10T10:40:25.793716+0000","last_undegraded":"2023-08-10T10:40:25.793716+0000","last_fullsized":"2023-08-10T10:40:25.793716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:07.596425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029662+0000","last_change":"2023-08-10T10:40:23.778707+0000","last_active":"2023-08-10T10:40:27.029662+0000","last_peered":"2023-08-10T10:40:27.029662+0000","last_clean":"2023-08-10T10:40:27.029662+0000","last_became_active":"2023-08-10T10:40:23.778449+0000","last_became_peered":"2023-08-10T10:40:23.778449+0000","last_unstale":"2023-08-10T10:40:27.029662+0000","last_undegraded":"2023-08-10T10:40:27.029662+0000","last_fullsized":"2023-08-10T10:40:27.029662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:28.984610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928973+0000","last_change":"2023-08-10T10:40:24.814930+0000","last_active":"2023-08-10T10:40:26.928973+0000","last_peered":"2023-08-10T10:40:26.928973+0000","last_clean":"2023-08-10T10:40:26.928973+0000","last_became_active":"2023-08-10T10:40:24.814400+0000","last_became_peered":"2023-08-10T10:40:24.814400+0000","last_unstale":"2023-08-10T10:40:26.928973+0000","last_undegraded":"2023-08-10T10:40:26.928973+0000","last_fullsized":"2023-08-10T10:40:26.928973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:29.998594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950744+0000","last_change":"2023-08-10T10:40:23.777097+0000","last_active":"2023-08-10T10:40:26.950744+0000","last_peered":"2023-08-10T10:40:26.950744+0000","last_clean":"2023-08-10T10:40:26.950744+0000","last_became_active":"2023-08-10T10:40:23.776782+0000","last_became_peered":"2023-08-10T10:40:23.776782+0000","last_unstale":"2023-08-10T10:40:26.950744+0000","last_undegraded":"2023-08-10T10:40:26.950744+0000","last_fullsized":"2023-08-10T10:40:26.950744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:57.254611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928783+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:40:26.928783+0000","last_peered":"2023-08-10T10:40:26.928783+0000","last_clean":"2023-08-10T10:40:26.928783+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:40:26.928783+0000","last_undegraded":"2023-08-10T10:40:26.928783+0000","last_fullsized":"2023-08-10T10:40:26.928783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:53.614758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.801106+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:40:25.801106+0000","last_peered":"2023-08-10T10:40:25.801106+0000","last_clean":"2023-08-10T10:40:25.801106+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:40:25.801106+0000","last_undegraded":"2023-08-10T10:40:25.801106+0000","last_fullsized":"2023-08-10T10:40:25.801106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:46.238601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793626+0000","last_change":"2023-08-10T10:40:24.808340+0000","last_active":"2023-08-10T10:40:25.793626+0000","last_peered":"2023-08-10T10:40:25.793626+0000","last_clean":"2023-08-10T10:40:25.793626+0000","last_became_active":"2023-08-10T10:40:24.807791+0000","last_became_peered":"2023-08-10T10:40:24.807791+0000","last_unstale":"2023-08-10T10:40:25.793626+0000","last_undegraded":"2023-08-10T10:40:25.793626+0000","last_fullsized":"2023-08-10T10:40:25.793626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:31.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928023+0000","last_change":"2023-08-10T10:40:23.778912+0000","last_active":"2023-08-10T10:40:26.928023+0000","last_peered":"2023-08-10T10:40:26.928023+0000","last_clean":"2023-08-10T10:40:26.928023+0000","last_became_active":"2023-08-10T10:40:23.778573+0000","last_became_peered":"2023-08-10T10:40:23.778573+0000","last_unstale":"2023-08-10T10:40:26.928023+0000","last_undegraded":"2023-08-10T10:40:26.928023+0000","last_fullsized":"2023-08-10T10:40:26.928023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:54.113644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928390+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:40:26.928390+0000","last_peered":"2023-08-10T10:40:26.928390+0000","last_clean":"2023-08-10T10:40:26.928390+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:40:26.928390+0000","last_undegraded":"2023-08-10T10:40:26.928390+0000","last_fullsized":"2023-08-10T10:40:26.928390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:01.408663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926387+0000","last_change":"2023-08-10T10:40:24.798884+0000","last_active":"2023-08-10T10:40:26.926387+0000","last_peered":"2023-08-10T10:40:26.926387+0000","last_clean":"2023-08-10T10:40:26.926387+0000","last_became_active":"2023-08-10T10:40:24.798630+0000","last_became_peered":"2023-08-10T10:40:24.798630+0000","last_unstale":"2023-08-10T10:40:26.926387+0000","last_undegraded":"2023-08-10T10:40:26.926387+0000","last_fullsized":"2023-08-10T10:40:26.926387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:30.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950732+0000","last_change":"2023-08-10T10:40:23.780167+0000","last_active":"2023-08-10T10:40:26.950732+0000","last_peered":"2023-08-10T10:40:26.950732+0000","last_clean":"2023-08-10T10:40:26.950732+0000","last_became_active":"2023-08-10T10:40:23.779006+0000","last_became_peered":"2023-08-10T10:40:23.779006+0000","last_unstale":"2023-08-10T10:40:26.950732+0000","last_undegraded":"2023-08-10T10:40:26.950732+0000","last_fullsized":"2023-08-10T10:40:26.950732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:42.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029590+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:40:27.029590+0000","last_peered":"2023-08-10T10:40:27.029590+0000","last_clean":"2023-08-10T10:40:27.029590+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:40:27.029590+0000","last_undegraded":"2023-08-10T10:40:27.029590+0000","last_fullsized":"2023-08-10T10:40:27.029590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:16.949185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800837+0000","last_change":"2023-08-10T10:40:24.816266+0000","last_active":"2023-08-10T10:40:25.800837+0000","last_peered":"2023-08-10T10:40:25.800837+0000","last_clean":"2023-08-10T10:40:25.800837+0000","last_became_active":"2023-08-10T10:40:24.815712+0000","last_became_peered":"2023-08-10T10:40:24.815712+0000","last_unstale":"2023-08-10T10:40:25.800837+0000","last_undegraded":"2023-08-10T10:40:25.800837+0000","last_fullsized":"2023-08-10T10:40:25.800837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:58.265168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927731+0000","last_change":"2023-08-10T10:40:23.781544+0000","last_active":"2023-08-10T10:40:26.927731+0000","last_peered":"2023-08-10T10:40:26.927731+0000","last_clean":"2023-08-10T10:40:26.927731+0000","last_became_active":"2023-08-10T10:40:23.780994+0000","last_became_peered":"2023-08-10T10:40:23.780994+0000","last_unstale":"2023-08-10T10:40:26.927731+0000","last_undegraded":"2023-08-10T10:40:26.927731+0000","last_fullsized":"2023-08-10T10:40:26.927731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:00.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799867+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:40:25.799867+0000","last_peered":"2023-08-10T10:40:25.799867+0000","last_clean":"2023-08-10T10:40:25.799867+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:40:25.799867+0000","last_undegraded":"2023-08-10T10:40:25.799867+0000","last_fullsized":"2023-08-10T10:40:25.799867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:34:13.190807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950839+0000","last_change":"2023-08-10T10:40:24.809284+0000","last_active":"2023-08-10T10:40:26.950839+0000","last_peered":"2023-08-10T10:40:26.950839+0000","last_clean":"2023-08-10T10:40:26.950839+0000","last_became_active":"2023-08-10T10:40:24.809045+0000","last_became_peered":"2023-08-10T10:40:24.809045+0000","last_unstale":"2023-08-10T10:40:26.950839+0000","last_undegraded":"2023-08-10T10:40:26.950839+0000","last_fullsized":"2023-08-10T10:40:26.950839+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:38.580281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799440+0000","last_change":"2023-08-10T10:40:23.763017+0000","last_active":"2023-08-10T10:40:25.799440+0000","last_peered":"2023-08-10T10:40:25.799440+0000","last_clean":"2023-08-10T10:40:25.799440+0000","last_became_active":"2023-08-10T10:40:23.762280+0000","last_became_peered":"2023-08-10T10:40:23.762280+0000","last_unstale":"2023-08-10T10:40:25.799440+0000","last_undegraded":"2023-08-10T10:40:25.799440+0000","last_fullsized":"2023-08-10T10:40:25.799440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:42.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794122+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:40:25.794122+0000","last_peered":"2023-08-10T10:40:25.794122+0000","last_clean":"2023-08-10T10:40:25.794122+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:40:25.794122+0000","last_undegraded":"2023-08-10T10:40:25.794122+0000","last_fullsized":"2023-08-10T10:40:25.794122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:46.486996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926361+0000","last_change":"2023-08-10T10:40:24.800161+0000","last_active":"2023-08-10T10:40:26.926361+0000","last_peered":"2023-08-10T10:40:26.926361+0000","last_clean":"2023-08-10T10:40:26.926361+0000","last_became_active":"2023-08-10T10:40:24.799202+0000","last_became_peered":"2023-08-10T10:40:24.799202+0000","last_unstale":"2023-08-10T10:40:26.926361+0000","last_undegraded":"2023-08-10T10:40:26.926361+0000","last_fullsized":"2023-08-10T10:40:26.926361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:47.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799019+0000","last_change":"2023-08-10T10:40:23.774983+0000","last_active":"2023-08-10T10:40:25.799019+0000","last_peered":"2023-08-10T10:40:25.799019+0000","last_clean":"2023-08-10T10:40:25.799019+0000","last_became_active":"2023-08-10T10:40:23.774282+0000","last_became_peered":"2023-08-10T10:40:23.774282+0000","last_unstale":"2023-08-10T10:40:25.799019+0000","last_undegraded":"2023-08-10T10:40:25.799019+0000","last_fullsized":"2023-08-10T10:40:25.799019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:27:48.841515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927710+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:40:26.927710+0000","last_peered":"2023-08-10T10:40:26.927710+0000","last_clean":"2023-08-10T10:40:26.927710+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:40:26.927710+0000","last_undegraded":"2023-08-10T10:40:26.927710+0000","last_fullsized":"2023-08-10T10:40:26.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:46.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950994+0000","last_change":"2023-08-10T10:40:24.813983+0000","last_active":"2023-08-10T10:40:26.950994+0000","last_peered":"2023-08-10T10:40:26.950994+0000","last_clean":"2023-08-10T10:40:26.950994+0000","last_became_active":"2023-08-10T10:40:24.813752+0000","last_became_peered":"2023-08-10T10:40:24.813752+0000","last_unstale":"2023-08-10T10:40:26.950994+0000","last_undegraded":"2023-08-10T10:40:26.950994+0000","last_fullsized":"2023-08-10T10:40:26.950994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:57:49.594396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926425+0000","last_change":"2023-08-10T10:40:23.781205+0000","last_active":"2023-08-10T10:40:26.926425+0000","last_peered":"2023-08-10T10:40:26.926425+0000","last_clean":"2023-08-10T10:40:26.926425+0000","last_became_active":"2023-08-10T10:40:23.780651+0000","last_became_peered":"2023-08-10T10:40:23.780651+0000","last_unstale":"2023-08-10T10:40:26.926425+0000","last_undegraded":"2023-08-10T10:40:26.926425+0000","last_fullsized":"2023-08-10T10:40:26.926425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:43.237165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794275+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:40:25.794275+0000","last_peered":"2023-08-10T10:40:25.794275+0000","last_clean":"2023-08-10T10:40:25.794275+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:40:25.794275+0000","last_undegraded":"2023-08-10T10:40:25.794275+0000","last_fullsized":"2023-08-10T10:40:25.794275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:56.240684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800661+0000","last_change":"2023-08-10T10:40:24.828245+0000","last_active":"2023-08-10T10:40:25.800661+0000","last_peered":"2023-08-10T10:40:25.800661+0000","last_clean":"2023-08-10T10:40:25.800661+0000","last_became_active":"2023-08-10T10:40:24.825941+0000","last_became_peered":"2023-08-10T10:40:24.825941+0000","last_unstale":"2023-08-10T10:40:25.800661+0000","last_undegraded":"2023-08-10T10:40:25.800661+0000","last_fullsized":"2023-08-10T10:40:25.800661+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:20.079337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926695+0000","last_change":"2023-08-10T10:40:23.783410+0000","last_active":"2023-08-10T10:40:26.926695+0000","last_peered":"2023-08-10T10:40:26.926695+0000","last_clean":"2023-08-10T10:40:26.926695+0000","last_became_active":"2023-08-10T10:40:23.780450+0000","last_became_peered":"2023-08-10T10:40:23.780450+0000","last_unstale":"2023-08-10T10:40:26.926695+0000","last_undegraded":"2023-08-10T10:40:26.926695+0000","last_fullsized":"2023-08-10T10:40:26.926695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:20.582917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928130+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:40:26.928130+0000","last_peered":"2023-08-10T10:40:26.928130+0000","last_clean":"2023-08-10T10:40:26.928130+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:40:26.928130+0000","last_undegraded":"2023-08-10T10:40:26.928130+0000","last_fullsized":"2023-08-10T10:40:26.928130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:31.999688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":837,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.486,"5min":1.613,"15min":1.613},"last":1.5189999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.427,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.05},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.133,"15min":1.1259999999999999},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4370000000000001,"5min":2.742,"15min":2.742},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.71299999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4570000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.5860000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.206,"15min":1.216},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.548,"5min":1.704,"15min":1.704},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.371,"15min":1.395},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.593,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6180000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.244,"15min":1.258},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.611,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.417}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.409,"15min":1.4339999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.482},{"interface":"front","average":{"1min":1.359,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8240000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.111}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.5700000000000001,"15min":1.601},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.78,"5min":2.25,"15min":2.25},"last":1.27},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.484,"15min":1.51},"min":{"1min":0.84299999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.865,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.2370000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6200000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.5609999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.486,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.141,"15min":1.149},"min":{"1min":0.79700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6739999999999999,"5min":1.96,"15min":1.96},"last":1.482}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.119,"15min":1.107},"min":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.206,"15min":1.202},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5589999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.173,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6100000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.755},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.232},"min":{"1min":0.90900000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.732,"15min":1.732},"last":1.3819999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1919999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8420000000000001,"5min":2.04,"15min":2.04},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.385,"15min":1.381},"min":{"1min":0.88800000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.79,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.3}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.383,"15min":1.367},"min":{"1min":0.97199999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8340000000000001,"5min":2.028,"15min":2.028},"last":1.671},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9790000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.087}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.345,"15min":1.341},"min":{"1min":0.81399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.2690000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.995},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.462,"15min":1.448},"min":{"1min":0.93300000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0259999999999998,"5min":2.698,"15min":2.698},"last":1.1259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195052,"statfs":{"total":200000000,"available":199733403,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.093,"15min":1.0640000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.833,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.014,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.484,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.4650000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.2170000000000001,"15min":1.232},"min":{"1min":0.81999999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5589999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2130000000000001,"15min":1.2350000000000001},"min":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6379999999999999,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3460000000000001,"15min":1.3700000000000001},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.246,"15min":1.25},"min":{"1min":0.91100000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3899999999999999,"15min":1.391},"min":{"1min":0.96199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7989999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.4339999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.875,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9039999999999999,"5min":2.399,"15min":2.399},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.617,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.333}]},{"osd":6,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.88600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.583},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.399,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.49,"15min":1.49},"min":{"1min":1.165,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6990000000000001,"5min":1.885,"15min":1.885},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.484},"min":{"1min":1.161,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.508}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4650000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.512},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.181,"15min":1.1930000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.637,"5min":1.667,"15min":1.667},"last":1.232}]},{"osd":1,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7110000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.119,"15min":1.137},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.365,"5min":1.677,"15min":1.677},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1220000000000001,"15min":1.1299999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.758,"5min":2.004,"15min":2.004},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.272,"15min":1.286},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5409999999999999,"5min":1.893,"15min":1.893},"last":1.3839999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5469999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2450000000000001,"15min":1.2549999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":1.863,"15min":1.863},"last":1.6830000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.343,"15min":1.3540000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8049999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.474},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2749999999999999,"15min":1.2809999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.6399999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3109999999999999,"15min":1.3160000000000001},"min":{"1min":0.92900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":1.349},{"interface":"front","average":{"1min":1.393,"5min":1.4410000000000001,"15min":1.4490000000000001},"min":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7210000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.601}]},{"osd":7,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3939999999999999,"15min":1.401},"min":{"1min":0.68999999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7989999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4750000000000001,"15min":1.4870000000000001},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.788}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730798,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.93500000000000005,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.93300000000000005,"15min":0.88900000000000001},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.268,"5min":1.042,"15min":1.004},"min":{"1min":0.58299999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.84799999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.079},{"interface":"front","average":{"1min":1.298,"5min":1.1839999999999999,"15min":1.165},"min":{"1min":0.92700000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.2989999999999999,"15min":1.2809999999999999},"min":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0059999999999998,"5min":2.125,"15min":2.125},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.3580000000000001,"15min":1.331},"min":{"1min":0.84499999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.01}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.248,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.3899999999999999,"15min":1.3640000000000001},"min":{"1min":1.002,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.427,"15min":1.403},"min":{"1min":0.94899999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.325,"15min":1.2949999999999999},"min":{"1min":0.96899999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.873},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4359999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.073,"15min":1.0740000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.502,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4199999999999999,"5min":1.639,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2370000000000001,"15min":1.2629999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6259999999999999,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.8069999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.276,"15min":1.282},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6759999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.226}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2490000000000001,"15min":1.254},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.696,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.018},{"interface":"front","average":{"1min":1.391,"5min":1.4630000000000001,"15min":1.4750000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8500000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.351},"min":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.325,"15min":1.329},"min":{"1min":0.85499999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.766,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.371,"15min":1.361},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.405,"15min":1.403},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.2789999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195051,"statfs":{"total":200000000,"available":199732224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.441,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.296,"5min":1.548,"15min":1.548},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6339999999999999,"5min":2.246,"15min":2.246},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.742,"5min":1.913,"15min":1.913},"last":1.105}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0049999999999999,"15min":0.997},"min":{"1min":0.51100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.01},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1399999999999999,"15min":1.119},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.431},{"interface":"front","average":{"1min":1.403,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.629}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3400000000000001,"15min":1.3340000000000001},"min":{"1min":1.0580000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.333},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.752,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.363}]},{"osd":6,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.87,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.232},{"interface":"front","average":{"1min":1.25,"5min":1.204,"15min":1.196},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.294}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.403,"15min":1.411},"min":{"1min":0.81299999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.351,"15min":1.343},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":836,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194475,"statfs":{"total":200000000,"available":199142979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97399999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.442},"max":{"1min":1.387,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0209999999999999,"15min":1.0149999999999999},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4630000000000001,"5min":1.853,"15min":1.853},"last":0.754}]},{"osd":2,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.028,"15min":1.018},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.516,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.62,"5min":0.496,"15min":0.496},"max":{"1min":1.393,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0660000000000001,"15min":1.0820000000000001},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.536,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.98599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.623,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.377,"15min":1.3740000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.165}]},{"osd":5,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.0069999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":1.986},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.258},"min":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.091}]},{"osd":6,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4350000000000001,"15min":1.4450000000000001},"min":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.0129999999999999,"5min":2.04,"15min":2.04},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.4299999999999999},"min":{"1min":0.95699999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.7869999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5249999999999999,"15min":1.5329999999999999},"min":{"1min":1.093,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8799999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.423,"5min":1.389,"15min":1.383},"min":{"1min":0.94499999999999995,"5min":0.879,"15min":0.879},"max":{"1min":1.9610000000000001,"5min":2.601,"15min":2.601},"last":1.3260000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:40:30.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-10T10:40:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.694+0000 7fbf17ff3640 1 Processor -- start 2023-08-10T10:40:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.695+0000 7fbf17ff3640 1 -- start start 2023-08-10T10:40:30.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.696+0000 7fbf17ff3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf10069db0 0x7fbf1006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.696+0000 7fbf17ff3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100b4120 con 0x7fbf100704f0 2023-08-10T10:40:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.696+0000 7fbf17ff3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100b43c0 con 0x7fbf1015abc0 2023-08-10T10:40:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.696+0000 7fbf17ff3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100b46a0 con 0x7fbf10069db0 2023-08-10T10:40:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.697+0000 7fbf1558e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf100704f0 0x7fbf100696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39042/0 (socket says 172.21.15.50:39042) 2023-08-10T10:40:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.697+0000 7fbf1558e640 1 -- 172.21.15.50:0/3145187761 learned_addr learned my addr 172.21.15.50:0/3145187761 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.697+0000 7fbf16590640 1 --2- 172.21.15.50:0/3145187761 >> v2:172.21.15.117:3300/0 conn(0x7fbf10069db0 0x7fbf1006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.697+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645559696 0 0) 0x7fbf100b4120 con 0x7fbf100704f0 2023-08-10T10:40:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.697+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef8003520 con 0x7fbf100704f0 2023-08-10T10:40:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2756771635 0 0) 0x7fbef8003520 con 0x7fbf100704f0 2023-08-10T10:40:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 >> v2:172.21.15.117:3300/0 conn(0x7fbf10069db0 msgr2=0x7fbf1006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 --2- 172.21.15.50:0/3145187761 >> v2:172.21.15.117:3300/0 conn(0x7fbf10069db0 0x7fbf1006c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 >> v1:172.21.15.117:6789/0 conn(0x7fbf1015abc0 legacy=0x7fbf100cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1006ec20 con 0x7fbf100704f0 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fbf04001670 con 0x7fbf100704f0 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 >> v1:172.21.15.50:6789/0 conn(0x7fbf100704f0 legacy=0x7fbf100696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef8003970 0x7fbef8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbef8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8005180 0x7fbef800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100b46a0 con 0x7fbef80047c0 2023-08-10T10:40:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef800c120 con 0x7fbef8005180 2023-08-10T10:40:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef800c2e0 con 0x7fbef8003970 2023-08-10T10:40:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf1558e640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbef8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.698+0000 7fbf15d8f640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef8003970 0x7fbef8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf1558e640 1 -- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef8003970 msgr2=0x7fbef8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:30.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf1558e640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef8003970 0x7fbef8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf1558e640 1 -- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8005180 msgr2=0x7fbef800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:30.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf1558e640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8005180 0x7fbef800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf1558e640 1 -- 172.21.15.50:0/3145187761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8003520 con 0x7fbef80047c0 2023-08-10T10:40:30.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.699+0000 7fbf16590640 1 -- 172.21.15.50:0/3145187761 reap_dead start 2023-08-10T10:40:30.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.700+0000 7fbf1558e640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbef8004c40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c240 tx=0x7fbef80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f0251f04960cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.700+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04005ad0 con 0x7fbef80047c0 2023-08-10T10:40:30.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.700+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04005c30 con 0x7fbef80047c0 2023-08-10T10:40:30.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.700+0000 7fbf14d8d640 1 -- 172.21.15.50:0/3145187761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0402caf0 con 0x7fbef80047c0 2023-08-10T10:40:30.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 -- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 msgr2=0x7fbef8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbef8004c40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c240 tx=0x7fbef80057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 -- 172.21.15.50:0/3145187761 shutdown_connections 2023-08-10T10:40:30.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/3145187761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbef8004c40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 -- 172.21.15.50:0/3145187761 >> 172.21.15.50:0/3145187761 conn(0x7fbf100cb7a0 msgr2=0x7fbf100ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 -- 172.21.15.50:0/3145187761 shutdown_connections 2023-08-10T10:40:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.701+0000 7fbf17ff3640 1 -- 172.21.15.50:0/3145187761 wait complete. 2023-08-10T10:40:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.703+0000 7fbf17ff3640 1 Processor -- start 2023-08-10T10:40:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.703+0000 7fbf17ff3640 1 -- start start 2023-08-10T10:40:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf1014fd80 0x7fbf10150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 0x7fbf100c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10150740 con 0x7fbef80047c0 2023-08-10T10:40:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100c7da0 con 0x7fbf1014fd80 2023-08-10T10:40:30.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf17ff3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100c8080 con 0x7fbf100c7020 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf15d8f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf15d8f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59736/0 (socket says 172.21.15.50:59736) 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.704+0000 7fbf15d8f640 1 -- 172.21.15.50:0/483275965 learned_addr learned my addr 172.21.15.50:0/483275965 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf16590640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 0x7fbf100c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 -- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 msgr2=0x7fbf100c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 0x7fbf100c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf1558e640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf1014fd80 0x7fbf10150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 -- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf1014fd80 msgr2=0x7fbf10150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf1014fd80 0x7fbf10150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 -- 172.21.15.50:0/483275965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100c8360 con 0x7fbef80047c0 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf16590640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 0x7fbf100c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf15d8f640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbf00000f80 tx=0x7fbf0000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00003b80 con 0x7fbef80047c0 2023-08-10T10:40:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00003ce0 con 0x7fbef80047c0 2023-08-10T10:40:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000052f0 con 0x7fbef80047c0 2023-08-10T10:40:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.705+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf100c8640 con 0x7fbef80047c0 2023-08-10T10:40:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.706+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf100ad040 con 0x7fbef80047c0 2023-08-10T10:40:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.707+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf100c22e0 con 0x7fbef80047c0 2023-08-10T10:40:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.708+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf00005450 con 0x7fbef80047c0 2023-08-10T10:40:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.709+0000 7fbf0e7fc640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 0x7fbefc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.709+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf00089560 con 0x7fbef80047c0 2023-08-10T10:40:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.709+0000 7fbf1558e640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 0x7fbefc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.710+0000 7fbf1558e640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 0x7fbefc06d110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf04034000 tx=0x7fbf04009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:30.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.714+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbf00054600 con 0x7fbef80047c0 2023-08-10T10:40:30.739 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:40:30.737+0000 7f8c8eeaa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:40:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.990+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbf1006c0e0 con 0x7fbef80047c0 2023-08-10T10:40:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.991+0000 7fbf0e7fc640 1 -- 172.21.15.50:0/483275965 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1427 (secure 0 0 0) 0x7fbf00057c20 con 0x7fbef80047c0 2023-08-10T10:40:30.993 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:30.993 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1691663887,"num_in_osds":8,"osd_in_since":1691663884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":3324350,"bytes_avail":1596675650,"bytes_total":1600000000,"write_bytes_sec":2170,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-10T10:40:10.354165+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-10T10:40:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.993+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 msgr2=0x7fbefc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.993+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 0x7fbefc06d110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf04034000 tx=0x7fbf04009030 comp rx=0 tx=0).stop 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 msgr2=0x7fbf100acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbf00000f80 tx=0x7fbf0000ec80 comp rx=0 tx=0).stop 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 shutdown_connections 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf100c7020 0x7fbf100c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbefc06ac50 0x7fbefc06d110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf1014fd80 0x7fbf10150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 --2- 172.21.15.50:0/483275965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbef80047c0 0x7fbf100acb00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 >> 172.21.15.50:0/483275965 conn(0x7fbf100cb7a0 msgr2=0x7fbf100b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 shutdown_connections 2023-08-10T10:40:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:30.994+0000 7fbf17ff3640 1 -- 172.21.15.50:0/483275965 wait complete. 2023-08-10T10:40:31.015 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-10T10:40:31.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:40:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.227+0000 7fa0c7ea7640 1 Processor -- start 2023-08-10T10:40:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.227+0000 7fa0c7ea7640 1 -- start start 2023-08-10T10:40:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c015ccb0 0x7fa0c00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c00b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 0x7fa0c0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c006a090 con 0x7fa0c015ccb0 2023-08-10T10:40:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00719f0 con 0x7fa0c00696a0 2023-08-10T10:40:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.229+0000 7fa0c7ea7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00c8db0 con 0x7fa0c00c9b30 2023-08-10T10:40:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c015ccb0 0x7fa0c00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c015ccb0 0x7fa0c00b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59750/0 (socket says 172.21.15.50:59750) 2023-08-10T10:40:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 -- 172.21.15.50:0/4251250891 learned_addr learned my addr 172.21.15.50:0/4251250891 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5442640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c00b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c6444640 1 --2- 172.21.15.50:0/4251250891 >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 0x7fa0c0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 -- 172.21.15.50:0/4251250891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 msgr2=0x7fa0c00b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c00b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 -- 172.21.15.50:0/4251250891 >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 msgr2=0x7fa0c0069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4251250891 >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 0x7fa0c0069b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c5c43640 1 -- 172.21.15.50:0/4251250891 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00c9050 con 0x7fa0c015ccb0 2023-08-10T10:40:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.230+0000 7fa0c6444640 1 --2- 172.21.15.50:0/4251250891 >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 0x7fa0c0069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.231+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c00b2900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00cf760 tx=0x7fa0bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfd11db2b4be2f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c4c41640 1 -- 172.21.15.50:0/4251250891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc031860 con 0x7fa0c015ccb0 2023-08-10T10:40:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c4c41640 1 -- 172.21.15.50:0/4251250891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc0319c0 con 0x7fa0c015ccb0 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c4c41640 1 -- 172.21.15.50:0/4251250891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc031d50 con 0x7fa0c015ccb0 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4251250891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 msgr2=0x7fa0c00b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c00b2900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00cf760 tx=0x7fa0bc02b900 comp rx=0 tx=0).stop 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4251250891 shutdown_connections 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4251250891 >> v2:172.21.15.117:3300/0 conn(0x7fa0c00696a0 0x7fa0c0069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c00b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4251250891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c00b2900 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.232+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4251250891 >> 172.21.15.50:0/4251250891 conn(0x7fa0c006b590 msgr2=0x7fa0c00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.233+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4251250891 shutdown_connections 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.233+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4251250891 wait complete. 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.235+0000 7fa0c7ea7640 1 Processor -- start 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.235+0000 7fa0c7ea7640 1 -- start start 2023-08-10T10:40:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00696a0 0x7fa0c006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0158860 con 0x7fa0c015ccb0 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015dc70 con 0x7fa0c00696a0 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.236+0000 7fa0c7ea7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015df50 con 0x7fa0c00c9b30 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59766/0 (socket says 172.21.15.50:59766) 2023-08-10T10:40:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 -- 172.21.15.50:0/4062818409 learned_addr learned my addr 172.21.15.50:0/4062818409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00696a0 0x7fa0c006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c5442640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 -- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 msgr2=0x7fa0c015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 -- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00696a0 msgr2=0x7fa0c006fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00696a0 0x7fa0c006fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 -- 172.21.15.50:0/4062818409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0094d0 con 0x7fa0c015ccb0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.237+0000 7fa0c6444640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800cd10 tx=0x7fa0b800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.238+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800f680 con 0x7fa0c015ccb0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.238+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800f800 con 0x7fa0c015ccb0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.238+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800fbb0 con 0x7fa0c015ccb0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.238+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c015e470 con 0x7fa0c015ccb0 2023-08-10T10:40:31.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.238+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c015ea30 con 0x7fa0c015ccb0 2023-08-10T10:40:31.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.239+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c015ec50 con 0x7fa0c015ccb0 2023-08-10T10:40:31.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.240+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0b800b040 con 0x7fa0c015ccb0 2023-08-10T10:40:31.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.241+0000 7fa0b67fc640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 0x7fa0a406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:31.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.241+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0b8089e60 con 0x7fa0c015ccb0 2023-08-10T10:40:31.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.241+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 0x7fa0a406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:31.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.242+0000 7fa0c5c43640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 0x7fa0a406d140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc036000 tx=0x7fa0bc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:31.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.246+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0b8054e70 con 0x7fa0c015ccb0 2023-08-10T10:40:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.436+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0c00c9610 con 0x7fa0a406ac80 2023-08-10T10:40:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.447+0000 7fa0b67fc640 1 -- 172.21.15.50:0/4062818409 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302932 (secure 0 0 0) 0x7fa0bc044400 con 0x7fa0a406ac80 2023-08-10T10:40:31.454 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:40:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.453+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 msgr2=0x7fa0a406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.453+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 0x7fa0a406d140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc036000 tx=0x7fa0bc03c040 comp rx=0 tx=0).stop 2023-08-10T10:40:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.453+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 msgr2=0x7fa0c015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.453+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800cd10 tx=0x7fa0b800a650 comp rx=0 tx=0).stop 2023-08-10T10:40:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 shutdown_connections 2023-08-10T10:40:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c015ccb0 0x7fa0c015d5d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c00c9b30 0x7fa0c015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a406ac80 0x7fa0a406d140 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 --2- 172.21.15.50:0/4062818409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00696a0 0x7fa0c006fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 >> 172.21.15.50:0/4062818409 conn(0x7fa0c006b590 msgr2=0x7fa0c015adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 shutdown_connections 2023-08-10T10:40:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:31.454+0000 7fa0c7ea7640 1 -- 172.21.15.50:0/4062818409 wait complete. 2023-08-10T10:40:31.474 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-08-10T10:40:30.359508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3246,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559253,"statfs":{"total":1600000000,"available":1596675650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.605165"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793647+0000","last_change":"2023-08-10T10:40:24.819297+0000","last_active":"2023-08-10T10:40:25.793647+0000","last_peered":"2023-08-10T10:40:25.793647+0000","last_clean":"2023-08-10T10:40:25.793647+0000","last_became_active":"2023-08-10T10:40:24.818707+0000","last_became_peered":"2023-08-10T10:40:24.818707+0000","last_unstale":"2023-08-10T10:40:25.793647+0000","last_undegraded":"2023-08-10T10:40:25.793647+0000","last_fullsized":"2023-08-10T10:40:25.793647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:47.566051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927741+0000","last_change":"2023-08-10T10:40:24.826025+0000","last_active":"2023-08-10T10:40:26.927741+0000","last_peered":"2023-08-10T10:40:26.927741+0000","last_clean":"2023-08-10T10:40:26.927741+0000","last_became_active":"2023-08-10T10:40:24.825801+0000","last_became_peered":"2023-08-10T10:40:24.825801+0000","last_unstale":"2023-08-10T10:40:26.927741+0000","last_undegraded":"2023-08-10T10:40:26.927741+0000","last_fullsized":"2023-08-10T10:40:26.927741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:26.431836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950498+0000","last_change":"2023-08-10T10:40:24.810909+0000","last_active":"2023-08-10T10:40:26.950498+0000","last_peered":"2023-08-10T10:40:26.950498+0000","last_clean":"2023-08-10T10:40:26.950498+0000","last_became_active":"2023-08-10T10:40:24.809876+0000","last_became_peered":"2023-08-10T10:40:24.809876+0000","last_unstale":"2023-08-10T10:40:26.950498+0000","last_undegraded":"2023-08-10T10:40:26.950498+0000","last_fullsized":"2023-08-10T10:40:26.950498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:23.622167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927461+0000","last_change":"2023-08-10T10:40:24.821547+0000","last_active":"2023-08-10T10:40:26.927461+0000","last_peered":"2023-08-10T10:40:26.927461+0000","last_clean":"2023-08-10T10:40:26.927461+0000","last_became_active":"2023-08-10T10:40:24.821285+0000","last_became_peered":"2023-08-10T10:40:24.821285+0000","last_unstale":"2023-08-10T10:40:26.927461+0000","last_undegraded":"2023-08-10T10:40:26.927461+0000","last_fullsized":"2023-08-10T10:40:26.927461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:57.962021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800370+0000","last_change":"2023-08-10T10:40:24.821946+0000","last_active":"2023-08-10T10:40:25.800370+0000","last_peered":"2023-08-10T10:40:25.800370+0000","last_clean":"2023-08-10T10:40:25.800370+0000","last_became_active":"2023-08-10T10:40:24.821611+0000","last_became_peered":"2023-08-10T10:40:24.821611+0000","last_unstale":"2023-08-10T10:40:25.800370+0000","last_undegraded":"2023-08-10T10:40:25.800370+0000","last_fullsized":"2023-08-10T10:40:25.800370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794029+0000","last_change":"2023-08-10T10:40:24.825555+0000","last_active":"2023-08-10T10:40:25.794029+0000","last_peered":"2023-08-10T10:40:25.794029+0000","last_clean":"2023-08-10T10:40:25.794029+0000","last_became_active":"2023-08-10T10:40:24.825326+0000","last_became_peered":"2023-08-10T10:40:24.825326+0000","last_unstale":"2023-08-10T10:40:25.794029+0000","last_undegraded":"2023-08-10T10:40:25.794029+0000","last_fullsized":"2023-08-10T10:40:25.794029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950462+0000","last_change":"2023-08-10T10:40:24.810497+0000","last_active":"2023-08-10T10:40:26.950462+0000","last_peered":"2023-08-10T10:40:26.950462+0000","last_clean":"2023-08-10T10:40:26.950462+0000","last_became_active":"2023-08-10T10:40:24.809819+0000","last_became_peered":"2023-08-10T10:40:24.809819+0000","last_unstale":"2023-08-10T10:40:26.950462+0000","last_undegraded":"2023-08-10T10:40:26.950462+0000","last_fullsized":"2023-08-10T10:40:26.950462+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:37.459852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925958+0000","last_change":"2023-08-10T10:40:24.809581+0000","last_active":"2023-08-10T10:40:26.925958+0000","last_peered":"2023-08-10T10:40:26.925958+0000","last_clean":"2023-08-10T10:40:26.925958+0000","last_became_active":"2023-08-10T10:40:24.809207+0000","last_became_peered":"2023-08-10T10:40:24.809207+0000","last_unstale":"2023-08-10T10:40:26.925958+0000","last_undegraded":"2023-08-10T10:40:26.925958+0000","last_fullsized":"2023-08-10T10:40:26.925958+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.319464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925985+0000","last_change":"2023-08-10T10:40:24.809021+0000","last_active":"2023-08-10T10:40:26.925985+0000","last_peered":"2023-08-10T10:40:26.925985+0000","last_clean":"2023-08-10T10:40:26.925985+0000","last_became_active":"2023-08-10T10:40:24.808722+0000","last_became_peered":"2023-08-10T10:40:24.808722+0000","last_unstale":"2023-08-10T10:40:26.925985+0000","last_undegraded":"2023-08-10T10:40:26.925985+0000","last_fullsized":"2023-08-10T10:40:26.925985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793886+0000","last_change":"2023-08-10T10:40:24.822453+0000","last_active":"2023-08-10T10:40:25.793886+0000","last_peered":"2023-08-10T10:40:25.793886+0000","last_clean":"2023-08-10T10:40:25.793886+0000","last_became_active":"2023-08-10T10:40:24.822211+0000","last_became_peered":"2023-08-10T10:40:24.822211+0000","last_unstale":"2023-08-10T10:40:25.793886+0000","last_undegraded":"2023-08-10T10:40:25.793886+0000","last_fullsized":"2023-08-10T10:40:25.793886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:43.869883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029126+0000","last_change":"2023-08-10T10:40:24.824743+0000","last_active":"2023-08-10T10:40:27.029126+0000","last_peered":"2023-08-10T10:40:27.029126+0000","last_clean":"2023-08-10T10:40:27.029126+0000","last_became_active":"2023-08-10T10:40:24.824477+0000","last_became_peered":"2023-08-10T10:40:24.824477+0000","last_unstale":"2023-08-10T10:40:27.029126+0000","last_undegraded":"2023-08-10T10:40:27.029126+0000","last_fullsized":"2023-08-10T10:40:27.029126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:48.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926255+0000","last_change":"2023-08-10T10:40:24.811049+0000","last_active":"2023-08-10T10:40:26.926255+0000","last_peered":"2023-08-10T10:40:26.926255+0000","last_clean":"2023-08-10T10:40:26.926255+0000","last_became_active":"2023-08-10T10:40:24.810393+0000","last_became_peered":"2023-08-10T10:40:24.810393+0000","last_unstale":"2023-08-10T10:40:26.926255+0000","last_undegraded":"2023-08-10T10:40:26.926255+0000","last_fullsized":"2023-08-10T10:40:26.926255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:47.992472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793741+0000","last_change":"2023-08-10T10:40:24.817177+0000","last_active":"2023-08-10T10:40:25.793741+0000","last_peered":"2023-08-10T10:40:25.793741+0000","last_clean":"2023-08-10T10:40:25.793741+0000","last_became_active":"2023-08-10T10:40:24.816897+0000","last_became_peered":"2023-08-10T10:40:24.816897+0000","last_unstale":"2023-08-10T10:40:25.793741+0000","last_undegraded":"2023-08-10T10:40:25.793741+0000","last_fullsized":"2023-08-10T10:40:25.793741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950439+0000","last_change":"2023-08-10T10:40:24.813196+0000","last_active":"2023-08-10T10:40:26.950439+0000","last_peered":"2023-08-10T10:40:26.950439+0000","last_clean":"2023-08-10T10:40:26.950439+0000","last_became_active":"2023-08-10T10:40:24.812791+0000","last_became_peered":"2023-08-10T10:40:24.812791+0000","last_unstale":"2023-08-10T10:40:26.950439+0000","last_undegraded":"2023-08-10T10:40:26.950439+0000","last_fullsized":"2023-08-10T10:40:26.950439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:06.144104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928356+0000","last_change":"2023-08-10T10:40:24.823572+0000","last_active":"2023-08-10T10:40:26.928356+0000","last_peered":"2023-08-10T10:40:26.928356+0000","last_clean":"2023-08-10T10:40:26.928356+0000","last_became_active":"2023-08-10T10:40:24.823304+0000","last_became_peered":"2023-08-10T10:40:24.823304+0000","last_unstale":"2023-08-10T10:40:26.928356+0000","last_undegraded":"2023-08-10T10:40:26.928356+0000","last_fullsized":"2023-08-10T10:40:26.928356+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:47.448633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793852+0000","last_change":"2023-08-10T10:40:24.816495+0000","last_active":"2023-08-10T10:40:25.793852+0000","last_peered":"2023-08-10T10:40:25.793852+0000","last_clean":"2023-08-10T10:40:25.793852+0000","last_became_active":"2023-08-10T10:40:24.816236+0000","last_became_peered":"2023-08-10T10:40:24.816236+0000","last_unstale":"2023-08-10T10:40:25.793852+0000","last_undegraded":"2023-08-10T10:40:25.793852+0000","last_fullsized":"2023-08-10T10:40:25.793852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:59.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950825+0000","last_change":"2023-08-10T10:40:24.825629+0000","last_active":"2023-08-10T10:40:26.950825+0000","last_peered":"2023-08-10T10:40:26.950825+0000","last_clean":"2023-08-10T10:40:26.950825+0000","last_became_active":"2023-08-10T10:40:24.825189+0000","last_became_peered":"2023-08-10T10:40:24.825189+0000","last_unstale":"2023-08-10T10:40:26.950825+0000","last_undegraded":"2023-08-10T10:40:26.950825+0000","last_fullsized":"2023-08-10T10:40:26.950825+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:44.656604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927540+0000","last_change":"2023-08-10T10:40:24.820809+0000","last_active":"2023-08-10T10:40:26.927540+0000","last_peered":"2023-08-10T10:40:26.927540+0000","last_clean":"2023-08-10T10:40:26.927540+0000","last_became_active":"2023-08-10T10:40:24.819946+0000","last_became_peered":"2023-08-10T10:40:24.819946+0000","last_unstale":"2023-08-10T10:40:26.927540+0000","last_undegraded":"2023-08-10T10:40:26.927540+0000","last_fullsized":"2023-08-10T10:40:26.927540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:55.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950222+0000","last_change":"2023-08-10T10:40:24.820089+0000","last_active":"2023-08-10T10:40:26.950222+0000","last_peered":"2023-08-10T10:40:26.950222+0000","last_clean":"2023-08-10T10:40:26.950222+0000","last_became_active":"2023-08-10T10:40:24.819656+0000","last_became_peered":"2023-08-10T10:40:24.819656+0000","last_unstale":"2023-08-10T10:40:26.950222+0000","last_undegraded":"2023-08-10T10:40:26.950222+0000","last_fullsized":"2023-08-10T10:40:26.950222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:02.236304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928603+0000","last_change":"2023-08-10T10:40:24.825090+0000","last_active":"2023-08-10T10:40:26.928603+0000","last_peered":"2023-08-10T10:40:26.928603+0000","last_clean":"2023-08-10T10:40:26.928603+0000","last_became_active":"2023-08-10T10:40:24.824657+0000","last_became_peered":"2023-08-10T10:40:24.824657+0000","last_unstale":"2023-08-10T10:40:26.928603+0000","last_undegraded":"2023-08-10T10:40:26.928603+0000","last_fullsized":"2023-08-10T10:40:26.928603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:26.593162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927498+0000","last_change":"2023-08-10T10:40:24.827481+0000","last_active":"2023-08-10T10:40:26.927498+0000","last_peered":"2023-08-10T10:40:26.927498+0000","last_clean":"2023-08-10T10:40:26.927498+0000","last_became_active":"2023-08-10T10:40:24.827080+0000","last_became_peered":"2023-08-10T10:40:24.827080+0000","last_unstale":"2023-08-10T10:40:26.927498+0000","last_undegraded":"2023-08-10T10:40:26.927498+0000","last_fullsized":"2023-08-10T10:40:26.927498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:57:50.126890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926412+0000","last_change":"2023-08-10T10:40:24.810755+0000","last_active":"2023-08-10T10:40:26.926412+0000","last_peered":"2023-08-10T10:40:26.926412+0000","last_clean":"2023-08-10T10:40:26.926412+0000","last_became_active":"2023-08-10T10:40:24.809982+0000","last_became_peered":"2023-08-10T10:40:24.809982+0000","last_unstale":"2023-08-10T10:40:26.926412+0000","last_undegraded":"2023-08-10T10:40:26.926412+0000","last_fullsized":"2023-08-10T10:40:26.926412+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:00.816162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029140+0000","last_change":"2023-08-10T10:40:24.818772+0000","last_active":"2023-08-10T10:40:27.029140+0000","last_peered":"2023-08-10T10:40:27.029140+0000","last_clean":"2023-08-10T10:40:27.029140+0000","last_became_active":"2023-08-10T10:40:24.818516+0000","last_became_peered":"2023-08-10T10:40:24.818516+0000","last_unstale":"2023-08-10T10:40:27.029140+0000","last_undegraded":"2023-08-10T10:40:27.029140+0000","last_fullsized":"2023-08-10T10:40:27.029140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:18.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950658+0000","last_change":"2023-08-10T10:40:24.813047+0000","last_active":"2023-08-10T10:40:26.950658+0000","last_peered":"2023-08-10T10:40:26.950658+0000","last_clean":"2023-08-10T10:40:26.950658+0000","last_became_active":"2023-08-10T10:40:24.812364+0000","last_became_peered":"2023-08-10T10:40:24.812364+0000","last_unstale":"2023-08-10T10:40:26.950658+0000","last_undegraded":"2023-08-10T10:40:26.950658+0000","last_fullsized":"2023-08-10T10:40:26.950658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:48.663407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950191+0000","last_change":"2023-08-10T10:40:24.813194+0000","last_active":"2023-08-10T10:40:26.950191+0000","last_peered":"2023-08-10T10:40:26.950191+0000","last_clean":"2023-08-10T10:40:26.950191+0000","last_became_active":"2023-08-10T10:40:24.812949+0000","last_became_peered":"2023-08-10T10:40:24.812949+0000","last_unstale":"2023-08-10T10:40:26.950191+0000","last_undegraded":"2023-08-10T10:40:26.950191+0000","last_fullsized":"2023-08-10T10:40:26.950191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:46.730566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926222+0000","last_change":"2023-08-10T10:40:24.800429+0000","last_active":"2023-08-10T10:40:26.926222+0000","last_peered":"2023-08-10T10:40:26.926222+0000","last_clean":"2023-08-10T10:40:26.926222+0000","last_became_active":"2023-08-10T10:40:24.800143+0000","last_became_peered":"2023-08-10T10:40:24.800143+0000","last_unstale":"2023-08-10T10:40:26.926222+0000","last_undegraded":"2023-08-10T10:40:26.926222+0000","last_fullsized":"2023-08-10T10:40:26.926222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793511+0000","last_change":"2023-08-10T10:40:24.813750+0000","last_active":"2023-08-10T10:40:25.793511+0000","last_peered":"2023-08-10T10:40:25.793511+0000","last_clean":"2023-08-10T10:40:25.793511+0000","last_became_active":"2023-08-10T10:40:24.813465+0000","last_became_peered":"2023-08-10T10:40:24.813465+0000","last_unstale":"2023-08-10T10:40:25.793511+0000","last_undegraded":"2023-08-10T10:40:25.793511+0000","last_fullsized":"2023-08-10T10:40:25.793511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.892628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927452+0000","last_change":"2023-08-10T10:40:24.810252+0000","last_active":"2023-08-10T10:40:26.927452+0000","last_peered":"2023-08-10T10:40:26.927452+0000","last_clean":"2023-08-10T10:40:26.927452+0000","last_became_active":"2023-08-10T10:40:24.809664+0000","last_became_peered":"2023-08-10T10:40:24.809664+0000","last_unstale":"2023-08-10T10:40:26.927452+0000","last_undegraded":"2023-08-10T10:40:26.927452+0000","last_fullsized":"2023-08-10T10:40:26.927452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:55.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950865+0000","last_change":"2023-08-10T10:40:24.816841+0000","last_active":"2023-08-10T10:40:26.950865+0000","last_peered":"2023-08-10T10:40:26.950865+0000","last_clean":"2023-08-10T10:40:26.950865+0000","last_became_active":"2023-08-10T10:40:24.816426+0000","last_became_peered":"2023-08-10T10:40:24.816426+0000","last_unstale":"2023-08-10T10:40:26.950865+0000","last_undegraded":"2023-08-10T10:40:26.950865+0000","last_fullsized":"2023-08-10T10:40:26.950865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:27.176324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928716+0000","last_change":"2023-08-10T10:40:24.817678+0000","last_active":"2023-08-10T10:40:26.928716+0000","last_peered":"2023-08-10T10:40:26.928716+0000","last_clean":"2023-08-10T10:40:26.928716+0000","last_became_active":"2023-08-10T10:40:24.817364+0000","last_became_peered":"2023-08-10T10:40:24.817364+0000","last_unstale":"2023-08-10T10:40:26.928716+0000","last_undegraded":"2023-08-10T10:40:26.928716+0000","last_fullsized":"2023-08-10T10:40:26.928716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:11.524071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950305+0000","last_change":"2023-08-10T10:40:24.810723+0000","last_active":"2023-08-10T10:40:26.950305+0000","last_peered":"2023-08-10T10:40:26.950305+0000","last_clean":"2023-08-10T10:40:26.950305+0000","last_became_active":"2023-08-10T10:40:24.810513+0000","last_became_peered":"2023-08-10T10:40:24.810513+0000","last_unstale":"2023-08-10T10:40:26.950305+0000","last_undegraded":"2023-08-10T10:40:26.950305+0000","last_fullsized":"2023-08-10T10:40:26.950305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:31.743560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799135+0000","last_change":"2023-08-10T10:40:24.821404+0000","last_active":"2023-08-10T10:40:25.799135+0000","last_peered":"2023-08-10T10:40:25.799135+0000","last_clean":"2023-08-10T10:40:25.799135+0000","last_became_active":"2023-08-10T10:40:24.820416+0000","last_became_peered":"2023-08-10T10:40:24.820416+0000","last_unstale":"2023-08-10T10:40:25.799135+0000","last_undegraded":"2023-08-10T10:40:25.799135+0000","last_fullsized":"2023-08-10T10:40:25.799135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:08.314818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929000+0000","last_change":"2023-08-10T10:40:24.822019+0000","last_active":"2023-08-10T10:40:26.929000+0000","last_peered":"2023-08-10T10:40:26.929000+0000","last_clean":"2023-08-10T10:40:26.929000+0000","last_became_active":"2023-08-10T10:40:24.820481+0000","last_became_peered":"2023-08-10T10:40:24.820481+0000","last_unstale":"2023-08-10T10:40:26.929000+0000","last_undegraded":"2023-08-10T10:40:26.929000+0000","last_fullsized":"2023-08-10T10:40:26.929000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:42.939869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927747+0000","last_change":"2023-08-10T10:40:23.781267+0000","last_active":"2023-08-10T10:40:26.927747+0000","last_peered":"2023-08-10T10:40:26.927747+0000","last_clean":"2023-08-10T10:40:26.927747+0000","last_became_active":"2023-08-10T10:40:23.779166+0000","last_became_peered":"2023-08-10T10:40:23.779166+0000","last_unstale":"2023-08-10T10:40:26.927747+0000","last_undegraded":"2023-08-10T10:40:26.927747+0000","last_fullsized":"2023-08-10T10:40:26.927747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:48.412032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799486+0000","last_change":"2023-08-10T10:40:24.821563+0000","last_active":"2023-08-10T10:40:25.799486+0000","last_peered":"2023-08-10T10:40:25.799486+0000","last_clean":"2023-08-10T10:40:25.799486+0000","last_became_active":"2023-08-10T10:40:24.821153+0000","last_became_peered":"2023-08-10T10:40:24.821153+0000","last_unstale":"2023-08-10T10:40:25.799486+0000","last_undegraded":"2023-08-10T10:40:25.799486+0000","last_fullsized":"2023-08-10T10:40:25.799486+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:06:08.970227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793409+0000","last_change":"2023-08-10T10:40:23.784500+0000","last_active":"2023-08-10T10:40:25.793409+0000","last_peered":"2023-08-10T10:40:25.793409+0000","last_clean":"2023-08-10T10:40:25.793409+0000","last_became_active":"2023-08-10T10:40:23.784247+0000","last_became_peered":"2023-08-10T10:40:23.784247+0000","last_unstale":"2023-08-10T10:40:25.793409+0000","last_undegraded":"2023-08-10T10:40:25.793409+0000","last_fullsized":"2023-08-10T10:40:25.793409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927888+0000","last_change":"2023-08-10T10:40:24.826402+0000","last_active":"2023-08-10T10:40:26.927888+0000","last_peered":"2023-08-10T10:40:26.927888+0000","last_clean":"2023-08-10T10:40:26.927888+0000","last_became_active":"2023-08-10T10:40:24.826145+0000","last_became_peered":"2023-08-10T10:40:24.826145+0000","last_unstale":"2023-08-10T10:40:26.927888+0000","last_undegraded":"2023-08-10T10:40:26.927888+0000","last_fullsized":"2023-08-10T10:40:26.927888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:12:06.733699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793986+0000","last_change":"2023-08-10T10:40:23.775943+0000","last_active":"2023-08-10T10:40:25.793986+0000","last_peered":"2023-08-10T10:40:25.793986+0000","last_clean":"2023-08-10T10:40:25.793986+0000","last_became_active":"2023-08-10T10:40:23.775676+0000","last_became_peered":"2023-08-10T10:40:23.775676+0000","last_unstale":"2023-08-10T10:40:25.793986+0000","last_undegraded":"2023-08-10T10:40:25.793986+0000","last_fullsized":"2023-08-10T10:40:25.793986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926384+0000","last_change":"2023-08-10T10:40:24.800430+0000","last_active":"2023-08-10T10:40:26.926384+0000","last_peered":"2023-08-10T10:40:26.926384+0000","last_clean":"2023-08-10T10:40:26.926384+0000","last_became_active":"2023-08-10T10:40:24.800197+0000","last_became_peered":"2023-08-10T10:40:24.800197+0000","last_unstale":"2023-08-10T10:40:26.926384+0000","last_undegraded":"2023-08-10T10:40:26.926384+0000","last_fullsized":"2023-08-10T10:40:26.926384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:44.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800957+0000","last_change":"2023-08-10T10:40:23.767248+0000","last_active":"2023-08-10T10:40:25.800957+0000","last_peered":"2023-08-10T10:40:25.800957+0000","last_clean":"2023-08-10T10:40:25.800957+0000","last_became_active":"2023-08-10T10:40:23.766543+0000","last_became_peered":"2023-08-10T10:40:23.766543+0000","last_unstale":"2023-08-10T10:40:25.800957+0000","last_undegraded":"2023-08-10T10:40:25.800957+0000","last_fullsized":"2023-08-10T10:40:25.800957+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:19:36.638106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799121+0000","last_change":"2023-08-10T10:40:24.817065+0000","last_active":"2023-08-10T10:40:25.799121+0000","last_peered":"2023-08-10T10:40:25.799121+0000","last_clean":"2023-08-10T10:40:25.799121+0000","last_became_active":"2023-08-10T10:40:24.815962+0000","last_became_peered":"2023-08-10T10:40:24.815962+0000","last_unstale":"2023-08-10T10:40:25.799121+0000","last_undegraded":"2023-08-10T10:40:25.799121+0000","last_fullsized":"2023-08-10T10:40:25.799121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.951166+0000","last_change":"2023-08-10T10:40:23.778353+0000","last_active":"2023-08-10T10:40:26.951166+0000","last_peered":"2023-08-10T10:40:26.951166+0000","last_clean":"2023-08-10T10:40:26.951166+0000","last_became_active":"2023-08-10T10:40:23.778082+0000","last_became_peered":"2023-08-10T10:40:23.778082+0000","last_unstale":"2023-08-10T10:40:26.951166+0000","last_undegraded":"2023-08-10T10:40:26.951166+0000","last_fullsized":"2023-08-10T10:40:26.951166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:24.878645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928609+0000","last_change":"2023-08-10T10:40:24.818529+0000","last_active":"2023-08-10T10:40:26.928609+0000","last_peered":"2023-08-10T10:40:26.928609+0000","last_clean":"2023-08-10T10:40:26.928609+0000","last_became_active":"2023-08-10T10:40:24.816469+0000","last_became_peered":"2023-08-10T10:40:24.816469+0000","last_unstale":"2023-08-10T10:40:26.928609+0000","last_undegraded":"2023-08-10T10:40:26.928609+0000","last_fullsized":"2023-08-10T10:40:26.928609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:41:57.964501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799100+0000","last_change":"2023-08-10T10:40:23.773137+0000","last_active":"2023-08-10T10:40:25.799100+0000","last_peered":"2023-08-10T10:40:25.799100+0000","last_clean":"2023-08-10T10:40:25.799100+0000","last_became_active":"2023-08-10T10:40:23.772367+0000","last_became_peered":"2023-08-10T10:40:23.772367+0000","last_unstale":"2023-08-10T10:40:25.799100+0000","last_undegraded":"2023-08-10T10:40:25.799100+0000","last_fullsized":"2023-08-10T10:40:25.799100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:58.463276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926588+0000","last_change":"2023-08-10T10:40:24.800790+0000","last_active":"2023-08-10T10:40:26.926588+0000","last_peered":"2023-08-10T10:40:26.926588+0000","last_clean":"2023-08-10T10:40:26.926588+0000","last_became_active":"2023-08-10T10:40:24.800146+0000","last_became_peered":"2023-08-10T10:40:24.800146+0000","last_unstale":"2023-08-10T10:40:26.926588+0000","last_undegraded":"2023-08-10T10:40:26.926588+0000","last_fullsized":"2023-08-10T10:40:26.926588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:13.348931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927516+0000","last_change":"2023-08-10T10:40:23.781681+0000","last_active":"2023-08-10T10:40:26.927516+0000","last_peered":"2023-08-10T10:40:26.927516+0000","last_clean":"2023-08-10T10:40:26.927516+0000","last_became_active":"2023-08-10T10:40:23.781336+0000","last_became_peered":"2023-08-10T10:40:23.781336+0000","last_unstale":"2023-08-10T10:40:26.927516+0000","last_undegraded":"2023-08-10T10:40:26.927516+0000","last_fullsized":"2023-08-10T10:40:26.927516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:52.540797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929349+0000","last_change":"2023-08-10T10:40:24.828683+0000","last_active":"2023-08-10T10:40:26.929349+0000","last_peered":"2023-08-10T10:40:26.929349+0000","last_clean":"2023-08-10T10:40:26.929349+0000","last_became_active":"2023-08-10T10:40:24.828132+0000","last_became_peered":"2023-08-10T10:40:24.828132+0000","last_unstale":"2023-08-10T10:40:26.929349+0000","last_undegraded":"2023-08-10T10:40:26.929349+0000","last_fullsized":"2023-08-10T10:40:26.929349+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:29.280310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950400+0000","last_change":"2023-08-10T10:40:23.783973+0000","last_active":"2023-08-10T10:40:26.950400+0000","last_peered":"2023-08-10T10:40:26.950400+0000","last_clean":"2023-08-10T10:40:26.950400+0000","last_became_active":"2023-08-10T10:40:23.783129+0000","last_became_peered":"2023-08-10T10:40:23.783129+0000","last_unstale":"2023-08-10T10:40:26.950400+0000","last_undegraded":"2023-08-10T10:40:26.950400+0000","last_fullsized":"2023-08-10T10:40:26.950400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:01.222729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800860+0000","last_change":"2023-08-10T10:40:24.801603+0000","last_active":"2023-08-10T10:40:25.800860+0000","last_peered":"2023-08-10T10:40:25.800860+0000","last_clean":"2023-08-10T10:40:25.800860+0000","last_became_active":"2023-08-10T10:40:24.800967+0000","last_became_peered":"2023-08-10T10:40:24.800967+0000","last_unstale":"2023-08-10T10:40:25.800860+0000","last_undegraded":"2023-08-10T10:40:25.800860+0000","last_fullsized":"2023-08-10T10:40:25.800860+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929456+0000","last_change":"2023-08-10T10:40:23.781796+0000","last_active":"2023-08-10T10:40:26.929456+0000","last_peered":"2023-08-10T10:40:26.929456+0000","last_clean":"2023-08-10T10:40:26.929456+0000","last_became_active":"2023-08-10T10:40:23.779727+0000","last_became_peered":"2023-08-10T10:40:23.779727+0000","last_unstale":"2023-08-10T10:40:26.929456+0000","last_undegraded":"2023-08-10T10:40:26.929456+0000","last_fullsized":"2023-08-10T10:40:26.929456+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:47.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.798767+0000","last_change":"2023-08-10T10:40:24.820149+0000","last_active":"2023-08-10T10:40:25.798767+0000","last_peered":"2023-08-10T10:40:25.798767+0000","last_clean":"2023-08-10T10:40:25.798767+0000","last_became_active":"2023-08-10T10:40:24.818757+0000","last_became_peered":"2023-08-10T10:40:24.818757+0000","last_unstale":"2023-08-10T10:40:25.798767+0000","last_undegraded":"2023-08-10T10:40:25.798767+0000","last_fullsized":"2023-08-10T10:40:25.798767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:21.608151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800191+0000","last_change":"2023-08-10T10:40:23.778598+0000","last_active":"2023-08-10T10:40:25.800191+0000","last_peered":"2023-08-10T10:40:25.800191+0000","last_clean":"2023-08-10T10:40:25.800191+0000","last_became_active":"2023-08-10T10:40:23.778175+0000","last_became_peered":"2023-08-10T10:40:23.778175+0000","last_unstale":"2023-08-10T10:40:25.800191+0000","last_undegraded":"2023-08-10T10:40:25.800191+0000","last_fullsized":"2023-08-10T10:40:25.800191+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950387+0000","last_change":"2023-08-10T10:40:24.826194+0000","last_active":"2023-08-10T10:40:26.950387+0000","last_peered":"2023-08-10T10:40:26.950387+0000","last_clean":"2023-08-10T10:40:26.950387+0000","last_became_active":"2023-08-10T10:40:24.822969+0000","last_became_peered":"2023-08-10T10:40:24.822969+0000","last_unstale":"2023-08-10T10:40:26.950387+0000","last_undegraded":"2023-08-10T10:40:26.950387+0000","last_fullsized":"2023-08-10T10:40:26.950387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:23.163693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929247+0000","last_change":"2023-08-10T10:40:23.782294+0000","last_active":"2023-08-10T10:40:26.929247+0000","last_peered":"2023-08-10T10:40:26.929247+0000","last_clean":"2023-08-10T10:40:26.929247+0000","last_became_active":"2023-08-10T10:40:23.778805+0000","last_became_peered":"2023-08-10T10:40:23.778805+0000","last_unstale":"2023-08-10T10:40:26.929247+0000","last_undegraded":"2023-08-10T10:40:26.929247+0000","last_fullsized":"2023-08-10T10:40:26.929247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:06:58.831750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799655+0000","last_change":"2023-08-10T10:40:24.801153+0000","last_active":"2023-08-10T10:40:25.799655+0000","last_peered":"2023-08-10T10:40:25.799655+0000","last_clean":"2023-08-10T10:40:25.799655+0000","last_became_active":"2023-08-10T10:40:24.800508+0000","last_became_peered":"2023-08-10T10:40:24.800508+0000","last_unstale":"2023-08-10T10:40:25.799655+0000","last_undegraded":"2023-08-10T10:40:25.799655+0000","last_fullsized":"2023-08-10T10:40:25.799655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926772+0000","last_change":"2023-08-10T10:40:23.783755+0000","last_active":"2023-08-10T10:40:26.926772+0000","last_peered":"2023-08-10T10:40:26.926772+0000","last_clean":"2023-08-10T10:40:26.926772+0000","last_became_active":"2023-08-10T10:40:23.782575+0000","last_became_peered":"2023-08-10T10:40:23.782575+0000","last_unstale":"2023-08-10T10:40:26.926772+0000","last_undegraded":"2023-08-10T10:40:26.926772+0000","last_fullsized":"2023-08-10T10:40:26.926772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:55:37.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800419+0000","last_change":"2023-08-10T10:40:24.828401+0000","last_active":"2023-08-10T10:40:25.800419+0000","last_peered":"2023-08-10T10:40:25.800419+0000","last_clean":"2023-08-10T10:40:25.800419+0000","last_became_active":"2023-08-10T10:40:24.827989+0000","last_became_peered":"2023-08-10T10:40:24.827989+0000","last_unstale":"2023-08-10T10:40:25.800419+0000","last_undegraded":"2023-08-10T10:40:25.800419+0000","last_fullsized":"2023-08-10T10:40:25.800419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:15.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950495+0000","last_change":"2023-08-10T10:40:23.783373+0000","last_active":"2023-08-10T10:40:26.950495+0000","last_peered":"2023-08-10T10:40:26.950495+0000","last_clean":"2023-08-10T10:40:26.950495+0000","last_became_active":"2023-08-10T10:40:23.782348+0000","last_became_peered":"2023-08-10T10:40:23.782348+0000","last_unstale":"2023-08-10T10:40:26.950495+0000","last_undegraded":"2023-08-10T10:40:26.950495+0000","last_fullsized":"2023-08-10T10:40:26.950495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:48:05.690784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950321+0000","last_change":"2023-08-10T10:40:24.811792+0000","last_active":"2023-08-10T10:40:26.950321+0000","last_peered":"2023-08-10T10:40:26.950321+0000","last_clean":"2023-08-10T10:40:26.950321+0000","last_became_active":"2023-08-10T10:40:24.811530+0000","last_became_peered":"2023-08-10T10:40:24.811530+0000","last_unstale":"2023-08-10T10:40:26.950321+0000","last_undegraded":"2023-08-10T10:40:26.950321+0000","last_fullsized":"2023-08-10T10:40:26.950321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:15.607685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928142+0000","last_change":"2023-08-10T10:40:23.781482+0000","last_active":"2023-08-10T10:40:26.928142+0000","last_peered":"2023-08-10T10:40:26.928142+0000","last_clean":"2023-08-10T10:40:26.928142+0000","last_became_active":"2023-08-10T10:40:23.779712+0000","last_became_peered":"2023-08-10T10:40:23.779712+0000","last_unstale":"2023-08-10T10:40:26.928142+0000","last_undegraded":"2023-08-10T10:40:26.928142+0000","last_fullsized":"2023-08-10T10:40:26.928142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:47.310601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926168+0000","last_change":"2023-08-10T10:40:24.823798+0000","last_active":"2023-08-10T10:40:26.926168+0000","last_peered":"2023-08-10T10:40:26.926168+0000","last_clean":"2023-08-10T10:40:26.926168+0000","last_became_active":"2023-08-10T10:40:24.823248+0000","last_became_peered":"2023-08-10T10:40:24.823248+0000","last_unstale":"2023-08-10T10:40:26.926168+0000","last_undegraded":"2023-08-10T10:40:26.926168+0000","last_fullsized":"2023-08-10T10:40:26.926168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927945+0000","last_change":"2023-08-10T10:40:23.780297+0000","last_active":"2023-08-10T10:40:26.927945+0000","last_peered":"2023-08-10T10:40:26.927945+0000","last_clean":"2023-08-10T10:40:26.927945+0000","last_became_active":"2023-08-10T10:40:23.779830+0000","last_became_peered":"2023-08-10T10:40:23.779830+0000","last_unstale":"2023-08-10T10:40:26.927945+0000","last_undegraded":"2023-08-10T10:40:26.927945+0000","last_fullsized":"2023-08-10T10:40:26.927945+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:36.541780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950238+0000","last_change":"2023-08-10T10:40:24.814662+0000","last_active":"2023-08-10T10:40:26.950238+0000","last_peered":"2023-08-10T10:40:26.950238+0000","last_clean":"2023-08-10T10:40:26.950238+0000","last_became_active":"2023-08-10T10:40:24.814402+0000","last_became_peered":"2023-08-10T10:40:24.814402+0000","last_unstale":"2023-08-10T10:40:26.950238+0000","last_undegraded":"2023-08-10T10:40:26.950238+0000","last_fullsized":"2023-08-10T10:40:26.950238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:50:56.111731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926176+0000","last_change":"2023-08-10T10:40:23.781989+0000","last_active":"2023-08-10T10:40:26.926176+0000","last_peered":"2023-08-10T10:40:26.926176+0000","last_clean":"2023-08-10T10:40:26.926176+0000","last_became_active":"2023-08-10T10:40:23.781505+0000","last_became_peered":"2023-08-10T10:40:23.781505+0000","last_unstale":"2023-08-10T10:40:26.926176+0000","last_undegraded":"2023-08-10T10:40:26.926176+0000","last_fullsized":"2023-08-10T10:40:26.926176+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:04.870677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926663+0000","last_change":"2023-08-10T10:40:24.811687+0000","last_active":"2023-08-10T10:40:26.926663+0000","last_peered":"2023-08-10T10:40:26.926663+0000","last_clean":"2023-08-10T10:40:26.926663+0000","last_became_active":"2023-08-10T10:40:24.811405+0000","last_became_peered":"2023-08-10T10:40:24.811405+0000","last_unstale":"2023-08-10T10:40:26.926663+0000","last_undegraded":"2023-08-10T10:40:26.926663+0000","last_fullsized":"2023-08-10T10:40:26.926663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:20:11.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950993+0000","last_change":"2023-08-10T10:40:23.784794+0000","last_active":"2023-08-10T10:40:26.950993+0000","last_peered":"2023-08-10T10:40:26.950993+0000","last_clean":"2023-08-10T10:40:26.950993+0000","last_became_active":"2023-08-10T10:40:23.784256+0000","last_became_peered":"2023-08-10T10:40:23.784256+0000","last_unstale":"2023-08-10T10:40:26.950993+0000","last_undegraded":"2023-08-10T10:40:26.950993+0000","last_fullsized":"2023-08-10T10:40:26.950993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793945+0000","last_change":"2023-08-10T10:40:24.814150+0000","last_active":"2023-08-10T10:40:25.793945+0000","last_peered":"2023-08-10T10:40:25.793945+0000","last_clean":"2023-08-10T10:40:25.793945+0000","last_became_active":"2023-08-10T10:40:24.813918+0000","last_became_peered":"2023-08-10T10:40:24.813918+0000","last_unstale":"2023-08-10T10:40:25.793945+0000","last_undegraded":"2023-08-10T10:40:25.793945+0000","last_fullsized":"2023-08-10T10:40:25.793945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029984+0000","last_change":"2023-08-10T10:40:23.780905+0000","last_active":"2023-08-10T10:40:27.029984+0000","last_peered":"2023-08-10T10:40:27.029984+0000","last_clean":"2023-08-10T10:40:27.029984+0000","last_became_active":"2023-08-10T10:40:23.780610+0000","last_became_peered":"2023-08-10T10:40:23.780610+0000","last_unstale":"2023-08-10T10:40:27.029984+0000","last_undegraded":"2023-08-10T10:40:27.029984+0000","last_fullsized":"2023-08-10T10:40:27.029984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:17.908346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799985+0000","last_change":"2023-08-10T10:40:24.814932+0000","last_active":"2023-08-10T10:40:25.799985+0000","last_peered":"2023-08-10T10:40:25.799985+0000","last_clean":"2023-08-10T10:40:25.799985+0000","last_became_active":"2023-08-10T10:40:24.814425+0000","last_became_peered":"2023-08-10T10:40:24.814425+0000","last_unstale":"2023-08-10T10:40:25.799985+0000","last_undegraded":"2023-08-10T10:40:25.799985+0000","last_fullsized":"2023-08-10T10:40:25.799985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928460+0000","last_change":"2023-08-10T10:40:23.777530+0000","last_active":"2023-08-10T10:40:26.928460+0000","last_peered":"2023-08-10T10:40:26.928460+0000","last_clean":"2023-08-10T10:40:26.928460+0000","last_became_active":"2023-08-10T10:40:23.777083+0000","last_became_peered":"2023-08-10T10:40:23.777083+0000","last_unstale":"2023-08-10T10:40:26.928460+0000","last_undegraded":"2023-08-10T10:40:26.928460+0000","last_fullsized":"2023-08-10T10:40:26.928460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:17.301863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794197+0000","last_change":"2023-08-10T10:40:24.819437+0000","last_active":"2023-08-10T10:40:25.794197+0000","last_peered":"2023-08-10T10:40:25.794197+0000","last_clean":"2023-08-10T10:40:25.794197+0000","last_became_active":"2023-08-10T10:40:24.819044+0000","last_became_peered":"2023-08-10T10:40:24.819044+0000","last_unstale":"2023-08-10T10:40:25.794197+0000","last_undegraded":"2023-08-10T10:40:25.794197+0000","last_fullsized":"2023-08-10T10:40:25.794197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927387+0000","last_change":"2023-08-10T10:40:23.775506+0000","last_active":"2023-08-10T10:40:26.927387+0000","last_peered":"2023-08-10T10:40:26.927387+0000","last_clean":"2023-08-10T10:40:26.927387+0000","last_became_active":"2023-08-10T10:40:23.774895+0000","last_became_peered":"2023-08-10T10:40:23.774895+0000","last_unstale":"2023-08-10T10:40:26.927387+0000","last_undegraded":"2023-08-10T10:40:26.927387+0000","last_fullsized":"2023-08-10T10:40:26.927387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:31.676819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799877+0000","last_change":"2023-08-10T10:40:24.822943+0000","last_active":"2023-08-10T10:40:25.799877+0000","last_peered":"2023-08-10T10:40:25.799877+0000","last_clean":"2023-08-10T10:40:25.799877+0000","last_became_active":"2023-08-10T10:40:24.822668+0000","last_became_peered":"2023-08-10T10:40:24.822668+0000","last_unstale":"2023-08-10T10:40:25.799877+0000","last_undegraded":"2023-08-10T10:40:25.799877+0000","last_fullsized":"2023-08-10T10:40:25.799877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:47.706213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794071+0000","last_change":"2023-08-10T10:40:23.779688+0000","last_active":"2023-08-10T10:40:25.794071+0000","last_peered":"2023-08-10T10:40:25.794071+0000","last_clean":"2023-08-10T10:40:25.794071+0000","last_became_active":"2023-08-10T10:40:23.779280+0000","last_became_peered":"2023-08-10T10:40:23.779280+0000","last_unstale":"2023-08-10T10:40:25.794071+0000","last_undegraded":"2023-08-10T10:40:25.794071+0000","last_fullsized":"2023-08-10T10:40:25.794071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:56.873303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927073+0000","last_change":"2023-08-10T10:40:24.820029+0000","last_active":"2023-08-10T10:40:26.927073+0000","last_peered":"2023-08-10T10:40:26.927073+0000","last_clean":"2023-08-10T10:40:26.927073+0000","last_became_active":"2023-08-10T10:40:24.819120+0000","last_became_peered":"2023-08-10T10:40:24.819120+0000","last_unstale":"2023-08-10T10:40:26.927073+0000","last_undegraded":"2023-08-10T10:40:26.927073+0000","last_fullsized":"2023-08-10T10:40:26.927073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:09.748763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926986+0000","last_change":"2023-08-10T10:40:23.783433+0000","last_active":"2023-08-10T10:40:26.926986+0000","last_peered":"2023-08-10T10:40:26.926986+0000","last_clean":"2023-08-10T10:40:26.926986+0000","last_became_active":"2023-08-10T10:40:23.782240+0000","last_became_peered":"2023-08-10T10:40:23.782240+0000","last_unstale":"2023-08-10T10:40:26.926986+0000","last_undegraded":"2023-08-10T10:40:26.926986+0000","last_fullsized":"2023-08-10T10:40:26.926986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:29.656096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950637+0000","last_change":"2023-08-10T10:40:24.823492+0000","last_active":"2023-08-10T10:40:26.950637+0000","last_peered":"2023-08-10T10:40:26.950637+0000","last_clean":"2023-08-10T10:40:26.950637+0000","last_became_active":"2023-08-10T10:40:24.822087+0000","last_became_peered":"2023-08-10T10:40:24.822087+0000","last_unstale":"2023-08-10T10:40:26.950637+0000","last_undegraded":"2023-08-10T10:40:26.950637+0000","last_fullsized":"2023-08-10T10:40:26.950637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:34.038306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950615+0000","last_change":"2023-08-10T10:40:23.780308+0000","last_active":"2023-08-10T10:40:26.950615+0000","last_peered":"2023-08-10T10:40:26.950615+0000","last_clean":"2023-08-10T10:40:26.950615+0000","last_became_active":"2023-08-10T10:40:23.779723+0000","last_became_peered":"2023-08-10T10:40:23.779723+0000","last_unstale":"2023-08-10T10:40:26.950615+0000","last_undegraded":"2023-08-10T10:40:26.950615+0000","last_fullsized":"2023-08-10T10:40:26.950615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:00.077955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793716+0000","last_change":"2023-08-10T10:40:24.812696+0000","last_active":"2023-08-10T10:40:25.793716+0000","last_peered":"2023-08-10T10:40:25.793716+0000","last_clean":"2023-08-10T10:40:25.793716+0000","last_became_active":"2023-08-10T10:40:24.812441+0000","last_became_peered":"2023-08-10T10:40:24.812441+0000","last_unstale":"2023-08-10T10:40:25.793716+0000","last_undegraded":"2023-08-10T10:40:25.793716+0000","last_fullsized":"2023-08-10T10:40:25.793716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:07.596425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029662+0000","last_change":"2023-08-10T10:40:23.778707+0000","last_active":"2023-08-10T10:40:27.029662+0000","last_peered":"2023-08-10T10:40:27.029662+0000","last_clean":"2023-08-10T10:40:27.029662+0000","last_became_active":"2023-08-10T10:40:23.778449+0000","last_became_peered":"2023-08-10T10:40:23.778449+0000","last_unstale":"2023-08-10T10:40:27.029662+0000","last_undegraded":"2023-08-10T10:40:27.029662+0000","last_fullsized":"2023-08-10T10:40:27.029662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:28.984610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928973+0000","last_change":"2023-08-10T10:40:24.814930+0000","last_active":"2023-08-10T10:40:26.928973+0000","last_peered":"2023-08-10T10:40:26.928973+0000","last_clean":"2023-08-10T10:40:26.928973+0000","last_became_active":"2023-08-10T10:40:24.814400+0000","last_became_peered":"2023-08-10T10:40:24.814400+0000","last_unstale":"2023-08-10T10:40:26.928973+0000","last_undegraded":"2023-08-10T10:40:26.928973+0000","last_fullsized":"2023-08-10T10:40:26.928973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:29.998594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950744+0000","last_change":"2023-08-10T10:40:23.777097+0000","last_active":"2023-08-10T10:40:26.950744+0000","last_peered":"2023-08-10T10:40:26.950744+0000","last_clean":"2023-08-10T10:40:26.950744+0000","last_became_active":"2023-08-10T10:40:23.776782+0000","last_became_peered":"2023-08-10T10:40:23.776782+0000","last_unstale":"2023-08-10T10:40:26.950744+0000","last_undegraded":"2023-08-10T10:40:26.950744+0000","last_fullsized":"2023-08-10T10:40:26.950744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:57.254611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928783+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:40:26.928783+0000","last_peered":"2023-08-10T10:40:26.928783+0000","last_clean":"2023-08-10T10:40:26.928783+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:40:26.928783+0000","last_undegraded":"2023-08-10T10:40:26.928783+0000","last_fullsized":"2023-08-10T10:40:26.928783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:53.614758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.801106+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:40:25.801106+0000","last_peered":"2023-08-10T10:40:25.801106+0000","last_clean":"2023-08-10T10:40:25.801106+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:40:25.801106+0000","last_undegraded":"2023-08-10T10:40:25.801106+0000","last_fullsized":"2023-08-10T10:40:25.801106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:46.238601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793626+0000","last_change":"2023-08-10T10:40:24.808340+0000","last_active":"2023-08-10T10:40:25.793626+0000","last_peered":"2023-08-10T10:40:25.793626+0000","last_clean":"2023-08-10T10:40:25.793626+0000","last_became_active":"2023-08-10T10:40:24.807791+0000","last_became_peered":"2023-08-10T10:40:24.807791+0000","last_unstale":"2023-08-10T10:40:25.793626+0000","last_undegraded":"2023-08-10T10:40:25.793626+0000","last_fullsized":"2023-08-10T10:40:25.793626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:31.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928023+0000","last_change":"2023-08-10T10:40:23.778912+0000","last_active":"2023-08-10T10:40:26.928023+0000","last_peered":"2023-08-10T10:40:26.928023+0000","last_clean":"2023-08-10T10:40:26.928023+0000","last_became_active":"2023-08-10T10:40:23.778573+0000","last_became_peered":"2023-08-10T10:40:23.778573+0000","last_unstale":"2023-08-10T10:40:26.928023+0000","last_undegraded":"2023-08-10T10:40:26.928023+0000","last_fullsized":"2023-08-10T10:40:26.928023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:54.113644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928390+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:40:26.928390+0000","last_peered":"2023-08-10T10:40:26.928390+0000","last_clean":"2023-08-10T10:40:26.928390+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:40:26.928390+0000","last_undegraded":"2023-08-10T10:40:26.928390+0000","last_fullsized":"2023-08-10T10:40:26.928390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:01.408663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926387+0000","last_change":"2023-08-10T10:40:24.798884+0000","last_active":"2023-08-10T10:40:26.926387+0000","last_peered":"2023-08-10T10:40:26.926387+0000","last_clean":"2023-08-10T10:40:26.926387+0000","last_became_active":"2023-08-10T10:40:24.798630+0000","last_became_peered":"2023-08-10T10:40:24.798630+0000","last_unstale":"2023-08-10T10:40:26.926387+0000","last_undegraded":"2023-08-10T10:40:26.926387+0000","last_fullsized":"2023-08-10T10:40:26.926387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:30.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950732+0000","last_change":"2023-08-10T10:40:23.780167+0000","last_active":"2023-08-10T10:40:26.950732+0000","last_peered":"2023-08-10T10:40:26.950732+0000","last_clean":"2023-08-10T10:40:26.950732+0000","last_became_active":"2023-08-10T10:40:23.779006+0000","last_became_peered":"2023-08-10T10:40:23.779006+0000","last_unstale":"2023-08-10T10:40:26.950732+0000","last_undegraded":"2023-08-10T10:40:26.950732+0000","last_fullsized":"2023-08-10T10:40:26.950732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:42.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029590+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:40:27.029590+0000","last_peered":"2023-08-10T10:40:27.029590+0000","last_clean":"2023-08-10T10:40:27.029590+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:40:27.029590+0000","last_undegraded":"2023-08-10T10:40:27.029590+0000","last_fullsized":"2023-08-10T10:40:27.029590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:16.949185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800837+0000","last_change":"2023-08-10T10:40:24.816266+0000","last_active":"2023-08-10T10:40:25.800837+0000","last_peered":"2023-08-10T10:40:25.800837+0000","last_clean":"2023-08-10T10:40:25.800837+0000","last_became_active":"2023-08-10T10:40:24.815712+0000","last_became_peered":"2023-08-10T10:40:24.815712+0000","last_unstale":"2023-08-10T10:40:25.800837+0000","last_undegraded":"2023-08-10T10:40:25.800837+0000","last_fullsized":"2023-08-10T10:40:25.800837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:58.265168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927731+0000","last_change":"2023-08-10T10:40:23.781544+0000","last_active":"2023-08-10T10:40:26.927731+0000","last_peered":"2023-08-10T10:40:26.927731+0000","last_clean":"2023-08-10T10:40:26.927731+0000","last_became_active":"2023-08-10T10:40:23.780994+0000","last_became_peered":"2023-08-10T10:40:23.780994+0000","last_unstale":"2023-08-10T10:40:26.927731+0000","last_undegraded":"2023-08-10T10:40:26.927731+0000","last_fullsized":"2023-08-10T10:40:26.927731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:00.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799867+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:40:25.799867+0000","last_peered":"2023-08-10T10:40:25.799867+0000","last_clean":"2023-08-10T10:40:25.799867+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:40:25.799867+0000","last_undegraded":"2023-08-10T10:40:25.799867+0000","last_fullsized":"2023-08-10T10:40:25.799867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:34:13.190807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950839+0000","last_change":"2023-08-10T10:40:24.809284+0000","last_active":"2023-08-10T10:40:26.950839+0000","last_peered":"2023-08-10T10:40:26.950839+0000","last_clean":"2023-08-10T10:40:26.950839+0000","last_became_active":"2023-08-10T10:40:24.809045+0000","last_became_peered":"2023-08-10T10:40:24.809045+0000","last_unstale":"2023-08-10T10:40:26.950839+0000","last_undegraded":"2023-08-10T10:40:26.950839+0000","last_fullsized":"2023-08-10T10:40:26.950839+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:38.580281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799440+0000","last_change":"2023-08-10T10:40:23.763017+0000","last_active":"2023-08-10T10:40:25.799440+0000","last_peered":"2023-08-10T10:40:25.799440+0000","last_clean":"2023-08-10T10:40:25.799440+0000","last_became_active":"2023-08-10T10:40:23.762280+0000","last_became_peered":"2023-08-10T10:40:23.762280+0000","last_unstale":"2023-08-10T10:40:25.799440+0000","last_undegraded":"2023-08-10T10:40:25.799440+0000","last_fullsized":"2023-08-10T10:40:25.799440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:42.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794122+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:40:25.794122+0000","last_peered":"2023-08-10T10:40:25.794122+0000","last_clean":"2023-08-10T10:40:25.794122+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:40:25.794122+0000","last_undegraded":"2023-08-10T10:40:25.794122+0000","last_fullsized":"2023-08-10T10:40:25.794122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:46.486996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926361+0000","last_change":"2023-08-10T10:40:24.800161+0000","last_active":"2023-08-10T10:40:26.926361+0000","last_peered":"2023-08-10T10:40:26.926361+0000","last_clean":"2023-08-10T10:40:26.926361+0000","last_became_active":"2023-08-10T10:40:24.799202+0000","last_became_peered":"2023-08-10T10:40:24.799202+0000","last_unstale":"2023-08-10T10:40:26.926361+0000","last_undegraded":"2023-08-10T10:40:26.926361+0000","last_fullsized":"2023-08-10T10:40:26.926361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:47.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799019+0000","last_change":"2023-08-10T10:40:23.774983+0000","last_active":"2023-08-10T10:40:25.799019+0000","last_peered":"2023-08-10T10:40:25.799019+0000","last_clean":"2023-08-10T10:40:25.799019+0000","last_became_active":"2023-08-10T10:40:23.774282+0000","last_became_peered":"2023-08-10T10:40:23.774282+0000","last_unstale":"2023-08-10T10:40:25.799019+0000","last_undegraded":"2023-08-10T10:40:25.799019+0000","last_fullsized":"2023-08-10T10:40:25.799019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:27:48.841515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927710+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:40:26.927710+0000","last_peered":"2023-08-10T10:40:26.927710+0000","last_clean":"2023-08-10T10:40:26.927710+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:40:26.927710+0000","last_undegraded":"2023-08-10T10:40:26.927710+0000","last_fullsized":"2023-08-10T10:40:26.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:46.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950994+0000","last_change":"2023-08-10T10:40:24.813983+0000","last_active":"2023-08-10T10:40:26.950994+0000","last_peered":"2023-08-10T10:40:26.950994+0000","last_clean":"2023-08-10T10:40:26.950994+0000","last_became_active":"2023-08-10T10:40:24.813752+0000","last_became_peered":"2023-08-10T10:40:24.813752+0000","last_unstale":"2023-08-10T10:40:26.950994+0000","last_undegraded":"2023-08-10T10:40:26.950994+0000","last_fullsized":"2023-08-10T10:40:26.950994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:57:49.594396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926425+0000","last_change":"2023-08-10T10:40:23.781205+0000","last_active":"2023-08-10T10:40:26.926425+0000","last_peered":"2023-08-10T10:40:26.926425+0000","last_clean":"2023-08-10T10:40:26.926425+0000","last_became_active":"2023-08-10T10:40:23.780651+0000","last_became_peered":"2023-08-10T10:40:23.780651+0000","last_unstale":"2023-08-10T10:40:26.926425+0000","last_undegraded":"2023-08-10T10:40:26.926425+0000","last_fullsized":"2023-08-10T10:40:26.926425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:43.237165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794275+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:40:25.794275+0000","last_peered":"2023-08-10T10:40:25.794275+0000","last_clean":"2023-08-10T10:40:25.794275+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:40:25.794275+0000","last_undegraded":"2023-08-10T10:40:25.794275+0000","last_fullsized":"2023-08-10T10:40:25.794275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:56.240684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800661+0000","last_change":"2023-08-10T10:40:24.828245+0000","last_active":"2023-08-10T10:40:25.800661+0000","last_peered":"2023-08-10T10:40:25.800661+0000","last_clean":"2023-08-10T10:40:25.800661+0000","last_became_active":"2023-08-10T10:40:24.825941+0000","last_became_peered":"2023-08-10T10:40:24.825941+0000","last_unstale":"2023-08-10T10:40:25.800661+0000","last_undegraded":"2023-08-10T10:40:25.800661+0000","last_fullsized":"2023-08-10T10:40:25.800661+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:20.079337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926695+0000","last_change":"2023-08-10T10:40:23.783410+0000","last_active":"2023-08-10T10:40:26.926695+0000","last_peered":"2023-08-10T10:40:26.926695+0000","last_clean":"2023-08-10T10:40:26.926695+0000","last_became_active":"2023-08-10T10:40:23.780450+0000","last_became_peered":"2023-08-10T10:40:23.780450+0000","last_unstale":"2023-08-10T10:40:26.926695+0000","last_undegraded":"2023-08-10T10:40:26.926695+0000","last_fullsized":"2023-08-10T10:40:26.926695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:20.582917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928130+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:40:26.928130+0000","last_peered":"2023-08-10T10:40:26.928130+0000","last_clean":"2023-08-10T10:40:26.928130+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:40:26.928130+0000","last_undegraded":"2023-08-10T10:40:26.928130+0000","last_fullsized":"2023-08-10T10:40:26.928130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:31.999688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":837,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.486,"5min":1.613,"15min":1.613},"last":1.5189999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.427,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.05},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.133,"15min":1.1259999999999999},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4370000000000001,"5min":2.742,"15min":2.742},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.71299999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4570000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.5860000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.206,"15min":1.216},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.548,"5min":1.704,"15min":1.704},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.371,"15min":1.395},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.593,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6180000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.244,"15min":1.258},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.611,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.417}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.409,"15min":1.4339999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.482},{"interface":"front","average":{"1min":1.359,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8240000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.111}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.5700000000000001,"15min":1.601},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.78,"5min":2.25,"15min":2.25},"last":1.27},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.484,"15min":1.51},"min":{"1min":0.84299999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.865,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.2370000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6200000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.5609999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.486,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.141,"15min":1.149},"min":{"1min":0.79700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6739999999999999,"5min":1.96,"15min":1.96},"last":1.482}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.119,"15min":1.107},"min":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.206,"15min":1.202},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5589999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.173,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6100000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.755},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.232},"min":{"1min":0.90900000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.732,"15min":1.732},"last":1.3819999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1919999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8420000000000001,"5min":2.04,"15min":2.04},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.385,"15min":1.381},"min":{"1min":0.88800000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.79,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.3}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.383,"15min":1.367},"min":{"1min":0.97199999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8340000000000001,"5min":2.028,"15min":2.028},"last":1.671},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9790000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.087}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.345,"15min":1.341},"min":{"1min":0.81399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.2690000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.995},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.462,"15min":1.448},"min":{"1min":0.93300000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0259999999999998,"5min":2.698,"15min":2.698},"last":1.1259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195052,"statfs":{"total":200000000,"available":199733403,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.093,"15min":1.0640000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.833,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.014,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.484,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.4650000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.2170000000000001,"15min":1.232},"min":{"1min":0.81999999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5589999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2130000000000001,"15min":1.2350000000000001},"min":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6379999999999999,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3460000000000001,"15min":1.3700000000000001},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.246,"15min":1.25},"min":{"1min":0.91100000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3899999999999999,"15min":1.391},"min":{"1min":0.96199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7989999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.4339999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.875,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9039999999999999,"5min":2.399,"15min":2.399},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.617,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.333}]},{"osd":6,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.88600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.583},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.399,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.49,"15min":1.49},"min":{"1min":1.165,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6990000000000001,"5min":1.885,"15min":1.885},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.484},"min":{"1min":1.161,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.508}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4650000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.512},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.181,"15min":1.1930000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.637,"5min":1.667,"15min":1.667},"last":1.232}]},{"osd":1,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7110000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.119,"15min":1.137},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.365,"5min":1.677,"15min":1.677},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1220000000000001,"15min":1.1299999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.758,"5min":2.004,"15min":2.004},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.272,"15min":1.286},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5409999999999999,"5min":1.893,"15min":1.893},"last":1.3839999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5469999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2450000000000001,"15min":1.2549999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":1.863,"15min":1.863},"last":1.6830000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.343,"15min":1.3540000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8049999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.474},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2749999999999999,"15min":1.2809999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.6399999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3109999999999999,"15min":1.3160000000000001},"min":{"1min":0.92900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":1.349},{"interface":"front","average":{"1min":1.393,"5min":1.4410000000000001,"15min":1.4490000000000001},"min":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7210000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.601}]},{"osd":7,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3939999999999999,"15min":1.401},"min":{"1min":0.68999999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7989999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4750000000000001,"15min":1.4870000000000001},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.788}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730798,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.93500000000000005,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.93300000000000005,"15min":0.88900000000000001},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.268,"5min":1.042,"15min":1.004},"min":{"1min":0.58299999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.84799999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.079},{"interface":"front","average":{"1min":1.298,"5min":1.1839999999999999,"15min":1.165},"min":{"1min":0.92700000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.2989999999999999,"15min":1.2809999999999999},"min":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0059999999999998,"5min":2.125,"15min":2.125},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.3580000000000001,"15min":1.331},"min":{"1min":0.84499999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.01}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.248,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.3899999999999999,"15min":1.3640000000000001},"min":{"1min":1.002,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.427,"15min":1.403},"min":{"1min":0.94899999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.325,"15min":1.2949999999999999},"min":{"1min":0.96899999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.873},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4359999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.073,"15min":1.0740000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.502,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4199999999999999,"5min":1.639,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2370000000000001,"15min":1.2629999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6259999999999999,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.8069999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.276,"15min":1.282},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6759999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.226}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2490000000000001,"15min":1.254},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.696,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.018},{"interface":"front","average":{"1min":1.391,"5min":1.4630000000000001,"15min":1.4750000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8500000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.351},"min":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.341},{"interface":"front","average":{"1min":1.298,"5min":1.325,"15min":1.329},"min":{"1min":0.85499999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.766,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.371,"15min":1.361},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.405,"15min":1.403},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.2789999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195051,"statfs":{"total":200000000,"available":199732224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.441,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.296,"5min":1.548,"15min":1.548},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6339999999999999,"5min":2.246,"15min":2.246},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.742,"5min":1.913,"15min":1.913},"last":1.105}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0049999999999999,"15min":0.997},"min":{"1min":0.51100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.01},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1399999999999999,"15min":1.119},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.431},{"interface":"front","average":{"1min":1.403,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.629}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3400000000000001,"15min":1.3340000000000001},"min":{"1min":1.0580000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.333},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.752,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.363}]},{"osd":6,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.87,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.232},{"interface":"front","average":{"1min":1.25,"5min":1.204,"15min":1.196},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.294}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.403,"15min":1.411},"min":{"1min":0.81299999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.351,"15min":1.343},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":836,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194475,"statfs":{"total":200000000,"available":199142979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97399999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.442},"max":{"1min":1.387,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0209999999999999,"15min":1.0149999999999999},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4630000000000001,"5min":1.853,"15min":1.853},"last":0.754}]},{"osd":2,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.028,"15min":1.018},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.516,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.62,"5min":0.496,"15min":0.496},"max":{"1min":1.393,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0660000000000001,"15min":1.0820000000000001},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.536,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.98599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.623,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.377,"15min":1.3740000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.165}]},{"osd":5,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.0069999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":1.986},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.258},"min":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.091}]},{"osd":6,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4350000000000001,"15min":1.4450000000000001},"min":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.0129999999999999,"5min":2.04,"15min":2.04},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.4299999999999999},"min":{"1min":0.95699999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.7869999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5249999999999999,"15min":1.5329999999999999},"min":{"1min":1.093,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8799999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.423,"5min":1.389,"15min":1.383},"min":{"1min":0.94499999999999995,"5min":0.879,"15min":0.879},"max":{"1min":1.9610000000000001,"5min":2.601,"15min":2.601},"last":1.3260000000000001}]}]}],"pool_statfs":[]}} 2023-08-10T10:40:34.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:40:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.716+0000 7fd6ace83640 1 Processor -- start 2023-08-10T10:40:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.716+0000 7fd6ace83640 1 -- start start 2023-08-10T10:40:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6ace83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6a815ccb0 0x7fd6a80b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6ace83640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a80719f0 con 0x7fd6a8069db0 2023-08-10T10:40:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6ace83640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a80c8db0 con 0x7fd6a80c9b30 2023-08-10T10:40:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6ace83640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a80c9050 con 0x7fd6a815ccb0 2023-08-10T10:40:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6a659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6a815ccb0 0x7fd6a80b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6a659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6a815ccb0 0x7fd6a80b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59770/0 (socket says 172.21.15.50:59770) 2023-08-10T10:40:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.718+0000 7fd6a659c640 1 -- 172.21.15.50:0/2164631171 learned_addr learned my addr 172.21.15.50:0/2164631171 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.719+0000 7fd6a659c640 1 -- 172.21.15.50:0/2164631171 >> v1:172.21.15.117:6789/0 conn(0x7fd6a80c9b30 legacy=0x7fd6a80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.719+0000 7fd6a659c640 1 -- 172.21.15.50:0/2164631171 >> v1:172.21.15.50:6789/0 conn(0x7fd6a8069db0 legacy=0x7fd6a806ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.719+0000 7fd6a659c640 1 -- 172.21.15.50:0/2164631171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80c9330 con 0x7fd6a815ccb0 2023-08-10T10:40:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.720+0000 7fd6a659c640 1 --2- 172.21.15.50:0/2164631171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a80b2900 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd698009870 tx=0x7fd69802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e8225fb6b6225 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.720+0000 7fd6a559a640 1 -- 172.21.15.50:0/2164631171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698030860 con 0x7fd6a815ccb0 2023-08-10T10:40:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.720+0000 7fd6a559a640 1 -- 172.21.15.50:0/2164631171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6980309c0 con 0x7fd6a815ccb0 2023-08-10T10:40:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.720+0000 7fd6a559a640 1 -- 172.21.15.50:0/2164631171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698030d50 con 0x7fd6a815ccb0 2023-08-10T10:40:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 -- 172.21.15.50:0/2164631171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 msgr2=0x7fd6a80b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2164631171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a80b2900 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd698009870 tx=0x7fd69802b9a0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 -- 172.21.15.50:0/2164631171 shutdown_connections 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2164631171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a80b2900 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 -- 172.21.15.50:0/2164631171 >> 172.21.15.50:0/2164631171 conn(0x7fd6a806b590 msgr2=0x7fd6a80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 -- 172.21.15.50:0/2164631171 shutdown_connections 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.721+0000 7fd6ace83640 1 -- 172.21.15.50:0/2164631171 wait complete. 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.723+0000 7fd6ace83640 1 Processor -- start 2023-08-10T10:40:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.723+0000 7fd6ace83640 1 -- start start 2023-08-10T10:40:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6a8069db0 0x7fd6a8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 0x7fd6a81515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8151fa0 con 0x7fd6a815ccb0 2023-08-10T10:40:34.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8152280 con 0x7fd6a80c9b30 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6ace83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8152560 con 0x7fd6a8069db0 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6a6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6a6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59786/0 (socket says 172.21.15.50:59786) 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.724+0000 7fd6a6d9d640 1 -- 172.21.15.50:0/2378616906 learned_addr learned my addr 172.21.15.50:0/2378616906 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a5d9b640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 0x7fd6a81515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 -- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6a8069db0 msgr2=0x7fd6a8157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6a8069db0 0x7fd6a8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 -- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 msgr2=0x7fd6a81515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 0x7fd6a81515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 -- 172.21.15.50:0/2378616906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980094d0 con 0x7fd6a815ccb0 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a5d9b640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 0x7fd6a81515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6a6d9d640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c730 tx=0x7fd6a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0003b70 con 0x7fd6a815ccb0 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0003cd0 con 0x7fd6a815ccb0 2023-08-10T10:40:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000aa90 con 0x7fd6a815ccb0 2023-08-10T10:40:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.725+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a8152840 con 0x7fd6a815ccb0 2023-08-10T10:40:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.726+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a8157e60 con 0x7fd6a815ccb0 2023-08-10T10:40:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.727+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8152d60 con 0x7fd6a815ccb0 2023-08-10T10:40:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.728+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6a000abf0 con 0x7fd6a815ccb0 2023-08-10T10:40:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.729+0000 7fd696ffd640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 0x7fd68806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.729+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6a0089350 con 0x7fd6a815ccb0 2023-08-10T10:40:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.729+0000 7fd6a659c640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 0x7fd68806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.730+0000 7fd6a659c640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 0x7fd68806d110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd698036000 tx=0x7fd69803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.734+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd6a0054360 con 0x7fd6a815ccb0 2023-08-10T10:40:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.919+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6a80c9610 con 0x7fd68806ac50 2023-08-10T10:40:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.932+0000 7fd696ffd640 1 -- 172.21.15.50:0/2378616906 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302738 (secure 0 0 0) 0x7fd698030c30 con 0x7fd68806ac50 2023-08-10T10:40:34.939 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:40:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 msgr2=0x7fd68806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 0x7fd68806d110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd698036000 tx=0x7fd69803b040 comp rx=0 tx=0).stop 2023-08-10T10:40:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 msgr2=0x7fd6a81539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c730 tx=0x7fd6a000cbf0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 shutdown_connections 2023-08-10T10:40:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a815ccb0 0x7fd6a81539d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68806ac50 0x7fd68806d110 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a80c9b30 0x7fd6a81515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 --2- 172.21.15.50:0/2378616906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6a8069db0 0x7fd6a8157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 >> 172.21.15.50:0/2378616906 conn(0x7fd6a806b590 msgr2=0x7fd6a8070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.939+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 shutdown_connections 2023-08-10T10:40:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:34.940+0000 7fd6ace83640 1 -- 172.21.15.50:0/2378616906 wait complete. 2023-08-10T10:40:34.961 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-08-10T10:40:34.361045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3246,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559253,"statfs":{"total":1600000000,"available":1596675650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.569595"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793647+0000","last_change":"2023-08-10T10:40:24.819297+0000","last_active":"2023-08-10T10:40:25.793647+0000","last_peered":"2023-08-10T10:40:25.793647+0000","last_clean":"2023-08-10T10:40:25.793647+0000","last_became_active":"2023-08-10T10:40:24.818707+0000","last_became_peered":"2023-08-10T10:40:24.818707+0000","last_unstale":"2023-08-10T10:40:25.793647+0000","last_undegraded":"2023-08-10T10:40:25.793647+0000","last_fullsized":"2023-08-10T10:40:25.793647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:47.566051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927741+0000","last_change":"2023-08-10T10:40:24.826025+0000","last_active":"2023-08-10T10:40:26.927741+0000","last_peered":"2023-08-10T10:40:26.927741+0000","last_clean":"2023-08-10T10:40:26.927741+0000","last_became_active":"2023-08-10T10:40:24.825801+0000","last_became_peered":"2023-08-10T10:40:24.825801+0000","last_unstale":"2023-08-10T10:40:26.927741+0000","last_undegraded":"2023-08-10T10:40:26.927741+0000","last_fullsized":"2023-08-10T10:40:26.927741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:26.431836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950498+0000","last_change":"2023-08-10T10:40:24.810909+0000","last_active":"2023-08-10T10:40:26.950498+0000","last_peered":"2023-08-10T10:40:26.950498+0000","last_clean":"2023-08-10T10:40:26.950498+0000","last_became_active":"2023-08-10T10:40:24.809876+0000","last_became_peered":"2023-08-10T10:40:24.809876+0000","last_unstale":"2023-08-10T10:40:26.950498+0000","last_undegraded":"2023-08-10T10:40:26.950498+0000","last_fullsized":"2023-08-10T10:40:26.950498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:23.622167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927461+0000","last_change":"2023-08-10T10:40:24.821547+0000","last_active":"2023-08-10T10:40:26.927461+0000","last_peered":"2023-08-10T10:40:26.927461+0000","last_clean":"2023-08-10T10:40:26.927461+0000","last_became_active":"2023-08-10T10:40:24.821285+0000","last_became_peered":"2023-08-10T10:40:24.821285+0000","last_unstale":"2023-08-10T10:40:26.927461+0000","last_undegraded":"2023-08-10T10:40:26.927461+0000","last_fullsized":"2023-08-10T10:40:26.927461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:57.962021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800370+0000","last_change":"2023-08-10T10:40:24.821946+0000","last_active":"2023-08-10T10:40:25.800370+0000","last_peered":"2023-08-10T10:40:25.800370+0000","last_clean":"2023-08-10T10:40:25.800370+0000","last_became_active":"2023-08-10T10:40:24.821611+0000","last_became_peered":"2023-08-10T10:40:24.821611+0000","last_unstale":"2023-08-10T10:40:25.800370+0000","last_undegraded":"2023-08-10T10:40:25.800370+0000","last_fullsized":"2023-08-10T10:40:25.800370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794029+0000","last_change":"2023-08-10T10:40:24.825555+0000","last_active":"2023-08-10T10:40:25.794029+0000","last_peered":"2023-08-10T10:40:25.794029+0000","last_clean":"2023-08-10T10:40:25.794029+0000","last_became_active":"2023-08-10T10:40:24.825326+0000","last_became_peered":"2023-08-10T10:40:24.825326+0000","last_unstale":"2023-08-10T10:40:25.794029+0000","last_undegraded":"2023-08-10T10:40:25.794029+0000","last_fullsized":"2023-08-10T10:40:25.794029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950462+0000","last_change":"2023-08-10T10:40:24.810497+0000","last_active":"2023-08-10T10:40:26.950462+0000","last_peered":"2023-08-10T10:40:26.950462+0000","last_clean":"2023-08-10T10:40:26.950462+0000","last_became_active":"2023-08-10T10:40:24.809819+0000","last_became_peered":"2023-08-10T10:40:24.809819+0000","last_unstale":"2023-08-10T10:40:26.950462+0000","last_undegraded":"2023-08-10T10:40:26.950462+0000","last_fullsized":"2023-08-10T10:40:26.950462+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:37.459852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925958+0000","last_change":"2023-08-10T10:40:24.809581+0000","last_active":"2023-08-10T10:40:26.925958+0000","last_peered":"2023-08-10T10:40:26.925958+0000","last_clean":"2023-08-10T10:40:26.925958+0000","last_became_active":"2023-08-10T10:40:24.809207+0000","last_became_peered":"2023-08-10T10:40:24.809207+0000","last_unstale":"2023-08-10T10:40:26.925958+0000","last_undegraded":"2023-08-10T10:40:26.925958+0000","last_fullsized":"2023-08-10T10:40:26.925958+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.319464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.925985+0000","last_change":"2023-08-10T10:40:24.809021+0000","last_active":"2023-08-10T10:40:26.925985+0000","last_peered":"2023-08-10T10:40:26.925985+0000","last_clean":"2023-08-10T10:40:26.925985+0000","last_became_active":"2023-08-10T10:40:24.808722+0000","last_became_peered":"2023-08-10T10:40:24.808722+0000","last_unstale":"2023-08-10T10:40:26.925985+0000","last_undegraded":"2023-08-10T10:40:26.925985+0000","last_fullsized":"2023-08-10T10:40:26.925985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:57.887287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793886+0000","last_change":"2023-08-10T10:40:24.822453+0000","last_active":"2023-08-10T10:40:25.793886+0000","last_peered":"2023-08-10T10:40:25.793886+0000","last_clean":"2023-08-10T10:40:25.793886+0000","last_became_active":"2023-08-10T10:40:24.822211+0000","last_became_peered":"2023-08-10T10:40:24.822211+0000","last_unstale":"2023-08-10T10:40:25.793886+0000","last_undegraded":"2023-08-10T10:40:25.793886+0000","last_fullsized":"2023-08-10T10:40:25.793886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:43.869883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029126+0000","last_change":"2023-08-10T10:40:24.824743+0000","last_active":"2023-08-10T10:40:27.029126+0000","last_peered":"2023-08-10T10:40:27.029126+0000","last_clean":"2023-08-10T10:40:27.029126+0000","last_became_active":"2023-08-10T10:40:24.824477+0000","last_became_peered":"2023-08-10T10:40:24.824477+0000","last_unstale":"2023-08-10T10:40:27.029126+0000","last_undegraded":"2023-08-10T10:40:27.029126+0000","last_fullsized":"2023-08-10T10:40:27.029126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:48.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926255+0000","last_change":"2023-08-10T10:40:24.811049+0000","last_active":"2023-08-10T10:40:26.926255+0000","last_peered":"2023-08-10T10:40:26.926255+0000","last_clean":"2023-08-10T10:40:26.926255+0000","last_became_active":"2023-08-10T10:40:24.810393+0000","last_became_peered":"2023-08-10T10:40:24.810393+0000","last_unstale":"2023-08-10T10:40:26.926255+0000","last_undegraded":"2023-08-10T10:40:26.926255+0000","last_fullsized":"2023-08-10T10:40:26.926255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:47.992472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793741+0000","last_change":"2023-08-10T10:40:24.817177+0000","last_active":"2023-08-10T10:40:25.793741+0000","last_peered":"2023-08-10T10:40:25.793741+0000","last_clean":"2023-08-10T10:40:25.793741+0000","last_became_active":"2023-08-10T10:40:24.816897+0000","last_became_peered":"2023-08-10T10:40:24.816897+0000","last_unstale":"2023-08-10T10:40:25.793741+0000","last_undegraded":"2023-08-10T10:40:25.793741+0000","last_fullsized":"2023-08-10T10:40:25.793741+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950439+0000","last_change":"2023-08-10T10:40:24.813196+0000","last_active":"2023-08-10T10:40:26.950439+0000","last_peered":"2023-08-10T10:40:26.950439+0000","last_clean":"2023-08-10T10:40:26.950439+0000","last_became_active":"2023-08-10T10:40:24.812791+0000","last_became_peered":"2023-08-10T10:40:24.812791+0000","last_unstale":"2023-08-10T10:40:26.950439+0000","last_undegraded":"2023-08-10T10:40:26.950439+0000","last_fullsized":"2023-08-10T10:40:26.950439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:06.144104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928356+0000","last_change":"2023-08-10T10:40:24.823572+0000","last_active":"2023-08-10T10:40:26.928356+0000","last_peered":"2023-08-10T10:40:26.928356+0000","last_clean":"2023-08-10T10:40:26.928356+0000","last_became_active":"2023-08-10T10:40:24.823304+0000","last_became_peered":"2023-08-10T10:40:24.823304+0000","last_unstale":"2023-08-10T10:40:26.928356+0000","last_undegraded":"2023-08-10T10:40:26.928356+0000","last_fullsized":"2023-08-10T10:40:26.928356+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:47.448633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793852+0000","last_change":"2023-08-10T10:40:24.816495+0000","last_active":"2023-08-10T10:40:25.793852+0000","last_peered":"2023-08-10T10:40:25.793852+0000","last_clean":"2023-08-10T10:40:25.793852+0000","last_became_active":"2023-08-10T10:40:24.816236+0000","last_became_peered":"2023-08-10T10:40:24.816236+0000","last_unstale":"2023-08-10T10:40:25.793852+0000","last_undegraded":"2023-08-10T10:40:25.793852+0000","last_fullsized":"2023-08-10T10:40:25.793852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:59.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950825+0000","last_change":"2023-08-10T10:40:24.825629+0000","last_active":"2023-08-10T10:40:26.950825+0000","last_peered":"2023-08-10T10:40:26.950825+0000","last_clean":"2023-08-10T10:40:26.950825+0000","last_became_active":"2023-08-10T10:40:24.825189+0000","last_became_peered":"2023-08-10T10:40:24.825189+0000","last_unstale":"2023-08-10T10:40:26.950825+0000","last_undegraded":"2023-08-10T10:40:26.950825+0000","last_fullsized":"2023-08-10T10:40:26.950825+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:44.656604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927540+0000","last_change":"2023-08-10T10:40:24.820809+0000","last_active":"2023-08-10T10:40:26.927540+0000","last_peered":"2023-08-10T10:40:26.927540+0000","last_clean":"2023-08-10T10:40:26.927540+0000","last_became_active":"2023-08-10T10:40:24.819946+0000","last_became_peered":"2023-08-10T10:40:24.819946+0000","last_unstale":"2023-08-10T10:40:26.927540+0000","last_undegraded":"2023-08-10T10:40:26.927540+0000","last_fullsized":"2023-08-10T10:40:26.927540+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:55.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950222+0000","last_change":"2023-08-10T10:40:24.820089+0000","last_active":"2023-08-10T10:40:26.950222+0000","last_peered":"2023-08-10T10:40:26.950222+0000","last_clean":"2023-08-10T10:40:26.950222+0000","last_became_active":"2023-08-10T10:40:24.819656+0000","last_became_peered":"2023-08-10T10:40:24.819656+0000","last_unstale":"2023-08-10T10:40:26.950222+0000","last_undegraded":"2023-08-10T10:40:26.950222+0000","last_fullsized":"2023-08-10T10:40:26.950222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:02.236304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928603+0000","last_change":"2023-08-10T10:40:24.825090+0000","last_active":"2023-08-10T10:40:26.928603+0000","last_peered":"2023-08-10T10:40:26.928603+0000","last_clean":"2023-08-10T10:40:26.928603+0000","last_became_active":"2023-08-10T10:40:24.824657+0000","last_became_peered":"2023-08-10T10:40:24.824657+0000","last_unstale":"2023-08-10T10:40:26.928603+0000","last_undegraded":"2023-08-10T10:40:26.928603+0000","last_fullsized":"2023-08-10T10:40:26.928603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:26.593162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927498+0000","last_change":"2023-08-10T10:40:24.827481+0000","last_active":"2023-08-10T10:40:26.927498+0000","last_peered":"2023-08-10T10:40:26.927498+0000","last_clean":"2023-08-10T10:40:26.927498+0000","last_became_active":"2023-08-10T10:40:24.827080+0000","last_became_peered":"2023-08-10T10:40:24.827080+0000","last_unstale":"2023-08-10T10:40:26.927498+0000","last_undegraded":"2023-08-10T10:40:26.927498+0000","last_fullsized":"2023-08-10T10:40:26.927498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:57:50.126890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926412+0000","last_change":"2023-08-10T10:40:24.810755+0000","last_active":"2023-08-10T10:40:26.926412+0000","last_peered":"2023-08-10T10:40:26.926412+0000","last_clean":"2023-08-10T10:40:26.926412+0000","last_became_active":"2023-08-10T10:40:24.809982+0000","last_became_peered":"2023-08-10T10:40:24.809982+0000","last_unstale":"2023-08-10T10:40:26.926412+0000","last_undegraded":"2023-08-10T10:40:26.926412+0000","last_fullsized":"2023-08-10T10:40:26.926412+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:00.816162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029140+0000","last_change":"2023-08-10T10:40:24.818772+0000","last_active":"2023-08-10T10:40:27.029140+0000","last_peered":"2023-08-10T10:40:27.029140+0000","last_clean":"2023-08-10T10:40:27.029140+0000","last_became_active":"2023-08-10T10:40:24.818516+0000","last_became_peered":"2023-08-10T10:40:24.818516+0000","last_unstale":"2023-08-10T10:40:27.029140+0000","last_undegraded":"2023-08-10T10:40:27.029140+0000","last_fullsized":"2023-08-10T10:40:27.029140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:18.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950658+0000","last_change":"2023-08-10T10:40:24.813047+0000","last_active":"2023-08-10T10:40:26.950658+0000","last_peered":"2023-08-10T10:40:26.950658+0000","last_clean":"2023-08-10T10:40:26.950658+0000","last_became_active":"2023-08-10T10:40:24.812364+0000","last_became_peered":"2023-08-10T10:40:24.812364+0000","last_unstale":"2023-08-10T10:40:26.950658+0000","last_undegraded":"2023-08-10T10:40:26.950658+0000","last_fullsized":"2023-08-10T10:40:26.950658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:48.663407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950191+0000","last_change":"2023-08-10T10:40:24.813194+0000","last_active":"2023-08-10T10:40:26.950191+0000","last_peered":"2023-08-10T10:40:26.950191+0000","last_clean":"2023-08-10T10:40:26.950191+0000","last_became_active":"2023-08-10T10:40:24.812949+0000","last_became_peered":"2023-08-10T10:40:24.812949+0000","last_unstale":"2023-08-10T10:40:26.950191+0000","last_undegraded":"2023-08-10T10:40:26.950191+0000","last_fullsized":"2023-08-10T10:40:26.950191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:46.730566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926222+0000","last_change":"2023-08-10T10:40:24.800429+0000","last_active":"2023-08-10T10:40:26.926222+0000","last_peered":"2023-08-10T10:40:26.926222+0000","last_clean":"2023-08-10T10:40:26.926222+0000","last_became_active":"2023-08-10T10:40:24.800143+0000","last_became_peered":"2023-08-10T10:40:24.800143+0000","last_unstale":"2023-08-10T10:40:26.926222+0000","last_undegraded":"2023-08-10T10:40:26.926222+0000","last_fullsized":"2023-08-10T10:40:26.926222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793511+0000","last_change":"2023-08-10T10:40:24.813750+0000","last_active":"2023-08-10T10:40:25.793511+0000","last_peered":"2023-08-10T10:40:25.793511+0000","last_clean":"2023-08-10T10:40:25.793511+0000","last_became_active":"2023-08-10T10:40:24.813465+0000","last_became_peered":"2023-08-10T10:40:24.813465+0000","last_unstale":"2023-08-10T10:40:25.793511+0000","last_undegraded":"2023-08-10T10:40:25.793511+0000","last_fullsized":"2023-08-10T10:40:25.793511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.892628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927452+0000","last_change":"2023-08-10T10:40:24.810252+0000","last_active":"2023-08-10T10:40:26.927452+0000","last_peered":"2023-08-10T10:40:26.927452+0000","last_clean":"2023-08-10T10:40:26.927452+0000","last_became_active":"2023-08-10T10:40:24.809664+0000","last_became_peered":"2023-08-10T10:40:24.809664+0000","last_unstale":"2023-08-10T10:40:26.927452+0000","last_undegraded":"2023-08-10T10:40:26.927452+0000","last_fullsized":"2023-08-10T10:40:26.927452+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:55.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950865+0000","last_change":"2023-08-10T10:40:24.816841+0000","last_active":"2023-08-10T10:40:26.950865+0000","last_peered":"2023-08-10T10:40:26.950865+0000","last_clean":"2023-08-10T10:40:26.950865+0000","last_became_active":"2023-08-10T10:40:24.816426+0000","last_became_peered":"2023-08-10T10:40:24.816426+0000","last_unstale":"2023-08-10T10:40:26.950865+0000","last_undegraded":"2023-08-10T10:40:26.950865+0000","last_fullsized":"2023-08-10T10:40:26.950865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:27.176324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928716+0000","last_change":"2023-08-10T10:40:24.817678+0000","last_active":"2023-08-10T10:40:26.928716+0000","last_peered":"2023-08-10T10:40:26.928716+0000","last_clean":"2023-08-10T10:40:26.928716+0000","last_became_active":"2023-08-10T10:40:24.817364+0000","last_became_peered":"2023-08-10T10:40:24.817364+0000","last_unstale":"2023-08-10T10:40:26.928716+0000","last_undegraded":"2023-08-10T10:40:26.928716+0000","last_fullsized":"2023-08-10T10:40:26.928716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:11.524071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950305+0000","last_change":"2023-08-10T10:40:24.810723+0000","last_active":"2023-08-10T10:40:26.950305+0000","last_peered":"2023-08-10T10:40:26.950305+0000","last_clean":"2023-08-10T10:40:26.950305+0000","last_became_active":"2023-08-10T10:40:24.810513+0000","last_became_peered":"2023-08-10T10:40:24.810513+0000","last_unstale":"2023-08-10T10:40:26.950305+0000","last_undegraded":"2023-08-10T10:40:26.950305+0000","last_fullsized":"2023-08-10T10:40:26.950305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:31.743560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799135+0000","last_change":"2023-08-10T10:40:24.821404+0000","last_active":"2023-08-10T10:40:25.799135+0000","last_peered":"2023-08-10T10:40:25.799135+0000","last_clean":"2023-08-10T10:40:25.799135+0000","last_became_active":"2023-08-10T10:40:24.820416+0000","last_became_peered":"2023-08-10T10:40:24.820416+0000","last_unstale":"2023-08-10T10:40:25.799135+0000","last_undegraded":"2023-08-10T10:40:25.799135+0000","last_fullsized":"2023-08-10T10:40:25.799135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:08.314818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929000+0000","last_change":"2023-08-10T10:40:24.822019+0000","last_active":"2023-08-10T10:40:26.929000+0000","last_peered":"2023-08-10T10:40:26.929000+0000","last_clean":"2023-08-10T10:40:26.929000+0000","last_became_active":"2023-08-10T10:40:24.820481+0000","last_became_peered":"2023-08-10T10:40:24.820481+0000","last_unstale":"2023-08-10T10:40:26.929000+0000","last_undegraded":"2023-08-10T10:40:26.929000+0000","last_fullsized":"2023-08-10T10:40:26.929000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:42.939869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927747+0000","last_change":"2023-08-10T10:40:23.781267+0000","last_active":"2023-08-10T10:40:26.927747+0000","last_peered":"2023-08-10T10:40:26.927747+0000","last_clean":"2023-08-10T10:40:26.927747+0000","last_became_active":"2023-08-10T10:40:23.779166+0000","last_became_peered":"2023-08-10T10:40:23.779166+0000","last_unstale":"2023-08-10T10:40:26.927747+0000","last_undegraded":"2023-08-10T10:40:26.927747+0000","last_fullsized":"2023-08-10T10:40:26.927747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:48.412032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799486+0000","last_change":"2023-08-10T10:40:24.821563+0000","last_active":"2023-08-10T10:40:25.799486+0000","last_peered":"2023-08-10T10:40:25.799486+0000","last_clean":"2023-08-10T10:40:25.799486+0000","last_became_active":"2023-08-10T10:40:24.821153+0000","last_became_peered":"2023-08-10T10:40:24.821153+0000","last_unstale":"2023-08-10T10:40:25.799486+0000","last_undegraded":"2023-08-10T10:40:25.799486+0000","last_fullsized":"2023-08-10T10:40:25.799486+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:06:08.970227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793409+0000","last_change":"2023-08-10T10:40:23.784500+0000","last_active":"2023-08-10T10:40:25.793409+0000","last_peered":"2023-08-10T10:40:25.793409+0000","last_clean":"2023-08-10T10:40:25.793409+0000","last_became_active":"2023-08-10T10:40:23.784247+0000","last_became_peered":"2023-08-10T10:40:23.784247+0000","last_unstale":"2023-08-10T10:40:25.793409+0000","last_undegraded":"2023-08-10T10:40:25.793409+0000","last_fullsized":"2023-08-10T10:40:25.793409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927888+0000","last_change":"2023-08-10T10:40:24.826402+0000","last_active":"2023-08-10T10:40:26.927888+0000","last_peered":"2023-08-10T10:40:26.927888+0000","last_clean":"2023-08-10T10:40:26.927888+0000","last_became_active":"2023-08-10T10:40:24.826145+0000","last_became_peered":"2023-08-10T10:40:24.826145+0000","last_unstale":"2023-08-10T10:40:26.927888+0000","last_undegraded":"2023-08-10T10:40:26.927888+0000","last_fullsized":"2023-08-10T10:40:26.927888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:12:06.733699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793986+0000","last_change":"2023-08-10T10:40:23.775943+0000","last_active":"2023-08-10T10:40:25.793986+0000","last_peered":"2023-08-10T10:40:25.793986+0000","last_clean":"2023-08-10T10:40:25.793986+0000","last_became_active":"2023-08-10T10:40:23.775676+0000","last_became_peered":"2023-08-10T10:40:23.775676+0000","last_unstale":"2023-08-10T10:40:25.793986+0000","last_undegraded":"2023-08-10T10:40:25.793986+0000","last_fullsized":"2023-08-10T10:40:25.793986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926384+0000","last_change":"2023-08-10T10:40:24.800430+0000","last_active":"2023-08-10T10:40:26.926384+0000","last_peered":"2023-08-10T10:40:26.926384+0000","last_clean":"2023-08-10T10:40:26.926384+0000","last_became_active":"2023-08-10T10:40:24.800197+0000","last_became_peered":"2023-08-10T10:40:24.800197+0000","last_unstale":"2023-08-10T10:40:26.926384+0000","last_undegraded":"2023-08-10T10:40:26.926384+0000","last_fullsized":"2023-08-10T10:40:26.926384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:44.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800957+0000","last_change":"2023-08-10T10:40:23.767248+0000","last_active":"2023-08-10T10:40:25.800957+0000","last_peered":"2023-08-10T10:40:25.800957+0000","last_clean":"2023-08-10T10:40:25.800957+0000","last_became_active":"2023-08-10T10:40:23.766543+0000","last_became_peered":"2023-08-10T10:40:23.766543+0000","last_unstale":"2023-08-10T10:40:25.800957+0000","last_undegraded":"2023-08-10T10:40:25.800957+0000","last_fullsized":"2023-08-10T10:40:25.800957+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:19:36.638106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799121+0000","last_change":"2023-08-10T10:40:24.817065+0000","last_active":"2023-08-10T10:40:25.799121+0000","last_peered":"2023-08-10T10:40:25.799121+0000","last_clean":"2023-08-10T10:40:25.799121+0000","last_became_active":"2023-08-10T10:40:24.815962+0000","last_became_peered":"2023-08-10T10:40:24.815962+0000","last_unstale":"2023-08-10T10:40:25.799121+0000","last_undegraded":"2023-08-10T10:40:25.799121+0000","last_fullsized":"2023-08-10T10:40:25.799121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:02:31.936274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.951166+0000","last_change":"2023-08-10T10:40:23.778353+0000","last_active":"2023-08-10T10:40:26.951166+0000","last_peered":"2023-08-10T10:40:26.951166+0000","last_clean":"2023-08-10T10:40:26.951166+0000","last_became_active":"2023-08-10T10:40:23.778082+0000","last_became_peered":"2023-08-10T10:40:23.778082+0000","last_unstale":"2023-08-10T10:40:26.951166+0000","last_undegraded":"2023-08-10T10:40:26.951166+0000","last_fullsized":"2023-08-10T10:40:26.951166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:24.878645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928609+0000","last_change":"2023-08-10T10:40:24.818529+0000","last_active":"2023-08-10T10:40:26.928609+0000","last_peered":"2023-08-10T10:40:26.928609+0000","last_clean":"2023-08-10T10:40:26.928609+0000","last_became_active":"2023-08-10T10:40:24.816469+0000","last_became_peered":"2023-08-10T10:40:24.816469+0000","last_unstale":"2023-08-10T10:40:26.928609+0000","last_undegraded":"2023-08-10T10:40:26.928609+0000","last_fullsized":"2023-08-10T10:40:26.928609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:41:57.964501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799100+0000","last_change":"2023-08-10T10:40:23.773137+0000","last_active":"2023-08-10T10:40:25.799100+0000","last_peered":"2023-08-10T10:40:25.799100+0000","last_clean":"2023-08-10T10:40:25.799100+0000","last_became_active":"2023-08-10T10:40:23.772367+0000","last_became_peered":"2023-08-10T10:40:23.772367+0000","last_unstale":"2023-08-10T10:40:25.799100+0000","last_undegraded":"2023-08-10T10:40:25.799100+0000","last_fullsized":"2023-08-10T10:40:25.799100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:58.463276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926588+0000","last_change":"2023-08-10T10:40:24.800790+0000","last_active":"2023-08-10T10:40:26.926588+0000","last_peered":"2023-08-10T10:40:26.926588+0000","last_clean":"2023-08-10T10:40:26.926588+0000","last_became_active":"2023-08-10T10:40:24.800146+0000","last_became_peered":"2023-08-10T10:40:24.800146+0000","last_unstale":"2023-08-10T10:40:26.926588+0000","last_undegraded":"2023-08-10T10:40:26.926588+0000","last_fullsized":"2023-08-10T10:40:26.926588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:13.348931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927516+0000","last_change":"2023-08-10T10:40:23.781681+0000","last_active":"2023-08-10T10:40:26.927516+0000","last_peered":"2023-08-10T10:40:26.927516+0000","last_clean":"2023-08-10T10:40:26.927516+0000","last_became_active":"2023-08-10T10:40:23.781336+0000","last_became_peered":"2023-08-10T10:40:23.781336+0000","last_unstale":"2023-08-10T10:40:26.927516+0000","last_undegraded":"2023-08-10T10:40:26.927516+0000","last_fullsized":"2023-08-10T10:40:26.927516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:52.540797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929349+0000","last_change":"2023-08-10T10:40:24.828683+0000","last_active":"2023-08-10T10:40:26.929349+0000","last_peered":"2023-08-10T10:40:26.929349+0000","last_clean":"2023-08-10T10:40:26.929349+0000","last_became_active":"2023-08-10T10:40:24.828132+0000","last_became_peered":"2023-08-10T10:40:24.828132+0000","last_unstale":"2023-08-10T10:40:26.929349+0000","last_undegraded":"2023-08-10T10:40:26.929349+0000","last_fullsized":"2023-08-10T10:40:26.929349+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:29.280310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950400+0000","last_change":"2023-08-10T10:40:23.783973+0000","last_active":"2023-08-10T10:40:26.950400+0000","last_peered":"2023-08-10T10:40:26.950400+0000","last_clean":"2023-08-10T10:40:26.950400+0000","last_became_active":"2023-08-10T10:40:23.783129+0000","last_became_peered":"2023-08-10T10:40:23.783129+0000","last_unstale":"2023-08-10T10:40:26.950400+0000","last_undegraded":"2023-08-10T10:40:26.950400+0000","last_fullsized":"2023-08-10T10:40:26.950400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:01.222729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800860+0000","last_change":"2023-08-10T10:40:24.801603+0000","last_active":"2023-08-10T10:40:25.800860+0000","last_peered":"2023-08-10T10:40:25.800860+0000","last_clean":"2023-08-10T10:40:25.800860+0000","last_became_active":"2023-08-10T10:40:24.800967+0000","last_became_peered":"2023-08-10T10:40:24.800967+0000","last_unstale":"2023-08-10T10:40:25.800860+0000","last_undegraded":"2023-08-10T10:40:25.800860+0000","last_fullsized":"2023-08-10T10:40:25.800860+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929456+0000","last_change":"2023-08-10T10:40:23.781796+0000","last_active":"2023-08-10T10:40:26.929456+0000","last_peered":"2023-08-10T10:40:26.929456+0000","last_clean":"2023-08-10T10:40:26.929456+0000","last_became_active":"2023-08-10T10:40:23.779727+0000","last_became_peered":"2023-08-10T10:40:23.779727+0000","last_unstale":"2023-08-10T10:40:26.929456+0000","last_undegraded":"2023-08-10T10:40:26.929456+0000","last_fullsized":"2023-08-10T10:40:26.929456+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:47.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.798767+0000","last_change":"2023-08-10T10:40:24.820149+0000","last_active":"2023-08-10T10:40:25.798767+0000","last_peered":"2023-08-10T10:40:25.798767+0000","last_clean":"2023-08-10T10:40:25.798767+0000","last_became_active":"2023-08-10T10:40:24.818757+0000","last_became_peered":"2023-08-10T10:40:24.818757+0000","last_unstale":"2023-08-10T10:40:25.798767+0000","last_undegraded":"2023-08-10T10:40:25.798767+0000","last_fullsized":"2023-08-10T10:40:25.798767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:21.608151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800191+0000","last_change":"2023-08-10T10:40:23.778598+0000","last_active":"2023-08-10T10:40:25.800191+0000","last_peered":"2023-08-10T10:40:25.800191+0000","last_clean":"2023-08-10T10:40:25.800191+0000","last_became_active":"2023-08-10T10:40:23.778175+0000","last_became_peered":"2023-08-10T10:40:23.778175+0000","last_unstale":"2023-08-10T10:40:25.800191+0000","last_undegraded":"2023-08-10T10:40:25.800191+0000","last_fullsized":"2023-08-10T10:40:25.800191+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:14.305480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950387+0000","last_change":"2023-08-10T10:40:24.826194+0000","last_active":"2023-08-10T10:40:26.950387+0000","last_peered":"2023-08-10T10:40:26.950387+0000","last_clean":"2023-08-10T10:40:26.950387+0000","last_became_active":"2023-08-10T10:40:24.822969+0000","last_became_peered":"2023-08-10T10:40:24.822969+0000","last_unstale":"2023-08-10T10:40:26.950387+0000","last_undegraded":"2023-08-10T10:40:26.950387+0000","last_fullsized":"2023-08-10T10:40:26.950387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:23.163693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.929247+0000","last_change":"2023-08-10T10:40:23.782294+0000","last_active":"2023-08-10T10:40:26.929247+0000","last_peered":"2023-08-10T10:40:26.929247+0000","last_clean":"2023-08-10T10:40:26.929247+0000","last_became_active":"2023-08-10T10:40:23.778805+0000","last_became_peered":"2023-08-10T10:40:23.778805+0000","last_unstale":"2023-08-10T10:40:26.929247+0000","last_undegraded":"2023-08-10T10:40:26.929247+0000","last_fullsized":"2023-08-10T10:40:26.929247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:06:58.831750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799655+0000","last_change":"2023-08-10T10:40:24.801153+0000","last_active":"2023-08-10T10:40:25.799655+0000","last_peered":"2023-08-10T10:40:25.799655+0000","last_clean":"2023-08-10T10:40:25.799655+0000","last_became_active":"2023-08-10T10:40:24.800508+0000","last_became_peered":"2023-08-10T10:40:24.800508+0000","last_unstale":"2023-08-10T10:40:25.799655+0000","last_undegraded":"2023-08-10T10:40:25.799655+0000","last_fullsized":"2023-08-10T10:40:25.799655+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926772+0000","last_change":"2023-08-10T10:40:23.783755+0000","last_active":"2023-08-10T10:40:26.926772+0000","last_peered":"2023-08-10T10:40:26.926772+0000","last_clean":"2023-08-10T10:40:26.926772+0000","last_became_active":"2023-08-10T10:40:23.782575+0000","last_became_peered":"2023-08-10T10:40:23.782575+0000","last_unstale":"2023-08-10T10:40:26.926772+0000","last_undegraded":"2023-08-10T10:40:26.926772+0000","last_fullsized":"2023-08-10T10:40:26.926772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:55:37.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800419+0000","last_change":"2023-08-10T10:40:24.828401+0000","last_active":"2023-08-10T10:40:25.800419+0000","last_peered":"2023-08-10T10:40:25.800419+0000","last_clean":"2023-08-10T10:40:25.800419+0000","last_became_active":"2023-08-10T10:40:24.827989+0000","last_became_peered":"2023-08-10T10:40:24.827989+0000","last_unstale":"2023-08-10T10:40:25.800419+0000","last_undegraded":"2023-08-10T10:40:25.800419+0000","last_fullsized":"2023-08-10T10:40:25.800419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:15.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950495+0000","last_change":"2023-08-10T10:40:23.783373+0000","last_active":"2023-08-10T10:40:26.950495+0000","last_peered":"2023-08-10T10:40:26.950495+0000","last_clean":"2023-08-10T10:40:26.950495+0000","last_became_active":"2023-08-10T10:40:23.782348+0000","last_became_peered":"2023-08-10T10:40:23.782348+0000","last_unstale":"2023-08-10T10:40:26.950495+0000","last_undegraded":"2023-08-10T10:40:26.950495+0000","last_fullsized":"2023-08-10T10:40:26.950495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:48:05.690784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950321+0000","last_change":"2023-08-10T10:40:24.811792+0000","last_active":"2023-08-10T10:40:26.950321+0000","last_peered":"2023-08-10T10:40:26.950321+0000","last_clean":"2023-08-10T10:40:26.950321+0000","last_became_active":"2023-08-10T10:40:24.811530+0000","last_became_peered":"2023-08-10T10:40:24.811530+0000","last_unstale":"2023-08-10T10:40:26.950321+0000","last_undegraded":"2023-08-10T10:40:26.950321+0000","last_fullsized":"2023-08-10T10:40:26.950321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:33:15.607685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928142+0000","last_change":"2023-08-10T10:40:23.781482+0000","last_active":"2023-08-10T10:40:26.928142+0000","last_peered":"2023-08-10T10:40:26.928142+0000","last_clean":"2023-08-10T10:40:26.928142+0000","last_became_active":"2023-08-10T10:40:23.779712+0000","last_became_peered":"2023-08-10T10:40:23.779712+0000","last_unstale":"2023-08-10T10:40:26.928142+0000","last_undegraded":"2023-08-10T10:40:26.928142+0000","last_fullsized":"2023-08-10T10:40:26.928142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:47.310601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926168+0000","last_change":"2023-08-10T10:40:24.823798+0000","last_active":"2023-08-10T10:40:26.926168+0000","last_peered":"2023-08-10T10:40:26.926168+0000","last_clean":"2023-08-10T10:40:26.926168+0000","last_became_active":"2023-08-10T10:40:24.823248+0000","last_became_peered":"2023-08-10T10:40:24.823248+0000","last_unstale":"2023-08-10T10:40:26.926168+0000","last_undegraded":"2023-08-10T10:40:26.926168+0000","last_fullsized":"2023-08-10T10:40:26.926168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:56.130973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927945+0000","last_change":"2023-08-10T10:40:23.780297+0000","last_active":"2023-08-10T10:40:26.927945+0000","last_peered":"2023-08-10T10:40:26.927945+0000","last_clean":"2023-08-10T10:40:26.927945+0000","last_became_active":"2023-08-10T10:40:23.779830+0000","last_became_peered":"2023-08-10T10:40:23.779830+0000","last_unstale":"2023-08-10T10:40:26.927945+0000","last_undegraded":"2023-08-10T10:40:26.927945+0000","last_fullsized":"2023-08-10T10:40:26.927945+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:36.541780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950238+0000","last_change":"2023-08-10T10:40:24.814662+0000","last_active":"2023-08-10T10:40:26.950238+0000","last_peered":"2023-08-10T10:40:26.950238+0000","last_clean":"2023-08-10T10:40:26.950238+0000","last_became_active":"2023-08-10T10:40:24.814402+0000","last_became_peered":"2023-08-10T10:40:24.814402+0000","last_unstale":"2023-08-10T10:40:26.950238+0000","last_undegraded":"2023-08-10T10:40:26.950238+0000","last_fullsized":"2023-08-10T10:40:26.950238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:50:56.111731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926176+0000","last_change":"2023-08-10T10:40:23.781989+0000","last_active":"2023-08-10T10:40:26.926176+0000","last_peered":"2023-08-10T10:40:26.926176+0000","last_clean":"2023-08-10T10:40:26.926176+0000","last_became_active":"2023-08-10T10:40:23.781505+0000","last_became_peered":"2023-08-10T10:40:23.781505+0000","last_unstale":"2023-08-10T10:40:26.926176+0000","last_undegraded":"2023-08-10T10:40:26.926176+0000","last_fullsized":"2023-08-10T10:40:26.926176+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:04.870677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926663+0000","last_change":"2023-08-10T10:40:24.811687+0000","last_active":"2023-08-10T10:40:26.926663+0000","last_peered":"2023-08-10T10:40:26.926663+0000","last_clean":"2023-08-10T10:40:26.926663+0000","last_became_active":"2023-08-10T10:40:24.811405+0000","last_became_peered":"2023-08-10T10:40:24.811405+0000","last_unstale":"2023-08-10T10:40:26.926663+0000","last_undegraded":"2023-08-10T10:40:26.926663+0000","last_fullsized":"2023-08-10T10:40:26.926663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:20:11.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950993+0000","last_change":"2023-08-10T10:40:23.784794+0000","last_active":"2023-08-10T10:40:26.950993+0000","last_peered":"2023-08-10T10:40:26.950993+0000","last_clean":"2023-08-10T10:40:26.950993+0000","last_became_active":"2023-08-10T10:40:23.784256+0000","last_became_peered":"2023-08-10T10:40:23.784256+0000","last_unstale":"2023-08-10T10:40:26.950993+0000","last_undegraded":"2023-08-10T10:40:26.950993+0000","last_fullsized":"2023-08-10T10:40:26.950993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:59.219277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793945+0000","last_change":"2023-08-10T10:40:24.814150+0000","last_active":"2023-08-10T10:40:25.793945+0000","last_peered":"2023-08-10T10:40:25.793945+0000","last_clean":"2023-08-10T10:40:25.793945+0000","last_became_active":"2023-08-10T10:40:24.813918+0000","last_became_peered":"2023-08-10T10:40:24.813918+0000","last_unstale":"2023-08-10T10:40:25.793945+0000","last_undegraded":"2023-08-10T10:40:25.793945+0000","last_fullsized":"2023-08-10T10:40:25.793945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:34.902908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029984+0000","last_change":"2023-08-10T10:40:23.780905+0000","last_active":"2023-08-10T10:40:27.029984+0000","last_peered":"2023-08-10T10:40:27.029984+0000","last_clean":"2023-08-10T10:40:27.029984+0000","last_became_active":"2023-08-10T10:40:23.780610+0000","last_became_peered":"2023-08-10T10:40:23.780610+0000","last_unstale":"2023-08-10T10:40:27.029984+0000","last_undegraded":"2023-08-10T10:40:27.029984+0000","last_fullsized":"2023-08-10T10:40:27.029984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:17.908346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799985+0000","last_change":"2023-08-10T10:40:24.814932+0000","last_active":"2023-08-10T10:40:25.799985+0000","last_peered":"2023-08-10T10:40:25.799985+0000","last_clean":"2023-08-10T10:40:25.799985+0000","last_became_active":"2023-08-10T10:40:24.814425+0000","last_became_peered":"2023-08-10T10:40:24.814425+0000","last_unstale":"2023-08-10T10:40:25.799985+0000","last_undegraded":"2023-08-10T10:40:25.799985+0000","last_fullsized":"2023-08-10T10:40:25.799985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:17.640855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928460+0000","last_change":"2023-08-10T10:40:23.777530+0000","last_active":"2023-08-10T10:40:26.928460+0000","last_peered":"2023-08-10T10:40:26.928460+0000","last_clean":"2023-08-10T10:40:26.928460+0000","last_became_active":"2023-08-10T10:40:23.777083+0000","last_became_peered":"2023-08-10T10:40:23.777083+0000","last_unstale":"2023-08-10T10:40:26.928460+0000","last_undegraded":"2023-08-10T10:40:26.928460+0000","last_fullsized":"2023-08-10T10:40:26.928460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:17.301863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794197+0000","last_change":"2023-08-10T10:40:24.819437+0000","last_active":"2023-08-10T10:40:25.794197+0000","last_peered":"2023-08-10T10:40:25.794197+0000","last_clean":"2023-08-10T10:40:25.794197+0000","last_became_active":"2023-08-10T10:40:24.819044+0000","last_became_peered":"2023-08-10T10:40:24.819044+0000","last_unstale":"2023-08-10T10:40:25.794197+0000","last_undegraded":"2023-08-10T10:40:25.794197+0000","last_fullsized":"2023-08-10T10:40:25.794197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:47.685009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927387+0000","last_change":"2023-08-10T10:40:23.775506+0000","last_active":"2023-08-10T10:40:26.927387+0000","last_peered":"2023-08-10T10:40:26.927387+0000","last_clean":"2023-08-10T10:40:26.927387+0000","last_became_active":"2023-08-10T10:40:23.774895+0000","last_became_peered":"2023-08-10T10:40:23.774895+0000","last_unstale":"2023-08-10T10:40:26.927387+0000","last_undegraded":"2023-08-10T10:40:26.927387+0000","last_fullsized":"2023-08-10T10:40:26.927387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:31.676819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799877+0000","last_change":"2023-08-10T10:40:24.822943+0000","last_active":"2023-08-10T10:40:25.799877+0000","last_peered":"2023-08-10T10:40:25.799877+0000","last_clean":"2023-08-10T10:40:25.799877+0000","last_became_active":"2023-08-10T10:40:24.822668+0000","last_became_peered":"2023-08-10T10:40:24.822668+0000","last_unstale":"2023-08-10T10:40:25.799877+0000","last_undegraded":"2023-08-10T10:40:25.799877+0000","last_fullsized":"2023-08-10T10:40:25.799877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:47.706213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794071+0000","last_change":"2023-08-10T10:40:23.779688+0000","last_active":"2023-08-10T10:40:25.794071+0000","last_peered":"2023-08-10T10:40:25.794071+0000","last_clean":"2023-08-10T10:40:25.794071+0000","last_became_active":"2023-08-10T10:40:23.779280+0000","last_became_peered":"2023-08-10T10:40:23.779280+0000","last_unstale":"2023-08-10T10:40:25.794071+0000","last_undegraded":"2023-08-10T10:40:25.794071+0000","last_fullsized":"2023-08-10T10:40:25.794071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:56.873303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927073+0000","last_change":"2023-08-10T10:40:24.820029+0000","last_active":"2023-08-10T10:40:26.927073+0000","last_peered":"2023-08-10T10:40:26.927073+0000","last_clean":"2023-08-10T10:40:26.927073+0000","last_became_active":"2023-08-10T10:40:24.819120+0000","last_became_peered":"2023-08-10T10:40:24.819120+0000","last_unstale":"2023-08-10T10:40:26.927073+0000","last_undegraded":"2023-08-10T10:40:26.927073+0000","last_fullsized":"2023-08-10T10:40:26.927073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:09.748763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926986+0000","last_change":"2023-08-10T10:40:23.783433+0000","last_active":"2023-08-10T10:40:26.926986+0000","last_peered":"2023-08-10T10:40:26.926986+0000","last_clean":"2023-08-10T10:40:26.926986+0000","last_became_active":"2023-08-10T10:40:23.782240+0000","last_became_peered":"2023-08-10T10:40:23.782240+0000","last_unstale":"2023-08-10T10:40:26.926986+0000","last_undegraded":"2023-08-10T10:40:26.926986+0000","last_fullsized":"2023-08-10T10:40:26.926986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:29.656096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950637+0000","last_change":"2023-08-10T10:40:24.823492+0000","last_active":"2023-08-10T10:40:26.950637+0000","last_peered":"2023-08-10T10:40:26.950637+0000","last_clean":"2023-08-10T10:40:26.950637+0000","last_became_active":"2023-08-10T10:40:24.822087+0000","last_became_peered":"2023-08-10T10:40:24.822087+0000","last_unstale":"2023-08-10T10:40:26.950637+0000","last_undegraded":"2023-08-10T10:40:26.950637+0000","last_fullsized":"2023-08-10T10:40:26.950637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:34:34.038306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950615+0000","last_change":"2023-08-10T10:40:23.780308+0000","last_active":"2023-08-10T10:40:26.950615+0000","last_peered":"2023-08-10T10:40:26.950615+0000","last_clean":"2023-08-10T10:40:26.950615+0000","last_became_active":"2023-08-10T10:40:23.779723+0000","last_became_peered":"2023-08-10T10:40:23.779723+0000","last_unstale":"2023-08-10T10:40:26.950615+0000","last_undegraded":"2023-08-10T10:40:26.950615+0000","last_fullsized":"2023-08-10T10:40:26.950615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:00.077955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793716+0000","last_change":"2023-08-10T10:40:24.812696+0000","last_active":"2023-08-10T10:40:25.793716+0000","last_peered":"2023-08-10T10:40:25.793716+0000","last_clean":"2023-08-10T10:40:25.793716+0000","last_became_active":"2023-08-10T10:40:24.812441+0000","last_became_peered":"2023-08-10T10:40:24.812441+0000","last_unstale":"2023-08-10T10:40:25.793716+0000","last_undegraded":"2023-08-10T10:40:25.793716+0000","last_fullsized":"2023-08-10T10:40:25.793716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:07.596425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029662+0000","last_change":"2023-08-10T10:40:23.778707+0000","last_active":"2023-08-10T10:40:27.029662+0000","last_peered":"2023-08-10T10:40:27.029662+0000","last_clean":"2023-08-10T10:40:27.029662+0000","last_became_active":"2023-08-10T10:40:23.778449+0000","last_became_peered":"2023-08-10T10:40:23.778449+0000","last_unstale":"2023-08-10T10:40:27.029662+0000","last_undegraded":"2023-08-10T10:40:27.029662+0000","last_fullsized":"2023-08-10T10:40:27.029662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:28.984610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928973+0000","last_change":"2023-08-10T10:40:24.814930+0000","last_active":"2023-08-10T10:40:26.928973+0000","last_peered":"2023-08-10T10:40:26.928973+0000","last_clean":"2023-08-10T10:40:26.928973+0000","last_became_active":"2023-08-10T10:40:24.814400+0000","last_became_peered":"2023-08-10T10:40:24.814400+0000","last_unstale":"2023-08-10T10:40:26.928973+0000","last_undegraded":"2023-08-10T10:40:26.928973+0000","last_fullsized":"2023-08-10T10:40:26.928973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:29.998594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950769+0000","last_change":"2023-08-10T10:40:23.777097+0000","last_active":"2023-08-10T10:40:26.950769+0000","last_peered":"2023-08-10T10:40:26.950769+0000","last_clean":"2023-08-10T10:40:26.950769+0000","last_became_active":"2023-08-10T10:40:23.776782+0000","last_became_peered":"2023-08-10T10:40:23.776782+0000","last_unstale":"2023-08-10T10:40:26.950769+0000","last_undegraded":"2023-08-10T10:40:26.950769+0000","last_fullsized":"2023-08-10T10:40:26.950769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:57.254611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928783+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:40:26.928783+0000","last_peered":"2023-08-10T10:40:26.928783+0000","last_clean":"2023-08-10T10:40:26.928783+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:40:26.928783+0000","last_undegraded":"2023-08-10T10:40:26.928783+0000","last_fullsized":"2023-08-10T10:40:26.928783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:53.614758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.801106+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:40:25.801106+0000","last_peered":"2023-08-10T10:40:25.801106+0000","last_clean":"2023-08-10T10:40:25.801106+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:40:25.801106+0000","last_undegraded":"2023-08-10T10:40:25.801106+0000","last_fullsized":"2023-08-10T10:40:25.801106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:46.238601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.793626+0000","last_change":"2023-08-10T10:40:24.808340+0000","last_active":"2023-08-10T10:40:25.793626+0000","last_peered":"2023-08-10T10:40:25.793626+0000","last_clean":"2023-08-10T10:40:25.793626+0000","last_became_active":"2023-08-10T10:40:24.807791+0000","last_became_peered":"2023-08-10T10:40:24.807791+0000","last_unstale":"2023-08-10T10:40:25.793626+0000","last_undegraded":"2023-08-10T10:40:25.793626+0000","last_fullsized":"2023-08-10T10:40:25.793626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:31.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928023+0000","last_change":"2023-08-10T10:40:23.778912+0000","last_active":"2023-08-10T10:40:26.928023+0000","last_peered":"2023-08-10T10:40:26.928023+0000","last_clean":"2023-08-10T10:40:26.928023+0000","last_became_active":"2023-08-10T10:40:23.778573+0000","last_became_peered":"2023-08-10T10:40:23.778573+0000","last_unstale":"2023-08-10T10:40:26.928023+0000","last_undegraded":"2023-08-10T10:40:26.928023+0000","last_fullsized":"2023-08-10T10:40:26.928023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:54.113644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928390+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:40:26.928390+0000","last_peered":"2023-08-10T10:40:26.928390+0000","last_clean":"2023-08-10T10:40:26.928390+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:40:26.928390+0000","last_undegraded":"2023-08-10T10:40:26.928390+0000","last_fullsized":"2023-08-10T10:40:26.928390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:01.408663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926387+0000","last_change":"2023-08-10T10:40:24.798884+0000","last_active":"2023-08-10T10:40:26.926387+0000","last_peered":"2023-08-10T10:40:26.926387+0000","last_clean":"2023-08-10T10:40:26.926387+0000","last_became_active":"2023-08-10T10:40:24.798630+0000","last_became_peered":"2023-08-10T10:40:24.798630+0000","last_unstale":"2023-08-10T10:40:26.926387+0000","last_undegraded":"2023-08-10T10:40:26.926387+0000","last_fullsized":"2023-08-10T10:40:26.926387+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:30.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950732+0000","last_change":"2023-08-10T10:40:23.780167+0000","last_active":"2023-08-10T10:40:26.950732+0000","last_peered":"2023-08-10T10:40:26.950732+0000","last_clean":"2023-08-10T10:40:26.950732+0000","last_became_active":"2023-08-10T10:40:23.779006+0000","last_became_peered":"2023-08-10T10:40:23.779006+0000","last_unstale":"2023-08-10T10:40:26.950732+0000","last_undegraded":"2023-08-10T10:40:26.950732+0000","last_fullsized":"2023-08-10T10:40:26.950732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:42.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:27.029590+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:40:27.029590+0000","last_peered":"2023-08-10T10:40:27.029590+0000","last_clean":"2023-08-10T10:40:27.029590+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:40:27.029590+0000","last_undegraded":"2023-08-10T10:40:27.029590+0000","last_fullsized":"2023-08-10T10:40:27.029590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:16.949185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800837+0000","last_change":"2023-08-10T10:40:24.816266+0000","last_active":"2023-08-10T10:40:25.800837+0000","last_peered":"2023-08-10T10:40:25.800837+0000","last_clean":"2023-08-10T10:40:25.800837+0000","last_became_active":"2023-08-10T10:40:24.815712+0000","last_became_peered":"2023-08-10T10:40:24.815712+0000","last_unstale":"2023-08-10T10:40:25.800837+0000","last_undegraded":"2023-08-10T10:40:25.800837+0000","last_fullsized":"2023-08-10T10:40:25.800837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:58.265168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927731+0000","last_change":"2023-08-10T10:40:23.781544+0000","last_active":"2023-08-10T10:40:26.927731+0000","last_peered":"2023-08-10T10:40:26.927731+0000","last_clean":"2023-08-10T10:40:26.927731+0000","last_became_active":"2023-08-10T10:40:23.780994+0000","last_became_peered":"2023-08-10T10:40:23.780994+0000","last_unstale":"2023-08-10T10:40:26.927731+0000","last_undegraded":"2023-08-10T10:40:26.927731+0000","last_fullsized":"2023-08-10T10:40:26.927731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:10:00.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799867+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:40:25.799867+0000","last_peered":"2023-08-10T10:40:25.799867+0000","last_clean":"2023-08-10T10:40:25.799867+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:40:25.799867+0000","last_undegraded":"2023-08-10T10:40:25.799867+0000","last_fullsized":"2023-08-10T10:40:25.799867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:34:13.190807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950839+0000","last_change":"2023-08-10T10:40:24.809284+0000","last_active":"2023-08-10T10:40:26.950839+0000","last_peered":"2023-08-10T10:40:26.950839+0000","last_clean":"2023-08-10T10:40:26.950839+0000","last_became_active":"2023-08-10T10:40:24.809045+0000","last_became_peered":"2023-08-10T10:40:24.809045+0000","last_unstale":"2023-08-10T10:40:26.950839+0000","last_undegraded":"2023-08-10T10:40:26.950839+0000","last_fullsized":"2023-08-10T10:40:26.950839+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:38.580281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799440+0000","last_change":"2023-08-10T10:40:23.763017+0000","last_active":"2023-08-10T10:40:25.799440+0000","last_peered":"2023-08-10T10:40:25.799440+0000","last_clean":"2023-08-10T10:40:25.799440+0000","last_became_active":"2023-08-10T10:40:23.762280+0000","last_became_peered":"2023-08-10T10:40:23.762280+0000","last_unstale":"2023-08-10T10:40:25.799440+0000","last_undegraded":"2023-08-10T10:40:25.799440+0000","last_fullsized":"2023-08-10T10:40:25.799440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:35:42.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794122+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:40:25.794122+0000","last_peered":"2023-08-10T10:40:25.794122+0000","last_clean":"2023-08-10T10:40:25.794122+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:40:25.794122+0000","last_undegraded":"2023-08-10T10:40:25.794122+0000","last_fullsized":"2023-08-10T10:40:25.794122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:46.486996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926361+0000","last_change":"2023-08-10T10:40:24.800161+0000","last_active":"2023-08-10T10:40:26.926361+0000","last_peered":"2023-08-10T10:40:26.926361+0000","last_clean":"2023-08-10T10:40:26.926361+0000","last_became_active":"2023-08-10T10:40:24.799202+0000","last_became_peered":"2023-08-10T10:40:24.799202+0000","last_unstale":"2023-08-10T10:40:26.926361+0000","last_undegraded":"2023-08-10T10:40:26.926361+0000","last_fullsized":"2023-08-10T10:40:26.926361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:47.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.799019+0000","last_change":"2023-08-10T10:40:23.774983+0000","last_active":"2023-08-10T10:40:25.799019+0000","last_peered":"2023-08-10T10:40:25.799019+0000","last_clean":"2023-08-10T10:40:25.799019+0000","last_became_active":"2023-08-10T10:40:23.774282+0000","last_became_peered":"2023-08-10T10:40:23.774282+0000","last_unstale":"2023-08-10T10:40:25.799019+0000","last_undegraded":"2023-08-10T10:40:25.799019+0000","last_fullsized":"2023-08-10T10:40:25.799019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:27:48.841515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.927710+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:40:26.927710+0000","last_peered":"2023-08-10T10:40:26.927710+0000","last_clean":"2023-08-10T10:40:26.927710+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:40:26.927710+0000","last_undegraded":"2023-08-10T10:40:26.927710+0000","last_fullsized":"2023-08-10T10:40:26.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:46.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.950994+0000","last_change":"2023-08-10T10:40:24.813983+0000","last_active":"2023-08-10T10:40:26.950994+0000","last_peered":"2023-08-10T10:40:26.950994+0000","last_clean":"2023-08-10T10:40:26.950994+0000","last_became_active":"2023-08-10T10:40:24.813752+0000","last_became_peered":"2023-08-10T10:40:24.813752+0000","last_unstale":"2023-08-10T10:40:26.950994+0000","last_undegraded":"2023-08-10T10:40:26.950994+0000","last_fullsized":"2023-08-10T10:40:26.950994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:57:49.594396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926425+0000","last_change":"2023-08-10T10:40:23.781205+0000","last_active":"2023-08-10T10:40:26.926425+0000","last_peered":"2023-08-10T10:40:26.926425+0000","last_clean":"2023-08-10T10:40:26.926425+0000","last_became_active":"2023-08-10T10:40:23.780651+0000","last_became_peered":"2023-08-10T10:40:23.780651+0000","last_unstale":"2023-08-10T10:40:26.926425+0000","last_undegraded":"2023-08-10T10:40:26.926425+0000","last_fullsized":"2023-08-10T10:40:26.926425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:43.237165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.794275+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:40:25.794275+0000","last_peered":"2023-08-10T10:40:25.794275+0000","last_clean":"2023-08-10T10:40:25.794275+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:40:25.794275+0000","last_undegraded":"2023-08-10T10:40:25.794275+0000","last_fullsized":"2023-08-10T10:40:25.794275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:56.240684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:25.800661+0000","last_change":"2023-08-10T10:40:24.828245+0000","last_active":"2023-08-10T10:40:25.800661+0000","last_peered":"2023-08-10T10:40:25.800661+0000","last_clean":"2023-08-10T10:40:25.800661+0000","last_became_active":"2023-08-10T10:40:24.825941+0000","last_became_peered":"2023-08-10T10:40:24.825941+0000","last_unstale":"2023-08-10T10:40:25.800661+0000","last_undegraded":"2023-08-10T10:40:25.800661+0000","last_fullsized":"2023-08-10T10:40:25.800661+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:23.746186+0000","last_clean_scrub_stamp":"2023-08-10T10:40:23.746186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:20.079337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.926695+0000","last_change":"2023-08-10T10:40:23.783410+0000","last_active":"2023-08-10T10:40:26.926695+0000","last_peered":"2023-08-10T10:40:26.926695+0000","last_clean":"2023-08-10T10:40:26.926695+0000","last_became_active":"2023-08-10T10:40:23.780450+0000","last_became_peered":"2023-08-10T10:40:23.780450+0000","last_unstale":"2023-08-10T10:40:26.926695+0000","last_undegraded":"2023-08-10T10:40:26.926695+0000","last_fullsized":"2023-08-10T10:40:26.926695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:40:22.732202+0000","last_clean_scrub_stamp":"2023-08-10T10:40:22.732202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:20.582917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-08-10T10:40:26.928130+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:40:26.928130+0000","last_peered":"2023-08-10T10:40:26.928130+0000","last_clean":"2023-08-10T10:40:26.928130+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:40:26.928130+0000","last_undegraded":"2023-08-10T10:40:26.928130+0000","last_fullsized":"2023-08-10T10:40:26.928130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:31.999688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":837,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5629999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.486,"5min":1.613,"15min":1.613},"last":1.278}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.427,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.133,"15min":1.1259999999999999},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.2030000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4370000000000001,"5min":2.742,"15min":2.742},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.71299999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4570000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.206,"15min":1.216},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.548,"5min":1.704,"15min":1.704},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.371,"15min":1.395},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.593,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.097}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6180000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.333},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.244,"15min":1.258},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.611,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.431}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.409,"15min":1.4339999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.671,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.26},{"interface":"front","average":{"1min":1.359,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8240000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.53}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.5700000000000001,"15min":1.601},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.78,"5min":2.25,"15min":2.25},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.484,"15min":1.51},"min":{"1min":0.84299999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.865,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.3919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6200000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.554},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.486,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.141,"15min":1.149},"min":{"1min":0.79700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6739999999999999,"5min":1.96,"15min":1.96},"last":1.367}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.119,"15min":1.107},"min":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.341},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.206,"15min":1.202},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5589999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.385}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.173,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6100000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2370000000000001,"15min":1.232},"min":{"1min":0.90900000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.732,"15min":1.732},"last":1.444}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1919999999999999,"15min":1.1739999999999999},"min":{"1min":0.755,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8420000000000001,"5min":2.04,"15min":2.04},"last":1.232},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.385,"15min":1.381},"min":{"1min":0.88800000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.79,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.284}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.383,"15min":1.367},"min":{"1min":0.97199999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.8340000000000001,"5min":2.028,"15min":2.028},"last":1.488},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.94999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9790000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.345,"15min":1.341},"min":{"1min":0.81399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.2690000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.165},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.462,"15min":1.448},"min":{"1min":0.93300000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0259999999999998,"5min":2.698,"15min":2.698},"last":1.605}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195052,"statfs":{"total":200000000,"available":199733403,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.093,"15min":1.0640000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.833,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.484,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.2170000000000001,"15min":1.232},"min":{"1min":0.81999999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5589999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2130000000000001,"15min":1.2350000000000001},"min":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6379999999999999,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.1659999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3460000000000001,"15min":1.3700000000000001},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.27,"5min":1.155,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.5780000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.246,"15min":1.25},"min":{"1min":0.91100000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.3899999999999999,"15min":1.391},"min":{"1min":0.96199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7989999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.538}]},{"osd":4,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.875,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9039999999999999,"5min":2.399,"15min":2.399},"last":1.284},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.617,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.6519999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.88600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.341},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.399,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.6890000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.49,"15min":1.49},"min":{"1min":1.165,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6990000000000001,"5min":1.885,"15min":1.885},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.484},"min":{"1min":1.161,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.603}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195050,"statfs":{"total":200000000,"available":199731802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4650000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.181,"15min":1.1930000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.637,"5min":1.667,"15min":1.667},"last":1.1739999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7110000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.425},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.119,"15min":1.137},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.365,"5min":1.677,"15min":1.677},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1220000000000001,"15min":1.1299999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.758,"5min":2.004,"15min":2.004},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.272,"15min":1.286},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5409999999999999,"5min":1.893,"15min":1.893},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.222,"15min":1.234},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5469999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2450000000000001,"15min":1.2549999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6000000000000001,"5min":1.863,"15min":1.863},"last":1.218}]},{"osd":5,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.343,"15min":1.3540000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8049999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.272},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2749999999999999,"15min":1.2809999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3109999999999999,"15min":1.3160000000000001},"min":{"1min":0.92900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2,"5min":2,"15min":2},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.393,"5min":1.4410000000000001,"15min":1.4490000000000001},"min":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7210000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4870000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:40:17 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3939999999999999,"15min":1.401},"min":{"1min":0.68999999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7989999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.351},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4750000000000001,"15min":1.4870000000000001},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.464}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730798,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.93500000000000005,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.81100000000000005,"15min":0.78300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.377},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.96199999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.93300000000000005,"15min":0.88900000000000001},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.268,"5min":1.042,"15min":1.004},"min":{"1min":0.58299999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.5469999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.84799999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.472},{"interface":"front","average":{"1min":1.298,"5min":1.1839999999999999,"15min":1.165},"min":{"1min":0.92700000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.506}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.2989999999999999,"15min":1.2809999999999999},"min":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0059999999999998,"5min":2.125,"15min":2.125},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.3580000000000001,"15min":1.331},"min":{"1min":0.84499999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.6060000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.248,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.679},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.3899999999999999,"15min":1.3640000000000001},"min":{"1min":1.002,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.651}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.427,"15min":1.403},"min":{"1min":0.94899999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.726},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.325,"15min":1.2949999999999999},"min":{"1min":0.96899999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":1.772}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195049,"statfs":{"total":200000000,"available":199730820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.873},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4359999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.304},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.073,"15min":1.0740000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.502,"5min":1.667,"15min":1.667},"last":1.137}]},{"osd":3,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4199999999999999,"5min":1.639,"15min":1.639},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2370000000000001,"15min":1.2629999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6259999999999999,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.8069999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.48},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.276,"15min":1.282},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6759999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.395}]},{"osd":5,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2490000000000001,"15min":1.254},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.696,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.415},{"interface":"front","average":{"1min":1.391,"5min":1.4630000000000001,"15min":1.4750000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8500000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.3759999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.363,"15min":1.351},"min":{"1min":0.88600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.339},{"interface":"front","average":{"1min":1.298,"5min":1.325,"15min":1.329},"min":{"1min":0.85499999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.766,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.6539999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.371,"15min":1.361},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.258},{"interface":"front","average":{"1min":1.417,"5min":1.405,"15min":1.403},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.5549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195051,"statfs":{"total":200000000,"available":199732224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.441,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.296,"5min":1.548,"15min":1.548},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6339999999999999,"5min":2.246,"15min":2.246},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.742,"5min":1.913,"15min":1.913},"last":1.339}]},{"osd":3,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0049999999999999,"15min":0.997},"min":{"1min":0.51100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.224},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.01},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1399999999999999,"15min":1.119},"min":{"1min":0.86299999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":0.94099999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.5469999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3400000000000001,"15min":1.3340000000000001},"min":{"1min":1.0580000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.452},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.752,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.87,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.204,"15min":1.196},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.377}]},{"osd":7,"last update":"Thu Aug 10 10:40:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.403,"15min":1.411},"min":{"1min":0.81299999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.609},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.351,"15min":1.343},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.5669999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":836,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194475,"statfs":{"total":200000000,"available":199142979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97399999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.442},"max":{"1min":1.387,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0209999999999999,"15min":1.0149999999999999},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4630000000000001,"5min":1.853,"15min":1.853},"last":1.091}]},{"osd":2,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.161},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.028,"15min":1.018},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.516,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.62,"5min":0.496,"15min":0.496},"max":{"1min":1.393,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.24},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0660000000000001,"15min":1.0820000000000001},"min":{"1min":0.57999999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.536,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.28}]},{"osd":4,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.98599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.623,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.377,"15min":1.3740000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.0069999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7090000000000001,"5min":1.986,"15min":1.986},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.258},"min":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4350000000000001,"15min":1.4450000000000001},"min":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.0129999999999999,"5min":2.04,"15min":2.04},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.4299999999999999},"min":{"1min":0.95699999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.7869999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.224}]},{"osd":7,"last update":"Thu Aug 10 10:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5249999999999999,"15min":1.5329999999999999},"min":{"1min":1.093,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.8799999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.389,"15min":1.383},"min":{"1min":0.94499999999999995,"5min":0.879,"15min":0.879},"max":{"1min":1.9610000000000001,"5min":2.601,"15min":2.601},"last":1.4019999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:40:34.968 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:40:34.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:40:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.245+0000 7f364ead3640 1 Processor -- start 2023-08-10T10:40:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.245+0000 7f364ead3640 1 -- start start 2023-08-10T10:40:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364ead3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f36480b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364ead3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f364806cb30 0x7f36480ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364ead3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480adcb0 con 0x7f36480cd2a0 2023-08-10T10:40:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364ead3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364806c320 con 0x7f364806cb30 2023-08-10T10:40:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364ead3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364806b770 con 0x7f364815ae40 2023-08-10T10:40:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364d070640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36480cd2a0 0x7f36480c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47176/0 (socket says 172.21.15.50:47176) 2023-08-10T10:40:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.247+0000 7f364d070640 1 -- 172.21.15.50:0/2686969368 learned_addr learned my addr 172.21.15.50:0/2686969368 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363ffff640 1 --2- 172.21.15.50:0/2686969368 >> v2:172.21.15.117:3300/0 conn(0x7f364806cb30 0x7f36480ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f364c86f640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f36480b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870895415 0 0) 0x7f36480adcb0 con 0x7f36480cd2a0 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3630003520 con 0x7f36480cd2a0 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238674117 0 0) 0x7f3630003520 con 0x7f36480cd2a0 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 msgr2=0x7f36480b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f36480b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 >> v2:172.21.15.117:3300/0 conn(0x7f364806cb30 msgr2=0x7f36480ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 --2- 172.21.15.50:0/2686969368 >> v2:172.21.15.117:3300/0 conn(0x7f364806cb30 0x7f36480ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364806b9f0 con 0x7f36480cd2a0 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f36400019f0 con 0x7f36480cd2a0 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 >> v1:172.21.15.50:6789/0 conn(0x7f36480cd2a0 legacy=0x7f36480c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3630003970 0x7f3630003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36300047c0 0x7f3630004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f3630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364806c320 con 0x7f36300047c0 2023-08-10T10:40:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364806b770 con 0x7f3630003970 2023-08-10T10:40:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.248+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363000fd90 con 0x7f364815ae40 2023-08-10T10:40:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36300047c0 0x7f3630004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f364c86f640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3630003970 0x7f3630003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f364d070640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f3630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 -- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 msgr2=0x7f3630005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f364815ae40 0x7f3630005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 -- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3630003970 msgr2=0x7f3630003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3630003970 0x7f3630003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.249+0000 7f363ffff640 1 -- 172.21.15.50:0/2686969368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630003520 con 0x7f36300047c0 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.250+0000 7f363ffff640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36300047c0 0x7f3630004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3638009a90 tx=0x7f36300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd4ded50191c7a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363802c6b0 con 0x7f36300047c0 2023-08-10T10:40:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363802c810 con 0x7f36300047c0 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f363f7fe640 1 -- 172.21.15.50:0/2686969368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363802cba0 con 0x7f36300047c0 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 -- 172.21.15.50:0/2686969368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36300047c0 msgr2=0x7f3630004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 --2- 172.21.15.50:0/2686969368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36300047c0 0x7f3630004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3638009a90 tx=0x7f36300057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364d070640 1 -- 172.21.15.50:0/2686969368 reap_dead start 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 -- 172.21.15.50:0/2686969368 shutdown_connections 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 -- 172.21.15.50:0/2686969368 >> 172.21.15.50:0/2686969368 conn(0x7f36480b01b0 msgr2=0x7f36480b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 -- 172.21.15.50:0/2686969368 shutdown_connections 2023-08-10T10:40:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.251+0000 7f364ead3640 1 -- 172.21.15.50:0/2686969368 wait complete. 2023-08-10T10:40:35.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.253+0000 7f364ead3640 1 Processor -- start 2023-08-10T10:40:35.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.253+0000 7f364ead3640 1 -- start start 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 0x7f3648148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 0x7f36480c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648158240 con 0x7f36480c21f0 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480c76e0 con 0x7f3648149320 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.254+0000 7f364ead3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364814c410 con 0x7f36300047c0 2023-08-10T10:40:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33540/0 (socket says 172.21.15.50:33540) 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 -- 172.21.15.50:0/3798917556 learned_addr learned my addr 172.21.15.50:0/3798917556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f364d070640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 0x7f36480c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f364c86f640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 0x7f3648148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 -- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 msgr2=0x7f3648148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 0x7f3648148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 -- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 msgr2=0x7f36480c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 0x7f36480c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f363ffff640 1 -- 172.21.15.50:0/3798917556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480c6a60 con 0x7f36480c21f0 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f364c86f640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 0x7f3648148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.255+0000 7f364d070640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 0x7f36480c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f363ffff640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f363802c250 tx=0x7f3638004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638003810 con 0x7f36480c21f0 2023-08-10T10:40:35.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638003970 con 0x7f36480c21f0 2023-08-10T10:40:35.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638003ce0 con 0x7f36480c21f0 2023-08-10T10:40:35.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36480c6d40 con 0x7f36480c21f0 2023-08-10T10:40:35.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.256+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36480c7300 con 0x7f36480c21f0 2023-08-10T10:40:35.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.257+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480612b0 con 0x7f36480c21f0 2023-08-10T10:40:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.258+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3638040450 con 0x7f36480c21f0 2023-08-10T10:40:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.259+0000 7f363d7fa640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 0x7f363406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.260+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36380ab6b0 con 0x7f36480c21f0 2023-08-10T10:40:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.260+0000 7f364c86f640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 0x7f363406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.260+0000 7f364c86f640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 0x7f363406d110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3644006ce0 tx=0x7f3644008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.264+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3638076750 con 0x7f36480c21f0 2023-08-10T10:40:35.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.523+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f364806b350 con 0x7f36480c21f0 2023-08-10T10:40:35.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.529+0000 7f363d7fa640 1 -- 172.21.15.50:0/3798917556 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f36380044e0 con 0x7f36480c21f0 2023-08-10T10:40:35.530 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:40:35.531 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:40:35.531 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:40:35.531 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:40:35.531 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:40:35.531 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:40:35.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 msgr2=0x7f363406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 0x7f363406d110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3644006ce0 tx=0x7f3644008040 comp rx=0 tx=0).stop 2023-08-10T10:40:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 msgr2=0x7f364814bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f363802c250 tx=0x7f3638004730 comp rx=0 tx=0).stop 2023-08-10T10:40:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 shutdown_connections 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f363406ac50 0x7f363406d110 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3648149320 0x7f36480c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36480c21f0 0x7f364814bed0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 --2- 172.21.15.50:0/3798917556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36300047c0 0x7f3648148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.531+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 >> 172.21.15.50:0/3798917556 conn(0x7f36480b01b0 msgr2=0x7f36480c1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.532+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 shutdown_connections 2023-08-10T10:40:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.532+0000 7f364ead3640 1 -- 172.21.15.50:0/3798917556 wait complete. 2023-08-10T10:40:35.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.772+0000 7f65d359e640 1 Processor -- start 2023-08-10T10:40:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.773+0000 7f65d359e640 1 -- start start 2023-08-10T10:40:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65d40b0620 0x7f65d40b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 0x7f65d40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40b1f10 con 0x7f65d415a940 2023-08-10T10:40:35.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40b21f0 con 0x7f65d40b0620 2023-08-10T10:40:35.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d359e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d415e5c0 con 0x7f65d415f2b0 2023-08-10T10:40:35.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f65d415a940 0x7f65d40aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47192/0 (socket says 172.21.15.50:47192) 2023-08-10T10:40:35.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d259c640 1 -- 172.21.15.50:0/2516021297 learned_addr learned my addr 172.21.15.50:0/2516021297 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:35.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.774+0000 7f65d1d9b640 1 --2- 172.21.15.50:0/2516021297 >> v2:172.21.15.50:3300/0 conn(0x7f65d40b0620 0x7f65d40b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d2d9d640 1 --2- 172.21.15.50:0/2516021297 >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 0x7f65d40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d159a640 1 -- 172.21.15.50:0/2516021297 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270831859 0 0) 0x7f65d40b1f10 con 0x7f65d415a940 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d159a640 1 -- 172.21.15.50:0/2516021297 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65bc003520 con 0x7f65d415a940 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d1d9b640 1 -- 172.21.15.50:0/2516021297 >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 msgr2=0x7f65d40b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d1d9b640 1 --2- 172.21.15.50:0/2516021297 >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 0x7f65d40b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d1d9b640 1 -- 172.21.15.50:0/2516021297 >> v1:172.21.15.50:6789/0 conn(0x7f65d415a940 legacy=0x7f65d40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d1d9b640 1 -- 172.21.15.50:0/2516021297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d415e7d0 con 0x7f65d40b0620 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.775+0000 7f65d2d9d640 1 --2- 172.21.15.50:0/2516021297 >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 0x7f65d40b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.776+0000 7f65d1d9b640 1 --2- 172.21.15.50:0/2516021297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d40b0620 0x7f65d40b12c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f65d415e520 tx=0x7f65c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149da5a32154a0ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.776+0000 7f65d159a640 1 -- 172.21.15.50:0/2516021297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c802e070 con 0x7f65d40b0620 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.776+0000 7f65d159a640 1 -- 172.21.15.50:0/2516021297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c80315a0 con 0x7f65d40b0620 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.776+0000 7f65d159a640 1 -- 172.21.15.50:0/2516021297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8031910 con 0x7f65d40b0620 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 -- 172.21.15.50:0/2516021297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d40b0620 msgr2=0x7f65d40b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 --2- 172.21.15.50:0/2516021297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d40b0620 0x7f65d40b12c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f65d415e520 tx=0x7f65c802b840 comp rx=0 tx=0).stop 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 -- 172.21.15.50:0/2516021297 shutdown_connections 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 --2- 172.21.15.50:0/2516021297 >> v2:172.21.15.117:3300/0 conn(0x7f65d415f2b0 0x7f65d40b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 --2- 172.21.15.50:0/2516021297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d40b0620 0x7f65d40b12c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 -- 172.21.15.50:0/2516021297 >> 172.21.15.50:0/2516021297 conn(0x7f65d406ab80 msgr2=0x7f65d406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 -- 172.21.15.50:0/2516021297 shutdown_connections 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.777+0000 7f65d359e640 1 -- 172.21.15.50:0/2516021297 wait complete. 2023-08-10T10:40:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.778+0000 7f65d359e640 1 Processor -- start 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.779+0000 7f65d359e640 1 -- start start 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.779+0000 7f65d359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40b0620 0x7f65d40c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415a940 0x7f65d4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40716f0 con 0x7f65d415f2b0 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4071410 con 0x7f65d40b0620 2023-08-10T10:40:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4156d70 con 0x7f65d415a940 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33556/0 (socket says 172.21.15.50:33556) 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 -- 172.21.15.50:0/3130154654 learned_addr learned my addr 172.21.15.50:0/3130154654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d259c640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40b0620 0x7f65d40c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 -- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415a940 msgr2=0x7f65d4157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415a940 0x7f65d4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 -- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40b0620 msgr2=0x7f65d40c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40b0620 0x7f65d40c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.780+0000 7f65d2d9d640 1 -- 172.21.15.50:0/3130154654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c8009400 con 0x7f65d415f2b0 2023-08-10T10:40:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65d2d9d640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00ce80 tx=0x7f65cc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00d840 con 0x7f65d415f2b0 2023-08-10T10:40:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00d9e0 con 0x7f65d415f2b0 2023-08-10T10:40:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00dd90 con 0x7f65d415f2b0 2023-08-10T10:40:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d4157050 con 0x7f65d415f2b0 2023-08-10T10:40:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.781+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d41583a0 con 0x7f65d415f2b0 2023-08-10T10:40:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.782+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d4157570 con 0x7f65d415f2b0 2023-08-10T10:40:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.783+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65cc015440 con 0x7f65d415f2b0 2023-08-10T10:40:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.784+0000 7f65c2ffd640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 0x7f65b406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.784+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65cc089dc0 con 0x7f65d415f2b0 2023-08-10T10:40:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.784+0000 7f65d259c640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 0x7f65b406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.785+0000 7f65d259c640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 0x7f65b406d140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000f60 tx=0x7f65c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:35.788+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f65d4157570 con 0x7f65d415f2b0 2023-08-10T10:40:36.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.010+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65d4157570 con 0x7f65d415f2b0 2023-08-10T10:40:36.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.012+0000 7f65c2ffd640 1 -- 172.21.15.50:0/3130154654 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f65d4157570 con 0x7f65d415f2b0 2023-08-10T10:40:36.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:36.013 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:40:36.014 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:40:36.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.014+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 msgr2=0x7f65b406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.014+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 0x7f65b406d140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000f60 tx=0x7f65c4009040 comp rx=0 tx=0).stop 2023-08-10T10:40:36.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.014+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 msgr2=0x7f65d41562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.014+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00ce80 tx=0x7f65cc00a710 comp rx=0 tx=0).stop 2023-08-10T10:40:36.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 shutdown_connections 2023-08-10T10:40:36.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d415f2b0 0x7f65d41562d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65d415a940 0x7f65d4157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f65b406ac80 0x7f65b406d140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 --2- 172.21.15.50:0/3130154654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65d40b0620 0x7f65d40c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 >> 172.21.15.50:0/3130154654 conn(0x7f65d406ab80 msgr2=0x7f65d40cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 shutdown_connections 2023-08-10T10:40:36.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.015+0000 7f65d359e640 1 -- 172.21.15.50:0/3130154654 wait complete. 2023-08-10T10:40:36.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:40:24.262589+0000', 'modified': '2023-08-10T10:40:27.860494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5634': {'gid': 5634, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6836/2990759901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2990759901}, {'type': 'v1', 'addr': '172.21.15.50:6836', 'nonce': 2990759901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:40:36.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:40:36.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:40:36.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.674+0000 7f05dcbd5640 1 Processor -- start 2023-08-10T10:40:36.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.674+0000 7f05dcbd5640 1 -- start start 2023-08-10T10:40:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.675+0000 7f05dcbd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d80cd9e0 0x7f05d815a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.675+0000 7f05dcbd5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05d806ea80 0x7f05d806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05dcbd5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d806a970 con 0x7f05d8157460 2023-08-10T10:40:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05dcbd5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d815ad60 con 0x7f05d806ea80 2023-08-10T10:40:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05dcbd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d8157840 con 0x7f05d80cd9e0 2023-08-10T10:40:36.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05d6d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05d806ea80 0x7f05d806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05d6d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05d806ea80 0x7f05d806ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42834/0 (socket says 172.21.15.50:42834) 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2068058247 learned_addr learned my addr 172.21.15.50:0/2068058247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.676+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d80cd9e0 0x7f05d815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.677+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d80cd9e0 msgr2=0x7f05d815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.677+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d80cd9e0 0x7f05d815a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.677+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2068058247 >> v1:172.21.15.117:6789/0 conn(0x7f05d8157460 legacy=0x7f05d80cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.677+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2068058247 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d806ac50 con 0x7f05d806ea80 2023-08-10T10:40:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.679+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d806ef10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f05d00098a0 tx=0x7f05d002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62159a0b6813d508 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.679+0000 7f05d5d9b640 1 -- 172.21.15.50:0/2068058247 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0030840 con 0x7f05d806ea80 2023-08-10T10:40:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05d5d9b640 1 -- 172.21.15.50:0/2068058247 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00309a0 con 0x7f05d806ea80 2023-08-10T10:40:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05d5d9b640 1 -- 172.21.15.50:0/2068058247 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0030d30 con 0x7f05d806ea80 2023-08-10T10:40:36.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 -- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 msgr2=0x7f05d806ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d806ef10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f05d00098a0 tx=0x7f05d002b980 comp rx=0 tx=0).stop 2023-08-10T10:40:36.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 -- 172.21.15.50:0/2068058247 shutdown_connections 2023-08-10T10:40:36.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d806ef10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/2068058247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d80cd9e0 0x7f05d815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 -- 172.21.15.50:0/2068058247 >> 172.21.15.50:0/2068058247 conn(0x7f05d80b08e0 msgr2=0x7f05d80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.680+0000 7f05dcbd5640 1 -- 172.21.15.50:0/2068058247 shutdown_connections 2023-08-10T10:40:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.681+0000 7f05dcbd5640 1 -- 172.21.15.50:0/2068058247 wait complete. 2023-08-10T10:40:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.682+0000 7f05dcbd5640 1 Processor -- start 2023-08-10T10:40:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.682+0000 7f05dcbd5640 1 -- start start 2023-08-10T10:40:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d8157460 0x7f05d8152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80afdc0 con 0x7f05d80cd9e0 2023-08-10T10:40:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d814ea50 con 0x7f05d806ea80 2023-08-10T10:40:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.683+0000 7f05dcbd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d814ed30 con 0x7f05d8157460 2023-08-10T10:40:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33572/0 (socket says 172.21.15.50:33572) 2023-08-10T10:40:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 -- 172.21.15.50:0/1576190993 learned_addr learned my addr 172.21.15.50:0/1576190993 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 -- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d8157460 msgr2=0x7f05d8152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d8157460 0x7f05d8152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05d659c640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d8157460 0x7f05d8152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 -- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 msgr2=0x7f05d814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 -- 172.21.15.50:0/1576190993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00094d0 con 0x7f05d80cd9e0 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.684+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f05c000efc0 tx=0x7f05c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.685+0000 7f05cf7fe640 1 -- 172.21.15.50:0/1576190993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0009b80 con 0x7f05d80cd9e0 2023-08-10T10:40:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.685+0000 7f05cf7fe640 1 -- 172.21.15.50:0/1576190993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000f040 con 0x7f05d80cd9e0 2023-08-10T10:40:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.685+0000 7f05cf7fe640 1 -- 172.21.15.50:0/1576190993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00146a0 con 0x7f05d80cd9e0 2023-08-10T10:40:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.685+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d814f010 con 0x7f05d80cd9e0 2023-08-10T10:40:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.685+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d814cf50 con 0x7f05d80cd9e0 2023-08-10T10:40:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.687+0000 7f05cf7fe640 1 -- 172.21.15.50:0/1576190993 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05c0014800 con 0x7f05d80cd9e0 2023-08-10T10:40:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.688+0000 7f05cf7fe640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 0x7f05b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.689+0000 7f05cf7fe640 1 -- 172.21.15.50:0/1576190993 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05c008a030 con 0x7f05d80cd9e0 2023-08-10T10:40:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.689+0000 7f05df81e740 1 Processor -- start 2023-08-10T10:40:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.689+0000 7f05d659c640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 0x7f05b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.689+0000 7f05df81e740 1 -- start start 2023-08-10T10:40:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05d659c640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 0x7f05b806d110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 0x5602a906d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a8fb09d0 con 0x5602a9044040 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a8fae0c0 con 0x5602a9040440 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602a8fa99b0 con 0x5602a90704c0 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33576/0 (socket says 172.21.15.50:33576) 2023-08-10T10:40:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.690+0000 7f05d6d9d640 1 -- 172.21.15.50:0/227586991 learned_addr learned my addr 172.21.15.50:0/227586991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 0x5602a906d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 -- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 msgr2=0x5602a90708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d659c640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 -- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 msgr2=0x5602a906d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 0x5602a906d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 -- 172.21.15.50:0/227586991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602a8f76c10 con 0x5602a9044040 2023-08-10T10:40:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 0x5602a906d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d659c640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f05d002b9c0 tx=0x7f05d0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dad3e6e3b12c36 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.691+0000 7f05b7fff640 1 -- 172.21.15.50:0/227586991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0030b10 con 0x5602a9044040 2023-08-10T10:40:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05b7fff640 1 -- 172.21.15.50:0/227586991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0030c70 con 0x5602a9044040 2023-08-10T10:40:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05b7fff640 1 -- 172.21.15.50:0/227586991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0039450 con 0x5602a9044040 2023-08-10T10:40:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 -- 172.21.15.50:0/227586991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 msgr2=0x5602a906dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f05d002b9c0 tx=0x7f05d0008030 comp rx=0 tx=0).stop 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 -- 172.21.15.50:0/227586991 shutdown_connections 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a906dc70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9040440 0x5602a906d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 --2- 172.21.15.50:0/227586991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 -- 172.21.15.50:0/227586991 >> 172.21.15.50:0/227586991 conn(0x5602a9042750 msgr2=0x5602a908b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 -- 172.21.15.50:0/227586991 shutdown_connections 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.692+0000 7f05df81e740 1 -- 172.21.15.50:0/227586991 wait complete. 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.693+0000 7f05df81e740 1 -- start start 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.693+0000 7f05df81e740 1 Processor -- start 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a906a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a90691d0 0x5602a906ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a8f4a940 con 0x5602a9044040 2023-08-10T10:40:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a8f4a5e0 con 0x5602a90691d0 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602a8d10f20 con 0x5602a90704c0 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05df81e740 10 client.0 _ll_register_callbacks cb 0x5602a8fa3250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.694+0000 7f05d659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33592/0 (socket says 172.21.15.50:33592) 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 -- 172.21.15.50:0/1801919047 learned_addr learned my addr 172.21.15.50:0/1801919047 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 -- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 msgr2=0x5602a906a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a906a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 -- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a90691d0 msgr2=0x5602a906ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a90691d0 0x5602a906ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 -- 172.21.15.50:0/1801919047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d806ac50 con 0x5602a9044040 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05d659c640 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d770 tx=0x7f05c8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c072aa324f6c28 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8003c90 con 0x5602a9044040 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.695+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05c8003df0 con 0x5602a9044040 2023-08-10T10:40:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602a8fd3bf0 con 0x5602a9044040 2023-08-10T10:40:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c8022460 con 0x5602a9044040 2023-08-10T10:40:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 10 client.5811 fetch_fsmap learned FSMap version 24 2023-08-10T10:40:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5602a8fa8030 con 0x5602a9044040 2023-08-10T10:40:36.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602a8fd3bf0 con 0x5602a9044040 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f05c80225c0 con 0x5602a9044040 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 10 client.5811 fetch_fsmap finished waiting for FSMap version 24 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 10 client.5811 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 20 client.5811 populate_metadata read hostname 'smithi050' 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a9056610 0x5602a90569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 4 client.5811 mds_command: new command op to 5634 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:40:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.696+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 --> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602a8f9c7c0 con 0x5602a9056610 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.697+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a9056610 0x5602a90569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.697+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a9056610 0x5602a90569f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=431dda422d522885 server_cookie=35c7bdf9c1f492bb in_seq=0 out_seq=0 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.697+0000 7f05b57fa640 10 client.5811 ms_handle_connect on v2:172.21.15.50:6834/2990759901 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05b57fa640 1 -- 172.21.15.50:0/1801919047 <== mds.0 v2:172.21.15.50:6834/2990759901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5602a8f9c7c0 con 0x5602a9056610 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05b57fa640 10 client.5811 handle_command_reply: tid=0 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 client.5811 shutdown 2023-08-10T10:40:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 msgr2=0x5602a9073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d770 tx=0x7f05c8001120 comp rx=0 tx=0).stop 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 shutdown_connections 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a9056610 0x5602a90569f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a90691d0 0x5602a906ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a906a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 --2- 172.21.15.50:0/1801919047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a9044040 0x5602a9073390 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05b57fa640 0 client.5811 ms_handle_reset on v2:172.21.15.50:6834/2990759901 2023-08-10T10:40:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 >> 172.21.15.50:0/1801919047 conn(0x5602a9040440 msgr2=0x5602a9044a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 shutdown_connections 2023-08-10T10:40:36.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.698+0000 7f05df81e740 1 -- 172.21.15.50:0/1801919047 wait complete. 2023-08-10T10:40:36.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.699+0000 7f05df81e740 20 client.5811 trim_cache size 0 max 16384 2023-08-10T10:40:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.715+0000 7f05df81e740 1 Processor -- start 2023-08-10T10:40:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.715+0000 7f05df81e740 1 -- start start 2023-08-10T10:40:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a90719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90661e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a9064e20 con 0x5602a90691d0 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a9046780 con 0x5602a9044040 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.716+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602a8f31840 con 0x5602a90704c0 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33608/0 (socket says 172.21.15.50:33608) 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 -- 172.21.15.50:0/3267931096 learned_addr learned my addr 172.21.15.50:0/3267931096 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 -- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 msgr2=0x5602a90661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 -- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 msgr2=0x5602a90719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a90719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 -- 172.21.15.50:0/3267931096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602a8fdd8a0 con 0x5602a90691d0 2023-08-10T10:40:36.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05cdd9b640 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f05c00094c0 tx=0x7f05c0016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a8cf53f922f74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.717+0000 7f05ccd99640 1 -- 172.21.15.50:0/3267931096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00554a0 con 0x5602a90691d0 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05ccd99640 1 -- 172.21.15.50:0/3267931096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0055600 con 0x5602a90691d0 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05ccd99640 1 -- 172.21.15.50:0/3267931096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011dd0 con 0x5602a90691d0 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 -- 172.21.15.50:0/3267931096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 msgr2=0x5602a9065b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f05c00094c0 tx=0x7f05c0016040 comp rx=0 tx=0).stop 2023-08-10T10:40:36.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 -- 172.21.15.50:0/3267931096 shutdown_connections 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90704c0 0x5602a90661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 --2- 172.21.15.50:0/3267931096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a90719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 -- 172.21.15.50:0/3267931096 >> 172.21.15.50:0/3267931096 conn(0x5602a9040440 msgr2=0x5602a906d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 -- 172.21.15.50:0/3267931096 shutdown_connections 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.718+0000 7f05df81e740 1 -- 172.21.15.50:0/3267931096 wait complete. 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.719+0000 7f05df81e740 1 -- start start 2023-08-10T10:40:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.719+0000 7f05df81e740 1 Processor -- start 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a908d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a906a4b0 con 0x5602a90704c0 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602a906b9f0 con 0x5602a9044040 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602a906bc30 con 0x5602a90691d0 2023-08-10T10:40:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05df81e740 10 client.0 _ll_register_callbacks cb 0x7f05c8005300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:40:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33614/0 (socket says 172.21.15.50:33614) 2023-08-10T10:40:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.720+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2513878999 learned_addr learned my addr 172.21.15.50:0/2513878999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90691d0 msgr2=0x5602a9065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 msgr2=0x5602a908d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a908d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 -- 172.21.15.50:0/2513878999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d814cf50 con 0x5602a90704c0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05d6d9d640 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f05d002b9c0 tx=0x7f05d0006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3a711d90d3372 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0030b10 con 0x5602a90704c0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05d003e070 con 0x5602a90704c0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.721+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05d0030c70 con 0x5602a90704c0 2023-08-10T10:40:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05d0004510 con 0x5602a90704c0 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 10 client.5817 fetch_fsmap learned FSMap version 24 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5602a8f49610 con 0x5602a90704c0 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0030c70 con 0x5602a90704c0 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f05d0003610 con 0x5602a90704c0 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 10 client.5817 fetch_fsmap finished waiting for FSMap version 24 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 10 client.5817 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 20 client.5817 populate_metadata read hostname 'smithi050' 2023-08-10T10:40:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a909d380 0x5602a909d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 4 client.5817 mds_command: new command op to 5634 tid=0[{"prefix": "status"}] 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 --> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5602a8fa2990 con 0x5602a909d380 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.722+0000 7f05d659c640 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a909d380 0x5602a909d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05d659c640 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a909d380 0x5602a909d760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791e92c0a7f0f346 server_cookie=e104a869ed8a63f1 in_seq=0 out_seq=0 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05b57fa640 10 client.5817 ms_handle_connect on v2:172.21.15.50:6834/2990759901 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05b57fa640 1 -- 172.21.15.50:0/2513878999 <== mds.0 v2:172.21.15.50:6834/2990759901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5602a8fa2990 con 0x5602a909d380 2023-08-10T10:40:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05b57fa640 10 client.5817 handle_command_reply: tid=0 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05df81e740 1 client.5817 shutdown 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 msgr2=0x5602a90660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.723+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f05d002b9c0 tx=0x7f05d0006ac0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 shutdown_connections 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:6834/2990759901,v1:172.21.15.50:6836/2990759901] conn(0x5602a909d380 0x5602a909d760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602a90704c0 0x5602a90660b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602a90691d0 0x5602a9065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 --2- 172.21.15.50:0/2513878999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602a9044040 0x5602a908d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05b57fa640 0 client.5817 ms_handle_reset on v2:172.21.15.50:6834/2990759901 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 >> 172.21.15.50:0/2513878999 conn(0x5602a9040440 msgr2=0x5602a9044420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 shutdown_connections 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 1 -- 172.21.15.50:0/2513878999 wait complete. 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05df81e740 20 client.5817 trim_cache size 0 max 16384 2023-08-10T10:40:36.732 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5634, 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:40:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.933662855, 2023-08-10T10:40:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2023-08-10T10:40:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 52, 2023-08-10T10:40:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 52, 2023-08-10T10:40:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.732731944000001 2023-08-10T10:40:36.734 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 msgr2=0x7f05b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 0x7f05b806d110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c8009040 comp rx=0 tx=0).stop 2023-08-10T10:40:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 msgr2=0x7f05d80af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.724+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f05c000efc0 tx=0x7f05c000c490 comp rx=0 tx=0).stop 2023-08-10T10:40:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 shutdown_connections 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05d8157460 0x7f05d8152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d80cd9e0 0x7f05d80af880 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05b806ac50 0x7f05b806d110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 --2- 172.21.15.50:0/1576190993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05d806ea80 0x7f05d814e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 >> 172.21.15.50:0/1576190993 conn(0x7f05d80b08e0 msgr2=0x7f05d8157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 shutdown_connections 2023-08-10T10:40:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.725+0000 7f05dcbd5640 1 -- 172.21.15.50:0/1576190993 wait complete. 2023-08-10T10:40:36.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:40:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.955+0000 7f4beab6d640 1 Processor -- start 2023-08-10T10:40:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.956+0000 7f4beab6d640 1 -- start start 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be4159830 0x7f4be40cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 0x7f4be40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4be4069be0 0x7f4be40c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be406a030 con 0x7f4be4069be0 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be415def0 con 0x7f4be40cde40 2023-08-10T10:40:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4beab6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40ce350 con 0x7f4be4159830 2023-08-10T10:40:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4bea36c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4be4069be0 0x7f4be40c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4bea36c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4be4069be0 0x7f4be40c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33628/0 (socket says 172.21.15.50:33628) 2023-08-10T10:40:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.957+0000 7f4bea36c640 1 -- 172.21.15.50:0/933486672 learned_addr learned my addr 172.21.15.50:0/933486672 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4be936a640 1 --2- 172.21.15.50:0/933486672 >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 0x7f4be40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4be9b6b640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be4159830 0x7f4be40cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4bea36c640 1 -- 172.21.15.50:0/933486672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be4159830 msgr2=0x7f4be40cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4bea36c640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be4159830 0x7f4be40cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4bea36c640 1 -- 172.21.15.50:0/933486672 >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 msgr2=0x7f4be40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4bea36c640 1 --2- 172.21.15.50:0/933486672 >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 0x7f4be40696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4bea36c640 1 -- 172.21.15.50:0/933486672 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be415e380 con 0x7f4be4069be0 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.958+0000 7f4be936a640 1 --2- 172.21.15.50:0/933486672 >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 0x7f4be40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.959+0000 7f4bea36c640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4069be0 0x7f4be40c8b70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4be406bd50 tx=0x7f4bdc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2616d42f312e0cf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.959+0000 7f4be8b69640 1 -- 172.21.15.50:0/933486672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc02ca80 con 0x7f4be4069be0 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.959+0000 7f4be8b69640 1 -- 172.21.15.50:0/933486672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc02cbe0 con 0x7f4be4069be0 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.959+0000 7f4be8b69640 1 -- 172.21.15.50:0/933486672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0343f0 con 0x7f4be4069be0 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 -- 172.21.15.50:0/933486672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4069be0 msgr2=0x7f4be40c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4069be0 0x7f4be40c8b70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4be406bd50 tx=0x7f4bdc02bee0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 -- 172.21.15.50:0/933486672 shutdown_connections 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4069be0 0x7f4be40c8b70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 --2- 172.21.15.50:0/933486672 >> v2:172.21.15.117:3300/0 conn(0x7f4be40cde40 0x7f4be40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 --2- 172.21.15.50:0/933486672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be4159830 0x7f4be40cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 -- 172.21.15.50:0/933486672 >> 172.21.15.50:0/933486672 conn(0x7f4be40cafa0 msgr2=0x7f4be40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 -- 172.21.15.50:0/933486672 shutdown_connections 2023-08-10T10:40:36.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.960+0000 7f4beab6d640 1 -- 172.21.15.50:0/933486672 wait complete. 2023-08-10T10:40:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.962+0000 7f4beab6d640 1 Processor -- start 2023-08-10T10:40:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.962+0000 7f4beab6d640 1 -- start start 2023-08-10T10:40:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 0x7f4be4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be40cde40 0x7f4be41574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4071690 con 0x7f4be4159830 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4070d60 con 0x7f4be4069be0 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.963+0000 7f4beab6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4071040 con 0x7f4be40cde40 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33630/0 (socket says 172.21.15.50:33630) 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 -- 172.21.15.50:0/2158813957 learned_addr learned my addr 172.21.15.50:0/2158813957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4be936a640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be40cde40 0x7f4be41574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4be9b6b640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 0x7f4be4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 -- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be40cde40 msgr2=0x7f4be41574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be40cde40 0x7f4be41574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 -- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 msgr2=0x7f4be4153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 0x7f4be4153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4bea36c640 1 -- 172.21.15.50:0/2158813957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009b30 con 0x7f4be4159830 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.964+0000 7f4be9b6b640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 0x7f4be4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4bea36c640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc036040 tx=0x7f4bdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc009510 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc03e450 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc03e800 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be4071320 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.965+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be4156b70 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.966+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be40ca9f0 con 0x7f4be4159830 2023-08-10T10:40:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.967+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4bdc02cd50 con 0x7f4be4159830 2023-08-10T10:40:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.968+0000 7f4bda7fc640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 0x7f4bc806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.968+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bdc0ac070 con 0x7f4be4159830 2023-08-10T10:40:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.968+0000 7f4be9b6b640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 0x7f4bc806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.969+0000 7f4be9b6b640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 0x7f4bc806d140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4be0008890 tx=0x7f4be0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:36.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:36.973+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4bdc0771d0 con 0x7f4be4159830 2023-08-10T10:40:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.205+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4be40717d0 con 0x7f4be4159830 2023-08-10T10:40:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.206+0000 7f4bda7fc640 1 -- 172.21.15.50:0/2158813957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4be40717d0 con 0x7f4be4159830 2023-08-10T10:40:37.207 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:40:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 msgr2=0x7f4bc806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 0x7f4bc806d140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4be0008890 tx=0x7f4be0008040 comp rx=0 tx=0).stop 2023-08-10T10:40:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 msgr2=0x7f4be41579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc036040 tx=0x7f4bdc004a40 comp rx=0 tx=0).stop 2023-08-10T10:40:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 shutdown_connections 2023-08-10T10:40:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4be4159830 0x7f4be41579e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4be40cde40 0x7f4be41574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bc806ac80 0x7f4bc806d140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 --2- 172.21.15.50:0/2158813957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4be4069be0 0x7f4be4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.208+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 >> 172.21.15.50:0/2158813957 conn(0x7f4be40cafa0 msgr2=0x7f4be40ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.209+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 shutdown_connections 2023-08-10T10:40:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:37.209+0000 7f4beab6d640 1 -- 172.21.15.50:0/2158813957 wait complete. 2023-08-10T10:40:37.230 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:40:37.230 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:40:37.230 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:40:37.231 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:40:37.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:40:37.231 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:40:37.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:40:37.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:40:37.232 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:40:37.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.233 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:40:37.289 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:40:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:40:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:40:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41088sec preferred_lft 41088sec 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:40:37.292 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:40:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:40:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.294 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:40:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:40:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:40:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:37.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.296 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:40:37.395 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:40:37.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.400 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:40:37.452 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:40:37.453 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:40:37.453 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:40:37.453 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:40:37.453 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:40:37.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.454 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:40:37.454 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:40:37.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:40:37.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:40:37.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:40:37.456 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:40:37.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.637 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:40:37.694 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:40:37.695 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:40:37.695 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:40:37.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:40:37.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:40:37.800 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:40:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:40:37.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:40:37.860 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:40:37.918 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:40:37.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:37.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:38.072 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:38.072 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:40:38.106 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:38.107 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:40:38.107 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:40:38.107 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:40:38.108 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:40:38.111 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:40:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:40:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:40:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:40:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:40:38.115 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:40:38.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:38.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:40:38.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:38.201 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:40:38.265 INFO:teuthology.orchestra.run.smithi050.stdout:client4991 2023-08-10T10:40:38.266 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:38.266 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:38.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:40:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.552+0000 7fda89af5640 1 Processor -- start 2023-08-10T10:40:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.553+0000 7fda89af5640 1 -- start start 2023-08-10T10:40:38.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.554+0000 7fda89af5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda8415cd60 0x7fda84160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.554+0000 7fda89af5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda840b8430 0x7fda840cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.554+0000 7fda89af5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda840ce200 con 0x7fda840cddb0 2023-08-10T10:40:38.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.554+0000 7fda89af5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda840b5bd0 con 0x7fda840b8430 2023-08-10T10:40:38.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.554+0000 7fda89af5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda84161180 con 0x7fda8415cd60 2023-08-10T10:40:38.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.555+0000 7fda82ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda840b8430 0x7fda840cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.555+0000 7fda82ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda840b8430 0x7fda840cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33636/0 (socket says 172.21.15.50:33636) 2023-08-10T10:40:38.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.555+0000 7fda82ffd640 1 -- 172.21.15.50:0/2198312466 learned_addr learned my addr 172.21.15.50:0/2198312466 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:38.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.555+0000 7fda837fe640 1 --2- 172.21.15.50:0/2198312466 >> v2:172.21.15.117:3300/0 conn(0x7fda8415cd60 0x7fda84160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.556+0000 7fda82ffd640 1 -- 172.21.15.50:0/2198312466 >> v2:172.21.15.117:3300/0 conn(0x7fda8415cd60 msgr2=0x7fda84160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.556+0000 7fda82ffd640 1 --2- 172.21.15.50:0/2198312466 >> v2:172.21.15.117:3300/0 conn(0x7fda8415cd60 0x7fda84160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.556+0000 7fda82ffd640 1 -- 172.21.15.50:0/2198312466 >> v1:172.21.15.50:6789/0 conn(0x7fda840cddb0 legacy=0x7fda840696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.555+0000 7fda827fc640 1 -- 172.21.15.50:0/2198312466 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397245256 0 0) 0x7fda7c001490 con 0x7fda840cddb0 2023-08-10T10:40:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.556+0000 7fda82ffd640 1 -- 172.21.15.50:0/2198312466 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84161460 con 0x7fda840b8430 2023-08-10T10:40:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.557+0000 7fda82ffd640 1 --2- 172.21.15.50:0/2198312466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda840b8430 0x7fda840cd870 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fda840b24f0 tx=0x7fda7802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed67a86eab2b0118 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.557+0000 7fda827fc640 1 -- 172.21.15.50:0/2198312466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7802f850 con 0x7fda840b8430 2023-08-10T10:40:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.557+0000 7fda827fc640 1 -- 172.21.15.50:0/2198312466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7802f9b0 con 0x7fda840b8430 2023-08-10T10:40:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.557+0000 7fda827fc640 1 -- 172.21.15.50:0/2198312466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7802fd40 con 0x7fda840b8430 2023-08-10T10:40:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 -- 172.21.15.50:0/2198312466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda840b8430 msgr2=0x7fda840cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 --2- 172.21.15.50:0/2198312466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda840b8430 0x7fda840cd870 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fda840b24f0 tx=0x7fda7802ba30 comp rx=0 tx=0).stop 2023-08-10T10:40:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 -- 172.21.15.50:0/2198312466 shutdown_connections 2023-08-10T10:40:38.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 --2- 172.21.15.50:0/2198312466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda840b8430 0x7fda840cd870 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 --2- 172.21.15.50:0/2198312466 >> v2:172.21.15.117:3300/0 conn(0x7fda8415cd60 0x7fda84160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 -- 172.21.15.50:0/2198312466 >> 172.21.15.50:0/2198312466 conn(0x7fda840d2ac0 msgr2=0x7fda840d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:38.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 -- 172.21.15.50:0/2198312466 shutdown_connections 2023-08-10T10:40:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.558+0000 7fda89af5640 1 -- 172.21.15.50:0/2198312466 wait complete. 2023-08-10T10:40:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.560+0000 7fda89af5640 1 Processor -- start 2023-08-10T10:40:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.560+0000 7fda89af5640 1 -- start start 2023-08-10T10:40:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda840b8430 0x7fda8415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840cddb0 0x7fda840a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841f53e0 con 0x7fda8415cd60 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda840ccbc0 con 0x7fda840cddb0 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda89af5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840ccea0 con 0x7fda840b8430 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33650/0 (socket says 172.21.15.50:33650) 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda83fff640 1 -- 172.21.15.50:0/1339291277 learned_addr learned my addr 172.21.15.50:0/1339291277 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.561+0000 7fda82ffd640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840cddb0 0x7fda840a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda837fe640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda840b8430 0x7fda8415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 -- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda840b8430 msgr2=0x7fda8415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda840b8430 0x7fda8415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 -- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840cddb0 msgr2=0x7fda840a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840cddb0 0x7fda840a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 -- 172.21.15.50:0/1339291277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780094d0 con 0x7fda8415cd60 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda83fff640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0016f0 tx=0x7fda7c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c003da0 con 0x7fda8415cd60 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c005070 con 0x7fda8415cd60 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0054a0 con 0x7fda8415cd60 2023-08-10T10:40:38.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.562+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda840cd180 con 0x7fda8415cd60 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.563+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda840cd740 con 0x7fda8415cd60 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.564+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8404e270 con 0x7fda8415cd60 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.565+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda7c005600 con 0x7fda8415cd60 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.566+0000 7fda6bfff640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 0x7fda7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.566+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda7c088d20 con 0x7fda8415cd60 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.566+0000 7fda837fe640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 0x7fda7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.567+0000 7fda837fe640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 0x7fda7006d110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda74009a30 tx=0x7fda74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.570+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fda7c053d30 con 0x7fda8415cd60 2023-08-10T10:40:38.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.799+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fda840ce200 con 0x7fda8415cd60 2023-08-10T10:40:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.800+0000 7fda6bfff640 1 -- 172.21.15.50:0/1339291277 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fda840ce200 con 0x7fda8415cd60 2023-08-10T10:40:38.801 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 msgr2=0x7fda7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 0x7fda7006d110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda74009a30 tx=0x7fda74008040 comp rx=0 tx=0).stop 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 msgr2=0x7fda8415f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0016f0 tx=0x7fda7c00cc70 comp rx=0 tx=0).stop 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 shutdown_connections 2023-08-10T10:40:38.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.802+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda8415cd60 0x7fda8415f660 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fda7006ac50 0x7fda7006d110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840cddb0 0x7fda840a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 --2- 172.21.15.50:0/1339291277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda840b8430 0x7fda8415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 >> 172.21.15.50:0/1339291277 conn(0x7fda840d2ac0 msgr2=0x7fda840d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 shutdown_connections 2023-08-10T10:40:38.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:38.803+0000 7fda89af5640 1 -- 172.21.15.50:0/1339291277 wait complete. 2023-08-10T10:40:38.823 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:40:38.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:40:38.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:40:38.824 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:40:38.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:40:38.824 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:40:38.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:40:38.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:40:38.825 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:40:38.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:38.826 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:40:38.888 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:40:38.888 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:40:38.888 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:40:38.888 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.888 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41258sec preferred_lft 41258sec 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:40:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.891 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:40:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:40:38.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:38.894 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:40:38.987 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:40:38.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:38.992 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:40:39.050 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:40:39.051 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:40:39.051 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:40:39.051 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:40:39.051 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:40:39.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.053 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:40:39.054 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:40:39.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:40:39.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:40:39.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:40:39.056 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:40:39.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.237 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:40:39.292 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:40:39.293 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:40:39.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:40:39.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:40:39.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:40:39.382 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:40:39.435 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:40:39.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:40:39.437 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:40:39.489 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:40:39.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:39.637 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:39.637 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:40:39.671 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:40:39.671 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:40:39.672 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:40:39.672 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:40:39.672 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:40:39.675 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:40:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:40:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:40:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:40:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:40:39.679 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:40:39.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:40:39.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:39.770 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:40:39.829 INFO:teuthology.orchestra.run.smithi117.stdout:client5230 2023-08-10T10:40:39.830 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:40:39.830 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:39.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:40.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.123+0000 7fe2325dc640 1 Processor -- start 2023-08-10T10:40:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.123+0000 7fe2325dc640 1 -- start start 2023-08-10T10:40:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe2325dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 0x7fe22c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe2325dc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe22c0b8430 0x7fe22c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe2325dc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0ce200 con 0x7fe22c0cddb0 2023-08-10T10:40:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe2325dc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c0b5bd0 con 0x7fe22c0b8430 2023-08-10T10:40:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe2325dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c161180 con 0x7fe22c15cd60 2023-08-10T10:40:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe22b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe22c0b8430 0x7fe22c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe22b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe22c0b8430 0x7fe22c0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33658/0 (socket says 172.21.15.50:33658) 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe22b7fe640 1 -- 172.21.15.50:0/2524938450 learned_addr learned my addr 172.21.15.50:0/2524938450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.125+0000 7fe22bfff640 1 --2- 172.21.15.50:0/2524938450 >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 0x7fe22c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.126+0000 7fe22b7fe640 1 -- 172.21.15.50:0/2524938450 >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 msgr2=0x7fe22c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.126+0000 7fe22b7fe640 1 --2- 172.21.15.50:0/2524938450 >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 0x7fe22c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.126+0000 7fe22b7fe640 1 -- 172.21.15.50:0/2524938450 >> v1:172.21.15.117:6789/0 conn(0x7fe22c0cddb0 legacy=0x7fe22c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.126+0000 7fe22b7fe640 1 -- 172.21.15.50:0/2524938450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c161460 con 0x7fe22c0b8430 2023-08-10T10:40:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.126+0000 7fe22bfff640 1 --2- 172.21.15.50:0/2524938450 >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 0x7fe22c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.127+0000 7fe22b7fe640 1 --2- 172.21.15.50:0/2524938450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b8430 0x7fe22c0cd870 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0b24f0 tx=0x7fe22002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b803b38195eff1e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.127+0000 7fe22affd640 1 -- 172.21.15.50:0/2524938450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22002cb20 con 0x7fe22c0b8430 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.127+0000 7fe22affd640 1 -- 172.21.15.50:0/2524938450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22002cc80 con 0x7fe22c0b8430 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.127+0000 7fe22affd640 1 -- 172.21.15.50:0/2524938450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200343f0 con 0x7fe22c0b8430 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 -- 172.21.15.50:0/2524938450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b8430 msgr2=0x7fe22c0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 --2- 172.21.15.50:0/2524938450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b8430 0x7fe22c0cd870 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0b24f0 tx=0x7fe22002bf80 comp rx=0 tx=0).stop 2023-08-10T10:40:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 -- 172.21.15.50:0/2524938450 shutdown_connections 2023-08-10T10:40:40.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 --2- 172.21.15.50:0/2524938450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b8430 0x7fe22c0cd870 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 --2- 172.21.15.50:0/2524938450 >> v2:172.21.15.117:3300/0 conn(0x7fe22c15cd60 0x7fe22c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 -- 172.21.15.50:0/2524938450 >> 172.21.15.50:0/2524938450 conn(0x7fe22c0d2ac0 msgr2=0x7fe22c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:40.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 -- 172.21.15.50:0/2524938450 shutdown_connections 2023-08-10T10:40:40.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.128+0000 7fe2325dc640 1 -- 172.21.15.50:0/2524938450 wait complete. 2023-08-10T10:40:40.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.130+0000 7fe2325dc640 1 Processor -- start 2023-08-10T10:40:40.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.130+0000 7fe2325dc640 1 -- start start 2023-08-10T10:40:40.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 0x7fe22c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe22c0cddb0 0x7fe22c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c15a6a0 con 0x7fe22c15cd60 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0a9930 con 0x7fe22c0b8430 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe2325dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0ca190 con 0x7fe22c0cddb0 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe230b79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe230b79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33662/0 (socket says 172.21.15.50:33662) 2023-08-10T10:40:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.131+0000 7fe230b79640 1 -- 172.21.15.50:0/1601250871 learned_addr learned my addr 172.21.15.50:0/1601250871 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe22bfff640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 0x7fe22c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 -- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe22c0cddb0 msgr2=0x7fe22c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe22b7fe640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe22c0cddb0 0x7fe22c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe22c0cddb0 0x7fe22c15a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 -- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 msgr2=0x7fe22c0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 0x7fe22c0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 -- 172.21.15.50:0/1601250871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009b30 con 0x7fe22c15cd60 2023-08-10T10:40:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe22bfff640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 0x7fe22c0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:40.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe230b79640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c390 tx=0x7fe22400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:40.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.132+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240035f0 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.133+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224003750 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.133+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003b00 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.133+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0ca470 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.133+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0caa30 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.134+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c04e270 con 0x7fe22c15cd60 2023-08-10T10:40:40.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.135+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe224003c60 con 0x7fe22c15cd60 2023-08-10T10:40:40.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.136+0000 7fe228ff9640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 0x7fe21806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:40.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.136+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2240887e0 con 0x7fe22c15cd60 2023-08-10T10:40:40.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.136+0000 7fe22bfff640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 0x7fe21806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:40.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.137+0000 7fe22bfff640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 0x7fe21806d110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe21c006fd0 tx=0x7fe21c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:40.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.140+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe2240537f0 con 0x7fe22c15cd60 2023-08-10T10:40:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.369+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe22c0d3940 con 0x7fe22c15cd60 2023-08-10T10:40:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.370+0000 7fe228ff9640 1 -- 172.21.15.50:0/1601250871 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fe224056e10 con 0x7fe22c15cd60 2023-08-10T10:40:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:40.372 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:40:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:40:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.372+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 msgr2=0x7fe21806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:40.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.372+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 0x7fe21806d110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe21c006fd0 tx=0x7fe21c008040 comp rx=0 tx=0).stop 2023-08-10T10:40:40.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.372+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 msgr2=0x7fe22c0a93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:40.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.372+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c390 tx=0x7fe22400c850 comp rx=0 tx=0).stop 2023-08-10T10:40:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 shutdown_connections 2023-08-10T10:40:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c15cd60 0x7fe22c0a93f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe22c0cddb0 0x7fe22c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe21806ac50 0x7fe21806d110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 --2- 172.21.15.50:0/1601250871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe22c0b8430 0x7fe22c0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:40.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 >> 172.21.15.50:0/1601250871 conn(0x7fe22c0d2ac0 msgr2=0x7fe22c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:40.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 shutdown_connections 2023-08-10T10:40:40.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:40.373+0000 7fe2325dc640 1 -- 172.21.15.50:0/1601250871 wait complete. 2023-08-10T10:40:40.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:40:40.639 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.83219175,"mdsmap_epoch":24,"osdmap_epoch":52,"osdmap_epoch_barrier":52,"uptime":21.631259752999998} 2023-08-10T10:40:40.640 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5634, "mdsmap_epoch": 24, "osdmap_epoch": 52, "osdmap_epoch_barrier": 52, "rank_uptime": 15.83219175, "state": "up:active", "uptime": 21.631259753, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:40:40.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:40:40.895 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:40:40.895 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:40:40.896 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-08-10T10:40:40.896 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:40.896 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:40.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:40.957 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-08-10T10:40:42.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:42.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:40:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:265+0 records in 2023-08-10T10:40:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:265+0 records out 2023-08-10T10:40:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.83327 s, 152 MB/s 2023-08-10T10:40:42.854 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:42.854 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:42.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:42.898 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-08-10T10:40:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:292+0 records in 2023-08-10T10:40:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:292+0 records out 2023-08-10T10:40:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.94994 s, 157 MB/s 2023-08-10T10:40:44.946 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-10T10:40:44.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:40:45.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.132+0000 7f7d5f3eb640 1 Processor -- start 2023-08-10T10:40:45.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.132+0000 7f7d5f3eb640 1 -- start start 2023-08-10T10:40:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.133+0000 7f7d5f3eb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d5815a940 0x7f7d580aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.133+0000 7f7d5f3eb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d5815f2b0 0x7f7d580b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5f3eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d580b12c0 0x7f7d580b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5f3eb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d580b21f0 con 0x7f7d5815a940 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5f3eb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5815e5c0 con 0x7f7d5815f2b0 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5f3eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580b3a60 con 0x7f7d580b12c0 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d5815a940 0x7f7d580aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d5815a940 0x7f7d580aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48810/0 (socket says 172.21.15.50:48810) 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 -- 172.21.15.50:0/2304721381 learned_addr learned my addr 172.21.15.50:0/2304721381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 -- 172.21.15.50:0/2304721381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d580b12c0 msgr2=0x7f7d580b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2304721381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d580b12c0 0x7f7d580b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 -- 172.21.15.50:0/2304721381 >> v2:172.21.15.117:3300/0 conn(0x7f7d5815f2b0 msgr2=0x7f7d580b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2304721381 >> v2:172.21.15.117:3300/0 conn(0x7f7d5815f2b0 0x7f7d580b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.134+0000 7f7d5e3e9640 1 -- 172.21.15.50:0/2304721381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d580b1c40 con 0x7f7d5815a940 2023-08-10T10:40:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.135+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2304721381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580aff10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7d580b3ba0 tx=0x7f7d5402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb065ebfb2572511 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.136+0000 7f7d5d3e7640 1 -- 172.21.15.50:0/2304721381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540317c0 con 0x7f7d5815a940 2023-08-10T10:40:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.136+0000 7f7d5d3e7640 1 -- 172.21.15.50:0/2304721381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54031920 con 0x7f7d5815a940 2023-08-10T10:40:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.136+0000 7f7d5d3e7640 1 -- 172.21.15.50:0/2304721381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54031cb0 con 0x7f7d5815a940 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.136+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2304721381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 msgr2=0x7f7d580aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.136+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2304721381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580aff10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7d580b3ba0 tx=0x7f7d5402b860 comp rx=0 tx=0).stop 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2304721381 shutdown_connections 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2304721381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d580b12c0 0x7f7d580b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2304721381 >> v2:172.21.15.117:3300/0 conn(0x7f7d5815f2b0 0x7f7d580b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2304721381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580aff10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2304721381 >> 172.21.15.50:0/2304721381 conn(0x7f7d5806ab80 msgr2=0x7f7d5806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2304721381 shutdown_connections 2023-08-10T10:40:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.137+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2304721381 wait complete. 2023-08-10T10:40:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.138+0000 7f7d5f3eb640 1 Processor -- start 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.139+0000 7f7d5f3eb640 1 -- start start 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.139+0000 7f7d5f3eb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 0x7f7d58149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5f3eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5f3eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d5815f2b0 0x7f7d580b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5f3eb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581f2130 con 0x7f7d5815a940 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5f3eb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581499b0 con 0x7f7d580b12c0 2023-08-10T10:40:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5f3eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58071280 con 0x7f7d5815f2b0 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48814/0 (socket says 172.21.15.50:48814) 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 -- 172.21.15.50:0/2896157409 learned_addr learned my addr 172.21.15.50:0/2896157409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 0x7f7d58149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 -- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d5815f2b0 msgr2=0x7f7d580b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5ebea640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d5815f2b0 0x7f7d580b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:45.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d5815f2b0 0x7f7d580b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 -- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 msgr2=0x7f7d58149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 0x7f7d58149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5dbe8640 1 -- 172.21.15.50:0/2896157409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540094d0 con 0x7f7d5815a940 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.140+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 0x7f7d58149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d5dbe8640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b410 tx=0x7f7d4800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48011830 con 0x7f7d5815a940 2023-08-10T10:40:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480119b0 con 0x7f7d5815a940 2023-08-10T10:40:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48011d60 con 0x7f7d5815a940 2023-08-10T10:40:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d58071560 con 0x7f7d5815a940 2023-08-10T10:40:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.141+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5814a120 con 0x7f7d5815a940 2023-08-10T10:40:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.142+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d580717a0 con 0x7f7d5815a940 2023-08-10T10:40:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.143+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d4801a400 con 0x7f7d5815a940 2023-08-10T10:40:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.144+0000 7f7d4effd640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 0x7f7d3c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.144+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d48089650 con 0x7f7d5815a940 2023-08-10T10:40:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.144+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 0x7f7d3c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.145+0000 7f7d5e3e9640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 0x7f7d3c06d110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:45.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.148+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7d580717a0 con 0x7f7d5815a940 2023-08-10T10:40:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.339+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7d580717a0 con 0x7f7d5815a940 2023-08-10T10:40:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.343+0000 7f7d4effd640 1 -- 172.21.15.50:0/2896157409 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+36986 (secure 0 0 0) 0x7f7d580717a0 con 0x7f7d5815a940 2023-08-10T10:40:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 52, 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:40:25.789277+0000", 2023-08-10T10:40:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:40:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:40:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:40:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:40:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:40:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:40:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:40:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:40:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "16", 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:40:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:40:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "19", 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:40:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "51", 2023-08-10T10:40:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:40:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "52", 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:40:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:40:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:40:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:40:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:40:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:40:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:40:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:40:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:40:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:40:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:40:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:40:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:40:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:40:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:40:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:40:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:40:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:40:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:40:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:40:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:40:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:45.547 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.345+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 msgr2=0x7f7d3c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.345+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 0x7f7d3c06d110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5403d040 comp rx=0 tx=0).stop 2023-08-10T10:40:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.345+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 msgr2=0x7f7d580afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.345+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b410 tx=0x7f7d4800b8d0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 shutdown_connections 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d5815f2b0 0x7f7d580b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d5815a940 0x7f7d580afe00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d3c06ac50 0x7f7d3c06d110 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 --2- 172.21.15.50:0/2896157409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d580b12c0 0x7f7d58149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 >> 172.21.15.50:0/2896157409 conn(0x7f7d5806ab80 msgr2=0x7f7d5806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 shutdown_connections 2023-08-10T10:40:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:45.346+0000 7f7d5f3eb640 1 -- 172.21.15.50:0/2896157409 wait complete. 2023-08-10T10:40:45.551 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:40:46.411 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:40:46.411+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-10T10:40:50.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:40:50.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.789+0000 7f478834e640 1 Processor -- start 2023-08-10T10:40:50.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.790+0000 7f478834e640 1 -- start start 2023-08-10T10:40:50.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f478834e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f47800ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f478834e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4780071c70 con 0x7f478015aa40 2023-08-10T10:40:50.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f478834e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800713d0 con 0x7f47800b0c60 2023-08-10T10:40:50.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f478834e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47800716b0 con 0x7f47800b3f30 2023-08-10T10:40:50.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f47860ea640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f478015aa40 0x7f47800b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49418/0 (socket says 172.21.15.50:49418) 2023-08-10T10:40:50.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.791+0000 7f47860ea640 1 -- 172.21.15.50:0/8396592 learned_addr learned my addr 172.21.15.50:0/8396592 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:50.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554910071 0 0) 0x7f4780071c70 con 0x7f478015aa40 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47868eb640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f47800ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c003520 con 0x7f478015aa40 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097634903 0 0) 0x7f476c003520 con 0x7f478015aa40 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 msgr2=0x7f47800ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f47800ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 >> v1:172.21.15.117:6789/0 conn(0x7f47800b0c60 legacy=0x7f47800c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780071990 con 0x7f478015aa40 2023-08-10T10:40:50.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f477c001670 con 0x7f478015aa40 2023-08-10T10:40:50.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 >> v1:172.21.15.50:6789/0 conn(0x7f478015aa40 legacy=0x7f47800b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f476c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c003fd0 0x7f476c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f476c004d00 0x7f476c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800716b0 con 0x7f476c004d00 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c00bbc0 con 0x7f476c003fd0 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.792+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c00bd80 con 0x7f47800b3f30 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f476c004d00 0x7f476c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47858e9640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c003fd0 0x7f476c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47860ea640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f476c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 -- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 msgr2=0x7f476c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b3f30 0x7f476c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 -- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c003fd0 msgr2=0x7f476c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c003fd0 0x7f476c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.793+0000 7f47868eb640 1 -- 172.21.15.50:0/8396592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c003520 con 0x7f476c004d00 2023-08-10T10:40:50.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.794+0000 7f47868eb640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f476c004d00 0x7f476c005180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4778007360 tx=0x7f476c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fe4a36517bbeda server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477802ccd0 con 0x7f476c004d00 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477802ce30 con 0x7f476c004d00 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f47850e8640 1 -- 172.21.15.50:0/8396592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778034660 con 0x7f476c004d00 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 -- 172.21.15.50:0/8396592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f476c004d00 msgr2=0x7f476c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 --2- 172.21.15.50:0/8396592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f476c004d00 0x7f476c005180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4778007360 tx=0x7f476c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f47868eb640 1 -- 172.21.15.50:0/8396592 reap_dead start 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 -- 172.21.15.50:0/8396592 shutdown_connections 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 -- 172.21.15.50:0/8396592 >> 172.21.15.50:0/8396592 conn(0x7f478006b590 msgr2=0x7f47800ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 -- 172.21.15.50:0/8396592 shutdown_connections 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.795+0000 7f478834e640 1 -- 172.21.15.50:0/8396592 wait complete. 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.797+0000 7f478834e640 1 Processor -- start 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.797+0000 7f478834e640 1 -- start start 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c004d00 0x7f478014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 0x7f4780158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800cd3c0 con 0x7f47800cca00 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800b2700 con 0x7f476c004d00 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.798+0000 7f478834e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478015c200 con 0x7f47800b1610 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48828/0 (socket says 172.21.15.50:48828) 2023-08-10T10:40:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 -- 172.21.15.50:0/795415979 learned_addr learned my addr 172.21.15.50:0/795415979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47860ea640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c004d00 0x7f478014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47858e9640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 0x7f4780158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 -- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 msgr2=0x7f4780158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 0x7f4780158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 -- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c004d00 msgr2=0x7f478014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c004d00 0x7f478014eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47868eb640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800b1b80 con 0x7f47800cca00 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.799+0000 7f47858e9640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 0x7f4780158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f47868eb640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4778002230 tx=0x7f4778004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477803e600 con 0x7f47800cca00 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477803e760 con 0x7f47800cca00 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477803eaf0 con 0x7f47800cca00 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47800b1e60 con 0x7f47800cca00 2023-08-10T10:40:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.800+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47800b2420 con 0x7f47800cca00 2023-08-10T10:40:50.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.801+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478015c3c0 con 0x7f47800cca00 2023-08-10T10:40:50.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.802+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f477803ec50 con 0x7f47800cca00 2023-08-10T10:40:50.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.803+0000 7f4776ffd640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 0x7f476406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.803+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47780abc10 con 0x7f47800cca00 2023-08-10T10:40:50.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.803+0000 7f47860ea640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 0x7f476406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.803+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f4764072da0 con 0x7f47800cca00 2023-08-10T10:40:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.804+0000 7f47860ea640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 0x7f476406d110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c90 tx=0x7f477c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:50.808+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4778039020 con 0x7f47800cca00 2023-08-10T10:40:51.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.004+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f478004e270 con 0x7f47800cca00 2023-08-10T10:40:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.008+0000 7f4776ffd640 1 -- 172.21.15.50:0/795415979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37126 (secure 0 0 0) 0x7f4778076b90 con 0x7f47800cca00 2023-08-10T10:40:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:51.009 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 55, 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:40:49.425332+0000", 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:40:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:40:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:40:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:40:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:40:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:40:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:40:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:40:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:40:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:40:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:51.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:51.059 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:40:51.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:51.063 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.064 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.065 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.066 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.067 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.069 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.071 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:51.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:40:51.073 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.079 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:40:51.081 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:40:51.083 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:40:51.084 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.086 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.087 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.087 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.087 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.087 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.087 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.096 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.097 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.098 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.099 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:40:51.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.102 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:40:51.105 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.106 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.107 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:51.108 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.109 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:40:51.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:40:51.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:51.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:40:51.118 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:51.119 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:40:51.129 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:51.130 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.131 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:40:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:40:51.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:40:51.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:40:51.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:40:51.140 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.141 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:51.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:51.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:51.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:51.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:51.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:40:51.151 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:51.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.153 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.154 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:40:51.155 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.156 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:51.157 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:40:51.162 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:51.163 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:40:51.164 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:40:51.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:40:51.167 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:40:51.168 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:40:51.168 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:40:51.168 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:40:51.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:51.168 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 msgr2=0x7f476406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 0x7f476406d110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c90 tx=0x7f477c009040 comp rx=0 tx=0).stop 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 msgr2=0x7f47800cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4778002230 tx=0x7f4778004ab0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 shutdown_connections 2023-08-10T10:40:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800cca00 0x7f47800cce80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47800b1610 0x7f4780158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f476406ac50 0x7f476406d110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 --2- 172.21.15.50:0/795415979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476c004d00 0x7f478014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 >> 172.21.15.50:0/795415979 conn(0x7f478006b590 msgr2=0x7f47801594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 shutdown_connections 2023-08-10T10:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.011+0000 7f478834e640 1 -- 172.21.15.50:0/795415979 wait complete. 2023-08-10T10:40:51.172 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-10T10:40:51.172 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:51.173 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:51.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:51.238 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-08-10T10:40:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-10T10:40:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:40:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:40:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.352647 s, 149 MB/s 2023-08-10T10:40:51.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:40:51.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:40:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.889+0000 7f00eee04640 1 Processor -- start 2023-08-10T10:40:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.889+0000 7f00eee04640 1 -- start start 2023-08-10T10:40:51.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.891+0000 7f00eee04640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00e815aaf0 0x7f00e80c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.891+0000 7f00eee04640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00e80b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.891+0000 7f00eee04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80b3a50 con 0x7f00e80b2140 2023-08-10T10:40:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.891+0000 7f00eee04640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80b45d0 con 0x7f00e815aaf0 2023-08-10T10:40:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.891+0000 7f00eee04640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b3d30 con 0x7f00e80ca8c0 2023-08-10T10:40:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00ed3a1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00e80b2140 0x7f00e80c95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49422/0 (socket says 172.21.15.50:49422) 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00ed3a1640 1 -- 172.21.15.50:0/1919960565 learned_addr learned my addr 172.21.15.50:0/1919960565 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00ecba0640 1 --2- 172.21.15.50:0/1919960565 >> v2:172.21.15.117:3300/0 conn(0x7f00e815aaf0 0x7f00e80c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e7fff640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00e80b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332632986 0 0) 0x7f00e80b3a50 con 0x7f00e80b2140 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003520 con 0x7f00e80b2140 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863640436 0 0) 0x7f00d8003520 con 0x7f00e80b2140 2023-08-10T10:40:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 msgr2=0x7f00e80b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00e80b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 >> v2:172.21.15.117:3300/0 conn(0x7f00e815aaf0 msgr2=0x7f00e80c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 --2- 172.21.15.50:0/1919960565 >> v2:172.21.15.117:3300/0 conn(0x7f00e815aaf0 0x7f00e80c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80b4010 con 0x7f00e80b2140 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.892+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f00e0001670 con 0x7f00e80b2140 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 >> v1:172.21.15.50:6789/0 conn(0x7f00e80b2140 legacy=0x7f00e80c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8003f60 0x7f00d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b45d0 con 0x7f00d8004d00 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b3d30 con 0x7f00d8003f60 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800fdc0 con 0x7f00e80ca8c0 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00ecba0640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00e7fff640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8003f60 0x7f00d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.893+0000 7f00ed3a1640 1 -- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 msgr2=0x7f00d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.894+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e80ca8c0 0x7f00d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.894+0000 7f00ed3a1640 1 -- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8003f60 msgr2=0x7f00d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.894+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8003f60 0x7f00d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.894+0000 7f00ed3a1640 1 -- 172.21.15.50:0/1919960565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8003520 con 0x7f00d8004d00 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.895+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c240 tx=0x7f00d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6f2be3e598bbc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.895+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e002cb00 con 0x7f00d8004d00 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.895+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e002cc60 con 0x7f00d8004d00 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.895+0000 7f00e77fe640 1 -- 172.21.15.50:0/1919960565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0005af0 con 0x7f00d8004d00 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 -- 172.21.15.50:0/1919960565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d8004d00 msgr2=0x7f00d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 --2- 172.21.15.50:0/1919960565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c240 tx=0x7f00d80057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00ed3a1640 1 -- 172.21.15.50:0/1919960565 reap_dead start 2023-08-10T10:40:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 -- 172.21.15.50:0/1919960565 shutdown_connections 2023-08-10T10:40:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 -- 172.21.15.50:0/1919960565 >> 172.21.15.50:0/1919960565 conn(0x7f00e80cb080 msgr2=0x7f00e80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 -- 172.21.15.50:0/1919960565 shutdown_connections 2023-08-10T10:40:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.896+0000 7f00eee04640 1 -- 172.21.15.50:0/1919960565 wait complete. 2023-08-10T10:40:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.898+0000 7f00eee04640 1 Processor -- start 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.898+0000 7f00eee04640 1 -- start start 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d8004d00 0x7f00e815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e8155fc0 0x7f00e8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8151990 con 0x7f00e80c3e80 2023-08-10T10:40:51.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8156420 con 0x7f00e8155fc0 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00eee04640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c46b0 con 0x7f00d8004d00 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00ed3a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00ed3a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48844/0 (socket says 172.21.15.50:48844) 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00ed3a1640 1 -- 172.21.15.50:0/3260170384 learned_addr learned my addr 172.21.15.50:0/3260170384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00ecba0640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d8004d00 0x7f00e815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.899+0000 7f00e7fff640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e8155fc0 0x7f00e8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 -- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d8004d00 msgr2=0x7f00e815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d8004d00 0x7f00e815dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 -- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e8155fc0 msgr2=0x7f00e8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e8155fc0 0x7f00e8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8155200 con 0x7f00e80c3e80 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00ed3a1640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c240 tx=0x7f00e0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e003c040 con 0x7f00e80c3e80 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0001630 con 0x7f00e80c3e80 2023-08-10T10:40:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0007270 con 0x7f00e80c3e80 2023-08-10T10:40:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.900+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e81554e0 con 0x7f00e80c3e80 2023-08-10T10:40:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.901+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e8155aa0 con 0x7f00e80c3e80 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.902+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e8066e30 con 0x7f00e80c3e80 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.903+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00e0032070 con 0x7f00e80c3e80 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.904+0000 7f00e57fa640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 0x7f00cc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.904+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00e00aa4c0 con 0x7f00e80c3e80 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.904+0000 7f00ecba0640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 0x7f00cc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.904+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f00cc072dd0 con 0x7f00e80c3e80 2023-08-10T10:40:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.905+0000 7f00ecba0640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 0x7f00cc06d140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00dc007520 tx=0x7f00dc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:51.908+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00e0046060 con 0x7f00e80c3e80 2023-08-10T10:40:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.100+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f00e80b3340 con 0x7f00e80c3e80 2023-08-10T10:40:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.102+0000 7f00e57fa640 1 -- 172.21.15.50:0/3260170384 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37126 (secure 0 0 0) 0x7f00e0046030 con 0x7f00e80c3e80 2023-08-10T10:40:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:52.103 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 55, 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:40:49.425332+0000", 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:40:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:40:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:40:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:40:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:40:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:40:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:40:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:40:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:40:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:40:52.108 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:40:52.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:40:52.108 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:40:52.109 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:40:52.109 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:40:52.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.109 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:40:52.110 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:40:52.110 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:40:52.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:52.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:52.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:52.111 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:52.111 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:52.112 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:52.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:52.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:52.113 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:52.113 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:52.113 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:52.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:52.114 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:40:52.114 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:40:52.114 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:40:52.114 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:40:52.115 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:40:52.115 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:52.115 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:52.115 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:52.116 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:52.116 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:52.116 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:52.116 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:52.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.117 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:52.117 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:52.117 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:40:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:40:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:40:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:40:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:40:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:40:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:40:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:40:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:40:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:40:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:40:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:40:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:40:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:40:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:40:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:40:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:40:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:40:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:40:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:40:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:40:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:40:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:40:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:40:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:40:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:40:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:40:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:40:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:40:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:40:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:40:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:40:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:40:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:40:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:40:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:40:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:40:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:40:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:40:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:40:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:40:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:40:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:40:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.267 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:52.269 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:52.270 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:40:52.271 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.272 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.273 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.274 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.275 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.277 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.278 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:52.279 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:40:52.281 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:52.282 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:40:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:40:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:40:52.285 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:40:52.286 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:40:52.287 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:40:52.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:52.287 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 msgr2=0x7f00cc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 0x7f00cc06d140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00dc007520 tx=0x7f00dc00b040 comp rx=0 tx=0).stop 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 msgr2=0x7f00e8158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c240 tx=0x7f00e0001a70 comp rx=0 tx=0).stop 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 shutdown_connections 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e80c3e80 0x7f00e8158370 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00cc06ac80 0x7f00cc06d140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e8155fc0 0x7f00e8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 --2- 172.21.15.50:0/3260170384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d8004d00 0x7f00e815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 >> 172.21.15.50:0/3260170384 conn(0x7f00e80cb080 msgr2=0x7f00e80cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 shutdown_connections 2023-08-10T10:40:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.105+0000 7f00eee04640 1 -- 172.21.15.50:0/3260170384 wait complete. 2023-08-10T10:40:52.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:40:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.528+0000 7fa62cd39640 1 Processor -- start 2023-08-10T10:40:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.528+0000 7fa62cd39640 1 -- start start 2023-08-10T10:40:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62cd39640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6280b0c60 0x7fa6280c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62cd39640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6280b3f30 0x7fa6280c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62cd39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa628071c70 con 0x7fa62815aa40 2023-08-10T10:40:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62cd39640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280713d0 con 0x7fa6280b3f30 2023-08-10T10:40:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62cd39640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280716b0 con 0x7fa6280b0c60 2023-08-10T10:40:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa626d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6280b3f30 0x7fa6280c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa62815aa40 0x7fa6280b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49430/0 (socket says 172.21.15.50:49430) 2023-08-10T10:40:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa626d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6280b3f30 0x7fa6280c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48850/0 (socket says 172.21.15.50:48850) 2023-08-10T10:40:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.530+0000 7fa62659c640 1 -- 172.21.15.50:0/2295577329 learned_addr learned my addr 172.21.15.50:0/2295577329 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa625d9b640 1 --2- 172.21.15.50:0/2295577329 >> v2:172.21.15.117:3300/0 conn(0x7fa6280b0c60 0x7fa6280c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa626d9d640 1 -- 172.21.15.50:0/2295577329 >> v2:172.21.15.117:3300/0 conn(0x7fa6280b0c60 msgr2=0x7fa6280c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa626d9d640 1 --2- 172.21.15.50:0/2295577329 >> v2:172.21.15.117:3300/0 conn(0x7fa6280b0c60 0x7fa6280c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa626d9d640 1 -- 172.21.15.50:0/2295577329 >> v1:172.21.15.50:6789/0 conn(0x7fa62815aa40 legacy=0x7fa6280b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa626d9d640 1 -- 172.21.15.50:0/2295577329 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628071990 con 0x7fa6280b3f30 2023-08-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.531+0000 7fa62559a640 1 -- 172.21.15.50:0/2295577329 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316047066 0 0) 0x7fa628071c70 con 0x7fa62815aa40 2023-08-10T10:40:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.532+0000 7fa626d9d640 1 --2- 172.21.15.50:0/2295577329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b3f30 0x7fa6280c9e60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa62815e6e0 tx=0x7fa62002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab88f991ad5055b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62559a640 1 -- 172.21.15.50:0/2295577329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62002cbe0 con 0x7fa6280b3f30 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62559a640 1 -- 172.21.15.50:0/2295577329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62002cd40 con 0x7fa6280b3f30 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62559a640 1 -- 172.21.15.50:0/2295577329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620034660 con 0x7fa6280b3f30 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 -- 172.21.15.50:0/2295577329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b3f30 msgr2=0x7fa6280c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2295577329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b3f30 0x7fa6280c9e60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa62815e6e0 tx=0x7fa62002be30 comp rx=0 tx=0).stop 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 -- 172.21.15.50:0/2295577329 shutdown_connections 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2295577329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b3f30 0x7fa6280c9e60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2295577329 >> v2:172.21.15.117:3300/0 conn(0x7fa6280b0c60 0x7fa6280c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 -- 172.21.15.50:0/2295577329 >> 172.21.15.50:0/2295577329 conn(0x7fa62806b590 msgr2=0x7fa6280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 -- 172.21.15.50:0/2295577329 shutdown_connections 2023-08-10T10:40:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.533+0000 7fa62cd39640 1 -- 172.21.15.50:0/2295577329 wait complete. 2023-08-10T10:40:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.535+0000 7fa62cd39640 1 Processor -- start 2023-08-10T10:40:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.535+0000 7fa62cd39640 1 -- start start 2023-08-10T10:40:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6280b3f30 0x7fa628152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62815aa40 0x7fa6281e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281e4470 con 0x7fa6280b0c60 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281e3eb0 con 0x7fa62815aa40 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.536+0000 7fa62cd39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281e4190 con 0x7fa6280b3f30 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48858/0 (socket says 172.21.15.50:48858) 2023-08-10T10:40:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 -- 172.21.15.50:0/2960510164 learned_addr learned my addr 172.21.15.50:0/2960510164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa625d9b640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6280b3f30 0x7fa628152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa626d9d640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62815aa40 0x7fa6281e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 -- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6280b3f30 msgr2=0x7fa628152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6280b3f30 0x7fa628152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 -- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62815aa40 msgr2=0x7fa6281e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62815aa40 0x7fa6281e33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009a70 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.537+0000 7fa62659c640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c430 tx=0x7fa61800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.538+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180074e0 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.538+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618007660 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.538+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618004a20 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.538+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6281540d0 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.538+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6281e51f0 con 0x7fa6280b0c60 2023-08-10T10:40:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.539+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62804e270 con 0x7fa6280b0c60 2023-08-10T10:40:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.540+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa618004b80 con 0x7fa6280b0c60 2023-08-10T10:40:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.541+0000 7fa616ffd640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 0x7fa60806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.542+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6180892e0 con 0x7fa6280b0c60 2023-08-10T10:40:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.542+0000 7fa625d9b640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 0x7fa60806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.542+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7fa608072da0 con 0x7fa6280b0c60 2023-08-10T10:40:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.543+0000 7fa625d9b640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 0x7fa60806d110 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa628153a30 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:52.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.546+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa618054380 con 0x7fa6280b0c60 2023-08-10T10:40:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.777+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6280cce20 con 0x7fa6280b0c60 2023-08-10T10:40:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.779+0000 7fa616ffd640 1 -- 172.21.15.50:0/2960510164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fa6180579a0 con 0x7fa6280b0c60 2023-08-10T10:40:52.780 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:52.780 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:40:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:40:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.781+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 msgr2=0x7fa60806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 0x7fa60806d110 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa628153a30 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2023-08-10T10:40:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 msgr2=0x7fa628151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c430 tx=0x7fa61800c8f0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 shutdown_connections 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa60806ac50 0x7fa60806d110 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62815aa40 0x7fa6281e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6280b3f30 0x7fa628152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 --2- 172.21.15.50:0/2960510164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6280b0c60 0x7fa628151c00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 >> 172.21.15.50:0/2960510164 conn(0x7fa62806b590 msgr2=0x7fa6280c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 shutdown_connections 2023-08-10T10:40:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:52.782+0000 7fa62cd39640 1 -- 172.21.15.50:0/2960510164 wait complete. 2023-08-10T10:40:52.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:40:53.039 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.233263878999999,"mdsmap_epoch":24,"osdmap_epoch":55,"osdmap_epoch_barrier":55,"uptime":34.032352199000002} 2023-08-10T10:40:53.040 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5634, "mdsmap_epoch": 24, "osdmap_epoch": 55, "osdmap_epoch_barrier": 55, "rank_uptime": 28.233263879, "state": "up:active", "uptime": 34.032352199, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:40:53.040 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:40:53.041 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:40:53.041 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:40:53.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:53.095 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-08-10T10:40:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:dd: failed to open 'small_file_1': Permission denied 2023-08-10T10:40:53.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:40:53.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:53.156 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-10T10:40:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:40:53.221 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-10T10:40:53.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:40:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.528+0000 7f470fe56640 1 Processor -- start 2023-08-10T10:40:53.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.528+0000 7f470fe56640 1 -- start start 2023-08-10T10:40:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f470815cd60 0x7f4708160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 0x7f47080cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47080cddb0 0x7f47080696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080ce240 con 0x7f470815cd60 2023-08-10T10:40:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080b5bd0 con 0x7f47080cddb0 2023-08-10T10:40:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.529+0000 7f470fe56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4708161180 con 0x7f47080b8430 2023-08-10T10:40:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f470815cd60 0x7f4708160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f470815cd60 0x7f4708160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48862/0 (socket says 172.21.15.50:48862) 2023-08-10T10:40:53.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 -- 172.21.15.50:0/1910830735 learned_addr learned my addr 172.21.15.50:0/1910830735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:53.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 -- 172.21.15.50:0/1910830735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 msgr2=0x7f47080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470d3f1640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 0x7f47080cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470e3f3640 1 --2- 172.21.15.50:0/1910830735 >> v2:172.21.15.117:3300/0 conn(0x7f47080cddb0 0x7f47080696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 0x7f47080cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 -- 172.21.15.50:0/1910830735 >> v2:172.21.15.117:3300/0 conn(0x7f47080cddb0 msgr2=0x7f47080696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 --2- 172.21.15.50:0/1910830735 >> v2:172.21.15.117:3300/0 conn(0x7f47080cddb0 0x7f47080696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470dbf2640 1 -- 172.21.15.50:0/1910830735 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708161460 con 0x7f470815cd60 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.530+0000 7f470d3f1640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 0x7f47080cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.532+0000 7f470dbf2640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f470815cd60 0x7f4708160930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f47080b5490 tx=0x7f46f802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85822a7e338c6d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.532+0000 7f470cbf0640 1 -- 172.21.15.50:0/1910830735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f802cb00 con 0x7f470815cd60 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.532+0000 7f470cbf0640 1 -- 172.21.15.50:0/1910830735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f802cc60 con 0x7f470815cd60 2023-08-10T10:40:53.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.532+0000 7f470cbf0640 1 -- 172.21.15.50:0/1910830735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80343f0 con 0x7f470815cd60 2023-08-10T10:40:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 -- 172.21.15.50:0/1910830735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f470815cd60 msgr2=0x7f4708160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f470815cd60 0x7f4708160930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f47080b5490 tx=0x7f46f802bf60 comp rx=0 tx=0).stop 2023-08-10T10:40:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 -- 172.21.15.50:0/1910830735 shutdown_connections 2023-08-10T10:40:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 --2- 172.21.15.50:0/1910830735 >> v2:172.21.15.117:3300/0 conn(0x7f47080cddb0 0x7f47080696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47080b8430 0x7f47080cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 --2- 172.21.15.50:0/1910830735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f470815cd60 0x7f4708160930 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 -- 172.21.15.50:0/1910830735 >> 172.21.15.50:0/1910830735 conn(0x7f47080d2ac0 msgr2=0x7f47080d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 -- 172.21.15.50:0/1910830735 shutdown_connections 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.533+0000 7f470fe56640 1 -- 172.21.15.50:0/1910830735 wait complete. 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.535+0000 7f470fe56640 1 Processor -- start 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.535+0000 7f470fe56640 1 -- start start 2023-08-10T10:40:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 0x7f47081f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f470815cd60 0x7f47080cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c9fd0 con 0x7f47080cddb0 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47081f2980 con 0x7f47080b8430 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470fe56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b7560 con 0x7f470815cd60 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470d3f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470d3f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48874/0 (socket says 172.21.15.50:48874) 2023-08-10T10:40:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470d3f1640 1 -- 172.21.15.50:0/836387944 learned_addr learned my addr 172.21.15.50:0/836387944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.536+0000 7f470e3f3640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f470815cd60 0x7f47080cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470dbf2640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 0x7f47081f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 -- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f470815cd60 msgr2=0x7f47080cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f470815cd60 0x7f47080cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 -- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 msgr2=0x7f47081f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 0x7f47081f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009b30 con 0x7f47080cddb0 2023-08-10T10:40:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470dbf2640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 0x7f47081f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:40:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470d3f1640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7f0 tx=0x7f46fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc007820 con 0x7f47080cddb0 2023-08-10T10:40:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc007980 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc007cf0 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.537+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080ca220 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.538+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47080ca7e0 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.539+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470804e270 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.540+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46fc0113f0 con 0x7f47080cddb0 2023-08-10T10:40:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.541+0000 7f47067fc640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 0x7f46f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.541+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46fc089820 con 0x7f47080cddb0 2023-08-10T10:40:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.541+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f46f4072da0 con 0x7f47080cddb0 2023-08-10T10:40:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.541+0000 7f470dbf2640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 0x7f46f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.542+0000 7f470dbf2640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 0x7f46f406d110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f46f8035000 tx=0x7f46f8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.546+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f46fc0548d0 con 0x7f47080cddb0 2023-08-10T10:40:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.738+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f47080d3940 con 0x7f47080cddb0 2023-08-10T10:40:53.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.741+0000 7f47067fc640 1 -- 172.21.15.50:0/836387944 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37126 (secure 0 0 0) 0x7f46fc01f070 con 0x7f47080cddb0 2023-08-10T10:40:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:53.743 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 55, 2023-08-10T10:40:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:40:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:40:49.425332+0000", 2023-08-10T10:40:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:40:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:40:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:40:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:40:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:40:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:40:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:40:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:40:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:40:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:40:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:40:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:40:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:40:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:40:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:40:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:40:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:40:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:40:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:40:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:40:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:40:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:40:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:40:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:40:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:40:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:40:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:40:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:40:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:40:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:40:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:40:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:40:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:40:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:40:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:40:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:40:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:40:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:40:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:40:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:40:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:40:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:40:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:40:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:40:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:40:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.875 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:53.876 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:53.877 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.879 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:53.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:40:53.883 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.884 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.884 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.884 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:53.884 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:40:53.886 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:40:53.887 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:40:53.887 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:53.887 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:53.887 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:53.887 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:53.888 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.890 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:53.890 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.892 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.893 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.895 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:53.895 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.895 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:40:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.897 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:53.897 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.897 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.899 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:40:53.900 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:53.900 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:53.900 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:40:53.901 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:53.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.902 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:53.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:40:53.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:40:53.903 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:40:53.903 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:40:53.903 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:40:53.903 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:40:53.904 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:40:53.904 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:40:53.904 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:40:53.904 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:40:53.905 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:40:53.905 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:40:53.905 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:40:53.905 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:40:53.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:53.906 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:40:53.906 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:40:53.907 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:40:53.907 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:40:53.907 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:40:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:40:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:40:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:40:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:40:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:40:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:40:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:53.909 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.743+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 msgr2=0x7f46f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.743+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 0x7f46f406d110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f46f8035000 tx=0x7f46f8030000 comp rx=0 tx=0).stop 2023-08-10T10:40:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.743+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 msgr2=0x7f47081f5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.743+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7f0 tx=0x7f46fc00ccb0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 shutdown_connections 2023-08-10T10:40:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f470815cd60 0x7f47080cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47080cddb0 0x7f47081f5140 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f46f406ac50 0x7f46f406d110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 --2- 172.21.15.50:0/836387944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47080b8430 0x7f47081f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 >> 172.21.15.50:0/836387944 conn(0x7f47080d2ac0 msgr2=0x7f47080b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 shutdown_connections 2023-08-10T10:40:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:53.744+0000 7f470fe56640 1 -- 172.21.15.50:0/836387944 wait complete. 2023-08-10T10:40:53.913 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:40:56.238 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:40:56.237+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-08-10T10:40:58.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:40:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.153+0000 7fc34acd7640 1 Processor -- start 2023-08-10T10:40:59.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.153+0000 7fc34acd7640 1 -- start start 2023-08-10T10:40:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc34acd7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3440b0620 0x7fc3440b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc34acd7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3440b1f10 con 0x7fc34415a940 2023-08-10T10:40:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc34acd7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34415e7d0 con 0x7fc34415f2b0 2023-08-10T10:40:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc34acd7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3440b21f0 con 0x7fc3440b0620 2023-08-10T10:40:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc349cd5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc34415a940 0x7fc3440aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43504/0 (socket says 172.21.15.50:43504) 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.155+0000 7fc349cd5640 1 -- 172.21.15.50:0/3106030436 learned_addr learned my addr 172.21.15.50:0/3106030436 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc3494d4640 1 --2- 172.21.15.50:0/3106030436 >> v2:172.21.15.117:3300/0 conn(0x7fc3440b0620 0x7fc3440b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743434788 0 0) 0x7fc3440b1f10 con 0x7fc34415a940 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc330003520 con 0x7fc34415a940 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853723752 0 0) 0x7fc330003520 con 0x7fc34415a940 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 >> v2:172.21.15.117:3300/0 conn(0x7fc3440b0620 msgr2=0x7fc3440b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 --2- 172.21.15.50:0/3106030436 >> v2:172.21.15.117:3300/0 conn(0x7fc3440b0620 0x7fc3440b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 >> v1:172.21.15.117:6789/0 conn(0x7fc34415f2b0 legacy=0x7fc3440ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34415eab0 con 0x7fc34415a940 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fc340001670 con 0x7fc34415a940 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 >> v1:172.21.15.50:6789/0 conn(0x7fc34415a940 legacy=0x7fc3440aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc330003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3300047c0 0x7fc330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300051f0 0x7fc33000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33000c120 con 0x7fc3300039e0 2023-08-10T10:40:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33000c290 con 0x7fc3300051f0 2023-08-10T10:40:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.156+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33000c450 con 0x7fc3300047c0 2023-08-10T10:40:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc330003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 -- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3300047c0 msgr2=0x7fc330004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3300047c0 0x7fc330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc34a4d6640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300051f0 0x7fc33000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 -- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300051f0 msgr2=0x7fc33000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:40:59.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300051f0 0x7fc33000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc349cd5640 1 -- 172.21.15.50:0/3106030436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330003520 con 0x7fc3300039e0 2023-08-10T10:40:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.157+0000 7fc34a4d6640 1 -- 172.21.15.50:0/3106030436 reap_dead start 2023-08-10T10:40:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.158+0000 7fc349cd5640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc330003e00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c240 tx=0x7fc3300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeda25582c35c8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340005ad0 con 0x7fc3300039e0 2023-08-10T10:40:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc340005c30 con 0x7fc3300039e0 2023-08-10T10:40:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc348cd3640 1 -- 172.21.15.50:0/3106030436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002ca50 con 0x7fc3300039e0 2023-08-10T10:40:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 -- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 msgr2=0x7fc330003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc330003e00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c240 tx=0x7fc3300057f0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 -- 172.21.15.50:0/3106030436 shutdown_connections 2023-08-10T10:40:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 --2- 172.21.15.50:0/3106030436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc330003e00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 -- 172.21.15.50:0/3106030436 >> 172.21.15.50:0/3106030436 conn(0x7fc34406ab80 msgr2=0x7fc34406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 -- 172.21.15.50:0/3106030436 shutdown_connections 2023-08-10T10:40:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.159+0000 7fc34acd7640 1 -- 172.21.15.50:0/3106030436 wait complete. 2023-08-10T10:40:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.162+0000 7fc34acd7640 1 Processor -- start 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.162+0000 7fc34acd7640 1 -- start start 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406e7b0 0x7fc34406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3441f0030 0x7fc3441f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441588b0 con 0x7fc3300039e0 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406ef20 con 0x7fc34406e7b0 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc34acd7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406f200 con 0x7fc3441f0030 2023-08-10T10:40:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc349cd5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc349cd5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49204/0 (socket says 172.21.15.50:49204) 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc349cd5640 1 -- 172.21.15.50:0/2687950258 learned_addr learned my addr 172.21.15.50:0/2687950258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.164+0000 7fc3494d4640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406e7b0 0x7fc34406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc34a4d6640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3441f0030 0x7fc3441f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 -- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3441f0030 msgr2=0x7fc3441f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3441f0030 0x7fc3441f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 -- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406e7b0 msgr2=0x7fc34406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406e7b0 0x7fc34406ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34406f4e0 con 0x7fc3300039e0 2023-08-10T10:40:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc349cd5640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc340001930 tx=0x7fc34002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34003c040 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34002cce0 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.165+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340007270 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.166+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34406f7c0 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.166+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34406ec30 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.167+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3440cf5e0 con 0x7fc3300039e0 2023-08-10T10:40:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.168+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc340032070 con 0x7fc3300039e0 2023-08-10T10:40:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.169+0000 7fc33a7fc640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 0x7fc32806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.169+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3400aabd0 con 0x7fc3300039e0 2023-08-10T10:40:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.169+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=58}) v3 -- 0x7fc328072da0 con 0x7fc3300039e0 2023-08-10T10:40:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.169+0000 7fc3494d4640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 0x7fc32806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.170+0000 7fc3494d4640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 0x7fc32806d110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3440c9d20 tx=0x7fc334008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:59.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.174+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc340075be0 con 0x7fc3300039e0 2023-08-10T10:40:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.369+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc344066e30 con 0x7fc3300039e0 2023-08-10T10:40:59.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.371+0000 7fc33a7fc640 1 -- 172.21.15.50:0/2687950258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+37054 (secure 0 0 0) 0x7fc340079200 con 0x7fc3300039e0 2023-08-10T10:40:59.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 57, 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:40:57.406947+0000", 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:40:59.373 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:40:59.374 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:40:59.375 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:40:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:59.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:59.378 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:40:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:59.380 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:59.381 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:59.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:59.383 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:59.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:59.385 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:40:59.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:40:59.387 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:59.389 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:59.390 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:59.391 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.392 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:59.393 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:59.394 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:59.396 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:59.397 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:40:59.398 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:59.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:59.401 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:59.401 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:59.401 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:59.401 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:40:59.402 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:59.403 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:59.404 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:59.405 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:59.406 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:59.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:59.408 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:40:59.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:40:59.410 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:59.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.412 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:40:59.412 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:40:59.413 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:40:59.414 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:40:59.415 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "53", 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:40:59.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:40:59.417 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:40:59.418 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:40:59.419 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:40:59.420 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:40:59.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:40:59.421 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:40:59.421 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:40:59.421 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:40:59.422 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:40:59.422 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:40:59.422 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:40:59.422 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:40:59.423 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:40:59.423 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:40:59.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.423 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:40:59.424 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:40:59.424 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:40:59.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.425 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:40:59.425 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:40:59.425 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:40:59.426 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:40:59.426 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:40:59.426 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:40:59.426 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:40:59.427 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:40:59.427 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:40:59.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.428 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:59.428 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:40:59.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.429 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:59.429 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.429 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.429 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.430 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.430 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.430 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.430 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.430 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.431 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:40:59.433 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:40:59.438 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:40:59.439 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:40:59.439 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:40:59.439 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.439 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.439 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.440 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:40:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:40:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:40:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:40:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:40:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:40:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:40:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:40:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:40:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:40:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:40:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:40:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:40:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:40:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:40:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:40:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:40:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:40:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:40:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:40:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:40:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:40:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:40:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:40:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:40:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:40:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:40:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:40:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:40:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:40:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:40:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:40:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:40:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:40:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:40:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:40:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:40:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:40:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:40:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:40:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:40:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:40:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:40:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:40:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:40:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:40:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:40:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:40:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:40:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:40:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:40:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:40:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:40:59.546 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:40:59.546 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:40:59.546 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:40:59.546 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:40:59.547 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:40:59.547 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:40:59.547 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:40:59.547 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:40:59.548 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:40:59.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:40:59.548 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:40:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 msgr2=0x7fc32806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 0x7fc32806d110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3440c9d20 tx=0x7fc334008040 comp rx=0 tx=0).stop 2023-08-10T10:40:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 msgr2=0x7fc3440712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc340001930 tx=0x7fc34002e070 comp rx=0 tx=0).stop 2023-08-10T10:40:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 shutdown_connections 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3441f0030 0x7fc3441f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc32806ac50 0x7fc32806d110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406e7b0 0x7fc34406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 --2- 172.21.15.50:0/2687950258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3300039e0 0x7fc3440712b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 >> 172.21.15.50:0/2687950258 conn(0x7fc34406ab80 msgr2=0x7fc3440cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 shutdown_connections 2023-08-10T10:40:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:40:59.374+0000 7fc34acd7640 1 -- 172.21.15.50:0/2687950258 wait complete. 2023-08-10T10:40:59.552 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:41:04.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:41:04.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.804+0000 7f5f874ad640 1 Processor -- start 2023-08-10T10:41:04.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.804+0000 7f5f874ad640 1 -- start start 2023-08-10T10:41:04.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f874ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 0x7f5f800b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f874ad640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f800b1f10 con 0x7f5f8015f2b0 2023-08-10T10:41:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f874ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8015e7d0 con 0x7f5f8015a940 2023-08-10T10:41:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f874ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800b21f0 con 0x7f5f800b0620 2023-08-10T10:41:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f86cac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f8015f2b0 0x7f5f800ca740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43510/0 (socket says 172.21.15.50:43510) 2023-08-10T10:41:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f86cac640 1 -- 172.21.15.50:0/140530820 learned_addr learned my addr 172.21.15.50:0/140530820 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.806+0000 7f5f85caa640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 0x7f5f800b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750787774 0 0) 0x7f5f800b1f10 con 0x7f5f8015f2b0 2023-08-10T10:41:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f6c003520 con 0x7f5f8015f2b0 2023-08-10T10:41:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2838824297 0 0) 0x7f5f6c003520 con 0x7f5f8015f2b0 2023-08-10T10:41:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 msgr2=0x7f5f800b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 0x7f5f800b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 >> v1:172.21.15.117:6789/0 conn(0x7f5f8015a940 legacy=0x7f5f800aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8015eab0 con 0x7f5f8015f2b0 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5f780019f0 con 0x7f5f8015f2b0 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 >> v1:172.21.15.50:6789/0 conn(0x7f5f8015f2b0 legacy=0x7f5f800ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f6c003a10 0x7f5f6c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c0047c0 0x7f5f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 0x7f5f6c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c00bb40 con 0x7f5f6c003a10 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c00bcb0 con 0x7f5f6c0047c0 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.807+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c00be70 con 0x7f5f800b0620 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f6c003a10 0x7f5f6c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 -- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 msgr2=0x7f5f6c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800b0620 0x7f5f6c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 -- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c0047c0 msgr2=0x7f5f6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c0047c0 0x7f5f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.808+0000 7f5f864ab640 1 -- 172.21.15.50:0/140530820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c003520 con 0x7f5f6c003a10 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.809+0000 7f5f864ab640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f6c003a10 0x7f5f6c003e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001720 tx=0x7f5f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60188c8c573e185 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0052d0 con 0x7f5f6c003a10 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c02e050 con 0x7f5f6c003a10 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f854a9640 1 -- 172.21.15.50:0/140530820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0035f0 con 0x7f5f6c003a10 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f874ad640 1 -- 172.21.15.50:0/140530820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f6c003a10 msgr2=0x7f5f6c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f874ad640 1 --2- 172.21.15.50:0/140530820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f6c003a10 0x7f5f6c003e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001720 tx=0x7f5f6c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.810+0000 7f5f86cac640 1 -- 172.21.15.50:0/140530820 reap_dead start 2023-08-10T10:41:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.811+0000 7f5f874ad640 1 -- 172.21.15.50:0/140530820 shutdown_connections 2023-08-10T10:41:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.811+0000 7f5f874ad640 1 -- 172.21.15.50:0/140530820 >> 172.21.15.50:0/140530820 conn(0x7f5f8006ab80 msgr2=0x7f5f8006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.811+0000 7f5f874ad640 1 -- 172.21.15.50:0/140530820 shutdown_connections 2023-08-10T10:41:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.811+0000 7f5f874ad640 1 -- 172.21.15.50:0/140530820 wait complete. 2023-08-10T10:41:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.813+0000 7f5f874ad640 1 Processor -- start 2023-08-10T10:41:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.813+0000 7f5f874ad640 1 -- start start 2023-08-10T10:41:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.814+0000 7f5f874ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c003a10 0x7f5f8015df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.814+0000 7f5f874ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.814+0000 7f5f874ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800cb000 0x7f5f800cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f874ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8014bd00 con 0x7f5f8014b360 2023-08-10T10:41:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f874ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800cb9c0 con 0x7f5f6c003a10 2023-08-10T10:41:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f874ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8014f6a0 con 0x7f5f800cb000 2023-08-10T10:41:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49218/0 (socket says 172.21.15.50:49218) 2023-08-10T10:41:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 -- 172.21.15.50:0/2031428720 learned_addr learned my addr 172.21.15.50:0/2031428720 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f864ab640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c003a10 0x7f5f8015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 -- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800cb000 msgr2=0x7f5f800cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800cb000 0x7f5f800cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 -- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c003a10 msgr2=0x7f5f8015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c003a10 0x7f5f8015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.815+0000 7f5f85caa640 1 -- 172.21.15.50:0/2031428720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8014bf00 con 0x7f5f8014b360 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f85caa640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e7a0 tx=0x7f5f7000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000eeb0 con 0x7f5f8014b360 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000c940 con 0x7f5f8014b360 2023-08-10T10:41:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000cd10 con 0x7f5f8014b360 2023-08-10T10:41:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8014c1e0 con 0x7f5f8014b360 2023-08-10T10:41:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.816+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f801495e0 con 0x7f5f8014b360 2023-08-10T10:41:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.818+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80066e30 con 0x7f5f8014b360 2023-08-10T10:41:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.819+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f70013470 con 0x7f5f8014b360 2023-08-10T10:41:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.820+0000 7f5f76ffd640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 0x7f5f6406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.820+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f700894e0 con 0x7f5f8014b360 2023-08-10T10:41:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.820+0000 7f5f864ab640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 0x7f5f6406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.821+0000 7f5f864ab640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 0x7f5f6406d110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c033000 tx=0x7f5f7c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:04.825+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f70054590 con 0x7f5f8014b360 2023-08-10T10:41:05.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.019+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5f800c8b50 con 0x7f5f8014b360 2023-08-10T10:41:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.021+0000 7f5f76ffd640 1 -- 172.21.15.50:0/2031428720 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+36986 (secure 0 0 0) 0x7f5f70057bb0 con 0x7f5f8014b360 2023-08-10T10:41:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:05.022 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:41:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 59, 2023-08-10T10:41:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:41:00.440748+0000", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:41:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:41:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:41:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:41:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:41:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:41:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:41:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:41:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:41:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:41:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:41:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:41:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:41:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:41:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:41:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:41:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:41:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:41:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:41:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:41:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:41:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:41:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:41:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:41:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:41:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:41:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:41:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:41:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:41:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:41:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:41:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:41:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:41:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:41:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:41:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:41:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:41:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:41:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:41:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.169 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:41:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.023+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 msgr2=0x7f5f6406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.023+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 0x7f5f6406d110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c033000 tx=0x7f5f7c009030 comp rx=0 tx=0).stop 2023-08-10T10:41:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.023+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 msgr2=0x7f5f8014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.023+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e7a0 tx=0x7f5f7000ec60 comp rx=0 tx=0).stop 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 shutdown_connections 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f800cb000 0x7f5f800cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f8014b360 0x7f5f8014b7c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f6406ac50 0x7f5f6406d110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 --2- 172.21.15.50:0/2031428720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6c003a10 0x7f5f8015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 >> 172.21.15.50:0/2031428720 conn(0x7f5f8006ab80 msgr2=0x7f5f800ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 shutdown_connections 2023-08-10T10:41:05.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.024+0000 7f5f874ad640 1 -- 172.21.15.50:0/2031428720 wait complete. 2023-08-10T10:41:05.173 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-10T10:41:05.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:41:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.411+0000 7f34f759e640 1 Processor -- start 2023-08-10T10:41:05.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.412+0000 7f34f759e640 1 -- start start 2023-08-10T10:41:05.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.413+0000 7f34f759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.413+0000 7f34f759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.413+0000 7f34f759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80cc5a0 con 0x7f34f8159830 2023-08-10T10:41:05.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.413+0000 7f34f759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80b4170 con 0x7f34f80c9d00 2023-08-10T10:41:05.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.413+0000 7f34f759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815d720 con 0x7f34f80cd290 2023-08-10T10:41:05.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.414+0000 7f34f6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.414+0000 7f34effff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.414+0000 7f34effff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:58896/0 (socket says 172.21.15.50:58896) 2023-08-10T10:41:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.414+0000 7f34effff640 1 -- 172.21.15.50:0/1956923678 learned_addr learned my addr 172.21.15.50:0/1956923678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.415+0000 7f34f6d9d640 1 -- 172.21.15.50:0/1956923678 >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 msgr2=0x7f34f80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.415+0000 7f34f6d9d640 1 --2- 172.21.15.50:0/1956923678 >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.415+0000 7f34f6d9d640 1 -- 172.21.15.50:0/1956923678 >> v1:172.21.15.117:6789/0 conn(0x7f34f8159830 legacy=0x7f34f815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.415+0000 7f34f6d9d640 1 -- 172.21.15.50:0/1956923678 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80cdc20 con 0x7f34f80cd290 2023-08-10T10:41:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.415+0000 7f34effff640 1 --2- 172.21.15.50:0/1956923678 >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:05.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.416+0000 7f34f6d9d640 1 --2- 172.21.15.50:0/1956923678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80cd6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009d90 tx=0x7f34f002e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c95aeff5bd175c7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:05.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.416+0000 7f34f5d9b640 1 -- 172.21.15.50:0/1956923678 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f002ee70 con 0x7f34f80cd290 2023-08-10T10:41:05.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.416+0000 7f34f5d9b640 1 -- 172.21.15.50:0/1956923678 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0036440 con 0x7f34f80cd290 2023-08-10T10:41:05.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f5d9b640 1 -- 172.21.15.50:0/1956923678 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00367d0 con 0x7f34f80cd290 2023-08-10T10:41:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 -- 172.21.15.50:0/1956923678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 msgr2=0x7f34f80cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 --2- 172.21.15.50:0/1956923678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80cd6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009d90 tx=0x7f34f002e0c0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 -- 172.21.15.50:0/1956923678 shutdown_connections 2023-08-10T10:41:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 --2- 172.21.15.50:0/1956923678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80cd6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 --2- 172.21.15.50:0/1956923678 >> v2:172.21.15.117:3300/0 conn(0x7f34f80c9d00 0x7f34f80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 -- 172.21.15.50:0/1956923678 >> 172.21.15.50:0/1956923678 conn(0x7f34f806ab80 msgr2=0x7f34f806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 -- 172.21.15.50:0/1956923678 shutdown_connections 2023-08-10T10:41:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.417+0000 7f34f759e640 1 -- 172.21.15.50:0/1956923678 wait complete. 2023-08-10T10:41:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.419+0000 7f34f759e640 1 Processor -- start 2023-08-10T10:41:05.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.419+0000 7f34f759e640 1 -- start start 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 0x7f34f80c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c1de0 con 0x7f34f80c9d00 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80c8790 con 0x7f34f8159830 2023-08-10T10:41:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815af40 con 0x7f34f80cd290 2023-08-10T10:41:05.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.420+0000 7f34f659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47812/0 (socket says 172.21.15.50:47812) 2023-08-10T10:41:05.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 -- 172.21.15.50:0/1920026020 learned_addr learned my addr 172.21.15.50:0/1920026020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:05.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34effff640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f6d9d640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 0x7f34f80c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 -- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 msgr2=0x7f34f80c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 -- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 msgr2=0x7f34f80c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 0x7f34f80c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 -- 172.21.15.50:0/1920026020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00094d0 con 0x7f34f80c9d00 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f6d9d640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 0x7f34f80c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.421+0000 7f34f659c640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c400 tx=0x7f34e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.422+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80052d0 con 0x7f34f80c9d00 2023-08-10T10:41:05.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.422+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8005430 con 0x7f34f80c9d00 2023-08-10T10:41:05.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.422+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8003830 con 0x7f34f80c9d00 2023-08-10T10:41:05.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.422+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f0009a70 con 0x7f34f80c9d00 2023-08-10T10:41:05.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.422+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8071460 con 0x7f34f80c9d00 2023-08-10T10:41:05.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.423+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8066e30 con 0x7f34f80c9d00 2023-08-10T10:41:05.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.424+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34e8003990 con 0x7f34f80c9d00 2023-08-10T10:41:05.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.425+0000 7f34eeffd640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 0x7f34d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:05.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.425+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34e8088a60 con 0x7f34f80c9d00 2023-08-10T10:41:05.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.426+0000 7f34effff640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 0x7f34d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:05.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.426+0000 7f34effff640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 0x7f34d806d110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34f80cf2b0 tx=0x7f34e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.429+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f34e8053b00 con 0x7f34f80c9d00 2023-08-10T10:41:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.623+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f34f80cd070 con 0x7f34f80c9d00 2023-08-10T10:41:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.627+0000 7f34eeffd640 1 -- 172.21.15.50:0/1920026020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+36986 (secure 0 0 0) 0x7f34e8057120 con 0x7f34f80c9d00 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 59, 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:41:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:41:00.440748+0000", 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:41:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:41:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:41:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:41:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 8, 2023-08-10T10:41:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:41:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:41:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:41:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:41:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:41:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:41:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:41:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:41:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:41:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 7, 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:41:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:22.656712+0000", 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:41:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:41:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:41:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:41:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:41:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:41:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:41:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:41:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:41:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:41:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:41:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:41:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:41:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:41:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:41:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 8, 2023-08-10T10:41:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:41:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:40:23.288053+0000", 2023-08-10T10:41:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:41:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:41:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:41:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:41:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:41:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:41:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:41:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:41:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:41:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:41:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:41:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:41:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:41:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:41:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:41:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:41:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:41:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:41:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:41:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:41:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:41:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:41:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:41:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:41:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "59", 2023-08-10T10:41:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:41:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:41:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:41:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:41:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:41:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:41:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:41:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:41:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:41:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:41:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:41:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:41:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:41:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:41:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:41:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:41:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:41:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:41:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.8799999952316284, 2023-08-10T10:41:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.8799999952316284, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:41:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:41:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:41:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:41:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:41:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:41:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:41:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:41:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:41:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:41:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:41:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:41:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:41:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:41:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:41:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:41:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:41:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:41:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:41:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:41:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:41:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:41:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:41:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:41:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:41:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:41:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:41:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:41:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:41:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:41:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:41:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:41:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:41:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 50, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:41:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:41:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:41:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:41:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:41:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:41:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:41:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:41:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:41:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:41:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:41:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.812 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:41:05.813 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.813 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.813 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.813 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:41:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:41:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:41:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:41:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:41:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:41:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:41:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:41:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:05.824 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 msgr2=0x7f34d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 0x7f34d806d110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34f80cf2b0 tx=0x7f34e0008040 comp rx=0 tx=0).stop 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 msgr2=0x7f34f806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c400 tx=0x7f34e800c8c0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 shutdown_connections 2023-08-10T10:41:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34d806ac50 0x7f34d806d110 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34f8159830 0x7f34f80c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34f80cd290 0x7f34f80c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 --2- 172.21.15.50:0/1920026020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f80c9d00 0x7f34f806f6d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.630+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 >> 172.21.15.50:0/1920026020 conn(0x7f34f806ab80 msgr2=0x7f34f80b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.631+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 shutdown_connections 2023-08-10T10:41:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:05.631+0000 7f34f759e640 1 -- 172.21.15.50:0/1920026020 wait complete. 2023-08-10T10:41:05.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.064+0000 7f8792abf640 1 Processor -- start 2023-08-10T10:41:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.065+0000 7f8792abf640 1 -- start start 2023-08-10T10:41:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f8792abf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f878c0c1af0 0x7f878c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f8792abf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f8792abf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c06f6f0 con 0x7f878c0b2d70 2023-08-10T10:41:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f8792abf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c1617f0 con 0x7f878c0c1af0 2023-08-10T10:41:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f8792abf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c06a020 con 0x7f878c069be0 2023-08-10T10:41:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f879085b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f878c0c1af0 0x7f878c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f879105c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f878c0b2d70 0x7f878c0b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54766/0 (socket says 172.21.15.50:54766) 2023-08-10T10:41:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f879105c640 1 -- 172.21.15.50:0/1775189847 learned_addr learned my addr 172.21.15.50:0/1775189847 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.067+0000 7f879085b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f878c0c1af0 0x7f878c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47818/0 (socket says 172.21.15.50:47818) 2023-08-10T10:41:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.068+0000 7f878bfff640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.068+0000 7f879085b640 1 -- 172.21.15.50:0/1775189847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 msgr2=0x7f878c0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.068+0000 7f879085b640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c0b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.068+0000 7f879085b640 1 -- 172.21.15.50:0/1775189847 >> v1:172.21.15.50:6789/0 conn(0x7f878c0b2d70 legacy=0x7f878c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.068+0000 7f879085b640 1 -- 172.21.15.50:0/1775189847 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0b31e0 con 0x7f878c0c1af0 2023-08-10T10:41:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.069+0000 7f879085b640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0c1af0 0x7f878c0696a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5727ba2c05c1b4b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.069+0000 7f878b7fe640 1 -- 172.21.15.50:0/1775189847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780030610 con 0x7f878c0c1af0 2023-08-10T10:41:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.069+0000 7f878b7fe640 1 -- 172.21.15.50:0/1775189847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780030770 con 0x7f878c0c1af0 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.069+0000 7f878b7fe640 1 -- 172.21.15.50:0/1775189847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780030b00 con 0x7f878c0c1af0 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 -- 172.21.15.50:0/1775189847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0c1af0 msgr2=0x7f878c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0c1af0 0x7f878c0696a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b960 comp rx=0 tx=0).stop 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 -- 172.21.15.50:0/1775189847 shutdown_connections 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 --2- 172.21.15.50:0/1775189847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0c1af0 0x7f878c0696a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 -- 172.21.15.50:0/1775189847 >> 172.21.15.50:0/1775189847 conn(0x7f878c06b590 msgr2=0x7f878c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 -- 172.21.15.50:0/1775189847 shutdown_connections 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.070+0000 7f8792abf640 1 -- 172.21.15.50:0/1775189847 wait complete. 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.072+0000 7f8792abf640 1 Processor -- start 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.072+0000 7f8792abf640 1 -- start start 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878c0c1af0 0x7f878c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0c8f70 con 0x7f878c0b2d70 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c153050 con 0x7f878c0c1af0 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f8792abf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0c9390 con 0x7f878c069be0 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f878bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f878bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47832/0 (socket says 172.21.15.50:47832) 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.073+0000 7f878bfff640 1 -- 172.21.15.50:0/3840937921 learned_addr learned my addr 172.21.15.50:0/3840937921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f879085b640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 -- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 msgr2=0x7f878c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f879105c640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878c0c1af0 0x7f878c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 -- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878c0c1af0 msgr2=0x7f878c0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878c0c1af0 0x7f878c0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 -- 172.21.15.50:0/3840937921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009400 con 0x7f878c0b2d70 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f879085b640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.074+0000 7f878bfff640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f877800d830 tx=0x7f877800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.075+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800b6c0 con 0x7f878c0b2d70 2023-08-10T10:41:06.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.075+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800b820 con 0x7f878c0b2d70 2023-08-10T10:41:06.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.075+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800bbb0 con 0x7f878c0b2d70 2023-08-10T10:41:06.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.075+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0c82f0 con 0x7f878c0b2d70 2023-08-10T10:41:06.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.075+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0c88b0 con 0x7f878c0b2d70 2023-08-10T10:41:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.076+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c0c90b0 con 0x7f878c0b2d70 2023-08-10T10:41:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.077+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f877801e460 con 0x7f878c0b2d70 2023-08-10T10:41:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.078+0000 7f87897fa640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 0x7f877006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.078+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8778089d20 con 0x7f878c0b2d70 2023-08-10T10:41:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.079+0000 7f879085b640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 0x7f877006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.079+0000 7f879085b640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 0x7f877006d110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8780036000 tx=0x7f878003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.082+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f878c0c90b0 con 0x7f878c0b2d70 2023-08-10T10:41:06.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.318+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f878c0c90b0 con 0x7f878c0b2d70 2023-08-10T10:41:06.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.320+0000 7f87897fa640 1 -- 172.21.15.50:0/3840937921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f878c0c90b0 con 0x7f878c0b2d70 2023-08-10T10:41:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:06.321 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:41:06.321 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:41:06.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.322+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 msgr2=0x7f877006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.322+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 0x7f877006d110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8780036000 tx=0x7f878003b040 comp rx=0 tx=0).stop 2023-08-10T10:41:06.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.322+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 msgr2=0x7f878c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:06.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.322+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f877800d830 tx=0x7f877800dcf0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 shutdown_connections 2023-08-10T10:41:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f877006ac50 0x7f877006d110 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878c0c1af0 0x7f878c0703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878c0b2d70 0x7f878c0c5790 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 --2- 172.21.15.50:0/3840937921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878c069be0 0x7f878c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 >> 172.21.15.50:0/3840937921 conn(0x7f878c06b590 msgr2=0x7f878c15f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 shutdown_connections 2023-08-10T10:41:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:06.323+0000 7f8792abf640 1 -- 172.21.15.50:0/3840937921 wait complete. 2023-08-10T10:41:06.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:41:06.554 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":41.748045892999997,"mdsmap_epoch":24,"osdmap_epoch":59,"osdmap_epoch_barrier":55,"uptime":47.547114080999997} 2023-08-10T10:41:06.555 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5634, "mdsmap_epoch": 24, "osdmap_epoch": 59, "osdmap_epoch_barrier": 55, "rank_uptime": 41.748045893, "state": "up:active", "uptime": 47.547114081, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:41:06.555 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:41:06.555 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:06.556 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:06.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:06.615 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-10T10:41:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:41:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:41:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.398854 s, 131 MB/s 2023-08-10T10:41:07.077 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:41:07.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:41:07.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:41:07.301 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:41:07.301 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:07.302 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:07.366 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:07.367 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:07.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.651+0000 7f8876f4e640 1 Processor -- start 2023-08-10T10:41:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.651+0000 7f8876f4e640 1 -- start start 2023-08-10T10:41:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.652+0000 7f8876f4e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88700b0c60 0x7f88700c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.652+0000 7f8876f4e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870071c70 con 0x7f88700b3f30 2023-08-10T10:41:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.652+0000 7f8876f4e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700713d0 con 0x7f887015aa40 2023-08-10T10:41:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.652+0000 7f8876f4e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700716b0 con 0x7f88700b0c60 2023-08-10T10:41:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.653+0000 7f88754eb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88700b3f30 0x7f88700c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54776/0 (socket says 172.21.15.50:54776) 2023-08-10T10:41:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.653+0000 7f88754eb640 1 -- 172.21.15.50:0/966077362 learned_addr learned my addr 172.21.15.50:0/966077362 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.653+0000 7f886ffff640 1 --2- 172.21.15.50:0/966077362 >> v2:172.21.15.117:3300/0 conn(0x7f88700b0c60 0x7f88700c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.653+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205496144 0 0) 0x7f8870071c70 con 0x7f88700b3f30 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.653+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8860003520 con 0x7f88700b3f30 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591292122 0 0) 0x7f8860003520 con 0x7f88700b3f30 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 >> v2:172.21.15.117:3300/0 conn(0x7f88700b0c60 msgr2=0x7f88700c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 --2- 172.21.15.50:0/966077362 >> v2:172.21.15.117:3300/0 conn(0x7f88700b0c60 0x7f88700c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 >> v1:172.21.15.117:6789/0 conn(0x7f887015aa40 legacy=0x7f88700b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870071990 con 0x7f88700b3f30 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f88680019f0 con 0x7f88700b3f30 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 >> v1:172.21.15.50:6789/0 conn(0x7f88700b3f30 legacy=0x7f88700c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 0x7f8860003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88600047c0 0x7f8860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88600052a0 0x7f886000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700716b0 con 0x7f8860003970 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886000c170 con 0x7f88600047c0 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886000c330 con 0x7f88600052a0 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.654+0000 7f8874cea640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 0x7f8860003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f886ffff640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88600047c0 0x7f8860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f88754eb640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88600052a0 0x7f886000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f8874cea640 1 -- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88600052a0 msgr2=0x7f886000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f8874cea640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88600052a0 0x7f886000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f8874cea640 1 -- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88600047c0 msgr2=0x7f8860004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f8874cea640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88600047c0 0x7f8860004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f8874cea640 1 -- 172.21.15.50:0/966077362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860003520 con 0x7f8860003970 2023-08-10T10:41:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.655+0000 7f88754eb640 1 -- 172.21.15.50:0/966077362 reap_dead start 2023-08-10T10:41:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.656+0000 7f8874cea640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 0x7f8860003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8864001720 tx=0x7f88600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a576e035acbe8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.656+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640052d0 con 0x7f8860003970 2023-08-10T10:41:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.656+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886402e050 con 0x7f8860003970 2023-08-10T10:41:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.656+0000 7f886f7fe640 1 -- 172.21.15.50:0/966077362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864003830 con 0x7f8860003970 2023-08-10T10:41:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 -- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 msgr2=0x7f8860003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 0x7f8860003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8864001720 tx=0x7f88600057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 -- 172.21.15.50:0/966077362 shutdown_connections 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 --2- 172.21.15.50:0/966077362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8860003970 0x7f8860003d90 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 -- 172.21.15.50:0/966077362 >> 172.21.15.50:0/966077362 conn(0x7f887006b590 msgr2=0x7f88700ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 -- 172.21.15.50:0/966077362 shutdown_connections 2023-08-10T10:41:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.657+0000 7f8876f4e640 1 -- 172.21.15.50:0/966077362 wait complete. 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.659+0000 7f8876f4e640 1 Processor -- start 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.659+0000 7f8876f4e640 1 -- start start 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8860003970 0x7f88701530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8870152040 0x7f88701524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870153620 con 0x7f8870154010 2023-08-10T10:41:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700b3160 con 0x7f8860003970 2023-08-10T10:41:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f8876f4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700b3440 con 0x7f8870152040 2023-08-10T10:41:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.660+0000 7f886ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47854/0 (socket says 172.21.15.50:47854) 2023-08-10T10:41:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 -- 172.21.15.50:0/3390640136 learned_addr learned my addr 172.21.15.50:0/3390640136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 -- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8870152040 msgr2=0x7f88701524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8870152040 0x7f88701524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 -- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8860003970 msgr2=0x7f88701530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8860003970 0x7f88701530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 -- 172.21.15.50:0/3390640136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700c5930 con 0x7f8870154010 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886ffff640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00f600 tx=0x7f885c00fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.661+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c014870 con 0x7f8870154010 2023-08-10T10:41:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.662+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0149d0 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.662+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c014d40 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.662+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88700c5c10 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.662+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88700cc240 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.663+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88700c5770 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.664+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f885c00d490 con 0x7f8870154010 2023-08-10T10:41:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.665+0000 7f886d7fa640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 0x7f885406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.665+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f885c089e70 con 0x7f8870154010 2023-08-10T10:41:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.665+0000 7f8874cea640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 0x7f885406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.666+0000 7f8874cea640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 0x7f885406d140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8864033000 tx=0x7f886402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.669+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f885c054f70 con 0x7f8870154010 2023-08-10T10:41:07.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.863+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f887004e270 con 0x7f8870154010 2023-08-10T10:41:07.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.866+0000 7f886d7fa640 1 -- 172.21.15.50:0/3390640136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f885c058590 con 0x7f8870154010 2023-08-10T10:41:07.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:07.869 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":60,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:07.487188+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.2a","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.869+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 msgr2=0x7f885406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.869+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 0x7f885406d140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8864033000 tx=0x7f886402f000 comp rx=0 tx=0).stop 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.869+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 msgr2=0x7f88700b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.869+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00f600 tx=0x7f885c00fac0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 shutdown_connections 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8870152040 0x7f88701524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8870154010 0x7f88700b2910 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f885406ac80 0x7f885406d140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 --2- 172.21.15.50:0/3390640136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8860003970 0x7f88701530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 >> 172.21.15.50:0/3390640136 conn(0x7f887006b590 msgr2=0x7f88700cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 shutdown_connections 2023-08-10T10:41:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:07.870+0000 7f8876f4e640 1 -- 172.21.15.50:0/3390640136 wait complete. 2023-08-10T10:41:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:40:22.656712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:40:23.288053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:41:07.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:41:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.127+0000 7f089a784640 1 Processor -- start 2023-08-10T10:41:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.128+0000 7f089a784640 1 -- start start 2023-08-10T10:41:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.129+0000 7f089a784640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08940718a0 0x7f08940ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f089a784640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08940cca70 con 0x7f08940af9b0 2023-08-10T10:41:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f089a784640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08940cf8a0 con 0x7f0894070d00 2023-08-10T10:41:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f089a784640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940cfb80 con 0x7f08940718a0 2023-08-10T10:41:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f08937fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08940718a0 0x7f08940ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f08937fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08940718a0 0x7f08940ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47858/0 (socket says 172.21.15.50:47858) 2023-08-10T10:41:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f08937fe640 1 -- 172.21.15.50:0/121429027 learned_addr learned my addr 172.21.15.50:0/121429027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f08937fe640 1 -- 172.21.15.50:0/121429027 >> v1:172.21.15.117:6789/0 conn(0x7f0894070d00 legacy=0x7f08940710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.130+0000 7f08937fe640 1 -- 172.21.15.50:0/121429027 >> v1:172.21.15.50:6789/0 conn(0x7f08940af9b0 legacy=0x7f08940cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.131+0000 7f08937fe640 1 -- 172.21.15.50:0/121429027 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940b3280 con 0x7f08940718a0 2023-08-10T10:41:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.131+0000 7f0892ffd640 1 -- 172.21.15.50:0/121429027 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402435214 0 0) 0x7f08940cca70 con 0x7f08940af9b0 2023-08-10T10:41:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.132+0000 7f08937fe640 1 --2- 172.21.15.50:0/121429027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940718a0 0x7f08940ccf00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0888009870 tx=0x7f088802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabfc76b5e7f1872 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.132+0000 7f0892ffd640 1 -- 172.21.15.50:0/121429027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888031870 con 0x7f08940718a0 2023-08-10T10:41:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.132+0000 7f0892ffd640 1 -- 172.21.15.50:0/121429027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08880319d0 con 0x7f08940718a0 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.132+0000 7f0892ffd640 1 -- 172.21.15.50:0/121429027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888031d60 con 0x7f08940718a0 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 -- 172.21.15.50:0/121429027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940718a0 msgr2=0x7f08940ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 --2- 172.21.15.50:0/121429027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940718a0 0x7f08940ccf00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0888009870 tx=0x7f088802b910 comp rx=0 tx=0).stop 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 -- 172.21.15.50:0/121429027 shutdown_connections 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 --2- 172.21.15.50:0/121429027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940718a0 0x7f08940ccf00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 -- 172.21.15.50:0/121429027 >> 172.21.15.50:0/121429027 conn(0x7f08940b23e0 msgr2=0x7f08940b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 -- 172.21.15.50:0/121429027 shutdown_connections 2023-08-10T10:41:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.133+0000 7f089a784640 1 -- 172.21.15.50:0/121429027 wait complete. 2023-08-10T10:41:08.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.135+0000 7f089a784640 1 Processor -- start 2023-08-10T10:41:08.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.135+0000 7f089a784640 1 -- start start 2023-08-10T10:41:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0894070d00 0x7f08941f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08940718a0 0x7f0894146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894155520 con 0x7f08940af9b0 2023-08-10T10:41:08.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08941548c0 con 0x7f08940718a0 2023-08-10T10:41:08.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f089a784640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0894154b80 con 0x7f0894070d00 2023-08-10T10:41:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f0898d21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f0898d21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47870/0 (socket says 172.21.15.50:47870) 2023-08-10T10:41:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.136+0000 7f0898d21640 1 -- 172.21.15.50:0/3203379627 learned_addr learned my addr 172.21.15.50:0/3203379627 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f08937fe640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08940718a0 0x7f0894146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0893fff640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0894070d00 0x7f08941f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 -- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0894070d00 msgr2=0x7f08941f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0894070d00 0x7f08941f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 -- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08940718a0 msgr2=0x7f0894146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08940718a0 0x7f0894146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 -- 172.21.15.50:0/3203379627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880094d0 con 0x7f08940af9b0 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0898d21640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c430 tx=0x7f088c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.137+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c0035f0 con 0x7f08940af9b0 2023-08-10T10:41:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.138+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c003770 con 0x7f08940af9b0 2023-08-10T10:41:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.138+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0894154e60 con 0x7f08940af9b0 2023-08-10T10:41:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.138+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c003b20 con 0x7f08940af9b0 2023-08-10T10:41:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.138+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941f5620 con 0x7f08940af9b0 2023-08-10T10:41:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.139+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894155660 con 0x7f08940af9b0 2023-08-10T10:41:08.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.140+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f088c003c80 con 0x7f08940af9b0 2023-08-10T10:41:08.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.141+0000 7f0890ff9640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 0x7f088006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.142+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f088c088b80 con 0x7f08940af9b0 2023-08-10T10:41:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.142+0000 7f0893fff640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 0x7f088006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.143+0000 7f0893fff640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 0x7f088006d110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0884009f20 tx=0x7f08840094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.146+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0894155660 con 0x7f08940af9b0 2023-08-10T10:41:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.335+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0894155660 con 0x7f08940af9b0 2023-08-10T10:41:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.336+0000 7f0890ff9640 1 -- 172.21.15.50:0/3203379627 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0894155660 con 0x7f08940af9b0 2023-08-10T10:41:08.338 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:41:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.338+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 msgr2=0x7f088006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.338+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 0x7f088006d110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0884009f20 tx=0x7f08840094d0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.338+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 msgr2=0x7f08940acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.338+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c430 tx=0x7f088c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 shutdown_connections 2023-08-10T10:41:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08940af9b0 0x7f08940acb30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f088006ac50 0x7f088006d110 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08940718a0 0x7f0894146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 --2- 172.21.15.50:0/3203379627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0894070d00 0x7f08941f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 >> 172.21.15.50:0/3203379627 conn(0x7f08940b23e0 msgr2=0x7f0894159350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 shutdown_connections 2023-08-10T10:41:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.339+0000 7f089a784640 1 -- 172.21.15.50:0/3203379627 wait complete. 2023-08-10T10:41:08.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:41:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.598+0000 7fa571581640 1 Processor -- start 2023-08-10T10:41:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.598+0000 7fa571581640 1 -- start start 2023-08-10T10:41:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.599+0000 7fa571581640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 0x7fa56c0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa571581640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa56c0cff30 0x7fa56c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa571581640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c069c10 con 0x7fa56c15e220 2023-08-10T10:41:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa571581640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0cc8e0 con 0x7fa56c0cff30 2023-08-10T10:41:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa571581640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0cbfb0 con 0x7fa56c15de40 2023-08-10T10:41:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa56b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa56c15e220 0x7fa56c0cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54798/0 (socket says 172.21.15.50:54798) 2023-08-10T10:41:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa56b7fe640 1 -- 172.21.15.50:0/535254029 learned_addr learned my addr 172.21.15.50:0/535254029 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:08.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa570d80640 1 --2- 172.21.15.50:0/535254029 >> v2:172.21.15.50:3300/0 conn(0x7fa56c0cff30 0x7fa56c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.600+0000 7fa56bfff640 1 --2- 172.21.15.50:0/535254029 >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 0x7fa56c0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa56affd640 1 -- 172.21.15.50:0/535254029 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399183055 0 0) 0x7fa560001110 con 0x7fa56c15e220 2023-08-10T10:41:08.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa56affd640 1 -- 172.21.15.50:0/535254029 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003520 con 0x7fa56c15e220 2023-08-10T10:41:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa570d80640 1 -- 172.21.15.50:0/535254029 >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 msgr2=0x7fa56c0cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa570d80640 1 --2- 172.21.15.50:0/535254029 >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 0x7fa56c0cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa570d80640 1 -- 172.21.15.50:0/535254029 >> v1:172.21.15.50:6789/0 conn(0x7fa56c15e220 legacy=0x7fa56c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa570d80640 1 -- 172.21.15.50:0/535254029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0cc290 con 0x7fa56c0cff30 2023-08-10T10:41:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.601+0000 7fa56bfff640 1 --2- 172.21.15.50:0/535254029 >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 0x7fa56c0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:08.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.602+0000 7fa570d80640 1 --2- 172.21.15.50:0/535254029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c0cd180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0b20e0 tx=0x7fa56402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c35ab0dfe28e48 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.603+0000 7fa56affd640 1 -- 172.21.15.50:0/535254029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56402cbf0 con 0x7fa56c0cff30 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.603+0000 7fa56affd640 1 -- 172.21.15.50:0/535254029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56402cd50 con 0x7fa56c0cff30 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.603+0000 7fa56affd640 1 -- 172.21.15.50:0/535254029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564034640 con 0x7fa56c0cff30 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.603+0000 7fa571581640 1 -- 172.21.15.50:0/535254029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 msgr2=0x7fa56c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.603+0000 7fa571581640 1 --2- 172.21.15.50:0/535254029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c0cd180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0b20e0 tx=0x7fa56402be40 comp rx=0 tx=0).stop 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 -- 172.21.15.50:0/535254029 shutdown_connections 2023-08-10T10:41:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 --2- 172.21.15.50:0/535254029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c0cd180 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 --2- 172.21.15.50:0/535254029 >> v2:172.21.15.117:3300/0 conn(0x7fa56c15de40 0x7fa56c0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 -- 172.21.15.50:0/535254029 >> 172.21.15.50:0/535254029 conn(0x7fa56c0b2500 msgr2=0x7fa56c0b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 -- 172.21.15.50:0/535254029 shutdown_connections 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.604+0000 7fa571581640 1 -- 172.21.15.50:0/535254029 wait complete. 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.605+0000 7fa571581640 1 Processor -- start 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.606+0000 7fa571581640 1 -- start start 2023-08-10T10:41:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c15de40 0x7fa56c1e4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c15e220 0x7fa56c0c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0c8690 con 0x7fa56c0cff30 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1e4d20 con 0x7fa56c15de40 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa571581640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0af170 con 0x7fa56c15e220 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47882/0 (socket says 172.21.15.50:47882) 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 -- 172.21.15.50:0/2611051220 learned_addr learned my addr 172.21.15.50:0/2611051220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 -- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c15e220 msgr2=0x7fa56c0c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c15e220 0x7fa56c0c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 -- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c15de40 msgr2=0x7fa56c1e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c15de40 0x7fa56c1e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.607+0000 7fa56bfff640 1 -- 172.21.15.50:0/2611051220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009a70 con 0x7fa56c0cff30 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa56bfff640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00e7e0 tx=0x7fa55c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004030 con 0x7fa56c0cff30 2023-08-10T10:41:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c004190 con 0x7fa56c0cff30 2023-08-10T10:41:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004520 con 0x7fa56c0cff30 2023-08-10T10:41:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c0cf130 con 0x7fa56c0cff30 2023-08-10T10:41:08.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.608+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c0af730 con 0x7fa56c0cff30 2023-08-10T10:41:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.609+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c0aefd0 con 0x7fa56c0cff30 2023-08-10T10:41:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.610+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa55c00c6d0 con 0x7fa56c0cff30 2023-08-10T10:41:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.611+0000 7fa568ff9640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 0x7fa55806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.611+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa55c089260 con 0x7fa56c0cff30 2023-08-10T10:41:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.612+0000 7fa56b7fe640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 0x7fa55806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.612+0000 7fa56b7fe640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 0x7fa55806d110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa560005880 tx=0x7fa560001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.615+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa56c0aefd0 con 0x7fa56c0cff30 2023-08-10T10:41:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.805+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa56c0aefd0 con 0x7fa56c0cff30 2023-08-10T10:41:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.806+0000 7fa568ff9640 1 -- 172.21.15.50:0/2611051220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa56c0aefd0 con 0x7fa56c0cff30 2023-08-10T10:41:08.807 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:41:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.808+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 msgr2=0x7fa55806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.808+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 0x7fa55806d110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa560005880 tx=0x7fa560001150 comp rx=0 tx=0).stop 2023-08-10T10:41:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.808+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 msgr2=0x7fa56c15bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.808+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00e7e0 tx=0x7fa55c00eca0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 shutdown_connections 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c15e220 0x7fa56c0c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa55806ac50 0x7fa55806d110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c15de40 0x7fa56c1e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 --2- 172.21.15.50:0/2611051220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa56c0cff30 0x7fa56c15bfa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 >> 172.21.15.50:0/2611051220 conn(0x7fa56c0b2500 msgr2=0x7fa56c15d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 shutdown_connections 2023-08-10T10:41:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:08.809+0000 7fa571581640 1 -- 172.21.15.50:0/2611051220 wait complete. 2023-08-10T10:41:08.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:41:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.057+0000 7f4bd8645640 1 Processor -- start 2023-08-10T10:41:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.057+0000 7f4bd8645640 1 -- start start 2023-08-10T10:41:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.058+0000 7f4bd8645640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4bd00cd9b0 0x7f4bd00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.058+0000 7f4bd8645640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd006cb30 0x7f4bd00ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.058+0000 7f4bd8645640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00adcb0 con 0x7f4bd015ae40 2023-08-10T10:41:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.058+0000 7f4bd8645640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd006c320 con 0x7f4bd00cd9b0 2023-08-10T10:41:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.058+0000 7f4bd8645640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006b770 con 0x7f4bd006cb30 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.059+0000 7f4bd63e1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4bd015ae40 0x7f4bd00cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54808/0 (socket says 172.21.15.50:54808) 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.059+0000 7f4bd63e1640 1 -- 172.21.15.50:0/2530398279 learned_addr learned my addr 172.21.15.50:0/2530398279 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.059+0000 7f4bd6be2640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd006cb30 0x7f4bd00ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.059+0000 7f4bd5be0640 1 --2- 172.21.15.50:0/2530398279 >> v2:172.21.15.117:3300/0 conn(0x7f4bd00cd9b0 0x7f4bd00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976350780 0 0) 0x7f4bd00adcb0 con 0x7f4bd015ae40 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bbc003520 con 0x7f4bd015ae40 2023-08-10T10:41:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 737320388 0 0) 0x7f4bbc003520 con 0x7f4bd015ae40 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd006cb30 msgr2=0x7f4bd00ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd006cb30 0x7f4bd00ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 >> v2:172.21.15.117:3300/0 conn(0x7f4bd00cd9b0 msgr2=0x7f4bd00b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 --2- 172.21.15.50:0/2530398279 >> v2:172.21.15.117:3300/0 conn(0x7f4bd00cd9b0 0x7f4bd00b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd006b9f0 con 0x7f4bd015ae40 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4bcc001670 con 0x7f4bd015ae40 2023-08-10T10:41:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 >> v1:172.21.15.50:6789/0 conn(0x7f4bd015ae40 legacy=0x7f4bd00cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bbc003970 0x7f4bbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bbc0047c0 0x7f4bbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc005180 0x7f4bbc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006c320 con 0x7f4bbc003970 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006b770 con 0x7f4bbc005180 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.060+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc00bec0 con 0x7f4bbc0047c0 2023-08-10T10:41:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd6be2640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd006cb30 0x7f4bd00ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bbc003970 0x7f4bbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd5be0640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bbc0047c0 0x7f4bbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 -- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bbc0047c0 msgr2=0x7f4bbc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bbc0047c0 0x7f4bbc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 -- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc005180 msgr2=0x7f4bbc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc005180 0x7f4bbc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.061+0000 7f4bd63e1640 1 -- 172.21.15.50:0/2530398279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc003520 con 0x7f4bbc003970 2023-08-10T10:41:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.062+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bbc003970 0x7f4bbc003d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c270 tx=0x7f4bbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b158ba53ab0159bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.062+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc005ad0 con 0x7f4bbc003970 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc005c30 con 0x7f4bbc003970 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd53df640 1 -- 172.21.15.50:0/2530398279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc02c870 con 0x7f4bbc003970 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 -- 172.21.15.50:0/2530398279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bbc003970 msgr2=0x7f4bbc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 --2- 172.21.15.50:0/2530398279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bbc003970 0x7f4bbc003d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c270 tx=0x7f4bbc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd6be2640 1 -- 172.21.15.50:0/2530398279 reap_dead start 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 -- 172.21.15.50:0/2530398279 shutdown_connections 2023-08-10T10:41:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 -- 172.21.15.50:0/2530398279 >> 172.21.15.50:0/2530398279 conn(0x7f4bd00b01b0 msgr2=0x7f4bd00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 -- 172.21.15.50:0/2530398279 shutdown_connections 2023-08-10T10:41:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.063+0000 7f4bd8645640 1 -- 172.21.15.50:0/2530398279 wait complete. 2023-08-10T10:41:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.065+0000 7f4bd8645640 1 Processor -- start 2023-08-10T10:41:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.066+0000 7f4bd8645640 1 -- start start 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.066+0000 7f4bd8645640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc003970 0x7f4bd006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd8645640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd0149eb0 0x7f4bd00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd8645640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd8645640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006f440 con 0x7f4bd006ea80 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd8645640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0070350 con 0x7f4bbc003970 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd8645640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd015e230 con 0x7f4bd0149eb0 2023-08-10T10:41:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47912/0 (socket says 172.21.15.50:47912) 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 -- 172.21.15.50:0/1540116702 learned_addr learned my addr 172.21.15.50:0/1540116702 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc003970 0x7f4bd006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd5be0640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd0149eb0 0x7f4bd00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 -- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd0149eb0 msgr2=0x7f4bd00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd0149eb0 0x7f4bd00c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 -- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc003970 msgr2=0x7f4bd006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.067+0000 7f4bd6be2640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc003970 0x7f4bd006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bd6be2640 1 -- 172.21.15.50:0/1540116702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd015d620 con 0x7f4bd006ea80 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bd6be2640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b0d80 tx=0x7f4bc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800ced0 con 0x7f4bd006ea80 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800f040 con 0x7f4bd006ea80 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd015d900 con 0x7f4bd006ea80 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80146c0 con 0x7f4bd006ea80 2023-08-10T10:41:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.068+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd015dec0 con 0x7f4bd006ea80 2023-08-10T10:41:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.069+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd015a6a0 con 0x7f4bd006ea80 2023-08-10T10:41:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.071+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4bc8014820 con 0x7f4bd006ea80 2023-08-10T10:41:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.072+0000 7f4bc6ffd640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 0x7f4bb406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.072+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4bc8089f00 con 0x7f4bd006ea80 2023-08-10T10:41:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.073+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 0x7f4bb406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.073+0000 7f4bd63e1640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 0x7f4bb406d140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc034000 tx=0x7f4bcc007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.077+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4bc8058a90 con 0x7f4bd006ea80 2023-08-10T10:41:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.266+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bd00612b0 con 0x7f4bd006ea80 2023-08-10T10:41:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.267+0000 7f4bc6ffd640 1 -- 172.21.15.50:0/1540116702 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bc8009ca0 con 0x7f4bd006ea80 2023-08-10T10:41:09.268 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:41:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.269+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 msgr2=0x7f4bb406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.269+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 0x7f4bb406d140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc034000 tx=0x7f4bcc007000 comp rx=0 tx=0).stop 2023-08-10T10:41:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.269+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 msgr2=0x7f4bd006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.269+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b0d80 tx=0x7f4bc800c490 comp rx=0 tx=0).stop 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 shutdown_connections 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd006ea80 0x7f4bd006ef00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd0149eb0 0x7f4bd00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4bb406ac80 0x7f4bb406d140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 --2- 172.21.15.50:0/1540116702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bbc003970 0x7f4bd006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 >> 172.21.15.50:0/1540116702 conn(0x7f4bd00b01b0 msgr2=0x7f4bd00cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 shutdown_connections 2023-08-10T10:41:09.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.270+0000 7f4bd8645640 1 -- 172.21.15.50:0/1540116702 wait complete. 2023-08-10T10:41:09.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:41:09.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.520+0000 7f4f6adfd640 1 Processor -- start 2023-08-10T10:41:09.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.520+0000 7f4f6adfd640 1 -- start start 2023-08-10T10:41:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.521+0000 7f4f6adfd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f6415cb90 0x7f4f640b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.521+0000 7f4f6adfd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f6415cf70 0x7f4f64160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f6adfd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f640b4640 0x7f4f64161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f6adfd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f64160a40 con 0x7f4f6415cf70 2023-08-10T10:41:09.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f6adfd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640b4bb0 con 0x7f4f640b4640 2023-08-10T10:41:09.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f6adfd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b4e90 con 0x7f4f6415cb90 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f6415cf70 0x7f4f64160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f6415cf70 0x7f4f64160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47924/0 (socket says 172.21.15.50:47924) 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3576116264 learned_addr learned my addr 172.21.15.50:0/3576116264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f68b99640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f6415cb90 0x7f4f640b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f6939a640 1 --2- 172.21.15.50:0/3576116264 >> v2:172.21.15.117:3300/0 conn(0x7f4f640b4640 0x7f4f64161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3576116264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f6415cb90 msgr2=0x7f4f640b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f6415cb90 0x7f4f640b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3576116264 >> v2:172.21.15.117:3300/0 conn(0x7f4f640b4640 msgr2=0x7f4f64161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.522+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3576116264 >> v2:172.21.15.117:3300/0 conn(0x7f4f640b4640 0x7f4f64161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.523+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3576116264 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640b5170 con 0x7f4f6415cf70 2023-08-10T10:41:09.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.524+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cf70 0x7f4f64160ed0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4f640718c0 tx=0x7f4f5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c63dc50aec6c76 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.524+0000 7f4f5b7fe640 1 -- 172.21.15.50:0/3576116264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031870 con 0x7f4f6415cf70 2023-08-10T10:41:09.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.524+0000 7f4f5b7fe640 1 -- 172.21.15.50:0/3576116264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540319d0 con 0x7f4f6415cf70 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.524+0000 7f4f5b7fe640 1 -- 172.21.15.50:0/3576116264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031d60 con 0x7f4f6415cf70 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3576116264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cf70 msgr2=0x7f4f64160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cf70 0x7f4f64160ed0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4f640718c0 tx=0x7f4f5402b910 comp rx=0 tx=0).stop 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3576116264 shutdown_connections 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3576116264 >> v2:172.21.15.117:3300/0 conn(0x7f4f640b4640 0x7f4f64161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cf70 0x7f4f64160ed0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3576116264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f6415cb90 0x7f4f640b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3576116264 >> 172.21.15.50:0/3576116264 conn(0x7f4f640cf640 msgr2=0x7f4f640cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3576116264 shutdown_connections 2023-08-10T10:41:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.525+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3576116264 wait complete. 2023-08-10T10:41:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.527+0000 7f4f6adfd640 1 Processor -- start 2023-08-10T10:41:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.528+0000 7f4f6adfd640 1 -- start start 2023-08-10T10:41:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f640b4640 0x7f4f6415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f6415cf70 0x7f4f6414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415f1e0 con 0x7f4f6415cb90 2023-08-10T10:41:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f641549a0 con 0x7f4f6415cf70 2023-08-10T10:41:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f6adfd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64154770 con 0x7f4f640b4640 2023-08-10T10:41:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47930/0 (socket says 172.21.15.50:47930) 2023-08-10T10:41:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.529+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3815935311 learned_addr learned my addr 172.21.15.50:0/3815935311 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f68b99640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f640b4640 0x7f4f6415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f6939a640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f6415cf70 0x7f4f6414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f640b4640 msgr2=0x7f4f6415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f640b4640 0x7f4f6415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f6415cf70 msgr2=0x7f4f6414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f6415cf70 0x7f4f6414d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 -- 172.21.15.50:0/3815935311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540094d0 con 0x7f4f6415cb90 2023-08-10T10:41:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.530+0000 7f4f5bfff640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.531+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5403acb0 con 0x7f4f6415cb90 2023-08-10T10:41:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.531+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5403ae10 con 0x7f4f6415cb90 2023-08-10T10:41:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.531+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54044630 con 0x7f4f6415cb90 2023-08-10T10:41:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.531+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6415fd00 con 0x7f4f6415cb90 2023-08-10T10:41:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.531+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6415f3d0 con 0x7f4f6415cb90 2023-08-10T10:41:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.532+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6415fe90 con 0x7f4f6415cb90 2023-08-10T10:41:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.533+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f54044790 con 0x7f4f6415cb90 2023-08-10T10:41:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.534+0000 7f4f597fa640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 0x7f4f5006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.534+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4f5402d040 con 0x7f4f6415cb90 2023-08-10T10:41:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.534+0000 7f4f68b99640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 0x7f4f5006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.535+0000 7f4f68b99640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 0x7f4f5006d110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f640b4610 tx=0x7f4f600039b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.538+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f54076dd0 con 0x7f4f6415cb90 2023-08-10T10:41:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.728+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f640612b0 con 0x7f4f6415cb90 2023-08-10T10:41:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.729+0000 7f4f597fa640 1 -- 172.21.15.50:0/3815935311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f540350a0 con 0x7f4f6415cb90 2023-08-10T10:41:09.730 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:41:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 msgr2=0x7f4f5006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 0x7f4f5006d110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f640b4610 tx=0x7f4f600039b0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 msgr2=0x7f4f64154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 shutdown_connections 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4f5006ac50 0x7f4f5006d110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f6415cf70 0x7f4f6414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f6415cb90 0x7f4f64154230 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 --2- 172.21.15.50:0/3815935311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f640b4640 0x7f4f6415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.731+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 >> 172.21.15.50:0/3815935311 conn(0x7f4f640cf640 msgr2=0x7f4f640cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.732+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 shutdown_connections 2023-08-10T10:41:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.732+0000 7f4f6adfd640 1 -- 172.21.15.50:0/3815935311 wait complete. 2023-08-10T10:41:09.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:41:09.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.990+0000 7f7539214640 1 Processor -- start 2023-08-10T10:41:09.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.990+0000 7f7539214640 1 -- start start 2023-08-10T10:41:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.991+0000 7f7539214640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f7539214640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 0x7f75340cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f7539214640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753415bcb0 con 0x7f753415a820 2023-08-10T10:41:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f7539214640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340c5540 con 0x7f7534069db0 2023-08-10T10:41:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f7539214640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753415b0a0 con 0x7f753415ac00 2023-08-10T10:41:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f753359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 0x7f75340cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.992+0000 7f752bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:51638/0 (socket says 172.21.15.50:51638) 2023-08-10T10:41:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f7532d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f753415a820 0x7f75340696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:33976/0 (socket says 172.21.15.50:33976) 2023-08-10T10:41:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 -- 172.21.15.50:0/215179870 learned_addr learned my addr 172.21.15.50:0/215179870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f753359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 0x7f75340cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:59042/0 (socket says 172.21.15.50:59042) 2023-08-10T10:41:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 -- 172.21.15.50:0/215179870 >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 msgr2=0x7f75340cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 --2- 172.21.15.50:0/215179870 >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 0x7f75340cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 -- 172.21.15.50:0/215179870 >> v1:172.21.15.117:6789/0 conn(0x7f753415a820 legacy=0x7f75340696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.993+0000 7f752bfff640 1 -- 172.21.15.50:0/215179870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753415b380 con 0x7f753415ac00 2023-08-10T10:41:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.995+0000 7f752bfff640 1 --2- 172.21.15.50:0/215179870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae772e6f6b73f46 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.995+0000 7f753259c640 1 -- 172.21.15.50:0/215179870 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c030840 con 0x7f753415ac00 2023-08-10T10:41:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f753259c640 1 -- 172.21.15.50:0/215179870 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c0309a0 con 0x7f753415ac00 2023-08-10T10:41:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f753259c640 1 -- 172.21.15.50:0/215179870 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c030d30 con 0x7f753415ac00 2023-08-10T10:41:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 -- 172.21.15.50:0/215179870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 msgr2=0x7f753406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 --2- 172.21.15.50:0/215179870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b980 comp rx=0 tx=0).stop 2023-08-10T10:41:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 -- 172.21.15.50:0/215179870 shutdown_connections 2023-08-10T10:41:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 --2- 172.21.15.50:0/215179870 >> v2:172.21.15.117:3300/0 conn(0x7f7534069db0 0x7f75340cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 --2- 172.21.15.50:0/215179870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f753406c180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 -- 172.21.15.50:0/215179870 >> 172.21.15.50:0/215179870 conn(0x7f75340b08e0 msgr2=0x7f75340ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.996+0000 7f7539214640 1 -- 172.21.15.50:0/215179870 shutdown_connections 2023-08-10T10:41:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.997+0000 7f7539214640 1 -- 172.21.15.50:0/215179870 wait complete. 2023-08-10T10:41:10.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.998+0000 7f7539214640 1 Processor -- start 2023-08-10T10:41:10.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.998+0000 7f7539214640 1 -- start start 2023-08-10T10:41:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:09.999+0000 7f7539214640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 0x7f75340ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7539214640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7539214640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f75340ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7539214640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b35a0 con 0x7f753415a820 2023-08-10T10:41:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7539214640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b3820 con 0x7f7534069db0 2023-08-10T10:41:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7539214640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c8ce0 con 0x7f753415ac00 2023-08-10T10:41:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47940/0 (socket says 172.21.15.50:47940) 2023-08-10T10:41:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 -- 172.21.15.50:0/431187807 learned_addr learned my addr 172.21.15.50:0/431187807 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f753359e640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f75340ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7532d9d640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 0x7f75340ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 -- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 msgr2=0x7f75340ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f75340ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 -- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 msgr2=0x7f75340ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 0x7f75340ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f752bfff640 1 -- 172.21.15.50:0/431187807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0094d0 con 0x7f753415a820 2023-08-10T10:41:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.000+0000 7f7532d9d640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 0x7f75340ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f752bfff640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c039a90 con 0x7f753415a820 2023-08-10T10:41:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c039bf0 con 0x7f753415a820 2023-08-10T10:41:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c043410 con 0x7f753415a820 2023-08-10T10:41:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340c8fc0 con 0x7f753415a820 2023-08-10T10:41:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.001+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340c9580 con 0x7f753415a820 2023-08-10T10:41:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.003+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404e270 con 0x7f753415a820 2023-08-10T10:41:10.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.003+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f751c02f390 con 0x7f753415a820 2023-08-10T10:41:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.005+0000 7f752b7fe640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 0x7f751806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.005+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f751c0ab800 con 0x7f753415a820 2023-08-10T10:41:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.005+0000 7f7532d9d640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 0x7f751806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.006+0000 7f7532d9d640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 0x7f751806d110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7524000f60 tx=0x7f7524009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:10.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.009+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f751c0768f0 con 0x7f753415a820 2023-08-10T10:41:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.213+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7534070a70 con 0x7f753415a820 2023-08-10T10:41:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.214+0000 7f752b7fe640 1 -- 172.21.15.50:0/431187807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f751c079f10 con 0x7f753415a820 2023-08-10T10:41:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:41:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.216+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 msgr2=0x7f751806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.216+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 0x7f751806d110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7524000f60 tx=0x7f7524009040 comp rx=0 tx=0).stop 2023-08-10T10:41:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.216+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 msgr2=0x7f75340b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.216+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c004730 comp rx=0 tx=0).stop 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 shutdown_connections 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f753415ac00 0x7f75340ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f753415a820 0x7f75340b3060 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f751806ac50 0x7f751806d110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 --2- 172.21.15.50:0/431187807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7534069db0 0x7f75340ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 >> 172.21.15.50:0/431187807 conn(0x7f75340b08e0 msgr2=0x7f75340cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 shutdown_connections 2023-08-10T10:41:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.217+0000 7f7539214640 1 -- 172.21.15.50:0/431187807 wait complete. 2023-08-10T10:41:10.238 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:41:10.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:10.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:41:10.413 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:41:10.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:10.414 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:41:10.460 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:10.461 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:10.510 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:10.511 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:10.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.842+0000 7fa183978640 1 Processor -- start 2023-08-10T10:41:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.843+0000 7fa183978640 1 -- start start 2023-08-10T10:41:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.844+0000 7fa183978640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa17c069db0 0x7fa17c167980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.844+0000 7fa183978640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0719f0 con 0x7fa17c0b3010 2023-08-10T10:41:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.844+0000 7fa183978640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0c8db0 con 0x7fa17c15ccb0 2023-08-10T10:41:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.844+0000 7fa183978640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c0c9050 con 0x7fa17c069db0 2023-08-10T10:41:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.845+0000 7fa180f13640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa17c0b3010 0x7fa17c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54818/0 (socket says 172.21.15.50:54818) 2023-08-10T10:41:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.845+0000 7fa180f13640 1 -- 172.21.15.50:0/3733143684 learned_addr learned my addr 172.21.15.50:0/3733143684 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.845+0000 7fa181f15640 1 --2- 172.21.15.50:0/3733143684 >> v2:172.21.15.117:3300/0 conn(0x7fa17c069db0 0x7fa17c167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.845+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872089906 0 0) 0x7fa17c0719f0 con 0x7fa17c0b3010 2023-08-10T10:41:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.845+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa168003520 con 0x7fa17c0b3010 2023-08-10T10:41:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489791502 0 0) 0x7fa168003520 con 0x7fa17c0b3010 2023-08-10T10:41:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 >> v2:172.21.15.117:3300/0 conn(0x7fa17c069db0 msgr2=0x7fa17c167980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 --2- 172.21.15.50:0/3733143684 >> v2:172.21.15.117:3300/0 conn(0x7fa17c069db0 0x7fa17c167980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 >> v1:172.21.15.117:6789/0 conn(0x7fa17c15ccb0 legacy=0x7fa17c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0c9330 con 0x7fa17c0b3010 2023-08-10T10:41:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa16c001670 con 0x7fa17c0b3010 2023-08-10T10:41:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 >> v1:172.21.15.50:6789/0 conn(0x7fa17c0b3010 legacy=0x7fa17c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 0x7fa168003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1680047c0 0x7fa168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa168005180 0x7fa16800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0c9050 con 0x7fa168003970 2023-08-10T10:41:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800c020 con 0x7fa168005180 2023-08-10T10:41:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800c1e0 con 0x7fa1680047c0 2023-08-10T10:41:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.846+0000 7fa181714640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 0x7fa168003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa180f13640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1680047c0 0x7fa168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181f15640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa168005180 0x7fa16800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181714640 1 -- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1680047c0 msgr2=0x7fa168004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181714640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1680047c0 0x7fa168004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181714640 1 -- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa168005180 msgr2=0x7fa16800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181714640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa168005180 0x7fa16800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181714640 1 -- 172.21.15.50:0/3733143684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168003520 con 0x7fa168003970 2023-08-10T10:41:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.847+0000 7fa181f15640 1 -- 172.21.15.50:0/3733143684 reap_dead start 2023-08-10T10:41:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.848+0000 7fa181714640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 0x7fa168003d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa178001750 tx=0x7fa1680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc97c0b6ab87224 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.848+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780052d0 con 0x7fa168003970 2023-08-10T10:41:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.848+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17802e050 con 0x7fa168003970 2023-08-10T10:41:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.848+0000 7fa173fff640 1 -- 172.21.15.50:0/3733143684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178003830 con 0x7fa168003970 2023-08-10T10:41:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 -- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 msgr2=0x7fa168003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 0x7fa168003d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa178001750 tx=0x7fa1680057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 -- 172.21.15.50:0/3733143684 shutdown_connections 2023-08-10T10:41:10.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 --2- 172.21.15.50:0/3733143684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168003970 0x7fa168003d90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 -- 172.21.15.50:0/3733143684 >> 172.21.15.50:0/3733143684 conn(0x7fa17c06b590 msgr2=0x7fa17c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 -- 172.21.15.50:0/3733143684 shutdown_connections 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.849+0000 7fa183978640 1 -- 172.21.15.50:0/3733143684 wait complete. 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.851+0000 7fa183978640 1 Processor -- start 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.851+0000 7fa183978640 1 -- start start 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa168003970 0x7fa17c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c0c69d0 0x7fa17c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0aef80 con 0x7fa17c1f6050 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1f6560 con 0x7fa17c0c69d0 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa183978640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1f6840 con 0x7fa168003970 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa181f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa181f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47958/0 (socket says 172.21.15.50:47958) 2023-08-10T10:41:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.852+0000 7fa181f15640 1 -- 172.21.15.50:0/550398099 learned_addr learned my addr 172.21.15.50:0/550398099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181714640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa168003970 0x7fa17c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa180f13640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c0c69d0 0x7fa17c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 -- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa168003970 msgr2=0x7fa17c1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa168003970 0x7fa17c1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 -- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c0c69d0 msgr2=0x7fa17c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c0c69d0 0x7fa17c1f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 -- 172.21.15.50:0/550398099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0af200 con 0x7fa17c1f6050 2023-08-10T10:41:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa181f15640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0cb000 tx=0x7fa17400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174016420 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1740165a0 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174016950 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.853+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c0af4e0 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.854+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c14ffa0 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.855+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c150160 con 0x7fa17c1f6050 2023-08-10T10:41:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.856+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa174016ab0 con 0x7fa17c1f6050 2023-08-10T10:41:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.857+0000 7fa171ffb640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 0x7fa16006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.857+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa17408a290 con 0x7fa17c1f6050 2023-08-10T10:41:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.857+0000 7fa181714640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 0x7fa16006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.858+0000 7fa181714640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 0x7fa16006d110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa178033000 tx=0x7fa178009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:10.861+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa174055260 con 0x7fa17c1f6050 2023-08-10T10:41:11.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.057+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17c0cc240 con 0x7fa17c1f6050 2023-08-10T10:41:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.060+0000 7fa171ffb640 1 -- 172.21.15.50:0/550398099 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fa174058880 con 0x7fa17c1f6050 2023-08-10T10:41:11.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:11.062 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:08.497772+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.2a","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 msgr2=0x7fa16006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 0x7fa16006d110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa178033000 tx=0x7fa178009030 comp rx=0 tx=0).stop 2023-08-10T10:41:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 msgr2=0x7fa17c15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0cb000 tx=0x7fa17400f520 comp rx=0 tx=0).stop 2023-08-10T10:41:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 shutdown_connections 2023-08-10T10:41:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa17c1f6050 0x7fa17c15f6d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa16006ac50 0x7fa16006d110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c0c69d0 0x7fa17c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.062+0000 7fa183978640 1 --2- 172.21.15.50:0/550398099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa168003970 0x7fa17c1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.063+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 >> 172.21.15.50:0/550398099 conn(0x7fa17c06b590 msgr2=0x7fa17c0ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.063+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 shutdown_connections 2023-08-10T10:41:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.063+0000 7fa183978640 1 -- 172.21.15.50:0/550398099 wait complete. 2023-08-10T10:41:11.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:40:22.656712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:40:23.288053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:41:11.083 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:41:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.304+0000 7f92389f3640 1 Processor -- start 2023-08-10T10:41:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.304+0000 7f92389f3640 1 -- start start 2023-08-10T10:41:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.305+0000 7f92389f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9234159c10 0x7f92340b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f92389f3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92340ada90 0x7f92340c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f92389f3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92340ca7b0 con 0x7f92340ca360 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f92389f3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92340adf40 con 0x7f9234159c10 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f92389f3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923406ebb0 con 0x7f92340ada90 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f9232d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92340ca360 0x7f92340cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54822/0 (socket says 172.21.15.50:54822) 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f9232d9d640 1 -- 172.21.15.50:0/2127154124 learned_addr learned my addr 172.21.15.50:0/2127154124 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f923259c640 1 --2- 172.21.15.50:0/2127154124 >> v2:172.21.15.50:3300/0 conn(0x7f9234159c10 0x7f92340b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.306+0000 7f922bfff640 1 --2- 172.21.15.50:0/2127154124 >> v2:172.21.15.117:3300/0 conn(0x7f92340ada90 0x7f92340c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f9231d9b640 1 -- 172.21.15.50:0/2127154124 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991662282 0 0) 0x7f922c001490 con 0x7f92340ca360 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f9231d9b640 1 -- 172.21.15.50:0/2127154124 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9220005730 con 0x7f92340ca360 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f923259c640 1 -- 172.21.15.50:0/2127154124 >> v2:172.21.15.117:3300/0 conn(0x7f92340ada90 msgr2=0x7f92340c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f923259c640 1 --2- 172.21.15.50:0/2127154124 >> v2:172.21.15.117:3300/0 conn(0x7f92340ada90 0x7f92340c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f923259c640 1 -- 172.21.15.50:0/2127154124 >> v1:172.21.15.50:6789/0 conn(0x7f92340ca360 legacy=0x7f92340cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.307+0000 7f923259c640 1 -- 172.21.15.50:0/2127154124 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923406ee90 con 0x7f9234159c10 2023-08-10T10:41:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.308+0000 7f923259c640 1 --2- 172.21.15.50:0/2127154124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234159c10 0x7f92340b0cd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9234073e80 tx=0x7f922402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2a86fc3d5ea86b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.308+0000 7f9231d9b640 1 -- 172.21.15.50:0/2127154124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922402e070 con 0x7f9234159c10 2023-08-10T10:41:11.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.308+0000 7f9231d9b640 1 -- 172.21.15.50:0/2127154124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92240315a0 con 0x7f9234159c10 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.308+0000 7f9231d9b640 1 -- 172.21.15.50:0/2127154124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224031910 con 0x7f9234159c10 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 -- 172.21.15.50:0/2127154124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234159c10 msgr2=0x7f92340b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 --2- 172.21.15.50:0/2127154124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234159c10 0x7f92340b0cd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9234073e80 tx=0x7f922402b840 comp rx=0 tx=0).stop 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 -- 172.21.15.50:0/2127154124 shutdown_connections 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 --2- 172.21.15.50:0/2127154124 >> v2:172.21.15.117:3300/0 conn(0x7f92340ada90 0x7f92340c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 --2- 172.21.15.50:0/2127154124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234159c10 0x7f92340b0cd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 -- 172.21.15.50:0/2127154124 >> 172.21.15.50:0/2127154124 conn(0x7f92340b01b0 msgr2=0x7f92340b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:11.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 -- 172.21.15.50:0/2127154124 shutdown_connections 2023-08-10T10:41:11.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.309+0000 7f92389f3640 1 -- 172.21.15.50:0/2127154124 wait complete. 2023-08-10T10:41:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.311+0000 7f92389f3640 1 Processor -- start 2023-08-10T10:41:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.311+0000 7f92389f3640 1 -- start start 2023-08-10T10:41:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 0x7f9234158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9234159c10 0x7f9234158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c2e60 con 0x7f92340ada90 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c2290 con 0x7f9234159c10 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f92389f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c2530 con 0x7f92340ca360 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.312+0000 7f923259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47966/0 (socket says 172.21.15.50:47966) 2023-08-10T10:41:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 -- 172.21.15.50:0/4201976305 learned_addr learned my addr 172.21.15.50:0/4201976305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f922bfff640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 0x7f9234158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f9232d9d640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9234159c10 0x7f9234158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 -- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 msgr2=0x7f9234158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 0x7f9234158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 -- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9234159c10 msgr2=0x7f9234158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9234159c10 0x7f9234158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 -- 172.21.15.50:0/4201976305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009400 con 0x7f92340ada90 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f922bfff640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 0x7f9234158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.313+0000 7f923259c640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9224000c00 tx=0x7f92240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.314+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224032630 con 0x7f92340ada90 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.314+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224032790 con 0x7f92340ada90 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.314+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224032b00 con 0x7f92340ada90 2023-08-10T10:41:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.314+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92340c2810 con 0x7f92340ada90 2023-08-10T10:41:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.314+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92340c3830 con 0x7f92340ada90 2023-08-10T10:41:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.315+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92340612b0 con 0x7f92340ada90 2023-08-10T10:41:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.316+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9224032c60 con 0x7f92340ada90 2023-08-10T10:41:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.317+0000 7f922affd640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 0x7f921406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.317+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f92240ab0d0 con 0x7f92340ada90 2023-08-10T10:41:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.317+0000 7f922bfff640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 0x7f921406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.318+0000 7f922bfff640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 0x7f921406d140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f921c006fd0 tx=0x7f921c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.321+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f92240760c0 con 0x7f92340ada90 2023-08-10T10:41:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.516+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92340ce190 con 0x7f92340ada90 2023-08-10T10:41:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.517+0000 7f922affd640 1 -- 172.21.15.50:0/4201976305 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92240796e0 con 0x7f92340ada90 2023-08-10T10:41:11.519 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:41:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 msgr2=0x7f921406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 0x7f921406d140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f921c006fd0 tx=0x7f921c008040 comp rx=0 tx=0).stop 2023-08-10T10:41:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 msgr2=0x7f92340c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9224000c00 tx=0x7f92240046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 shutdown_connections 2023-08-10T10:41:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f921406ac80 0x7f921406d140 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9234159c10 0x7f9234158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92340ca360 0x7f9234158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 --2- 172.21.15.50:0/4201976305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ada90 0x7f92340c32f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 >> 172.21.15.50:0/4201976305 conn(0x7f92340b01b0 msgr2=0x7f92340cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 shutdown_connections 2023-08-10T10:41:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.520+0000 7f92389f3640 1 -- 172.21.15.50:0/4201976305 wait complete. 2023-08-10T10:41:11.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:41:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.772+0000 7f7543fff640 1 Processor -- start 2023-08-10T10:41:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.772+0000 7f7543fff640 1 -- start start 2023-08-10T10:41:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.773+0000 7f7543fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75440cd660 0x7f754406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7543fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75440b1e00 0x7f75440d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7543fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754406a5c0 con 0x7f754415fde0 2023-08-10T10:41:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7543fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754406b0c0 con 0x7f75440cd660 2023-08-10T10:41:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7543fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754406a820 con 0x7f75440b1e00 2023-08-10T10:41:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f75427fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75440cd660 0x7f754406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7542ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f754415fde0 0x7f75440ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:33998/0 (socket says 172.21.15.50:33998) 2023-08-10T10:41:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f7542ffd640 1 -- 172.21.15.50:0/2005028155 learned_addr learned my addr 172.21.15.50:0/2005028155 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.774+0000 7f75437fe640 1 --2- 172.21.15.50:0/2005028155 >> v2:172.21.15.117:3300/0 conn(0x7f75440b1e00 0x7f75440d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.775+0000 7f75427fc640 1 -- 172.21.15.50:0/2005028155 >> v2:172.21.15.117:3300/0 conn(0x7f75440b1e00 msgr2=0x7f75440d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.775+0000 7f75427fc640 1 --2- 172.21.15.50:0/2005028155 >> v2:172.21.15.117:3300/0 conn(0x7f75440b1e00 0x7f75440d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.775+0000 7f75427fc640 1 -- 172.21.15.50:0/2005028155 >> v1:172.21.15.117:6789/0 conn(0x7f754415fde0 legacy=0x7f75440ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.775+0000 7f75427fc640 1 -- 172.21.15.50:0/2005028155 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754406ab00 con 0x7f75440cd660 2023-08-10T10:41:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.776+0000 7f75427fc640 1 --2- 172.21.15.50:0/2005028155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f754406a080 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f75440d36d0 tx=0x7f752c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d30223491720cd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.776+0000 7f7541ffb640 1 -- 172.21.15.50:0/2005028155 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c031520 con 0x7f75440cd660 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.776+0000 7f7541ffb640 1 -- 172.21.15.50:0/2005028155 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c031680 con 0x7f75440cd660 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.776+0000 7f7541ffb640 1 -- 172.21.15.50:0/2005028155 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c031a10 con 0x7f75440cd660 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 -- 172.21.15.50:0/2005028155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 msgr2=0x7f754406a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 --2- 172.21.15.50:0/2005028155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f754406a080 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f75440d36d0 tx=0x7f752c02b7c0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 -- 172.21.15.50:0/2005028155 shutdown_connections 2023-08-10T10:41:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 --2- 172.21.15.50:0/2005028155 >> v2:172.21.15.117:3300/0 conn(0x7f75440b1e00 0x7f75440d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 --2- 172.21.15.50:0/2005028155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f754406a080 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 -- 172.21.15.50:0/2005028155 >> 172.21.15.50:0/2005028155 conn(0x7f75440d2900 msgr2=0x7f75440d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 -- 172.21.15.50:0/2005028155 shutdown_connections 2023-08-10T10:41:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.777+0000 7f7543fff640 1 -- 172.21.15.50:0/2005028155 wait complete. 2023-08-10T10:41:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.780+0000 7f7543fff640 1 Processor -- start 2023-08-10T10:41:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.780+0000 7f7543fff640 1 -- start start 2023-08-10T10:41:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 0x7f754415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754415fde0 0x7f7544147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754415c8c0 con 0x7f75440cd660 2023-08-10T10:41:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754415b9e0 con 0x7f75440b1e00 2023-08-10T10:41:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f7543fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754415bcb0 con 0x7f754415fde0 2023-08-10T10:41:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f75427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f75427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47974/0 (socket says 172.21.15.50:47974) 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.782+0000 7f75427fc640 1 -- 172.21.15.50:0/3821770930 learned_addr learned my addr 172.21.15.50:0/3821770930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f7542ffd640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 0x7f754415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75437fe640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754415fde0 0x7f7544147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 -- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754415fde0 msgr2=0x7f7544147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754415fde0 0x7f7544147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 -- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 msgr2=0x7f754415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 0x7f754415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 -- 172.21.15.50:0/3821770930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009400 con 0x7f75440cd660 2023-08-10T10:41:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f7542ffd640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 0x7f754415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.783+0000 7f75427fc640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f752c000c00 tx=0x7f752c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.784+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c031520 con 0x7f75440cd660 2023-08-10T10:41:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.784+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c033c70 con 0x7f75440cd660 2023-08-10T10:41:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.784+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c03c400 con 0x7f75440cd660 2023-08-10T10:41:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.784+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754415bf90 con 0x7f75440cd660 2023-08-10T10:41:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.784+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754415c550 con 0x7f75440cd660 2023-08-10T10:41:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.785+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754415ca30 con 0x7f75440cd660 2023-08-10T10:41:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.787+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f752c03a040 con 0x7f75440cd660 2023-08-10T10:41:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.788+0000 7f753b7fe640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 0x7f752406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.788+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f752c0ab330 con 0x7f75440cd660 2023-08-10T10:41:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.788+0000 7f7542ffd640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 0x7f752406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.789+0000 7f7542ffd640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 0x7f752406d110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f75340012e0 tx=0x7f7534009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.792+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f752c0764a0 con 0x7f75440cd660 2023-08-10T10:41:11.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.982+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7544066e30 con 0x7f75440cd660 2023-08-10T10:41:11.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.983+0000 7f753b7fe640 1 -- 172.21.15.50:0/3821770930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f752c038020 con 0x7f75440cd660 2023-08-10T10:41:11.985 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:41:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 msgr2=0x7f752406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 0x7f752406d110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f75340012e0 tx=0x7f7534009040 comp rx=0 tx=0).stop 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 msgr2=0x7f75441f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f752c000c00 tx=0x7f752c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 shutdown_connections 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f754415fde0 0x7f7544147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440cd660 0x7f75441f2710 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f752406ac50 0x7f752406d110 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 --2- 172.21.15.50:0/3821770930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75440b1e00 0x7f754415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 >> 172.21.15.50:0/3821770930 conn(0x7f75440d2900 msgr2=0x7f754415f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 shutdown_connections 2023-08-10T10:41:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:11.986+0000 7f7543fff640 1 -- 172.21.15.50:0/3821770930 wait complete. 2023-08-10T10:41:12.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:41:12.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.235+0000 7f623c584640 1 Processor -- start 2023-08-10T10:41:12.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.236+0000 7f623c584640 1 -- start start 2023-08-10T10:41:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.237+0000 7f623c584640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f623415ae40 0x7f62340b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.237+0000 7f623c584640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62340cd9b0 0x7f62340ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.237+0000 7f623c584640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62340adcb0 con 0x7f623406cb30 2023-08-10T10:41:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.237+0000 7f623c584640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623406c320 con 0x7f623415ae40 2023-08-10T10:41:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.237+0000 7f623c584640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623406b770 con 0x7f62340cd9b0 2023-08-10T10:41:12.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f623415ae40 0x7f62340b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f623415ae40 0x7f62340b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47978/0 (socket says 172.21.15.50:47978) 2023-08-10T10:41:12.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 -- 172.21.15.50:0/3160749067 learned_addr learned my addr 172.21.15.50:0/3160749067 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:12.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623ab21640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62340cd9b0 0x7f62340ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 -- 172.21.15.50:0/3160749067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62340cd9b0 msgr2=0x7f62340ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62340cd9b0 0x7f62340ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 -- 172.21.15.50:0/3160749067 >> v1:172.21.15.117:6789/0 conn(0x7f623406cb30 legacy=0x7f62340cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.238+0000 7f623a320640 1 -- 172.21.15.50:0/3160749067 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623406b9f0 con 0x7f623415ae40 2023-08-10T10:41:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.239+0000 7f623a320640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623415ae40 0x7f62340b1510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6230009870 tx=0x7f623002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cba33447610349a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623931e640 1 -- 172.21.15.50:0/3160749067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230031640 con 0x7f623415ae40 2023-08-10T10:41:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623931e640 1 -- 172.21.15.50:0/3160749067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300317a0 con 0x7f623415ae40 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623931e640 1 -- 172.21.15.50:0/3160749067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230031b30 con 0x7f623415ae40 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 -- 172.21.15.50:0/3160749067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623415ae40 msgr2=0x7f62340b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623415ae40 0x7f62340b1510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6230009870 tx=0x7f623002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 -- 172.21.15.50:0/3160749067 shutdown_connections 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62340cd9b0 0x7f62340ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 --2- 172.21.15.50:0/3160749067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623415ae40 0x7f62340b1510 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 -- 172.21.15.50:0/3160749067 >> 172.21.15.50:0/3160749067 conn(0x7f62340b01b0 msgr2=0x7f62340b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 -- 172.21.15.50:0/3160749067 shutdown_connections 2023-08-10T10:41:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.240+0000 7f623c584640 1 -- 172.21.15.50:0/3160749067 wait complete. 2023-08-10T10:41:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.242+0000 7f623c584640 1 Processor -- start 2023-08-10T10:41:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.242+0000 7f623c584640 1 -- start start 2023-08-10T10:41:12.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623406cb30 0x7f62340c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623415ae40 0x7f62340c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623415cb50 con 0x7f62340cd9b0 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623415c1c0 con 0x7f623415ae40 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.243+0000 7f623c584640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62340c89a0 con 0x7f623406cb30 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47986/0 (socket says 172.21.15.50:47986) 2023-08-10T10:41:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 -- 172.21.15.50:0/125628901 learned_addr learned my addr 172.21.15.50:0/125628901 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f623a320640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623406cb30 0x7f62340c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f623ab21640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623415ae40 0x7f62340c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 -- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623406cb30 msgr2=0x7f62340c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623406cb30 0x7f62340c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 -- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623415ae40 msgr2=0x7f62340c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623415ae40 0x7f62340c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.244+0000 7f6239b1f640 1 -- 172.21.15.50:0/125628901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300094d0 con 0x7f62340cd9b0 2023-08-10T10:41:12.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f6239b1f640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f622400b3c0 tx=0x7f622400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224011830 con 0x7f62340cd9b0 2023-08-10T10:41:12.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6224011990 con 0x7f62340cd9b0 2023-08-10T10:41:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224011d80 con 0x7f62340cd9b0 2023-08-10T10:41:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623415b920 con 0x7f62340cd9b0 2023-08-10T10:41:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.245+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623415bee0 con 0x7f62340cd9b0 2023-08-10T10:41:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.246+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623415cc90 con 0x7f62340cd9b0 2023-08-10T10:41:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.247+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f622401b460 con 0x7f62340cd9b0 2023-08-10T10:41:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.248+0000 7f622affd640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 0x7f621806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.248+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6224089100 con 0x7f62340cd9b0 2023-08-10T10:41:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.249+0000 7f623a320640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 0x7f621806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.249+0000 7f623a320640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 0x7f621806d110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6230036000 tx=0x7f623003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.253+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f623415cc90 con 0x7f62340cd9b0 2023-08-10T10:41:12.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:12.452 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:12.453 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:41:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.449+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f623415cc90 con 0x7f62340cd9b0 2023-08-10T10:41:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.450+0000 7f622affd640 1 -- 172.21.15.50:0/125628901 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f623415cc90 con 0x7f62340cd9b0 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 msgr2=0x7f621806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 0x7f621806d110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6230036000 tx=0x7f623003c040 comp rx=0 tx=0).stop 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 msgr2=0x7f623415b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f622400b3c0 tx=0x7f622400b880 comp rx=0 tx=0).stop 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 shutdown_connections 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f621806ac50 0x7f621806d110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623415ae40 0x7f62340c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62340cd9b0 0x7f623415b220 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 --2- 172.21.15.50:0/125628901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623406cb30 0x7f62340c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.452+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 >> 172.21.15.50:0/125628901 conn(0x7f62340b01b0 msgr2=0x7f62340ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.453+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 shutdown_connections 2023-08-10T10:41:12.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.453+0000 7f623c584640 1 -- 172.21.15.50:0/125628901 wait complete. 2023-08-10T10:41:12.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:41:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.746+0000 7f29bb59e640 1 Processor -- start 2023-08-10T10:41:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.746+0000 7f29bb59e640 1 -- start start 2023-08-10T10:41:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29bc15ff90 0x7f29bc160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bb59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29bc0d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bb59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc160370 con 0x7f29bc0cd960 2023-08-10T10:41:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bb59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0d0b90 con 0x7f29bc15ff90 2023-08-10T10:41:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bb59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1614d0 con 0x7f29bc0d28b0 2023-08-10T10:41:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29b1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29bc0cd960 0x7f29bc0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54832/0 (socket says 172.21.15.50:54832) 2023-08-10T10:41:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29b1d9b640 1 -- 172.21.15.50:0/558463942 learned_addr learned my addr 172.21.15.50:0/558463942 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29ba59c640 1 --2- 172.21.15.50:0/558463942 >> v2:172.21.15.117:3300/0 conn(0x7f29bc15ff90 0x7f29bc160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.748+0000 7f29bad9d640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29bc0d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149271052 0 0) 0x7f29a4001110 con 0x7f29bc0cd960 2023-08-10T10:41:12.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a8003520 con 0x7f29bc0cd960 2023-08-10T10:41:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905619973 0 0) 0x7f29a8003520 con 0x7f29bc0cd960 2023-08-10T10:41:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 msgr2=0x7f29bc0d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29bc0d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 >> v2:172.21.15.117:3300/0 conn(0x7f29bc15ff90 msgr2=0x7f29bc160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 --2- 172.21.15.50:0/558463942 >> v2:172.21.15.117:3300/0 conn(0x7f29bc15ff90 0x7f29bc160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0d3240 con 0x7f29bc0cd960 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f29a4001800 con 0x7f29bc0cd960 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 >> v1:172.21.15.50:6789/0 conn(0x7f29bc0cd960 legacy=0x7f29bc0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80039e0 0x7f29a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0d0b90 con 0x7f29a8004d00 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1614d0 con 0x7f29a80039e0 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.749+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a800b980 con 0x7f29bc0d28b0 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29ba59c640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80039e0 0x7f29a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29b1d9b640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 -- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 msgr2=0x7f29a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc0d28b0 0x7f29a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 -- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80039e0 msgr2=0x7f29a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80039e0 0x7f29a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.750+0000 7f29bad9d640 1 -- 172.21.15.50:0/558463942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8003520 con 0x7f29a8004d00 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.751+0000 7f29bad9d640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29a8005180 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009fc0 tx=0x7f29a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df94299bf22250eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.751+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b402cc20 con 0x7f29a8004d00 2023-08-10T10:41:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400f040 con 0x7f29a8004d00 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29b9d9b640 1 -- 172.21.15.50:0/558463942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4034440 con 0x7f29a8004d00 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 -- 172.21.15.50:0/558463942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 msgr2=0x7f29a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 --2- 172.21.15.50:0/558463942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29a8005180 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009fc0 tx=0x7f29a80057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bad9d640 1 -- 172.21.15.50:0/558463942 reap_dead start 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 -- 172.21.15.50:0/558463942 shutdown_connections 2023-08-10T10:41:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 -- 172.21.15.50:0/558463942 >> 172.21.15.50:0/558463942 conn(0x7f29bc069ac0 msgr2=0x7f29bc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 -- 172.21.15.50:0/558463942 shutdown_connections 2023-08-10T10:41:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.752+0000 7f29bb59e640 1 -- 172.21.15.50:0/558463942 wait complete. 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.754+0000 7f29bb59e640 1 Processor -- start 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.754+0000 7f29bb59e640 1 -- start start 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29bc0cb5e0 0x7f29bc1f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc1586c0 0x7f29bc158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b4040 con 0x7f29a8004d00 2023-08-10T10:41:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b3190 con 0x7f29bc0cb5e0 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29bb59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b3430 con 0x7f29bc1586c0 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29ba59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29ba59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48002/0 (socket says 172.21.15.50:48002) 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.755+0000 7f29ba59c640 1 -- 172.21.15.50:0/634766995 learned_addr learned my addr 172.21.15.50:0/634766995 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 -- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc1586c0 msgr2=0x7f29bc158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc1586c0 0x7f29bc158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 -- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29bc0cb5e0 msgr2=0x7f29bc1f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29bc0cb5e0 0x7f29bc1f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 -- 172.21.15.50:0/634766995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0b3710 con 0x7f29a8004d00 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29ba59c640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0116d0 tx=0x7f29ac011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00f940 con 0x7f29a8004d00 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00faa0 con 0x7f29a8004d00 2023-08-10T10:41:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00fe10 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.756+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0b39f0 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.757+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc1f6150 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.758+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc066e30 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.759+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f29ac015460 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.760+0000 7f29b37fe640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 0x7f299c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.760+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f29ac0899a0 con 0x7f29a8004d00 2023-08-10T10:41:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.760+0000 7f29b1d9b640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 0x7f299c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.761+0000 7f29b1d9b640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 0x7f299c06d140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29a40012b0 tx=0x7f29a4001e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.764+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f29ac054ab0 con 0x7f29a8004d00 2023-08-10T10:41:12.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.960+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29bc0d05c0 con 0x7f29a8004d00 2023-08-10T10:41:12.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.961+0000 7f29b37fe640 1 -- 172.21.15.50:0/634766995 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29ac022020 con 0x7f29a8004d00 2023-08-10T10:41:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:41:12.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.963+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 msgr2=0x7f299c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.963+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 0x7f299c06d140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29a40012b0 tx=0x7f29a4001e10 comp rx=0 tx=0).stop 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.963+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 msgr2=0x7f29bc0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.963+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0116d0 tx=0x7f29ac011b90 comp rx=0 tx=0).stop 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 shutdown_connections 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29bc1586c0 0x7f29bc158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f299c06ac80 0x7f299c06d140 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29bc0cb5e0 0x7f29bc1f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 --2- 172.21.15.50:0/634766995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a8004d00 0x7f29bc0b2c50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 >> 172.21.15.50:0/634766995 conn(0x7f29bc069ac0 msgr2=0x7f29bc15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 shutdown_connections 2023-08-10T10:41:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:12.964+0000 7f29bb59e640 1 -- 172.21.15.50:0/634766995 wait complete. 2023-08-10T10:41:12.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:41:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.215+0000 7fde5b86a640 1 Processor -- start 2023-08-10T10:41:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.215+0000 7fde5b86a640 1 -- start start 2023-08-10T10:41:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde5b86a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde540cf7d0 0x7fde5406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde5b86a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde540c9c60 0x7fde540ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde5b86a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5415d0a0 con 0x7fde5415cb30 2023-08-10T10:41:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde5b86a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540ccb60 con 0x7fde540cf7d0 2023-08-10T10:41:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde5b86a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5415d380 con 0x7fde540c9c60 2023-08-10T10:41:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde59606640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde540cf7d0 0x7fde5406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde58e05640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde5415cb30 0x7fde540c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54834/0 (socket says 172.21.15.50:54834) 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde58e05640 1 -- 172.21.15.50:0/3421401718 learned_addr learned my addr 172.21.15.50:0/3421401718 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.217+0000 7fde59e07640 1 --2- 172.21.15.50:0/3421401718 >> v2:172.21.15.117:3300/0 conn(0x7fde540c9c60 0x7fde540ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.218+0000 7fde59606640 1 -- 172.21.15.50:0/3421401718 >> v2:172.21.15.117:3300/0 conn(0x7fde540c9c60 msgr2=0x7fde540ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.218+0000 7fde59606640 1 --2- 172.21.15.50:0/3421401718 >> v2:172.21.15.117:3300/0 conn(0x7fde540c9c60 0x7fde540ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.218+0000 7fde59606640 1 -- 172.21.15.50:0/3421401718 >> v1:172.21.15.50:6789/0 conn(0x7fde5415cb30 legacy=0x7fde540c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.218+0000 7fde59606640 1 -- 172.21.15.50:0/3421401718 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5415d660 con 0x7fde540cf7d0 2023-08-10T10:41:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.218+0000 7fde4bfff640 1 -- 172.21.15.50:0/3421401718 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477327958 0 0) 0x7fde5415d0a0 con 0x7fde5415cb30 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.219+0000 7fde59606640 1 --2- 172.21.15.50:0/3421401718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540cf7d0 0x7fde5406c4a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde540ccad0 tx=0x7fde5002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec2ee85646b1a8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.219+0000 7fde4bfff640 1 -- 172.21.15.50:0/3421401718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5002cc70 con 0x7fde540cf7d0 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.219+0000 7fde4bfff640 1 -- 172.21.15.50:0/3421401718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5002cdd0 con 0x7fde540cf7d0 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.219+0000 7fde4bfff640 1 -- 172.21.15.50:0/3421401718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50034660 con 0x7fde540cf7d0 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 -- 172.21.15.50:0/3421401718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540cf7d0 msgr2=0x7fde5406c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 --2- 172.21.15.50:0/3421401718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540cf7d0 0x7fde5406c4a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde540ccad0 tx=0x7fde5002bec0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 -- 172.21.15.50:0/3421401718 shutdown_connections 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 --2- 172.21.15.50:0/3421401718 >> v2:172.21.15.117:3300/0 conn(0x7fde540c9c60 0x7fde540ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 --2- 172.21.15.50:0/3421401718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540cf7d0 0x7fde5406c4a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 -- 172.21.15.50:0/3421401718 >> 172.21.15.50:0/3421401718 conn(0x7fde540698b0 msgr2=0x7fde54069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 -- 172.21.15.50:0/3421401718 shutdown_connections 2023-08-10T10:41:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.220+0000 7fde5b86a640 1 -- 172.21.15.50:0/3421401718 wait complete. 2023-08-10T10:41:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.222+0000 7fde5b86a640 1 Processor -- start 2023-08-10T10:41:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.222+0000 7fde5b86a640 1 -- start start 2023-08-10T10:41:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde540cf7d0 0x7fde540ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5415cb30 0x7fde540c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ad830 con 0x7fde540c9c60 2023-08-10T10:41:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ad270 con 0x7fde5415cb30 2023-08-10T10:41:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.223+0000 7fde5b86a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ad550 con 0x7fde540cf7d0 2023-08-10T10:41:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48026/0 (socket says 172.21.15.50:48026) 2023-08-10T10:41:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 -- 172.21.15.50:0/2574388291 learned_addr learned my addr 172.21.15.50:0/2574388291 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59e07640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5415cb30 0x7fde540c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde58e05640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde540cf7d0 0x7fde540ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 -- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde540cf7d0 msgr2=0x7fde540ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde540cf7d0 0x7fde540ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 -- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5415cb30 msgr2=0x7fde540c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5415cb30 0x7fde540c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.224+0000 7fde59606640 1 -- 172.21.15.50:0/2574388291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009a70 con 0x7fde540c9c60 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde59606640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde50009e80 tx=0x7fde50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50003b90 con 0x7fde540c9c60 2023-08-10T10:41:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50003cf0 con 0x7fde540c9c60 2023-08-10T10:41:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde541596e0 con 0x7fde540c9c60 2023-08-10T10:41:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50004220 con 0x7fde540c9c60 2023-08-10T10:41:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.225+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde541f2f10 con 0x7fde540c9c60 2023-08-10T10:41:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.226+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54159c00 con 0x7fde540c9c60 2023-08-10T10:41:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.227+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde5003b050 con 0x7fde540c9c60 2023-08-10T10:41:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.228+0000 7fde49ffb640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 0x7fde3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.228+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fde500abb00 con 0x7fde540c9c60 2023-08-10T10:41:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.229+0000 7fde58e05640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 0x7fde3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.229+0000 7fde58e05640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 0x7fde3806d110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde540cea30 tx=0x7fde44007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.233+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde54159c00 con 0x7fde540c9c60 2023-08-10T10:41:13.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.436+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde54159c00 con 0x7fde540c9c60 2023-08-10T10:41:13.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.437+0000 7fde49ffb640 1 -- 172.21.15.50:0/2574388291 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde54159c00 con 0x7fde540c9c60 2023-08-10T10:41:13.438 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:41:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 msgr2=0x7fde3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 0x7fde3806d110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde540cea30 tx=0x7fde44007b50 comp rx=0 tx=0).stop 2023-08-10T10:41:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 msgr2=0x7fde541f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde50009e80 tx=0x7fde50004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 shutdown_connections 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde3806ac50 0x7fde3806d110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5415cb30 0x7fde540c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde540cf7d0 0x7fde540ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 --2- 172.21.15.50:0/2574388291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde540c9c60 0x7fde541f29d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.439+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 >> 172.21.15.50:0/2574388291 conn(0x7fde540698b0 msgr2=0x7fde5406f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.440+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 shutdown_connections 2023-08-10T10:41:13.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:13.440+0000 7fde5b86a640 1 -- 172.21.15.50:0/2574388291 wait complete. 2023-08-10T10:41:13.461 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:41:13.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:13.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:41:13.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:41:13.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:13.589 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:41:13.639 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:13.639 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:13.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:41:13.704 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:13.704 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:13.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:41:13.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:14.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.006+0000 7fa562ea7640 1 Processor -- start 2023-08-10T10:41:14.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.007+0000 7fa562ea7640 1 -- start start 2023-08-10T10:41:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.008+0000 7fa562ea7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.008+0000 7fa562ea7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55c0b8430 0x7fa55c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.008+0000 7fa562ea7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c161180 con 0x7fa55c0cddb0 2023-08-10T10:41:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.008+0000 7fa562ea7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0ce240 con 0x7fa55c0b8430 2023-08-10T10:41:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.008+0000 7fa562ea7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b5bd0 con 0x7fa55c15cd60 2023-08-10T10:41:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.009+0000 7fa560c43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.009+0000 7fa55bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55c0b8430 0x7fa55c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.009+0000 7fa560c43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:51764/0 (socket says 172.21.15.50:51764) 2023-08-10T10:41:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.009+0000 7fa560c43640 1 -- 172.21.15.50:0/1998729563 learned_addr learned my addr 172.21.15.50:0/1998729563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.010+0000 7fa560c43640 1 -- 172.21.15.50:0/1998729563 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0b8430 msgr2=0x7fa55c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.010+0000 7fa560c43640 1 --2- 172.21.15.50:0/1998729563 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0b8430 0x7fa55c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.010+0000 7fa560c43640 1 -- 172.21.15.50:0/1998729563 >> v1:172.21.15.117:6789/0 conn(0x7fa55c0cddb0 legacy=0x7fa55c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.010+0000 7fa560c43640 1 -- 172.21.15.50:0/1998729563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c161460 con 0x7fa55c15cd60 2023-08-10T10:41:14.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.011+0000 7fa560c43640 1 --2- 172.21.15.50:0/1998729563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168723e6aa6fee89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.012+0000 7fa55b7fe640 1 -- 172.21.15.50:0/1998729563 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c02cb90 con 0x7fa55c15cd60 2023-08-10T10:41:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.012+0000 7fa55b7fe640 1 -- 172.21.15.50:0/1998729563 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c02ccf0 con 0x7fa55c15cd60 2023-08-10T10:41:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.012+0000 7fa55b7fe640 1 -- 172.21.15.50:0/1998729563 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c034610 con 0x7fa55c15cd60 2023-08-10T10:41:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 -- 172.21.15.50:0/1998729563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 msgr2=0x7fa55c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1998729563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c02bff0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 -- 172.21.15.50:0/1998729563 shutdown_connections 2023-08-10T10:41:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1998729563 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0b8430 0x7fa55c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1998729563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c15cd60 0x7fa55c160930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 -- 172.21.15.50:0/1998729563 >> 172.21.15.50:0/1998729563 conn(0x7fa55c0d2ac0 msgr2=0x7fa55c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 -- 172.21.15.50:0/1998729563 shutdown_connections 2023-08-10T10:41:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.013+0000 7fa562ea7640 1 -- 172.21.15.50:0/1998729563 wait complete. 2023-08-10T10:41:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.015+0000 7fa562ea7640 1 Processor -- start 2023-08-10T10:41:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.015+0000 7fa562ea7640 1 -- start start 2023-08-10T10:41:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cddb0 0x7fa55c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c15cd60 0x7fa55c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c9b00 con 0x7fa55c0b8430 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b4390 con 0x7fa55c15cd60 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa562ea7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15dfa0 con 0x7fa55c0cddb0 2023-08-10T10:41:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa560c43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa560c43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48034/0 (socket says 172.21.15.50:48034) 2023-08-10T10:41:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa560c43640 1 -- 172.21.15.50:0/1831542530 learned_addr learned my addr 172.21.15.50:0/1831542530 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.016+0000 7fa561444640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c15cd60 0x7fa55c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa55bfff640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cddb0 0x7fa55c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 -- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cddb0 msgr2=0x7fa55c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cddb0 0x7fa55c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 -- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c15cd60 msgr2=0x7fa55c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c15cd60 0x7fa55c15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 -- 172.21.15.50:0/1831542530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009b30 con 0x7fa55c0b8430 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa560c43640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c03e450 con 0x7fa55c0b8430 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c03e5f0 con 0x7fa55c0b8430 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c03e9a0 con 0x7fa55c0b8430 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.017+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c15e280 con 0x7fa55c0b8430 2023-08-10T10:41:14.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.018+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c15e840 con 0x7fa55c0b8430 2023-08-10T10:41:14.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.019+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c04e270 con 0x7fa55c0b8430 2023-08-10T10:41:14.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.020+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa54c03eb00 con 0x7fa55c0b8430 2023-08-10T10:41:14.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.021+0000 7fa5597fa640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 0x7fa54806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.021+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa54c0ac100 con 0x7fa55c0b8430 2023-08-10T10:41:14.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.021+0000 7fa55bfff640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 0x7fa54806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.022+0000 7fa55bfff640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 0x7fa54806d110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0cd3b0 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.026+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa54c077160 con 0x7fa55c0b8430 2023-08-10T10:41:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.258+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa55c0c97c0 con 0x7fa55c0b8430 2023-08-10T10:41:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.259+0000 7fa5597fa640 1 -- 172.21.15.50:0/1831542530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fa54c02ce60 con 0x7fa55c0b8430 2023-08-10T10:41:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:14.261 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:41:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:41:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 msgr2=0x7fa54806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 0x7fa54806d110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0cd3b0 tx=0x7fa550008040 comp rx=0 tx=0).stop 2023-08-10T10:41:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 msgr2=0x7fa55c0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 shutdown_connections 2023-08-10T10:41:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa54806ac50 0x7fa54806d110 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c15cd60 0x7fa55c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cddb0 0x7fa55c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 --2- 172.21.15.50:0/1831542530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa55c0b8430 0x7fa55c0b3e50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 >> 172.21.15.50:0/1831542530 conn(0x7fa55c0d2ac0 msgr2=0x7fa55c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 shutdown_connections 2023-08-10T10:41:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.262+0000 7fa562ea7640 1 -- 172.21.15.50:0/1831542530 wait complete. 2023-08-10T10:41:14.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.507+0000 7fe10d767640 1 Processor -- start 2023-08-10T10:41:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.507+0000 7fe10d767640 1 -- start start 2023-08-10T10:41:14.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.508+0000 7fe10d767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 0x7fe1080d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.508+0000 7fe10d767640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 0x7fe1080b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.508+0000 7fe10d767640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1080d1630 con 0x7fe1080d22e0 2023-08-10T10:41:14.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.508+0000 7fe10d767640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080d0a20 con 0x7fe1080cfdf0 2023-08-10T10:41:14.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.508+0000 7fe10d767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080d0d00 con 0x7fe10815cb90 2023-08-10T10:41:14.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.509+0000 7fe0ff7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1080d22e0 0x7fe1080cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54848/0 (socket says 172.21.15.50:54848) 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.509+0000 7fe0ff7fe640 1 -- 172.21.15.50:0/1996475243 learned_addr learned my addr 172.21.15.50:0/1996475243 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.509+0000 7fe10cf66640 1 --2- 172.21.15.50:0/1996475243 >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 0x7fe1080b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.509+0000 7fe107fff640 1 --2- 172.21.15.50:0/1996475243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 0x7fe1080d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.509+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602361621 0 0) 0x7fe1080d1630 con 0x7fe1080d22e0 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f4003520 con 0x7fe1080d22e0 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe107fff640 1 -- 172.21.15.50:0/1996475243 >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 msgr2=0x7fe1080b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe107fff640 1 --2- 172.21.15.50:0/1996475243 >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 0x7fe1080b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe107fff640 1 -- 172.21.15.50:0/1996475243 >> v1:172.21.15.50:6789/0 conn(0x7fe1080d22e0 legacy=0x7fe1080cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727797996 0 0) 0x7fe0f4003520 con 0x7fe1080d22e0 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe107fff640 1 -- 172.21.15.50:0/1996475243 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1080d0fe0 con 0x7fe10815cb90 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.510+0000 7fe10cf66640 1 --2- 172.21.15.50:0/1996475243 >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 0x7fe1080b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.511+0000 7fe107fff640 1 --2- 172.21.15.50:0/1996475243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 0x7fe1080d1da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009d90 tx=0x7fe0f802bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb05a3cc9280e2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.512+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0001670 con 0x7fe10815cb90 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.512+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f802c810 con 0x7fe10815cb90 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.512+0000 7fe1077fe640 1 -- 172.21.15.50:0/1996475243 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f802cba0 con 0x7fe10815cb90 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.512+0000 7fe10d767640 1 -- 172.21.15.50:0/1996475243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 msgr2=0x7fe1080d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.512+0000 7fe10d767640 1 --2- 172.21.15.50:0/1996475243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 0x7fe1080d1da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009d90 tx=0x7fe0f802bce0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 -- 172.21.15.50:0/1996475243 shutdown_connections 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 --2- 172.21.15.50:0/1996475243 >> v2:172.21.15.117:3300/0 conn(0x7fe1080cfdf0 0x7fe1080b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 --2- 172.21.15.50:0/1996475243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10815cb90 0x7fe1080d1da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 -- 172.21.15.50:0/1996475243 >> 172.21.15.50:0/1996475243 conn(0x7fe108069880 msgr2=0x7fe108069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 -- 172.21.15.50:0/1996475243 shutdown_connections 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.513+0000 7fe10d767640 1 -- 172.21.15.50:0/1996475243 wait complete. 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.515+0000 7fe10d767640 1 Processor -- start 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.515+0000 7fe10d767640 1 -- start start 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080cfdf0 0x7fe10815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080d22e0 0x7fe108158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080b10f0 con 0x7fe1080ca330 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080caea0 con 0x7fe1080cfdf0 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10d767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080ca8e0 con 0x7fe1080d22e0 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10cf66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10cf66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48042/0 (socket says 172.21.15.50:48042) 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe10cf66640 1 -- 172.21.15.50:0/995134570 learned_addr learned my addr 172.21.15.50:0/995134570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe0ff7fe640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080d22e0 0x7fe108158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.516+0000 7fe107fff640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080cfdf0 0x7fe10815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 -- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080d22e0 msgr2=0x7fe108158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080d22e0 0x7fe108158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 -- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080cfdf0 msgr2=0x7fe10815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080cfdf0 0x7fe10815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 -- 172.21.15.50:0/995134570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009400 con 0x7fe1080ca330 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10cf66640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e930 tx=0x7fe10000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100009700 con 0x7fe1080ca330 2023-08-10T10:41:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10000ca00 con 0x7fe1080ca330 2023-08-10T10:41:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.517+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f8009a70 con 0x7fe1080ca330 2023-08-10T10:41:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.518+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10000cd90 con 0x7fe1080ca330 2023-08-10T10:41:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.518+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10815d0a0 con 0x7fe1080ca330 2023-08-10T10:41:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.519+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe108066e30 con 0x7fe1080ca330 2023-08-10T10:41:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.520+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe100004030 con 0x7fe1080ca330 2023-08-10T10:41:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.521+0000 7fe1057fa640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 0x7fe0e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.521+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe100089900 con 0x7fe1080ca330 2023-08-10T10:41:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.521+0000 7fe107fff640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 0x7fe0e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.522+0000 7fe107fff640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 0x7fe0e806d110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036000 tx=0x7fe0f8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.525+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe100054a20 con 0x7fe1080ca330 2023-08-10T10:41:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.720+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe10815fe60 con 0x7fe1080ca330 2023-08-10T10:41:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.723+0000 7fe1057fa640 1 -- 172.21.15.50:0/995134570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fe100020090 con 0x7fe1080ca330 2023-08-10T10:41:14.725 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:14.726 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:08.497772+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.2a","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 msgr2=0x7fe0e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 0x7fe0e806d110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036000 tx=0x7fe0f8030000 comp rx=0 tx=0).stop 2023-08-10T10:41:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 msgr2=0x7fe1080cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e930 tx=0x7fe10000edf0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 shutdown_connections 2023-08-10T10:41:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1080ca330 0x7fe1080cb9a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080d22e0 0x7fe108158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe0e806ac50 0x7fe0e806d110 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 --2- 172.21.15.50:0/995134570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080cfdf0 0x7fe10815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 >> 172.21.15.50:0/995134570 conn(0x7fe108069880 msgr2=0x7fe1080cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 shutdown_connections 2023-08-10T10:41:14.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.726+0000 7fe10d767640 1 -- 172.21.15.50:0/995134570 wait complete. 2023-08-10T10:41:14.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:40:22.656712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:40:23.288053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:41:14.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:41:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.976+0000 7f67d0d39640 1 Processor -- start 2023-08-10T10:41:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.976+0000 7f67d0d39640 1 -- start start 2023-08-10T10:41:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.978+0000 7f67d0d39640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67cc0cd9b0 0x7f67cc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.978+0000 7f67d0d39640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67cc06cb30 0x7f67cc0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.978+0000 7f67d0d39640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc0adcb0 con 0x7f67cc15ae40 2023-08-10T10:41:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.978+0000 7f67d0d39640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67cc06c320 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.978+0000 7f67d0d39640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67cc06b770 con 0x7f67cc06cb30 2023-08-10T10:41:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67cc0cd9b0 0x7f67cc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67cc0cd9b0 0x7f67cc0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58418/0 (socket says 172.21.15.50:58418) 2023-08-10T10:41:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 -- 172.21.15.50:0/1644855174 learned_addr learned my addr 172.21.15.50:0/1644855174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67cad9d640 1 --2- 172.21.15.50:0/1644855174 >> v2:172.21.15.117:3300/0 conn(0x7f67cc06cb30 0x7f67cc0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 -- 172.21.15.50:0/1644855174 >> v2:172.21.15.117:3300/0 conn(0x7f67cc06cb30 msgr2=0x7f67cc0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 --2- 172.21.15.50:0/1644855174 >> v2:172.21.15.117:3300/0 conn(0x7f67cc06cb30 0x7f67cc0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 -- 172.21.15.50:0/1644855174 >> v1:172.21.15.117:6789/0 conn(0x7f67cc15ae40 legacy=0x7f67cc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.979+0000 7f67c1d9b640 1 -- 172.21.15.50:0/1644855174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc06b9f0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.980+0000 7f67c1d9b640 1 --2- 172.21.15.50:0/1644855174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc0b1510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0b0d60 tx=0x7f67b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97715f70cac89d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67c9d9b640 1 -- 172.21.15.50:0/1644855174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b402ca80 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67c9d9b640 1 -- 172.21.15.50:0/1644855174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b402cbe0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67c9d9b640 1 -- 172.21.15.50:0/1644855174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40343f0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 -- 172.21.15.50:0/1644855174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 msgr2=0x7f67cc0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 --2- 172.21.15.50:0/1644855174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc0b1510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0b0d60 tx=0x7f67b402bee0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 -- 172.21.15.50:0/1644855174 shutdown_connections 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 --2- 172.21.15.50:0/1644855174 >> v2:172.21.15.117:3300/0 conn(0x7f67cc06cb30 0x7f67cc0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 --2- 172.21.15.50:0/1644855174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc0b1510 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 -- 172.21.15.50:0/1644855174 >> 172.21.15.50:0/1644855174 conn(0x7f67cc0b01b0 msgr2=0x7f67cc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 -- 172.21.15.50:0/1644855174 shutdown_connections 2023-08-10T10:41:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.981+0000 7f67d0d39640 1 -- 172.21.15.50:0/1644855174 wait complete. 2023-08-10T10:41:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.983+0000 7f67d0d39640 1 Processor -- start 2023-08-10T10:41:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.983+0000 7f67d0d39640 1 -- start start 2023-08-10T10:41:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67cc06cb30 0x7f67cc14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67cc15ae40 0x7f67cc0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc0c67e0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc0c2700 con 0x7f67cc15ae40 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67d0d39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc15bc00 con 0x7f67cc06cb30 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.984+0000 7f67c1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58422/0 (socket says 172.21.15.50:58422) 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 -- 172.21.15.50:0/3012444751 learned_addr learned my addr 172.21.15.50:0/3012444751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 -- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67cc06cb30 msgr2=0x7f67cc14ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67cc06cb30 0x7f67cc14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 -- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67cc15ae40 msgr2=0x7f67cc0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67cc15ae40 0x7f67cc0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 -- 172.21.15.50:0/3012444751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009b30 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.985+0000 7f67c1d9b640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f67b4036040 tx=0x7f67b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.986+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4009510 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.986+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b403e450 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.986+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b403e800 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.986+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc15bee0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.986+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc15c4a0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.987+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67cc15c6c0 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.988+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67b402cd50 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.989+0000 7f67c37fe640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 0x7f67ac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.989+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f67b40ac050 con 0x7f67cc0cd9b0 2023-08-10T10:41:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.989+0000 7f67ca59c640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 0x7f67ac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.990+0000 7f67ca59c640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 0x7f67ac06d110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f67bc006fd0 tx=0x7f67bc006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:14.993+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f67b40de330 con 0x7f67cc0cd9b0 2023-08-10T10:41:15.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.186+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67cc0adad0 con 0x7f67cc0cd9b0 2023-08-10T10:41:15.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.187+0000 7f67c37fe640 1 -- 172.21.15.50:0/3012444751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67b4043020 con 0x7f67cc0cd9b0 2023-08-10T10:41:15.189 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:41:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 msgr2=0x7f67ac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 0x7f67ac06d110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f67bc006fd0 tx=0x7f67bc006bc0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 msgr2=0x7f67cc15b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f67b4036040 tx=0x7f67b4004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 shutdown_connections 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f67ac06ac50 0x7f67ac06d110 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67cc15ae40 0x7f67cc0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0cd9b0 0x7f67cc15b220 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 --2- 172.21.15.50:0/3012444751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67cc06cb30 0x7f67cc14ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 >> 172.21.15.50:0/3012444751 conn(0x7f67cc0b01b0 msgr2=0x7f67cc0ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 shutdown_connections 2023-08-10T10:41:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.190+0000 7f67d0d39640 1 -- 172.21.15.50:0/3012444751 wait complete. 2023-08-10T10:41:15.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:41:15.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.430+0000 7f674b646640 1 Processor -- start 2023-08-10T10:41:15.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.431+0000 7f674b646640 1 -- start start 2023-08-10T10:41:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.432+0000 7f674b646640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f674415cb90 0x7f67440b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.432+0000 7f674b646640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cf70 0x7f6744160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.432+0000 7f674b646640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6744160a40 con 0x7f67440b4640 2023-08-10T10:41:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.432+0000 7f674b646640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67440b4bb0 con 0x7f674415cb90 2023-08-10T10:41:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.432+0000 7f674b646640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440b4e90 con 0x7f674415cf70 2023-08-10T10:41:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f674415cb90 0x7f67440b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f674415cb90 0x7f67440b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58428/0 (socket says 172.21.15.50:58428) 2023-08-10T10:41:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 -- 172.21.15.50:0/4200178696 learned_addr learned my addr 172.21.15.50:0/4200178696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f6748be1640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cf70 0x7f6744160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 -- 172.21.15.50:0/4200178696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cf70 msgr2=0x7f6744160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cf70 0x7f6744160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 -- 172.21.15.50:0/4200178696 >> v1:172.21.15.117:6789/0 conn(0x7f67440b4640 legacy=0x7f674406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:15.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.433+0000 7f67493e2640 1 -- 172.21.15.50:0/4200178696 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440b5170 con 0x7f674415cb90 2023-08-10T10:41:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.434+0000 7f67493e2640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cb90 0x7f67440b5dd0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc7259acfd24fac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.435+0000 7f673bfff640 1 -- 172.21.15.50:0/4200178696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740031640 con 0x7f674415cb90 2023-08-10T10:41:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.435+0000 7f673bfff640 1 -- 172.21.15.50:0/4200178696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67400317a0 con 0x7f674415cb90 2023-08-10T10:41:15.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.435+0000 7f673bfff640 1 -- 172.21.15.50:0/4200178696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740031b30 con 0x7f674415cb90 2023-08-10T10:41:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 -- 172.21.15.50:0/4200178696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cb90 msgr2=0x7f67440b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cb90 0x7f67440b5dd0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 -- 172.21.15.50:0/4200178696 shutdown_connections 2023-08-10T10:41:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cf70 0x7f6744160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 --2- 172.21.15.50:0/4200178696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cb90 0x7f67440b5dd0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.436+0000 7f674b646640 1 -- 172.21.15.50:0/4200178696 >> 172.21.15.50:0/4200178696 conn(0x7f67440cf640 msgr2=0x7f67440cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.437+0000 7f674b646640 1 -- 172.21.15.50:0/4200178696 shutdown_connections 2023-08-10T10:41:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.437+0000 7f674b646640 1 -- 172.21.15.50:0/4200178696 wait complete. 2023-08-10T10:41:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.438+0000 7f674b646640 1 Processor -- start 2023-08-10T10:41:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.439+0000 7f674b646640 1 -- start start 2023-08-10T10:41:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67440b4640 0x7f6744149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cb90 0x7f674415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67441601f0 con 0x7f674415cf70 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674415d7a0 con 0x7f67440b4640 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f674b646640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440c9450 con 0x7f674415cb90 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f6749be3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f6749be3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58440/0 (socket says 172.21.15.50:58440) 2023-08-10T10:41:15.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f6749be3640 1 -- 172.21.15.50:0/3962908835 learned_addr learned my addr 172.21.15.50:0/3962908835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:15.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f67493e2640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67440b4640 0x7f6744149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.440+0000 7f6748be1640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cb90 0x7f674415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 -- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cb90 msgr2=0x7f674415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cb90 0x7f674415fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 -- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67440b4640 msgr2=0x7f6744149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67440b4640 0x7f6744149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 -- 172.21.15.50:0/3962908835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400094d0 con 0x7f674415cf70 2023-08-10T10:41:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6749be3640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c780 tx=0x7f673c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c004b60 con 0x7f674415cf70 2023-08-10T10:41:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c00ce90 con 0x7f674415cf70 2023-08-10T10:41:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.441+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c00a850 con 0x7f674415cf70 2023-08-10T10:41:15.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.442+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67440c8e90 con 0x7f674415cf70 2023-08-10T10:41:15.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.442+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674415d430 con 0x7f674415cf70 2023-08-10T10:41:15.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.443+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674415d930 con 0x7f674415cf70 2023-08-10T10:41:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.444+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f673c00a9b0 con 0x7f674415cf70 2023-08-10T10:41:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.445+0000 7f6739ffb640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 0x7f672806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.445+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f673c0894b0 con 0x7f674415cf70 2023-08-10T10:41:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.445+0000 7f67493e2640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 0x7f672806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.446+0000 7f67493e2640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 0x7f672806d110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6740036000 tx=0x7f674003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.449+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f673c054660 con 0x7f674415cf70 2023-08-10T10:41:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.643+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67440612b0 con 0x7f674415cf70 2023-08-10T10:41:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.644+0000 7f6739ffb640 1 -- 172.21.15.50:0/3962908835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f673c057c80 con 0x7f674415cf70 2023-08-10T10:41:15.646 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:41:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 msgr2=0x7f672806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 0x7f672806d110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6740036000 tx=0x7f674003c040 comp rx=0 tx=0).stop 2023-08-10T10:41:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 msgr2=0x7f6744155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c780 tx=0x7f673c00cc40 comp rx=0 tx=0).stop 2023-08-10T10:41:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 shutdown_connections 2023-08-10T10:41:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674415cf70 0x7f6744155700 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f674415cb90 0x7f674415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f672806ac50 0x7f672806d110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 --2- 172.21.15.50:0/3962908835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67440b4640 0x7f6744149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 >> 172.21.15.50:0/3962908835 conn(0x7f67440cf640 msgr2=0x7f67441571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 shutdown_connections 2023-08-10T10:41:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.647+0000 7f674b646640 1 -- 172.21.15.50:0/3962908835 wait complete. 2023-08-10T10:41:15.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:41:15.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.886+0000 7f8459235640 1 Processor -- start 2023-08-10T10:41:15.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.886+0000 7f8459235640 1 -- start start 2023-08-10T10:41:15.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8459235640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f845415a800 0x7f84540cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8459235640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f845415abe0 0x7f8454071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8459235640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845406c380 con 0x7f84540b2190 2023-08-10T10:41:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8459235640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8454071d20 con 0x7f845415abe0 2023-08-10T10:41:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8459235640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8454071aa0 con 0x7f845415a800 2023-08-10T10:41:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f84537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f845415abe0 0x7f8454071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f84537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f845415abe0 0x7f8454071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58452/0 (socket says 172.21.15.50:58452) 2023-08-10T10:41:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f84537fe640 1 -- 172.21.15.50:0/3917247410 learned_addr learned my addr 172.21.15.50:0/3917247410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.888+0000 7f8453fff640 1 --2- 172.21.15.50:0/3917247410 >> v2:172.21.15.117:3300/0 conn(0x7f845415a800 0x7f84540cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.889+0000 7f84537fe640 1 -- 172.21.15.50:0/3917247410 >> v2:172.21.15.117:3300/0 conn(0x7f845415a800 msgr2=0x7f84540cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:15.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.889+0000 7f84537fe640 1 --2- 172.21.15.50:0/3917247410 >> v2:172.21.15.117:3300/0 conn(0x7f845415a800 0x7f84540cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.889+0000 7f84537fe640 1 -- 172.21.15.50:0/3917247410 >> v1:172.21.15.117:6789/0 conn(0x7f84540b2190 legacy=0x7f84540b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:15.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.889+0000 7f84537fe640 1 -- 172.21.15.50:0/3917247410 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540b3560 con 0x7f845415abe0 2023-08-10T10:41:15.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.890+0000 7f84537fe640 1 --2- 172.21.15.50:0/3917247410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f845415abe0 0x7f8454071560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f845406c940 tx=0x7f843c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d223a702fe8252 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.890+0000 7f8452ffd640 1 -- 172.21.15.50:0/3917247410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c02cb20 con 0x7f845415abe0 2023-08-10T10:41:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.890+0000 7f8452ffd640 1 -- 172.21.15.50:0/3917247410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c02cc80 con 0x7f845415abe0 2023-08-10T10:41:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.890+0000 7f8452ffd640 1 -- 172.21.15.50:0/3917247410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c0343f0 con 0x7f845415abe0 2023-08-10T10:41:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 -- 172.21.15.50:0/3917247410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f845415abe0 msgr2=0x7f8454071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 --2- 172.21.15.50:0/3917247410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f845415abe0 0x7f8454071560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f845406c940 tx=0x7f843c02bf80 comp rx=0 tx=0).stop 2023-08-10T10:41:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 -- 172.21.15.50:0/3917247410 shutdown_connections 2023-08-10T10:41:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 --2- 172.21.15.50:0/3917247410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f845415abe0 0x7f8454071560 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 --2- 172.21.15.50:0/3917247410 >> v2:172.21.15.117:3300/0 conn(0x7f845415a800 0x7f84540cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 -- 172.21.15.50:0/3917247410 >> 172.21.15.50:0/3917247410 conn(0x7f84540cd190 msgr2=0x7f84540cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 -- 172.21.15.50:0/3917247410 shutdown_connections 2023-08-10T10:41:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.891+0000 7f8459235640 1 -- 172.21.15.50:0/3917247410 wait complete. 2023-08-10T10:41:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.893+0000 7f8459235640 1 Processor -- start 2023-08-10T10:41:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.893+0000 7f8459235640 1 -- start start 2023-08-10T10:41:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 0x7f84540c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845415abe0 0x7f84540ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c4b40 con 0x7f84540b2190 2023-08-10T10:41:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c4e20 con 0x7f845415a800 2023-08-10T10:41:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8459235640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c5100 con 0x7f845415abe0 2023-08-10T10:41:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8453fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8453fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58466/0 (socket says 172.21.15.50:58466) 2023-08-10T10:41:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.894+0000 7f8453fff640 1 -- 172.21.15.50:0/83861136 learned_addr learned my addr 172.21.15.50:0/83861136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8458a34640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845415abe0 0x7f84540ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f84537fe640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 0x7f84540c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 -- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845415abe0 msgr2=0x7f84540ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845415abe0 0x7f84540ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 -- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 msgr2=0x7f84540c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 0x7f84540c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 -- 172.21.15.50:0/83861136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009b30 con 0x7f84540b2190 2023-08-10T10:41:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f84537fe640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 0x7f84540c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8453fff640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f844400d800 tx=0x7f844400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400b6c0 con 0x7f84540b2190 2023-08-10T10:41:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400b820 con 0x7f84540b2190 2023-08-10T10:41:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400bbb0 con 0x7f84540b2190 2023-08-10T10:41:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.895+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845415c170 con 0x7f84540b2190 2023-08-10T10:41:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.896+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84540c4780 con 0x7f84540b2190 2023-08-10T10:41:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.897+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540c5320 con 0x7f84540b2190 2023-08-10T10:41:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.898+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f844400bd10 con 0x7f84540b2190 2023-08-10T10:41:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.899+0000 7f8450ff9640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 0x7f843406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.899+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8444089aa0 con 0x7f84540b2190 2023-08-10T10:41:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.900+0000 7f84537fe640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 0x7f843406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.900+0000 7f84537fe640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 0x7f843406d110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f843c035000 tx=0x7f843c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:15.904+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8444054b00 con 0x7f84540b2190 2023-08-10T10:41:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.096+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f845415bfb0 con 0x7f84540b2190 2023-08-10T10:41:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.096+0000 7f8450ff9640 1 -- 172.21.15.50:0/83861136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8444058120 con 0x7f84540b2190 2023-08-10T10:41:16.098 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:41:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.099+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 msgr2=0x7f843406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.099+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 0x7f843406d110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f843c035000 tx=0x7f843c030000 comp rx=0 tx=0).stop 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.099+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 msgr2=0x7f84541570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.099+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f844400d800 tx=0x7f844400dcc0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 shutdown_connections 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845415abe0 0x7f84540ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f843406ac50 0x7f843406d110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845415a800 0x7f84540c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 --2- 172.21.15.50:0/83861136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84540b2190 0x7f84541570b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 >> 172.21.15.50:0/83861136 conn(0x7f84540cd190 msgr2=0x7f8454159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 shutdown_connections 2023-08-10T10:41:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.100+0000 7f8459235640 1 -- 172.21.15.50:0/83861136 wait complete. 2023-08-10T10:41:16.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:41:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.355+0000 7f02daf17640 1 Processor -- start 2023-08-10T10:41:16.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.355+0000 7f02daf17640 1 -- start start 2023-08-10T10:41:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.356+0000 7f02daf17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02d41583c0 0x7f02d40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.356+0000 7f02daf17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02d40b1ba0 0x7f02d40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.356+0000 7f02daf17640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d406a030 con 0x7f02d4069be0 2023-08-10T10:41:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.356+0000 7f02daf17640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d415aee0 con 0x7f02d41583c0 2023-08-10T10:41:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.356+0000 7f02daf17640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40b2100 con 0x7f02d40b1ba0 2023-08-10T10:41:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02d41583c0 0x7f02d40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02d41583c0 0x7f02d40b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58482/0 (socket says 172.21.15.50:58482) 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02da716640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02d4069be0 0x7f02d406ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36280/0 (socket says 172.21.15.50:36280) 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 -- 172.21.15.50:0/4279495883 learned_addr learned my addr 172.21.15.50:0/4279495883 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9714640 1 --2- 172.21.15.50:0/4279495883 >> v2:172.21.15.117:3300/0 conn(0x7f02d40b1ba0 0x7f02d40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 -- 172.21.15.50:0/4279495883 >> v2:172.21.15.117:3300/0 conn(0x7f02d40b1ba0 msgr2=0x7f02d40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 --2- 172.21.15.50:0/4279495883 >> v2:172.21.15.117:3300/0 conn(0x7f02d40b1ba0 0x7f02d40696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 -- 172.21.15.50:0/4279495883 >> v1:172.21.15.50:6789/0 conn(0x7f02d4069be0 legacy=0x7f02d406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d9f15640 1 -- 172.21.15.50:0/4279495883 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d415b1a0 con 0x7f02d41583c0 2023-08-10T10:41:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.357+0000 7f02d8f13640 1 -- 172.21.15.50:0/4279495883 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644118442 0 0) 0x7f02cc001110 con 0x7f02d4069be0 2023-08-10T10:41:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02d9f15640 1 --2- 172.21.15.50:0/4279495883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d41583c0 0x7f02d40b1660 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f02d40ade00 tx=0x7f02d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a282229d93fe9d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02d8f13640 1 -- 172.21.15.50:0/4279495883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d002ca80 con 0x7f02d41583c0 2023-08-10T10:41:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02d8f13640 1 -- 172.21.15.50:0/4279495883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d002cbe0 con 0x7f02d41583c0 2023-08-10T10:41:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02d8f13640 1 -- 172.21.15.50:0/4279495883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00343f0 con 0x7f02d41583c0 2023-08-10T10:41:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02daf17640 1 -- 172.21.15.50:0/4279495883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d41583c0 msgr2=0x7f02d40b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.359+0000 7f02daf17640 1 --2- 172.21.15.50:0/4279495883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d41583c0 0x7f02d40b1660 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f02d40ade00 tx=0x7f02d002bee0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 -- 172.21.15.50:0/4279495883 shutdown_connections 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 --2- 172.21.15.50:0/4279495883 >> v2:172.21.15.117:3300/0 conn(0x7f02d40b1ba0 0x7f02d40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 --2- 172.21.15.50:0/4279495883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d41583c0 0x7f02d40b1660 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 -- 172.21.15.50:0/4279495883 >> 172.21.15.50:0/4279495883 conn(0x7f02d40caf80 msgr2=0x7f02d40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 -- 172.21.15.50:0/4279495883 shutdown_connections 2023-08-10T10:41:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.360+0000 7f02daf17640 1 -- 172.21.15.50:0/4279495883 wait complete. 2023-08-10T10:41:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.361+0000 7f02daf17640 1 Processor -- start 2023-08-10T10:41:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.362+0000 7f02daf17640 1 -- start start 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d40b1ba0 0x7f02d40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d41583c0 0x7f02d40ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41591e0 con 0x7f02d4069be0 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4147e70 con 0x7f02d40b1ba0 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02daf17640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4070650 con 0x7f02d41583c0 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02d9f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02d9f15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58496/0 (socket says 172.21.15.50:58496) 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02d9f15640 1 -- 172.21.15.50:0/3138956763 learned_addr learned my addr 172.21.15.50:0/3138956763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02da716640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d41583c0 0x7f02d40ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.363+0000 7f02d9714640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d40b1ba0 0x7f02d40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 -- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d41583c0 msgr2=0x7f02d40ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d41583c0 0x7f02d40ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 -- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d40b1ba0 msgr2=0x7f02d40c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d40b1ba0 0x7f02d40c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 -- 172.21.15.50:0/3138956763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0009b30 con 0x7f02d4069be0 2023-08-10T10:41:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02d9f15640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f02d0000f80 tx=0x7f02d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0009510 con 0x7f02d4069be0 2023-08-10T10:41:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d003e450 con 0x7f02d4069be0 2023-08-10T10:41:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d003e5e0 con 0x7f02d4069be0 2023-08-10T10:41:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.364+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d4158840 con 0x7f02d4069be0 2023-08-10T10:41:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.365+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d4158e00 con 0x7f02d4069be0 2023-08-10T10:41:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.366+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d4066e30 con 0x7f02d4069be0 2023-08-10T10:41:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.366+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02d002cd50 con 0x7f02d4069be0 2023-08-10T10:41:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.367+0000 7f02ca7fc640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 0x7f02b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.367+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f02d00abd80 con 0x7f02d4069be0 2023-08-10T10:41:16.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.368+0000 7f02d9714640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 0x7f02b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.368+0000 7f02d9714640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 0x7f02b806d110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f02d4157210 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.372+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f02d0076d50 con 0x7f02d4069be0 2023-08-10T10:41:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.566+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02d40cb500 con 0x7f02d4069be0 2023-08-10T10:41:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.567+0000 7f02ca7fc640 1 -- 172.21.15.50:0/3138956763 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02d007a370 con 0x7f02d4069be0 2023-08-10T10:41:16.568 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:41:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 msgr2=0x7f02b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 0x7f02b806d110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f02d4157210 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2023-08-10T10:41:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 msgr2=0x7f02d4147930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f02d0000f80 tx=0x7f02d0004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 shutdown_connections 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d41583c0 0x7f02d40ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b806ac50 0x7f02b806d110 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d40b1ba0 0x7f02d40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 --2- 172.21.15.50:0/3138956763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02d4069be0 0x7f02d4147930 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.569+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 >> 172.21.15.50:0/3138956763 conn(0x7f02d40caf80 msgr2=0x7f02d41577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.570+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 shutdown_connections 2023-08-10T10:41:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.570+0000 7f02daf17640 1 -- 172.21.15.50:0/3138956763 wait complete. 2023-08-10T10:41:16.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.804+0000 7ff8bbfff640 1 Processor -- start 2023-08-10T10:41:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.804+0000 7ff8bbfff640 1 -- start start 2023-08-10T10:41:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8bc15a940 0x7ff8bc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 0x7ff8bc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8bbfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0b1f10 con 0x7ff8bc15f2b0 2023-08-10T10:41:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8bbfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b21f0 con 0x7ff8bc15a940 2023-08-10T10:41:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8bbfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc15e5c0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8baffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8bc15a940 0x7ff8bc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8baffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8bc15a940 0x7ff8bc0aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58510/0 (socket says 172.21.15.50:58510) 2023-08-10T10:41:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8baffd640 1 -- 172.21.15.50:0/2821780063 learned_addr learned my addr 172.21.15.50:0/2821780063 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.806+0000 7ff8b3fff640 1 --1- 172.21.15.50:0/2821780063 >> v1:172.21.15.50:6789/0 conn(0x7ff8bc15f2b0 0x7ff8bc0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36286/0 (socket says 172.21.15.50:36286) 2023-08-10T10:41:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8bb7fe640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 0x7ff8bc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8baffd640 1 -- 172.21.15.50:0/2821780063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 msgr2=0x7ff8bc0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8baffd640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 0x7ff8bc0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8baffd640 1 -- 172.21.15.50:0/2821780063 >> v1:172.21.15.50:6789/0 conn(0x7ff8bc15f2b0 legacy=0x7ff8bc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8ba7fc640 1 -- 172.21.15.50:0/2821780063 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161430219 0 0) 0x7ff8bc0b1f10 con 0x7ff8bc15f2b0 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8baffd640 1 -- 172.21.15.50:0/2821780063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc15e7d0 con 0x7ff8bc15a940 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.807+0000 7ff8bb7fe640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 0x7ff8bc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.808+0000 7ff8baffd640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc15a940 0x7ff8bc0aff10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac178b6fcb4500f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.808+0000 7ff8ba7fc640 1 -- 172.21.15.50:0/2821780063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac031640 con 0x7ff8bc15a940 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8ba7fc640 1 -- 172.21.15.50:0/2821780063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0317a0 con 0x7ff8bc15a940 2023-08-10T10:41:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8ba7fc640 1 -- 172.21.15.50:0/2821780063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac031b30 con 0x7ff8bc15a940 2023-08-10T10:41:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 -- 172.21.15.50:0/2821780063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc15a940 msgr2=0x7ff8bc0aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc15a940 0x7ff8bc0aff10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 -- 172.21.15.50:0/2821780063 shutdown_connections 2023-08-10T10:41:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc0b19d0 0x7ff8bc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/2821780063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc15a940 0x7ff8bc0aff10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 -- 172.21.15.50:0/2821780063 >> 172.21.15.50:0/2821780063 conn(0x7ff8bc06ab80 msgr2=0x7ff8bc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 -- 172.21.15.50:0/2821780063 shutdown_connections 2023-08-10T10:41:16.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.809+0000 7ff8bbfff640 1 -- 172.21.15.50:0/2821780063 wait complete. 2023-08-10T10:41:16.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.811+0000 7ff8bbfff640 1 Processor -- start 2023-08-10T10:41:16.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.811+0000 7ff8bbfff640 1 -- start start 2023-08-10T10:41:16.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc15a940 0x7ff8bc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8bc15f2b0 0x7ff8bc0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0c55f0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc06ea40 con 0x7ff8bc15f2b0 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8bbfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc070980 con 0x7ff8bc15a940 2023-08-10T10:41:16.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.812+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58522/0 (socket says 172.21.15.50:58522) 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 -- 172.21.15.50:0/4056182596 learned_addr learned my addr 172.21.15.50:0/4056182596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 -- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc15a940 msgr2=0x7ff8bc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc15a940 0x7ff8bc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 -- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8bc15f2b0 msgr2=0x7ff8bc0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8bc15f2b0 0x7ff8bc0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 -- 172.21.15.50:0/4056182596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0094d0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.813+0000 7ff8baffd640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0090b0 tx=0x7ff8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.814+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac004230 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.814+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0043b0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.814+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac004520 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.814+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc070c20 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.814+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc0711e0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.815+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc066e30 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.816+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8ac042070 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.817+0000 7ff8b37fe640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 0x7ff89c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:16.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.817+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff8ac0ab3d0 con 0x7ff8bc0b19d0 2023-08-10T10:41:16.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.818+0000 7ff8b3fff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 0x7ff89c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:16.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.818+0000 7ff8b3fff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 0x7ff89c06d110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:16.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:16.822+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff8ac076430 con 0x7ff8bc0b19d0 2023-08-10T10:41:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.052+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8bc0ad4d0 con 0x7ff8bc0b19d0 2023-08-10T10:41:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.053+0000 7ff8b37fe640 1 -- 172.21.15.50:0/4056182596 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7ff8ac079a50 con 0x7ff8bc0b19d0 2023-08-10T10:41:17.055 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:17.055 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:41:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:41:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.055+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 msgr2=0x7ff89c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.055+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 0x7ff89c06d110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4007940 comp rx=0 tx=0).stop 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.055+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 msgr2=0x7ff8bc0aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.055+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0090b0 tx=0x7ff8ac0046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 shutdown_connections 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff89c06ac50 0x7ff89c06d110 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8bc15f2b0 0x7ff8bc0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8bc15a940 0x7ff8bc0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 --2- 172.21.15.50:0/4056182596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8bc0b19d0 0x7ff8bc0aeba0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 >> 172.21.15.50:0/4056182596 conn(0x7ff8bc06ab80 msgr2=0x7ff8bc0afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 shutdown_connections 2023-08-10T10:41:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.056+0000 7ff8bbfff640 1 -- 172.21.15.50:0/4056182596 wait complete. 2023-08-10T10:41:17.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:17.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.306+0000 7f213c142640 1 Processor -- start 2023-08-10T10:41:17.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.307+0000 7f213c142640 1 -- start start 2023-08-10T10:41:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.308+0000 7f213c142640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21340b8430 0x7f21340cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.308+0000 7f213c142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21340cddb0 0x7f21340d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.308+0000 7f213c142640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340ce200 con 0x7f213415cd60 2023-08-10T10:41:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.308+0000 7f213c142640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340b5bd0 con 0x7f21340b8430 2023-08-10T10:41:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.308+0000 7f213c142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2134161180 con 0x7f21340cddb0 2023-08-10T10:41:17.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f21396dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21340b8430 0x7f21340cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f2139ede640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f213415cd60 0x7f2134160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36290/0 (socket says 172.21.15.50:36290) 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f21396dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21340b8430 0x7f21340cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58530/0 (socket says 172.21.15.50:58530) 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f2139ede640 1 -- 172.21.15.50:0/613134335 learned_addr learned my addr 172.21.15.50:0/613134335 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f213a6df640 1 --2- 172.21.15.50:0/613134335 >> v2:172.21.15.117:3300/0 conn(0x7f21340cddb0 0x7f21340d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f21396dd640 1 -- 172.21.15.50:0/613134335 >> v2:172.21.15.117:3300/0 conn(0x7f21340cddb0 msgr2=0x7f21340d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f21396dd640 1 --2- 172.21.15.50:0/613134335 >> v2:172.21.15.117:3300/0 conn(0x7f21340cddb0 0x7f21340d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.310+0000 7f21396dd640 1 -- 172.21.15.50:0/613134335 >> v1:172.21.15.50:6789/0 conn(0x7f213415cd60 legacy=0x7f2134160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.309+0000 7f2138edc640 1 -- 172.21.15.50:0/613134335 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333177823 0 0) 0x7f2130001110 con 0x7f213415cd60 2023-08-10T10:41:17.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.310+0000 7f21396dd640 1 -- 172.21.15.50:0/613134335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134161460 con 0x7f21340b8430 2023-08-10T10:41:17.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.311+0000 7f21396dd640 1 --2- 172.21.15.50:0/613134335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340cd870 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2134074130 tx=0x7f212402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878a8f8415805ebb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.311+0000 7f2138edc640 1 -- 172.21.15.50:0/613134335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124030610 con 0x7f21340b8430 2023-08-10T10:41:17.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.311+0000 7f2138edc640 1 -- 172.21.15.50:0/613134335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124030770 con 0x7f21340b8430 2023-08-10T10:41:17.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.311+0000 7f2138edc640 1 -- 172.21.15.50:0/613134335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124030b00 con 0x7f21340b8430 2023-08-10T10:41:17.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 -- 172.21.15.50:0/613134335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 msgr2=0x7f21340cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 --2- 172.21.15.50:0/613134335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340cd870 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2134074130 tx=0x7f212402b960 comp rx=0 tx=0).stop 2023-08-10T10:41:17.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 -- 172.21.15.50:0/613134335 shutdown_connections 2023-08-10T10:41:17.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 --2- 172.21.15.50:0/613134335 >> v2:172.21.15.117:3300/0 conn(0x7f21340cddb0 0x7f21340d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 --2- 172.21.15.50:0/613134335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340cd870 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 -- 172.21.15.50:0/613134335 >> 172.21.15.50:0/613134335 conn(0x7f21340d2ac0 msgr2=0x7f21340d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 -- 172.21.15.50:0/613134335 shutdown_connections 2023-08-10T10:41:17.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.312+0000 7f213c142640 1 -- 172.21.15.50:0/613134335 wait complete. 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.314+0000 7f213c142640 1 Processor -- start 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.314+0000 7f213c142640 1 -- start start 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21340cddb0 0x7f21340c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f213415cd60 0x7f21340c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213415ec90 con 0x7f21340b8430 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213415e310 con 0x7f21340cddb0 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f213c142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213415f0b0 con 0x7f213415cd60 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.315+0000 7f2139ede640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58532/0 (socket says 172.21.15.50:58532) 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 -- 172.21.15.50:0/4179141782 learned_addr learned my addr 172.21.15.50:0/4179141782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f21396dd640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21340cddb0 0x7f21340c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f213a6df640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f213415cd60 0x7f21340c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 -- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f213415cd60 msgr2=0x7f21340c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f213415cd60 0x7f21340c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 -- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21340cddb0 msgr2=0x7f21340c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21340cddb0 0x7f21340c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 -- 172.21.15.50:0/4179141782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009400 con 0x7f21340b8430 2023-08-10T10:41:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.316+0000 7f2139ede640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f213000c780 tx=0x7f213000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.317+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300072d0 con 0x7f21340b8430 2023-08-10T10:41:17.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.317+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130007450 con 0x7f21340b8430 2023-08-10T10:41:17.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.317+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300047e0 con 0x7f21340b8430 2023-08-10T10:41:17.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.317+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213415e5d0 con 0x7f21340b8430 2023-08-10T10:41:17.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.317+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21340b33d0 con 0x7f21340b8430 2023-08-10T10:41:17.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.318+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213415edd0 con 0x7f21340b8430 2023-08-10T10:41:17.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.319+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2130004960 con 0x7f21340b8430 2023-08-10T10:41:17.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.320+0000 7f212a7fc640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 0x7f211806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.320+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f21300886b0 con 0x7f21340b8430 2023-08-10T10:41:17.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.321+0000 7f21396dd640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 0x7f211806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.321+0000 7f21396dd640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 0x7f211806d110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2124036000 tx=0x7f212403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.324+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f213415edd0 con 0x7f21340b8430 2023-08-10T10:41:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.521+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21340ce200 con 0x7f21340b8430 2023-08-10T10:41:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.524+0000 7f212a7fc640 1 -- 172.21.15.50:0/4179141782 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f21340ce200 con 0x7f21340b8430 2023-08-10T10:41:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:17.526 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:08.497772+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.2a","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 msgr2=0x7f211806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 0x7f211806d110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2124036000 tx=0x7f212403b040 comp rx=0 tx=0).stop 2023-08-10T10:41:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 msgr2=0x7f21340b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f213000c780 tx=0x7f213000cc40 comp rx=0 tx=0).stop 2023-08-10T10:41:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 shutdown_connections 2023-08-10T10:41:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f213415cd60 0x7f21340c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f211806ac50 0x7f211806d110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21340cddb0 0x7f21340c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 --2- 172.21.15.50:0/4179141782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21340b8430 0x7f21340b2e90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.526+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 >> 172.21.15.50:0/4179141782 conn(0x7f21340d2ac0 msgr2=0x7f21340d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.527+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 shutdown_connections 2023-08-10T10:41:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.527+0000 7f213c142640 1 -- 172.21.15.50:0/4179141782 wait complete. 2023-08-10T10:41:17.548 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:41:17.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:17.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.769+0000 7f733ca0c640 1 Processor -- start 2023-08-10T10:41:17.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.769+0000 7f733ca0c640 1 -- start start 2023-08-10T10:41:17.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733ca0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7338153850 0x7f73380b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733ca0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733ca0c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733815d010 con 0x7f73380cf630 2023-08-10T10:41:17.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733ca0c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733815d290 con 0x7f7338153850 2023-08-10T10:41:17.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733ca0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733815d570 con 0x7f7338153c30 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f7336d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7338153850 0x7f73380b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.771+0000 7f733659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f733659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:56932/0 (socket says 172.21.15.50:56932) 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f733659c640 1 -- 172.21.15.50:0/3529979780 learned_addr learned my addr 172.21.15.50:0/3529979780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f7336d9d640 1 -- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 msgr2=0x7f73380b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f7336d9d640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f7336d9d640 1 -- 172.21.15.50:0/3529979780 >> v1:172.21.15.117:6789/0 conn(0x7f73380cf630 legacy=0x7f73380ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f7336d9d640 1 -- 172.21.15.50:0/3529979780 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733815d850 con 0x7f7338153850 2023-08-10T10:41:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.772+0000 7f733659c640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.774+0000 7f7336d9d640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380b1690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7328009d90 tx=0x7f732802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520f5ee29600afbe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.774+0000 7f7335d9b640 1 -- 172.21.15.50:0/3529979780 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732802cc60 con 0x7f7338153850 2023-08-10T10:41:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f7335d9b640 1 -- 172.21.15.50:0/3529979780 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732802cdc0 con 0x7f7338153850 2023-08-10T10:41:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f7335d9b640 1 -- 172.21.15.50:0/3529979780 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328034660 con 0x7f7338153850 2023-08-10T10:41:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 -- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 msgr2=0x7f73380b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380b1690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7328009d90 tx=0x7f732802beb0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 -- 172.21.15.50:0/3529979780 shutdown_connections 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73380b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 --2- 172.21.15.50:0/3529979780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380b1690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 -- 172.21.15.50:0/3529979780 >> 172.21.15.50:0/3529979780 conn(0x7f7338069880 msgr2=0x7f7338069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 -- 172.21.15.50:0/3529979780 shutdown_connections 2023-08-10T10:41:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.775+0000 7f733ca0c640 1 -- 172.21.15.50:0/3529979780 wait complete. 2023-08-10T10:41:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.777+0000 7f733ca0c640 1 Processor -- start 2023-08-10T10:41:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.777+0000 7f733ca0c640 1 -- start start 2023-08-10T10:41:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73381560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73380ca8c0 con 0x7f73380cf630 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338153450 con 0x7f7338153850 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.778+0000 7f733ca0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73380d0f40 con 0x7f7338153c30 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58548/0 (socket says 172.21.15.50:58548) 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 -- 172.21.15.50:0/4265828575 learned_addr learned my addr 172.21.15.50:0/4265828575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f733659c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 -- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 msgr2=0x7f73381560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73381560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 -- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 msgr2=0x7f73380ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.779+0000 7f7336d9d640 1 -- 172.21.15.50:0/4265828575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0094d0 con 0x7f73380cf630 2023-08-10T10:41:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f7336d9d640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7328037040 tx=0x7f7328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328040650 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280407b0 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328040b60 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328009a70 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.780+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73380cbcd0 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.781+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73380d1080 con 0x7f73380cf630 2023-08-10T10:41:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.782+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7328040cc0 con 0x7f73380cf630 2023-08-10T10:41:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.783+0000 7f731f7fe640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 0x7f732406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.783+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f73280ac2b0 con 0x7f73380cf630 2023-08-10T10:41:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.784+0000 7f733659c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 0x7f732406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.784+0000 7f733659c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 0x7f732406d110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73380c7b90 tx=0x7f732c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:17.788+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7328077430 con 0x7f73380cf630 2023-08-10T10:41:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.019+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7338066e30 con 0x7f73380cf630 2023-08-10T10:41:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.020+0000 7f731f7fe640 1 -- 172.21.15.50:0/4265828575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f732807aa50 con 0x7f73380cf630 2023-08-10T10:41:18.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:18.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:41:18.022 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:41:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 msgr2=0x7f732406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 0x7f732406d110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73380c7b90 tx=0x7f732c008040 comp rx=0 tx=0).stop 2023-08-10T10:41:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 msgr2=0x7f7338152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7328037040 tx=0x7f7328004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 shutdown_connections 2023-08-10T10:41:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7338153c30 0x7f73381560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f732406ac50 0x7f732406d110 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7338153850 0x7f73380ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 --2- 172.21.15.50:0/4265828575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73380cf630 0x7f7338152b00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.023+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 >> 172.21.15.50:0/4265828575 conn(0x7f7338069880 msgr2=0x7f7338069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.024+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 shutdown_connections 2023-08-10T10:41:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.024+0000 7f733ca0c640 1 -- 172.21.15.50:0/4265828575 wait complete. 2023-08-10T10:41:18.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.265+0000 7f037ce87640 1 Processor -- start 2023-08-10T10:41:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.265+0000 7f037ce87640 1 -- start start 2023-08-10T10:41:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037ce87640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f037815aa40 0x7f03780b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037ce87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 0x7f03780b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037ce87640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0378071c70 con 0x7f0378070e80 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037ce87640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780713d0 con 0x7f037815aa40 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037ce87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780716b0 con 0x7f03780b0c60 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.267+0000 7f037659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f037815aa40 0x7f03780b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f037815aa40 0x7f03780b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58560/0 (socket says 172.21.15.50:58560) 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 -- 172.21.15.50:0/2455512533 learned_addr learned my addr 172.21.15.50:0/2455512533 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f0375d9b640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 0x7f03780b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 -- 172.21.15.50:0/2455512533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 msgr2=0x7f03780b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 0x7f03780b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 -- 172.21.15.50:0/2455512533 >> v1:172.21.15.117:6789/0 conn(0x7f0378070e80 legacy=0x7f03780696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f037659c640 1 -- 172.21.15.50:0/2455512533 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378071990 con 0x7f037815aa40 2023-08-10T10:41:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.268+0000 7f0375d9b640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 0x7f03780b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.269+0000 7f037659c640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f03780b3820 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0368009870 tx=0x7f036802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d6f5b599e046a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.270+0000 7f037559a640 1 -- 172.21.15.50:0/2455512533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680317c0 con 0x7f037815aa40 2023-08-10T10:41:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.270+0000 7f037559a640 1 -- 172.21.15.50:0/2455512533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368031920 con 0x7f037815aa40 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.270+0000 7f037559a640 1 -- 172.21.15.50:0/2455512533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368031cb0 con 0x7f037815aa40 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.270+0000 7f037ce87640 1 -- 172.21.15.50:0/2455512533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 msgr2=0x7f03780b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.270+0000 7f037ce87640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f03780b3820 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0368009870 tx=0x7f036802b860 comp rx=0 tx=0).stop 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 -- 172.21.15.50:0/2455512533 shutdown_connections 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03780b0c60 0x7f03780b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 --2- 172.21.15.50:0/2455512533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f03780b3820 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 -- 172.21.15.50:0/2455512533 >> 172.21.15.50:0/2455512533 conn(0x7f037806b590 msgr2=0x7f03780ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 -- 172.21.15.50:0/2455512533 shutdown_connections 2023-08-10T10:41:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.271+0000 7f037ce87640 1 -- 172.21.15.50:0/2455512533 wait complete. 2023-08-10T10:41:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.273+0000 7f037ce87640 1 Processor -- start 2023-08-10T10:41:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.273+0000 7f037ce87640 1 -- start start 2023-08-10T10:41:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0378070e80 0x7f03780c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 0x7f0378150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c7ac0 con 0x7f037815aa40 2023-08-10T10:41:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c6240 con 0x7f03780b0c60 2023-08-10T10:41:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037ce87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c6520 con 0x7f0378070e80 2023-08-10T10:41:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58576/0 (socket says 172.21.15.50:58576) 2023-08-10T10:41:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0376d9d640 1 -- 172.21.15.50:0/2400404023 learned_addr learned my addr 172.21.15.50:0/2400404023 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f037659c640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0378070e80 0x7f03780c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0375d9b640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 0x7f0378150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0376d9d640 1 -- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0378070e80 msgr2=0x7f03780c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.275+0000 7f0376d9d640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0378070e80 0x7f03780c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0376d9d640 1 -- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 msgr2=0x7f0378150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0376d9d640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 0x7f0378150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0376d9d640 1 -- 172.21.15.50:0/2400404023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03680094d0 con 0x7f037815aa40 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0375d9b640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 0x7f0378150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0376d9d640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f037000c780 tx=0x7f037000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370004b60 con 0x7f037815aa40 2023-08-10T10:41:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037000ce90 con 0x7f037815aa40 2023-08-10T10:41:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000a850 con 0x7f037815aa40 2023-08-10T10:41:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03780c6800 con 0x7f037815aa40 2023-08-10T10:41:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.276+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0378150a40 con 0x7f037815aa40 2023-08-10T10:41:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.278+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037804e270 con 0x7f037815aa40 2023-08-10T10:41:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.279+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f037000a9b0 con 0x7f037815aa40 2023-08-10T10:41:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.280+0000 7f0366ffd640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 0x7f035806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.280+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0370089750 con 0x7f037815aa40 2023-08-10T10:41:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.281+0000 7f037659c640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 0x7f035806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.281+0000 7f037659c640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 0x7f035806d110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0368036000 tx=0x7f036803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.286+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0370054720 con 0x7f037815aa40 2023-08-10T10:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.524+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03780cd0d0 con 0x7f037815aa40 2023-08-10T10:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.525+0000 7f0366ffd640 1 -- 172.21.15.50:0/2400404023 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f0370087e60 con 0x7f037815aa40 2023-08-10T10:41:18.529 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:18.529 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:40:24.262589+0000","modified":"2023-08-10T10:40:27.860494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/2990759901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2990759901},{"type":"v1","addr":"172.21.15.50:6836","nonce":2990759901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-10T10:41:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-08-10T10:41:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 msgr2=0x7f035806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 0x7f035806d110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0368036000 tx=0x7f036803d040 comp rx=0 tx=0).stop 2023-08-10T10:41:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 msgr2=0x7f037815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f037000c780 tx=0x7f037000cc40 comp rx=0 tx=0).stop 2023-08-10T10:41:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 shutdown_connections 2023-08-10T10:41:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037815aa40 0x7f037815ae20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f035806ac50 0x7f035806d110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03780b0c60 0x7f0378150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 --2- 172.21.15.50:0/2400404023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0378070e80 0x7f03780c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 >> 172.21.15.50:0/2400404023 conn(0x7f037806b590 msgr2=0x7f03780cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 shutdown_connections 2023-08-10T10:41:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.528+0000 7f037ce87640 1 -- 172.21.15.50:0/2400404023 wait complete. 2023-08-10T10:41:18.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.774+0000 7faed359e640 1 Processor -- start 2023-08-10T10:41:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.774+0000 7faed359e640 1 -- start start 2023-08-10T10:41:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed4153850 0x7faed40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed415d010 con 0x7faed40cfd40 2023-08-10T10:41:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed415d290 con 0x7faed4153c30 2023-08-10T10:41:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed415d570 con 0x7faed4153850 2023-08-10T10:41:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faed40cfd40 0x7faed40ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36304/0 (socket says 172.21.15.50:36304) 2023-08-10T10:41:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.776+0000 7faed2d9d640 1 -- 172.21.15.50:0/1132438033 learned_addr learned my addr 172.21.15.50:0/1132438033 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed259c640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed4153850 0x7faed40b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677588705 0 0) 0x7faed415d010 con 0x7faed40cfd40 2023-08-10T10:41:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec0003520 con 0x7faed40cfd40 2023-08-10T10:41:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917978611 0 0) 0x7faec0003520 con 0x7faed40cfd40 2023-08-10T10:41:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed4153850 msgr2=0x7faed40b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed4153850 0x7faed40b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 >> v1:172.21.15.117:6789/0 conn(0x7faed4153c30 legacy=0x7faed40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed415d850 con 0x7faed40cfd40 2023-08-10T10:41:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7faecc001a40 con 0x7faed40cfd40 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.777+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 >> v1:172.21.15.50:6789/0 conn(0x7faed40cfd40 legacy=0x7faed40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec0003a10 0x7faec0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec00047c0 0x7faec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faec000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed415d570 con 0x7faec0005180 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec000bff0 con 0x7faec00047c0 2023-08-10T10:41:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec000c1b0 con 0x7faec0003a10 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed259c640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed4153850 0x7faed40b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faec000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faecbfff640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec00047c0 0x7faec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 -- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec0003a10 msgr2=0x7faec0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec0003a10 0x7faec0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 -- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec00047c0 msgr2=0x7faec0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec00047c0 0x7faec0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.778+0000 7faed2d9d640 1 -- 172.21.15.50:0/1132438033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0003520 con 0x7faec0005180 2023-08-10T10:41:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed2d9d640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faec000b980 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faed40d38a0 tx=0x7faec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b7124a8b4ac34e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc034630 con 0x7faec0005180 2023-08-10T10:41:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc02f070 con 0x7faec0005180 2023-08-10T10:41:18.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed1d9b640 1 -- 172.21.15.50:0/1132438033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc034a50 con 0x7faec0005180 2023-08-10T10:41:18.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed359e640 1 -- 172.21.15.50:0/1132438033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 msgr2=0x7faec000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed359e640 1 --2- 172.21.15.50:0/1132438033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faec000b980 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faed40d38a0 tx=0x7faec00057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed2d9d640 1 -- 172.21.15.50:0/1132438033 reap_dead start 2023-08-10T10:41:18.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed359e640 1 -- 172.21.15.50:0/1132438033 shutdown_connections 2023-08-10T10:41:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.780+0000 7faed359e640 1 -- 172.21.15.50:0/1132438033 >> 172.21.15.50:0/1132438033 conn(0x7faed4069880 msgr2=0x7faed4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.781+0000 7faed359e640 1 -- 172.21.15.50:0/1132438033 shutdown_connections 2023-08-10T10:41:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.781+0000 7faed359e640 1 -- 172.21.15.50:0/1132438033 wait complete. 2023-08-10T10:41:18.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.782+0000 7faed359e640 1 Processor -- start 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.783+0000 7faed359e640 1 -- start start 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.783+0000 7faed359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faed41f5ca0 0x7faed41f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed40ca660 0x7faed40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40cc7c0 con 0x7faec0005180 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed41f6660 con 0x7faed41f5ca0 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed41f3ea0 con 0x7faed40ca660 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58584/0 (socket says 172.21.15.50:58584) 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 -- 172.21.15.50:0/2748057573 learned_addr learned my addr 172.21.15.50:0/2748057573 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed2d9d640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed40ca660 0x7faed40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faecbfff640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faed41f5ca0 0x7faed41f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 -- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed40ca660 msgr2=0x7faed40caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed40ca660 0x7faed40caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 -- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faed41f5ca0 msgr2=0x7faed41f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faed41f5ca0 0x7faed41f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.784+0000 7faed259c640 1 -- 172.21.15.50:0/2748057573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed41f3870 con 0x7faec0005180 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faed259c640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faec4006c00 tx=0x7faec400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4004030 con 0x7faec0005180 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec40041d0 con 0x7faec0005180 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400c860 con 0x7faec0005180 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40cb3c0 con 0x7faec0005180 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.785+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed41f3b30 con 0x7faec0005180 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.786+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed4066e30 con 0x7faec0005180 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.787+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faec400c9c0 con 0x7faec0005180 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.788+0000 7faecaffd640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 0x7faeb406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.788+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faec40893e0 con 0x7faec0005180 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.788+0000 7faecbfff640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 0x7faeb406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.789+0000 7faecbfff640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 0x7faeb406d140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faebc007fd0 tx=0x7faebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.793+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faec4054440 con 0x7faec0005180 2023-08-10T10:41:18.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.984+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faed40b50f0 con 0x7faec0005180 2023-08-10T10:41:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.986+0000 7faecaffd640 1 -- 172.21.15.50:0/2748057573 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18434 (secure 0 0 0) 0x7faec4057a60 con 0x7faec0005180 2023-08-10T10:41:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:18.988 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:08.497772+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:40:22.656712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-10T10:40:23.288053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.2a","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.988+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 msgr2=0x7faeb406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.988+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 0x7faeb406d140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faebc007fd0 tx=0x7faebc009040 comp rx=0 tx=0).stop 2023-08-10T10:41:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.988+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 msgr2=0x7faed40c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.988+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faec4006c00 tx=0x7faec400ed60 comp rx=0 tx=0).stop 2023-08-10T10:41:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 shutdown_connections 2023-08-10T10:41:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faed40ca660 0x7faed40caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faeb406ac80 0x7faeb406d140 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faed41f5ca0 0x7faed41f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 --2- 172.21.15.50:0/2748057573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faec0005180 0x7faed40c52d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 >> 172.21.15.50:0/2748057573 conn(0x7faed4069880 msgr2=0x7faed40cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 shutdown_connections 2023-08-10T10:41:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:18.989+0000 7faed359e640 1 -- 172.21.15.50:0/2748057573 wait complete. 2023-08-10T10:41:19.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:41:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.237+0000 7f1d5182a640 1 Processor -- start 2023-08-10T10:41:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.237+0000 7f1d5182a640 1 -- start start 2023-08-10T10:41:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d5182a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d5182a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d5182a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0b2280 con 0x7f1d4c15ad00 2023-08-10T10:41:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d5182a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0b19e0 con 0x7f1d4c069a80 2023-08-10T10:41:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d5182a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0b1cc0 con 0x7f1d4c0696a0 2023-08-10T10:41:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.239+0000 7f1d51029640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58588/0 (socket says 172.21.15.50:58588) 2023-08-10T10:41:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 -- 172.21.15.50:0/3007330124 learned_addr learned my addr 172.21.15.50:0/3007330124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d50828640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 -- 172.21.15.50:0/3007330124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 msgr2=0x7f1d4c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 -- 172.21.15.50:0/3007330124 >> v1:172.21.15.117:6789/0 conn(0x7f1d4c15ad00 legacy=0x7f1d4c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.240+0000 7f1d51029640 1 -- 172.21.15.50:0/3007330124 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0b1fa0 con 0x7f1d4c069a80 2023-08-10T10:41:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.241+0000 7f1d51029640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009e80 tx=0x7f1d4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3420a4e745d2da30 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.241+0000 7f1d4b7fe640 1 -- 172.21.15.50:0/3007330124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4402c9c0 con 0x7f1d4c069a80 2023-08-10T10:41:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.241+0000 7f1d4b7fe640 1 -- 172.21.15.50:0/3007330124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4402cb20 con 0x7f1d4c069a80 2023-08-10T10:41:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.241+0000 7f1d4b7fe640 1 -- 172.21.15.50:0/3007330124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440343f0 con 0x7f1d4c069a80 2023-08-10T10:41:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 -- 172.21.15.50:0/3007330124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 msgr2=0x7f1d4c0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009e80 tx=0x7f1d4402be20 comp rx=0 tx=0).stop 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 -- 172.21.15.50:0/3007330124 shutdown_connections 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c0ccfb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 --2- 172.21.15.50:0/3007330124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 -- 172.21.15.50:0/3007330124 >> 172.21.15.50:0/3007330124 conn(0x7f1d4c0cafa0 msgr2=0x7f1d4c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 -- 172.21.15.50:0/3007330124 shutdown_connections 2023-08-10T10:41:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.242+0000 7f1d5182a640 1 -- 172.21.15.50:0/3007330124 wait complete. 2023-08-10T10:41:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.244+0000 7f1d5182a640 1 Processor -- start 2023-08-10T10:41:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.244+0000 7f1d5182a640 1 -- start start 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d4c15ad00 0x7f1d4c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1529b0 con 0x7f1d4c069a80 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0c6410 con 0x7f1d4c15ad00 2023-08-10T10:41:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.245+0000 7f1d5182a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0c5690 con 0x7f1d4c0696a0 2023-08-10T10:41:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58596/0 (socket says 172.21.15.50:58596) 2023-08-10T10:41:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 -- 172.21.15.50:0/2056794115 learned_addr learned my addr 172.21.15.50:0/2056794115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d51029640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d4c15ad00 0x7f1d4c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d50828640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 -- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 msgr2=0x7f1d4c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 -- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d4c15ad00 msgr2=0x7f1d4c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d4c15ad00 0x7f1d4c0af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 -- 172.21.15.50:0/2056794115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009b30 con 0x7f1d4c069a80 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d50828640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.246+0000 7f1d4bfff640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800b3c0 tx=0x7f1d3800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.247+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011830 con 0x7f1d4c069a80 2023-08-10T10:41:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.247+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38011990 con 0x7f1d4c069a80 2023-08-10T10:41:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.247+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011d80 con 0x7f1d4c069a80 2023-08-10T10:41:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.247+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0c5930 con 0x7f1d4c069a80 2023-08-10T10:41:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.247+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c0c5ef0 con 0x7f1d4c069a80 2023-08-10T10:41:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.248+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c04e2c0 con 0x7f1d4c069a80 2023-08-10T10:41:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.249+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d3801b460 con 0x7f1d4c069a80 2023-08-10T10:41:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.250+0000 7f1d497fa640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 0x7f1d3006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.250+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1d38089060 con 0x7f1d4c069a80 2023-08-10T10:41:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.250+0000 7f1d50828640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 0x7f1d3006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.251+0000 7f1d50828640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 0x7f1d3006d110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0b1400 tx=0x7f1d40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.254+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d380bb330 con 0x7f1d4c069a80 2023-08-10T10:41:19.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.486+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1d4c067910 con 0x7f1d4c069a80 2023-08-10T10:41:19.488 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:41:19.487+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:41:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.496+0000 7f1d497fa640 1 -- 172.21.15.50:0/2056794115 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1d380540c0 con 0x7f1d4c069a80 2023-08-10T10:41:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:41:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 msgr2=0x7f1d3006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 0x7f1d3006d110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0b1400 tx=0x7f1d40008040 comp rx=0 tx=0).stop 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 msgr2=0x7f1d4c15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800b3c0 tx=0x7f1d3800b880 comp rx=0 tx=0).stop 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 shutdown_connections 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d3006ac50 0x7f1d3006d110 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d4c15ad00 0x7f1d4c0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4c069a80 0x7f1d4c15cbd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 --2- 172.21.15.50:0/2056794115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d4c0696a0 0x7f1d4c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 >> 172.21.15.50:0/2056794115 conn(0x7f1d4c0cafa0 msgr2=0x7f1d4c159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 shutdown_connections 2023-08-10T10:41:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.500+0000 7f1d5182a640 1 -- 172.21.15.50:0/2056794115 wait complete. 2023-08-10T10:41:19.529 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:41:19.582 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:41:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.737+0000 7f6089845640 1 Processor -- start 2023-08-10T10:41:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.737+0000 7f6089845640 1 -- start start 2023-08-10T10:41:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6089845640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60840cf3b0 0x7f60840d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6089845640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6084160b60 con 0x7f608415ce70 2023-08-10T10:41:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6089845640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60840b8200 con 0x7f60840b1a30 2023-08-10T10:41:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6089845640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6084161700 con 0x7f60840cf3b0 2023-08-10T10:41:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6083fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f608415ce70 0x7f60840cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36310/0 (socket says 172.21.15.50:36310) 2023-08-10T10:41:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.739+0000 7f6083fff640 1 -- 172.21.15.50:0/3757329322 learned_addr learned my addr 172.21.15.50:0/3757329322 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494359847 0 0) 0x7f6084160b60 con 0x7f608415ce70 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6074003520 con 0x7f608415ce70 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831786832 0 0) 0x7f6074003520 con 0x7f608415ce70 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 >> v2:172.21.15.117:3300/0 conn(0x7f60840cf3b0 msgr2=0x7f60840d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 --2- 172.21.15.50:0/3757329322 >> v2:172.21.15.117:3300/0 conn(0x7f60840cf3b0 0x7f60840d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 >> v1:172.21.15.117:6789/0 conn(0x7f60840b1a30 legacy=0x7f6084160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840b8750 con 0x7f608415ce70 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6070001670 con 0x7f608415ce70 2023-08-10T10:41:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 >> v1:172.21.15.50:6789/0 conn(0x7f608415ce70 legacy=0x7f60840cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6074003970 0x7f6074003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 0x7f6074004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.740+0000 7f60837fe640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60740052a0 0x7f607400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084161700 con 0x7f60740047c0 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607400c1a0 con 0x7f6074003970 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607400c360 con 0x7f60740052a0 2023-08-10T10:41:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f6083fff640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 0x7f6074004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f6088843640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6074003970 0x7f6074003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.741+0000 7f6089044640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60740052a0 0x7f607400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6083fff640 1 -- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60740052a0 msgr2=0x7f607400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6083fff640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60740052a0 0x7f607400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6083fff640 1 -- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6074003970 msgr2=0x7f6074003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6083fff640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6074003970 0x7f6074003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6083fff640 1 -- 172.21.15.50:0/3757329322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074003520 con 0x7f60740047c0 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.742+0000 7f6089044640 1 -- 172.21.15.50:0/3757329322 reap_dead start 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.743+0000 7f6083fff640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 0x7f6074004c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6070001eb0 tx=0x7f60740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e490c2e025a6632 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.743+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070005ad0 con 0x7f60740047c0 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.743+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070005c50 con 0x7f60740047c0 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.743+0000 7f60837fe640 1 -- 172.21.15.50:0/3757329322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607002c870 con 0x7f60740047c0 2023-08-10T10:41:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 -- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 msgr2=0x7f6074004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 0x7f6074004c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6070001eb0 tx=0x7f60740057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 -- 172.21.15.50:0/3757329322 shutdown_connections 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 --2- 172.21.15.50:0/3757329322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60740047c0 0x7f6074004c40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 -- 172.21.15.50:0/3757329322 >> 172.21.15.50:0/3757329322 conn(0x7f60840696a0 msgr2=0x7f6084069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 -- 172.21.15.50:0/3757329322 shutdown_connections 2023-08-10T10:41:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.744+0000 7f6089845640 1 -- 172.21.15.50:0/3757329322 wait complete. 2023-08-10T10:41:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.746+0000 7f6089845640 1 Processor -- start 2023-08-10T10:41:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.746+0000 7f6089845640 1 -- start start 2023-08-10T10:41:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.747+0000 7f6089845640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60740047c0 0x7f608415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089845640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f608415f8d0 0x7f60840c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089845640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089845640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840cc860 con 0x7f60840d2870 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089845640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840d3230 con 0x7f60740047c0 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089845640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60841600d0 con 0x7f608415f8d0 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58630/0 (socket says 172.21.15.50:58630) 2023-08-10T10:41:19.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 -- 172.21.15.50:0/1355056181 learned_addr learned my addr 172.21.15.50:0/1355056181 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6088843640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60740047c0 0x7f608415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6083fff640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f608415f8d0 0x7f60840c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 -- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f608415f8d0 msgr2=0x7f60840c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f608415f8d0 0x7f60840c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.748+0000 7f6089044640 1 -- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60740047c0 msgr2=0x7f608415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f6089044640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60740047c0 0x7f608415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f6089044640 1 -- 172.21.15.50:0/1355056181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60841f3870 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f6089044640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60840b54d0 tx=0x7f607c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0050d0 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c005250 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0035f0 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60841f3b50 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.749+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60841f4110 con 0x7f60840d2870 2023-08-10T10:41:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.750+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60840612b0 con 0x7f60840d2870 2023-08-10T10:41:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.751+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f607c003750 con 0x7f60840d2870 2023-08-10T10:41:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.752+0000 7f60817fa640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 0x7f606806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.752+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f607c088bc0 con 0x7f60840d2870 2023-08-10T10:41:19.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.753+0000 7f6088843640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 0x7f606806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:19.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.753+0000 7f6088843640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 0x7f606806d110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6084157780 tx=0x7f6078009540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:19.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.757+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f607c053b40 con 0x7f60840d2870 2023-08-10T10:41:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:19.995+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f60840b5200 con 0x7f60840d2870 2023-08-10T10:41:20.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.577+0000 7f60817fa640 1 -- 172.21.15.50:0/1355056181 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f607c057160 con 0x7f60840d2870 2023-08-10T10:41:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 msgr2=0x7f606806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 0x7f606806d110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6084157780 tx=0x7f6078009540 comp rx=0 tx=0).stop 2023-08-10T10:41:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 msgr2=0x7f60840d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60840b54d0 tx=0x7f607c001e70 comp rx=0 tx=0).stop 2023-08-10T10:41:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 shutdown_connections 2023-08-10T10:41:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60840d2870 0x7f60840d2cf0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f608415f8d0 0x7f60840c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f606806ac50 0x7f606806d110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 --2- 172.21.15.50:0/1355056181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60740047c0 0x7f608415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.581+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 >> 172.21.15.50:0/1355056181 conn(0x7f60840696a0 msgr2=0x7f60840cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.582+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 shutdown_connections 2023-08-10T10:41:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.582+0000 7f6089845640 1 -- 172.21.15.50:0/1355056181 wait complete. 2023-08-10T10:41:20.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:41:20.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.833+0000 7fcfd6693640 1 Processor -- start 2023-08-10T10:41:20.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.834+0000 7fcfd6693640 1 -- start start 2023-08-10T10:41:20.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd015a820 0x7fcfd00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd00cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 0x7fcfd0070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00b4060 con 0x7fcfd015a820 2023-08-10T10:41:20.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00c5450 con 0x7fcfd00ca740 2023-08-10T10:41:20.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.835+0000 7fcfd6693640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00b1d60 con 0x7fcfd00718f0 2023-08-10T10:41:20.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd015a820 0x7fcfd00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd015a820 0x7fcfd00cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58640/0 (socket says 172.21.15.50:58640) 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 -- 172.21.15.50:0/1712066881 learned_addr learned my addr 172.21.15.50:0/1712066881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5e92640 1 --2- 172.21.15.50:0/1712066881 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 0x7fcfd0070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 -- 172.21.15.50:0/1712066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 msgr2=0x7fcfd00cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 --2- 172.21.15.50:0/1712066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd00cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 -- 172.21.15.50:0/1712066881 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 msgr2=0x7fcfd0070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:20.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 --2- 172.21.15.50:0/1712066881 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 0x7fcfd0070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5691640 1 -- 172.21.15.50:0/1712066881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00b4480 con 0x7fcfd015a820 2023-08-10T10:41:20.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.836+0000 7fcfd5e92640 1 --2- 172.21.15.50:0/1712066881 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 0x7fcfd0070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:20.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.837+0000 7fcfd5691640 1 --2- 172.21.15.50:0/1712066881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd00cae20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00c1fd0 tx=0x7fcfcc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80022c101d63cd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.838+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1712066881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc031860 con 0x7fcfd015a820 2023-08-10T10:41:20.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.838+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1712066881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0319c0 con 0x7fcfd015a820 2023-08-10T10:41:20.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.838+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1712066881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc031d50 con 0x7fcfd015a820 2023-08-10T10:41:20.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.838+0000 7fcfd6693640 1 -- 172.21.15.50:0/1712066881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 msgr2=0x7fcfd00cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.838+0000 7fcfd6693640 1 --2- 172.21.15.50:0/1712066881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd00cae20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00c1fd0 tx=0x7fcfcc02b900 comp rx=0 tx=0).stop 2023-08-10T10:41:20.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 -- 172.21.15.50:0/1712066881 shutdown_connections 2023-08-10T10:41:20.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 --2- 172.21.15.50:0/1712066881 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00ca740 0x7fcfd0070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 --2- 172.21.15.50:0/1712066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd00cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 --2- 172.21.15.50:0/1712066881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd00cae20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 -- 172.21.15.50:0/1712066881 >> 172.21.15.50:0/1712066881 conn(0x7fcfd00b0050 msgr2=0x7fcfd00b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 -- 172.21.15.50:0/1712066881 shutdown_connections 2023-08-10T10:41:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.839+0000 7fcfd6693640 1 -- 172.21.15.50:0/1712066881 wait complete. 2023-08-10T10:41:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.840+0000 7fcfd6693640 1 Processor -- start 2023-08-10T10:41:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.840+0000 7fcfd6693640 1 -- start start 2023-08-10T10:41:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd0157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 0x7fcfd01f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0158280 con 0x7fcfd015a820 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01f3300 con 0x7fcfd00ca740 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.841+0000 7fcfd6693640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd015c060 con 0x7fcfd00718f0 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58644/0 (socket says 172.21.15.50:58644) 2023-08-10T10:41:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 -- 172.21.15.50:0/2036272681 learned_addr learned my addr 172.21.15.50:0/2036272681 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd4e90640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 0x7fcfd01f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 -- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 msgr2=0x7fcfd0157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd0157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 -- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 msgr2=0x7fcfd01f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 0x7fcfd01f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd5e92640 1 -- 172.21.15.50:0/2036272681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0094d0 con 0x7fcfd015a820 2023-08-10T10:41:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.842+0000 7fcfd4e90640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 0x7fcfd01f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfd5e92640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800cf20 tx=0x7fcfc800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800d840 con 0x7fcfd015a820 2023-08-10T10:41:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800d9a0 con 0x7fcfd015a820 2023-08-10T10:41:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800dd50 con 0x7fcfd015a820 2023-08-10T10:41:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd01f6820 con 0x7fcfd015a820 2023-08-10T10:41:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.843+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01f2cb0 con 0x7fcfd015a820 2023-08-10T10:41:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.844+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd01f2750 con 0x7fcfd015a820 2023-08-10T10:41:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.845+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfc801e3b0 con 0x7fcfd015a820 2023-08-10T10:41:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.846+0000 7fcfc5ffb640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 0x7fcfb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.846+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fcfc808a0e0 con 0x7fcfd015a820 2023-08-10T10:41:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.846+0000 7fcfd5691640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 0x7fcfb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.847+0000 7fcfd5691640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 0x7fcfb406d110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc036000 tx=0x7fcfcc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:20.850+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcfc8055060 con 0x7fcfd015a820 2023-08-10T10:41:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.033+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcfd015c1a0 con 0x7fcfd015a820 2023-08-10T10:41:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.598+0000 7fcfc5ffb640 1 -- 172.21.15.50:0/2036272681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcfc8058680 con 0x7fcfd015a820 2023-08-10T10:41:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:41:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.601+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 msgr2=0x7fcfb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.601+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 0x7fcfb406d110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc036000 tx=0x7fcfcc030000 comp rx=0 tx=0).stop 2023-08-10T10:41:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.601+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 msgr2=0x7fcfd0158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.601+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800cf20 tx=0x7fcfc800a7d0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 shutdown_connections 2023-08-10T10:41:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd015a820 0x7fcfd0158ac0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfb406ac50 0x7fcfb406d110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00ca740 0x7fcfd01f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 --2- 172.21.15.50:0/2036272681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00718f0 0x7fcfd0157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 >> 172.21.15.50:0/2036272681 conn(0x7fcfd00b0050 msgr2=0x7fcfd00cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 shutdown_connections 2023-08-10T10:41:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.602+0000 7fcfd6693640 1 -- 172.21.15.50:0/2036272681 wait complete. 2023-08-10T10:41:21.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:41:21.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.860+0000 7f6fbac4d640 1 Processor -- start 2023-08-10T10:41:21.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.860+0000 7f6fbac4d640 1 -- start start 2023-08-10T10:41:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.862+0000 7f6fbac4d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fb415cbe0 0x7f6fb40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.862+0000 7f6fbac4d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.862+0000 7f6fbac4d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40d20d0 con 0x7f6fb40d2560 2023-08-10T10:41:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.862+0000 7f6fbac4d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb415cfc0 con 0x7f6fb40b4c10 2023-08-10T10:41:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.862+0000 7f6fbac4d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40d14c0 con 0x7f6fb415cbe0 2023-08-10T10:41:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58646/0 (socket says 172.21.15.50:58646) 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 -- 172.21.15.50:0/911501285 learned_addr learned my addr 172.21.15.50:0/911501285 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb89e9640 1 --2- 172.21.15.50:0/911501285 >> v2:172.21.15.117:3300/0 conn(0x7f6fb415cbe0 0x7f6fb40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 -- 172.21.15.50:0/911501285 >> v2:172.21.15.117:3300/0 conn(0x7f6fb415cbe0 msgr2=0x7f6fb40d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 --2- 172.21.15.50:0/911501285 >> v2:172.21.15.117:3300/0 conn(0x7f6fb415cbe0 0x7f6fb40d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 -- 172.21.15.50:0/911501285 >> v1:172.21.15.117:6789/0 conn(0x7f6fb40d2560 legacy=0x7f6fb40b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.863+0000 7f6fb91ea640 1 -- 172.21.15.50:0/911501285 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40d17a0 con 0x7f6fb40b4c10 2023-08-10T10:41:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.864+0000 7f6fb91ea640 1 --2- 172.21.15.50:0/911501285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40d3af0 tx=0x7f6fac02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fad6795c4230bb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.865+0000 7f6fb37fe640 1 -- 172.21.15.50:0/911501285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac02cb10 con 0x7f6fb40b4c10 2023-08-10T10:41:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.865+0000 7f6fb37fe640 1 -- 172.21.15.50:0/911501285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac02cc70 con 0x7f6fb40b4c10 2023-08-10T10:41:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.865+0000 7f6fb37fe640 1 -- 172.21.15.50:0/911501285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0343f0 con 0x7f6fb40b4c10 2023-08-10T10:41:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.865+0000 7f6fbac4d640 1 -- 172.21.15.50:0/911501285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 msgr2=0x7f6fb40b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/911501285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40d3af0 tx=0x7f6fac02bf70 comp rx=0 tx=0).stop 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 -- 172.21.15.50:0/911501285 shutdown_connections 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/911501285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40b5ae0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/911501285 >> v2:172.21.15.117:3300/0 conn(0x7f6fb415cbe0 0x7f6fb40d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 -- 172.21.15.50:0/911501285 >> 172.21.15.50:0/911501285 conn(0x7f6fb40702f0 msgr2=0x7f6fb40d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 -- 172.21.15.50:0/911501285 shutdown_connections 2023-08-10T10:41:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.866+0000 7f6fbac4d640 1 -- 172.21.15.50:0/911501285 wait complete. 2023-08-10T10:41:21.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.868+0000 7f6fbac4d640 1 Processor -- start 2023-08-10T10:41:21.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.868+0000 7f6fbac4d640 1 -- start start 2023-08-10T10:41:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fb40d2560 0x7f6fb4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb415cbe0 0x7f6fb40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4154510 con 0x7f6fb40b4c10 2023-08-10T10:41:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c82b0 con 0x7f6fb415cbe0 2023-08-10T10:41:21.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fbac4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c8590 con 0x7f6fb40d2560 2023-08-10T10:41:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fb89e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fb89e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58662/0 (socket says 172.21.15.50:58662) 2023-08-10T10:41:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.870+0000 7f6fb89e9640 1 -- 172.21.15.50:0/1670144551 learned_addr learned my addr 172.21.15.50:0/1670144551 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb91ea640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb415cbe0 0x7f6fb40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb3fff640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fb40d2560 0x7f6fb4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 -- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fb40d2560 msgr2=0x7f6fb4153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fb40d2560 0x7f6fb4153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 -- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb415cbe0 msgr2=0x7f6fb40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb415cbe0 0x7f6fb40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 -- 172.21.15.50:0/1670144551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009b30 con 0x7f6fb40b4c10 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb89e9640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800d800 tx=0x7f6fa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.871+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800b6c0 con 0x7f6fb40b4c10 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.872+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800b820 con 0x7f6fb40b4c10 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.872+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800bbb0 con 0x7f6fb40b4c10 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.872+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40c9b60 con 0x7f6fb40b4c10 2023-08-10T10:41:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.872+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40c8870 con 0x7f6fb40b4c10 2023-08-10T10:41:21.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.873+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb404e270 con 0x7f6fb40b4c10 2023-08-10T10:41:21.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.874+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fa800bd10 con 0x7f6fb40b4c10 2023-08-10T10:41:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.875+0000 7f6fb17fa640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 0x7f6f9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.875+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f6fa8089940 con 0x7f6fb40b4c10 2023-08-10T10:41:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.875+0000 7f6fb3fff640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 0x7f6f9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.876+0000 7f6fb3fff640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 0x7f6f9806d110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40b6b30 tx=0x7f6fa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:21.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:21.880+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6fa8054b00 con 0x7f6fb40b4c10 2023-08-10T10:41:22.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.070+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6fb40b7490 con 0x7f6fb40b4c10 2023-08-10T10:41:22.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.613+0000 7f6fb17fa640 1 -- 172.21.15.50:0/1670144551 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6fa8058120 con 0x7f6fb40b4c10 2023-08-10T10:41:22.615 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:41:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.617+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 msgr2=0x7f6f9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.617+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 0x7f6f9806d110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40b6b30 tx=0x7f6fa0009040 comp rx=0 tx=0).stop 2023-08-10T10:41:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.617+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 msgr2=0x7f6fb40c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.617+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800d800 tx=0x7f6fa800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 shutdown_connections 2023-08-10T10:41:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6f9806ac50 0x7f6f9806d110 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb415cbe0 0x7f6fb40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fb40d2560 0x7f6fb4153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 --2- 172.21.15.50:0/1670144551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb40b4c10 0x7f6fb40c7c40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 >> 172.21.15.50:0/1670144551 conn(0x7f6fb40702f0 msgr2=0x7f6fb415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 shutdown_connections 2023-08-10T10:41:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.618+0000 7f6fbac4d640 1 -- 172.21.15.50:0/1670144551 wait complete. 2023-08-10T10:41:22.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:41:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.876+0000 7f5e1ffff640 1 Processor -- start 2023-08-10T10:41:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.877+0000 7f5e1ffff640 1 -- start start 2023-08-10T10:41:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.879+0000 7f5e1ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e2015ce70 0x7f5e200d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:22.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.879+0000 7f5e1ffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20160b60 con 0x7f5e200b1a30 2023-08-10T10:41:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.879+0000 7f5e1ffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e200b8200 con 0x7f5e200cf3b0 2023-08-10T10:41:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.879+0000 7f5e1ffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e20161700 con 0x7f5e2015ce70 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.879+0000 7f5e1f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e200b1a30 0x7f5e20160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36318/0 (socket says 172.21.15.50:36318) 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1f7fe640 1 -- 172.21.15.50:0/2274910537 learned_addr learned my addr 172.21.15.50:0/2274910537 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/2274910537 >> v2:172.21.15.117:3300/0 conn(0x7f5e2015ce70 0x7f5e200d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518334771 0 0) 0x7f5e20160b60 con 0x7f5e200b1a30 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c003520 con 0x7f5e200b1a30 2023-08-10T10:41:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269006444 0 0) 0x7f5e200b8200 con 0x7f5e200cf3b0 2023-08-10T10:41:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.880+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20160b60 con 0x7f5e200cf3b0 2023-08-10T10:41:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.881+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1326797558 0 0) 0x7f5e0c003520 con 0x7f5e200b1a30 2023-08-10T10:41:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.881+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/2274910537 >> v1:172.21.15.117:6789/0 conn(0x7f5e200cf3b0 legacy=0x7f5e200cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.881+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/2274910537 >> v1:172.21.15.50:6789/0 conn(0x7f5e200b1a30 legacy=0x7f5e20160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.881+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/2274910537 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200b8750 con 0x7f5e2015ce70 2023-08-10T10:41:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.883+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/2274910537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200d2190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097a0 tx=0x7f5e0802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b284864b6b0a38a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.883+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0802f050 con 0x7f5e2015ce70 2023-08-10T10:41:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.883+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08031500 con 0x7f5e2015ce70 2023-08-10T10:41:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.883+0000 7f5e1dffb640 1 -- 172.21.15.50:0/2274910537 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18001670 con 0x7f5e2015ce70 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 -- 172.21.15.50:0/2274910537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 msgr2=0x7f5e200d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/2274910537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200d2190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097a0 tx=0x7f5e0802b820 comp rx=0 tx=0).stop 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 -- 172.21.15.50:0/2274910537 shutdown_connections 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/2274910537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200d2190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 -- 172.21.15.50:0/2274910537 >> 172.21.15.50:0/2274910537 conn(0x7f5e200696a0 msgr2=0x7f5e20069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 -- 172.21.15.50:0/2274910537 shutdown_connections 2023-08-10T10:41:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.884+0000 7f5e1ffff640 1 -- 172.21.15.50:0/2274910537 wait complete. 2023-08-10T10:41:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.886+0000 7f5e1ffff640 1 Processor -- start 2023-08-10T10:41:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.886+0000 7f5e1ffff640 1 -- start start 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e200b1a30 0x7f5e201508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200ca9a0 con 0x7f5e200cf3b0 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200c9d90 con 0x7f5e2015ce70 2023-08-10T10:41:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.887+0000 7f5e1ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200ca070 con 0x7f5e200b1a30 2023-08-10T10:41:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58670/0 (socket says 172.21.15.50:58670) 2023-08-10T10:41:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/1591562677 learned_addr learned my addr 172.21.15.50:0/1591562677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e200b1a30 msgr2=0x7f5e201508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e200b1a30 0x7f5e201508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 msgr2=0x7f5e200cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1f7fe640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/1591562677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e08009400 con 0x7f5e200cf3b0 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1f7fe640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.888+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e08036040 tx=0x7f5e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.889+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0803c8d0 con 0x7f5e200cf3b0 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.889+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0803ca30 con 0x7f5e200cf3b0 2023-08-10T10:41:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.889+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0803cdc0 con 0x7f5e200cf3b0 2023-08-10T10:41:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.889+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e200ca350 con 0x7f5e200cf3b0 2023-08-10T10:41:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.889+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e20150e30 con 0x7f5e200cf3b0 2023-08-10T10:41:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.890+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e200612b0 con 0x7f5e200cf3b0 2023-08-10T10:41:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.891+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e0803a040 con 0x7f5e200cf3b0 2023-08-10T10:41:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.893+0000 7f5e177fe640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 0x7f5e0006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.893+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5e080aa9f0 con 0x7f5e200cf3b0 2023-08-10T10:41:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.893+0000 7f5e1effd640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 0x7f5e0006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.894+0000 7f5e1effd640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 0x7f5e0006d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5e10001460 tx=0x7f5e10007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:22.897+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e08075e40 con 0x7f5e200cf3b0 2023-08-10T10:41:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.093+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e200b5200 con 0x7f5e200cf3b0 2023-08-10T10:41:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.098+0000 7f5e177fe640 1 -- 172.21.15.50:0/1591562677 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e08079460 con 0x7f5e200cf3b0 2023-08-10T10:41:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 msgr2=0x7f5e0006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 0x7f5e0006d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5e10001460 tx=0x7f5e10007cd0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 msgr2=0x7f5e200cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e08036040 tx=0x7f5e080046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 shutdown_connections 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e0006ac50 0x7f5e0006d110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e2015ce70 0x7f5e200cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e200cf3b0 0x7f5e200cb290 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 --2- 172.21.15.50:0/1591562677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e200b1a30 0x7f5e201508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.101+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 >> 172.21.15.50:0/1591562677 conn(0x7f5e200696a0 msgr2=0x7f5e2015c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.102+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 shutdown_connections 2023-08-10T10:41:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.102+0000 7f5e1ffff640 1 -- 172.21.15.50:0/1591562677 wait complete. 2023-08-10T10:41:23.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-08-10T10:41:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.351+0000 7f6715973640 1 Processor -- start 2023-08-10T10:41:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.352+0000 7f6715973640 1 -- start start 2023-08-10T10:41:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.353+0000 7f6715973640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f67100b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.353+0000 7f6715973640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100b1f10 con 0x7f671015a940 2023-08-10T10:41:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f6715973640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671015e7d0 con 0x7f671015f2b0 2023-08-10T10:41:23.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f6715973640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b21f0 con 0x7f67100b0620 2023-08-10T10:41:23.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f6714971640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f671015a940 0x7f67100aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36334/0 (socket says 172.21.15.50:36334) 2023-08-10T10:41:23.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f6714971640 1 -- 172.21.15.50:0/3201331513 learned_addr learned my addr 172.21.15.50:0/3201331513 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f670ffff640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f67100b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.354+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070578608 0 0) 0x7f67100b1f10 con 0x7f671015a940 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6700003520 con 0x7f671015a940 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3296517390 0 0) 0x7f6700003520 con 0x7f671015a940 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 msgr2=0x7f67100b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f67100b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 >> v1:172.21.15.117:6789/0 conn(0x7f671015f2b0 legacy=0x7f67100ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671015eab0 con 0x7f671015a940 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6704001670 con 0x7f671015a940 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 >> v1:172.21.15.50:6789/0 conn(0x7f671015a940 legacy=0x7f67100aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f6700003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6700003f90 0x7f67000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700004d00 0x7f6700005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670000ff20 con 0x7f6700003f90 2023-08-10T10:41:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700010090 con 0x7f6700004d00 2023-08-10T10:41:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.355+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700010250 con 0x7f67100b0620 2023-08-10T10:41:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6700003f90 0x7f67000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f6715172640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700004d00 0x7f6700005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f6714971640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f6700003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 -- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 msgr2=0x7f6700003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100b0620 0x7f6700003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 -- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700004d00 msgr2=0x7f6700005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700004d00 0x7f6700005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.356+0000 7f670ffff640 1 -- 172.21.15.50:0/3201331513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671015eab0 con 0x7f6700003f90 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.358+0000 7f670ffff640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6700003f90 0x7f67000047c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009ac0 tx=0x7f67000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591c783d53c39c48 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.358+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc02c6b0 con 0x7f6700003f90 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.358+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc02c810 con 0x7f6700003f90 2023-08-10T10:41:23.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.358+0000 7f670f7fe640 1 -- 172.21.15.50:0/3201331513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc02cba0 con 0x7f6700003f90 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 -- 172.21.15.50:0/3201331513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6700003f90 msgr2=0x7f67000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 --2- 172.21.15.50:0/3201331513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6700003f90 0x7f67000047c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009ac0 tx=0x7f67000057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715172640 1 -- 172.21.15.50:0/3201331513 reap_dead start 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 -- 172.21.15.50:0/3201331513 shutdown_connections 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 -- 172.21.15.50:0/3201331513 >> 172.21.15.50:0/3201331513 conn(0x7f671006ab80 msgr2=0x7f671006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 -- 172.21.15.50:0/3201331513 shutdown_connections 2023-08-10T10:41:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.359+0000 7f6715973640 1 -- 172.21.15.50:0/3201331513 wait complete. 2023-08-10T10:41:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.362+0000 7f6715973640 1 Processor -- start 2023-08-10T10:41:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.362+0000 7f6715973640 1 -- start start 2023-08-10T10:41:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 0x7f67101f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100c78f0 0x7f67100c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c6e40 con 0x7f67100cd090 2023-08-10T10:41:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c82b0 con 0x7f6700003f90 2023-08-10T10:41:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715973640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100cda50 con 0x7f67100c78f0 2023-08-10T10:41:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715172640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715172640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58694/0 (socket says 172.21.15.50:58694) 2023-08-10T10:41:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6715172640 1 -- 172.21.15.50:0/667989637 learned_addr learned my addr 172.21.15.50:0/667989637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f6714971640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 0x7f67101f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.364+0000 7f670ffff640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100c78f0 0x7f67100c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 -- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100c78f0 msgr2=0x7f67100c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100c78f0 0x7f67100c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 -- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 msgr2=0x7f67101f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 0x7f67101f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 -- 172.21.15.50:0/667989637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100cdd10 con 0x7f67100cd090 2023-08-10T10:41:23.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6714971640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 0x7f67101f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:23.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715172640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f67100cbf20 tx=0x7f670800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708017070 con 0x7f67100cd090 2023-08-10T10:41:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708006b50 con 0x7f67100cd090 2023-08-10T10:41:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708006d00 con 0x7f67100cd090 2023-08-10T10:41:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.365+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100cdff0 con 0x7f67100cd090 2023-08-10T10:41:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.366+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100ce5b0 con 0x7f67100cd090 2023-08-10T10:41:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.367+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710066e30 con 0x7f67100cd090 2023-08-10T10:41:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.368+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6708003970 con 0x7f67100cd090 2023-08-10T10:41:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.369+0000 7f670d7fa640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 0x7f66f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.369+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f67080888d0 con 0x7f67100cd090 2023-08-10T10:41:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.369+0000 7f6714971640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 0x7f66f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.370+0000 7f6714971640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 0x7f66f406d110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6704001eb0 tx=0x7f6704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.373+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6708053c80 con 0x7f67100cd090 2023-08-10T10:41:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:23.635+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f67100b0dc0 con 0x7f67100cd090 2023-08-10T10:41:24.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.623+0000 7f670d7fa640 1 -- 172.21.15.50:0/667989637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v187) v1 ==== 142+0+0 (secure 0 0 0) 0x7f67080572a0 con 0x7f67100cd090 2023-08-10T10:41:24.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 msgr2=0x7f66f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 0x7f66f406d110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6704001eb0 tx=0x7f6704009040 comp rx=0 tx=0).stop 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 msgr2=0x7f67100cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f67100cbf20 tx=0x7f670800ec10 comp rx=0 tx=0).stop 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 shutdown_connections 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67100cd090 0x7f67100cd510 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67100c78f0 0x7f67100c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f66f406ac50 0x7f66f406d110 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 --2- 172.21.15.50:0/667989637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6700003f90 0x7f67101f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 >> 172.21.15.50:0/667989637 conn(0x7f671006ab80 msgr2=0x7f671006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:24.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 shutdown_connections 2023-08-10T10:41:24.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.627+0000 7f6715973640 1 -- 172.21.15.50:0/667989637 wait complete. 2023-08-10T10:41:24.648 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-10T10:41:24.649 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-08-10T10:41:24.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-08-10T10:41:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.883+0000 7f776041a640 1 Processor -- start 2023-08-10T10:41:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.883+0000 7f776041a640 1 -- start start 2023-08-10T10:41:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.884+0000 7f776041a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f775815f370 0x7f77580cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.884+0000 7f776041a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77580cf3c0 0x7f775815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.884+0000 7f776041a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580b0000 con 0x7f77580afc20 2023-08-10T10:41:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.884+0000 7f776041a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77580cf850 con 0x7f77580cf3c0 2023-08-10T10:41:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.884+0000 7f776041a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77580cbe60 con 0x7f775815f370 2023-08-10T10:41:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.885+0000 7f775e9b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77580cf3c0 0x7f775815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.885+0000 7f775d9b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f775815f370 0x7f77580cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.885+0000 7f775e9b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77580cf3c0 0x7f775815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35122/0 (socket says 172.21.15.50:35122) 2023-08-10T10:41:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.885+0000 7f775e9b7640 1 -- 172.21.15.50:0/1272662815 learned_addr learned my addr 172.21.15.50:0/1272662815 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.885+0000 7f775e1b6640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f77580afc20 0x7f77580cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:55020/0 (socket says 172.21.15.50:55020) 2023-08-10T10:41:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.886+0000 7f775e9b7640 1 -- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f775815f370 msgr2=0x7f77580cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.886+0000 7f775e9b7640 1 --2- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f775815f370 0x7f77580cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.886+0000 7f775e9b7640 1 -- 172.21.15.50:0/1272662815 >> v1:172.21.15.117:6789/0 conn(0x7f77580afc20 legacy=0x7f77580cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.886+0000 7f775e9b7640 1 -- 172.21.15.50:0/1272662815 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580cc140 con 0x7f77580cf3c0 2023-08-10T10:41:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.888+0000 7f775e9b7640 1 --2- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77580cf3c0 0x7f775815a580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7750009e50 tx=0x7f775002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39524db3afbbf59 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f775d1b4640 1 -- 172.21.15.50:0/1272662815 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775002cb00 con 0x7f77580cf3c0 2023-08-10T10:41:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f775d1b4640 1 -- 172.21.15.50:0/1272662815 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775002cc60 con 0x7f77580cf3c0 2023-08-10T10:41:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f775d1b4640 1 -- 172.21.15.50:0/1272662815 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77500343f0 con 0x7f77580cf3c0 2023-08-10T10:41:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 -- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77580cf3c0 msgr2=0x7f775815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 --2- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77580cf3c0 0x7f775815a580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7750009e50 tx=0x7f775002bf60 comp rx=0 tx=0).stop 2023-08-10T10:41:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 -- 172.21.15.50:0/1272662815 shutdown_connections 2023-08-10T10:41:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 --2- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77580cf3c0 0x7f775815a580 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 --2- 172.21.15.50:0/1272662815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f775815f370 0x7f77580cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 -- 172.21.15.50:0/1272662815 >> 172.21.15.50:0/1272662815 conn(0x7f77580d0930 msgr2=0x7f77580d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 -- 172.21.15.50:0/1272662815 shutdown_connections 2023-08-10T10:41:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.889+0000 7f776041a640 1 -- 172.21.15.50:0/1272662815 wait complete. 2023-08-10T10:41:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.891+0000 7f776041a640 1 Processor -- start 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.891+0000 7f776041a640 1 -- start start 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 0x7f77580c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f775815f370 0x7f77580b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77580c5a50 con 0x7f77580cf3c0 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77580c4e80 con 0x7f775815f370 2023-08-10T10:41:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.892+0000 7f776041a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77580c5120 con 0x7f77580afc20 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54526/0 (socket says 172.21.15.50:54526) 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 -- 172.21.15.50:0/181410208 learned_addr learned my addr 172.21.15.50:0/181410208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775e9b7640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f775815f370 0x7f77580b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775e1b6640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 0x7f77580c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 -- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 msgr2=0x7f77580c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 0x7f77580c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 -- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f775815f370 msgr2=0x7f77580b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f775815f370 0x7f77580b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 -- 172.21.15.50:0/181410208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009b30 con 0x7f77580cf3c0 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775e1b6640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 0x7f77580c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.893+0000 7f775d9b5640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f774800e870 tx=0x7f774800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.894+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480094f0 con 0x7f77580cf3c0 2023-08-10T10:41:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.894+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800c940 con 0x7f77580cf3c0 2023-08-10T10:41:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.894+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800ccf0 con 0x7f77580cf3c0 2023-08-10T10:41:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.894+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77580c5400 con 0x7f77580cf3c0 2023-08-10T10:41:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.894+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77580c6420 con 0x7f77580cf3c0 2023-08-10T10:41:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.895+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77580c5bc0 con 0x7f77580cf3c0 2023-08-10T10:41:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.896+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7748013470 con 0x7f77580cf3c0 2023-08-10T10:41:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.897+0000 7f774effd640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 0x7f773c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.897+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f77480892a0 con 0x7f77580cf3c0 2023-08-10T10:41:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.897+0000 7f775e1b6640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 0x7f773c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.898+0000 7f775e1b6640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 0x7f773c06d140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7754000fb0 tx=0x7f7754009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:24.902+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7748054660 con 0x7f77580cf3c0 2023-08-10T10:41:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.166+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f775804e270 con 0x7f77580cf3c0 2023-08-10T10:41:25.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.628+0000 7f774effd640 1 -- 172.21.15.50:0/181410208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v188) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7748057c80 con 0x7f77580cf3c0 2023-08-10T10:41:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.632+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 msgr2=0x7f773c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.632+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 0x7f773c06d140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7754000fb0 tx=0x7f7754009040 comp rx=0 tx=0).stop 2023-08-10T10:41:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.632+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 msgr2=0x7f77580b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.632+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f774800e870 tx=0x7f774800ed30 comp rx=0 tx=0).stop 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 shutdown_connections 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f773c06ac80 0x7f773c06d140 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f775815f370 0x7f77580b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77580cf3c0 0x7f77580b6140 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 --2- 172.21.15.50:0/181410208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77580afc20 0x7f77580c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 >> 172.21.15.50:0/181410208 conn(0x7f77580d0930 msgr2=0x7f775815cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 shutdown_connections 2023-08-10T10:41:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:25.633+0000 7f776041a640 1 -- 172.21.15.50:0/181410208 wait complete. 2023-08-10T10:41:25.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-10T10:41:25.901 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_objectstore":"memstore"} 2023-08-10T10:41:25.901 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-10T10:41:25.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.129+0000 7fe211294640 1 Processor -- start 2023-08-10T10:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.129+0000 7fe211294640 1 -- start start 2023-08-10T10:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.130+0000 7fe211294640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 0x7fe20c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe211294640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe20c0cdf80 0x7fe20c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe211294640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c161180 con 0x7fe20c0b8430 2023-08-10T10:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe211294640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0b5bd0 con 0x7fe20c0cdf80 2023-08-10T10:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe211294640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c161460 con 0x7fe20c15cd60 2023-08-10T10:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe20b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe20c0cdf80 0x7fe20c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe20b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe20c0cdf80 0x7fe20c0d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54540/0 (socket says 172.21.15.50:54540) 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1337714744 learned_addr learned my addr 172.21.15.50:0/1337714744 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe20affd640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 0x7fe20c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.131+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1337714744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 msgr2=0x7fe20c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.132+0000 7fe20b7fe640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 0x7fe20c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.132+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1337714744 >> v1:172.21.15.117:6789/0 conn(0x7fe20c0b8430 legacy=0x7fe20c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.132+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1337714744 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c161740 con 0x7fe20c0cdf80 2023-08-10T10:41:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.132+0000 7fe20affd640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 0x7fe20c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.133+0000 7fe20b7fe640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c0cdf80 0x7fe20c0d1400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa959b33fdae4c34 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.133+0000 7fe209ffb640 1 -- 172.21.15.50:0/1337714744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204030840 con 0x7fe20c0cdf80 2023-08-10T10:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.133+0000 7fe209ffb640 1 -- 172.21.15.50:0/1337714744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2040309a0 con 0x7fe20c0cdf80 2023-08-10T10:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.133+0000 7fe209ffb640 1 -- 172.21.15.50:0/1337714744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204030d30 con 0x7fe20c0cdf80 2023-08-10T10:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 -- 172.21.15.50:0/1337714744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c0cdf80 msgr2=0x7fe20c0d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c0cdf80 0x7fe20c0d1400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402b980 comp rx=0 tx=0).stop 2023-08-10T10:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 -- 172.21.15.50:0/1337714744 shutdown_connections 2023-08-10T10:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c0cdf80 0x7fe20c0d1400 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 --2- 172.21.15.50:0/1337714744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c15cd60 0x7fe20c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 -- 172.21.15.50:0/1337714744 >> 172.21.15.50:0/1337714744 conn(0x7fe20c0d2ac0 msgr2=0x7fe20c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 -- 172.21.15.50:0/1337714744 shutdown_connections 2023-08-10T10:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.134+0000 7fe211294640 1 -- 172.21.15.50:0/1337714744 wait complete. 2023-08-10T10:41:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.136+0000 7fe211294640 1 Processor -- start 2023-08-10T10:41:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.137+0000 7fe211294640 1 -- start start 2023-08-10T10:41:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 0x7fe20c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 0x7fe20c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1536b0 con 0x7fe20c15cd60 2023-08-10T10:41:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c152aa0 con 0x7fe20c0b8430 2023-08-10T10:41:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe211294640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c152d80 con 0x7fe20c0cdf80 2023-08-10T10:41:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54542/0 (socket says 172.21.15.50:54542) 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.138+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1216961558 learned_addr learned my addr 172.21.15.50:0/1216961558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20affd640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 0x7fe20c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20a7fc640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 0x7fe20c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 msgr2=0x7fe20c0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 0x7fe20c0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 msgr2=0x7fe20c152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 0x7fe20c152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 -- 172.21.15.50:0/1216961558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040094d0 con 0x7fe20c15cd60 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20affd640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 0x7fe20c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20a7fc640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 0x7fe20c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.139+0000 7fe20b7fe640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe204004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.140+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040307d0 con 0x7fe20c15cd60 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.140+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c153060 con 0x7fe20c15cd60 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.140+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c152740 con 0x7fe20c15cd60 2023-08-10T10:41:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.140+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20404d460 con 0x7fe20c15cd60 2023-08-10T10:41:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.140+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20404d7d0 con 0x7fe20c15cd60 2023-08-10T10:41:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.141+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c0d0bc0 con 0x7fe20c15cd60 2023-08-10T10:41:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.142+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe20404d930 con 0x7fe20c15cd60 2023-08-10T10:41:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.143+0000 7fe1f37fe640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 0x7fe1f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.143+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe20403e070 con 0x7fe20c15cd60 2023-08-10T10:41:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.143+0000 7fe20affd640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 0x7fe1f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.144+0000 7fe20affd640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 0x7fe1f806d110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00d430 tx=0x7fe1fc007530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.147+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe204077880 con 0x7fe20c15cd60 2023-08-10T10:41:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.342+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe20c04e270 con 0x7fe20c15cd60 2023-08-10T10:41:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.343+0000 7fe1f37fe640 1 -- 172.21.15.50:0/1216961558 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+14756 (secure 0 0 0) 0x7fe20407aea0 con 0x7fe20c15cd60 2023-08-10T10:41:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:26.344 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":64,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:22.595330+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6836/2990759901":"2023-08-11T10:41:19.488251+0000","172.21.15.50:6834/2990759901":"2023-08-11T10:41:19.488251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 msgr2=0x7fe1f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 0x7fe1f806d110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00d430 tx=0x7fe1fc007530 comp rx=0 tx=0).stop 2023-08-10T10:41:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 msgr2=0x7fe20c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe204004730 comp rx=0 tx=0).stop 2023-08-10T10:41:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 shutdown_connections 2023-08-10T10:41:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe20c15cd60 0x7fe20c153b40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c0cdf80 0x7fe20c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe1f806ac50 0x7fe1f806d110 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 --2- 172.21.15.50:0/1216961558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0b8430 0x7fe20c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.346+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 >> 172.21.15.50:0/1216961558 conn(0x7fe20c0d2ac0 msgr2=0x7fe20c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.347+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 shutdown_connections 2023-08-10T10:41:26.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.347+0000 7fe211294640 1 -- 172.21.15.50:0/1216961558 wait complete. 2023-08-10T10:41:26.370 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:41:26.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:41:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.606+0000 7f1ab7324640 1 Processor -- start 2023-08-10T10:41:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.606+0000 7f1ab7324640 1 -- start start 2023-08-10T10:41:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.607+0000 7f1ab7324640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.607+0000 7f1ab7324640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ab01615e0 0x7f1ab006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.607+0000 7f1ab7324640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab0160a40 con 0x7f1ab015cf70 2023-08-10T10:41:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.607+0000 7f1ab7324640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab00b4bb0 con 0x7f1ab01615e0 2023-08-10T10:41:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.607+0000 7f1ab7324640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00b4e90 con 0x7f1ab015cb90 2023-08-10T10:41:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ab01615e0 0x7f1ab006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ab01615e0 0x7f1ab006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54548/0 (socket says 172.21.15.50:54548) 2023-08-10T10:41:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 -- 172.21.15.50:0/3485299770 learned_addr learned my addr 172.21.15.50:0/3485299770 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab50c0640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 -- 172.21.15.50:0/3485299770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 msgr2=0x7f1ab00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab00b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 -- 172.21.15.50:0/3485299770 >> v1:172.21.15.117:6789/0 conn(0x7f1ab015cf70 legacy=0x7f1ab0160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.608+0000 7f1ab58c1640 1 -- 172.21.15.50:0/3485299770 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00b5170 con 0x7f1ab01615e0 2023-08-10T10:41:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.610+0000 7f1ab58c1640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab01615e0 0x7f1ab006fcc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009e50 tx=0x7f1aa802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84385b7d0f1dbc4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.610+0000 7f1aaffff640 1 -- 172.21.15.50:0/3485299770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa802ca80 con 0x7f1ab01615e0 2023-08-10T10:41:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.610+0000 7f1aaffff640 1 -- 172.21.15.50:0/3485299770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa802cbe0 con 0x7f1ab01615e0 2023-08-10T10:41:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.610+0000 7f1aaffff640 1 -- 172.21.15.50:0/3485299770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80343f0 con 0x7f1ab01615e0 2023-08-10T10:41:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 -- 172.21.15.50:0/3485299770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab01615e0 msgr2=0x7f1ab006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab01615e0 0x7f1ab006fcc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009e50 tx=0x7f1aa802bee0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 -- 172.21.15.50:0/3485299770 shutdown_connections 2023-08-10T10:41:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab01615e0 0x7f1ab006fcc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 --2- 172.21.15.50:0/3485299770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab00b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 -- 172.21.15.50:0/3485299770 >> 172.21.15.50:0/3485299770 conn(0x7f1ab00cf640 msgr2=0x7f1ab00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 -- 172.21.15.50:0/3485299770 shutdown_connections 2023-08-10T10:41:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.611+0000 7f1ab7324640 1 -- 172.21.15.50:0/3485299770 wait complete. 2023-08-10T10:41:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.613+0000 7f1ab7324640 1 Processor -- start 2023-08-10T10:41:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.613+0000 7f1ab7324640 1 -- start start 2023-08-10T10:41:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab01615e0 0x7f1ab00c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab015eb70 con 0x7f1ab015cf70 2023-08-10T10:41:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab015def0 con 0x7f1ab01615e0 2023-08-10T10:41:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab7324640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab015e1d0 con 0x7f1ab015cb90 2023-08-10T10:41:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab48bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab48bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54556/0 (socket says 172.21.15.50:54556) 2023-08-10T10:41:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.614+0000 7f1ab48bf640 1 -- 172.21.15.50:0/168901074 learned_addr learned my addr 172.21.15.50:0/168901074 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab58c1640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab01615e0 0x7f1ab00c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab50c0640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 -- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 msgr2=0x7f1ab014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 -- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab01615e0 msgr2=0x7f1ab00c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab01615e0 0x7f1ab00c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 -- 172.21.15.50:0/168901074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8009b30 con 0x7f1ab015cf70 2023-08-10T10:41:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab48bf640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c430 tx=0x7f1aa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4011790 con 0x7f1ab015cf70 2023-08-10T10:41:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40118f0 con 0x7f1ab015cf70 2023-08-10T10:41:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4011ce0 con 0x7f1ab015cf70 2023-08-10T10:41:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.615+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab015e4b0 con 0x7f1ab015cf70 2023-08-10T10:41:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.616+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab00cc440 con 0x7f1ab015cf70 2023-08-10T10:41:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.617+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab00cc660 con 0x7f1ab015cf70 2023-08-10T10:41:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.618+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1aa401c460 con 0x7f1ab015cf70 2023-08-10T10:41:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.619+0000 7f1aadffb640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 0x7f1a9c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.619+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1aa40891c0 con 0x7f1ab015cf70 2023-08-10T10:41:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.619+0000 7f1ab50c0640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 0x7f1a9c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.620+0000 7f1ab50c0640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 0x7f1a9c06d140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0006fd0 tx=0x7f1aa0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.624+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1aa40544f0 con 0x7f1ab015cf70 2023-08-10T10:41:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.815+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ab015ecb0 con 0x7f1ab015cf70 2023-08-10T10:41:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.816+0000 7f1aadffb640 1 -- 172.21.15.50:0/168901074 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1aa4057b10 con 0x7f1ab015cf70 2023-08-10T10:41:26.817 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:41:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 msgr2=0x7f1a9c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 0x7f1a9c06d140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0006fd0 tx=0x7f1aa0008040 comp rx=0 tx=0).stop 2023-08-10T10:41:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 msgr2=0x7f1ab00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c430 tx=0x7f1aa400c8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 shutdown_connections 2023-08-10T10:41:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a9c06ac80 0x7f1a9c06d140 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab01615e0 0x7f1ab00c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ab015cf70 0x7f1ab00cbf00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 --2- 172.21.15.50:0/168901074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab015cb90 0x7f1ab014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.818+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 >> 172.21.15.50:0/168901074 conn(0x7f1ab00cf640 msgr2=0x7f1ab00b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.819+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 shutdown_connections 2023-08-10T10:41:26.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:26.819+0000 7f1ab7324640 1 -- 172.21.15.50:0/168901074 wait complete. 2023-08-10T10:41:26.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:41:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.070+0000 7f9dbc199640 1 Processor -- start 2023-08-10T10:41:27.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.070+0000 7f9dbc199640 1 -- start start 2023-08-10T10:41:27.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9dbc199640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4159c10 0x7f9db40b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9dbc199640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9dbc199640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40adf10 con 0x7f9db40ca360 2023-08-10T10:41:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9dbc199640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40ca7f0 con 0x7f9db4159c10 2023-08-10T10:41:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9dbc199640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db406ebb0 con 0x7f9db40ada90 2023-08-10T10:41:27.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9db9f35640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4159c10 0x7f9db40b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9db9f35640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9db4159c10 0x7f9db40b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54568/0 (socket says 172.21.15.50:54568) 2023-08-10T10:41:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9db9f35640 1 -- 172.21.15.50:0/523088659 learned_addr learned my addr 172.21.15.50:0/523088659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.072+0000 7f9db9734640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.073+0000 7f9db9f35640 1 -- 172.21.15.50:0/523088659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 msgr2=0x7f9db40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.073+0000 7f9db9f35640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db40c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.073+0000 7f9db9f35640 1 -- 172.21.15.50:0/523088659 >> v1:172.21.15.50:6789/0 conn(0x7f9db40ca360 legacy=0x7f9db40cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.073+0000 7f9db9f35640 1 -- 172.21.15.50:0/523088659 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db406ee90 con 0x7f9db4159c10 2023-08-10T10:41:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.074+0000 7f9db9f35640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4159c10 0x7f9db40b0cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009e50 tx=0x7f9da402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f1baeef88a643f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.074+0000 7f9db8f33640 1 -- 172.21.15.50:0/523088659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da402ca80 con 0x7f9db4159c10 2023-08-10T10:41:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.074+0000 7f9db8f33640 1 -- 172.21.15.50:0/523088659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da402cbe0 con 0x7f9db4159c10 2023-08-10T10:41:27.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.074+0000 7f9db8f33640 1 -- 172.21.15.50:0/523088659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40343f0 con 0x7f9db4159c10 2023-08-10T10:41:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 -- 172.21.15.50:0/523088659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4159c10 msgr2=0x7f9db40b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4159c10 0x7f9db40b0cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009e50 tx=0x7f9da402bee0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 -- 172.21.15.50:0/523088659 shutdown_connections 2023-08-10T10:41:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db40c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 --2- 172.21.15.50:0/523088659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db4159c10 0x7f9db40b0cd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 -- 172.21.15.50:0/523088659 >> 172.21.15.50:0/523088659 conn(0x7f9db40b01b0 msgr2=0x7f9db40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 -- 172.21.15.50:0/523088659 shutdown_connections 2023-08-10T10:41:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.075+0000 7f9dbc199640 1 -- 172.21.15.50:0/523088659 wait complete. 2023-08-10T10:41:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.077+0000 7f9dbc199640 1 Processor -- start 2023-08-10T10:41:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.077+0000 7f9dbc199640 1 -- start start 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db4159c10 0x7f9db40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40b25a0 con 0x7f9db40ca360 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40b2860 con 0x7f9db4159c10 2023-08-10T10:41:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9dbc199640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40b2b40 con 0x7f9db40ada90 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9db9734640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9db9734640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54576/0 (socket says 172.21.15.50:54576) 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.078+0000 7f9db9734640 1 -- 172.21.15.50:0/925620459 learned_addr learned my addr 172.21.15.50:0/925620459 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9f35640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9dba736640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db4159c10 0x7f9db40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 -- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 msgr2=0x7f9db414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 -- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db4159c10 msgr2=0x7f9db40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db4159c10 0x7f9db40b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 -- 172.21.15.50:0/925620459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4009b30 con 0x7f9db40ca360 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.079+0000 7f9db9734640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9da800d5f0 tx=0x7f9da800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.080+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80125f0 con 0x7f9db40ca360 2023-08-10T10:41:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.080+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8012750 con 0x7f9db40ca360 2023-08-10T10:41:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.080+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8012b00 con 0x7f9db40ca360 2023-08-10T10:41:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.080+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40b2e20 con 0x7f9db40ca360 2023-08-10T10:41:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.080+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db414b3f0 con 0x7f9db40ca360 2023-08-10T10:41:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.081+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db40612b0 con 0x7f9db40ca360 2023-08-10T10:41:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.082+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9da8012c60 con 0x7f9db40ca360 2023-08-10T10:41:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.083+0000 7f9db27fc640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 0x7f9da006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.083+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9da8089710 con 0x7f9db40ca360 2023-08-10T10:41:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.083+0000 7f9db9f35640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 0x7f9da006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.084+0000 7f9db9f35640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 0x7f9da006d140 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9da4035000 tx=0x7f9da4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.088+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9da8054a40 con 0x7f9db40ca360 2023-08-10T10:41:27.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.279+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9db4070b70 con 0x7f9db40ca360 2023-08-10T10:41:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.279+0000 7f9db27fc640 1 -- 172.21.15.50:0/925620459 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9da8058060 con 0x7f9db40ca360 2023-08-10T10:41:27.280 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:41:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 msgr2=0x7f9da006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 0x7f9da006d140 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9da4035000 tx=0x7f9da4030000 comp rx=0 tx=0).stop 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 msgr2=0x7f9db40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9da800d5f0 tx=0x7f9da800dab0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 shutdown_connections 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9da006ac80 0x7f9da006d140 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db4159c10 0x7f9db40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db40ca360 0x7f9db40b3620 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 --2- 172.21.15.50:0/925620459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db40ada90 0x7f9db414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 >> 172.21.15.50:0/925620459 conn(0x7f9db40b01b0 msgr2=0x7f9db415c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 shutdown_connections 2023-08-10T10:41:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.282+0000 7f9dbc199640 1 -- 172.21.15.50:0/925620459 wait complete. 2023-08-10T10:41:27.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:41:27.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.534+0000 7fd69ffff640 1 Processor -- start 2023-08-10T10:41:27.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.534+0000 7fd69ffff640 1 -- start start 2023-08-10T10:41:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6a015ca80 0x7fd6a00ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69ffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00cdb20 con 0x7fd6a0161360 2023-08-10T10:41:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69ffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00cde00 con 0x7fd6a00696a0 2023-08-10T10:41:27.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69ffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00cc0d0 con 0x7fd6a015ca80 2023-08-10T10:41:27.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6a0161360 0x7fd6a00cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33556/0 (socket says 172.21.15.50:33556) 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.536+0000 7fd69e7fc640 1 -- 172.21.15.50:0/1699546152 learned_addr learned my addr 172.21.15.50:0/1699546152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69effd640 1 --2- 172.21.15.50:0/1699546152 >> v2:172.21.15.117:3300/0 conn(0x7fd6a015ca80 0x7fd6a00ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231557031 0 0) 0x7fd6a00cdb20 con 0x7fd6a0161360 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd688003520 con 0x7fd6a0161360 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589189411 0 0) 0x7fd688003520 con 0x7fd6a0161360 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 >> v2:172.21.15.117:3300/0 conn(0x7fd6a015ca80 msgr2=0x7fd6a00ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 --2- 172.21.15.50:0/1699546152 >> v2:172.21.15.117:3300/0 conn(0x7fd6a015ca80 0x7fd6a00ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 >> v1:172.21.15.117:6789/0 conn(0x7fd6a00696a0 legacy=0x7fd6a00c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00cc3b0 con 0x7fd6a0161360 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd694001670 con 0x7fd6a0161360 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 >> v1:172.21.15.50:6789/0 conn(0x7fd6a0161360 legacy=0x7fd6a00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880039e0 0x7fd688003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 0x7fd688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6880051f0 0x7fd68800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00cc0d0 con 0x7fd6880047c0 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68800c150 con 0x7fd6880051f0 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.537+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68800c310 con 0x7fd6880039e0 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 0x7fd688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69effd640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880039e0 0x7fd688003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 -- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880039e0 msgr2=0x7fd688003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880039e0 0x7fd688003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 -- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6880051f0 msgr2=0x7fd68800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6880051f0 0x7fd68800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69e7fc640 1 -- 172.21.15.50:0/1699546152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688003520 con 0x7fd6880047c0 2023-08-10T10:41:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.538+0000 7fd69f7fe640 1 -- 172.21.15.50:0/1699546152 reap_dead start 2023-08-10T10:41:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.539+0000 7fd69e7fc640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 0x7fd688004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c240 tx=0x7fd6880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934dbb8adb72b9d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.539+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694005ad0 con 0x7fd6880047c0 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.539+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694005c30 con 0x7fd6880047c0 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.539+0000 7fd69dffb640 1 -- 172.21.15.50:0/1699546152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69402caf0 con 0x7fd6880047c0 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 -- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 msgr2=0x7fd688004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 0x7fd688004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c240 tx=0x7fd6880057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 -- 172.21.15.50:0/1699546152 shutdown_connections 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 --2- 172.21.15.50:0/1699546152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6880047c0 0x7fd688004c40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 -- 172.21.15.50:0/1699546152 >> 172.21.15.50:0/1699546152 conn(0x7fd6a00caf80 msgr2=0x7fd6a00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 -- 172.21.15.50:0/1699546152 shutdown_connections 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.540+0000 7fd69ffff640 1 -- 172.21.15.50:0/1699546152 wait complete. 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.542+0000 7fd69ffff640 1 Processor -- start 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.542+0000 7fd69ffff640 1 -- start start 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880047c0 0x7fd6a015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a015bac0 0x7fd6a01f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00b1b00 con 0x7fd6a00b1140 2023-08-10T10:41:27.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a006eef0 con 0x7fd6a015bac0 2023-08-10T10:41:27.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0071840 con 0x7fd6880047c0 2023-08-10T10:41:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54600/0 (socket says 172.21.15.50:54600) 2023-08-10T10:41:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.543+0000 7fd69f7fe640 1 -- 172.21.15.50:0/549923912 learned_addr learned my addr 172.21.15.50:0/549923912 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 -- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880047c0 msgr2=0x7fd6a015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69effd640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880047c0 0x7fd6a015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69e7fc640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a015bac0 0x7fd6a01f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880047c0 0x7fd6a015d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 -- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a015bac0 msgr2=0x7fd6a01f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a015bac0 0x7fd6a01f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 -- 172.21.15.50:0/549923912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a015bf40 con 0x7fd6a00b1140 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69f7fe640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00adf70 tx=0x7fd69800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698007070 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6980071d0 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698007580 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.544+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a01f6b70 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.545+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a006e8a0 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.546+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a0066e30 con 0x7fd6a00b1140 2023-08-10T10:41:27.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.547+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6980076e0 con 0x7fd6a00b1140 2023-08-10T10:41:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.548+0000 7fd687fff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 0x7fd68c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.548+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd698088670 con 0x7fd6a00b1140 2023-08-10T10:41:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.548+0000 7fd69effd640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 0x7fd68c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.549+0000 7fd69effd640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 0x7fd68c06d110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6900099d0 tx=0x7fd690008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.552+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd6980539a0 con 0x7fd6a00b1140 2023-08-10T10:41:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.749+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd6a00c1e10 con 0x7fd6a00b1140 2023-08-10T10:41:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.757+0000 7fd687fff640 1 -- 172.21.15.50:0/549923912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6980170c0 con 0x7fd6a00b1140 2023-08-10T10:41:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.760+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 msgr2=0x7fd68c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.760+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 0x7fd68c06d110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6900099d0 tx=0x7fd690008040 comp rx=0 tx=0).stop 2023-08-10T10:41:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.760+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 msgr2=0x7fd6a00b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.760+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00adf70 tx=0x7fd69800c960 comp rx=0 tx=0).stop 2023-08-10T10:41:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 shutdown_connections 2023-08-10T10:41:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a00b1140 0x7fd6a00b15c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd68c06ac50 0x7fd68c06d110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6a015bac0 0x7fd6a01f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 --2- 172.21.15.50:0/549923912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6880047c0 0x7fd6a015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 >> 172.21.15.50:0/549923912 conn(0x7fd6a00caf80 msgr2=0x7fd6a00c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 shutdown_connections 2023-08-10T10:41:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:27.761+0000 7fd69ffff640 1 -- 172.21.15.50:0/549923912 wait complete. 2023-08-10T10:41:27.781 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:41:27.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:41:27.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:41:28.020 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:41:28.020 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:28.021 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:28.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:41:28.086 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:28.087 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:28.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:41:28.148 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:28.148 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:28.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:41:28.214 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:28.214 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:28.271 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:41:28.271 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:41:28.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.507+0000 7fae15369640 1 Processor -- start 2023-08-10T10:41:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.507+0000 7fae15369640 1 -- start start 2023-08-10T10:41:28.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae15369640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae15369640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae100aff10 0x7fae100b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae15369640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae101604d0 con 0x7fae100ccec0 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae15369640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae100b08d0 con 0x7fae100aff10 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae15369640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100cca30 con 0x7fae101600f0 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae0f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae100aff10 0x7fae100b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae0f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae100aff10 0x7fae100b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54612/0 (socket says 172.21.15.50:54612) 2023-08-10T10:41:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.509+0000 7fae0f7fe640 1 -- 172.21.15.50:0/883350580 learned_addr learned my addr 172.21.15.50:0/883350580 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.510+0000 7fae0ffff640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.510+0000 7fae0f7fe640 1 -- 172.21.15.50:0/883350580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 msgr2=0x7fae100ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.510+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.510+0000 7fae0f7fe640 1 -- 172.21.15.50:0/883350580 >> v1:172.21.15.117:6789/0 conn(0x7fae100ccec0 legacy=0x7fae100cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.510+0000 7fae0f7fe640 1 -- 172.21.15.50:0/883350580 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100cc100 con 0x7fae100aff10 2023-08-10T10:41:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.511+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae100b0390 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fae040098a0 tx=0x7fae0402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0cd6d7a1e3b93 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae0effd640 1 -- 172.21.15.50:0/883350580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040317c0 con 0x7fae100aff10 2023-08-10T10:41:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae0effd640 1 -- 172.21.15.50:0/883350580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04031920 con 0x7fae100aff10 2023-08-10T10:41:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae0effd640 1 -- 172.21.15.50:0/883350580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04031cb0 con 0x7fae100aff10 2023-08-10T10:41:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 -- 172.21.15.50:0/883350580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 msgr2=0x7fae100b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae100b0390 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fae040098a0 tx=0x7fae0402b860 comp rx=0 tx=0).stop 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 -- 172.21.15.50:0/883350580 shutdown_connections 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae100b0390 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 --2- 172.21.15.50:0/883350580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 -- 172.21.15.50:0/883350580 >> 172.21.15.50:0/883350580 conn(0x7fae1006ab80 msgr2=0x7fae1006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.512+0000 7fae15369640 1 -- 172.21.15.50:0/883350580 shutdown_connections 2023-08-10T10:41:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.513+0000 7fae15369640 1 -- 172.21.15.50:0/883350580 wait complete. 2023-08-10T10:41:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.514+0000 7fae15369640 1 Processor -- start 2023-08-10T10:41:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.514+0000 7fae15369640 1 -- start start 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 0x7fae10153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10071290 con 0x7fae100aff10 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b2b10 con 0x7fae100ccec0 2023-08-10T10:41:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.515+0000 7fae15369640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b2df0 con 0x7fae101600f0 2023-08-10T10:41:28.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54618/0 (socket says 172.21.15.50:54618) 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 -- 172.21.15.50:0/2315926999 learned_addr learned my addr 172.21.15.50:0/2315926999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 -- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 msgr2=0x7fae100b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 0x7fae10153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 -- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 msgr2=0x7fae10153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 0x7fae10153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0ffff640 1 -- 172.21.15.50:0/2315926999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040094d0 con 0x7fae100aff10 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.516+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 0x7fae10153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae0ffff640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d800 tx=0x7fae0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000b6c0 con 0x7fae100aff10 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0000b820 con 0x7fae100aff10 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000bbb0 con 0x7fae100aff10 2023-08-10T10:41:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae100b30d0 con 0x7fae100aff10 2023-08-10T10:41:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.517+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae100b2820 con 0x7fae100aff10 2023-08-10T10:41:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.518+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae10066e30 con 0x7fae100aff10 2023-08-10T10:41:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.519+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae0000bd10 con 0x7fae100aff10 2023-08-10T10:41:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.520+0000 7fae0cff9640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 0x7fadfc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.521+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fae000897d0 con 0x7fae100aff10 2023-08-10T10:41:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.521+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 0x7fadfc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.521+0000 7fae0f7fe640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 0x7fadfc06d110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae04036000 tx=0x7fae0403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.525+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae00054b00 con 0x7fae100aff10 2023-08-10T10:41:28.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.757+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae100ad720 con 0x7fae100aff10 2023-08-10T10:41:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.761+0000 7fae0cff9640 1 -- 172.21.15.50:0/2315926999 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fae00058120 con 0x7fae100aff10 2023-08-10T10:41:28.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:28.763 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4913,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/1185200383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1185200383},{"type":"v1","addr":"172.21.15.117:6834","nonce":1185200383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2146224475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2146224475},{"type":"v1","addr":"172.21.15.50:6837","nonce":2146224475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3341547807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3341547807},{"type":"v1","addr":"172.21.15.117:6835","nonce":3341547807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/3615876826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3615876826},{"type":"v1","addr":"172.21.15.50:6836","nonce":3615876826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-08-10T10:41:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-08-10T10:41:28.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.765+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 msgr2=0x7fadfc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.765+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 0x7fadfc06d110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae04036000 tx=0x7fae0403d040 comp rx=0 tx=0).stop 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 msgr2=0x7fae10070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d800 tx=0x7fae0000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 shutdown_connections 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae101600f0 0x7fae100b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fadfc06ac50 0x7fadfc06d110 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae100ccec0 0x7fae10153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 --2- 172.21.15.50:0/2315926999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae100aff10 0x7fae10070d50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 >> 172.21.15.50:0/2315926999 conn(0x7fae1006ab80 msgr2=0x7fae1015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 shutdown_connections 2023-08-10T10:41:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:28.766+0000 7fae15369640 1 -- 172.21.15.50:0/2315926999 wait complete. 2023-08-10T10:41:28.788 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:41:28.788 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:41:28.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:41:28.789 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:41:28.790 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:41:28.790 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:41:28.790 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:41:28.790 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:41:28.791 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:41:28.791 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:41:28.791 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:41:28.791 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:41:28.792 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:41:28.792 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:41:28.792 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:41:28.792 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:41:28.813 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:41:28.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:41:28.816 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:41:28.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:41:28.825 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:41:28.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:41:28.829 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:41:28.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:41:28.864 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:41:28.865 DEBUG:teuthology.parallel:result is None 2023-08-10T10:41:28.873 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:41:28.873 DEBUG:teuthology.parallel:result is None 2023-08-10T10:41:28.876 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:41:28.877 DEBUG:teuthology.parallel:result is None 2023-08-10T10:41:28.883 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:41:28.884 DEBUG:teuthology.parallel:result is None 2023-08-10T10:41:28.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:41:29.031 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:41:29.031 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:41:29.043 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:41:29.048 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:41:29.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.079+0000 7fc441221640 1 Processor -- start 2023-08-10T10:41:29.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.079+0000 7fc441221640 1 -- start start 2023-08-10T10:41:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c0d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc43c0d2370 0x7fc43c0d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0d0b90 con 0x7fc43c0d2370 2023-08-10T10:41:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c1614d0 con 0x7fc43c15ff90 2023-08-10T10:41:29.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.080+0000 7fc441221640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c160370 con 0x7fc43c0cd960 2023-08-10T10:41:29.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.081+0000 7fc43bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.081+0000 7fc440a20640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc43c0d2370 0x7fc43c0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.081+0000 7fc43bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35226/0 (socket says 172.21.15.50:35226) 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.081+0000 7fc43bfff640 1 -- 172.21.15.50:0/820132624 learned_addr learned my addr 172.21.15.50:0/820132624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.081+0000 7fc43b7fe640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c0d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc440a20640 1 -- 172.21.15.50:0/820132624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 msgr2=0x7fc43c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc440a20640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c0d1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc440a20640 1 -- 172.21.15.50:0/820132624 >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 msgr2=0x7fc43c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc440a20640 1 --2- 172.21.15.50:0/820132624 >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc440a20640 1 -- 172.21.15.50:0/820132624 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0d0d90 con 0x7fc43c0d2370 2023-08-10T10:41:29.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc43bfff640 1 --2- 172.21.15.50:0/820132624 >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:29.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.082+0000 7fc43b7fe640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c0d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.083+0000 7fc440a20640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c0d2370 0x7fc43c0d28b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc43c071330 tx=0x7fc43402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1976f7d13d6989c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.083+0000 7fc43affd640 1 -- 172.21.15.50:0/820132624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43402cbe0 con 0x7fc43c0d2370 2023-08-10T10:41:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.083+0000 7fc43affd640 1 -- 172.21.15.50:0/820132624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43402cd40 con 0x7fc43c0d2370 2023-08-10T10:41:29.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.083+0000 7fc43affd640 1 -- 172.21.15.50:0/820132624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434034660 con 0x7fc43c0d2370 2023-08-10T10:41:29.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 -- 172.21.15.50:0/820132624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c0d2370 msgr2=0x7fc43c0d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c0d2370 0x7fc43c0d28b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc43c071330 tx=0x7fc43402be30 comp rx=0 tx=0).stop 2023-08-10T10:41:29.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 -- 172.21.15.50:0/820132624 shutdown_connections 2023-08-10T10:41:29.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c0d2370 0x7fc43c0d28b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 --2- 172.21.15.50:0/820132624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c0d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 --2- 172.21.15.50:0/820132624 >> v2:172.21.15.117:3300/0 conn(0x7fc43c15ff90 0x7fc43c160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 -- 172.21.15.50:0/820132624 >> 172.21.15.50:0/820132624 conn(0x7fc43c069ac0 msgr2=0x7fc43c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 -- 172.21.15.50:0/820132624 shutdown_connections 2023-08-10T10:41:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.084+0000 7fc441221640 1 -- 172.21.15.50:0/820132624 wait complete. 2023-08-10T10:41:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.086+0000 7fc441221640 1 Processor -- start 2023-08-10T10:41:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.086+0000 7fc441221640 1 -- start start 2023-08-10T10:41:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0d2370 0x7fc43c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15c6c0 con 0x7fc43c15ff90 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0cccc0 con 0x7fc43c0d2370 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc441221640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15bab0 con 0x7fc43c0cd960 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc440a20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc440a20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54660/0 (socket says 172.21.15.50:54660) 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc440a20640 1 -- 172.21.15.50:0/2194091628 learned_addr learned my addr 172.21.15.50:0/2194091628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc43b7fe640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0d2370 0x7fc43c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.087+0000 7fc43bfff640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 -- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 msgr2=0x7fc43c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 -- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0d2370 msgr2=0x7fc43c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0d2370 0x7fc43c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 -- 172.21.15.50:0/2194091628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094d0 con 0x7fc43c15ff90 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc440a20640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc434009e80 tx=0x7fc434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434040650 con 0x7fc43c15ff90 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4340407b0 con 0x7fc43c15ff90 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434040b60 con 0x7fc43c15ff90 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc434009a70 con 0x7fc43c15ff90 2023-08-10T10:41:29.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.088+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c15c070 con 0x7fc43c15ff90 2023-08-10T10:41:29.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.090+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c15c870 con 0x7fc43c15ff90 2023-08-10T10:41:29.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.090+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc434040cc0 con 0x7fc43c15ff90 2023-08-10T10:41:29.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.091+0000 7fc438ff9640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 0x7fc42806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.092+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc4340abde0 con 0x7fc43c15ff90 2023-08-10T10:41:29.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.092+0000 7fc43bfff640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 0x7fc42806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.093+0000 7fc43bfff640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 0x7fc42806d110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006ca0 tx=0x7fc42c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:29.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.095+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc43c15c870 con 0x7fc43c15ff90 2023-08-10T10:41:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.299+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc43c066e30 con 0x7fc43c15ff90 2023-08-10T10:41:29.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.790+0000 7fc438ff9640 1 -- 172.21.15.50:0/2194091628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc434077250 con 0x7fc43c15ff90 2023-08-10T10:41:29.791 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:41:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 msgr2=0x7fc42806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 0x7fc42806d110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006ca0 tx=0x7fc42c009240 comp rx=0 tx=0).stop 2023-08-10T10:41:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 msgr2=0x7fc43c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc434009e80 tx=0x7fc434004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 shutdown_connections 2023-08-10T10:41:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c15ff90 0x7fc43c159900 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc42806ac50 0x7fc42806d110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0d2370 0x7fc43c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 --2- 172.21.15.50:0/2194091628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0cd960 0x7fc43c15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.794+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 >> 172.21.15.50:0/2194091628 conn(0x7fc43c069ac0 msgr2=0x7fc43c0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.795+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 shutdown_connections 2023-08-10T10:41:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:29.795+0000 7fc441221640 1 -- 172.21.15.50:0/2194091628 wait complete. 2023-08-10T10:41:29.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:41:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.055+0000 7f3d61f5d640 1 Processor -- start 2023-08-10T10:41:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.055+0000 7f3d61f5d640 1 -- start start 2023-08-10T10:41:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.056+0000 7f3d61f5d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c08a440 0x7f3d5c0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.056+0000 7f3d61f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 0x7f3d5c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.056+0000 7f3d61f5d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0b1c90 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.056+0000 7f3d61f5d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b31b0 con 0x7f3d5c08a440 2023-08-10T10:41:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.056+0000 7f3d61f5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b1640 con 0x7f3d5c0b2120 2023-08-10T10:41:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.057+0000 7f3d5affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c08a440 0x7f3d5c0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.057+0000 7f3d5affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d5c08a440 0x7f3d5c0b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54676/0 (socket says 172.21.15.50:54676) 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.057+0000 7f3d5affd640 1 -- 172.21.15.50:0/3708453248 learned_addr learned my addr 172.21.15.50:0/3708453248 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.057+0000 7f3d5bfff640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 0x7f3d5c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.058+0000 7f3d5a7fc640 1 -- 172.21.15.50:0/3708453248 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911387351 0 0) 0x7f3d5c0b1c90 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5a7fc640 1 -- 172.21.15.50:0/3708453248 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d44003520 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5affd640 1 -- 172.21.15.50:0/3708453248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 msgr2=0x7f3d5c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5affd640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 0x7f3d5c0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5affd640 1 -- 172.21.15.50:0/3708453248 >> v1:172.21.15.117:6789/0 conn(0x7f3d5c0ca5c0 legacy=0x7f3d5c0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5affd640 1 -- 172.21.15.50:0/3708453248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0b1920 con 0x7f3d5c08a440 2023-08-10T10:41:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.132+0000 7f3d5bfff640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 0x7f3d5c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.135+0000 7f3d5affd640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c08a440 0x7f3d5c0b2840 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3d500083f0 tx=0x7f3d500302e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9280cee643e837 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.136+0000 7f3d5a7fc640 1 -- 172.21.15.50:0/3708453248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000a2d0 con 0x7f3d5c08a440 2023-08-10T10:41:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.136+0000 7f3d5a7fc640 1 -- 172.21.15.50:0/3708453248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50030e90 con 0x7f3d5c08a440 2023-08-10T10:41:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.136+0000 7f3d5a7fc640 1 -- 172.21.15.50:0/3708453248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50008700 con 0x7f3d5c08a440 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 -- 172.21.15.50:0/3708453248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c08a440 msgr2=0x7f3d5c0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c08a440 0x7f3d5c0b2840 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3d500083f0 tx=0x7f3d500302e0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 -- 172.21.15.50:0/3708453248 shutdown_connections 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c0b2120 0x7f3d5c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/3708453248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c08a440 0x7f3d5c0b2840 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 -- 172.21.15.50:0/3708453248 >> 172.21.15.50:0/3708453248 conn(0x7f3d5c06b1b0 msgr2=0x7f3d5c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 -- 172.21.15.50:0/3708453248 shutdown_connections 2023-08-10T10:41:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.137+0000 7f3d61f5d640 1 -- 172.21.15.50:0/3708453248 wait complete. 2023-08-10T10:41:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.141+0000 7f3d61f5d640 1 Processor -- start 2023-08-10T10:41:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.142+0000 7f3d61f5d640 1 -- start start 2023-08-10T10:41:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.144+0000 7f3d61f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 0x7f3d5c16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.144+0000 7f3d61f5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d5c0b2120 0x7f3d5c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d61f5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d61f5d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c16a570 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d61f5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c3a10 con 0x7f3d5c0b2120 2023-08-10T10:41:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d61f5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c3cf0 con 0x7f3d5c08a440 2023-08-10T10:41:30.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54682/0 (socket says 172.21.15.50:54682) 2023-08-10T10:41:30.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 -- 172.21.15.50:0/4270483657 learned_addr learned my addr 172.21.15.50:0/4270483657 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:30.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5affd640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d5c0b2120 0x7f3d5c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5b7fe640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 0x7f3d5c16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 -- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 msgr2=0x7f3d5c16a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 0x7f3d5c16a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.145+0000 7f3d5bfff640 1 -- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d5c0b2120 msgr2=0x7f3d5c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d5bfff640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d5c0b2120 0x7f3d5c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d5bfff640 1 -- 172.21.15.50:0/4270483657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5000ab50 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d5b7fe640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 0x7f3d5c16a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d5bfff640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400ba40 tx=0x7f3d5400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54011070 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54008c30 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54004030 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.146+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0c3fd0 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.147+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0c4590 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.149+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c0c4780 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.149+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d54004190 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.150+0000 7f3d43fff640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 0x7f3d4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.150+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d54089190 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.151+0000 7f3d5b7fe640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 0x7f3d4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.152+0000 7f3d5b7fe640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 0x7f3d4806d110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c070e30 tx=0x7f3d4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.155+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3d540580c0 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.414+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d5c04e270 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.416+0000 7f3d43fff640 1 -- 172.21.15.50:0/4270483657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3d54057c50 con 0x7f3d5c0ca5c0 2023-08-10T10:41:30.416 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.417 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.418 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.420 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:41:30.420 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:41:30.420 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.420 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:41:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.423 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:41:30.423 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:41:30.423 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.424 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:41:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.427 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.428 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:41:30.429 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.430 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.433 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.433 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:41:30.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:41:30.437 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:41:30.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:41:30.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:41:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.442 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:41:30.442 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:41:30.442 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:41:30.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:41:30.443 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:30.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:30.444 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:41:30.445 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:41:30.445 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:41:30.445 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:41:30.445 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:41:30.446 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:41:30.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:30.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:41:30.447 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:41:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 msgr2=0x7f3d4806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 0x7f3d4806d110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c070e30 tx=0x7f3d4c009040 comp rx=0 tx=0).stop 2023-08-10T10:41:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 msgr2=0x7f3d5c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400ba40 tx=0x7f3d5400bf00 comp rx=0 tx=0).stop 2023-08-10T10:41:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 shutdown_connections 2023-08-10T10:41:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d5c0ca5c0 0x7f3d5c0afa70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3d4806ac50 0x7f3d4806d110 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d5c0b2120 0x7f3d5c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 --2- 172.21.15.50:0/4270483657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d5c08a440 0x7f3d5c16a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.418+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 >> 172.21.15.50:0/4270483657 conn(0x7f3d5c06b1b0 msgr2=0x7f3d5c06eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:30.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.419+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 shutdown_connections 2023-08-10T10:41:30.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.419+0000 7f3d61f5d640 1 -- 172.21.15.50:0/4270483657 wait complete. 2023-08-10T10:41:30.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.689+0000 7fb595be8640 1 Processor -- start 2023-08-10T10:41:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.689+0000 7fb595be8640 1 -- start start 2023-08-10T10:41:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb595be8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015ccb0 0x7fb5900b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb595be8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5900c9b30 0x7fb5900b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb595be8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5900719f0 con 0x7fb5900696a0 2023-08-10T10:41:30.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb595be8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900c8db0 con 0x7fb59015ccb0 2023-08-10T10:41:30.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb595be8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900c9050 con 0x7fb5900c9b30 2023-08-10T10:41:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.691+0000 7fb58f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015ccb0 0x7fb5900b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015ccb0 0x7fb5900b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54690/0 (socket says 172.21.15.50:54690) 2023-08-10T10:41:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 -- 172.21.15.50:0/4051515434 learned_addr learned my addr 172.21.15.50:0/4051515434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58effd640 1 --2- 172.21.15.50:0/4051515434 >> v2:172.21.15.117:3300/0 conn(0x7fb5900c9b30 0x7fb5900b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 -- 172.21.15.50:0/4051515434 >> v2:172.21.15.117:3300/0 conn(0x7fb5900c9b30 msgr2=0x7fb5900b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/4051515434 >> v2:172.21.15.117:3300/0 conn(0x7fb5900c9b30 0x7fb5900b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 -- 172.21.15.50:0/4051515434 >> v1:172.21.15.117:6789/0 conn(0x7fb5900696a0 legacy=0x7fb5900b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:30.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.692+0000 7fb58f7fe640 1 -- 172.21.15.50:0/4051515434 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5900c9330 con 0x7fb59015ccb0 2023-08-10T10:41:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.694+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/4051515434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015ccb0 0x7fb5900b2900 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb59006cb50 tx=0x7fb58002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd24c8d7bfa5fe5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.694+0000 7fb58e7fc640 1 -- 172.21.15.50:0/4051515434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580031870 con 0x7fb59015ccb0 2023-08-10T10:41:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.694+0000 7fb58e7fc640 1 -- 172.21.15.50:0/4051515434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800319d0 con 0x7fb59015ccb0 2023-08-10T10:41:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.694+0000 7fb58e7fc640 1 -- 172.21.15.50:0/4051515434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580031d60 con 0x7fb59015ccb0 2023-08-10T10:41:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 -- 172.21.15.50:0/4051515434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015ccb0 msgr2=0x7fb5900b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 --2- 172.21.15.50:0/4051515434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015ccb0 0x7fb5900b2900 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb59006cb50 tx=0x7fb58002b910 comp rx=0 tx=0).stop 2023-08-10T10:41:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 -- 172.21.15.50:0/4051515434 shutdown_connections 2023-08-10T10:41:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 --2- 172.21.15.50:0/4051515434 >> v2:172.21.15.117:3300/0 conn(0x7fb5900c9b30 0x7fb5900b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 --2- 172.21.15.50:0/4051515434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015ccb0 0x7fb5900b2900 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 -- 172.21.15.50:0/4051515434 >> 172.21.15.50:0/4051515434 conn(0x7fb59006b590 msgr2=0x7fb5900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:30.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 -- 172.21.15.50:0/4051515434 shutdown_connections 2023-08-10T10:41:30.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.695+0000 7fb595be8640 1 -- 172.21.15.50:0/4051515434 wait complete. 2023-08-10T10:41:30.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.697+0000 7fb595be8640 1 Processor -- start 2023-08-10T10:41:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.697+0000 7fb595be8640 1 -- start start 2023-08-10T10:41:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5900696a0 0x7fb590157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015ccb0 0x7fb5900b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901567b0 con 0x7fb5900c9b30 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590156a90 con 0x7fb5900696a0 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb595be8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590156d70 con 0x7fb59015ccb0 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb58effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb58effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54706/0 (socket says 172.21.15.50:54706) 2023-08-10T10:41:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb58effd640 1 -- 172.21.15.50:0/3202797333 learned_addr learned my addr 172.21.15.50:0/3202797333 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.698+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5900696a0 0x7fb590157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58ffff640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015ccb0 0x7fb5900b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 -- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015ccb0 msgr2=0x7fb5900b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015ccb0 0x7fb5900b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 -- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5900696a0 msgr2=0x7fb590157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5900696a0 0x7fb590157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 -- 172.21.15.50:0/3202797333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800094d0 con 0x7fb5900c9b30 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb58effd640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb58400d7d0 tx=0x7fb58400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584018070 con 0x7fb5900c9b30 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584004020 con 0x7fb5900c9b30 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840041b0 con 0x7fb5900c9b30 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.699+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb590157050 con 0x7fb5900c9b30 2023-08-10T10:41:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.700+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5901563a0 con 0x7fb5900c9b30 2023-08-10T10:41:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.701+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590156560 con 0x7fb5900c9b30 2023-08-10T10:41:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.702+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb584004310 con 0x7fb5900c9b30 2023-08-10T10:41:30.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.703+0000 7fb577fff640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 0x7fb57c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.703+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb5840890b0 con 0x7fb5900c9b30 2023-08-10T10:41:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.703+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 0x7fb57c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:30.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.704+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 0x7fb57c06d110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb580036000 tx=0x7fb58003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:30.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.707+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb584057ea0 con 0x7fb5900c9b30 2023-08-10T10:41:30.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.902+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb59004e270 con 0x7fb5900c9b30 2023-08-10T10:41:30.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.905+0000 7fb577fff640 1 -- 172.21.15.50:0/3202797333 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+14627 (secure 0 0 0) 0x7fb584057a30 con 0x7fb5900c9b30 2023-08-10T10:41:30.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:30.906 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:29.797223+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:30.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 msgr2=0x7fb57c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 0x7fb57c06d110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb580036000 tx=0x7fb58003c040 comp rx=0 tx=0).stop 2023-08-10T10:41:30.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 msgr2=0x7fb590155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb58400d7d0 tx=0x7fb58400dc90 comp rx=0 tx=0).stop 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 shutdown_connections 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015ccb0 0x7fb5900b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900c9b30 0x7fb590155e60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb57c06ac50 0x7fb57c06d110 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 --2- 172.21.15.50:0/3202797333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5900696a0 0x7fb590157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 >> 172.21.15.50:0/3202797333 conn(0x7fb59006b590 msgr2=0x7fb5900ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 shutdown_connections 2023-08-10T10:41:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:30.908+0000 7fb595be8640 1 -- 172.21.15.50:0/3202797333 wait complete. 2023-08-10T10:41:30.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:41:30.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:41:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.145+0000 7fb08aec2640 1 Processor -- start 2023-08-10T10:41:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.145+0000 7fb08aec2640 1 -- start start 2023-08-10T10:41:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb08aec2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb08406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb08aec2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb08406cc80 0x7fb08406e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb08aec2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08406d0e0 con 0x7fb08406e9b0 2023-08-10T10:41:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb08aec2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08406ee40 con 0x7fb08406cc80 2023-08-10T10:41:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb08aec2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840ce5a0 con 0x7fb08415cda0 2023-08-10T10:41:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.146+0000 7fb0896bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb08406cc80 0x7fb08406e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb08406cc80 0x7fb08406e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54716/0 (socket says 172.21.15.50:54716) 2023-08-10T10:41:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 -- 172.21.15.50:0/2644638648 learned_addr learned my addr 172.21.15.50:0/2644638648 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb089ec0640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb08406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 -- 172.21.15.50:0/2644638648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 msgr2=0x7fb08406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb08406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 -- 172.21.15.50:0/2644638648 >> v1:172.21.15.117:6789/0 conn(0x7fb08406e9b0 legacy=0x7fb084160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.147+0000 7fb0896bf640 1 -- 172.21.15.50:0/2644638648 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08415d180 con 0x7fb08406cc80 2023-08-10T10:41:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.148+0000 7fb0896bf640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406cc80 0x7fb08406e470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74d7918215f1226 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.149+0000 7fb088ebe640 1 -- 172.21.15.50:0/2644638648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074031640 con 0x7fb08406cc80 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.149+0000 7fb088ebe640 1 -- 172.21.15.50:0/2644638648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740317a0 con 0x7fb08406cc80 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.149+0000 7fb088ebe640 1 -- 172.21.15.50:0/2644638648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074031b30 con 0x7fb08406cc80 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.149+0000 7fb08aec2640 1 -- 172.21.15.50:0/2644638648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406cc80 msgr2=0x7fb08406e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.149+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406cc80 0x7fb08406e470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 -- 172.21.15.50:0/2644638648 shutdown_connections 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406cc80 0x7fb08406e470 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2644638648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb08406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 -- 172.21.15.50:0/2644638648 >> 172.21.15.50:0/2644638648 conn(0x7fb0840d06a0 msgr2=0x7fb0840d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 -- 172.21.15.50:0/2644638648 shutdown_connections 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.150+0000 7fb08aec2640 1 -- 172.21.15.50:0/2644638648 wait complete. 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.152+0000 7fb08aec2640 1 Processor -- start 2023-08-10T10:41:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.152+0000 7fb08aec2640 1 -- start start 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08406cc80 0x7fb08415b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb0840b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c9390 con 0x7fb08406e9b0 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c8780 con 0x7fb08406cc80 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08aec2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c8a60 con 0x7fb08415cda0 2023-08-10T10:41:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb0896bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb0896bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54728/0 (socket says 172.21.15.50:54728) 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb0896bf640 1 -- 172.21.15.50:0/2529403172 learned_addr learned my addr 172.21.15.50:0/2529403172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb089ec0640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08406cc80 0x7fb08415b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb08a6c1640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb0840b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.153+0000 7fb0896bf640 1 -- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 msgr2=0x7fb0840b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb0896bf640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb0840b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb0896bf640 1 -- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08406cc80 msgr2=0x7fb08415b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb0896bf640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08406cc80 0x7fb08415b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb0896bf640 1 -- 172.21.15.50:0/2529403172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740094d0 con 0x7fb08406e9b0 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb08a6c1640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb0840b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb0896bf640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07403ac60 con 0x7fb08406e9b0 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07403adc0 con 0x7fb08406e9b0 2023-08-10T10:41:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074044630 con 0x7fb08406e9b0 2023-08-10T10:41:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840c8d40 con 0x7fb08406e9b0 2023-08-10T10:41:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.154+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08415bba0 con 0x7fb08406e9b0 2023-08-10T10:41:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.156+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb084066e30 con 0x7fb08406e9b0 2023-08-10T10:41:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.157+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb07402f050 con 0x7fb08406e9b0 2023-08-10T10:41:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.158+0000 7fb07a7fc640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 0x7fb06806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.158+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0740ab080 con 0x7fb08406e9b0 2023-08-10T10:41:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.158+0000 7fb089ec0640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 0x7fb06806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.159+0000 7fb089ec0640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 0x7fb06806d140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb080006fd0 tx=0x7fb080008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.162+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb0740dd330 con 0x7fb08406e9b0 2023-08-10T10:41:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.358+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb08406b3b0 con 0x7fb08406e9b0 2023-08-10T10:41:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.359+0000 7fb07a7fc640 1 -- 172.21.15.50:0/2529403172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb074035020 con 0x7fb08406e9b0 2023-08-10T10:41:31.360 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:41:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 msgr2=0x7fb06806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 0x7fb06806d140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb080006fd0 tx=0x7fb080008040 comp rx=0 tx=0).stop 2023-08-10T10:41:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 msgr2=0x7fb0840ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb0740046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 shutdown_connections 2023-08-10T10:41:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08415cda0 0x7fb0840b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08406e9b0 0x7fb0840ca320 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb06806ac80 0x7fb06806d140 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 --2- 172.21.15.50:0/2529403172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb08406cc80 0x7fb08415b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 >> 172.21.15.50:0/2529403172 conn(0x7fb0840d06a0 msgr2=0x7fb0840b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 shutdown_connections 2023-08-10T10:41:31.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.362+0000 7fb08aec2640 1 -- 172.21.15.50:0/2529403172 wait complete. 2023-08-10T10:41:31.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:41:31.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.612+0000 7f69fc953640 1 Processor -- start 2023-08-10T10:41:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.612+0000 7f69fc953640 1 -- start start 2023-08-10T10:41:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69fc953640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f69f815aa50 0x7f69f80c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69fc953640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69f80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69fc953640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f80b1370 con 0x7f69f80aff00 2023-08-10T10:41:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69fc953640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f815ae30 con 0x7f69f815aa50 2023-08-10T10:41:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69fc953640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80b1650 con 0x7f69f80b4130 2023-08-10T10:41:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.613+0000 7f69f7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f69f80aff00 0x7f69f80cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33586/0 (socket says 172.21.15.50:33586) 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f7fff640 1 -- 172.21.15.50:0/3046269314 learned_addr learned my addr 172.21.15.50:0/3046269314 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f77fe640 1 --2- 172.21.15.50:0/3046269314 >> v2:172.21.15.117:3300/0 conn(0x7f69f815aa50 0x7f69f80c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69eeffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69f80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991345372 0 0) 0x7f69f80b1370 con 0x7f69f80aff00 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e4003520 con 0x7f69f80aff00 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88072981 0 0) 0x7f69e4003520 con 0x7f69f80aff00 2023-08-10T10:41:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 msgr2=0x7f69f80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69f80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 >> v2:172.21.15.117:3300/0 conn(0x7f69f815aa50 msgr2=0x7f69f80c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 --2- 172.21.15.50:0/3046269314 >> v2:172.21.15.117:3300/0 conn(0x7f69f815aa50 0x7f69f80c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80b1930 con 0x7f69f80aff00 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.614+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f69f0001670 con 0x7f69f80aff00 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 >> v1:172.21.15.50:6789/0 conn(0x7f69f80aff00 legacy=0x7f69f80cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e40039e0 0x7f69e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69e4004d00 0x7f69e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f815ae30 con 0x7f69e40039e0 2023-08-10T10:41:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80b1650 con 0x7f69e4004d00 2023-08-10T10:41:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e400b9d0 con 0x7f69f80b4130 2023-08-10T10:41:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f77fe640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e40039e0 0x7f69e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69eeffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f7fff640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69e4004d00 0x7f69e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f77fe640 1 -- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 msgr2=0x7f69e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f77fe640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f77fe640 1 -- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69e4004d00 msgr2=0x7f69e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.615+0000 7f69f77fe640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69e4004d00 0x7f69e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.616+0000 7f69f77fe640 1 -- 172.21.15.50:0/3046269314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4003520 con 0x7f69e40039e0 2023-08-10T10:41:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.616+0000 7f69eeffd640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69f80b4130 0x7f69e40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.616+0000 7f69f7fff640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69e4004d00 0x7f69e4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.617+0000 7f69f77fe640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e40039e0 0x7f69e4003e00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009fc0 tx=0x7f69e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5408554f0e1172a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.617+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e802cc30 con 0x7f69e40039e0 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.617+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800f040 con 0x7f69e40039e0 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.617+0000 7f69f6ffd640 1 -- 172.21.15.50:0/3046269314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8034440 con 0x7f69e40039e0 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 -- 172.21.15.50:0/3046269314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e40039e0 msgr2=0x7f69e4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 --2- 172.21.15.50:0/3046269314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e40039e0 0x7f69e4003e00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009fc0 tx=0x7f69e40057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69f7fff640 1 -- 172.21.15.50:0/3046269314 reap_dead start 2023-08-10T10:41:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 -- 172.21.15.50:0/3046269314 shutdown_connections 2023-08-10T10:41:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 -- 172.21.15.50:0/3046269314 >> 172.21.15.50:0/3046269314 conn(0x7f69f8069cd0 msgr2=0x7f69f80caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 -- 172.21.15.50:0/3046269314 shutdown_connections 2023-08-10T10:41:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.618+0000 7f69fc953640 1 -- 172.21.15.50:0/3046269314 wait complete. 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.620+0000 7f69fc953640 1 Processor -- start 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.620+0000 7f69fc953640 1 -- start start 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69e40039e0 0x7f69f814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f806fcb0 0x7f69f80c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8070280 con 0x7f69f806f830 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8070560 con 0x7f69f806fcb0 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69fc953640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8070840 con 0x7f69e40039e0 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69eeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69eeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54746/0 (socket says 172.21.15.50:54746) 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.621+0000 7f69eeffd640 1 -- 172.21.15.50:0/2499097623 learned_addr learned my addr 172.21.15.50:0/2499097623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69f77fe640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69e40039e0 0x7f69f814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 -- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69e40039e0 msgr2=0x7f69f814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69e40039e0 0x7f69f814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69f7fff640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f806fcb0 0x7f69f80c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 -- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f806fcb0 msgr2=0x7f69f80c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f806fcb0 0x7f69f80c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 -- 172.21.15.50:0/2499097623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8070b20 con 0x7f69f806f830 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69eeffd640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f69e00108b0 tx=0x7f69e0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000eb60 con 0x7f69f806f830 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000ecc0 con 0x7f69f806f830 2023-08-10T10:41:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e001c400 con 0x7f69f806f830 2023-08-10T10:41:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.622+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8070e00 con 0x7f69f806f830 2023-08-10T10:41:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.623+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f80c45c0 con 0x7f69f806f830 2023-08-10T10:41:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.624+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8066e30 con 0x7f69f806f830 2023-08-10T10:41:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.625+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69e001c560 con 0x7f69f806f830 2023-08-10T10:41:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.626+0000 7f69f4ff9640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 0x7f69d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.626+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f69e00897c0 con 0x7f69f806f830 2023-08-10T10:41:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.626+0000 7f69f77fe640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 0x7f69d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.627+0000 7f69f77fe640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 0x7f69d806d110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f69e8036000 tx=0x7f69e802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:31.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.630+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f69e00586f0 con 0x7f69f806f830 2023-08-10T10:41:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.821+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69f80c85f0 con 0x7f69f806f830 2023-08-10T10:41:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.822+0000 7f69f4ff9640 1 -- 172.21.15.50:0/2499097623 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69e0058280 con 0x7f69f806f830 2023-08-10T10:41:31.823 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:41:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.824+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 msgr2=0x7f69d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.824+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 0x7f69d806d110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f69e8036000 tx=0x7f69e802e000 comp rx=0 tx=0).stop 2023-08-10T10:41:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 msgr2=0x7f69f80c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f69e00108b0 tx=0x7f69e0010d70 comp rx=0 tx=0).stop 2023-08-10T10:41:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 shutdown_connections 2023-08-10T10:41:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f69d806ac50 0x7f69d806d110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f806fcb0 0x7f69f80c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f806f830 0x7f69f80c22d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 --2- 172.21.15.50:0/2499097623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69e40039e0 0x7f69f814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 >> 172.21.15.50:0/2499097623 conn(0x7f69f8069cd0 msgr2=0x7f69f80c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 shutdown_connections 2023-08-10T10:41:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:31.825+0000 7f69fc953640 1 -- 172.21.15.50:0/2499097623 wait complete. 2023-08-10T10:41:31.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:41:32.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.073+0000 7f7e47c87640 1 Processor -- start 2023-08-10T10:41:32.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.074+0000 7f7e47c87640 1 -- start start 2023-08-10T10:41:32.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.075+0000 7f7e47c87640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.075+0000 7f7e47c87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e400d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e47c87640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e40161180 con 0x7f7e400b8430 2023-08-10T10:41:32.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e47c87640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400b5bd0 con 0x7f7e4015cd60 2023-08-10T10:41:32.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e47c87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40161460 con 0x7f7e400cdf80 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e45a23640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e45a23640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35310/0 (socket says 172.21.15.50:35310) 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e46224640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e400d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.076+0000 7f7e45a23640 1 -- 172.21.15.50:0/4249672097 learned_addr learned my addr 172.21.15.50:0/4249672097 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.077+0000 7f7e46224640 1 -- 172.21.15.50:0/4249672097 >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 msgr2=0x7f7e40160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:32.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.077+0000 7f7e46224640 1 --2- 172.21.15.50:0/4249672097 >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.077+0000 7f7e46224640 1 -- 172.21.15.50:0/4249672097 >> v1:172.21.15.117:6789/0 conn(0x7f7e400b8430 legacy=0x7f7e400cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.077+0000 7f7e46224640 1 -- 172.21.15.50:0/4249672097 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40161740 con 0x7f7e400cdf80 2023-08-10T10:41:32.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.077+0000 7f7e45a23640 1 --2- 172.21.15.50:0/4249672097 >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:32.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.078+0000 7f7e46224640 1 --2- 172.21.15.50:0/4249672097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e400d1400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e380097a0 tx=0x7f7e3802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b23b4fcbdf13ca1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.079+0000 7f7e44a21640 1 -- 172.21.15.50:0/4249672097 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38030800 con 0x7f7e400cdf80 2023-08-10T10:41:32.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.079+0000 7f7e44a21640 1 -- 172.21.15.50:0/4249672097 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38030960 con 0x7f7e400cdf80 2023-08-10T10:41:32.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.079+0000 7f7e44a21640 1 -- 172.21.15.50:0/4249672097 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38030cf0 con 0x7f7e400cdf80 2023-08-10T10:41:32.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 -- 172.21.15.50:0/4249672097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 msgr2=0x7f7e400d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 --2- 172.21.15.50:0/4249672097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e400d1400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e380097a0 tx=0x7f7e3802b940 comp rx=0 tx=0).stop 2023-08-10T10:41:32.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 -- 172.21.15.50:0/4249672097 shutdown_connections 2023-08-10T10:41:32.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 --2- 172.21.15.50:0/4249672097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e400d1400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 --2- 172.21.15.50:0/4249672097 >> v2:172.21.15.117:3300/0 conn(0x7f7e4015cd60 0x7f7e40160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 -- 172.21.15.50:0/4249672097 >> 172.21.15.50:0/4249672097 conn(0x7f7e400d2ac0 msgr2=0x7f7e400d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:32.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 -- 172.21.15.50:0/4249672097 shutdown_connections 2023-08-10T10:41:32.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.080+0000 7f7e47c87640 1 -- 172.21.15.50:0/4249672097 wait complete. 2023-08-10T10:41:32.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.082+0000 7f7e47c87640 1 Processor -- start 2023-08-10T10:41:32.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.082+0000 7f7e47c87640 1 -- start start 2023-08-10T10:41:32.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e400b8430 0x7f7e40157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e4014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015e2f0 con 0x7f7e4015cd60 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4014d560 con 0x7f7e400b8430 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e47c87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015ec50 con 0x7f7e400cdf80 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e46224640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e46224640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54756/0 (socket says 172.21.15.50:54756) 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e46224640 1 -- 172.21.15.50:0/1739701271 learned_addr learned my addr 172.21.15.50:0/1739701271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e45a23640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e400b8430 0x7f7e40157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.083+0000 7f7e45222640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e4014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 -- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 msgr2=0x7f7e4014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e4014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 -- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e400b8430 msgr2=0x7f7e40157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e400b8430 0x7f7e40157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 -- 172.21.15.50:0/1739701271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009b30 con 0x7f7e4015cd60 2023-08-10T10:41:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.084+0000 7f7e46224640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7e380098c0 tx=0x7f7e38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.085+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3803e040 con 0x7f7e4015cd60 2023-08-10T10:41:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.085+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38039c50 con 0x7f7e4015cd60 2023-08-10T10:41:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.085+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380443f0 con 0x7f7e4015cd60 2023-08-10T10:41:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.085+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e38009400 con 0x7f7e4015cd60 2023-08-10T10:41:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.085+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4015d950 con 0x7f7e4015cd60 2023-08-10T10:41:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.086+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4015e430 con 0x7f7e4015cd60 2023-08-10T10:41:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.087+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e3804d3b0 con 0x7f7e4015cd60 2023-08-10T10:41:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.088+0000 7f7e367fc640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 0x7f7e2406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.088+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e380ab780 con 0x7f7e4015cd60 2023-08-10T10:41:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.088+0000 7f7e45a23640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 0x7f7e2406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.089+0000 7f7e45a23640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 0x7f7e2406d110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c9440 tx=0x7f7e3c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.093+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7e4015e430 con 0x7f7e4015cd60 2023-08-10T10:41:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.287+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e4015e430 con 0x7f7e4015cd60 2023-08-10T10:41:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.288+0000 7f7e367fc640 1 -- 172.21.15.50:0/1739701271 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7e38034090 con 0x7f7e4015cd60 2023-08-10T10:41:32.289 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:41:32.290 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:41:32.291 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:41:32.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:41:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 msgr2=0x7f7e2406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 0x7f7e2406d110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c9440 tx=0x7f7e3c00b040 comp rx=0 tx=0).stop 2023-08-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 msgr2=0x7f7e4015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7e380098c0 tx=0x7f7e38004730 comp rx=0 tx=0).stop 2023-08-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 shutdown_connections 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4015cd60 0x7f7e4015e710 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e400cdf80 0x7f7e4014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7e2406ac50 0x7f7e2406d110 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 --2- 172.21.15.50:0/1739701271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e400b8430 0x7f7e40157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.290+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 >> 172.21.15.50:0/1739701271 conn(0x7f7e400d2ac0 msgr2=0x7f7e400b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.291+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 shutdown_connections 2023-08-10T10:41:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.291+0000 7f7e47c87640 1 -- 172.21.15.50:0/1739701271 wait complete. 2023-08-10T10:41:32.309 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:41:32.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:41:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.549+0000 7f086bb0c640 1 Processor -- start 2023-08-10T10:41:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.550+0000 7f086bb0c640 1 -- start start 2023-08-10T10:41:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.551+0000 7f086bb0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f086415cbe0 0x7f08640d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.551+0000 7f086bb0c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08640d20d0 con 0x7f08640d2560 2023-08-10T10:41:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.551+0000 7f086bb0c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086415cfc0 con 0x7f08640b4c10 2023-08-10T10:41:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.551+0000 7f086bb0c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08640d14c0 con 0x7f086415cbe0 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f086415cbe0 0x7f08640d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f086415cbe0 0x7f08640d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54768/0 (socket says 172.21.15.50:54768) 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 -- 172.21.15.50:0/3623776427 learned_addr learned my addr 172.21.15.50:0/3623776427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08690a7640 1 --1- 172.21.15.50:0/3623776427 >> v1:172.21.15.50:6789/0 conn(0x7f08640d2560 0x7f08640b4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33602/0 (socket says 172.21.15.50:33602) 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 -- 172.21.15.50:0/3623776427 >> v1:172.21.15.117:6789/0 conn(0x7f08640b4c10 legacy=0x7f08640b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 -- 172.21.15.50:0/3623776427 >> v1:172.21.15.50:6789/0 conn(0x7f08640d2560 legacy=0x7f08640b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08698a8640 1 -- 172.21.15.50:0/3623776427 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640d17a0 con 0x7f086415cbe0 2023-08-10T10:41:32.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.552+0000 7f08688a6640 1 -- 172.21.15.50:0/3623776427 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111128773 0 0) 0x7f08640d20d0 con 0x7f08640d2560 2023-08-10T10:41:32.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.553+0000 7f08698a8640 1 --2- 172.21.15.50:0/3623776427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f086415cbe0 0x7f08640d0bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086002c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bd8e8868bc7bea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f08688a6640 1 -- 172.21.15.50:0/3623776427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086002cc30 con 0x7f086415cbe0 2023-08-10T10:41:32.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f08688a6640 1 -- 172.21.15.50:0/3623776427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086002cd90 con 0x7f086415cbe0 2023-08-10T10:41:32.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f08688a6640 1 -- 172.21.15.50:0/3623776427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860034610 con 0x7f086415cbe0 2023-08-10T10:41:32.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 -- 172.21.15.50:0/3623776427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f086415cbe0 msgr2=0x7f08640d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 --2- 172.21.15.50:0/3623776427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f086415cbe0 0x7f08640d0bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086002c090 comp rx=0 tx=0).stop 2023-08-10T10:41:32.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 -- 172.21.15.50:0/3623776427 shutdown_connections 2023-08-10T10:41:32.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 --2- 172.21.15.50:0/3623776427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f086415cbe0 0x7f08640d0bc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 -- 172.21.15.50:0/3623776427 >> 172.21.15.50:0/3623776427 conn(0x7f08640702f0 msgr2=0x7f08640d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:32.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.554+0000 7f086bb0c640 1 -- 172.21.15.50:0/3623776427 shutdown_connections 2023-08-10T10:41:32.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.555+0000 7f086bb0c640 1 -- 172.21.15.50:0/3623776427 wait complete. 2023-08-10T10:41:32.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.556+0000 7f086bb0c640 1 Processor -- start 2023-08-10T10:41:32.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.556+0000 7f086bb0c640 1 -- start start 2023-08-10T10:41:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08640d2560 0x7f08640c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086415cbe0 0x7f08640b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c9250 con 0x7f08640b4c10 2023-08-10T10:41:32.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c7c70 con 0x7f086415cbe0 2023-08-10T10:41:32.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.557+0000 7f086bb0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c7f50 con 0x7f08640d2560 2023-08-10T10:41:32.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54782/0 (socket says 172.21.15.50:54782) 2023-08-10T10:41:32.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 -- 172.21.15.50:0/1377092640 learned_addr learned my addr 172.21.15.50:0/1377092640 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:32.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08690a7640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08640d2560 0x7f08640c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f086a0a9640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086415cbe0 0x7f08640b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 -- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08640d2560 msgr2=0x7f08640c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08640d2560 0x7f08640c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 -- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086415cbe0 msgr2=0x7f08640b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086415cbe0 0x7f08640b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.558+0000 7f08698a8640 1 -- 172.21.15.50:0/1377092640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009b30 con 0x7f08640b4c10 2023-08-10T10:41:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f08698a8640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f0860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086003e450 con 0x7f08640b4c10 2023-08-10T10:41:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086003e5f0 con 0x7f08640b4c10 2023-08-10T10:41:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086003e9a0 con 0x7f08640b4c10 2023-08-10T10:41:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08640c8230 con 0x7f08640b4c10 2023-08-10T10:41:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.559+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08640c87f0 con 0x7f08640b4c10 2023-08-10T10:41:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.560+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086414fdb0 con 0x7f08640b4c10 2023-08-10T10:41:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.561+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f086003eb00 con 0x7f08640b4c10 2023-08-10T10:41:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.562+0000 7f085a7fc640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 0x7f084806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.562+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f08600ac0e0 con 0x7f08640b4c10 2023-08-10T10:41:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.563+0000 7f08690a7640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 0x7f084806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.563+0000 7f08690a7640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 0x7f084806d110 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0864159f70 tx=0x7f0854007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.567+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f08600774d0 con 0x7f08640b4c10 2023-08-10T10:41:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.758+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f086404e270 con 0x7f08640b4c10 2023-08-10T10:41:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.875+0000 7f085a7fc640 1 -- 172.21.15.50:0/1377092640 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f086003edb0 con 0x7f08640b4c10 2023-08-10T10:41:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:41:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 msgr2=0x7f084806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 0x7f084806d110 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0864159f70 tx=0x7f0854007b90 comp rx=0 tx=0).stop 2023-08-10T10:41:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 msgr2=0x7f086414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f0860004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 shutdown_connections 2023-08-10T10:41:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f084806ac50 0x7f084806d110 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086415cbe0 0x7f08640b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08640d2560 0x7f08640c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 --2- 172.21.15.50:0/1377092640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08640b4c10 0x7f086414f870 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.881+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 >> 172.21.15.50:0/1377092640 conn(0x7f08640702f0 msgr2=0x7f086415bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.882+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 shutdown_connections 2023-08-10T10:41:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:32.882+0000 7f086bb0c640 1 -- 172.21.15.50:0/1377092640 wait complete. 2023-08-10T10:41:32.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:41:33.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.141+0000 7fca6da6a640 1 Processor -- start 2023-08-10T10:41:33.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.142+0000 7fca6da6a640 1 -- start start 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.143+0000 7fca6da6a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca6815cf70 0x7fca68160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.143+0000 7fca6da6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca680b4640 0x7fca68161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.143+0000 7fca6da6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca68160a40 con 0x7fca6815cb90 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.143+0000 7fca6da6a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca680b4bb0 con 0x7fca6815cf70 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.143+0000 7fca6da6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b4e90 con 0x7fca680b4640 2023-08-10T10:41:33.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca677fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fca6815cb90 0x7fca680b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33618/0 (socket says 172.21.15.50:33618) 2023-08-10T10:41:33.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca677fe640 1 -- 172.21.15.50:0/3097375845 learned_addr learned my addr 172.21.15.50:0/3097375845 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:33.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca66ffd640 1 --2- 172.21.15.50:0/3097375845 >> v2:172.21.15.50:3300/0 conn(0x7fca6815cf70 0x7fca68160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca67fff640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca680b4640 0x7fca68161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca667fc640 1 -- 172.21.15.50:0/3097375845 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751256102 0 0) 0x7fca68160a40 con 0x7fca6815cb90 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca667fc640 1 -- 172.21.15.50:0/3097375845 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca50003520 con 0x7fca6815cb90 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca66ffd640 1 -- 172.21.15.50:0/3097375845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca680b4640 msgr2=0x7fca68161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca66ffd640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca680b4640 0x7fca68161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca66ffd640 1 -- 172.21.15.50:0/3097375845 >> v1:172.21.15.50:6789/0 conn(0x7fca6815cb90 legacy=0x7fca680b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.144+0000 7fca66ffd640 1 -- 172.21.15.50:0/3097375845 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680b5170 con 0x7fca6815cf70 2023-08-10T10:41:33.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca66ffd640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6815cf70 0x7fca68160ed0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0097a0 tx=0x7fca5c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b55aa41dd0e802 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:33.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca667fc640 1 -- 172.21.15.50:0/3097375845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c02d040 con 0x7fca6815cf70 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca667fc640 1 -- 172.21.15.50:0/3097375845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c031810 con 0x7fca6815cf70 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca667fc640 1 -- 172.21.15.50:0/3097375845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c031b80 con 0x7fca6815cf70 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca6da6a640 1 -- 172.21.15.50:0/3097375845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6815cf70 msgr2=0x7fca68160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.146+0000 7fca6da6a640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6815cf70 0x7fca68160ed0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0097a0 tx=0x7fca5c02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 -- 172.21.15.50:0/3097375845 shutdown_connections 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca6815cf70 0x7fca68160ed0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 --2- 172.21.15.50:0/3097375845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca680b4640 0x7fca68161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 -- 172.21.15.50:0/3097375845 >> 172.21.15.50:0/3097375845 conn(0x7fca680cf640 msgr2=0x7fca680cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 -- 172.21.15.50:0/3097375845 shutdown_connections 2023-08-10T10:41:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.147+0000 7fca6da6a640 1 -- 172.21.15.50:0/3097375845 wait complete. 2023-08-10T10:41:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.148+0000 7fca6da6a640 1 Processor -- start 2023-08-10T10:41:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.149+0000 7fca6da6a640 1 -- start start 2023-08-10T10:41:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.149+0000 7fca6da6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.149+0000 7fca6da6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6815cb90 0x7fca6814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca6da6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 0x7fca680c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca6da6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6814f020 con 0x7fca680b4640 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca6da6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6814f440 con 0x7fca6815cf70 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca6da6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6814e3a0 con 0x7fca6815cb90 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54800/0 (socket says 172.21.15.50:54800) 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 -- 172.21.15.50:0/2166123289 learned_addr learned my addr 172.21.15.50:0/2166123289 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca67fff640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 0x7fca680c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 -- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6815cb90 msgr2=0x7fca6814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca66ffd640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6815cb90 0x7fca6814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6815cb90 0x7fca6814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 -- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 msgr2=0x7fca680c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 0x7fca680c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca677fe640 1 -- 172.21.15.50:0/2166123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009400 con 0x7fca680b4640 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.150+0000 7fca67fff640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 0x7fca680c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca677fe640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c530 tx=0x7fca5800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58005ce0 con 0x7fca680b4640 2023-08-10T10:41:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58005e40 con 0x7fca680b4640 2023-08-10T10:41:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6814e680 con 0x7fca680b4640 2023-08-10T10:41:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580072b0 con 0x7fca680b4640 2023-08-10T10:41:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.151+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6814ec40 con 0x7fca680b4640 2023-08-10T10:41:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.152+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6814f160 con 0x7fca680b4640 2023-08-10T10:41:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.153+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca58007410 con 0x7fca680b4640 2023-08-10T10:41:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.154+0000 7fca4ffff640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 0x7fca5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.154+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fca58088930 con 0x7fca680b4640 2023-08-10T10:41:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.155+0000 7fca66ffd640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 0x7fca5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.155+0000 7fca66ffd640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 0x7fca5406d110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca5c036000 tx=0x7fca5c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.159+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fca58053c70 con 0x7fca680b4640 2023-08-10T10:41:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.344+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fca680612b0 con 0x7fca680b4640 2023-08-10T10:41:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.882+0000 7fca4ffff640 1 -- 172.21.15.50:0/2166123289 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7fca580170d0 con 0x7fca680b4640 2023-08-10T10:41:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:41:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.894+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 msgr2=0x7fca5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.894+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 0x7fca5406d110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca5c036000 tx=0x7fca5c008030 comp rx=0 tx=0).stop 2023-08-10T10:41:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.894+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 msgr2=0x7fca68150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.894+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c530 tx=0x7fca5800c9f0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 shutdown_connections 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca5406ac50 0x7fca5406d110 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6815cf70 0x7fca680c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6815cb90 0x7fca6814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 --2- 172.21.15.50:0/2166123289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca680b4640 0x7fca68150a70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.895+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 >> 172.21.15.50:0/2166123289 conn(0x7fca680cf640 msgr2=0x7fca680d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.896+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 shutdown_connections 2023-08-10T10:41:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:33.896+0000 7fca6da6a640 1 -- 172.21.15.50:0/2166123289 wait complete. 2023-08-10T10:41:33.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:41:34.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.134+0000 7f783cfa4640 1 Processor -- start 2023-08-10T10:41:34.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.134+0000 7f783cfa4640 1 -- start start 2023-08-10T10:41:34.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f783815cb90 0x7f78380b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f783815cf70 0x7f7838160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 0x7f7838161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838160a40 con 0x7f783815cb90 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380b4bb0 con 0x7f783815cf70 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.135+0000 7f783cfa4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b4e90 con 0x7f78380b4640 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.136+0000 7f783659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f783815cb90 0x7f78380b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.136+0000 7f783659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f783815cb90 0x7f78380b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54814/0 (socket says 172.21.15.50:54814) 2023-08-10T10:41:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.136+0000 7f783659c640 1 -- 172.21.15.50:0/952511011 learned_addr learned my addr 172.21.15.50:0/952511011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.136+0000 7f7836d9d640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 0x7f7838161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.136+0000 7f7835d9b640 1 --2- 172.21.15.50:0/952511011 >> v2:172.21.15.117:3300/0 conn(0x7f783815cf70 0x7f7838160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f783659c640 1 -- 172.21.15.50:0/952511011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 msgr2=0x7f7838161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f783659c640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 0x7f7838161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f783659c640 1 -- 172.21.15.50:0/952511011 >> v2:172.21.15.117:3300/0 conn(0x7f783815cf70 msgr2=0x7f7838160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f783659c640 1 --2- 172.21.15.50:0/952511011 >> v2:172.21.15.117:3300/0 conn(0x7f783815cf70 0x7f7838160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f783659c640 1 -- 172.21.15.50:0/952511011 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380b5170 con 0x7f783815cb90 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.137+0000 7f7836d9d640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 0x7f7838161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.138+0000 7f783659c640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cb90 0x7f78380b5dd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78380d2b70 tx=0x7f782802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66331d75b302502 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.138+0000 7f783559a640 1 -- 172.21.15.50:0/952511011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828031870 con 0x7f783815cb90 2023-08-10T10:41:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.138+0000 7f783559a640 1 -- 172.21.15.50:0/952511011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280319d0 con 0x7f783815cb90 2023-08-10T10:41:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.138+0000 7f783559a640 1 -- 172.21.15.50:0/952511011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828031d60 con 0x7f783815cb90 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 -- 172.21.15.50:0/952511011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cb90 msgr2=0x7f78380b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cb90 0x7f78380b5dd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78380d2b70 tx=0x7f782802b910 comp rx=0 tx=0).stop 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 -- 172.21.15.50:0/952511011 shutdown_connections 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78380b4640 0x7f7838161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 --2- 172.21.15.50:0/952511011 >> v2:172.21.15.117:3300/0 conn(0x7f783815cf70 0x7f7838160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 --2- 172.21.15.50:0/952511011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cb90 0x7f78380b5dd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 -- 172.21.15.50:0/952511011 >> 172.21.15.50:0/952511011 conn(0x7f78380cf640 msgr2=0x7f78380cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 -- 172.21.15.50:0/952511011 shutdown_connections 2023-08-10T10:41:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.139+0000 7f783cfa4640 1 -- 172.21.15.50:0/952511011 wait complete. 2023-08-10T10:41:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.142+0000 7f783cfa4640 1 Processor -- start 2023-08-10T10:41:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.142+0000 7f783cfa4640 1 -- start start 2023-08-10T10:41:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78380b4640 0x7f78381603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 0x7f78381516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838151c10 con 0x7f783815cf70 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381f2f50 con 0x7f78380b4640 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783cfa4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78381f2620 con 0x7f783815cb90 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f7836d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f7836d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54822/0 (socket says 172.21.15.50:54822) 2023-08-10T10:41:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f7836d9d640 1 -- 172.21.15.50:0/1824848283 learned_addr learned my addr 172.21.15.50:0/1824848283 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f783659c640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78380b4640 0x7f78381603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.144+0000 7f7835d9b640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 0x7f78381516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 -- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 msgr2=0x7f78381516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 0x7f78381516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 -- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78380b4640 msgr2=0x7f78381603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78380b4640 0x7f78381603d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 -- 172.21.15.50:0/1824848283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f783815cf70 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7835d9b640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 0x7f78381516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f7836d9d640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f783000e5e0 tx=0x7f783000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830004230 con 0x7f783815cf70 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830004390 con 0x7f783815cf70 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830003850 con 0x7f783815cf70 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381f2900 con 0x7f783815cf70 2023-08-10T10:41:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.145+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78381549c0 con 0x7f783815cf70 2023-08-10T10:41:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.147+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78381f30e0 con 0x7f783815cf70 2023-08-10T10:41:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.148+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78300039b0 con 0x7f783815cf70 2023-08-10T10:41:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.149+0000 7f782effd640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 0x7f781806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.149+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7830089450 con 0x7f783815cf70 2023-08-10T10:41:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.149+0000 7f783659c640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 0x7f781806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.150+0000 7f783659c640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 0x7f781806d140 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7828036000 tx=0x7f782803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.154+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7830054540 con 0x7f783815cf70 2023-08-10T10:41:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.384+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78380612b0 con 0x7f783815cf70 2023-08-10T10:41:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.924+0000 7f782effd640 1 -- 172.21.15.50:0/1824848283 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7830057b60 con 0x7f783815cf70 2023-08-10T10:41:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 9 and data pool 10 2023-08-10T10:41:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 msgr2=0x7f781806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 0x7f781806d140 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7828036000 tx=0x7f782803c040 comp rx=0 tx=0).stop 2023-08-10T10:41:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 msgr2=0x7f7838154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f783000e5e0 tx=0x7f783000eaa0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 shutdown_connections 2023-08-10T10:41:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783815cf70 0x7f7838154480 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783815cb90 0x7f78381516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f781806ac80 0x7f781806d140 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 --2- 172.21.15.50:0/1824848283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78380b4640 0x7f78381603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.928+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 >> 172.21.15.50:0/1824848283 conn(0x7f78380cf640 msgr2=0x7f78380cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.929+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 shutdown_connections 2023-08-10T10:41:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:34.929+0000 7f783cfa4640 1 -- 172.21.15.50:0/1824848283 wait complete. 2023-08-10T10:41:34.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.152+0000 7f06daa94640 1 Processor -- start 2023-08-10T10:41:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.152+0000 7f06daa94640 1 -- start start 2023-08-10T10:41:35.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06daa94640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 0x7f06d40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06daa94640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06d40b2f40 0x7f06d406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06daa94640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d406f6f0 con 0x7f06d4069be0 2023-08-10T10:41:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06daa94640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d41617f0 con 0x7f06d40b2f40 2023-08-10T10:41:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06daa94640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406a050 con 0x7f06d40c1af0 2023-08-10T10:41:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.154+0000 7f06d9031640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06d40b2f40 0x7f06d406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06d40b2f40 0x7f06d406fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47264/0 (socket says 172.21.15.50:47264) 2023-08-10T10:41:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 -- 172.21.15.50:0/2963427235 learned_addr learned my addr 172.21.15.50:0/2963427235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d8830640 1 --2- 172.21.15.50:0/2963427235 >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 0x7f06d40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 -- 172.21.15.50:0/2963427235 >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 msgr2=0x7f06d40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 --2- 172.21.15.50:0/2963427235 >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 0x7f06d40696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 -- 172.21.15.50:0/2963427235 >> v1:172.21.15.50:6789/0 conn(0x7f06d4069be0 legacy=0x7f06d40b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d9031640 1 -- 172.21.15.50:0/2963427235 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d406edc0 con 0x7f06d40b2f40 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d37fe640 1 -- 172.21.15.50:0/2963427235 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988031021 0 0) 0x7f06d406f6f0 con 0x7f06d4069be0 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.155+0000 7f06d8830640 1 --2- 172.21.15.50:0/2963427235 >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 0x7f06d40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.156+0000 7f06d9031640 1 --2- 172.21.15.50:0/2963427235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d40b2f40 0x7f06d406fb80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f06d406bba0 tx=0x7f06cc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f315cbb0eb8c3fa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06d37fe640 1 -- 172.21.15.50:0/2963427235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc02cba0 con 0x7f06d40b2f40 2023-08-10T10:41:35.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06d37fe640 1 -- 172.21.15.50:0/2963427235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc02cd00 con 0x7f06d40b2f40 2023-08-10T10:41:35.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06d37fe640 1 -- 172.21.15.50:0/2963427235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc034610 con 0x7f06d40b2f40 2023-08-10T10:41:35.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 -- 172.21.15.50:0/2963427235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d40b2f40 msgr2=0x7f06d406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 --2- 172.21.15.50:0/2963427235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d40b2f40 0x7f06d406fb80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f06d406bba0 tx=0x7f06cc02c000 comp rx=0 tx=0).stop 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 -- 172.21.15.50:0/2963427235 shutdown_connections 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 --2- 172.21.15.50:0/2963427235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d40b2f40 0x7f06d406fb80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 --2- 172.21.15.50:0/2963427235 >> v2:172.21.15.117:3300/0 conn(0x7f06d40c1af0 0x7f06d40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 -- 172.21.15.50:0/2963427235 >> 172.21.15.50:0/2963427235 conn(0x7f06d406b590 msgr2=0x7f06d40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 -- 172.21.15.50:0/2963427235 shutdown_connections 2023-08-10T10:41:35.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.157+0000 7f06daa94640 1 -- 172.21.15.50:0/2963427235 wait complete. 2023-08-10T10:41:35.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.159+0000 7f06daa94640 1 Processor -- start 2023-08-10T10:41:35.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.159+0000 7f06daa94640 1 -- start start 2023-08-10T10:41:35.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d40b2f40 0x7f06d41624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d40c1af0 0x7f06d41ea110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c3c80 con 0x7f06d4069be0 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4162dc0 con 0x7f06d40b2f40 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.160+0000 7f06daa94640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41630a0 con 0x7f06d40c1af0 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47274/0 (socket says 172.21.15.50:47274) 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 -- 172.21.15.50:0/3466095079 learned_addr learned my addr 172.21.15.50:0/3466095079 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 -- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d40c1af0 msgr2=0x7f06d41ea110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d40c1af0 0x7f06d41ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 -- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d40b2f40 msgr2=0x7f06d41624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d40b2f40 0x7f06d41624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 -- 172.21.15.50:0/3466095079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009b30 con 0x7f06d4069be0 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.161+0000 7f06d8830640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c7f0 tx=0x7f06c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.162+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8007820 con 0x7f06d4069be0 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.162+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8007980 con 0x7f06d4069be0 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.162+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8007d10 con 0x7f06d4069be0 2023-08-10T10:41:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.162+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d40c35c0 con 0x7f06d4069be0 2023-08-10T10:41:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.162+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d4162a00 con 0x7f06d4069be0 2023-08-10T10:41:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.163+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d40c3ef0 con 0x7f06d4069be0 2023-08-10T10:41:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.164+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06c80113f0 con 0x7f06d4069be0 2023-08-10T10:41:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.165+0000 7f06d17fa640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 0x7f06b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.165+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06c8089910 con 0x7f06d4069be0 2023-08-10T10:41:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.166+0000 7f06d3fff640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 0x7f06b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.166+0000 7f06d3fff640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 0x7f06b806d110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06d41eaf10 tx=0x7f06c0007910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.170+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f06c8054920 con 0x7f06d4069be0 2023-08-10T10:41:35.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.365+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d40caf40 con 0x7f06d4069be0 2023-08-10T10:41:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.367+0000 7f06d17fa640 1 -- 172.21.15.50:0/3466095079 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f06c8057f40 con 0x7f06d4069be0 2023-08-10T10:41:35.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:35.368 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:34.385962+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 msgr2=0x7f06b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 0x7f06b806d110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06d41eaf10 tx=0x7f06c0007910 comp rx=0 tx=0).stop 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 msgr2=0x7f06d41596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c7f0 tx=0x7f06c800ccb0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 shutdown_connections 2023-08-10T10:41:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d40c1af0 0x7f06d41ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f06b806ac50 0x7f06b806d110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d40b2f40 0x7f06d41624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 --2- 172.21.15.50:0/3466095079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4069be0 0x7f06d41596a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 >> 172.21.15.50:0/3466095079 conn(0x7f06d406b590 msgr2=0x7f06d4159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 shutdown_connections 2023-08-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.370+0000 7f06daa94640 1 -- 172.21.15.50:0/3466095079 wait complete. 2023-08-10T10:41:35.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.617+0000 7f15f42fa640 1 Processor -- start 2023-08-10T10:41:35.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.617+0000 7f15f42fa640 1 -- start start 2023-08-10T10:41:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.618+0000 7f15f42fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 0x7f15ec0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f42fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15ec0b0f00 0x7f15ec0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f42fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ec15e1f0 con 0x7f15ec069be0 2023-08-10T10:41:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f42fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec06a000 con 0x7f15ec0b0f00 2023-08-10T10:41:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f42fa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec15d5e0 con 0x7f15ec159970 2023-08-10T10:41:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f1895640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15ec0b0f00 0x7f15ec0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f1895640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15ec0b0f00 0x7f15ec0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47286/0 (socket says 172.21.15.50:47286) 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f1895640 1 -- 172.21.15.50:0/1193304667 learned_addr learned my addr 172.21.15.50:0/1193304667 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f2897640 1 --1- 172.21.15.50:0/1193304667 >> v1:172.21.15.50:6789/0 conn(0x7f15ec069be0 0x7f15ec0c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53292/0 (socket says 172.21.15.50:53292) 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f2096640 1 --2- 172.21.15.50:0/1193304667 >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 0x7f15ec0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f1895640 1 -- 172.21.15.50:0/1193304667 >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 msgr2=0x7f15ec0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.619+0000 7f15f1895640 1 --2- 172.21.15.50:0/1193304667 >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 0x7f15ec0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.620+0000 7f15f1895640 1 -- 172.21.15.50:0/1193304667 >> v1:172.21.15.50:6789/0 conn(0x7f15ec069be0 legacy=0x7f15ec0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.620+0000 7f15f1895640 1 -- 172.21.15.50:0/1193304667 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec15d8c0 con 0x7f15ec0b0f00 2023-08-10T10:41:35.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.620+0000 7f15f2096640 1 --2- 172.21.15.50:0/1193304667 >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 0x7f15ec0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.621+0000 7f15f1895640 1 --2- 172.21.15.50:0/1193304667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec0696a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0ce530 tx=0x7f15dc02e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c3f9498737fbf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.621+0000 7f15f1094640 1 -- 172.21.15.50:0/1193304667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc036440 con 0x7f15ec0b0f00 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.621+0000 7f15f1094640 1 -- 172.21.15.50:0/1193304667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc0365a0 con 0x7f15ec0b0f00 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.621+0000 7f15f1094640 1 -- 172.21.15.50:0/1193304667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc036930 con 0x7f15ec0b0f00 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 -- 172.21.15.50:0/1193304667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 msgr2=0x7f15ec0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 --2- 172.21.15.50:0/1193304667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec0696a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0ce530 tx=0x7f15dc02e180 comp rx=0 tx=0).stop 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 -- 172.21.15.50:0/1193304667 shutdown_connections 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 --2- 172.21.15.50:0/1193304667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec0696a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 --2- 172.21.15.50:0/1193304667 >> v2:172.21.15.117:3300/0 conn(0x7f15ec159970 0x7f15ec0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 -- 172.21.15.50:0/1193304667 >> 172.21.15.50:0/1193304667 conn(0x7f15ec06b590 msgr2=0x7f15ec0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 -- 172.21.15.50:0/1193304667 shutdown_connections 2023-08-10T10:41:35.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.622+0000 7f15f42fa640 1 -- 172.21.15.50:0/1193304667 wait complete. 2023-08-10T10:41:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.624+0000 7f15f42fa640 1 Processor -- start 2023-08-10T10:41:35.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.624+0000 7f15f42fa640 1 -- start start 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 0x7f15ec15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 0x7f15ec14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ae180 con 0x7f15ec0b0f00 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0c8120 con 0x7f15ec069be0 2023-08-10T10:41:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f42fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ae3b0 con 0x7f15ec159970 2023-08-10T10:41:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f1895640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f1895640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47294/0 (socket says 172.21.15.50:47294) 2023-08-10T10:41:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f1895640 1 -- 172.21.15.50:0/4024730510 learned_addr learned my addr 172.21.15.50:0/4024730510 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f2096640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 0x7f15ec15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f2897640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 0x7f15ec14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f1895640 1 -- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 msgr2=0x7f15ec14e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.625+0000 7f15f1895640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 0x7f15ec14e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f1895640 1 -- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 msgr2=0x7f15ec15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f1895640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 0x7f15ec15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f1895640 1 -- 172.21.15.50:0/4024730510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc00b770 con 0x7f15ec0b0f00 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f2897640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 0x7f15ec14e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f2096640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 0x7f15ec15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f1895640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00b2c0 tx=0x7f15dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc034b00 con 0x7f15ec0b0f00 2023-08-10T10:41:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc034c80 con 0x7f15ec0b0f00 2023-08-10T10:41:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc041460 con 0x7f15ec0b0f00 2023-08-10T10:41:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0ae690 con 0x7f15ec0b0f00 2023-08-10T10:41:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.626+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec0aec50 con 0x7f15ec0b0f00 2023-08-10T10:41:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.628+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec04e270 con 0x7f15ec0b0f00 2023-08-10T10:41:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.629+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15dc049360 con 0x7f15ec0b0f00 2023-08-10T10:41:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.629+0000 7f15e2ffd640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 0x7f15d006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.630+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15dc0abaa0 con 0x7f15ec0b0f00 2023-08-10T10:41:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.630+0000 7f15f2096640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 0x7f15d006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.631+0000 7f15f2096640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 0x7f15d006d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006fd0 tx=0x7f15e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.634+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15dc076b40 con 0x7f15ec0b0f00 2023-08-10T10:41:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.826+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15ec0b3160 con 0x7f15ec0b0f00 2023-08-10T10:41:35.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.829+0000 7f15e2ffd640 1 -- 172.21.15.50:0/4024730510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f15dc03b020 con 0x7f15ec0b0f00 2023-08-10T10:41:35.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:35.830 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:34.385962+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 msgr2=0x7f15d006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 0x7f15d006d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006fd0 tx=0x7f15e8008040 comp rx=0 tx=0).stop 2023-08-10T10:41:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 msgr2=0x7f15ec1f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00b2c0 tx=0x7f15dc0046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 shutdown_connections 2023-08-10T10:41:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15ec159970 0x7f15ec14e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ec0b0f00 0x7f15ec1f5f60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f15d006ac50 0x7f15d006d110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 --2- 172.21.15.50:0/4024730510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15ec069be0 0x7f15ec15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 >> 172.21.15.50:0/4024730510 conn(0x7f15ec06b590 msgr2=0x7f15ec0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 shutdown_connections 2023-08-10T10:41:35.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:35.833+0000 7f15f42fa640 1 -- 172.21.15.50:0/4024730510 wait complete. 2023-08-10T10:41:35.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:41:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.073+0000 7fd22d91d640 1 Processor -- start 2023-08-10T10:41:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.073+0000 7fd22d91d640 1 -- start start 2023-08-10T10:41:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2281599e0 0x7fd2280ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 0x7fd2280696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 0x7fd228069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280ccff0 con 0x7fd2281599e0 2023-08-10T10:41:36.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280cdca0 con 0x7fd2280c8b50 2023-08-10T10:41:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22d91d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280cdf80 con 0x7fd2280c9000 2023-08-10T10:41:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22c91b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2281599e0 0x7fd2280ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22c91b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2281599e0 0x7fd2280ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47310/0 (socket says 172.21.15.50:47310) 2023-08-10T10:41:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.075+0000 7fd22c91b640 1 -- 172.21.15.50:0/4076058711 learned_addr learned my addr 172.21.15.50:0/4076058711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:36.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22d11c640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 0x7fd228069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22c91b640 1 -- 172.21.15.50:0/4076058711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 msgr2=0x7fd228069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd21ffff640 1 --2- 172.21.15.50:0/4076058711 >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 0x7fd2280696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22c91b640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 0x7fd228069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22c91b640 1 -- 172.21.15.50:0/4076058711 >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 msgr2=0x7fd2280696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22c91b640 1 --2- 172.21.15.50:0/4076058711 >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 0x7fd2280696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22c91b640 1 -- 172.21.15.50:0/4076058711 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280b2910 con 0x7fd2281599e0 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd21ffff640 1 --2- 172.21.15.50:0/4076058711 >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 0x7fd2280696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.076+0000 7fd22d11c640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 0x7fd228069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.077+0000 7fd22c91b640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280ccab0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2280adf70 tx=0x7fd22402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1abf687bb099cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.077+0000 7fd21f7fe640 1 -- 172.21.15.50:0/4076058711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22402ca80 con 0x7fd2281599e0 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.077+0000 7fd21f7fe640 1 -- 172.21.15.50:0/4076058711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22402cbe0 con 0x7fd2281599e0 2023-08-10T10:41:36.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.077+0000 7fd21f7fe640 1 -- 172.21.15.50:0/4076058711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240343f0 con 0x7fd2281599e0 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 -- 172.21.15.50:0/4076058711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 msgr2=0x7fd2280ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280ccab0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2280adf70 tx=0x7fd22402bee0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 -- 172.21.15.50:0/4076058711 shutdown_connections 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c9000 0x7fd228069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 --2- 172.21.15.50:0/4076058711 >> v2:172.21.15.117:3300/0 conn(0x7fd2280c8b50 0x7fd2280696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 --2- 172.21.15.50:0/4076058711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280ccab0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 -- 172.21.15.50:0/4076058711 >> 172.21.15.50:0/4076058711 conn(0x7fd2280caf80 msgr2=0x7fd2280cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:36.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 -- 172.21.15.50:0/4076058711 shutdown_connections 2023-08-10T10:41:36.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.078+0000 7fd22d91d640 1 -- 172.21.15.50:0/4076058711 wait complete. 2023-08-10T10:41:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.080+0000 7fd22d91d640 1 Processor -- start 2023-08-10T10:41:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.080+0000 7fd22d91d640 1 -- start start 2023-08-10T10:41:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c8b50 0x7fd2281f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 0x7fd2280b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2281f1c10 con 0x7fd2281599e0 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2281f1ef0 con 0x7fd2280c9000 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.081+0000 7fd22d91d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2281f21d0 con 0x7fd2280c8b50 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47316/0 (socket says 172.21.15.50:47316) 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22c91b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c8b50 0x7fd2281f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 -- 172.21.15.50:0/2742222797 learned_addr learned my addr 172.21.15.50:0/2742222797 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd21ffff640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 0x7fd2280b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 -- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c8b50 msgr2=0x7fd2281f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c8b50 0x7fd2281f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 -- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 msgr2=0x7fd2280b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 0x7fd2280b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd22d11c640 1 -- 172.21.15.50:0/2742222797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009b30 con 0x7fd2281599e0 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.082+0000 7fd21ffff640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 0x7fd2280b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd22d11c640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd22000c7c0 tx=0x7fd22000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220004230 con 0x7fd2281599e0 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220004390 con 0x7fd2281599e0 2023-08-10T10:41:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220007860 con 0x7fd2281599e0 2023-08-10T10:41:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2281f24b0 con 0x7fd2281599e0 2023-08-10T10:41:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.083+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2281f1900 con 0x7fd2281599e0 2023-08-10T10:41:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.084+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2281f29d0 con 0x7fd2281599e0 2023-08-10T10:41:36.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.085+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2200079c0 con 0x7fd2281599e0 2023-08-10T10:41:36.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.087+0000 7fd21d7fa640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 0x7fd21406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:36.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.087+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd220089660 con 0x7fd2281599e0 2023-08-10T10:41:36.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.087+0000 7fd22c91b640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 0x7fd21406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:36.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.088+0000 7fd22c91b640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 0x7fd21406d110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd224035000 tx=0x7fd224030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:36.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.091+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd2200547c0 con 0x7fd2281599e0 2023-08-10T10:41:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.324+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd2280cd8d0 con 0x7fd2281599e0 2023-08-10T10:41:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.941+0000 7fd21d7fa640 1 -- 172.21.15.50:0/2742222797 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd220057de0 con 0x7fd2281599e0 2023-08-10T10:41:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 msgr2=0x7fd21406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 0x7fd21406d110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd224035000 tx=0x7fd224030000 comp rx=0 tx=0).stop 2023-08-10T10:41:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 msgr2=0x7fd2280c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd22000c7c0 tx=0x7fd22000cc80 comp rx=0 tx=0).stop 2023-08-10T10:41:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 shutdown_connections 2023-08-10T10:41:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2281599e0 0x7fd2280c1dd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd21406ac50 0x7fd21406d110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2280c9000 0x7fd2280b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 --2- 172.21.15.50:0/2742222797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2280c8b50 0x7fd2281f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 >> 172.21.15.50:0/2742222797 conn(0x7fd2280caf80 msgr2=0x7fd228158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.945+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 shutdown_connections 2023-08-10T10:41:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:36.946+0000 7fd22d91d640 1 -- 172.21.15.50:0/2742222797 wait complete. 2023-08-10T10:41:36.966 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:41:36.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:41:37.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.188+0000 7f64e22c0640 1 Processor -- start 2023-08-10T10:41:37.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.188+0000 7f64e22c0640 1 -- start start 2023-08-10T10:41:37.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e22c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64dc0ae9f0 0x7f64dc0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e22c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc06aa30 0x7f64dc072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e22c0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc0cbf70 con 0x7f64dc0aedd0 2023-08-10T10:41:37.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e22c0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc0cb9b0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e22c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0cbc90 con 0x7f64dc06aa30 2023-08-10T10:41:37.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e12be640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64dc0ae9f0 0x7f64dc0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e0abd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64dc0aedd0 0x7f64dc070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53306/0 (socket says 172.21.15.50:53306) 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.190+0000 7f64e0abd640 1 -- 172.21.15.50:0/1773102741 learned_addr learned my addr 172.21.15.50:0/1773102741 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.191+0000 7f64e1abf640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc06aa30 0x7f64dc072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.191+0000 7f64e12be640 1 -- 172.21.15.50:0/1773102741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc06aa30 msgr2=0x7f64dc072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.191+0000 7f64e12be640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc06aa30 0x7f64dc072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.191+0000 7f64e12be640 1 -- 172.21.15.50:0/1773102741 >> v1:172.21.15.50:6789/0 conn(0x7f64dc0aedd0 legacy=0x7f64dc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.191+0000 7f64e12be640 1 -- 172.21.15.50:0/1773102741 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc06fba0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.192+0000 7f64e12be640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc0cb2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009d90 tx=0x7f64d802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896524e579207351 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:37.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.192+0000 7f64d3fff640 1 -- 172.21.15.50:0/1773102741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d802cbd0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.192+0000 7f64d3fff640 1 -- 172.21.15.50:0/1773102741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d802cd30 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.192+0000 7f64d3fff640 1 -- 172.21.15.50:0/1773102741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d802cea0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 -- 172.21.15.50:0/1773102741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 msgr2=0x7f64dc0cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc0cb2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009d90 tx=0x7f64d802be20 comp rx=0 tx=0).stop 2023-08-10T10:41:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 -- 172.21.15.50:0/1773102741 shutdown_connections 2023-08-10T10:41:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc06aa30 0x7f64dc072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 --2- 172.21.15.50:0/1773102741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc0cb2f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 -- 172.21.15.50:0/1773102741 >> 172.21.15.50:0/1773102741 conn(0x7f64dc0cf8a0 msgr2=0x7f64dc0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 -- 172.21.15.50:0/1773102741 shutdown_connections 2023-08-10T10:41:37.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.193+0000 7f64e22c0640 1 -- 172.21.15.50:0/1773102741 wait complete. 2023-08-10T10:41:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.195+0000 7f64e22c0640 1 Processor -- start 2023-08-10T10:41:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.195+0000 7f64e22c0640 1 -- start start 2023-08-10T10:41:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64dc06aa30 0x7f64dc14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc0aedd0 0x7f64dc1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1589d0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0c7f40 con 0x7f64dc06aa30 2023-08-10T10:41:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e22c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc157ae0 con 0x7f64dc0aedd0 2023-08-10T10:41:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e0abd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e0abd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47328/0 (socket says 172.21.15.50:47328) 2023-08-10T10:41:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.196+0000 7f64e0abd640 1 -- 172.21.15.50:0/3455224527 learned_addr learned my addr 172.21.15.50:0/3455224527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e1abf640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc0aedd0 0x7f64dc1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 -- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc0aedd0 msgr2=0x7f64dc1f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc0aedd0 0x7f64dc1f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 -- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64dc06aa30 msgr2=0x7f64dc14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64dc06aa30 0x7f64dc14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 -- 172.21.15.50:0/3455224527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009a70 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e0abd640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c480 tx=0x7f64cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc005ce0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc005e40 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc157dc0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0072f0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.197+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc158380 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.199+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc0d0140 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.200+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64cc007510 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.201+0000 7f64d1ffb640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 0x7f64c006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.201+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64cc088900 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.201+0000 7f64e12be640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 0x7f64c006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.202+0000 7f64e12be640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 0x7f64c006d110 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f64d8036000 tx=0x7f64d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.205+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f64cc053af0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.437+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f64dc066e30 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.951+0000 7f64d1ffb640 1 -- 172.21.15.50:0/3455224527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64cc0170c0 con 0x7f64dc0ae9f0 2023-08-10T10:41:37.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 msgr2=0x7f64c006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 0x7f64c006d110 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f64d8036000 tx=0x7f64d802e000 comp rx=0 tx=0).stop 2023-08-10T10:41:37.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 msgr2=0x7f64dc158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:37.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c480 tx=0x7f64cc00c940 comp rx=0 tx=0).stop 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 shutdown_connections 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64dc0aedd0 0x7f64dc1f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64dc0ae9f0 0x7f64dc158e60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f64c006ac50 0x7f64c006d110 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 --2- 172.21.15.50:0/3455224527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64dc06aa30 0x7f64dc14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.954+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 >> 172.21.15.50:0/3455224527 conn(0x7f64dc0cf8a0 msgr2=0x7f64dc15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.955+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 shutdown_connections 2023-08-10T10:41:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:37.955+0000 7f64e22c0640 1 -- 172.21.15.50:0/3455224527 wait complete. 2023-08-10T10:41:37.976 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:41:37.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.213+0000 7f1b71857640 1 Processor -- start 2023-08-10T10:41:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.213+0000 7f1b71857640 1 -- start start 2023-08-10T10:41:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.214+0000 7f1b71857640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b6c15f370 0x7f1b6c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.214+0000 7f1b71857640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 0x7f1b6c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.214+0000 7f1b71857640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c0b0000 con 0x7f1b6c0afc20 2023-08-10T10:41:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b71857640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c0cf850 con 0x7f1b6c15f370 2023-08-10T10:41:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b71857640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0cbe60 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b6c15f370 0x7f1b6c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b6c15f370 0x7f1b6c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47344/0 (socket says 172.21.15.50:47344) 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/174480307 learned_addr learned my addr 172.21.15.50:0/174480307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6affd640 1 --1- 172.21.15.50:0/174480307 >> v1:172.21.15.50:6789/0 conn(0x7f1b6c0afc20 0x7f1b6c0cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53320/0 (socket says 172.21.15.50:53320) 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6b7fe640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 0x7f1b6c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/174480307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 msgr2=0x7f1b6c15a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 0x7f1b6c15a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/174480307 >> v1:172.21.15.50:6789/0 conn(0x7f1b6c0afc20 legacy=0x7f1b6c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.215+0000 7f1b69ffb640 1 -- 172.21.15.50:0/174480307 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139280491 0 0) 0x7f1b6c0b0000 con 0x7f1b6c0afc20 2023-08-10T10:41:38.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.216+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/174480307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0cc140 con 0x7f1b6c15f370 2023-08-10T10:41:38.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.216+0000 7f1b6b7fe640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 0x7f1b6c15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b6a7fc640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c15f370 0x7f1b6c0cee80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098a0 tx=0x7f1b6002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab00694824010368 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b69ffb640 1 -- 172.21.15.50:0/174480307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60030840 con 0x7f1b6c15f370 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b69ffb640 1 -- 172.21.15.50:0/174480307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b600309a0 con 0x7f1b6c15f370 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b69ffb640 1 -- 172.21.15.50:0/174480307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60030d30 con 0x7f1b6c15f370 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b71857640 1 -- 172.21.15.50:0/174480307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c15f370 msgr2=0x7f1b6c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.217+0000 7f1b71857640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c15f370 0x7f1b6c0cee80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098a0 tx=0x7f1b6002b980 comp rx=0 tx=0).stop 2023-08-10T10:41:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 -- 172.21.15.50:0/174480307 shutdown_connections 2023-08-10T10:41:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c15f370 0x7f1b6c0cee80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 --2- 172.21.15.50:0/174480307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c0cf3c0 0x7f1b6c15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 -- 172.21.15.50:0/174480307 >> 172.21.15.50:0/174480307 conn(0x7f1b6c0d0930 msgr2=0x7f1b6c0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 -- 172.21.15.50:0/174480307 shutdown_connections 2023-08-10T10:41:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.218+0000 7f1b71857640 1 -- 172.21.15.50:0/174480307 wait complete. 2023-08-10T10:41:38.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.219+0000 7f1b71857640 1 Processor -- start 2023-08-10T10:41:38.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.220+0000 7f1b71857640 1 -- start start 2023-08-10T10:41:38.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 0x7f1b6c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 0x7f1b6c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c069ed0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c06a1b0 con 0x7f1b6c0afc20 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b71857640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c06a490 con 0x7f1b6c15f370 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47358/0 (socket says 172.21.15.50:47358) 2023-08-10T10:41:38.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/19217408 learned_addr learned my addr 172.21.15.50:0/19217408 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6affd640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 0x7f1b6c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6b7fe640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 0x7f1b6c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 msgr2=0x7f1b6c0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 0x7f1b6c0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 msgr2=0x7f1b6c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 0x7f1b6c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6a7fc640 1 -- 172.21.15.50:0/19217408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600094d0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6affd640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 0x7f1b6c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.221+0000 7f1b6b7fe640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 0x7f1b6c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b6a7fc640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1b60000c00 tx=0x7f1b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6003e070 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b600307d0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600423f0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c06a770 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.222+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c069be0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.223+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c0c64e0 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.224+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b60042550 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.225+0000 7f1b53fff640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 0x7f1b5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.225+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b600abd40 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.226+0000 7f1b6affd640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 0x7f1b5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.226+0000 7f1b6affd640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 0x7f1b5806d110 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c001e50 tx=0x7f1b5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.229+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1b60076d50 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.461+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b6c0b3830 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.462+0000 7f1b53fff640 1 -- 172.21.15.50:0/19217408 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f1b6c0b3830 con 0x7f1b6c0cf3c0 2023-08-10T10:41:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:38.464 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:41:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:41:38.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 msgr2=0x7f1b5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 0x7f1b5806d110 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c001e50 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2023-08-10T10:41:38.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 msgr2=0x7f1b6c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1b60000c00 tx=0x7f1b600046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 shutdown_connections 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b6c15f370 0x7f1b6c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6c0cf3c0 0x7f1b6c0696a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1b5806ac50 0x7f1b5806d110 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 --2- 172.21.15.50:0/19217408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6c0afc20 0x7f1b6c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 >> 172.21.15.50:0/19217408 conn(0x7f1b6c0d0930 msgr2=0x7f1b6c0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.465+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 shutdown_connections 2023-08-10T10:41:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.466+0000 7f1b71857640 1 -- 172.21.15.50:0/19217408 wait complete. 2023-08-10T10:41:38.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:41:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.715+0000 7f1356f67640 1 Processor -- start 2023-08-10T10:41:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.715+0000 7f1356f67640 1 -- start start 2023-08-10T10:41:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.716+0000 7f1356f67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13500b0620 0x7f13500b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1356f67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500b1f10 con 0x7f135015f2b0 2023-08-10T10:41:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1356f67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135015e7d0 con 0x7f135015a940 2023-08-10T10:41:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1356f67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500b21f0 con 0x7f13500b0620 2023-08-10T10:41:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1356766640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f135015f2b0 0x7f13500ca740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53322/0 (socket says 172.21.15.50:53322) 2023-08-10T10:41:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1356766640 1 -- 172.21.15.50:0/2705480974 learned_addr learned my addr 172.21.15.50:0/2705480974 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:38.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> v2:172.21.15.117:3300/0 conn(0x7f13500b0620 0x7f13500b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750534194 0 0) 0x7f13500b1f10 con 0x7f135015f2b0 2023-08-10T10:41:38.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.717+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c003520 con 0x7f135015f2b0 2023-08-10T10:41:38.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083631663 0 0) 0x7f133c003520 con 0x7f135015f2b0 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 >> v2:172.21.15.117:3300/0 conn(0x7f13500b0620 msgr2=0x7f13500b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 --2- 172.21.15.50:0/2705480974 >> v2:172.21.15.117:3300/0 conn(0x7f13500b0620 0x7f13500b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 >> v1:172.21.15.117:6789/0 conn(0x7f135015a940 legacy=0x7f13500aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135015eab0 con 0x7f135015f2b0 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f13480019f0 con 0x7f135015f2b0 2023-08-10T10:41:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> v2:172.21.15.117:3300/0 conn(0x7f13500b0620 0x7f13500b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 >> v1:172.21.15.50:6789/0 conn(0x7f135015f2b0 legacy=0x7f13500ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133c0039e0 0x7f133c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f133c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133c0052a0 0x7f133c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00c190 con 0x7f133c0047c0 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00c300 con 0x7f133c0039e0 2023-08-10T10:41:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00c4c0 con 0x7f133c0052a0 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.718+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f133c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355764640 1 -- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133c0052a0 msgr2=0x7f133c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1356766640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133c0052a0 0x7f133c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355f65640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133c0039e0 0x7f133c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133c0052a0 0x7f133c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355764640 1 -- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133c0039e0 msgr2=0x7f133c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133c0039e0 0x7f133c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1355764640 1 -- 172.21.15.50:0/2705480974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c003520 con 0x7f133c0047c0 2023-08-10T10:41:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.719+0000 7f1356766640 1 -- 172.21.15.50:0/2705480974 reap_dead start 2023-08-10T10:41:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.720+0000 7f1355764640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f133c004c40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f13400098a0 tx=0x7f133c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea994eec43dd8ca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.720+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340004230 con 0x7f133c0047c0 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.720+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340004390 con 0x7f133c0047c0 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.720+0000 7f1354f63640 1 -- 172.21.15.50:0/2705480974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003830 con 0x7f133c0047c0 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 -- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 msgr2=0x7f133c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f133c004c40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f13400098a0 tx=0x7f133c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 -- 172.21.15.50:0/2705480974 shutdown_connections 2023-08-10T10:41:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 --2- 172.21.15.50:0/2705480974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f133c004c40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 -- 172.21.15.50:0/2705480974 >> 172.21.15.50:0/2705480974 conn(0x7f135006ab80 msgr2=0x7f135006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 -- 172.21.15.50:0/2705480974 shutdown_connections 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.721+0000 7f1356f67640 1 -- 172.21.15.50:0/2705480974 wait complete. 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.723+0000 7f1356f67640 1 Processor -- start 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.723+0000 7f1356f67640 1 -- start start 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 0x7f135015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 0x7f135015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350070fd0 con 0x7f133c0047c0 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015b5c0 con 0x7f135015c870 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1356f67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135015b7d0 con 0x7f13501ef930 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1355f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1355f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47368/0 (socket says 172.21.15.50:47368) 2023-08-10T10:41:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.724+0000 7f1355f65640 1 -- 172.21.15.50:0/1064613080 learned_addr learned my addr 172.21.15.50:0/1064613080 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355764640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 0x7f135015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1356766640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 0x7f135015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 -- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 msgr2=0x7f135015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 0x7f135015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 -- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 msgr2=0x7f135015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 0x7f135015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 -- 172.21.15.50:0/1064613080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135015bab0 con 0x7f133c0047c0 2023-08-10T10:41:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355764640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 0x7f135015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1356766640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 0x7f135015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1355f65640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d3b0 tx=0x7f134c00d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c012800 con 0x7f133c0047c0 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c012980 con 0x7f133c0047c0 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135015bd90 con 0x7f133c0047c0 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.725+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c012d30 con 0x7f133c0047c0 2023-08-10T10:41:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.726+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135015c350 con 0x7f133c0047c0 2023-08-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.727+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135015c540 con 0x7f133c0047c0 2023-08-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.728+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f134c01b400 con 0x7f133c0047c0 2023-08-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.729+0000 7f13467fc640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 0x7f133406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.729+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f134c0897f0 con 0x7f133c0047c0 2023-08-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.729+0000 7f1355764640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 0x7f133406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.730+0000 7f1355764640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 0x7f133406d110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1340035000 tx=0x7f134003a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.733+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f134c054800 con 0x7f133c0047c0 2023-08-10T10:41:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.930+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1350066e30 con 0x7f133c0047c0 2023-08-10T10:41:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.933+0000 7f13467fc640 1 -- 172.21.15.50:0/1064613080 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f134c057e20 con 0x7f133c0047c0 2023-08-10T10:41:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:38.935 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":72,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:41:35.880309+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 msgr2=0x7f133406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 0x7f133406d110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1340035000 tx=0x7f134003a040 comp rx=0 tx=0).stop 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 msgr2=0x7f1350070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d3b0 tx=0x7f134c00d870 comp rx=0 tx=0).stop 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 shutdown_connections 2023-08-10T10:41:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13501ef930 0x7f135015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f133406ac50 0x7f133406d110 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135015c870 0x7f135015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 --2- 172.21.15.50:0/1064613080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133c0047c0 0x7f1350070a90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 >> 172.21.15.50:0/1064613080 conn(0x7f135006ab80 msgr2=0x7f1350157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 shutdown_connections 2023-08-10T10:41:38.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:38.936+0000 7f1356f67640 1 -- 172.21.15.50:0/1064613080 wait complete. 2023-08-10T10:41:38.959 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:41:38.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.187+0000 7f17452ec640 1 Processor -- start 2023-08-10T10:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.187+0000 7f17452ec640 1 -- start start 2023-08-10T10:41:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.189+0000 7f17452ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 0x7f17400696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.189+0000 7f17452ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400719f0 con 0x7f174015ccb0 2023-08-10T10:41:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.189+0000 7f17452ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400c8db0 con 0x7f17400c9b30 2023-08-10T10:41:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.189+0000 7f17452ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400c9050 con 0x7f17400b3010 2023-08-10T10:41:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.190+0000 7f173effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f174015ccb0 0x7f17400b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53334/0 (socket says 172.21.15.50:53334) 2023-08-10T10:41:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.190+0000 7f173effd640 1 -- 172.21.15.50:0/3044954355 learned_addr learned my addr 172.21.15.50:0/3044954355 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:39.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.190+0000 7f1737fff640 1 --2- 172.21.15.50:0/3044954355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 0x7f17400696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.190+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278926052 0 0) 0x7f17400719f0 con 0x7f174015ccb0 2023-08-10T10:41:39.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.190+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f172c003520 con 0x7f174015ccb0 2023-08-10T10:41:39.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.191+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428376543 0 0) 0x7f17400c8db0 con 0x7f17400c9b30 2023-08-10T10:41:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.191+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17400719f0 con 0x7f17400c9b30 2023-08-10T10:41:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.191+0000 7f1737fff640 1 -- 172.21.15.50:0/3044954355 >> v1:172.21.15.117:6789/0 conn(0x7f17400c9b30 legacy=0x7f174006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.191+0000 7f1737fff640 1 -- 172.21.15.50:0/3044954355 >> v1:172.21.15.50:6789/0 conn(0x7f174015ccb0 legacy=0x7f17400b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.191+0000 7f1737fff640 1 -- 172.21.15.50:0/3044954355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400c9330 con 0x7f17400b3010 2023-08-10T10:41:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.193+0000 7f1737fff640 1 --2- 172.21.15.50:0/3044954355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 0x7f17400696a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f17280097d0 tx=0x7f172802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c4be89006080de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.193+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728030800 con 0x7f17400b3010 2023-08-10T10:41:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.193+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728030960 con 0x7f17400b3010 2023-08-10T10:41:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.193+0000 7f173e7fc640 1 -- 172.21.15.50:0/3044954355 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728030cf0 con 0x7f17400b3010 2023-08-10T10:41:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 -- 172.21.15.50:0/3044954355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 msgr2=0x7f17400696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 --2- 172.21.15.50:0/3044954355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 0x7f17400696a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f17280097d0 tx=0x7f172802b940 comp rx=0 tx=0).stop 2023-08-10T10:41:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 -- 172.21.15.50:0/3044954355 shutdown_connections 2023-08-10T10:41:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 --2- 172.21.15.50:0/3044954355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400b3010 0x7f17400696a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 -- 172.21.15.50:0/3044954355 >> 172.21.15.50:0/3044954355 conn(0x7f174006b590 msgr2=0x7f17400ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:39.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.194+0000 7f17452ec640 1 -- 172.21.15.50:0/3044954355 shutdown_connections 2023-08-10T10:41:39.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.195+0000 7f17452ec640 1 -- 172.21.15.50:0/3044954355 wait complete. 2023-08-10T10:41:39.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.197+0000 7f17452ec640 1 Processor -- start 2023-08-10T10:41:39.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.197+0000 7f17452ec640 1 -- start start 2023-08-10T10:41:39.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17400b3010 0x7f1740150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400c9b30 0x7f17400c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400c6f10 con 0x7f174015ccb0 2023-08-10T10:41:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174015ff40 con 0x7f17400b3010 2023-08-10T10:41:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.198+0000 7f17452ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400c6300 con 0x7f17400c9b30 2023-08-10T10:41:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47370/0 (socket says 172.21.15.50:47370) 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 -- 172.21.15.50:0/980376322 learned_addr learned my addr 172.21.15.50:0/980376322 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173effd640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17400b3010 0x7f1740150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f1737fff640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400c9b30 0x7f17400c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 -- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400c9b30 msgr2=0x7f17400c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400c9b30 0x7f17400c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 -- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17400b3010 msgr2=0x7f1740150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17400b3010 0x7f1740150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.199+0000 7f173f7fe640 1 -- 172.21.15.50:0/980376322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009400 con 0x7f174015ccb0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f173f7fe640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f173800c790 tx=0x7f173800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800cea0 con 0x7f174015ccb0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738003b70 con 0x7f174015ccb0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17400c65e0 con 0x7f174015ccb0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800a850 con 0x7f174015ccb0 2023-08-10T10:41:39.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.200+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17400c6ba0 con 0x7f174015ccb0 2023-08-10T10:41:39.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.201+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17400c7080 con 0x7f174015ccb0 2023-08-10T10:41:39.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.203+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f173800a9b0 con 0x7f174015ccb0 2023-08-10T10:41:39.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.204+0000 7f17377fe640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 0x7f172006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.205+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17380894c0 con 0x7f174015ccb0 2023-08-10T10:41:39.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.205+0000 7f173effd640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 0x7f172006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.205+0000 7f173effd640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 0x7f172006d110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17300011e0 tx=0x7f1730009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.210+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1738054450 con 0x7f174015ccb0 2023-08-10T10:41:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.398+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17400c9610 con 0x7f172006ac50 2023-08-10T10:41:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.414+0000 7f17377fe640 1 -- 172.21.15.50:0/980376322 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303090 (secure 0 0 0) 0x7f1730001c40 con 0x7f172006ac50 2023-08-10T10:41:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 msgr2=0x7f172006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 0x7f172006d110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17300011e0 tx=0x7f1730009040 comp rx=0 tx=0).stop 2023-08-10T10:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 msgr2=0x7f17400c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f173800c790 tx=0x7f173800cc50 comp rx=0 tx=0).stop 2023-08-10T10:41:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 shutdown_connections 2023-08-10T10:41:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174015ccb0 0x7f17400c5cd0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17400c9b30 0x7f17400c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f172006ac50 0x7f172006d110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 --2- 172.21.15.50:0/980376322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17400b3010 0x7f1740150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 >> 172.21.15.50:0/980376322 conn(0x7f174006b590 msgr2=0x7f17400b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 shutdown_connections 2023-08-10T10:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.421+0000 7f17452ec640 1 -- 172.21.15.50:0/980376322 wait complete. 2023-08-10T10:41:39.440 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-08-10T10:41:38.384074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558261,"statfs":{"total":1600000000,"available":1595659274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512944"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884595+0000","last_change":"2023-08-10T10:41:34.917521+0000","last_active":"2023-08-10T10:41:35.884595+0000","last_peered":"2023-08-10T10:41:35.884595+0000","last_clean":"2023-08-10T10:41:35.884595+0000","last_became_active":"2023-08-10T10:41:34.915275+0000","last_became_peered":"2023-08-10T10:41:34.915275+0000","last_unstale":"2023-08-10T10:41:35.884595+0000","last_undegraded":"2023-08-10T10:41:35.884595+0000","last_fullsized":"2023-08-10T10:41:35.884595+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:30.954421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884555+0000","last_change":"2023-08-10T10:41:34.920835+0000","last_active":"2023-08-10T10:41:35.884555+0000","last_peered":"2023-08-10T10:41:35.884555+0000","last_clean":"2023-08-10T10:41:35.884555+0000","last_became_active":"2023-08-10T10:41:34.920479+0000","last_became_peered":"2023-08-10T10:41:34.920479+0000","last_unstale":"2023-08-10T10:41:35.884555+0000","last_undegraded":"2023-08-10T10:41:35.884555+0000","last_fullsized":"2023-08-10T10:41:35.884555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:23.505013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054628+0000","last_change":"2023-08-10T10:41:34.919318+0000","last_active":"2023-08-10T10:41:37.054628+0000","last_peered":"2023-08-10T10:41:37.054628+0000","last_clean":"2023-08-10T10:41:37.054628+0000","last_became_active":"2023-08-10T10:41:34.919059+0000","last_became_peered":"2023-08-10T10:41:34.919059+0000","last_unstale":"2023-08-10T10:41:37.054628+0000","last_undegraded":"2023-08-10T10:41:37.054628+0000","last_fullsized":"2023-08-10T10:41:37.054628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:28.277120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056507+0000","last_change":"2023-08-10T10:41:34.914906+0000","last_active":"2023-08-10T10:41:37.056507+0000","last_peered":"2023-08-10T10:41:37.056507+0000","last_clean":"2023-08-10T10:41:37.056507+0000","last_became_active":"2023-08-10T10:41:34.914659+0000","last_became_peered":"2023-08-10T10:41:34.914659+0000","last_unstale":"2023-08-10T10:41:37.056507+0000","last_undegraded":"2023-08-10T10:41:37.056507+0000","last_fullsized":"2023-08-10T10:41:37.056507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:21.637756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053066+0000","last_change":"2023-08-10T10:41:34.911004+0000","last_active":"2023-08-10T10:41:37.053066+0000","last_peered":"2023-08-10T10:41:37.053066+0000","last_clean":"2023-08-10T10:41:37.053066+0000","last_became_active":"2023-08-10T10:41:34.910628+0000","last_became_peered":"2023-08-10T10:41:34.910628+0000","last_unstale":"2023-08-10T10:41:37.053066+0000","last_undegraded":"2023-08-10T10:41:37.053066+0000","last_fullsized":"2023-08-10T10:41:37.053066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:21.637756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886105+0000","last_change":"2023-08-10T10:41:34.916461+0000","last_active":"2023-08-10T10:41:35.886105+0000","last_peered":"2023-08-10T10:41:35.886105+0000","last_clean":"2023-08-10T10:41:35.886105+0000","last_became_active":"2023-08-10T10:41:34.916081+0000","last_became_peered":"2023-08-10T10:41:34.916081+0000","last_unstale":"2023-08-10T10:41:35.886105+0000","last_undegraded":"2023-08-10T10:41:35.886105+0000","last_fullsized":"2023-08-10T10:41:35.886105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:06.738931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886783+0000","last_change":"2023-08-10T10:41:34.904769+0000","last_active":"2023-08-10T10:41:35.886783+0000","last_peered":"2023-08-10T10:41:35.886783+0000","last_clean":"2023-08-10T10:41:35.886783+0000","last_became_active":"2023-08-10T10:41:34.904046+0000","last_became_peered":"2023-08-10T10:41:34.904046+0000","last_unstale":"2023-08-10T10:41:35.886783+0000","last_undegraded":"2023-08-10T10:41:35.886783+0000","last_fullsized":"2023-08-10T10:41:35.886783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:11.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057829+0000","last_change":"2023-08-10T10:41:34.912244+0000","last_active":"2023-08-10T10:41:37.057829+0000","last_peered":"2023-08-10T10:41:37.057829+0000","last_clean":"2023-08-10T10:41:37.057829+0000","last_became_active":"2023-08-10T10:41:34.911918+0000","last_became_peered":"2023-08-10T10:41:34.911918+0000","last_unstale":"2023-08-10T10:41:37.057829+0000","last_undegraded":"2023-08-10T10:41:37.057829+0000","last_fullsized":"2023-08-10T10:41:37.057829+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:32.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053024+0000","last_change":"2023-08-10T10:41:34.909412+0000","last_active":"2023-08-10T10:41:37.053024+0000","last_peered":"2023-08-10T10:41:37.053024+0000","last_clean":"2023-08-10T10:41:37.053024+0000","last_became_active":"2023-08-10T10:41:34.909125+0000","last_became_peered":"2023-08-10T10:41:34.909125+0000","last_unstale":"2023-08-10T10:41:37.053024+0000","last_undegraded":"2023-08-10T10:41:37.053024+0000","last_fullsized":"2023-08-10T10:41:37.053024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:23.584074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054126+0000","last_change":"2023-08-10T10:41:34.919599+0000","last_active":"2023-08-10T10:41:37.054126+0000","last_peered":"2023-08-10T10:41:37.054126+0000","last_clean":"2023-08-10T10:41:37.054126+0000","last_became_active":"2023-08-10T10:41:34.918702+0000","last_became_peered":"2023-08-10T10:41:34.918702+0000","last_unstale":"2023-08-10T10:41:37.054126+0000","last_undegraded":"2023-08-10T10:41:37.054126+0000","last_fullsized":"2023-08-10T10:41:37.054126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:05:02.381897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056052+0000","last_change":"2023-08-10T10:41:34.891974+0000","last_active":"2023-08-10T10:41:37.056052+0000","last_peered":"2023-08-10T10:41:37.056052+0000","last_clean":"2023-08-10T10:41:37.056052+0000","last_became_active":"2023-08-10T10:41:34.891319+0000","last_became_peered":"2023-08-10T10:41:34.891319+0000","last_unstale":"2023-08-10T10:41:37.056052+0000","last_undegraded":"2023-08-10T10:41:37.056052+0000","last_fullsized":"2023-08-10T10:41:37.056052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:21.618571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057615+0000","last_change":"2023-08-10T10:41:34.913322+0000","last_active":"2023-08-10T10:41:37.057615+0000","last_peered":"2023-08-10T10:41:37.057615+0000","last_clean":"2023-08-10T10:41:37.057615+0000","last_became_active":"2023-08-10T10:41:34.912968+0000","last_became_peered":"2023-08-10T10:41:34.912968+0000","last_unstale":"2023-08-10T10:41:37.057615+0000","last_undegraded":"2023-08-10T10:41:37.057615+0000","last_fullsized":"2023-08-10T10:41:37.057615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:58.128885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058309+0000","last_change":"2023-08-10T10:41:34.908223+0000","last_active":"2023-08-10T10:41:37.058309+0000","last_peered":"2023-08-10T10:41:37.058309+0000","last_clean":"2023-08-10T10:41:37.058309+0000","last_became_active":"2023-08-10T10:41:34.907868+0000","last_became_peered":"2023-08-10T10:41:34.907868+0000","last_unstale":"2023-08-10T10:41:37.058309+0000","last_undegraded":"2023-08-10T10:41:37.058309+0000","last_fullsized":"2023-08-10T10:41:37.058309+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:05:28.918997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053330+0000","last_change":"2023-08-10T10:41:34.917246+0000","last_active":"2023-08-10T10:41:37.053330+0000","last_peered":"2023-08-10T10:41:37.053330+0000","last_clean":"2023-08-10T10:41:37.053330+0000","last_became_active":"2023-08-10T10:41:34.916703+0000","last_became_peered":"2023-08-10T10:41:34.916703+0000","last_unstale":"2023-08-10T10:41:37.053330+0000","last_undegraded":"2023-08-10T10:41:37.053330+0000","last_fullsized":"2023-08-10T10:41:37.053330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:43:54.350978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054919+0000","last_change":"2023-08-10T10:41:34.919790+0000","last_active":"2023-08-10T10:41:37.054919+0000","last_peered":"2023-08-10T10:41:37.054919+0000","last_clean":"2023-08-10T10:41:37.054919+0000","last_became_active":"2023-08-10T10:41:34.919243+0000","last_became_peered":"2023-08-10T10:41:34.919243+0000","last_unstale":"2023-08-10T10:41:37.054919+0000","last_undegraded":"2023-08-10T10:41:37.054919+0000","last_fullsized":"2023-08-10T10:41:37.054919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:00.189133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887118+0000","last_change":"2023-08-10T10:41:34.915710+0000","last_active":"2023-08-10T10:41:35.887118+0000","last_peered":"2023-08-10T10:41:35.887118+0000","last_clean":"2023-08-10T10:41:35.887118+0000","last_became_active":"2023-08-10T10:41:34.912924+0000","last_became_peered":"2023-08-10T10:41:34.912924+0000","last_unstale":"2023-08-10T10:41:35.887118+0000","last_undegraded":"2023-08-10T10:41:35.887118+0000","last_fullsized":"2023-08-10T10:41:35.887118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:50.570890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.883978+0000","last_change":"2023-08-10T10:41:34.892553+0000","last_active":"2023-08-10T10:41:35.883978+0000","last_peered":"2023-08-10T10:41:35.883978+0000","last_clean":"2023-08-10T10:41:35.883978+0000","last_became_active":"2023-08-10T10:41:34.891046+0000","last_became_peered":"2023-08-10T10:41:34.891046+0000","last_unstale":"2023-08-10T10:41:35.883978+0000","last_undegraded":"2023-08-10T10:41:35.883978+0000","last_fullsized":"2023-08-10T10:41:35.883978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:04:11.360838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052844+0000","last_change":"2023-08-10T10:41:34.914283+0000","last_active":"2023-08-10T10:41:37.052844+0000","last_peered":"2023-08-10T10:41:37.052844+0000","last_clean":"2023-08-10T10:41:37.052844+0000","last_became_active":"2023-08-10T10:41:34.914053+0000","last_became_peered":"2023-08-10T10:41:34.914053+0000","last_unstale":"2023-08-10T10:41:37.052844+0000","last_undegraded":"2023-08-10T10:41:37.052844+0000","last_fullsized":"2023-08-10T10:41:37.052844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:00.565168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051258+0000","last_change":"2023-08-10T10:41:34.915253+0000","last_active":"2023-08-10T10:41:37.051258+0000","last_peered":"2023-08-10T10:41:37.051258+0000","last_clean":"2023-08-10T10:41:37.051258+0000","last_became_active":"2023-08-10T10:41:34.915014+0000","last_became_peered":"2023-08-10T10:41:34.915014+0000","last_unstale":"2023-08-10T10:41:37.051258+0000","last_undegraded":"2023-08-10T10:41:37.051258+0000","last_fullsized":"2023-08-10T10:41:37.051258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:35.535656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.944122+0000","last_change":"2023-08-10T10:41:34.914385+0000","last_active":"2023-08-10T10:41:35.944122+0000","last_peered":"2023-08-10T10:41:35.944122+0000","last_clean":"2023-08-10T10:41:35.944122+0000","last_became_active":"2023-08-10T10:41:34.913850+0000","last_became_peered":"2023-08-10T10:41:34.913850+0000","last_unstale":"2023-08-10T10:41:35.944122+0000","last_undegraded":"2023-08-10T10:41:35.944122+0000","last_fullsized":"2023-08-10T10:41:35.944122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:50.019577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054334+0000","last_change":"2023-08-10T10:41:34.908948+0000","last_active":"2023-08-10T10:41:37.054334+0000","last_peered":"2023-08-10T10:41:37.054334+0000","last_clean":"2023-08-10T10:41:37.054334+0000","last_became_active":"2023-08-10T10:41:34.907125+0000","last_became_peered":"2023-08-10T10:41:34.907125+0000","last_unstale":"2023-08-10T10:41:37.054334+0000","last_undegraded":"2023-08-10T10:41:37.054334+0000","last_fullsized":"2023-08-10T10:41:37.054334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:11.236881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942965+0000","last_change":"2023-08-10T10:41:34.917641+0000","last_active":"2023-08-10T10:41:35.942965+0000","last_peered":"2023-08-10T10:41:35.942965+0000","last_clean":"2023-08-10T10:41:35.942965+0000","last_became_active":"2023-08-10T10:41:34.908949+0000","last_became_peered":"2023-08-10T10:41:34.908949+0000","last_unstale":"2023-08-10T10:41:35.942965+0000","last_undegraded":"2023-08-10T10:41:35.942965+0000","last_fullsized":"2023-08-10T10:41:35.942965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:46.897758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942757+0000","last_change":"2023-08-10T10:41:34.915683+0000","last_active":"2023-08-10T10:41:35.942757+0000","last_peered":"2023-08-10T10:41:35.942757+0000","last_clean":"2023-08-10T10:41:35.942757+0000","last_became_active":"2023-08-10T10:41:34.910325+0000","last_became_peered":"2023-08-10T10:41:34.910325+0000","last_unstale":"2023-08-10T10:41:35.942757+0000","last_undegraded":"2023-08-10T10:41:35.942757+0000","last_fullsized":"2023-08-10T10:41:35.942757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:08.111614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053651+0000","last_change":"2023-08-10T10:41:34.917097+0000","last_active":"2023-08-10T10:41:37.053651+0000","last_peered":"2023-08-10T10:41:37.053651+0000","last_clean":"2023-08-10T10:41:37.053651+0000","last_became_active":"2023-08-10T10:41:34.916486+0000","last_became_peered":"2023-08-10T10:41:34.916486+0000","last_unstale":"2023-08-10T10:41:37.053651+0000","last_undegraded":"2023-08-10T10:41:37.053651+0000","last_fullsized":"2023-08-10T10:41:37.053651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:18:12.151693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054161+0000","last_change":"2023-08-10T10:41:34.913849+0000","last_active":"2023-08-10T10:41:37.054161+0000","last_peered":"2023-08-10T10:41:37.054161+0000","last_clean":"2023-08-10T10:41:37.054161+0000","last_became_active":"2023-08-10T10:41:34.913571+0000","last_became_peered":"2023-08-10T10:41:34.913571+0000","last_unstale":"2023-08-10T10:41:37.054161+0000","last_undegraded":"2023-08-10T10:41:37.054161+0000","last_fullsized":"2023-08-10T10:41:37.054161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:09.613628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054672+0000","last_change":"2023-08-10T10:41:34.907441+0000","last_active":"2023-08-10T10:41:37.054672+0000","last_peered":"2023-08-10T10:41:37.054672+0000","last_clean":"2023-08-10T10:41:37.054672+0000","last_became_active":"2023-08-10T10:41:34.906737+0000","last_became_peered":"2023-08-10T10:41:34.906737+0000","last_unstale":"2023-08-10T10:41:37.054672+0000","last_undegraded":"2023-08-10T10:41:37.054672+0000","last_fullsized":"2023-08-10T10:41:37.054672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:43.296351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057135+0000","last_change":"2023-08-10T10:41:34.898972+0000","last_active":"2023-08-10T10:41:37.057135+0000","last_peered":"2023-08-10T10:41:37.057135+0000","last_clean":"2023-08-10T10:41:37.057135+0000","last_became_active":"2023-08-10T10:41:34.896004+0000","last_became_peered":"2023-08-10T10:41:34.896004+0000","last_unstale":"2023-08-10T10:41:37.057135+0000","last_undegraded":"2023-08-10T10:41:37.057135+0000","last_fullsized":"2023-08-10T10:41:37.057135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:03.244602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884184+0000","last_change":"2023-08-10T10:41:34.921393+0000","last_active":"2023-08-10T10:41:35.884184+0000","last_peered":"2023-08-10T10:41:35.884184+0000","last_clean":"2023-08-10T10:41:35.884184+0000","last_became_active":"2023-08-10T10:41:34.920070+0000","last_became_peered":"2023-08-10T10:41:34.920070+0000","last_unstale":"2023-08-10T10:41:35.884184+0000","last_undegraded":"2023-08-10T10:41:35.884184+0000","last_fullsized":"2023-08-10T10:41:35.884184+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:05:35.896543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054246+0000","last_change":"2023-08-10T10:41:34.916903+0000","last_active":"2023-08-10T10:41:37.054246+0000","last_peered":"2023-08-10T10:41:37.054246+0000","last_clean":"2023-08-10T10:41:37.054246+0000","last_became_active":"2023-08-10T10:41:34.916170+0000","last_became_peered":"2023-08-10T10:41:34.916170+0000","last_unstale":"2023-08-10T10:41:37.054246+0000","last_undegraded":"2023-08-10T10:41:37.054246+0000","last_fullsized":"2023-08-10T10:41:37.054246+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:51.002652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057874+0000","last_change":"2023-08-10T10:41:34.911931+0000","last_active":"2023-08-10T10:41:37.057874+0000","last_peered":"2023-08-10T10:41:37.057874+0000","last_clean":"2023-08-10T10:41:37.057874+0000","last_became_active":"2023-08-10T10:41:34.911664+0000","last_became_peered":"2023-08-10T10:41:34.911664+0000","last_unstale":"2023-08-10T10:41:37.057874+0000","last_undegraded":"2023-08-10T10:41:37.057874+0000","last_fullsized":"2023-08-10T10:41:37.057874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:24.195928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056435+0000","last_change":"2023-08-10T10:41:34.899130+0000","last_active":"2023-08-10T10:41:37.056435+0000","last_peered":"2023-08-10T10:41:37.056435+0000","last_clean":"2023-08-10T10:41:37.056435+0000","last_became_active":"2023-08-10T10:41:34.897392+0000","last_became_peered":"2023-08-10T10:41:34.897392+0000","last_unstale":"2023-08-10T10:41:37.056435+0000","last_undegraded":"2023-08-10T10:41:37.056435+0000","last_fullsized":"2023-08-10T10:41:37.056435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:14.687541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885904+0000","last_change":"2023-08-10T10:41:34.916136+0000","last_active":"2023-08-10T10:41:35.885904+0000","last_peered":"2023-08-10T10:41:35.885904+0000","last_clean":"2023-08-10T10:41:35.885904+0000","last_became_active":"2023-08-10T10:41:34.915308+0000","last_became_peered":"2023-08-10T10:41:34.915308+0000","last_unstale":"2023-08-10T10:41:35.885904+0000","last_undegraded":"2023-08-10T10:41:35.885904+0000","last_fullsized":"2023-08-10T10:41:35.885904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:39:29.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051604+0000","last_change":"2023-08-10T10:41:34.907468+0000","last_active":"2023-08-10T10:41:37.051604+0000","last_peered":"2023-08-10T10:41:37.051604+0000","last_clean":"2023-08-10T10:41:37.051604+0000","last_became_active":"2023-08-10T10:41:34.906901+0000","last_became_peered":"2023-08-10T10:41:34.906901+0000","last_unstale":"2023-08-10T10:41:37.051604+0000","last_undegraded":"2023-08-10T10:41:37.051604+0000","last_fullsized":"2023-08-10T10:41:37.051604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:47.824462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"71'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884312+0000","last_change":"2023-08-10T10:41:33.905034+0000","last_active":"2023-08-10T10:41:35.884312+0000","last_peered":"2023-08-10T10:41:35.884312+0000","last_clean":"2023-08-10T10:41:35.884312+0000","last_became_active":"2023-08-10T10:41:33.904594+0000","last_became_peered":"2023-08-10T10:41:33.904594+0000","last_unstale":"2023-08-10T10:41:35.884312+0000","last_undegraded":"2023-08-10T10:41:35.884312+0000","last_fullsized":"2023-08-10T10:41:35.884312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:07.107268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055262+0000","last_change":"2023-08-10T10:41:34.912803+0000","last_active":"2023-08-10T10:41:37.055262+0000","last_peered":"2023-08-10T10:41:37.055262+0000","last_clean":"2023-08-10T10:41:37.055262+0000","last_became_active":"2023-08-10T10:41:34.912050+0000","last_became_peered":"2023-08-10T10:41:34.912050+0000","last_unstale":"2023-08-10T10:41:37.055262+0000","last_undegraded":"2023-08-10T10:41:37.055262+0000","last_fullsized":"2023-08-10T10:41:37.055262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:41.843856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885766+0000","last_change":"2023-08-10T10:41:33.905255+0000","last_active":"2023-08-10T10:41:35.885766+0000","last_peered":"2023-08-10T10:41:35.885766+0000","last_clean":"2023-08-10T10:41:35.885766+0000","last_became_active":"2023-08-10T10:41:33.904987+0000","last_became_peered":"2023-08-10T10:41:33.904987+0000","last_unstale":"2023-08-10T10:41:35.885766+0000","last_undegraded":"2023-08-10T10:41:35.885766+0000","last_fullsized":"2023-08-10T10:41:35.885766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:43:39.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886080+0000","last_change":"2023-08-10T10:41:34.919665+0000","last_active":"2023-08-10T10:41:35.886080+0000","last_peered":"2023-08-10T10:41:35.886080+0000","last_clean":"2023-08-10T10:41:35.886080+0000","last_became_active":"2023-08-10T10:41:34.918385+0000","last_became_peered":"2023-08-10T10:41:34.918385+0000","last_unstale":"2023-08-10T10:41:35.886080+0000","last_undegraded":"2023-08-10T10:41:35.886080+0000","last_fullsized":"2023-08-10T10:41:35.886080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:16.374137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886360+0000","last_change":"2023-08-10T10:41:33.899106+0000","last_active":"2023-08-10T10:41:35.886360+0000","last_peered":"2023-08-10T10:41:35.886360+0000","last_clean":"2023-08-10T10:41:35.886360+0000","last_became_active":"2023-08-10T10:41:33.898844+0000","last_became_peered":"2023-08-10T10:41:33.898844+0000","last_unstale":"2023-08-10T10:41:35.886360+0000","last_undegraded":"2023-08-10T10:41:35.886360+0000","last_fullsized":"2023-08-10T10:41:35.886360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:21.884531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054994+0000","last_change":"2023-08-10T10:41:34.918831+0000","last_active":"2023-08-10T10:41:37.054994+0000","last_peered":"2023-08-10T10:41:37.054994+0000","last_clean":"2023-08-10T10:41:37.054994+0000","last_became_active":"2023-08-10T10:41:34.918554+0000","last_became_peered":"2023-08-10T10:41:34.918554+0000","last_unstale":"2023-08-10T10:41:37.054994+0000","last_undegraded":"2023-08-10T10:41:37.054994+0000","last_fullsized":"2023-08-10T10:41:37.054994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:36.832539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886521+0000","last_change":"2023-08-10T10:41:33.892623+0000","last_active":"2023-08-10T10:41:35.886521+0000","last_peered":"2023-08-10T10:41:35.886521+0000","last_clean":"2023-08-10T10:41:35.886521+0000","last_became_active":"2023-08-10T10:41:33.892367+0000","last_became_peered":"2023-08-10T10:41:33.892367+0000","last_unstale":"2023-08-10T10:41:35.886521+0000","last_undegraded":"2023-08-10T10:41:35.886521+0000","last_fullsized":"2023-08-10T10:41:35.886521+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:07:51.236820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887069+0000","last_change":"2023-08-10T10:41:34.896322+0000","last_active":"2023-08-10T10:41:35.887069+0000","last_peered":"2023-08-10T10:41:35.887069+0000","last_clean":"2023-08-10T10:41:35.887069+0000","last_became_active":"2023-08-10T10:41:34.895640+0000","last_became_peered":"2023-08-10T10:41:34.895640+0000","last_unstale":"2023-08-10T10:41:35.887069+0000","last_undegraded":"2023-08-10T10:41:35.887069+0000","last_fullsized":"2023-08-10T10:41:35.887069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:34.502015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943261+0000","last_change":"2023-08-10T10:41:33.892035+0000","last_active":"2023-08-10T10:41:35.943261+0000","last_peered":"2023-08-10T10:41:35.943261+0000","last_clean":"2023-08-10T10:41:35.943261+0000","last_became_active":"2023-08-10T10:41:33.891163+0000","last_became_peered":"2023-08-10T10:41:33.891163+0000","last_unstale":"2023-08-10T10:41:35.943261+0000","last_undegraded":"2023-08-10T10:41:35.943261+0000","last_fullsized":"2023-08-10T10:41:35.943261+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:08.609282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.883913+0000","last_change":"2023-08-10T10:41:34.890727+0000","last_active":"2023-08-10T10:41:35.883913+0000","last_peered":"2023-08-10T10:41:35.883913+0000","last_clean":"2023-08-10T10:41:35.883913+0000","last_became_active":"2023-08-10T10:41:34.889859+0000","last_became_peered":"2023-08-10T10:41:34.889859+0000","last_unstale":"2023-08-10T10:41:35.883913+0000","last_undegraded":"2023-08-10T10:41:35.883913+0000","last_fullsized":"2023-08-10T10:41:35.883913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:40.191552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943073+0000","last_change":"2023-08-10T10:41:33.892517+0000","last_active":"2023-08-10T10:41:35.943073+0000","last_peered":"2023-08-10T10:41:35.943073+0000","last_clean":"2023-08-10T10:41:35.943073+0000","last_became_active":"2023-08-10T10:41:33.892169+0000","last_became_peered":"2023-08-10T10:41:33.892169+0000","last_unstale":"2023-08-10T10:41:35.943073+0000","last_undegraded":"2023-08-10T10:41:35.943073+0000","last_fullsized":"2023-08-10T10:41:35.943073+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:29.950075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051897+0000","last_change":"2023-08-10T10:41:34.914153+0000","last_active":"2023-08-10T10:41:37.051897+0000","last_peered":"2023-08-10T10:41:37.051897+0000","last_clean":"2023-08-10T10:41:37.051897+0000","last_became_active":"2023-08-10T10:41:34.913927+0000","last_became_peered":"2023-08-10T10:41:34.913927+0000","last_unstale":"2023-08-10T10:41:37.051897+0000","last_undegraded":"2023-08-10T10:41:37.051897+0000","last_fullsized":"2023-08-10T10:41:37.051897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:31.156554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942863+0000","last_change":"2023-08-10T10:41:33.903710+0000","last_active":"2023-08-10T10:41:35.942863+0000","last_peered":"2023-08-10T10:41:35.942863+0000","last_clean":"2023-08-10T10:41:35.942863+0000","last_became_active":"2023-08-10T10:41:33.903405+0000","last_became_peered":"2023-08-10T10:41:33.903405+0000","last_unstale":"2023-08-10T10:41:35.942863+0000","last_undegraded":"2023-08-10T10:41:35.942863+0000","last_fullsized":"2023-08-10T10:41:35.942863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:22.500667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943136+0000","last_change":"2023-08-10T10:41:34.911325+0000","last_active":"2023-08-10T10:41:35.943136+0000","last_peered":"2023-08-10T10:41:35.943136+0000","last_clean":"2023-08-10T10:41:35.943136+0000","last_became_active":"2023-08-10T10:41:34.907810+0000","last_became_peered":"2023-08-10T10:41:34.907810+0000","last_unstale":"2023-08-10T10:41:35.943136+0000","last_undegraded":"2023-08-10T10:41:35.943136+0000","last_fullsized":"2023-08-10T10:41:35.943136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:52.490891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053480+0000","last_change":"2023-08-10T10:41:33.904570+0000","last_active":"2023-08-10T10:41:37.053480+0000","last_peered":"2023-08-10T10:41:37.053480+0000","last_clean":"2023-08-10T10:41:37.053480+0000","last_became_active":"2023-08-10T10:41:33.904212+0000","last_became_peered":"2023-08-10T10:41:33.904212+0000","last_unstale":"2023-08-10T10:41:37.053480+0000","last_undegraded":"2023-08-10T10:41:37.053480+0000","last_fullsized":"2023-08-10T10:41:37.053480+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:38.851100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884088+0000","last_change":"2023-08-10T10:41:34.896176+0000","last_active":"2023-08-10T10:41:35.884088+0000","last_peered":"2023-08-10T10:41:35.884088+0000","last_clean":"2023-08-10T10:41:35.884088+0000","last_became_active":"2023-08-10T10:41:34.895488+0000","last_became_peered":"2023-08-10T10:41:34.895488+0000","last_unstale":"2023-08-10T10:41:35.884088+0000","last_undegraded":"2023-08-10T10:41:35.884088+0000","last_fullsized":"2023-08-10T10:41:35.884088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:16.891214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052719+0000","last_change":"2023-08-10T10:41:33.903148+0000","last_active":"2023-08-10T10:41:37.052719+0000","last_peered":"2023-08-10T10:41:37.052719+0000","last_clean":"2023-08-10T10:41:37.052719+0000","last_became_active":"2023-08-10T10:41:33.902355+0000","last_became_peered":"2023-08-10T10:41:33.902355+0000","last_unstale":"2023-08-10T10:41:37.052719+0000","last_undegraded":"2023-08-10T10:41:37.052719+0000","last_fullsized":"2023-08-10T10:41:37.052719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:57.844582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942920+0000","last_change":"2023-08-10T10:41:34.911000+0000","last_active":"2023-08-10T10:41:35.942920+0000","last_peered":"2023-08-10T10:41:35.942920+0000","last_clean":"2023-08-10T10:41:35.942920+0000","last_became_active":"2023-08-10T10:41:34.909370+0000","last_became_peered":"2023-08-10T10:41:34.909370+0000","last_unstale":"2023-08-10T10:41:35.942920+0000","last_undegraded":"2023-08-10T10:41:35.942920+0000","last_fullsized":"2023-08-10T10:41:35.942920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:14.817924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057495+0000","last_change":"2023-08-10T10:41:33.901686+0000","last_active":"2023-08-10T10:41:37.057495+0000","last_peered":"2023-08-10T10:41:37.057495+0000","last_clean":"2023-08-10T10:41:37.057495+0000","last_became_active":"2023-08-10T10:41:33.901113+0000","last_became_peered":"2023-08-10T10:41:33.901113+0000","last_unstale":"2023-08-10T10:41:37.057495+0000","last_undegraded":"2023-08-10T10:41:37.057495+0000","last_fullsized":"2023-08-10T10:41:37.057495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:22:02.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051418+0000","last_change":"2023-08-10T10:41:34.908522+0000","last_active":"2023-08-10T10:41:37.051418+0000","last_peered":"2023-08-10T10:41:37.051418+0000","last_clean":"2023-08-10T10:41:37.051418+0000","last_became_active":"2023-08-10T10:41:34.908233+0000","last_became_peered":"2023-08-10T10:41:34.908233+0000","last_unstale":"2023-08-10T10:41:37.051418+0000","last_undegraded":"2023-08-10T10:41:37.051418+0000","last_fullsized":"2023-08-10T10:41:37.051418+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:42.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"71'3","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055828+0000","last_change":"2023-08-10T10:41:33.906125+0000","last_active":"2023-08-10T10:41:37.055828+0000","last_peered":"2023-08-10T10:41:37.055828+0000","last_clean":"2023-08-10T10:41:37.055828+0000","last_became_active":"2023-08-10T10:41:33.905698+0000","last_became_peered":"2023-08-10T10:41:33.905698+0000","last_unstale":"2023-08-10T10:41:37.055828+0000","last_undegraded":"2023-08-10T10:41:37.055828+0000","last_fullsized":"2023-08-10T10:41:37.055828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:33.669834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056773+0000","last_change":"2023-08-10T10:41:34.899507+0000","last_active":"2023-08-10T10:41:37.056773+0000","last_peered":"2023-08-10T10:41:37.056773+0000","last_clean":"2023-08-10T10:41:37.056773+0000","last_became_active":"2023-08-10T10:41:34.898363+0000","last_became_peered":"2023-08-10T10:41:34.898363+0000","last_unstale":"2023-08-10T10:41:37.056773+0000","last_undegraded":"2023-08-10T10:41:37.056773+0000","last_fullsized":"2023-08-10T10:41:37.056773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:39.855446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"71'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884296+0000","last_change":"2023-08-10T10:41:33.888886+0000","last_active":"2023-08-10T10:41:35.884296+0000","last_peered":"2023-08-10T10:41:35.884296+0000","last_clean":"2023-08-10T10:41:35.884296+0000","last_became_active":"2023-08-10T10:41:33.885954+0000","last_became_peered":"2023-08-10T10:41:33.885954+0000","last_unstale":"2023-08-10T10:41:35.884296+0000","last_undegraded":"2023-08-10T10:41:35.884296+0000","last_fullsized":"2023-08-10T10:41:35.884296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:13:50.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053936+0000","last_change":"2023-08-10T10:41:34.912362+0000","last_active":"2023-08-10T10:41:37.053936+0000","last_peered":"2023-08-10T10:41:37.053936+0000","last_clean":"2023-08-10T10:41:37.053936+0000","last_became_active":"2023-08-10T10:41:34.911784+0000","last_became_peered":"2023-08-10T10:41:34.911784+0000","last_unstale":"2023-08-10T10:41:37.053936+0000","last_undegraded":"2023-08-10T10:41:37.053936+0000","last_fullsized":"2023-08-10T10:41:37.053936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:08.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054508+0000","last_change":"2023-08-10T10:41:33.906215+0000","last_active":"2023-08-10T10:41:37.054508+0000","last_peered":"2023-08-10T10:41:37.054508+0000","last_clean":"2023-08-10T10:41:37.054508+0000","last_became_active":"2023-08-10T10:41:33.905409+0000","last_became_peered":"2023-08-10T10:41:33.905409+0000","last_unstale":"2023-08-10T10:41:37.054508+0000","last_undegraded":"2023-08-10T10:41:37.054508+0000","last_fullsized":"2023-08-10T10:41:37.054508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:19.749067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057990+0000","last_change":"2023-08-10T10:41:34.914287+0000","last_active":"2023-08-10T10:41:37.057990+0000","last_peered":"2023-08-10T10:41:37.057990+0000","last_clean":"2023-08-10T10:41:37.057990+0000","last_became_active":"2023-08-10T10:41:34.913975+0000","last_became_peered":"2023-08-10T10:41:34.913975+0000","last_unstale":"2023-08-10T10:41:37.057990+0000","last_undegraded":"2023-08-10T10:41:37.057990+0000","last_fullsized":"2023-08-10T10:41:37.057990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:54.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055051+0000","last_change":"2023-08-10T10:41:33.892134+0000","last_active":"2023-08-10T10:41:37.055051+0000","last_peered":"2023-08-10T10:41:37.055051+0000","last_clean":"2023-08-10T10:41:37.055051+0000","last_became_active":"2023-08-10T10:41:33.891435+0000","last_became_peered":"2023-08-10T10:41:33.891435+0000","last_unstale":"2023-08-10T10:41:37.055051+0000","last_undegraded":"2023-08-10T10:41:37.055051+0000","last_fullsized":"2023-08-10T10:41:37.055051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:29.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051994+0000","last_change":"2023-08-10T10:41:34.907156+0000","last_active":"2023-08-10T10:41:37.051994+0000","last_peered":"2023-08-10T10:41:37.051994+0000","last_clean":"2023-08-10T10:41:37.051994+0000","last_became_active":"2023-08-10T10:41:34.906052+0000","last_became_peered":"2023-08-10T10:41:34.906052+0000","last_unstale":"2023-08-10T10:41:37.051994+0000","last_undegraded":"2023-08-10T10:41:37.051994+0000","last_fullsized":"2023-08-10T10:41:37.051994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:49.446792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056704+0000","last_change":"2023-08-10T10:41:33.900575+0000","last_active":"2023-08-10T10:41:37.056704+0000","last_peered":"2023-08-10T10:41:37.056704+0000","last_clean":"2023-08-10T10:41:37.056704+0000","last_became_active":"2023-08-10T10:41:33.900205+0000","last_became_peered":"2023-08-10T10:41:33.900205+0000","last_unstale":"2023-08-10T10:41:37.056704+0000","last_undegraded":"2023-08-10T10:41:37.056704+0000","last_fullsized":"2023-08-10T10:41:37.056704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:25.238672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884415+0000","last_change":"2023-08-10T10:41:34.914198+0000","last_active":"2023-08-10T10:41:35.884415+0000","last_peered":"2023-08-10T10:41:35.884415+0000","last_clean":"2023-08-10T10:41:35.884415+0000","last_became_active":"2023-08-10T10:41:34.912515+0000","last_became_peered":"2023-08-10T10:41:34.912515+0000","last_unstale":"2023-08-10T10:41:35.884415+0000","last_undegraded":"2023-08-10T10:41:35.884415+0000","last_fullsized":"2023-08-10T10:41:35.884415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:14.817924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"71'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054464+0000","last_change":"2023-08-10T10:41:33.905124+0000","last_active":"2023-08-10T10:41:37.054464+0000","last_peered":"2023-08-10T10:41:37.054464+0000","last_clean":"2023-08-10T10:41:37.054464+0000","last_became_active":"2023-08-10T10:41:33.904838+0000","last_became_peered":"2023-08-10T10:41:33.904838+0000","last_unstale":"2023-08-10T10:41:37.054464+0000","last_undegraded":"2023-08-10T10:41:37.054464+0000","last_fullsized":"2023-08-10T10:41:37.054464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:48.442446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886222+0000","last_change":"2023-08-10T10:41:34.911038+0000","last_active":"2023-08-10T10:41:35.886222+0000","last_peered":"2023-08-10T10:41:35.886222+0000","last_clean":"2023-08-10T10:41:35.886222+0000","last_became_active":"2023-08-10T10:41:34.910390+0000","last_became_peered":"2023-08-10T10:41:34.910390+0000","last_unstale":"2023-08-10T10:41:35.886222+0000","last_undegraded":"2023-08-10T10:41:35.886222+0000","last_fullsized":"2023-08-10T10:41:35.886222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:27.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058139+0000","last_change":"2023-08-10T10:41:33.902170+0000","last_active":"2023-08-10T10:41:37.058139+0000","last_peered":"2023-08-10T10:41:37.058139+0000","last_clean":"2023-08-10T10:41:37.058139+0000","last_became_active":"2023-08-10T10:41:33.901542+0000","last_became_peered":"2023-08-10T10:41:33.901542+0000","last_unstale":"2023-08-10T10:41:37.058139+0000","last_undegraded":"2023-08-10T10:41:37.058139+0000","last_fullsized":"2023-08-10T10:41:37.058139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:23:04.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885995+0000","last_change":"2023-08-10T10:41:34.916448+0000","last_active":"2023-08-10T10:41:35.885995+0000","last_peered":"2023-08-10T10:41:35.885995+0000","last_clean":"2023-08-10T10:41:35.885995+0000","last_became_active":"2023-08-10T10:41:34.916088+0000","last_became_peered":"2023-08-10T10:41:34.916088+0000","last_unstale":"2023-08-10T10:41:35.885995+0000","last_undegraded":"2023-08-10T10:41:35.885995+0000","last_fullsized":"2023-08-10T10:41:35.885995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:58.402468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058700+0000","last_change":"2023-08-10T10:41:33.901459+0000","last_active":"2023-08-10T10:41:37.058700+0000","last_peered":"2023-08-10T10:41:37.058700+0000","last_clean":"2023-08-10T10:41:37.058700+0000","last_became_active":"2023-08-10T10:41:33.901193+0000","last_became_peered":"2023-08-10T10:41:33.901193+0000","last_unstale":"2023-08-10T10:41:37.058700+0000","last_undegraded":"2023-08-10T10:41:37.058700+0000","last_fullsized":"2023-08-10T10:41:37.058700+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:43.412684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058523+0000","last_change":"2023-08-10T10:41:34.915562+0000","last_active":"2023-08-10T10:41:37.058523+0000","last_peered":"2023-08-10T10:41:37.058523+0000","last_clean":"2023-08-10T10:41:37.058523+0000","last_became_active":"2023-08-10T10:41:34.915279+0000","last_became_peered":"2023-08-10T10:41:34.915279+0000","last_unstale":"2023-08-10T10:41:37.058523+0000","last_undegraded":"2023-08-10T10:41:37.058523+0000","last_fullsized":"2023-08-10T10:41:37.058523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:31:10.827776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885904+0000","last_change":"2023-08-10T10:41:33.895907+0000","last_active":"2023-08-10T10:41:35.885904+0000","last_peered":"2023-08-10T10:41:35.885904+0000","last_clean":"2023-08-10T10:41:35.885904+0000","last_became_active":"2023-08-10T10:41:33.895646+0000","last_became_peered":"2023-08-10T10:41:33.895646+0000","last_unstale":"2023-08-10T10:41:35.885904+0000","last_undegraded":"2023-08-10T10:41:35.885904+0000","last_fullsized":"2023-08-10T10:41:35.885904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:27:17.550826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051821+0000","last_change":"2023-08-10T10:41:34.913681+0000","last_active":"2023-08-10T10:41:37.051821+0000","last_peered":"2023-08-10T10:41:37.051821+0000","last_clean":"2023-08-10T10:41:37.051821+0000","last_became_active":"2023-08-10T10:41:34.913421+0000","last_became_peered":"2023-08-10T10:41:34.913421+0000","last_unstale":"2023-08-10T10:41:37.051821+0000","last_undegraded":"2023-08-10T10:41:37.051821+0000","last_fullsized":"2023-08-10T10:41:37.051821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:08.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884532+0000","last_change":"2023-08-10T10:41:33.888381+0000","last_active":"2023-08-10T10:41:35.884532+0000","last_peered":"2023-08-10T10:41:35.884532+0000","last_clean":"2023-08-10T10:41:35.884532+0000","last_became_active":"2023-08-10T10:41:33.886456+0000","last_became_peered":"2023-08-10T10:41:33.886456+0000","last_unstale":"2023-08-10T10:41:35.884532+0000","last_undegraded":"2023-08-10T10:41:35.884532+0000","last_fullsized":"2023-08-10T10:41:35.884532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:51.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052683+0000","last_change":"2023-08-10T10:41:34.920865+0000","last_active":"2023-08-10T10:41:37.052683+0000","last_peered":"2023-08-10T10:41:37.052683+0000","last_clean":"2023-08-10T10:41:37.052683+0000","last_became_active":"2023-08-10T10:41:34.920577+0000","last_became_peered":"2023-08-10T10:41:34.920577+0000","last_unstale":"2023-08-10T10:41:37.052683+0000","last_undegraded":"2023-08-10T10:41:37.052683+0000","last_fullsized":"2023-08-10T10:41:37.052683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:14.687541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053329+0000","last_change":"2023-08-10T10:41:33.902985+0000","last_active":"2023-08-10T10:41:37.053329+0000","last_peered":"2023-08-10T10:41:37.053329+0000","last_clean":"2023-08-10T10:41:37.053329+0000","last_became_active":"2023-08-10T10:41:33.901977+0000","last_became_peered":"2023-08-10T10:41:33.901977+0000","last_unstale":"2023-08-10T10:41:37.053329+0000","last_undegraded":"2023-08-10T10:41:37.053329+0000","last_fullsized":"2023-08-10T10:41:37.053329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:07.265289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054245+0000","last_change":"2023-08-10T10:41:34.912065+0000","last_active":"2023-08-10T10:41:37.054245+0000","last_peered":"2023-08-10T10:41:37.054245+0000","last_clean":"2023-08-10T10:41:37.054245+0000","last_became_active":"2023-08-10T10:41:34.911376+0000","last_became_peered":"2023-08-10T10:41:34.911376+0000","last_unstale":"2023-08-10T10:41:37.054245+0000","last_undegraded":"2023-08-10T10:41:37.054245+0000","last_fullsized":"2023-08-10T10:41:37.054245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:31.156554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943655+0000","last_change":"2023-08-10T10:41:33.892323+0000","last_active":"2023-08-10T10:41:35.943655+0000","last_peered":"2023-08-10T10:41:35.943655+0000","last_clean":"2023-08-10T10:41:35.943655+0000","last_became_active":"2023-08-10T10:41:33.891687+0000","last_became_peered":"2023-08-10T10:41:33.891687+0000","last_unstale":"2023-08-10T10:41:35.943655+0000","last_undegraded":"2023-08-10T10:41:35.943655+0000","last_fullsized":"2023-08-10T10:41:35.943655+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:29.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884167+0000","last_change":"2023-08-10T10:41:34.892970+0000","last_active":"2023-08-10T10:41:35.884167+0000","last_peered":"2023-08-10T10:41:35.884167+0000","last_clean":"2023-08-10T10:41:35.884167+0000","last_became_active":"2023-08-10T10:41:34.891951+0000","last_became_peered":"2023-08-10T10:41:34.891951+0000","last_unstale":"2023-08-10T10:41:35.884167+0000","last_undegraded":"2023-08-10T10:41:35.884167+0000","last_fullsized":"2023-08-10T10:41:35.884167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:10.448615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943213+0000","last_change":"2023-08-10T10:41:33.904054+0000","last_active":"2023-08-10T10:41:35.943213+0000","last_peered":"2023-08-10T10:41:35.943213+0000","last_clean":"2023-08-10T10:41:35.943213+0000","last_became_active":"2023-08-10T10:41:33.903572+0000","last_became_peered":"2023-08-10T10:41:33.903572+0000","last_unstale":"2023-08-10T10:41:35.943213+0000","last_undegraded":"2023-08-10T10:41:35.943213+0000","last_fullsized":"2023-08-10T10:41:35.943213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:42:03.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887224+0000","last_change":"2023-08-10T10:41:34.915232+0000","last_active":"2023-08-10T10:41:35.887224+0000","last_peered":"2023-08-10T10:41:35.887224+0000","last_clean":"2023-08-10T10:41:35.887224+0000","last_became_active":"2023-08-10T10:41:34.912081+0000","last_became_peered":"2023-08-10T10:41:34.912081+0000","last_unstale":"2023-08-10T10:41:35.887224+0000","last_undegraded":"2023-08-10T10:41:35.887224+0000","last_fullsized":"2023-08-10T10:41:35.887224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:39:36.332514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884468+0000","last_change":"2023-08-10T10:41:33.903004+0000","last_active":"2023-08-10T10:41:35.884468+0000","last_peered":"2023-08-10T10:41:35.884468+0000","last_clean":"2023-08-10T10:41:35.884468+0000","last_became_active":"2023-08-10T10:41:33.902743+0000","last_became_peered":"2023-08-10T10:41:33.902743+0000","last_unstale":"2023-08-10T10:41:35.884468+0000","last_undegraded":"2023-08-10T10:41:35.884468+0000","last_fullsized":"2023-08-10T10:41:35.884468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:45.893411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052228+0000","last_change":"2023-08-10T10:41:34.910472+0000","last_active":"2023-08-10T10:41:37.052228+0000","last_peered":"2023-08-10T10:41:37.052228+0000","last_clean":"2023-08-10T10:41:37.052228+0000","last_became_active":"2023-08-10T10:41:34.910215+0000","last_became_peered":"2023-08-10T10:41:34.910215+0000","last_unstale":"2023-08-10T10:41:37.052228+0000","last_undegraded":"2023-08-10T10:41:37.052228+0000","last_fullsized":"2023-08-10T10:41:37.052228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:27.707842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943340+0000","last_change":"2023-08-10T10:41:33.893819+0000","last_active":"2023-08-10T10:41:35.943340+0000","last_peered":"2023-08-10T10:41:35.943340+0000","last_clean":"2023-08-10T10:41:35.943340+0000","last_became_active":"2023-08-10T10:41:33.893445+0000","last_became_peered":"2023-08-10T10:41:33.893445+0000","last_unstale":"2023-08-10T10:41:35.943340+0000","last_undegraded":"2023-08-10T10:41:35.943340+0000","last_fullsized":"2023-08-10T10:41:35.943340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:10.232535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":260,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054767+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:41:37.054767+0000","last_peered":"2023-08-10T10:41:37.054767+0000","last_clean":"2023-08-10T10:41:37.054767+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:41:37.054767+0000","last_undegraded":"2023-08-10T10:41:37.054767+0000","last_fullsized":"2023-08-10T10:41:37.054767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:30.588083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055331+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:41:37.055331+0000","last_peered":"2023-08-10T10:41:37.055331+0000","last_clean":"2023-08-10T10:41:37.055331+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:41:37.055331+0000","last_undegraded":"2023-08-10T10:41:37.055331+0000","last_fullsized":"2023-08-10T10:41:37.055331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:30.252155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886298+0000","last_change":"2023-08-10T10:41:34.919681+0000","last_active":"2023-08-10T10:41:35.886298+0000","last_peered":"2023-08-10T10:41:35.886298+0000","last_clean":"2023-08-10T10:41:35.886298+0000","last_became_active":"2023-08-10T10:41:34.919354+0000","last_became_peered":"2023-08-10T10:41:34.919354+0000","last_unstale":"2023-08-10T10:41:35.886298+0000","last_undegraded":"2023-08-10T10:41:35.886298+0000","last_fullsized":"2023-08-10T10:41:35.886298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:05:12.720569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886691+0000","last_change":"2023-08-10T10:41:33.903026+0000","last_active":"2023-08-10T10:41:35.886691+0000","last_peered":"2023-08-10T10:41:35.886691+0000","last_clean":"2023-08-10T10:41:35.886691+0000","last_became_active":"2023-08-10T10:41:33.902762+0000","last_became_peered":"2023-08-10T10:41:33.902762+0000","last_unstale":"2023-08-10T10:41:35.886691+0000","last_undegraded":"2023-08-10T10:41:35.886691+0000","last_fullsized":"2023-08-10T10:41:35.886691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:46:12.300985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054450+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:41:37.054450+0000","last_peered":"2023-08-10T10:41:37.054450+0000","last_clean":"2023-08-10T10:41:37.054450+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:41:37.054450+0000","last_undegraded":"2023-08-10T10:41:37.054450+0000","last_fullsized":"2023-08-10T10:41:37.054450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:52:56.472123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058234+0000","last_change":"2023-08-10T10:41:34.908705+0000","last_active":"2023-08-10T10:41:37.058234+0000","last_peered":"2023-08-10T10:41:37.058234+0000","last_clean":"2023-08-10T10:41:37.058234+0000","last_became_active":"2023-08-10T10:41:34.908278+0000","last_became_peered":"2023-08-10T10:41:34.908278+0000","last_unstale":"2023-08-10T10:41:37.058234+0000","last_undegraded":"2023-08-10T10:41:37.058234+0000","last_fullsized":"2023-08-10T10:41:37.058234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:21.373989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053791+0000","last_change":"2023-08-10T10:41:33.898136+0000","last_active":"2023-08-10T10:41:37.053791+0000","last_peered":"2023-08-10T10:41:37.053791+0000","last_clean":"2023-08-10T10:41:37.053791+0000","last_became_active":"2023-08-10T10:41:33.897625+0000","last_became_peered":"2023-08-10T10:41:33.897625+0000","last_unstale":"2023-08-10T10:41:37.053791+0000","last_undegraded":"2023-08-10T10:41:37.053791+0000","last_fullsized":"2023-08-10T10:41:37.053791+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:42:03.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886298+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:41:35.886298+0000","last_peered":"2023-08-10T10:41:35.886298+0000","last_clean":"2023-08-10T10:41:35.886298+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:41:35.886298+0000","last_undegraded":"2023-08-10T10:41:35.886298+0000","last_fullsized":"2023-08-10T10:41:35.886298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:25.269365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052277+0000","last_change":"2023-08-10T10:41:34.921281+0000","last_active":"2023-08-10T10:41:37.052277+0000","last_peered":"2023-08-10T10:41:37.052277+0000","last_clean":"2023-08-10T10:41:37.052277+0000","last_became_active":"2023-08-10T10:41:34.921118+0000","last_became_peered":"2023-08-10T10:41:34.921118+0000","last_unstale":"2023-08-10T10:41:37.052277+0000","last_undegraded":"2023-08-10T10:41:37.052277+0000","last_fullsized":"2023-08-10T10:41:37.052277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:00.565168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886546+0000","last_change":"2023-08-10T10:41:33.905249+0000","last_active":"2023-08-10T10:41:35.886546+0000","last_peered":"2023-08-10T10:41:35.886546+0000","last_clean":"2023-08-10T10:41:35.886546+0000","last_became_active":"2023-08-10T10:41:33.904933+0000","last_became_peered":"2023-08-10T10:41:33.904933+0000","last_unstale":"2023-08-10T10:41:35.886546+0000","last_undegraded":"2023-08-10T10:41:35.886546+0000","last_fullsized":"2023-08-10T10:41:35.886546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:48:10.139773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058325+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:41:37.058325+0000","last_peered":"2023-08-10T10:41:37.058325+0000","last_clean":"2023-08-10T10:41:37.058325+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:41:37.058325+0000","last_undegraded":"2023-08-10T10:41:37.058325+0000","last_fullsized":"2023-08-10T10:41:37.058325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:32.682893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056269+0000","last_change":"2023-08-10T10:41:34.910711+0000","last_active":"2023-08-10T10:41:37.056269+0000","last_peered":"2023-08-10T10:41:37.056269+0000","last_clean":"2023-08-10T10:41:37.056269+0000","last_became_active":"2023-08-10T10:41:34.910415+0000","last_became_peered":"2023-08-10T10:41:34.910415+0000","last_unstale":"2023-08-10T10:41:37.056269+0000","last_undegraded":"2023-08-10T10:41:37.056269+0000","last_fullsized":"2023-08-10T10:41:37.056269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:03.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053395+0000","last_change":"2023-08-10T10:41:33.897954+0000","last_active":"2023-08-10T10:41:37.053395+0000","last_peered":"2023-08-10T10:41:37.053395+0000","last_clean":"2023-08-10T10:41:37.053395+0000","last_became_active":"2023-08-10T10:41:33.897232+0000","last_became_peered":"2023-08-10T10:41:33.897232+0000","last_unstale":"2023-08-10T10:41:37.053395+0000","last_undegraded":"2023-08-10T10:41:37.053395+0000","last_fullsized":"2023-08-10T10:41:37.053395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:51.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884788+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:41:35.884788+0000","last_peered":"2023-08-10T10:41:35.884788+0000","last_clean":"2023-08-10T10:41:35.884788+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:41:35.884788+0000","last_undegraded":"2023-08-10T10:41:35.884788+0000","last_fullsized":"2023-08-10T10:41:35.884788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:49.846206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052360+0000","last_change":"2023-08-10T10:41:34.907311+0000","last_active":"2023-08-10T10:41:37.052360+0000","last_peered":"2023-08-10T10:41:37.052360+0000","last_clean":"2023-08-10T10:41:37.052360+0000","last_became_active":"2023-08-10T10:41:34.906476+0000","last_became_peered":"2023-08-10T10:41:34.906476+0000","last_unstale":"2023-08-10T10:41:37.052360+0000","last_undegraded":"2023-08-10T10:41:37.052360+0000","last_fullsized":"2023-08-10T10:41:37.052360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:21.618571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055137+0000","last_change":"2023-08-10T10:41:33.906376+0000","last_active":"2023-08-10T10:41:37.055137+0000","last_peered":"2023-08-10T10:41:37.055137+0000","last_clean":"2023-08-10T10:41:37.055137+0000","last_became_active":"2023-08-10T10:41:33.905838+0000","last_became_peered":"2023-08-10T10:41:33.905838+0000","last_unstale":"2023-08-10T10:41:37.055137+0000","last_undegraded":"2023-08-10T10:41:37.055137+0000","last_fullsized":"2023-08-10T10:41:37.055137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:21.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053859+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:41:37.053859+0000","last_peered":"2023-08-10T10:41:37.053859+0000","last_clean":"2023-08-10T10:41:37.053859+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:41:37.053859+0000","last_undegraded":"2023-08-10T10:41:37.053859+0000","last_fullsized":"2023-08-10T10:41:37.053859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:07.452877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055578+0000","last_change":"2023-08-10T10:41:34.912497+0000","last_active":"2023-08-10T10:41:37.055578+0000","last_peered":"2023-08-10T10:41:37.055578+0000","last_clean":"2023-08-10T10:41:37.055578+0000","last_became_active":"2023-08-10T10:41:34.911663+0000","last_became_peered":"2023-08-10T10:41:34.911663+0000","last_unstale":"2023-08-10T10:41:37.055578+0000","last_undegraded":"2023-08-10T10:41:37.055578+0000","last_fullsized":"2023-08-10T10:41:37.055578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:27.707842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053042+0000","last_change":"2023-08-10T10:41:33.903302+0000","last_active":"2023-08-10T10:41:37.053042+0000","last_peered":"2023-08-10T10:41:37.053042+0000","last_clean":"2023-08-10T10:41:37.053042+0000","last_became_active":"2023-08-10T10:41:33.902706+0000","last_became_peered":"2023-08-10T10:41:33.902706+0000","last_unstale":"2023-08-10T10:41:37.053042+0000","last_undegraded":"2023-08-10T10:41:37.053042+0000","last_fullsized":"2023-08-10T10:41:37.053042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:28.642861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884535+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:41:35.884535+0000","last_peered":"2023-08-10T10:41:35.884535+0000","last_clean":"2023-08-10T10:41:35.884535+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:41:35.884535+0000","last_undegraded":"2023-08-10T10:41:35.884535+0000","last_fullsized":"2023-08-10T10:41:35.884535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:38:45.229258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.050900+0000","last_change":"2023-08-10T10:41:34.917622+0000","last_active":"2023-08-10T10:41:37.050900+0000","last_peered":"2023-08-10T10:41:37.050900+0000","last_clean":"2023-08-10T10:41:37.050900+0000","last_became_active":"2023-08-10T10:41:34.917440+0000","last_became_peered":"2023-08-10T10:41:34.917440+0000","last_unstale":"2023-08-10T10:41:37.050900+0000","last_undegraded":"2023-08-10T10:41:37.050900+0000","last_fullsized":"2023-08-10T10:41:37.050900+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:28.226061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943423+0000","last_change":"2023-08-10T10:41:33.898907+0000","last_active":"2023-08-10T10:41:35.943423+0000","last_peered":"2023-08-10T10:41:35.943423+0000","last_clean":"2023-08-10T10:41:35.943423+0000","last_became_active":"2023-08-10T10:41:33.898250+0000","last_became_peered":"2023-08-10T10:41:33.898250+0000","last_unstale":"2023-08-10T10:41:35.943423+0000","last_undegraded":"2023-08-10T10:41:35.943423+0000","last_fullsized":"2023-08-10T10:41:35.943423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:42.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052033+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:41:37.052033+0000","last_peered":"2023-08-10T10:41:37.052033+0000","last_clean":"2023-08-10T10:41:37.052033+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:41:37.052033+0000","last_undegraded":"2023-08-10T10:41:37.052033+0000","last_fullsized":"2023-08-10T10:41:37.052033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:22.076435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194349,"statfs":{"total":200000000,"available":199014193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.119,"15min":1.139},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.548,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.115,"15min":1.0600000000000001},"min":{"1min":0.86099999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":5.149,"5min":5.149,"15min":5.149},"last":1.337}]},{"osd":1,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.76600000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7370000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1419999999999999,"15min":1.129},"min":{"1min":0.80300000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5660000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.96999999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.258,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":5.2709999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.242,"15min":1.248},"min":{"1min":0.95899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7589999999999999,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.214},"min":{"1min":0.81499999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.351,"15min":1.3879999999999999},"min":{"1min":0.98499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.9610000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.117}]},{"osd":4,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2090000000000001,"15min":1.2270000000000001},"min":{"1min":0.82999999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6739999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.3140000000000001,"15min":1.2809999999999999},"min":{"1min":0.93999999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":6.657,"5min":6.657,"15min":6.657},"last":1.274}]},{"osd":5,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.4339999999999999,"15min":1.4419999999999999},"min":{"1min":0.95399999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.5169999999999999,"15min":1.5029999999999999},"min":{"1min":1.111,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.385}]},{"osd":6,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.5629999999999999,"15min":1.599},"min":{"1min":1.1519999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.401},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.4950000000000001,"15min":1.5129999999999999},"min":{"1min":1.03,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":1.2330000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.554,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.125,"5min":0.98999999999999999,"15min":0.96199999999999997},"min":{"1min":0.79800000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.72499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.157,"15min":1.1539999999999999},"min":{"1min":0.92400000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.579,"5min":1.96,"15min":1.96},"last":1.3959999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1100000000000001},"min":{"1min":0.91600000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.383,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.321},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2270000000000001,"15min":1.2090000000000001},"min":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5920000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.7929999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1859999999999999,"15min":1.171},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.484,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.25,"15min":1.236},"min":{"1min":0.88,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.476}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2310000000000001,"15min":1.1870000000000001},"min":{"1min":0.92300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6799999999999999,"5min":2.04,"15min":2.04},"last":2.137},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4079999999999999,"15min":1.3879999999999999},"min":{"1min":1.135,"5min":0.622,"15min":0.622},"max":{"1min":1.7330000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.4279999999999999,"15min":1.3819999999999999},"min":{"1min":1.3380000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.958,"5min":2.028,"15min":2.028},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.502,"5min":1.4690000000000001,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8899999999999999,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.982}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.359,"15min":1.345},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9330000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.611},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.486,"15min":1.456},"min":{"1min":1.05,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9079999999999999,"5min":2.698,"15min":2.698},"last":2.536}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":384,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606334,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.117,"15min":1.0720000000000001},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6879999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":2.532,"5min":1.363,"15min":1.181},"min":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":32.941000000000003,"5min":32.941000000000003,"15min":32.941000000000003},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2050000000000001,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5920000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.653,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.24}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.579,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.387},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1639999999999999,"15min":1.139},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6299999999999999,"5min":1.73,"15min":1.73},"last":1.196}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2270000000000001,"15min":1.244},"min":{"1min":0.83999999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.47,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6100000000000001,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3129999999999999},"min":{"1min":0.82899999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7330000000000001,"5min":2.399,"15min":2.399},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6519999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3129999999999999,"15min":1.2929999999999999},"min":{"1min":0.78200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.583,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.536},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4079999999999999,"15min":1.379},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.9650000000000001,"5min":1.98,"15min":1.98},"last":1.351}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4730000000000001,"15min":1.4850000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.4810000000000001},"min":{"1min":1.0669999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7250000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.45}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.67500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.512,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.167,"15min":1.1890000000000001},"min":{"1min":0.77400000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.667,"15min":1.667},"last":1.071}]},{"osd":1,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2390000000000001,"15min":1.292},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.276},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.135},"min":{"1min":0.67900000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.601,"5min":1.677,"15min":1.677},"last":1.1439999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.1080000000000001,"15min":1.1259999999999999},"min":{"1min":0.66000000000000003,"5min":0.621,"15min":0.621},"max":{"1min":1.6519999999999999,"5min":2.004,"15min":2.004},"last":1.216},{"interface":"front","average":{"1min":1.173,"5min":1.248,"15min":1.278},"min":{"1min":0.85499999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":1.893,"15min":1.893},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7250000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.238,"15min":1.252},"min":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6830000000000001,"5min":1.863,"15min":1.863},"last":1.6930000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.345,"15min":1.355},"min":{"1min":1.038,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.923,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.593},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.28,"15min":1.282},"min":{"1min":0.82299999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.661,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.405}]},{"osd":6,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3,"15min":1.3120000000000001},"min":{"1min":0.89800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.706,"5min":2,"15min":2},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.444,"15min":1.45},"min":{"1min":1.2250000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.827,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.506}]},{"osd":7,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.093,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7350000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.476,"15min":1.4870000000000001},"min":{"1min":1.21,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.788,"5min":1.877,"15min":1.877},"last":1.5580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.85099999999999998,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.8140000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96099999999999997,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.768,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":2.4470000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81999999999999995,"15min":0.78600000000000003},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.377,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.51100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.444,"5min":1.897,"15min":1.897},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.89400000000000002},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.8720000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.125,"5min":1.0700000000000001,"15min":1.014},"min":{"1min":0.69999999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8879999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.115}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2290000000000001,"15min":1.181},"min":{"1min":0.78200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.655,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.202},{"interface":"front","average":{"1min":1.232,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":0.80900000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.579,"5min":1.948,"15min":1.948},"last":1.036}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3149999999999999,"15min":1.2869999999999999},"min":{"1min":0.94799999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.681,"5min":2.125,"15min":2.125},"last":1.389},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3480000000000001,"15min":1.3280000000000001},"min":{"1min":0.82699999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6890000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.089},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.401,"15min":1.367},"min":{"1min":0.95199999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7529999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.171}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4079999999999999,"15min":1.397},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.726,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.052},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.331,"15min":1.2969999999999999},"min":{"1min":0.88100000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.829,"5min":2.306,"15min":2.306},"last":1.2430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.53500000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.135,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.5369999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5129999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.079,"15min":1.0760000000000001},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.115}]},{"osd":3,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4359999999999999,"5min":1.639,"15min":1.639},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.202,"15min":1.2509999999999999},"min":{"1min":0.626,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5860000000000001,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.391,"15min":1.4199999999999999},"min":{"1min":0.92400000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.865,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.28,"15min":1.284},"min":{"1min":0.95799999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0779999999999998,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.252},"min":{"1min":0.85399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6899999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.4450000000000001,"15min":1.4690000000000001},"min":{"1min":0.93899999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.944,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.353}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":0.93100000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1859999999999999,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.319,"15min":1.327},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8260000000000001,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.321}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.377,"15min":1.363},"min":{"1min":0.90800000000000003,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.397,"15min":1.3999999999999999},"min":{"1min":0.96899999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6990000000000001,"5min":2.444,"15min":2.444},"last":1.506}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194924,"statfs":{"total":200000000,"available":199603009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3979999999999999,"5min":1.548,"15min":1.548},"last":1.014},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.597,"5min":2.246,"15min":2.246},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.878,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.436,"15min":0.436},"max":{"1min":1.8320000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.5},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.0629999999999999,"15min":0.999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.036,"15min":1.0069999999999999},"min":{"1min":0.58499999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.486,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.51000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.45,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1299999999999999},"min":{"1min":0.98799999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6459999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3819999999999999,"15min":1.3600000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.206,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.135}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.3600000000000001,"15min":1.341},"min":{"1min":1.179,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8140000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":1.1259999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3580000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8720000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.355,"5min":1.236,"15min":1.2070000000000001},"min":{"1min":1.012,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0230000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.409,"15min":1.413},"min":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3199999999999998,"5min":2.742,"15min":2.742},"last":1.24},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.391,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8540000000000001,"5min":2.605,"15min":2.605},"last":1.1950000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194351,"statfs":{"total":200000000,"available":199015988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.48299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.359,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.0229999999999999,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.573,"5min":1.853,"15min":1.853},"last":0.75}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.032,"15min":1.03},"min":{"1min":0.46700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.006,"15min":1.01},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.526,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.4690000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":0.97199999999999998,"15min":0.93400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.9980000000000002,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":1.294},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.069,"15min":1.083},"min":{"1min":0.51500000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.615,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.296,"15min":1.25},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":6.5209999999999999,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3779999999999999,"15min":1.3740000000000001},"min":{"1min":0.83999999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1160000000000001,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.405}]},{"osd":5,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.3380000000000001,"15min":1.371},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.863,"5min":1.986,"15min":1.986},"last":1.3600000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.446,"15min":1.3180000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":16.058,"5min":16.058,"15min":16.058},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4199999999999999,"15min":1.4399999999999999},"min":{"1min":0.96199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.96,"5min":2.04,"15min":2.04},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.413,"15min":1.425},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.1789999999999998,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.2599999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.4450000000000001,"15min":1.4019999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.389}]}]}],"pool_statfs":[]}} 2023-08-10T10:41:39.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:41:39.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.714+0000 7f2da3e34640 1 Processor -- start 2023-08-10T10:41:39.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.714+0000 7f2da3e34640 1 -- start start 2023-08-10T10:41:39.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da3e34640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d9c0b3010 0x7f2d9c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da3e34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d9c0c9b30 0x7f2d9c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da3e34640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c0719f0 con 0x7f2d9c15ccb0 2023-08-10T10:41:39.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da3e34640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c8db0 con 0x7f2d9c0b3010 2023-08-10T10:41:39.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da3e34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c9050 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da13cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d9c0b3010 0x7f2d9c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.716+0000 7f2da13cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d9c0b3010 0x7f2d9c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47382/0 (socket says 172.21.15.50:47382) 2023-08-10T10:41:39.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da13cf640 1 -- 172.21.15.50:0/366394653 learned_addr learned my addr 172.21.15.50:0/366394653 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:39.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da23d1640 1 --2- 172.21.15.50:0/366394653 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c0c9b30 0x7f2d9c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da13cf640 1 -- 172.21.15.50:0/366394653 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c0c9b30 msgr2=0x7f2d9c069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:39.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da13cf640 1 --2- 172.21.15.50:0/366394653 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c0c9b30 0x7f2d9c069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da13cf640 1 -- 172.21.15.50:0/366394653 >> v1:172.21.15.117:6789/0 conn(0x7f2d9c15ccb0 legacy=0x7f2d9c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.717+0000 7f2da13cf640 1 -- 172.21.15.50:0/366394653 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0c9330 con 0x7f2d9c0b3010 2023-08-10T10:41:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.718+0000 7f2da13cf640 1 --2- 172.21.15.50:0/366394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0b3010 0x7f2d9c0696a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06cb50 tx=0x7f2d8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c8eab906333cbf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da0bce640 1 -- 172.21.15.50:0/366394653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c031870 con 0x7f2d9c0b3010 2023-08-10T10:41:39.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da0bce640 1 -- 172.21.15.50:0/366394653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0319d0 con 0x7f2d9c0b3010 2023-08-10T10:41:39.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da0bce640 1 -- 172.21.15.50:0/366394653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c031d60 con 0x7f2d9c0b3010 2023-08-10T10:41:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 -- 172.21.15.50:0/366394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0b3010 msgr2=0x7f2d9c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 --2- 172.21.15.50:0/366394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0b3010 0x7f2d9c0696a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06cb50 tx=0x7f2d8c02b910 comp rx=0 tx=0).stop 2023-08-10T10:41:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 -- 172.21.15.50:0/366394653 shutdown_connections 2023-08-10T10:41:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 --2- 172.21.15.50:0/366394653 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c0c9b30 0x7f2d9c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 --2- 172.21.15.50:0/366394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0b3010 0x7f2d9c0696a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 -- 172.21.15.50:0/366394653 >> 172.21.15.50:0/366394653 conn(0x7f2d9c06b590 msgr2=0x7f2d9c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 -- 172.21.15.50:0/366394653 shutdown_connections 2023-08-10T10:41:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.719+0000 7f2da3e34640 1 -- 172.21.15.50:0/366394653 wait complete. 2023-08-10T10:41:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.721+0000 7f2da3e34640 1 Processor -- start 2023-08-10T10:41:39.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.721+0000 7f2da3e34640 1 -- start start 2023-08-10T10:41:39.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c0b3010 0x7f2d9c0c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 0x7f2d9c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15edb0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15e410 con 0x7f2d9c15ccb0 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.722+0000 7f2da3e34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15e6f0 con 0x7f2d9c0b3010 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47388/0 (socket says 172.21.15.50:47388) 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 -- 172.21.15.50:0/685888568 learned_addr learned my addr 172.21.15.50:0/685888568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da1bd0640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c0b3010 0x7f2d9c0c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da23d1640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 0x7f2d9c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 -- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c0b3010 msgr2=0x7f2d9c0c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c0b3010 0x7f2d9c0c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 -- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 msgr2=0x7f2d9c15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 0x7f2d9c15f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da13cf640 1 -- 172.21.15.50:0/685888568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0094d0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.723+0000 7f2da23d1640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 0x7f2d9c15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2da13cf640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c03abe0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c03ad40 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0445f0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c15e9d0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.724+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0c3300 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.725+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c15eef0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.727+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d8c04d450 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.728+0000 7f2d927fc640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 0x7f2d8006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.728+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d8c02d040 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.728+0000 7f2da1bd0640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 0x7f2d8006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.729+0000 7f2da1bd0640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 0x7f2d8006d110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d98006fd0 tx=0x7f2d98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.732+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2d9c15eef0 con 0x7f2d9c0c9b30 2023-08-10T10:41:39.787 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:41:39.787+0000 7ff5875b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.920+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d9c0c9610 con 0x7f2d8006ac50 2023-08-10T10:41:39.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.944+0000 7f2d927fc640 1 -- 172.21.15.50:0/685888568 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303090 (secure 0 0 0) 0x7f2d9800be30 con 0x7f2d8006ac50 2023-08-10T10:41:39.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:39.950 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:41:39.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.951+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 msgr2=0x7f2d8006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.951+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 0x7f2d8006d110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d98006fd0 tx=0x7f2d98008040 comp rx=0 tx=0).stop 2023-08-10T10:41:39.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 msgr2=0x7f2d9c0c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 shutdown_connections 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d8006ac50 0x7f2d8006d110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ccb0 0x7f2d9c15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d9c0c9b30 0x7f2d9c0c2dc0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 --2- 172.21.15.50:0/685888568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c0b3010 0x7f2d9c0c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:39.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 >> 172.21.15.50:0/685888568 conn(0x7f2d9c06b590 msgr2=0x7f2d9c0cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:39.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 shutdown_connections 2023-08-10T10:41:39.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:39.952+0000 7f2da3e34640 1 -- 172.21.15.50:0/685888568 wait complete. 2023-08-10T10:41:39.971 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-08-10T10:41:38.384074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558261,"statfs":{"total":1600000000,"available":1595659274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512944"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884595+0000","last_change":"2023-08-10T10:41:34.917521+0000","last_active":"2023-08-10T10:41:35.884595+0000","last_peered":"2023-08-10T10:41:35.884595+0000","last_clean":"2023-08-10T10:41:35.884595+0000","last_became_active":"2023-08-10T10:41:34.915275+0000","last_became_peered":"2023-08-10T10:41:34.915275+0000","last_unstale":"2023-08-10T10:41:35.884595+0000","last_undegraded":"2023-08-10T10:41:35.884595+0000","last_fullsized":"2023-08-10T10:41:35.884595+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:30.954421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884555+0000","last_change":"2023-08-10T10:41:34.920835+0000","last_active":"2023-08-10T10:41:35.884555+0000","last_peered":"2023-08-10T10:41:35.884555+0000","last_clean":"2023-08-10T10:41:35.884555+0000","last_became_active":"2023-08-10T10:41:34.920479+0000","last_became_peered":"2023-08-10T10:41:34.920479+0000","last_unstale":"2023-08-10T10:41:35.884555+0000","last_undegraded":"2023-08-10T10:41:35.884555+0000","last_fullsized":"2023-08-10T10:41:35.884555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:23.505013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054628+0000","last_change":"2023-08-10T10:41:34.919318+0000","last_active":"2023-08-10T10:41:37.054628+0000","last_peered":"2023-08-10T10:41:37.054628+0000","last_clean":"2023-08-10T10:41:37.054628+0000","last_became_active":"2023-08-10T10:41:34.919059+0000","last_became_peered":"2023-08-10T10:41:34.919059+0000","last_unstale":"2023-08-10T10:41:37.054628+0000","last_undegraded":"2023-08-10T10:41:37.054628+0000","last_fullsized":"2023-08-10T10:41:37.054628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:28.277120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056507+0000","last_change":"2023-08-10T10:41:34.914906+0000","last_active":"2023-08-10T10:41:37.056507+0000","last_peered":"2023-08-10T10:41:37.056507+0000","last_clean":"2023-08-10T10:41:37.056507+0000","last_became_active":"2023-08-10T10:41:34.914659+0000","last_became_peered":"2023-08-10T10:41:34.914659+0000","last_unstale":"2023-08-10T10:41:37.056507+0000","last_undegraded":"2023-08-10T10:41:37.056507+0000","last_fullsized":"2023-08-10T10:41:37.056507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:21.637756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053066+0000","last_change":"2023-08-10T10:41:34.911004+0000","last_active":"2023-08-10T10:41:37.053066+0000","last_peered":"2023-08-10T10:41:37.053066+0000","last_clean":"2023-08-10T10:41:37.053066+0000","last_became_active":"2023-08-10T10:41:34.910628+0000","last_became_peered":"2023-08-10T10:41:34.910628+0000","last_unstale":"2023-08-10T10:41:37.053066+0000","last_undegraded":"2023-08-10T10:41:37.053066+0000","last_fullsized":"2023-08-10T10:41:37.053066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:21.637756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886105+0000","last_change":"2023-08-10T10:41:34.916461+0000","last_active":"2023-08-10T10:41:35.886105+0000","last_peered":"2023-08-10T10:41:35.886105+0000","last_clean":"2023-08-10T10:41:35.886105+0000","last_became_active":"2023-08-10T10:41:34.916081+0000","last_became_peered":"2023-08-10T10:41:34.916081+0000","last_unstale":"2023-08-10T10:41:35.886105+0000","last_undegraded":"2023-08-10T10:41:35.886105+0000","last_fullsized":"2023-08-10T10:41:35.886105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:06.738931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886783+0000","last_change":"2023-08-10T10:41:34.904769+0000","last_active":"2023-08-10T10:41:35.886783+0000","last_peered":"2023-08-10T10:41:35.886783+0000","last_clean":"2023-08-10T10:41:35.886783+0000","last_became_active":"2023-08-10T10:41:34.904046+0000","last_became_peered":"2023-08-10T10:41:34.904046+0000","last_unstale":"2023-08-10T10:41:35.886783+0000","last_undegraded":"2023-08-10T10:41:35.886783+0000","last_fullsized":"2023-08-10T10:41:35.886783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:11.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057829+0000","last_change":"2023-08-10T10:41:34.912244+0000","last_active":"2023-08-10T10:41:37.057829+0000","last_peered":"2023-08-10T10:41:37.057829+0000","last_clean":"2023-08-10T10:41:37.057829+0000","last_became_active":"2023-08-10T10:41:34.911918+0000","last_became_peered":"2023-08-10T10:41:34.911918+0000","last_unstale":"2023-08-10T10:41:37.057829+0000","last_undegraded":"2023-08-10T10:41:37.057829+0000","last_fullsized":"2023-08-10T10:41:37.057829+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:32.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053024+0000","last_change":"2023-08-10T10:41:34.909412+0000","last_active":"2023-08-10T10:41:37.053024+0000","last_peered":"2023-08-10T10:41:37.053024+0000","last_clean":"2023-08-10T10:41:37.053024+0000","last_became_active":"2023-08-10T10:41:34.909125+0000","last_became_peered":"2023-08-10T10:41:34.909125+0000","last_unstale":"2023-08-10T10:41:37.053024+0000","last_undegraded":"2023-08-10T10:41:37.053024+0000","last_fullsized":"2023-08-10T10:41:37.053024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:23.584074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054126+0000","last_change":"2023-08-10T10:41:34.919599+0000","last_active":"2023-08-10T10:41:37.054126+0000","last_peered":"2023-08-10T10:41:37.054126+0000","last_clean":"2023-08-10T10:41:37.054126+0000","last_became_active":"2023-08-10T10:41:34.918702+0000","last_became_peered":"2023-08-10T10:41:34.918702+0000","last_unstale":"2023-08-10T10:41:37.054126+0000","last_undegraded":"2023-08-10T10:41:37.054126+0000","last_fullsized":"2023-08-10T10:41:37.054126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:05:02.381897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056052+0000","last_change":"2023-08-10T10:41:34.891974+0000","last_active":"2023-08-10T10:41:37.056052+0000","last_peered":"2023-08-10T10:41:37.056052+0000","last_clean":"2023-08-10T10:41:37.056052+0000","last_became_active":"2023-08-10T10:41:34.891319+0000","last_became_peered":"2023-08-10T10:41:34.891319+0000","last_unstale":"2023-08-10T10:41:37.056052+0000","last_undegraded":"2023-08-10T10:41:37.056052+0000","last_fullsized":"2023-08-10T10:41:37.056052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:21.618571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057615+0000","last_change":"2023-08-10T10:41:34.913322+0000","last_active":"2023-08-10T10:41:37.057615+0000","last_peered":"2023-08-10T10:41:37.057615+0000","last_clean":"2023-08-10T10:41:37.057615+0000","last_became_active":"2023-08-10T10:41:34.912968+0000","last_became_peered":"2023-08-10T10:41:34.912968+0000","last_unstale":"2023-08-10T10:41:37.057615+0000","last_undegraded":"2023-08-10T10:41:37.057615+0000","last_fullsized":"2023-08-10T10:41:37.057615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:58.128885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058309+0000","last_change":"2023-08-10T10:41:34.908223+0000","last_active":"2023-08-10T10:41:37.058309+0000","last_peered":"2023-08-10T10:41:37.058309+0000","last_clean":"2023-08-10T10:41:37.058309+0000","last_became_active":"2023-08-10T10:41:34.907868+0000","last_became_peered":"2023-08-10T10:41:34.907868+0000","last_unstale":"2023-08-10T10:41:37.058309+0000","last_undegraded":"2023-08-10T10:41:37.058309+0000","last_fullsized":"2023-08-10T10:41:37.058309+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:05:28.918997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053330+0000","last_change":"2023-08-10T10:41:34.917246+0000","last_active":"2023-08-10T10:41:37.053330+0000","last_peered":"2023-08-10T10:41:37.053330+0000","last_clean":"2023-08-10T10:41:37.053330+0000","last_became_active":"2023-08-10T10:41:34.916703+0000","last_became_peered":"2023-08-10T10:41:34.916703+0000","last_unstale":"2023-08-10T10:41:37.053330+0000","last_undegraded":"2023-08-10T10:41:37.053330+0000","last_fullsized":"2023-08-10T10:41:37.053330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:43:54.350978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054919+0000","last_change":"2023-08-10T10:41:34.919790+0000","last_active":"2023-08-10T10:41:37.054919+0000","last_peered":"2023-08-10T10:41:37.054919+0000","last_clean":"2023-08-10T10:41:37.054919+0000","last_became_active":"2023-08-10T10:41:34.919243+0000","last_became_peered":"2023-08-10T10:41:34.919243+0000","last_unstale":"2023-08-10T10:41:37.054919+0000","last_undegraded":"2023-08-10T10:41:37.054919+0000","last_fullsized":"2023-08-10T10:41:37.054919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:00.189133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887118+0000","last_change":"2023-08-10T10:41:34.915710+0000","last_active":"2023-08-10T10:41:35.887118+0000","last_peered":"2023-08-10T10:41:35.887118+0000","last_clean":"2023-08-10T10:41:35.887118+0000","last_became_active":"2023-08-10T10:41:34.912924+0000","last_became_peered":"2023-08-10T10:41:34.912924+0000","last_unstale":"2023-08-10T10:41:35.887118+0000","last_undegraded":"2023-08-10T10:41:35.887118+0000","last_fullsized":"2023-08-10T10:41:35.887118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:50.570890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.883978+0000","last_change":"2023-08-10T10:41:34.892553+0000","last_active":"2023-08-10T10:41:35.883978+0000","last_peered":"2023-08-10T10:41:35.883978+0000","last_clean":"2023-08-10T10:41:35.883978+0000","last_became_active":"2023-08-10T10:41:34.891046+0000","last_became_peered":"2023-08-10T10:41:34.891046+0000","last_unstale":"2023-08-10T10:41:35.883978+0000","last_undegraded":"2023-08-10T10:41:35.883978+0000","last_fullsized":"2023-08-10T10:41:35.883978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:04:11.360838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052844+0000","last_change":"2023-08-10T10:41:34.914283+0000","last_active":"2023-08-10T10:41:37.052844+0000","last_peered":"2023-08-10T10:41:37.052844+0000","last_clean":"2023-08-10T10:41:37.052844+0000","last_became_active":"2023-08-10T10:41:34.914053+0000","last_became_peered":"2023-08-10T10:41:34.914053+0000","last_unstale":"2023-08-10T10:41:37.052844+0000","last_undegraded":"2023-08-10T10:41:37.052844+0000","last_fullsized":"2023-08-10T10:41:37.052844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:00.565168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051258+0000","last_change":"2023-08-10T10:41:34.915253+0000","last_active":"2023-08-10T10:41:37.051258+0000","last_peered":"2023-08-10T10:41:37.051258+0000","last_clean":"2023-08-10T10:41:37.051258+0000","last_became_active":"2023-08-10T10:41:34.915014+0000","last_became_peered":"2023-08-10T10:41:34.915014+0000","last_unstale":"2023-08-10T10:41:37.051258+0000","last_undegraded":"2023-08-10T10:41:37.051258+0000","last_fullsized":"2023-08-10T10:41:37.051258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:35.535656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.944122+0000","last_change":"2023-08-10T10:41:34.914385+0000","last_active":"2023-08-10T10:41:35.944122+0000","last_peered":"2023-08-10T10:41:35.944122+0000","last_clean":"2023-08-10T10:41:35.944122+0000","last_became_active":"2023-08-10T10:41:34.913850+0000","last_became_peered":"2023-08-10T10:41:34.913850+0000","last_unstale":"2023-08-10T10:41:35.944122+0000","last_undegraded":"2023-08-10T10:41:35.944122+0000","last_fullsized":"2023-08-10T10:41:35.944122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:50.019577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054334+0000","last_change":"2023-08-10T10:41:34.908948+0000","last_active":"2023-08-10T10:41:37.054334+0000","last_peered":"2023-08-10T10:41:37.054334+0000","last_clean":"2023-08-10T10:41:37.054334+0000","last_became_active":"2023-08-10T10:41:34.907125+0000","last_became_peered":"2023-08-10T10:41:34.907125+0000","last_unstale":"2023-08-10T10:41:37.054334+0000","last_undegraded":"2023-08-10T10:41:37.054334+0000","last_fullsized":"2023-08-10T10:41:37.054334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:11.236881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942965+0000","last_change":"2023-08-10T10:41:34.917641+0000","last_active":"2023-08-10T10:41:35.942965+0000","last_peered":"2023-08-10T10:41:35.942965+0000","last_clean":"2023-08-10T10:41:35.942965+0000","last_became_active":"2023-08-10T10:41:34.908949+0000","last_became_peered":"2023-08-10T10:41:34.908949+0000","last_unstale":"2023-08-10T10:41:35.942965+0000","last_undegraded":"2023-08-10T10:41:35.942965+0000","last_fullsized":"2023-08-10T10:41:35.942965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:46.897758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942757+0000","last_change":"2023-08-10T10:41:34.915683+0000","last_active":"2023-08-10T10:41:35.942757+0000","last_peered":"2023-08-10T10:41:35.942757+0000","last_clean":"2023-08-10T10:41:35.942757+0000","last_became_active":"2023-08-10T10:41:34.910325+0000","last_became_peered":"2023-08-10T10:41:34.910325+0000","last_unstale":"2023-08-10T10:41:35.942757+0000","last_undegraded":"2023-08-10T10:41:35.942757+0000","last_fullsized":"2023-08-10T10:41:35.942757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:08.111614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053651+0000","last_change":"2023-08-10T10:41:34.917097+0000","last_active":"2023-08-10T10:41:37.053651+0000","last_peered":"2023-08-10T10:41:37.053651+0000","last_clean":"2023-08-10T10:41:37.053651+0000","last_became_active":"2023-08-10T10:41:34.916486+0000","last_became_peered":"2023-08-10T10:41:34.916486+0000","last_unstale":"2023-08-10T10:41:37.053651+0000","last_undegraded":"2023-08-10T10:41:37.053651+0000","last_fullsized":"2023-08-10T10:41:37.053651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:18:12.151693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054161+0000","last_change":"2023-08-10T10:41:34.913849+0000","last_active":"2023-08-10T10:41:37.054161+0000","last_peered":"2023-08-10T10:41:37.054161+0000","last_clean":"2023-08-10T10:41:37.054161+0000","last_became_active":"2023-08-10T10:41:34.913571+0000","last_became_peered":"2023-08-10T10:41:34.913571+0000","last_unstale":"2023-08-10T10:41:37.054161+0000","last_undegraded":"2023-08-10T10:41:37.054161+0000","last_fullsized":"2023-08-10T10:41:37.054161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:09.613628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054672+0000","last_change":"2023-08-10T10:41:34.907441+0000","last_active":"2023-08-10T10:41:37.054672+0000","last_peered":"2023-08-10T10:41:37.054672+0000","last_clean":"2023-08-10T10:41:37.054672+0000","last_became_active":"2023-08-10T10:41:34.906737+0000","last_became_peered":"2023-08-10T10:41:34.906737+0000","last_unstale":"2023-08-10T10:41:37.054672+0000","last_undegraded":"2023-08-10T10:41:37.054672+0000","last_fullsized":"2023-08-10T10:41:37.054672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:43.296351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057135+0000","last_change":"2023-08-10T10:41:34.898972+0000","last_active":"2023-08-10T10:41:37.057135+0000","last_peered":"2023-08-10T10:41:37.057135+0000","last_clean":"2023-08-10T10:41:37.057135+0000","last_became_active":"2023-08-10T10:41:34.896004+0000","last_became_peered":"2023-08-10T10:41:34.896004+0000","last_unstale":"2023-08-10T10:41:37.057135+0000","last_undegraded":"2023-08-10T10:41:37.057135+0000","last_fullsized":"2023-08-10T10:41:37.057135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:03.244602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884184+0000","last_change":"2023-08-10T10:41:34.921393+0000","last_active":"2023-08-10T10:41:35.884184+0000","last_peered":"2023-08-10T10:41:35.884184+0000","last_clean":"2023-08-10T10:41:35.884184+0000","last_became_active":"2023-08-10T10:41:34.920070+0000","last_became_peered":"2023-08-10T10:41:34.920070+0000","last_unstale":"2023-08-10T10:41:35.884184+0000","last_undegraded":"2023-08-10T10:41:35.884184+0000","last_fullsized":"2023-08-10T10:41:35.884184+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:05:35.896543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054246+0000","last_change":"2023-08-10T10:41:34.916903+0000","last_active":"2023-08-10T10:41:37.054246+0000","last_peered":"2023-08-10T10:41:37.054246+0000","last_clean":"2023-08-10T10:41:37.054246+0000","last_became_active":"2023-08-10T10:41:34.916170+0000","last_became_peered":"2023-08-10T10:41:34.916170+0000","last_unstale":"2023-08-10T10:41:37.054246+0000","last_undegraded":"2023-08-10T10:41:37.054246+0000","last_fullsized":"2023-08-10T10:41:37.054246+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:51.002652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057874+0000","last_change":"2023-08-10T10:41:34.911931+0000","last_active":"2023-08-10T10:41:37.057874+0000","last_peered":"2023-08-10T10:41:37.057874+0000","last_clean":"2023-08-10T10:41:37.057874+0000","last_became_active":"2023-08-10T10:41:34.911664+0000","last_became_peered":"2023-08-10T10:41:34.911664+0000","last_unstale":"2023-08-10T10:41:37.057874+0000","last_undegraded":"2023-08-10T10:41:37.057874+0000","last_fullsized":"2023-08-10T10:41:37.057874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:24.195928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056435+0000","last_change":"2023-08-10T10:41:34.899130+0000","last_active":"2023-08-10T10:41:37.056435+0000","last_peered":"2023-08-10T10:41:37.056435+0000","last_clean":"2023-08-10T10:41:37.056435+0000","last_became_active":"2023-08-10T10:41:34.897392+0000","last_became_peered":"2023-08-10T10:41:34.897392+0000","last_unstale":"2023-08-10T10:41:37.056435+0000","last_undegraded":"2023-08-10T10:41:37.056435+0000","last_fullsized":"2023-08-10T10:41:37.056435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:14.687541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885904+0000","last_change":"2023-08-10T10:41:34.916136+0000","last_active":"2023-08-10T10:41:35.885904+0000","last_peered":"2023-08-10T10:41:35.885904+0000","last_clean":"2023-08-10T10:41:35.885904+0000","last_became_active":"2023-08-10T10:41:34.915308+0000","last_became_peered":"2023-08-10T10:41:34.915308+0000","last_unstale":"2023-08-10T10:41:35.885904+0000","last_undegraded":"2023-08-10T10:41:35.885904+0000","last_fullsized":"2023-08-10T10:41:35.885904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:39:29.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051604+0000","last_change":"2023-08-10T10:41:34.907468+0000","last_active":"2023-08-10T10:41:37.051604+0000","last_peered":"2023-08-10T10:41:37.051604+0000","last_clean":"2023-08-10T10:41:37.051604+0000","last_became_active":"2023-08-10T10:41:34.906901+0000","last_became_peered":"2023-08-10T10:41:34.906901+0000","last_unstale":"2023-08-10T10:41:37.051604+0000","last_undegraded":"2023-08-10T10:41:37.051604+0000","last_fullsized":"2023-08-10T10:41:37.051604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:47.824462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"71'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884312+0000","last_change":"2023-08-10T10:41:33.905034+0000","last_active":"2023-08-10T10:41:35.884312+0000","last_peered":"2023-08-10T10:41:35.884312+0000","last_clean":"2023-08-10T10:41:35.884312+0000","last_became_active":"2023-08-10T10:41:33.904594+0000","last_became_peered":"2023-08-10T10:41:33.904594+0000","last_unstale":"2023-08-10T10:41:35.884312+0000","last_undegraded":"2023-08-10T10:41:35.884312+0000","last_fullsized":"2023-08-10T10:41:35.884312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:07.107268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055262+0000","last_change":"2023-08-10T10:41:34.912803+0000","last_active":"2023-08-10T10:41:37.055262+0000","last_peered":"2023-08-10T10:41:37.055262+0000","last_clean":"2023-08-10T10:41:37.055262+0000","last_became_active":"2023-08-10T10:41:34.912050+0000","last_became_peered":"2023-08-10T10:41:34.912050+0000","last_unstale":"2023-08-10T10:41:37.055262+0000","last_undegraded":"2023-08-10T10:41:37.055262+0000","last_fullsized":"2023-08-10T10:41:37.055262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:41.843856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885766+0000","last_change":"2023-08-10T10:41:33.905255+0000","last_active":"2023-08-10T10:41:35.885766+0000","last_peered":"2023-08-10T10:41:35.885766+0000","last_clean":"2023-08-10T10:41:35.885766+0000","last_became_active":"2023-08-10T10:41:33.904987+0000","last_became_peered":"2023-08-10T10:41:33.904987+0000","last_unstale":"2023-08-10T10:41:35.885766+0000","last_undegraded":"2023-08-10T10:41:35.885766+0000","last_fullsized":"2023-08-10T10:41:35.885766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:43:39.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886080+0000","last_change":"2023-08-10T10:41:34.919665+0000","last_active":"2023-08-10T10:41:35.886080+0000","last_peered":"2023-08-10T10:41:35.886080+0000","last_clean":"2023-08-10T10:41:35.886080+0000","last_became_active":"2023-08-10T10:41:34.918385+0000","last_became_peered":"2023-08-10T10:41:34.918385+0000","last_unstale":"2023-08-10T10:41:35.886080+0000","last_undegraded":"2023-08-10T10:41:35.886080+0000","last_fullsized":"2023-08-10T10:41:35.886080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:16.374137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886360+0000","last_change":"2023-08-10T10:41:33.899106+0000","last_active":"2023-08-10T10:41:35.886360+0000","last_peered":"2023-08-10T10:41:35.886360+0000","last_clean":"2023-08-10T10:41:35.886360+0000","last_became_active":"2023-08-10T10:41:33.898844+0000","last_became_peered":"2023-08-10T10:41:33.898844+0000","last_unstale":"2023-08-10T10:41:35.886360+0000","last_undegraded":"2023-08-10T10:41:35.886360+0000","last_fullsized":"2023-08-10T10:41:35.886360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:21.884531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054994+0000","last_change":"2023-08-10T10:41:34.918831+0000","last_active":"2023-08-10T10:41:37.054994+0000","last_peered":"2023-08-10T10:41:37.054994+0000","last_clean":"2023-08-10T10:41:37.054994+0000","last_became_active":"2023-08-10T10:41:34.918554+0000","last_became_peered":"2023-08-10T10:41:34.918554+0000","last_unstale":"2023-08-10T10:41:37.054994+0000","last_undegraded":"2023-08-10T10:41:37.054994+0000","last_fullsized":"2023-08-10T10:41:37.054994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:36:36.832539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886521+0000","last_change":"2023-08-10T10:41:33.892623+0000","last_active":"2023-08-10T10:41:35.886521+0000","last_peered":"2023-08-10T10:41:35.886521+0000","last_clean":"2023-08-10T10:41:35.886521+0000","last_became_active":"2023-08-10T10:41:33.892367+0000","last_became_peered":"2023-08-10T10:41:33.892367+0000","last_unstale":"2023-08-10T10:41:35.886521+0000","last_undegraded":"2023-08-10T10:41:35.886521+0000","last_fullsized":"2023-08-10T10:41:35.886521+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:07:51.236820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887069+0000","last_change":"2023-08-10T10:41:34.896322+0000","last_active":"2023-08-10T10:41:35.887069+0000","last_peered":"2023-08-10T10:41:35.887069+0000","last_clean":"2023-08-10T10:41:35.887069+0000","last_became_active":"2023-08-10T10:41:34.895640+0000","last_became_peered":"2023-08-10T10:41:34.895640+0000","last_unstale":"2023-08-10T10:41:35.887069+0000","last_undegraded":"2023-08-10T10:41:35.887069+0000","last_fullsized":"2023-08-10T10:41:35.887069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:34.502015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943261+0000","last_change":"2023-08-10T10:41:33.892035+0000","last_active":"2023-08-10T10:41:35.943261+0000","last_peered":"2023-08-10T10:41:35.943261+0000","last_clean":"2023-08-10T10:41:35.943261+0000","last_became_active":"2023-08-10T10:41:33.891163+0000","last_became_peered":"2023-08-10T10:41:33.891163+0000","last_unstale":"2023-08-10T10:41:35.943261+0000","last_undegraded":"2023-08-10T10:41:35.943261+0000","last_fullsized":"2023-08-10T10:41:35.943261+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:08.609282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.883913+0000","last_change":"2023-08-10T10:41:34.890727+0000","last_active":"2023-08-10T10:41:35.883913+0000","last_peered":"2023-08-10T10:41:35.883913+0000","last_clean":"2023-08-10T10:41:35.883913+0000","last_became_active":"2023-08-10T10:41:34.889859+0000","last_became_peered":"2023-08-10T10:41:34.889859+0000","last_unstale":"2023-08-10T10:41:35.883913+0000","last_undegraded":"2023-08-10T10:41:35.883913+0000","last_fullsized":"2023-08-10T10:41:35.883913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:40.191552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943073+0000","last_change":"2023-08-10T10:41:33.892517+0000","last_active":"2023-08-10T10:41:35.943073+0000","last_peered":"2023-08-10T10:41:35.943073+0000","last_clean":"2023-08-10T10:41:35.943073+0000","last_became_active":"2023-08-10T10:41:33.892169+0000","last_became_peered":"2023-08-10T10:41:33.892169+0000","last_unstale":"2023-08-10T10:41:35.943073+0000","last_undegraded":"2023-08-10T10:41:35.943073+0000","last_fullsized":"2023-08-10T10:41:35.943073+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:29.950075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051897+0000","last_change":"2023-08-10T10:41:34.914153+0000","last_active":"2023-08-10T10:41:37.051897+0000","last_peered":"2023-08-10T10:41:37.051897+0000","last_clean":"2023-08-10T10:41:37.051897+0000","last_became_active":"2023-08-10T10:41:34.913927+0000","last_became_peered":"2023-08-10T10:41:34.913927+0000","last_unstale":"2023-08-10T10:41:37.051897+0000","last_undegraded":"2023-08-10T10:41:37.051897+0000","last_fullsized":"2023-08-10T10:41:37.051897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:31.156554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942863+0000","last_change":"2023-08-10T10:41:33.903710+0000","last_active":"2023-08-10T10:41:35.942863+0000","last_peered":"2023-08-10T10:41:35.942863+0000","last_clean":"2023-08-10T10:41:35.942863+0000","last_became_active":"2023-08-10T10:41:33.903405+0000","last_became_peered":"2023-08-10T10:41:33.903405+0000","last_unstale":"2023-08-10T10:41:35.942863+0000","last_undegraded":"2023-08-10T10:41:35.942863+0000","last_fullsized":"2023-08-10T10:41:35.942863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:22.500667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943136+0000","last_change":"2023-08-10T10:41:34.911325+0000","last_active":"2023-08-10T10:41:35.943136+0000","last_peered":"2023-08-10T10:41:35.943136+0000","last_clean":"2023-08-10T10:41:35.943136+0000","last_became_active":"2023-08-10T10:41:34.907810+0000","last_became_peered":"2023-08-10T10:41:34.907810+0000","last_unstale":"2023-08-10T10:41:35.943136+0000","last_undegraded":"2023-08-10T10:41:35.943136+0000","last_fullsized":"2023-08-10T10:41:35.943136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:52.490891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053480+0000","last_change":"2023-08-10T10:41:33.904570+0000","last_active":"2023-08-10T10:41:37.053480+0000","last_peered":"2023-08-10T10:41:37.053480+0000","last_clean":"2023-08-10T10:41:37.053480+0000","last_became_active":"2023-08-10T10:41:33.904212+0000","last_became_peered":"2023-08-10T10:41:33.904212+0000","last_unstale":"2023-08-10T10:41:37.053480+0000","last_undegraded":"2023-08-10T10:41:37.053480+0000","last_fullsized":"2023-08-10T10:41:37.053480+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:38.851100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884088+0000","last_change":"2023-08-10T10:41:34.896176+0000","last_active":"2023-08-10T10:41:35.884088+0000","last_peered":"2023-08-10T10:41:35.884088+0000","last_clean":"2023-08-10T10:41:35.884088+0000","last_became_active":"2023-08-10T10:41:34.895488+0000","last_became_peered":"2023-08-10T10:41:34.895488+0000","last_unstale":"2023-08-10T10:41:35.884088+0000","last_undegraded":"2023-08-10T10:41:35.884088+0000","last_fullsized":"2023-08-10T10:41:35.884088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:16.891214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052719+0000","last_change":"2023-08-10T10:41:33.903148+0000","last_active":"2023-08-10T10:41:37.052719+0000","last_peered":"2023-08-10T10:41:37.052719+0000","last_clean":"2023-08-10T10:41:37.052719+0000","last_became_active":"2023-08-10T10:41:33.902355+0000","last_became_peered":"2023-08-10T10:41:33.902355+0000","last_unstale":"2023-08-10T10:41:37.052719+0000","last_undegraded":"2023-08-10T10:41:37.052719+0000","last_fullsized":"2023-08-10T10:41:37.052719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:57.844582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.942920+0000","last_change":"2023-08-10T10:41:34.911000+0000","last_active":"2023-08-10T10:41:35.942920+0000","last_peered":"2023-08-10T10:41:35.942920+0000","last_clean":"2023-08-10T10:41:35.942920+0000","last_became_active":"2023-08-10T10:41:34.909370+0000","last_became_peered":"2023-08-10T10:41:34.909370+0000","last_unstale":"2023-08-10T10:41:35.942920+0000","last_undegraded":"2023-08-10T10:41:35.942920+0000","last_fullsized":"2023-08-10T10:41:35.942920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:14.817924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057495+0000","last_change":"2023-08-10T10:41:33.901686+0000","last_active":"2023-08-10T10:41:37.057495+0000","last_peered":"2023-08-10T10:41:37.057495+0000","last_clean":"2023-08-10T10:41:37.057495+0000","last_became_active":"2023-08-10T10:41:33.901113+0000","last_became_peered":"2023-08-10T10:41:33.901113+0000","last_unstale":"2023-08-10T10:41:37.057495+0000","last_undegraded":"2023-08-10T10:41:37.057495+0000","last_fullsized":"2023-08-10T10:41:37.057495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:22:02.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051418+0000","last_change":"2023-08-10T10:41:34.908522+0000","last_active":"2023-08-10T10:41:37.051418+0000","last_peered":"2023-08-10T10:41:37.051418+0000","last_clean":"2023-08-10T10:41:37.051418+0000","last_became_active":"2023-08-10T10:41:34.908233+0000","last_became_peered":"2023-08-10T10:41:34.908233+0000","last_unstale":"2023-08-10T10:41:37.051418+0000","last_undegraded":"2023-08-10T10:41:37.051418+0000","last_fullsized":"2023-08-10T10:41:37.051418+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:42.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"71'3","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055828+0000","last_change":"2023-08-10T10:41:33.906125+0000","last_active":"2023-08-10T10:41:37.055828+0000","last_peered":"2023-08-10T10:41:37.055828+0000","last_clean":"2023-08-10T10:41:37.055828+0000","last_became_active":"2023-08-10T10:41:33.905698+0000","last_became_peered":"2023-08-10T10:41:33.905698+0000","last_unstale":"2023-08-10T10:41:37.055828+0000","last_undegraded":"2023-08-10T10:41:37.055828+0000","last_fullsized":"2023-08-10T10:41:37.055828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:33.669834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056773+0000","last_change":"2023-08-10T10:41:34.899507+0000","last_active":"2023-08-10T10:41:37.056773+0000","last_peered":"2023-08-10T10:41:37.056773+0000","last_clean":"2023-08-10T10:41:37.056773+0000","last_became_active":"2023-08-10T10:41:34.898363+0000","last_became_peered":"2023-08-10T10:41:34.898363+0000","last_unstale":"2023-08-10T10:41:37.056773+0000","last_undegraded":"2023-08-10T10:41:37.056773+0000","last_fullsized":"2023-08-10T10:41:37.056773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:39.855446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"71'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884296+0000","last_change":"2023-08-10T10:41:33.888886+0000","last_active":"2023-08-10T10:41:35.884296+0000","last_peered":"2023-08-10T10:41:35.884296+0000","last_clean":"2023-08-10T10:41:35.884296+0000","last_became_active":"2023-08-10T10:41:33.885954+0000","last_became_peered":"2023-08-10T10:41:33.885954+0000","last_unstale":"2023-08-10T10:41:35.884296+0000","last_undegraded":"2023-08-10T10:41:35.884296+0000","last_fullsized":"2023-08-10T10:41:35.884296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:13:50.689644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053936+0000","last_change":"2023-08-10T10:41:34.912362+0000","last_active":"2023-08-10T10:41:37.053936+0000","last_peered":"2023-08-10T10:41:37.053936+0000","last_clean":"2023-08-10T10:41:37.053936+0000","last_became_active":"2023-08-10T10:41:34.911784+0000","last_became_peered":"2023-08-10T10:41:34.911784+0000","last_unstale":"2023-08-10T10:41:37.053936+0000","last_undegraded":"2023-08-10T10:41:37.053936+0000","last_fullsized":"2023-08-10T10:41:37.053936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:08.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054508+0000","last_change":"2023-08-10T10:41:33.906215+0000","last_active":"2023-08-10T10:41:37.054508+0000","last_peered":"2023-08-10T10:41:37.054508+0000","last_clean":"2023-08-10T10:41:37.054508+0000","last_became_active":"2023-08-10T10:41:33.905409+0000","last_became_peered":"2023-08-10T10:41:33.905409+0000","last_unstale":"2023-08-10T10:41:37.054508+0000","last_undegraded":"2023-08-10T10:41:37.054508+0000","last_fullsized":"2023-08-10T10:41:37.054508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:19.749067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.057990+0000","last_change":"2023-08-10T10:41:34.914287+0000","last_active":"2023-08-10T10:41:37.057990+0000","last_peered":"2023-08-10T10:41:37.057990+0000","last_clean":"2023-08-10T10:41:37.057990+0000","last_became_active":"2023-08-10T10:41:34.913975+0000","last_became_peered":"2023-08-10T10:41:34.913975+0000","last_unstale":"2023-08-10T10:41:37.057990+0000","last_undegraded":"2023-08-10T10:41:37.057990+0000","last_fullsized":"2023-08-10T10:41:37.057990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:54.933815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055051+0000","last_change":"2023-08-10T10:41:33.892134+0000","last_active":"2023-08-10T10:41:37.055051+0000","last_peered":"2023-08-10T10:41:37.055051+0000","last_clean":"2023-08-10T10:41:37.055051+0000","last_became_active":"2023-08-10T10:41:33.891435+0000","last_became_peered":"2023-08-10T10:41:33.891435+0000","last_unstale":"2023-08-10T10:41:37.055051+0000","last_undegraded":"2023-08-10T10:41:37.055051+0000","last_fullsized":"2023-08-10T10:41:37.055051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:29.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051994+0000","last_change":"2023-08-10T10:41:34.907156+0000","last_active":"2023-08-10T10:41:37.051994+0000","last_peered":"2023-08-10T10:41:37.051994+0000","last_clean":"2023-08-10T10:41:37.051994+0000","last_became_active":"2023-08-10T10:41:34.906052+0000","last_became_peered":"2023-08-10T10:41:34.906052+0000","last_unstale":"2023-08-10T10:41:37.051994+0000","last_undegraded":"2023-08-10T10:41:37.051994+0000","last_fullsized":"2023-08-10T10:41:37.051994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:49.446792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056704+0000","last_change":"2023-08-10T10:41:33.900575+0000","last_active":"2023-08-10T10:41:37.056704+0000","last_peered":"2023-08-10T10:41:37.056704+0000","last_clean":"2023-08-10T10:41:37.056704+0000","last_became_active":"2023-08-10T10:41:33.900205+0000","last_became_peered":"2023-08-10T10:41:33.900205+0000","last_unstale":"2023-08-10T10:41:37.056704+0000","last_undegraded":"2023-08-10T10:41:37.056704+0000","last_fullsized":"2023-08-10T10:41:37.056704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:25.238672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884415+0000","last_change":"2023-08-10T10:41:34.914198+0000","last_active":"2023-08-10T10:41:35.884415+0000","last_peered":"2023-08-10T10:41:35.884415+0000","last_clean":"2023-08-10T10:41:35.884415+0000","last_became_active":"2023-08-10T10:41:34.912515+0000","last_became_peered":"2023-08-10T10:41:34.912515+0000","last_unstale":"2023-08-10T10:41:35.884415+0000","last_undegraded":"2023-08-10T10:41:35.884415+0000","last_fullsized":"2023-08-10T10:41:35.884415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:56:14.817924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"71'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054464+0000","last_change":"2023-08-10T10:41:33.905124+0000","last_active":"2023-08-10T10:41:37.054464+0000","last_peered":"2023-08-10T10:41:37.054464+0000","last_clean":"2023-08-10T10:41:37.054464+0000","last_became_active":"2023-08-10T10:41:33.904838+0000","last_became_peered":"2023-08-10T10:41:33.904838+0000","last_unstale":"2023-08-10T10:41:37.054464+0000","last_undegraded":"2023-08-10T10:41:37.054464+0000","last_fullsized":"2023-08-10T10:41:37.054464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:48.442446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886222+0000","last_change":"2023-08-10T10:41:34.911038+0000","last_active":"2023-08-10T10:41:35.886222+0000","last_peered":"2023-08-10T10:41:35.886222+0000","last_clean":"2023-08-10T10:41:35.886222+0000","last_became_active":"2023-08-10T10:41:34.910390+0000","last_became_peered":"2023-08-10T10:41:34.910390+0000","last_unstale":"2023-08-10T10:41:35.886222+0000","last_undegraded":"2023-08-10T10:41:35.886222+0000","last_fullsized":"2023-08-10T10:41:35.886222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:27.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058139+0000","last_change":"2023-08-10T10:41:33.902170+0000","last_active":"2023-08-10T10:41:37.058139+0000","last_peered":"2023-08-10T10:41:37.058139+0000","last_clean":"2023-08-10T10:41:37.058139+0000","last_became_active":"2023-08-10T10:41:33.901542+0000","last_became_peered":"2023-08-10T10:41:33.901542+0000","last_unstale":"2023-08-10T10:41:37.058139+0000","last_undegraded":"2023-08-10T10:41:37.058139+0000","last_fullsized":"2023-08-10T10:41:37.058139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:23:04.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885995+0000","last_change":"2023-08-10T10:41:34.916448+0000","last_active":"2023-08-10T10:41:35.885995+0000","last_peered":"2023-08-10T10:41:35.885995+0000","last_clean":"2023-08-10T10:41:35.885995+0000","last_became_active":"2023-08-10T10:41:34.916088+0000","last_became_peered":"2023-08-10T10:41:34.916088+0000","last_unstale":"2023-08-10T10:41:35.885995+0000","last_undegraded":"2023-08-10T10:41:35.885995+0000","last_fullsized":"2023-08-10T10:41:35.885995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:58.402468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058700+0000","last_change":"2023-08-10T10:41:33.901459+0000","last_active":"2023-08-10T10:41:37.058700+0000","last_peered":"2023-08-10T10:41:37.058700+0000","last_clean":"2023-08-10T10:41:37.058700+0000","last_became_active":"2023-08-10T10:41:33.901193+0000","last_became_peered":"2023-08-10T10:41:33.901193+0000","last_unstale":"2023-08-10T10:41:37.058700+0000","last_undegraded":"2023-08-10T10:41:37.058700+0000","last_fullsized":"2023-08-10T10:41:37.058700+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:43.412684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058523+0000","last_change":"2023-08-10T10:41:34.915562+0000","last_active":"2023-08-10T10:41:37.058523+0000","last_peered":"2023-08-10T10:41:37.058523+0000","last_clean":"2023-08-10T10:41:37.058523+0000","last_became_active":"2023-08-10T10:41:34.915279+0000","last_became_peered":"2023-08-10T10:41:34.915279+0000","last_unstale":"2023-08-10T10:41:37.058523+0000","last_undegraded":"2023-08-10T10:41:37.058523+0000","last_fullsized":"2023-08-10T10:41:37.058523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:31:10.827776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.885904+0000","last_change":"2023-08-10T10:41:33.895907+0000","last_active":"2023-08-10T10:41:35.885904+0000","last_peered":"2023-08-10T10:41:35.885904+0000","last_clean":"2023-08-10T10:41:35.885904+0000","last_became_active":"2023-08-10T10:41:33.895646+0000","last_became_peered":"2023-08-10T10:41:33.895646+0000","last_unstale":"2023-08-10T10:41:35.885904+0000","last_undegraded":"2023-08-10T10:41:35.885904+0000","last_fullsized":"2023-08-10T10:41:35.885904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:27:17.550826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.051821+0000","last_change":"2023-08-10T10:41:34.913681+0000","last_active":"2023-08-10T10:41:37.051821+0000","last_peered":"2023-08-10T10:41:37.051821+0000","last_clean":"2023-08-10T10:41:37.051821+0000","last_became_active":"2023-08-10T10:41:34.913421+0000","last_became_peered":"2023-08-10T10:41:34.913421+0000","last_unstale":"2023-08-10T10:41:37.051821+0000","last_undegraded":"2023-08-10T10:41:37.051821+0000","last_fullsized":"2023-08-10T10:41:37.051821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:08.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884532+0000","last_change":"2023-08-10T10:41:33.888381+0000","last_active":"2023-08-10T10:41:35.884532+0000","last_peered":"2023-08-10T10:41:35.884532+0000","last_clean":"2023-08-10T10:41:35.884532+0000","last_became_active":"2023-08-10T10:41:33.886456+0000","last_became_peered":"2023-08-10T10:41:33.886456+0000","last_unstale":"2023-08-10T10:41:35.884532+0000","last_undegraded":"2023-08-10T10:41:35.884532+0000","last_fullsized":"2023-08-10T10:41:35.884532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:51.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052683+0000","last_change":"2023-08-10T10:41:34.920865+0000","last_active":"2023-08-10T10:41:37.052683+0000","last_peered":"2023-08-10T10:41:37.052683+0000","last_clean":"2023-08-10T10:41:37.052683+0000","last_became_active":"2023-08-10T10:41:34.920577+0000","last_became_peered":"2023-08-10T10:41:34.920577+0000","last_unstale":"2023-08-10T10:41:37.052683+0000","last_undegraded":"2023-08-10T10:41:37.052683+0000","last_fullsized":"2023-08-10T10:41:37.052683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:14.687541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053329+0000","last_change":"2023-08-10T10:41:33.902985+0000","last_active":"2023-08-10T10:41:37.053329+0000","last_peered":"2023-08-10T10:41:37.053329+0000","last_clean":"2023-08-10T10:41:37.053329+0000","last_became_active":"2023-08-10T10:41:33.901977+0000","last_became_peered":"2023-08-10T10:41:33.901977+0000","last_unstale":"2023-08-10T10:41:37.053329+0000","last_undegraded":"2023-08-10T10:41:37.053329+0000","last_fullsized":"2023-08-10T10:41:37.053329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:07.265289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054245+0000","last_change":"2023-08-10T10:41:34.912065+0000","last_active":"2023-08-10T10:41:37.054245+0000","last_peered":"2023-08-10T10:41:37.054245+0000","last_clean":"2023-08-10T10:41:37.054245+0000","last_became_active":"2023-08-10T10:41:34.911376+0000","last_became_peered":"2023-08-10T10:41:34.911376+0000","last_unstale":"2023-08-10T10:41:37.054245+0000","last_undegraded":"2023-08-10T10:41:37.054245+0000","last_fullsized":"2023-08-10T10:41:37.054245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:31.156554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943655+0000","last_change":"2023-08-10T10:41:33.892323+0000","last_active":"2023-08-10T10:41:35.943655+0000","last_peered":"2023-08-10T10:41:35.943655+0000","last_clean":"2023-08-10T10:41:35.943655+0000","last_became_active":"2023-08-10T10:41:33.891687+0000","last_became_peered":"2023-08-10T10:41:33.891687+0000","last_unstale":"2023-08-10T10:41:35.943655+0000","last_undegraded":"2023-08-10T10:41:35.943655+0000","last_fullsized":"2023-08-10T10:41:35.943655+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:29.211716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884167+0000","last_change":"2023-08-10T10:41:34.892970+0000","last_active":"2023-08-10T10:41:35.884167+0000","last_peered":"2023-08-10T10:41:35.884167+0000","last_clean":"2023-08-10T10:41:35.884167+0000","last_became_active":"2023-08-10T10:41:34.891951+0000","last_became_peered":"2023-08-10T10:41:34.891951+0000","last_unstale":"2023-08-10T10:41:35.884167+0000","last_undegraded":"2023-08-10T10:41:35.884167+0000","last_fullsized":"2023-08-10T10:41:35.884167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:10.448615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943213+0000","last_change":"2023-08-10T10:41:33.904054+0000","last_active":"2023-08-10T10:41:35.943213+0000","last_peered":"2023-08-10T10:41:35.943213+0000","last_clean":"2023-08-10T10:41:35.943213+0000","last_became_active":"2023-08-10T10:41:33.903572+0000","last_became_peered":"2023-08-10T10:41:33.903572+0000","last_unstale":"2023-08-10T10:41:35.943213+0000","last_undegraded":"2023-08-10T10:41:35.943213+0000","last_fullsized":"2023-08-10T10:41:35.943213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:42:03.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.887224+0000","last_change":"2023-08-10T10:41:34.915232+0000","last_active":"2023-08-10T10:41:35.887224+0000","last_peered":"2023-08-10T10:41:35.887224+0000","last_clean":"2023-08-10T10:41:35.887224+0000","last_became_active":"2023-08-10T10:41:34.912081+0000","last_became_peered":"2023-08-10T10:41:34.912081+0000","last_unstale":"2023-08-10T10:41:35.887224+0000","last_undegraded":"2023-08-10T10:41:35.887224+0000","last_fullsized":"2023-08-10T10:41:35.887224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:39:36.332514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884468+0000","last_change":"2023-08-10T10:41:33.903004+0000","last_active":"2023-08-10T10:41:35.884468+0000","last_peered":"2023-08-10T10:41:35.884468+0000","last_clean":"2023-08-10T10:41:35.884468+0000","last_became_active":"2023-08-10T10:41:33.902743+0000","last_became_peered":"2023-08-10T10:41:33.902743+0000","last_unstale":"2023-08-10T10:41:35.884468+0000","last_undegraded":"2023-08-10T10:41:35.884468+0000","last_fullsized":"2023-08-10T10:41:35.884468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:45.893411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052228+0000","last_change":"2023-08-10T10:41:34.910472+0000","last_active":"2023-08-10T10:41:37.052228+0000","last_peered":"2023-08-10T10:41:37.052228+0000","last_clean":"2023-08-10T10:41:37.052228+0000","last_became_active":"2023-08-10T10:41:34.910215+0000","last_became_peered":"2023-08-10T10:41:34.910215+0000","last_unstale":"2023-08-10T10:41:37.052228+0000","last_undegraded":"2023-08-10T10:41:37.052228+0000","last_fullsized":"2023-08-10T10:41:37.052228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:27.707842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943340+0000","last_change":"2023-08-10T10:41:33.893819+0000","last_active":"2023-08-10T10:41:35.943340+0000","last_peered":"2023-08-10T10:41:35.943340+0000","last_clean":"2023-08-10T10:41:35.943340+0000","last_became_active":"2023-08-10T10:41:33.893445+0000","last_became_peered":"2023-08-10T10:41:33.893445+0000","last_unstale":"2023-08-10T10:41:35.943340+0000","last_undegraded":"2023-08-10T10:41:35.943340+0000","last_fullsized":"2023-08-10T10:41:35.943340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:10.232535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":260,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054767+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:41:37.054767+0000","last_peered":"2023-08-10T10:41:37.054767+0000","last_clean":"2023-08-10T10:41:37.054767+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:41:37.054767+0000","last_undegraded":"2023-08-10T10:41:37.054767+0000","last_fullsized":"2023-08-10T10:41:37.054767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:30.588083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055331+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:41:37.055331+0000","last_peered":"2023-08-10T10:41:37.055331+0000","last_clean":"2023-08-10T10:41:37.055331+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:41:37.055331+0000","last_undegraded":"2023-08-10T10:41:37.055331+0000","last_fullsized":"2023-08-10T10:41:37.055331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:30.252155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886298+0000","last_change":"2023-08-10T10:41:34.919681+0000","last_active":"2023-08-10T10:41:35.886298+0000","last_peered":"2023-08-10T10:41:35.886298+0000","last_clean":"2023-08-10T10:41:35.886298+0000","last_became_active":"2023-08-10T10:41:34.919354+0000","last_became_peered":"2023-08-10T10:41:34.919354+0000","last_unstale":"2023-08-10T10:41:35.886298+0000","last_undegraded":"2023-08-10T10:41:35.886298+0000","last_fullsized":"2023-08-10T10:41:35.886298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:05:12.720569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886691+0000","last_change":"2023-08-10T10:41:33.903026+0000","last_active":"2023-08-10T10:41:35.886691+0000","last_peered":"2023-08-10T10:41:35.886691+0000","last_clean":"2023-08-10T10:41:35.886691+0000","last_became_active":"2023-08-10T10:41:33.902762+0000","last_became_peered":"2023-08-10T10:41:33.902762+0000","last_unstale":"2023-08-10T10:41:35.886691+0000","last_undegraded":"2023-08-10T10:41:35.886691+0000","last_fullsized":"2023-08-10T10:41:35.886691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:46:12.300985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.054450+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:41:37.054450+0000","last_peered":"2023-08-10T10:41:37.054450+0000","last_clean":"2023-08-10T10:41:37.054450+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:41:37.054450+0000","last_undegraded":"2023-08-10T10:41:37.054450+0000","last_fullsized":"2023-08-10T10:41:37.054450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:52:56.472123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058234+0000","last_change":"2023-08-10T10:41:34.908705+0000","last_active":"2023-08-10T10:41:37.058234+0000","last_peered":"2023-08-10T10:41:37.058234+0000","last_clean":"2023-08-10T10:41:37.058234+0000","last_became_active":"2023-08-10T10:41:34.908278+0000","last_became_peered":"2023-08-10T10:41:34.908278+0000","last_unstale":"2023-08-10T10:41:37.058234+0000","last_undegraded":"2023-08-10T10:41:37.058234+0000","last_fullsized":"2023-08-10T10:41:37.058234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:21.373989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053791+0000","last_change":"2023-08-10T10:41:33.898136+0000","last_active":"2023-08-10T10:41:37.053791+0000","last_peered":"2023-08-10T10:41:37.053791+0000","last_clean":"2023-08-10T10:41:37.053791+0000","last_became_active":"2023-08-10T10:41:33.897625+0000","last_became_peered":"2023-08-10T10:41:33.897625+0000","last_unstale":"2023-08-10T10:41:37.053791+0000","last_undegraded":"2023-08-10T10:41:37.053791+0000","last_fullsized":"2023-08-10T10:41:37.053791+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:42:03.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886298+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:41:35.886298+0000","last_peered":"2023-08-10T10:41:35.886298+0000","last_clean":"2023-08-10T10:41:35.886298+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:41:35.886298+0000","last_undegraded":"2023-08-10T10:41:35.886298+0000","last_fullsized":"2023-08-10T10:41:35.886298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:25.269365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052277+0000","last_change":"2023-08-10T10:41:34.921281+0000","last_active":"2023-08-10T10:41:37.052277+0000","last_peered":"2023-08-10T10:41:37.052277+0000","last_clean":"2023-08-10T10:41:37.052277+0000","last_became_active":"2023-08-10T10:41:34.921118+0000","last_became_peered":"2023-08-10T10:41:34.921118+0000","last_unstale":"2023-08-10T10:41:37.052277+0000","last_undegraded":"2023-08-10T10:41:37.052277+0000","last_fullsized":"2023-08-10T10:41:37.052277+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:46:00.565168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.886546+0000","last_change":"2023-08-10T10:41:33.905249+0000","last_active":"2023-08-10T10:41:35.886546+0000","last_peered":"2023-08-10T10:41:35.886546+0000","last_clean":"2023-08-10T10:41:35.886546+0000","last_became_active":"2023-08-10T10:41:33.904933+0000","last_became_peered":"2023-08-10T10:41:33.904933+0000","last_unstale":"2023-08-10T10:41:35.886546+0000","last_undegraded":"2023-08-10T10:41:35.886546+0000","last_fullsized":"2023-08-10T10:41:35.886546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:48:10.139773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.058325+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:41:37.058325+0000","last_peered":"2023-08-10T10:41:37.058325+0000","last_clean":"2023-08-10T10:41:37.058325+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:41:37.058325+0000","last_undegraded":"2023-08-10T10:41:37.058325+0000","last_fullsized":"2023-08-10T10:41:37.058325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:32.682893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.056269+0000","last_change":"2023-08-10T10:41:34.910711+0000","last_active":"2023-08-10T10:41:37.056269+0000","last_peered":"2023-08-10T10:41:37.056269+0000","last_clean":"2023-08-10T10:41:37.056269+0000","last_became_active":"2023-08-10T10:41:34.910415+0000","last_became_peered":"2023-08-10T10:41:34.910415+0000","last_unstale":"2023-08-10T10:41:37.056269+0000","last_undegraded":"2023-08-10T10:41:37.056269+0000","last_fullsized":"2023-08-10T10:41:37.056269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:03.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053395+0000","last_change":"2023-08-10T10:41:33.897954+0000","last_active":"2023-08-10T10:41:37.053395+0000","last_peered":"2023-08-10T10:41:37.053395+0000","last_clean":"2023-08-10T10:41:37.053395+0000","last_became_active":"2023-08-10T10:41:33.897232+0000","last_became_peered":"2023-08-10T10:41:33.897232+0000","last_unstale":"2023-08-10T10:41:37.053395+0000","last_undegraded":"2023-08-10T10:41:37.053395+0000","last_fullsized":"2023-08-10T10:41:37.053395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:51.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884788+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:41:35.884788+0000","last_peered":"2023-08-10T10:41:35.884788+0000","last_clean":"2023-08-10T10:41:35.884788+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:41:35.884788+0000","last_undegraded":"2023-08-10T10:41:35.884788+0000","last_fullsized":"2023-08-10T10:41:35.884788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:49.846206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052360+0000","last_change":"2023-08-10T10:41:34.907311+0000","last_active":"2023-08-10T10:41:37.052360+0000","last_peered":"2023-08-10T10:41:37.052360+0000","last_clean":"2023-08-10T10:41:37.052360+0000","last_became_active":"2023-08-10T10:41:34.906476+0000","last_became_peered":"2023-08-10T10:41:34.906476+0000","last_unstale":"2023-08-10T10:41:37.052360+0000","last_undegraded":"2023-08-10T10:41:37.052360+0000","last_fullsized":"2023-08-10T10:41:37.052360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:21.618571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"71'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055137+0000","last_change":"2023-08-10T10:41:33.906376+0000","last_active":"2023-08-10T10:41:37.055137+0000","last_peered":"2023-08-10T10:41:37.055137+0000","last_clean":"2023-08-10T10:41:37.055137+0000","last_became_active":"2023-08-10T10:41:33.905838+0000","last_became_peered":"2023-08-10T10:41:33.905838+0000","last_unstale":"2023-08-10T10:41:37.055137+0000","last_undegraded":"2023-08-10T10:41:37.055137+0000","last_fullsized":"2023-08-10T10:41:37.055137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:21.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053859+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:41:37.053859+0000","last_peered":"2023-08-10T10:41:37.053859+0000","last_clean":"2023-08-10T10:41:37.053859+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:41:37.053859+0000","last_undegraded":"2023-08-10T10:41:37.053859+0000","last_fullsized":"2023-08-10T10:41:37.053859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:07.452877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.055578+0000","last_change":"2023-08-10T10:41:34.912497+0000","last_active":"2023-08-10T10:41:37.055578+0000","last_peered":"2023-08-10T10:41:37.055578+0000","last_clean":"2023-08-10T10:41:37.055578+0000","last_became_active":"2023-08-10T10:41:34.911663+0000","last_became_peered":"2023-08-10T10:41:34.911663+0000","last_unstale":"2023-08-10T10:41:37.055578+0000","last_undegraded":"2023-08-10T10:41:37.055578+0000","last_fullsized":"2023-08-10T10:41:37.055578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:27.707842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"71'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.053042+0000","last_change":"2023-08-10T10:41:33.903302+0000","last_active":"2023-08-10T10:41:37.053042+0000","last_peered":"2023-08-10T10:41:37.053042+0000","last_clean":"2023-08-10T10:41:37.053042+0000","last_became_active":"2023-08-10T10:41:33.902706+0000","last_became_peered":"2023-08-10T10:41:33.902706+0000","last_unstale":"2023-08-10T10:41:37.053042+0000","last_undegraded":"2023-08-10T10:41:37.053042+0000","last_fullsized":"2023-08-10T10:41:37.053042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:28.642861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.884535+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:41:35.884535+0000","last_peered":"2023-08-10T10:41:35.884535+0000","last_clean":"2023-08-10T10:41:35.884535+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:41:35.884535+0000","last_undegraded":"2023-08-10T10:41:35.884535+0000","last_fullsized":"2023-08-10T10:41:35.884535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:38:45.229258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.050900+0000","last_change":"2023-08-10T10:41:34.917622+0000","last_active":"2023-08-10T10:41:37.050900+0000","last_peered":"2023-08-10T10:41:37.050900+0000","last_clean":"2023-08-10T10:41:37.050900+0000","last_became_active":"2023-08-10T10:41:34.917440+0000","last_became_peered":"2023-08-10T10:41:34.917440+0000","last_unstale":"2023-08-10T10:41:37.050900+0000","last_undegraded":"2023-08-10T10:41:37.050900+0000","last_fullsized":"2023-08-10T10:41:37.050900+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:33.869631+0000","last_clean_scrub_stamp":"2023-08-10T10:41:33.869631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:28.226061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:35.943423+0000","last_change":"2023-08-10T10:41:33.898907+0000","last_active":"2023-08-10T10:41:35.943423+0000","last_peered":"2023-08-10T10:41:35.943423+0000","last_clean":"2023-08-10T10:41:35.943423+0000","last_became_active":"2023-08-10T10:41:33.898250+0000","last_became_peered":"2023-08-10T10:41:33.898250+0000","last_unstale":"2023-08-10T10:41:35.943423+0000","last_undegraded":"2023-08-10T10:41:35.943423+0000","last_fullsized":"2023-08-10T10:41:35.943423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:41:32.865285+0000","last_clean_scrub_stamp":"2023-08-10T10:41:32.865285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:42.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-08-10T10:41:37.052033+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:41:37.052033+0000","last_peered":"2023-08-10T10:41:37.052033+0000","last_clean":"2023-08-10T10:41:37.052033+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:41:37.052033+0000","last_undegraded":"2023-08-10T10:41:37.052033+0000","last_fullsized":"2023-08-10T10:41:37.052033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:22.076435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194349,"statfs":{"total":200000000,"available":199014193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.119,"15min":1.139},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.548,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.115,"15min":1.0600000000000001},"min":{"1min":0.86099999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":5.149,"5min":5.149,"15min":5.149},"last":1.337}]},{"osd":1,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1200000000000001,"15min":1.129},"min":{"1min":0.76600000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7370000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1419999999999999,"15min":1.129},"min":{"1min":0.80300000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5660000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.96999999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.258,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":5.2709999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.242,"15min":1.248},"min":{"1min":0.95899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7589999999999999,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.214},"min":{"1min":0.81499999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.351,"15min":1.3879999999999999},"min":{"1min":0.98499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.9610000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.117}]},{"osd":4,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2090000000000001,"15min":1.2270000000000001},"min":{"1min":0.82999999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6739999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.3140000000000001,"15min":1.2809999999999999},"min":{"1min":0.93999999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":6.657,"5min":6.657,"15min":6.657},"last":1.274}]},{"osd":5,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.4339999999999999,"15min":1.4419999999999999},"min":{"1min":0.95399999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.5169999999999999,"15min":1.5029999999999999},"min":{"1min":1.111,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.385}]},{"osd":6,"last update":"Thu Aug 10 10:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.5629999999999999,"15min":1.599},"min":{"1min":1.1519999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.401},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.4950000000000001,"15min":1.5129999999999999},"min":{"1min":1.03,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":1.2330000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.554,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.125,"5min":0.98999999999999999,"15min":0.96199999999999997},"min":{"1min":0.79800000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.72499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.157,"15min":1.1539999999999999},"min":{"1min":0.92400000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.579,"5min":1.96,"15min":1.96},"last":1.3959999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1100000000000001},"min":{"1min":0.91600000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.383,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.321},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2270000000000001,"15min":1.2090000000000001},"min":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5920000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.7929999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1859999999999999,"15min":1.171},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.484,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.25,"15min":1.236},"min":{"1min":0.88,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.476}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2310000000000001,"15min":1.1870000000000001},"min":{"1min":0.92300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6799999999999999,"5min":2.04,"15min":2.04},"last":2.137},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4079999999999999,"15min":1.3879999999999999},"min":{"1min":1.135,"5min":0.622,"15min":0.622},"max":{"1min":1.7330000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.4279999999999999,"15min":1.3819999999999999},"min":{"1min":1.3380000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.958,"5min":2.028,"15min":2.028},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.502,"5min":1.4690000000000001,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8899999999999999,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.982}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.359,"15min":1.345},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9330000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.611},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.486,"15min":1.456},"min":{"1min":1.05,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9079999999999999,"5min":2.698,"15min":2.698},"last":2.536}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":384,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606334,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.117,"15min":1.0720000000000001},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6879999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":2.532,"5min":1.363,"15min":1.181},"min":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":32.941000000000003,"5min":32.941000000000003,"15min":32.941000000000003},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2050000000000001,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5920000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.653,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.24}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.579,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.387},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1639999999999999,"15min":1.139},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6299999999999999,"5min":1.73,"15min":1.73},"last":1.196}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2270000000000001,"15min":1.244},"min":{"1min":0.83999999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.47,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6100000000000001,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3069999999999999,"15min":1.3129999999999999},"min":{"1min":0.82899999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7330000000000001,"5min":2.399,"15min":2.399},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3460000000000001,"15min":1.3540000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6519999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3129999999999999,"15min":1.2929999999999999},"min":{"1min":0.78200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.583,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.536},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4079999999999999,"15min":1.379},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.9650000000000001,"5min":1.98,"15min":1.98},"last":1.351}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4730000000000001,"15min":1.4850000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.4810000000000001},"min":{"1min":1.0669999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7250000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.45}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.67500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.512,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.167,"15min":1.1890000000000001},"min":{"1min":0.77400000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.667,"15min":1.667},"last":1.071}]},{"osd":1,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2390000000000001,"15min":1.292},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.276},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.135},"min":{"1min":0.67900000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.601,"5min":1.677,"15min":1.677},"last":1.1439999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.1080000000000001,"15min":1.1259999999999999},"min":{"1min":0.66000000000000003,"5min":0.621,"15min":0.621},"max":{"1min":1.6519999999999999,"5min":2.004,"15min":2.004},"last":1.216},{"interface":"front","average":{"1min":1.173,"5min":1.248,"15min":1.278},"min":{"1min":0.85499999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":1.893,"15min":1.893},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2210000000000001,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7250000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.238,"15min":1.252},"min":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6830000000000001,"5min":1.863,"15min":1.863},"last":1.6930000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.345,"15min":1.355},"min":{"1min":1.038,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.923,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.593},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.28,"15min":1.282},"min":{"1min":0.82299999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.661,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.405}]},{"osd":6,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3,"15min":1.3120000000000001},"min":{"1min":0.89800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.706,"5min":2,"15min":2},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.444,"15min":1.45},"min":{"1min":1.2250000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.827,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.506}]},{"osd":7,"last update":"Thu Aug 10 10:41:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.093,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7350000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.476,"15min":1.4870000000000001},"min":{"1min":1.21,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.788,"5min":1.877,"15min":1.877},"last":1.5580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.85099999999999998,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.8140000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96099999999999997,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.768,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":2.4470000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81999999999999995,"15min":0.78600000000000003},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.377,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.51100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.444,"5min":1.897,"15min":1.897},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.89400000000000002},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.8720000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.125,"5min":1.0700000000000001,"15min":1.014},"min":{"1min":0.69999999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8879999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.115}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2290000000000001,"15min":1.181},"min":{"1min":0.78200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.655,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.202},{"interface":"front","average":{"1min":1.232,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":0.80900000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.579,"5min":1.948,"15min":1.948},"last":1.036}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3149999999999999,"15min":1.2869999999999999},"min":{"1min":0.94799999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.681,"5min":2.125,"15min":2.125},"last":1.389},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3480000000000001,"15min":1.3280000000000001},"min":{"1min":0.82699999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2589999999999999,"15min":1.224},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6890000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.089},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.401,"15min":1.367},"min":{"1min":0.95199999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7529999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.171}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4079999999999999,"15min":1.397},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.726,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.052},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.331,"15min":1.2969999999999999},"min":{"1min":0.88100000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.829,"5min":2.306,"15min":2.306},"last":1.2430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194927,"statfs":{"total":200000000,"available":199605337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85499999999999998,"15min":0.86899999999999999},"min":{"1min":0.53500000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.135,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.5369999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5129999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.079,"15min":1.0760000000000001},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.115}]},{"osd":3,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4359999999999999,"5min":1.639,"15min":1.639},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.202,"15min":1.2509999999999999},"min":{"1min":0.626,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5860000000000001,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.391,"15min":1.4199999999999999},"min":{"1min":0.92400000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.865,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.28,"15min":1.284},"min":{"1min":0.95799999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0779999999999998,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.252},"min":{"1min":0.85399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6899999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.4450000000000001,"15min":1.4690000000000001},"min":{"1min":0.93899999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.944,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.353}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":0.93100000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1859999999999999,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.319,"15min":1.327},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8260000000000001,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.321}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.377,"15min":1.363},"min":{"1min":0.90800000000000003,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.397,"15min":1.3999999999999999},"min":{"1min":0.96899999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6990000000000001,"5min":2.444,"15min":2.444},"last":1.506}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194924,"statfs":{"total":200000000,"available":199603009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3979999999999999,"5min":1.548,"15min":1.548},"last":1.014},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.597,"5min":2.246,"15min":2.246},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.878,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.436,"15min":0.436},"max":{"1min":1.8320000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.5},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.0629999999999999,"15min":0.999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.036,"15min":1.0069999999999999},"min":{"1min":0.58499999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.486,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.51000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.45,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1299999999999999},"min":{"1min":0.98799999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6459999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3819999999999999,"15min":1.3600000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.206,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.135}]},{"osd":5,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.3600000000000001,"15min":1.341},"min":{"1min":1.179,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8140000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3080000000000001,"15min":1.274},"min":{"1min":1.1259999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3580000000000001,"15min":1.3380000000000001},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8720000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.355,"5min":1.236,"15min":1.2070000000000001},"min":{"1min":1.012,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0230000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.409,"15min":1.413},"min":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3199999999999998,"5min":2.742,"15min":2.742},"last":1.24},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.391,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8540000000000001,"5min":2.605,"15min":2.605},"last":1.1950000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194351,"statfs":{"total":200000000,"available":199015988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.48299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.359,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.0229999999999999,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.573,"5min":1.853,"15min":1.853},"last":0.75}]},{"osd":2,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.032,"15min":1.03},"min":{"1min":0.46700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.006,"15min":1.01},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.526,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.4690000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":0.97199999999999998,"15min":0.93400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.9980000000000002,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":1.294},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.069,"15min":1.083},"min":{"1min":0.51500000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.615,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.296,"15min":1.25},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":6.5209999999999999,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3779999999999999,"15min":1.3740000000000001},"min":{"1min":0.83999999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.1160000000000001,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.405}]},{"osd":5,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.3380000000000001,"15min":1.371},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.863,"5min":1.986,"15min":1.986},"last":1.3600000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.446,"15min":1.3180000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":16.058,"5min":16.058,"15min":16.058},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4199999999999999,"15min":1.4399999999999999},"min":{"1min":0.96199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.96,"5min":2.04,"15min":2.04},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.413,"15min":1.425},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.1789999999999998,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.2599999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.4450000000000001,"15min":1.4019999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.389}]}]}],"pool_statfs":[]}} 2023-08-10T10:41:39.979 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:41:39.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:41:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.257+0000 7fe37a008640 1 Processor -- start 2023-08-10T10:41:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.257+0000 7fe37a008640 1 -- start start 2023-08-10T10:41:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.258+0000 7fe37a008640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe37415aa50 0x7fe3740c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.258+0000 7fe37a008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe37a008640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740b1370 con 0x7fe3740aff00 2023-08-10T10:41:40.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe37a008640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37415ae30 con 0x7fe37415aa50 2023-08-10T10:41:40.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe37a008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740b1650 con 0x7fe3740b4130 2023-08-10T10:41:40.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe379006640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe37415aa50 0x7fe3740c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe379006640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe37415aa50 0x7fe3740c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47402/0 (socket says 172.21.15.50:47402) 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe379006640 1 -- 172.21.15.50:0/3764615066 learned_addr learned my addr 172.21.15.50:0/3764615066 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.259+0000 7fe378805640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.260+0000 7fe379006640 1 -- 172.21.15.50:0/3764615066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 msgr2=0x7fe3740cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.260+0000 7fe379006640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.260+0000 7fe379006640 1 -- 172.21.15.50:0/3764615066 >> v1:172.21.15.117:6789/0 conn(0x7fe3740aff00 legacy=0x7fe3740cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.260+0000 7fe379006640 1 -- 172.21.15.50:0/3764615066 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740b1930 con 0x7fe37415aa50 2023-08-10T10:41:40.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.261+0000 7fe379006640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740c5550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe370009870 tx=0x7fe37002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6fb9a2ce4cd136 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.262+0000 7fe36bfff640 1 -- 172.21.15.50:0/3764615066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3700317c0 con 0x7fe37415aa50 2023-08-10T10:41:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.262+0000 7fe36bfff640 1 -- 172.21.15.50:0/3764615066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370031920 con 0x7fe37415aa50 2023-08-10T10:41:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.262+0000 7fe36bfff640 1 -- 172.21.15.50:0/3764615066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370031cb0 con 0x7fe37415aa50 2023-08-10T10:41:40.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.262+0000 7fe37a008640 1 -- 172.21.15.50:0/3764615066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 msgr2=0x7fe3740c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.262+0000 7fe37a008640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740c5550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe370009870 tx=0x7fe37002b860 comp rx=0 tx=0).stop 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 -- 172.21.15.50:0/3764615066 shutdown_connections 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 --2- 172.21.15.50:0/3764615066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740c5550 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 -- 172.21.15.50:0/3764615066 >> 172.21.15.50:0/3764615066 conn(0x7fe374069cd0 msgr2=0x7fe3740caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 -- 172.21.15.50:0/3764615066 shutdown_connections 2023-08-10T10:41:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.263+0000 7fe37a008640 1 -- 172.21.15.50:0/3764615066 wait complete. 2023-08-10T10:41:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.265+0000 7fe37a008640 1 Processor -- start 2023-08-10T10:41:40.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.265+0000 7fe37a008640 1 -- start start 2023-08-10T10:41:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 0x7fe37414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c9ea0 con 0x7fe37415aa50 2023-08-10T10:41:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c9320 con 0x7fe3740aff00 2023-08-10T10:41:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe37a008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c9600 con 0x7fe3740b4130 2023-08-10T10:41:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe379807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe379807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47410/0 (socket says 172.21.15.50:47410) 2023-08-10T10:41:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.266+0000 7fe379807640 1 -- 172.21.15.50:0/1756517962 learned_addr learned my addr 172.21.15.50:0/1756517962 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379006640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 0x7fe37414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe378805640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 -- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 msgr2=0x7fe3740c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 -- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 msgr2=0x7fe37414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 0x7fe37414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 -- 172.21.15.50:0/1756517962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700094d0 con 0x7fe37415aa50 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379006640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 0x7fe37414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe379807640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00b970 tx=0x7fe36c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00cb40 con 0x7fe37415aa50 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c00cca0 con 0x7fe37415aa50 2023-08-10T10:41:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c014680 con 0x7fe37415aa50 2023-08-10T10:41:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.267+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740c98e0 con 0x7fe37415aa50 2023-08-10T10:41:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.268+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3740c9010 con 0x7fe37415aa50 2023-08-10T10:41:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.269+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374066e30 con 0x7fe37415aa50 2023-08-10T10:41:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.270+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe36c01d3b0 con 0x7fe37415aa50 2023-08-10T10:41:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.271+0000 7fe369ffb640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 0x7fe35806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.271+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe36c089350 con 0x7fe37415aa50 2023-08-10T10:41:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.271+0000 7fe379006640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 0x7fe35806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.272+0000 7fe379006640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 0x7fe35806d140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe370036000 tx=0x7fe37003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.275+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe36c0543f0 con 0x7fe37415aa50 2023-08-10T10:41:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.533+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe3740b2410 con 0x7fe37415aa50 2023-08-10T10:41:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.541+0000 7fe369ffb640 1 -- 172.21.15.50:0/1756517962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe36c057a10 con 0x7fe37415aa50 2023-08-10T10:41:40.543 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:41:40.543 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:41:40.543 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:41:40.544 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:41:40.544 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:41:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:41:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 msgr2=0x7fe35806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 0x7fe35806d140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe370036000 tx=0x7fe37003d040 comp rx=0 tx=0).stop 2023-08-10T10:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 msgr2=0x7fe3740ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00b970 tx=0x7fe36c00be30 comp rx=0 tx=0).stop 2023-08-10T10:41:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 shutdown_connections 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe37415aa50 0x7fe3740ac890 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3740b4130 0x7fe3740c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe35806ac80 0x7fe35806d140 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 --2- 172.21.15.50:0/1756517962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3740aff00 0x7fe37414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 >> 172.21.15.50:0/1756517962 conn(0x7fe374069cd0 msgr2=0x7fe3740af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 shutdown_connections 2023-08-10T10:41:40.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.544+0000 7fe37a008640 1 -- 172.21.15.50:0/1756517962 wait complete. 2023-08-10T10:41:40.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:40.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.781+0000 7fd12c883640 1 Processor -- start 2023-08-10T10:41:40.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.781+0000 7fd12c883640 1 -- start start 2023-08-10T10:41:40.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.783+0000 7fd12c883640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 0x7fd1280b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.783+0000 7fd12c883640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.783+0000 7fd12c883640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd128071c70 con 0x7fd128070e80 2023-08-10T10:41:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.783+0000 7fd12c883640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280713d0 con 0x7fd1280b0c60 2023-08-10T10:41:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.783+0000 7fd12c883640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280716b0 con 0x7fd12815aa40 2023-08-10T10:41:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd125d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd12659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 0x7fd1280b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd125d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:44896/0 (socket says 172.21.15.50:44896) 2023-08-10T10:41:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd125d9b640 1 -- 172.21.15.50:0/1657901495 learned_addr learned my addr 172.21.15.50:0/1657901495 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:40.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd12659c640 1 -- 172.21.15.50:0/1657901495 >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 msgr2=0x7fd1280b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:40.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd12659c640 1 --2- 172.21.15.50:0/1657901495 >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd12659c640 1 -- 172.21.15.50:0/1657901495 >> v1:172.21.15.117:6789/0 conn(0x7fd128070e80 legacy=0x7fd1280696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd12659c640 1 -- 172.21.15.50:0/1657901495 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128071990 con 0x7fd12815aa40 2023-08-10T10:41:40.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.784+0000 7fd125d9b640 1 --2- 172.21.15.50:0/1657901495 >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:41:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.786+0000 7fd12659c640 1 --2- 172.21.15.50:0/1657901495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 0x7fd1280b3820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd118009d90 tx=0x7fd11802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908683fd9c6f3f91 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.786+0000 7fd12559a640 1 -- 172.21.15.50:0/1657901495 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11802cbc0 con 0x7fd12815aa40 2023-08-10T10:41:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.786+0000 7fd12559a640 1 -- 172.21.15.50:0/1657901495 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11802cd20 con 0x7fd12815aa40 2023-08-10T10:41:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.786+0000 7fd12559a640 1 -- 172.21.15.50:0/1657901495 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118034660 con 0x7fd12815aa40 2023-08-10T10:41:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 -- 172.21.15.50:0/1657901495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 msgr2=0x7fd1280b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 --2- 172.21.15.50:0/1657901495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 0x7fd1280b3820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd118009d90 tx=0x7fd11802be10 comp rx=0 tx=0).stop 2023-08-10T10:41:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 -- 172.21.15.50:0/1657901495 shutdown_connections 2023-08-10T10:41:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 --2- 172.21.15.50:0/1657901495 >> v2:172.21.15.117:3300/0 conn(0x7fd1280b0c60 0x7fd1280b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 --2- 172.21.15.50:0/1657901495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd12815aa40 0x7fd1280b3820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 -- 172.21.15.50:0/1657901495 >> 172.21.15.50:0/1657901495 conn(0x7fd12806b590 msgr2=0x7fd1280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 -- 172.21.15.50:0/1657901495 shutdown_connections 2023-08-10T10:41:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.787+0000 7fd12c883640 1 -- 172.21.15.50:0/1657901495 wait complete. 2023-08-10T10:41:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.789+0000 7fd12c883640 1 Processor -- start 2023-08-10T10:41:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.789+0000 7fd12c883640 1 -- start start 2023-08-10T10:41:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280b0c60 0x7fd12806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd12815aa40 0x7fd12806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280ccf20 con 0x7fd128070e80 2023-08-10T10:41:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280a87b0 con 0x7fd12815aa40 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12c883640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280c8610 con 0x7fd1280b0c60 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.790+0000 7fd12659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47426/0 (socket says 172.21.15.50:47426) 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 -- 172.21.15.50:0/1543241370 learned_addr learned my addr 172.21.15.50:0/1543241370 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd126d9d640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd12815aa40 0x7fd12806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd125d9b640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280b0c60 0x7fd12806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 -- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280b0c60 msgr2=0x7fd12806eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280b0c60 0x7fd12806eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 -- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd12815aa40 msgr2=0x7fd12806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd12815aa40 0x7fd12806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 -- 172.21.15.50:0/1543241370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100094d0 con 0x7fd128070e80 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.791+0000 7fd12659c640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd118009d90 tx=0x7fd118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.792+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11803e610 con 0x7fd128070e80 2023-08-10T10:41:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.792+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11802ce90 con 0x7fd128070e80 2023-08-10T10:41:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.792+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11803e9d0 con 0x7fd128070e80 2023-08-10T10:41:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.792+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118009a70 con 0x7fd128070e80 2023-08-10T10:41:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.792+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280cc580 con 0x7fd128070e80 2023-08-10T10:41:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.793+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12804e270 con 0x7fd128070e80 2023-08-10T10:41:40.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.794+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd11803b050 con 0x7fd128070e80 2023-08-10T10:41:40.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.795+0000 7fd11effd640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 0x7fd10806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:40.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.795+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1180abbd0 con 0x7fd128070e80 2023-08-10T10:41:40.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.795+0000 7fd125d9b640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 0x7fd10806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.796+0000 7fd125d9b640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 0x7fd10806d110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd1280c7f30 tx=0x7fd110008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:40.799+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd118076d90 con 0x7fd128070e80 2023-08-10T10:41:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.029+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd128158370 con 0x7fd128070e80 2023-08-10T10:41:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.030+0000 7fd11effd640 1 -- 172.21.15.50:0/1543241370 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7fd118039090 con 0x7fd128070e80 2023-08-10T10:41:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:41.031 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:41:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:41:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 msgr2=0x7fd10806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 0x7fd10806d110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd1280c7f30 tx=0x7fd110008040 comp rx=0 tx=0).stop 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 msgr2=0x7fd128151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd118009d90 tx=0x7fd118004a40 comp rx=0 tx=0).stop 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 shutdown_connections 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd10806ac50 0x7fd10806d110 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd12815aa40 0x7fd12806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1280b0c60 0x7fd12806eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 --2- 172.21.15.50:0/1543241370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd128070e80 0x7fd128151510 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 >> 172.21.15.50:0/1543241370 conn(0x7fd12806b590 msgr2=0x7fd1280cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 shutdown_connections 2023-08-10T10:41:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.033+0000 7fd12c883640 1 -- 172.21.15.50:0/1543241370 wait complete. 2023-08-10T10:41:41.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:41:34.387202+0000', 'modified': '2023-08-10T10:41:37.937665+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6138': {'gid': 6138, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6836/1006474021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 1006474021}, {'type': 'v1', 'addr': '172.21.15.50:6836', 'nonce': 1006474021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:41:41.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:41:41.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:41:41.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.701+0000 7f8b8c342640 1 Processor -- start 2023-08-10T10:41:41.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.701+0000 7f8b8c342640 1 -- start start 2023-08-10T10:41:41.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.702+0000 7f8b8c342640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b840cd730 0x7f8b840d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8c342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 0x7f8b840d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8c342640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840d1220 con 0x7f8b8415ce00 2023-08-10T10:41:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8c342640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840d2930 con 0x7f8b840cd730 2023-08-10T10:41:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8c342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840b8a30 con 0x7f8b840b5af0 2023-08-10T10:41:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b840cd730 0x7f8b840d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b840cd730 0x7f8b840d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47432/0 (socket says 172.21.15.50:47432) 2023-08-10T10:41:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1594665430 learned_addr learned my addr 172.21.15.50:0/1594665430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 0x7f8b840d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1594665430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 msgr2=0x7f8b840d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 0x7f8b840d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1594665430 >> v1:172.21.15.50:6789/0 conn(0x7f8b8415ce00 legacy=0x7f8b840cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1594665430 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840b1e70 con 0x7f8b840cd730 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.703+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 0x7f8b840d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.705+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840cd730 0x7f8b840d23f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e093c6ae8969864 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.705+0000 7f8b890dc640 1 -- 172.21.15.50:0/1594665430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80030840 con 0x7f8b840cd730 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.705+0000 7f8b890dc640 1 -- 172.21.15.50:0/1594665430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b800309a0 con 0x7f8b840cd730 2023-08-10T10:41:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.705+0000 7f8b890dc640 1 -- 172.21.15.50:0/1594665430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80030d30 con 0x7f8b840cd730 2023-08-10T10:41:41.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 -- 172.21.15.50:0/1594665430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840cd730 msgr2=0x7f8b840d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840cd730 0x7f8b840d23f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002b980 comp rx=0 tx=0).stop 2023-08-10T10:41:41.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 -- 172.21.15.50:0/1594665430 shutdown_connections 2023-08-10T10:41:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840b5af0 0x7f8b840d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 --2- 172.21.15.50:0/1594665430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840cd730 0x7f8b840d23f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 -- 172.21.15.50:0/1594665430 >> 172.21.15.50:0/1594665430 conn(0x7f8b840d2c60 msgr2=0x7f8b840d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 -- 172.21.15.50:0/1594665430 shutdown_connections 2023-08-10T10:41:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.706+0000 7f8b8c342640 1 -- 172.21.15.50:0/1594665430 wait complete. 2023-08-10T10:41:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.707+0000 7f8b8c342640 1 Processor -- start 2023-08-10T10:41:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.708+0000 7f8b8c342640 1 -- start start 2023-08-10T10:41:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.708+0000 7f8b8c342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8c342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840cd730 0x7f8b8415d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8c342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415ce00 0x7f8b84150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8c342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415da30 con 0x7f8b840b5af0 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8c342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415dd10 con 0x7f8b8415ce00 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8c342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415dff0 con 0x7f8b840cd730 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47438/0 (socket says 172.21.15.50:47438) 2023-08-10T10:41:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3638591878 learned_addr learned my addr 172.21.15.50:0/3638591878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b898dd640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840cd730 0x7f8b8415d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415ce00 0x7f8b84150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840cd730 msgr2=0x7f8b8415d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840cd730 0x7f8b8415d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415ce00 msgr2=0x7f8b84150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415ce00 0x7f8b84150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.709+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3638591878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800094d0 con 0x7f8b840b5af0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b7affd640 1 -- 172.21.15.50:0/3638591878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80030810 con 0x7f8b840b5af0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b7affd640 1 -- 172.21.15.50:0/3638591878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80043400 con 0x7f8b840b5af0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b7affd640 1 -- 172.21.15.50:0/3638591878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800437d0 con 0x7f8b840b5af0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8415e2d0 con 0x7f8b840b5af0 2023-08-10T10:41:41.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.710+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8415d720 con 0x7f8b840b5af0 2023-08-10T10:41:41.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.712+0000 7f8b7affd640 1 -- 172.21.15.50:0/3638591878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b80043930 con 0x7f8b840b5af0 2023-08-10T10:41:41.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.713+0000 7f8b7affd640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 0x7f8b6806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.714+0000 7f8b7affd640 1 -- 172.21.15.50:0/3638591878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b8003e070 con 0x7f8b840b5af0 2023-08-10T10:41:41.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.714+0000 7f8b898dd640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 0x7f8b6806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.714+0000 7f8b8ef90740 1 Processor -- start 2023-08-10T10:41:41.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.714+0000 7f8b8ef90740 1 -- start start 2023-08-10T10:41:41.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.714+0000 7f8b898dd640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 0x7f8b6806d140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8b8415efc0 tx=0x7f8b74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c1dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1b609d0 con 0x55b5a1bf0440 2023-08-10T10:41:41.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1b5e0c0 con 0x55b5a1bf4040 2023-08-10T10:41:41.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.715+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1b599b0 con 0x55b5a1c204c0 2023-08-10T10:41:41.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47450/0 (socket says 172.21.15.50:47450) 2023-08-10T10:41:41.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 -- 172.21.15.50:0/4128361985 learned_addr learned my addr 172.21.15.50:0/4128361985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 -- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 msgr2=0x55b5a1c208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 -- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 msgr2=0x55b5a1c1dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c1dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 -- 172.21.15.50:0/4128361985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a1b26c10 con 0x55b5a1bf0440 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.716+0000 7f8b898dd640 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005210 tx=0x7f8b74011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d015299c7a6c82ab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b67fff640 1 -- 172.21.15.50:0/4128361985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400e4a0 con 0x55b5a1bf0440 2023-08-10T10:41:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b67fff640 1 -- 172.21.15.50:0/4128361985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400e600 con 0x55b5a1bf0440 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b67fff640 1 -- 172.21.15.50:0/4128361985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400e970 con 0x55b5a1bf0440 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 -- 172.21.15.50:0/4128361985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 msgr2=0x55b5a1c1d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005210 tx=0x7f8b74011000 comp rx=0 tx=0).stop 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 -- 172.21.15.50:0/4128361985 shutdown_connections 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c1dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf0440 0x55b5a1c1d730 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/4128361985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 -- 172.21.15.50:0/4128361985 >> 172.21.15.50:0/4128361985 conn(0x55b5a1bf2750 msgr2=0x55b5a1c3b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 -- 172.21.15.50:0/4128361985 shutdown_connections 2023-08-10T10:41:41.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.717+0000 7f8b8ef90740 1 -- 172.21.15.50:0/4128361985 wait complete. 2023-08-10T10:41:41.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.718+0000 7f8b8ef90740 1 -- start start 2023-08-10T10:41:41.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.718+0000 7f8b8ef90740 1 Processor -- start 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c1a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1afa940 con 0x55b5a1bf4040 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1afa5e0 con 0x55b5a1c204c0 2023-08-10T10:41:41.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5a18c0f20 con 0x55b5a1c242e0 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.719+0000 7f8b8ef90740 10 client.0 _ll_register_callbacks cb 0x55b5a1b53250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47464/0 (socket says 172.21.15.50:47464) 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3750339822 learned_addr learned my addr 172.21.15.50:0/3750339822 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 msgr2=0x55b5a1c1a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c1a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 msgr2=0x55b5a1c23da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 -- 172.21.15.50:0/3750339822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7400f040 con 0x55b5a1bf4040 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8b80077980 tx=0x7f8b80040400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f451d606829352 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.720+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80081070 con 0x55b5a1bf4040 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b800811d0 con 0x55b5a1bf4040 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5a1b83bf0 con 0x55b5a1bf4040 2023-08-10T10:41:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b80043be0 con 0x55b5a1bf4040 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 10 client.6294 fetch_fsmap learned FSMap version 33 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55b5a1b58030 con 0x55b5a1bf4040 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5a1b83bf0 con 0x55b5a1bf4040 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8b80077270 con 0x55b5a1bf4040 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 10 client.6294 fetch_fsmap finished waiting for FSMap version 33 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 10 client.6294 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:41:41.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 20 client.6294 populate_metadata read hostname 'smithi050' 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c18770 0x55b5a1c16320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 4 client.6294 mds_command: new command op to 6138 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.721+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 --> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5a1b4c7c0 con 0x55b5a1c18770 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.722+0000 7f8b898dd640 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c18770 0x55b5a1c16320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.722+0000 7f8b657fa640 10 client.6294 ms_handle_connect on v2:172.21.15.50:6834/1006474021 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.722+0000 7f8b898dd640 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c18770 0x55b5a1c16320 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c995c257e7c094b4 server_cookie=7c799ae4b56bbd1f in_seq=0 out_seq=0 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b657fa640 1 -- 172.21.15.50:0/3750339822 <== mds.0 v2:172.21.15.50:6834/1006474021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b5a1b4c7c0 con 0x55b5a1c18770 2023-08-10T10:41:41.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b657fa640 10 client.6294 handle_command_reply: tid=0 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 client.6294 shutdown 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 msgr2=0x55b5a1c0eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8b80077980 tx=0x7f8b80040400 comp rx=0 tx=0).stop 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 shutdown_connections 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c18770 0x55b5a1c16320 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c1a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/3750339822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c0eec0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b657fa640 0 client.6294 ms_handle_reset on v2:172.21.15.50:6834/1006474021 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 >> 172.21.15.50:0/3750339822 conn(0x55b5a1bf0440 msgr2=0x55b5a1c3e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 shutdown_connections 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.723+0000 7f8b8ef90740 1 -- 172.21.15.50:0/3750339822 wait complete. 2023-08-10T10:41:41.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.724+0000 7f8b8ef90740 20 client.6294 trim_cache size 0 max 16384 2023-08-10T10:41:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.740+0000 7f8b8ef90740 1 Processor -- start 2023-08-10T10:41:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 -- start start 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c22a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c22f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1beb430 con 0x55b5a1c242e0 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1c3eef0 con 0x55b5a1bf4040 2023-08-10T10:41:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.741+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1c1aaf0 con 0x55b5a1c204c0 2023-08-10T10:41:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47476/0 (socket says 172.21.15.50:47476) 2023-08-10T10:41:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 -- 172.21.15.50:0/2223416138 learned_addr learned my addr 172.21.15.50:0/2223416138 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b898dd640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c22f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c22a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 -- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 msgr2=0x55b5a1c22f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c22f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 -- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 msgr2=0x55b5a1c22a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c22a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a8df640 1 -- 172.21.15.50:0/2223416138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a1b8d8a0 con 0x55b5a1c242e0 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b898dd640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c22f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.742+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c22a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55b5a1c246c0 tx=0x7f8b7c00d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e461e1ae1ae4e93 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b78ff9640 1 -- 172.21.15.50:0/2223416138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c015410 con 0x55b5a1c242e0 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b78ff9640 1 -- 172.21.15.50:0/2223416138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c015570 con 0x55b5a1c242e0 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b78ff9640 1 -- 172.21.15.50:0/2223416138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c015920 con 0x55b5a1c242e0 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 -- 172.21.15.50:0/2223416138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 msgr2=0x55b5a1c19a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55b5a1c246c0 tx=0x7f8b7c00d800 comp rx=0 tx=0).stop 2023-08-10T10:41:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 -- 172.21.15.50:0/2223416138 shutdown_connections 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1c242e0 0x55b5a1c19a70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c204c0 0x55b5a1c22f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/2223416138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1bf4040 0x55b5a1c22a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.743+0000 7f8b8ef90740 1 -- 172.21.15.50:0/2223416138 >> 172.21.15.50:0/2223416138 conn(0x55b5a1bf0440 msgr2=0x55b5a1c0e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.744+0000 7f8b8ef90740 1 -- 172.21.15.50:0/2223416138 shutdown_connections 2023-08-10T10:41:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.744+0000 7f8b8ef90740 1 -- 172.21.15.50:0/2223416138 wait complete. 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.744+0000 7f8b8ef90740 1 -- start start 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.744+0000 7f8b8ef90740 1 Processor -- start 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.745+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c8c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c8cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1c221e0 con 0x55b5a1bf4040 2023-08-10T10:41:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1c16820 con 0x55b5a1c204c0 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5a1c1a3b0 con 0x55b5a1c242e0 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8ef90740 10 client.0 _ll_register_callbacks cb 0x7f8b8007aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47492/0 (socket says 172.21.15.50:47492) 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1655867174 learned_addr learned my addr 172.21.15.50:0/1655867174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a8df640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c8cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b898dd640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c8c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 msgr2=0x55b5a1c8cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c8cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 msgr2=0x55b5a1c8c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c8c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.746+0000 7f8b8a0de640 1 -- 172.21.15.50:0/1655867174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c0079d0 con 0x55b5a1bf4040 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8a0de640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8b80077930 tx=0x7f8b800aa9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b61d9691c8b49be server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80040380 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b8007a3e0 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b7400e600 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b8007b250 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 10 client.6300 fetch_fsmap learned FSMap version 33 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55b5a1af9610 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400e600 con 0x55b5a1bf4040 2023-08-10T10:41:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8b8007a5a0 con 0x55b5a1bf4040 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 10 client.6300 fetch_fsmap finished waiting for FSMap version 33 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 10 client.6300 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 20 client.6300 populate_metadata read hostname 'smithi050' 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c20f40 0x55b5a1c21320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 4 client.6300 mds_command: new command op to 6138 tid=0[{"prefix": "status"}] 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.747+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 --> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b5a1b52990 con 0x55b5a1c20f40 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b898dd640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c20f40 0x55b5a1c21320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b898dd640 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c20f40 0x55b5a1c21320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6754d2ebc6752ccf server_cookie=20b22a5a9f2d327f in_seq=0 out_seq=0 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b657fa640 10 client.6300 ms_handle_connect on v2:172.21.15.50:6834/1006474021 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b657fa640 1 -- 172.21.15.50:0/1655867174 <== mds.0 v2:172.21.15.50:6834/1006474021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b5a1b52990 con 0x55b5a1c20f40 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b657fa640 10 client.6300 handle_command_reply: tid=0 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.748+0000 7f8b8ef90740 1 client.6300 shutdown 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 msgr2=0x55b5a1c19e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8b80077930 tx=0x7f8b800aa9b0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 shutdown_connections 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:6834/1006474021,v1:172.21.15.50:6836/1006474021] conn(0x55b5a1c20f40 0x55b5a1c21320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b5a1c242e0 0x55b5a1c8cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b5a1c204c0 0x55b5a1c8c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 --2- 172.21.15.50:0/1655867174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5a1bf4040 0x55b5a1c19e70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 >> 172.21.15.50:0/1655867174 conn(0x55b5a1bf0440 msgr2=0x55b5a1c229b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b657fa640 0 client.6300 ms_handle_reset on v2:172.21.15.50:6834/1006474021 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 shutdown_connections 2023-08-10T10:41:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 1 -- 172.21.15.50:0/1655867174 wait complete. 2023-08-10T10:41:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.749+0000 7f8b8ef90740 20 client.6300 trim_cache size 0 max 16384 2023-08-10T10:41:41.757 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:41:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:41:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:41:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6138, 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.8290517340000001, 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 33, 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 72, 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 72, 2023-08-10T10:41:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.713379714 2023-08-10T10:41:41.759 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:41:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 msgr2=0x7f8b6806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 0x7f8b6806d140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8b8415efc0 tx=0x7f8b74009040 comp rx=0 tx=0).stop 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 msgr2=0x7f8b84151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b80004730 comp rx=0 tx=0).stop 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 shutdown_connections 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8b6806ac80 0x7f8b6806d140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415ce00 0x7f8b84150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b840cd730 0x7f8b8415d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 --2- 172.21.15.50:0/3638591878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b840b5af0 0x7f8b84151010 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 >> 172.21.15.50:0/3638591878 conn(0x7f8b840d2c60 msgr2=0x7f8b8415c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 shutdown_connections 2023-08-10T10:41:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.750+0000 7f8b8c342640 1 -- 172.21.15.50:0/3638591878 wait complete. 2023-08-10T10:41:41.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:41:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.978+0000 7f495d767640 1 Processor -- start 2023-08-10T10:41:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.978+0000 7f495d767640 1 -- start start 2023-08-10T10:41:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.979+0000 7f495d767640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49580b1370 0x7f49580ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f495d767640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580b2280 con 0x7f49580696a0 2023-08-10T10:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f495d767640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580b19e0 con 0x7f495815ad00 2023-08-10T10:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f495d767640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49580b1cc0 con 0x7f49580b1370 2023-08-10T10:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f4957fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49580696a0 0x7f49580cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53356/0 (socket says 172.21.15.50:53356) 2023-08-10T10:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f4957fff640 1 -- 172.21.15.50:0/1001910652 learned_addr learned my addr 172.21.15.50:0/1001910652 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:41:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f495cf66640 1 --2- 172.21.15.50:0/1001910652 >> v2:172.21.15.50:3300/0 conn(0x7f49580b1370 0x7f49580ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f49577fe640 1 -- 172.21.15.50:0/1001910652 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100329466 0 0) 0x7f49580b2280 con 0x7f49580696a0 2023-08-10T10:41:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.980+0000 7f49577fe640 1 -- 172.21.15.50:0/1001910652 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4944003520 con 0x7f49580696a0 2023-08-10T10:41:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.981+0000 7f495cf66640 1 -- 172.21.15.50:0/1001910652 >> v1:172.21.15.117:6789/0 conn(0x7f495815ad00 legacy=0x7f4958069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.981+0000 7f495cf66640 1 -- 172.21.15.50:0/1001910652 >> v1:172.21.15.50:6789/0 conn(0x7f49580696a0 legacy=0x7f49580cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.981+0000 7f495cf66640 1 -- 172.21.15.50:0/1001910652 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580b1fa0 con 0x7f49580b1370 2023-08-10T10:41:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.982+0000 7f495cf66640 1 --2- 172.21.15.50:0/1001910652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580b1370 0x7f49580ccfb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f49500097a0 tx=0x7f495002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3e84861de4e90b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.982+0000 7f49577fe640 1 -- 172.21.15.50:0/1001910652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950031830 con 0x7f49580b1370 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.982+0000 7f49577fe640 1 -- 172.21.15.50:0/1001910652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950031990 con 0x7f49580b1370 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.982+0000 7f49577fe640 1 -- 172.21.15.50:0/1001910652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950031d00 con 0x7f49580b1370 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 -- 172.21.15.50:0/1001910652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580b1370 msgr2=0x7f49580ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 --2- 172.21.15.50:0/1001910652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580b1370 0x7f49580ccfb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f49500097a0 tx=0x7f495002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 -- 172.21.15.50:0/1001910652 shutdown_connections 2023-08-10T10:41:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 --2- 172.21.15.50:0/1001910652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580b1370 0x7f49580ccfb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 -- 172.21.15.50:0/1001910652 >> 172.21.15.50:0/1001910652 conn(0x7f49580cafa0 msgr2=0x7f49580cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 -- 172.21.15.50:0/1001910652 shutdown_connections 2023-08-10T10:41:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.983+0000 7f495d767640 1 -- 172.21.15.50:0/1001910652 wait complete. 2023-08-10T10:41:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.985+0000 7f495d767640 1 Processor -- start 2023-08-10T10:41:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.985+0000 7f495d767640 1 -- start start 2023-08-10T10:41:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 0x7f495814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f495815ad00 0x7f49580c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495814e190 con 0x7f49580696a0 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495815ce00 con 0x7f495815ad00 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f495d767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495806ec30 con 0x7f49580b1370 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.986+0000 7f4957fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47500/0 (socket says 172.21.15.50:47500) 2023-08-10T10:41:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 -- 172.21.15.50:0/1712056172 learned_addr learned my addr 172.21.15.50:0/1712056172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:41.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f494f7fe640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 0x7f495814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f495cf66640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f495815ad00 0x7f49580c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 -- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 msgr2=0x7f495814dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 0x7f495814dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 -- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f495815ad00 msgr2=0x7f49580c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f495815ad00 0x7f49580c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 -- 172.21.15.50:0/1712056172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009400 con 0x7f49580696a0 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f494f7fe640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 0x7f495814dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.987+0000 7f4957fff640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f494800cbc0 tx=0x7f494800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.988+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800ad40 con 0x7f49580696a0 2023-08-10T10:41:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.988+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948012400 con 0x7f49580696a0 2023-08-10T10:41:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.988+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495815bcf0 con 0x7f49580696a0 2023-08-10T10:41:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.988+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800aea0 con 0x7f49580696a0 2023-08-10T10:41:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.988+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495815c7b0 con 0x7f49580696a0 2023-08-10T10:41:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.989+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958066e30 con 0x7f49580696a0 2023-08-10T10:41:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.990+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4948007070 con 0x7f49580696a0 2023-08-10T10:41:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.991+0000 7f49557fa640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 0x7f493806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.992+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4948089480 con 0x7f49580696a0 2023-08-10T10:41:41.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.992+0000 7f494f7fe640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 0x7f493806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:41.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.992+0000 7f494f7fe640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 0x7f493806d110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f49580cacf0 tx=0x7f4940009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:41.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:41.996+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49480545d0 con 0x7f49580696a0 2023-08-10T10:41:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.247+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49580cd050 con 0x7f49580696a0 2023-08-10T10:41:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.248+0000 7f49557fa640 1 -- 172.21.15.50:0/1712056172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4948057bf0 con 0x7f49580696a0 2023-08-10T10:41:42.249 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:41:42.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 msgr2=0x7f493806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:42.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 0x7f493806d110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f49580cacf0 tx=0x7f4940009040 comp rx=0 tx=0).stop 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 msgr2=0x7f495814e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f494800cbc0 tx=0x7f494800a430 comp rx=0 tx=0).stop 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 shutdown_connections 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f493806ac50 0x7f493806d110 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f495815ad00 0x7f49580c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:42.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49580b1370 0x7f495814dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 --2- 172.21.15.50:0/1712056172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49580696a0 0x7f495814e4f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 >> 172.21.15.50:0/1712056172 conn(0x7f49580cafa0 msgr2=0x7f49580ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 shutdown_connections 2023-08-10T10:41:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:42.251+0000 7f495d767640 1 -- 172.21.15.50:0/1712056172 wait complete. 2023-08-10T10:41:42.268 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:41:42.269 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:41:42.269 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:41:42.269 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:41:42.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:41:42.270 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:41:42.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:41:42.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:41:42.271 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:41:42.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.272 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:41:42.322 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:41:42.323 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:41:42.323 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:41:42.323 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.323 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:41:42.323 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.324 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:42.324 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:42.324 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:41:42.324 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:42.325 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:42.325 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:41:42.325 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:41:42.325 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:42.326 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:41:42.326 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:41:42.326 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41023sec preferred_lft 41023sec 2023-08-10T10:41:42.326 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:42.327 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:41:42.328 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.329 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:41:42.329 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:41:42.329 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:41:42.329 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:42.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.330 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:41:42.425 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:41:42.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.430 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:41:42.487 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:41:42.487 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:41:42.488 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:41:42.488 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:41:42.488 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:41:42.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.489 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:41:42.489 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:41:42.489 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:41:42.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:41:42.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:41:42.490 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:41:42.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:42.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:41:42.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.692 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:41:42.740 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:41:42.740 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:41:42.741 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:41:42.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:41:42.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:41:42.844 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:41:42.905 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:41:42.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:41:42.906 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:41:42.965 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:41:42.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:42.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:43.123 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:41:43.155 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:41:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:41:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:41:43.156 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:41:43.158 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:41:43.158 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:41:43.158 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:41:43.158 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:41:43.158 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:41:43.162 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:41:43.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:43.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:41:43.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:43.255 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:41:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:client5500 2023-08-10T10:41:43.321 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:41:43.322 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:43.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:41:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.611+0000 7f1aa088a640 1 Processor -- start 2023-08-10T10:41:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.611+0000 7f1aa088a640 1 -- start start 2023-08-10T10:41:43.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1aa088a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1aa088a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1aa088a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c0b2280 con 0x7f1a9c0696a0 2023-08-10T10:41:43.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1aa088a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b19e0 con 0x7f1a9c069a80 2023-08-10T10:41:43.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1aa088a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b1cc0 con 0x7f1a9c15ad00 2023-08-10T10:41:43.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1a9bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:50190/0 (socket says 172.21.15.50:50190) 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1a9bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:44978/0 (socket says 172.21.15.50:44978) 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.613+0000 7f1a93fff640 1 -- 172.21.15.50:0/2362221955 learned_addr learned my addr 172.21.15.50:0/2362221955 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.614+0000 7f1a9bfff640 1 -- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 msgr2=0x7f1a9c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.614+0000 7f1a9bfff640 1 --2- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.614+0000 7f1a9bfff640 1 -- 172.21.15.50:0/2362221955 >> v1:172.21.15.117:6789/0 conn(0x7f1a9c0696a0 legacy=0x7f1a9c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.614+0000 7f1a9bfff640 1 -- 172.21.15.50:0/2362221955 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0b1fa0 con 0x7f1a9c069a80 2023-08-10T10:41:43.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.616+0000 7f1a9bfff640 1 --2- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009dc0 tx=0x7f1a9402be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26561e8da687e806 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:43.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.616+0000 7f1a9affd640 1 -- 172.21.15.50:0/2362221955 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9402cbb0 con 0x7f1a9c069a80 2023-08-10T10:41:43.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.616+0000 7f1a9affd640 1 -- 172.21.15.50:0/2362221955 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9402cd10 con 0x7f1a9c069a80 2023-08-10T10:41:43.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.616+0000 7f1a9affd640 1 -- 172.21.15.50:0/2362221955 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94034660 con 0x7f1a9c069a80 2023-08-10T10:41:43.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 -- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c069a80 msgr2=0x7f1a9c0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 --2- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009dc0 tx=0x7f1a9402be00 comp rx=0 tx=0).stop 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 -- 172.21.15.50:0/2362221955 shutdown_connections 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 --2- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c069a80 0x7f1a9c0ccfb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 --2- 172.21.15.50:0/2362221955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 -- 172.21.15.50:0/2362221955 >> 172.21.15.50:0/2362221955 conn(0x7f1a9c0cafa0 msgr2=0x7f1a9c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 -- 172.21.15.50:0/2362221955 shutdown_connections 2023-08-10T10:41:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.617+0000 7f1aa088a640 1 -- 172.21.15.50:0/2362221955 wait complete. 2023-08-10T10:41:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.619+0000 7f1aa088a640 1 Processor -- start 2023-08-10T10:41:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.619+0000 7f1aa088a640 1 -- start start 2023-08-10T10:41:43.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c0696a0 0x7f1a9c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0c7260 con 0x7f1a9c069a80 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c152ad0 con 0x7f1a9c0696a0 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1aa088a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0718e0 con 0x7f1a9c15ad00 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1a93fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47508/0 (socket says 172.21.15.50:47508) 2023-08-10T10:41:43.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.620+0000 7f1a93fff640 1 -- 172.21.15.50:0/556807949 learned_addr learned my addr 172.21.15.50:0/556807949 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a9bfff640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a9b7fe640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c0696a0 0x7f1a9c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 -- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 msgr2=0x7f1a9c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 -- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c0696a0 msgr2=0x7f1a9c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c0696a0 0x7f1a9c06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 -- 172.21.15.50:0/556807949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94009a70 con 0x7f1a9c069a80 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.621+0000 7f1a93fff640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e870 tx=0x7f1a8400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.622+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400c940 con 0x7f1a9c069a80 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.622+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400caa0 con 0x7f1a9c069a80 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.622+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400ce50 con 0x7f1a9c069a80 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.622+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c0c68c0 con 0x7f1a9c069a80 2023-08-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.622+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c0c6e80 con 0x7f1a9c069a80 2023-08-10T10:41:43.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.623+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c0c74d0 con 0x7f1a9c069a80 2023-08-10T10:41:43.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.624+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a84013470 con 0x7f1a9c069a80 2023-08-10T10:41:43.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.625+0000 7f1a98ff9640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 0x7f1a7c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:43.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.625+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a84089560 con 0x7f1a9c069a80 2023-08-10T10:41:43.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.625+0000 7f1a9b7fe640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 0x7f1a7c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:43.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.626+0000 7f1a9b7fe640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 0x7f1a7c06d110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000f60 tx=0x7f1a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.629+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a84054600 con 0x7f1a9c069a80 2023-08-10T10:41:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.857+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a9c0b2d70 con 0x7f1a9c069a80 2023-08-10T10:41:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.858+0000 7f1a98ff9640 1 -- 172.21.15.50:0/556807949 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a84057c20 con 0x7f1a9c069a80 2023-08-10T10:41:43.859 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:41:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.860+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 msgr2=0x7f1a7c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.860+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 0x7f1a7c06d110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000f60 tx=0x7f1a8c009040 comp rx=0 tx=0).stop 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.860+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 msgr2=0x7f1a9c152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.860+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e870 tx=0x7f1a8400ed30 comp rx=0 tx=0).stop 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 shutdown_connections 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a9c15ad00 0x7f1a9c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a9c069a80 0x7f1a9c152590 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1a7c06ac50 0x7f1a7c06d110 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 --2- 172.21.15.50:0/556807949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a9c0696a0 0x7f1a9c06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 >> 172.21.15.50:0/556807949 conn(0x7f1a9c0cafa0 msgr2=0x7f1a9c159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 shutdown_connections 2023-08-10T10:41:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:43.861+0000 7f1aa088a640 1 -- 172.21.15.50:0/556807949 wait complete. 2023-08-10T10:41:43.881 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:41:43.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:41:43.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:41:43.882 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:41:43.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:41:43.883 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:41:43.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:41:43.883 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:41:43.884 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:41:43.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:43.884 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:41:43.946 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.947 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:41:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41193sec preferred_lft 41193sec 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:41:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:41:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:41:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.951 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:41:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:41:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:41:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:41:43.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:43.952 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:41:44.046 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:41:44.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.050 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:41:44.106 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:41:44.106 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:41:44.107 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:41:44.107 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:41:44.107 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:41:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.108 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:41:44.108 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:41:44.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:41:44.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:41:44.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:41:44.110 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:41:44.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.290 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:41:44.341 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:41:44.341 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:41:44.342 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:41:44.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:41:44.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:41:44.437 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:41:44.483 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:41:44.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:41:44.484 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:41:44.579 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:41:44.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:44.719 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:44.719 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:41:44.752 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:41:44.753 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:41:44.753 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:41:44.753 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:41:44.753 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:41:44.755 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:41:44.755 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:41:44.755 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:41:44.755 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:41:44.755 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:41:44.759 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:41:44.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:41:44.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:41:44.851 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:41:44.909 INFO:teuthology.orchestra.run.smithi117.stdout:client5512 2023-08-10T10:41:44.909 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:41:44.910 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:41:44.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:41:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.192+0000 7fabac9cf640 1 Processor -- start 2023-08-10T10:41:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.192+0000 7fabac9cf640 1 -- start start 2023-08-10T10:41:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7fabac9cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faba815cd60 0x7faba8160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7fabac9cf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faba80b8430 0x7faba80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7fabac9cf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba80ce200 con 0x7faba80cddb0 2023-08-10T10:41:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7fabac9cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80b5bd0 con 0x7faba815cd60 2023-08-10T10:41:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7fabac9cf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba8161180 con 0x7faba80b8430 2023-08-10T10:41:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7faba659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faba815cd60 0x7faba8160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7faba659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faba815cd60 0x7faba8160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33036/0 (socket says 172.21.15.50:33036) 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.194+0000 7faba659c640 1 -- 172.21.15.50:0/1871702116 learned_addr learned my addr 172.21.15.50:0/1871702116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.195+0000 7fab9ffff640 1 --2- 172.21.15.50:0/1871702116 >> v2:172.21.15.117:3300/0 conn(0x7faba80b8430 0x7faba80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.195+0000 7faba659c640 1 -- 172.21.15.50:0/1871702116 >> v2:172.21.15.117:3300/0 conn(0x7faba80b8430 msgr2=0x7faba80cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.195+0000 7faba659c640 1 --2- 172.21.15.50:0/1871702116 >> v2:172.21.15.117:3300/0 conn(0x7faba80b8430 0x7faba80cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.195+0000 7faba659c640 1 -- 172.21.15.50:0/1871702116 >> v1:172.21.15.117:6789/0 conn(0x7faba80cddb0 legacy=0x7faba80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:41:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.195+0000 7faba659c640 1 -- 172.21.15.50:0/1871702116 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8161460 con 0x7faba815cd60 2023-08-10T10:41:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.196+0000 7faba659c640 1 --2- 172.21.15.50:0/1871702116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba815cd60 0x7faba8160930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faba80ceeb0 tx=0x7fab9802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32c720909375d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.196+0000 7faba5d9b640 1 -- 172.21.15.50:0/1871702116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98030860 con 0x7faba815cd60 2023-08-10T10:41:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.196+0000 7faba5d9b640 1 -- 172.21.15.50:0/1871702116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab980309c0 con 0x7faba815cd60 2023-08-10T10:41:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.196+0000 7faba5d9b640 1 -- 172.21.15.50:0/1871702116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98030d50 con 0x7faba815cd60 2023-08-10T10:41:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 -- 172.21.15.50:0/1871702116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba815cd60 msgr2=0x7faba8160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 --2- 172.21.15.50:0/1871702116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba815cd60 0x7faba8160930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faba80ceeb0 tx=0x7fab9802b9a0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 -- 172.21.15.50:0/1871702116 shutdown_connections 2023-08-10T10:41:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 --2- 172.21.15.50:0/1871702116 >> v2:172.21.15.117:3300/0 conn(0x7faba80b8430 0x7faba80cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 --2- 172.21.15.50:0/1871702116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba815cd60 0x7faba8160930 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 -- 172.21.15.50:0/1871702116 >> 172.21.15.50:0/1871702116 conn(0x7faba80d2ac0 msgr2=0x7faba80d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 -- 172.21.15.50:0/1871702116 shutdown_connections 2023-08-10T10:41:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.197+0000 7fabac9cf640 1 -- 172.21.15.50:0/1871702116 wait complete. 2023-08-10T10:41:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.199+0000 7fabac9cf640 1 Processor -- start 2023-08-10T10:41:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.199+0000 7fabac9cf640 1 -- start start 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba80b8430 0x7faba81f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba815cd60 0x7faba8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba815de60 con 0x7faba80cddb0 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba815d1e0 con 0x7faba815cd60 2023-08-10T10:41:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fabac9cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba815d4c0 con 0x7faba80b8430 2023-08-10T10:41:45.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.200+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:45.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33050/0 (socket says 172.21.15.50:33050) 2023-08-10T10:41:45.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 -- 172.21.15.50:0/4036568158 learned_addr learned my addr 172.21.15.50:0/4036568158 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 -- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba80b8430 msgr2=0x7faba81f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba80b8430 0x7faba81f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 -- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba815cd60 msgr2=0x7faba8156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7faba6d9d640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba815cd60 0x7faba8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba815cd60 0x7faba8156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 -- 172.21.15.50:0/4036568158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980094d0 con 0x7faba80cddb0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.201+0000 7fab9ffff640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c7f0 tx=0x7fab9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.202+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90004220 con 0x7faba80cddb0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.202+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900043a0 con 0x7faba80cddb0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.202+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90007860 con 0x7faba80cddb0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.202+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba815d7a0 con 0x7faba80cddb0 2023-08-10T10:41:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.202+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba81f39b0 con 0x7faba80cddb0 2023-08-10T10:41:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.203+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba80d0bc0 con 0x7faba80cddb0 2023-08-10T10:41:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.204+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab90007bd0 con 0x7faba80cddb0 2023-08-10T10:41:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.205+0000 7fab9effd640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 0x7fab8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.205+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab90089570 con 0x7faba80cddb0 2023-08-10T10:41:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.205+0000 7faba659c640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 0x7fab8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.206+0000 7faba659c640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 0x7fab8806d110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fab98036000 tx=0x7fab9803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.209+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab90054580 con 0x7faba80cddb0 2023-08-10T10:41:45.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.440+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba815dfa0 con 0x7faba80cddb0 2023-08-10T10:41:45.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.441+0000 7fab9effd640 1 -- 172.21.15.50:0/4036568158 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7faba815dfa0 con 0x7faba80cddb0 2023-08-10T10:41:45.442 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:41:45.442 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:41:45.443 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:41:45.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 msgr2=0x7fab8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 0x7fab8806d110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fab98036000 tx=0x7fab9803b040 comp rx=0 tx=0).stop 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 msgr2=0x7faba8155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c7f0 tx=0x7fab9000ccb0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 shutdown_connections 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab8806ac50 0x7fab8806d110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba815cd60 0x7faba8156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faba80cddb0 0x7faba8155f00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 --2- 172.21.15.50:0/4036568158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba80b8430 0x7faba81f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:45.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 >> 172.21.15.50:0/4036568158 conn(0x7faba80d2ac0 msgr2=0x7faba80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:45.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 shutdown_connections 2023-08-10T10:41:45.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:41:45.444+0000 7fabac9cf640 1 -- 172.21.15.50:0/4036568158 wait complete. 2023-08-10T10:41:45.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:41:45.717 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":6138,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.780494452999999,"mdsmap_epoch":33,"osdmap_epoch":72,"osdmap_epoch_barrier":72,"uptime":16.664835227000001} 2023-08-10T10:41:45.717 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 6138, "mdsmap_epoch": 33, "osdmap_epoch": 72, "osdmap_epoch_barrier": 72, "rank_uptime": 10.780494453, "state": "up:active", "uptime": 16.664835227, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:41:45.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:41:45.965 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:41:45.966 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:41:45.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-10T10:41:46.205 INFO:teuthology.orchestra.run.smithi050.stdout:{"mon_tick_interval":"5"} 2023-08-10T10:41:46.205 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-10T10:41:46.205 INFO:tasks.cephfs.test_full:pool capacity 556930624, 531MB should be enough to fill it 2023-08-10T10:41:46.206 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:41:46.206 DEBUG:teuthology.orchestra.run.smithi050:> import time 2023-08-10T10:41:46.206 DEBUG:teuthology.orchestra.run.smithi050:> import datetime 2023-08-10T10:41:46.207 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-08-10T10:41:46.207 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:41:46.207 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.208 DEBUG:teuthology.orchestra.run.smithi050:> # Write some buffered data through before going full, all should be well 2023-08-10T10:41:46.208 DEBUG:teuthology.orchestra.run.smithi050:> print("writing some data through which we expect to succeed") 2023-08-10T10:41:46.208 DEBUG:teuthology.orchestra.run.smithi050:> bytes = 0 2023-08-10T10:41:46.208 DEBUG:teuthology.orchestra.run.smithi050:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-10T10:41:46.209 DEBUG:teuthology.orchestra.run.smithi050:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-10T10:41:46.209 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-08-10T10:41:46.209 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:41:46.209 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-10T10:41:46.210 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.210 DEBUG:teuthology.orchestra.run.smithi050:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-10T10:41:46.210 DEBUG:teuthology.orchestra.run.smithi050:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-10T10:41:46.211 DEBUG:teuthology.orchestra.run.smithi050:> # buffered IO, the error should always only appear from fsync and not 2023-08-10T10:41:46.211 DEBUG:teuthology.orchestra.run.smithi050:> # from write 2023-08-10T10:41:46.211 DEBUG:teuthology.orchestra.run.smithi050:> full = False 2023-08-10T10:41:46.211 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.212 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(531 * 0.9)): 2023-08-10T10:41:46.212 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:41:46.212 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-08-10T10:41:46.212 DEBUG:teuthology.orchestra.run.smithi050:> print("done writing {0} bytes".format(bytes)) 2023-08-10T10:41:46.213 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.213 DEBUG:teuthology.orchestra.run.smithi050:> # OK, now we should sneak in under the full condition 2023-08-10T10:41:46.213 DEBUG:teuthology.orchestra.run.smithi050:> # due to the time it takes the OSDs to report to the 2023-08-10T10:41:46.213 DEBUG:teuthology.orchestra.run.smithi050:> # mons, and get a successful fsync on our full-making data 2023-08-10T10:41:46.214 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:41:46.214 DEBUG:teuthology.orchestra.run.smithi050:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-08-10T10:41:46.214 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.215 DEBUG:teuthology.orchestra.run.smithi050:> # buffered write, add more dirty data to the buffer 2023-08-10T10:41:46.215 DEBUG:teuthology.orchestra.run.smithi050:> print("starting buffered write") 2023-08-10T10:41:46.215 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:41:46.215 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(531 * 0.2)): 2023-08-10T10:41:46.216 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:41:46.216 DEBUG:teuthology.orchestra.run.smithi050:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-10T10:41:46.216 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(15.0) 2023-08-10T10:41:46.216 DEBUG:teuthology.orchestra.run.smithi050:> except OSError: 2023-08-10T10:41:46.217 DEBUG:teuthology.orchestra.run.smithi050:> pass; 2023-08-10T10:41:46.217 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.217 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-08-10T10:41:46.217 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.218 DEBUG:teuthology.orchestra.run.smithi050:> # Wait long enough for a background flush that should fail 2023-08-10T10:41:46.218 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(30) 2023-08-10T10:41:46.218 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.219 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2023-08-10T10:41:46.219 DEBUG:teuthology.orchestra.run.smithi050:> # ...and check that the failed background flush is reflected in fclose 2023-08-10T10:41:46.219 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:41:46.219 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:41:46.220 DEBUG:teuthology.orchestra.run.smithi050:> except OSError: 2023-08-10T10:41:46.220 DEBUG:teuthology.orchestra.run.smithi050:> print("close() returned an error as expected") 2023-08-10T10:41:46.220 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:41:46.220 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("close() failed to raise error") 2023-08-10T10:41:46.221 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:41:46.221 DEBUG:teuthology.orchestra.run.smithi050:> # The kernel cephfs client does not raise errors on fclose 2023-08-10T10:41:46.221 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:41:46.221 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:41:46.222 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-10T10:41:46.222 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:41:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:writing some data through which we expect to succeed 2023-08-10T10:41:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-10T10:41:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-08-10T10:41:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-08-10T10:41:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-08-10T10:41:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-08-10T10:41:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-08-10T10:41:49.299 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-08-10T10:41:49.299 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-08-10T10:41:49.299 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-08-10T10:41:49.299 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-08-10T10:41:49.300 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-08-10T10:41:49.300 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-08-10T10:41:49.300 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-08-10T10:41:49.301 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-08-10T10:41:49.301 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-08-10T10:41:49.301 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-08-10T10:41:49.302 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-08-10T10:41:49.302 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-08-10T10:41:49.302 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-08-10T10:41:49.302 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-08-10T10:41:49.302 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-08-10T10:41:49.303 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-08-10T10:41:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-08-10T10:41:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-08-10T10:41:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-08-10T10:41:49.307 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-08-10T10:41:49.308 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-08-10T10:41:49.308 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-08-10T10:41:49.308 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-08-10T10:41:49.308 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-08-10T10:41:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-08-10T10:41:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-08-10T10:41:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-08-10T10:41:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-08-10T10:41:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-08-10T10:41:49.310 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-08-10T10:41:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-08-10T10:41:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-08-10T10:41:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-08-10T10:41:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-08-10T10:41:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-08-10T10:41:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-08-10T10:41:49.313 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-08-10T10:41:49.313 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-08-10T10:41:49.313 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-08-10T10:41:49.313 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-08-10T10:41:49.314 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-08-10T10:41:49.314 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-08-10T10:41:49.314 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-08-10T10:41:49.315 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-08-10T10:41:49.315 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-08-10T10:41:49.315 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-08-10T10:41:49.316 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-08-10T10:41:49.316 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-08-10T10:41:49.316 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-08-10T10:41:49.316 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-08-10T10:41:49.317 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-08-10T10:41:49.318 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-08-10T10:41:49.319 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-08-10T10:41:49.319 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-08-10T10:41:49.319 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-08-10T10:41:49.319 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-08-10T10:41:49.320 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-08-10T10:41:49.320 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-08-10T10:41:49.320 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-08-10T10:41:49.320 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-08-10T10:41:49.320 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-08-10T10:41:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-08-10T10:41:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-08-10T10:41:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-08-10T10:41:49.324 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-08-10T10:41:49.325 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-08-10T10:41:49.326 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-08-10T10:41:49.326 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-08-10T10:41:49.326 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-08-10T10:41:49.490 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-08-10T10:41:49.491 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-08-10T10:41:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-08-10T10:41:49.493 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-08-10T10:41:49.493 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-08-10T10:41:49.493 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-08-10T10:41:49.493 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-08-10T10:41:49.493 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-08-10T10:41:49.494 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-08-10T10:41:49.495 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-08-10T10:41:49.496 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-08-10T10:41:49.497 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-08-10T10:41:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-08-10T10:41:49.499 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-08-10T10:41:49.500 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-08-10T10:41:49.501 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-08-10T10:41:49.502 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-08-10T10:41:49.503 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-08-10T10:41:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-08-10T10:41:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-08-10T10:41:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-08-10T10:41:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-08-10T10:41:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-08-10T10:41:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-08-10T10:41:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-08-10T10:41:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-08-10T10:41:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-08-10T10:41:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-08-10T10:41:49.511 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-08-10T10:41:49.512 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-08-10T10:41:49.513 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-08-10T10:41:49.513 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-08-10T10:41:49.513 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-08-10T10:41:49.513 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-08-10T10:41:49.683 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-08-10T10:41:49.683 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-08-10T10:41:49.683 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-08-10T10:41:49.683 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-08-10T10:41:49.683 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-08-10T10:41:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-08-10T10:41:49.685 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-08-10T10:41:49.686 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-08-10T10:41:49.687 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-08-10T10:41:49.688 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-08-10T10:41:49.689 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-08-10T10:41:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-08-10T10:41:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-08-10T10:41:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-08-10T10:41:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-08-10T10:41:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-08-10T10:41:49.695 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-08-10T10:41:49.696 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-08-10T10:41:49.697 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-08-10T10:41:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-08-10T10:41:49.699 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-08-10T10:41:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-08-10T10:41:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-08-10T10:41:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-08-10T10:41:49.703 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-08-10T10:41:49.703 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-08-10T10:41:49.703 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-08-10T10:41:53.480 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:41:53.479+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-10T10:42:01.425 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:42:01.424+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-08-10T10:42:12.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:12.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:14.450 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:42:14.449+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-08-10T10:42:42.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:42.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:42:50.883 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-08-10T10:42:50.883 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-08-10T10:42:50.883 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-08-10T10:42:50.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-08-10T10:42:50.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-08-10T10:42:50.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-08-10T10:42:50.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-08-10T10:42:50.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-08-10T10:42:50.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-08-10T10:42:50.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-08-10T10:42:50.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-08-10T10:42:50.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-08-10T10:42:50.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-08-10T10:42:50.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-08-10T10:42:50.887 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-08-10T10:42:50.887 INFO:teuthology.orchestra.run.smithi050.stdout:done writing 500695040 bytes 2023-08-10T10:42:50.887 INFO:teuthology.orchestra.run.smithi050.stdout:successfully fsync'ed prior to getting full state reported 2023-08-10T10:42:50.887 INFO:teuthology.orchestra.run.smithi050.stdout:starting buffered write 2023-08-10T10:42:50.888 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:42:50.888 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:42:50.888 INFO:teuthology.orchestra.run.smithi050.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-08-10T10:42:51.066 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:42:51.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:42:51.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:42:51.325 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:42:51.326 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:42:51.326 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:51.391 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:42:51.392 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:51.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:42:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.685+0000 7f0d09afb640 1 Processor -- start 2023-08-10T10:42:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.685+0000 7f0d09afb640 1 -- start start 2023-08-10T10:42:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0d09afb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0d040b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0d09afb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d040cfd40 0x7f0d040b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0d09afb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0415d010 con 0x7f0d04153c30 2023-08-10T10:42:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0d09afb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0415d290 con 0x7f0d040cfd40 2023-08-10T10:42:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0d09afb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415d570 con 0x7f0d04153850 2023-08-10T10:42:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0cfbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0d04153c30 0x7f0d040cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59024/0 (socket says 172.21.15.50:59024) 2023-08-10T10:42:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.687+0000 7f0cfbfff640 1 -- 172.21.15.50:0/791564052 learned_addr learned my addr 172.21.15.50:0/791564052 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0d08af9640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0d040b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0d092fa640 1 --2- 172.21.15.50:0/791564052 >> v2:172.21.15.117:3300/0 conn(0x7f0d040cfd40 0x7f0d040b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387354867 0 0) 0x7f0d0415d010 con 0x7f0d04153c30 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003520 con 0x7f0d04153c30 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 846748576 0 0) 0x7f0cec003520 con 0x7f0d04153c30 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 msgr2=0x7f0d040b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0d040b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 >> v2:172.21.15.117:3300/0 conn(0x7f0d040cfd40 msgr2=0x7f0d040b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 --2- 172.21.15.50:0/791564052 >> v2:172.21.15.117:3300/0 conn(0x7f0d040cfd40 0x7f0d040b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0415d850 con 0x7f0d04153c30 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0cf4001670 con 0x7f0d04153c30 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 >> v1:172.21.15.50:6789/0 conn(0x7f0d04153c30 legacy=0x7f0d040cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0cec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.688+0000 7f0cfb7fe640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec003f60 0x7f0cec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0cfb7fe640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cec004d00 0x7f0cec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415d290 con 0x7f0cec004d00 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415d570 con 0x7f0cec003f60 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec00b9b0 con 0x7f0d04153850 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cec004d00 0x7f0cec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0cfbfff640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec003f60 0x7f0cec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d08af9640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0cec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 -- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 msgr2=0x7f0cec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d04153850 0x7f0cec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 -- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec003f60 msgr2=0x7f0cec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec003f60 0x7f0cec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.689+0000 7f0d092fa640 1 -- 172.21.15.50:0/791564052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec003520 con 0x7f0cec004d00 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0d092fa640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cec004d00 0x7f0cec005180 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0d040d38a0 tx=0x7f0cec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcb9cd0c21ca675 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc02cbd0 con 0x7f0cec004d00 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00f040 con 0x7f0cec004d00 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0cfb7fe640 1 -- 172.21.15.50:0/791564052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc034440 con 0x7f0cec004d00 2023-08-10T10:42:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0d09afb640 1 -- 172.21.15.50:0/791564052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cec004d00 msgr2=0x7f0cec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0d09afb640 1 --2- 172.21.15.50:0/791564052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cec004d00 0x7f0cec005180 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0d040d38a0 tx=0x7f0cec0057f0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.691+0000 7f0d092fa640 1 -- 172.21.15.50:0/791564052 reap_dead start 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.692+0000 7f0d09afb640 1 -- 172.21.15.50:0/791564052 shutdown_connections 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.692+0000 7f0d09afb640 1 -- 172.21.15.50:0/791564052 >> 172.21.15.50:0/791564052 conn(0x7f0d04069880 msgr2=0x7f0d04069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.692+0000 7f0d09afb640 1 -- 172.21.15.50:0/791564052 shutdown_connections 2023-08-10T10:42:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.692+0000 7f0d09afb640 1 -- 172.21.15.50:0/791564052 wait complete. 2023-08-10T10:42:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.693+0000 7f0d09afb640 1 Processor -- start 2023-08-10T10:42:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.694+0000 7f0d09afb640 1 -- start start 2023-08-10T10:42:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec004d00 0x7f0d040d0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d040d0ec0 0x7f0d0414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040ca7b0 con 0x7f0d0414dd80 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0414e210 con 0x7f0cec004d00 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d09afb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c9b30 con 0x7f0d040d0ec0 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43658/0 (socket says 172.21.15.50:43658) 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 -- 172.21.15.50:0/2181487126 learned_addr learned my addr 172.21.15.50:0/2181487126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d08af9640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec004d00 0x7f0d040d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0cfbfff640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d040d0ec0 0x7f0d0414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 -- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d040d0ec0 msgr2=0x7f0d0414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d040d0ec0 0x7f0d0414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 -- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec004d00 msgr2=0x7f0d040d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec004d00 0x7f0d040d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.695+0000 7f0d092fa640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040c9e10 con 0x7f0d0414dd80 2023-08-10T10:42:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0d092fa640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc037040 tx=0x7f0cfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc034b40 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc034cc0 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc03e680 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d040ca0f0 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.696+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040c69b0 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.697+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d040ca8f0 con 0x7f0d0414dd80 2023-08-10T10:42:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.698+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cfc03e7e0 con 0x7f0d0414dd80 2023-08-10T10:42:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.699+0000 7f0cf97fa640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 0x7f0cf006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.699+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0cfc0abb90 con 0x7f0d0414dd80 2023-08-10T10:42:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.700+0000 7f0d08af9640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 0x7f0cf006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.700+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f0cf0072f80 con 0x7f0d0414dd80 2023-08-10T10:42:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.700+0000 7f0d08af9640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 0x7f0cf006d110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009a10 tx=0x7f0d00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.704+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0cfc042060 con 0x7f0d0414dd80 2023-08-10T10:42:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.896+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d04066e30 con 0x7f0d0414dd80 2023-08-10T10:42:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.900+0000 7f0cf97fa640 1 -- 172.21.15.50:0/2181487126 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18592 (secure 0 0 0) 0x7f0cfc039070 con 0x7f0d0414dd80 2023-08-10T10:42:51.901 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:42:51.901 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:42:09.449619+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:42:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.902+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 msgr2=0x7f0cf006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.902+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 0x7f0cf006d110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009a10 tx=0x7f0d00008040 comp rx=0 tx=0).stop 2023-08-10T10:42:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.902+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 msgr2=0x7f0d041e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:51.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.902+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc037040 tx=0x7f0cfc009750 comp rx=0 tx=0).stop 2023-08-10T10:42:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 shutdown_connections 2023-08-10T10:42:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0414dd80 0x7f0d041e84b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d040d0ec0 0x7f0d0414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cf006ac50 0x7f0cf006d110 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 --2- 172.21.15.50:0/2181487126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cec004d00 0x7f0d040d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 >> 172.21.15.50:0/2181487126 conn(0x7f0d04069880 msgr2=0x7f0d04160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 shutdown_connections 2023-08-10T10:42:51.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:51.903+0000 7f0d09afb640 1 -- 172.21.15.50:0/2181487126 wait complete. 2023-08-10T10:42:51.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:41:32.815026+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:41:33.402009+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:42:51.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:42:52.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.154+0000 7f992c976640 1 Processor -- start 2023-08-10T10:42:52.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.154+0000 7f992c976640 1 -- start start 2023-08-10T10:42:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f992c976640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280ce740 0x7f99280afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f992c976640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280ceb70 con 0x7f99280cf650 2023-08-10T10:42:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f992c976640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280ccae0 con 0x7f992815ae30 2023-08-10T10:42:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f992c976640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280cc240 con 0x7f99280ce740 2023-08-10T10:42:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f991dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99280cf650 0x7f992806d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59026/0 (socket says 172.21.15.50:59026) 2023-08-10T10:42:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.156+0000 7f991dd9b640 1 -- 172.21.15.50:0/2131020344 learned_addr learned my addr 172.21.15.50:0/2131020344 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280ce740 0x7f99280afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189785280 0 0) 0x7f99280ceb70 con 0x7f99280cf650 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9914003520 con 0x7f99280cf650 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293598853 0 0) 0x7f9914003520 con 0x7f99280cf650 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280ce740 msgr2=0x7f99280afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280ce740 0x7f99280afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 >> v1:172.21.15.117:6789/0 conn(0x7f992815ae30 legacy=0x7f99280cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280cc520 con 0x7f99280cf650 2023-08-10T10:42:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9910001690 con 0x7f99280cf650 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 >> v1:172.21.15.50:6789/0 conn(0x7f99280cf650 legacy=0x7f992806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99140039a0 0x7f9914003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.157+0000 7f9925d9b640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9914004390 0x7f9914004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9925d9b640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f991400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280cc240 con 0x7f9914005060 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991400bf70 con 0x7f9914004390 2023-08-10T10:42:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991400c130 con 0x7f99140039a0 2023-08-10T10:42:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f991400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f991dd9b640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9914004390 0x7f9914004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f992659c640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99140039a0 0x7f9914003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 -- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99140039a0 msgr2=0x7f9914003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99140039a0 0x7f9914003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 -- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9914004390 msgr2=0x7f9914004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9914004390 0x7f9914004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.158+0000 7f9926d9d640 1 -- 172.21.15.50:0/2131020344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914003520 con 0x7f9914005060 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.159+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f991400b980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f99280ceb20 tx=0x7f99140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693bfd5f1e008ea6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992002c580 con 0x7f9914005060 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992002c6e0 con 0x7f9914005060 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f9925d9b640 1 -- 172.21.15.50:0/2131020344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992002ca50 con 0x7f9914005060 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f992c976640 1 -- 172.21.15.50:0/2131020344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 msgr2=0x7f991400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f992c976640 1 --2- 172.21.15.50:0/2131020344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f991400b980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f99280ceb20 tx=0x7f99140057f0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.160+0000 7f9926d9d640 1 -- 172.21.15.50:0/2131020344 reap_dead start 2023-08-10T10:42:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.161+0000 7f992c976640 1 -- 172.21.15.50:0/2131020344 shutdown_connections 2023-08-10T10:42:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.161+0000 7f992c976640 1 -- 172.21.15.50:0/2131020344 >> 172.21.15.50:0/2131020344 conn(0x7f99280d0960 msgr2=0x7f99280d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.161+0000 7f992c976640 1 -- 172.21.15.50:0/2131020344 shutdown_connections 2023-08-10T10:42:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.161+0000 7f992c976640 1 -- 172.21.15.50:0/2131020344 wait complete. 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.162+0000 7f992c976640 1 Processor -- start 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 -- start start 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280b0150 0x7f99280b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99280c8bb0 0x7f99280c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b1a20 con 0x7f9914005060 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b0b10 con 0x7f99280c8bb0 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.163+0000 7f992c976640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b0da0 con 0x7f99280b0150 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43676/0 (socket says 172.21.15.50:43676) 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 -- 172.21.15.50:0/2311202057 learned_addr learned my addr 172.21.15.50:0/2311202057 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f991dd9b640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280b0150 0x7f99280b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f9926d9d640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99280c8bb0 0x7f99280c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 -- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280b0150 msgr2=0x7f99280b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280b0150 0x7f99280b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 -- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99280c8bb0 msgr2=0x7f99280c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99280c8bb0 0x7f99280c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.164+0000 7f992659c640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280b1080 con 0x7f9914005060 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f992659c640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f991800e8f0 tx=0x7f991800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918003bd0 con 0x7f9914005060 2023-08-10T10:42:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918003d30 con 0x7f9914005060 2023-08-10T10:42:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918003ea0 con 0x7f9914005060 2023-08-10T10:42:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280b1360 con 0x7f9914005060 2023-08-10T10:42:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.165+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99280b28c0 con 0x7f9914005060 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.166+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99280b4380 con 0x7f9914005060 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.167+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f991800c8e0 con 0x7f9914005060 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.168+0000 7f991f7fe640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 0x7f990806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.168+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f99180896a0 con 0x7f9914005060 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.168+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f9908072fb0 con 0x7f9914005060 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.168+0000 7f991dd9b640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 0x7f990806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.169+0000 7f991dd9b640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 0x7f990806d140 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f99280ca750 tx=0x7f9910009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.172+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f99180546b0 con 0x7f9914005060 2023-08-10T10:42:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.363+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99280b2a50 con 0x7f9914005060 2023-08-10T10:42:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.364+0000 7f991f7fe640 1 -- 172.21.15.50:0/2311202057 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9918057cd0 con 0x7f9914005060 2023-08-10T10:42:52.365 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:42:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.366+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 msgr2=0x7f990806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.366+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 0x7f990806d140 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f99280ca750 tx=0x7f9910009040 comp rx=0 tx=0).stop 2023-08-10T10:42:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.366+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 msgr2=0x7f99280b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.366+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f991800e8f0 tx=0x7f991800edb0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 shutdown_connections 2023-08-10T10:42:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f990806ac80 0x7f990806d140 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99280c8bb0 0x7f99280c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99280b0150 0x7f99280b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 --2- 172.21.15.50:0/2311202057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914005060 0x7f99280b2380 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 >> 172.21.15.50:0/2311202057 conn(0x7f99280d0960 msgr2=0x7f99280cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 shutdown_connections 2023-08-10T10:42:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.367+0000 7f992c976640 1 -- 172.21.15.50:0/2311202057 wait complete. 2023-08-10T10:42:52.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:42:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.603+0000 7efec9c6a640 1 Processor -- start 2023-08-10T10:42:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.603+0000 7efec9c6a640 1 -- start start 2023-08-10T10:42:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.605+0000 7efec9c6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efec415fde0 0x7efec406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.605+0000 7efec9c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.605+0000 7efec9c6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec406a5c0 con 0x7efec40b1e00 2023-08-10T10:42:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.605+0000 7efec9c6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec406b0c0 con 0x7efec415fde0 2023-08-10T10:42:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.605+0000 7efec9c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec406a820 con 0x7efec40cd660 2023-08-10T10:42:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.606+0000 7efec9469640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.606+0000 7efec8c68640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efec415fde0 0x7efec406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.606+0000 7efec9469640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:58502/0 (socket says 172.21.15.50:58502) 2023-08-10T10:42:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.606+0000 7efec9469640 1 -- 172.21.15.50:0/2006283541 learned_addr learned my addr 172.21.15.50:0/2006283541 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.607+0000 7efebb7fe640 1 -- 172.21.15.50:0/2006283541 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276667909 0 0) 0x7efec406a5c0 con 0x7efec40b1e00 2023-08-10T10:42:52.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.607+0000 7efec9469640 1 -- 172.21.15.50:0/2006283541 >> v2:172.21.15.117:3300/0 conn(0x7efec415fde0 msgr2=0x7efec406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:52.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.607+0000 7efec9469640 1 --2- 172.21.15.50:0/2006283541 >> v2:172.21.15.117:3300/0 conn(0x7efec415fde0 0x7efec406a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.607+0000 7efec9469640 1 -- 172.21.15.50:0/2006283541 >> v1:172.21.15.117:6789/0 conn(0x7efec40b1e00 legacy=0x7efec40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.607+0000 7efec9469640 1 -- 172.21.15.50:0/2006283541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec406ab00 con 0x7efec40cd660 2023-08-10T10:42:52.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.609+0000 7efec9469640 1 --2- 172.21.15.50:0/2006283541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=131b23aae91925ae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.609+0000 7efebb7fe640 1 -- 172.21.15.50:0/2006283541 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0317c0 con 0x7efec40cd660 2023-08-10T10:42:52.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.609+0000 7efebb7fe640 1 -- 172.21.15.50:0/2006283541 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc031920 con 0x7efec40cd660 2023-08-10T10:42:52.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.609+0000 7efebb7fe640 1 -- 172.21.15.50:0/2006283541 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc031cb0 con 0x7efec40cd660 2023-08-10T10:42:52.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 -- 172.21.15.50:0/2006283541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 msgr2=0x7efec40d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 --2- 172.21.15.50:0/2006283541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc02b860 comp rx=0 tx=0).stop 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 -- 172.21.15.50:0/2006283541 shutdown_connections 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 --2- 172.21.15.50:0/2006283541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cd660 0x7efec40d0b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 --2- 172.21.15.50:0/2006283541 >> v2:172.21.15.117:3300/0 conn(0x7efec415fde0 0x7efec406a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 -- 172.21.15.50:0/2006283541 >> 172.21.15.50:0/2006283541 conn(0x7efec40d2900 msgr2=0x7efec40d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 -- 172.21.15.50:0/2006283541 shutdown_connections 2023-08-10T10:42:52.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.610+0000 7efec9c6a640 1 -- 172.21.15.50:0/2006283541 wait complete. 2023-08-10T10:42:52.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.613+0000 7efec9c6a640 1 Processor -- start 2023-08-10T10:42:52.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.613+0000 7efec9c6a640 1 -- start start 2023-08-10T10:42:52.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40b1e00 0x7efec414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec415fde0 0x7efec40cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40ca690 con 0x7efec40cd660 2023-08-10T10:42:52.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b6c30 con 0x7efec415fde0 2023-08-10T10:42:52.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.614+0000 7efec9c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b6950 con 0x7efec40b1e00 2023-08-10T10:42:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.615+0000 7efebbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.615+0000 7efebbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43692/0 (socket says 172.21.15.50:43692) 2023-08-10T10:42:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.615+0000 7efebbfff640 1 -- 172.21.15.50:0/1170723507 learned_addr learned my addr 172.21.15.50:0/1170723507 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.615+0000 7efec8c68640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40b1e00 0x7efec414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.615+0000 7efec9469640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec415fde0 0x7efec40cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 -- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40b1e00 msgr2=0x7efec414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40b1e00 0x7efec414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 -- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec415fde0 msgr2=0x7efec40cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec415fde0 0x7efec40cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0094d0 con 0x7efec40cd660 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efebbfff640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efeb400c410 tx=0x7efeb400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40035f0 con 0x7efec40cd660 2023-08-10T10:42:52.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4003770 con 0x7efec40cd660 2023-08-10T10:42:52.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4003b20 con 0x7efec40cd660 2023-08-10T10:42:52.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.616+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40ca040 con 0x7efec40cd660 2023-08-10T10:42:52.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.617+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40cdfc0 con 0x7efec40cd660 2023-08-10T10:42:52.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.618+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40ca800 con 0x7efec40cd660 2023-08-10T10:42:52.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.619+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efeb4003c80 con 0x7efec40cd660 2023-08-10T10:42:52.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.620+0000 7efeb97fa640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 0x7efeb006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:52.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.620+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7efeb4088b00 con 0x7efec40cd660 2023-08-10T10:42:52.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.620+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7efeb0072f80 con 0x7efec40cd660 2023-08-10T10:42:52.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.620+0000 7efec8c68640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 0x7efeb006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:52.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.621+0000 7efec8c68640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 0x7efeb006d110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efec00113e0 tx=0x7efec000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:52.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.625+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efeb4017060 con 0x7efec40cd660 2023-08-10T10:42:52.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.819+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efec4066e30 con 0x7efec40cd660 2023-08-10T10:42:52.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.820+0000 7efeb97fa640 1 -- 172.21.15.50:0/1170723507 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7efeb408ae60 con 0x7efec40cd660 2023-08-10T10:42:52.821 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:42:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 msgr2=0x7efeb006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 0x7efeb006d110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efec00113e0 tx=0x7efec000b040 comp rx=0 tx=0).stop 2023-08-10T10:42:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 msgr2=0x7efec414ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efeb400c410 tx=0x7efeb400c8d0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 shutdown_connections 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efeb006ac50 0x7efeb006d110 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec415fde0 0x7efec40cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cd660 0x7efec414ecc0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 --2- 172.21.15.50:0/1170723507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40b1e00 0x7efec414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 >> 172.21.15.50:0/1170723507 conn(0x7efec40d2900 msgr2=0x7efec415ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.823+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 shutdown_connections 2023-08-10T10:42:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:52.824+0000 7efec9c6a640 1 -- 172.21.15.50:0/1170723507 wait complete. 2023-08-10T10:42:52.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:42:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.067+0000 7f9a254c2640 1 Processor -- start 2023-08-10T10:42:53.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.068+0000 7f9a254c2640 1 -- start start 2023-08-10T10:42:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.069+0000 7f9a254c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a200b2190 0x7f9a200b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.069+0000 7f9a254c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.069+0000 7f9a254c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200cf260 con 0x7f9a200cfc00 2023-08-10T10:42:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.069+0000 7f9a254c2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200b2ab0 con 0x7f9a200b2190 2023-08-10T10:42:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.069+0000 7f9a254c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200ce650 con 0x7f9a200d0090 2023-08-10T10:42:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.070+0000 7f9a24cc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.070+0000 7f9a24cc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:58526/0 (socket says 172.21.15.50:58526) 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.070+0000 7f9a24cc1640 1 -- 172.21.15.50:0/1419309206 learned_addr learned my addr 172.21.15.50:0/1419309206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.070+0000 7f9a1ffff640 1 --2- 172.21.15.50:0/1419309206 >> v2:172.21.15.117:3300/0 conn(0x7f9a200b2190 0x7f9a200b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.071+0000 7f9a24cc1640 1 -- 172.21.15.50:0/1419309206 >> v2:172.21.15.117:3300/0 conn(0x7f9a200b2190 msgr2=0x7f9a200b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.071+0000 7f9a24cc1640 1 --2- 172.21.15.50:0/1419309206 >> v2:172.21.15.117:3300/0 conn(0x7f9a200b2190 0x7f9a200b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.071+0000 7f9a24cc1640 1 -- 172.21.15.50:0/1419309206 >> v1:172.21.15.117:6789/0 conn(0x7f9a200cfc00 legacy=0x7f9a20070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.071+0000 7f9a24cc1640 1 -- 172.21.15.50:0/1419309206 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200ce930 con 0x7f9a200d0090 2023-08-10T10:42:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.072+0000 7f9a24cc1640 1 --2- 172.21.15.50:0/1419309206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009e50 tx=0x7f9a1802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94e0b31004c1a6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.073+0000 7f9a1effd640 1 -- 172.21.15.50:0/1419309206 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1802ca70 con 0x7f9a200d0090 2023-08-10T10:42:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.073+0000 7f9a1effd640 1 -- 172.21.15.50:0/1419309206 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1802cbd0 con 0x7f9a200d0090 2023-08-10T10:42:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.073+0000 7f9a1effd640 1 -- 172.21.15.50:0/1419309206 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180343f0 con 0x7f9a200d0090 2023-08-10T10:42:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.073+0000 7f9a254c2640 1 -- 172.21.15.50:0/1419309206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 msgr2=0x7f9a200712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.073+0000 7f9a254c2640 1 --2- 172.21.15.50:0/1419309206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009e50 tx=0x7f9a1802bed0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 -- 172.21.15.50:0/1419309206 shutdown_connections 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 --2- 172.21.15.50:0/1419309206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200d0090 0x7f9a200712d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 --2- 172.21.15.50:0/1419309206 >> v2:172.21.15.117:3300/0 conn(0x7f9a200b2190 0x7f9a200b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 -- 172.21.15.50:0/1419309206 >> 172.21.15.50:0/1419309206 conn(0x7f9a200cd190 msgr2=0x7f9a200cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 -- 172.21.15.50:0/1419309206 shutdown_connections 2023-08-10T10:42:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.074+0000 7f9a254c2640 1 -- 172.21.15.50:0/1419309206 wait complete. 2023-08-10T10:42:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.076+0000 7f9a254c2640 1 Processor -- start 2023-08-10T10:42:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.077+0000 7f9a254c2640 1 -- start start 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200b2190 0x7f9a2015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a200d0090 0x7f9a200c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015e880 con 0x7f9a200cfc00 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015ad20 con 0x7f9a200d0090 2023-08-10T10:42:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.078+0000 7f9a254c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200c9110 con 0x7f9a200b2190 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43696/0 (socket says 172.21.15.50:43696) 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 -- 172.21.15.50:0/3540652758 learned_addr learned my addr 172.21.15.50:0/3540652758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1ffff640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200b2190 0x7f9a2015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a24cc1640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a200d0090 0x7f9a200c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 -- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200b2190 msgr2=0x7f9a2015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200b2190 0x7f9a2015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 -- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a200d0090 msgr2=0x7f9a200c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a200d0090 0x7f9a200c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.079+0000 7f9a1f7fe640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009b30 con 0x7f9a200cfc00 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a1f7fe640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c400 tx=0x7f9a1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140052d0 con 0x7f9a200cfc00 2023-08-10T10:42:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14005430 con 0x7f9a200cfc00 2023-08-10T10:42:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003830 con 0x7f9a200cfc00 2023-08-10T10:42:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200c93f0 con 0x7f9a200cfc00 2023-08-10T10:42:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.080+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a200c57c0 con 0x7f9a200cfc00 2023-08-10T10:42:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.082+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200d0510 con 0x7f9a200cfc00 2023-08-10T10:42:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.083+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a14003990 con 0x7f9a200cfc00 2023-08-10T10:42:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.083+0000 7f9a1cff9640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 0x7f9a0c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.084+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9a14088b30 con 0x7f9a200cfc00 2023-08-10T10:42:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.084+0000 7f9a1ffff640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 0x7f9a0c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.084+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f9a0c072fb0 con 0x7f9a200cfc00 2023-08-10T10:42:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.084+0000 7f9a1ffff640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 0x7f9a0c06d140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009a30 tx=0x7f9a10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.090+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a14053ab0 con 0x7f9a200cfc00 2023-08-10T10:42:53.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.280+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a20066e30 con 0x7f9a200cfc00 2023-08-10T10:42:53.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.281+0000 7f9a1cff9640 1 -- 172.21.15.50:0/3540652758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a14017070 con 0x7f9a200cfc00 2023-08-10T10:42:53.281 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 msgr2=0x7f9a0c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 0x7f9a0c06d140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009a30 tx=0x7f9a10008040 comp rx=0 tx=0).stop 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 msgr2=0x7f9a200c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c400 tx=0x7f9a1400c8c0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 shutdown_connections 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9a0c06ac80 0x7f9a0c06d140 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a200d0090 0x7f9a200c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a200cfc00 0x7f9a200c5280 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 --2- 172.21.15.50:0/3540652758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a200b2190 0x7f9a2015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.283+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 >> 172.21.15.50:0/3540652758 conn(0x7f9a200cd190 msgr2=0x7f9a200b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.284+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 shutdown_connections 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.284+0000 7f9a254c2640 1 -- 172.21.15.50:0/3540652758 wait complete. 2023-08-10T10:42:53.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:42:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.541+0000 7f0a40d3d640 1 Processor -- start 2023-08-10T10:42:53.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.542+0000 7f0a40d3d640 1 -- start start 2023-08-10T10:42:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a40d3d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3c1583c0 0x7f0a3c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a40d3d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a3c069db0 0x7f0a3c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a40d3d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c15aee0 con 0x7f0a3c0b1ba0 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a40d3d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b2100 con 0x7f0a3c1583c0 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a40d3d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c15b1a0 con 0x7f0a3c069db0 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a3b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3c1583c0 0x7f0a3c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a33fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a3c0b1ba0 0x7f0a3c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59028/0 (socket says 172.21.15.50:59028) 2023-08-10T10:42:53.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a3b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3c1583c0 0x7f0a3c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43708/0 (socket says 172.21.15.50:43708) 2023-08-10T10:42:53.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.543+0000 7f0a33fff640 1 -- 172.21.15.50:0/2716383794 learned_addr learned my addr 172.21.15.50:0/2716383794 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3bfff640 1 --2- 172.21.15.50:0/2716383794 >> v2:172.21.15.117:3300/0 conn(0x7f0a3c069db0 0x7f0a3c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/2716383794 >> v2:172.21.15.117:3300/0 conn(0x7f0a3c069db0 msgr2=0x7f0a3c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3b7fe640 1 --2- 172.21.15.50:0/2716383794 >> v2:172.21.15.117:3300/0 conn(0x7f0a3c069db0 0x7f0a3c15e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/2716383794 >> v1:172.21.15.50:6789/0 conn(0x7f0a3c0b1ba0 legacy=0x7f0a3c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/2716383794 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c15b480 con 0x7f0a3c1583c0 2023-08-10T10:42:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.544+0000 7f0a3affd640 1 -- 172.21.15.50:0/2716383794 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64004925 0 0) 0x7f0a3c15aee0 con 0x7f0a3c0b1ba0 2023-08-10T10:42:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.545+0000 7f0a3b7fe640 1 --2- 172.21.15.50:0/2716383794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c1583c0 0x7f0a3c0b1660 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06cdf0 tx=0x7f0a2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cf4b56cb7abc34 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.545+0000 7f0a3affd640 1 -- 172.21.15.50:0/2716383794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c031830 con 0x7f0a3c1583c0 2023-08-10T10:42:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.545+0000 7f0a3affd640 1 -- 172.21.15.50:0/2716383794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c031990 con 0x7f0a3c1583c0 2023-08-10T10:42:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.545+0000 7f0a3affd640 1 -- 172.21.15.50:0/2716383794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c031d20 con 0x7f0a3c1583c0 2023-08-10T10:42:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 -- 172.21.15.50:0/2716383794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c1583c0 msgr2=0x7f0a3c0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/2716383794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c1583c0 0x7f0a3c0b1660 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06cdf0 tx=0x7f0a2c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 -- 172.21.15.50:0/2716383794 shutdown_connections 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/2716383794 >> v2:172.21.15.117:3300/0 conn(0x7f0a3c069db0 0x7f0a3c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/2716383794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c1583c0 0x7f0a3c0b1660 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 -- 172.21.15.50:0/2716383794 >> 172.21.15.50:0/2716383794 conn(0x7f0a3c0caf80 msgr2=0x7f0a3c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 -- 172.21.15.50:0/2716383794 shutdown_connections 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.546+0000 7f0a40d3d640 1 -- 172.21.15.50:0/2716383794 wait complete. 2023-08-10T10:42:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.548+0000 7f0a40d3d640 1 Processor -- start 2023-08-10T10:42:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.548+0000 7f0a40d3d640 1 -- start start 2023-08-10T10:42:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3c0b1ba0 0x7f0a3c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a3c1583c0 0x7f0a3c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c06fed0 con 0x7f0a3c069db0 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c06f2c0 con 0x7f0a3c0b1ba0 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a40d3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c06f5a0 con 0x7f0a3c1583c0 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43718/0 (socket says 172.21.15.50:43718) 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.549+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/3444393701 learned_addr learned my addr 172.21.15.50:0/3444393701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a33fff640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3c0b1ba0 0x7f0a3c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3bfff640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a3c1583c0 0x7f0a3c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a3c1583c0 msgr2=0x7f0a3c1587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a3c1583c0 0x7f0a3c1587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3c0b1ba0 msgr2=0x7f0a3c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3c0b1ba0 0x7f0a3c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c009400 con 0x7f0a3c069db0 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.550+0000 7f0a3b7fe640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009890 tx=0x7f0a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.551+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004230 con 0x7f0a3c069db0 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.551+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c004390 con 0x7f0a3c069db0 2023-08-10T10:42:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.551+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c03a940 con 0x7f0a3c069db0 2023-08-10T10:42:53.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.551+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c06f880 con 0x7f0a3c069db0 2023-08-10T10:42:53.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.551+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c070360 con 0x7f0a3c069db0 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.552+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c066e30 con 0x7f0a3c069db0 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.553+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a2c03aaa0 con 0x7f0a3c069db0 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.554+0000 7f0a38ff9640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 0x7f0a1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.554+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0a2c0abe20 con 0x7f0a3c069db0 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.554+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f0a1c072f80 con 0x7f0a3c069db0 2023-08-10T10:42:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.554+0000 7f0a33fff640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 0x7f0a1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.555+0000 7f0a33fff640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 0x7f0a1c06d110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0cef70 tx=0x7f0a24007b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.559+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0a2c035070 con 0x7f0a3c069db0 2023-08-10T10:42:53.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.749+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a3c073380 con 0x7f0a3c069db0 2023-08-10T10:42:53.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.750+0000 7f0a38ff9640 1 -- 172.21.15.50:0/3444393701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a2c076d10 con 0x7f0a3c069db0 2023-08-10T10:42:53.751 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 msgr2=0x7f0a1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 0x7f0a1c06d110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0cef70 tx=0x7f0a24007b70 comp rx=0 tx=0).stop 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 msgr2=0x7f0a3c156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009890 tx=0x7f0a2c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 shutdown_connections 2023-08-10T10:42:53.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a3c1583c0 0x7f0a3c1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0a1c06ac50 0x7f0a1c06d110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3c0b1ba0 0x7f0a3c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 --2- 172.21.15.50:0/3444393701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c069db0 0x7f0a3c156a20 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 >> 172.21.15.50:0/3444393701 conn(0x7f0a3c0caf80 msgr2=0x7f0a3c0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 shutdown_connections 2023-08-10T10:42:53.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:53.753+0000 7f0a40d3d640 1 -- 172.21.15.50:0/3444393701 wait complete. 2023-08-10T10:42:53.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:42:54.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.003+0000 7f8edc9ab640 1 Processor -- start 2023-08-10T10:42:54.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.003+0000 7f8edc9ab640 1 -- start start 2023-08-10T10:42:54.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8edc9ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ed80696a0 0x7f8ed80b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8edc9ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ed8069a80 0x7f8ed80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8edc9ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80b2280 con 0x7f8ed815ad00 2023-08-10T10:42:54.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8edc9ab640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80b19e0 con 0x7f8ed80696a0 2023-08-10T10:42:54.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8edc9ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80b1cc0 con 0x7f8ed8069a80 2023-08-10T10:42:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.005+0000 7f8ed77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ed80696a0 0x7f8ed80b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ed815ad00 0x7f8ed80cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59042/0 (socket says 172.21.15.50:59042) 2023-08-10T10:42:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed6ffd640 1 -- 172.21.15.50:0/1485816234 learned_addr learned my addr 172.21.15.50:0/1485816234 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed7fff640 1 --2- 172.21.15.50:0/1485816234 >> v2:172.21.15.117:3300/0 conn(0x7f8ed8069a80 0x7f8ed80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1485816234 >> v2:172.21.15.117:3300/0 conn(0x7f8ed8069a80 msgr2=0x7f8ed80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed77fe640 1 --2- 172.21.15.50:0/1485816234 >> v2:172.21.15.117:3300/0 conn(0x7f8ed8069a80 0x7f8ed80ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1485816234 >> v1:172.21.15.50:6789/0 conn(0x7f8ed815ad00 legacy=0x7f8ed80cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.006+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1485816234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80b1fa0 con 0x7f8ed80696a0 2023-08-10T10:42:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.007+0000 7f8ed77fe640 1 --2- 172.21.15.50:0/1485816234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed80b1370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80cc000 tx=0x7f8ec802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ea26b1117f8129 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.008+0000 7f8ed67fc640 1 -- 172.21.15.50:0/1485816234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec802e070 con 0x7f8ed80696a0 2023-08-10T10:42:54.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.008+0000 7f8ed67fc640 1 -- 172.21.15.50:0/1485816234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec80315a0 con 0x7f8ed80696a0 2023-08-10T10:42:54.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.008+0000 7f8ed67fc640 1 -- 172.21.15.50:0/1485816234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8031930 con 0x7f8ed80696a0 2023-08-10T10:42:54.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.008+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1485816234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 msgr2=0x7f8ed80b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.008+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1485816234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed80b1370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80cc000 tx=0x7f8ec802b840 comp rx=0 tx=0).stop 2023-08-10T10:42:54.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1485816234 shutdown_connections 2023-08-10T10:42:54.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1485816234 >> v2:172.21.15.117:3300/0 conn(0x7f8ed8069a80 0x7f8ed80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1485816234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed80b1370 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1485816234 >> 172.21.15.50:0/1485816234 conn(0x7f8ed80cafa0 msgr2=0x7f8ed80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:54.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1485816234 shutdown_connections 2023-08-10T10:42:54.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.009+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1485816234 wait complete. 2023-08-10T10:42:54.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.010+0000 7f8edc9ab640 1 Processor -- start 2023-08-10T10:42:54.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.011+0000 7f8edc9ab640 1 -- start start 2023-08-10T10:42:54.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ed8069a80 0x7f8ed806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 0x7f8ed806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b47d0 con 0x7f8ed80696a0 2023-08-10T10:42:54.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80ca400 con 0x7f8ed8069a80 2023-08-10T10:42:54.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8edc9ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806fac0 con 0x7f8ed815ad00 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43742/0 (socket says 172.21.15.50:43742) 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1365169040 learned_addr learned my addr 172.21.15.50:0/1365169040 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed7fff640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 0x7f8ed806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed6ffd640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ed8069a80 0x7f8ed806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 msgr2=0x7f8ed806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.012+0000 7f8ed77fe640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 0x7f8ed806ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ed8069a80 msgr2=0x7f8ed806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ed77fe640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ed8069a80 0x7f8ed806e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ed77fe640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8009400 con 0x7f8ed80696a0 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ed7fff640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 0x7f8ed806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ed77fe640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000c00 tx=0x7f8ec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8032840 con 0x7f8ed80696a0 2023-08-10T10:42:54.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec80329c0 con 0x7f8ed80696a0 2023-08-10T10:42:54.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8032d70 con 0x7f8ed80696a0 2023-08-10T10:42:54.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed806f500 con 0x7f8ed80696a0 2023-08-10T10:42:54.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.013+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed815c220 con 0x7f8ed80696a0 2023-08-10T10:42:54.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.015+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed806cb50 con 0x7f8ed80696a0 2023-08-10T10:42:54.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.016+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ec803b3f0 con 0x7f8ed80696a0 2023-08-10T10:42:54.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.017+0000 7f8ebffff640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 0x7f8ec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.017+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8ec80ab590 con 0x7f8ed80696a0 2023-08-10T10:42:54.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.017+0000 7f8ed6ffd640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 0x7f8ec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.018+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f8ec4073080 con 0x7f8ed80696a0 2023-08-10T10:42:54.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.018+0000 7f8ed6ffd640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 0x7f8ec406d190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80ad2a0 tx=0x7f8ecc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.021+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ec8076500 con 0x7f8ed80696a0 2023-08-10T10:42:54.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.232+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ed80cf670 con 0x7f8ed80696a0 2023-08-10T10:42:54.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.232+0000 7f8ebffff640 1 -- 172.21.15.50:0/1365169040 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8ec8079b20 con 0x7f8ed80696a0 2023-08-10T10:42:54.233 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:42:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 msgr2=0x7f8ec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 0x7f8ec406d190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80ad2a0 tx=0x7f8ecc009040 comp rx=0 tx=0).stop 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 msgr2=0x7f8ed806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000c00 tx=0x7f8ec80046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 shutdown_connections 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ed815ad00 0x7f8ed806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ec406acd0 0x7f8ec406d190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ed8069a80 0x7f8ed806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 --2- 172.21.15.50:0/1365169040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed80696a0 0x7f8ed806ff70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.235+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 >> 172.21.15.50:0/1365169040 conn(0x7f8ed80cafa0 msgr2=0x7f8ed80c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.236+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 shutdown_connections 2023-08-10T10:42:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.236+0000 7f8edc9ab640 1 -- 172.21.15.50:0/1365169040 wait complete. 2023-08-10T10:42:54.257 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:42:54.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:42:54.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:42:54.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:42:54.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:42:54.388 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:42:54.443 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:42:54.444 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:54.504 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:42:54.505 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:54.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:42:54.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.798+0000 7ff2a0c45640 1 Processor -- start 2023-08-10T10:42:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.798+0000 7ff2a0c45640 1 -- start start 2023-08-10T10:42:54.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff2a0c45640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff29c15aa40 0x7ff29c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff2a0c45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff29c0ca930 0x7ff29c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff2a0c45640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c071c70 con 0x7ff29c0b0c60 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff2a0c45640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0713d0 con 0x7ff29c15aa40 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff2a0c45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0716b0 con 0x7ff29c0ca930 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff29a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff29c15aa40 0x7ff29c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff29a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff29c15aa40 0x7ff29c0b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43746/0 (socket says 172.21.15.50:43746) 2023-08-10T10:42:54.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.800+0000 7ff29a59c640 1 -- 172.21.15.50:0/2818990140 learned_addr learned my addr 172.21.15.50:0/2818990140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:54.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.801+0000 7ff29ad9d640 1 --2- 172.21.15.50:0/2818990140 >> v2:172.21.15.117:3300/0 conn(0x7ff29c0ca930 0x7ff29c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.801+0000 7ff29a59c640 1 -- 172.21.15.50:0/2818990140 >> v2:172.21.15.117:3300/0 conn(0x7ff29c0ca930 msgr2=0x7ff29c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:54.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.801+0000 7ff29a59c640 1 --2- 172.21.15.50:0/2818990140 >> v2:172.21.15.117:3300/0 conn(0x7ff29c0ca930 0x7ff29c0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.801+0000 7ff29a59c640 1 -- 172.21.15.50:0/2818990140 >> v1:172.21.15.117:6789/0 conn(0x7ff29c0b0c60 legacy=0x7ff29c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:54.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.801+0000 7ff29a59c640 1 -- 172.21.15.50:0/2818990140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c071990 con 0x7ff29c15aa40 2023-08-10T10:42:54.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.802+0000 7ff29a59c640 1 --2- 172.21.15.50:0/2818990140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c15aa40 0x7ff29c0b3820 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cb110 tx=0x7ff28c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750bd941659b11bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.802+0000 7ff299d9b640 1 -- 172.21.15.50:0/2818990140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0317e0 con 0x7ff29c15aa40 2023-08-10T10:42:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.802+0000 7ff299d9b640 1 -- 172.21.15.50:0/2818990140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c031940 con 0x7ff29c15aa40 2023-08-10T10:42:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.802+0000 7ff299d9b640 1 -- 172.21.15.50:0/2818990140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c031cd0 con 0x7ff29c15aa40 2023-08-10T10:42:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 -- 172.21.15.50:0/2818990140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c15aa40 msgr2=0x7ff29c0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/2818990140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c15aa40 0x7ff29c0b3820 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cb110 tx=0x7ff28c02b880 comp rx=0 tx=0).stop 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 -- 172.21.15.50:0/2818990140 shutdown_connections 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/2818990140 >> v2:172.21.15.117:3300/0 conn(0x7ff29c0ca930 0x7ff29c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/2818990140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c15aa40 0x7ff29c0b3820 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 -- 172.21.15.50:0/2818990140 >> 172.21.15.50:0/2818990140 conn(0x7ff29c06b590 msgr2=0x7ff29c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 -- 172.21.15.50:0/2818990140 shutdown_connections 2023-08-10T10:42:54.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.803+0000 7ff2a0c45640 1 -- 172.21.15.50:0/2818990140 wait complete. 2023-08-10T10:42:54.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.806+0000 7ff2a0c45640 1 Processor -- start 2023-08-10T10:42:54.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.806+0000 7ff2a0c45640 1 -- start start 2023-08-10T10:42:54.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff29c0ca930 0x7ff29c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 0x7ff29c156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c150e20 con 0x7ff29c0b0c60 2023-08-10T10:42:54.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c157570 con 0x7ff29c15aa40 2023-08-10T10:42:54.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.807+0000 7ff2a0c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c156fb0 con 0x7ff29c0ca930 2023-08-10T10:42:54.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43762/0 (socket says 172.21.15.50:43762) 2023-08-10T10:42:54.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 -- 172.21.15.50:0/1476745659 learned_addr learned my addr 172.21.15.50:0/1476745659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:54.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff293fff640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff29c0ca930 0x7ff29c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29ad9d640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 0x7ff29c156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 -- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff29c0ca930 msgr2=0x7ff29c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff29c0ca930 0x7ff29c1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 -- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 msgr2=0x7ff29c156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 0x7ff29c156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0094d0 con 0x7ff29c0b0c60 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29ad9d640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 0x7ff29c156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.808+0000 7ff29a59c640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff28c02b8c0 tx=0x7ff28c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.809+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c032880 con 0x7ff29c0b0c60 2023-08-10T10:42:54.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.809+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c0329e0 con 0x7ff29c0b0c60 2023-08-10T10:42:54.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.809+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c032d90 con 0x7ff29c0b0c60 2023-08-10T10:42:54.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.809+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c157290 con 0x7ff29c0b0c60 2023-08-10T10:42:54.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.809+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c0c5ba0 con 0x7ff29c0b0c60 2023-08-10T10:42:54.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.810+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c0c5d90 con 0x7ff29c0b0c60 2023-08-10T10:42:54.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.811+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff28c04e450 con 0x7ff29c0b0c60 2023-08-10T10:42:54.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.812+0000 7ff292ffd640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 0x7ff27c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:54.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.813+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff28c0ab6b0 con 0x7ff29c0b0c60 2023-08-10T10:42:54.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.813+0000 7ff293fff640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 0x7ff27c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:54.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.813+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7ff27c072f70 con 0x7ff29c0b0c60 2023-08-10T10:42:54.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.814+0000 7ff293fff640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 0x7ff27c06d110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff29c154220 tx=0x7ff284009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:54.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:54.817+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff28c076890 con 0x7ff29c0b0c60 2023-08-10T10:42:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.012+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff29c04e270 con 0x7ff29c0b0c60 2023-08-10T10:42:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.014+0000 7ff292ffd640 1 -- 172.21.15.50:0/1476745659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18592 (secure 0 0 0) 0x7ff28c079eb0 con 0x7ff29c0b0c60 2023-08-10T10:42:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:42:55.015 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:42:09.449619+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:42:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 msgr2=0x7ff27c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 0x7ff27c06d110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff29c154220 tx=0x7ff284009040 comp rx=0 tx=0).stop 2023-08-10T10:42:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 msgr2=0x7ff29c1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff28c02b8c0 tx=0x7ff28c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 shutdown_connections 2023-08-10T10:42:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff27c06ac50 0x7ff27c06d110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29c15aa40 0x7ff29c156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff29c0ca930 0x7ff29c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.016+0000 7ff2a0c45640 1 --2- 172.21.15.50:0/1476745659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff29c0b0c60 0x7ff29c1508e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.017+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 >> 172.21.15.50:0/1476745659 conn(0x7ff29c06b590 msgr2=0x7ff29c158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.017+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 shutdown_connections 2023-08-10T10:42:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.017+0000 7ff2a0c45640 1 -- 172.21.15.50:0/1476745659 wait complete. 2023-08-10T10:42:55.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:41:32.815026+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:41:33.402009+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:42:55.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:42:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.327+0000 7f0c6ef0c640 1 Processor -- start 2023-08-10T10:42:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.327+0000 7f0c6ef0c640 1 -- start start 2023-08-10T10:42:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6ef0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c6815cb90 0x7f0c680b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6ef0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c6815cf70 0x7f0c68160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6ef0c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c68160a40 con 0x7f0c680b4640 2023-08-10T10:42:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6ef0c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680b4bb0 con 0x7f0c6815cf70 2023-08-10T10:42:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6ef0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b4e90 con 0x7f0c6815cb90 2023-08-10T10:42:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c67fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c6815cf70 0x7f0c68160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6d4a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c680b4640 0x7f0c6806fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35228/0 (socket says 172.21.15.50:35228) 2023-08-10T10:42:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6d4a9640 1 -- 172.21.15.50:0/497560433 learned_addr learned my addr 172.21.15.50:0/497560433 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.329+0000 7f0c6cca8640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c6815cb90 0x7f0c680b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.330+0000 7f0c67fff640 1 -- 172.21.15.50:0/497560433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c6815cb90 msgr2=0x7f0c680b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.330+0000 7f0c67fff640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c6815cb90 0x7f0c680b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.330+0000 7f0c67fff640 1 -- 172.21.15.50:0/497560433 >> v1:172.21.15.50:6789/0 conn(0x7f0c680b4640 legacy=0x7f0c6806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.330+0000 7f0c67fff640 1 -- 172.21.15.50:0/497560433 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680b5170 con 0x7f0c6815cf70 2023-08-10T10:42:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.331+0000 7f0c67fff640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cf70 0x7f0c68160ed0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097a0 tx=0x7f0c5402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9d8acf0d9469a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.331+0000 7f0c677fe640 1 -- 172.21.15.50:0/497560433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5402d040 con 0x7f0c6815cf70 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.331+0000 7f0c677fe640 1 -- 172.21.15.50:0/497560433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54031810 con 0x7f0c6815cf70 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.331+0000 7f0c677fe640 1 -- 172.21.15.50:0/497560433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54031ba0 con 0x7f0c6815cf70 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/497560433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cf70 msgr2=0x7f0c68160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cf70 0x7f0c68160ed0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097a0 tx=0x7f0c5402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/497560433 shutdown_connections 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cf70 0x7f0c68160ed0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/497560433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c6815cb90 0x7f0c680b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/497560433 >> 172.21.15.50:0/497560433 conn(0x7f0c680cf640 msgr2=0x7f0c680cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/497560433 shutdown_connections 2023-08-10T10:42:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.332+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/497560433 wait complete. 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.334+0000 7f0c6ef0c640 1 Processor -- start 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.334+0000 7f0c6ef0c640 1 -- start start 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 0x7f0c681f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6815cf70 0x7f0c6813e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c8290 con 0x7f0c6815cb90 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c7680 con 0x7f0c6815cf70 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c6ef0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c7960 con 0x7f0c680b4640 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56150/0 (socket says 172.21.15.50:56150) 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.335+0000 7f0c67fff640 1 -- 172.21.15.50:0/1572842853 learned_addr learned my addr 172.21.15.50:0/1572842853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c6cca8640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 0x7f0c681f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c6d4a9640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6815cf70 0x7f0c6813e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 -- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 msgr2=0x7f0c681f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 0x7f0c681f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 -- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6815cf70 msgr2=0x7f0c6813e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6815cf70 0x7f0c6813e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54009400 con 0x7f0c6815cb90 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c6cca8640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 0x7f0c681f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c67fff640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000c00 tx=0x7f0c540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.336+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5403ad60 con 0x7f0c6815cb90 2023-08-10T10:42:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.337+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540443f0 con 0x7f0c6815cb90 2023-08-10T10:42:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.337+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540447a0 con 0x7f0c6815cb90 2023-08-10T10:42:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.337+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680c7c40 con 0x7f0c6815cb90 2023-08-10T10:42:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.337+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6813f390 con 0x7f0c6815cb90 2023-08-10T10:42:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.338+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680612b0 con 0x7f0c6815cb90 2023-08-10T10:42:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.339+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c5404d450 con 0x7f0c6815cb90 2023-08-10T10:42:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.340+0000 7f0c657fa640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 0x7f0c4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.340+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0c540ab800 con 0x7f0c6815cb90 2023-08-10T10:42:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.340+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f0c4c072f80 con 0x7f0c6815cb90 2023-08-10T10:42:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.340+0000 7f0c6cca8640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 0x7f0c4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.341+0000 7f0c6cca8640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 0x7f0c4c06d110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.344+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0c54076930 con 0x7f0c6815cb90 2023-08-10T10:42:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.533+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c680d0a10 con 0x7f0c6815cb90 2023-08-10T10:42:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.534+0000 7f0c657fa640 1 -- 172.21.15.50:0/1572842853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c54035020 con 0x7f0c6815cb90 2023-08-10T10:42:55.535 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 msgr2=0x7f0c4c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 0x7f0c4c06d110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 msgr2=0x7f0c6814ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000c00 tx=0x7f0c540046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 shutdown_connections 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4c06ac50 0x7f0c4c06d110 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6815cf70 0x7f0c6813e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c6815cb90 0x7f0c6814ec80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 --2- 172.21.15.50:0/1572842853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c680b4640 0x7f0c681f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 >> 172.21.15.50:0/1572842853 conn(0x7f0c680cf640 msgr2=0x7f0c680cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 shutdown_connections 2023-08-10T10:42:55.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.537+0000 7f0c6ef0c640 1 -- 172.21.15.50:0/1572842853 wait complete. 2023-08-10T10:42:55.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:42:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.785+0000 7fd037302640 1 Processor -- start 2023-08-10T10:42:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.786+0000 7fd037302640 1 -- start start 2023-08-10T10:42:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.787+0000 7fd037302640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd030160f70 0x7fd03015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.787+0000 7fd037302640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd0300aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.787+0000 7fd037302640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300ad6e0 con 0x7fd030161350 2023-08-10T10:42:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.787+0000 7fd037302640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300cdaf0 con 0x7fd030160f70 2023-08-10T10:42:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.787+0000 7fd037302640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300acb10 con 0x7fd03015dd10 2023-08-10T10:42:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036b01640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd030161350 0x7fd03006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35244/0 (socket says 172.21.15.50:35244) 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036b01640 1 -- 172.21.15.50:0/1652292560 learned_addr learned my addr 172.21.15.50:0/1652292560 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036300640 1 --2- 172.21.15.50:0/1652292560 >> v2:172.21.15.50:3300/0 conn(0x7fd030160f70 0x7fd03015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd035aff640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd0300aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd0352fe640 1 -- 172.21.15.50:0/1652292560 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669959865 0 0) 0x7fd0300ad6e0 con 0x7fd030161350 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd0352fe640 1 -- 172.21.15.50:0/1652292560 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd01c003520 con 0x7fd030161350 2023-08-10T10:42:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036300640 1 -- 172.21.15.50:0/1652292560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 msgr2=0x7fd0300aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:55.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036300640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd0300aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036300640 1 -- 172.21.15.50:0/1652292560 >> v1:172.21.15.50:6789/0 conn(0x7fd030161350 legacy=0x7fd03006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.788+0000 7fd036300640 1 -- 172.21.15.50:0/1652292560 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300acdb0 con 0x7fd030160f70 2023-08-10T10:42:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd036300640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd03015d7d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0097a0 tx=0x7fd02c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11acf50e9d659579 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd0352fe640 1 -- 172.21.15.50:0/1652292560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c031830 con 0x7fd030160f70 2023-08-10T10:42:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd0352fe640 1 -- 172.21.15.50:0/1652292560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c031990 con 0x7fd030160f70 2023-08-10T10:42:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd0352fe640 1 -- 172.21.15.50:0/1652292560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c031d20 con 0x7fd030160f70 2023-08-10T10:42:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd037302640 1 -- 172.21.15.50:0/1652292560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 msgr2=0x7fd03015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.790+0000 7fd037302640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd03015d7d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0097a0 tx=0x7fd02c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 -- 172.21.15.50:0/1652292560 shutdown_connections 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd0300aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 --2- 172.21.15.50:0/1652292560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd03015d7d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 -- 172.21.15.50:0/1652292560 >> 172.21.15.50:0/1652292560 conn(0x7fd030069cd0 msgr2=0x7fd0300caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 -- 172.21.15.50:0/1652292560 shutdown_connections 2023-08-10T10:42:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.791+0000 7fd037302640 1 -- 172.21.15.50:0/1652292560 wait complete. 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.792+0000 7fd037302640 1 Processor -- start 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.792+0000 7fd037302640 1 -- start start 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd030156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 0x7fd0300c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030156a70 con 0x7fd030160f70 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300c1fb0 con 0x7fd030161350 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.793+0000 7fd037302640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd030156ed0 con 0x7fd03015dd10 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56172/0 (socket says 172.21.15.50:56172) 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 -- 172.21.15.50:0/1343518035 learned_addr learned my addr 172.21.15.50:0/1343518035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd036300640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd030156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd036b01640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 0x7fd0300c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 -- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 msgr2=0x7fd030156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd030156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 -- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 msgr2=0x7fd0300c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 0x7fd0300c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd035aff640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c009400 con 0x7fd030160f70 2023-08-10T10:42:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.794+0000 7fd036b01640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 0x7fd0300c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd035aff640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d800 tx=0x7fd02000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000b6c0 con 0x7fd030160f70 2023-08-10T10:42:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000b820 con 0x7fd030160f70 2023-08-10T10:42:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000bbb0 con 0x7fd030160f70 2023-08-10T10:42:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0300c2250 con 0x7fd030160f70 2023-08-10T10:42:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.795+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300c2810 con 0x7fd030160f70 2023-08-10T10:42:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.797+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0300adb50 con 0x7fd030160f70 2023-08-10T10:42:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.797+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd02000bd10 con 0x7fd030160f70 2023-08-10T10:42:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.798+0000 7fd026ffd640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 0x7fd01406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.798+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd020089b50 con 0x7fd030160f70 2023-08-10T10:42:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.799+0000 7fd036300640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 0x7fd01406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.799+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fd014072f80 con 0x7fd030160f70 2023-08-10T10:42:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.799+0000 7fd036300640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 0x7fd01406d110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd02c036000 tx=0x7fd02c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.803+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0300adb50 con 0x7fd030160f70 2023-08-10T10:42:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.988+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0300adb50 con 0x7fd030160f70 2023-08-10T10:42:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.989+0000 7fd026ffd640 1 -- 172.21.15.50:0/1343518035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0300adb50 con 0x7fd030160f70 2023-08-10T10:42:55.990 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:42:55.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 msgr2=0x7fd01406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 0x7fd01406d110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd02c036000 tx=0x7fd02c03c040 comp rx=0 tx=0).stop 2023-08-10T10:42:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 msgr2=0x7fd0300b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d800 tx=0x7fd02000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 shutdown_connections 2023-08-10T10:42:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd01406ac50 0x7fd01406d110 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd030161350 0x7fd0300c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd030160f70 0x7fd0300b3cf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 --2- 172.21.15.50:0/1343518035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd03015dd10 0x7fd030156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:55.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 >> 172.21.15.50:0/1343518035 conn(0x7fd030069cd0 msgr2=0x7fd03015e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:55.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 shutdown_connections 2023-08-10T10:42:55.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:55.992+0000 7fd037302640 1 -- 172.21.15.50:0/1343518035 wait complete. 2023-08-10T10:42:56.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:42:56.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.235+0000 7f0f34c34640 1 Processor -- start 2023-08-10T10:42:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.235+0000 7f0f34c34640 1 -- start start 2023-08-10T10:42:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 0x7f0f30159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f3006c640 0x7f0f300b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006cab0 0x7f0f300b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3006cfe0 con 0x7f0f3006c640 2023-08-10T10:42:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3006d2c0 con 0x7f0f30142360 2023-08-10T10:42:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f34c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3006d5a0 con 0x7f0f3006cab0 2023-08-10T10:42:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f2dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f3006c640 0x7f0f300b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f2dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f3006c640 0x7f0f300b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56188/0 (socket says 172.21.15.50:56188) 2023-08-10T10:42:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.237+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/4239151842 learned_addr learned my addr 172.21.15.50:0/4239151842 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2ed9d640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006cab0 0x7f0f300b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2e59c640 1 --2- 172.21.15.50:0/4239151842 >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 0x7f0f30159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/4239151842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006cab0 msgr2=0x7f0f300b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006cab0 0x7f0f300b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/4239151842 >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 msgr2=0x7f0f30159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/4239151842 >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 0x7f0f30159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/4239151842 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3006f940 con 0x7f0f3006c640 2023-08-10T10:42:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.238+0000 7f0f2e59c640 1 --2- 172.21.15.50:0/4239151842 >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 0x7f0f30159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.239+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006c640 0x7f0f300b0b20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006dc40 tx=0x7f0f2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79554f75ba7ad7c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.239+0000 7f0f2d59a640 1 -- 172.21.15.50:0/4239151842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24031870 con 0x7f0f3006c640 2023-08-10T10:42:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.239+0000 7f0f2d59a640 1 -- 172.21.15.50:0/4239151842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240319d0 con 0x7f0f3006c640 2023-08-10T10:42:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.239+0000 7f0f2d59a640 1 -- 172.21.15.50:0/4239151842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24031d60 con 0x7f0f3006c640 2023-08-10T10:42:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 -- 172.21.15.50:0/4239151842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006c640 msgr2=0x7f0f300b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006c640 0x7f0f300b0b20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006dc40 tx=0x7f0f2402b910 comp rx=0 tx=0).stop 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 -- 172.21.15.50:0/4239151842 shutdown_connections 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006cab0 0x7f0f300b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 --2- 172.21.15.50:0/4239151842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006c640 0x7f0f300b0b20 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 --2- 172.21.15.50:0/4239151842 >> v2:172.21.15.117:3300/0 conn(0x7f0f30142360 0x7f0f30159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 -- 172.21.15.50:0/4239151842 >> 172.21.15.50:0/4239151842 conn(0x7f0f3006b3e0 msgr2=0x7f0f3006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 -- 172.21.15.50:0/4239151842 shutdown_connections 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.240+0000 7f0f34c34640 1 -- 172.21.15.50:0/4239151842 wait complete. 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.242+0000 7f0f34c34640 1 Processor -- start 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.242+0000 7f0f34c34640 1 -- start start 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006c640 0x7f0f30141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f30142360 0x7f0f300cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f301590b0 con 0x7f0f3006cab0 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300cdc70 con 0x7f0f30142360 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f34c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300cdf10 con 0x7f0f3006c640 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f2dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f2dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56198/0 (socket says 172.21.15.50:56198) 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.243+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/2975676402 learned_addr learned my addr 172.21.15.50:0/2975676402 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:56.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2e59c640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006c640 0x7f0f30141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006c640 msgr2=0x7f0f30141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2ed9d640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f30142360 0x7f0f300cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006c640 0x7f0f30141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f30142360 msgr2=0x7f0f300cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f30142360 0x7f0f300cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240094d0 con 0x7f0f3006cab0 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f2dd9b640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0f2402b950 tx=0x7f0f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.244+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2403ac60 con 0x7f0f3006cab0 2023-08-10T10:42:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.245+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f300ce1f0 con 0x7f0f3006cab0 2023-08-10T10:42:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.245+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2403adc0 con 0x7f0f3006cab0 2023-08-10T10:42:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.245+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240445f0 con 0x7f0f3006cab0 2023-08-10T10:42:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.245+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f300cc530 con 0x7f0f3006cab0 2023-08-10T10:42:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.246+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f300612b0 con 0x7f0f3006cab0 2023-08-10T10:42:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.247+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f24044750 con 0x7f0f3006cab0 2023-08-10T10:42:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.248+0000 7f0f1effd640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 0x7f0f1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.248+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0f2402d040 con 0x7f0f3006cab0 2023-08-10T10:42:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.248+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f0f10073000 con 0x7f0f3006cab0 2023-08-10T10:42:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.248+0000 7f0f2e59c640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 0x7f0f1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.249+0000 7f0f2e59c640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 0x7f0f1006d110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b840 tx=0x7f0f20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.252+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f24035020 con 0x7f0f3006cab0 2023-08-10T10:42:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.454+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f300cfaa0 con 0x7f0f3006cab0 2023-08-10T10:42:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.455+0000 7f0f1effd640 1 -- 172.21.15.50:0/2975676402 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f24076ea0 con 0x7f0f3006cab0 2023-08-10T10:42:56.455 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:42:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 msgr2=0x7f0f1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 0x7f0f1006d110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b840 tx=0x7f0f20008040 comp rx=0 tx=0).stop 2023-08-10T10:42:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 msgr2=0x7f0f300cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0f2402b950 tx=0x7f0f240046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 shutdown_connections 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.457+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f1006ac50 0x7f0f1006d110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f30142360 0x7f0f300cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f3006cab0 0x7f0f300cb990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 --2- 172.21.15.50:0/2975676402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f3006c640 0x7f0f30141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 >> 172.21.15.50:0/2975676402 conn(0x7f0f3006b3e0 msgr2=0x7f0f30159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 shutdown_connections 2023-08-10T10:42:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.458+0000 7f0f34c34640 1 -- 172.21.15.50:0/2975676402 wait complete. 2023-08-10T10:42:56.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:42:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.705+0000 7f00f588a640 1 Processor -- start 2023-08-10T10:42:56.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.705+0000 7f00f588a640 1 -- start start 2023-08-10T10:42:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00f588a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00f0069b30 0x7f00f015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00f588a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f015aee0 con 0x7f00f00696a0 2023-08-10T10:42:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00f588a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00b2100 con 0x7f00f01583c0 2023-08-10T10:42:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00f588a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f015b1a0 con 0x7f00f0069b30 2023-08-10T10:42:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00e7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00f00696a0 0x7f00f015e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35260/0 (socket says 172.21.15.50:35260) 2023-08-10T10:42:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.707+0000 7f00e7fff640 1 -- 172.21.15.50:0/2180500458 learned_addr learned my addr 172.21.15.50:0/2180500458 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00f5089640 1 --2- 172.21.15.50:0/2180500458 >> v2:172.21.15.117:3300/0 conn(0x7f00f0069b30 0x7f00f015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572452571 0 0) 0x7f00f015aee0 con 0x7f00f00696a0 2023-08-10T10:42:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003520 con 0x7f00f00696a0 2023-08-10T10:42:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865904613 0 0) 0x7f00d8003520 con 0x7f00f00696a0 2023-08-10T10:42:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 >> v2:172.21.15.117:3300/0 conn(0x7f00f0069b30 msgr2=0x7f00f015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 --2- 172.21.15.50:0/2180500458 >> v2:172.21.15.117:3300/0 conn(0x7f00f0069b30 0x7f00f015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 >> v1:172.21.15.117:6789/0 conn(0x7f00f01583c0 legacy=0x7f00f00b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f015b480 con 0x7f00f00696a0 2023-08-10T10:42:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f00e0001670 con 0x7f00f00696a0 2023-08-10T10:42:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 >> v1:172.21.15.50:6789/0 conn(0x7f00f00696a0 legacy=0x7f00f015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 0x7f00d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.708+0000 7f00e77fe640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e77fe640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015b1a0 con 0x7f00d80039e0 2023-08-10T10:42:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800c0b0 con 0x7f00d8005180 2023-08-10T10:42:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800c270 con 0x7f00d80047c0 2023-08-10T10:42:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 0x7f00d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f5089640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e7fff640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 -- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d80047c0 msgr2=0x7f00d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 -- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8005180 msgr2=0x7f00d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:56.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f4888640 1 -- 172.21.15.50:0/2180500458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8003520 con 0x7f00d80039e0 2023-08-10T10:42:56.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f5089640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d8005180 0x7f00d800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00f5089640 1 -- 172.21.15.50:0/2180500458 reap_dead start 2023-08-10T10:42:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.709+0000 7f00e7fff640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00d80047c0 0x7f00d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.710+0000 7f00f4888640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 0x7f00d8003e00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001750 tx=0x7f00d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5164595de0be495 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0052d0 con 0x7f00d80039e0 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec02e050 con 0x7f00d80039e0 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00e77fe640 1 -- 172.21.15.50:0/2180500458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec003830 con 0x7f00d80039e0 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 -- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 msgr2=0x7f00d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 0x7f00d8003e00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001750 tx=0x7f00d80057f0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 -- 172.21.15.50:0/2180500458 shutdown_connections 2023-08-10T10:42:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 --2- 172.21.15.50:0/2180500458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00d80039e0 0x7f00d8003e00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 -- 172.21.15.50:0/2180500458 >> 172.21.15.50:0/2180500458 conn(0x7f00f00caf80 msgr2=0x7f00f00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.711+0000 7f00f588a640 1 -- 172.21.15.50:0/2180500458 shutdown_connections 2023-08-10T10:42:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.712+0000 7f00f588a640 1 -- 172.21.15.50:0/2180500458 wait complete. 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.713+0000 7f00f588a640 1 Processor -- start 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.714+0000 7f00f588a640 1 -- start start 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d80039e0 0x7f00f014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00f00700e0 0x7f00f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f014ef50 con 0x7f00f01597f0 2023-08-10T10:42:56.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015a1b0 con 0x7f00d80039e0 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f588a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0070e60 con 0x7f00f00700e0 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56212/0 (socket says 172.21.15.50:56212) 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 -- 172.21.15.50:0/3296458285 learned_addr learned my addr 172.21.15.50:0/3296458285 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00f4888640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d80039e0 0x7f00f014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 -- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00f00700e0 msgr2=0x7f00f0070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00f00700e0 0x7f00f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 -- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d80039e0 msgr2=0x7f00f014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d80039e0 0x7f00f014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.715+0000 7f00e7fff640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f006ea60 con 0x7f00f01597f0 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00e7fff640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d700 tx=0x7f00e000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00074e0 con 0x7f00f01597f0 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0007640 con 0x7f00f01597f0 2023-08-10T10:42:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00049e0 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f006ed40 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.716+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f006f300 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.718+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f0066e30 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.718+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00e0004b40 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.719+0000 7f00e57fa640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 0x7f00dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.720+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f00e0088ff0 con 0x7f00f01597f0 2023-08-10T10:42:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.720+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f00dc072f80 con 0x7f00f01597f0 2023-08-10T10:42:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.720+0000 7f00f4888640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 0x7f00dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.721+0000 7f00f4888640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 0x7f00dc06d110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00ec033000 tx=0x7f00ec009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.724+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00e00bb330 con 0x7f00f01597f0 2023-08-10T10:42:56.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.919+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00f00b2dd0 con 0x7f00f01597f0 2023-08-10T10:42:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.920+0000 7f00e57fa640 1 -- 172.21.15.50:0/3296458285 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00e0019060 con 0x7f00f01597f0 2023-08-10T10:42:56.921 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:42:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.922+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 msgr2=0x7f00dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.922+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 0x7f00dc06d110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00ec033000 tx=0x7f00ec009030 comp rx=0 tx=0).stop 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.922+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 msgr2=0x7f00f0159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.922+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d700 tx=0x7f00e000dbc0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 shutdown_connections 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00f00700e0 0x7f00f0070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00f01597f0 0x7f00f0159c70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00dc06ac50 0x7f00dc06d110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 --2- 172.21.15.50:0/3296458285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d80039e0 0x7f00f014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 >> 172.21.15.50:0/3296458285 conn(0x7f00f00caf80 msgr2=0x7f00f00aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 shutdown_connections 2023-08-10T10:42:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:56.923+0000 7f00f588a640 1 -- 172.21.15.50:0/3296458285 wait complete. 2023-08-10T10:42:56.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:42:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.174+0000 7fa841a9b640 1 Processor -- start 2023-08-10T10:42:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.174+0000 7fa841a9b640 1 -- start start 2023-08-10T10:42:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.175+0000 7fa841a9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0ac890 0x7fa83c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.175+0000 7fa841a9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa83c0acc70 0x7fa83c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.175+0000 7fa841a9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c0cae00 con 0x7fa83c06f550 2023-08-10T10:42:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa841a9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0c9150 con 0x7fa83c0acc70 2023-08-10T10:42:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa841a9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0cdba0 con 0x7fa83c0ac890 2023-08-10T10:42:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa83affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa83c0acc70 0x7fa83c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa83bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa83c06f550 0x7fa83c0c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35276/0 (socket says 172.21.15.50:35276) 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa83bfff640 1 -- 172.21.15.50:0/2898702114 learned_addr learned my addr 172.21.15.50:0/2898702114 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0ac890 0x7fa83c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.176+0000 7fa83a7fc640 1 -- 172.21.15.50:0/2898702114 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472606477 0 0) 0x7fa83c0cae00 con 0x7fa83c06f550 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.177+0000 7fa83a7fc640 1 -- 172.21.15.50:0/2898702114 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa824003520 con 0x7fa83c06f550 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.177+0000 7fa83affd640 1 -- 172.21.15.50:0/2898702114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0ac890 msgr2=0x7fa83c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.177+0000 7fa83affd640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0ac890 0x7fa83c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.177+0000 7fa83affd640 1 -- 172.21.15.50:0/2898702114 >> v1:172.21.15.50:6789/0 conn(0x7fa83c06f550 legacy=0x7fa83c0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.177+0000 7fa83affd640 1 -- 172.21.15.50:0/2898702114 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0ca840 con 0x7fa83c0acc70 2023-08-10T10:42:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.178+0000 7fa83affd640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0acc70 0x7fa83c0cd660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097a0 tx=0x7fa83002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a2535c79ac61e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa83a7fc640 1 -- 172.21.15.50:0/2898702114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300316f0 con 0x7fa83c0acc70 2023-08-10T10:42:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa83a7fc640 1 -- 172.21.15.50:0/2898702114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830031850 con 0x7fa83c0acc70 2023-08-10T10:42:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa83a7fc640 1 -- 172.21.15.50:0/2898702114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830031bc0 con 0x7fa83c0acc70 2023-08-10T10:42:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 -- 172.21.15.50:0/2898702114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0acc70 msgr2=0x7fa83c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0acc70 0x7fa83c0cd660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097a0 tx=0x7fa83002b790 comp rx=0 tx=0).stop 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 -- 172.21.15.50:0/2898702114 shutdown_connections 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0acc70 0x7fa83c0cd660 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 --2- 172.21.15.50:0/2898702114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0ac890 0x7fa83c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.179+0000 7fa841a9b640 1 -- 172.21.15.50:0/2898702114 >> 172.21.15.50:0/2898702114 conn(0x7fa83c0b08e0 msgr2=0x7fa83c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.180+0000 7fa841a9b640 1 -- 172.21.15.50:0/2898702114 shutdown_connections 2023-08-10T10:42:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.180+0000 7fa841a9b640 1 -- 172.21.15.50:0/2898702114 wait complete. 2023-08-10T10:42:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.181+0000 7fa841a9b640 1 Processor -- start 2023-08-10T10:42:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.182+0000 7fa841a9b640 1 -- start start 2023-08-10T10:42:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c06f550 0x7fa83c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0acc70 0x7fa83c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1588c0 con 0x7fa83c0ac890 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c15e790 con 0x7fa83c06f550 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa841a9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c06acd0 con 0x7fa83c0acc70 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa83affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa83affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56232/0 (socket says 172.21.15.50:56232) 2023-08-10T10:42:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa83affd640 1 -- 172.21.15.50:0/612426464 learned_addr learned my addr 172.21.15.50:0/612426464 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c06f550 0x7fa83c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.183+0000 7fa83bfff640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0acc70 0x7fa83c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 -- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0acc70 msgr2=0x7fa83c0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0acc70 0x7fa83c0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 -- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c06f550 msgr2=0x7fa83c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c06f550 0x7fa83c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009400 con 0x7fa83c0ac890 2023-08-10T10:42:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa83affd640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa83002b7d0 tx=0x7fa8300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300319c0 con 0x7fa83c0ac890 2023-08-10T10:42:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830031b20 con 0x7fa83c0ac890 2023-08-10T10:42:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830031e90 con 0x7fa83c0ac890 2023-08-10T10:42:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.184+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c06afb0 con 0x7fa83c0ac890 2023-08-10T10:42:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.185+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c06b570 con 0x7fa83c0ac890 2023-08-10T10:42:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.186+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c04e270 con 0x7fa83c0ac890 2023-08-10T10:42:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.187+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa83003b070 con 0x7fa83c0ac890 2023-08-10T10:42:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.188+0000 7fa823fff640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 0x7fa82806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.188+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa8300ab230 con 0x7fa83c0ac890 2023-08-10T10:42:57.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.188+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 0x7fa82806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.188+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fa828072fb0 con 0x7fa83c0ac890 2023-08-10T10:42:57.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.189+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 0x7fa82806d140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0074a0 tx=0x7fa82c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.192+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa830076420 con 0x7fa83c0ac890 2023-08-10T10:42:57.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.396+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa83c0ad9c0 con 0x7fa83c0ac890 2023-08-10T10:42:57.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.397+0000 7fa823fff640 1 -- 172.21.15.50:0/612426464 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa830039080 con 0x7fa83c0ac890 2023-08-10T10:42:57.397 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:42:57.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 msgr2=0x7fa82806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 0x7fa82806d140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0074a0 tx=0x7fa82c00b040 comp rx=0 tx=0).stop 2023-08-10T10:42:57.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 msgr2=0x7fa83c0c56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa83002b7d0 tx=0x7fa8300046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 shutdown_connections 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0acc70 0x7fa83c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0ac890 0x7fa83c0c56c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa82806ac80 0x7fa82806d140 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 --2- 172.21.15.50:0/612426464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c06f550 0x7fa83c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.399+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 >> 172.21.15.50:0/612426464 conn(0x7fa83c0b08e0 msgr2=0x7fa83c1604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.400+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 shutdown_connections 2023-08-10T10:42:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.400+0000 7fa841a9b640 1 -- 172.21.15.50:0/612426464 wait complete. 2023-08-10T10:42:57.420 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:42:57.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:42:57.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:42:57.484 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:42:57.484+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-08-10T10:42:57.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:42:57.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:42:57.558 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:42:57.606 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:42:57.606 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:57.666 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:42:57.667 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:42:57.667 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:42:57.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:42:57.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:42:57.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.961+0000 7f2ea9efd640 1 Processor -- start 2023-08-10T10:42:57.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.962+0000 7f2ea9efd640 1 -- start start 2023-08-10T10:42:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.963+0000 7f2ea9efd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ea415a940 0x7f2ea40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.963+0000 7f2ea9efd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.963+0000 7f2ea9efd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40b1f10 con 0x7f2ea40b12c0 2023-08-10T10:42:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.963+0000 7f2ea9efd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40b21f0 con 0x7f2ea415a940 2023-08-10T10:42:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.963+0000 7f2ea9efd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea415e5c0 con 0x7f2ea415f2b0 2023-08-10T10:42:57.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ea415a940 0x7f2ea40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ea415a940 0x7f2ea40aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56236/0 (socket says 172.21.15.50:56236) 2023-08-10T10:42:57.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 -- 172.21.15.50:0/4068872780 learned_addr learned my addr 172.21.15.50:0/4068872780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:57.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea3fff640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 -- 172.21.15.50:0/4068872780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 msgr2=0x7f2ea40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:57.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 -- 172.21.15.50:0/4068872780 >> v1:172.21.15.117:6789/0 conn(0x7f2ea40b12c0 legacy=0x7f2ea40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:57.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.964+0000 7f2ea8efb640 1 -- 172.21.15.50:0/4068872780 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea415e7d0 con 0x7f2ea415a940 2023-08-10T10:42:57.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.965+0000 7f2ea8efb640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea415a940 0x7f2ea40aff10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ce2e0 tx=0x7f2e9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cf29de52520c7c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.966+0000 7f2ea37fe640 1 -- 172.21.15.50:0/4068872780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9802e070 con 0x7f2ea415a940 2023-08-10T10:42:57.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.966+0000 7f2ea37fe640 1 -- 172.21.15.50:0/4068872780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980315a0 con 0x7f2ea415a940 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.966+0000 7f2ea37fe640 1 -- 172.21.15.50:0/4068872780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98031930 con 0x7f2ea415a940 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.966+0000 7f2ea9efd640 1 -- 172.21.15.50:0/4068872780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea415a940 msgr2=0x7f2ea40aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.966+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea415a940 0x7f2ea40aff10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ce2e0 tx=0x7f2e9802b840 comp rx=0 tx=0).stop 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 -- 172.21.15.50:0/4068872780 shutdown_connections 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea40b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/4068872780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea415a940 0x7f2ea40aff10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 -- 172.21.15.50:0/4068872780 >> 172.21.15.50:0/4068872780 conn(0x7f2ea406ab80 msgr2=0x7f2ea406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 -- 172.21.15.50:0/4068872780 shutdown_connections 2023-08-10T10:42:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.967+0000 7f2ea9efd640 1 -- 172.21.15.50:0/4068872780 wait complete. 2023-08-10T10:42:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.969+0000 7f2ea9efd640 1 Processor -- start 2023-08-10T10:42:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.969+0000 7f2ea9efd640 1 -- start start 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea415a940 0x7f2ea40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea406f240 con 0x7f2ea40b12c0 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea414c510 con 0x7f2ea415a940 2023-08-10T10:42:57.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea9efd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea406e8a0 con 0x7f2ea415f2b0 2023-08-10T10:42:57.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea8efb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea8efb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56250/0 (socket says 172.21.15.50:56250) 2023-08-10T10:42:57.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea8efb640 1 -- 172.21.15.50:0/3549365970 learned_addr learned my addr 172.21.15.50:0/3549365970 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:57.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea3fff640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea415a940 0x7f2ea40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.970+0000 7f2ea96fc640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 -- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 msgr2=0x7f2ea415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 -- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea415a940 msgr2=0x7f2ea40ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea415a940 0x7f2ea40ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980094d0 con 0x7f2ea40b12c0 2023-08-10T10:42:57.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea96fc640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea8efb640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2e9802b880 tx=0x7f2e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98031f10 con 0x7f2ea40b12c0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98032860 con 0x7f2ea40b12c0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea406eb80 con 0x7f2ea40b12c0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98032c10 con 0x7f2ea40b12c0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.971+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea414c890 con 0x7f2ea40b12c0 2023-08-10T10:42:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.973+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4066e30 con 0x7f2ea40b12c0 2023-08-10T10:42:57.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.973+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e9804d3f0 con 0x7f2ea40b12c0 2023-08-10T10:42:57.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.974+0000 7f2ea17fa640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 0x7f2e8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:57.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.974+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2e980ab0d0 con 0x7f2ea40b12c0 2023-08-10T10:42:57.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.975+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f2e88072f80 con 0x7f2ea40b12c0 2023-08-10T10:42:57.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.975+0000 7f2ea3fff640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 0x7f2e8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:57.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.975+0000 7f2ea3fff640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 0x7f2e8806d110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40c4490 tx=0x7f2e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:57.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:57.979+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e98076050 con 0x7f2ea40b12c0 2023-08-10T10:42:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.209+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ea40b0770 con 0x7f2ea40b12c0 2023-08-10T10:42:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.210+0000 7f2ea17fa640 1 -- 172.21.15.50:0/3549365970 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f2e98079670 con 0x7f2ea40b12c0 2023-08-10T10:42:58.211 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:42:58.212 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:42:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:42:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 msgr2=0x7f2e8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 0x7f2e8806d110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40c4490 tx=0x7f2e90008040 comp rx=0 tx=0).stop 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 msgr2=0x7f2ea414bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2e9802b880 tx=0x7f2e980046c0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 shutdown_connections 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ea415f2b0 0x7f2ea415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e8806ac50 0x7f2e8806d110 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ea415a940 0x7f2ea40ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 --2- 172.21.15.50:0/3549365970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ea40b12c0 0x7f2ea414bfd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 >> 172.21.15.50:0/3549365970 conn(0x7f2ea406ab80 msgr2=0x7f2ea40b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 shutdown_connections 2023-08-10T10:42:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.213+0000 7f2ea9efd640 1 -- 172.21.15.50:0/3549365970 wait complete. 2023-08-10T10:42:58.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:42:58.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.463+0000 7fbcffdc9640 1 Processor -- start 2023-08-10T10:42:58.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.463+0000 7fbcffdc9640 1 -- start start 2023-08-10T10:42:58.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcffdc9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcf8159970 0x7fbcf80b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcffdc9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 0x7fbcf80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcffdc9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf815e1f0 con 0x7fbcf8069be0 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcffdc9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf806a000 con 0x7fbcf8159970 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcffdc9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf815d5e0 con 0x7fbcf80b0f00 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcfdb65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcf8159970 0x7fbcf80b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcfdb65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcf8159970 0x7fbcf80b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56256/0 (socket says 172.21.15.50:56256) 2023-08-10T10:42:58.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2208338055 learned_addr learned my addr 172.21.15.50:0/2208338055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:58.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2208338055 >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 0x7fbcf80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.465+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2208338055 >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 msgr2=0x7fbcf80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:58.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.466+0000 7fbcfdb65640 1 --2- 172.21.15.50:0/2208338055 >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 0x7fbcf80696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.466+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2208338055 >> v1:172.21.15.117:6789/0 conn(0x7fbcf8069be0 legacy=0x7fbcf80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:58.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.466+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2208338055 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf815d8c0 con 0x7fbcf8159970 2023-08-10T10:42:58.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.466+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2208338055 >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 0x7fbcf80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.467+0000 7fbcfdb65640 1 --2- 172.21.15.50:0/2208338055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8159970 0x7fbcf80b09c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80caf40 tx=0x7fbcf402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ba436656580bde server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.467+0000 7fbcfcb63640 1 -- 172.21.15.50:0/2208338055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf402ca80 con 0x7fbcf8159970 2023-08-10T10:42:58.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.467+0000 7fbcfcb63640 1 -- 172.21.15.50:0/2208338055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf402cbe0 con 0x7fbcf8159970 2023-08-10T10:42:58.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.467+0000 7fbcfcb63640 1 -- 172.21.15.50:0/2208338055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40343f0 con 0x7fbcf8159970 2023-08-10T10:42:58.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2208338055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8159970 msgr2=0x7fbcf80b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2208338055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8159970 0x7fbcf80b09c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80caf40 tx=0x7fbcf402bee0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2208338055 shutdown_connections 2023-08-10T10:42:58.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2208338055 >> v2:172.21.15.117:3300/0 conn(0x7fbcf80b0f00 0x7fbcf80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2208338055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8159970 0x7fbcf80b09c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2208338055 >> 172.21.15.50:0/2208338055 conn(0x7fbcf806b590 msgr2=0x7fbcf80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:58.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2208338055 shutdown_connections 2023-08-10T10:42:58.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.468+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2208338055 wait complete. 2023-08-10T10:42:58.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.470+0000 7fbcffdc9640 1 Processor -- start 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.470+0000 7fbcffdc9640 1 -- start start 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 0x7fbcf8153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 0x7fbcf8153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf814e5e0 con 0x7fbcf8069be0 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c2250 con 0x7fbcf8159970 2023-08-10T10:42:58.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcffdc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c2530 con 0x7fbcf80b0f00 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcfdb65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcfdb65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56260/0 (socket says 172.21.15.50:56260) 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.471+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2091806701 learned_addr learned my addr 172.21.15.50:0/2091806701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 0x7fbcf8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfe366640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 0x7fbcf8153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 msgr2=0x7fbcf8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 0x7fbcf8153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 msgr2=0x7fbcf8153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 0x7fbcf8153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4009b30 con 0x7fbcf8069be0 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 0x7fbcf8153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfe366640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 0x7fbcf8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.472+0000 7fbcfdb65640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4000f80 tx=0x7fbcf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.473+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf403e450 con 0x7fbcf8069be0 2023-08-10T10:42:58.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.473+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf403e5f0 con 0x7fbcf8069be0 2023-08-10T10:42:58.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.473+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf403e9a0 con 0x7fbcf8069be0 2023-08-10T10:42:58.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.473+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf80c2810 con 0x7fbcf8069be0 2023-08-10T10:42:58.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.473+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80c2dd0 con 0x7fbcf8069be0 2023-08-10T10:42:58.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.474+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf804e270 con 0x7fbcf8069be0 2023-08-10T10:42:58.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.475+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbcf402cd50 con 0x7fbcf8069be0 2023-08-10T10:42:58.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.476+0000 7fbcee7fc640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 0x7fbcdc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.476+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbcf40ac2f0 con 0x7fbcf8069be0 2023-08-10T10:42:58.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.477+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 0x7fbcdc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.477+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7fbcdc072f80 con 0x7fbcf8069be0 2023-08-10T10:42:58.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.477+0000 7fbcfd364640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 0x7fbcdc06d110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80710c0 tx=0x7fbce8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.481+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbcf40771e0 con 0x7fbcf8069be0 2023-08-10T10:42:58.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.505+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(80..80 src has 1..80) v4 ==== 1967+0+0 (secure 0 0 0) 0x7fbcf40ac0c0 con 0x7fbcf8069be0 2023-08-10T10:42:58.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.505+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7fbcdc0745c0 con 0x7fbcf8069be0 2023-08-10T10:42:58.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.679+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf80b3160 con 0x7fbcf8069be0 2023-08-10T10:42:58.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.683+0000 7fbcee7fc640 1 -- 172.21.15.50:0/2091806701 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18600 (secure 0 0 0) 0x7fbcf407a800 con 0x7fbcf8069be0 2023-08-10T10:42:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:42:58.684 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:42:58.497018+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:42:58.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.685+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 msgr2=0x7fbcdc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.685+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 0x7fbcdc06d110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80710c0 tx=0x7fbce8008040 comp rx=0 tx=0).stop 2023-08-10T10:42:58.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.685+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 msgr2=0x7fbcf814e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.685+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4000f80 tx=0x7fbcf4004a40 comp rx=0 tx=0).stop 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 shutdown_connections 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbcdc06ac50 0x7fbcdc06d110 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcf8159970 0x7fbcf8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcf80b0f00 0x7fbcf8153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 --2- 172.21.15.50:0/2091806701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8069be0 0x7fbcf814e0a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 >> 172.21.15.50:0/2091806701 conn(0x7fbcf806b590 msgr2=0x7fbcf806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:58.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 shutdown_connections 2023-08-10T10:42:58.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.686+0000 7fbcffdc9640 1 -- 172.21.15.50:0/2091806701 wait complete. 2023-08-10T10:42:58.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:41:32.815026+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:41:33.402009+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:42:58.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:42:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.940+0000 7f0b8e712640 1 Processor -- start 2023-08-10T10:42:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.940+0000 7f0b8e712640 1 -- start start 2023-08-10T10:42:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.941+0000 7f0b8e712640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 0x7f0b880b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8e712640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b880ada90 0x7f0b880c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8e712640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 0x7f0b880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8e712640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880ca7f0 con 0x7f0b880ada90 2023-08-10T10:42:58.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8e712640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880adf10 con 0x7f0b880ca360 2023-08-10T10:42:58.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8e712640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8806ebb0 con 0x7f0b88159c10 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b7f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b880ada90 0x7f0b880c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b7f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b880ada90 0x7f0b880c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56276/0 (socket says 172.21.15.50:56276) 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b7f7fe640 1 -- 172.21.15.50:0/2798434119 learned_addr learned my addr 172.21.15.50:0/2798434119 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b8ccaf640 1 --2- 172.21.15.50:0/2798434119 >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 0x7f0b880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b7f7fe640 1 -- 172.21.15.50:0/2798434119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 msgr2=0x7f0b880b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b87fff640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 0x7f0b880b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.942+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 0x7f0b880b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.943+0000 7f0b7f7fe640 1 -- 172.21.15.50:0/2798434119 >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 msgr2=0x7f0b880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.943+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/2798434119 >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 0x7f0b880cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.943+0000 7f0b7f7fe640 1 -- 172.21.15.50:0/2798434119 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8806ee90 con 0x7f0b880ada90 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.943+0000 7f0b8ccaf640 1 --2- 172.21.15.50:0/2798434119 >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 0x7f0b880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.943+0000 7f0b87fff640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 0x7f0b880b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.944+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b880c9e20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0b880ce5c0 tx=0x7f0b7002daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab7ffcae13df4e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.944+0000 7f0b877fe640 1 -- 172.21.15.50:0/2798434119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7002f860 con 0x7f0b880ada90 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.944+0000 7f0b877fe640 1 -- 172.21.15.50:0/2798434119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7002f9c0 con 0x7f0b880ada90 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.944+0000 7f0b877fe640 1 -- 172.21.15.50:0/2798434119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7002fd50 con 0x7f0b880ada90 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 -- 172.21.15.50:0/2798434119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 msgr2=0x7f0b880c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b880c9e20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0b880ce5c0 tx=0x7f0b7002daa0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 -- 172.21.15.50:0/2798434119 shutdown_connections 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 --2- 172.21.15.50:0/2798434119 >> v2:172.21.15.117:3300/0 conn(0x7f0b880ca360 0x7f0b880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b880c9e20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 --2- 172.21.15.50:0/2798434119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b88159c10 0x7f0b880b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 -- 172.21.15.50:0/2798434119 >> 172.21.15.50:0/2798434119 conn(0x7f0b880b01b0 msgr2=0x7f0b880b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:58.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 -- 172.21.15.50:0/2798434119 shutdown_connections 2023-08-10T10:42:58.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.945+0000 7f0b8e712640 1 -- 172.21.15.50:0/2798434119 wait complete. 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.947+0000 7f0b8e712640 1 Processor -- start 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.947+0000 7f0b8e712640 1 -- start start 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b880ca360 0x7f0b880c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 0x7f0b8806fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c3910 con 0x7f0b880ada90 2023-08-10T10:42:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c3d30 con 0x7f0b88159c10 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b8e712640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c2c90 con 0x7f0b880ca360 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56284/0 (socket says 172.21.15.50:56284) 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.948+0000 7f0b87fff640 1 -- 172.21.15.50:0/712782554 learned_addr learned my addr 172.21.15.50:0/712782554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b880ca360 0x7f0b880c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b8ccaf640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 0x7f0b8806fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 -- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b880ca360 msgr2=0x7f0b880c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b880ca360 0x7f0b880c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 -- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 msgr2=0x7f0b8806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 0x7f0b8806fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 -- 172.21.15.50:0/712782554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700094d0 con 0x7f0b880ada90 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b8ccaf640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 0x7f0b8806fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b87fff640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c820 tx=0x7f0b7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007a30 con 0x7f0b880ada90 2023-08-10T10:42:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78007b90 con 0x7f0b880ada90 2023-08-10T10:42:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800ce70 con 0x7f0b880ada90 2023-08-10T10:42:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880c2f70 con 0x7f0b880ada90 2023-08-10T10:42:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.949+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b880c3530 con 0x7f0b880ada90 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.951+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880612b0 con 0x7f0b880ada90 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.951+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b780113f0 con 0x7f0b880ada90 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.952+0000 7f0b857fa640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 0x7f0b6806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.952+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0b78089830 con 0x7f0b880ada90 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.953+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 0x7f0b6806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.953+0000 7f0b7f7fe640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 0x7f0b6806d110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b70038000 tx=0x7f0b7003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:58.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:58.957+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0b780547b0 con 0x7f0b880ada90 2023-08-10T10:42:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.148+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b880c3b80 con 0x7f0b880ada90 2023-08-10T10:42:59.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.149+0000 7f0b857fa640 1 -- 172.21.15.50:0/712782554 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b78057dd0 con 0x7f0b880ada90 2023-08-10T10:42:59.150 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:42:59.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 msgr2=0x7f0b6806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 0x7f0b6806d110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b70038000 tx=0x7f0b7003b040 comp rx=0 tx=0).stop 2023-08-10T10:42:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 msgr2=0x7f0b8814ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c820 tx=0x7f0b7800cc20 comp rx=0 tx=0).stop 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 shutdown_connections 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0b6806ac50 0x7f0b6806d110 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b88159c10 0x7f0b8806fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b880ca360 0x7f0b880c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 --2- 172.21.15.50:0/712782554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880ada90 0x7f0b8814ffb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.152+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 >> 172.21.15.50:0/712782554 conn(0x7f0b880b01b0 msgr2=0x7f0b8815c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.153+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 shutdown_connections 2023-08-10T10:42:59.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.153+0000 7f0b8e712640 1 -- 172.21.15.50:0/712782554 wait complete. 2023-08-10T10:42:59.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:42:59.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.401+0000 7f7a13fff640 1 Processor -- start 2023-08-10T10:42:59.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.401+0000 7f7a13fff640 1 -- start start 2023-08-10T10:42:59.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 0x7f7a140c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a13fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140b1370 con 0x7f7a1415aa50 2023-08-10T10:42:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a13fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140b1650 con 0x7f7a140b4130 2023-08-10T10:42:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a13fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1415ae30 con 0x7f7a140b0610 2023-08-10T10:42:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a12ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a1415aa50 0x7f7a140cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35280/0 (socket says 172.21.15.50:35280) 2023-08-10T10:42:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.403+0000 7f7a12ffd640 1 -- 172.21.15.50:0/889403618 learned_addr learned my addr 172.21.15.50:0/889403618 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a137fe640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 0x7f7a140c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938887767 0 0) 0x7f7a140b1370 con 0x7f7a1415aa50 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc003520 con 0x7f7a1415aa50 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057105464 0 0) 0x7f79fc003520 con 0x7f7a1415aa50 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 msgr2=0x7f7a140c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 0x7f7a140c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 >> v1:172.21.15.117:6789/0 conn(0x7f7a140b4130 legacy=0x7f7a140aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140b1930 con 0x7f7a1415aa50 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7a04001670 con 0x7f7a1415aa50 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 >> v1:172.21.15.50:6789/0 conn(0x7f7a1415aa50 legacy=0x7f7a140cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79fc003a10 0x7f79fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 0x7f79fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1415ae30 con 0x7f79fc003a10 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc010040 con 0x7f79fc004d50 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.404+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc010200 con 0x7f7a140b0610 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79fc003a10 0x7f79fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 -- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 msgr2=0x7f79fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a140b0610 0x7f79fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 -- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79fc004d50 msgr2=0x7f79fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.405+0000 7f7a12ffd640 1 -- 172.21.15.50:0/889403618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc003520 con 0x7f79fc003a10 2023-08-10T10:42:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.406+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79fc003a10 0x7f79fc003e30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c240 tx=0x7f79fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f306540a808d43 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.406+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04005ad0 con 0x7f79fc003a10 2023-08-10T10:42:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.406+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04005c30 con 0x7f79fc003a10 2023-08-10T10:42:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.406+0000 7f7a11ffb640 1 -- 172.21.15.50:0/889403618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0402c8b0 con 0x7f79fc003a10 2023-08-10T10:42:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 -- 172.21.15.50:0/889403618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79fc003a10 msgr2=0x7f79fc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 --2- 172.21.15.50:0/889403618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79fc003a10 0x7f79fc003e30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c240 tx=0x7f79fc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a137fe640 1 -- 172.21.15.50:0/889403618 reap_dead start 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 -- 172.21.15.50:0/889403618 shutdown_connections 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 -- 172.21.15.50:0/889403618 >> 172.21.15.50:0/889403618 conn(0x7f7a14069cd0 msgr2=0x7f7a140caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 -- 172.21.15.50:0/889403618 shutdown_connections 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.407+0000 7f7a13fff640 1 -- 172.21.15.50:0/889403618 wait complete. 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.409+0000 7f7a13fff640 1 Processor -- start 2023-08-10T10:42:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.409+0000 7f7a13fff640 1 -- start start 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 0x7f7a141f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1415c560 0x7f7a1415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14070590 con 0x7f7a1415af90 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141f23f0 con 0x7f7a1415c560 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a13fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1415b4c0 con 0x7f79fc003a10 2023-08-10T10:42:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.410+0000 7f7a127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56310/0 (socket says 172.21.15.50:56310) 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 -- 172.21.15.50:0/1732345695 learned_addr learned my addr 172.21.15.50:0/1732345695 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 0x7f7a141f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 -- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 msgr2=0x7f7a141f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 0x7f7a141f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 -- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1415c560 msgr2=0x7f7a1415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1415c560 0x7f7a1415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 -- 172.21.15.50:0/1732345695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1415b7a0 con 0x7f7a1415af90 2023-08-10T10:42:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 0x7f7a141f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.411+0000 7f7a127fc640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c430 tx=0x7f7a0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.412+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080052d0 con 0x7f7a1415af90 2023-08-10T10:42:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.412+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a08005450 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.412+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08003830 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.412+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1415ba80 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.412+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1415c040 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.413+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a140c5530 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.414+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a08003990 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.415+0000 7f79fb7fe640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 0x7f7a0006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.415+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7a08088aa0 con 0x7f7a1415af90 2023-08-10T10:42:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.415+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 0x7f7a0006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.416+0000 7f7a12ffd640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 0x7f7a0006d110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034000 tx=0x7f7a04009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.419+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a140c5530 con 0x7f7a1415af90 2023-08-10T10:42:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.616+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a140c5530 con 0x7f7a1415af90 2023-08-10T10:42:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.617+0000 7f79fb7fe640 1 -- 172.21.15.50:0/1732345695 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a08017020 con 0x7f7a1415af90 2023-08-10T10:42:59.618 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:42:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.619+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 msgr2=0x7f7a0006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.619+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 0x7f7a0006d110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034000 tx=0x7f7a04009030 comp rx=0 tx=0).stop 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.619+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 msgr2=0x7f7a141590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.619+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c430 tx=0x7f7a0800c8f0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 shutdown_connections 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7a0006ac50 0x7f7a0006d110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1415c560 0x7f7a1415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a1415af90 0x7f7a141590b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 --2- 172.21.15.50:0/1732345695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79fc003a10 0x7f7a141f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 >> 172.21.15.50:0/1732345695 conn(0x7f7a14069cd0 msgr2=0x7f7a140afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 shutdown_connections 2023-08-10T10:42:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.620+0000 7f7a13fff640 1 -- 172.21.15.50:0/1732345695 wait complete. 2023-08-10T10:42:59.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:42:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.870+0000 7f59a6683640 1 Processor -- start 2023-08-10T10:42:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.870+0000 7f59a6683640 1 -- start start 2023-08-10T10:42:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.872+0000 7f59a6683640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59a015ae40 0x7f59a00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.872+0000 7f59a6683640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a006c320 con 0x7f59a00cd9b0 2023-08-10T10:42:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.872+0000 7f59a6683640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a006b770 con 0x7f59a006cb30 2023-08-10T10:42:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.872+0000 7f59a6683640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a006b9f0 con 0x7f59a015ae40 2023-08-10T10:42:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.873+0000 7f59a4c20640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59a00cd9b0 0x7f59a00c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35290/0 (socket says 172.21.15.50:35290) 2023-08-10T10:42:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.873+0000 7f59a4c20640 1 -- 172.21.15.50:0/401114422 learned_addr learned my addr 172.21.15.50:0/401114422 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:42:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.873+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267347362 0 0) 0x7f59a006c320 con 0x7f59a00cd9b0 2023-08-10T10:42:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.873+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5988003520 con 0x7f59a00cd9b0 2023-08-10T10:42:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599ffff640 1 --2- 172.21.15.50:0/401114422 >> v2:172.21.15.117:3300/0 conn(0x7f59a015ae40 0x7f59a00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3986193632 0 0) 0x7f5988003520 con 0x7f59a00cd9b0 2023-08-10T10:42:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 >> v2:172.21.15.117:3300/0 conn(0x7f59a015ae40 msgr2=0x7f59a00b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 --2- 172.21.15.50:0/401114422 >> v2:172.21.15.117:3300/0 conn(0x7f59a015ae40 0x7f59a00b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 >> v1:172.21.15.117:6789/0 conn(0x7f59a006cb30 legacy=0x7f59a00cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a006bcd0 con 0x7f59a00cd9b0 2023-08-10T10:42:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f59980019f0 con 0x7f59a00cd9b0 2023-08-10T10:42:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 >> v1:172.21.15.50:6789/0 conn(0x7f59a00cd9b0 legacy=0x7f59a00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5988003970 0x7f5988003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59880047c0 0x7f5988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f598800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a006b9f0 con 0x7f5988005180 2023-08-10T10:42:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598800c0d0 con 0x7f5988003970 2023-08-10T10:42:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598800c290 con 0x7f59880047c0 2023-08-10T10:42:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f59a4c20640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f598800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.874+0000 7f599ffff640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5988003970 0x7f5988003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f599f7fe640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59880047c0 0x7f5988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f59a4c20640 1 -- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59880047c0 msgr2=0x7f5988004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f59a4c20640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59880047c0 0x7f5988004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f59a4c20640 1 -- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5988003970 msgr2=0x7f5988003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:42:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f59a4c20640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5988003970 0x7f5988003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.875+0000 7f59a4c20640 1 -- 172.21.15.50:0/401114422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988003520 con 0x7f5988005180 2023-08-10T10:42:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.876+0000 7f59a4c20640 1 -- 172.21.15.50:0/401114422 reap_dead start 2023-08-10T10:42:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.876+0000 7f59a4c20640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f598800b980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f599800a800 tx=0x7f59880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dda9c83df61f9f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.876+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59980072d0 con 0x7f5988005180 2023-08-10T10:42:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.876+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599802f070 con 0x7f5988005180 2023-08-10T10:42:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.876+0000 7f599effd640 1 -- 172.21.15.50:0/401114422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998007690 con 0x7f5988005180 2023-08-10T10:42:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 -- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 msgr2=0x7f598800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f598800b980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f599800a800 tx=0x7f59880057f0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 -- 172.21.15.50:0/401114422 shutdown_connections 2023-08-10T10:42:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 --2- 172.21.15.50:0/401114422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f598800b980 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 -- 172.21.15.50:0/401114422 >> 172.21.15.50:0/401114422 conn(0x7f59a00b01b0 msgr2=0x7f59a00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 -- 172.21.15.50:0/401114422 shutdown_connections 2023-08-10T10:42:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.877+0000 7f59a6683640 1 -- 172.21.15.50:0/401114422 wait complete. 2023-08-10T10:42:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.879+0000 7f59a6683640 1 Processor -- start 2023-08-10T10:42:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.879+0000 7f59a6683640 1 -- start start 2023-08-10T10:42:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 0x7f59a00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59a01483b0 0x7f59a0148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00c89b0 con 0x7f5988005180 2023-08-10T10:42:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01490e0 con 0x7f59a00ca350 2023-08-10T10:42:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f59a6683640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01f65f0 con 0x7f59a01483b0 2023-08-10T10:42:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f599ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f599ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56322/0 (socket says 172.21.15.50:56322) 2023-08-10T10:42:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.880+0000 7f599ffff640 1 -- 172.21.15.50:0/3256296689 learned_addr learned my addr 172.21.15.50:0/3256296689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:42:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599f7fe640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 0x7f59a00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f59a4c20640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59a01483b0 0x7f59a0148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 -- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59a01483b0 msgr2=0x7f59a0148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59a01483b0 0x7f59a0148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 -- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 msgr2=0x7f59a00ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 0x7f59a00ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 -- 172.21.15.50:0/3256296689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a01f5830 con 0x7f5988005180 2023-08-10T10:42:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599f7fe640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 0x7f59a00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.881+0000 7f599ffff640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f599000f5b0 tx=0x7f599000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.882+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990013810 con 0x7f5988005180 2023-08-10T10:42:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.882+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990013970 con 0x7f5988005180 2023-08-10T10:42:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.882+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990013ce0 con 0x7f5988005180 2023-08-10T10:42:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.882+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a01f5b10 con 0x7f5988005180 2023-08-10T10:42:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.882+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a01f60d0 con 0x7f5988005180 2023-08-10T10:42:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.883+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a01f6290 con 0x7f5988005180 2023-08-10T10:42:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.884+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f599001f460 con 0x7f5988005180 2023-08-10T10:42:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.885+0000 7f599cff9640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 0x7f598c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.885+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5990089970 con 0x7f5988005180 2023-08-10T10:42:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.886+0000 7f599f7fe640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 0x7f598c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.887+0000 7f599f7fe640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 0x7f598c06d140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5994000c00 tx=0x7f5994009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:42:59.890+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f59900548f0 con 0x7f5988005180 2023-08-10T10:43:00.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.080+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59a00612b0 con 0x7f5988005180 2023-08-10T10:43:00.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.081+0000 7f599cff9640 1 -- 172.21.15.50:0/3256296689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5990057f10 con 0x7f5988005180 2023-08-10T10:43:00.082 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:43:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.083+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 msgr2=0x7f598c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.083+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 0x7f598c06d140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5994000c00 tx=0x7f5994009040 comp rx=0 tx=0).stop 2023-08-10T10:43:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.083+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 msgr2=0x7f59a00c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.083+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f599000f5b0 tx=0x7f599000fa70 comp rx=0 tx=0).stop 2023-08-10T10:43:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 shutdown_connections 2023-08-10T10:43:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59a01483b0 0x7f59a0148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f598c06ac80 0x7f598c06d140 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59a00ca350 0x7f59a00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 --2- 172.21.15.50:0/3256296689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988005180 0x7f59a00c2460 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 >> 172.21.15.50:0/3256296689 conn(0x7f59a00b01b0 msgr2=0x7f59a0159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 shutdown_connections 2023-08-10T10:43:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.084+0000 7f59a6683640 1 -- 172.21.15.50:0/3256296689 wait complete. 2023-08-10T10:43:00.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:43:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.343+0000 7f77cd846640 1 Processor -- start 2023-08-10T10:43:00.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.343+0000 7f77cd846640 1 -- start start 2023-08-10T10:43:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77cd846640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77c815cde0 0x7f77c80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77cd846640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77c80b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77cd846640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80d0bf0 con 0x7f77c80b6440 2023-08-10T10:43:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77cd846640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80b68d0 con 0x7f77c815cde0 2023-08-10T10:43:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77cd846640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ce320 con 0x7f77c80d1e60 2023-08-10T10:43:00.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77c77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77c80b6440 0x7f77c80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35296/0 (socket says 172.21.15.50:35296) 2023-08-10T10:43:00.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77c77fe640 1 -- 172.21.15.50:0/4136838204 learned_addr learned my addr 172.21.15.50:0/4136838204 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/4136838204 >> v2:172.21.15.117:3300/0 conn(0x7f77c815cde0 0x7f77c80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.345+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978382170 0 0) 0x7f77c80d0bf0 con 0x7f77c80b6440 2023-08-10T10:43:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b0003520 con 0x7f77c80b6440 2023-08-10T10:43:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c67fc640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77c80b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785418397 0 0) 0x7f77b0003520 con 0x7f77c80b6440 2023-08-10T10:43:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 msgr2=0x7f77c80b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77c80b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 >> v2:172.21.15.117:3300/0 conn(0x7f77c815cde0 msgr2=0x7f77c80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 --2- 172.21.15.50:0/4136838204 >> v2:172.21.15.117:3300/0 conn(0x7f77c815cde0 0x7f77c80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80d0e40 con 0x7f77c80b6440 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f77c0001670 con 0x7f77c80b6440 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 >> v1:172.21.15.50:6789/0 conn(0x7f77c80b6440 legacy=0x7f77c80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b0003970 0x7f77b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77b0004d00 0x7f77b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b68d0 con 0x7f77b0004d00 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ce320 con 0x7f77b0003970 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b000b980 con 0x7f77c80d1e60 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.346+0000 7f77c77fe640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77b0004d00 0x7f77b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b0003970 0x7f77b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c67fc640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c77fe640 1 -- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 msgr2=0x7f77b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c77fe640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77c80d1e60 0x7f77b00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c77fe640 1 -- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b0003970 msgr2=0x7f77b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c77fe640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b0003970 0x7f77b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c77fe640 1 -- 172.21.15.50:0/4136838204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0003520 con 0x7f77b0004d00 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.347+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b0003970 0x7f77b0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:00.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.348+0000 7f77c77fe640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77b0004d00 0x7f77b0005180 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c270 tx=0x7f77b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fca17589a8986e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.348+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c002cae0 con 0x7f77b0004d00 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.348+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c002cc40 con 0x7f77b0004d00 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.348+0000 7f77c5ffb640 1 -- 172.21.15.50:0/4136838204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00058d0 con 0x7f77b0004d00 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 -- 172.21.15.50:0/4136838204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77b0004d00 msgr2=0x7f77b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 --2- 172.21.15.50:0/4136838204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77b0004d00 0x7f77b0005180 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c270 tx=0x7f77b00057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77c77fe640 1 -- 172.21.15.50:0/4136838204 reap_dead start 2023-08-10T10:43:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 -- 172.21.15.50:0/4136838204 shutdown_connections 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 -- 172.21.15.50:0/4136838204 >> 172.21.15.50:0/4136838204 conn(0x7f77c806fcc0 msgr2=0x7f77c80700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 -- 172.21.15.50:0/4136838204 shutdown_connections 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.349+0000 7f77cd846640 1 -- 172.21.15.50:0/4136838204 wait complete. 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.351+0000 7f77cd846640 1 Processor -- start 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.351+0000 7f77cd846640 1 -- start start 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b0004d00 0x7f77c8153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 0x7f77c81546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81536e0 con 0x7f77c80d2c20 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8155140 con 0x7f77c80d27c0 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77cd846640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8152850 con 0x7f77b0004d00 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56338/0 (socket says 172.21.15.50:56338) 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.352+0000 7f77c77fe640 1 -- 172.21.15.50:0/3944560381 learned_addr learned my addr 172.21.15.50:0/3944560381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c67fc640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 0x7f77c81546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b0004d00 0x7f77c8153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 -- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b0004d00 msgr2=0x7f77c8153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b0004d00 0x7f77c8153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 -- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 msgr2=0x7f77c81546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 0x7f77c81546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 -- 172.21.15.50:0/3944560381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8152a60 con 0x7f77c80d2c20 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c67fc640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 0x7f77c81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77c77fe640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c210 tx=0x7f77c0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c003c040 con 0x7f77c80d2c20 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.353+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0001630 con 0x7f77c80d2c20 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.354+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0007290 con 0x7f77c80d2c20 2023-08-10T10:43:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.354+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c8152d40 con 0x7f77c80d2c20 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.354+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c8153300 con 0x7f77c80d2c20 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.355+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c8153820 con 0x7f77c80d2c20 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.356+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77c0032070 con 0x7f77c80d2c20 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.357+0000 7f77affff640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 0x7f77b406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.357+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f77c00aa6a0 con 0x7f77c80d2c20 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.357+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 0x7f77b406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.358+0000 7f77c6ffd640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 0x7f77b406d140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77b8007440 tx=0x7f77b800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.361+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f77c8153820 con 0x7f77c80d2c20 2023-08-10T10:43:00.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.562+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77c8153820 con 0x7f77c80d2c20 2023-08-10T10:43:00.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.563+0000 7f77affff640 1 -- 172.21.15.50:0/3944560381 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77c8153820 con 0x7f77c80d2c20 2023-08-10T10:43:00.563 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:43:00.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.565+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 msgr2=0x7f77b406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.565+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 0x7f77b406d140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77b8007440 tx=0x7f77b800b040 comp rx=0 tx=0).stop 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.565+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 msgr2=0x7f77c8154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.565+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f77c000c210 tx=0x7f77c0001a70 comp rx=0 tx=0).stop 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 shutdown_connections 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77c80d2c20 0x7f77c8154c00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f77b406ac80 0x7f77b406d140 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77c80d27c0 0x7f77c81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 --2- 172.21.15.50:0/3944560381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b0004d00 0x7f77c8153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 >> 172.21.15.50:0/3944560381 conn(0x7f77c806fcc0 msgr2=0x7f77c815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:00.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 shutdown_connections 2023-08-10T10:43:00.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.566+0000 7f77cd846640 1 -- 172.21.15.50:0/3944560381 wait complete. 2023-08-10T10:43:00.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:00.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.812+0000 7f7c21b37640 1 Processor -- start 2023-08-10T10:43:00.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.812+0000 7f7c21b37640 1 -- start start 2023-08-10T10:43:00.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c21b37640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c1c15f510 0x7f7c1c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c21b37640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c15d010 con 0x7f7c1c153850 2023-08-10T10:43:00.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c21b37640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c15d290 con 0x7f7c1c0b1da0 2023-08-10T10:43:00.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c21b37640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1c15d570 con 0x7f7c1c15f510 2023-08-10T10:43:00.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c20b35640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c1c153850 0x7f7c1c0b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35298/0 (socket says 172.21.15.50:35298) 2023-08-10T10:43:00.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c20b35640 1 -- 172.21.15.50:0/4178072251 learned_addr learned my addr 172.21.15.50:0/4178072251 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:00.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.814+0000 7f7c21336640 1 --2- 172.21.15.50:0/4178072251 >> v2:172.21.15.50:3300/0 conn(0x7f7c1c15f510 0x7f7c1c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.815+0000 7f7c21336640 1 -- 172.21.15.50:0/4178072251 >> v1:172.21.15.117:6789/0 conn(0x7f7c1c0b1da0 legacy=0x7f7c1c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.815+0000 7f7c21336640 1 -- 172.21.15.50:0/4178072251 >> v1:172.21.15.50:6789/0 conn(0x7f7c1c153850 legacy=0x7f7c1c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.815+0000 7f7c21336640 1 -- 172.21.15.50:0/4178072251 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c15d850 con 0x7f7c1c15f510 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.816+0000 7f7c21336640 1 --2- 172.21.15.50:0/4178072251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c0ccef0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006fd0 tx=0x7f7c1402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4addccf1255b2a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.816+0000 7f7c137fe640 1 -- 172.21.15.50:0/4178072251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1402d040 con 0x7f7c1c15f510 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.816+0000 7f7c137fe640 1 -- 172.21.15.50:0/4178072251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14031810 con 0x7f7c1c15f510 2023-08-10T10:43:00.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.816+0000 7f7c137fe640 1 -- 172.21.15.50:0/4178072251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14031ba0 con 0x7f7c1c15f510 2023-08-10T10:43:00.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 -- 172.21.15.50:0/4178072251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 msgr2=0x7f7c1c0ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 --2- 172.21.15.50:0/4178072251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c0ccef0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006fd0 tx=0x7f7c1402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 -- 172.21.15.50:0/4178072251 shutdown_connections 2023-08-10T10:43:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 --2- 172.21.15.50:0/4178072251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c0ccef0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 -- 172.21.15.50:0/4178072251 >> 172.21.15.50:0/4178072251 conn(0x7f7c1c069880 msgr2=0x7f7c1c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 -- 172.21.15.50:0/4178072251 shutdown_connections 2023-08-10T10:43:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.817+0000 7f7c21b37640 1 -- 172.21.15.50:0/4178072251 wait complete. 2023-08-10T10:43:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.819+0000 7f7c21b37640 1 Processor -- start 2023-08-10T10:43:00.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.819+0000 7f7c21b37640 1 -- start start 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.820+0000 7f7c21b37640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c153850 0x7f7c1c1e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21b37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21b37640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 0x7f7c1c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21b37640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c1560b0 con 0x7f7c1c15f510 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21b37640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c156390 con 0x7f7c1c153850 2023-08-10T10:43:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21b37640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c156670 con 0x7f7c1c157150 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56346/0 (socket says 172.21.15.50:56346) 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 -- 172.21.15.50:0/700380660 learned_addr learned my addr 172.21.15.50:0/700380660 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c20b35640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c153850 0x7f7c1c1e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21336640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 0x7f7c1c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 -- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 msgr2=0x7f7c1c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 0x7f7c1c160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 -- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c153850 msgr2=0x7f7c1c1e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c153850 0x7f7c1c1e8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c13fff640 1 -- 172.21.15.50:0/700380660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14009400 con 0x7f7c1c15f510 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.821+0000 7f7c21336640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 0x7f7c1c160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c13fff640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c430 tx=0x7f7c0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011790 con 0x7f7c1c15f510 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0118f0 con 0x7f7c1c15f510 2023-08-10T10:43:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011ce0 con 0x7f7c1c15f510 2023-08-10T10:43:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c156950 con 0x7f7c1c15f510 2023-08-10T10:43:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.822+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c1e9200 con 0x7f7c1c15f510 2023-08-10T10:43:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.823+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c156e70 con 0x7f7c1c15f510 2023-08-10T10:43:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.824+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c0c01c460 con 0x7f7c1c15f510 2023-08-10T10:43:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.826+0000 7f7c117fa640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 0x7f7c0806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.826+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7c0c0895a0 con 0x7f7c1c15f510 2023-08-10T10:43:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.826+0000 7f7c20b35640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 0x7f7c0806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.827+0000 7f7c20b35640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 0x7f7c0806d110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005c00 tx=0x7f7c18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:00.830+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7c1c156e70 con 0x7f7c1c15f510 2023-08-10T10:43:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.064+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c1c156e70 con 0x7f7c1c15f510 2023-08-10T10:43:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.065+0000 7f7c117fa640 1 -- 172.21.15.50:0/700380660 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f7c1c156e70 con 0x7f7c1c15f510 2023-08-10T10:43:01.066 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:01.067 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:43:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:43:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.068+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 msgr2=0x7f7c0806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.068+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 0x7f7c0806d110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005c00 tx=0x7f7c18009040 comp rx=0 tx=0).stop 2023-08-10T10:43:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.068+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 msgr2=0x7f7c1c160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.068+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c430 tx=0x7f7c0c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 shutdown_connections 2023-08-10T10:43:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c157150 0x7f7c1c160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c15f510 0x7f7c1c160590 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c0806ac50 0x7f7c0806d110 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 --2- 172.21.15.50:0/700380660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c153850 0x7f7c1c1e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 >> 172.21.15.50:0/700380660 conn(0x7f7c1c069880 msgr2=0x7f7c1c0b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 shutdown_connections 2023-08-10T10:43:01.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.069+0000 7f7c21b37640 1 -- 172.21.15.50:0/700380660 wait complete. 2023-08-10T10:43:01.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:01.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.306+0000 7f1fa757f640 1 Processor -- start 2023-08-10T10:43:01.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.306+0000 7f1fa757f640 1 -- start start 2023-08-10T10:43:01.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa757f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1fa0165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa757f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa00b1f10 con 0x7f1fa015a940 2023-08-10T10:43:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa757f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa015e7d0 con 0x7f1fa00b0620 2023-08-10T10:43:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa757f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b21f0 con 0x7f1fa015f2b0 2023-08-10T10:43:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa657d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1fa015a940 0x7f1fa00aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35302/0 (socket says 172.21.15.50:35302) 2023-08-10T10:43:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.308+0000 7f1fa657d640 1 -- 172.21.15.50:0/2922710446 learned_addr learned my addr 172.21.15.50:0/2922710446 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1fa0165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961338174 0 0) 0x7f1fa00b1f10 con 0x7f1fa015a940 2023-08-10T10:43:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c003520 con 0x7f1fa015a940 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228128736 0 0) 0x7f1f8c003520 con 0x7f1fa015a940 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 msgr2=0x7f1fa0165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1fa0165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 >> v1:172.21.15.117:6789/0 conn(0x7f1fa00b0620 legacy=0x7f1fa00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa015eab0 con 0x7f1fa015a940 2023-08-10T10:43:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1f9c001670 con 0x7f1fa015a940 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 >> v1:172.21.15.50:6789/0 conn(0x7f1fa015a940 legacy=0x7f1fa00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.309+0000 7f1fa557b640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1f8c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa557b640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f8c003f90 0x7f1f8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa557b640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8c004d00 0x7f1f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00bb40 con 0x7f1f8c004d00 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00bcb0 con 0x7f1f8c003f90 2023-08-10T10:43:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00be70 con 0x7f1fa015f2b0 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8c004d00 0x7f1f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa657d640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1f8c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa5d7c640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f8c003f90 0x7f1f8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 msgr2=0x7f1f8c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa015f2b0 0x7f1f8c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f8c003f90 msgr2=0x7f1f8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f8c003f90 0x7f1f8c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/2922710446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c003520 con 0x7f1f8c004d00 2023-08-10T10:43:01.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.310+0000 7f1fa5d7c640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f8c003f90 0x7f1f8c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.312+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8c004d00 0x7f1f8c005180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009f90 tx=0x7f1f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506506a16f99e83f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.312+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9802cbd0 con 0x7f1f8c004d00 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.312+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800f040 con 0x7f1f8c004d00 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.312+0000 7f1fa557b640 1 -- 172.21.15.50:0/2922710446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98034440 con 0x7f1f8c004d00 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 -- 172.21.15.50:0/2922710446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8c004d00 msgr2=0x7f1f8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 --2- 172.21.15.50:0/2922710446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8c004d00 0x7f1f8c005180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009f90 tx=0x7f1f8c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/2922710446 reap_dead start 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 -- 172.21.15.50:0/2922710446 shutdown_connections 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 -- 172.21.15.50:0/2922710446 >> 172.21.15.50:0/2922710446 conn(0x7f1fa006ab80 msgr2=0x7f1fa006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 -- 172.21.15.50:0/2922710446 shutdown_connections 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.313+0000 7f1fa757f640 1 -- 172.21.15.50:0/2922710446 wait complete. 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.315+0000 7f1fa757f640 1 Processor -- start 2023-08-10T10:43:01.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.315+0000 7f1fa757f640 1 -- start start 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8c004d00 0x7f1fa01497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa015d770 0x7f1fa00c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa015b220 con 0x7f1fa015dbf0 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c6550 con 0x7f1fa015d770 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa757f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c6830 con 0x7f1f8c004d00 2023-08-10T10:43:01.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa6d7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa6d7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56362/0 (socket says 172.21.15.50:56362) 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/3162829549 learned_addr learned my addr 172.21.15.50:0/3162829549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa657d640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8c004d00 0x7f1fa01497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa5d7c640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa015d770 0x7f1fa00c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8c004d00 msgr2=0x7f1fa01497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.317+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8c004d00 0x7f1fa01497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa015d770 msgr2=0x7f1fa00c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa015d770 0x7f1fa00c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa6d7e640 1 -- 172.21.15.50:0/3162829549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00c6b10 con 0x7f1fa015dbf0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa6d7e640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1f98037040 tx=0x7f1f98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98003b90 con 0x7f1fa015dbf0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98003cf0 con 0x7f1fa015dbf0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98034b60 con 0x7f1fa015dbf0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa00c6df0 con 0x7f1fa015dbf0 2023-08-10T10:43:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.318+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa01f1330 con 0x7f1fa015dbf0 2023-08-10T10:43:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.320+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa015b360 con 0x7f1fa015dbf0 2023-08-10T10:43:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.321+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f98034cc0 con 0x7f1fa015dbf0 2023-08-10T10:43:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.322+0000 7f1f96ffd640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 0x7f1f8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.322+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1f980aad70 con 0x7f1fa015dbf0 2023-08-10T10:43:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.322+0000 7f1fa657d640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 0x7f1f8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.323+0000 7f1fa657d640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 0x7f1f8406d110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c001050 tx=0x7f1f9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.326+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1fa015b360 con 0x7f1fa015dbf0 2023-08-10T10:43:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.520+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa015b360 con 0x7f1fa015dbf0 2023-08-10T10:43:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.522+0000 7f1f96ffd640 1 -- 172.21.15.50:0/3162829549 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18521 (secure 0 0 0) 0x7f1fa015b360 con 0x7f1fa015dbf0 2023-08-10T10:43:01.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:01.524 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":81,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:00.491646+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 msgr2=0x7f1f8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 0x7f1f8406d110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c001050 tx=0x7f1f9c009040 comp rx=0 tx=0).stop 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 msgr2=0x7f1fa00c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1f98037040 tx=0x7f1f98009750 comp rx=0 tx=0).stop 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 shutdown_connections 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fa015dbf0 0x7f1fa00c7a40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1f8406ac50 0x7f1f8406d110 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa015d770 0x7f1fa00c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 --2- 172.21.15.50:0/3162829549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8c004d00 0x7f1fa01497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 >> 172.21.15.50:0/3162829549 conn(0x7f1fa006ab80 msgr2=0x7f1fa0159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 shutdown_connections 2023-08-10T10:43:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.525+0000 7f1fa757f640 1 -- 172.21.15.50:0/3162829549 wait complete. 2023-08-10T10:43:01.545 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:43:01.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.763+0000 7f4aa359e640 1 Processor -- start 2023-08-10T10:43:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.764+0000 7f4aa359e640 1 -- start start 2023-08-10T10:43:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.765+0000 7f4aa359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4aa415a940 0x7f4aa40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.765+0000 7f4aa359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aa40b19d0 0x7f4aa40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.765+0000 7f4aa359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40b1f10 con 0x7f4aa415f2b0 2023-08-10T10:43:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.765+0000 7f4aa359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40b21f0 con 0x7f4aa40b19d0 2023-08-10T10:43:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.765+0000 7f4aa359e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa415e5c0 con 0x7f4aa415a940 2023-08-10T10:43:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aa40b19d0 0x7f4aa40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aa40b19d0 0x7f4aa40b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56376/0 (socket says 172.21.15.50:56376) 2023-08-10T10:43:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 -- 172.21.15.50:0/1062938832 learned_addr learned my addr 172.21.15.50:0/1062938832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa259c640 1 --2- 172.21.15.50:0/1062938832 >> v2:172.21.15.117:3300/0 conn(0x7f4aa415a940 0x7f4aa40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 -- 172.21.15.50:0/1062938832 >> v2:172.21.15.117:3300/0 conn(0x7f4aa415a940 msgr2=0x7f4aa40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 --2- 172.21.15.50:0/1062938832 >> v2:172.21.15.117:3300/0 conn(0x7f4aa415a940 0x7f4aa40aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 -- 172.21.15.50:0/1062938832 >> v1:172.21.15.117:6789/0 conn(0x7f4aa415f2b0 legacy=0x7f4aa40b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.766+0000 7f4aa2d9d640 1 -- 172.21.15.50:0/1062938832 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa415e7d0 con 0x7f4aa40b19d0 2023-08-10T10:43:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.767+0000 7f4aa2d9d640 1 --2- 172.21.15.50:0/1062938832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40b0450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40ce2e0 tx=0x7f4a9c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382b73ca78d0d4f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.768+0000 7f4aa159a640 1 -- 172.21.15.50:0/1062938832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c02c9f0 con 0x7f4aa40b19d0 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.768+0000 7f4aa159a640 1 -- 172.21.15.50:0/1062938832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c02cb50 con 0x7f4aa40b19d0 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.768+0000 7f4aa159a640 1 -- 172.21.15.50:0/1062938832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0343f0 con 0x7f4aa40b19d0 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 -- 172.21.15.50:0/1062938832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa40b19d0 msgr2=0x7f4aa40b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 --2- 172.21.15.50:0/1062938832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40b0450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40ce2e0 tx=0x7f4a9c02be50 comp rx=0 tx=0).stop 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 -- 172.21.15.50:0/1062938832 shutdown_connections 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 --2- 172.21.15.50:0/1062938832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40b0450 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 --2- 172.21.15.50:0/1062938832 >> v2:172.21.15.117:3300/0 conn(0x7f4aa415a940 0x7f4aa40aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 -- 172.21.15.50:0/1062938832 >> 172.21.15.50:0/1062938832 conn(0x7f4aa406ab80 msgr2=0x7f4aa406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:01.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 -- 172.21.15.50:0/1062938832 shutdown_connections 2023-08-10T10:43:01.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.769+0000 7f4aa359e640 1 -- 172.21.15.50:0/1062938832 wait complete. 2023-08-10T10:43:01.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.771+0000 7f4aa359e640 1 Processor -- start 2023-08-10T10:43:01.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.771+0000 7f4aa359e640 1 -- start start 2023-08-10T10:43:01.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa415f2b0 0x7f4aa41edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40ce3a0 con 0x7f4aa415a940 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40cd790 con 0x7f4aa40b19d0 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40cda70 con 0x7f4aa415f2b0 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56378/0 (socket says 172.21.15.50:56378) 2023-08-10T10:43:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.772+0000 7f4aa1d9b640 1 -- 172.21.15.50:0/200446906 learned_addr learned my addr 172.21.15.50:0/200446906 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa259c640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa2d9d640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa415f2b0 0x7f4aa41edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 -- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa415f2b0 msgr2=0x7f4aa41edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa415f2b0 0x7f4aa41edb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 -- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40b19d0 msgr2=0x7f4aa40c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 -- 172.21.15.50:0/200446906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c009b30 con 0x7f4aa415a940 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa1d9b640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c400 tx=0x7f4a9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98011790 con 0x7f4aa415a940 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98011930 con 0x7f4aa415a940 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa40cdd50 con 0x7f4aa415a940 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98011ce0 con 0x7f4aa415a940 2023-08-10T10:43:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.773+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa41ee0a0 con 0x7f4aa415a940 2023-08-10T10:43:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.775+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa40ce550 con 0x7f4aa415a940 2023-08-10T10:43:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.776+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a9801c460 con 0x7f4aa415a940 2023-08-10T10:43:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.777+0000 7f4a92ffd640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 0x7f4a8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.777+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4a98089510 con 0x7f4aa415a940 2023-08-10T10:43:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.777+0000 7f4aa259c640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 0x7f4a8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.778+0000 7f4aa259c640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 0x7f4a8406d110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006fd0 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:01.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:01.782+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4aa40ce550 con 0x7f4aa415a940 2023-08-10T10:43:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.012+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4aa4066e30 con 0x7f4aa415a940 2023-08-10T10:43:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.013+0000 7f4a92ffd640 1 -- 172.21.15.50:0/200446906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f4a98057f20 con 0x7f4aa415a940 2023-08-10T10:43:02.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:02.014 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:43:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:43:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.015+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 msgr2=0x7f4a8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.015+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 0x7f4a8406d110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006fd0 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-08-10T10:43:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.015+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 msgr2=0x7f4aa40cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.015+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c400 tx=0x7f4a9800c8c0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 shutdown_connections 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa415f2b0 0x7f4aa41edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa415a940 0x7f4aa40cd090 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a8406ac50 0x7f4a8406d110 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 --2- 172.21.15.50:0/200446906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40b19d0 0x7f4aa40c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 >> 172.21.15.50:0/200446906 conn(0x7f4aa406ab80 msgr2=0x7f4aa40cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 shutdown_connections 2023-08-10T10:43:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.016+0000 7f4aa359e640 1 -- 172.21.15.50:0/200446906 wait complete. 2023-08-10T10:43:02.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:02.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.254+0000 7f2de2b55640 1 Processor -- start 2023-08-10T10:43:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.254+0000 7f2de2b55640 1 -- start start 2023-08-10T10:43:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de2b55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc0696a0 0x7f2ddc069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de2b55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ddc0b1ae0 0x7f2ddc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de2b55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc15e1f0 con 0x7f2ddc159970 2023-08-10T10:43:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de2b55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0b10d0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de2b55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc15d5e0 con 0x7f2ddc0696a0 2023-08-10T10:43:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de08f1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ddc159970 0x7f2ddc0b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35304/0 (socket says 172.21.15.50:35304) 2023-08-10T10:43:02.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de08f1640 1 -- 172.21.15.50:0/3715971193 learned_addr learned my addr 172.21.15.50:0/3715971193 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:02.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.256+0000 7f2de10f2640 1 --2- 172.21.15.50:0/3715971193 >> v2:172.21.15.50:3300/0 conn(0x7f2ddc0b1ae0 0x7f2ddc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2ddbfff640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc0696a0 0x7f2ddc069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2ddb7fe640 1 -- 172.21.15.50:0/3715971193 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305251017 0 0) 0x7f2ddc15e1f0 con 0x7f2ddc159970 2023-08-10T10:43:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2ddb7fe640 1 -- 172.21.15.50:0/3715971193 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dcc003520 con 0x7f2ddc159970 2023-08-10T10:43:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2de10f2640 1 -- 172.21.15.50:0/3715971193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc0696a0 msgr2=0x7f2ddc069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:02.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2de10f2640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc0696a0 0x7f2ddc069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2de10f2640 1 -- 172.21.15.50:0/3715971193 >> v1:172.21.15.50:6789/0 conn(0x7f2ddc159970 legacy=0x7f2ddc0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.257+0000 7f2de10f2640 1 -- 172.21.15.50:0/3715971193 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc06a040 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.258+0000 7f2de10f2640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc0b1f70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009d90 tx=0x7f2dd402e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c4017ccf6c6d8b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.258+0000 7f2ddb7fe640 1 -- 172.21.15.50:0/3715971193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402ee60 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2ddb7fe640 1 -- 172.21.15.50:0/3715971193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd4036440 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2ddb7fe640 1 -- 172.21.15.50:0/3715971193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40367b0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 -- 172.21.15.50:0/3715971193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 msgr2=0x7f2ddc0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc0b1f70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009d90 tx=0x7f2dd402e0b0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 -- 172.21.15.50:0/3715971193 shutdown_connections 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc0b1f70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 --2- 172.21.15.50:0/3715971193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc0696a0 0x7f2ddc069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 -- 172.21.15.50:0/3715971193 >> 172.21.15.50:0/3715971193 conn(0x7f2ddc06b590 msgr2=0x7f2ddc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 -- 172.21.15.50:0/3715971193 shutdown_connections 2023-08-10T10:43:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.259+0000 7f2de2b55640 1 -- 172.21.15.50:0/3715971193 wait complete. 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.261+0000 7f2de2b55640 1 Processor -- start 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.261+0000 7f2de2b55640 1 -- start start 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc0696a0 0x7f2ddc157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc159970 0x7f2ddc06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0c3360 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0c3640 con 0x7f2ddc0696a0 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2de2b55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0c3920 con 0x7f2ddc159970 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.262+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56384/0 (socket says 172.21.15.50:56384) 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 -- 172.21.15.50:0/2095412515 learned_addr learned my addr 172.21.15.50:0/2095412515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2de10f2640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc159970 0x7f2ddc06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 -- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc159970 msgr2=0x7f2ddc06fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc159970 0x7f2ddc06fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 -- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc0696a0 msgr2=0x7f2ddc157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc0696a0 0x7f2ddc157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 -- 172.21.15.50:0/2095412515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4009a70 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.263+0000 7f2ddbfff640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800d800 tx=0x7f2dc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.264+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc800b6c0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.264+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc800b820 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.264+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc800bbb0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.264+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc0c3c00 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.264+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc1f2820 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.265+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc04e270 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.266+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2dc800bd10 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.267+0000 7f2dd97fa640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 0x7f2dc006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.267+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2dc8089af0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.267+0000 7f2de08f1640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 0x7f2dc006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.268+0000 7f2de08f1640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 0x7f2dc006d110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0001570 tx=0x7f2dd0007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.271+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2dc8054b00 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.506+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ddc0c3df0 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.513+0000 7f2dd97fa640 1 -- 172.21.15.50:0/2095412515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f2dc8058120 con 0x7f2ddc0b1ae0 2023-08-10T10:43:02.514 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:02.514 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:41:34.387202+0000","modified":"2023-08-10T10:41:37.937665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/1006474021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1006474021},{"type":"v1","addr":"172.21.15.50:6836","nonce":1006474021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-10T10:43:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-08-10T10:43:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.515+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 msgr2=0x7f2dc006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.515+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 0x7f2dc006d110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0001570 tx=0x7f2dd0007930 comp rx=0 tx=0).stop 2023-08-10T10:43:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.515+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 msgr2=0x7f2ddc15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.515+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800d800 tx=0x7f2dc800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 shutdown_connections 2023-08-10T10:43:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ddc159970 0x7f2ddc06fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ddc0b1ae0 0x7f2ddc15bd50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2dc006ac50 0x7f2dc006d110 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 --2- 172.21.15.50:0/2095412515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc0696a0 0x7f2ddc157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 >> 172.21.15.50:0/2095412515 conn(0x7f2ddc06b590 msgr2=0x7f2ddc0714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 shutdown_connections 2023-08-10T10:43:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.516+0000 7f2de2b55640 1 -- 172.21.15.50:0/2095412515 wait complete. 2023-08-10T10:43:02.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.767+0000 7fe401a85640 1 Processor -- start 2023-08-10T10:43:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.767+0000 7fe401a85640 1 -- start start 2023-08-10T10:43:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401a85640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3fc0b0620 0x7fe3fc0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401a85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401a85640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0b1f10 con 0x7fe3fc15a940 2023-08-10T10:43:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401a85640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b21f0 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401a85640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc15e5c0 con 0x7fe3fc0b0620 2023-08-10T10:43:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401284640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401284640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56392/0 (socket says 172.21.15.50:56392) 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe401284640 1 -- 172.21.15.50:0/555192895 learned_addr learned my addr 172.21.15.50:0/555192895 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.769+0000 7fe3fbfff640 1 --2- 172.21.15.50:0/555192895 >> v2:172.21.15.117:3300/0 conn(0x7fe3fc0b0620 0x7fe3fc0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.770+0000 7fe401284640 1 -- 172.21.15.50:0/555192895 >> v2:172.21.15.117:3300/0 conn(0x7fe3fc0b0620 msgr2=0x7fe3fc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.770+0000 7fe401284640 1 --2- 172.21.15.50:0/555192895 >> v2:172.21.15.117:3300/0 conn(0x7fe3fc0b0620 0x7fe3fc0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.770+0000 7fe401284640 1 -- 172.21.15.50:0/555192895 >> v1:172.21.15.117:6789/0 conn(0x7fe3fc15a940 legacy=0x7fe3fc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.770+0000 7fe401284640 1 -- 172.21.15.50:0/555192895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc15e7d0 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.771+0000 7fe401284640 1 --2- 172.21.15.50:0/555192895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0b1080 tx=0x7fe3f402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8048e6d3e33342c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.771+0000 7fe3fb7fe640 1 -- 172.21.15.50:0/555192895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f402c9f0 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.771+0000 7fe3fb7fe640 1 -- 172.21.15.50:0/555192895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f402cb50 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.771+0000 7fe3fb7fe640 1 -- 172.21.15.50:0/555192895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40343f0 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 -- 172.21.15.50:0/555192895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15f2b0 msgr2=0x7fe3fc0b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 --2- 172.21.15.50:0/555192895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0b1080 tx=0x7fe3f402be50 comp rx=0 tx=0).stop 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 -- 172.21.15.50:0/555192895 shutdown_connections 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 --2- 172.21.15.50:0/555192895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15f2b0 0x7fe3fc0b1800 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 --2- 172.21.15.50:0/555192895 >> v2:172.21.15.117:3300/0 conn(0x7fe3fc0b0620 0x7fe3fc0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 -- 172.21.15.50:0/555192895 >> 172.21.15.50:0/555192895 conn(0x7fe3fc06ab80 msgr2=0x7fe3fc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 -- 172.21.15.50:0/555192895 shutdown_connections 2023-08-10T10:43:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.772+0000 7fe401a85640 1 -- 172.21.15.50:0/555192895 wait complete. 2023-08-10T10:43:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.774+0000 7fe401a85640 1 Processor -- start 2023-08-10T10:43:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.774+0000 7fe401a85640 1 -- start start 2023-08-10T10:43:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3fc0b0620 0x7fe3fc0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3fc15f2b0 0x7fe3fc0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc06f330 con 0x7fe3fc15a940 2023-08-10T10:43:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15c270 con 0x7fe3fc0b0620 2023-08-10T10:43:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe401a85640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15c550 con 0x7fe3fc15f2b0 2023-08-10T10:43:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe3fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe3fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56398/0 (socket says 172.21.15.50:56398) 2023-08-10T10:43:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe3fbfff640 1 -- 172.21.15.50:0/3711697303 learned_addr learned my addr 172.21.15.50:0/3711697303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.775+0000 7fe400a83640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3fc0b0620 0x7fe3fc0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe401284640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3fc15f2b0 0x7fe3fc0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 -- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3fc15f2b0 msgr2=0x7fe3fc0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3fc15f2b0 0x7fe3fc0c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 -- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3fc0b0620 msgr2=0x7fe3fc0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3fc0b0620 0x7fe3fc0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 -- 172.21.15.50:0/3711697303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4009b30 con 0x7fe3fc15a940 2023-08-10T10:43:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3fbfff640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800d5f0 tx=0x7fe3e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80125f0 con 0x7fe3fc15a940 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8012750 con 0x7fe3fc15a940 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8012b00 con 0x7fe3fc15a940 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.776+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc15c830 con 0x7fe3fc15a940 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.777+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0c5df0 con 0x7fe3fc15a940 2023-08-10T10:43:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.778+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc0c5f80 con 0x7fe3fc15a940 2023-08-10T10:43:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.779+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3e8012c60 con 0x7fe3fc15a940 2023-08-10T10:43:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.780+0000 7fe3f97fa640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 0x7fe3e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.780+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe3e8089a50 con 0x7fe3fc15a940 2023-08-10T10:43:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.780+0000 7fe400a83640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 0x7fe3e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.781+0000 7fe400a83640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 0x7fe3e006d110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006fd0 tx=0x7fe3f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.786+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe3e8054a60 con 0x7fe3fc15a940 2023-08-10T10:43:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.984+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3fc066e30 con 0x7fe3fc15a940 2023-08-10T10:43:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.987+0000 7fe3f97fa640 1 -- 172.21.15.50:0/3711697303 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18521 (secure 0 0 0) 0x7fe3e8058080 con 0x7fe3fc15a940 2023-08-10T10:43:02.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:02.988 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":81,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:00.491646+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:41:32.815026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-10T10:41:33.402009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3a","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.989+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 msgr2=0x7fe3e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.989+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 0x7fe3e006d110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0006fd0 tx=0x7fe3f0008040 comp rx=0 tx=0).stop 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.989+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 msgr2=0x7fe3fc06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.989+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800d5f0 tx=0x7fe3e800dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 shutdown_connections 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3fc15f2b0 0x7fe3fc0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3fc15a940 0x7fe3fc06edf0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe3e006ac50 0x7fe3e006d110 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 --2- 172.21.15.50:0/3711697303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3fc0b0620 0x7fe3fc0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 >> 172.21.15.50:0/3711697303 conn(0x7fe3fc06ab80 msgr2=0x7fe3fc0cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 shutdown_connections 2023-08-10T10:43:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:02.990+0000 7fe401a85640 1 -- 172.21.15.50:0/3711697303 wait complete. 2023-08-10T10:43:03.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:43:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.236+0000 7f277239b640 1 Processor -- start 2023-08-10T10:43:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.236+0000 7f277239b640 1 -- start start 2023-08-10T10:43:03.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.237+0000 7f277239b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f276c0cfe10 0x7f276c0d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.237+0000 7f277239b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c0d2630 con 0x7f276c0d08e0 2023-08-10T10:43:03.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.237+0000 7f277239b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c0b8010 con 0x7f276c15cc30 2023-08-10T10:43:03.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.237+0000 7f277239b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0d0ea0 con 0x7f276c0cfe10 2023-08-10T10:43:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.238+0000 7f2771b9a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f276c0d08e0 0x7f276c0b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35310/0 (socket says 172.21.15.50:35310) 2023-08-10T10:43:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.238+0000 7f2771b9a640 1 -- 172.21.15.50:0/2113708188 learned_addr learned my addr 172.21.15.50:0/2113708188 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.238+0000 7f2770b98640 1 --2- 172.21.15.50:0/2113708188 >> v2:172.21.15.117:3300/0 conn(0x7f276c0cfe10 0x7f276c0d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.238+0000 7f2763fff640 1 -- 172.21.15.50:0/2113708188 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329230243 0 0) 0x7f276c0d2630 con 0x7f276c0d08e0 2023-08-10T10:43:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.239+0000 7f2763fff640 1 -- 172.21.15.50:0/2113708188 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2758003520 con 0x7f276c0d08e0 2023-08-10T10:43:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.239+0000 7f2770b98640 1 -- 172.21.15.50:0/2113708188 >> v1:172.21.15.117:6789/0 conn(0x7f276c15cc30 legacy=0x7f276c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.239+0000 7f2770b98640 1 -- 172.21.15.50:0/2113708188 >> v1:172.21.15.50:6789/0 conn(0x7f276c0d08e0 legacy=0x7f276c0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.239+0000 7f2770b98640 1 -- 172.21.15.50:0/2113708188 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0d1180 con 0x7f276c0cfe10 2023-08-10T10:43:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.240+0000 7f2770b98640 1 --2- 172.21.15.50:0/2113708188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cfe10 0x7f276c0d1d20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53cdd4918d47431e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f2763fff640 1 -- 172.21.15.50:0/2113708188 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c030610 con 0x7f276c0cfe10 2023-08-10T10:43:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f2763fff640 1 -- 172.21.15.50:0/2113708188 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c030770 con 0x7f276c0cfe10 2023-08-10T10:43:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f2763fff640 1 -- 172.21.15.50:0/2113708188 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c030b00 con 0x7f276c0cfe10 2023-08-10T10:43:03.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f277239b640 1 -- 172.21.15.50:0/2113708188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cfe10 msgr2=0x7f276c0d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f277239b640 1 --2- 172.21.15.50:0/2113708188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cfe10 0x7f276c0d1d20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f275c0097a0 tx=0x7f275c02b960 comp rx=0 tx=0).stop 2023-08-10T10:43:03.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f277239b640 1 -- 172.21.15.50:0/2113708188 shutdown_connections 2023-08-10T10:43:03.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f277239b640 1 --2- 172.21.15.50:0/2113708188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c0cfe10 0x7f276c0d1d20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.241+0000 7f277239b640 1 -- 172.21.15.50:0/2113708188 >> 172.21.15.50:0/2113708188 conn(0x7f276c069880 msgr2=0x7f276c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.242+0000 7f277239b640 1 -- 172.21.15.50:0/2113708188 shutdown_connections 2023-08-10T10:43:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.242+0000 7f277239b640 1 -- 172.21.15.50:0/2113708188 wait complete. 2023-08-10T10:43:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.243+0000 7f277239b640 1 Processor -- start 2023-08-10T10:43:03.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.243+0000 7f277239b640 1 -- start start 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 0x7f276c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 0x7f276c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0abff0 con 0x7f276c0d08e0 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0ab3e0 con 0x7f276c15cc30 2023-08-10T10:43:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.244+0000 7f277239b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0ab6c0 con 0x7f276c0cfe10 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56406/0 (socket says 172.21.15.50:56406) 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 -- 172.21.15.50:0/280853529 learned_addr learned my addr 172.21.15.50:0/280853529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 -- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 msgr2=0x7f276c0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2771399640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 0x7f276c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2771b9a640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 0x7f276c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 0x7f276c0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 -- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 msgr2=0x7f276c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 0x7f276c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2770b98640 1 -- 172.21.15.50:0/280853529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009400 con 0x7f276c0d08e0 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2771399640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 0x7f276c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.245+0000 7f2771b9a640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 0x7f276c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f2770b98640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f275c02bf70 tx=0x7f275c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c03e040 con 0x7f276c0d08e0 2023-08-10T10:43:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c039cb0 con 0x7f276c0d08e0 2023-08-10T10:43:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c0ab9a0 con 0x7f276c0d08e0 2023-08-10T10:43:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c044630 con 0x7f276c0d08e0 2023-08-10T10:43:03.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.246+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c151280 con 0x7f276c0d08e0 2023-08-10T10:43:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.248+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c0ac1a0 con 0x7f276c0d08e0 2023-08-10T10:43:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.249+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f275c043390 con 0x7f276c0d08e0 2023-08-10T10:43:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.249+0000 7f2761ffb640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 0x7f275006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.250+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f275c0ab710 con 0x7f276c0d08e0 2023-08-10T10:43:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.250+0000 7f2771399640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 0x7f275006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.251+0000 7f2771399640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 0x7f275006d140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f27680012e0 tx=0x7f2768009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.254+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f276c0ac1a0 con 0x7f276c0d08e0 2023-08-10T10:43:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.488+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f276c066e30 con 0x7f276c0d08e0 2023-08-10T10:43:03.489 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:43:03.489+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:43:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.500+0000 7f2761ffb640 1 -- 172.21.15.50:0/280853529 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f275c07a120 con 0x7f276c0d08e0 2023-08-10T10:43:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:43:03.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 msgr2=0x7f275006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 0x7f275006d140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f27680012e0 tx=0x7f2768009040 comp rx=0 tx=0).stop 2023-08-10T10:43:03.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 msgr2=0x7f276c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f275c02bf70 tx=0x7f275c004730 comp rx=0 tx=0).stop 2023-08-10T10:43:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 shutdown_connections 2023-08-10T10:43:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f275006ac80 0x7f275006d140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c15cc30 0x7f276c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f276c0d08e0 0x7f276c0aa920 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 --2- 172.21.15.50:0/280853529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f276c0cfe10 0x7f276c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 >> 172.21.15.50:0/280853529 conn(0x7f276c069880 msgr2=0x7f276c0cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 shutdown_connections 2023-08-10T10:43:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.503+0000 7f277239b640 1 -- 172.21.15.50:0/280853529 wait complete. 2023-08-10T10:43:03.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:43:03.632 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:43:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.736+0000 7f1d88bca640 1 Processor -- start 2023-08-10T10:43:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.737+0000 7f1d88bca640 1 -- start start 2023-08-10T10:43:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d88bca640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d840cf3b0 0x7f1d840d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d88bca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 0x7f1d840cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d88bca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d84160b60 con 0x7f1d840b1a30 2023-08-10T10:43:03.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d88bca640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d84161700 con 0x7f1d840cf3b0 2023-08-10T10:43:03.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d88bca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840b8200 con 0x7f1d8415ce70 2023-08-10T10:43:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.738+0000 7f1d837fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d840cf3b0 0x7f1d840d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d840cf3b0 0x7f1d840d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56434/0 (socket says 172.21.15.50:56434) 2023-08-10T10:43:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 -- 172.21.15.50:0/754753580 learned_addr learned my addr 172.21.15.50:0/754753580 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:03.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d82ffd640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 0x7f1d840cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 -- 172.21.15.50:0/754753580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 msgr2=0x7f1d840cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 0x7f1d840cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 -- 172.21.15.50:0/754753580 >> v1:172.21.15.117:6789/0 conn(0x7f1d840b1a30 legacy=0x7f1d84160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d837fe640 1 -- 172.21.15.50:0/754753580 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840cfcd0 con 0x7f1d840cf3b0 2023-08-10T10:43:03.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.739+0000 7f1d82ffd640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 0x7f1d840cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.740+0000 7f1d837fe640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d840cf3b0 0x7f1d840d2190 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6059fa1fe53d952 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.740+0000 7f1d827fc640 1 -- 172.21.15.50:0/754753580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74031640 con 0x7f1d840cf3b0 2023-08-10T10:43:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.740+0000 7f1d827fc640 1 -- 172.21.15.50:0/754753580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740317a0 con 0x7f1d840cf3b0 2023-08-10T10:43:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.740+0000 7f1d827fc640 1 -- 172.21.15.50:0/754753580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74031b30 con 0x7f1d840cf3b0 2023-08-10T10:43:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 -- 172.21.15.50:0/754753580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d840cf3b0 msgr2=0x7f1d840d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d840cf3b0 0x7f1d840d2190 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 -- 172.21.15.50:0/754753580 shutdown_connections 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8415ce70 0x7f1d840cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 --2- 172.21.15.50:0/754753580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d840cf3b0 0x7f1d840d2190 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 -- 172.21.15.50:0/754753580 >> 172.21.15.50:0/754753580 conn(0x7f1d840696a0 msgr2=0x7f1d84069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 -- 172.21.15.50:0/754753580 shutdown_connections 2023-08-10T10:43:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.741+0000 7f1d88bca640 1 -- 172.21.15.50:0/754753580 wait complete. 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.743+0000 7f1d88bca640 1 Processor -- start 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.743+0000 7f1d88bca640 1 -- start start 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d840b1a30 0x7f1d84150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840cf3b0 0x7f1d840c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840cb040 con 0x7f1d8415ce70 2023-08-10T10:43:03.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840ca430 con 0x7f1d840b1a30 2023-08-10T10:43:03.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d88bca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840ca710 con 0x7f1d840cf3b0 2023-08-10T10:43:03.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56444/0 (socket says 172.21.15.50:56444) 2023-08-10T10:43:03.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.744+0000 7f1d83fff640 1 -- 172.21.15.50:0/3039291262 learned_addr learned my addr 172.21.15.50:0/3039291262 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 -- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840cf3b0 msgr2=0x7f1d840c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840cf3b0 0x7f1d840c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 -- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d840b1a30 msgr2=0x7f1d84150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d840b1a30 0x7f1d84150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 -- 172.21.15.50:0/3039291262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740094d0 con 0x7f1d8415ce70 2023-08-10T10:43:03.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d83fff640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c780 tx=0x7f1d7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c004b60 con 0x7f1d8415ce70 2023-08-10T10:43:03.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00ce90 con 0x7f1d8415ce70 2023-08-10T10:43:03.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00a850 con 0x7f1d8415ce70 2023-08-10T10:43:03.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d840ca9f0 con 0x7f1d8415ce70 2023-08-10T10:43:03.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.745+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d84151420 con 0x7f1d8415ce70 2023-08-10T10:43:03.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.746+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d840612b0 con 0x7f1d8415ce70 2023-08-10T10:43:03.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.747+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d7c00a9b0 con 0x7f1d8415ce70 2023-08-10T10:43:03.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.749+0000 7f1d6bfff640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 0x7f1d7006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.749+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1d7c089720 con 0x7f1d8415ce70 2023-08-10T10:43:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.749+0000 7f1d837fe640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 0x7f1d7006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.750+0000 7f1d837fe640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 0x7f1d7006d140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d74036000 tx=0x7f1d74030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:03.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.753+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d7c0546d0 con 0x7f1d8415ce70 2023-08-10T10:43:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:03.978+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1d840cb180 con 0x7f1d8415ce70 2023-08-10T10:43:04.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.517+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3039291262 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1d7c057cf0 con 0x7f1d8415ce70 2023-08-10T10:43:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.521+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 msgr2=0x7f1d7006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.521+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 0x7f1d7006d140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d74036000 tx=0x7f1d74030000 comp rx=0 tx=0).stop 2023-08-10T10:43:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.521+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 msgr2=0x7f1d840cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.521+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c780 tx=0x7f1d7c00cc40 comp rx=0 tx=0).stop 2023-08-10T10:43:04.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 shutdown_connections 2023-08-10T10:43:04.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d8415ce70 0x7f1d840cb730 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840cf3b0 0x7f1d840c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d7006ac80 0x7f1d7006d140 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 --2- 172.21.15.50:0/3039291262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d840b1a30 0x7f1d84150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 >> 172.21.15.50:0/3039291262 conn(0x7f1d840696a0 msgr2=0x7f1d840b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:04.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 shutdown_connections 2023-08-10T10:43:04.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.522+0000 7f1d88bca640 1 -- 172.21.15.50:0/3039291262 wait complete. 2023-08-10T10:43:04.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:43:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.779+0000 7fc536883640 1 Processor -- start 2023-08-10T10:43:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.780+0000 7fc536883640 1 -- start start 2023-08-10T10:43:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.781+0000 7fc536883640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc53015aa30 0x7fc5300cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.781+0000 7fc536883640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc530072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.781+0000 7fc536883640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53006dbc0 con 0x7fc5300ae9a0 2023-08-10T10:43:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.781+0000 7fc536883640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc530073100 con 0x7fc53015aa30 2023-08-10T10:43:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.781+0000 7fc536883640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53015ae10 con 0x7fc530072730 2023-08-10T10:43:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc53015aa30 0x7fc5300cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc53015aa30 0x7fc5300cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56450/0 (socket says 172.21.15.50:56450) 2023-08-10T10:43:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 -- 172.21.15.50:0/2449504539 learned_addr learned my addr 172.21.15.50:0/2449504539 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc534e20640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc530072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 -- 172.21.15.50:0/2449504539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 msgr2=0x7fc530072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc530072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 -- 172.21.15.50:0/2449504539 >> v1:172.21.15.117:6789/0 conn(0x7fc5300ae9a0 legacy=0x7fc5300705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.782+0000 7fc52ffff640 1 -- 172.21.15.50:0/2449504539 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300cbf90 con 0x7fc53015aa30 2023-08-10T10:43:04.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.784+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc5300cb1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc520009870 tx=0x7fc52002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ef93328da79f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.784+0000 7fc52f7fe640 1 -- 172.21.15.50:0/2449504539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520031640 con 0x7fc53015aa30 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.784+0000 7fc52f7fe640 1 -- 172.21.15.50:0/2449504539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200317a0 con 0x7fc53015aa30 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.784+0000 7fc52f7fe640 1 -- 172.21.15.50:0/2449504539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520031b30 con 0x7fc53015aa30 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 -- 172.21.15.50:0/2449504539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 msgr2=0x7fc5300cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc5300cb1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc520009870 tx=0x7fc52002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 -- 172.21.15.50:0/2449504539 shutdown_connections 2023-08-10T10:43:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc530072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 --2- 172.21.15.50:0/2449504539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc5300cb1f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 -- 172.21.15.50:0/2449504539 >> 172.21.15.50:0/2449504539 conn(0x7fc5300cf780 msgr2=0x7fc5300cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 -- 172.21.15.50:0/2449504539 shutdown_connections 2023-08-10T10:43:04.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.785+0000 7fc536883640 1 -- 172.21.15.50:0/2449504539 wait complete. 2023-08-10T10:43:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.788+0000 7fc536883640 1 Processor -- start 2023-08-10T10:43:04.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.788+0000 7fc536883640 1 -- start start 2023-08-10T10:43:04.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc53014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 0x7fc53014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c2aa0 con 0x7fc53015aa30 2023-08-10T10:43:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014d520 con 0x7fc5300ae9a0 2023-08-10T10:43:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.789+0000 7fc536883640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014d800 con 0x7fc530072730 2023-08-10T10:43:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56462/0 (socket says 172.21.15.50:56462) 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 -- 172.21.15.50:0/2453447178 learned_addr learned my addr 172.21.15.50:0/2453447178 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc53014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc5277fe640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 0x7fc53014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 -- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 msgr2=0x7fc53014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc53014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 -- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 msgr2=0x7fc53014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 0x7fc53014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc534e20640 1 -- 172.21.15.50:0/2453447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200094d0 con 0x7fc53015aa30 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc5277fe640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 0x7fc53014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.790+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc53014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc534e20640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc52800d5d0 tx=0x7fc52800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280125f0 con 0x7fc53015aa30 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528012770 con 0x7fc53015aa30 2023-08-10T10:43:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528012b20 con 0x7fc53015aa30 2023-08-10T10:43:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53014dae0 con 0x7fc53015aa30 2023-08-10T10:43:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.791+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53014e0a0 con 0x7fc53015aa30 2023-08-10T10:43:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.792+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53004e270 con 0x7fc53015aa30 2023-08-10T10:43:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.793+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc528012c80 con 0x7fc53015aa30 2023-08-10T10:43:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.794+0000 7fc52d7fa640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.794+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc528089b90 con 0x7fc53015aa30 2023-08-10T10:43:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.794+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.795+0000 7fc52ffff640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc520036000 tx=0x7fc52003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:04.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.799+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc528054a30 con 0x7fc53015aa30 2023-08-10T10:43:04.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:04.990+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc53015f010 con 0x7fc53015aa30 2023-08-10T10:43:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.541+0000 7fc52d7fa640 1 -- 172.21.15.50:0/2453447178 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc528058050 con 0x7fc53015aa30 2023-08-10T10:43:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:43:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 msgr2=0x7fc51006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc520036000 tx=0x7fc52003c040 comp rx=0 tx=0).stop 2023-08-10T10:43:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 msgr2=0x7fc53014ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc52800d5d0 tx=0x7fc52800da90 comp rx=0 tx=0).stop 2023-08-10T10:43:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 shutdown_connections 2023-08-10T10:43:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc53015aa30 0x7fc53014ce30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300ae9a0 0x7fc53014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 --2- 172.21.15.50:0/2453447178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc530072730 0x7fc53014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.547+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 >> 172.21.15.50:0/2453447178 conn(0x7fc5300cf780 msgr2=0x7fc530069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.548+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 shutdown_connections 2023-08-10T10:43:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.548+0000 7fc536883640 1 -- 172.21.15.50:0/2453447178 wait complete. 2023-08-10T10:43:05.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:43:05.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.803+0000 7fe823fff640 1 Processor -- start 2023-08-10T10:43:05.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.803+0000 7fe823fff640 1 -- start start 2023-08-10T10:43:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.805+0000 7fe823fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe82415cbe0 0x7fe8240cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.805+0000 7fe823fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8240cf850 0x7fe8240b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.805+0000 7fe823fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240d1480 con 0x7fe8240cdd50 2023-08-10T10:43:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.805+0000 7fe823fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8240d1760 con 0x7fe82415cbe0 2023-08-10T10:43:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.805+0000 7fe823fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240d1a40 con 0x7fe8240cf850 2023-08-10T10:43:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.806+0000 7fe8227fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8240cdd50 0x7fe8240cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40394/0 (socket says 172.21.15.50:40394) 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.806+0000 7fe8227fc640 1 -- 172.21.15.50:0/2692108643 learned_addr learned my addr 172.21.15.50:0/2692108643 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.806+0000 7fe822ffd640 1 --2- 172.21.15.50:0/2692108643 >> v2:172.21.15.117:3300/0 conn(0x7fe82415cbe0 0x7fe8240cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.806+0000 7fe8237fe640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8240cf850 0x7fe8240b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe821ffb640 1 -- 172.21.15.50:0/2692108643 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728614707 0 0) 0x7fe8240d1480 con 0x7fe8240cdd50 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe821ffb640 1 -- 172.21.15.50:0/2692108643 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003520 con 0x7fe8240cdd50 2023-08-10T10:43:05.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe822ffd640 1 -- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8240cf850 msgr2=0x7fe8240b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe822ffd640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8240cf850 0x7fe8240b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe822ffd640 1 -- 172.21.15.50:0/2692108643 >> v1:172.21.15.50:6789/0 conn(0x7fe8240cdd50 legacy=0x7fe8240cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.807+0000 7fe822ffd640 1 -- 172.21.15.50:0/2692108643 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240d1d20 con 0x7fe82415cbe0 2023-08-10T10:43:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.808+0000 7fe822ffd640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82415cbe0 0x7fe8240cd810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a9d346f2361c27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.809+0000 7fe821ffb640 1 -- 172.21.15.50:0/2692108643 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814030800 con 0x7fe82415cbe0 2023-08-10T10:43:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.809+0000 7fe821ffb640 1 -- 172.21.15.50:0/2692108643 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814030960 con 0x7fe82415cbe0 2023-08-10T10:43:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.809+0000 7fe821ffb640 1 -- 172.21.15.50:0/2692108643 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814030cd0 con 0x7fe82415cbe0 2023-08-10T10:43:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.809+0000 7fe823fff640 1 -- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82415cbe0 msgr2=0x7fe8240cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.809+0000 7fe823fff640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82415cbe0 0x7fe8240cd810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402b940 comp rx=0 tx=0).stop 2023-08-10T10:43:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 -- 172.21.15.50:0/2692108643 shutdown_connections 2023-08-10T10:43:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8240cf850 0x7fe8240b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 --2- 172.21.15.50:0/2692108643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82415cbe0 0x7fe8240cd810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 -- 172.21.15.50:0/2692108643 >> 172.21.15.50:0/2692108643 conn(0x7fe82406fcc0 msgr2=0x7fe8240700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 -- 172.21.15.50:0/2692108643 shutdown_connections 2023-08-10T10:43:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.810+0000 7fe823fff640 1 -- 172.21.15.50:0/2692108643 wait complete. 2023-08-10T10:43:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.812+0000 7fe823fff640 1 Processor -- start 2023-08-10T10:43:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.812+0000 7fe823fff640 1 -- start start 2023-08-10T10:43:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 0x7fe8241f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82415cbe0 0x7fe82414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415e6f0 con 0x7fe8240cdd50 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415e260 con 0x7fe8240cf850 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe823fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82415d650 con 0x7fe82415cbe0 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe822ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe822ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57978/0 (socket says 172.21.15.50:57978) 2023-08-10T10:43:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe822ffd640 1 -- 172.21.15.50:0/620217831 learned_addr learned my addr 172.21.15.50:0/620217831 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.813+0000 7fe8227fc640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 0x7fe8241f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 -- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82415cbe0 msgr2=0x7fe82414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82415cbe0 0x7fe82414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 -- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 msgr2=0x7fe8241f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 0x7fe8241f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 -- 172.21.15.50:0/620217831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009400 con 0x7fe8240cdd50 2023-08-10T10:43:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe8227fc640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 0x7fe8241f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe822ffd640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe81402b980 tx=0x7fe8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81403f070 con 0x7fe8240cdd50 2023-08-10T10:43:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814004500 con 0x7fe8240cdd50 2023-08-10T10:43:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814003830 con 0x7fe8240cdd50 2023-08-10T10:43:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.814+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82415d930 con 0x7fe8240cdd50 2023-08-10T10:43:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.815+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82415def0 con 0x7fe8240cdd50 2023-08-10T10:43:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.816+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8240612b0 con 0x7fe8240cdd50 2023-08-10T10:43:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.817+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe814003990 con 0x7fe8240cdd50 2023-08-10T10:43:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.818+0000 7fe80b7fe640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 0x7fe81006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.818+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5826+0+0 (secure 0 0 0) 0x7fe8140ab170 con 0x7fe8240cdd50 2023-08-10T10:43:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.818+0000 7fe8227fc640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 0x7fe81006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.819+0000 7fe8227fc640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 0x7fe81006d140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b3910 tx=0x7fe818009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:05.822+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe814076410 con 0x7fe8240cdd50 2023-08-10T10:43:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.012+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe82415c2a0 con 0x7fe8240cdd50 2023-08-10T10:43:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.555+0000 7fe80b7fe640 1 -- 172.21.15.50:0/620217831 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe814079a30 con 0x7fe8240cdd50 2023-08-10T10:43:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:43:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 msgr2=0x7fe81006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 0x7fe81006d140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b3910 tx=0x7fe818009040 comp rx=0 tx=0).stop 2023-08-10T10:43:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 msgr2=0x7fe82415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe81402b980 tx=0x7fe8140046c0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 shutdown_connections 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe82415cbe0 0x7fe82414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe81006ac80 0x7fe81006d140 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8240cf850 0x7fe8241f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 --2- 172.21.15.50:0/620217831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8240cdd50 0x7fe82415cfc0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.559+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 >> 172.21.15.50:0/620217831 conn(0x7fe82406fcc0 msgr2=0x7fe8240b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.560+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 shutdown_connections 2023-08-10T10:43:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.560+0000 7fe823fff640 1 -- 172.21.15.50:0/620217831 wait complete. 2023-08-10T10:43:06.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:43:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.812+0000 7fa0caf8b640 1 Processor -- start 2023-08-10T10:43:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.812+0000 7fa0caf8b640 1 -- start start 2023-08-10T10:43:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0caf8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0c40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0caf8b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0c40acc70 0x7fa0c40cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0caf8b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40cae00 con 0x7fa0c406f550 2023-08-10T10:43:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0caf8b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40c9150 con 0x7fa0c40acc70 2023-08-10T10:43:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0caf8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40cdba0 con 0x7fa0c40ac890 2023-08-10T10:43:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0c9528640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa0c406f550 0x7fa0c40c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40398/0 (socket says 172.21.15.50:40398) 2023-08-10T10:43:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.814+0000 7fa0c9528640 1 -- 172.21.15.50:0/1682073973 learned_addr learned my addr 172.21.15.50:0/1682073973 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c3fff640 1 --2- 172.21.15.50:0/1682073973 >> v2:172.21.15.117:3300/0 conn(0x7fa0c40acc70 0x7fa0c40cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c8d27640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0c40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278761609 0 0) 0x7fa0c40cae00 con 0x7fa0c406f550 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003520 con 0x7fa0c406f550 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347041379 0 0) 0x7fa0b4003520 con 0x7fa0c406f550 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 msgr2=0x7fa0c40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0c40ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 >> v2:172.21.15.117:3300/0 conn(0x7fa0c40acc70 msgr2=0x7fa0c40cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 --2- 172.21.15.50:0/1682073973 >> v2:172.21.15.117:3300/0 conn(0x7fa0c40acc70 0x7fa0c40cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40ca840 con 0x7fa0c406f550 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa0bc0019f0 con 0x7fa0c406f550 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 >> v1:172.21.15.50:6789/0 conn(0x7fa0c406f550 legacy=0x7fa0c40c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0b4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b4003ef0 0x7fa0b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.815+0000 7fa0c37fe640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4004d00 0x7fa0b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c9150 con 0x7fa0b4003ef0 2023-08-10T10:43:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40cdba0 con 0x7fa0b4004d00 2023-08-10T10:43:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b400bb10 con 0x7fa0c40ac890 2023-08-10T10:43:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b4003ef0 0x7fa0b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c9528640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4004d00 0x7fa0b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c8d27640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0b4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 -- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 msgr2=0x7fa0b4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:06.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c40ac890 0x7fa0b4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 -- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4004d00 msgr2=0x7fa0b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4004d00 0x7fa0b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.816+0000 7fa0c3fff640 1 -- 172.21.15.50:0/1682073973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4003520 con 0x7fa0b4003ef0 2023-08-10T10:43:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.817+0000 7fa0c3fff640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b4003ef0 0x7fa0b40047c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009ac0 tx=0x7fa0b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9aa7e0929dbe98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b002c710 con 0x7fa0b4003ef0 2023-08-10T10:43:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b002c870 con 0x7fa0b4003ef0 2023-08-10T10:43:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0c37fe640 1 -- 172.21.15.50:0/1682073973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b002cc00 con 0x7fa0b4003ef0 2023-08-10T10:43:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0caf8b640 1 -- 172.21.15.50:0/1682073973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b4003ef0 msgr2=0x7fa0b40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/1682073973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b4003ef0 0x7fa0b40047c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009ac0 tx=0x7fa0b40057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0c9528640 1 -- 172.21.15.50:0/1682073973 reap_dead start 2023-08-10T10:43:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0caf8b640 1 -- 172.21.15.50:0/1682073973 shutdown_connections 2023-08-10T10:43:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.818+0000 7fa0caf8b640 1 -- 172.21.15.50:0/1682073973 >> 172.21.15.50:0/1682073973 conn(0x7fa0c40b08e0 msgr2=0x7fa0c40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.819+0000 7fa0caf8b640 1 -- 172.21.15.50:0/1682073973 shutdown_connections 2023-08-10T10:43:06.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.819+0000 7fa0caf8b640 1 -- 172.21.15.50:0/1682073973 wait complete. 2023-08-10T10:43:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.820+0000 7fa0caf8b640 1 Processor -- start 2023-08-10T10:43:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 -- start start 2023-08-10T10:43:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4003ef0 0x7fa0c406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c41f5660 0x7fa0c41f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41f6020 con 0x7fa0c40c3140 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c5000 con 0x7fa0b4003ef0 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.821+0000 7fa0caf8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c5970 con 0x7fa0c41f5660 2023-08-10T10:43:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57988/0 (socket says 172.21.15.50:57988) 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 -- 172.21.15.50:0/2127006938 learned_addr learned my addr 172.21.15.50:0/2127006938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 -- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c41f5660 msgr2=0x7fa0c41f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c41f5660 0x7fa0c41f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 -- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4003ef0 msgr2=0x7fa0c406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4003ef0 0x7fa0c406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.822+0000 7fa0c9528640 1 -- 172.21.15.50:0/2127006938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40c4d20 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0c9528640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc001460 tx=0x7fa0bc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00ec10 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00ed90 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc013660 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c406b1a0 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.823+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c406b760 con 0x7fa0c40c3140 2023-08-10T10:43:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.824+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c404e270 con 0x7fa0c40c3140 2023-08-10T10:43:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.825+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0bc0137c0 con 0x7fa0c40c3140 2023-08-10T10:43:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.826+0000 7fa0c17fa640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 0x7fa0a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.826+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa0bc089640 con 0x7fa0c40c3140 2023-08-10T10:43:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.827+0000 7fa0c8d27640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 0x7fa0a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.827+0000 7fa0c8d27640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 0x7fa0a806d190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006a90 tx=0x7fa0b8006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:06.831+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0bc0549f0 con 0x7fa0c40c3140 2023-08-10T10:43:07.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.025+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa0c40ad9c0 con 0x7fa0c40c3140 2023-08-10T10:43:07.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.034+0000 7fa0c17fa640 1 -- 172.21.15.50:0/2127006938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa0bc058010 con 0x7fa0c40c3140 2023-08-10T10:43:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 msgr2=0x7fa0a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 0x7fa0a806d190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006a90 tx=0x7fa0b8006a20 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 msgr2=0x7fa0c40c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc001460 tx=0x7fa0bc00e530 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 shutdown_connections 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40c3140 0x7fa0c40c35c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c41f5660 0x7fa0c41f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa0a806acd0 0x7fa0a806d190 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 --2- 172.21.15.50:0/2127006938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b4003ef0 0x7fa0c406bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 >> 172.21.15.50:0/2127006938 conn(0x7fa0c40b08e0 msgr2=0x7fa0c40cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 shutdown_connections 2023-08-10T10:43:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.037+0000 7fa0caf8b640 1 -- 172.21.15.50:0/2127006938 wait complete. 2023-08-10T10:43:07.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-08-10T10:43:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.285+0000 7fef7226a640 1 Processor -- start 2023-08-10T10:43:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.285+0000 7fef7226a640 1 -- start start 2023-08-10T10:43:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c15aa40 0x7fef6c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 0x7fef6c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c070e80 0x7fef6c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c071c70 con 0x7fef6c070e80 2023-08-10T10:43:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0713d0 con 0x7fef6c0b0c60 2023-08-10T10:43:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef7226a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0716b0 con 0x7fef6c15aa40 2023-08-10T10:43:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef70807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c070e80 0x7fef6c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef70807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef6c070e80 0x7fef6c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57994/0 (socket says 172.21.15.50:57994) 2023-08-10T10:43:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.287+0000 7fef70807640 1 -- 172.21.15.50:0/3516355505 learned_addr learned my addr 172.21.15.50:0/3516355505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef6bfff640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c15aa40 0x7fef6c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef6b7fe640 1 --2- 172.21.15.50:0/3516355505 >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 0x7fef6c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef70807640 1 -- 172.21.15.50:0/3516355505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c15aa40 msgr2=0x7fef6c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef70807640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c15aa40 0x7fef6c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef70807640 1 -- 172.21.15.50:0/3516355505 >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 msgr2=0x7fef6c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef70807640 1 --2- 172.21.15.50:0/3516355505 >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 0x7fef6c0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef70807640 1 -- 172.21.15.50:0/3516355505 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c071990 con 0x7fef6c070e80 2023-08-10T10:43:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.288+0000 7fef6b7fe640 1 --2- 172.21.15.50:0/3516355505 >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 0x7fef6c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.289+0000 7fef70807640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c0696a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0ce560 tx=0x7fef6402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fd8b1063750419 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef6affd640 1 -- 172.21.15.50:0/3516355505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6402c9f0 con 0x7fef6c070e80 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef6affd640 1 -- 172.21.15.50:0/3516355505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6402cb50 con 0x7fef6c070e80 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef6affd640 1 -- 172.21.15.50:0/3516355505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640343f0 con 0x7fef6c070e80 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 -- 172.21.15.50:0/3516355505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 msgr2=0x7fef6c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c0696a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0ce560 tx=0x7fef6402be50 comp rx=0 tx=0).stop 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 -- 172.21.15.50:0/3516355505 shutdown_connections 2023-08-10T10:43:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c0696a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 --2- 172.21.15.50:0/3516355505 >> v2:172.21.15.117:3300/0 conn(0x7fef6c0b0c60 0x7fef6c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 --2- 172.21.15.50:0/3516355505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c15aa40 0x7fef6c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.290+0000 7fef7226a640 1 -- 172.21.15.50:0/3516355505 >> 172.21.15.50:0/3516355505 conn(0x7fef6c06b590 msgr2=0x7fef6c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.291+0000 7fef7226a640 1 -- 172.21.15.50:0/3516355505 shutdown_connections 2023-08-10T10:43:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.291+0000 7fef7226a640 1 -- 172.21.15.50:0/3516355505 wait complete. 2023-08-10T10:43:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.292+0000 7fef7226a640 1 Processor -- start 2023-08-10T10:43:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.292+0000 7fef7226a640 1 -- start start 2023-08-10T10:43:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c0b0c60 0x7fef6c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c15aa40 0x7fef6c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c5b00 con 0x7fef6c070e80 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c5de0 con 0x7fef6c15aa40 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.293+0000 7fef7226a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c60c0 con 0x7fef6c0b0c60 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58006/0 (socket says 172.21.15.50:58006) 2023-08-10T10:43:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 -- 172.21.15.50:0/88020643 learned_addr learned my addr 172.21.15.50:0/88020643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 -- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c0b0c60 msgr2=0x7fef6c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c0b0c60 0x7fef6c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 -- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c15aa40 msgr2=0x7fef6c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c15aa40 0x7fef6c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 -- 172.21.15.50:0/88020643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64009b30 con 0x7fef6c070e80 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.294+0000 7fef6bfff640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00d5f0 tx=0x7fef5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.295+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0125f0 con 0x7fef6c070e80 2023-08-10T10:43:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.295+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c012750 con 0x7fef6c070e80 2023-08-10T10:43:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.295+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c012b00 con 0x7fef6c070e80 2023-08-10T10:43:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.295+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0c63a0 con 0x7fef6c070e80 2023-08-10T10:43:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.295+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1e67e0 con 0x7fef6c070e80 2023-08-10T10:43:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.296+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04e270 con 0x7fef6c070e80 2023-08-10T10:43:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.297+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef5c012c60 con 0x7fef6c070e80 2023-08-10T10:43:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.298+0000 7fef68ff9640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 0x7fef5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.298+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fef5c089750 con 0x7fef6c070e80 2023-08-10T10:43:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.298+0000 7fef6b7fe640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 0x7fef5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.299+0000 7fef6b7fe640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 0x7fef5806d110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0cd460 tx=0x7fef60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.302+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fef5c054a80 con 0x7fef6c070e80 2023-08-10T10:43:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:07.566+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fef6c1e48b0 con 0x7fef6c070e80 2023-08-10T10:43:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.566+0000 7fef68ff9640 1 -- 172.21.15.50:0/88020643 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v262) v1 ==== 134+0+0 (secure 0 0 0) 0x7fef5c0580a0 con 0x7fef6c070e80 2023-08-10T10:43:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 msgr2=0x7fef5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 0x7fef5806d110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0cd460 tx=0x7fef60008040 comp rx=0 tx=0).stop 2023-08-10T10:43:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 msgr2=0x7fef6c1e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00d5f0 tx=0x7fef5c00dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 shutdown_connections 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef5806ac50 0x7fef5806d110 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c15aa40 0x7fef6c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef6c0b0c60 0x7fef6c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 --2- 172.21.15.50:0/88020643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef6c070e80 0x7fef6c1e62a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.570+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 >> 172.21.15.50:0/88020643 conn(0x7fef6c06b590 msgr2=0x7fef6c1e50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.571+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 shutdown_connections 2023-08-10T10:43:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.571+0000 7fef7226a640 1 -- 172.21.15.50:0/88020643 wait complete. 2023-08-10T10:43:08.593 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-10T10:43:08.594 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-08-10T10:43:08.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-08-10T10:43:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.831+0000 7f70c3fff640 1 Processor -- start 2023-08-10T10:43:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.831+0000 7f70c3fff640 1 -- start start 2023-08-10T10:43:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415c8d0 0x7f70c40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70c3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70c415ccb0 0x7f70c4069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70c3fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c41606f0 con 0x7f70c415d250 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70c3fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c415df80 con 0x7f70c415ccb0 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70c3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c4160990 con 0x7f70c415c8d0 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70c415ccb0 0x7f70c4069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70c415ccb0 0x7f70c4069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58012/0 (socket says 172.21.15.50:58012) 2023-08-10T10:43:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.833+0000 7f70bbfff640 1 -- 172.21.15.50:0/3577350870 learned_addr learned my addr 172.21.15.50:0/3577350870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.834+0000 7f70c2ffd640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415c8d0 0x7f70c40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.834+0000 7f70bbfff640 1 -- 172.21.15.50:0/3577350870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415c8d0 msgr2=0x7f70c40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.834+0000 7f70bbfff640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415c8d0 0x7f70c40696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.834+0000 7f70bbfff640 1 -- 172.21.15.50:0/3577350870 >> v1:172.21.15.117:6789/0 conn(0x7f70c415d250 legacy=0x7f70c415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.834+0000 7f70bbfff640 1 -- 172.21.15.50:0/3577350870 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4160c70 con 0x7f70c415ccb0 2023-08-10T10:43:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.835+0000 7f70bbfff640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415ccb0 0x7f70c4069be0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009870 tx=0x7f70ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2f8d4c990f09f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.835+0000 7f70c27fc640 1 -- 172.21.15.50:0/3577350870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac031640 con 0x7f70c415ccb0 2023-08-10T10:43:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.835+0000 7f70c27fc640 1 -- 172.21.15.50:0/3577350870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0317a0 con 0x7f70c415ccb0 2023-08-10T10:43:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.835+0000 7f70c27fc640 1 -- 172.21.15.50:0/3577350870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac031b30 con 0x7f70c415ccb0 2023-08-10T10:43:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 -- 172.21.15.50:0/3577350870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415ccb0 msgr2=0x7f70c4069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415ccb0 0x7f70c4069be0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009870 tx=0x7f70ac02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 -- 172.21.15.50:0/3577350870 shutdown_connections 2023-08-10T10:43:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415ccb0 0x7f70c4069be0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3577350870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415c8d0 0x7f70c40696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 -- 172.21.15.50:0/3577350870 >> 172.21.15.50:0/3577350870 conn(0x7f70c40cafa0 msgr2=0x7f70c40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 -- 172.21.15.50:0/3577350870 shutdown_connections 2023-08-10T10:43:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.836+0000 7f70c3fff640 1 -- 172.21.15.50:0/3577350870 wait complete. 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.838+0000 7f70c3fff640 1 Processor -- start 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.838+0000 7f70c3fff640 1 -- start start 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70c415c8d0 0x7f70c40c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415ccb0 0x7f70c41f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c415f590 con 0x7f70c415d250 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c40c8410 con 0x7f70c415c8d0 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41f26a0 con 0x7f70c415ccb0 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58022/0 (socket says 172.21.15.50:58022) 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.839+0000 7f70c37fe640 1 -- 172.21.15.50:0/3096231553 learned_addr learned my addr 172.21.15.50:0/3096231553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 -- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415ccb0 msgr2=0x7f70c41f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415ccb0 0x7f70c41f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 -- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70c415c8d0 msgr2=0x7f70c40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70c415c8d0 0x7f70c40c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 -- 172.21.15.50:0/3096231553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0094d0 con 0x7f70c415d250 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c37fe640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00b9a0 tx=0x7f70bc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00cba0 con 0x7f70c415d250 2023-08-10T10:43:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc00cd00 con 0x7f70c415d250 2023-08-10T10:43:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc014680 con 0x7f70c415d250 2023-08-10T10:43:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c40b1a60 con 0x7f70c415d250 2023-08-10T10:43:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.840+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c41f5ee0 con 0x7f70c415d250 2023-08-10T10:43:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.842+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c40b1c50 con 0x7f70c415d250 2023-08-10T10:43:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.843+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70bc01d3b0 con 0x7f70c415d250 2023-08-10T10:43:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.843+0000 7f70bb7fe640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 0x7f70a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.844+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f70bc088fc0 con 0x7f70c415d250 2023-08-10T10:43:08.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.844+0000 7f70c2ffd640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 0x7f70a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:08.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.845+0000 7f70c2ffd640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 0x7f70a406d110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098f0 tx=0x7f70b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:08.848+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f70bc054380 con 0x7f70c415d250 2023-08-10T10:43:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.099+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f70c4066e30 con 0x7f70c415d250 2023-08-10T10:43:09.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.571+0000 7f70bb7fe640 1 -- 172.21.15.50:0/3096231553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v263) v1 ==== 136+0+0 (secure 0 0 0) 0x7f70bc0579a0 con 0x7f70c415d250 2023-08-10T10:43:09.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 msgr2=0x7f70a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:09.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 0x7f70a406d110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098f0 tx=0x7f70b4008040 comp rx=0 tx=0).stop 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 msgr2=0x7f70c40ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00b9a0 tx=0x7f70bc00be60 comp rx=0 tx=0).stop 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 shutdown_connections 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70c415d250 0x7f70c40ca2c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70c415ccb0 0x7f70c41f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:09.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f70a406ac50 0x7f70a406d110 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:09.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 --2- 172.21.15.50:0/3096231553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70c415c8d0 0x7f70c40c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:09.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.574+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 >> 172.21.15.50:0/3096231553 conn(0x7f70c40cafa0 msgr2=0x7f70c40af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:09.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.575+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 shutdown_connections 2023-08-10T10:43:09.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:09.575+0000 7f70c3fff640 1 -- 172.21.15.50:0/3096231553 wait complete. 2023-08-10T10:43:09.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-10T10:43:09.842 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_objectstore":"memstore"} 2023-08-10T10:43:09.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-10T10:43:09.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.050+0000 7f172d014640 1 Processor -- start 2023-08-10T10:43:10.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.050+0000 7f172d014640 1 -- start start 2023-08-10T10:43:10.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172d014640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17280b3f30 0x7f17280ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172d014640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728071c70 con 0x7f17280b0c60 2023-08-10T10:43:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172d014640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280713d0 con 0x7f172815aa40 2023-08-10T10:43:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172d014640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280716b0 con 0x7f17280b3f30 2023-08-10T10:43:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17280b0c60 0x7f17280c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40406/0 (socket says 172.21.15.50:40406) 2023-08-10T10:43:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172659c640 1 -- 172.21.15.50:0/2627188830 learned_addr learned my addr 172.21.15.50:0/2627188830 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.052+0000 7f172759e640 1 --2- 172.21.15.50:0/2627188830 >> v2:172.21.15.117:3300/0 conn(0x7f17280b3f30 0x7f17280ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235102103 0 0) 0x7f1728071c70 con 0x7f17280b0c60 2023-08-10T10:43:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1710003520 con 0x7f17280b0c60 2023-08-10T10:43:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680318233 0 0) 0x7f1710003520 con 0x7f17280b0c60 2023-08-10T10:43:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 >> v2:172.21.15.117:3300/0 conn(0x7f17280b3f30 msgr2=0x7f17280ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 --2- 172.21.15.50:0/2627188830 >> v2:172.21.15.117:3300/0 conn(0x7f17280b3f30 0x7f17280ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 >> v1:172.21.15.117:6789/0 conn(0x7f172815aa40 legacy=0x7f17280b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728071990 con 0x7f17280b0c60 2023-08-10T10:43:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f171c001670 con 0x7f17280b0c60 2023-08-10T10:43:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 >> v1:172.21.15.50:6789/0 conn(0x7f17280b0c60 legacy=0x7f17280c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1710003970 0x7f1710003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f1710004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1710005180 0x7f171000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280716b0 con 0x7f17100047c0 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171000c120 con 0x7f1710005180 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171000c2e0 con 0x7f1710003970 2023-08-10T10:43:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.053+0000 7f172659c640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f1710004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f1726d9d640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1710003970 0x7f1710003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172759e640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1710005180 0x7f171000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172659c640 1 -- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1710003970 msgr2=0x7f1710003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172659c640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1710003970 0x7f1710003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172659c640 1 -- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1710005180 msgr2=0x7f171000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172659c640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1710005180 0x7f171000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172659c640 1 -- 172.21.15.50:0/2627188830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710003520 con 0x7f17100047c0 2023-08-10T10:43:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172759e640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1710005180 0x7f171000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.054+0000 7f172759e640 1 -- 172.21.15.50:0/2627188830 reap_dead start 2023-08-10T10:43:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.055+0000 7f172659c640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f1710004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c240 tx=0x7f17100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4fdc22d6bbead6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.055+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c005ad0 con 0x7f17100047c0 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.055+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c005c30 con 0x7f17100047c0 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.055+0000 7f1725d9b640 1 -- 172.21.15.50:0/2627188830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c02ca80 con 0x7f17100047c0 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 -- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 msgr2=0x7f1710004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f1710004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c240 tx=0x7f17100057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 -- 172.21.15.50:0/2627188830 shutdown_connections 2023-08-10T10:43:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 --2- 172.21.15.50:0/2627188830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f1710004c40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 -- 172.21.15.50:0/2627188830 >> 172.21.15.50:0/2627188830 conn(0x7f172806b590 msgr2=0x7f17280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 -- 172.21.15.50:0/2627188830 shutdown_connections 2023-08-10T10:43:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.056+0000 7f172d014640 1 -- 172.21.15.50:0/2627188830 wait complete. 2023-08-10T10:43:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.058+0000 7f172d014640 1 Processor -- start 2023-08-10T10:43:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.058+0000 7f172d014640 1 -- start start 2023-08-10T10:43:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f172815c450 0x7f172815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281f5ba0 0x7f17281f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281f6560 con 0x7f17100047c0 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172815dfd0 con 0x7f17281f5ba0 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.059+0000 7f172d014640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172815db40 con 0x7f172815c450 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58040/0 (socket says 172.21.15.50:58040) 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 -- 172.21.15.50:0/3920683323 learned_addr learned my addr 172.21.15.50:0/3920683323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f172659c640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f172815c450 0x7f172815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 -- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f172815c450 msgr2=0x7f172815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f172815c450 0x7f172815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 -- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281f5ba0 msgr2=0x7f17281f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f172759e640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281f5ba0 0x7f17281f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281f5ba0 0x7f17281f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 -- 172.21.15.50:0/3920683323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172815cf30 con 0x7f17100047c0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.060+0000 7f1726d9d640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f171800e4d0 tx=0x7f171800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.061+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180052e0 con 0x7f17100047c0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.061+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718005440 con 0x7f17100047c0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.061+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718003810 con 0x7f17100047c0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.061+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172815d210 con 0x7f17100047c0 2023-08-10T10:43:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.061+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172815d7d0 con 0x7f17100047c0 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.062+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17281426e0 con 0x7f17100047c0 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.063+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1718003970 con 0x7f17100047c0 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.064+0000 7f170f7fe640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 0x7f171406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.064+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1718088fd0 con 0x7f17100047c0 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.064+0000 7f172659c640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 0x7f171406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.065+0000 7f172659c640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 0x7f171406d110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f171c034000 tx=0x7f171c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.068+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1718054300 con 0x7f17100047c0 2023-08-10T10:43:10.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.258+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f172804e270 con 0x7f17100047c0 2023-08-10T10:43:10.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.260+0000 7f170f7fe640 1 -- 172.21.15.50:0/3920683323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+14757 (secure 0 0 0) 0x7f1718057920 con 0x7f17100047c0 2023-08-10T10:43:10.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:10.262 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:06.534810+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6836/1006474021":"2023-08-11T10:43:03.489310+0000","172.21.15.50:6834/1006474021":"2023-08-11T10:43:03.489310+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:10.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.262+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 msgr2=0x7f171406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.262+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 0x7f171406d110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f171c034000 tx=0x7f171c009030 comp rx=0 tx=0).stop 2023-08-10T10:43:10.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.262+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 msgr2=0x7f17281f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.262+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f171800e4d0 tx=0x7f171800e990 comp rx=0 tx=0).stop 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 shutdown_connections 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f171406ac50 0x7f171406d110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281f5ba0 0x7f17281f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f172815c450 0x7f172815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 --2- 172.21.15.50:0/3920683323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17100047c0 0x7f17281f1eb0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 >> 172.21.15.50:0/3920683323 conn(0x7f172806b590 msgr2=0x7f17280c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:10.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 shutdown_connections 2023-08-10T10:43:10.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.263+0000 7f172d014640 1 -- 172.21.15.50:0/3920683323 wait complete. 2023-08-10T10:43:10.282 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:43:10.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:43:10.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.494+0000 7f6dcdca6640 1 Processor -- start 2023-08-10T10:43:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.494+0000 7f6dcdca6640 1 -- start start 2023-08-10T10:43:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dc806cb30 0x7f6dc80ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dc80cd2a0 0x7f6dc80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80cdc90 con 0x7f6dc806cb30 2023-08-10T10:43:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80adcb0 con 0x7f6dc80cd2a0 2023-08-10T10:43:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dcdca6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc806c320 con 0x7f6dc815ae40 2023-08-10T10:43:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dc6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dc806cb30 0x7f6dc80ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dc6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dc806cb30 0x7f6dc80ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58050/0 (socket says 172.21.15.50:58050) 2023-08-10T10:43:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.496+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/646677296 learned_addr learned my addr 172.21.15.50:0/646677296 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc7fff640 1 --2- 172.21.15.50:0/646677296 >> v2:172.21.15.117:3300/0 conn(0x7f6dc80cd2a0 0x7f6dc80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/646677296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 msgr2=0x7f6dc80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc80b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/646677296 >> v2:172.21.15.117:3300/0 conn(0x7f6dc80cd2a0 msgr2=0x7f6dc80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/646677296 >> v2:172.21.15.117:3300/0 conn(0x7f6dc80cd2a0 0x7f6dc80cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.497+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/646677296 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc806b770 con 0x7f6dc806cb30 2023-08-10T10:43:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.498+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc80ad770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80b4550 tx=0x7f6dbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1464d8f380661f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dc67fc640 1 -- 172.21.15.50:0/646677296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc031870 con 0x7f6dc806cb30 2023-08-10T10:43:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dc67fc640 1 -- 172.21.15.50:0/646677296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0319d0 con 0x7f6dc806cb30 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dc67fc640 1 -- 172.21.15.50:0/646677296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc031d60 con 0x7f6dc806cb30 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 -- 172.21.15.50:0/646677296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 msgr2=0x7f6dc80ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc80ad770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80b4550 tx=0x7f6dbc02b910 comp rx=0 tx=0).stop 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 -- 172.21.15.50:0/646677296 shutdown_connections 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/646677296 >> v2:172.21.15.117:3300/0 conn(0x7f6dc80cd2a0 0x7f6dc80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc80ad770 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/646677296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.499+0000 7f6dcdca6640 1 -- 172.21.15.50:0/646677296 >> 172.21.15.50:0/646677296 conn(0x7f6dc80b01b0 msgr2=0x7f6dc80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.500+0000 7f6dcdca6640 1 -- 172.21.15.50:0/646677296 shutdown_connections 2023-08-10T10:43:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.500+0000 7f6dcdca6640 1 -- 172.21.15.50:0/646677296 wait complete. 2023-08-10T10:43:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.501+0000 7f6dcdca6640 1 Processor -- start 2023-08-10T10:43:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.502+0000 7f6dcdca6640 1 -- start start 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 0x7f6dc815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc815b220 con 0x7f6dc806cb30 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc81f5c10 con 0x7f6dc80cd2a0 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dcdca6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc815b470 con 0x7f6dc815ae40 2023-08-10T10:43:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58062/0 (socket says 172.21.15.50:58062) 2023-08-10T10:43:10.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc77fe640 1 -- 172.21.15.50:0/3052770750 learned_addr learned my addr 172.21.15.50:0/3052770750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc7fff640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 0x7f6dc815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.503+0000 7f6dc77fe640 1 -- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 msgr2=0x7f6dc806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc77fe640 1 -- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 msgr2=0x7f6dc815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 0x7f6dc815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc77fe640 1 -- 172.21.15.50:0/3052770750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0094d0 con 0x7f6dc806cb30 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 0x7f6dc815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d5f0 tx=0x7f6db800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db80125f0 con 0x7f6dc806cb30 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8012750 con 0x7f6dc806cb30 2023-08-10T10:43:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8012b00 con 0x7f6dc806cb30 2023-08-10T10:43:10.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc815b750 con 0x7f6dc806cb30 2023-08-10T10:43:10.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.504+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc806f920 con 0x7f6dc806cb30 2023-08-10T10:43:10.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.506+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc806fab0 con 0x7f6dc806cb30 2023-08-10T10:43:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.507+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6db8012c60 con 0x7f6dc806cb30 2023-08-10T10:43:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.508+0000 7f6daffff640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 0x7f6db406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.508+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6db8089680 con 0x7f6dc806cb30 2023-08-10T10:43:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.508+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 0x7f6db406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.509+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 0x7f6db406d140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc036000 tx=0x7f6dbc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.512+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6db8054a40 con 0x7f6dc806cb30 2023-08-10T10:43:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.704+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dc80612b0 con 0x7f6dc806cb30 2023-08-10T10:43:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.704+0000 7f6daffff640 1 -- 172.21.15.50:0/3052770750 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6db8058060 con 0x7f6dc806cb30 2023-08-10T10:43:10.707 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:43:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.707+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 msgr2=0x7f6db406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.707+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 0x7f6db406d140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc036000 tx=0x7f6dbc03c040 comp rx=0 tx=0).stop 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.707+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 msgr2=0x7f6dc8151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.707+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d5f0 tx=0x7f6db800dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 shutdown_connections 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dc815ae40 0x7f6dc806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6db406ac80 0x7f6db406d140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc80cd2a0 0x7f6dc815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 --2- 172.21.15.50:0/3052770750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc806cb30 0x7f6dc8151200 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 >> 172.21.15.50:0/3052770750 conn(0x7f6dc80b01b0 msgr2=0x7f6dc80c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 shutdown_connections 2023-08-10T10:43:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.708+0000 7f6dcdca6640 1 -- 172.21.15.50:0/3052770750 wait complete. 2023-08-10T10:43:10.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:43:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.956+0000 7f061d2c5640 1 Processor -- start 2023-08-10T10:43:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.957+0000 7f061d2c5640 1 -- start start 2023-08-10T10:43:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.958+0000 7f061d2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.958+0000 7f061d2c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06180cd9b0 0x7f06180ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.958+0000 7f061d2c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180adcb0 con 0x7f061806cb30 2023-08-10T10:43:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.958+0000 7f061d2c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061806c320 con 0x7f06180cd9b0 2023-08-10T10:43:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.958+0000 7f061d2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061806b770 con 0x7f061815ae40 2023-08-10T10:43:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06180cd9b0 0x7f06180ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06180cd9b0 0x7f06180ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58072/0 (socket says 172.21.15.50:58072) 2023-08-10T10:43:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 -- 172.21.15.50:0/2889358738 learned_addr learned my addr 172.21.15.50:0/2889358738 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f060e7fc640 1 --1- 172.21.15.50:0/2889358738 >> v1:172.21.15.50:6789/0 conn(0x7f061806cb30 0x7f06180cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40412/0 (socket says 172.21.15.50:40412) 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f0616ffd640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 -- 172.21.15.50:0/2889358738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 msgr2=0x7f06180b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 -- 172.21.15.50:0/2889358738 >> v1:172.21.15.50:6789/0 conn(0x7f061806cb30 legacy=0x7f06180cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f06177fe640 1 -- 172.21.15.50:0/2889358738 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061806b9f0 con 0x7f06180cd9b0 2023-08-10T10:43:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.959+0000 7f0616ffd640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.960+0000 7f06177fe640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f06180ad770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0610009870 tx=0x7f061002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fcd9c4f28874db server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f06167fc640 1 -- 172.21.15.50:0/2889358738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610030840 con 0x7f06180cd9b0 2023-08-10T10:43:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f06167fc640 1 -- 172.21.15.50:0/2889358738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06100309a0 con 0x7f06180cd9b0 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f06167fc640 1 -- 172.21.15.50:0/2889358738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610030d30 con 0x7f06180cd9b0 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 -- 172.21.15.50:0/2889358738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 msgr2=0x7f06180ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f06180ad770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0610009870 tx=0x7f061002b980 comp rx=0 tx=0).stop 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 -- 172.21.15.50:0/2889358738 shutdown_connections 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f06180ad770 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 --2- 172.21.15.50:0/2889358738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.961+0000 7f061d2c5640 1 -- 172.21.15.50:0/2889358738 >> 172.21.15.50:0/2889358738 conn(0x7f06180b01b0 msgr2=0x7f06180b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.962+0000 7f061d2c5640 1 -- 172.21.15.50:0/2889358738 shutdown_connections 2023-08-10T10:43:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.962+0000 7f061d2c5640 1 -- 172.21.15.50:0/2889358738 wait complete. 2023-08-10T10:43:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.963+0000 7f061d2c5640 1 Processor -- start 2023-08-10T10:43:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.963+0000 7f061d2c5640 1 -- start start 2023-08-10T10:43:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f061806cb30 0x7f06180c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c3140 con 0x7f06180cd9b0 2023-08-10T10:43:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c3900 con 0x7f061806cb30 2023-08-10T10:43:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.964+0000 7f061d2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c3be0 con 0x7f061815ae40 2023-08-10T10:43:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58082/0 (socket says 172.21.15.50:58082) 2023-08-10T10:43:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 -- 172.21.15.50:0/1304534842 learned_addr learned my addr 172.21.15.50:0/1304534842 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f0616ffd640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f061806cb30 0x7f06180c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 -- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 msgr2=0x7f06180c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 -- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f061806cb30 msgr2=0x7f06180c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f061806cb30 0x7f06180c2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 -- 172.21.15.50:0/1304534842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100094d0 con 0x7f06180cd9b0 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.965+0000 7f060e7fc640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f060000c7a0 tx=0x7f060000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.966+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000a5e0 con 0x7f06180cd9b0 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.966+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000a740 con 0x7f06180cd9b0 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.966+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000aaf0 con 0x7f06180cd9b0 2023-08-10T10:43:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.966+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06180c3ec0 con 0x7f06180cd9b0 2023-08-10T10:43:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.966+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180c4480 con 0x7f06180cd9b0 2023-08-10T10:43:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.967+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0618066390 con 0x7f06180cd9b0 2023-08-10T10:43:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.968+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f060000ac50 con 0x7f06180cd9b0 2023-08-10T10:43:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.969+0000 7f060ffff640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 0x7f05f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.969+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0600088950 con 0x7f06180cd9b0 2023-08-10T10:43:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.970+0000 7f0616ffd640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 0x7f05f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.970+0000 7f0616ffd640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 0x7f05f806d110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f06080096d0 tx=0x7f0608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:10.973+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0600053dc0 con 0x7f06180cd9b0 2023-08-10T10:43:11.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.164+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06180c4670 con 0x7f06180cd9b0 2023-08-10T10:43:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.164+0000 7f060ffff640 1 -- 172.21.15.50:0/1304534842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06000170a0 con 0x7f06180cd9b0 2023-08-10T10:43:11.166 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:43:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 msgr2=0x7f05f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 0x7f05f806d110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f06080096d0 tx=0x7f0608008040 comp rx=0 tx=0).stop 2023-08-10T10:43:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 msgr2=0x7f061815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f060000c7a0 tx=0x7f060000cc60 comp rx=0 tx=0).stop 2023-08-10T10:43:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 shutdown_connections 2023-08-10T10:43:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f061815ae40 0x7f06180c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06180cd9b0 0x7f061815ce10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f05f806ac50 0x7f05f806d110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 --2- 172.21.15.50:0/1304534842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f061806cb30 0x7f06180c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.167+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 >> 172.21.15.50:0/1304534842 conn(0x7f06180b01b0 msgr2=0x7f06180ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.168+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 shutdown_connections 2023-08-10T10:43:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.168+0000 7f061d2c5640 1 -- 172.21.15.50:0/1304534842 wait complete. 2023-08-10T10:43:11.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:43:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.417+0000 7f3afa312640 1 Processor -- start 2023-08-10T10:43:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.417+0000 7f3afa312640 1 -- start start 2023-08-10T10:43:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af415ae30 0x7f3af40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3af40afd60 0x7f3af40cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3af40cf480 0x7f3af40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af40cf8f0 con 0x7f3af40afd60 2023-08-10T10:43:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af40b01c0 con 0x7f3af40cf480 2023-08-10T10:43:11.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3afa312640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40ccae0 con 0x7f3af415ae30 2023-08-10T10:43:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3aeb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3af40afd60 0x7f3af40cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3aeb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3af40afd60 0x7f3af40cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58086/0 (socket says 172.21.15.50:58086) 2023-08-10T10:43:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3aeb7fe640 1 -- 172.21.15.50:0/1564365571 learned_addr learned my addr 172.21.15.50:0/1564365571 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3af3fff640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af415ae30 0x7f3af40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.419+0000 7f3af88af640 1 --2- 172.21.15.50:0/1564365571 >> v2:172.21.15.117:3300/0 conn(0x7f3af40cf480 0x7f3af40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.420+0000 7f3aeb7fe640 1 -- 172.21.15.50:0/1564365571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af415ae30 msgr2=0x7f3af40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.420+0000 7f3aeb7fe640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af415ae30 0x7f3af40ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.420+0000 7f3aeb7fe640 1 -- 172.21.15.50:0/1564365571 >> v2:172.21.15.117:3300/0 conn(0x7f3af40cf480 msgr2=0x7f3af40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.420+0000 7f3aeb7fe640 1 --2- 172.21.15.50:0/1564365571 >> v2:172.21.15.117:3300/0 conn(0x7f3af40cf480 0x7f3af40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.420+0000 7f3aeb7fe640 1 -- 172.21.15.50:0/1564365571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40cc240 con 0x7f3af40afd60 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.421+0000 7f3aeb7fe640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af40afd60 0x7f3af40cef40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3af4070ce0 tx=0x7f3adc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b93eb7fca4607f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.421+0000 7f3af37fe640 1 -- 172.21.15.50:0/1564365571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc031860 con 0x7f3af40afd60 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.421+0000 7f3af37fe640 1 -- 172.21.15.50:0/1564365571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0319c0 con 0x7f3af40afd60 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.421+0000 7f3af37fe640 1 -- 172.21.15.50:0/1564365571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc031d50 con 0x7f3af40afd60 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 -- 172.21.15.50:0/1564365571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af40afd60 msgr2=0x7f3af40cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af40afd60 0x7f3af40cef40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3af4070ce0 tx=0x7f3adc02b900 comp rx=0 tx=0).stop 2023-08-10T10:43:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 -- 172.21.15.50:0/1564365571 shutdown_connections 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 --2- 172.21.15.50:0/1564365571 >> v2:172.21.15.117:3300/0 conn(0x7f3af40cf480 0x7f3af40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af40afd60 0x7f3af40cef40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 --2- 172.21.15.50:0/1564365571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af415ae30 0x7f3af40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 -- 172.21.15.50:0/1564365571 >> 172.21.15.50:0/1564365571 conn(0x7f3af40d0960 msgr2=0x7f3af40d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 -- 172.21.15.50:0/1564365571 shutdown_connections 2023-08-10T10:43:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.422+0000 7f3afa312640 1 -- 172.21.15.50:0/1564365571 wait complete. 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.424+0000 7f3afa312640 1 Processor -- start 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.424+0000 7f3afa312640 1 -- start start 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 0x7f3af4155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3af40cf480 0x7f3af40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4156fd0 con 0x7f3af415ae30 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4156350 con 0x7f3af40cf480 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3afa312640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4156630 con 0x7f3af40afd60 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3af88af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3af88af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58094/0 (socket says 172.21.15.50:58094) 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.425+0000 7f3af88af640 1 -- 172.21.15.50:0/2087767062 learned_addr learned my addr 172.21.15.50:0/2087767062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af3fff640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 0x7f3af4155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 -- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 msgr2=0x7f3af4155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 0x7f3af4155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 -- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3af40cf480 msgr2=0x7f3af40b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3af40cf480 0x7f3af40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 -- 172.21.15.50:0/2087767062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0094d0 con 0x7f3af415ae30 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af3fff640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 0x7f3af4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af88af640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007d20 tx=0x7f3aec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec014420 con 0x7f3af415ae30 2023-08-10T10:43:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0145a0 con 0x7f3af415ae30 2023-08-10T10:43:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec014950 con 0x7f3af415ae30 2023-08-10T10:43:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.426+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4156910 con 0x7f3af415ae30 2023-08-10T10:43:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.427+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af4156060 con 0x7f3af415ae30 2023-08-10T10:43:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.428+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4157110 con 0x7f3af415ae30 2023-08-10T10:43:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.429+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3aec014ab0 con 0x7f3af415ae30 2023-08-10T10:43:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.430+0000 7f3af17fa640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 0x7f3ad406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.430+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3aec089a80 con 0x7f3af415ae30 2023-08-10T10:43:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.430+0000 7f3af3fff640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 0x7f3ad406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.431+0000 7f3af3fff640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 0x7f3ad406d110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3af4157810 tx=0x7f3ae4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.435+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3af4157110 con 0x7f3af415ae30 2023-08-10T10:43:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.637+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3af4157110 con 0x7f3af415ae30 2023-08-10T10:43:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.643+0000 7f3af17fa640 1 -- 172.21.15.50:0/2087767062 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3af4157110 con 0x7f3af415ae30 2023-08-10T10:43:11.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 msgr2=0x7f3ad406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 0x7f3ad406d110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3af4157810 tx=0x7f3ae4008040 comp rx=0 tx=0).stop 2023-08-10T10:43:11.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 msgr2=0x7f3af40b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:11.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007d20 tx=0x7f3aec00e4b0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 shutdown_connections 2023-08-10T10:43:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3af415ae30 0x7f3af40b13f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3ad406ac50 0x7f3ad406d110 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3af40cf480 0x7f3af40b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 --2- 172.21.15.50:0/2087767062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3af40afd60 0x7f3af4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:11.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.645+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 >> 172.21.15.50:0/2087767062 conn(0x7f3af40d0960 msgr2=0x7f3af40ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:11.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.646+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 shutdown_connections 2023-08-10T10:43:11.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:11.646+0000 7f3afa312640 1 -- 172.21.15.50:0/2087767062 wait complete. 2023-08-10T10:43:11.665 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:43:11.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:43:11.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:43:11.915 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:43:11.916 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:43:11.917 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:11.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:43:11.980 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:43:11.981 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:12.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:43:12.038 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:43:12.038 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:12.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:43:12.102 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:43:12.102 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:12.163 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:43:12.163 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:43:12.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:12.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.401+0000 7f2820796640 1 Processor -- start 2023-08-10T10:43:12.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.401+0000 7f2820796640 1 -- start start 2023-08-10T10:43:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f281815cd60 0x7f2818160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f28180cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28180cddb0 0x7f28180696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180ce240 con 0x7f281815cd60 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180b5bd0 con 0x7f28180cddb0 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f2820796640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2818161180 con 0x7f28180b8430 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f281e532640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f281815cd60 0x7f2818160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f281e532640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f281815cd60 0x7f2818160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58096/0 (socket says 172.21.15.50:58096) 2023-08-10T10:43:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.403+0000 7f281e532640 1 -- 172.21.15.50:0/3994035335 learned_addr learned my addr 172.21.15.50:0/3994035335 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281dd31640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f28180cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281ed33640 1 --2- 172.21.15.50:0/3994035335 >> v2:172.21.15.117:3300/0 conn(0x7f28180cddb0 0x7f28180696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281e532640 1 -- 172.21.15.50:0/3994035335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 msgr2=0x7f28180cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281e532640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f28180cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281e532640 1 -- 172.21.15.50:0/3994035335 >> v2:172.21.15.117:3300/0 conn(0x7f28180cddb0 msgr2=0x7f28180696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281e532640 1 --2- 172.21.15.50:0/3994035335 >> v2:172.21.15.117:3300/0 conn(0x7f28180cddb0 0x7f28180696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.404+0000 7f281e532640 1 -- 172.21.15.50:0/3994035335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818161460 con 0x7f281815cd60 2023-08-10T10:43:12.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.405+0000 7f281e532640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818160930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f28180b5490 tx=0x7f281402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3db1593197d708 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f281d530640 1 -- 172.21.15.50:0/3994035335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814030860 con 0x7f281815cd60 2023-08-10T10:43:12.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f281d530640 1 -- 172.21.15.50:0/3994035335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28140309c0 con 0x7f281815cd60 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f281d530640 1 -- 172.21.15.50:0/3994035335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814030d50 con 0x7f281815cd60 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f2820796640 1 -- 172.21.15.50:0/3994035335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 msgr2=0x7f2818160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f2820796640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818160930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f28180b5490 tx=0x7f281402b9a0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.406+0000 7f2820796640 1 -- 172.21.15.50:0/3994035335 shutdown_connections 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 --2- 172.21.15.50:0/3994035335 >> v2:172.21.15.117:3300/0 conn(0x7f28180cddb0 0x7f28180696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f28180cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 --2- 172.21.15.50:0/3994035335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818160930 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 -- 172.21.15.50:0/3994035335 >> 172.21.15.50:0/3994035335 conn(0x7f28180d2ac0 msgr2=0x7f28180d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 -- 172.21.15.50:0/3994035335 shutdown_connections 2023-08-10T10:43:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.407+0000 7f2820796640 1 -- 172.21.15.50:0/3994035335 wait complete. 2023-08-10T10:43:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.408+0000 7f2820796640 1 Processor -- start 2023-08-10T10:43:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.409+0000 7f2820796640 1 -- start start 2023-08-10T10:43:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.409+0000 7f2820796640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f2818157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f2820796640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180cddb0 0x7f281815fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f2820796640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f2820796640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281815eac0 con 0x7f281815cd60 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f2820796640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281815eda0 con 0x7f28180cddb0 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f2820796640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281815f080 con 0x7f28180b8430 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58108/0 (socket says 172.21.15.50:58108) 2023-08-10T10:43:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 -- 172.21.15.50:0/297643774 learned_addr learned my addr 172.21.15.50:0/297643774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 -- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 msgr2=0x7f2818157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f2818157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281dd31640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180cddb0 0x7f281815fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 -- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180cddb0 msgr2=0x7f281815fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180cddb0 0x7f281815fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.410+0000 7f281ed33640 1 -- 172.21.15.50:0/297643774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140094d0 con 0x7f281815cd60 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f281ed33640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2810007e40 tx=0x7f281000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810014620 con 0x7f281815cd60 2023-08-10T10:43:12.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000ee90 con 0x7f281815cd60 2023-08-10T10:43:12.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100149e0 con 0x7f281815cd60 2023-08-10T10:43:12.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281815f360 con 0x7f281815cd60 2023-08-10T10:43:12.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.411+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28181600a0 con 0x7f281815cd60 2023-08-10T10:43:12.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.412+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281804e270 con 0x7f281815cd60 2023-08-10T10:43:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.413+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2810014b40 con 0x7f281815cd60 2023-08-10T10:43:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.414+0000 7f280effd640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 0x7f27fc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.414+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2810089ae0 con 0x7f281815cd60 2023-08-10T10:43:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.414+0000 7f281e532640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 0x7f27fc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.415+0000 7f281e532640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 0x7f27fc06d140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2814036000 tx=0x7f281403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.419+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2810054ea0 con 0x7f281815cd60 2023-08-10T10:43:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.646+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28180ccf80 con 0x7f281815cd60 2023-08-10T10:43:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.648+0000 7f280effd640 1 -- 172.21.15.50:0/297643774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f28100584c0 con 0x7f281815cd60 2023-08-10T10:43:12.650 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:12.651 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1007967601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1007967601},{"type":"v1","addr":"172.21.15.117:6833","nonce":1007967601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/234234443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":234234443},{"type":"v1","addr":"172.21.15.50:6837","nonce":234234443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2070226485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2070226485},{"type":"v1","addr":"172.21.15.117:6835","nonce":2070226485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1838836228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1838836228},{"type":"v1","addr":"172.21.15.50:6836","nonce":1838836228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-08-10T10:43:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-08-10T10:43:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.652+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 msgr2=0x7f27fc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.652+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 0x7f27fc06d140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2814036000 tx=0x7f281403b040 comp rx=0 tx=0).stop 2023-08-10T10:43:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.652+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 msgr2=0x7f2818156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.652+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2810007e40 tx=0x7f281000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 shutdown_connections 2023-08-10T10:43:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f281815cd60 0x7f2818156390 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27fc06ac80 0x7f27fc06d140 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180cddb0 0x7f281815fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 --2- 172.21.15.50:0/297643774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28180b8430 0x7f2818157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 >> 172.21.15.50:0/297643774 conn(0x7f28180d2ac0 msgr2=0x7f281815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 shutdown_connections 2023-08-10T10:43:12.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.653+0000 7f2820796640 1 -- 172.21.15.50:0/297643774 wait complete. 2023-08-10T10:43:12.675 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:43:12.675 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:43:12.675 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:43:12.676 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:43:12.676 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:43:12.677 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:43:12.677 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:43:12.677 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:43:12.678 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:43:12.678 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:43:12.678 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:43:12.678 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:43:12.679 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:43:12.679 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:43:12.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:43:12.680 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:43:12.696 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:43:12.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:43:12.699 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:43:12.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:43:12.707 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:43:12.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:43:12.710 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:43:12.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:43:12.748 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:43:12.749 DEBUG:teuthology.parallel:result is None 2023-08-10T10:43:12.756 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:43:12.757 DEBUG:teuthology.parallel:result is None 2023-08-10T10:43:12.758 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:43:12.759 DEBUG:teuthology.parallel:result is None 2023-08-10T10:43:12.766 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:43:12.767 DEBUG:teuthology.parallel:result is None 2023-08-10T10:43:12.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:43:12.918 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:43:12.919 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:43:12.925 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:43:12.926 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:43:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.971+0000 7ffbaf199640 1 Processor -- start 2023-08-10T10:43:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.972+0000 7ffbaf199640 1 -- start start 2023-08-10T10:43:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbaf199640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba815ce00 0x7ffba80d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbaf199640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffba80b5af0 0x7ffba80d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbaf199640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80d1220 con 0x7ffba80cd730 2023-08-10T10:43:12.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbaf199640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80d2930 con 0x7ffba815ce00 2023-08-10T10:43:12.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbaf199640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80b8a30 con 0x7ffba80b5af0 2023-08-10T10:43:12.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbacf35640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffba80cd730 0x7ffba80cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40458/0 (socket says 172.21.15.50:40458) 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffb9ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba815ce00 0x7ffba80d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.973+0000 7ffbacf35640 1 -- 172.21.15.50:0/841651405 learned_addr learned my addr 172.21.15.50:0/841651405 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.974+0000 7ffbad736640 1 --2- 172.21.15.50:0/841651405 >> v2:172.21.15.117:3300/0 conn(0x7ffba80b5af0 0x7ffba80d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.974+0000 7ffb9ffff640 1 -- 172.21.15.50:0/841651405 >> v2:172.21.15.117:3300/0 conn(0x7ffba80b5af0 msgr2=0x7ffba80d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.974+0000 7ffb9ffff640 1 --2- 172.21.15.50:0/841651405 >> v2:172.21.15.117:3300/0 conn(0x7ffba80b5af0 0x7ffba80d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.974+0000 7ffb9ffff640 1 -- 172.21.15.50:0/841651405 >> v1:172.21.15.50:6789/0 conn(0x7ffba80cd730 legacy=0x7ffba80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.974+0000 7ffb9ffff640 1 -- 172.21.15.50:0/841651405 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80b1e70 con 0x7ffba815ce00 2023-08-10T10:43:12.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.975+0000 7ffb9ffff640 1 --2- 172.21.15.50:0/841651405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba815ce00 0x7ffba80d23f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ffba8070bd0 tx=0x7ffb9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec30e449caf75e27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.975+0000 7ffb9f7fe640 1 -- 172.21.15.50:0/841651405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98031830 con 0x7ffba815ce00 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.975+0000 7ffb9f7fe640 1 -- 172.21.15.50:0/841651405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98031990 con 0x7ffba815ce00 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.975+0000 7ffb9f7fe640 1 -- 172.21.15.50:0/841651405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98031d20 con 0x7ffba815ce00 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 -- 172.21.15.50:0/841651405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba815ce00 msgr2=0x7ffba80d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 --2- 172.21.15.50:0/841651405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba815ce00 0x7ffba80d23f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ffba8070bd0 tx=0x7ffb9802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 -- 172.21.15.50:0/841651405 shutdown_connections 2023-08-10T10:43:12.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 --2- 172.21.15.50:0/841651405 >> v2:172.21.15.117:3300/0 conn(0x7ffba80b5af0 0x7ffba80d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 --2- 172.21.15.50:0/841651405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba815ce00 0x7ffba80d23f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 -- 172.21.15.50:0/841651405 >> 172.21.15.50:0/841651405 conn(0x7ffba80d2c60 msgr2=0x7ffba80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:12.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 -- 172.21.15.50:0/841651405 shutdown_connections 2023-08-10T10:43:12.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.976+0000 7ffbaf199640 1 -- 172.21.15.50:0/841651405 wait complete. 2023-08-10T10:43:12.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.978+0000 7ffbaf199640 1 Processor -- start 2023-08-10T10:43:12.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.978+0000 7ffbaf199640 1 -- start start 2023-08-10T10:43:12.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80b5af0 0x7ffba815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba815ce00 0x7ffba814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80c6d70 con 0x7ffba80cd730 2023-08-10T10:43:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80c7050 con 0x7ffba80b5af0 2023-08-10T10:43:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffbaf199640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80c7330 con 0x7ffba815ce00 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.979+0000 7ffb9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58144/0 (socket says 172.21.15.50:58144) 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 -- 172.21.15.50:0/3783200779 learned_addr learned my addr 172.21.15.50:0/3783200779 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffbacf35640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80b5af0 0x7ffba815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffbad736640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba815ce00 0x7ffba814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 -- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba815ce00 msgr2=0x7ffba814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba815ce00 0x7ffba814cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 -- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80b5af0 msgr2=0x7ffba815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80b5af0 0x7ffba815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.980+0000 7ffb9ffff640 1 -- 172.21.15.50:0/3783200779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009400 con 0x7ffba80cd730 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffb9ffff640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb98000c00 tx=0x7ffb980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9803aa60 con 0x7ffba80cd730 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9803abe0 con 0x7ffba80cd730 2023-08-10T10:43:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980443f0 con 0x7ffba80cd730 2023-08-10T10:43:12.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba80c7610 con 0x7ffba80cd730 2023-08-10T10:43:12.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.981+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba814d2d0 con 0x7ffba80cd730 2023-08-10T10:43:12.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.982+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba804e270 con 0x7ffba80cd730 2023-08-10T10:43:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.983+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb9804d450 con 0x7ffba80cd730 2023-08-10T10:43:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.984+0000 7ffb9d7fa640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 0x7ffb9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.984+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffb980ab1e0 con 0x7ffba80cd730 2023-08-10T10:43:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.984+0000 7ffbacf35640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 0x7ffb9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.985+0000 7ffbacf35640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 0x7ffb9406d110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffba4005880 tx=0x7ffba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:12.988+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb980766e0 con 0x7ffba80cd730 2023-08-10T10:43:13.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:13.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:13.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.205+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffba80b3140 con 0x7ffba80cd730 2023-08-10T10:43:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.680+0000 7ffb9d7fa640 1 -- 172.21.15.50:0/3783200779 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffb98079d00 con 0x7ffba80cd730 2023-08-10T10:43:13.683 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:43:13.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.684+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 msgr2=0x7ffb9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.684+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 0x7ffb9406d110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffba4005880 tx=0x7ffba4009040 comp rx=0 tx=0).stop 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.684+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 msgr2=0x7ffba80c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.684+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb98000c00 tx=0x7ffb980046c0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 shutdown_connections 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba815ce00 0x7ffba814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba80cd730 0x7ffba80c6520 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffb9406ac50 0x7ffb9406d110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 --2- 172.21.15.50:0/3783200779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80b5af0 0x7ffba815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 >> 172.21.15.50:0/3783200779 conn(0x7ffba80d2c60 msgr2=0x7ffba80b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 shutdown_connections 2023-08-10T10:43:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.685+0000 7ffbaf199640 1 -- 172.21.15.50:0/3783200779 wait complete. 2023-08-10T10:43:13.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:43:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.926+0000 7ff9e759e640 1 Processor -- start 2023-08-10T10:43:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.926+0000 7ff9e759e640 1 -- start start 2023-08-10T10:43:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9e80b0620 0x7ff9e80ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80c14e0 0x7ff9e80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e759e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80b40b0 con 0x7ff9e8161140 2023-08-10T10:43:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80cc100 con 0x7ff9e80b0620 2023-08-10T10:43:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80cc3e0 con 0x7ff9e80c14e0 2023-08-10T10:43:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9e8161140 0x7ff9e80aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40470/0 (socket says 172.21.15.50:40470) 2023-08-10T10:43:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.928+0000 7ff9e659c640 1 -- 172.21.15.50:0/2768776829 learned_addr learned my addr 172.21.15.50:0/2768776829 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745230107 0 0) 0x7ff9e80b40b0 con 0x7ff9e8161140 2023-08-10T10:43:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d4003520 con 0x7ff9e8161140 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9dffff640 1 --2- 172.21.15.50:0/2768776829 >> v2:172.21.15.117:3300/0 conn(0x7ff9e80b0620 0x7ff9e80ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e6d9d640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80c14e0 0x7ff9e80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542043073 0 0) 0x7ff9d4003520 con 0x7ff9e8161140 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80c14e0 msgr2=0x7ff9e80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80c14e0 0x7ff9e80cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 >> v2:172.21.15.117:3300/0 conn(0x7ff9e80b0620 msgr2=0x7ff9e80ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 --2- 172.21.15.50:0/2768776829 >> v2:172.21.15.117:3300/0 conn(0x7ff9e80b0620 0x7ff9e80ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80cc6c0 con 0x7ff9e8161140 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff9d8001670 con 0x7ff9e8161140 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 >> v1:172.21.15.50:6789/0 conn(0x7ff9e8161140 legacy=0x7ff9e80aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d40039e0 0x7ff9d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.929+0000 7ff9e5d9b640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4005180 0x7ff9d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80cc100 con 0x7ff9d40047c0 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80cc3e0 con 0x7ff9d4005180 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d400c020 con 0x7ff9d40039e0 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9e659c640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d40039e0 0x7ff9d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 -- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d40039e0 msgr2=0x7ff9d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d40039e0 0x7ff9d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9e6d9d640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4005180 0x7ff9d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 -- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4005180 msgr2=0x7ff9d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4005180 0x7ff9d400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.930+0000 7ff9dffff640 1 -- 172.21.15.50:0/2768776829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4003520 con 0x7ff9d40047c0 2023-08-10T10:43:13.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.931+0000 7ff9dffff640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9d4004c40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ba30 tx=0x7ff9d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2a0464246617b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:13.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0032680 con 0x7ff9d40047c0 2023-08-10T10:43:13.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d00327e0 con 0x7ff9d40047c0 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e5d9b640 1 -- 172.21.15.50:0/2768776829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0032b70 con 0x7ff9d40047c0 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e759e640 1 -- 172.21.15.50:0/2768776829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 msgr2=0x7ff9d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e759e640 1 --2- 172.21.15.50:0/2768776829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9d4004c40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ba30 tx=0x7ff9d40057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.932+0000 7ff9e6d9d640 1 -- 172.21.15.50:0/2768776829 reap_dead start 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.933+0000 7ff9e759e640 1 -- 172.21.15.50:0/2768776829 shutdown_connections 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.933+0000 7ff9e759e640 1 -- 172.21.15.50:0/2768776829 >> 172.21.15.50:0/2768776829 conn(0x7ff9e806ab80 msgr2=0x7ff9e806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.933+0000 7ff9e759e640 1 -- 172.21.15.50:0/2768776829 shutdown_connections 2023-08-10T10:43:13.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.933+0000 7ff9e759e640 1 -- 172.21.15.50:0/2768776829 wait complete. 2023-08-10T10:43:13.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.935+0000 7ff9e759e640 1 Processor -- start 2023-08-10T10:43:13.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.935+0000 7ff9e759e640 1 -- start start 2023-08-10T10:43:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.936+0000 7ff9e759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80b39e0 0x7ff9e81f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e81f9090 0x7ff9e815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81f7ff0 con 0x7ff9d40047c0 2023-08-10T10:43:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81f82d0 con 0x7ff9e81f9090 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81f85b0 con 0x7ff9e80b39e0 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58168/0 (socket says 172.21.15.50:58168) 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 -- 172.21.15.50:0/1398073872 learned_addr learned my addr 172.21.15.50:0/1398073872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 -- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80b39e0 msgr2=0x7ff9e81f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80b39e0 0x7ff9e81f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 -- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e81f9090 msgr2=0x7ff9e815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e81f9090 0x7ff9e815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.937+0000 7ff9e659c640 1 -- 172.21.15.50:0/1398073872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e81f8890 con 0x7ff9d40047c0 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9e659c640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800e730 tx=0x7ff9d800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800ee40 con 0x7ff9d40047c0 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d800c850 con 0x7ff9d40047c0 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800cc00 con 0x7ff9d40047c0 2023-08-10T10:43:13.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e81f8b70 con 0x7ff9d40047c0 2023-08-10T10:43:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.938+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e81f7da0 con 0x7ff9d40047c0 2023-08-10T10:43:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.939+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e8066e30 con 0x7ff9d40047c0 2023-08-10T10:43:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.940+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9d801d460 con 0x7ff9d40047c0 2023-08-10T10:43:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.941+0000 7ff9deffd640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 0x7ff9c806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.941+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff9d8089150 con 0x7ff9d40047c0 2023-08-10T10:43:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.941+0000 7ff9dffff640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 0x7ff9c806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.942+0000 7ff9dffff640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 0x7ff9c806d140 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ba00 tx=0x7ff9d0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:13.945+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9d8057f40 con 0x7ff9d40047c0 2023-08-10T10:43:14.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.200+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff9e80c9250 con 0x7ff9d40047c0 2023-08-10T10:43:14.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.202+0000 7ff9deffd640 1 -- 172.21.15.50:0/1398073872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff9d8057ad0 con 0x7ff9d40047c0 2023-08-10T10:43:14.203 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.204 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.205 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.207 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.208 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:43:14.209 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.210 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:43:14.211 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.212 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.212 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.212 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.213 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:43:14.213 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:43:14.214 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.214 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.214 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.214 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.215 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.215 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:43:14.216 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:43:14.216 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.216 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.217 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.217 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.217 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.218 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:43:14.218 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:43:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:43:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:43:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:43:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:43:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:43:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:43:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:43:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:43:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:43:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:43:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:43:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:43:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:43:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:43:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:43:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:43:14.240 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:43:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 msgr2=0x7ff9c806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 0x7ff9c806d140 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ba00 tx=0x7ff9d0032000 comp rx=0 tx=0).stop 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 msgr2=0x7ff9e815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800e730 tx=0x7ff9d800ebf0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 shutdown_connections 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9c806ac80 0x7ff9c806d140 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e81f9090 0x7ff9e815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80b39e0 0x7ff9e81f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 --2- 172.21.15.50:0/1398073872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d40047c0 0x7ff9e815b1c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 >> 172.21.15.50:0/1398073872 conn(0x7ff9e806ab80 msgr2=0x7ff9e806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 shutdown_connections 2023-08-10T10:43:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.204+0000 7ff9e759e640 1 -- 172.21.15.50:0/1398073872 wait complete. 2023-08-10T10:43:14.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.472+0000 7f70a6e06640 1 Processor -- start 2023-08-10T10:43:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.473+0000 7f70a6e06640 1 -- start start 2023-08-10T10:43:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.474+0000 7f70a6e06640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70a00c1af0 0x7f70a00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.474+0000 7f70a6e06640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70a0069be0 0x7f70a00b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.474+0000 7f70a6e06640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a006f6f0 con 0x7f70a00b2d70 2023-08-10T10:43:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.474+0000 7f70a6e06640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a01617f0 con 0x7f70a0069be0 2023-08-10T10:43:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.474+0000 7f70a6e06640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a006a050 con 0x7f70a00c1af0 2023-08-10T10:43:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70a0069be0 0x7f70a00b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70a0069be0 0x7f70a00b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58172/0 (socket says 172.21.15.50:58172) 2023-08-10T10:43:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 -- 172.21.15.50:0/640970578 learned_addr learned my addr 172.21.15.50:0/640970578 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f70a4ba2640 1 --2- 172.21.15.50:0/640970578 >> v2:172.21.15.117:3300/0 conn(0x7f70a00c1af0 0x7f70a00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 -- 172.21.15.50:0/640970578 >> v2:172.21.15.117:3300/0 conn(0x7f70a00c1af0 msgr2=0x7f70a00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 --2- 172.21.15.50:0/640970578 >> v2:172.21.15.117:3300/0 conn(0x7f70a00c1af0 0x7f70a00696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 -- 172.21.15.50:0/640970578 >> v1:172.21.15.117:6789/0 conn(0x7f70a00b2d70 legacy=0x7f70a00b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.475+0000 7f7097fff640 1 -- 172.21.15.50:0/640970578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a006edc0 con 0x7f70a0069be0 2023-08-10T10:43:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.476+0000 7f7097fff640 1 --2- 172.21.15.50:0/640970578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a00b2830 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f70a006bba0 tx=0x7f709002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614b3d26a00c0cac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.477+0000 7f70977fe640 1 -- 172.21.15.50:0/640970578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090030860 con 0x7f70a0069be0 2023-08-10T10:43:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.477+0000 7f70977fe640 1 -- 172.21.15.50:0/640970578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900309c0 con 0x7f70a0069be0 2023-08-10T10:43:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.477+0000 7f70977fe640 1 -- 172.21.15.50:0/640970578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090030d50 con 0x7f70a0069be0 2023-08-10T10:43:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.477+0000 7f70a6e06640 1 -- 172.21.15.50:0/640970578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 msgr2=0x7f70a00b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.477+0000 7f70a6e06640 1 --2- 172.21.15.50:0/640970578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a00b2830 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f70a006bba0 tx=0x7f709002b9a0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 -- 172.21.15.50:0/640970578 shutdown_connections 2023-08-10T10:43:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 --2- 172.21.15.50:0/640970578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a00b2830 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 --2- 172.21.15.50:0/640970578 >> v2:172.21.15.117:3300/0 conn(0x7f70a00c1af0 0x7f70a00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 -- 172.21.15.50:0/640970578 >> 172.21.15.50:0/640970578 conn(0x7f70a006b590 msgr2=0x7f70a00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 -- 172.21.15.50:0/640970578 shutdown_connections 2023-08-10T10:43:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.478+0000 7f70a6e06640 1 -- 172.21.15.50:0/640970578 wait complete. 2023-08-10T10:43:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.479+0000 7f70a6e06640 1 Processor -- start 2023-08-10T10:43:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.480+0000 7f70a6e06640 1 -- start start 2023-08-10T10:43:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.480+0000 7f70a6e06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a6e06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a00b2d70 0x7f70a015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a6e06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70a00c1af0 0x7f70a015f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a6e06640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014e020 con 0x7f70a0069be0 2023-08-10T10:43:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a6e06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014e300 con 0x7f70a00b2d70 2023-08-10T10:43:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a6e06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a014e5e0 con 0x7f70a00c1af0 2023-08-10T10:43:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58184/0 (socket says 172.21.15.50:58184) 2023-08-10T10:43:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 -- 172.21.15.50:0/3532181127 learned_addr learned my addr 172.21.15.50:0/3532181127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 -- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70a00c1af0 msgr2=0x7f70a015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70a00c1af0 0x7f70a015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 -- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a00b2d70 msgr2=0x7f70a015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f7097fff640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a00b2d70 0x7f70a015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a00b2d70 0x7f70a015f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.481+0000 7f70a4ba2640 1 -- 172.21.15.50:0/3532181127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900094d0 con 0x7f70a0069be0 2023-08-10T10:43:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70a4ba2640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f709c007e40 tx=0x7f709c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c014620 con 0x7f70a0069be0 2023-08-10T10:43:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00ee90 con 0x7f70a0069be0 2023-08-10T10:43:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c0149c0 con 0x7f70a0069be0 2023-08-10T10:43:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a014e8c0 con 0x7f70a0069be0 2023-08-10T10:43:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.482+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a014f0c0 con 0x7f70a0069be0 2023-08-10T10:43:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.483+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a004e270 con 0x7f70a0069be0 2023-08-10T10:43:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.484+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f709c014b20 con 0x7f70a0069be0 2023-08-10T10:43:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.485+0000 7f70957fa640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 0x7f708c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.485+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f709c089ba0 con 0x7f70a0069be0 2023-08-10T10:43:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.486+0000 7f7097fff640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 0x7f708c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.486+0000 7f7097fff640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 0x7f708c06d110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7090036000 tx=0x7f709003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.490+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f709c054f00 con 0x7f70a0069be0 2023-08-10T10:43:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.682+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a00ccfc0 con 0x7f70a0069be0 2023-08-10T10:43:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.684+0000 7f70957fa640 1 -- 172.21.15.50:0/3532181127 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+14628 (secure 0 0 0) 0x7f709c058520 con 0x7f70a0069be0 2023-08-10T10:43:14.686 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:14.686 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:13.691255+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.686+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 msgr2=0x7f708c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.686+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 0x7f708c06d110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7090036000 tx=0x7f709003b040 comp rx=0 tx=0).stop 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 msgr2=0x7f70a014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f709c007e40 tx=0x7f709c00e4b0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 shutdown_connections 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70a00c1af0 0x7f70a015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f708c06ac50 0x7f708c06d110 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a00b2d70 0x7f70a015f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 --2- 172.21.15.50:0/3532181127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70a0069be0 0x7f70a014cc40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 >> 172.21.15.50:0/3532181127 conn(0x7f70a006b590 msgr2=0x7f70a00cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 shutdown_connections 2023-08-10T10:43:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.687+0000 7f70a6e06640 1 -- 172.21.15.50:0/3532181127 wait complete. 2023-08-10T10:43:14.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:43:14.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:43:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.925+0000 7fca8f59e640 1 Processor -- start 2023-08-10T10:43:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.925+0000 7fca8f59e640 1 -- start start 2023-08-10T10:43:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca9015aa50 0x7fca900c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca900b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8f59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900b1370 con 0x7fca900b4130 2023-08-10T10:43:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9015ae30 con 0x7fca9015aa50 2023-08-10T10:43:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b08d0 con 0x7fca900aff00 2023-08-10T10:43:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.926+0000 7fca8e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca9015aa50 0x7fca900c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca9015aa50 0x7fca900c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48314/0 (socket says 172.21.15.50:48314) 2023-08-10T10:43:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 -- 172.21.15.50:0/295987569 learned_addr learned my addr 172.21.15.50:0/295987569 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8ed9d640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca900b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 -- 172.21.15.50:0/295987569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 msgr2=0x7fca900b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca900b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 -- 172.21.15.50:0/295987569 >> v1:172.21.15.117:6789/0 conn(0x7fca900b4130 legacy=0x7fca900cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8e59c640 1 -- 172.21.15.50:0/295987569 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900b1650 con 0x7fca9015aa50 2023-08-10T10:43:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.927+0000 7fca8ed9d640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca900b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.928+0000 7fca8e59c640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c5550 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fca80009870 tx=0x7fca8002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8705e3010d3955 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.928+0000 7fca8dd9b640 1 -- 172.21.15.50:0/295987569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca800317c0 con 0x7fca9015aa50 2023-08-10T10:43:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.928+0000 7fca8dd9b640 1 -- 172.21.15.50:0/295987569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca80031920 con 0x7fca9015aa50 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.928+0000 7fca8dd9b640 1 -- 172.21.15.50:0/295987569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031cb0 con 0x7fca9015aa50 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 -- 172.21.15.50:0/295987569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 msgr2=0x7fca900c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c5550 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fca80009870 tx=0x7fca8002b860 comp rx=0 tx=0).stop 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 -- 172.21.15.50:0/295987569 shutdown_connections 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca900b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 --2- 172.21.15.50:0/295987569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c5550 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 -- 172.21.15.50:0/295987569 >> 172.21.15.50:0/295987569 conn(0x7fca90069cd0 msgr2=0x7fca900caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 -- 172.21.15.50:0/295987569 shutdown_connections 2023-08-10T10:43:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.929+0000 7fca8f59e640 1 -- 172.21.15.50:0/295987569 wait complete. 2023-08-10T10:43:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.931+0000 7fca8f59e640 1 Processor -- start 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.931+0000 7fca8f59e640 1 -- start start 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca90158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca900b4130 0x7fca901584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c3ad0 con 0x7fca9015aa50 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901591f0 con 0x7fca900b4130 2023-08-10T10:43:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.932+0000 7fca8f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c3130 con 0x7fca900aff00 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48330/0 (socket says 172.21.15.50:48330) 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 -- 172.21.15.50:0/2068376749 learned_addr learned my addr 172.21.15.50:0/2068376749 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8e59c640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca90158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca87fff640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca900b4130 0x7fca901584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 -- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 msgr2=0x7fca90158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca90158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 -- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca900b4130 msgr2=0x7fca901584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca900b4130 0x7fca901584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8ed9d640 1 -- 172.21.15.50:0/2068376749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800094d0 con 0x7fca9015aa50 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.933+0000 7fca8e59c640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca90158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca8ed9d640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fca8800cd50 tx=0x7fca8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800f680 con 0x7fca9015aa50 2023-08-10T10:43:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800f800 con 0x7fca9015aa50 2023-08-10T10:43:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800fbb0 con 0x7fca9015aa50 2023-08-10T10:43:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900c3410 con 0x7fca9015aa50 2023-08-10T10:43:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.934+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900c4430 con 0x7fca9015aa50 2023-08-10T10:43:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.935+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900c3c10 con 0x7fca9015aa50 2023-08-10T10:43:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.937+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca8800b040 con 0x7fca9015aa50 2023-08-10T10:43:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.937+0000 7fca86ffd640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 0x7fca7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.938+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca88089b00 con 0x7fca9015aa50 2023-08-10T10:43:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.938+0000 7fca8e59c640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 0x7fca7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.938+0000 7fca8e59c640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 0x7fca7006d110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:14.944+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fca900c3c10 con 0x7fca9015aa50 2023-08-10T10:43:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.127+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca900c3c10 con 0x7fca9015aa50 2023-08-10T10:43:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.127+0000 7fca86ffd640 1 -- 172.21.15.50:0/2068376749 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca900c3c10 con 0x7fca9015aa50 2023-08-10T10:43:15.129 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:43:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 msgr2=0x7fca7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 0x7fca7006d110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003d040 comp rx=0 tx=0).stop 2023-08-10T10:43:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 msgr2=0x7fca900c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fca8800cd50 tx=0x7fca8800a650 comp rx=0 tx=0).stop 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 shutdown_connections 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9015aa50 0x7fca900c3ef0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca7006ac50 0x7fca7006d110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca900b4130 0x7fca901584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 --2- 172.21.15.50:0/2068376749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca900aff00 0x7fca90158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 >> 172.21.15.50:0/2068376749 conn(0x7fca90069cd0 msgr2=0x7fca900ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 shutdown_connections 2023-08-10T10:43:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.130+0000 7fca8f59e640 1 -- 172.21.15.50:0/2068376749 wait complete. 2023-08-10T10:43:15.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:43:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.370+0000 7f71366ad640 1 Processor -- start 2023-08-10T10:43:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.370+0000 7f71366ad640 1 -- start start 2023-08-10T10:43:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71366ad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f713015cf70 0x7f7130160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71366ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300b4640 0x7f7130161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71366ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7130160a40 con 0x7f713015cb90 2023-08-10T10:43:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71366ad640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300b4bb0 con 0x7f713015cf70 2023-08-10T10:43:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71366ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300b4e90 con 0x7f71300b4640 2023-08-10T10:43:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.372+0000 7f71277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f713015cf70 0x7f7130160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f713015cf70 0x7f7130160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48340/0 (socket says 172.21.15.50:48340) 2023-08-10T10:43:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 -- 172.21.15.50:0/769906598 learned_addr learned my addr 172.21.15.50:0/769906598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f7134c4a640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300b4640 0x7f7130161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 -- 172.21.15.50:0/769906598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300b4640 msgr2=0x7f7130161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300b4640 0x7f7130161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 -- 172.21.15.50:0/769906598 >> v1:172.21.15.117:6789/0 conn(0x7f713015cb90 legacy=0x7f71300b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.373+0000 7f71277fe640 1 -- 172.21.15.50:0/769906598 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300b5170 con 0x7f713015cf70 2023-08-10T10:43:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.374+0000 7f71277fe640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cf70 0x7f7130160ed0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7118009e50 tx=0x7f711802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e6cd9857ed3646 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.375+0000 7f712f7fe640 1 -- 172.21.15.50:0/769906598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711802cb00 con 0x7f713015cf70 2023-08-10T10:43:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.375+0000 7f712f7fe640 1 -- 172.21.15.50:0/769906598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711802cc60 con 0x7f713015cf70 2023-08-10T10:43:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.375+0000 7f712f7fe640 1 -- 172.21.15.50:0/769906598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180343f0 con 0x7f713015cf70 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 -- 172.21.15.50:0/769906598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cf70 msgr2=0x7f7130160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cf70 0x7f7130160ed0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7118009e50 tx=0x7f711802bf60 comp rx=0 tx=0).stop 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 -- 172.21.15.50:0/769906598 shutdown_connections 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300b4640 0x7f7130161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 --2- 172.21.15.50:0/769906598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cf70 0x7f7130160ed0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 -- 172.21.15.50:0/769906598 >> 172.21.15.50:0/769906598 conn(0x7f71300cf640 msgr2=0x7f71300cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 -- 172.21.15.50:0/769906598 shutdown_connections 2023-08-10T10:43:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.376+0000 7f71366ad640 1 -- 172.21.15.50:0/769906598 wait complete. 2023-08-10T10:43:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.378+0000 7f71366ad640 1 Processor -- start 2023-08-10T10:43:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.378+0000 7f71366ad640 1 -- start start 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 0x7f71301f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 0x7f7130155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c8110 con 0x7f713015cb90 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c7070 con 0x7f71300b4640 2023-08-10T10:43:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71366ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c7350 con 0x7f713015cf70 2023-08-10T10:43:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48342/0 (socket says 172.21.15.50:48342) 2023-08-10T10:43:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 -- 172.21.15.50:0/566603510 learned_addr learned my addr 172.21.15.50:0/566603510 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 -- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 msgr2=0x7f7130155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f7134c4a640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 0x7f7130155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f712ffff640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 0x7f71301f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 0x7f7130155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 -- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 msgr2=0x7f71301f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 0x7f71301f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.379+0000 7f71277fe640 1 -- 172.21.15.50:0/566603510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118009b30 con 0x7f713015cb90 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f7134c4a640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 0x7f7130155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f712ffff640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 0x7f71301f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f71277fe640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7118000f80 tx=0x7f7118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118040670 con 0x7f713015cb90 2023-08-10T10:43:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118040810 con 0x7f713015cb90 2023-08-10T10:43:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300c7630 con 0x7f713015cb90 2023-08-10T10:43:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118040bc0 con 0x7f713015cb90 2023-08-10T10:43:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.380+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300c7bf0 con 0x7f713015cb90 2023-08-10T10:43:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.381+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71300c7de0 con 0x7f713015cb90 2023-08-10T10:43:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.383+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7118040d20 con 0x7f713015cb90 2023-08-10T10:43:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.384+0000 7f712d7fa640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 0x7f711006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.384+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f71180ac500 con 0x7f713015cb90 2023-08-10T10:43:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.384+0000 7f712ffff640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 0x7f711006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.385+0000 7f712ffff640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 0x7f711006d110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.390+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7118077980 con 0x7f713015cb90 2023-08-10T10:43:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.580+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71300612b0 con 0x7f713015cb90 2023-08-10T10:43:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.581+0000 7f712d7fa640 1 -- 172.21.15.50:0/566603510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f711807afa0 con 0x7f713015cb90 2023-08-10T10:43:15.583 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:43:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.583+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 msgr2=0x7f711006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.583+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 0x7f711006d110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120009040 comp rx=0 tx=0).stop 2023-08-10T10:43:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 msgr2=0x7f71300c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7118000f80 tx=0x7f7118004a40 comp rx=0 tx=0).stop 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 shutdown_connections 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713015cf70 0x7f7130155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713015cb90 0x7f71300c6620 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711006ac50 0x7f711006d110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 --2- 172.21.15.50:0/566603510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300b4640 0x7f71301f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 >> 172.21.15.50:0/566603510 conn(0x7f71300cf640 msgr2=0x7f71300cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 shutdown_connections 2023-08-10T10:43:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.584+0000 7f71366ad640 1 -- 172.21.15.50:0/566603510 wait complete. 2023-08-10T10:43:15.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:43:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.825+0000 7f659883f640 1 Processor -- start 2023-08-10T10:43:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.826+0000 7f659883f640 1 -- start start 2023-08-10T10:43:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.827+0000 7f659883f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 0x7f65940cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.827+0000 7f659883f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65940cddb0 0x7f65940d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.827+0000 7f659883f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6594161180 con 0x7f659415cd60 2023-08-10T10:43:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.827+0000 7f659883f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940ce240 con 0x7f65940cddb0 2023-08-10T10:43:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.827+0000 7f659883f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940b5bd0 con 0x7f65940b8430 2023-08-10T10:43:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.828+0000 7f659259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f659415cd60 0x7f6594160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45966/0 (socket says 172.21.15.50:45966) 2023-08-10T10:43:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.828+0000 7f659259c640 1 -- 172.21.15.50:0/687110569 learned_addr learned my addr 172.21.15.50:0/687110569 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.828+0000 7f6591d9b640 1 --2- 172.21.15.50:0/687110569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 0x7f65940cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.828+0000 7f6592d9d640 1 --2- 172.21.15.50:0/687110569 >> v2:172.21.15.117:3300/0 conn(0x7f65940cddb0 0x7f65940d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.828+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882832410 0 0) 0x7f6594161180 con 0x7f659415cd60 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003520 con 0x7f659415cd60 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f6591d9b640 1 -- 172.21.15.50:0/687110569 >> v2:172.21.15.117:3300/0 conn(0x7f65940cddb0 msgr2=0x7f65940d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f6591d9b640 1 --2- 172.21.15.50:0/687110569 >> v2:172.21.15.117:3300/0 conn(0x7f65940cddb0 0x7f65940d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f6591d9b640 1 -- 172.21.15.50:0/687110569 >> v1:172.21.15.50:6789/0 conn(0x7f659415cd60 legacy=0x7f6594160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276272218 0 0) 0x7f657c003520 con 0x7f659415cd60 2023-08-10T10:43:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.829+0000 7f6591d9b640 1 -- 172.21.15.50:0/687110569 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594161460 con 0x7f65940b8430 2023-08-10T10:43:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.830+0000 7f6591d9b640 1 --2- 172.21.15.50:0/687110569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 0x7f65940cd870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65880097a0 tx=0x7f658802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a802870f5bda70dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.831+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658802f050 con 0x7f65940b8430 2023-08-10T10:43:15.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.831+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588031500 con 0x7f65940b8430 2023-08-10T10:43:15.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.831+0000 7f659159a640 1 -- 172.21.15.50:0/687110569 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840019f0 con 0x7f65940b8430 2023-08-10T10:43:15.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.831+0000 7f659883f640 1 -- 172.21.15.50:0/687110569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 msgr2=0x7f65940cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.831+0000 7f659883f640 1 --2- 172.21.15.50:0/687110569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 0x7f65940cd870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65880097a0 tx=0x7f658802b820 comp rx=0 tx=0).stop 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 -- 172.21.15.50:0/687110569 shutdown_connections 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 --2- 172.21.15.50:0/687110569 >> v2:172.21.15.117:3300/0 conn(0x7f65940cddb0 0x7f65940d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 --2- 172.21.15.50:0/687110569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65940b8430 0x7f65940cd870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 -- 172.21.15.50:0/687110569 >> 172.21.15.50:0/687110569 conn(0x7f65940d2ac0 msgr2=0x7f65940d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 -- 172.21.15.50:0/687110569 shutdown_connections 2023-08-10T10:43:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.832+0000 7f659883f640 1 -- 172.21.15.50:0/687110569 wait complete. 2023-08-10T10:43:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.833+0000 7f659883f640 1 Processor -- start 2023-08-10T10:43:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.834+0000 7f659883f640 1 -- start start 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 0x7f65940ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f659415cd60 0x7f659414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940cab20 con 0x7f65940cddb0 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940a93f0 con 0x7f65940b8430 2023-08-10T10:43:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659883f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940a9640 con 0x7f659415cd60 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48352/0 (socket says 172.21.15.50:48352) 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 -- 172.21.15.50:0/2254832978 learned_addr learned my addr 172.21.15.50:0/2254832978 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659259c640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 0x7f65940ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 -- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f659415cd60 msgr2=0x7f659414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f659415cd60 0x7f659414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 -- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 msgr2=0x7f65940ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 0x7f65940ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f6591d9b640 1 -- 172.21.15.50:0/2254832978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009400 con 0x7f65940cddb0 2023-08-10T10:43:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.835+0000 7f659259c640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 0x7f65940ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f6591d9b640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f65880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588003ea0 con 0x7f65940cddb0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65880044c0 con 0x7f65940cddb0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880318b0 con 0x7f65940cddb0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65940a9920 con 0x7f65940cddb0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.836+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65940c9de0 con 0x7f65940cddb0 2023-08-10T10:43:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.837+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65940d0bc0 con 0x7f65940cddb0 2023-08-10T10:43:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.838+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6588031a10 con 0x7f65940cddb0 2023-08-10T10:43:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.839+0000 7f6582ffd640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 0x7f657406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.839+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f65880aaeb0 con 0x7f65940cddb0 2023-08-10T10:43:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.839+0000 7f659259c640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 0x7f657406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.840+0000 7f659259c640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 0x7f657406d140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6584001700 tx=0x7f6584009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:15.844+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6588076210 con 0x7f65940cddb0 2023-08-10T10:43:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.037+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f659404e270 con 0x7f65940cddb0 2023-08-10T10:43:16.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.038+0000 7f6582ffd640 1 -- 172.21.15.50:0/2254832978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6588038090 con 0x7f65940cddb0 2023-08-10T10:43:16.039 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:43:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:43:16.041 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:43:16.041 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:43:16.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:43:16.041 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:43:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 msgr2=0x7f657406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 0x7f657406d140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6584001700 tx=0x7f6584009040 comp rx=0 tx=0).stop 2023-08-10T10:43:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 msgr2=0x7f659414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f65880046c0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 shutdown_connections 2023-08-10T10:43:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f659415cd60 0x7f659414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65940cddb0 0x7f659414bed0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f657406ac80 0x7f657406d140 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 --2- 172.21.15.50:0/2254832978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65940b8430 0x7f65940ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 >> 172.21.15.50:0/2254832978 conn(0x7f65940d2ac0 msgr2=0x7f65940b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 shutdown_connections 2023-08-10T10:43:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.041+0000 7f659883f640 1 -- 172.21.15.50:0/2254832978 wait complete. 2023-08-10T10:43:16.061 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:43:16.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:43:16.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.282+0000 7f13e4e14640 1 Processor -- start 2023-08-10T10:43:16.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.282+0000 7f13e4e14640 1 -- start start 2023-08-10T10:43:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.283+0000 7f13e4e14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e015ac00 0x7f13e006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.283+0000 7f13e4e14640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e015bcb0 con 0x7f13e015a820 2023-08-10T10:43:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.283+0000 7f13e4e14640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e015b0a0 con 0x7f13e0069db0 2023-08-10T10:43:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.283+0000 7f13e4e14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c5540 con 0x7f13e015ac00 2023-08-10T10:43:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.284+0000 7f13de59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13e015a820 0x7f13e00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45980/0 (socket says 172.21.15.50:45980) 2023-08-10T10:43:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.284+0000 7f13de59c640 1 -- 172.21.15.50:0/4182735815 learned_addr learned my addr 172.21.15.50:0/4182735815 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.284+0000 7f13d7fff640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e015ac00 0x7f13e006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685423112 0 0) 0x7f13e015bcb0 con 0x7f13e015a820 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13cc003520 con 0x7f13e015a820 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445242112 0 0) 0x7f13e015b0a0 con 0x7f13e0069db0 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e015bcb0 con 0x7f13e0069db0 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2515926038 0 0) 0x7f13cc003520 con 0x7f13e015a820 2023-08-10T10:43:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e015ac00 msgr2=0x7f13e006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:16.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.285+0000 7f13ddd9b640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e015ac00 0x7f13e006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 >> v1:172.21.15.117:6789/0 conn(0x7f13e0069db0 legacy=0x7f13e00cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e015b380 con 0x7f13e015a820 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f13d0001670 con 0x7f13e015a820 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 >> v1:172.21.15.50:6789/0 conn(0x7f13e015a820 legacy=0x7f13e00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13cc004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13cc003760 0x7f13cc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13cc004120 0x7f13cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c5540 con 0x7f13cc003760 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc00bfa0 con 0x7f13cc004b90 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc00c160 con 0x7f13cc004120 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.286+0000 7f13d7fff640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e015ac00 0x7f13e006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13cc004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13ded9d640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13cc004120 0x7f13cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13d7fff640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13cc003760 0x7f13cc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 -- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13cc004120 msgr2=0x7f13cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13cc004120 0x7f13cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 -- 172.21.15.50:0/4182735815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13cc003760 msgr2=0x7f13cc003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13cc003760 0x7f13cc003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.287+0000 7f13de59c640 1 -- 172.21.15.50:0/4182735815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc003520 con 0x7f13cc004b90 2023-08-10T10:43:16.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.289+0000 7f13de59c640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13cc004f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c160 tx=0x7f13cc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b8a4365f6767473 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:16.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.289+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0005ad0 con 0x7f13cc004b90 2023-08-10T10:43:16.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.289+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0005c50 con 0x7f13cc004b90 2023-08-10T10:43:16.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.289+0000 7f13ddd9b640 1 -- 172.21.15.50:0/4182735815 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d002c850 con 0x7f13cc004b90 2023-08-10T10:43:16.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 -- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 msgr2=0x7f13cc004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4182735815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13cc004f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c160 tx=0x7f13cc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13ded9d640 1 -- 172.21.15.50:0/4182735815 reap_dead start 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 -- 172.21.15.50:0/4182735815 shutdown_connections 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 -- 172.21.15.50:0/4182735815 >> 172.21.15.50:0/4182735815 conn(0x7f13e00b08e0 msgr2=0x7f13e00ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 -- 172.21.15.50:0/4182735815 shutdown_connections 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.290+0000 7f13e4e14640 1 -- 172.21.15.50:0/4182735815 wait complete. 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.292+0000 7f13e4e14640 1 Processor -- start 2023-08-10T10:43:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.292+0000 7f13e4e14640 1 -- start start 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13e00c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e00b2520 0x7f13e0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c31d0 con 0x7f13e00c5860 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c2930 con 0x7f13cc004b90 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.293+0000 7f13e4e14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c2c10 con 0x7f13e00b2520 2023-08-10T10:43:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48364/0 (socket says 172.21.15.50:48364) 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 -- 172.21.15.50:0/4043634259 learned_addr learned my addr 172.21.15.50:0/4043634259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13de59c640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13e00c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13d7fff640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e00b2520 0x7f13e0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 -- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e00b2520 msgr2=0x7f13e0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e00b2520 0x7f13e0159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 -- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 msgr2=0x7f13e00c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13e00c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:16.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.294+0000 7f13ded9d640 1 -- 172.21.15.50:0/4043634259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00c2ef0 con 0x7f13e00c5860 2023-08-10T10:43:16.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13ded9d640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f13e00adb40 tx=0x7f13d800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003b80 con 0x7f13e00c5860 2023-08-10T10:43:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d8003d00 con 0x7f13e00c5860 2023-08-10T10:43:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8005310 con 0x7f13e00c5860 2023-08-10T10:43:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e00c8d70 con 0x7f13e00c5860 2023-08-10T10:43:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.295+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e015a010 con 0x7f13e00c5860 2023-08-10T10:43:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.296+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e00c8f90 con 0x7f13e00c5860 2023-08-10T10:43:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.297+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13d8005470 con 0x7f13e00c5860 2023-08-10T10:43:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.298+0000 7f13d6ffd640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 0x7f13c006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.298+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f13d8089250 con 0x7f13e00c5860 2023-08-10T10:43:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.299+0000 7f13de59c640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 0x7f13c006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.299+0000 7f13de59c640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 0x7f13c006d140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f13d0034000 tx=0x7f13d0007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.303+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13d80545b0 con 0x7f13e00c5860 2023-08-10T10:43:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:16.497+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f13e004e270 con 0x7f13e00c5860 2023-08-10T10:43:17.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.468+0000 7f13d6ffd640 1 -- 172.21.15.50:0/4043634259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13d8057bd0 con 0x7f13e00c5860 2023-08-10T10:43:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:43:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 msgr2=0x7f13c006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 0x7f13c006d140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f13d0034000 tx=0x7f13d0007000 comp rx=0 tx=0).stop 2023-08-10T10:43:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 msgr2=0x7f13e00ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f13e00adb40 tx=0x7f13d800fd60 comp rx=0 tx=0).stop 2023-08-10T10:43:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 shutdown_connections 2023-08-10T10:43:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e00c5860 0x7f13e00ac890 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e00b2520 0x7f13e0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13c006ac80 0x7f13c006d140 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 --2- 172.21.15.50:0/4043634259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc004b90 0x7f13e00c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.475+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 >> 172.21.15.50:0/4043634259 conn(0x7f13e00b08e0 msgr2=0x7f13e00cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:17.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.476+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 shutdown_connections 2023-08-10T10:43:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.476+0000 7f13e4e14640 1 -- 172.21.15.50:0/4043634259 wait complete. 2023-08-10T10:43:17.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:43:17.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.738+0000 7fece22ec640 1 Processor -- start 2023-08-10T10:43:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.738+0000 7fece22ec640 1 -- start start 2023-08-10T10:43:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fece22ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fecdc0b0cd0 0x7fecdc06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fece22ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecdc06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fece22ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc161640 con 0x7fecdc161260 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fece22ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc0c1bb0 con 0x7fecdc0b0cd0 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fece22ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0adb30 con 0x7fecdc0cdcb0 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fecdbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fecdc161260 0x7fecdc0ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45988/0 (socket says 172.21.15.50:45988) 2023-08-10T10:43:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.740+0000 7fecdbfff640 1 -- 172.21.15.50:0/870799665 learned_addr learned my addr 172.21.15.50:0/870799665 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733149139 0 0) 0x7fecdc161640 con 0x7fecdc161260 2023-08-10T10:43:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc4003520 con 0x7fecdc161260 2023-08-10T10:43:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fece0889640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecdc06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> v2:172.21.15.117:3300/0 conn(0x7fecdc0b0cd0 0x7fecdc06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515657874 0 0) 0x7fecc4003520 con 0x7fecdc161260 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 msgr2=0x7fecdc06f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecdc06f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 >> v2:172.21.15.117:3300/0 conn(0x7fecdc0b0cd0 msgr2=0x7fecdc06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 --2- 172.21.15.50:0/870799665 >> v2:172.21.15.117:3300/0 conn(0x7fecdc0b0cd0 0x7fecdc06ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0ade10 con 0x7fecdc161260 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7feccc001670 con 0x7fecdc161260 2023-08-10T10:43:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 >> v1:172.21.15.50:6789/0 conn(0x7fecdc161260 legacy=0x7fecdc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc4003970 0x7fecc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0adb30 con 0x7fecc40047c0 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400b9b0 con 0x7fecc4003970 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400bb70 con 0x7fecdc0cdcb0 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.741+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> v2:172.21.15.117:3300/0 conn(0x7fecdc0b0cd0 0x7fecdc06ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fece0889640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdbfff640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc4003970 0x7fecc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 -- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 msgr2=0x7fecc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0cdcb0 0x7fecc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 -- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc4003970 msgr2=0x7fecc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc4003970 0x7fecc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdb7fe640 1 -- 172.21.15.50:0/870799665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4003520 con 0x7fecc40047c0 2023-08-10T10:43:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.742+0000 7fecdbfff640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc4003970 0x7fecc4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.743+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecc4004c40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006fd0 tx=0x7fecc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a499840825a134 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0032660 con 0x7fecc40047c0 2023-08-10T10:43:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00327c0 con 0x7fecc40047c0 2023-08-10T10:43:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fecdaffd640 1 -- 172.21.15.50:0/870799665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0032b30 con 0x7fecc40047c0 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 -- 172.21.15.50:0/870799665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 msgr2=0x7fecc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 --2- 172.21.15.50:0/870799665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecc4004c40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006fd0 tx=0x7fecc40057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece0889640 1 -- 172.21.15.50:0/870799665 reap_dead start 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 -- 172.21.15.50:0/870799665 shutdown_connections 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 -- 172.21.15.50:0/870799665 >> 172.21.15.50:0/870799665 conn(0x7fecdc0b01b0 msgr2=0x7fecdc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 -- 172.21.15.50:0/870799665 shutdown_connections 2023-08-10T10:43:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.744+0000 7fece22ec640 1 -- 172.21.15.50:0/870799665 wait complete. 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.746+0000 7fece22ec640 1 Processor -- start 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.746+0000 7fece22ec640 1 -- start start 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 0x7fecdc0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0b2510 0x7fecdc06a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc15bed0 con 0x7fecc40047c0 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1635d0 con 0x7fecdc0c1d40 2023-08-10T10:43:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.747+0000 7fece22ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc162ca0 con 0x7fecdc0b2510 2023-08-10T10:43:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48384/0 (socket says 172.21.15.50:48384) 2023-08-10T10:43:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 -- 172.21.15.50:0/4044997583 learned_addr learned my addr 172.21.15.50:0/4044997583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 -- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0b2510 msgr2=0x7fecdc06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0b2510 0x7fecdc06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 -- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 msgr2=0x7fecdc0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 0x7fecdc0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 0x7fecdc0b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdbfff640 1 -- 172.21.15.50:0/4044997583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc162f80 con 0x7fecc40047c0 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.748+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 0x7fecdc0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fecdbfff640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d760 tx=0x7feccc00dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0074e0 con 0x7fecc40047c0 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc007640 con 0x7fecc40047c0 2023-08-10T10:43:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0049e0 con 0x7fecc40047c0 2023-08-10T10:43:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc163260 con 0x7fecc40047c0 2023-08-10T10:43:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.749+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0c21c0 con 0x7fecc40047c0 2023-08-10T10:43:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.750+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc0612b0 con 0x7fecc40047c0 2023-08-10T10:43:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.751+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feccc004b40 con 0x7fecc40047c0 2023-08-10T10:43:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.752+0000 7fecd8ff9640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 0x7fecc806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.752+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5580+0+0 (secure 0 0 0) 0x7feccc088d20 con 0x7fecc40047c0 2023-08-10T10:43:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.753+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 0x7fecc806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:17.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.754+0000 7fecdb7fe640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 0x7fecc806d110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fecd0036000 tx=0x7fecd0031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.758+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feccc053f10 con 0x7fecc40047c0 2023-08-10T10:43:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:17.951+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fecdc160760 con 0x7fecc40047c0 2023-08-10T10:43:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.479+0000 7fecd8ff9640 1 -- 172.21.15.50:0/4044997583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) v1 ==== 170+0+0 (secure 0 0 0) 0x7feccc0190d0 con 0x7fecc40047c0 2023-08-10T10:43:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:43:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.490+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 msgr2=0x7fecc806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.490+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 0x7fecc806d110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fecd0036000 tx=0x7fecd0031000 comp rx=0 tx=0).stop 2023-08-10T10:43:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.490+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 msgr2=0x7fecdc15b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.490+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d760 tx=0x7feccc00dc20 comp rx=0 tx=0).stop 2023-08-10T10:43:18.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 shutdown_connections 2023-08-10T10:43:18.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecdc0b2510 0x7fecdc06a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fecc806ac50 0x7fecc806d110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecdc0c1d40 0x7fecdc0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 --2- 172.21.15.50:0/4044997583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc40047c0 0x7fecdc15b990 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.492+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 >> 172.21.15.50:0/4044997583 conn(0x7fecdc0b01b0 msgr2=0x7fecdc0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.493+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 shutdown_connections 2023-08-10T10:43:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.493+0000 7fece22ec640 1 -- 172.21.15.50:0/4044997583 wait complete. 2023-08-10T10:43:18.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:43:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.727+0000 7f6474656640 1 Processor -- start 2023-08-10T10:43:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.727+0000 7f6474656640 1 -- start start 2023-08-10T10:43:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.728+0000 7f6474656640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c15cb90 0x7f646c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.728+0000 7f6474656640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f646c15cf70 0x7f646c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.728+0000 7f6474656640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c160a40 con 0x7f646c0b4640 2023-08-10T10:43:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.728+0000 7f6474656640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c0b4bb0 con 0x7f646c15cf70 2023-08-10T10:43:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.728+0000 7f6474656640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0b4e90 con 0x7f646c15cb90 2023-08-10T10:43:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f6472bf3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f646c0b4640 0x7f646c06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45990/0 (socket says 172.21.15.50:45990) 2023-08-10T10:43:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f6472bf3640 1 -- 172.21.15.50:0/4051417015 learned_addr learned my addr 172.21.15.50:0/4051417015 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:18.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f6471bf1640 1 --2- 172.21.15.50:0/4051417015 >> v2:172.21.15.117:3300/0 conn(0x7f646c15cf70 0x7f646c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f64723f2640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c15cb90 0x7f646c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023550140 0 0) 0x7f646c160a40 con 0x7f646c0b4640 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.729+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6458003520 con 0x7f646c0b4640 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.730+0000 7f6471bf1640 1 -- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c15cb90 msgr2=0x7f646c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.730+0000 7f6471bf1640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c15cb90 0x7f646c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.730+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084034569 0 0) 0x7f6458003520 con 0x7f646c0b4640 2023-08-10T10:43:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.730+0000 7f6471bf1640 1 -- 172.21.15.50:0/4051417015 >> v1:172.21.15.50:6789/0 conn(0x7f646c0b4640 legacy=0x7f646c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.730+0000 7f6471bf1640 1 -- 172.21.15.50:0/4051417015 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0b5170 con 0x7f646c15cf70 2023-08-10T10:43:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.731+0000 7f6471bf1640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cf70 0x7f646c160ed0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f645c0097a0 tx=0x7f645c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbd29acb1019f0e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.732+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640019f0 con 0x7f646c15cf70 2023-08-10T10:43:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.732+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c02e050 con 0x7f646c15cf70 2023-08-10T10:43:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.732+0000 7f64713f0640 1 -- 172.21.15.50:0/4051417015 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c030730 con 0x7f646c15cf70 2023-08-10T10:43:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.732+0000 7f6474656640 1 -- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cf70 msgr2=0x7f646c160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.732+0000 7f6474656640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cf70 0x7f646c160ed0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f645c0097a0 tx=0x7f645c02b790 comp rx=0 tx=0).stop 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 -- 172.21.15.50:0/4051417015 shutdown_connections 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cf70 0x7f646c160ed0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 --2- 172.21.15.50:0/4051417015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c15cb90 0x7f646c0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 -- 172.21.15.50:0/4051417015 >> 172.21.15.50:0/4051417015 conn(0x7f646c0cf640 msgr2=0x7f646c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 -- 172.21.15.50:0/4051417015 shutdown_connections 2023-08-10T10:43:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.733+0000 7f6474656640 1 -- 172.21.15.50:0/4051417015 wait complete. 2023-08-10T10:43:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.734+0000 7f6474656640 1 Processor -- start 2023-08-10T10:43:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.735+0000 7f6474656640 1 -- start start 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c0b4640 0x7f646c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cb90 0x7f646c15fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c7040 con 0x7f646c15cf70 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c73d0 con 0x7f646c15cb90 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6474656640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c15da40 con 0x7f646c0b4640 2023-08-10T10:43:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48400/0 (socket says 172.21.15.50:48400) 2023-08-10T10:43:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 -- 172.21.15.50:0/3503479845 learned_addr learned my addr 172.21.15.50:0/3503479845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f64723f2640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c0b4640 0x7f646c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6471bf1640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cb90 0x7f646c15fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 -- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c0b4640 msgr2=0x7f646c14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c0b4640 0x7f646c14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 -- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cb90 msgr2=0x7f646c15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cb90 0x7f646c15fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.736+0000 7f6472bf3640 1 -- 172.21.15.50:0/3503479845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009400 con 0x7f646c15cf70 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6472bf3640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6464001890 tx=0x7f646400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464012400 con 0x7f646c15cf70 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464012560 con 0x7f646c15cf70 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c14c3b0 con 0x7f646c15cf70 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464012910 con 0x7f646c15cf70 2023-08-10T10:43:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.737+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c15d760 con 0x7f646c15cf70 2023-08-10T10:43:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.738+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c0612b0 con 0x7f646c15cf70 2023-08-10T10:43:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.739+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6464012a70 con 0x7f646c15cf70 2023-08-10T10:43:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.740+0000 7f6462ffd640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 0x7f645006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.741+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6464089cd0 con 0x7f646c15cf70 2023-08-10T10:43:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.741+0000 7f64723f2640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 0x7f645006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.742+0000 7f64723f2640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 0x7f645006d110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6468009ad0 tx=0x7f6468008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.745+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6464054dd0 con 0x7f646c15cf70 2023-08-10T10:43:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:18.972+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f646c14c5f0 con 0x7f646c15cf70 2023-08-10T10:43:19.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.545+0000 7f6462ffd640 1 -- 172.21.15.50:0/3503479845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7f64640583f0 con 0x7f646c15cf70 2023-08-10T10:43:19.547 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 11 and data pool 12 2023-08-10T10:43:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.548+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 msgr2=0x7f645006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.548+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 0x7f645006d110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6468009ad0 tx=0x7f6468008040 comp rx=0 tx=0).stop 2023-08-10T10:43:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.548+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 msgr2=0x7f646c1e5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.548+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6464001890 tx=0x7f646400a430 comp rx=0 tx=0).stop 2023-08-10T10:43:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 shutdown_connections 2023-08-10T10:43:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f646c15cf70 0x7f646c1e5be0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f645006ac50 0x7f645006d110 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f646c15cb90 0x7f646c15fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 --2- 172.21.15.50:0/3503479845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f646c0b4640 0x7f646c14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 >> 172.21.15.50:0/3503479845 conn(0x7f646c0cf640 msgr2=0x7f646c0c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 shutdown_connections 2023-08-10T10:43:19.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.549+0000 7f6474656640 1 -- 172.21.15.50:0/3503479845 wait complete. 2023-08-10T10:43:19.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:19.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.776+0000 7f4270779640 1 Processor -- start 2023-08-10T10:43:19.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.777+0000 7f4270779640 1 -- start start 2023-08-10T10:43:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.778+0000 7f4270779640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f426815cd60 0x7f4268160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.778+0000 7f4270779640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f42680d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.778+0000 7f4270779640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4268161180 con 0x7f42680b8430 2023-08-10T10:43:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.778+0000 7f4270779640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42680b5bd0 con 0x7f426815cd60 2023-08-10T10:43:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.778+0000 7f4270779640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4268161460 con 0x7f42680cdf80 2023-08-10T10:43:19.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426dd14640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42680b8430 0x7f42680cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45994/0 (socket says 172.21.15.50:45994) 2023-08-10T10:43:19.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426dd14640 1 -- 172.21.15.50:0/2270004361 learned_addr learned my addr 172.21.15.50:0/2270004361 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426ed16640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f42680d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343778677 0 0) 0x7f4268161180 con 0x7f42680b8430 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426e515640 1 --2- 172.21.15.50:0/2270004361 >> v2:172.21.15.117:3300/0 conn(0x7f426815cd60 0x7f4268160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.779+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4254003520 con 0x7f42680b8430 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949136592 0 0) 0x7f4254003520 con 0x7f42680b8430 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 msgr2=0x7f42680d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f42680d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 >> v2:172.21.15.117:3300/0 conn(0x7f426815cd60 msgr2=0x7f4268160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 --2- 172.21.15.50:0/2270004361 >> v2:172.21.15.117:3300/0 conn(0x7f426815cd60 0x7f4268160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268161740 con 0x7f42680b8430 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4258001670 con 0x7f42680b8430 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 >> v1:172.21.15.50:6789/0 conn(0x7f42680b8430 legacy=0x7f42680cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4254003970 0x7f4254003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42540047c0 0x7f4254004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f4254005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680b5bd0 con 0x7f42540047c0 2023-08-10T10:43:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268161460 con 0x7f4254003970 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425400b9b0 con 0x7f42680cdf80 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426dd14640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42540047c0 0x7f4254004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426e515640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4254003970 0x7f4254003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426ed16640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f4254005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.780+0000 7f426dd14640 1 -- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 msgr2=0x7f4254005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.781+0000 7f426dd14640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42680cdf80 0x7f4254005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.781+0000 7f426dd14640 1 -- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4254003970 msgr2=0x7f4254003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:19.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.781+0000 7f426dd14640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4254003970 0x7f4254003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.781+0000 7f426dd14640 1 -- 172.21.15.50:0/2270004361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254003520 con 0x7f42540047c0 2023-08-10T10:43:19.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.782+0000 7f426dd14640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42540047c0 0x7f4254004c40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f425800c240 tx=0x7f42540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05f2bffcf09cc2b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:19.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.782+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425802cb00 con 0x7f42540047c0 2023-08-10T10:43:19.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.782+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425802cc60 con 0x7f42540047c0 2023-08-10T10:43:19.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.782+0000 7f426d513640 1 -- 172.21.15.50:0/2270004361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580058d0 con 0x7f42540047c0 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 -- 172.21.15.50:0/2270004361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42540047c0 msgr2=0x7f4254004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 --2- 172.21.15.50:0/2270004361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42540047c0 0x7f4254004c40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f425800c240 tx=0x7f42540057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f426ed16640 1 -- 172.21.15.50:0/2270004361 reap_dead start 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 -- 172.21.15.50:0/2270004361 shutdown_connections 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 -- 172.21.15.50:0/2270004361 >> 172.21.15.50:0/2270004361 conn(0x7f42680d2ac0 msgr2=0x7f42680d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 -- 172.21.15.50:0/2270004361 shutdown_connections 2023-08-10T10:43:19.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.783+0000 7f4270779640 1 -- 172.21.15.50:0/2270004361 wait complete. 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.785+0000 7f4270779640 1 Processor -- start 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.785+0000 7f4270779640 1 -- start start 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42540047c0 0x7f426815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42681542d0 0x7f42681f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680b2f10 con 0x7f42680b2550 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42681f23f0 con 0x7f42681542d0 2023-08-10T10:43:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f4270779640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426815f2d0 con 0x7f42540047c0 2023-08-10T10:43:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f426ed16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f426ed16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48406/0 (socket says 172.21.15.50:48406) 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f426ed16640 1 -- 172.21.15.50:0/1275982879 learned_addr learned my addr 172.21.15.50:0/1275982879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f426dd14640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42681542d0 0x7f42681f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.786+0000 7f426e515640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42540047c0 0x7f426815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 -- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42540047c0 msgr2=0x7f426815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42540047c0 0x7f426815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 -- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42681542d0 msgr2=0x7f42681f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42681542d0 0x7f42681f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 -- 172.21.15.50:0/1275982879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426815d840 con 0x7f42680b2550 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f426ed16640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4268074150 tx=0x7f42600115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000e070 con 0x7f42680b2550 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011db0 con 0x7f42680b2550 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260003990 con 0x7f42680b2550 2023-08-10T10:43:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.787+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426815db20 con 0x7f42680b2550 2023-08-10T10:43:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.788+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426815e0e0 con 0x7f42680b2550 2023-08-10T10:43:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.789+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4268066390 con 0x7f42680b2550 2023-08-10T10:43:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.790+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4260003af0 con 0x7f42680b2550 2023-08-10T10:43:19.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.791+0000 7f425effd640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 0x7f424c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.791+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4260089ad0 con 0x7f42680b2550 2023-08-10T10:43:19.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.791+0000 7f426e515640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 0x7f424c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.792+0000 7f426e515640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 0x7f424c06d110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4264009a10 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:19.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.795+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4260054ae0 con 0x7f42680b2550 2023-08-10T10:43:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.988+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42680b21f0 con 0x7f42680b2550 2023-08-10T10:43:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.991+0000 7f425effd640 1 -- 172.21.15.50:0/1275982879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18355 (secure 0 0 0) 0x7f4260058100 con 0x7f42680b2550 2023-08-10T10:43:19.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:19.994 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":91,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:18.975252+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:19.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 msgr2=0x7f424c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 0x7f424c06d110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4264009a10 tx=0x7f4264008040 comp rx=0 tx=0).stop 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 msgr2=0x7f42680b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4268074150 tx=0x7f42600115a0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 shutdown_connections 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680b2550 0x7f42680b29d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f424c06ac50 0x7f424c06d110 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42681542d0 0x7f42681f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 --2- 172.21.15.50:0/1275982879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42540047c0 0x7f426815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 >> 172.21.15.50:0/1275982879 conn(0x7f42680d2ac0 msgr2=0x7f42680b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 shutdown_connections 2023-08-10T10:43:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:19.994+0000 7f4270779640 1 -- 172.21.15.50:0/1275982879 wait complete. 2023-08-10T10:43:20.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:20.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.231+0000 7fbee1c6a640 1 Processor -- start 2023-08-10T10:43:20.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.232+0000 7fbee1c6a640 1 -- start start 2023-08-10T10:43:20.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.233+0000 7fbee1c6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbedc0696a0 0x7fbedc069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbee1c6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc15e1f0 con 0x7fbedc159970 2023-08-10T10:43:20.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbee1c6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc06a040 con 0x7fbedc0b1ae0 2023-08-10T10:43:20.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbee1c6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0b10d0 con 0x7fbedc0696a0 2023-08-10T10:43:20.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbedb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbedc159970 0x7fbedc0b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46000/0 (socket says 172.21.15.50:46000) 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbedb7fe640 1 -- 172.21.15.50:0/171741752 learned_addr learned my addr 172.21.15.50:0/171741752 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbed3fff640 1 --2- 172.21.15.50:0/171741752 >> v2:172.21.15.117:3300/0 conn(0x7fbedc0696a0 0x7fbedc069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.234+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761515079 0 0) 0x7fbedc15e1f0 con 0x7fbedc159970 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8003520 con 0x7fbedc159970 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 716941614 0 0) 0x7fbec8003520 con 0x7fbedc159970 2023-08-10T10:43:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 >> v2:172.21.15.117:3300/0 conn(0x7fbedc0696a0 msgr2=0x7fbedc069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 --2- 172.21.15.50:0/171741752 >> v2:172.21.15.117:3300/0 conn(0x7fbedc0696a0 0x7fbedc069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 >> v1:172.21.15.117:6789/0 conn(0x7fbedc0b1ae0 legacy=0x7fbedc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc15d5e0 con 0x7fbedc159970 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fbecc001690 con 0x7fbedc159970 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 >> v1:172.21.15.50:6789/0 conn(0x7fbedc159970 legacy=0x7fbedc0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbec8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec80047c0 0x7fbec8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec8005180 0x7fbec800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b10d0 con 0x7fbec8003970 2023-08-10T10:43:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800c020 con 0x7fbec80047c0 2023-08-10T10:43:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800c1e0 con 0x7fbec8005180 2023-08-10T10:43:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.235+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbec8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedb7fe640 1 -- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec8005180 msgr2=0x7fbec800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec8005180 0x7fbec800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedb7fe640 1 -- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec80047c0 msgr2=0x7fbec8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec80047c0 0x7fbec8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedb7fe640 1 -- 172.21.15.50:0/171741752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8003520 con 0x7fbec8003970 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.236+0000 7fbedbfff640 1 -- 172.21.15.50:0/171741752 reap_dead start 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.237+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbec8003d90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c210 tx=0x7fbec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cc2c8447ce0a68 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.237+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc005ad0 con 0x7fbec8003970 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.237+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc005c30 con 0x7fbec8003970 2023-08-10T10:43:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.237+0000 7fbedaffd640 1 -- 172.21.15.50:0/171741752 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02c870 con 0x7fbec8003970 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 -- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 msgr2=0x7fbec8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbec8003d90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c210 tx=0x7fbec80057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 -- 172.21.15.50:0/171741752 shutdown_connections 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/171741752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbec8003d90 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 -- 172.21.15.50:0/171741752 >> 172.21.15.50:0/171741752 conn(0x7fbedc06b590 msgr2=0x7fbedc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 -- 172.21.15.50:0/171741752 shutdown_connections 2023-08-10T10:43:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.238+0000 7fbee1c6a640 1 -- 172.21.15.50:0/171741752 wait complete. 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.240+0000 7fbee1c6a640 1 Processor -- start 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.240+0000 7fbee1c6a640 1 -- start start 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc0c5790 0x7fbedc0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc14bae0 0x7fbedc14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc14c4d0 con 0x7fbec8003970 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0c6d90 con 0x7fbedc0c5790 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbee1c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0c7070 con 0x7fbedc14bae0 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbedb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbedb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48418/0 (socket says 172.21.15.50:48418) 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.241+0000 7fbedb7fe640 1 -- 172.21.15.50:0/736777703 learned_addr learned my addr 172.21.15.50:0/736777703 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 -- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc14bae0 msgr2=0x7fbedc14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc14bae0 0x7fbedc14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 -- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc0c5790 msgr2=0x7fbedc0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc0c5790 0x7fbedc0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 -- 172.21.15.50:0/736777703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0c5f70 con 0x7fbec8003970 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbedb7fe640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c210 tx=0x7fbedc15e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc03c070 con 0x7fbec8003970 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc02ca80 con 0x7fbec8003970 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02ce30 con 0x7fbec8003970 2023-08-10T10:43:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.242+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0c6250 con 0x7fbec8003970 2023-08-10T10:43:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.243+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0c5c10 con 0x7fbec8003970 2023-08-10T10:43:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.244+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc04e270 con 0x7fbec8003970 2023-08-10T10:43:20.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.245+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbecc032070 con 0x7fbec8003970 2023-08-10T10:43:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.246+0000 7fbed8ff9640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 0x7fbebc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.246+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbecc0aa320 con 0x7fbec8003970 2023-08-10T10:43:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.246+0000 7fbed3fff640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 0x7fbebc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.247+0000 7fbed3fff640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 0x7fbebc06d110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbec4006e80 tx=0x7fbec4006dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.250+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbecc0753c0 con 0x7fbec8003970 2023-08-10T10:43:20.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.460+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbedc0b3160 con 0x7fbec8003970 2023-08-10T10:43:20.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.462+0000 7fbed8ff9640 1 -- 172.21.15.50:0/736777703 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18355 (secure 0 0 0) 0x7fbecc045090 con 0x7fbec8003970 2023-08-10T10:43:20.464 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:20.465 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":91,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:18.975252+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.465+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 msgr2=0x7fbebc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.465+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 0x7fbebc06d110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbec4006e80 tx=0x7fbec4006dd0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.465+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 msgr2=0x7fbedc14c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.465+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c210 tx=0x7fbedc15e160 comp rx=0 tx=0).stop 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 shutdown_connections 2023-08-10T10:43:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc14bae0 0x7fbedc14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbebc06ac50 0x7fbebc06d110 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc0c5790 0x7fbedc0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 --2- 172.21.15.50:0/736777703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbec8003970 0x7fbedc14c650 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 >> 172.21.15.50:0/736777703 conn(0x7fbedc06b590 msgr2=0x7fbedc0cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 shutdown_connections 2023-08-10T10:43:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.466+0000 7fbee1c6a640 1 -- 172.21.15.50:0/736777703 wait complete. 2023-08-10T10:43:20.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:43:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.711+0000 7fba1b45d640 1 Processor -- start 2023-08-10T10:43:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.711+0000 7fba1b45d640 1 -- start start 2023-08-10T10:43:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.712+0000 7fba1b45d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.712+0000 7fba1b45d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba14160370 con 0x7fba140d28b0 2023-08-10T10:43:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.712+0000 7fba1b45d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140d0d90 con 0x7fba140cd960 2023-08-10T10:43:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.712+0000 7fba1b45d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140d0b90 con 0x7fba1415ff90 2023-08-10T10:43:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1ac5c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba140d28b0 0x7fba140d2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46004/0 (socket says 172.21.15.50:46004) 2023-08-10T10:43:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1ac5c640 1 -- 172.21.15.50:0/2500644516 learned_addr learned my addr 172.21.15.50:0/2500644516 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1a45b640 1 --2- 172.21.15.50:0/2500644516 >> v2:172.21.15.50:3300/0 conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba19459640 1 -- 172.21.15.50:0/2500644516 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488628041 0 0) 0x7fba0c001110 con 0x7fba140d28b0 2023-08-10T10:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1a45b640 1 -- 172.21.15.50:0/2500644516 >> v1:172.21.15.117:6789/0 conn(0x7fba140cd960 legacy=0x7fba140d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1a45b640 1 -- 172.21.15.50:0/2500644516 >> v1:172.21.15.50:6789/0 conn(0x7fba140d28b0 legacy=0x7fba140d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.713+0000 7fba1a45b640 1 -- 172.21.15.50:0/2500644516 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140d1070 con 0x7fba1415ff90 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.715+0000 7fba1a45b640 1 --2- 172.21.15.50:0/2500644516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1415ff90 0x7fba14160f90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fba10009d90 tx=0x7fba1002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa8ac7ec5089fc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.715+0000 7fba19459640 1 -- 172.21.15.50:0/2500644516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1002ccf0 con 0x7fba1415ff90 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.715+0000 7fba19459640 1 -- 172.21.15.50:0/2500644516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1002ce50 con 0x7fba1415ff90 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.715+0000 7fba19459640 1 -- 172.21.15.50:0/2500644516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10034660 con 0x7fba1415ff90 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 -- 172.21.15.50:0/2500644516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1415ff90 msgr2=0x7fba14160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 --2- 172.21.15.50:0/2500644516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1415ff90 0x7fba14160f90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fba10009d90 tx=0x7fba1002bf40 comp rx=0 tx=0).stop 2023-08-10T10:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 -- 172.21.15.50:0/2500644516 shutdown_connections 2023-08-10T10:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 --2- 172.21.15.50:0/2500644516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 -- 172.21.15.50:0/2500644516 >> 172.21.15.50:0/2500644516 conn(0x7fba14069ac0 msgr2=0x7fba14069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 -- 172.21.15.50:0/2500644516 shutdown_connections 2023-08-10T10:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.716+0000 7fba1b45d640 1 -- 172.21.15.50:0/2500644516 wait complete. 2023-08-10T10:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.717+0000 7fba1b45d640 1 Processor -- start 2023-08-10T10:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.718+0000 7fba1b45d640 1 -- start start 2023-08-10T10:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 0x7fba141e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ff90 0x7fba140c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c5d20 con 0x7fba140cd960 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14142800 con 0x7fba140d28b0 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1b45d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba141e6550 con 0x7fba1415ff90 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48444/0 (socket says 172.21.15.50:48444) 2023-08-10T10:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 -- 172.21.15.50:0/4167421718 learned_addr learned my addr 172.21.15.50:0/4167421718 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba19c5a640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 0x7fba141e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1ac5c640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ff90 0x7fba140c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 -- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ff90 msgr2=0x7fba140c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ff90 0x7fba140c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 -- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 msgr2=0x7fba141e5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 0x7fba141e5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba1a45b640 1 -- 172.21.15.50:0/4167421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10009a70 con 0x7fba140cd960 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.719+0000 7fba19c5a640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 0x7fba141e5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba1a45b640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fba1002dfd0 tx=0x7fba10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10003b90 con 0x7fba140cd960 2023-08-10T10:43:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10003cf0 con 0x7fba140cd960 2023-08-10T10:43:20.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10004260 con 0x7fba140cd960 2023-08-10T10:43:20.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14142aa0 con 0x7fba140cd960 2023-08-10T10:43:20.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.720+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba14143060 con 0x7fba140cd960 2023-08-10T10:43:20.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.721+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14066e30 con 0x7fba140cd960 2023-08-10T10:43:20.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.722+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba1003b050 con 0x7fba140cd960 2023-08-10T10:43:20.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.723+0000 7fba0affd640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 0x7fb9f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:20.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.723+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba100abce0 con 0x7fba140cd960 2023-08-10T10:43:20.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.723+0000 7fba19c5a640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 0x7fb9f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:20.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.724+0000 7fba19c5a640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 0x7fb9f806d110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba140cc990 tx=0x7fba04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:20.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.727+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fba10076d90 con 0x7fba140cd960 2023-08-10T10:43:20.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:20.958+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fba140d05c0 con 0x7fba140cd960 2023-08-10T10:43:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.560+0000 7fba0affd640 1 -- 172.21.15.50:0/4167421718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7fba100390b0 con 0x7fba140cd960 2023-08-10T10:43:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 msgr2=0x7fb9f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 0x7fb9f806d110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba140cc990 tx=0x7fba04009040 comp rx=0 tx=0).stop 2023-08-10T10:43:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 msgr2=0x7fba140cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fba1002dfd0 tx=0x7fba10004a40 comp rx=0 tx=0).stop 2023-08-10T10:43:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 shutdown_connections 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ff90 0x7fba140c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f806ac50 0x7fb9f806d110 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba140d28b0 0x7fba141e5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 --2- 172.21.15.50:0/4167421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cd960 0x7fba140cb640 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 >> 172.21.15.50:0/4167421718 conn(0x7fba14069ac0 msgr2=0x7fba140ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.564+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 shutdown_connections 2023-08-10T10:43:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.565+0000 7fba1b45d640 1 -- 172.21.15.50:0/4167421718 wait complete. 2023-08-10T10:43:21.588 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:43:21.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:43:21.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.821+0000 7fc49141c640 1 Processor -- start 2023-08-10T10:43:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.821+0000 7fc49141c640 1 -- start start 2023-08-10T10:43:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.822+0000 7fc49141c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc48c0cd960 0x7fc48c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.822+0000 7fc49141c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc48c0d28b0 0x7fc48c0d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc49141c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c160370 con 0x7fc48c15ff90 2023-08-10T10:43:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc49141c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0d0b90 con 0x7fc48c0cd960 2023-08-10T10:43:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc49141c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c1614d0 con 0x7fc48c0d28b0 2023-08-10T10:43:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc48c0cd960 0x7fc48c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc48c0cd960 0x7fc48c160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48452/0 (socket says 172.21.15.50:48452) 2023-08-10T10:43:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 -- 172.21.15.50:0/195410427 learned_addr learned my addr 172.21.15.50:0/195410427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc490c1b640 1 --2- 172.21.15.50:0/195410427 >> v2:172.21.15.117:3300/0 conn(0x7fc48c0d28b0 0x7fc48c0d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 -- 172.21.15.50:0/195410427 >> v2:172.21.15.117:3300/0 conn(0x7fc48c0d28b0 msgr2=0x7fc48c0d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 --2- 172.21.15.50:0/195410427 >> v2:172.21.15.117:3300/0 conn(0x7fc48c0d28b0 0x7fc48c0d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.823+0000 7fc48b7fe640 1 -- 172.21.15.50:0/195410427 >> v1:172.21.15.117:6789/0 conn(0x7fc48c15ff90 legacy=0x7fc48c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.824+0000 7fc48b7fe640 1 -- 172.21.15.50:0/195410427 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0d3200 con 0x7fc48c0cd960 2023-08-10T10:43:21.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.825+0000 7fc48b7fe640 1 --2- 172.21.15.50:0/195410427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c160f90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0d0260 tx=0x7fc48002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c2f20f6039aa12 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:21.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.825+0000 7fc48affd640 1 -- 172.21.15.50:0/195410427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48002ca80 con 0x7fc48c0cd960 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.825+0000 7fc48affd640 1 -- 172.21.15.50:0/195410427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48002cbe0 con 0x7fc48c0cd960 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.825+0000 7fc48affd640 1 -- 172.21.15.50:0/195410427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800343f0 con 0x7fc48c0cd960 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 -- 172.21.15.50:0/195410427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 msgr2=0x7fc48c160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 --2- 172.21.15.50:0/195410427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c160f90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0d0260 tx=0x7fc48002bee0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 -- 172.21.15.50:0/195410427 shutdown_connections 2023-08-10T10:43:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 --2- 172.21.15.50:0/195410427 >> v2:172.21.15.117:3300/0 conn(0x7fc48c0d28b0 0x7fc48c0d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 --2- 172.21.15.50:0/195410427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c160f90 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 -- 172.21.15.50:0/195410427 >> 172.21.15.50:0/195410427 conn(0x7fc48c069ac0 msgr2=0x7fc48c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 -- 172.21.15.50:0/195410427 shutdown_connections 2023-08-10T10:43:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.826+0000 7fc49141c640 1 -- 172.21.15.50:0/195410427 wait complete. 2023-08-10T10:43:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.828+0000 7fc49141c640 1 Processor -- start 2023-08-10T10:43:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.828+0000 7fc49141c640 1 -- start start 2023-08-10T10:43:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc48c0d28b0 0x7fc48c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 0x7fc48c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b26c0 con 0x7fc48c0cd960 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cbb20 con 0x7fc48c0d28b0 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc49141c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cbe00 con 0x7fc48c15ff90 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc48bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc48bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48464/0 (socket says 172.21.15.50:48464) 2023-08-10T10:43:21.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc48bfff640 1 -- 172.21.15.50:0/161339398 learned_addr learned my addr 172.21.15.50:0/161339398 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:21.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc48b7fe640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc48c0d28b0 0x7fc48c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.830+0000 7fc490c1b640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 0x7fc48c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 -- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 msgr2=0x7fc48c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 0x7fc48c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 -- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc48c0d28b0 msgr2=0x7fc48c0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc48c0d28b0 0x7fc48c0cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 -- 172.21.15.50:0/161339398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480009b30 con 0x7fc48c0cd960 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc490c1b640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 0x7fc48c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc48bfff640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b3f0 tx=0x7fc47c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c011830 con 0x7fc48c0cd960 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c011990 con 0x7fc48c0cd960 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c011d40 con 0x7fc48c0cd960 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0b2350 con 0x7fc48c0cd960 2023-08-10T10:43:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.831+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c1f5a70 con 0x7fc48c0cd960 2023-08-10T10:43:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.833+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c066e30 con 0x7fc48c0cd960 2023-08-10T10:43:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.834+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc47c01a400 con 0x7fc48c0cd960 2023-08-10T10:43:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.835+0000 7fc488ff9640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 0x7fc47806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.835+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc47c089340 con 0x7fc48c0cd960 2023-08-10T10:43:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.835+0000 7fc48b7fe640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 0x7fc47806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.836+0000 7fc48b7fe640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 0x7fc47806d110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc480035000 tx=0x7fc480030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:21.840+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc47c0543e0 con 0x7fc48c0cd960 2023-08-10T10:43:22.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.073+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc48c0d05c0 con 0x7fc48c0cd960 2023-08-10T10:43:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.575+0000 7fc488ff9640 1 -- 172.21.15.50:0/161339398 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc47c057a00 con 0x7fc48c0cd960 2023-08-10T10:43:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.578+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 msgr2=0x7fc47806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.578+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 0x7fc47806d110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc480035000 tx=0x7fc480030000 comp rx=0 tx=0).stop 2023-08-10T10:43:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.578+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 msgr2=0x7fc48c1f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.578+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b3f0 tx=0x7fc47c00b8b0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 shutdown_connections 2023-08-10T10:43:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc48c15ff90 0x7fc48c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc47806ac50 0x7fc47806d110 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc48c0d28b0 0x7fc48c0cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 --2- 172.21.15.50:0/161339398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48c0cd960 0x7fc48c1f1aa0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 >> 172.21.15.50:0/161339398 conn(0x7fc48c069ac0 msgr2=0x7fc48c15dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 shutdown_connections 2023-08-10T10:43:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.579+0000 7fc49141c640 1 -- 172.21.15.50:0/161339398 wait complete. 2023-08-10T10:43:22.601 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:43:22.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.830+0000 7f4cd98fb640 1 Processor -- start 2023-08-10T10:43:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.830+0000 7f4cd98fb640 1 -- start start 2023-08-10T10:43:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd98fb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd40c9d00 0x7f4cd40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd98fb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cd40cd290 0x7f4cd40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd98fb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd40cc5a0 con 0x7f4cd4159830 2023-08-10T10:43:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd98fb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd40b4170 con 0x7f4cd40cd290 2023-08-10T10:43:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd98fb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd415d720 con 0x7f4cd40c9d00 2023-08-10T10:43:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd88f9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4cd4159830 0x7f4cd415dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46018/0 (socket says 172.21.15.50:46018) 2023-08-10T10:43:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd88f9640 1 -- 172.21.15.50:0/362249910 learned_addr learned my addr 172.21.15.50:0/362249910 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.832+0000 7f4cd90fa640 1 --2- 172.21.15.50:0/362249910 >> v2:172.21.15.50:3300/0 conn(0x7f4cd40cd290 0x7f4cd40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd3fff640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd40c9d00 0x7f4cd40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd37fe640 1 -- 172.21.15.50:0/362249910 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174513669 0 0) 0x7f4cd40cc5a0 con 0x7f4cd4159830 2023-08-10T10:43:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd37fe640 1 -- 172.21.15.50:0/362249910 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4005730 con 0x7f4cd4159830 2023-08-10T10:43:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd90fa640 1 -- 172.21.15.50:0/362249910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd40c9d00 msgr2=0x7f4cd40cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd90fa640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd40c9d00 0x7f4cd40cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd90fa640 1 -- 172.21.15.50:0/362249910 >> v1:172.21.15.50:6789/0 conn(0x7f4cd4159830 legacy=0x7f4cd415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.833+0000 7f4cd90fa640 1 -- 172.21.15.50:0/362249910 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40cdc20 con 0x7f4cd40cd290 2023-08-10T10:43:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.834+0000 7f4cd90fa640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40cd6e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009d90 tx=0x7f4ccc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5da1f208f3166e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd37fe640 1 -- 172.21.15.50:0/362249910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc02cc60 con 0x7f4cd40cd290 2023-08-10T10:43:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd37fe640 1 -- 172.21.15.50:0/362249910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc02cdc0 con 0x7f4cd40cd290 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd37fe640 1 -- 172.21.15.50:0/362249910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc034640 con 0x7f4cd40cd290 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 -- 172.21.15.50:0/362249910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 msgr2=0x7f4cd40cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40cd6e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009d90 tx=0x7f4ccc02beb0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 -- 172.21.15.50:0/362249910 shutdown_connections 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40cd6e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/362249910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd40c9d00 0x7f4cd40cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.835+0000 7f4cd98fb640 1 -- 172.21.15.50:0/362249910 >> 172.21.15.50:0/362249910 conn(0x7f4cd406ab80 msgr2=0x7f4cd406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.836+0000 7f4cd98fb640 1 -- 172.21.15.50:0/362249910 shutdown_connections 2023-08-10T10:43:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.836+0000 7f4cd98fb640 1 -- 172.21.15.50:0/362249910 wait complete. 2023-08-10T10:43:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.837+0000 7f4cd98fb640 1 Processor -- start 2023-08-10T10:43:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.837+0000 7f4cd98fb640 1 -- start start 2023-08-10T10:43:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.838+0000 7f4cd98fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd40c9d00 0x7f4cd41f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.838+0000 7f4cd98fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd98fb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd4159830 0x7f4cd40acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd98fb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41f3210 con 0x7f4cd40cd290 2023-08-10T10:43:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd98fb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41f2f30 con 0x7f4cd40c9d00 2023-08-10T10:43:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd98fb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd415b200 con 0x7f4cd4159830 2023-08-10T10:43:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48494/0 (socket says 172.21.15.50:48494) 2023-08-10T10:43:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 -- 172.21.15.50:0/3064544761 learned_addr learned my addr 172.21.15.50:0/3064544761 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd88f9640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd40c9d00 0x7f4cd41f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 -- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd4159830 msgr2=0x7f4cd40acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd4159830 0x7f4cd40acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 -- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd40c9d00 msgr2=0x7f4cd41f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd40c9d00 0x7f4cd41f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.839+0000 7f4cd3fff640 1 -- 172.21.15.50:0/3064544761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009a70 con 0x7f4cd40cd290 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd3fff640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000d5f0 tx=0x7f4cc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00125f0 con 0x7f4cd40cd290 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0012750 con 0x7f4cd40cd290 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0012b00 con 0x7f4cd40cd290 2023-08-10T10:43:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd415b4e0 con 0x7f4cd40cd290 2023-08-10T10:43:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.840+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd41f3390 con 0x7f4cd40cd290 2023-08-10T10:43:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.841+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd415b060 con 0x7f4cd40cd290 2023-08-10T10:43:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.842+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cc0012c60 con 0x7f4cd40cd290 2023-08-10T10:43:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.843+0000 7f4cd17fa640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 0x7f4cb806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.843+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4cc0089a50 con 0x7f4cd40cd290 2023-08-10T10:43:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.843+0000 7f4cd88f9640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 0x7f4cb806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.844+0000 7f4cd88f9640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 0x7f4cb806d110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80011e0 tx=0x7f4cc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:22.848+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4cd415b060 con 0x7f4cd40cd290 2023-08-10T10:43:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.083+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cd415b060 con 0x7f4cd40cd290 2023-08-10T10:43:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.084+0000 7f4cd17fa640 1 -- 172.21.15.50:0/3064544761 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4cd415b060 con 0x7f4cd40cd290 2023-08-10T10:43:23.086 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:23.086 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:43:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:43:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 msgr2=0x7f4cb806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 0x7f4cb806d110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80011e0 tx=0x7f4cc8009040 comp rx=0 tx=0).stop 2023-08-10T10:43:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 msgr2=0x7f4cd40ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000d5f0 tx=0x7f4cc000dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 shutdown_connections 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd4159830 0x7f4cd40acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cd40cd290 0x7f4cd40ac890 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4cb806ac50 0x7f4cb806d110 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 --2- 172.21.15.50:0/3064544761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd40c9d00 0x7f4cd41f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 >> 172.21.15.50:0/3064544761 conn(0x7f4cd406ab80 msgr2=0x7f4cd40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.087+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 shutdown_connections 2023-08-10T10:43:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.088+0000 7f4cd98fb640 1 -- 172.21.15.50:0/3064544761 wait complete. 2023-08-10T10:43:23.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:43:23.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.335+0000 7f17dec06640 1 Processor -- start 2023-08-10T10:43:23.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.336+0000 7f17dec06640 1 -- start start 2023-08-10T10:43:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.337+0000 7f17dec06640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17d80b3010 0x7f17d80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.337+0000 7f17dec06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 0x7f17d8069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.337+0000 7f17dec06640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80719f0 con 0x7f17d815ccb0 2023-08-10T10:43:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.337+0000 7f17dec06640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d80c8db0 con 0x7f17d80b3010 2023-08-10T10:43:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.337+0000 7f17dec06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80c9050 con 0x7f17d80c9b30 2023-08-10T10:43:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17dc9a2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17d815ccb0 0x7f17d80b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46032/0 (socket says 172.21.15.50:46032) 2023-08-10T10:43:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17dc9a2640 1 -- 172.21.15.50:0/2724031783 learned_addr learned my addr 172.21.15.50:0/2724031783 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17dd1a3640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 0x7f17d8069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17cffff640 1 --2- 172.21.15.50:0/2724031783 >> v2:172.21.15.117:3300/0 conn(0x7f17d80b3010 0x7f17d80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192698709 0 0) 0x7f17d80719f0 con 0x7f17d815ccb0 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.338+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c0003520 con 0x7f17d815ccb0 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137914044 0 0) 0x7f17c0003520 con 0x7f17d815ccb0 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 msgr2=0x7f17d8069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 0x7f17d8069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 >> v2:172.21.15.117:3300/0 conn(0x7f17d80b3010 msgr2=0x7f17d80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 --2- 172.21.15.50:0/2724031783 >> v2:172.21.15.117:3300/0 conn(0x7f17d80b3010 0x7f17d80696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80c9330 con 0x7f17d815ccb0 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f17d4001670 con 0x7f17d815ccb0 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 >> v1:172.21.15.50:6789/0 conn(0x7f17d815ccb0 legacy=0x7f17d80b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 0x7f17c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17c0004d00 0x7f17c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80c8db0 con 0x7f17c0003970 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80c9050 con 0x7f17c0004d00 2023-08-10T10:43:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c000b980 con 0x7f17d80c9b30 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17cffff640 1 --2- 172.21.15.50:0/2724031783 >> v2:172.21.15.117:3300/0 conn(0x7f17d80b3010 0x7f17d80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 -- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 msgr2=0x7f17c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d80c9b30 0x7f17c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 -- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17c0004d00 msgr2=0x7f17c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dd1a3640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17c0004d00 0x7f17c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17c0004d00 0x7f17c0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.339+0000 7f17dc9a2640 1 -- 172.21.15.50:0/2724031783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0003520 con 0x7f17c0003970 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17c0003d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c270 tx=0x7f17c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2975389cf812c65 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d402cae0 con 0x7f17c0003970 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d402cc40 con 0x7f17c0003970 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17cf7fe640 1 -- 172.21.15.50:0/2724031783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40058d0 con 0x7f17c0003970 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17dec06640 1 -- 172.21.15.50:0/2724031783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 msgr2=0x7f17c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17dec06640 1 --2- 172.21.15.50:0/2724031783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17c0003d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c270 tx=0x7f17c00057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.341+0000 7f17dd1a3640 1 -- 172.21.15.50:0/2724031783 reap_dead start 2023-08-10T10:43:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.342+0000 7f17dec06640 1 -- 172.21.15.50:0/2724031783 shutdown_connections 2023-08-10T10:43:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.342+0000 7f17dec06640 1 -- 172.21.15.50:0/2724031783 >> 172.21.15.50:0/2724031783 conn(0x7f17d806b590 msgr2=0x7f17d80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.342+0000 7f17dec06640 1 -- 172.21.15.50:0/2724031783 shutdown_connections 2023-08-10T10:43:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.342+0000 7f17dec06640 1 -- 172.21.15.50:0/2724031783 wait complete. 2023-08-10T10:43:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.344+0000 7f17dec06640 1 Processor -- start 2023-08-10T10:43:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.344+0000 7f17dec06640 1 -- start start 2023-08-10T10:43:23.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 0x7f17d8143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 0x7f17d81f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8143e20 con 0x7f17c0003970 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d81f6ac0 con 0x7f17d80c71b0 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dec06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80c6110 con 0x7f17d81439a0 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dc9a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dc9a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48512/0 (socket says 172.21.15.50:48512) 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.345+0000 7f17dc9a2640 1 -- 172.21.15.50:0/696178245 learned_addr learned my addr 172.21.15.50:0/696178245 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17cffff640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 0x7f17d8143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dd1a3640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 0x7f17d81f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 -- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 msgr2=0x7f17d81f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 0x7f17d81f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 -- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 msgr2=0x7f17d8143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 0x7f17d8143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 -- 172.21.15.50:0/696178245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80c63f0 con 0x7f17c0003970 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17cffff640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 0x7f17d8143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dd1a3640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 0x7f17d81f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dc9a2640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c270 tx=0x7f17d4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4039030 con 0x7f17c0003970 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4004bf0 con 0x7f17c0003970 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d403c040 con 0x7f17c0003970 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.346+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d80c66d0 con 0x7f17c0003970 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.347+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d80c6c90 con 0x7f17c0003970 2023-08-10T10:43:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.348+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d804e270 con 0x7f17c0003970 2023-08-10T10:43:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.349+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17d4032070 con 0x7f17c0003970 2023-08-10T10:43:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.351+0000 7f17cd7fa640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 0x7f17c406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.351+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17d40aa8f0 con 0x7f17c0003970 2023-08-10T10:43:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.351+0000 7f17cffff640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 0x7f17c406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.352+0000 7f17cffff640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 0x7f17c406d140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.356+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f17d4075900 con 0x7f17c0003970 2023-08-10T10:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.548+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17d80b2420 con 0x7f17c0003970 2023-08-10T10:43:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.552+0000 7f17cd7fa640 1 -- 172.21.15.50:0/696178245 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f17d4078f20 con 0x7f17c0003970 2023-08-10T10:43:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:23.554 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":92,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:20.506863+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 msgr2=0x7f17c406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 0x7f17c406d140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8008040 comp rx=0 tx=0).stop 2023-08-10T10:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 msgr2=0x7f17d81f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c270 tx=0x7f17d4001a00 comp rx=0 tx=0).stop 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 shutdown_connections 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17d81439a0 0x7f17d81f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f17c406ac80 0x7f17c406d140 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d80c71b0 0x7f17d8143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 --2- 172.21.15.50:0/696178245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c0003970 0x7f17d81f6580 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.554+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 >> 172.21.15.50:0/696178245 conn(0x7f17d806b590 msgr2=0x7f17d80696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.555+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 shutdown_connections 2023-08-10T10:43:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.555+0000 7f17dec06640 1 -- 172.21.15.50:0/696178245 wait complete. 2023-08-10T10:43:23.576 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:43:23.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:43:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.803+0000 7f5069122640 1 Processor -- start 2023-08-10T10:43:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.803+0000 7f5069122640 1 -- start start 2023-08-10T10:43:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.804+0000 7f5069122640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5064159830 0x7f50640cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5069122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c9d00 0x7f506415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5069122640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640cc5a0 con 0x7f506415e0f0 2023-08-10T10:43:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5069122640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50640b4170 con 0x7f5064159830 2023-08-10T10:43:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5069122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506415d720 con 0x7f50640c9d00 2023-08-10T10:43:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5063fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5064159830 0x7f50640cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5063fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5064159830 0x7f50640cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:34892/0 (socket says 172.21.15.50:34892) 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f5063fff640 1 -- 172.21.15.50:0/1567714156 learned_addr learned my addr 172.21.15.50:0/1567714156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.805+0000 7f505bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c9d00 0x7f506415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.806+0000 7f5063fff640 1 -- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c9d00 msgr2=0x7f506415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.806+0000 7f5063fff640 1 --2- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c9d00 0x7f506415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.806+0000 7f5063fff640 1 -- 172.21.15.50:0/1567714156 >> v1:172.21.15.117:6789/0 conn(0x7f506415e0f0 legacy=0x7f50640cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.806+0000 7f5063fff640 1 -- 172.21.15.50:0/1567714156 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064159c10 con 0x7f5064159830 2023-08-10T10:43:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.808+0000 7f5063fff640 1 --2- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5064159830 0x7f50640cc060 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5054009870 tx=0x7f505402db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428884621735b52c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.808+0000 7f50637fe640 1 -- 172.21.15.50:0/1567714156 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505402e940 con 0x7f5064159830 2023-08-10T10:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.808+0000 7f50637fe640 1 -- 172.21.15.50:0/1567714156 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505402eaa0 con 0x7f5064159830 2023-08-10T10:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.808+0000 7f50637fe640 1 -- 172.21.15.50:0/1567714156 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505402ee30 con 0x7f5064159830 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 -- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5064159830 msgr2=0x7f50640cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 --2- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5064159830 0x7f50640cc060 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5054009870 tx=0x7f505402db90 comp rx=0 tx=0).stop 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 -- 172.21.15.50:0/1567714156 shutdown_connections 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 --2- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c9d00 0x7f506415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 --2- 172.21.15.50:0/1567714156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5064159830 0x7f50640cc060 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 -- 172.21.15.50:0/1567714156 >> 172.21.15.50:0/1567714156 conn(0x7f506406ab80 msgr2=0x7f506406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 -- 172.21.15.50:0/1567714156 shutdown_connections 2023-08-10T10:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.809+0000 7f5069122640 1 -- 172.21.15.50:0/1567714156 wait complete. 2023-08-10T10:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.811+0000 7f5069122640 1 Processor -- start 2023-08-10T10:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.811+0000 7f5069122640 1 -- start start 2023-08-10T10:43:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 0x7f506415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 0x7f50640ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506415c6e0 con 0x7f50640c9d00 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506415ba60 con 0x7f506415b4a0 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5069122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506415bd40 con 0x7f5064159830 2023-08-10T10:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5063fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5063fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48518/0 (socket says 172.21.15.50:48518) 2023-08-10T10:43:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.812+0000 7f5063fff640 1 -- 172.21.15.50:0/3527104537 learned_addr learned my addr 172.21.15.50:0/3527104537 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5068921640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 0x7f50640ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f505bfff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 0x7f506415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 -- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 msgr2=0x7f506415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 0x7f506415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 -- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 msgr2=0x7f50640ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 0x7f50640ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 -- 172.21.15.50:0/3527104537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540094d0 con 0x7f50640c9d00 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5068921640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 0x7f50640ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f505bfff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 0x7f506415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.813+0000 7f5063fff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5054000c00 tx=0x7f50540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.814+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054040600 con 0x7f50640c9d00 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.814+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5054040760 con 0x7f50640c9d00 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.814+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054040b10 con 0x7f50640c9d00 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.814+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506415c020 con 0x7f50640c9d00 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.814+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5064155370 con 0x7f50640c9d00 2023-08-10T10:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.815+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5064066e30 con 0x7f50640c9d00 2023-08-10T10:43:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.816+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5054040c70 con 0x7f50640c9d00 2023-08-10T10:43:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.817+0000 7f50617fa640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 0x7f504406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.817+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50540abe80 con 0x7f50640c9d00 2023-08-10T10:43:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.817+0000 7f505bfff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 0x7f504406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.818+0000 7f505bfff640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 0x7f504406d140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f50640b3b40 tx=0x7f504c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:23.822+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5054076fb0 con 0x7f50640c9d00 2023-08-10T10:43:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.013+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50640ccab0 con 0x7f504406ac80 2023-08-10T10:43:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.030+0000 7f50617fa640 1 -- 172.21.15.50:0/3527104537 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293200 (secure 0 0 0) 0x7f504c004030 con 0x7f504406ac80 2023-08-10T10:43:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:43:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 msgr2=0x7f504406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 0x7f504406d140 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f50640b3b40 tx=0x7f504c008040 comp rx=0 tx=0).stop 2023-08-10T10:43:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 msgr2=0x7f5064154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5054000c00 tx=0x7f50540046c0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 shutdown_connections 2023-08-10T10:43:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f504406ac80 0x7f504406d140 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506415b4a0 0x7f50640ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5064159830 0x7f506415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 --2- 172.21.15.50:0/3527104537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c9d00 0x7f5064154e30 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 >> 172.21.15.50:0/3527104537 conn(0x7f506406ab80 msgr2=0x7f50640ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:24.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 shutdown_connections 2023-08-10T10:43:24.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.036+0000 7f5069122640 1 -- 172.21.15.50:0/3527104537 wait complete. 2023-08-10T10:43:24.058 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2023-08-10T10:43:22.424020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5103,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557396,"statfs":{"total":1600000000,"available":1594774070,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.958631"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.476078+0000","last_change":"2023-08-10T10:43:17.476078+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.476078+0000","last_undegraded":"2023-08-10T10:43:17.476078+0000","last_fullsized":"2023-08-10T10:43:17.476078+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.475661+0000","last_change":"2023-08-10T10:43:17.475661+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.475661+0000","last_undegraded":"2023-08-10T10:43:17.475661+0000","last_fullsized":"2023-08-10T10:43:17.475661+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474800+0000","last_change":"2023-08-10T10:43:17.474800+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474800+0000","last_undegraded":"2023-08-10T10:43:17.474800+0000","last_fullsized":"2023-08-10T10:43:17.474800+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474910+0000","last_change":"2023-08-10T10:43:17.474910+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474910+0000","last_undegraded":"2023-08-10T10:43:17.474910+0000","last_fullsized":"2023-08-10T10:43:17.474910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.468043+0000","last_change":"2023-08-10T10:43:17.468043+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.468043+0000","last_undegraded":"2023-08-10T10:43:17.468043+0000","last_fullsized":"2023-08-10T10:43:17.468043+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.472098+0000","last_change":"2023-08-10T10:43:17.472098+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.472098+0000","last_undegraded":"2023-08-10T10:43:17.472098+0000","last_fullsized":"2023-08-10T10:43:17.472098+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.477599+0000","last_change":"2023-08-10T10:43:17.477599+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.477599+0000","last_undegraded":"2023-08-10T10:43:17.477599+0000","last_fullsized":"2023-08-10T10:43:17.477599+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474611+0000","last_change":"2023-08-10T10:43:17.474611+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474611+0000","last_undegraded":"2023-08-10T10:43:17.474611+0000","last_fullsized":"2023-08-10T10:43:17.474611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.472661+0000","last_change":"2023-08-10T10:43:17.472661+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.472661+0000","last_undegraded":"2023-08-10T10:43:17.472661+0000","last_fullsized":"2023-08-10T10:43:17.472661+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471760+0000","last_change":"2023-08-10T10:43:17.471760+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471760+0000","last_undegraded":"2023-08-10T10:43:17.471760+0000","last_fullsized":"2023-08-10T10:43:17.471760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474545+0000","last_change":"2023-08-10T10:43:17.474545+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474545+0000","last_undegraded":"2023-08-10T10:43:17.474545+0000","last_fullsized":"2023-08-10T10:43:17.474545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.473107+0000","last_change":"2023-08-10T10:43:17.473107+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.473107+0000","last_undegraded":"2023-08-10T10:43:17.473107+0000","last_fullsized":"2023-08-10T10:43:17.473107+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.469899+0000","last_change":"2023-08-10T10:43:17.469899+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.469899+0000","last_undegraded":"2023-08-10T10:43:17.469899+0000","last_fullsized":"2023-08-10T10:43:17.469899+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471623+0000","last_change":"2023-08-10T10:43:17.471623+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471623+0000","last_undegraded":"2023-08-10T10:43:17.471623+0000","last_fullsized":"2023-08-10T10:43:17.471623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474683+0000","last_change":"2023-08-10T10:43:17.474683+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474683+0000","last_undegraded":"2023-08-10T10:43:17.474683+0000","last_fullsized":"2023-08-10T10:43:17.474683+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.478494+0000","last_change":"2023-08-10T10:43:17.478494+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.478494+0000","last_undegraded":"2023-08-10T10:43:17.478494+0000","last_fullsized":"2023-08-10T10:43:17.478494+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.470056+0000","last_change":"2023-08-10T10:43:17.470056+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.470056+0000","last_undegraded":"2023-08-10T10:43:17.470056+0000","last_fullsized":"2023-08-10T10:43:17.470056+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.477660+0000","last_change":"2023-08-10T10:43:17.477660+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.477660+0000","last_undegraded":"2023-08-10T10:43:17.477660+0000","last_fullsized":"2023-08-10T10:43:17.477660+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471428+0000","last_change":"2023-08-10T10:43:17.471428+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471428+0000","last_undegraded":"2023-08-10T10:43:17.471428+0000","last_fullsized":"2023-08-10T10:43:17.471428+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.473622+0000","last_change":"2023-08-10T10:43:17.473622+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.473622+0000","last_undegraded":"2023-08-10T10:43:17.473622+0000","last_fullsized":"2023-08-10T10:43:17.473622+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474048+0000","last_change":"2023-08-10T10:43:17.474048+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474048+0000","last_undegraded":"2023-08-10T10:43:17.474048+0000","last_fullsized":"2023-08-10T10:43:17.474048+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474152+0000","last_change":"2023-08-10T10:43:17.474152+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474152+0000","last_undegraded":"2023-08-10T10:43:17.474152+0000","last_fullsized":"2023-08-10T10:43:17.474152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.472454+0000","last_change":"2023-08-10T10:43:17.472454+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.472454+0000","last_undegraded":"2023-08-10T10:43:17.472454+0000","last_fullsized":"2023-08-10T10:43:17.472454+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.472123+0000","last_change":"2023-08-10T10:43:17.472123+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.472123+0000","last_undegraded":"2023-08-10T10:43:17.472123+0000","last_fullsized":"2023-08-10T10:43:17.472123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471460+0000","last_change":"2023-08-10T10:43:17.471460+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471460+0000","last_undegraded":"2023-08-10T10:43:17.471460+0000","last_fullsized":"2023-08-10T10:43:17.471460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.478438+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:43:17.478438+0000","last_peered":"2023-08-10T10:43:17.478438+0000","last_clean":"2023-08-10T10:43:17.478438+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:43:17.478438+0000","last_undegraded":"2023-08-10T10:43:17.478438+0000","last_fullsized":"2023-08-10T10:43:17.478438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:54.830202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.467845+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:43:17.467845+0000","last_peered":"2023-08-10T10:43:17.467845+0000","last_clean":"2023-08-10T10:43:17.467845+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:43:17.467845+0000","last_undegraded":"2023-08-10T10:43:17.467845+0000","last_fullsized":"2023-08-10T10:43:17.467845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:38:19.651592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471889+0000","last_change":"2023-08-10T10:43:17.471889+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471889+0000","last_undegraded":"2023-08-10T10:43:17.471889+0000","last_fullsized":"2023-08-10T10:43:17.471889+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.478043+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:43:17.478043+0000","last_peered":"2023-08-10T10:43:17.478043+0000","last_clean":"2023-08-10T10:43:17.478043+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:43:17.478043+0000","last_undegraded":"2023-08-10T10:43:17.478043+0000","last_fullsized":"2023-08-10T10:43:17.478043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:46.638145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471941+0000","last_change":"2023-08-10T10:43:17.471941+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471941+0000","last_undegraded":"2023-08-10T10:43:17.471941+0000","last_fullsized":"2023-08-10T10:43:17.471941+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.477165+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:43:17.477165+0000","last_peered":"2023-08-10T10:43:17.477165+0000","last_clean":"2023-08-10T10:43:17.477165+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:43:17.477165+0000","last_undegraded":"2023-08-10T10:43:17.477165+0000","last_fullsized":"2023-08-10T10:43:17.477165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:32.682893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.471647+0000","last_change":"2023-08-10T10:43:17.471647+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.471647+0000","last_undegraded":"2023-08-10T10:43:17.471647+0000","last_fullsized":"2023-08-10T10:43:17.471647+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.467399+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:43:17.467399+0000","last_peered":"2023-08-10T10:43:17.467399+0000","last_clean":"2023-08-10T10:43:17.467399+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:43:17.467399+0000","last_undegraded":"2023-08-10T10:43:17.467399+0000","last_fullsized":"2023-08-10T10:43:17.467399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:12.515371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474312+0000","last_change":"2023-08-10T10:43:17.474312+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474312+0000","last_undegraded":"2023-08-10T10:43:17.474312+0000","last_fullsized":"2023-08-10T10:43:17.474312+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.466212+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:43:17.466212+0000","last_peered":"2023-08-10T10:43:17.466212+0000","last_clean":"2023-08-10T10:43:17.466212+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:43:17.466212+0000","last_undegraded":"2023-08-10T10:43:17.466212+0000","last_fullsized":"2023-08-10T10:43:17.466212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:39.221319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.472347+0000","last_change":"2023-08-10T10:43:17.472347+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.472347+0000","last_undegraded":"2023-08-10T10:43:17.472347+0000","last_fullsized":"2023-08-10T10:43:17.472347+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.477785+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:43:17.477785+0000","last_peered":"2023-08-10T10:43:17.477785+0000","last_clean":"2023-08-10T10:43:17.477785+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:43:17.477785+0000","last_undegraded":"2023-08-10T10:43:17.477785+0000","last_fullsized":"2023-08-10T10:43:17.477785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:17.898582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.474772+0000","last_change":"2023-08-10T10:43:17.474772+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.474772+0000","last_undegraded":"2023-08-10T10:43:17.474772+0000","last_fullsized":"2023-08-10T10:43:17.474772+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.466200+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:43:17.466200+0000","last_peered":"2023-08-10T10:43:17.466200+0000","last_clean":"2023-08-10T10:43:17.466200+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:43:17.466200+0000","last_undegraded":"2023-08-10T10:43:17.466200+0000","last_fullsized":"2023-08-10T10:43:17.466200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:41:42.185671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-10T10:43:18.463746+0000","last_change":"2023-08-10T10:43:18.463746+0000","last_active":"2023-08-10T10:43:18.463746+0000","last_peered":"2023-08-10T10:43:18.463746+0000","last_clean":"2023-08-10T10:43:18.463746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:18.463746+0000","last_undegraded":"2023-08-10T10:43:18.463746+0000","last_fullsized":"2023-08-10T10:43:18.463746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-08-10T10:43:17.467904+0000","last_change":"2023-08-10T10:43:17.467904+0000","last_active":"2023-08-10T10:43:17.458649+0000","last_peered":"2023-08-10T10:43:17.458649+0000","last_clean":"2023-08-10T10:43:17.458649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-10T10:43:17.467904+0000","last_undegraded":"2023-08-10T10:43:17.467904+0000","last_fullsized":"2023-08-10T10:43:17.467904+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-10T10:43:17.471937+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:43:17.471937+0000","last_peered":"2023-08-10T10:43:17.471937+0000","last_clean":"2023-08-10T10:43:17.471937+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:43:17.471937+0000","last_undegraded":"2023-08-10T10:43:17.471937+0000","last_fullsized":"2023-08-10T10:43:17.471937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:47:02.413184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1070,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0760000000000001,"15min":1.125},"min":{"1min":0.59299999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.661,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.661},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.141,"15min":1.069},"min":{"1min":0.89500000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.587,"5min":5.149,"15min":5.149},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.143,"15min":1.137},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5940000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.589},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.151,"15min":1.1319999999999999},"min":{"1min":0.82199999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.554,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.357}]},{"osd":2,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":0.83599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.504,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.28,"5min":1.216,"15min":1.24},"min":{"1min":0.72399999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.718,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.81899999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.609,"5min":1.766,"15min":1.766},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.3320000000000001,"15min":1.3819999999999999},"min":{"1min":0.89200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.982,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.4219999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.86899999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.645,"5min":1.99,"15min":1.99},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.2849999999999999,"15min":1.2709999999999999},"min":{"1min":0.78700000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.653,"5min":6.657,"15min":6.657},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.421,"15min":1.4379999999999999},"min":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8540000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":1.02,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.911,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.512,"15min":1.5820000000000001},"min":{"1min":0.83399999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.8720000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.4690000000000001,"15min":1.5049999999999999},"min":{"1min":0.91900000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0950000000000002,"5min":3.585,"15min":3.585},"last":1.47}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0780000000000001,"15min":1.0429999999999999},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.75,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0209999999999999,"15min":0.97299999999999998},"min":{"1min":0.68999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.45,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.91100000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.624,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5349999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1739999999999999,"15min":1.1599999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.7490000000000001,"5min":1.96,"15min":1.96},"last":1.5049999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.1539999999999999,"15min":1.1180000000000001},"min":{"1min":0.76700000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.613,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.236,"15min":1.212},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7929999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.3420000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2130000000000001,"15min":1.1799999999999999},"min":{"1min":0.81899999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2609999999999999,"15min":1.24},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7509999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.4199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.242,"15min":1.1910000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.456},{"interface":"front","average":{"1min":1.425,"5min":1.4179999999999999,"15min":1.3919999999999999},"min":{"1min":0.67200000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.8200000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.726}]},{"osd":5,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4390000000000001,"15min":1.3859999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.478,"15min":1.466},"min":{"1min":0.85199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.982,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":2.0680000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.353,"15min":1.343},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7909999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.504,"15min":1.462},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.536,"5min":2.698,"15min":2.698},"last":1.8080000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194819,"statfs":{"total":200000000,"available":199495115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.1140000000000001,"15min":1.071},"min":{"1min":0.621,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5249999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.3740000000000001,"15min":1.1839999999999999},"min":{"1min":0.67800000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8069999999999999,"5min":32.941000000000003,"15min":32.941000000000003},"last":0.89800000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1839999999999999,"15min":1.2210000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5960000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1739999999999999,"15min":1.222},"min":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.546,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.0469999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.29,"15min":1.351},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5880000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.357},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.177,"15min":1.143},"min":{"1min":0.77400000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.653,"5min":1.73,"15min":1.73},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2250000000000001,"15min":1.2430000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7669999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.407},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3440000000000001,"15min":1.3759999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.7270000000000001,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.165}]},{"osd":4,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.2649999999999999,"15min":1.2989999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4279999999999999,"5min":2.399,"15min":2.399},"last":1.258},{"interface":"front","average":{"1min":1.331,"5min":1.3400000000000001,"15min":1.3520000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.111}]},{"osd":6,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3280000000000001,"15min":1.298},"min":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.819,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4079999999999999,"15min":1.379},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":1.98,"15min":1.98},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4710000000000001,"15min":1.484},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.905,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4950000000000001,"15min":1.484},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8029999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.542}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.157,"15min":1.139},"min":{"1min":0.748,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.278},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.73999999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2110000000000001,"15min":1.2829999999999999},"min":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.75,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1319999999999999},"min":{"1min":0.73299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.516}]},{"osd":2,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.159,"15min":1.143},"min":{"1min":0.76900000000000002,"5min":0.621,"15min":0.621},"max":{"1min":4.4969999999999999,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2629999999999999,"15min":1.2829999999999999},"min":{"1min":0.92200000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":3.9780000000000002},"last":1.3280000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.242,"15min":1.2410000000000001},"min":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.29,"15min":1.27},"min":{"1min":0.93300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":4.6859999999999999,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.353},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.754,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.84599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.581}]},{"osd":6,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.3300000000000001,"15min":1.3220000000000001},"min":{"1min":0.91900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4630000000000001,"15min":1.4570000000000001},"min":{"1min":0.86699999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":1.218}]},{"osd":7,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.4219999999999999,"15min":1.4099999999999999},"min":{"1min":0.91700000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.516,"15min":1.5},"min":{"1min":0.96699999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.456}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92400000000000004,"15min":0.81000000000000005},"min":{"1min":0.68500000000000005,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.629,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.0920000000000001,"15min":0.95199999999999996},"min":{"1min":1.0249999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.78,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.92100000000000004,"15min":0.81999999999999995},"min":{"1min":0.74399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5209999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.022,"15min":0.91000000000000003},"min":{"1min":0.71699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.752,"5min":1.897,"15min":1.897},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0329999999999999,"15min":0.92300000000000004},"min":{"1min":0.76400000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.651,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.329,"5min":1.1819999999999999,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.958,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.3089999999999999,"15min":1.2070000000000001},"min":{"1min":1.1699999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.357,"5min":1.2569999999999999,"15min":1.1890000000000001},"min":{"1min":0.80600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3919999999999999,"15min":1.3120000000000001},"min":{"1min":1.129,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":2.125,"15min":2.125},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.405,"15min":1.347},"min":{"1min":1.228,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.849,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.21}]},{"osd":6,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.341,"15min":1.2509999999999999},"min":{"1min":1.1619999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1920000000000002,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.4650000000000001,"15min":1.389},"min":{"1min":1.212,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8360000000000001,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.115}]},{"osd":7,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.4690000000000001,"15min":1.417},"min":{"1min":1.431,"5min":0.754,"15min":0.754},"max":{"1min":1.8160000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.421,"15min":1.327},"min":{"1min":1.2509999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.0189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85899999999999999,"15min":0.871},"min":{"1min":0.58499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.306,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93600000000000005,"15min":0.878},"min":{"1min":0.44900000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4179999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.121}]},{"osd":1,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.0289999999999999},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8009999999999999,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7170000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.633}]},{"osd":3,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96099999999999997,"15min":0.999},"min":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.621,"5min":1.639,"15min":1.639},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.181,"15min":1.244},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.863,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":1.5069999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3759999999999999,"15min":1.415},"min":{"1min":0.92300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.601,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.3009999999999999,"15min":1.2909999999999999},"min":{"1min":0.88100000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6579999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.407}]},{"osd":5,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.268,"15min":1.26},"min":{"1min":0.85099999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.7969999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.321},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4319999999999999,"15min":1.4650000000000001},"min":{"1min":0.876,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8089999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.587}]},{"osd":6,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4079999999999999,"15min":1.3660000000000001},"min":{"1min":1.042,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0680000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.804},{"interface":"front","average":{"1min":1.427,"5min":1.3500000000000001,"15min":1.3380000000000001},"min":{"1min":0.86499999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.089,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.161}]},{"osd":7,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.4379999999999999,"15min":1.3839999999999999},"min":{"1min":0.87,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.532},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.421,"15min":1.4079999999999999},"min":{"1min":0.95099999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2240000000000002,"5min":2.444,"15min":2.444},"last":1.466}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81899999999999995},"min":{"1min":0.621,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.052,"5min":0.95299999999999996,"15min":0.93400000000000005},"min":{"1min":0.626,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.012,"5min":2.246,"15min":2.246},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96199999999999997,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.436,"15min":0.436},"max":{"1min":1.669,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.175,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7589999999999999,"5min":2.423,"15min":2.423},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1040000000000001,"15min":1.03},"min":{"1min":0.80700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.532,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.66200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.512,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.399}]},{"osd":4,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.23,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4890000000000001,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.4219999999999999,"15min":1.373},"min":{"1min":1.1890000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.4750000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3939999999999999,"15min":1.3520000000000001},"min":{"1min":1.159,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9299999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.373,"15min":1.2949999999999999},"min":{"1min":1.1379999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9710000000000001,"5min":2.73,"15min":2.73},"last":1.5129999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.387,"15min":1.347},"min":{"1min":1.1719999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9219999999999999,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.556},{"interface":"front","average":{"1min":1.395,"5min":1.3180000000000001,"15min":1.234},"min":{"1min":1.0269999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6799999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.593}]},{"osd":7,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4399999999999999,"15min":1.4239999999999999},"min":{"1min":1.1719999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8420000000000001,"5min":2.742,"15min":2.742},"last":1.625},{"interface":"front","average":{"1min":1.552,"5min":1.4530000000000001,"15min":1.377},"min":{"1min":1.1399999999999999,"5min":0.625,"15min":0.625},"max":{"1min":2.1190000000000002,"5min":2.605,"15min":2.605},"last":1.643}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1069,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194242,"statfs":{"total":200000000,"available":198904747,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.94399999999999995,"15min":0.96599999999999997},"min":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4330000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.052,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.607,"5min":1.853,"15min":1.853},"last":1.508}]},{"osd":2,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.55100000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4239999999999999,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0389999999999999,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.1180000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.006,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7969999999999999,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":1.329},{"interface":"front","average":{"1min":1.21,"5min":1.135,"15min":1.105},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.756,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.7350000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.351,"15min":1.268},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.77,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.238},{"interface":"front","average":{"1min":1.468,"5min":1.4390000000000001,"15min":1.395},"min":{"1min":1.0629999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.919,"5min":2.536,"15min":2.536},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.3560000000000001,"15min":1.377},"min":{"1min":0.85899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8799999999999999,"5min":1.986,"15min":1.986},"last":1.698},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.514,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.873,"5min":16.058,"15min":16.058},"last":1.4710000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.46,"15min":1.454},"min":{"1min":0.92700000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.121,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.867},{"interface":"front","average":{"1min":1.494,"5min":1.4279999999999999,"15min":1.4299999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.016,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.8300000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.512,"15min":1.528},"min":{"1min":1.018,"5min":0.752,"15min":0.752},"max":{"1min":1.927,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.9239999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.482,"15min":1.4139999999999999},"min":{"1min":0.877,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.0139999999999998,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.7769999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:43:24.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:43:24.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.332+0000 7fe03759e640 1 Processor -- start 2023-08-10T10:43:24.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.333+0000 7fe03759e640 1 -- start start 2023-08-10T10:43:24.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe038153850 0x7fe0380b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe038153c30 0x7fe0380b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0380cf630 0x7fe0380cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0380cffe0 con 0x7fe0380cf630 2023-08-10T10:43:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03815d010 con 0x7fe038153850 2023-08-10T10:43:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.334+0000 7fe03759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03815d290 con 0x7fe038153c30 2023-08-10T10:43:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0380cf630 0x7fe0380cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0380cf630 0x7fe0380cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48524/0 (socket says 172.21.15.50:48524) 2023-08-10T10:43:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 -- 172.21.15.50:0/2313396020 learned_addr learned my addr 172.21.15.50:0/2313396020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe035d9b640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe038153c30 0x7fe0380b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe03659c640 1 --2- 172.21.15.50:0/2313396020 >> v2:172.21.15.117:3300/0 conn(0x7fe038153850 0x7fe0380b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 -- 172.21.15.50:0/2313396020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe038153c30 msgr2=0x7fe0380b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe038153c30 0x7fe0380b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 -- 172.21.15.50:0/2313396020 >> v2:172.21.15.117:3300/0 conn(0x7fe038153850 msgr2=0x7fe0380b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 --2- 172.21.15.50:0/2313396020 >> v2:172.21.15.117:3300/0 conn(0x7fe038153850 0x7fe0380b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.335+0000 7fe036d9d640 1 -- 172.21.15.50:0/2313396020 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03815d570 con 0x7fe0380cf630 2023-08-10T10:43:24.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.336+0000 7fe036d9d640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380cf630 0x7fe0380cfaa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe038070d30 tx=0x7fe03002b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54e5e2ca2db593d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.337+0000 7fe03559a640 1 -- 172.21.15.50:0/2313396020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030031640 con 0x7fe0380cf630 2023-08-10T10:43:24.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.337+0000 7fe03559a640 1 -- 172.21.15.50:0/2313396020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0300317a0 con 0x7fe0380cf630 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.337+0000 7fe03559a640 1 -- 172.21.15.50:0/2313396020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030031b30 con 0x7fe0380cf630 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.337+0000 7fe03759e640 1 -- 172.21.15.50:0/2313396020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380cf630 msgr2=0x7fe0380cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.337+0000 7fe03759e640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380cf630 0x7fe0380cfaa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe038070d30 tx=0x7fe03002b8e0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 -- 172.21.15.50:0/2313396020 shutdown_connections 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380cf630 0x7fe0380cfaa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 --2- 172.21.15.50:0/2313396020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe038153c30 0x7fe0380b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 --2- 172.21.15.50:0/2313396020 >> v2:172.21.15.117:3300/0 conn(0x7fe038153850 0x7fe0380b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 -- 172.21.15.50:0/2313396020 >> 172.21.15.50:0/2313396020 conn(0x7fe038069880 msgr2=0x7fe038069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 -- 172.21.15.50:0/2313396020 shutdown_connections 2023-08-10T10:43:24.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.338+0000 7fe03759e640 1 -- 172.21.15.50:0/2313396020 wait complete. 2023-08-10T10:43:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.339+0000 7fe03759e640 1 Processor -- start 2023-08-10T10:43:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.340+0000 7fe03759e640 1 -- start start 2023-08-10T10:43:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0380cf630 0x7fe0380d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe038153c30 0x7fe0381f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380c8920 con 0x7fe038153850 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380d0e80 con 0x7fe038153c30 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380d1160 con 0x7fe0380cf630 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48536/0 (socket says 172.21.15.50:48536) 2023-08-10T10:43:24.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 -- 172.21.15.50:0/1027212343 learned_addr learned my addr 172.21.15.50:0/1027212343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe03659c640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0380cf630 0x7fe0380d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 -- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0380cf630 msgr2=0x7fe0380d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0380cf630 0x7fe0380d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 -- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe038153c30 msgr2=0x7fe0381f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe038153c30 0x7fe0381f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.341+0000 7fe035d9b640 1 -- 172.21.15.50:0/1027212343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300094b0 con 0x7fe038153850 2023-08-10T10:43:24.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe035d9b640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d5f0 tx=0x7fe02000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200125f0 con 0x7fe038153850 2023-08-10T10:43:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe020012750 con 0x7fe038153850 2023-08-10T10:43:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020012b00 con 0x7fe038153850 2023-08-10T10:43:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0380d1440 con 0x7fe038153850 2023-08-10T10:43:24.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.342+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0380d1a00 con 0x7fe038153850 2023-08-10T10:43:24.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.343+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0380d1bc0 con 0x7fe038153850 2023-08-10T10:43:24.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.344+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe020012c60 con 0x7fe038153850 2023-08-10T10:43:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.345+0000 7fe02effd640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 0x7fe01806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.345+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0200898e0 con 0x7fe038153850 2023-08-10T10:43:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.346+0000 7fe03659c640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 0x7fe01806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.346+0000 7fe03659c640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 0x7fe01806d140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe028009a60 tx=0x7fe028003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.351+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe020054980 con 0x7fe038153850 2023-08-10T10:43:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.541+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe03815db30 con 0x7fe01806ac80 2023-08-10T10:43:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.564+0000 7fe02effd640 1 -- 172.21.15.50:0/1027212343 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302964 (secure 0 0 0) 0x7fe028004780 con 0x7fe01806ac80 2023-08-10T10:43:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:43:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 msgr2=0x7fe01806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 0x7fe01806d140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe028009a60 tx=0x7fe028003990 comp rx=0 tx=0).stop 2023-08-10T10:43:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 msgr2=0x7fe0380c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d5f0 tx=0x7fe02000dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 shutdown_connections 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe01806ac80 0x7fe01806d140 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe038153c30 0x7fe0381f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038153850 0x7fe0380c83e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 --2- 172.21.15.50:0/1027212343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0380cf630 0x7fe0380d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 >> 172.21.15.50:0/1027212343 conn(0x7fe038069880 msgr2=0x7fe0380b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 shutdown_connections 2023-08-10T10:43:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.570+0000 7fe03759e640 1 -- 172.21.15.50:0/1027212343 wait complete. 2023-08-10T10:43:24.594 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-08-10T10:43:24.424742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5267,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557232,"statfs":{"total":1600000000,"available":1594606074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002029"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.530099+0000","last_change":"2023-08-10T10:43:19.540080+0000","last_active":"2023-08-10T10:43:20.530099+0000","last_peered":"2023-08-10T10:43:20.530099+0000","last_clean":"2023-08-10T10:43:20.530099+0000","last_became_active":"2023-08-10T10:43:19.539210+0000","last_became_peered":"2023-08-10T10:43:19.539210+0000","last_unstale":"2023-08-10T10:43:20.530099+0000","last_undegraded":"2023-08-10T10:43:20.530099+0000","last_fullsized":"2023-08-10T10:43:20.530099+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:54:37.378545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609775+0000","last_change":"2023-08-10T10:43:19.540163+0000","last_active":"2023-08-10T10:43:20.609775+0000","last_peered":"2023-08-10T10:43:20.609775+0000","last_clean":"2023-08-10T10:43:20.609775+0000","last_became_active":"2023-08-10T10:43:19.539848+0000","last_became_peered":"2023-08-10T10:43:19.539848+0000","last_unstale":"2023-08-10T10:43:20.609775+0000","last_undegraded":"2023-08-10T10:43:20.609775+0000","last_fullsized":"2023-08-10T10:43:20.609775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:56:28.490118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610185+0000","last_change":"2023-08-10T10:43:19.538595+0000","last_active":"2023-08-10T10:43:20.610185+0000","last_peered":"2023-08-10T10:43:20.610185+0000","last_clean":"2023-08-10T10:43:20.610185+0000","last_became_active":"2023-08-10T10:43:19.538277+0000","last_became_peered":"2023-08-10T10:43:19.538277+0000","last_unstale":"2023-08-10T10:43:20.610185+0000","last_undegraded":"2023-08-10T10:43:20.610185+0000","last_fullsized":"2023-08-10T10:43:20.610185+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:40:26.589752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608546+0000","last_change":"2023-08-10T10:43:19.540858+0000","last_active":"2023-08-10T10:43:20.608546+0000","last_peered":"2023-08-10T10:43:20.608546+0000","last_clean":"2023-08-10T10:43:20.608546+0000","last_became_active":"2023-08-10T10:43:19.537718+0000","last_became_peered":"2023-08-10T10:43:19.537718+0000","last_unstale":"2023-08-10T10:43:20.608546+0000","last_undegraded":"2023-08-10T10:43:20.608546+0000","last_fullsized":"2023-08-10T10:43:20.608546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:53:49.593392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608366+0000","last_change":"2023-08-10T10:43:19.543330+0000","last_active":"2023-08-10T10:43:20.608366+0000","last_peered":"2023-08-10T10:43:20.608366+0000","last_clean":"2023-08-10T10:43:20.608366+0000","last_became_active":"2023-08-10T10:43:19.541289+0000","last_became_peered":"2023-08-10T10:43:19.541289+0000","last_unstale":"2023-08-10T10:43:20.608366+0000","last_undegraded":"2023-08-10T10:43:20.608366+0000","last_fullsized":"2023-08-10T10:43:20.608366+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:30:45.313649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522020+0000","last_change":"2023-08-10T10:43:19.532292+0000","last_active":"2023-08-10T10:43:20.522020+0000","last_peered":"2023-08-10T10:43:20.522020+0000","last_clean":"2023-08-10T10:43:20.522020+0000","last_became_active":"2023-08-10T10:43:19.528137+0000","last_became_peered":"2023-08-10T10:43:19.528137+0000","last_unstale":"2023-08-10T10:43:20.522020+0000","last_undegraded":"2023-08-10T10:43:20.522020+0000","last_fullsized":"2023-08-10T10:43:20.522020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:05:58.369764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610060+0000","last_change":"2023-08-10T10:43:19.539565+0000","last_active":"2023-08-10T10:43:20.610060+0000","last_peered":"2023-08-10T10:43:20.610060+0000","last_clean":"2023-08-10T10:43:20.610060+0000","last_became_active":"2023-08-10T10:43:19.539144+0000","last_became_peered":"2023-08-10T10:43:19.539144+0000","last_unstale":"2023-08-10T10:43:20.610060+0000","last_undegraded":"2023-08-10T10:43:20.610060+0000","last_fullsized":"2023-08-10T10:43:20.610060+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:04:34.952036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608912+0000","last_change":"2023-08-10T10:43:19.542920+0000","last_active":"2023-08-10T10:43:20.608912+0000","last_peered":"2023-08-10T10:43:20.608912+0000","last_clean":"2023-08-10T10:43:20.608912+0000","last_became_active":"2023-08-10T10:43:19.541249+0000","last_became_peered":"2023-08-10T10:43:19.541249+0000","last_unstale":"2023-08-10T10:43:20.608912+0000","last_undegraded":"2023-08-10T10:43:20.608912+0000","last_fullsized":"2023-08-10T10:43:20.608912+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:03.496213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526263+0000","last_change":"2023-08-10T10:43:19.537473+0000","last_active":"2023-08-10T10:43:20.526263+0000","last_peered":"2023-08-10T10:43:20.526263+0000","last_clean":"2023-08-10T10:43:20.526263+0000","last_became_active":"2023-08-10T10:43:19.536442+0000","last_became_peered":"2023-08-10T10:43:19.536442+0000","last_unstale":"2023-08-10T10:43:20.526263+0000","last_undegraded":"2023-08-10T10:43:20.526263+0000","last_fullsized":"2023-08-10T10:43:20.526263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:05:29.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609244+0000","last_change":"2023-08-10T10:43:19.541784+0000","last_active":"2023-08-10T10:43:20.609244+0000","last_peered":"2023-08-10T10:43:20.609244+0000","last_clean":"2023-08-10T10:43:20.609244+0000","last_became_active":"2023-08-10T10:43:19.541467+0000","last_became_peered":"2023-08-10T10:43:19.541467+0000","last_unstale":"2023-08-10T10:43:20.609244+0000","last_undegraded":"2023-08-10T10:43:20.609244+0000","last_fullsized":"2023-08-10T10:43:20.609244+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:31.112586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607768+0000","last_change":"2023-08-10T10:43:19.539175+0000","last_active":"2023-08-10T10:43:20.607768+0000","last_peered":"2023-08-10T10:43:20.607768+0000","last_clean":"2023-08-10T10:43:20.607768+0000","last_became_active":"2023-08-10T10:43:19.538704+0000","last_became_peered":"2023-08-10T10:43:19.538704+0000","last_unstale":"2023-08-10T10:43:20.607768+0000","last_undegraded":"2023-08-10T10:43:20.607768+0000","last_fullsized":"2023-08-10T10:43:20.607768+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:57.538172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608358+0000","last_change":"2023-08-10T10:43:19.542261+0000","last_active":"2023-08-10T10:43:20.608358+0000","last_peered":"2023-08-10T10:43:20.608358+0000","last_clean":"2023-08-10T10:43:20.608358+0000","last_became_active":"2023-08-10T10:43:19.541117+0000","last_became_peered":"2023-08-10T10:43:19.541117+0000","last_unstale":"2023-08-10T10:43:20.608358+0000","last_undegraded":"2023-08-10T10:43:20.608358+0000","last_fullsized":"2023-08-10T10:43:20.608358+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:45.448833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608507+0000","last_change":"2023-08-10T10:43:19.544984+0000","last_active":"2023-08-10T10:43:20.608507+0000","last_peered":"2023-08-10T10:43:20.608507+0000","last_clean":"2023-08-10T10:43:20.608507+0000","last_became_active":"2023-08-10T10:43:19.544295+0000","last_became_peered":"2023-08-10T10:43:19.544295+0000","last_unstale":"2023-08-10T10:43:20.608507+0000","last_undegraded":"2023-08-10T10:43:20.608507+0000","last_fullsized":"2023-08-10T10:43:20.608507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:52.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522007+0000","last_change":"2023-08-10T10:43:19.538742+0000","last_active":"2023-08-10T10:43:20.522007+0000","last_peered":"2023-08-10T10:43:20.522007+0000","last_clean":"2023-08-10T10:43:20.522007+0000","last_became_active":"2023-08-10T10:43:19.534984+0000","last_became_peered":"2023-08-10T10:43:19.534984+0000","last_unstale":"2023-08-10T10:43:20.522007+0000","last_undegraded":"2023-08-10T10:43:20.522007+0000","last_fullsized":"2023-08-10T10:43:20.522007+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:50.877234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608925+0000","last_change":"2023-08-10T10:43:19.531782+0000","last_active":"2023-08-10T10:43:20.608925+0000","last_peered":"2023-08-10T10:43:20.608925+0000","last_clean":"2023-08-10T10:43:20.608925+0000","last_became_active":"2023-08-10T10:43:19.530601+0000","last_became_peered":"2023-08-10T10:43:19.530601+0000","last_unstale":"2023-08-10T10:43:20.608925+0000","last_undegraded":"2023-08-10T10:43:20.608925+0000","last_fullsized":"2023-08-10T10:43:20.608925+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:18.446302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529499+0000","last_change":"2023-08-10T10:43:19.543062+0000","last_active":"2023-08-10T10:43:20.529499+0000","last_peered":"2023-08-10T10:43:20.529499+0000","last_clean":"2023-08-10T10:43:20.529499+0000","last_became_active":"2023-08-10T10:43:19.542742+0000","last_became_peered":"2023-08-10T10:43:19.542742+0000","last_unstale":"2023-08-10T10:43:20.529499+0000","last_undegraded":"2023-08-10T10:43:20.529499+0000","last_fullsized":"2023-08-10T10:43:20.529499+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:29:01.587766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610183+0000","last_change":"2023-08-10T10:43:19.544624+0000","last_active":"2023-08-10T10:43:20.610183+0000","last_peered":"2023-08-10T10:43:20.610183+0000","last_clean":"2023-08-10T10:43:20.610183+0000","last_became_active":"2023-08-10T10:43:19.543405+0000","last_became_peered":"2023-08-10T10:43:19.543405+0000","last_unstale":"2023-08-10T10:43:20.610183+0000","last_undegraded":"2023-08-10T10:43:20.610183+0000","last_fullsized":"2023-08-10T10:43:20.610183+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:06.562234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610039+0000","last_change":"2023-08-10T10:43:19.537014+0000","last_active":"2023-08-10T10:43:20.610039+0000","last_peered":"2023-08-10T10:43:20.610039+0000","last_clean":"2023-08-10T10:43:20.610039+0000","last_became_active":"2023-08-10T10:43:19.536615+0000","last_became_peered":"2023-08-10T10:43:19.536615+0000","last_unstale":"2023-08-10T10:43:20.610039+0000","last_undegraded":"2023-08-10T10:43:20.610039+0000","last_fullsized":"2023-08-10T10:43:20.610039+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:57.538172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522351+0000","last_change":"2023-08-10T10:43:19.541770+0000","last_active":"2023-08-10T10:43:20.522351+0000","last_peered":"2023-08-10T10:43:20.522351+0000","last_clean":"2023-08-10T10:43:20.522351+0000","last_became_active":"2023-08-10T10:43:19.540613+0000","last_became_peered":"2023-08-10T10:43:19.540613+0000","last_unstale":"2023-08-10T10:43:20.522351+0000","last_undegraded":"2023-08-10T10:43:20.522351+0000","last_fullsized":"2023-08-10T10:43:20.522351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:26.147006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609067+0000","last_change":"2023-08-10T10:43:19.543587+0000","last_active":"2023-08-10T10:43:20.609067+0000","last_peered":"2023-08-10T10:43:20.609067+0000","last_clean":"2023-08-10T10:43:20.609067+0000","last_became_active":"2023-08-10T10:43:19.542999+0000","last_became_peered":"2023-08-10T10:43:19.542999+0000","last_unstale":"2023-08-10T10:43:20.609067+0000","last_undegraded":"2023-08-10T10:43:20.609067+0000","last_fullsized":"2023-08-10T10:43:20.609067+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:03.539419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526815+0000","last_change":"2023-08-10T10:43:19.538557+0000","last_active":"2023-08-10T10:43:20.526815+0000","last_peered":"2023-08-10T10:43:20.526815+0000","last_clean":"2023-08-10T10:43:20.526815+0000","last_became_active":"2023-08-10T10:43:19.538137+0000","last_became_peered":"2023-08-10T10:43:19.538137+0000","last_unstale":"2023-08-10T10:43:20.526815+0000","last_undegraded":"2023-08-10T10:43:20.526815+0000","last_fullsized":"2023-08-10T10:43:20.526815+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:55.394253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609836+0000","last_change":"2023-08-10T10:43:19.544449+0000","last_active":"2023-08-10T10:43:20.609836+0000","last_peered":"2023-08-10T10:43:20.609836+0000","last_clean":"2023-08-10T10:43:20.609836+0000","last_became_active":"2023-08-10T10:43:19.543065+0000","last_became_peered":"2023-08-10T10:43:19.543065+0000","last_unstale":"2023-08-10T10:43:20.609836+0000","last_undegraded":"2023-08-10T10:43:20.609836+0000","last_fullsized":"2023-08-10T10:43:20.609836+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:54.089332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526083+0000","last_change":"2023-08-10T10:43:19.533543+0000","last_active":"2023-08-10T10:43:20.526083+0000","last_peered":"2023-08-10T10:43:20.526083+0000","last_clean":"2023-08-10T10:43:20.526083+0000","last_became_active":"2023-08-10T10:43:19.533122+0000","last_became_peered":"2023-08-10T10:43:19.533122+0000","last_unstale":"2023-08-10T10:43:20.526083+0000","last_undegraded":"2023-08-10T10:43:20.526083+0000","last_fullsized":"2023-08-10T10:43:20.526083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:00.676483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607271+0000","last_change":"2023-08-10T10:43:19.525053+0000","last_active":"2023-08-10T10:43:20.607271+0000","last_peered":"2023-08-10T10:43:20.607271+0000","last_clean":"2023-08-10T10:43:20.607271+0000","last_became_active":"2023-08-10T10:43:19.518968+0000","last_became_peered":"2023-08-10T10:43:19.518968+0000","last_unstale":"2023-08-10T10:43:20.607271+0000","last_undegraded":"2023-08-10T10:43:20.607271+0000","last_fullsized":"2023-08-10T10:43:20.607271+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:49.434789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608338+0000","last_change":"2023-08-10T10:43:19.519262+0000","last_active":"2023-08-10T10:43:20.608338+0000","last_peered":"2023-08-10T10:43:20.608338+0000","last_clean":"2023-08-10T10:43:20.608338+0000","last_became_active":"2023-08-10T10:43:19.518615+0000","last_became_peered":"2023-08-10T10:43:19.518615+0000","last_unstale":"2023-08-10T10:43:20.608338+0000","last_undegraded":"2023-08-10T10:43:20.608338+0000","last_fullsized":"2023-08-10T10:43:20.608338+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:59.278664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608597+0000","last_change":"2023-08-10T10:43:19.540864+0000","last_active":"2023-08-10T10:43:20.608597+0000","last_peered":"2023-08-10T10:43:20.608597+0000","last_clean":"2023-08-10T10:43:20.608597+0000","last_became_active":"2023-08-10T10:43:19.537894+0000","last_became_peered":"2023-08-10T10:43:19.537894+0000","last_unstale":"2023-08-10T10:43:20.608597+0000","last_undegraded":"2023-08-10T10:43:20.608597+0000","last_fullsized":"2023-08-10T10:43:20.608597+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:42.221913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529142+0000","last_change":"2023-08-10T10:43:19.542316+0000","last_active":"2023-08-10T10:43:20.529142+0000","last_peered":"2023-08-10T10:43:20.529142+0000","last_clean":"2023-08-10T10:43:20.529142+0000","last_became_active":"2023-08-10T10:43:19.542037+0000","last_became_peered":"2023-08-10T10:43:19.542037+0000","last_unstale":"2023-08-10T10:43:20.529142+0000","last_undegraded":"2023-08-10T10:43:20.529142+0000","last_fullsized":"2023-08-10T10:43:20.529142+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:29:18.342574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608681+0000","last_change":"2023-08-10T10:43:19.545076+0000","last_active":"2023-08-10T10:43:20.608681+0000","last_peered":"2023-08-10T10:43:20.608681+0000","last_clean":"2023-08-10T10:43:20.608681+0000","last_became_active":"2023-08-10T10:43:19.544737+0000","last_became_peered":"2023-08-10T10:43:19.544737+0000","last_unstale":"2023-08-10T10:43:20.608681+0000","last_undegraded":"2023-08-10T10:43:20.608681+0000","last_fullsized":"2023-08-10T10:43:20.608681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:45.599830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607478+0000","last_change":"2023-08-10T10:43:19.519633+0000","last_active":"2023-08-10T10:43:20.607478+0000","last_peered":"2023-08-10T10:43:20.607478+0000","last_clean":"2023-08-10T10:43:20.607478+0000","last_became_active":"2023-08-10T10:43:19.518020+0000","last_became_peered":"2023-08-10T10:43:19.518020+0000","last_unstale":"2023-08-10T10:43:20.607478+0000","last_undegraded":"2023-08-10T10:43:20.607478+0000","last_fullsized":"2023-08-10T10:43:20.607478+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:45:38.926552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529465+0000","last_change":"2023-08-10T10:43:19.539885+0000","last_active":"2023-08-10T10:43:20.529465+0000","last_peered":"2023-08-10T10:43:20.529465+0000","last_clean":"2023-08-10T10:43:20.529465+0000","last_became_active":"2023-08-10T10:43:19.539544+0000","last_became_peered":"2023-08-10T10:43:19.539544+0000","last_unstale":"2023-08-10T10:43:20.529465+0000","last_undegraded":"2023-08-10T10:43:20.529465+0000","last_fullsized":"2023-08-10T10:43:20.529465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:43:21.797838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608601+0000","last_change":"2023-08-10T10:43:19.530176+0000","last_active":"2023-08-10T10:43:20.608601+0000","last_peered":"2023-08-10T10:43:20.608601+0000","last_clean":"2023-08-10T10:43:20.608601+0000","last_became_active":"2023-08-10T10:43:19.529774+0000","last_became_peered":"2023-08-10T10:43:19.529774+0000","last_unstale":"2023-08-10T10:43:20.608601+0000","last_undegraded":"2023-08-10T10:43:20.608601+0000","last_fullsized":"2023-08-10T10:43:20.608601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:49.434789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529990+0000","last_change":"2023-08-10T10:43:19.538961+0000","last_active":"2023-08-10T10:43:20.529990+0000","last_peered":"2023-08-10T10:43:20.529990+0000","last_clean":"2023-08-10T10:43:20.529990+0000","last_became_active":"2023-08-10T10:43:19.538681+0000","last_became_peered":"2023-08-10T10:43:19.538681+0000","last_unstale":"2023-08-10T10:43:20.529990+0000","last_undegraded":"2023-08-10T10:43:20.529990+0000","last_fullsized":"2023-08-10T10:43:20.529990+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:03:56.274662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610053+0000","last_change":"2023-08-10T10:43:19.540214+0000","last_active":"2023-08-10T10:43:20.610053+0000","last_peered":"2023-08-10T10:43:20.610053+0000","last_clean":"2023-08-10T10:43:20.610053+0000","last_became_active":"2023-08-10T10:43:19.538584+0000","last_became_peered":"2023-08-10T10:43:19.538584+0000","last_unstale":"2023-08-10T10:43:20.610053+0000","last_undegraded":"2023-08-10T10:43:20.610053+0000","last_fullsized":"2023-08-10T10:43:20.610053+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:47.293891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"91'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609117+0000","last_change":"2023-08-10T10:43:18.501132+0000","last_active":"2023-08-10T10:43:20.609117+0000","last_peered":"2023-08-10T10:43:20.609117+0000","last_clean":"2023-08-10T10:43:20.609117+0000","last_became_active":"2023-08-10T10:43:18.500867+0000","last_became_peered":"2023-08-10T10:43:18.500867+0000","last_unstale":"2023-08-10T10:43:20.609117+0000","last_undegraded":"2023-08-10T10:43:20.609117+0000","last_fullsized":"2023-08-10T10:43:20.609117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:35.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607684+0000","last_change":"2023-08-10T10:43:19.534020+0000","last_active":"2023-08-10T10:43:20.607684+0000","last_peered":"2023-08-10T10:43:20.607684+0000","last_clean":"2023-08-10T10:43:20.607684+0000","last_became_active":"2023-08-10T10:43:19.533672+0000","last_became_peered":"2023-08-10T10:43:19.533672+0000","last_unstale":"2023-08-10T10:43:20.607684+0000","last_undegraded":"2023-08-10T10:43:20.607684+0000","last_fullsized":"2023-08-10T10:43:20.607684+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:56.787517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.528737+0000","last_change":"2023-08-10T10:43:18.499500+0000","last_active":"2023-08-10T10:43:20.528737+0000","last_peered":"2023-08-10T10:43:20.528737+0000","last_clean":"2023-08-10T10:43:20.528737+0000","last_became_active":"2023-08-10T10:43:18.498623+0000","last_became_peered":"2023-08-10T10:43:18.498623+0000","last_unstale":"2023-08-10T10:43:20.528737+0000","last_undegraded":"2023-08-10T10:43:20.528737+0000","last_fullsized":"2023-08-10T10:43:20.528737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:22:49.994146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526414+0000","last_change":"2023-08-10T10:43:19.526187+0000","last_active":"2023-08-10T10:43:20.526414+0000","last_peered":"2023-08-10T10:43:20.526414+0000","last_clean":"2023-08-10T10:43:20.526414+0000","last_became_active":"2023-08-10T10:43:19.524527+0000","last_became_peered":"2023-08-10T10:43:19.524527+0000","last_unstale":"2023-08-10T10:43:20.526414+0000","last_undegraded":"2023-08-10T10:43:20.526414+0000","last_fullsized":"2023-08-10T10:43:20.526414+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:13.203488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529730+0000","last_change":"2023-08-10T10:43:18.499579+0000","last_active":"2023-08-10T10:43:20.529730+0000","last_peered":"2023-08-10T10:43:20.529730+0000","last_clean":"2023-08-10T10:43:20.529730+0000","last_became_active":"2023-08-10T10:43:18.499057+0000","last_became_peered":"2023-08-10T10:43:18.499057+0000","last_unstale":"2023-08-10T10:43:20.529730+0000","last_undegraded":"2023-08-10T10:43:20.529730+0000","last_fullsized":"2023-08-10T10:43:20.529730+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:00.894694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526430+0000","last_change":"2023-08-10T10:43:19.536823+0000","last_active":"2023-08-10T10:43:20.526430+0000","last_peered":"2023-08-10T10:43:20.526430+0000","last_clean":"2023-08-10T10:43:20.526430+0000","last_became_active":"2023-08-10T10:43:19.536393+0000","last_became_peered":"2023-08-10T10:43:19.536393+0000","last_unstale":"2023-08-10T10:43:20.526430+0000","last_undegraded":"2023-08-10T10:43:20.526430+0000","last_fullsized":"2023-08-10T10:43:20.526430+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:26.464893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610022+0000","last_change":"2023-08-10T10:43:18.497994+0000","last_active":"2023-08-10T10:43:20.610022+0000","last_peered":"2023-08-10T10:43:20.610022+0000","last_clean":"2023-08-10T10:43:20.610022+0000","last_became_active":"2023-08-10T10:43:18.496966+0000","last_became_peered":"2023-08-10T10:43:18.496966+0000","last_unstale":"2023-08-10T10:43:20.610022+0000","last_undegraded":"2023-08-10T10:43:20.610022+0000","last_fullsized":"2023-08-10T10:43:20.610022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:39.140441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608059+0000","last_change":"2023-08-10T10:43:19.539008+0000","last_active":"2023-08-10T10:43:20.608059+0000","last_peered":"2023-08-10T10:43:20.608059+0000","last_clean":"2023-08-10T10:43:20.608059+0000","last_became_active":"2023-08-10T10:43:19.538382+0000","last_became_peered":"2023-08-10T10:43:19.538382+0000","last_unstale":"2023-08-10T10:43:20.608059+0000","last_undegraded":"2023-08-10T10:43:20.608059+0000","last_fullsized":"2023-08-10T10:43:20.608059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:40.545986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.527208+0000","last_change":"2023-08-10T10:43:18.495041+0000","last_active":"2023-08-10T10:43:20.527208+0000","last_peered":"2023-08-10T10:43:20.527208+0000","last_clean":"2023-08-10T10:43:20.527208+0000","last_became_active":"2023-08-10T10:43:18.494756+0000","last_became_peered":"2023-08-10T10:43:18.494756+0000","last_unstale":"2023-08-10T10:43:20.527208+0000","last_undegraded":"2023-08-10T10:43:20.527208+0000","last_fullsized":"2023-08-10T10:43:20.527208+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:42:16.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608500+0000","last_change":"2023-08-10T10:43:19.541704+0000","last_active":"2023-08-10T10:43:20.608500+0000","last_peered":"2023-08-10T10:43:20.608500+0000","last_clean":"2023-08-10T10:43:20.608500+0000","last_became_active":"2023-08-10T10:43:19.540737+0000","last_became_peered":"2023-08-10T10:43:19.540737+0000","last_unstale":"2023-08-10T10:43:20.608500+0000","last_undegraded":"2023-08-10T10:43:20.608500+0000","last_fullsized":"2023-08-10T10:43:20.608500+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:20:08.629448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608404+0000","last_change":"2023-08-10T10:43:18.478473+0000","last_active":"2023-08-10T10:43:20.608404+0000","last_peered":"2023-08-10T10:43:20.608404+0000","last_clean":"2023-08-10T10:43:20.608404+0000","last_became_active":"2023-08-10T10:43:18.477782+0000","last_became_peered":"2023-08-10T10:43:18.477782+0000","last_unstale":"2023-08-10T10:43:20.608404+0000","last_undegraded":"2023-08-10T10:43:20.608404+0000","last_fullsized":"2023-08-10T10:43:20.608404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:45.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526887+0000","last_change":"2023-08-10T10:43:19.537164+0000","last_active":"2023-08-10T10:43:20.526887+0000","last_peered":"2023-08-10T10:43:20.526887+0000","last_clean":"2023-08-10T10:43:20.526887+0000","last_became_active":"2023-08-10T10:43:19.535828+0000","last_became_peered":"2023-08-10T10:43:19.535828+0000","last_unstale":"2023-08-10T10:43:20.526887+0000","last_undegraded":"2023-08-10T10:43:20.526887+0000","last_fullsized":"2023-08-10T10:43:20.526887+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:36:19.692084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607820+0000","last_change":"2023-08-10T10:43:18.500464+0000","last_active":"2023-08-10T10:43:20.607820+0000","last_peered":"2023-08-10T10:43:20.607820+0000","last_clean":"2023-08-10T10:43:20.607820+0000","last_became_active":"2023-08-10T10:43:18.500226+0000","last_became_peered":"2023-08-10T10:43:18.500226+0000","last_unstale":"2023-08-10T10:43:20.607820+0000","last_undegraded":"2023-08-10T10:43:20.607820+0000","last_fullsized":"2023-08-10T10:43:20.607820+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:40:25.584654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608354+0000","last_change":"2023-08-10T10:43:19.539572+0000","last_active":"2023-08-10T10:43:20.608354+0000","last_peered":"2023-08-10T10:43:20.608354+0000","last_clean":"2023-08-10T10:43:20.608354+0000","last_became_active":"2023-08-10T10:43:19.539290+0000","last_became_peered":"2023-08-10T10:43:19.539290+0000","last_unstale":"2023-08-10T10:43:20.608354+0000","last_undegraded":"2023-08-10T10:43:20.608354+0000","last_fullsized":"2023-08-10T10:43:20.608354+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:31:17.297467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609301+0000","last_change":"2023-08-10T10:43:18.498007+0000","last_active":"2023-08-10T10:43:20.609301+0000","last_peered":"2023-08-10T10:43:20.609301+0000","last_clean":"2023-08-10T10:43:20.609301+0000","last_became_active":"2023-08-10T10:43:18.497361+0000","last_became_peered":"2023-08-10T10:43:18.497361+0000","last_unstale":"2023-08-10T10:43:20.609301+0000","last_undegraded":"2023-08-10T10:43:20.609301+0000","last_fullsized":"2023-08-10T10:43:20.609301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:26.795811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607582+0000","last_change":"2023-08-10T10:43:19.536147+0000","last_active":"2023-08-10T10:43:20.607582+0000","last_peered":"2023-08-10T10:43:20.607582+0000","last_clean":"2023-08-10T10:43:20.607582+0000","last_became_active":"2023-08-10T10:43:19.535311+0000","last_became_peered":"2023-08-10T10:43:19.535311+0000","last_unstale":"2023-08-10T10:43:20.607582+0000","last_undegraded":"2023-08-10T10:43:20.607582+0000","last_fullsized":"2023-08-10T10:43:20.607582+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:15.521475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529857+0000","last_change":"2023-08-10T10:43:18.500233+0000","last_active":"2023-08-10T10:43:20.529857+0000","last_peered":"2023-08-10T10:43:20.529857+0000","last_clean":"2023-08-10T10:43:20.529857+0000","last_became_active":"2023-08-10T10:43:18.499408+0000","last_became_peered":"2023-08-10T10:43:18.499408+0000","last_unstale":"2023-08-10T10:43:20.529857+0000","last_undegraded":"2023-08-10T10:43:20.529857+0000","last_fullsized":"2023-08-10T10:43:20.529857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:24.449717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608744+0000","last_change":"2023-08-10T10:43:19.542546+0000","last_active":"2023-08-10T10:43:20.608744+0000","last_peered":"2023-08-10T10:43:20.608744+0000","last_clean":"2023-08-10T10:43:20.608744+0000","last_became_active":"2023-08-10T10:43:19.541949+0000","last_became_peered":"2023-08-10T10:43:19.541949+0000","last_unstale":"2023-08-10T10:43:20.608744+0000","last_undegraded":"2023-08-10T10:43:20.608744+0000","last_fullsized":"2023-08-10T10:43:20.608744+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:45:04.244302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609022+0000","last_change":"2023-08-10T10:43:18.496648+0000","last_active":"2023-08-10T10:43:20.609022+0000","last_peered":"2023-08-10T10:43:20.609022+0000","last_clean":"2023-08-10T10:43:20.609022+0000","last_became_active":"2023-08-10T10:43:18.495819+0000","last_became_peered":"2023-08-10T10:43:18.495819+0000","last_unstale":"2023-08-10T10:43:20.609022+0000","last_undegraded":"2023-08-10T10:43:20.609022+0000","last_fullsized":"2023-08-10T10:43:20.609022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:01.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522152+0000","last_change":"2023-08-10T10:43:19.533199+0000","last_active":"2023-08-10T10:43:20.522152+0000","last_peered":"2023-08-10T10:43:20.522152+0000","last_clean":"2023-08-10T10:43:20.522152+0000","last_became_active":"2023-08-10T10:43:19.532764+0000","last_became_peered":"2023-08-10T10:43:19.532764+0000","last_unstale":"2023-08-10T10:43:20.522152+0000","last_undegraded":"2023-08-10T10:43:20.522152+0000","last_fullsized":"2023-08-10T10:43:20.522152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:23.357966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"91'3","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609288+0000","last_change":"2023-08-10T10:43:18.497986+0000","last_active":"2023-08-10T10:43:20.609288+0000","last_peered":"2023-08-10T10:43:20.609288+0000","last_clean":"2023-08-10T10:43:20.609288+0000","last_became_active":"2023-08-10T10:43:18.497488+0000","last_became_peered":"2023-08-10T10:43:18.497488+0000","last_unstale":"2023-08-10T10:43:20.609288+0000","last_undegraded":"2023-08-10T10:43:20.609288+0000","last_fullsized":"2023-08-10T10:43:20.609288+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:56:48.890620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610392+0000","last_change":"2023-08-10T10:43:19.540004+0000","last_active":"2023-08-10T10:43:20.610392+0000","last_peered":"2023-08-10T10:43:20.610392+0000","last_clean":"2023-08-10T10:43:20.610392+0000","last_became_active":"2023-08-10T10:43:19.537860+0000","last_became_peered":"2023-08-10T10:43:19.537860+0000","last_unstale":"2023-08-10T10:43:20.610392+0000","last_undegraded":"2023-08-10T10:43:20.610392+0000","last_fullsized":"2023-08-10T10:43:20.610392+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:40.545986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"91'6","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609344+0000","last_change":"2023-08-10T10:43:18.496931+0000","last_active":"2023-08-10T10:43:20.609344+0000","last_peered":"2023-08-10T10:43:20.609344+0000","last_clean":"2023-08-10T10:43:20.609344+0000","last_became_active":"2023-08-10T10:43:18.495485+0000","last_became_peered":"2023-08-10T10:43:18.495485+0000","last_unstale":"2023-08-10T10:43:20.609344+0000","last_undegraded":"2023-08-10T10:43:20.609344+0000","last_fullsized":"2023-08-10T10:43:20.609344+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:55.810614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608916+0000","last_change":"2023-08-10T10:43:19.543012+0000","last_active":"2023-08-10T10:43:20.608916+0000","last_peered":"2023-08-10T10:43:20.608916+0000","last_clean":"2023-08-10T10:43:20.608916+0000","last_became_active":"2023-08-10T10:43:19.542612+0000","last_became_peered":"2023-08-10T10:43:19.542612+0000","last_unstale":"2023-08-10T10:43:20.608916+0000","last_undegraded":"2023-08-10T10:43:20.608916+0000","last_fullsized":"2023-08-10T10:43:20.608916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:25.563203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609501+0000","last_change":"2023-08-10T10:43:18.482464+0000","last_active":"2023-08-10T10:43:20.609501+0000","last_peered":"2023-08-10T10:43:20.609501+0000","last_clean":"2023-08-10T10:43:20.609501+0000","last_became_active":"2023-08-10T10:43:18.481800+0000","last_became_peered":"2023-08-10T10:43:18.481800+0000","last_unstale":"2023-08-10T10:43:20.609501+0000","last_undegraded":"2023-08-10T10:43:20.609501+0000","last_fullsized":"2023-08-10T10:43:20.609501+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:29.131071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608734+0000","last_change":"2023-08-10T10:43:19.534037+0000","last_active":"2023-08-10T10:43:20.608734+0000","last_peered":"2023-08-10T10:43:20.608734+0000","last_clean":"2023-08-10T10:43:20.608734+0000","last_became_active":"2023-08-10T10:43:19.533349+0000","last_became_peered":"2023-08-10T10:43:19.533349+0000","last_unstale":"2023-08-10T10:43:20.608734+0000","last_undegraded":"2023-08-10T10:43:20.608734+0000","last_fullsized":"2023-08-10T10:43:20.608734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:43:43.833374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.530211+0000","last_change":"2023-08-10T10:43:18.500869+0000","last_active":"2023-08-10T10:43:20.530211+0000","last_peered":"2023-08-10T10:43:20.530211+0000","last_clean":"2023-08-10T10:43:20.530211+0000","last_became_active":"2023-08-10T10:43:18.500573+0000","last_became_peered":"2023-08-10T10:43:18.500573+0000","last_unstale":"2023-08-10T10:43:20.530211+0000","last_undegraded":"2023-08-10T10:43:20.530211+0000","last_fullsized":"2023-08-10T10:43:20.530211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:39.402729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610393+0000","last_change":"2023-08-10T10:43:19.532180+0000","last_active":"2023-08-10T10:43:20.610393+0000","last_peered":"2023-08-10T10:43:20.610393+0000","last_clean":"2023-08-10T10:43:20.610393+0000","last_became_active":"2023-08-10T10:43:19.531585+0000","last_became_peered":"2023-08-10T10:43:19.531585+0000","last_unstale":"2023-08-10T10:43:20.610393+0000","last_undegraded":"2023-08-10T10:43:20.610393+0000","last_fullsized":"2023-08-10T10:43:20.610393+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:37:36.163194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610001+0000","last_change":"2023-08-10T10:43:18.500281+0000","last_active":"2023-08-10T10:43:20.610001+0000","last_peered":"2023-08-10T10:43:20.610001+0000","last_clean":"2023-08-10T10:43:20.610001+0000","last_became_active":"2023-08-10T10:43:18.499877+0000","last_became_peered":"2023-08-10T10:43:18.499877+0000","last_unstale":"2023-08-10T10:43:20.610001+0000","last_undegraded":"2023-08-10T10:43:20.610001+0000","last_fullsized":"2023-08-10T10:43:20.610001+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:56.799937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609605+0000","last_change":"2023-08-10T10:43:19.518144+0000","last_active":"2023-08-10T10:43:20.609605+0000","last_peered":"2023-08-10T10:43:20.609605+0000","last_clean":"2023-08-10T10:43:20.609605+0000","last_became_active":"2023-08-10T10:43:19.517501+0000","last_became_peered":"2023-08-10T10:43:19.517501+0000","last_unstale":"2023-08-10T10:43:20.609605+0000","last_undegraded":"2023-08-10T10:43:20.609605+0000","last_fullsized":"2023-08-10T10:43:20.609605+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:18:42.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"91'8","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607711+0000","last_change":"2023-08-10T10:43:18.498878+0000","last_active":"2023-08-10T10:43:20.607711+0000","last_peered":"2023-08-10T10:43:20.607711+0000","last_clean":"2023-08-10T10:43:20.607711+0000","last_became_active":"2023-08-10T10:43:18.498638+0000","last_became_peered":"2023-08-10T10:43:18.498638+0000","last_unstale":"2023-08-10T10:43:20.607711+0000","last_undegraded":"2023-08-10T10:43:20.607711+0000","last_fullsized":"2023-08-10T10:43:20.607711+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:46.288793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.527199+0000","last_change":"2023-08-10T10:43:19.528580+0000","last_active":"2023-08-10T10:43:20.527199+0000","last_peered":"2023-08-10T10:43:20.527199+0000","last_clean":"2023-08-10T10:43:20.527199+0000","last_became_active":"2023-08-10T10:43:19.528134+0000","last_became_peered":"2023-08-10T10:43:19.528134+0000","last_unstale":"2023-08-10T10:43:20.527199+0000","last_undegraded":"2023-08-10T10:43:20.527199+0000","last_fullsized":"2023-08-10T10:43:20.527199+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:49.344042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609348+0000","last_change":"2023-08-10T10:43:18.488786+0000","last_active":"2023-08-10T10:43:20.609348+0000","last_peered":"2023-08-10T10:43:20.609348+0000","last_clean":"2023-08-10T10:43:20.609348+0000","last_became_active":"2023-08-10T10:43:18.488159+0000","last_became_peered":"2023-08-10T10:43:18.488159+0000","last_unstale":"2023-08-10T10:43:20.609348+0000","last_undegraded":"2023-08-10T10:43:20.609348+0000","last_fullsized":"2023-08-10T10:43:20.609348+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:51:20.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609083+0000","last_change":"2023-08-10T10:43:19.517972+0000","last_active":"2023-08-10T10:43:20.609083+0000","last_peered":"2023-08-10T10:43:20.609083+0000","last_clean":"2023-08-10T10:43:20.609083+0000","last_became_active":"2023-08-10T10:43:19.517365+0000","last_became_peered":"2023-08-10T10:43:19.517365+0000","last_unstale":"2023-08-10T10:43:20.609083+0000","last_undegraded":"2023-08-10T10:43:20.609083+0000","last_fullsized":"2023-08-10T10:43:20.609083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:54.470086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"92'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.607952+0000","last_change":"2023-08-10T10:43:18.496038+0000","last_active":"2023-08-10T10:43:20.607952+0000","last_peered":"2023-08-10T10:43:20.607952+0000","last_clean":"2023-08-10T10:43:20.607952+0000","last_became_active":"2023-08-10T10:43:18.495778+0000","last_became_peered":"2023-08-10T10:43:18.495778+0000","last_unstale":"2023-08-10T10:43:20.607952+0000","last_undegraded":"2023-08-10T10:43:20.607952+0000","last_fullsized":"2023-08-10T10:43:20.607952+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:33.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526790+0000","last_change":"2023-08-10T10:43:19.530940+0000","last_active":"2023-08-10T10:43:20.526790+0000","last_peered":"2023-08-10T10:43:20.526790+0000","last_clean":"2023-08-10T10:43:20.526790+0000","last_became_active":"2023-08-10T10:43:19.524296+0000","last_became_peered":"2023-08-10T10:43:19.524296+0000","last_unstale":"2023-08-10T10:43:20.526790+0000","last_undegraded":"2023-08-10T10:43:20.526790+0000","last_fullsized":"2023-08-10T10:43:20.526790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:18.978774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529601+0000","last_change":"2023-08-10T10:43:18.500463+0000","last_active":"2023-08-10T10:43:20.529601+0000","last_peered":"2023-08-10T10:43:20.529601+0000","last_clean":"2023-08-10T10:43:20.529601+0000","last_became_active":"2023-08-10T10:43:18.500161+0000","last_became_peered":"2023-08-10T10:43:18.500161+0000","last_unstale":"2023-08-10T10:43:20.529601+0000","last_undegraded":"2023-08-10T10:43:20.529601+0000","last_fullsized":"2023-08-10T10:43:20.529601+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:57.522196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608224+0000","last_change":"2023-08-10T10:43:19.536287+0000","last_active":"2023-08-10T10:43:20.608224+0000","last_peered":"2023-08-10T10:43:20.608224+0000","last_clean":"2023-08-10T10:43:20.608224+0000","last_became_active":"2023-08-10T10:43:19.535883+0000","last_became_peered":"2023-08-10T10:43:19.535883+0000","last_unstale":"2023-08-10T10:43:20.608224+0000","last_undegraded":"2023-08-10T10:43:20.608224+0000","last_fullsized":"2023-08-10T10:43:20.608224+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:08:49.086096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.530071+0000","last_change":"2023-08-10T10:43:18.499362+0000","last_active":"2023-08-10T10:43:20.530071+0000","last_peered":"2023-08-10T10:43:20.530071+0000","last_clean":"2023-08-10T10:43:20.530071+0000","last_became_active":"2023-08-10T10:43:18.498392+0000","last_became_peered":"2023-08-10T10:43:18.498392+0000","last_unstale":"2023-08-10T10:43:20.530071+0000","last_undegraded":"2023-08-10T10:43:20.530071+0000","last_fullsized":"2023-08-10T10:43:20.530071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:54.224182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610491+0000","last_change":"2023-08-10T10:43:19.516439+0000","last_active":"2023-08-10T10:43:20.610491+0000","last_peered":"2023-08-10T10:43:20.610491+0000","last_clean":"2023-08-10T10:43:20.610491+0000","last_became_active":"2023-08-10T10:43:19.515831+0000","last_became_peered":"2023-08-10T10:43:19.515831+0000","last_unstale":"2023-08-10T10:43:20.610491+0000","last_undegraded":"2023-08-10T10:43:20.610491+0000","last_fullsized":"2023-08-10T10:43:20.610491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:53:48.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610332+0000","last_change":"2023-08-10T10:43:18.497355+0000","last_active":"2023-08-10T10:43:20.610332+0000","last_peered":"2023-08-10T10:43:20.610332+0000","last_clean":"2023-08-10T10:43:20.610332+0000","last_became_active":"2023-08-10T10:43:18.496581+0000","last_became_peered":"2023-08-10T10:43:18.496581+0000","last_unstale":"2023-08-10T10:43:20.610332+0000","last_undegraded":"2023-08-10T10:43:20.610332+0000","last_fullsized":"2023-08-10T10:43:20.610332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:47.703209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608937+0000","last_change":"2023-08-10T10:43:19.538065+0000","last_active":"2023-08-10T10:43:20.608937+0000","last_peered":"2023-08-10T10:43:20.608937+0000","last_clean":"2023-08-10T10:43:20.608937+0000","last_became_active":"2023-08-10T10:43:19.537692+0000","last_became_peered":"2023-08-10T10:43:19.537692+0000","last_unstale":"2023-08-10T10:43:20.608937+0000","last_undegraded":"2023-08-10T10:43:20.608937+0000","last_fullsized":"2023-08-10T10:43:20.608937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:30:21.109473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610274+0000","last_change":"2023-08-10T10:43:18.500121+0000","last_active":"2023-08-10T10:43:20.610274+0000","last_peered":"2023-08-10T10:43:20.610274+0000","last_clean":"2023-08-10T10:43:20.610274+0000","last_became_active":"2023-08-10T10:43:18.499403+0000","last_became_peered":"2023-08-10T10:43:18.499403+0000","last_unstale":"2023-08-10T10:43:20.610274+0000","last_undegraded":"2023-08-10T10:43:20.610274+0000","last_fullsized":"2023-08-10T10:43:20.610274+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:10:53.614599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610277+0000","last_change":"2023-08-10T10:43:19.531281+0000","last_active":"2023-08-10T10:43:20.610277+0000","last_peered":"2023-08-10T10:43:20.610277+0000","last_clean":"2023-08-10T10:43:20.610277+0000","last_became_active":"2023-08-10T10:43:19.530909+0000","last_became_peered":"2023-08-10T10:43:19.530909+0000","last_unstale":"2023-08-10T10:43:20.610277+0000","last_undegraded":"2023-08-10T10:43:20.610277+0000","last_fullsized":"2023-08-10T10:43:20.610277+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:34.159574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609328+0000","last_change":"2023-08-10T10:43:18.490495+0000","last_active":"2023-08-10T10:43:20.609328+0000","last_peered":"2023-08-10T10:43:20.609328+0000","last_clean":"2023-08-10T10:43:20.609328+0000","last_became_active":"2023-08-10T10:43:18.489818+0000","last_became_peered":"2023-08-10T10:43:18.489818+0000","last_unstale":"2023-08-10T10:43:20.609328+0000","last_undegraded":"2023-08-10T10:43:20.609328+0000","last_fullsized":"2023-08-10T10:43:20.609328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:43.924710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609324+0000","last_change":"2023-08-10T10:43:19.539587+0000","last_active":"2023-08-10T10:43:20.609324+0000","last_peered":"2023-08-10T10:43:20.609324+0000","last_clean":"2023-08-10T10:43:20.609324+0000","last_became_active":"2023-08-10T10:43:19.539185+0000","last_became_peered":"2023-08-10T10:43:19.539185+0000","last_unstale":"2023-08-10T10:43:20.609324+0000","last_undegraded":"2023-08-10T10:43:20.609324+0000","last_fullsized":"2023-08-10T10:43:20.609324+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:15.521475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608858+0000","last_change":"2023-08-10T10:43:18.496455+0000","last_active":"2023-08-10T10:43:20.608858+0000","last_peered":"2023-08-10T10:43:20.608858+0000","last_clean":"2023-08-10T10:43:20.608858+0000","last_became_active":"2023-08-10T10:43:18.495615+0000","last_became_peered":"2023-08-10T10:43:18.495615+0000","last_unstale":"2023-08-10T10:43:20.608858+0000","last_undegraded":"2023-08-10T10:43:20.608858+0000","last_fullsized":"2023-08-10T10:43:20.608858+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:45:37.921454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529079+0000","last_change":"2023-08-10T10:43:19.540301+0000","last_active":"2023-08-10T10:43:20.529079+0000","last_peered":"2023-08-10T10:43:20.529079+0000","last_clean":"2023-08-10T10:43:20.529079+0000","last_became_active":"2023-08-10T10:43:19.539770+0000","last_became_peered":"2023-08-10T10:43:19.539770+0000","last_unstale":"2023-08-10T10:43:20.529079+0000","last_undegraded":"2023-08-10T10:43:20.529079+0000","last_fullsized":"2023-08-10T10:43:20.529079+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:33.669305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522407+0000","last_change":"2023-08-10T10:43:18.495023+0000","last_active":"2023-08-10T10:43:20.522407+0000","last_peered":"2023-08-10T10:43:20.522407+0000","last_clean":"2023-08-10T10:43:20.522407+0000","last_became_active":"2023-08-10T10:43:18.494233+0000","last_became_peered":"2023-08-10T10:43:18.494233+0000","last_unstale":"2023-08-10T10:43:20.522407+0000","last_undegraded":"2023-08-10T10:43:20.522407+0000","last_fullsized":"2023-08-10T10:43:20.522407+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:47.038221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":297,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529809+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:43:20.529809+0000","last_peered":"2023-08-10T10:43:20.529809+0000","last_clean":"2023-08-10T10:43:20.529809+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:43:20.529809+0000","last_undegraded":"2023-08-10T10:43:20.529809+0000","last_fullsized":"2023-08-10T10:43:20.529809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:46.612778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608872+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:43:20.608872+0000","last_peered":"2023-08-10T10:43:20.608872+0000","last_clean":"2023-08-10T10:43:20.608872+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:43:20.608872+0000","last_undegraded":"2023-08-10T10:43:20.608872+0000","last_fullsized":"2023-08-10T10:43:20.608872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:28.504983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608677+0000","last_change":"2023-08-10T10:43:19.527870+0000","last_active":"2023-08-10T10:43:20.608677+0000","last_peered":"2023-08-10T10:43:20.608677+0000","last_clean":"2023-08-10T10:43:20.608677+0000","last_became_active":"2023-08-10T10:43:19.527352+0000","last_became_peered":"2023-08-10T10:43:19.527352+0000","last_unstale":"2023-08-10T10:43:20.608677+0000","last_undegraded":"2023-08-10T10:43:20.608677+0000","last_fullsized":"2023-08-10T10:43:20.608677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:24.502114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522354+0000","last_change":"2023-08-10T10:43:18.496232+0000","last_active":"2023-08-10T10:43:20.522354+0000","last_peered":"2023-08-10T10:43:20.522354+0000","last_clean":"2023-08-10T10:43:20.522354+0000","last_became_active":"2023-08-10T10:43:18.495868+0000","last_became_peered":"2023-08-10T10:43:18.495868+0000","last_unstale":"2023-08-10T10:43:20.522354+0000","last_undegraded":"2023-08-10T10:43:20.522354+0000","last_fullsized":"2023-08-10T10:43:20.522354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:57.994945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529424+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:43:20.529424+0000","last_peered":"2023-08-10T10:43:20.529424+0000","last_clean":"2023-08-10T10:43:20.529424+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:43:20.529424+0000","last_undegraded":"2023-08-10T10:43:20.529424+0000","last_fullsized":"2023-08-10T10:43:20.529424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:49.695143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608579+0000","last_change":"2023-08-10T10:43:19.536139+0000","last_active":"2023-08-10T10:43:20.608579+0000","last_peered":"2023-08-10T10:43:20.608579+0000","last_clean":"2023-08-10T10:43:20.608579+0000","last_became_active":"2023-08-10T10:43:19.535795+0000","last_became_peered":"2023-08-10T10:43:19.535795+0000","last_unstale":"2023-08-10T10:43:20.608579+0000","last_undegraded":"2023-08-10T10:43:20.608579+0000","last_fullsized":"2023-08-10T10:43:20.608579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:52.405203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522325+0000","last_change":"2023-08-10T10:43:18.497509+0000","last_active":"2023-08-10T10:43:20.522325+0000","last_peered":"2023-08-10T10:43:20.522325+0000","last_clean":"2023-08-10T10:43:20.522325+0000","last_became_active":"2023-08-10T10:43:18.497189+0000","last_became_peered":"2023-08-10T10:43:18.497189+0000","last_unstale":"2023-08-10T10:43:20.522325+0000","last_undegraded":"2023-08-10T10:43:20.522325+0000","last_fullsized":"2023-08-10T10:43:20.522325+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:09:11.330196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609432+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:43:20.609432+0000","last_peered":"2023-08-10T10:43:20.609432+0000","last_clean":"2023-08-10T10:43:20.609432+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:43:20.609432+0000","last_undegraded":"2023-08-10T10:43:20.609432+0000","last_fullsized":"2023-08-10T10:43:20.609432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:30:24.716032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609968+0000","last_change":"2023-08-10T10:43:19.536377+0000","last_active":"2023-08-10T10:43:20.609968+0000","last_peered":"2023-08-10T10:43:20.609968+0000","last_clean":"2023-08-10T10:43:20.609968+0000","last_became_active":"2023-08-10T10:43:19.536022+0000","last_became_peered":"2023-08-10T10:43:19.536022+0000","last_unstale":"2023-08-10T10:43:20.609968+0000","last_undegraded":"2023-08-10T10:43:20.609968+0000","last_fullsized":"2023-08-10T10:43:20.609968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:41.815976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522542+0000","last_change":"2023-08-10T10:43:18.489760+0000","last_active":"2023-08-10T10:43:20.522542+0000","last_peered":"2023-08-10T10:43:20.522542+0000","last_clean":"2023-08-10T10:43:20.522542+0000","last_became_active":"2023-08-10T10:43:18.487951+0000","last_became_peered":"2023-08-10T10:43:18.487951+0000","last_unstale":"2023-08-10T10:43:20.522542+0000","last_undegraded":"2023-08-10T10:43:20.522542+0000","last_fullsized":"2023-08-10T10:43:20.522542+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:41:15.637803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609896+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:43:20.609896+0000","last_peered":"2023-08-10T10:43:20.609896+0000","last_clean":"2023-08-10T10:43:20.609896+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:43:20.609896+0000","last_undegraded":"2023-08-10T10:43:20.609896+0000","last_fullsized":"2023-08-10T10:43:20.609896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:03.271454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608053+0000","last_change":"2023-08-10T10:43:19.537746+0000","last_active":"2023-08-10T10:43:20.608053+0000","last_peered":"2023-08-10T10:43:20.608053+0000","last_clean":"2023-08-10T10:43:20.608053+0000","last_became_active":"2023-08-10T10:43:19.537296+0000","last_became_peered":"2023-08-10T10:43:19.537296+0000","last_unstale":"2023-08-10T10:43:20.608053+0000","last_undegraded":"2023-08-10T10:43:20.608053+0000","last_fullsized":"2023-08-10T10:43:20.608053+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:27.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609592+0000","last_change":"2023-08-10T10:43:18.493144+0000","last_active":"2023-08-10T10:43:20.609592+0000","last_peered":"2023-08-10T10:43:20.609592+0000","last_clean":"2023-08-10T10:43:20.609592+0000","last_became_active":"2023-08-10T10:43:18.492882+0000","last_became_peered":"2023-08-10T10:43:18.492882+0000","last_unstale":"2023-08-10T10:43:20.609592+0000","last_undegraded":"2023-08-10T10:43:20.609592+0000","last_fullsized":"2023-08-10T10:43:20.609592+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:18.311709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610992+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:43:20.610992+0000","last_peered":"2023-08-10T10:43:20.610992+0000","last_clean":"2023-08-10T10:43:20.610992+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:43:20.610992+0000","last_undegraded":"2023-08-10T10:43:20.610992+0000","last_fullsized":"2023-08-10T10:43:20.610992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:54.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522152+0000","last_change":"2023-08-10T10:43:19.542402+0000","last_active":"2023-08-10T10:43:20.522152+0000","last_peered":"2023-08-10T10:43:20.522152+0000","last_clean":"2023-08-10T10:43:20.522152+0000","last_became_active":"2023-08-10T10:43:19.542096+0000","last_became_peered":"2023-08-10T10:43:19.542096+0000","last_unstale":"2023-08-10T10:43:20.522152+0000","last_undegraded":"2023-08-10T10:43:20.522152+0000","last_fullsized":"2023-08-10T10:43:20.522152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:18.376244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.609432+0000","last_change":"2023-08-10T10:43:18.495645+0000","last_active":"2023-08-10T10:43:20.609432+0000","last_peered":"2023-08-10T10:43:20.609432+0000","last_clean":"2023-08-10T10:43:20.609432+0000","last_became_active":"2023-08-10T10:43:18.495305+0000","last_became_peered":"2023-08-10T10:43:18.495305+0000","last_unstale":"2023-08-10T10:43:20.609432+0000","last_undegraded":"2023-08-10T10:43:20.609432+0000","last_fullsized":"2023-08-10T10:43:20.609432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:55.782419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529233+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:43:20.529233+0000","last_peered":"2023-08-10T10:43:20.529233+0000","last_clean":"2023-08-10T10:43:20.529233+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:43:20.529233+0000","last_undegraded":"2023-08-10T10:43:20.529233+0000","last_fullsized":"2023-08-10T10:43:20.529233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:04.974869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.522230+0000","last_change":"2023-08-10T10:43:19.538196+0000","last_active":"2023-08-10T10:43:20.522230+0000","last_peered":"2023-08-10T10:43:20.522230+0000","last_clean":"2023-08-10T10:43:20.522230+0000","last_became_active":"2023-08-10T10:43:19.537884+0000","last_became_peered":"2023-08-10T10:43:19.537884+0000","last_unstale":"2023-08-10T10:43:20.522230+0000","last_undegraded":"2023-08-10T10:43:20.522230+0000","last_fullsized":"2023-08-10T10:43:20.522230+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:37:13.927353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.529048+0000","last_change":"2023-08-10T10:43:18.499296+0000","last_active":"2023-08-10T10:43:20.529048+0000","last_peered":"2023-08-10T10:43:20.529048+0000","last_clean":"2023-08-10T10:43:20.529048+0000","last_became_active":"2023-08-10T10:43:18.498236+0000","last_became_peered":"2023-08-10T10:43:18.498236+0000","last_unstale":"2023-08-10T10:43:20.529048+0000","last_undegraded":"2023-08-10T10:43:20.529048+0000","last_fullsized":"2023-08-10T10:43:20.529048+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:27.161892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610440+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:43:20.610440+0000","last_peered":"2023-08-10T10:43:20.610440+0000","last_clean":"2023-08-10T10:43:20.610440+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:43:20.610440+0000","last_undegraded":"2023-08-10T10:43:20.610440+0000","last_fullsized":"2023-08-10T10:43:20.610440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:44.724559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.608731+0000","last_change":"2023-08-10T10:43:19.539175+0000","last_active":"2023-08-10T10:43:20.608731+0000","last_peered":"2023-08-10T10:43:20.608731+0000","last_clean":"2023-08-10T10:43:20.608731+0000","last_became_active":"2023-08-10T10:43:19.538945+0000","last_became_peered":"2023-08-10T10:43:19.538945+0000","last_unstale":"2023-08-10T10:43:20.608731+0000","last_undegraded":"2023-08-10T10:43:20.608731+0000","last_fullsized":"2023-08-10T10:43:20.608731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:18.463746+0000","last_clean_scrub_stamp":"2023-08-10T10:43:18.463746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:22.271814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.526680+0000","last_change":"2023-08-10T10:43:18.489235+0000","last_active":"2023-08-10T10:43:20.526680+0000","last_peered":"2023-08-10T10:43:20.526680+0000","last_clean":"2023-08-10T10:43:20.526680+0000","last_became_active":"2023-08-10T10:43:18.488767+0000","last_became_peered":"2023-08-10T10:43:18.488767+0000","last_unstale":"2023-08-10T10:43:20.526680+0000","last_undegraded":"2023-08-10T10:43:20.526680+0000","last_fullsized":"2023-08-10T10:43:20.526680+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:17.458649+0000","last_clean_scrub_stamp":"2023-08-10T10:43:17.458649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:48.575331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-10T10:43:20.610598+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:43:20.610598+0000","last_peered":"2023-08-10T10:43:20.610598+0000","last_clean":"2023-08-10T10:43:20.610598+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:43:20.610598+0000","last_undegraded":"2023-08-10T10:43:20.610598+0000","last_fullsized":"2023-08-10T10:43:20.610598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:27.453897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1090,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194221,"statfs":{"total":200000000,"available":198883297,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0760000000000001,"15min":1.125},"min":{"1min":0.59299999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.661,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.669},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.141,"15min":1.069},"min":{"1min":0.89500000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.587,"5min":5.149,"15min":5.149},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.143,"15min":1.137},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5940000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.371},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.151,"15min":1.1319999999999999},"min":{"1min":0.82199999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.554,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":0.83599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.504,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.127},{"interface":"front","average":{"1min":1.28,"5min":1.216,"15min":1.24},"min":{"1min":0.72399999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.718,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.5269999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.81899999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.609,"5min":1.766,"15min":1.766},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.3320000000000001,"15min":1.3819999999999999},"min":{"1min":0.89200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.982,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.621}]},{"osd":4,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.86899999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.645,"5min":1.99,"15min":1.99},"last":1.161},{"interface":"front","average":{"1min":1.206,"5min":1.2849999999999999,"15min":1.2709999999999999},"min":{"1min":0.78700000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.653,"5min":6.657,"15min":6.657},"last":1.228}]},{"osd":5,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.421,"15min":1.4379999999999999},"min":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8540000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.476},{"interface":"front","average":{"1min":1.454,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":1.02,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.911,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.339}]},{"osd":6,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.512,"15min":1.5820000000000001},"min":{"1min":0.83399999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.8720000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.4690000000000001,"15min":1.5049999999999999},"min":{"1min":0.91900000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0950000000000002,"5min":3.585,"15min":3.585},"last":1.3240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199472123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.69999999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.667,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.069,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.002}]},{"osd":1,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0820000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.84599999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.895,"5min":1.96,"15min":1.96},"last":1.444}]},{"osd":2,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.167,"15min":1.123},"min":{"1min":0.84099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.135},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2629999999999999,"15min":1.2210000000000001},"min":{"1min":0.91200000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.2}]},{"osd":3,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2569999999999999,"15min":1.1950000000000001},"min":{"1min":0.96899999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.286,"15min":1.248},"min":{"1min":1.0169999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2729999999999999,"15min":1.2010000000000001},"min":{"1min":0.80900000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.571},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.401},"min":{"1min":1.1899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":2.6890000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.7130000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4730000000000001,"15min":1.397},"min":{"1min":1.1839999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.5109999999999999,"15min":1.4770000000000001},"min":{"1min":1.2110000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.7559999999999998,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.778}]},{"osd":7,"last update":"Thu Aug 10 10:43:20 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3859999999999999,"15min":1.3540000000000001},"min":{"1min":1.0129999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.6259999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.49},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.5409999999999999,"15min":1.474},"min":{"1min":1.1850000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.5819999999999999,"5min":2.698,"15min":2.698},"last":1.6679999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194799,"statfs":{"total":200000000,"available":199474672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.143,"15min":1.081},"min":{"1min":0.72299999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.581,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.349},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.1990000000000001},"min":{"1min":0.86399999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6200000000000001,"5min":32.941000000000003,"15min":32.941000000000003},"last":1.143}]},{"osd":1,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.1879999999999999,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.659,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.173,"15min":1.2210000000000001},"min":{"1min":0.83099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.2160000000000002,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.8360000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.268,"15min":1.3440000000000001},"min":{"1min":0.98299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6000000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.226,"15min":1.1599999999999999},"min":{"1min":0.84999999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.627,"5min":1.73,"15min":1.73},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.258,"15min":1.254},"min":{"1min":1.0580000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.734,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.502},{"interface":"front","average":{"1min":1.3,"5min":1.325,"15min":1.369},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5269999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":1.024}]},{"osd":4,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.236,"15min":1.2889999999999999},"min":{"1min":0.83299999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6930000000000001,"5min":2.399,"15min":2.399},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.397,"5min":1.3480000000000001,"15min":1.355},"min":{"1min":0.98399999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6970000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.29}]},{"osd":6,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.363,"15min":1.3100000000000001},"min":{"1min":1.0189999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.776,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.776},{"interface":"front","average":{"1min":1.403,"5min":1.4159999999999999,"15min":1.3819999999999999},"min":{"1min":1.079,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6439999999999999,"5min":1.98,"15min":1.98},"last":1.079}]},{"osd":7,"last update":"Thu Aug 10 10:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4690000000000001,"15min":1.4830000000000001},"min":{"1min":1.2270000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6839999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.498,"15min":1.4850000000000001},"min":{"1min":1.3009999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.714,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.714}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":515,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194796,"statfs":{"total":200000000,"available":199472019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.157,"15min":1.139},"min":{"1min":0.748,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.73999999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.47}]},{"osd":1,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2110000000000001,"15min":1.2829999999999999},"min":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.75,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1319999999999999},"min":{"1min":0.73299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.085}]},{"osd":2,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.159,"15min":1.143},"min":{"1min":0.76900000000000002,"5min":0.621,"15min":0.621},"max":{"1min":4.4969999999999999,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2629999999999999,"15min":1.2829999999999999},"min":{"1min":0.92200000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":3.9780000000000002},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.242,"15min":1.2410000000000001},"min":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.175},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.29,"15min":1.27},"min":{"1min":0.93300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":4.6859999999999999,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.306}]},{"osd":5,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.353},"min":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.754,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.84599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.26}]},{"osd":6,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.3300000000000001,"15min":1.3220000000000001},"min":{"1min":0.91900000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.135},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4630000000000001,"15min":1.4570000000000001},"min":{"1min":0.86699999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":1.591}]},{"osd":7,"last update":"Thu Aug 10 10:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.4219999999999999,"15min":1.4099999999999999},"min":{"1min":0.91700000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.351},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.516,"15min":1.5},"min":{"1min":0.96699999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.423}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194797,"statfs":{"total":200000000,"available":199473105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92400000000000004,"15min":0.81000000000000005},"min":{"1min":0.68500000000000005,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.629,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.0920000000000001,"15min":0.95199999999999996},"min":{"1min":1.0249999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.78,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.92100000000000004,"15min":0.81999999999999995},"min":{"1min":0.74399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5209999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.022,"15min":0.91000000000000003},"min":{"1min":0.71699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.752,"5min":1.897,"15min":1.897},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0329999999999999,"15min":0.92300000000000004},"min":{"1min":0.76400000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.651,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.329,"5min":1.1819999999999999,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.958,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.3089999999999999,"15min":1.2070000000000001},"min":{"1min":1.1699999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.357,"5min":1.2569999999999999,"15min":1.1890000000000001},"min":{"1min":0.80600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3919999999999999,"15min":1.3120000000000001},"min":{"1min":1.129,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":2.125,"15min":2.125},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.405,"15min":1.347},"min":{"1min":1.228,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.849,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.21}]},{"osd":6,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.341,"15min":1.2509999999999999},"min":{"1min":1.1619999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1920000000000002,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.4650000000000001,"15min":1.389},"min":{"1min":1.212,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8360000000000001,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.115}]},{"osd":7,"last update":"Thu Aug 10 10:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.4690000000000001,"15min":1.417},"min":{"1min":1.431,"5min":0.754,"15min":0.754},"max":{"1min":1.8160000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.421,"15min":1.327},"min":{"1min":1.2509999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.0189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194797,"statfs":{"total":200000000,"available":199472945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85899999999999999,"15min":0.871},"min":{"1min":0.58499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.306,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93600000000000005,"15min":0.878},"min":{"1min":0.44900000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4179999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.0289999999999999},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8009999999999999,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.548},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7170000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.071}]},{"osd":3,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96099999999999997,"15min":0.999},"min":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.621,"5min":1.639,"15min":1.639},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.181,"15min":1.244},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.863,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3759999999999999,"15min":1.415},"min":{"1min":0.92300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.601,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.756},{"interface":"front","average":{"1min":1.327,"5min":1.3009999999999999,"15min":1.2909999999999999},"min":{"1min":0.88100000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6579999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.268,"15min":1.26},"min":{"1min":0.85099999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.7969999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.498},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4319999999999999,"15min":1.4650000000000001},"min":{"1min":0.876,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.8089999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.879}]},{"osd":6,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4079999999999999,"15min":1.3660000000000001},"min":{"1min":1.042,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0680000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.446},{"interface":"front","average":{"1min":1.427,"5min":1.3500000000000001,"15min":1.3380000000000001},"min":{"1min":0.86499999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.089,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.6040000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:43:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.4379999999999999,"15min":1.3839999999999999},"min":{"1min":0.87,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.657},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.421,"15min":1.4079999999999999},"min":{"1min":0.95099999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2240000000000002,"5min":2.444,"15min":2.444},"last":1.706}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194798,"statfs":{"total":200000000,"available":199473575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81899999999999995},"min":{"1min":0.621,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.052,"5min":0.95299999999999996,"15min":0.93400000000000005},"min":{"1min":0.626,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.012,"5min":2.246,"15min":2.246},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96199999999999997,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.436,"15min":0.436},"max":{"1min":1.669,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.202},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.175,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7589999999999999,"5min":2.423,"15min":2.423},"last":1.3859999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1040000000000001,"15min":1.03},"min":{"1min":0.80700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.532,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.302},{"interface":"front","average":{"1min":1.081,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.66200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.512,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.23,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4890000000000001,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.4219999999999999,"15min":1.373},"min":{"1min":1.1890000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.4870000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3939999999999999,"15min":1.3520000000000001},"min":{"1min":1.159,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9299999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.373,"15min":1.2949999999999999},"min":{"1min":1.1379999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9710000000000001,"5min":2.73,"15min":2.73},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.387,"15min":1.347},"min":{"1min":1.1719999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.9219999999999999,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.3180000000000001,"15min":1.234},"min":{"1min":1.0269999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6799999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.3480000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:43:16 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4399999999999999,"15min":1.4239999999999999},"min":{"1min":1.1719999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8420000000000001,"5min":2.742,"15min":2.742},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.4530000000000001,"15min":1.377},"min":{"1min":1.1399999999999999,"5min":0.625,"15min":0.625},"max":{"1min":2.1190000000000002,"5min":2.605,"15min":2.605},"last":1.4239999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1089,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194222,"statfs":{"total":200000000,"available":198884338,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.94399999999999995,"15min":0.96599999999999997},"min":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4330000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.093},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.052,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.607,"5min":1.853,"15min":1.853},"last":1.399}]},{"osd":2,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.55100000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4239999999999999,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0389999999999999,"15min":1.0209999999999999},"min":{"1min":0.59799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.006,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7969999999999999,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.21,"5min":1.135,"15min":1.105},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.756,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.351,"15min":1.268},"min":{"1min":0.88800000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.77,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4390000000000001,"15min":1.395},"min":{"1min":1.0629999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.919,"5min":2.536,"15min":2.536},"last":1.45}]},{"osd":5,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.3560000000000001,"15min":1.377},"min":{"1min":0.85899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8799999999999999,"5min":1.986,"15min":1.986},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.514,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.873,"5min":16.058,"15min":16.058},"last":1.55}]},{"osd":6,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.46,"15min":1.454},"min":{"1min":0.92700000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.121,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.4279999999999999,"15min":1.4299999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.016,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.835}]},{"osd":7,"last update":"Thu Aug 10 10:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.512,"15min":1.528},"min":{"1min":1.018,"5min":0.752,"15min":0.752},"max":{"1min":1.927,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.482,"15min":1.4139999999999999},"min":{"1min":0.877,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.0139999999999998,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.323}]}]}],"pool_statfs":[]}} 2023-08-10T10:43:24.601 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:43:24.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:43:24.687 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-08-10T10:43:24.687+0000 7fa250b26640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:43:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.881+0000 7f811823f640 1 Processor -- start 2023-08-10T10:43:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 -- start start 2023-08-10T10:43:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f811015cb90 0x7f81100b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f811015cf70 0x7f8110160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8110160a40 con 0x7f81100b4640 2023-08-10T10:43:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100b4bb0 con 0x7f811015cb90 2023-08-10T10:43:24.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f811823f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100b4e90 con 0x7f811015cf70 2023-08-10T10:43:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f81167dc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81100b4640 0x7f811006fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43502/0 (socket says 172.21.15.50:43502) 2023-08-10T10:43:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f81167dc640 1 -- 172.21.15.50:0/612497164 learned_addr learned my addr 172.21.15.50:0/612497164 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.882+0000 7f8115fdb640 1 --2- 172.21.15.50:0/612497164 >> v2:172.21.15.50:3300/0 conn(0x7f811015cb90 0x7f81100b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f81157da640 1 --2- 172.21.15.50:0/612497164 >> v2:172.21.15.117:3300/0 conn(0x7f811015cf70 0x7f8110160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8114fd9640 1 -- 172.21.15.50:0/612497164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203257480 0 0) 0x7f8110160a40 con 0x7f81100b4640 2023-08-10T10:43:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8114fd9640 1 -- 172.21.15.50:0/612497164 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc003520 con 0x7f81100b4640 2023-08-10T10:43:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8115fdb640 1 -- 172.21.15.50:0/612497164 >> v2:172.21.15.117:3300/0 conn(0x7f811015cf70 msgr2=0x7f8110160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8115fdb640 1 --2- 172.21.15.50:0/612497164 >> v2:172.21.15.117:3300/0 conn(0x7f811015cf70 0x7f8110160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8115fdb640 1 -- 172.21.15.50:0/612497164 >> v1:172.21.15.50:6789/0 conn(0x7f81100b4640 legacy=0x7f811006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.883+0000 7f8115fdb640 1 -- 172.21.15.50:0/612497164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100b5170 con 0x7f811015cb90 2023-08-10T10:43:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.884+0000 7f8115fdb640 1 --2- 172.21.15.50:0/612497164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100b5dd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f81100d2b70 tx=0x7f810c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad30c89c06ea83f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.885+0000 7f8114fd9640 1 -- 172.21.15.50:0/612497164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c031830 con 0x7f811015cb90 2023-08-10T10:43:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.885+0000 7f8114fd9640 1 -- 172.21.15.50:0/612497164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c031990 con 0x7f811015cb90 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.885+0000 7f8114fd9640 1 -- 172.21.15.50:0/612497164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c031d00 con 0x7f811015cb90 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.885+0000 7f811823f640 1 -- 172.21.15.50:0/612497164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 msgr2=0x7f81100b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.885+0000 7f811823f640 1 --2- 172.21.15.50:0/612497164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100b5dd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f81100d2b70 tx=0x7f810c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 -- 172.21.15.50:0/612497164 shutdown_connections 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 --2- 172.21.15.50:0/612497164 >> v2:172.21.15.117:3300/0 conn(0x7f811015cf70 0x7f8110160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 --2- 172.21.15.50:0/612497164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100b5dd0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 -- 172.21.15.50:0/612497164 >> 172.21.15.50:0/612497164 conn(0x7f81100cf640 msgr2=0x7f81100cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 -- 172.21.15.50:0/612497164 shutdown_connections 2023-08-10T10:43:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.886+0000 7f811823f640 1 -- 172.21.15.50:0/612497164 wait complete. 2023-08-10T10:43:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.887+0000 7f811823f640 1 Processor -- start 2023-08-10T10:43:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 -- start start 2023-08-10T10:43:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 0x7f811014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f811015cf70 0x7f8110154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100c8d50 con 0x7f811015cb90 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110154dd0 con 0x7f81100b4640 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.888+0000 7f811823f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81101537f0 con 0x7f811015cf70 2023-08-10T10:43:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46046/0 (socket says 172.21.15.50:46046) 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 -- 172.21.15.50:0/268209804 learned_addr learned my addr 172.21.15.50:0/268209804 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f8115fdb640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 0x7f811014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 -- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f811015cf70 msgr2=0x7f8110154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f811015cf70 0x7f8110154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 -- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 msgr2=0x7f811014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 0x7f811014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f81157da640 1 -- 172.21.15.50:0/268209804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009400 con 0x7f811015cb90 2023-08-10T10:43:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.889+0000 7f8115fdb640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 0x7f811014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f81157da640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f810000d5f0 tx=0x7f810000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000125f0 con 0x7f811015cb90 2023-08-10T10:43:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100012750 con 0x7f811015cb90 2023-08-10T10:43:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100012b00 con 0x7f811015cb90 2023-08-10T10:43:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8110153ad0 con 0x7f811015cb90 2023-08-10T10:43:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.890+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110154090 con 0x7f811015cb90 2023-08-10T10:43:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.891+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100612b0 con 0x7f811015cb90 2023-08-10T10:43:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.892+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8100012c60 con 0x7f811015cb90 2023-08-10T10:43:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.893+0000 7f81067fc640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 0x7f80f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.893+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81000899b0 con 0x7f811015cb90 2023-08-10T10:43:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.894+0000 7f8115fdb640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 0x7f80f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.894+0000 7f8115fdb640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 0x7f80f406d110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f810c036000 tx=0x7f810c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:24.898+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8100054a60 con 0x7f811015cb90 2023-08-10T10:43:25.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.158+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f81100d0a10 con 0x7f811015cb90 2023-08-10T10:43:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.167+0000 7f81067fc640 1 -- 172.21.15.50:0/268209804 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8100058080 con 0x7f811015cb90 2023-08-10T10:43:25.168 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:43:25.168 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:43:25.169 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:43:25.169 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:43:25.169 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:43:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:43:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 msgr2=0x7f80f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 0x7f80f406d110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f810c036000 tx=0x7f810c008030 comp rx=0 tx=0).stop 2023-08-10T10:43:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 msgr2=0x7f81100c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f810000d5f0 tx=0x7f810000dab0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 shutdown_connections 2023-08-10T10:43:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f811015cf70 0x7f8110154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f811015cb90 0x7f81100c8810 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f80f406ac50 0x7f80f406d110 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 --2- 172.21.15.50:0/268209804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b4640 0x7f811014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 >> 172.21.15.50:0/268209804 conn(0x7f81100cf640 msgr2=0x7f81101579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 shutdown_connections 2023-08-10T10:43:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.170+0000 7f811823f640 1 -- 172.21.15.50:0/268209804 wait complete. 2023-08-10T10:43:25.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.412+0000 7f0c6370f640 1 Processor -- start 2023-08-10T10:43:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.412+0000 7f0c6370f640 1 -- start start 2023-08-10T10:43:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.414+0000 7f0c6370f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c5c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.414+0000 7f0c6370f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c5c0b2f40 0x7f0c5c06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.414+0000 7f0c6370f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c06f6f0 con 0x7f0c5c069be0 2023-08-10T10:43:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.414+0000 7f0c6370f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c1617f0 con 0x7f0c5c0b2f40 2023-08-10T10:43:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.414+0000 7f0c6370f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c06a020 con 0x7f0c5c0c1af0 2023-08-10T10:43:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c60caa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c5c069be0 0x7f0c5c0b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43514/0 (socket says 172.21.15.50:43514) 2023-08-10T10:43:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c60caa640 1 -- 172.21.15.50:0/874386608 learned_addr learned my addr 172.21.15.50:0/874386608 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c61cac640 1 --2- 172.21.15.50:0/874386608 >> v2:172.21.15.117:3300/0 conn(0x7f0c5c0b2f40 0x7f0c5c06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c614ab640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c5c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623941619 0 0) 0x7f0c5c06f6f0 con 0x7f0c5c069be0 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.415+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c48003520 con 0x7f0c5c069be0 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 467389880 0 0) 0x7f0c48003520 con 0x7f0c5c069be0 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 msgr2=0x7f0c5c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c5c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 >> v2:172.21.15.117:3300/0 conn(0x7f0c5c0b2f40 msgr2=0x7f0c5c06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 --2- 172.21.15.50:0/874386608 >> v2:172.21.15.117:3300/0 conn(0x7f0c5c0b2f40 0x7f0c5c06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c06edc0 con 0x7f0c5c069be0 2023-08-10T10:43:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0c4c001670 con 0x7f0c5c069be0 2023-08-10T10:43:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 >> v1:172.21.15.50:6789/0 conn(0x7f0c5c069be0 legacy=0x7f0c5c0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c48004d00 0x7f0c48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c1617f0 con 0x7f0c48003970 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c06a020 con 0x7f0c48004d00 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800b980 con 0x7f0c5c0c1af0 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c614ab640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.416+0000 7f0c60caa640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c614ab640 1 -- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 msgr2=0x7f0c480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c614ab640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c614ab640 1 -- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c48004d00 msgr2=0x7f0c48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c614ab640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c48004d00 0x7f0c48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c614ab640 1 -- 172.21.15.50:0/874386608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48003520 con 0x7f0c48003970 2023-08-10T10:43:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.417+0000 7f0c60caa640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c0c1af0 0x7f0c480047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.418+0000 7f0c614ab640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c48003d90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ac0 tx=0x7f0c480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef7c2cfdc528762 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.418+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5802c6b0 con 0x7f0c48003970 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.418+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5802c810 con 0x7f0c48003970 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.418+0000 7f0c53fff640 1 -- 172.21.15.50:0/874386608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5802cba0 con 0x7f0c48003970 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 -- 172.21.15.50:0/874386608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 msgr2=0x7f0c48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 --2- 172.21.15.50:0/874386608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c48003d90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ac0 tx=0x7f0c480057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c61cac640 1 -- 172.21.15.50:0/874386608 reap_dead start 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 -- 172.21.15.50:0/874386608 shutdown_connections 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 -- 172.21.15.50:0/874386608 >> 172.21.15.50:0/874386608 conn(0x7f0c5c06b590 msgr2=0x7f0c5c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 -- 172.21.15.50:0/874386608 shutdown_connections 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.419+0000 7f0c6370f640 1 -- 172.21.15.50:0/874386608 wait complete. 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.421+0000 7f0c6370f640 1 Processor -- start 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.421+0000 7f0c6370f640 1 -- start start 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1fa010 0x7f0c5c0c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 0x7f0c5c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c1594e0 con 0x7f0c48003970 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0c26b0 con 0x7f0c5c1fa470 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c6370f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0c2990 con 0x7f0c5c1fa010 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c614ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c614ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46070/0 (socket says 172.21.15.50:46070) 2023-08-10T10:43:25.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c614ab640 1 -- 172.21.15.50:0/1847725687 learned_addr learned my addr 172.21.15.50:0/1847725687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c60caa640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1fa010 0x7f0c5c0c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c614ab640 1 -- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1fa010 msgr2=0x7f0c5c0c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.422+0000 7f0c614ab640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1fa010 0x7f0c5c0c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c61cac640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 0x7f0c5c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c614ab640 1 -- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 msgr2=0x7f0c5c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c614ab640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 0x7f0c5c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c614ab640 1 -- 172.21.15.50:0/1847725687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0c2c70 con 0x7f0c48003970 2023-08-10T10:43:25.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c61cac640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 0x7f0c5c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c614ab640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ac0 tx=0x7f0c58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58003810 con 0x7f0c48003970 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58003970 con 0x7f0c48003970 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c0c2f50 con 0x7f0c48003970 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.423+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58003d00 con 0x7f0c48003970 2023-08-10T10:43:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.424+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c0c39b0 con 0x7f0c48003970 2023-08-10T10:43:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.425+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c04e270 con 0x7f0c48003970 2023-08-10T10:43:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.425+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c58040450 con 0x7f0c48003970 2023-08-10T10:43:25.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.426+0000 7f0c51ffb640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 0x7f0c4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.427+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c580ab450 con 0x7f0c48003970 2023-08-10T10:43:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.427+0000 7f0c60caa640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 0x7f0c4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.427+0000 7f0c60caa640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 0x7f0c4006d110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0017a0 tx=0x7f0c4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.431+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0c58076610 con 0x7f0c48003970 2023-08-10T10:43:25.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.663+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c5c161210 con 0x7f0c48003970 2023-08-10T10:43:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.664+0000 7f0c51ffb640 1 -- 172.21.15.50:0/1847725687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f0c580044e0 con 0x7f0c48003970 2023-08-10T10:43:25.665 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:25.665 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:43:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:43:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 msgr2=0x7f0c4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 0x7f0c4006d110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0017a0 tx=0x7f0c4c009040 comp rx=0 tx=0).stop 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 msgr2=0x7f0c5c161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ac0 tx=0x7f0c58004730 comp rx=0 tx=0).stop 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 shutdown_connections 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c4006ac50 0x7f0c4006d110 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1fa470 0x7f0c5c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1fa010 0x7f0c5c0c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 --2- 172.21.15.50:0/1847725687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c48003970 0x7f0c5c161930 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 >> 172.21.15.50:0/1847725687 conn(0x7f0c5c06b590 msgr2=0x7f0c5c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 shutdown_connections 2023-08-10T10:43:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:25.667+0000 7f0c6370f640 1 -- 172.21.15.50:0/1847725687 wait complete. 2023-08-10T10:43:26.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:43:18.975711+0000', 'modified': '2023-08-10T10:43:22.559311+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6579}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6579': {'gid': 6579, 'name': 'd', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6834/3885575175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6832', 'nonce': 3885575175}, {'type': 'v1', 'addr': '172.21.15.117:6834', 'nonce': 3885575175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:43:26.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:43:26.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-10T10:43:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.315+0000 7f5fa284d640 1 Processor -- start 2023-08-10T10:43:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.315+0000 7f5fa284d640 1 -- start start 2023-08-10T10:43:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5fa284d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f9c15ce00 0x7f5f9c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5fa284d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c0b5af0 0x7f5f9c0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5fa284d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c0d1220 con 0x7f5f9c0cd730 2023-08-10T10:43:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5fa284d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0d2930 con 0x7f5f9c15ce00 2023-08-10T10:43:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5fa284d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0b8a30 con 0x7f5f9c0b5af0 2023-08-10T10:43:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5f9bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f9c0cd730 0x7f5f9c0cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43518/0 (socket says 172.21.15.50:43518) 2023-08-10T10:43:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.316+0000 7f5f9bfff640 1 -- 172.21.15.50:0/670226333 learned_addr learned my addr 172.21.15.50:0/670226333 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f937fe640 1 --2- 172.21.15.50:0/670226333 >> v2:172.21.15.50:3300/0 conn(0x7f5f9c15ce00 0x7f5f9c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c0b5af0 0x7f5f9c0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f937fe640 1 -- 172.21.15.50:0/670226333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c0b5af0 msgr2=0x7f5f9c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/670226333 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606543865 0 0) 0x7f5f9c0d1220 con 0x7f5f9c0cd730 2023-08-10T10:43:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f937fe640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c0b5af0 0x7f5f9c0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f937fe640 1 -- 172.21.15.50:0/670226333 >> v1:172.21.15.50:6789/0 conn(0x7f5f9c0cd730 legacy=0x7f5f9c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.317+0000 7f5f937fe640 1 -- 172.21.15.50:0/670226333 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0b1e70 con 0x7f5f9c15ce00 2023-08-10T10:43:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.318+0000 7f5f937fe640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c15ce00 0x7f5f9c0d23f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7245955c238cfe0d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.318+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/670226333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8402cc50 con 0x7f5f9c15ce00 2023-08-10T10:43:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.318+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/670226333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8402cdb0 con 0x7f5f9c15ce00 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.318+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/670226333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84034660 con 0x7f5f9c15ce00 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 -- 172.21.15.50:0/670226333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c15ce00 msgr2=0x7f5f9c0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c15ce00 0x7f5f9c0d23f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8402bea0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 -- 172.21.15.50:0/670226333 shutdown_connections 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c15ce00 0x7f5f9c0d23f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 --2- 172.21.15.50:0/670226333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c0b5af0 0x7f5f9c0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 -- 172.21.15.50:0/670226333 >> 172.21.15.50:0/670226333 conn(0x7f5f9c0d2c60 msgr2=0x7f5f9c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 -- 172.21.15.50:0/670226333 shutdown_connections 2023-08-10T10:43:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.319+0000 7f5fa284d640 1 -- 172.21.15.50:0/670226333 wait complete. 2023-08-10T10:43:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.321+0000 7f5fa284d640 1 Processor -- start 2023-08-10T10:43:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.321+0000 7f5fa284d640 1 -- start start 2023-08-10T10:43:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 0x7f5f9c151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c15ce00 0x7f5f9c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c15f230 con 0x7f5f9c0cd730 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c15f510 con 0x7f5f9c0b5af0 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.322+0000 7f5fa284d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c15f7f0 con 0x7f5f9c15ce00 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46086/0 (socket says 172.21.15.50:46086) 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 -- 172.21.15.50:0/1624418261 learned_addr learned my addr 172.21.15.50:0/1624418261 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 0x7f5f9c151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 -- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c15ce00 msgr2=0x7f5f9c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c15ce00 0x7f5f9c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 -- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 msgr2=0x7f5f9c151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 0x7f5f9c151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f937fe640 1 -- 172.21.15.50:0/1624418261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009a70 con 0x7f5f9c0cd730 2023-08-10T10:43:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.323+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 0x7f5f9c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:26.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5f937fe640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5f997fa640 1 -- 172.21.15.50:0/1624418261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84040650 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5f997fa640 1 -- 172.21.15.50:0/1624418261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f840407b0 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5f997fa640 1 -- 172.21.15.50:0/1624418261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84040b60 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c15fad0 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.324+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c15ee50 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.327+0000 7f5f997fa640 1 -- 172.21.15.50:0/1624418261 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f84040cc0 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.327+0000 7f5f997fa640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 0x7f5f7c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.328+0000 7f5f997fa640 1 -- 172.21.15.50:0/1624418261 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f840ac3e0 con 0x7f5f9c0cd730 2023-08-10T10:43:26.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.328+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 0x7f5f7c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.329+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 0x7f5f7c06d110 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c000f60 tx=0x7f5f8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.329+0000 7f5fa53c5740 1 Processor -- start 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.329+0000 7f5fa53c5740 1 -- start start 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 0x5589a113c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a113cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a107f9d0 con 0x5589a113f4c0 2023-08-10T10:43:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a107d0c0 con 0x5589a110f440 2023-08-10T10:43:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a10789b0 con 0x5589a1113040 2023-08-10T10:43:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46100/0 (socket says 172.21.15.50:46100) 2023-08-10T10:43:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3949854878 learned_addr learned my addr 172.21.15.50:0/3949854878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a113cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f937fe640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 0x5589a113c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 msgr2=0x5589a113cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a113cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 msgr2=0x5589a113c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.330+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 0x5589a113c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3949854878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a1045c10 con 0x5589a113f4c0 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f937fe640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 0x5589a113c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007360 tx=0x7f5f8c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f0ffd9ac9999d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f91ffb640 1 -- 172.21.15.50:0/3949854878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00dbb0 con 0x5589a113f4c0 2023-08-10T10:43:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f91ffb640 1 -- 172.21.15.50:0/3949854878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00dd10 con 0x5589a113f4c0 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.331+0000 7f5f91ffb640 1 -- 172.21.15.50:0/3949854878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c020650 con 0x5589a113f4c0 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3949854878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 msgr2=0x5589a113f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007360 tx=0x7f5f8c010000 comp rx=0 tx=0).stop 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3949854878 shutdown_connections 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a113cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a110f440 0x5589a113c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3949854878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a113f8a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3949854878 >> 172.21.15.50:0/3949854878 conn(0x5589a1111750 msgr2=0x5589a115a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3949854878 shutdown_connections 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.332+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3949854878 wait complete. 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.333+0000 7f5fa53c5740 1 -- start start 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.333+0000 7f5fa53c5740 1 Processor -- start 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a1139260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a11397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a1019940 con 0x5589a1113040 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a10195e0 con 0x5589a113f4c0 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a0ddff20 con 0x5589a11381c0 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5fa53c5740 10 client.0 _ll_register_callbacks cb 0x5589a1072250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46102/0 (socket says 172.21.15.50:46102) 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.334+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3109551374 learned_addr learned my addr 172.21.15.50:0/3109551374 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a11397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 msgr2=0x5589a11397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a11397a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 msgr2=0x5589a1139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a1139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 -- 172.21.15.50:0/3109551374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c0070d0 con 0x5589a1113040 2023-08-10T10:43:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0226a0 tx=0x7f5f8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611874bb94d0633 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:43:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c027070 con 0x5589a1113040 2023-08-10T10:43:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a10a2bf0 con 0x5589a1113040 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.335+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f8c00de80 con 0x5589a1113040 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f8c0222e0 con 0x5589a1113040 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 10 client.6720 fetch_fsmap learned FSMap version 42 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5589a1077030 con 0x5589a1113040 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589a10a2bf0 con 0x5589a1113040 2023-08-10T10:43:26.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f8c022880 con 0x5589a1113040 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 10 client.6720 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 10 client.6720 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 20 client.6720 populate_metadata read hostname 'smithi050' 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a116ebb0 0x5589a1135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 4 client.6720 mds_command: new command op to 6579 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.336+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 --> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589a106b7c0 con 0x5589a116ebb0 2023-08-10T10:43:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.337+0000 7f5f937fe640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a116ebb0 0x5589a1135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.338+0000 7f5f937fe640 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a116ebb0 0x5589a1135190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6cb820d7a644fb0 server_cookie=84ca5841edaae52 in_seq=0 out_seq=0 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.338+0000 7f5f7affd640 10 client.6720 ms_handle_connect on v2:172.21.15.117:6832/3885575175 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5f7affd640 1 -- 172.21.15.50:0/3109551374 <== mds.0 v2:172.21.15.117:6832/3885575175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5589a106b7c0 con 0x5589a116ebb0 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5f7affd640 10 client.6720 handle_command_reply: tid=0 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 client.6720 shutdown 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 msgr2=0x5589a113fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0226a0 tx=0x7f5f8c012000 comp rx=0 tx=0).stop 2023-08-10T10:43:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 shutdown_connections 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a116ebb0 0x5589a1135190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a11397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a1139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3109551374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a113fe00 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 >> 172.21.15.50:0/3109551374 conn(0x5589a110f440 msgr2=0x5589a1113a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5f7affd640 0 client.6720 ms_handle_reset on v2:172.21.15.117:6832/3885575175 2023-08-10T10:43:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 shutdown_connections 2023-08-10T10:43:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.340+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3109551374 wait complete. 2023-08-10T10:43:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.341+0000 7f5fa53c5740 20 client.6720 trim_cache size 0 max 16384 2023-08-10T10:43:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.357+0000 7f5fa53c5740 1 Processor -- start 2023-08-10T10:43:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.357+0000 7f5fa53c5740 1 -- start start 2023-08-10T10:43:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a11381c0 0x5589a11385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a115d980 con 0x5589a113f4c0 2023-08-10T10:43:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a11408c0 con 0x5589a11381c0 2023-08-10T10:43:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.358+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a113bfc0 con 0x5589a1113040 2023-08-10T10:43:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46112/0 (socket says 172.21.15.50:46112) 2023-08-10T10:43:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 -- 172.21.15.50:0/3315802839 learned_addr learned my addr 172.21.15.50:0/3315802839 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 -- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 msgr2=0x5589a11391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5f937fe640 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a11381c0 0x5589a11385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 -- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a11381c0 msgr2=0x5589a11385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a11381c0 0x5589a11385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 -- 172.21.15.50:0/3315802839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a10ac8a0 con 0x5589a113f4c0 2023-08-10T10:43:26.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.359+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009850 tx=0x7f5f94009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5bb5f494a1557 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5f927fc640 1 -- 172.21.15.50:0/3315802839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94011b70 con 0x5589a113f4c0 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5f927fc640 1 -- 172.21.15.50:0/3315802839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400c050 con 0x5589a113f4c0 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5f927fc640 1 -- 172.21.15.50:0/3315802839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94015420 con 0x5589a113f4c0 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3315802839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 msgr2=0x5589a1138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009850 tx=0x7f5f94009d10 comp rx=0 tx=0).stop 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3315802839 shutdown_connections 2023-08-10T10:43:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a113f4c0 0x5589a1138ae0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a11381c0 0x5589a11385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/3315802839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3315802839 >> 172.21.15.50:0/3315802839 conn(0x5589a110f440 msgr2=0x5589a110e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3315802839 shutdown_connections 2023-08-10T10:43:26.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.360+0000 7f5fa53c5740 1 -- 172.21.15.50:0/3315802839 wait complete. 2023-08-10T10:43:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.361+0000 7f5fa53c5740 1 -- start start 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.361+0000 7f5fa53c5740 1 Processor -- start 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a1139700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a115bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a1138fd0 con 0x5589a1113040 2023-08-10T10:43:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a11c3840 con 0x5589a113f4c0 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a1138b40 con 0x5589a11381c0 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.362+0000 7f5fa53c5740 10 client.0 _ll_register_callbacks cb 0x7f5f8c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46124/0 (socket says 172.21.15.50:46124) 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 -- 172.21.15.50:0/2499071942 learned_addr learned my addr 172.21.15.50:0/2499071942 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 -- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 msgr2=0x5589a1139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a1139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 -- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 msgr2=0x5589a115bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5fa0dea640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a115bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a115bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 -- 172.21.15.50:0/2499071942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940094d0 con 0x5589a1113040 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f9bfff640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c02c6a0 tx=0x7f5f8c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36408c22b65f2611 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.363+0000 7f5f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c02cc90 con 0x5589a1113040 2023-08-10T10:43:26.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f8c022d90 con 0x5589a1113040 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f8c00dd10 con 0x5589a1113040 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f8c0222e0 con 0x5589a1113040 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 10 client.6726 fetch_fsmap learned FSMap version 42 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5589a1018610 con 0x5589a1113040 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00dd10 con 0x5589a1113040 2023-08-10T10:43:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f8c020450 con 0x5589a1113040 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 10 client.6726 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 10 client.6726 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 20 client.6726 populate_metadata read hostname 'smithi050' 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a113b4f0 0x5589a115c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 4 client.6726 mds_command: new command op to 6579 tid=0[{"prefix": "status"}] 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.364+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 --> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589a1071990 con 0x5589a113b4f0 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.365+0000 7f5f937fe640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a113b4f0 0x5589a115c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.366+0000 7f5f937fe640 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a113b4f0 0x5589a115c210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d78b773caff34b server_cookie=502a383ac6fbcae2 in_seq=0 out_seq=0 2023-08-10T10:43:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.366+0000 7f5f7affd640 10 client.6726 ms_handle_connect on v2:172.21.15.117:6832/3885575175 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5f7affd640 1 -- 172.21.15.50:0/2499071942 <== mds.0 v2:172.21.15.117:6832/3885575175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5589a1071990 con 0x5589a113b4f0 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5f7affd640 10 client.6726 handle_command_reply: tid=0 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 client.6726 shutdown 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 msgr2=0x5589a11391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c02c6a0 tx=0x7f5f8c001080 comp rx=0 tx=0).stop 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 shutdown_connections 2023-08-10T10:43:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:6832/3885575175,v1:172.21.15.117:6834/3885575175] conn(0x5589a113b4f0 0x5589a115c210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589a113f4c0 0x5589a115bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589a11381c0 0x5589a1139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 --2- 172.21.15.50:0/2499071942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589a1113040 0x5589a11391c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5f7affd640 0 client.6726 ms_handle_reset on v2:172.21.15.117:6832/3885575175 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 >> 172.21.15.50:0/2499071942 conn(0x5589a110f440 msgr2=0x5589a115dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 shutdown_connections 2023-08-10T10:43:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 1 -- 172.21.15.50:0/2499071942 wait complete. 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.367+0000 7f5fa53c5740 20 client.6726 trim_cache size 0 max 16384 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6579, 2023-08-10T10:43:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.8226838470000004, 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 42, 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 92, 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 92, 2023-08-10T10:43:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.437629412 2023-08-10T10:43:26.377 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:43:26.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 msgr2=0x7f5f7c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 0x7f5f7c06d110 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c000f60 tx=0x7f5f8c009040 comp rx=0 tx=0).stop 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 msgr2=0x7f5f9c15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f84004a40 comp rx=0 tx=0).stop 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 shutdown_connections 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f9c15ce00 0x7f5f9c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c0cd730 0x7f5f9c15d1e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f7c06ac50 0x7f5f7c06d110 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 --2- 172.21.15.50:0/1624418261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9c0b5af0 0x7f5f9c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 >> 172.21.15.50:0/1624418261 conn(0x7f5f9c0d2c60 msgr2=0x7f5f9c15c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 shutdown_connections 2023-08-10T10:43:26.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.368+0000 7f5fa284d640 1 -- 172.21.15.50:0/1624418261 wait complete. 2023-08-10T10:43:26.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:43:26.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.624+0000 7f7f72386640 1 Processor -- start 2023-08-10T10:43:26.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.624+0000 7f7f72386640 1 -- start start 2023-08-10T10:43:26.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f72386640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f6c0b2370 0x7f7f6c0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f72386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f72386640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c1596e0 con 0x7f7f6c0b1510 2023-08-10T10:43:26.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f72386640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c90b0 con 0x7f7f6c0b2370 2023-08-10T10:43:26.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f72386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c9390 con 0x7f7f6c069f30 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f6bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f6c0b2370 0x7f7f6c0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f6bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f6c0b2370 0x7f7f6c0ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46126/0 (socket says 172.21.15.50:46126) 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.626+0000 7f7f6bfff640 1 -- 172.21.15.50:0/4216110332 learned_addr learned my addr 172.21.15.50:0/4216110332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.627+0000 7f7f6bfff640 1 -- 172.21.15.50:0/4216110332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 msgr2=0x7f7f6c0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.627+0000 7f7f6bfff640 1 --2- 172.21.15.50:0/4216110332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.627+0000 7f7f6bfff640 1 -- 172.21.15.50:0/4216110332 >> v1:172.21.15.117:6789/0 conn(0x7f7f6c0b1510 legacy=0x7f7f6c06f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.627+0000 7f7f6bfff640 1 -- 172.21.15.50:0/4216110332 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0c9670 con 0x7f7f6c0b2370 2023-08-10T10:43:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.628+0000 7f7f6bfff640 1 --2- 172.21.15.50:0/4216110332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c0ca150 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009e50 tx=0x7f7f5c02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbb6ca28cc64539 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.628+0000 7f7f6affd640 1 -- 172.21.15.50:0/4216110332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c02ec90 con 0x7f7f6c0b2370 2023-08-10T10:43:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.628+0000 7f7f6affd640 1 -- 172.21.15.50:0/4216110332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c02edf0 con 0x7f7f6c0b2370 2023-08-10T10:43:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.628+0000 7f7f6affd640 1 -- 172.21.15.50:0/4216110332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c036610 con 0x7f7f6c0b2370 2023-08-10T10:43:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 -- 172.21.15.50:0/4216110332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b2370 msgr2=0x7f7f6c0ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 --2- 172.21.15.50:0/4216110332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c0ca150 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009e50 tx=0x7f7f5c02e0f0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 -- 172.21.15.50:0/4216110332 shutdown_connections 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 --2- 172.21.15.50:0/4216110332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 --2- 172.21.15.50:0/4216110332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c0ca150 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 -- 172.21.15.50:0/4216110332 >> 172.21.15.50:0/4216110332 conn(0x7f7f6c06b590 msgr2=0x7f7f6c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 -- 172.21.15.50:0/4216110332 shutdown_connections 2023-08-10T10:43:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.629+0000 7f7f72386640 1 -- 172.21.15.50:0/4216110332 wait complete. 2023-08-10T10:43:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.631+0000 7f7f72386640 1 Processor -- start 2023-08-10T10:43:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.631+0000 7f7f72386640 1 -- start start 2023-08-10T10:43:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1f25c0 con 0x7f7f6c0b1510 2023-08-10T10:43:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c156de0 con 0x7f7f6c0b2370 2023-08-10T10:43:26.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.632+0000 7f7f72386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c153270 con 0x7f7f6c069f30 2023-08-10T10:43:26.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46140/0 (socket says 172.21.15.50:46140) 2023-08-10T10:43:26.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 -- 172.21.15.50:0/3889816049 learned_addr learned my addr 172.21.15.50:0/3889816049 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6bfff640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f70923640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 -- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 msgr2=0x7f7f6c152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 -- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c0b2370 msgr2=0x7f7f6c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.633+0000 7f7f6b7fe640 1 -- 172.21.15.50:0/3889816049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c009b30 con 0x7f7f6c0b1510 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f6b7fe640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400b450 tx=0x7f7f5400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011890 con 0x7f7f6c0b1510 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540119f0 con 0x7f7f6c0b1510 2023-08-10T10:43:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011da0 con 0x7f7f6c0b1510 2023-08-10T10:43:26.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c1561b0 con 0x7f7f6c0b1510 2023-08-10T10:43:26.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.634+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c156770 con 0x7f7f6c0b1510 2023-08-10T10:43:26.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.635+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c156f50 con 0x7f7f6c0b1510 2023-08-10T10:43:26.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.636+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f5401a400 con 0x7f7f6c0b1510 2023-08-10T10:43:26.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.638+0000 7f7f68ff9640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 0x7f7f4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:26.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.638+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f54089910 con 0x7f7f6c0b1510 2023-08-10T10:43:26.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.638+0000 7f7f6bfff640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 0x7f7f4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:26.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.639+0000 7f7f6bfff640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 0x7f7f4c06d110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c037000 tx=0x7f7f5c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.644+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f54054920 con 0x7f7f6c0b1510 2023-08-10T10:43:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.875+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f6c04e270 con 0x7f7f6c0b1510 2023-08-10T10:43:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.876+0000 7f7f68ff9640 1 -- 172.21.15.50:0/3889816049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f54015070 con 0x7f7f6c0b1510 2023-08-10T10:43:26.876 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:43:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 msgr2=0x7f7f4c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 0x7f7f4c06d110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c037000 tx=0x7f7f5c032000 comp rx=0 tx=0).stop 2023-08-10T10:43:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 msgr2=0x7f7f6c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400b450 tx=0x7f7f5400b910 comp rx=0 tx=0).stop 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 shutdown_connections 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f4c06ac50 0x7f7f4c06d110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c0b2370 0x7f7f6c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f6c0b1510 0x7f7f6c0c4760 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 --2- 172.21.15.50:0/3889816049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c069f30 0x7f7f6c152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.878+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 >> 172.21.15.50:0/3889816049 conn(0x7f7f6c06b590 msgr2=0x7f7f6c154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.879+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 shutdown_connections 2023-08-10T10:43:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:26.879+0000 7f7f72386640 1 -- 172.21.15.50:0/3889816049 wait complete. 2023-08-10T10:43:26.898 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:43:26.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:43:26.899 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:43:26.899 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:43:26.899 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:43:26.900 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:43:26.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:43:26.900 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:43:26.900 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:43:26.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:26.901 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:43:26.954 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:43:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:43:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:43:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:43:26.955 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:43:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40919sec preferred_lft 40919sec 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:43:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:43:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.959 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:43:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:43:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:43:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:26.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:26.961 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:43:27.056 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:43:27.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.061 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:43:27.116 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:43:27.116 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:43:27.117 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:43:27.117 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:43:27.117 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:43:27.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.118 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:43:27.118 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:43:27.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:43:27.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:43:27.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:43:27.120 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:43:27.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.318 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:43:27.374 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:43:27.374 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:43:27.375 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:43:27.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:43:27.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:43:27.482 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:43:27.540 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:43:27.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:43:27.541 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:43:27.595 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:43:27.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:27.748 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:27.749 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:43:27.784 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:27.785 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:43:27.785 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:43:27.785 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:43:27.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:43:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:43:27.788 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:43:27.789 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:43:27.789 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:43:27.789 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:43:27.792 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:43:27.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:43:27.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:27.888 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:43:27.950 INFO:teuthology.orchestra.run.smithi050.stdout:client5396 2023-08-10T10:43:27.951 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:43:27.951 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:28.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:43:28.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.235+0000 7f629536b640 1 Processor -- start 2023-08-10T10:43:28.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.236+0000 7f629536b640 1 -- start start 2023-08-10T10:43:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.237+0000 7f629536b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f629015aa40 0x7f62900b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.237+0000 7f629536b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 0x7f62900b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.237+0000 7f629536b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6290071c70 con 0x7f6290070e80 2023-08-10T10:43:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.237+0000 7f629536b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900713d0 con 0x7f629015aa40 2023-08-10T10:43:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.237+0000 7f629536b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900716b0 con 0x7f62900b0c60 2023-08-10T10:43:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f628f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6290070e80 0x7f62900696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43520/0 (socket says 172.21.15.50:43520) 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f628f7fe640 1 -- 172.21.15.50:0/3456124114 learned_addr learned my addr 172.21.15.50:0/3456124114 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f628effd640 1 --2- 172.21.15.50:0/3456124114 >> v2:172.21.15.117:3300/0 conn(0x7f629015aa40 0x7f62900b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f6287fff640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 0x7f62900b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959382222 0 0) 0x7f6290071c70 con 0x7f6290070e80 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.238+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c003520 con 0x7f6290070e80 2023-08-10T10:43:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3842264844 0 0) 0x7f627c003520 con 0x7f6290070e80 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 msgr2=0x7f62900b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 0x7f62900b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 >> v2:172.21.15.117:3300/0 conn(0x7f629015aa40 msgr2=0x7f62900b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 --2- 172.21.15.50:0/3456124114 >> v2:172.21.15.117:3300/0 conn(0x7f629015aa40 0x7f62900b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290071990 con 0x7f6290070e80 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f62880019f0 con 0x7f6290070e80 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 >> v1:172.21.15.50:6789/0 conn(0x7f6290070e80 legacy=0x7f62900696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627c003970 0x7f627c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c0047c0 0x7f627c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 0x7f627c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900713d0 con 0x7f627c003970 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900716b0 con 0x7f627c0047c0 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00b980 con 0x7f62900b0c60 2023-08-10T10:43:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f628effd640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627c003970 0x7f627c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.239+0000 7f6287fff640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c0047c0 0x7f627c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f628effd640 1 -- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 msgr2=0x7f627c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f628effd640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62900b0c60 0x7f627c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f628effd640 1 -- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c0047c0 msgr2=0x7f627c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f628effd640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c0047c0 0x7f627c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f628effd640 1 -- 172.21.15.50:0/3456124114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c003520 con 0x7f627c003970 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.240+0000 7f6287fff640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c0047c0 0x7f627c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.241+0000 7f628effd640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627c003970 0x7f627c003d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6280009af0 tx=0x7f627c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7280fbd11ca8dd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.241+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628002c710 con 0x7f627c003970 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.241+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628002c870 con 0x7f627c003970 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.241+0000 7f628e7fc640 1 -- 172.21.15.50:0/3456124114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628002cc00 con 0x7f627c003970 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 -- 172.21.15.50:0/3456124114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627c003970 msgr2=0x7f627c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 --2- 172.21.15.50:0/3456124114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f627c003970 0x7f627c003d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6280009af0 tx=0x7f627c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f628f7fe640 1 -- 172.21.15.50:0/3456124114 reap_dead start 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 -- 172.21.15.50:0/3456124114 shutdown_connections 2023-08-10T10:43:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 -- 172.21.15.50:0/3456124114 >> 172.21.15.50:0/3456124114 conn(0x7f629006b590 msgr2=0x7f62900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 -- 172.21.15.50:0/3456124114 shutdown_connections 2023-08-10T10:43:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.242+0000 7f629536b640 1 -- 172.21.15.50:0/3456124114 wait complete. 2023-08-10T10:43:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.244+0000 7f629536b640 1 Processor -- start 2023-08-10T10:43:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.244+0000 7f629536b640 1 -- start start 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 0x7f6290149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6290158740 0x7f6290158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629014a300 con 0x7f62900c7f90 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290159100 con 0x7f627c003970 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f629536b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900c7b00 con 0x7f6290158740 2023-08-10T10:43:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f6287fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f6287fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46156/0 (socket says 172.21.15.50:46156) 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f6287fff640 1 -- 172.21.15.50:0/1092900366 learned_addr learned my addr 172.21.15.50:0/1092900366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.245+0000 7f628effd640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 0x7f6290149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f628f7fe640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6290158740 0x7f6290158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 -- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6290158740 msgr2=0x7f6290158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6290158740 0x7f6290158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 -- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 msgr2=0x7f6290149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 0x7f6290149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 -- 172.21.15.50:0/1092900366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900c6c50 con 0x7f62900c7f90 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f628effd640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 0x7f6290149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f6287fff640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f62780108e0 tx=0x7f6278010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800ebc0 con 0x7f62900c7f90 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800ed20 con 0x7f62900c7f90 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900c6ef0 con 0x7f62900c7f90 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627801c600 con 0x7f62900c7f90 2023-08-10T10:43:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.246+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900c74b0 con 0x7f62900c7f90 2023-08-10T10:43:28.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.248+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629004e270 con 0x7f62900c7f90 2023-08-10T10:43:28.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.249+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f627801c760 con 0x7f62900c7f90 2023-08-10T10:43:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.250+0000 7f62877fe640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 0x7f627006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.250+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6278089b10 con 0x7f62900c7f90 2023-08-10T10:43:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.250+0000 7f628effd640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 0x7f627006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.251+0000 7f628effd640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 0x7f627006d110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6280036000 tx=0x7f6280030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.254+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6278058700 con 0x7f62900c7f90 2023-08-10T10:43:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.490+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62900c7c40 con 0x7f62900c7f90 2023-08-10T10:43:28.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.490+0000 7f62877fe640 1 -- 172.21.15.50:0/1092900366 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6278058290 con 0x7f62900c7f90 2023-08-10T10:43:28.491 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 msgr2=0x7f627006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 0x7f627006d110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6280036000 tx=0x7f6280030000 comp rx=0 tx=0).stop 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 msgr2=0x7f62901540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f62780108e0 tx=0x7f6278010da0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 shutdown_connections 2023-08-10T10:43:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6290158740 0x7f6290158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62900c7f90 0x7f62901540f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f627006ac50 0x7f627006d110 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 --2- 172.21.15.50:0/1092900366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627c003970 0x7f6290149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 >> 172.21.15.50:0/1092900366 conn(0x7f629006b590 msgr2=0x7f62900cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 shutdown_connections 2023-08-10T10:43:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:28.493+0000 7f629536b640 1 -- 172.21.15.50:0/1092900366 wait complete. 2023-08-10T10:43:28.513 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:43:28.513 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:43:28.513 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:43:28.514 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:43:28.514 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:43:28.514 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:43:28.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:43:28.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:43:28.515 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:43:28.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.516 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:43:28.578 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:43:28.579 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41089sec preferred_lft 41089sec 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:43:28.580 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:43:28.581 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:43:28.582 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:43:28.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.584 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:43:28.673 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:43:28.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.678 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:43:28.734 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:43:28.735 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:43:28.735 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:43:28.735 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:43:28.735 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:43:28.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.736 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:43:28.736 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:43:28.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:43:28.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:43:28.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:43:28.737 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:43:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.924 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:43:28.974 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:43:28.975 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:43:28.975 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:43:28.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:28.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:43:29.052 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:43:29.053 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:43:29.100 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:43:29.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:43:29.100 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:43:29.196 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:43:29.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:29.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:29.337 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:29.337 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:43:29.367 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:43:29.367 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:43:29.367 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:43:29.368 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:43:29.368 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:43:29.369 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:43:29.369 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:43:29.369 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:43:29.370 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:43:29.370 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:43:29.372 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:43:29.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:29.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:43:29.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:43:29.452 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:43:29.504 INFO:teuthology.orchestra.run.smithi117.stdout:client5402 2023-08-10T10:43:29.505 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:43:29.505 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:43:29.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:43:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.793+0000 7f14923b5640 1 Processor -- start 2023-08-10T10:43:29.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.793+0000 7f14923b5640 1 -- start start 2023-08-10T10:43:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f14923b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c15aa40 0x7f148c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f14923b5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f148c0b0c60 0x7f148c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f14923b5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c071c70 con 0x7f148c070e80 2023-08-10T10:43:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f14923b5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0713d0 con 0x7f148c0b0c60 2023-08-10T10:43:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f14923b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0716b0 con 0x7f148c15aa40 2023-08-10T10:43:29.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f148c0b0c60 0x7f148c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f148c0b0c60 0x7f148c0b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46164/0 (socket says 172.21.15.50:46164) 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148b7fe640 1 -- 172.21.15.50:0/3719623048 learned_addr learned my addr 172.21.15.50:0/3719623048 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148bfff640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c15aa40 0x7f148c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148b7fe640 1 -- 172.21.15.50:0/3719623048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c15aa40 msgr2=0x7f148c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.795+0000 7f148b7fe640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c15aa40 0x7f148c0b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:29.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.796+0000 7f148b7fe640 1 -- 172.21.15.50:0/3719623048 >> v1:172.21.15.117:6789/0 conn(0x7f148c070e80 legacy=0x7f148c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:43:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.796+0000 7f148b7fe640 1 -- 172.21.15.50:0/3719623048 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c071990 con 0x7f148c0b0c60 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.797+0000 7f148b7fe640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c0b0c60 0x7f148c0b3d60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7e596b5a489be6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.797+0000 7f148affd640 1 -- 172.21.15.50:0/3719623048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800317c0 con 0x7f148c0b0c60 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.797+0000 7f148affd640 1 -- 172.21.15.50:0/3719623048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480031920 con 0x7f148c0b0c60 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.797+0000 7f148affd640 1 -- 172.21.15.50:0/3719623048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480031cb0 con 0x7f148c0b0c60 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 -- 172.21.15.50:0/3719623048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c0b0c60 msgr2=0x7f148c0b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c0b0c60 0x7f148c0b3d60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148002b860 comp rx=0 tx=0).stop 2023-08-10T10:43:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 -- 172.21.15.50:0/3719623048 shutdown_connections 2023-08-10T10:43:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c0b0c60 0x7f148c0b3d60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 --2- 172.21.15.50:0/3719623048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c15aa40 0x7f148c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 -- 172.21.15.50:0/3719623048 >> 172.21.15.50:0/3719623048 conn(0x7f148c06b590 msgr2=0x7f148c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 -- 172.21.15.50:0/3719623048 shutdown_connections 2023-08-10T10:43:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.798+0000 7f14923b5640 1 -- 172.21.15.50:0/3719623048 wait complete. 2023-08-10T10:43:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.800+0000 7f14923b5640 1 Processor -- start 2023-08-10T10:43:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.800+0000 7f14923b5640 1 -- start start 2023-08-10T10:43:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c070e80 0x7f148c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 0x7f148c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0c5830 con 0x7f148c15aa40 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0c5b10 con 0x7f148c070e80 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f14923b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0c5df0 con 0x7f148c0b0c60 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f1490952640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f1490952640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46178/0 (socket says 172.21.15.50:46178) 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.801+0000 7f1490952640 1 -- 172.21.15.50:0/2934586998 learned_addr learned my addr 172.21.15.50:0/2934586998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f148b7fe640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 0x7f148c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 -- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 msgr2=0x7f148c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f148bfff640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c070e80 0x7f148c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 0x7f148c0b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 -- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c070e80 msgr2=0x7f148c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c070e80 0x7f148c0aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 -- 172.21.15.50:0/2934586998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800094d0 con 0x7f148c15aa40 2023-08-10T10:43:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f148b7fe640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 0x7f148c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1490952640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f148400c780 tx=0x7f148400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484004b60 con 0x7f148c15aa40 2023-08-10T10:43:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400ce90 con 0x7f148c15aa40 2023-08-10T10:43:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c0c60d0 con 0x7f148c15aa40 2023-08-10T10:43:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400a850 con 0x7f148c15aa40 2023-08-10T10:43:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.802+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c0b04c0 con 0x7f148c15aa40 2023-08-10T10:43:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.804+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c0c65f0 con 0x7f148c15aa40 2023-08-10T10:43:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.805+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f148400a9b0 con 0x7f148c15aa40 2023-08-10T10:43:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.805+0000 7f1488ff9640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 0x7f147806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.806+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1484089710 con 0x7f148c15aa40 2023-08-10T10:43:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.806+0000 7f148bfff640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 0x7f147806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.806+0000 7f148bfff640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 0x7f147806d110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b7c0 tx=0x7f147c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:29.810+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1484054720 con 0x7f148c15aa40 2023-08-10T10:43:30.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.037+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f148c04e270 con 0x7f148c15aa40 2023-08-10T10:43:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.039+0000 7f1488ff9640 1 -- 172.21.15.50:0/2934586998 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f1484087e60 con 0x7f148c15aa40 2023-08-10T10:43:30.040 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:43:30.040 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:43:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:43:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.041+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 msgr2=0x7f147806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.041+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 0x7f147806d110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b7c0 tx=0x7f147c008040 comp rx=0 tx=0).stop 2023-08-10T10:43:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.041+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 msgr2=0x7f148c0b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.041+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f148400c780 tx=0x7f148400cc40 comp rx=0 tx=0).stop 2023-08-10T10:43:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 shutdown_connections 2023-08-10T10:43:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f148c15aa40 0x7f148c0b2cd0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f148c0b0c60 0x7f148c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f147806ac50 0x7f147806d110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 --2- 172.21.15.50:0/2934586998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c070e80 0x7f148c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 >> 172.21.15.50:0/2934586998 conn(0x7f148c06b590 msgr2=0x7f148c0cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 shutdown_connections 2023-08-10T10:43:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:43:30.042+0000 7f14923b5640 1 -- 172.21.15.50:0/2934586998 wait complete. 2023-08-10T10:43:30.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-10T10:43:30.296 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":6579,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.735700078000001,"mdsmap_epoch":42,"osdmap_epoch":92,"osdmap_epoch_barrier":92,"uptime":17.350685058} 2023-08-10T10:43:30.297 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 6579, "mdsmap_epoch": 42, "osdmap_epoch": 92, "osdmap_epoch_barrier": 92, "rank_uptime": 10.735700078, "state": "up:active", "uptime": 17.350685058, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:43:30.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:43:30.551 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:43:30.551 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:43:30.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-10T10:43:30.790 INFO:teuthology.orchestra.run.smithi050.stdout:{"mon_tick_interval":"5"} 2023-08-10T10:43:30.790 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-10T10:43:30.790 INFO:tasks.cephfs.test_full:pool capacity 556930624, 531MB should be enough to fill it 2023-08-10T10:43:30.791 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:43:30.791 DEBUG:teuthology.orchestra.run.smithi050:> import time 2023-08-10T10:43:30.791 DEBUG:teuthology.orchestra.run.smithi050:> import datetime 2023-08-10T10:43:30.792 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-08-10T10:43:30.792 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:43:30.792 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.793 DEBUG:teuthology.orchestra.run.smithi050:> # Write some buffered data through before going full, all should be well 2023-08-10T10:43:30.793 DEBUG:teuthology.orchestra.run.smithi050:> print("writing some data through which we expect to succeed") 2023-08-10T10:43:30.793 DEBUG:teuthology.orchestra.run.smithi050:> bytes = 0 2023-08-10T10:43:30.793 DEBUG:teuthology.orchestra.run.smithi050:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-10T10:43:30.794 DEBUG:teuthology.orchestra.run.smithi050:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-10T10:43:30.794 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-08-10T10:43:30.794 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:43:30.795 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-10T10:43:30.795 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.795 DEBUG:teuthology.orchestra.run.smithi050:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-10T10:43:30.796 DEBUG:teuthology.orchestra.run.smithi050:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-10T10:43:30.796 DEBUG:teuthology.orchestra.run.smithi050:> # buffered IO, the error should always only appear from fsync and not 2023-08-10T10:43:30.796 DEBUG:teuthology.orchestra.run.smithi050:> # from write 2023-08-10T10:43:30.797 DEBUG:teuthology.orchestra.run.smithi050:> full = False 2023-08-10T10:43:30.797 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.797 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(531 * 1.1)): 2023-08-10T10:43:30.798 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:43:30.798 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:43:30.798 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote bytes via buffered write, moving on to fsync") 2023-08-10T10:43:30.798 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-08-10T10:43:30.799 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2023-08-10T10:43:30.799 DEBUG:teuthology.orchestra.run.smithi050:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-08-10T10:43:30.799 DEBUG:teuthology.orchestra.run.smithi050:> raise 2023-08-10T10:43:30.799 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:43:30.800 DEBUG:teuthology.orchestra.run.smithi050:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:43:30.800 DEBUG:teuthology.orchestra.run.smithi050:> full = True 2023-08-10T10:43:30.800 DEBUG:teuthology.orchestra.run.smithi050:> break 2023-08-10T10:43:30.800 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.801 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:43:30.801 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:43:30.801 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed successfully") 2023-08-10T10:43:30.802 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-08-10T10:43:30.802 DEBUG:teuthology.orchestra.run.smithi050:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:43:30.802 DEBUG:teuthology.orchestra.run.smithi050:> full = True 2023-08-10T10:43:30.802 DEBUG:teuthology.orchestra.run.smithi050:> break 2023-08-10T10:43:30.803 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:43:30.803 DEBUG:teuthology.orchestra.run.smithi050:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:43:30.803 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.803 DEBUG:teuthology.orchestra.run.smithi050:> if n > 531 * 0.9: 2023-08-10T10:43:30.804 DEBUG:teuthology.orchestra.run.smithi050:> # Be cautious in the last region where we expect to hit 2023-08-10T10:43:30.804 DEBUG:teuthology.orchestra.run.smithi050:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-08-10T10:43:30.804 DEBUG:teuthology.orchestra.run.smithi050:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-10T10:43:30.805 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(15.0) 2023-08-10T10:43:30.805 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.805 DEBUG:teuthology.orchestra.run.smithi050:> if not full: 2023-08-10T10:43:30.805 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-08-10T10:43:30.806 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.806 DEBUG:teuthology.orchestra.run.smithi050:> # close() should not raise an error because we already caught it in 2023-08-10T10:43:30.807 DEBUG:teuthology.orchestra.run.smithi050:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-08-10T10:43:30.807 DEBUG:teuthology.orchestra.run.smithi050:> # since then because all IOs got cancelled on the full flag. 2023-08-10T10:43:30.807 DEBUG:teuthology.orchestra.run.smithi050:> print("calling close") 2023-08-10T10:43:30.808 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:43:30.809 DEBUG:teuthology.orchestra.run.smithi050:> print("close() did not raise error") 2023-08-10T10:43:30.809 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:43:30.810 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-10T10:43:30.811 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:43:33.854 INFO:teuthology.orchestra.run.smithi050.stdout:writing some data through which we expect to succeed 2023-08-10T10:43:33.854 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-10T10:43:33.854 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.854 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.854 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 1.00 MB 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 2.00 MB 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 3.00 MB 2023-08-10T10:43:33.855 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 4.00 MB 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 5.00 MB 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.856 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 6.00 MB 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 7.00 MB 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 8.00 MB 2023-08-10T10:43:33.857 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 9.00 MB 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 10.00 MB 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.858 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 11.00 MB 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 12.00 MB 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 13.00 MB 2023-08-10T10:43:33.859 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 14.00 MB 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 15.00 MB 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.860 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 16.00 MB 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 17.00 MB 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 18.00 MB 2023-08-10T10:43:33.861 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 19.00 MB 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 20.00 MB 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.862 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 21.00 MB 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 22.00 MB 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 23.00 MB 2023-08-10T10:43:33.864 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.864 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 24.00 MB 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 25.00 MB 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.865 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 26.00 MB 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 27.00 MB 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 28.00 MB 2023-08-10T10:43:33.866 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 29.00 MB 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 30.00 MB 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 31.00 MB 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 32.00 MB 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 33.00 MB 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.868 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 34.00 MB 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 35.00 MB 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.869 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 36.00 MB 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 37.00 MB 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 38.00 MB 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.870 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 39.00 MB 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 40.00 MB 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 41.00 MB 2023-08-10T10:43:33.871 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 42.00 MB 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 43.00 MB 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.872 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 44.00 MB 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 45.00 MB 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 46.00 MB 2023-08-10T10:43:33.873 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 47.00 MB 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 48.00 MB 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.874 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 49.00 MB 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 50.00 MB 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 51.00 MB 2023-08-10T10:43:33.875 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 52.00 MB 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 53.00 MB 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.876 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 54.00 MB 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 55.00 MB 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 56.00 MB 2023-08-10T10:43:33.877 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 57.00 MB 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 58.00 MB 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 59.00 MB 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 60.00 MB 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 61.00 MB 2023-08-10T10:43:33.879 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 62.00 MB 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 63.00 MB 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.880 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 64.00 MB 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 65.00 MB 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.881 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 66.00 MB 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 67.00 MB 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 68.00 MB 2023-08-10T10:43:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 69.00 MB 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 70.00 MB 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 71.00 MB 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 72.00 MB 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 73.00 MB 2023-08-10T10:43:33.884 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 74.00 MB 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 75.00 MB 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 76.00 MB 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 77.00 MB 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 78.00 MB 2023-08-10T10:43:33.886 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.887 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.887 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 79.00 MB 2023-08-10T10:43:33.887 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:33.887 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:33.887 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 80.00 MB 2023-08-10T10:43:34.796 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.796 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.796 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 81.00 MB 2023-08-10T10:43:34.796 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 82.00 MB 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 83.00 MB 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.797 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 84.00 MB 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 85.00 MB 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 86.00 MB 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 87.00 MB 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 88.00 MB 2023-08-10T10:43:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.800 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.800 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 89.00 MB 2023-08-10T10:43:34.800 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.800 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.800 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 90.00 MB 2023-08-10T10:43:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 91.00 MB 2023-08-10T10:43:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 92.00 MB 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 93.00 MB 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 94.00 MB 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 95.00 MB 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 96.00 MB 2023-08-10T10:43:34.803 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 97.00 MB 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 98.00 MB 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.804 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 99.00 MB 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 100.00 MB 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.805 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 101.00 MB 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 102.00 MB 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 103.00 MB 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 104.00 MB 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 105.00 MB 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 106.00 MB 2023-08-10T10:43:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 107.00 MB 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 108.00 MB 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 109.00 MB 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 110.00 MB 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 111.00 MB 2023-08-10T10:43:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 112.00 MB 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 113.00 MB 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.810 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 114.00 MB 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 115.00 MB 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 116.00 MB 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.811 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 117.00 MB 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 118.00 MB 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 119.00 MB 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 120.00 MB 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 121.00 MB 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 122.00 MB 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 123.00 MB 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 124.00 MB 2023-08-10T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 125.00 MB 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 126.00 MB 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 127.00 MB 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 128.00 MB 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 129.00 MB 2023-08-10T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 130.00 MB 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 131.00 MB 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 132.00 MB 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 133.00 MB 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 134.00 MB 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 135.00 MB 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 136.00 MB 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 137.00 MB 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 138.00 MB 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 139.00 MB 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 140.00 MB 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 141.00 MB 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 142.00 MB 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 143.00 MB 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 144.00 MB 2023-08-10T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 145.00 MB 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 146.00 MB 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 147.00 MB 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 148.00 MB 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 149.00 MB 2023-08-10T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 150.00 MB 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 151.00 MB 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 152.00 MB 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 153.00 MB 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 154.00 MB 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 155.00 MB 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 156.00 MB 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 157.00 MB 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 158.00 MB 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 159.00 MB 2023-08-10T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 160.00 MB 2023-08-10T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.760 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 161.00 MB 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 162.00 MB 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.761 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 163.00 MB 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 164.00 MB 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.762 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 165.00 MB 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 166.00 MB 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 167.00 MB 2023-08-10T10:43:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 168.00 MB 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 169.00 MB 2023-08-10T10:43:35.764 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 170.00 MB 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 171.00 MB 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 172.00 MB 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 173.00 MB 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 174.00 MB 2023-08-10T10:43:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 175.00 MB 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 176.00 MB 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.767 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 177.00 MB 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 178.00 MB 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 179.00 MB 2023-08-10T10:43:35.768 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 180.00 MB 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 181.00 MB 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.769 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 182.00 MB 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 183.00 MB 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 184.00 MB 2023-08-10T10:43:35.770 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 185.00 MB 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 186.00 MB 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 187.00 MB 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 188.00 MB 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 189.00 MB 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 190.00 MB 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 191.00 MB 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 192.00 MB 2023-08-10T10:43:35.773 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 193.00 MB 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 194.00 MB 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.774 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 195.00 MB 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 196.00 MB 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 197.00 MB 2023-08-10T10:43:35.775 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 198.00 MB 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 199.00 MB 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 200.00 MB 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 201.00 MB 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 202.00 MB 2023-08-10T10:43:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 203.00 MB 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 204.00 MB 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 205.00 MB 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 206.00 MB 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 207.00 MB 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 208.00 MB 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 209.00 MB 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 210.00 MB 2023-08-10T10:43:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 211.00 MB 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 212.00 MB 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.781 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 213.00 MB 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 214.00 MB 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 215.00 MB 2023-08-10T10:43:35.782 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 216.00 MB 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 217.00 MB 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.783 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 218.00 MB 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 219.00 MB 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 220.00 MB 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.784 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 221.00 MB 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 222.00 MB 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 223.00 MB 2023-08-10T10:43:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 224.00 MB 2023-08-10T10:43:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 225.00 MB 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 226.00 MB 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 227.00 MB 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 228.00 MB 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 229.00 MB 2023-08-10T10:43:35.788 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 230.00 MB 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 231.00 MB 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 232.00 MB 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 233.00 MB 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 234.00 MB 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 235.00 MB 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 236.00 MB 2023-08-10T10:43:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 237.00 MB 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 238.00 MB 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.792 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 239.00 MB 2023-08-10T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 240.00 MB 2023-08-10T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 241.00 MB 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 242.00 MB 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 243.00 MB 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 244.00 MB 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 245.00 MB 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 246.00 MB 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 247.00 MB 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 248.00 MB 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 249.00 MB 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 250.00 MB 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 251.00 MB 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 252.00 MB 2023-08-10T10:43:36.644 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 253.00 MB 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 254.00 MB 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 255.00 MB 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 256.00 MB 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 257.00 MB 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 258.00 MB 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 259.00 MB 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 260.00 MB 2023-08-10T10:43:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 261.00 MB 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 262.00 MB 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.648 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 263.00 MB 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 264.00 MB 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 265.00 MB 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 266.00 MB 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 267.00 MB 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 268.00 MB 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 269.00 MB 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 270.00 MB 2023-08-10T10:43:36.651 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 271.00 MB 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 272.00 MB 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.652 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 273.00 MB 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 274.00 MB 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 275.00 MB 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.653 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 276.00 MB 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 277.00 MB 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 278.00 MB 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 279.00 MB 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 280.00 MB 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 281.00 MB 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 282.00 MB 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 283.00 MB 2023-08-10T10:43:36.656 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 284.00 MB 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 285.00 MB 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.657 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 286.00 MB 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 287.00 MB 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 288.00 MB 2023-08-10T10:43:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 289.00 MB 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 290.00 MB 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.659 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 291.00 MB 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 292.00 MB 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 293.00 MB 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.660 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 294.00 MB 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 295.00 MB 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 296.00 MB 2023-08-10T10:43:36.661 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 297.00 MB 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 298.00 MB 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.662 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 299.00 MB 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 300.00 MB 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 301.00 MB 2023-08-10T10:43:36.663 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 302.00 MB 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 303.00 MB 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 304.00 MB 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 305.00 MB 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 306.00 MB 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.665 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 307.00 MB 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 308.00 MB 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 309.00 MB 2023-08-10T10:43:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 310.00 MB 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 311.00 MB 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 312.00 MB 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 313.00 MB 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 314.00 MB 2023-08-10T10:43:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 315.00 MB 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 316.00 MB 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.669 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 317.00 MB 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 318.00 MB 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 319.00 MB 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.670 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.671 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 320.00 MB 2023-08-10T10:43:36.671 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:36.671 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:36.671 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 321.00 MB 2023-08-10T10:43:37.514 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.515 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.515 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 322.00 MB 2023-08-10T10:43:37.515 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.515 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.515 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 323.00 MB 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 324.00 MB 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 325.00 MB 2023-08-10T10:43:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 326.00 MB 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 327.00 MB 2023-08-10T10:43:37.517 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.518 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.518 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 328.00 MB 2023-08-10T10:43:37.518 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.518 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.519 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 329.00 MB 2023-08-10T10:43:37.519 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.519 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.519 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 330.00 MB 2023-08-10T10:43:37.520 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.521 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.521 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 331.00 MB 2023-08-10T10:43:37.521 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.521 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 332.00 MB 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 333.00 MB 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 334.00 MB 2023-08-10T10:43:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 335.00 MB 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 336.00 MB 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.523 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 337.00 MB 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 338.00 MB 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 339.00 MB 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 340.00 MB 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 341.00 MB 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 342.00 MB 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.526 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 343.00 MB 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 344.00 MB 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 345.00 MB 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.527 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 346.00 MB 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 347.00 MB 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.528 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 348.00 MB 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 349.00 MB 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 350.00 MB 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.530 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 351.00 MB 2023-08-10T10:43:37.530 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 352.00 MB 2023-08-10T10:43:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 353.00 MB 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 354.00 MB 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 355.00 MB 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 356.00 MB 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 357.00 MB 2023-08-10T10:43:37.533 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 358.00 MB 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 359.00 MB 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.534 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 360.00 MB 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 361.00 MB 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.535 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 362.00 MB 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 363.00 MB 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 364.00 MB 2023-08-10T10:43:37.536 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 365.00 MB 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 366.00 MB 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.537 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 367.00 MB 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 368.00 MB 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 369.00 MB 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 370.00 MB 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 371.00 MB 2023-08-10T10:43:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 372.00 MB 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 373.00 MB 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.540 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 374.00 MB 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 375.00 MB 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 376.00 MB 2023-08-10T10:43:37.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 377.00 MB 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 378.00 MB 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 379.00 MB 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 380.00 MB 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.543 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 381.00 MB 2023-08-10T10:43:37.544 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.544 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.544 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 382.00 MB 2023-08-10T10:43:37.544 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.544 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.545 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 383.00 MB 2023-08-10T10:43:37.545 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.545 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.545 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 384.00 MB 2023-08-10T10:43:37.546 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.546 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.546 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 385.00 MB 2023-08-10T10:43:37.547 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.547 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.547 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 386.00 MB 2023-08-10T10:43:37.547 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.548 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.548 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 387.00 MB 2023-08-10T10:43:37.548 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.548 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.549 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 388.00 MB 2023-08-10T10:43:37.549 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.549 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.549 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 389.00 MB 2023-08-10T10:43:37.550 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.550 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.550 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 390.00 MB 2023-08-10T10:43:37.551 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.551 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.551 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 391.00 MB 2023-08-10T10:43:37.552 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.552 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.552 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 392.00 MB 2023-08-10T10:43:37.552 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.553 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.553 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 393.00 MB 2023-08-10T10:43:37.553 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.553 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.554 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 394.00 MB 2023-08-10T10:43:37.554 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.554 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.554 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 395.00 MB 2023-08-10T10:43:37.555 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.555 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.555 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 396.00 MB 2023-08-10T10:43:37.555 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.556 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.556 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 397.00 MB 2023-08-10T10:43:37.556 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.556 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 398.00 MB 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 399.00 MB 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.557 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.558 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 400.00 MB 2023-08-10T10:43:37.558 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:43:37.558 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:43:37.558 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 401.00 MB 2023-08-10T10:43:39.133 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:43:39.132+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-08-10T10:43:43.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:43:43.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:44:08.529 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.529 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.529 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 402.00 MB 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 403.00 MB 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 404.00 MB 2023-08-10T10:44:08.530 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 405.00 MB 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 406.00 MB 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.531 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 407.00 MB 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 408.00 MB 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.532 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 409.00 MB 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 410.00 MB 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.533 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 411.00 MB 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 412.00 MB 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 413.00 MB 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.534 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 414.00 MB 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 415.00 MB 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 416.00 MB 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 417.00 MB 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 418.00 MB 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 419.00 MB 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 420.00 MB 2023-08-10T10:44:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 421.00 MB 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 422.00 MB 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 423.00 MB 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 424.00 MB 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 425.00 MB 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 426.00 MB 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 427.00 MB 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 428.00 MB 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 429.00 MB 2023-08-10T10:44:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 430.00 MB 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 431.00 MB 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 432.00 MB 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 433.00 MB 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.543 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 434.00 MB 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 435.00 MB 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.544 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 436.00 MB 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 437.00 MB 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.545 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 438.00 MB 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 439.00 MB 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 440.00 MB 2023-08-10T10:44:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 441.00 MB 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 442.00 MB 2023-08-10T10:44:08.547 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 443.00 MB 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 444.00 MB 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.548 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.549 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 445.00 MB 2023-08-10T10:44:08.549 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.549 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.549 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 446.00 MB 2023-08-10T10:44:08.550 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.550 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.550 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 447.00 MB 2023-08-10T10:44:08.550 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 448.00 MB 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 449.00 MB 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.551 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 450.00 MB 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 451.00 MB 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 452.00 MB 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 453.00 MB 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.553 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 454.00 MB 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 455.00 MB 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 456.00 MB 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.554 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 457.00 MB 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 458.00 MB 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 459.00 MB 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 460.00 MB 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 461.00 MB 2023-08-10T10:44:08.556 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 462.00 MB 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 463.00 MB 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.557 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 464.00 MB 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 465.00 MB 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 466.00 MB 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 467.00 MB 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.559 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.560 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 468.00 MB 2023-08-10T10:44:08.560 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.560 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.560 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 469.00 MB 2023-08-10T10:44:08.560 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 470.00 MB 2023-08-10T10:44:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 471.00 MB 2023-08-10T10:44:08.562 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.562 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.562 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 472.00 MB 2023-08-10T10:44:08.562 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 473.00 MB 2023-08-10T10:44:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 474.00 MB 2023-08-10T10:44:08.564 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.564 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.564 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 475.00 MB 2023-08-10T10:44:08.564 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.564 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 476.00 MB 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 477.00 MB 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.565 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 478.00 MB 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 479.00 MB 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:44:08.566 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:44:08.567 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 480.00 MB 2023-08-10T10:44:08.567 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:44:08.667 INFO:teuthology.orchestra.run.smithi050.stdout:Reached fullness after 480.00 MB 2023-08-10T10:44:08.667 INFO:teuthology.orchestra.run.smithi050.stdout:calling close 2023-08-10T10:44:08.667 INFO:teuthology.orchestra.run.smithi050.stdout:close() did not raise error 2023-08-10T10:44:08.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:44:08.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:44:08.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:44:09.088 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:44:09.088 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:09.088 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:09.150 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:09.151 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:09.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.443+0000 7fe4e1134640 1 Processor -- start 2023-08-10T10:44:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.443+0000 7fe4e1134640 1 -- start start 2023-08-10T10:44:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.445+0000 7fe4e1134640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.445+0000 7fe4e1134640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4dc0b19d0 0x7fe4dc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.445+0000 7fe4e1134640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0b1f10 con 0x7fe4dc15f2b0 2023-08-10T10:44:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.445+0000 7fe4e1134640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0b21f0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.445+0000 7fe4e1134640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc15e5c0 con 0x7fe4dc15a940 2023-08-10T10:44:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4d3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe4dc15f2b0 0x7fe4dc0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43396/0 (socket says 172.21.15.50:43396) 2023-08-10T10:44:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4d3fff640 1 -- 172.21.15.50:0/775782455 learned_addr learned my addr 172.21.15.50:0/775782455 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4e0933640 1 --2- 172.21.15.50:0/775782455 >> v2:172.21.15.50:3300/0 conn(0x7fe4dc0b19d0 0x7fe4dc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4dbfff640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4e0933640 1 -- 172.21.15.50:0/775782455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 msgr2=0x7fe4dc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4e0933640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4e0933640 1 -- 172.21.15.50:0/775782455 >> v1:172.21.15.50:6789/0 conn(0x7fe4dc15f2b0 legacy=0x7fe4dc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.446+0000 7fe4e0933640 1 -- 172.21.15.50:0/775782455 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc15e7d0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.447+0000 7fe4e0933640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc0b0450 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009d90 tx=0x7fe4d402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89407a17ab1fa99f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4db7fe640 1 -- 172.21.15.50:0/775782455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d402cbd0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4db7fe640 1 -- 172.21.15.50:0/775782455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d402cd30 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4db7fe640 1 -- 172.21.15.50:0/775782455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d402cea0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 -- 172.21.15.50:0/775782455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 msgr2=0x7fe4dc0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc0b0450 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009d90 tx=0x7fe4d402be20 comp rx=0 tx=0).stop 2023-08-10T10:44:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 -- 172.21.15.50:0/775782455 shutdown_connections 2023-08-10T10:44:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc0b0450 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 --2- 172.21.15.50:0/775782455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 -- 172.21.15.50:0/775782455 >> 172.21.15.50:0/775782455 conn(0x7fe4dc06ab80 msgr2=0x7fe4dc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 -- 172.21.15.50:0/775782455 shutdown_connections 2023-08-10T10:44:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.448+0000 7fe4e1134640 1 -- 172.21.15.50:0/775782455 wait complete. 2023-08-10T10:44:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.450+0000 7fe4e1134640 1 Processor -- start 2023-08-10T10:44:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.450+0000 7fe4e1134640 1 -- start start 2023-08-10T10:44:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc15f2b0 0x7fe4dc0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc06fc90 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0c7bf0 con 0x7fe4dc15f2b0 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.451+0000 7fe4e1134640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc06f640 con 0x7fe4dc15a940 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36526/0 (socket says 172.21.15.50:36526) 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 -- 172.21.15.50:0/2855931926 learned_addr learned my addr 172.21.15.50:0/2855931926 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4d3fff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 -- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 msgr2=0x7fe4dc070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc070120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 -- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc15f2b0 msgr2=0x7fe4dc0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc15f2b0 0x7fe4dc0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4009a70 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.452+0000 7fe4dbfff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d5f0 tx=0x7fe4cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.453+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0125f0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.453+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc012750 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.453+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc012b00 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.453+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc06f920 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.453+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc06f2f0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.454+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc066e30 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.455+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4cc012c60 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.456+0000 7fe4d97fa640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 0x7fe4bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.456+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4cc089a50 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.456+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fe4bc072da0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.456+0000 7fe4d3fff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 0x7fe4bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.457+0000 7fe4d3fff640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 0x7fe4bc06d110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0b1800 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.461+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe4cc054a60 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.657+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4dc0b0dc0 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.661+0000 7fe4d97fa640 1 -- 172.21.15.50:0/2855931926 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fe4cc058080 con 0x7fe4dc0b19d0 2023-08-10T10:44:09.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:09.662 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:41.155422+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.663+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 msgr2=0x7fe4bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.663+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 0x7fe4bc06d110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0b1800 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2023-08-10T10:44:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 msgr2=0x7fe4dc156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d5f0 tx=0x7fe4cc00dab0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 shutdown_connections 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe4bc06ac50 0x7fe4bc06d110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc15f2b0 0x7fe4dc0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4dc15a940 0x7fe4dc070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 --2- 172.21.15.50:0/2855931926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4dc0b19d0 0x7fe4dc156f50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 >> 172.21.15.50:0/2855931926 conn(0x7fe4dc06ab80 msgr2=0x7fe4dc0c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 shutdown_connections 2023-08-10T10:44:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.664+0000 7fe4e1134640 1 -- 172.21.15.50:0/2855931926 wait complete. 2023-08-10T10:44:09.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:43:16.551358+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:43:18.005134+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:44:09.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:44:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.907+0000 7f8376586640 1 Processor -- start 2023-08-10T10:44:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.907+0000 7f8376586640 1 -- start start 2023-08-10T10:44:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8376586640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8370160f70 0x7f837015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8376586640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837015dd10 0x7f83700aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8376586640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700ad6e0 con 0x7f8370161350 2023-08-10T10:44:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8376586640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700cdaf0 con 0x7f8370160f70 2023-08-10T10:44:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8376586640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700acb10 con 0x7f837015dd10 2023-08-10T10:44:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8375584640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8370160f70 0x7f837015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8375d85640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8370161350 0x7f837006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43404/0 (socket says 172.21.15.50:43404) 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8375d85640 1 -- 172.21.15.50:0/1821855795 learned_addr learned my addr 172.21.15.50:0/1821855795 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.909+0000 7f8374d83640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837015dd10 0x7f83700aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.910+0000 7f8375584640 1 -- 172.21.15.50:0/1821855795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837015dd10 msgr2=0x7f83700aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.910+0000 7f8375584640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837015dd10 0x7f83700aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.910+0000 7f8375584640 1 -- 172.21.15.50:0/1821855795 >> v1:172.21.15.50:6789/0 conn(0x7f8370161350 legacy=0x7f837006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.910+0000 7f8375584640 1 -- 172.21.15.50:0/1821855795 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700acdb0 con 0x7f8370160f70 2023-08-10T10:44:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.910+0000 7f8367fff640 1 -- 172.21.15.50:0/1821855795 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519834691 0 0) 0x7f83700ad6e0 con 0x7f8370161350 2023-08-10T10:44:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.911+0000 7f8375584640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8370160f70 0x7f837015d7d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f836c0097a0 tx=0x7f836c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89b504cf6fffb85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8367fff640 1 -- 172.21.15.50:0/1821855795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c031830 con 0x7f8370160f70 2023-08-10T10:44:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8367fff640 1 -- 172.21.15.50:0/1821855795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c031990 con 0x7f8370160f70 2023-08-10T10:44:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8367fff640 1 -- 172.21.15.50:0/1821855795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c031d20 con 0x7f8370160f70 2023-08-10T10:44:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 -- 172.21.15.50:0/1821855795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8370160f70 msgr2=0x7f837015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8370160f70 0x7f837015d7d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f836c0097a0 tx=0x7f836c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 -- 172.21.15.50:0/1821855795 shutdown_connections 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837015dd10 0x7f83700aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 --2- 172.21.15.50:0/1821855795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8370160f70 0x7f837015d7d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 -- 172.21.15.50:0/1821855795 >> 172.21.15.50:0/1821855795 conn(0x7f8370069cd0 msgr2=0x7f83700caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.912+0000 7f8376586640 1 -- 172.21.15.50:0/1821855795 shutdown_connections 2023-08-10T10:44:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.913+0000 7f8376586640 1 -- 172.21.15.50:0/1821855795 wait complete. 2023-08-10T10:44:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.914+0000 7f8376586640 1 Processor -- start 2023-08-10T10:44:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.914+0000 7f8376586640 1 -- start start 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 0x7f83700c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8370161350 0x7f83700c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837006ecf0 con 0x7f837015dd10 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837006efd0 con 0x7f8370161350 2023-08-10T10:44:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.915+0000 7f8376586640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837006f2b0 con 0x7f8370160f70 2023-08-10T10:44:09.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36532/0 (socket says 172.21.15.50:36532) 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 -- 172.21.15.50:0/3569557772 learned_addr learned my addr 172.21.15.50:0/3569557772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8374d83640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 0x7f83700c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 -- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 msgr2=0x7f83700c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 0x7f83700c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 -- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8370161350 msgr2=0x7f83700c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8370161350 0x7f83700c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8375584640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009400 con 0x7f837015dd10 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.916+0000 7f8374d83640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 0x7f83700c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8375584640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f836c000c00 tx=0x7f836c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c004230 con 0x7f837015dd10 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c004390 con 0x7f837015dd10 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c03a880 con 0x7f837015dd10 2023-08-10T10:44:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837006f590 con 0x7f837015dd10 2023-08-10T10:44:09.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.917+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83700c3f10 con 0x7f837015dd10 2023-08-10T10:44:09.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.919+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837006fab0 con 0x7f837015dd10 2023-08-10T10:44:09.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.920+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f836c03a9e0 con 0x7f837015dd10 2023-08-10T10:44:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.921+0000 7f8365ffb640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 0x7f835406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.921+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f836c0abac0 con 0x7f837015dd10 2023-08-10T10:44:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.921+0000 7f8374d83640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 0x7f835406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.921+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f8354072da0 con 0x7f837015dd10 2023-08-10T10:44:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.922+0000 7f8374d83640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 0x7f835406d110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8370156930 tx=0x7f8360008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:09.926+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f837006fab0 con 0x7f837015dd10 2023-08-10T10:44:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.117+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f837006fab0 con 0x7f837015dd10 2023-08-10T10:44:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.118+0000 7f8365ffb640 1 -- 172.21.15.50:0/3569557772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f837006fab0 con 0x7f837015dd10 2023-08-10T10:44:10.119 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:44:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 msgr2=0x7f835406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 0x7f835406d110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8370156930 tx=0x7f8360008040 comp rx=0 tx=0).stop 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 msgr2=0x7f83700c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f836c000c00 tx=0x7f836c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 shutdown_connections 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f835406ac50 0x7f835406d110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8370161350 0x7f83700c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370160f70 0x7f83700c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 --2- 172.21.15.50:0/3569557772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837015dd10 0x7f83700c39d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 >> 172.21.15.50:0/3569557772 conn(0x7f8370069cd0 msgr2=0x7f83700c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 shutdown_connections 2023-08-10T10:44:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.121+0000 7f8376586640 1 -- 172.21.15.50:0/3569557772 wait complete. 2023-08-10T10:44:10.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:44:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.371+0000 7f86e0dbc640 1 Processor -- start 2023-08-10T10:44:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.371+0000 7f86e0dbc640 1 -- start start 2023-08-10T10:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86e0dbc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86dc15cf70 0x7f86dc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86e0dbc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc160a40 con 0x7f86dc15cb90 2023-08-10T10:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86e0dbc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc0b4bb0 con 0x7f86dc0b4640 2023-08-10T10:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86e0dbc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0b4e90 con 0x7f86dc15cf70 2023-08-10T10:44:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86da59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86dc15cb90 0x7f86dc0b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43414/0 (socket says 172.21.15.50:43414) 2023-08-10T10:44:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86da59c640 1 -- 172.21.15.50:0/101491458 learned_addr learned my addr 172.21.15.50:0/101491458 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.373+0000 7f86d1d9b640 1 --2- 172.21.15.50:0/101491458 >> v2:172.21.15.117:3300/0 conn(0x7f86dc15cf70 0x7f86dc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.374+0000 7f86d9d9b640 1 -- 172.21.15.50:0/101491458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045959512 0 0) 0x7f86dc160a40 con 0x7f86dc15cb90 2023-08-10T10:44:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.374+0000 7f86d9d9b640 1 -- 172.21.15.50:0/101491458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c8003520 con 0x7f86dc15cb90 2023-08-10T10:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.374+0000 7f86d1d9b640 1 -- 172.21.15.50:0/101491458 >> v1:172.21.15.117:6789/0 conn(0x7f86dc0b4640 legacy=0x7f86dc06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.374+0000 7f86d1d9b640 1 -- 172.21.15.50:0/101491458 >> v1:172.21.15.50:6789/0 conn(0x7f86dc15cb90 legacy=0x7f86dc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.374+0000 7f86d1d9b640 1 -- 172.21.15.50:0/101491458 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0b5170 con 0x7f86dc15cf70 2023-08-10T10:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.376+0000 7f86d1d9b640 1 --2- 172.21.15.50:0/101491458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cf70 0x7f86dc160ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c402bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=940c3fc1902cd5d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.376+0000 7f86d9d9b640 1 -- 172.21.15.50:0/101491458 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c402ccf0 con 0x7f86dc15cf70 2023-08-10T10:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.376+0000 7f86d9d9b640 1 -- 172.21.15.50:0/101491458 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c402ce50 con 0x7f86dc15cf70 2023-08-10T10:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.376+0000 7f86d9d9b640 1 -- 172.21.15.50:0/101491458 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4034660 con 0x7f86dc15cf70 2023-08-10T10:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 -- 172.21.15.50:0/101491458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cf70 msgr2=0x7f86dc160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/101491458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cf70 0x7f86dc160ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c402bf40 comp rx=0 tx=0).stop 2023-08-10T10:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 -- 172.21.15.50:0/101491458 shutdown_connections 2023-08-10T10:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/101491458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cf70 0x7f86dc160ed0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 -- 172.21.15.50:0/101491458 >> 172.21.15.50:0/101491458 conn(0x7f86dc0cf640 msgr2=0x7f86dc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.377+0000 7f86e0dbc640 1 -- 172.21.15.50:0/101491458 shutdown_connections 2023-08-10T10:44:10.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.378+0000 7f86e0dbc640 1 -- 172.21.15.50:0/101491458 wait complete. 2023-08-10T10:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.379+0000 7f86e0dbc640 1 Processor -- start 2023-08-10T10:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.379+0000 7f86e0dbc640 1 -- start start 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cb90 0x7f86dc15f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86dc15cf70 0x7f86dc15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc155d30 con 0x7f86dc0b4640 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0c8960 con 0x7f86dc15cb90 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.380+0000 7f86e0dbc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0c8c40 con 0x7f86dc15cf70 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36544/0 (socket says 172.21.15.50:36544) 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 -- 172.21.15.50:0/2242202877 learned_addr learned my addr 172.21.15.50:0/2242202877 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 -- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86dc15cf70 msgr2=0x7f86dc15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86dc15cf70 0x7f86dc15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 -- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cb90 msgr2=0x7f86dc15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86d1d9b640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cb90 0x7f86dc15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cb90 0x7f86dc15f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.381+0000 7f86da59c640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009a70 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86da59c640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c500 tx=0x7f86cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005ce0 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc005e40 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc007330 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc0c8f20 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.382+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc0c94e0 con 0x7f86dc0b4640 2023-08-10T10:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.383+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc0c96d0 con 0x7f86dc0b4640 2023-08-10T10:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.384+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86cc007550 con 0x7f86dc0b4640 2023-08-10T10:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.385+0000 7f86d37fe640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 0x7f86bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.385+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86cc088be0 con 0x7f86dc0b4640 2023-08-10T10:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.386+0000 7f86d1d9b640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 0x7f86bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.386+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f86bc072da0 con 0x7f86dc0b4640 2023-08-10T10:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.386+0000 7f86d1d9b640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 0x7f86bc06d110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f86c4036000 tx=0x7f86c4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.390+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f86cc017060 con 0x7f86dc0b4640 2023-08-10T10:44:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.583+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86dc0612b0 con 0x7f86dc0b4640 2023-08-10T10:44:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.584+0000 7f86d37fe640 1 -- 172.21.15.50:0/2242202877 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86cc053d40 con 0x7f86dc0b4640 2023-08-10T10:44:10.585 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:44:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 msgr2=0x7f86bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 0x7f86bc06d110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f86c4036000 tx=0x7f86c4030000 comp rx=0 tx=0).stop 2023-08-10T10:44:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 msgr2=0x7f86dc1557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c500 tx=0x7f86cc00c9c0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 shutdown_connections 2023-08-10T10:44:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86dc15cf70 0x7f86dc15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86bc06ac50 0x7f86bc06d110 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86dc15cb90 0x7f86dc15f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 --2- 172.21.15.50:0/2242202877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86dc0b4640 0x7f86dc1557f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 >> 172.21.15.50:0/2242202877 conn(0x7f86dc0cf640 msgr2=0x7f86dc15b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 shutdown_connections 2023-08-10T10:44:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.587+0000 7f86e0dbc640 1 -- 172.21.15.50:0/2242202877 wait complete. 2023-08-10T10:44:10.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:44:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.844+0000 7feb3ee04640 1 Processor -- start 2023-08-10T10:44:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.845+0000 7feb3ee04640 1 -- start start 2023-08-10T10:44:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.846+0000 7feb3ee04640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb3815cb90 0x7feb380b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.846+0000 7feb3ee04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb38160a40 con 0x7feb381615e0 2023-08-10T10:44:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.846+0000 7feb3ee04640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb380b4bb0 con 0x7feb3815cf70 2023-08-10T10:44:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.846+0000 7feb3ee04640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb380b4e90 con 0x7feb3815cb90 2023-08-10T10:44:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.847+0000 7feb3d3a1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb381615e0 0x7feb3806fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43420/0 (socket says 172.21.15.50:43420) 2023-08-10T10:44:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.847+0000 7feb3d3a1640 1 -- 172.21.15.50:0/681969009 learned_addr learned my addr 172.21.15.50:0/681969009 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.847+0000 7feb3cba0640 1 --2- 172.21.15.50:0/681969009 >> v2:172.21.15.117:3300/0 conn(0x7feb3815cb90 0x7feb380b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.847+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206122592 0 0) 0x7feb38160a40 con 0x7feb381615e0 2023-08-10T10:44:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.847+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb20003520 con 0x7feb381615e0 2023-08-10T10:44:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924822068 0 0) 0x7feb20003520 con 0x7feb381615e0 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 >> v2:172.21.15.117:3300/0 conn(0x7feb3815cb90 msgr2=0x7feb380b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 --2- 172.21.15.50:0/681969009 >> v2:172.21.15.117:3300/0 conn(0x7feb3815cb90 0x7feb380b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 >> v1:172.21.15.117:6789/0 conn(0x7feb3815cf70 legacy=0x7feb38160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380b5170 con 0x7feb381615e0 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7feb30001670 con 0x7feb381615e0 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 >> v1:172.21.15.50:6789/0 conn(0x7feb381615e0 legacy=0x7feb3806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb200047c0 0x7feb20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb20005180 0x7feb2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb380b4e90 con 0x7feb20003970 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2000c020 con 0x7feb20005180 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2000c1e0 con 0x7feb200047c0 2023-08-10T10:44:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb3cba0640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb3cba0640 1 -- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb200047c0 msgr2=0x7feb20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.848+0000 7feb3cba0640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb200047c0 0x7feb20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3cba0640 1 -- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb20005180 msgr2=0x7feb2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3d3a1640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb20005180 0x7feb2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3cba0640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb20005180 0x7feb2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3cba0640 1 -- 172.21.15.50:0/681969009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20003520 con 0x7feb20003970 2023-08-10T10:44:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3d3a1640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb20005180 0x7feb2000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.849+0000 7feb3d3a1640 1 -- 172.21.15.50:0/681969009 reap_dead start 2023-08-10T10:44:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.850+0000 7feb3cba0640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb20003d90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7feb28009fc0 tx=0x7feb200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f5c8bd46c768bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.850+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2802cc20 con 0x7feb20003970 2023-08-10T10:44:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.850+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2800f040 con 0x7feb20003970 2023-08-10T10:44:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.850+0000 7feb377fe640 1 -- 172.21.15.50:0/681969009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28034440 con 0x7feb20003970 2023-08-10T10:44:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 -- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 msgr2=0x7feb20003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb20003d90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7feb28009fc0 tx=0x7feb200057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 -- 172.21.15.50:0/681969009 shutdown_connections 2023-08-10T10:44:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 --2- 172.21.15.50:0/681969009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb20003d90 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 -- 172.21.15.50:0/681969009 >> 172.21.15.50:0/681969009 conn(0x7feb380cf640 msgr2=0x7feb380cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 -- 172.21.15.50:0/681969009 shutdown_connections 2023-08-10T10:44:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.851+0000 7feb3ee04640 1 -- 172.21.15.50:0/681969009 wait complete. 2023-08-10T10:44:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.853+0000 7feb3ee04640 1 Processor -- start 2023-08-10T10:44:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.853+0000 7feb3ee04640 1 -- start start 2023-08-10T10:44:10.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 0x7feb38160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 0x7feb380cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3815fb80 con 0x7feb20003970 2023-08-10T10:44:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb381f30b0 con 0x7feb3815d390 2023-08-10T10:44:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3ee04640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb381f3390 con 0x7feb38154070 2023-08-10T10:44:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3cba0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3cba0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36562/0 (socket says 172.21.15.50:36562) 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3cba0640 1 -- 172.21.15.50:0/2039257621 learned_addr learned my addr 172.21.15.50:0/2039257621 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb3d3a1640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 0x7feb380cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.854+0000 7feb37fff640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 0x7feb38160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 -- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 msgr2=0x7feb380cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 0x7feb380cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 -- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 msgr2=0x7feb38160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 0x7feb38160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3815f810 con 0x7feb20003970 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3d3a1640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 0x7feb380cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb37fff640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 0x7feb38160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3cba0640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7feb2800e230 tx=0x7feb28009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28034c50 con 0x7feb20003970 2023-08-10T10:44:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb28034db0 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28003bb0 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.855+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb381f2d70 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.856+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb381544f0 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.857+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3815f9a0 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.857+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb28040450 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.859+0000 7feb357fa640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 0x7feb2406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.859+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb280abcd0 con 0x7feb20003970 2023-08-10T10:44:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.859+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7feb24072dd0 con 0x7feb20003970 2023-08-10T10:44:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.859+0000 7feb37fff640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 0x7feb2406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.860+0000 7feb37fff640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 0x7feb2406d140 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb380d23b0 tx=0x7feb2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:10.863+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feb28076e00 con 0x7feb20003970 2023-08-10T10:44:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.056+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb380612b0 con 0x7feb20003970 2023-08-10T10:44:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.057+0000 7feb357fa640 1 -- 172.21.15.50:0/2039257621 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb280390a0 con 0x7feb20003970 2023-08-10T10:44:11.058 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:44:11.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.059+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 msgr2=0x7feb2406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.059+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 0x7feb2406d140 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb380d23b0 tx=0x7feb2c009040 comp rx=0 tx=0).stop 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.059+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 msgr2=0x7feb381f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.059+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7feb2800e230 tx=0x7feb28009750 comp rx=0 tx=0).stop 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 shutdown_connections 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb38154070 0x7feb380cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feb2406ac80 0x7feb2406d140 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb3815d390 0x7feb38160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 --2- 172.21.15.50:0/2039257621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb20003970 0x7feb381f2830 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 >> 172.21.15.50:0/2039257621 conn(0x7feb380cf640 msgr2=0x7feb380d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 shutdown_connections 2023-08-10T10:44:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.060+0000 7feb3ee04640 1 -- 172.21.15.50:0/2039257621 wait complete. 2023-08-10T10:44:11.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:44:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.317+0000 7f849f0cd640 1 Processor -- start 2023-08-10T10:44:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.318+0000 7f849f0cd640 1 -- start start 2023-08-10T10:44:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849f0cd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84980696a0 0x7f8498069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849f0cd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f849815e4d0 0x7f849815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849f0cd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849815aee0 con 0x7f84981583c0 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849f0cd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849806a070 con 0x7f849815e4d0 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849f0cd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84980b2100 con 0x7f84980696a0 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849e0cb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f84981583c0 0x7f84980b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43424/0 (socket says 172.21.15.50:43424) 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849e0cb640 1 -- 172.21.15.50:0/2185681242 learned_addr learned my addr 172.21.15.50:0/2185681242 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.319+0000 7f849e8cc640 1 --2- 172.21.15.50:0/2185681242 >> v2:172.21.15.50:3300/0 conn(0x7f849815e4d0 0x7f849815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849d8ca640 1 --2- 172.21.15.50:0/2185681242 >> v2:172.21.15.117:3300/0 conn(0x7f84980696a0 0x7f8498069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849d0c9640 1 -- 172.21.15.50:0/2185681242 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013395799 0 0) 0x7f849815aee0 con 0x7f84981583c0 2023-08-10T10:44:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849d0c9640 1 -- 172.21.15.50:0/2185681242 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484003520 con 0x7f84981583c0 2023-08-10T10:44:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849e8cc640 1 -- 172.21.15.50:0/2185681242 >> v2:172.21.15.117:3300/0 conn(0x7f84980696a0 msgr2=0x7f8498069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849e8cc640 1 --2- 172.21.15.50:0/2185681242 >> v2:172.21.15.117:3300/0 conn(0x7f84980696a0 0x7f8498069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849e8cc640 1 -- 172.21.15.50:0/2185681242 >> v1:172.21.15.50:6789/0 conn(0x7f84981583c0 legacy=0x7f84980b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.320+0000 7f849e8cc640 1 -- 172.21.15.50:0/2185681242 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849815b1a0 con 0x7f849815e4d0 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.321+0000 7f849e8cc640 1 --2- 172.21.15.50:0/2185681242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f849815e8d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f84980b1400 tx=0x7f849002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4bd0e479cfae3a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.321+0000 7f849d0c9640 1 -- 172.21.15.50:0/2185681242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849002cc70 con 0x7f849815e4d0 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.321+0000 7f849d0c9640 1 -- 172.21.15.50:0/2185681242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849002cdd0 con 0x7f849815e4d0 2023-08-10T10:44:11.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.321+0000 7f849d0c9640 1 -- 172.21.15.50:0/2185681242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490034640 con 0x7f849815e4d0 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 -- 172.21.15.50:0/2185681242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 msgr2=0x7f849815e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 --2- 172.21.15.50:0/2185681242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f849815e8d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f84980b1400 tx=0x7f849002bec0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 -- 172.21.15.50:0/2185681242 shutdown_connections 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 --2- 172.21.15.50:0/2185681242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f849815e8d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 --2- 172.21.15.50:0/2185681242 >> v2:172.21.15.117:3300/0 conn(0x7f84980696a0 0x7f8498069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 -- 172.21.15.50:0/2185681242 >> 172.21.15.50:0/2185681242 conn(0x7f84980caf80 msgr2=0x7f84980cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 -- 172.21.15.50:0/2185681242 shutdown_connections 2023-08-10T10:44:11.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.322+0000 7f849f0cd640 1 -- 172.21.15.50:0/2185681242 wait complete. 2023-08-10T10:44:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.324+0000 7f849f0cd640 1 Processor -- start 2023-08-10T10:44:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.324+0000 7f849f0cd640 1 -- start start 2023-08-10T10:44:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84980696a0 0x7f84981466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84981583c0 0x7f8498148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498148b50 con 0x7f849815e4d0 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849815c010 con 0x7f84981583c0 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849f0cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849815c2f0 con 0x7f84980696a0 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849e8cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849e8cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36580/0 (socket says 172.21.15.50:36580) 2023-08-10T10:44:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849e8cc640 1 -- 172.21.15.50:0/1118832900 learned_addr learned my addr 172.21.15.50:0/1118832900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.325+0000 7f849e8cc640 1 -- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84980696a0 msgr2=0x7f84981466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849e8cc640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84980696a0 0x7f84981466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849e8cc640 1 -- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84981583c0 msgr2=0x7f8498148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849e8cc640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84981583c0 0x7f8498148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849e8cc640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490009a70 con 0x7f849815e4d0 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849e8cc640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f849002c4d0 tx=0x7f8490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849003e610 con 0x7f849815e4d0 2023-08-10T10:44:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849003e770 con 0x7f849815e4d0 2023-08-10T10:44:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849003eb60 con 0x7f849815e4d0 2023-08-10T10:44:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849815c5d0 con 0x7f849815e4d0 2023-08-10T10:44:11.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.326+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849815cb90 con 0x7f849815e4d0 2023-08-10T10:44:11.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.328+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498066e30 con 0x7f849815e4d0 2023-08-10T10:44:11.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.328+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f849003b050 con 0x7f849815e4d0 2023-08-10T10:44:11.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.330+0000 7f848effd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 0x7f847c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.330+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84900ab6d0 con 0x7f849815e4d0 2023-08-10T10:44:11.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.330+0000 7f849e0cb640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 0x7f847c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.330+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f847c072da0 con 0x7f849815e4d0 2023-08-10T10:44:11.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.331+0000 7f849e0cb640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 0x7f847c06d110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8494000f60 tx=0x7f84940078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.334+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f84900766e0 con 0x7f849815e4d0 2023-08-10T10:44:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.525+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f849804e270 con 0x7f849815e4d0 2023-08-10T10:44:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.526+0000 7f848effd640 1 -- 172.21.15.50:0/1118832900 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f849004d0a0 con 0x7f849815e4d0 2023-08-10T10:44:11.527 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:44:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 msgr2=0x7f847c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 0x7f847c06d110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8494000f60 tx=0x7f84940078f0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 msgr2=0x7f84980ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f849002c4d0 tx=0x7f8490004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 shutdown_connections 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f849815e4d0 0x7f84980ae900 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f847c06ac50 0x7f847c06d110 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84981583c0 0x7f8498148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 --2- 172.21.15.50:0/1118832900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84980696a0 0x7f84981466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 >> 172.21.15.50:0/1118832900 conn(0x7f84980caf80 msgr2=0x7f84981553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 shutdown_connections 2023-08-10T10:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.529+0000 7f849f0cd640 1 -- 172.21.15.50:0/1118832900 wait complete. 2023-08-10T10:44:11.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:44:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.779+0000 7f90fa3a2640 1 Processor -- start 2023-08-10T10:44:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.779+0000 7f90fa3a2640 1 -- start start 2023-08-10T10:44:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.780+0000 7f90fa3a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90f40d23f0 0x7f90f40d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90fa3a2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40d1220 con 0x7f90f40cd730 2023-08-10T10:44:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90fa3a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40b8a30 con 0x7f90f415ce00 2023-08-10T10:44:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90fa3a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40b1e70 con 0x7f90f40d23f0 2023-08-10T10:44:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90f3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90f40cd730 0x7f90f40cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43430/0 (socket says 172.21.15.50:43430) 2023-08-10T10:44:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90f3fff640 1 -- 172.21.15.50:0/2436639354 learned_addr learned my addr 172.21.15.50:0/2436639354 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.781+0000 7f90f893f640 1 --2- 172.21.15.50:0/2436639354 >> v2:172.21.15.50:3300/0 conn(0x7f90f40d23f0 0x7f90f40d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.782+0000 7f90f893f640 1 -- 172.21.15.50:0/2436639354 >> v1:172.21.15.117:6789/0 conn(0x7f90f415ce00 legacy=0x7f90f40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.782+0000 7f90f2ffd640 1 -- 172.21.15.50:0/2436639354 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393164635 0 0) 0x7f90f40d1220 con 0x7f90f40cd730 2023-08-10T10:44:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.782+0000 7f90f893f640 1 -- 172.21.15.50:0/2436639354 >> v1:172.21.15.50:6789/0 conn(0x7f90f40cd730 legacy=0x7f90f40cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.782+0000 7f90f893f640 1 -- 172.21.15.50:0/2436639354 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40d0c10 con 0x7f90f40d23f0 2023-08-10T10:44:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.783+0000 7f90f893f640 1 --2- 172.21.15.50:0/2436639354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f40d23f0 0x7f90f40d16b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83827dc2ca153429 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.783+0000 7f90f2ffd640 1 -- 172.21.15.50:0/2436639354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec02cd00 con 0x7f90f40d23f0 2023-08-10T10:44:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.783+0000 7f90f2ffd640 1 -- 172.21.15.50:0/2436639354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec02ce60 con 0x7f90f40d23f0 2023-08-10T10:44:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.783+0000 7f90f2ffd640 1 -- 172.21.15.50:0/2436639354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec034660 con 0x7f90f40d23f0 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 -- 172.21.15.50:0/2436639354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f40d23f0 msgr2=0x7f90f40d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/2436639354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f40d23f0 0x7f90f40d16b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec02bf50 comp rx=0 tx=0).stop 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 -- 172.21.15.50:0/2436639354 shutdown_connections 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/2436639354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f40d23f0 0x7f90f40d16b0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 -- 172.21.15.50:0/2436639354 >> 172.21.15.50:0/2436639354 conn(0x7f90f40d2c60 msgr2=0x7f90f40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 -- 172.21.15.50:0/2436639354 shutdown_connections 2023-08-10T10:44:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.784+0000 7f90fa3a2640 1 -- 172.21.15.50:0/2436639354 wait complete. 2023-08-10T10:44:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.786+0000 7f90fa3a2640 1 Processor -- start 2023-08-10T10:44:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.786+0000 7f90fa3a2640 1 -- start start 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40cd730 0x7f90f41e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 0x7f90f40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f41f3680 con 0x7f90f415ce00 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40cb5e0 con 0x7f90f40cd730 2023-08-10T10:44:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90fa3a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40cb8c0 con 0x7f90f40d23f0 2023-08-10T10:44:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90f893f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90f893f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36584/0 (socket says 172.21.15.50:36584) 2023-08-10T10:44:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.787+0000 7f90f893f640 1 -- 172.21.15.50:0/3475993689 learned_addr learned my addr 172.21.15.50:0/3475993689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f3fff640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40cd730 0x7f90f41e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f37fe640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 0x7f90f40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 -- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 msgr2=0x7f90f40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 0x7f90f40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 -- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40cd730 msgr2=0x7f90f41e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40cd730 0x7f90f41e5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:11.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009a70 con 0x7f90f415ce00 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f37fe640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 0x7f90f40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.788+0000 7f90f893f640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.789+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec003b90 con 0x7f90f415ce00 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.789+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec003cf0 con 0x7f90f415ce00 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.789+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec004230 con 0x7f90f415ce00 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.789+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f40cbba0 con 0x7f90f415ce00 2023-08-10T10:44:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.789+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40cbe80 con 0x7f90f415ce00 2023-08-10T10:44:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.790+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f404e270 con 0x7f90f415ce00 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.791+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90ec03b050 con 0x7f90f415ce00 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.792+0000 7f90f0ff9640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 0x7f90e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.792+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90ec0abe70 con 0x7f90f415ce00 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.792+0000 7f90f3fff640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 0x7f90e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.792+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f90e0072da0 con 0x7f90f415ce00 2023-08-10T10:44:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.793+0000 7f90f3fff640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 0x7f90e006d110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90e4000f60 tx=0x7f90e4007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:11.797+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f90ec039060 con 0x7f90f415ce00 2023-08-10T10:44:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.002+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90f41f37c0 con 0x7f90f415ce00 2023-08-10T10:44:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.003+0000 7f90f0ff9640 1 -- 172.21.15.50:0/3475993689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90ec076e80 con 0x7f90f415ce00 2023-08-10T10:44:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:44:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.005+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 msgr2=0x7f90e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.005+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 0x7f90e006d110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90e4000f60 tx=0x7f90e4007b90 comp rx=0 tx=0).stop 2023-08-10T10:44:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.005+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 msgr2=0x7f90f41584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.005+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 shutdown_connections 2023-08-10T10:44:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90f415ce00 0x7f90f41584b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40d23f0 0x7f90f40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90e006ac50 0x7f90e006d110 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 --2- 172.21.15.50:0/3475993689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40cd730 0x7f90f41e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 >> 172.21.15.50:0/3475993689 conn(0x7f90f40d2c60 msgr2=0x7f90f40d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 shutdown_connections 2023-08-10T10:44:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.006+0000 7f90fa3a2640 1 -- 172.21.15.50:0/3475993689 wait complete. 2023-08-10T10:44:12.025 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:44:12.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:12.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:44:12.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:44:12.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:12.157 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:44:12.217 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:12.217 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:12.277 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:12.278 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:12.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:12.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.567+0000 7fd59ebc4640 1 Processor -- start 2023-08-10T10:44:12.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.568+0000 7fd59ebc4640 1 -- start start 2023-08-10T10:44:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.569+0000 7fd59ebc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd598153850 0x7fd5980b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.569+0000 7fd59ebc4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd598153c30 0x7fd5980b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.569+0000 7fd59ebc4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59815d010 con 0x7fd5980cf630 2023-08-10T10:44:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59ebc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59815d290 con 0x7fd598153850 2023-08-10T10:44:12.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59ebc4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59815d570 con 0x7fd598153c30 2023-08-10T10:44:12.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd598153850 0x7fd5980b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:12.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd598153850 0x7fd5980b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36588/0 (socket says 172.21.15.50:36588) 2023-08-10T10:44:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 -- 172.21.15.50:0/2009937953 learned_addr learned my addr 172.21.15.50:0/2009937953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 -- 172.21.15.50:0/2009937953 >> v2:172.21.15.117:3300/0 conn(0x7fd598153c30 msgr2=0x7fd5980b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 --2- 172.21.15.50:0/2009937953 >> v2:172.21.15.117:3300/0 conn(0x7fd598153c30 0x7fd5980b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 -- 172.21.15.50:0/2009937953 >> v1:172.21.15.117:6789/0 conn(0x7fd5980cf630 legacy=0x7fd5980ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.570+0000 7fd59dbc2640 1 -- 172.21.15.50:0/2009937953 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59815d850 con 0x7fd598153850 2023-08-10T10:44:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.571+0000 7fd59dbc2640 1 --2- 172.21.15.50:0/2009937953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b1690 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd59808b960 tx=0x7fd59402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94504f5df801c57 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.572+0000 7fd59cbc0640 1 -- 172.21.15.50:0/2009937953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594031870 con 0x7fd598153850 2023-08-10T10:44:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.572+0000 7fd59cbc0640 1 -- 172.21.15.50:0/2009937953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940319d0 con 0x7fd598153850 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.572+0000 7fd59cbc0640 1 -- 172.21.15.50:0/2009937953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594031d60 con 0x7fd598153850 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.572+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2009937953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 msgr2=0x7fd5980b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.572+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2009937953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b1690 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd59808b960 tx=0x7fd59402b910 comp rx=0 tx=0).stop 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2009937953 shutdown_connections 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2009937953 >> v2:172.21.15.117:3300/0 conn(0x7fd598153c30 0x7fd5980b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2009937953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b1690 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2009937953 >> 172.21.15.50:0/2009937953 conn(0x7fd598069880 msgr2=0x7fd598069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2009937953 shutdown_connections 2023-08-10T10:44:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.573+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2009937953 wait complete. 2023-08-10T10:44:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.575+0000 7fd59ebc4640 1 Processor -- start 2023-08-10T10:44:12.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.575+0000 7fd59ebc4640 1 -- start start 2023-08-10T10:44:12.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5980cf630 0x7fd5981512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 0x7fd5980b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598151820 con 0x7fd598153850 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980d1350 con 0x7fd598153c30 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59ebc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c8030 con 0x7fd5980cf630 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59d3c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:12.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59d3c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36600/0 (socket says 172.21.15.50:36600) 2023-08-10T10:44:12.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59d3c1640 1 -- 172.21.15.50:0/2795539644 learned_addr learned my addr 172.21.15.50:0/2795539644 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.576+0000 7fd59dbc2640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5980cf630 0x7fd5981512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59e3c3640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 0x7fd5980b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 -- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5980cf630 msgr2=0x7fd5981512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5980cf630 0x7fd5981512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 -- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 msgr2=0x7fd5980b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 0x7fd5980b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940094d0 con 0x7fd598153850 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59e3c3640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 0x7fd5980b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59d3c1640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b410 tx=0x7fd58800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011830 con 0x7fd598153850 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5880119b0 con 0x7fd598153850 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011d60 con 0x7fd598153850 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980c8310 con 0x7fd598153850 2023-08-10T10:44:12.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.577+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5980c88d0 con 0x7fd598153850 2023-08-10T10:44:12.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.579+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd598066e30 con 0x7fd598153850 2023-08-10T10:44:12.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.579+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd58801a400 con 0x7fd598153850 2023-08-10T10:44:12.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.580+0000 7fd58e7fc640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 0x7fd57c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.580+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd588089700 con 0x7fd598153850 2023-08-10T10:44:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.581+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fd57c072da0 con 0x7fd598153850 2023-08-10T10:44:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.581+0000 7fd59dbc2640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 0x7fd57c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.582+0000 7fd59dbc2640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 0x7fd57c06d110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd594036000 tx=0x7fd59403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:12.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.585+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd588054710 con 0x7fd598153850 2023-08-10T10:44:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.878+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5980b50f0 con 0x7fd598153850 2023-08-10T10:44:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.880+0000 7fd58e7fc640 1 -- 172.21.15.50:0/2795539644 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fd588015070 con 0x7fd598153850 2023-08-10T10:44:12.881 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:12.881 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:43:41.155422+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 msgr2=0x7fd57c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 0x7fd57c06d110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd594036000 tx=0x7fd59403c040 comp rx=0 tx=0).stop 2023-08-10T10:44:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 msgr2=0x7fd5980b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b410 tx=0x7fd58800b8d0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 shutdown_connections 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd57c06ac50 0x7fd57c06d110 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd598153c30 0x7fd5980b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.882+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd598153850 0x7fd5980b2740 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.883+0000 7fd59ebc4640 1 --2- 172.21.15.50:0/2795539644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5980cf630 0x7fd5981512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.883+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 >> 172.21.15.50:0/2795539644 conn(0x7fd598069880 msgr2=0x7fd598160960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.883+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 shutdown_connections 2023-08-10T10:44:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:12.883+0000 7fd59ebc4640 1 -- 172.21.15.50:0/2795539644 wait complete. 2023-08-10T10:44:12.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:43:16.551358+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:43:18.005134+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:44:12.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.121+0000 7f27f87fd640 1 Processor -- start 2023-08-10T10:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.121+0000 7f27f87fd640 1 -- start start 2023-08-10T10:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f87fd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 0x7f27f01612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f87fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27f00c98b0 0x7f27f00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f87fd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f0161800 con 0x7f27f00c8d10 2023-08-10T10:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f87fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f0160870 con 0x7f27f00c98b0 2023-08-10T10:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f87fd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00ca370 con 0x7f27f015cbb0 2023-08-10T10:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f6d9a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27f00c8d10 0x7f27f00c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43446/0 (socket says 172.21.15.50:43446) 2023-08-10T10:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f6d9a640 1 -- 172.21.15.50:0/1984836863 learned_addr learned my addr 172.21.15.50:0/1984836863 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.123+0000 7f27f5d98640 1 --2- 172.21.15.50:0/1984836863 >> v2:172.21.15.50:3300/0 conn(0x7f27f00c98b0 0x7f27f00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f6599640 1 --2- 172.21.15.50:0/1984836863 >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 0x7f27f01612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5597640 1 -- 172.21.15.50:0/1984836863 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347160350 0 0) 0x7f27e8001490 con 0x7f27f00c8d10 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5597640 1 -- 172.21.15.50:0/1984836863 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003520 con 0x7f27f00c8d10 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5d98640 1 -- 172.21.15.50:0/1984836863 >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 msgr2=0x7f27f01612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5d98640 1 --2- 172.21.15.50:0/1984836863 >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 0x7f27f01612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5d98640 1 -- 172.21.15.50:0/1984836863 >> v1:172.21.15.50:6789/0 conn(0x7f27f00c8d10 legacy=0x7f27f00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f5d98640 1 -- 172.21.15.50:0/1984836863 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00ca650 con 0x7f27f00c98b0 2023-08-10T10:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.124+0000 7f27f6599640 1 --2- 172.21.15.50:0/1984836863 >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 0x7f27f01612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:44:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.126+0000 7f27f5d98640 1 --2- 172.21.15.50:0/1984836863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f00c98b0 0x7f27f00c9d40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f27f006e6f0 tx=0x7f27e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182c0f2d88820cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.126+0000 7f27f5597640 1 -- 172.21.15.50:0/1984836863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e002e070 con 0x7f27f00c98b0 2023-08-10T10:44:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f5597640 1 -- 172.21.15.50:0/1984836863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00315a0 con 0x7f27f00c98b0 2023-08-10T10:44:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f5597640 1 -- 172.21.15.50:0/1984836863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0031910 con 0x7f27f00c98b0 2023-08-10T10:44:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 -- 172.21.15.50:0/1984836863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f00c98b0 msgr2=0x7f27f00c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 --2- 172.21.15.50:0/1984836863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f00c98b0 0x7f27f00c9d40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f27f006e6f0 tx=0x7f27e002b840 comp rx=0 tx=0).stop 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 -- 172.21.15.50:0/1984836863 shutdown_connections 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 --2- 172.21.15.50:0/1984836863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f00c98b0 0x7f27f00c9d40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 --2- 172.21.15.50:0/1984836863 >> v2:172.21.15.117:3300/0 conn(0x7f27f015cbb0 0x7f27f01612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 -- 172.21.15.50:0/1984836863 >> 172.21.15.50:0/1984836863 conn(0x7f27f00b01b0 msgr2=0x7f27f00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.127+0000 7f27f87fd640 1 -- 172.21.15.50:0/1984836863 shutdown_connections 2023-08-10T10:44:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.128+0000 7f27f87fd640 1 -- 172.21.15.50:0/1984836863 wait complete. 2023-08-10T10:44:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.129+0000 7f27f87fd640 1 Processor -- start 2023-08-10T10:44:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.130+0000 7f27f87fd640 1 -- start start 2023-08-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.130+0000 7f27f87fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f00c8d10 0x7f27f006c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f87fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 0x7f27f01f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f87fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f87fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015b250 con 0x7f27f015cbb0 2023-08-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f87fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b31b0 con 0x7f27f00c98b0 2023-08-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f87fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b3490 con 0x7f27f00c8d10 2023-08-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36618/0 (socket says 172.21.15.50:36618) 2023-08-10T10:44:13.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 -- 172.21.15.50:0/3188960673 learned_addr learned my addr 172.21.15.50:0/3188960673 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:13.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6599640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f00c8d10 0x7f27f006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f5d98640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 0x7f27f01f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 -- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f00c8d10 msgr2=0x7f27f006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f00c8d10 0x7f27f006c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 -- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 msgr2=0x7f27f01f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 0x7f27f01f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f6d9a640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009400 con 0x7f27f015cbb0 2023-08-10T10:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.131+0000 7f27f5d98640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 0x7f27f01f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27f6d9a640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f27e800cae0 tx=0x7f27e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800ac40 con 0x7f27f015cbb0 2023-08-10T10:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800ada0 con 0x7f27f015cbb0 2023-08-10T10:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00b3770 con 0x7f27f015cbb0 2023-08-10T10:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8012620 con 0x7f27f015cbb0 2023-08-10T10:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.132+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00b3d30 con 0x7f27f015cbb0 2023-08-10T10:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.134+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00b3f20 con 0x7f27f015cbb0 2023-08-10T10:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.135+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27e8007070 con 0x7f27f015cbb0 2023-08-10T10:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.135+0000 7f27e6ffd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 0x7f27d406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.136+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27e8089370 con 0x7f27f015cbb0 2023-08-10T10:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.136+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f27d4072dd0 con 0x7f27f015cbb0 2023-08-10T10:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.136+0000 7f27f6599640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 0x7f27d406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.137+0000 7f27f6599640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 0x7f27d406d140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.140+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27e8017060 con 0x7f27f015cbb0 2023-08-10T10:44:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.333+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f0161800 con 0x7f27f015cbb0 2023-08-10T10:44:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.334+0000 7f27e6ffd640 1 -- 172.21.15.50:0/3188960673 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27f0161800 con 0x7f27f015cbb0 2023-08-10T10:44:13.334 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:44:13.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.337+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 msgr2=0x7f27d406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.337+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 0x7f27d406d140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).stop 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.337+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 msgr2=0x7f27f00c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.337+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f27e800cae0 tx=0x7f27e800a060 comp rx=0 tx=0).stop 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 shutdown_connections 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f015cbb0 0x7f27f00c7190 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f27d406ac80 0x7f27d406d140 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27f00c98b0 0x7f27f01f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 --2- 172.21.15.50:0/3188960673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f00c8d10 0x7f27f006c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 >> 172.21.15.50:0/3188960673 conn(0x7f27f00b01b0 msgr2=0x7f27f00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 shutdown_connections 2023-08-10T10:44:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.338+0000 7f27f87fd640 1 -- 172.21.15.50:0/3188960673 wait complete. 2023-08-10T10:44:13.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:44:13.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:44:13.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:44:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.588+0000 7f2363fff640 1 Processor -- start 2023-08-10T10:44:13.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.589+0000 7f2363fff640 1 -- start start 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236415ac30 0x7f23640cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 0x7f236406e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236406cc80 con 0x7f236415ac30 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236406dae0 con 0x7f236406e470 2023-08-10T10:44:13.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.590+0000 7f2363fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236406edf0 con 0x7f236415e720 2023-08-10T10:44:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236415ac30 0x7f23640cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f236415ac30 0x7f23640cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36620/0 (socket says 172.21.15.50:36620) 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 -- 172.21.15.50:0/688813637 learned_addr learned my addr 172.21.15.50:0/688813637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f235bfff640 1 --2- 172.21.15.50:0/688813637 >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 0x7f236406e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f23637fe640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 -- 172.21.15.50:0/688813637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 msgr2=0x7f236415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 -- 172.21.15.50:0/688813637 >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 msgr2=0x7f236406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:13.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 --2- 172.21.15.50:0/688813637 >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 0x7f236406e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f2362ffd640 1 -- 172.21.15.50:0/688813637 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236415b010 con 0x7f236415ac30 2023-08-10T10:44:13.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f23637fe640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:13.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.591+0000 7f235bfff640 1 --2- 172.21.15.50:0/688813637 >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 0x7f236406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.592+0000 7f2362ffd640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236415ac30 0x7f23640cc8d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2364073770 tx=0x7f235402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c61215aeb50b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.593+0000 7f23627fc640 1 -- 172.21.15.50:0/688813637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354030850 con 0x7f236415ac30 2023-08-10T10:44:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.593+0000 7f23627fc640 1 -- 172.21.15.50:0/688813637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540309b0 con 0x7f236415ac30 2023-08-10T10:44:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.593+0000 7f23627fc640 1 -- 172.21.15.50:0/688813637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354030d40 con 0x7f236415ac30 2023-08-10T10:44:13.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 -- 172.21.15.50:0/688813637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236415ac30 msgr2=0x7f23640cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236415ac30 0x7f23640cc8d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2364073770 tx=0x7f235402b990 comp rx=0 tx=0).stop 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 -- 172.21.15.50:0/688813637 shutdown_connections 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 --2- 172.21.15.50:0/688813637 >> v2:172.21.15.117:3300/0 conn(0x7f236406e470 0x7f236406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 --2- 172.21.15.50:0/688813637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236415ac30 0x7f23640cc8d0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 -- 172.21.15.50:0/688813637 >> 172.21.15.50:0/688813637 conn(0x7f23640d06a0 msgr2=0x7f23640d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 -- 172.21.15.50:0/688813637 shutdown_connections 2023-08-10T10:44:13.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.594+0000 7f2363fff640 1 -- 172.21.15.50:0/688813637 wait complete. 2023-08-10T10:44:13.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.596+0000 7f2363fff640 1 Processor -- start 2023-08-10T10:44:13.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.596+0000 7f2363fff640 1 -- start start 2023-08-10T10:44:13.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236415ac30 0x7f2364156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236406a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640c8eb0 con 0x7f236406e470 2023-08-10T10:44:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364156a70 con 0x7f236415ac30 2023-08-10T10:44:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2363fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236406b300 con 0x7f236415e720 2023-08-10T10:44:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2362ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2362ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36628/0 (socket says 172.21.15.50:36628) 2023-08-10T10:44:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f2362ffd640 1 -- 172.21.15.50:0/3305499496 learned_addr learned my addr 172.21.15.50:0/3305499496 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:13.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f23637fe640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.598+0000 7f235bfff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236415ac30 0x7f2364156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 -- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 msgr2=0x7f236406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236406a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 -- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236415ac30 msgr2=0x7f2364156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236415ac30 0x7f2364156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540094d0 con 0x7f236406e470 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f2362ffd640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f235402b9d0 tx=0x7f2354004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.599+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354030820 con 0x7f236406e470 2023-08-10T10:44:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.600+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354043400 con 0x7f236406e470 2023-08-10T10:44:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.600+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540437b0 con 0x7f236406e470 2023-08-10T10:44:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.600+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236406b5e0 con 0x7f236406e470 2023-08-10T10:44:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.600+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23640c8b40 con 0x7f236406e470 2023-08-10T10:44:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.601+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2364066e30 con 0x7f236406e470 2023-08-10T10:44:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.602+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f235402e070 con 0x7f236406e470 2023-08-10T10:44:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.603+0000 7f235b7fe640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 0x7f234406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.603+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f235403e070 con 0x7f236406e470 2023-08-10T10:44:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.603+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f2344072dd0 con 0x7f236406e470 2023-08-10T10:44:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.603+0000 7f235bfff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 0x7f234406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.604+0000 7f235bfff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 0x7f234406d140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23640697c0 tx=0x7f234c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.607+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2354034060 con 0x7f236406e470 2023-08-10T10:44:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.806+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f236406d760 con 0x7f236406e470 2023-08-10T10:44:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.807+0000 7f235b7fe640 1 -- 172.21.15.50:0/3305499496 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2354077530 con 0x7f236406e470 2023-08-10T10:44:13.808 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:44:13.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.810+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 msgr2=0x7f234406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.810+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 0x7f234406d140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23640697c0 tx=0x7f234c008040 comp rx=0 tx=0).stop 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 msgr2=0x7f23641537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f235402b9d0 tx=0x7f2354004730 comp rx=0 tx=0).stop 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 shutdown_connections 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f236415e720 0x7f236406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f234406ac80 0x7f234406d140 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236415ac30 0x7f2364156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 --2- 172.21.15.50:0/3305499496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236406e470 0x7f23641537b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 >> 172.21.15.50:0/3305499496 conn(0x7f23640d06a0 msgr2=0x7f236415b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 shutdown_connections 2023-08-10T10:44:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:13.811+0000 7f2363fff640 1 -- 172.21.15.50:0/3305499496 wait complete. 2023-08-10T10:44:13.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:44:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.089+0000 7fb748206640 1 Processor -- start 2023-08-10T10:44:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.089+0000 7fb748206640 1 -- start start 2023-08-10T10:44:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.090+0000 7fb748206640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb74015ae40 0x7fb7400b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.090+0000 7fb748206640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb74006cb30 0x7fb7400ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.090+0000 7fb748206640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400adcb0 con 0x7fb7400cd2a0 2023-08-10T10:44:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.090+0000 7fb748206640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74006c320 con 0x7fb74015ae40 2023-08-10T10:44:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb748206640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74006b770 con 0x7fb74006cb30 2023-08-10T10:44:14.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb7467a3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7400cd2a0 0x7fb7400c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43460/0 (socket says 172.21.15.50:43460) 2023-08-10T10:44:14.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb7467a3640 1 -- 172.21.15.50:0/9753948 learned_addr learned my addr 172.21.15.50:0/9753948 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb745fa2640 1 --2- 172.21.15.50:0/9753948 >> v2:172.21.15.50:3300/0 conn(0x7fb74015ae40 0x7fb7400b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb744fa0640 1 -- 172.21.15.50:0/9753948 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169771493 0 0) 0x7fb7400adcb0 con 0x7fb7400cd2a0 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb7457a1640 1 --2- 172.21.15.50:0/9753948 >> v2:172.21.15.117:3300/0 conn(0x7fb74006cb30 0x7fb7400ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.091+0000 7fb744fa0640 1 -- 172.21.15.50:0/9753948 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72c003520 con 0x7fb7400cd2a0 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.092+0000 7fb745fa2640 1 -- 172.21.15.50:0/9753948 >> v2:172.21.15.117:3300/0 conn(0x7fb74006cb30 msgr2=0x7fb7400ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.092+0000 7fb745fa2640 1 --2- 172.21.15.50:0/9753948 >> v2:172.21.15.117:3300/0 conn(0x7fb74006cb30 0x7fb7400ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.092+0000 7fb745fa2640 1 -- 172.21.15.50:0/9753948 >> v1:172.21.15.50:6789/0 conn(0x7fb7400cd2a0 legacy=0x7fb7400c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.092+0000 7fb745fa2640 1 -- 172.21.15.50:0/9753948 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74006b9f0 con 0x7fb74015ae40 2023-08-10T10:44:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.093+0000 7fb745fa2640 1 --2- 172.21.15.50:0/9753948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74015ae40 0x7fb7400b1510 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb74006ea30 tx=0x7fb73c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796a4977fc536979 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.093+0000 7fb744fa0640 1 -- 172.21.15.50:0/9753948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c031830 con 0x7fb74015ae40 2023-08-10T10:44:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.093+0000 7fb744fa0640 1 -- 172.21.15.50:0/9753948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c031990 con 0x7fb74015ae40 2023-08-10T10:44:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.093+0000 7fb744fa0640 1 -- 172.21.15.50:0/9753948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c031d20 con 0x7fb74015ae40 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 -- 172.21.15.50:0/9753948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74015ae40 msgr2=0x7fb7400b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 --2- 172.21.15.50:0/9753948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74015ae40 0x7fb7400b1510 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb74006ea30 tx=0x7fb73c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 -- 172.21.15.50:0/9753948 shutdown_connections 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 --2- 172.21.15.50:0/9753948 >> v2:172.21.15.117:3300/0 conn(0x7fb74006cb30 0x7fb7400ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 --2- 172.21.15.50:0/9753948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74015ae40 0x7fb7400b1510 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 -- 172.21.15.50:0/9753948 >> 172.21.15.50:0/9753948 conn(0x7fb7400b01b0 msgr2=0x7fb7400b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 -- 172.21.15.50:0/9753948 shutdown_connections 2023-08-10T10:44:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.094+0000 7fb748206640 1 -- 172.21.15.50:0/9753948 wait complete. 2023-08-10T10:44:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.096+0000 7fb748206640 1 Processor -- start 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.096+0000 7fb748206640 1 -- start start 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7400cd2a0 0x7fb7400ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74015ae40 0x7fb7401f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c85e0 con 0x7fb74006cb30 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7401f6560 con 0x7fb7400cd2a0 2023-08-10T10:44:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb748206640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c51a0 con 0x7fb74015ae40 2023-08-10T10:44:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb745fa2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb745fa2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36644/0 (socket says 172.21.15.50:36644) 2023-08-10T10:44:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.097+0000 7fb745fa2640 1 -- 172.21.15.50:0/852668523 learned_addr learned my addr 172.21.15.50:0/852668523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb7457a1640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7400cd2a0 0x7fb7400ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 -- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74015ae40 msgr2=0x7fb7401f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb7467a3640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74015ae40 0x7fb7401f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74015ae40 0x7fb7401f9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 -- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7400cd2a0 msgr2=0x7fb7400ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7400cd2a0 0x7fb7400ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c009400 con 0x7fb74006cb30 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb745fa2640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb73c034040 tx=0x7fb73c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.098+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c03a830 con 0x7fb74006cb30 2023-08-10T10:44:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.099+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c03a9d0 con 0x7fb74006cb30 2023-08-10T10:44:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.099+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c03ad80 con 0x7fb74006cb30 2023-08-10T10:44:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.099+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7401f6770 con 0x7fb74006cb30 2023-08-10T10:44:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.099+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7401f6a10 con 0x7fb74006cb30 2023-08-10T10:44:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.100+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7400612b0 con 0x7fb74006cb30 2023-08-10T10:44:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.101+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb73c04d450 con 0x7fb74006cb30 2023-08-10T10:44:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.102+0000 7fb7367fc640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 0x7fb72406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.102+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb73c0ab5d0 con 0x7fb74006cb30 2023-08-10T10:44:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.102+0000 7fb7457a1640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 0x7fb72406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.102+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fb724072dd0 con 0x7fb74006cb30 2023-08-10T10:44:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.103+0000 7fb7457a1640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 0x7fb72406d140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb730008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.108+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb73c035020 con 0x7fb74006cb30 2023-08-10T10:44:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.297+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7400cd980 con 0x7fb74006cb30 2023-08-10T10:44:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.298+0000 7fb7367fc640 1 -- 172.21.15.50:0/852668523 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb73c07a220 con 0x7fb74006cb30 2023-08-10T10:44:14.299 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:44:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 msgr2=0x7fb72406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 0x7fb72406d140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb730008040 comp rx=0 tx=0).stop 2023-08-10T10:44:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 msgr2=0x7fb7400c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb73c034040 tx=0x7fb73c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 shutdown_connections 2023-08-10T10:44:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74015ae40 0x7fb7401f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb72406ac80 0x7fb72406d140 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7400cd2a0 0x7fb7400ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 --2- 172.21.15.50:0/852668523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb74006cb30 0x7fb7400c48e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 >> 172.21.15.50:0/852668523 conn(0x7fb7400b01b0 msgr2=0x7fb7400c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 shutdown_connections 2023-08-10T10:44:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.301+0000 7fb748206640 1 -- 172.21.15.50:0/852668523 wait complete. 2023-08-10T10:44:14.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:44:14.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.557+0000 7fed79f76640 1 Processor -- start 2023-08-10T10:44:14.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.558+0000 7fed79f76640 1 -- start start 2023-08-10T10:44:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.559+0000 7fed79f76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed7406ec90 0x7fed740ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.559+0000 7fed79f76640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd730 0x7fed74163e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.559+0000 7fed79f76640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740ca220 con 0x7fed740cd2a0 2023-08-10T10:44:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.559+0000 7fed79f76640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed74159750 con 0x7fed740cd730 2023-08-10T10:44:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.559+0000 7fed79f76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740ca500 con 0x7fed7406ec90 2023-08-10T10:44:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd730 0x7fed74163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed740cd730 0x7fed74163e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36646/0 (socket says 172.21.15.50:36646) 2023-08-10T10:44:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 -- 172.21.15.50:0/3609452271 learned_addr learned my addr 172.21.15.50:0/3609452271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed737fe640 1 --2- 172.21.15.50:0/3609452271 >> v2:172.21.15.117:3300/0 conn(0x7fed7406ec90 0x7fed740ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 -- 172.21.15.50:0/3609452271 >> v2:172.21.15.117:3300/0 conn(0x7fed7406ec90 msgr2=0x7fed740ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 --2- 172.21.15.50:0/3609452271 >> v2:172.21.15.117:3300/0 conn(0x7fed7406ec90 0x7fed740ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 -- 172.21.15.50:0/3609452271 >> v1:172.21.15.117:6789/0 conn(0x7fed740cd2a0 legacy=0x7fed7406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.560+0000 7fed73fff640 1 -- 172.21.15.50:0/3609452271 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7406a0f0 con 0x7fed740cd730 2023-08-10T10:44:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.561+0000 7fed73fff640 1 --2- 172.21.15.50:0/3609452271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd730 0x7fed74163e10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fed74073e80 tx=0x7fed6c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefc7dd1496153be server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.562+0000 7fed727fc640 1 -- 172.21.15.50:0/3609452271 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c02ca80 con 0x7fed740cd730 2023-08-10T10:44:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.562+0000 7fed727fc640 1 -- 172.21.15.50:0/3609452271 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c02cbe0 con 0x7fed740cd730 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.562+0000 7fed727fc640 1 -- 172.21.15.50:0/3609452271 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0343f0 con 0x7fed740cd730 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.562+0000 7fed79f76640 1 -- 172.21.15.50:0/3609452271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd730 msgr2=0x7fed74163e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.562+0000 7fed79f76640 1 --2- 172.21.15.50:0/3609452271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd730 0x7fed74163e10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fed74073e80 tx=0x7fed6c02bee0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 -- 172.21.15.50:0/3609452271 shutdown_connections 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 --2- 172.21.15.50:0/3609452271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd730 0x7fed74163e10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 --2- 172.21.15.50:0/3609452271 >> v2:172.21.15.117:3300/0 conn(0x7fed7406ec90 0x7fed740ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 -- 172.21.15.50:0/3609452271 >> 172.21.15.50:0/3609452271 conn(0x7fed740b01b0 msgr2=0x7fed740b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 -- 172.21.15.50:0/3609452271 shutdown_connections 2023-08-10T10:44:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.563+0000 7fed79f76640 1 -- 172.21.15.50:0/3609452271 wait complete. 2023-08-10T10:44:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.564+0000 7fed79f76640 1 Processor -- start 2023-08-10T10:44:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.565+0000 7fed79f76640 1 -- start start 2023-08-10T10:44:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7406ec90 0x7fed74151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740cd730 0x7fed740c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c53d0 con 0x7fed740cd2a0 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c50f0 con 0x7fed740cd730 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed79f76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7414bdd0 con 0x7fed7406ec90 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36660/0 (socket says 172.21.15.50:36660) 2023-08-10T10:44:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 -- 172.21.15.50:0/1905488299 learned_addr learned my addr 172.21.15.50:0/1905488299 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed737fe640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7406ec90 0x7fed74151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed73fff640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740cd730 0x7fed740c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 -- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7406ec90 msgr2=0x7fed74151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7406ec90 0x7fed74151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 -- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740cd730 msgr2=0x7fed740c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740cd730 0x7fed740c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.566+0000 7fed72ffd640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009b30 con 0x7fed740cd2a0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed72ffd640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fed6800b3f0 tx=0x7fed6800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68011830 con 0x7fed740cd2a0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed68011990 con 0x7fed740cd2a0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68011d40 con 0x7fed740cd2a0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7414c0b0 con 0x7fed740cd2a0 2023-08-10T10:44:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.567+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7414cdf0 con 0x7fed740cd2a0 2023-08-10T10:44:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.569+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7414c5d0 con 0x7fed740cd2a0 2023-08-10T10:44:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.569+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed6801a400 con 0x7fed740cd2a0 2023-08-10T10:44:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.570+0000 7fed5bfff640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 0x7fed6006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.571+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed680892e0 con 0x7fed740cd2a0 2023-08-10T10:44:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.571+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fed60072dd0 con 0x7fed740cd2a0 2023-08-10T10:44:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.571+0000 7fed737fe640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 0x7fed6006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.572+0000 7fed737fe640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 0x7fed6006d140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed64006fd0 tx=0x7fed64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.575+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed7414c5d0 con 0x7fed740cd2a0 2023-08-10T10:44:14.738 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:44:14.738+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-08-10T10:44:14.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.748+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(97..97 src has 1..97) v4 ==== 296+0+0 (secure 0 0 0) 0x7fed6805c000 con 0x7fed740cd2a0 2023-08-10T10:44:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.748+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fed60073680 con 0x7fed740cd2a0 2023-08-10T10:44:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.772+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed7414c5d0 con 0x7fed740cd2a0 2023-08-10T10:44:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.773+0000 7fed5bfff640 1 -- 172.21.15.50:0/1905488299 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed7414c5d0 con 0x7fed740cd2a0 2023-08-10T10:44:14.774 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:44:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 msgr2=0x7fed6006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 0x7fed6006d140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed64006fd0 tx=0x7fed64008040 comp rx=0 tx=0).stop 2023-08-10T10:44:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 msgr2=0x7fed7414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fed6800b3f0 tx=0x7fed6800b8b0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 shutdown_connections 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed6006ac80 0x7fed6006d140 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed740cd730 0x7fed740c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed740cd2a0 0x7fed7414c8b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 --2- 172.21.15.50:0/1905488299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed7406ec90 0x7fed74151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.776+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 >> 172.21.15.50:0/1905488299 conn(0x7fed740b01b0 msgr2=0x7fed740c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.777+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 shutdown_connections 2023-08-10T10:44:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:14.777+0000 7fed79f76640 1 -- 172.21.15.50:0/1905488299 wait complete. 2023-08-10T10:44:14.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:44:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.020+0000 7f7f37fff640 1 Processor -- start 2023-08-10T10:44:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.020+0000 7f7f37fff640 1 -- start start 2023-08-10T10:44:15.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.021+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f38069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f37fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3806a040 con 0x7f7f380cc420 2023-08-10T10:44:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f37fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3815def0 con 0x7f7f38159830 2023-08-10T10:44:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f37fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380ce350 con 0x7f7f380696a0 2023-08-10T10:44:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7f380cc420 0x7f7f380cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45976/0 (socket says 172.21.15.50:45976) 2023-08-10T10:44:15.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f377fe640 1 -- 172.21.15.50:0/3697005269 learned_addr learned my addr 172.21.15.50:0/3697005269 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.022+0000 7f7f2ffff640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f38069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787589827 0 0) 0x7f7f3806a040 con 0x7f7f380cc420 2023-08-10T10:44:15.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f24003520 con 0x7f7f380cc420 2023-08-10T10:44:15.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679515400 0 0) 0x7f7f24003520 con 0x7f7f380cc420 2023-08-10T10:44:15.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 msgr2=0x7f7f38069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:15.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f38069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 >> v1:172.21.15.117:6789/0 conn(0x7f7f38159830 legacy=0x7f7f380cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3815e380 con 0x7f7f380cc420 2023-08-10T10:44:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7f300019f0 con 0x7f7f380cc420 2023-08-10T10:44:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 >> v1:172.21.15.50:6789/0 conn(0x7f7f380cc420 legacy=0x7f7f380cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f24003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f24004d00 0x7f7f24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380ce350 con 0x7f7f24003a10 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400dca0 con 0x7f7f24004d00 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.023+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400de60 con 0x7f7f380696a0 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f24003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f2ffff640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f377fe640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f24004d00 0x7f7f24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 -- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 msgr2=0x7f7f240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f380696a0 0x7f7f240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 -- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f24004d00 msgr2=0x7f7f24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f24004d00 0x7f7f24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.024+0000 7f7f36ffd640 1 -- 172.21.15.50:0/3697005269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24003520 con 0x7f7f24003a10 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.025+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f24003e30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7f28001720 tx=0x7f7f240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f872cfca935c40 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280052d0 con 0x7f7f24003a10 2023-08-10T10:44:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2802e050 con 0x7f7f24003a10 2023-08-10T10:44:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f367fc640 1 -- 172.21.15.50:0/3697005269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280035f0 con 0x7f7f24003a10 2023-08-10T10:44:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 -- 172.21.15.50:0/3697005269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 msgr2=0x7f7f24003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 --2- 172.21.15.50:0/3697005269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f24003e30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7f28001720 tx=0x7f7f240057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f377fe640 1 -- 172.21.15.50:0/3697005269 reap_dead start 2023-08-10T10:44:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 -- 172.21.15.50:0/3697005269 shutdown_connections 2023-08-10T10:44:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 -- 172.21.15.50:0/3697005269 >> 172.21.15.50:0/3697005269 conn(0x7f7f380cafa0 msgr2=0x7f7f380cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 -- 172.21.15.50:0/3697005269 shutdown_connections 2023-08-10T10:44:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.026+0000 7f7f37fff640 1 -- 172.21.15.50:0/3697005269 wait complete. 2023-08-10T10:44:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.028+0000 7f7f37fff640 1 Processor -- start 2023-08-10T10:44:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.028+0000 7f7f37fff640 1 -- start start 2023-08-10T10:44:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f380aeac0 0x7f7f380aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f381f5d20 0x7f7f381f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380af480 con 0x7f7f24003a10 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f381f6a50 con 0x7f7f380aeac0 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.029+0000 7f7f37fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38147960 con 0x7f7f381f5d20 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44154/0 (socket says 172.21.15.50:44154) 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 -- 172.21.15.50:0/274495533 learned_addr learned my addr 172.21.15.50:0/274495533 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f2ffff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f380aeac0 0x7f7f380aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f377fe640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f381f5d20 0x7f7f381f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 -- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f381f5d20 msgr2=0x7f7f381f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f381f5d20 0x7f7f381f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 -- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f380aeac0 msgr2=0x7f7f380aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f380aeac0 0x7f7f380aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.030+0000 7f7f36ffd640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38147c40 con 0x7f7f24003a10 2023-08-10T10:44:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f36ffd640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7f28005040 tx=0x7f7f28001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28007a30 con 0x7f7f24003a10 2023-08-10T10:44:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f280069e0 con 0x7f7f24003a10 2023-08-10T10:44:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28006d50 con 0x7f7f24003a10 2023-08-10T10:44:15.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f38147f20 con 0x7f7f24003a10 2023-08-10T10:44:15.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.031+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f38148700 con 0x7f7f24003a10 2023-08-10T10:44:15.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.032+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f38066e30 con 0x7f7f24003a10 2023-08-10T10:44:15.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.033+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f280035f0 con 0x7f7f24003a10 2023-08-10T10:44:15.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.034+0000 7f7f2f7fe640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 0x7f7f1806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.034+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f280ab3f0 con 0x7f7f24003a10 2023-08-10T10:44:15.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.034+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f7f18072dd0 con 0x7f7f24003a10 2023-08-10T10:44:15.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.035+0000 7f7f2ffff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 0x7f7f1806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.035+0000 7f7f2ffff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 0x7f7f1806d140 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7f380ae440 tx=0x7f7f20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.039+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f2804b060 con 0x7f7f24003a10 2023-08-10T10:44:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.243+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f380b37c0 con 0x7f7f24003a10 2023-08-10T10:44:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.244+0000 7f7f2f7fe640 1 -- 172.21.15.50:0/274495533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v97) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f2804b070 con 0x7f7f24003a10 2023-08-10T10:44:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:44:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 msgr2=0x7f7f1806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 0x7f7f1806d140 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7f380ae440 tx=0x7f7f20008040 comp rx=0 tx=0).stop 2023-08-10T10:44:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 msgr2=0x7f7f3814b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7f28005040 tx=0x7f7f28001120 comp rx=0 tx=0).stop 2023-08-10T10:44:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 shutdown_connections 2023-08-10T10:44:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f381f5d20 0x7f7f381f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac80 0x7f7f1806d140 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f380aeac0 0x7f7f380aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 --2- 172.21.15.50:0/274495533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24003a10 0x7f7f3814b580 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.246+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 >> 172.21.15.50:0/274495533 conn(0x7f7f380cafa0 msgr2=0x7f7f380af910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.247+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 shutdown_connections 2023-08-10T10:44:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.247+0000 7f7f37fff640 1 -- 172.21.15.50:0/274495533 wait complete. 2023-08-10T10:44:15.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:44:15.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:15.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:44:15.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:44:15.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:15.398 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:44:15.451 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:15.452 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:15.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:44:15.516 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:15.516 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:15.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:44:15.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:15.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.817+0000 7fab2eaec640 1 Processor -- start 2023-08-10T10:44:15.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.818+0000 7fab2eaec640 1 -- start start 2023-08-10T10:44:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2eaec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab2815aa40 0x7fab280b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2eaec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab280ca930 0x7fab280b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2eaec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab28071c70 con 0x7fab280b0c60 2023-08-10T10:44:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2eaec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280713d0 con 0x7fab2815aa40 2023-08-10T10:44:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2eaec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280716b0 con 0x7fab280ca930 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab2c888640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab2815aa40 0x7fab280b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab27fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fab280b0c60 0x7fab280696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45988/0 (socket says 172.21.15.50:45988) 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.819+0000 7fab27fff640 1 -- 172.21.15.50:0/843071193 learned_addr learned my addr 172.21.15.50:0/843071193 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.820+0000 7fab2c888640 1 -- 172.21.15.50:0/843071193 >> v2:172.21.15.117:3300/0 conn(0x7fab280ca930 msgr2=0x7fab280b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.820+0000 7fab2c888640 1 --2- 172.21.15.50:0/843071193 >> v2:172.21.15.117:3300/0 conn(0x7fab280ca930 0x7fab280b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.820+0000 7fab2c888640 1 -- 172.21.15.50:0/843071193 >> v1:172.21.15.50:6789/0 conn(0x7fab280b0c60 legacy=0x7fab280696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.820+0000 7fab2c888640 1 -- 172.21.15.50:0/843071193 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28071990 con 0x7fab2815aa40 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.821+0000 7fab2c888640 1 --2- 172.21.15.50:0/843071193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280b3820 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fab280cb110 tx=0x7fab1802be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439241b75fe8efce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.821+0000 7fab277fe640 1 -- 172.21.15.50:0/843071193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1802cbe0 con 0x7fab2815aa40 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.821+0000 7fab277fe640 1 -- 172.21.15.50:0/843071193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1802cd40 con 0x7fab2815aa40 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.821+0000 7fab277fe640 1 -- 172.21.15.50:0/843071193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18034660 con 0x7fab2815aa40 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 -- 172.21.15.50:0/843071193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 msgr2=0x7fab280b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 --2- 172.21.15.50:0/843071193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280b3820 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fab280cb110 tx=0x7fab1802be30 comp rx=0 tx=0).stop 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 -- 172.21.15.50:0/843071193 shutdown_connections 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 --2- 172.21.15.50:0/843071193 >> v2:172.21.15.117:3300/0 conn(0x7fab280ca930 0x7fab280b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 --2- 172.21.15.50:0/843071193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280b3820 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 -- 172.21.15.50:0/843071193 >> 172.21.15.50:0/843071193 conn(0x7fab2806b590 msgr2=0x7fab280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 -- 172.21.15.50:0/843071193 shutdown_connections 2023-08-10T10:44:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.822+0000 7fab2eaec640 1 -- 172.21.15.50:0/843071193 wait complete. 2023-08-10T10:44:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.824+0000 7fab2eaec640 1 Processor -- start 2023-08-10T10:44:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.824+0000 7fab2eaec640 1 -- start start 2023-08-10T10:44:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280b0c60 0x7fab28147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280ca930 0x7fab281498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28149df0 con 0x7fab2815aa40 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab281f6370 con 0x7fab280b0c60 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2eaec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab281f6650 con 0x7fab280ca930 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2d089640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2d089640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44180/0 (socket says 172.21.15.50:44180) 2023-08-10T10:44:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.825+0000 7fab2d089640 1 -- 172.21.15.50:0/4051193781 learned_addr learned my addr 172.21.15.50:0/4051193781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab27fff640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280ca930 0x7fab281498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2c888640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280b0c60 0x7fab28147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 -- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280ca930 msgr2=0x7fab281498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280ca930 0x7fab281498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 -- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280b0c60 msgr2=0x7fab28147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280b0c60 0x7fab28147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009a70 con 0x7fab2815aa40 2023-08-10T10:44:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2d089640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fab20009fd0 tx=0x7fab2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011830 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20011990 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011d20 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab281f6930 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.826+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab280c4dc0 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.828+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2804e270 con 0x7fab2815aa40 2023-08-10T10:44:15.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.829+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab2001b460 con 0x7fab2815aa40 2023-08-10T10:44:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.830+0000 7fab257fa640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 0x7fab0806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.830+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab200892c0 con 0x7fab2815aa40 2023-08-10T10:44:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.830+0000 7fab2c888640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 0x7fab0806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.830+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7fab08072dd0 con 0x7fab2815aa40 2023-08-10T10:44:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.831+0000 7fab2c888640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 0x7fab0806d140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab18036000 tx=0x7fab18030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:15.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:15.834+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab20054360 con 0x7fab2815aa40 2023-08-10T10:44:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.069+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab2814bba0 con 0x7fab2815aa40 2023-08-10T10:44:16.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.071+0000 7fab257fa640 1 -- 172.21.15.50:0/4051193781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fab20057980 con 0x7fab2815aa40 2023-08-10T10:44:16.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:16.072 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:44:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:44:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.073+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 msgr2=0x7fab0806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.073+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 0x7fab0806d140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab18036000 tx=0x7fab18030000 comp rx=0 tx=0).stop 2023-08-10T10:44:16.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.073+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 msgr2=0x7fab280c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.073+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fab20009fd0 tx=0x7fab2000b8e0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 shutdown_connections 2023-08-10T10:44:16.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab2815aa40 0x7fab280c4880 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab280ca930 0x7fab281498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fab0806ac80 0x7fab0806d140 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 --2- 172.21.15.50:0/4051193781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab280b0c60 0x7fab28147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 >> 172.21.15.50:0/4051193781 conn(0x7fab2806b590 msgr2=0x7fab2806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 shutdown_connections 2023-08-10T10:44:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.074+0000 7fab2eaec640 1 -- 172.21.15.50:0/4051193781 wait complete. 2023-08-10T10:44:16.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:16.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.324+0000 7f3166955640 1 Processor -- start 2023-08-10T10:44:16.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.324+0000 7f3166955640 1 -- start start 2023-08-10T10:44:16.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f3166955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 0x7f31600ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f3166955640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3160071c70 con 0x7f31600b0c60 2023-08-10T10:44:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f3166955640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600713d0 con 0x7f316015aa40 2023-08-10T10:44:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f3166955640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600716b0 con 0x7f31600b3f30 2023-08-10T10:44:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f315f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f31600b0c60 0x7f31600c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45992/0 (socket says 172.21.15.50:45992) 2023-08-10T10:44:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.326+0000 7f315f7fe640 1 -- 172.21.15.50:0/1849057297 learned_addr learned my addr 172.21.15.50:0/1849057297 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f3164ef2640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 0x7f31600ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14790873 0 0) 0x7f3160071c70 con 0x7f31600b0c60 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3144003520 con 0x7f31600b0c60 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354059215 0 0) 0x7f3144003520 con 0x7f31600b0c60 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 msgr2=0x7f31600ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 0x7f31600ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 >> v1:172.21.15.117:6789/0 conn(0x7f316015aa40 legacy=0x7f31600b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160071990 con 0x7f31600b0c60 2023-08-10T10:44:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f314c001670 con 0x7f31600b0c60 2023-08-10T10:44:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 >> v1:172.21.15.50:6789/0 conn(0x7f31600b0c60 legacy=0x7f31600c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440039a0 0x7f3144003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31440047c0 0x7f3144004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 0x7f3144005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600716b0 con 0x7f31440039a0 2023-08-10T10:44:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314400bb40 con 0x7f31440047c0 2023-08-10T10:44:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.327+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314400bd00 con 0x7f31600b3f30 2023-08-10T10:44:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440039a0 0x7f3144003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315f7fe640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31440047c0 0x7f3144004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 -- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 msgr2=0x7f3144005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31600b3f30 0x7f3144005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 -- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31440047c0 msgr2=0x7f3144004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31440047c0 0x7f3144004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.328+0000 7f315ffff640 1 -- 172.21.15.50:0/1849057297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160071990 con 0x7f31440039a0 2023-08-10T10:44:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.329+0000 7f315ffff640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440039a0 0x7f3144003dc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3150001750 tx=0x7f31440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911d1a61d6ec26b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.329+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500052d0 con 0x7f31440039a0 2023-08-10T10:44:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315002e050 con 0x7f31440039a0 2023-08-10T10:44:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f315effd640 1 -- 172.21.15.50:0/1849057297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500035f0 con 0x7f31440039a0 2023-08-10T10:44:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 -- 172.21.15.50:0/1849057297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440039a0 msgr2=0x7f3144003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 --2- 172.21.15.50:0/1849057297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31440039a0 0x7f3144003dc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3150001750 tx=0x7f31440057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3164ef2640 1 -- 172.21.15.50:0/1849057297 reap_dead start 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 -- 172.21.15.50:0/1849057297 shutdown_connections 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 -- 172.21.15.50:0/1849057297 >> 172.21.15.50:0/1849057297 conn(0x7f316006b590 msgr2=0x7f31600ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 -- 172.21.15.50:0/1849057297 shutdown_connections 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.330+0000 7f3166955640 1 -- 172.21.15.50:0/1849057297 wait complete. 2023-08-10T10:44:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.332+0000 7f3166955640 1 Processor -- start 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.332+0000 7f3166955640 1 -- start start 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31440039a0 0x7f31600b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31601f66e0 0x7f316015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600c59c0 con 0x7f31600b2d30 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600b2570 con 0x7f31601f66e0 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.333+0000 7f3166955640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600b1cd0 con 0x7f31440039a0 2023-08-10T10:44:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44192/0 (socket says 172.21.15.50:44192) 2023-08-10T10:44:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 -- 172.21.15.50:0/2460053334 learned_addr learned my addr 172.21.15.50:0/2460053334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 -- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31440039a0 msgr2=0x7f31600b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31440039a0 0x7f31600b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 -- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31601f66e0 msgr2=0x7f316015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f315f7fe640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31601f66e0 0x7f316015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31601f66e0 0x7f316015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600b1fb0 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.334+0000 7f3164ef2640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f31600c9090 tx=0x7f315800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.335+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158018070 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.335+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315800eb90 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.335+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158003990 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.335+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600b2290 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.335+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316015bf30 con 0x7f31600b2d30 2023-08-10T10:44:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.336+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316004e270 con 0x7f31600b2d30 2023-08-10T10:44:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.337+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3158014420 con 0x7f31600b2d30 2023-08-10T10:44:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.338+0000 7f315cff9640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 0x7f314806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.338+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31580892e0 con 0x7f31600b2d30 2023-08-10T10:44:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.338+0000 7f315ffff640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 0x7f314806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.338+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f3148072da0 con 0x7f31600b2d30 2023-08-10T10:44:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.339+0000 7f315ffff640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 0x7f314806d110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3150033000 tx=0x7f315002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.342+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3158054380 con 0x7f31600b2d30 2023-08-10T10:44:16.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.535+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31600c5b00 con 0x7f31600b2d30 2023-08-10T10:44:16.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.538+0000 7f315cff9640 1 -- 172.21.15.50:0/2460053334 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18369 (secure 0 0 0) 0x7f31600c5b00 con 0x7f31600b2d30 2023-08-10T10:44:16.539 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:16.539 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":98,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:15.748366+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:16.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.540+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 msgr2=0x7f314806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.540+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 0x7f314806d110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3150033000 tx=0x7f315002f000 comp rx=0 tx=0).stop 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.540+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 msgr2=0x7f316014a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.540+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f31600c9090 tx=0x7f315800e4b0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 shutdown_connections 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31600b2d30 0x7f316014a5f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f314806ac50 0x7f314806d110 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31601f66e0 0x7f316015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 --2- 172.21.15.50:0/2460053334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31440039a0 0x7f31600b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 >> 172.21.15.50:0/2460053334 conn(0x7f316006b590 msgr2=0x7f31600696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 shutdown_connections 2023-08-10T10:44:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.541+0000 7f3166955640 1 -- 172.21.15.50:0/2460053334 wait complete. 2023-08-10T10:44:16.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:43:16.551358+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:43:18.005134+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:44:16.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:44:16.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.798+0000 7fad01e4d640 1 Processor -- start 2023-08-10T10:44:16.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.798+0000 7fad01e4d640 1 -- start start 2023-08-10T10:44:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.799+0000 7fad01e4d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7facfc15cf70 0x7facfc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.799+0000 7fad01e4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.799+0000 7fad01e4d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc160a40 con 0x7facfc15cb90 2023-08-10T10:44:16.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.799+0000 7fad01e4d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0b4bb0 con 0x7facfc15cf70 2023-08-10T10:44:16.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.799+0000 7fad01e4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0b4e90 con 0x7facfc0b4640 2023-08-10T10:44:16.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7facfc15cf70 0x7facfc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7facfc15cf70 0x7facfc160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44194/0 (socket says 172.21.15.50:44194) 2023-08-10T10:44:16.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 -- 172.21.15.50:0/3571214716 learned_addr learned my addr 172.21.15.50:0/3571214716 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:16.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 -- 172.21.15.50:0/3571214716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 msgr2=0x7facfc161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:16.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 --2- 172.21.15.50:0/3571214716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 -- 172.21.15.50:0/3571214716 >> v1:172.21.15.50:6789/0 conn(0x7facfc15cb90 legacy=0x7facfc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfaffd640 1 -- 172.21.15.50:0/3571214716 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0b5170 con 0x7facfc15cf70 2023-08-10T10:44:16.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.800+0000 7facfa7fc640 1 -- 172.21.15.50:0/3571214716 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301837470 0 0) 0x7facfc160a40 con 0x7facfc15cb90 2023-08-10T10:44:16.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7facfaffd640 1 --2- 172.21.15.50:0/3571214716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cf70 0x7facfc160ed0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7facf0009870 tx=0x7facf002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb7680c6544d82 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7facfa7fc640 1 -- 172.21.15.50:0/3571214716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0030840 con 0x7facfc15cf70 2023-08-10T10:44:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7facfa7fc640 1 -- 172.21.15.50:0/3571214716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf00309a0 con 0x7facfc15cf70 2023-08-10T10:44:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7facfa7fc640 1 -- 172.21.15.50:0/3571214716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0030d30 con 0x7facfc15cf70 2023-08-10T10:44:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7fad01e4d640 1 -- 172.21.15.50:0/3571214716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cf70 msgr2=0x7facfc160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.802+0000 7fad01e4d640 1 --2- 172.21.15.50:0/3571214716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cf70 0x7facfc160ed0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7facf0009870 tx=0x7facf002b980 comp rx=0 tx=0).stop 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 -- 172.21.15.50:0/3571214716 shutdown_connections 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 --2- 172.21.15.50:0/3571214716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cf70 0x7facfc160ed0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 --2- 172.21.15.50:0/3571214716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 -- 172.21.15.50:0/3571214716 >> 172.21.15.50:0/3571214716 conn(0x7facfc0cf640 msgr2=0x7facfc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 -- 172.21.15.50:0/3571214716 shutdown_connections 2023-08-10T10:44:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.803+0000 7fad01e4d640 1 -- 172.21.15.50:0/3571214716 wait complete. 2023-08-10T10:44:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.804+0000 7fad01e4d640 1 Processor -- start 2023-08-10T10:44:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.805+0000 7fad01e4d640 1 -- start start 2023-08-10T10:44:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc1f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 0x7facfc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1f35a0 con 0x7facfc15cb90 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc158860 con 0x7facfc15cf70 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7fad01e4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc15a570 con 0x7facfc0b4640 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44202/0 (socket says 172.21.15.50:44202) 2023-08-10T10:44:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 -- 172.21.15.50:0/1716194928 learned_addr learned my addr 172.21.15.50:0/1716194928 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfb7fe640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc1f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfbfff640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 0x7facfc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 -- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 msgr2=0x7facfc1f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc1f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 -- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 msgr2=0x7facfc157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 0x7facfc157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.806+0000 7facfaffd640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf00094d0 con 0x7facfc15cb90 2023-08-10T10:44:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7facfbfff640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 0x7facfc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7facfaffd640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7facf0009870 tx=0x7facf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf003e070 con 0x7facfc15cb90 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0004030 con 0x7facfc15cb90 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00043c0 con 0x7facfc15cb90 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc145db0 con 0x7facfc15cb90 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.807+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc146370 con 0x7facfc15cb90 2023-08-10T10:44:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.809+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc15a730 con 0x7facfc15cb90 2023-08-10T10:44:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.810+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7facf0042070 con 0x7facfc15cb90 2023-08-10T10:44:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.810+0000 7face3fff640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 0x7face806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.811+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facf00ab410 con 0x7facfc15cb90 2023-08-10T10:44:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.811+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7face8072da0 con 0x7facfc15cb90 2023-08-10T10:44:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.811+0000 7facfb7fe640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 0x7face806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:16.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.812+0000 7facfb7fe640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 0x7face806d110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facec0012e0 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:16.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:16.815+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7facf0076550 con 0x7facfc15cb90 2023-08-10T10:44:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.008+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facfc0612b0 con 0x7facfc15cb90 2023-08-10T10:44:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.009+0000 7face3fff640 1 -- 172.21.15.50:0/1716194928 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7facf0034020 con 0x7facfc15cb90 2023-08-10T10:44:17.010 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:44:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 msgr2=0x7face806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 0x7face806d110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facec0012e0 tx=0x7facec009040 comp rx=0 tx=0).stop 2023-08-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 msgr2=0x7facfc1f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7facf0009870 tx=0x7facf00046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 shutdown_connections 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7face806ac50 0x7face806d110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facfc15cf70 0x7facfc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facfc15cb90 0x7facfc1f1dd0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 --2- 172.21.15.50:0/1716194928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facfc0b4640 0x7facfc1f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 >> 172.21.15.50:0/1716194928 conn(0x7facfc0cf640 msgr2=0x7facfc0d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 shutdown_connections 2023-08-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.012+0000 7fad01e4d640 1 -- 172.21.15.50:0/1716194928 wait complete. 2023-08-10T10:44:17.033 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:44:17.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.258+0000 7f679d4f5640 1 Processor -- start 2023-08-10T10:44:17.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.258+0000 7f679d4f5640 1 -- start start 2023-08-10T10:44:17.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f679d4f5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67980b4130 0x7f67980c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f679d4f5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980b1370 con 0x7f679815aa50 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f679d4f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980b1650 con 0x7f67980aff00 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f679d4f5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679815ae30 con 0x7f67980b4130 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f6797fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f679815aa50 0x7f67980cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46006/0 (socket says 172.21.15.50:46006) 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f6797fff640 1 -- 172.21.15.50:0/1005331991 learned_addr learned my addr 172.21.15.50:0/1005331991 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.260+0000 7f67977fe640 1 --2- 172.21.15.50:0/1005331991 >> v2:172.21.15.50:3300/0 conn(0x7f67980b4130 0x7f67980c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.261+0000 7f67977fe640 1 -- 172.21.15.50:0/1005331991 >> v1:172.21.15.117:6789/0 conn(0x7f67980aff00 legacy=0x7f67980cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.261+0000 7f67977fe640 1 -- 172.21.15.50:0/1005331991 >> v1:172.21.15.50:6789/0 conn(0x7f679815aa50 legacy=0x7f67980cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.261+0000 7f6796ffd640 1 -- 172.21.15.50:0/1005331991 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447162638 0 0) 0x7f67980b1370 con 0x7f679815aa50 2023-08-10T10:44:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.261+0000 7f67977fe640 1 -- 172.21.15.50:0/1005331991 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67980b1930 con 0x7f67980b4130 2023-08-10T10:44:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.262+0000 7f67977fe640 1 --2- 172.21.15.50:0/1005331991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980b4130 0x7f67980c5550 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67800097a0 tx=0x7f678002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b78362a7478cc35 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.262+0000 7f6796ffd640 1 -- 172.21.15.50:0/1005331991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678002e070 con 0x7f67980b4130 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.262+0000 7f6796ffd640 1 -- 172.21.15.50:0/1005331991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800315a0 con 0x7f67980b4130 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.262+0000 7f6796ffd640 1 -- 172.21.15.50:0/1005331991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780031930 con 0x7f67980b4130 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 -- 172.21.15.50:0/1005331991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980b4130 msgr2=0x7f67980c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 --2- 172.21.15.50:0/1005331991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980b4130 0x7f67980c5550 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67800097a0 tx=0x7f678002b840 comp rx=0 tx=0).stop 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 -- 172.21.15.50:0/1005331991 shutdown_connections 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 --2- 172.21.15.50:0/1005331991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980b4130 0x7f67980c5550 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 -- 172.21.15.50:0/1005331991 >> 172.21.15.50:0/1005331991 conn(0x7f6798069cd0 msgr2=0x7f67980caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 -- 172.21.15.50:0/1005331991 shutdown_connections 2023-08-10T10:44:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.263+0000 7f679d4f5640 1 -- 172.21.15.50:0/1005331991 wait complete. 2023-08-10T10:44:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.265+0000 7f679d4f5640 1 Processor -- start 2023-08-10T10:44:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.265+0000 7f679d4f5640 1 -- start start 2023-08-10T10:44:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67980b4130 0x7f679815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 0x7f67980ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679815cf80 con 0x7f67980aff00 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679815d260 con 0x7f679815aa50 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f679d4f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679815d540 con 0x7f67980b4130 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f6797fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f6797fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44222/0 (socket says 172.21.15.50:44222) 2023-08-10T10:44:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.266+0000 7f6797fff640 1 -- 172.21.15.50:0/990674164 learned_addr learned my addr 172.21.15.50:0/990674164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 -- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67980b4130 msgr2=0x7f679815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67980b4130 0x7f679815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 -- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 msgr2=0x7f67980ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f679ccf4640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 0x7f67980ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 0x7f67980ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009400 con 0x7f67980aff00 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f679ccf4640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 0x7f67980ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6797fff640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f678800c7c0 tx=0x7f678800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800a640 con 0x7f67980aff00 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678800a7c0 con 0x7f67980aff00 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800ab70 con 0x7f67980aff00 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.267+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679815d820 con 0x7f67980aff00 2023-08-10T10:44:17.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.268+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679815cb70 con 0x7f67980aff00 2023-08-10T10:44:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.269+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679815dd40 con 0x7f67980aff00 2023-08-10T10:44:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.270+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f678800acd0 con 0x7f67980aff00 2023-08-10T10:44:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.270+0000 7f6794ff9640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 0x7f677806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.271+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6788088bd0 con 0x7f67980aff00 2023-08-10T10:44:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.271+0000 7f67977fe640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 0x7f677806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.271+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f6778072da0 con 0x7f67980aff00 2023-08-10T10:44:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.272+0000 7f67977fe640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 0x7f677806d110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6780036000 tx=0x7f6780030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.276+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f679815dd40 con 0x7f67980aff00 2023-08-10T10:44:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.466+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f679815dd40 con 0x7f67980aff00 2023-08-10T10:44:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.467+0000 7f6794ff9640 1 -- 172.21.15.50:0/990674164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f679815dd40 con 0x7f67980aff00 2023-08-10T10:44:17.467 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:44:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 msgr2=0x7f677806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 0x7f677806d110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6780036000 tx=0x7f6780030000 comp rx=0 tx=0).stop 2023-08-10T10:44:17.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 msgr2=0x7f6798156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f678800c7c0 tx=0x7f678800cc80 comp rx=0 tx=0).stop 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 shutdown_connections 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f677806ac50 0x7f677806d110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679815aa50 0x7f67980ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67980b4130 0x7f679815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 --2- 172.21.15.50:0/990674164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67980aff00 0x7f6798156980 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.469+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 >> 172.21.15.50:0/990674164 conn(0x7f6798069cd0 msgr2=0x7f67980c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.470+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 shutdown_connections 2023-08-10T10:44:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.470+0000 7f679d4f5640 1 -- 172.21.15.50:0/990674164 wait complete. 2023-08-10T10:44:17.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:44:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.711+0000 7f546cc8a640 1 Processor -- start 2023-08-10T10:44:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.711+0000 7f546cc8a640 1 -- start start 2023-08-10T10:44:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f546cc8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b1b80 0x7f54680d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f546cc8a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54680b5910 0x7f54680b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f546cc8a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546806a150 con 0x7f54680cd170 2023-08-10T10:44:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f546cc8a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54680cdfd0 con 0x7f54680b5910 2023-08-10T10:44:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f546cc8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546806a3f0 con 0x7f54680b1b80 2023-08-10T10:44:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f5467fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54680b5910 0x7f54680b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f5467fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54680b5910 0x7f54680b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44234/0 (socket says 172.21.15.50:44234) 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f5467fff640 1 -- 172.21.15.50:0/273657191 learned_addr learned my addr 172.21.15.50:0/273657191 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.713+0000 7f545effd640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b1b80 0x7f54680d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.714+0000 7f5467fff640 1 -- 172.21.15.50:0/273657191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b1b80 msgr2=0x7f54680d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.714+0000 7f5467fff640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b1b80 0x7f54680d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.714+0000 7f5467fff640 1 -- 172.21.15.50:0/273657191 >> v1:172.21.15.117:6789/0 conn(0x7f54680cd170 legacy=0x7f54680cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.714+0000 7f5467fff640 1 -- 172.21.15.50:0/273657191 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546806a6d0 con 0x7f54680b5910 2023-08-10T10:44:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.715+0000 7f5467fff640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680b5910 0x7f54680b5da0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f5460009e50 tx=0x7f546002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51a7409a309d253 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.715+0000 7f5466ffd640 1 -- 172.21.15.50:0/273657191 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546002cb90 con 0x7f54680b5910 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.715+0000 7f5466ffd640 1 -- 172.21.15.50:0/273657191 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546002ccf0 con 0x7f54680b5910 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.715+0000 7f5466ffd640 1 -- 172.21.15.50:0/273657191 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460034610 con 0x7f54680b5910 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 -- 172.21.15.50:0/273657191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680b5910 msgr2=0x7f54680b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680b5910 0x7f54680b5da0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f5460009e50 tx=0x7f546002bff0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 -- 172.21.15.50:0/273657191 shutdown_connections 2023-08-10T10:44:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680b5910 0x7f54680b5da0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 --2- 172.21.15.50:0/273657191 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b1b80 0x7f54680d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 -- 172.21.15.50:0/273657191 >> 172.21.15.50:0/273657191 conn(0x7f54680d2910 msgr2=0x7f54680d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 -- 172.21.15.50:0/273657191 shutdown_connections 2023-08-10T10:44:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.716+0000 7f546cc8a640 1 -- 172.21.15.50:0/273657191 wait complete. 2023-08-10T10:44:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.718+0000 7f546cc8a640 1 Processor -- start 2023-08-10T10:44:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.718+0000 7f546cc8a640 1 -- start start 2023-08-10T10:44:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54680b1b80 0x7f54680a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 0x7f54680c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680c9770 con 0x7f54680cd170 2023-08-10T10:44:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680a98e0 con 0x7f54680b1b80 2023-08-10T10:44:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.719+0000 7f546cc8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54680c65c0 con 0x7f54680b5910 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44242/0 (socket says 172.21.15.50:44242) 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 -- 172.21.15.50:0/3050478033 learned_addr learned my addr 172.21.15.50:0/3050478033 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f54677fe640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54680b1b80 0x7f54680a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f545effd640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 0x7f54680c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 -- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 msgr2=0x7f54680c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 0x7f54680c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 -- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54680b1b80 msgr2=0x7f54680a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54680b1b80 0x7f54680a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f5467fff640 1 -- 172.21.15.50:0/3050478033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009b30 con 0x7f54680cd170 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.720+0000 7f545effd640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 0x7f54680c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f5467fff640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5460009e50 tx=0x7f5460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460009510 con 0x7f54680cd170 2023-08-10T10:44:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546003e450 con 0x7f54680cd170 2023-08-10T10:44:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54680c68a0 con 0x7f54680cd170 2023-08-10T10:44:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546003e800 con 0x7f54680cd170 2023-08-10T10:44:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.721+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54680c6e60 con 0x7f54680cd170 2023-08-10T10:44:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.722+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54680d2710 con 0x7f54680cd170 2023-08-10T10:44:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.723+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f546003e960 con 0x7f54680cd170 2023-08-10T10:44:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.724+0000 7f5464ff9640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 0x7f544806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.724+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54600ac1b0 con 0x7f54680cd170 2023-08-10T10:44:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.725+0000 7f54677fe640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 0x7f544806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:17.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.725+0000 7f54677fe640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 0x7f544806d110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5458000fb0 tx=0x7f5458009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:17.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.728+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54600771c0 con 0x7f54680cd170 2023-08-10T10:44:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.918+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54680c7050 con 0x7f54680cd170 2023-08-10T10:44:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.919+0000 7f5464ff9640 1 -- 172.21.15.50:0/3050478033 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7f546002ce60 con 0x7f54680cd170 2023-08-10T10:44:17.921 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:44:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.921+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 msgr2=0x7f544806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.921+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 0x7f544806d110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5458000fb0 tx=0x7f5458009040 comp rx=0 tx=0).stop 2023-08-10T10:44:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.921+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 msgr2=0x7f54681f1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.921+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5460009e50 tx=0x7f5460004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 shutdown_connections 2023-08-10T10:44:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54680cd170 0x7f54681f1950 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54680b5910 0x7f54680c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f544806ac50 0x7f544806d110 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 --2- 172.21.15.50:0/3050478033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54680b1b80 0x7f54680a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 >> 172.21.15.50:0/3050478033 conn(0x7f54680d2910 msgr2=0x7f54680b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 shutdown_connections 2023-08-10T10:44:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:17.922+0000 7f546cc8a640 1 -- 172.21.15.50:0/3050478033 wait complete. 2023-08-10T10:44:17.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:44:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.169+0000 7f3102f57640 1 Processor -- start 2023-08-10T10:44:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.169+0000 7f3102f57640 1 -- start start 2023-08-10T10:44:18.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f3102f57640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30fc0b0cd0 0x7f30fc0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f3102f57640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0b1100 con 0x7f30fc0ca530 2023-08-10T10:44:18.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f3102f57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc06ebb0 con 0x7f30fc159c10 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f3102f57640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30fc06ee90 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f30fbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30fc0ca530 0x7f30fc06a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46016/0 (socket says 172.21.15.50:46016) 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f30fbfff640 1 -- 172.21.15.50:0/1195745519 learned_addr learned my addr 172.21.15.50:0/1195745519 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.171+0000 7f31014f4640 1 --2- 172.21.15.50:0/1195745519 >> v2:172.21.15.117:3300/0 conn(0x7f30fc0b0cd0 0x7f30fc0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806252595 0 0) 0x7f30fc0b1100 con 0x7f30fc0ca530 2023-08-10T10:44:18.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003520 con 0x7f30fc0ca530 2023-08-10T10:44:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 74156610 0 0) 0x7f30ec003520 con 0x7f30fc0ca530 2023-08-10T10:44:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f31014f4640 1 -- 172.21.15.50:0/1195745519 >> v1:172.21.15.117:6789/0 conn(0x7f30fc159c10 legacy=0x7f30fc0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f31014f4640 1 -- 172.21.15.50:0/1195745519 >> v1:172.21.15.50:6789/0 conn(0x7f30fc0ca530 legacy=0x7f30fc06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.172+0000 7f31014f4640 1 -- 172.21.15.50:0/1195745519 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc06f170 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.174+0000 7f31014f4640 1 --2- 172.21.15.50:0/1195745519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0b0cd0 0x7f30fc0ada90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f402df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3edfd5e6b729cd91 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.174+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8001670 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.174+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f402eac0 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.174+0000 7f30fb7fe640 1 -- 172.21.15.50:0/1195745519 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f402ee50 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 -- 172.21.15.50:0/1195745519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0b0cd0 msgr2=0x7f30fc0ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 --2- 172.21.15.50:0/1195745519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0b0cd0 0x7f30fc0ada90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f402df90 comp rx=0 tx=0).stop 2023-08-10T10:44:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 -- 172.21.15.50:0/1195745519 shutdown_connections 2023-08-10T10:44:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 --2- 172.21.15.50:0/1195745519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0b0cd0 0x7f30fc0ada90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 -- 172.21.15.50:0/1195745519 >> 172.21.15.50:0/1195745519 conn(0x7f30fc0b01b0 msgr2=0x7f30fc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 -- 172.21.15.50:0/1195745519 shutdown_connections 2023-08-10T10:44:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.175+0000 7f3102f57640 1 -- 172.21.15.50:0/1195745519 wait complete. 2023-08-10T10:44:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.177+0000 7f3102f57640 1 Processor -- start 2023-08-10T10:44:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.177+0000 7f3102f57640 1 -- start start 2023-08-10T10:44:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 0x7f30fc151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 0x7f30fc0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c3780 con 0x7f30fc159c10 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c3a00 con 0x7f30fc0ca530 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f3102f57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c3ce0 con 0x7f30fc0b0cd0 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f31014f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f31014f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44252/0 (socket says 172.21.15.50:44252) 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.178+0000 7f31014f4640 1 -- 172.21.15.50:0/3465244675 learned_addr learned my addr 172.21.15.50:0/3465244675 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f30fbfff640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 0x7f30fc0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f3100cf3640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 0x7f30fc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 -- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 msgr2=0x7f30fc151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 0x7f30fc151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 -- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 msgr2=0x7f30fc0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 0x7f30fc0c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 -- 172.21.15.50:0/3465244675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009a70 con 0x7f30fc159c10 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f30fbfff640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 0x7f30fc0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f3100cf3640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 0x7f30fc151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.179+0000 7f31014f4640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.180+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4045070 con 0x7f30fc159c10 2023-08-10T10:44:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.180+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4009450 con 0x7f30fc159c10 2023-08-10T10:44:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.180+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003bd0 con 0x7f30fc159c10 2023-08-10T10:44:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.180+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc0c3fc0 con 0x7f30fc159c10 2023-08-10T10:44:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.180+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc0b1150 con 0x7f30fc159c10 2023-08-10T10:44:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.181+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc0612b0 con 0x7f30fc159c10 2023-08-10T10:44:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.182+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30f403d070 con 0x7f30fc159c10 2023-08-10T10:44:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.183+0000 7f30f97fa640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 0x7f30e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.183+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30f40abc10 con 0x7f30fc159c10 2023-08-10T10:44:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.183+0000 7f3100cf3640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 0x7f30e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.184+0000 7f3100cf3640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 0x7f30e006d110 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000f60 tx=0x7f30f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.187+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f30f4076c20 con 0x7f30fc159c10 2023-08-10T10:44:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.378+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30fc0b4300 con 0x7f30fc159c10 2023-08-10T10:44:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.379+0000 7f30f97fa640 1 -- 172.21.15.50:0/3465244675 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30f403b0a0 con 0x7f30fc159c10 2023-08-10T10:44:18.380 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:44:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.381+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 msgr2=0x7f30e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.381+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 0x7f30e006d110 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000f60 tx=0x7f30f0009040 comp rx=0 tx=0).stop 2023-08-10T10:44:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.381+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 msgr2=0x7f30fc1f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.381+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f4004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 shutdown_connections 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30fc159c10 0x7f30fc1f18f0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30e006ac50 0x7f30e006d110 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0ca530 0x7f30fc0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 --2- 172.21.15.50:0/3465244675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30fc0b0cd0 0x7f30fc151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 >> 172.21.15.50:0/3465244675 conn(0x7f30fc0b01b0 msgr2=0x7f30fc0b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 shutdown_connections 2023-08-10T10:44:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.382+0000 7f3102f57640 1 -- 172.21.15.50:0/3465244675 wait complete. 2023-08-10T10:44:18.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.625+0000 7f562a2fa640 1 Processor -- start 2023-08-10T10:44:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.625+0000 7f562a2fa640 1 -- start start 2023-08-10T10:44:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f562a2fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56240696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f562a2fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56240719f0 con 0x7f562415ccb0 2023-08-10T10:44:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f562a2fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56240c8db0 con 0x7f56240c9b30 2023-08-10T10:44:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f562a2fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56240c9050 con 0x7f56240b3010 2023-08-10T10:44:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f5623fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f562415ccb0 0x7f56240b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46018/0 (socket says 172.21.15.50:46018) 2023-08-10T10:44:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.627+0000 7f5623fff640 1 -- 172.21.15.50:0/2792950387 learned_addr learned my addr 172.21.15.50:0/2792950387 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492364694 0 0) 0x7f56240719f0 con 0x7f562415ccb0 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f561bfff640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56240696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5610003520 con 0x7f562415ccb0 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190354135 0 0) 0x7f5610003520 con 0x7f562415ccb0 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 msgr2=0x7f56240696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56240696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 >> v1:172.21.15.117:6789/0 conn(0x7f56240c9b30 legacy=0x7f562406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56240c9330 con 0x7f562415ccb0 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5614001670 con 0x7f562415ccb0 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 >> v1:172.21.15.50:6789/0 conn(0x7f562415ccb0 legacy=0x7f56240b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5610003fd0 0x7f56100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f5610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56240c9050 con 0x7f5610004d00 2023-08-10T10:44:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561000bb40 con 0x7f5610003fd0 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.628+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561000bd00 con 0x7f56240b3010 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f5610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5623fff640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f561bfff640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5610003fd0 0x7f56100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 -- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 msgr2=0x7f56100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 -- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5610003fd0 msgr2=0x7f56100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:18.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5610003fd0 0x7f56100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5628897640 1 -- 172.21.15.50:0/2792950387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610003520 con 0x7f5610004d00 2023-08-10T10:44:18.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.629+0000 7f5623fff640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240b3010 0x7f56100039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:18.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.630+0000 7f5628897640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f5610005180 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f561c001e50 tx=0x7f56100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2eadb1c663b076 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c003b70 con 0x7f5610004d00 2023-08-10T10:44:18.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c003cd0 con 0x7f5610004d00 2023-08-10T10:44:18.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f56237fe640 1 -- 172.21.15.50:0/2792950387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c005310 con 0x7f5610004d00 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 -- 172.21.15.50:0/2792950387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 msgr2=0x7f5610005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 --2- 172.21.15.50:0/2792950387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f5610005180 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f561c001e50 tx=0x7f56100057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f5628897640 1 -- 172.21.15.50:0/2792950387 reap_dead start 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 -- 172.21.15.50:0/2792950387 shutdown_connections 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 -- 172.21.15.50:0/2792950387 >> 172.21.15.50:0/2792950387 conn(0x7f562406b590 msgr2=0x7f56240ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 -- 172.21.15.50:0/2792950387 shutdown_connections 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.631+0000 7f562a2fa640 1 -- 172.21.15.50:0/2792950387 wait complete. 2023-08-10T10:44:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.633+0000 7f562a2fa640 1 Processor -- start 2023-08-10T10:44:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.633+0000 7f562a2fa640 1 -- start start 2023-08-10T10:44:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 0x7f562415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240c3f30 0x7f56240c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56240c48f0 con 0x7f5610004d00 2023-08-10T10:44:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562414d360 con 0x7f562415d120 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.634+0000 7f562a2fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562415dbe0 con 0x7f56240c3f30 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44266/0 (socket says 172.21.15.50:44266) 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 -- 172.21.15.50:0/1170431684 learned_addr learned my addr 172.21.15.50:0/1170431684 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f561bfff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 0x7f562415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5628897640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240c3f30 0x7f56240c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 -- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240c3f30 msgr2=0x7f56240c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240c3f30 0x7f56240c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 -- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 msgr2=0x7f562415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 0x7f562415d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f5623fff640 1 -- 172.21.15.50:0/1170431684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562415dec0 con 0x7f5610004d00 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.635+0000 7f561bfff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 0x7f562415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f5623fff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f561400d8c0 tx=0x7f561400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56140074e0 con 0x7f5610004d00 2023-08-10T10:44:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5614007640 con 0x7f5610004d00 2023-08-10T10:44:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56140049e0 con 0x7f5610004d00 2023-08-10T10:44:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562415e1a0 con 0x7f5610004d00 2023-08-10T10:44:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.636+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562415e9a0 con 0x7f5610004d00 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.637+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562415eb60 con 0x7f5610004d00 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.638+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5614004b40 con 0x7f5610004d00 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.639+0000 7f56217fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 0x7f560406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.639+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5614088ef0 con 0x7f5610004d00 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.639+0000 7f561bfff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 0x7f560406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.640+0000 7f561bfff640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 0x7f560406d110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f56240c4c60 tx=0x7f560c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.644+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5614053fb0 con 0x7f5610004d00 2023-08-10T10:44:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.873+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f562404e270 con 0x7f5610004d00 2023-08-10T10:44:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.874+0000 7f56217fa640 1 -- 172.21.15.50:0/1170431684 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f5614019090 con 0x7f5610004d00 2023-08-10T10:44:18.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:18.875 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:44:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:44:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.876+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 msgr2=0x7f560406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.876+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 0x7f560406d110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f56240c4c60 tx=0x7f560c008040 comp rx=0 tx=0).stop 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.876+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 msgr2=0x7f56241f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.876+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f561400d8c0 tx=0x7f561400dd80 comp rx=0 tx=0).stop 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 shutdown_connections 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56240c3f30 0x7f56240c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f560406ac50 0x7f560406d110 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f562415d120 0x7f562415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 --2- 172.21.15.50:0/1170431684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5610004d00 0x7f56241f1da0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 >> 172.21.15.50:0/1170431684 conn(0x7f562406b590 msgr2=0x7f56240696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 shutdown_connections 2023-08-10T10:44:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:18.877+0000 7f562a2fa640 1 -- 172.21.15.50:0/1170431684 wait complete. 2023-08-10T10:44:18.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.121+0000 7f56de60d640 1 Processor -- start 2023-08-10T10:44:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.121+0000 7f56de60d640 1 -- start start 2023-08-10T10:44:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56de60d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56d80b3f30 0x7f56d80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56de60d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d8071c70 con 0x7f56d815aa40 2023-08-10T10:44:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56de60d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80713d0 con 0x7f56d80b0c60 2023-08-10T10:44:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56de60d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80716b0 con 0x7f56d80b3f30 2023-08-10T10:44:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56d7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56d815aa40 0x7f56d80b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46030/0 (socket says 172.21.15.50:46030) 2023-08-10T10:44:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56d7fff640 1 -- 172.21.15.50:0/1787377176 learned_addr learned my addr 172.21.15.50:0/1787377176 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.123+0000 7f56dcbaa640 1 --2- 172.21.15.50:0/1787377176 >> v2:172.21.15.50:3300/0 conn(0x7f56d80b3f30 0x7f56d80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.124+0000 7f56d6ffd640 1 -- 172.21.15.50:0/1787377176 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747002027 0 0) 0x7f56d8071c70 con 0x7f56d815aa40 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.124+0000 7f56d6ffd640 1 -- 172.21.15.50:0/1787377176 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c0003520 con 0x7f56d815aa40 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.124+0000 7f56dcbaa640 1 -- 172.21.15.50:0/1787377176 >> v1:172.21.15.117:6789/0 conn(0x7f56d80b0c60 legacy=0x7f56d80c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.124+0000 7f56dcbaa640 1 -- 172.21.15.50:0/1787377176 >> v1:172.21.15.50:6789/0 conn(0x7f56d815aa40 legacy=0x7f56d80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.124+0000 7f56dcbaa640 1 -- 172.21.15.50:0/1787377176 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8071990 con 0x7f56d80b3f30 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.125+0000 7f56dcbaa640 1 --2- 172.21.15.50:0/1787377176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d80b3f30 0x7f56d80ca030 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009d90 tx=0x7f56d002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19098acf1eef98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.125+0000 7f56d6ffd640 1 -- 172.21.15.50:0/1787377176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d002cbd0 con 0x7f56d80b3f30 2023-08-10T10:44:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.125+0000 7f56d6ffd640 1 -- 172.21.15.50:0/1787377176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d002cd30 con 0x7f56d80b3f30 2023-08-10T10:44:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.125+0000 7f56d6ffd640 1 -- 172.21.15.50:0/1787377176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d002cea0 con 0x7f56d80b3f30 2023-08-10T10:44:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 -- 172.21.15.50:0/1787377176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d80b3f30 msgr2=0x7f56d80ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 --2- 172.21.15.50:0/1787377176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d80b3f30 0x7f56d80ca030 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009d90 tx=0x7f56d002be20 comp rx=0 tx=0).stop 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 -- 172.21.15.50:0/1787377176 shutdown_connections 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 --2- 172.21.15.50:0/1787377176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d80b3f30 0x7f56d80ca030 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 -- 172.21.15.50:0/1787377176 >> 172.21.15.50:0/1787377176 conn(0x7f56d806b590 msgr2=0x7f56d80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 -- 172.21.15.50:0/1787377176 shutdown_connections 2023-08-10T10:44:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.126+0000 7f56de60d640 1 -- 172.21.15.50:0/1787377176 wait complete. 2023-08-10T10:44:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.128+0000 7f56de60d640 1 Processor -- start 2023-08-10T10:44:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.128+0000 7f56de60d640 1 -- start start 2023-08-10T10:44:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 0x7f56d81f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 0x7f56d8153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c6c90 con 0x7f56d815aa40 2023-08-10T10:44:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d81537c0 con 0x7f56d80b0c60 2023-08-10T10:44:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56de60d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8153a90 con 0x7f56d80b3f30 2023-08-10T10:44:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56dcbaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56dcbaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44298/0 (socket says 172.21.15.50:44298) 2023-08-10T10:44:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.129+0000 7f56dcbaa640 1 -- 172.21.15.50:0/2747868564 learned_addr learned my addr 172.21.15.50:0/2747868564 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 -- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 msgr2=0x7f56d8153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56d77fe640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 0x7f56d8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56d7fff640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 0x7f56d81f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 0x7f56d8153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 -- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 msgr2=0x7f56d81f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 0x7f56d81f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 -- 172.21.15.50:0/2747868564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009a70 con 0x7f56d815aa40 2023-08-10T10:44:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56d77fe640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 0x7f56d8153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56d7fff640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 0x7f56d81f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:19.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56dcbaa640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009eb0 tx=0x7f56d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.130+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d002cea0 con 0x7f56d815aa40 2023-08-10T10:44:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.131+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d003e630 con 0x7f56d815aa40 2023-08-10T10:44:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.131+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d003e9e0 con 0x7f56d815aa40 2023-08-10T10:44:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.131+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d8153d70 con 0x7f56d815aa40 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.131+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d80c71c0 con 0x7f56d815aa40 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.132+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d804e270 con 0x7f56d815aa40 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.133+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56d003b050 con 0x7f56d815aa40 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.134+0000 7f56d4ff9640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 0x7f56c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.134+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56d00ab670 con 0x7f56d815aa40 2023-08-10T10:44:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.135+0000 7f56d7fff640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 0x7f56c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.135+0000 7f56d7fff640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 0x7f56c406d110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005880 tx=0x7f56c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.139+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f56d0076680 con 0x7f56d815aa40 2023-08-10T10:44:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.322+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56d80c8ba0 con 0x7f56d815aa40 2023-08-10T10:44:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.325+0000 7f56d4ff9640 1 -- 172.21.15.50:0/2747868564 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f56d0009450 con 0x7f56d815aa40 2023-08-10T10:44:19.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:19.326 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:17.483407+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 msgr2=0x7f56c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 0x7f56c406d110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005880 tx=0x7f56c8009040 comp rx=0 tx=0).stop 2023-08-10T10:44:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 msgr2=0x7f56d8150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009eb0 tx=0x7f56d0004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 shutdown_connections 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.327+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d815aa40 0x7f56d8150b80 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56d80b3f30 0x7f56d8153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f56c406ac50 0x7f56c406d110 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 --2- 172.21.15.50:0/2747868564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56d80b0c60 0x7f56d81f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 >> 172.21.15.50:0/2747868564 conn(0x7f56d806b590 msgr2=0x7f56d8155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 shutdown_connections 2023-08-10T10:44:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.328+0000 7f56de60d640 1 -- 172.21.15.50:0/2747868564 wait complete. 2023-08-10T10:44:19.346 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:44:19.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:19.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.561+0000 7fe83f59e640 1 Processor -- start 2023-08-10T10:44:19.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.561+0000 7fe83f59e640 1 -- start start 2023-08-10T10:44:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 0x7fe8400ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8400c8e90 0x7fe8400aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8400c9cf0 0x7fe8400b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400cca30 con 0x7fe8400c8e90 2023-08-10T10:44:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400ca180 con 0x7fe840159000 2023-08-10T10:44:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe83f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cc100 con 0x7fe8400c9cf0 2023-08-10T10:44:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe835d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8400c8e90 0x7fe8400aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe835d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8400c8e90 0x7fe8400aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44304/0 (socket says 172.21.15.50:44304) 2023-08-10T10:44:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.563+0000 7fe835d9b640 1 -- 172.21.15.50:0/1227782986 learned_addr learned my addr 172.21.15.50:0/1227782986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe83e59c640 1 --2- 172.21.15.50:0/1227782986 >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 0x7fe8400ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe835d9b640 1 -- 172.21.15.50:0/1227782986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8400c9cf0 msgr2=0x7fe8400b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe835d9b640 1 --2- 172.21.15.50:0/1227782986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8400c9cf0 0x7fe8400b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe835d9b640 1 -- 172.21.15.50:0/1227782986 >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 msgr2=0x7fe8400ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe835d9b640 1 --2- 172.21.15.50:0/1227782986 >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 0x7fe8400ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe835d9b640 1 -- 172.21.15.50:0/1227782986 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400cc3e0 con 0x7fe8400c8e90 2023-08-10T10:44:19.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.564+0000 7fe83e59c640 1 --2- 172.21.15.50:0/1227782986 >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 0x7fe8400ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:19.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.565+0000 7fe835d9b640 1 --2- 172.21.15.50:0/1227782986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8400c8e90 0x7fe8400aff10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe84006d0f0 tx=0x7fe82802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6864f33bd5ded92 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.565+0000 7fe83dd9b640 1 -- 172.21.15.50:0/1227782986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82802caa0 con 0x7fe8400c8e90 2023-08-10T10:44:19.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.565+0000 7fe83dd9b640 1 -- 172.21.15.50:0/1227782986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82802cc00 con 0x7fe8400c8e90 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.565+0000 7fe83dd9b640 1 -- 172.21.15.50:0/1227782986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8280343f0 con 0x7fe8400c8e90 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 -- 172.21.15.50:0/1227782986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8400c8e90 msgr2=0x7fe8400aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 --2- 172.21.15.50:0/1227782986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8400c8e90 0x7fe8400aff10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe84006d0f0 tx=0x7fe82802bf00 comp rx=0 tx=0).stop 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 -- 172.21.15.50:0/1227782986 shutdown_connections 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 --2- 172.21.15.50:0/1227782986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8400c9cf0 0x7fe8400b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 --2- 172.21.15.50:0/1227782986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8400c8e90 0x7fe8400aff10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 --2- 172.21.15.50:0/1227782986 >> v2:172.21.15.117:3300/0 conn(0x7fe840159000 0x7fe8400ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 -- 172.21.15.50:0/1227782986 >> 172.21.15.50:0/1227782986 conn(0x7fe84006ab80 msgr2=0x7fe84006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 -- 172.21.15.50:0/1227782986 shutdown_connections 2023-08-10T10:44:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.566+0000 7fe83f59e640 1 -- 172.21.15.50:0/1227782986 wait complete. 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.568+0000 7fe83f59e640 1 Processor -- start 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.568+0000 7fe83f59e640 1 -- start start 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 0x7fe8400c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 0x7fe8400c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400c2f30 con 0x7fe8401f1ee0 2023-08-10T10:44:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400c3210 con 0x7fe8400c8e90 2023-08-10T10:44:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.569+0000 7fe83f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400c34f0 con 0x7fe840159000 2023-08-10T10:44:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44314/0 (socket says 172.21.15.50:44314) 2023-08-10T10:44:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 -- 172.21.15.50:0/2600386515 learned_addr learned my addr 172.21.15.50:0/2600386515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83e59c640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 0x7fe8400c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe835d9b640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 0x7fe8400c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 -- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 msgr2=0x7fe8400c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 0x7fe8400c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 -- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 msgr2=0x7fe8400c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 0x7fe8400c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83ed9d640 1 -- 172.21.15.50:0/2600386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009b30 con 0x7fe8401f1ee0 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe83e59c640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 0x7fe8400c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.570+0000 7fe835d9b640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 0x7fe8400c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe83ed9d640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b3c0 tx=0x7fe83800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838011830 con 0x7fe8401f1ee0 2023-08-10T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838011990 con 0x7fe8401f1ee0 2023-08-10T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838011d40 con 0x7fe8401f1ee0 2023-08-10T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8400c37d0 con 0x7fe8401f1ee0 2023-08-10T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.571+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840071150 con 0x7fe8401f1ee0 2023-08-10T10:44:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.572+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840066e30 con 0x7fe8401f1ee0 2023-08-10T10:44:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.573+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe83801b460 con 0x7fe8401f1ee0 2023-08-10T10:44:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.574+0000 7fe8377fe640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 0x7fe82006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.574+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8380892e0 con 0x7fe8401f1ee0 2023-08-10T10:44:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.575+0000 7fe83e59c640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 0x7fe82006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:19.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.575+0000 7fe83e59c640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 0x7fe82006d110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe830006fd0 tx=0x7fe830008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:19.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.579+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8380542f0 con 0x7fe8401f1ee0 2023-08-10T10:44:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.820+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8400cb7a0 con 0x7fe8401f1ee0 2023-08-10T10:44:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.820+0000 7fe8377fe640 1 -- 172.21.15.50:0/2600386515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fe838057910 con 0x7fe8401f1ee0 2023-08-10T10:44:19.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:19.821 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:44:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:44:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.822+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 msgr2=0x7fe82006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.822+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 0x7fe82006d110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe830006fd0 tx=0x7fe830008040 comp rx=0 tx=0).stop 2023-08-10T10:44:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.822+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 msgr2=0x7fe8400c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.822+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b3c0 tx=0x7fe83800b880 comp rx=0 tx=0).stop 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 shutdown_connections 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8401f1ee0 0x7fe8400c6850 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe840159000 0x7fe8400c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe82006ac50 0x7fe82006d110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 --2- 172.21.15.50:0/2600386515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8400c8e90 0x7fe8400c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 >> 172.21.15.50:0/2600386515 conn(0x7fe84006ab80 msgr2=0x7fe840157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 shutdown_connections 2023-08-10T10:44:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:19.823+0000 7fe83f59e640 1 -- 172.21.15.50:0/2600386515 wait complete. 2023-08-10T10:44:19.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.041+0000 7f5fe1c45640 1 Processor -- start 2023-08-10T10:44:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.041+0000 7f5fe1c45640 1 -- start start 2023-08-10T10:44:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fdc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1c45640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc15d010 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1c45640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc15d290 con 0x7f5fdc153c30 2023-08-10T10:44:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15d570 con 0x7f5fdc153850 2023-08-10T10:44:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1444640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fdc0cfd40 0x7f5fdc0ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46034/0 (socket says 172.21.15.50:46034) 2023-08-10T10:44:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.043+0000 7f5fe1444640 1 -- 172.21.15.50:0/1458498691 learned_addr learned my addr 172.21.15.50:0/1458498691 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fe0c43640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fdc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413656484 0 0) 0x7f5fdc15d010 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc003520 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3115617480 0 0) 0x7f5fcc003520 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 msgr2=0x7f5fdc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fdc0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 >> v1:172.21.15.117:6789/0 conn(0x7f5fdc153c30 legacy=0x7f5fdc0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc15d850 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5fd4001a40 con 0x7f5fdc0cfd40 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 >> v1:172.21.15.50:6789/0 conn(0x7f5fdc0cfd40 legacy=0x7f5fdc0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fcc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fcc003f90 0x7f5fcc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fcc004d00 0x7f5fcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15d570 con 0x7f5fcc003f90 2023-08-10T10:44:20.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00bae0 con 0x7f5fcc004d00 2023-08-10T10:44:20.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.044+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00bca0 con 0x7f5fdc153850 2023-08-10T10:44:20.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fcc003f90 0x7f5fcc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fe0c43640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fcc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fe1444640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fcc004d00 0x7f5fcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 -- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 msgr2=0x7f5fcc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc153850 0x7f5fcc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 -- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fcc004d00 msgr2=0x7f5fcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fcc004d00 0x7f5fcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fdbfff640 1 -- 172.21.15.50:0/1458498691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc003520 con 0x7f5fcc003f90 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.045+0000 7f5fe1444640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fcc004d00 0x7f5fcc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.046+0000 7f5fdbfff640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fcc003f90 0x7f5fcc0047c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8001750 tx=0x7f5fcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f102cc421b86e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.046+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80052d0 con 0x7f5fcc003f90 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.046+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc802e050 con 0x7f5fcc003f90 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.046+0000 7f5fdb7fe640 1 -- 172.21.15.50:0/1458498691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8003830 con 0x7f5fcc003f90 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1458498691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fcc003f90 msgr2=0x7f5fcc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1458498691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fcc003f90 0x7f5fcc0047c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8001750 tx=0x7f5fcc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1444640 1 -- 172.21.15.50:0/1458498691 reap_dead start 2023-08-10T10:44:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1458498691 shutdown_connections 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1458498691 >> 172.21.15.50:0/1458498691 conn(0x7f5fdc069880 msgr2=0x7f5fdc069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1458498691 shutdown_connections 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.047+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1458498691 wait complete. 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.049+0000 7f5fe1c45640 1 Processor -- start 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.049+0000 7f5fe1c45640 1 -- start start 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fcc003f90 0x7f5fdc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc152210 0x7f5fdc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0d2060 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0d2340 con 0x7f5fdc152210 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.050+0000 7f5fe1c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0d2620 con 0x7f5fcc003f90 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44336/0 (socket says 172.21.15.50:44336) 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 -- 172.21.15.50:0/1670819568 learned_addr learned my addr 172.21.15.50:0/1670819568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 -- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fcc003f90 msgr2=0x7f5fdc0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fcc003f90 0x7f5fdc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 -- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc152210 msgr2=0x7f5fdc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc152210 0x7f5fdc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 -- 172.21.15.50:0/1670819568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0ca380 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.051+0000 7f5fe1444640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0b5090 tx=0x7f5fd400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.052+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400b8d0 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.052+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400ba30 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.052+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400bdc0 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.052+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0ca660 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.052+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc151ef0 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.053+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc0ca850 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.054+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fd4007110 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.055+0000 7f5fd97fa640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 0x7f5fc006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.055+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd40898b0 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.056+0000 7f5fe0c43640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 0x7f5fc006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.056+0000 7f5fe0c43640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 0x7f5fc006d140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009910 tx=0x7f5fd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.060+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5fd4054950 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.291+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc066e30 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.292+0000 7f5fd97fa640 1 -- 172.21.15.50:0/1670819568 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f5fd4057f70 con 0x7f5fdc1f2ab0 2023-08-10T10:44:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:20.293 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:43:18.975711+0000","modified":"2023-08-10T10:43:22.559311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3885575175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3885575175},{"type":"v1","addr":"172.21.15.117:6834","nonce":3885575175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-10T10:44:20.293 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2023-08-10T10:44:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 msgr2=0x7f5fc006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 0x7f5fc006d140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009910 tx=0x7f5fd0008040 comp rx=0 tx=0).stop 2023-08-10T10:44:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 msgr2=0x7f5fdc1f2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0b5090 tx=0x7f5fd400b0d0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 shutdown_connections 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fdc1f2ab0 0x7f5fdc1f2f30 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc006ac80 0x7f5fc006d140 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc152210 0x7f5fdc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 --2- 172.21.15.50:0/1670819568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fcc003f90 0x7f5fdc0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 >> 172.21.15.50:0/1670819568 conn(0x7f5fdc069880 msgr2=0x7f5fdc15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.296+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 shutdown_connections 2023-08-10T10:44:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.297+0000 7f5fe1c45640 1 -- 172.21.15.50:0/1670819568 wait complete. 2023-08-10T10:44:20.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.539+0000 7f002caa6640 1 Processor -- start 2023-08-10T10:44:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.539+0000 7f002caa6640 1 -- start start 2023-08-10T10:44:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002caa6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00280ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002caa6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0028071c70 con 0x7f002815aa40 2023-08-10T10:44:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002caa6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00280713d0 con 0x7f00280b0c60 2023-08-10T10:44:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002caa6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280716b0 con 0x7f00280b3f30 2023-08-10T10:44:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f002815aa40 0x7f00280b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46040/0 (socket says 172.21.15.50:46040) 2023-08-10T10:44:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f002659c640 1 -- 172.21.15.50:0/3054644057 learned_addr learned my addr 172.21.15.50:0/3054644057 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f0026d9d640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00280ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464411102 0 0) 0x7f0028071c70 con 0x7f002815aa40 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.541+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0014003520 con 0x7f002815aa40 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088094652 0 0) 0x7f0014003520 con 0x7f002815aa40 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 msgr2=0x7f00280ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00280ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 >> v1:172.21.15.117:6789/0 conn(0x7f00280b0c60 legacy=0x7f00280c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028071990 con 0x7f002815aa40 2023-08-10T10:44:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0018001670 con 0x7f002815aa40 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 >> v1:172.21.15.50:6789/0 conn(0x7f002815aa40 legacy=0x7f00280b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014003fd0 0x7f00140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0014004d00 0x7f0014005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00280716b0 con 0x7f0014004d00 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001400bbc0 con 0x7f0014003fd0 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001400bd80 con 0x7f00280b3f30 2023-08-10T10:44:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.542+0000 7f0026d9d640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0014004d00 0x7f0014005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f002659c640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f001ffff640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014003fd0 0x7f00140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f0026d9d640 1 -- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 msgr2=0x7f00140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f0026d9d640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00280b3f30 0x7f00140039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f0026d9d640 1 -- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014003fd0 msgr2=0x7f00140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f0026d9d640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014003fd0 0x7f00140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f0026d9d640 1 -- 172.21.15.50:0/3054644057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014003520 con 0x7f0014004d00 2023-08-10T10:44:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.543+0000 7f001ffff640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014003fd0 0x7f00140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.544+0000 7f0026d9d640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0014004d00 0x7f0014005180 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0020007360 tx=0x7f00140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0debd1c5b67669 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.544+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002002ccd0 con 0x7f0014004d00 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.544+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002002ce30 con 0x7f0014004d00 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.544+0000 7f0025d9b640 1 -- 172.21.15.50:0/3054644057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020034660 con 0x7f0014004d00 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 -- 172.21.15.50:0/3054644057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0014004d00 msgr2=0x7f0014005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 --2- 172.21.15.50:0/3054644057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0014004d00 0x7f0014005180 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0020007360 tx=0x7f00140057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f0026d9d640 1 -- 172.21.15.50:0/3054644057 reap_dead start 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 -- 172.21.15.50:0/3054644057 shutdown_connections 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 -- 172.21.15.50:0/3054644057 >> 172.21.15.50:0/3054644057 conn(0x7f002806b590 msgr2=0x7f00280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 -- 172.21.15.50:0/3054644057 shutdown_connections 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.545+0000 7f002caa6640 1 -- 172.21.15.50:0/3054644057 wait complete. 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.547+0000 7f002caa6640 1 Processor -- start 2023-08-10T10:44:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.547+0000 7f002caa6640 1 -- start start 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0014004d00 0x7f002814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 0x7f0028153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00280c5f70 con 0x7f00280b2f20 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00280c5c60 con 0x7f0028153200 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f002caa6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002814f220 con 0x7f0014004d00 2023-08-10T10:44:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f001ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f001ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44356/0 (socket says 172.21.15.50:44356) 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.548+0000 7f001ffff640 1 -- 172.21.15.50:0/1842985835 learned_addr learned my addr 172.21.15.50:0/1842985835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f002659c640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0014004d00 0x7f002814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f0026d9d640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 0x7f0028153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 -- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0014004d00 msgr2=0x7f002814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0014004d00 0x7f002814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 -- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 msgr2=0x7f0028153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 0x7f0028153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 -- 172.21.15.50:0/1842985835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00281f62a0 con 0x7f00280b2f20 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f0026d9d640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 0x7f0028153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.549+0000 7f001ffff640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f001000d7a0 tx=0x7f001000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.550+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010017070 con 0x7f00280b2f20 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.550+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010005070 con 0x7f00280b2f20 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.550+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00281f6540 con 0x7f00280b2f20 2023-08-10T10:44:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.550+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010005420 con 0x7f00280b2f20 2023-08-10T10:44:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.550+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00281f6b00 con 0x7f00280b2f20 2023-08-10T10:44:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.551+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002804e270 con 0x7f00280b2f20 2023-08-10T10:44:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.552+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0010007030 con 0x7f00280b2f20 2023-08-10T10:44:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.553+0000 7f001effd640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 0x7f000806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.553+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0010088e00 con 0x7f00280b2f20 2023-08-10T10:44:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.553+0000 7f002659c640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 0x7f000806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.554+0000 7f002659c640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 0x7f000806d110 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00180017a0 tx=0x7f0018001590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.557+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0010053e10 con 0x7f00280b2f20 2023-08-10T10:44:20.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.741+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f002806fbd0 con 0x7f00280b2f20 2023-08-10T10:44:20.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.744+0000 7f001effd640 1 -- 172.21.15.50:0/1842985835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f0010057430 con 0x7f00280b2f20 2023-08-10T10:44:20.746 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:20.746 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:17.483407+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:43:16.551358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-10T10:43:18.005134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:20.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.746+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 msgr2=0x7f000806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.746+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 0x7f000806d110 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00180017a0 tx=0x7f0018001590 comp rx=0 tx=0).stop 2023-08-10T10:44:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.746+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 msgr2=0x7f00281f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.746+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f001000d7a0 tx=0x7f001000dc60 comp rx=0 tx=0).stop 2023-08-10T10:44:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 shutdown_connections 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f000806ac50 0x7f000806d110 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0028153200 0x7f0028153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00280b2f20 0x7f00281f5d60 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 --2- 172.21.15.50:0/1842985835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0014004d00 0x7f002814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 >> 172.21.15.50:0/1842985835 conn(0x7f002806b590 msgr2=0x7f00280cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 shutdown_connections 2023-08-10T10:44:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.747+0000 7f002caa6640 1 -- 172.21.15.50:0/1842985835 wait complete. 2023-08-10T10:44:20.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:44:20.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.992+0000 7fc05e238640 1 Processor -- start 2023-08-10T10:44:20.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.992+0000 7fc05e238640 1 -- start start 2023-08-10T10:44:20.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc05e238640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc05806f550 0x7fc05806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc05e238640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580cae00 con 0x7fc0580ac890 2023-08-10T10:44:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc05e238640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580ca5c0 con 0x7fc0580ca160 2023-08-10T10:44:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc05e238640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580c9150 con 0x7fc05806f550 2023-08-10T10:44:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc0577fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc0580ac890 0x7fc0580acc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46042/0 (socket says 172.21.15.50:46042) 2023-08-10T10:44:21.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.994+0000 7fc0577fe640 1 -- 172.21.15.50:0/1314966304 learned_addr learned my addr 172.21.15.50:0/1314966304 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc057fff640 1 --2- 172.21.15.50:0/1314966304 >> v2:172.21.15.117:3300/0 conn(0x7fc05806f550 0x7fc05806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911318743 0 0) 0x7fc0580cae00 con 0x7fc0580ac890 2023-08-10T10:44:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc044003520 con 0x7fc0580ac890 2023-08-10T10:44:21.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018085121 0 0) 0x7fc044003520 con 0x7fc0580ac890 2023-08-10T10:44:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 >> v2:172.21.15.117:3300/0 conn(0x7fc05806f550 msgr2=0x7fc05806f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 --2- 172.21.15.50:0/1314966304 >> v2:172.21.15.117:3300/0 conn(0x7fc05806f550 0x7fc05806f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 >> v1:172.21.15.117:6789/0 conn(0x7fc0580ca160 legacy=0x7fc0580cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580ca840 con 0x7fc0580ac890 2023-08-10T10:44:21.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fc048001670 con 0x7fc0580ac890 2023-08-10T10:44:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 >> v1:172.21.15.50:6789/0 conn(0x7fc0580ac890 legacy=0x7fc0580acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.995+0000 7fc056ffd640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc056ffd640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580c9150 con 0x7fc0440052a0 2023-08-10T10:44:21.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c170 con 0x7fc0440047c0 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c330 con 0x7fc044003970 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc057fff640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc04ffff640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.996+0000 7fc0577fe640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 -- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc044003970 msgr2=0x7fc044003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 -- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0440047c0 msgr2=0x7fc044004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 -- 172.21.15.50:0/1314966304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044003520 con 0x7fc0440052a0 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.997+0000 7fc057fff640 1 -- 172.21.15.50:0/1314966304 reap_dead start 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.998+0000 7fc057fff640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc04400b980 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc050009f90 tx=0x7fc0440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6a829ba1a10bed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.998+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05002cc20 con 0x7fc0440052a0 2023-08-10T10:44:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.998+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000f040 con 0x7fc0440052a0 2023-08-10T10:44:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.998+0000 7fc056ffd640 1 -- 172.21.15.50:0/1314966304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050003990 con 0x7fc0440052a0 2023-08-10T10:44:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 -- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 msgr2=0x7fc04400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc04400b980 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc050009f90 tx=0x7fc0440057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 -- 172.21.15.50:0/1314966304 shutdown_connections 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 --2- 172.21.15.50:0/1314966304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 -- 172.21.15.50:0/1314966304 >> 172.21.15.50:0/1314966304 conn(0x7fc0580b08e0 msgr2=0x7fc0580ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 -- 172.21.15.50:0/1314966304 shutdown_connections 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:20.999+0000 7fc05e238640 1 -- 172.21.15.50:0/1314966304 wait complete. 2023-08-10T10:44:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.001+0000 7fc05e238640 1 Processor -- start 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.001+0000 7fc05e238640 1 -- start start 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 0x7fc0580b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0580b26c0 0x7fc05815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581576b0 con 0x7fc0440052a0 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05806a700 con 0x7fc05815dc30 2023-08-10T10:44:21.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc05e238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05806b0d0 con 0x7fc0580b26c0 2023-08-10T10:44:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc0577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc0577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44366/0 (socket says 172.21.15.50:44366) 2023-08-10T10:44:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.002+0000 7fc0577fe640 1 -- 172.21.15.50:0/1317329536 learned_addr learned my addr 172.21.15.50:0/1317329536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc04ffff640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 0x7fc0580b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc057fff640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0580b26c0 0x7fc05815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 -- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0580b26c0 msgr2=0x7fc05815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0580b26c0 0x7fc05815ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 -- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 msgr2=0x7fc0580b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 0x7fc0580b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 -- 172.21.15.50:0/1317329536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058069af0 con 0x7fc0440052a0 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc04ffff640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 0x7fc0580b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:21.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc0577fe640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e700 tx=0x7fc04800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800c660 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800c7c0 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.003+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800cb30 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.004+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc058069dd0 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.004+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05806a390 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.005+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05806a550 con 0x7fc0440052a0 2023-08-10T10:44:21.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.006+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc04800cc90 con 0x7fc0440052a0 2023-08-10T10:44:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.007+0000 7fc054ff9640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 0x7fc03806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.007+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc048089140 con 0x7fc0440052a0 2023-08-10T10:44:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.007+0000 7fc04ffff640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 0x7fc03806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.008+0000 7fc04ffff640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 0x7fc03806d140 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0581599a0 tx=0x7fc040009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.011+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc048054150 con 0x7fc0440052a0 2023-08-10T10:44:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.237+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc05804e270 con 0x7fc0440052a0 2023-08-10T10:44:21.239 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:44:21.239+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:44:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.248+0000 7fc054ff9640 1 -- 172.21.15.50:0/1317329536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc048057770 con 0x7fc0440052a0 2023-08-10T10:44:21.250 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:44:21.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 msgr2=0x7fc03806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 0x7fc03806d140 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0581599a0 tx=0x7fc040009040 comp rx=0 tx=0).stop 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 msgr2=0x7fc05806ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e700 tx=0x7fc04800ebc0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 shutdown_connections 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0580b26c0 0x7fc05815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc03806ac80 0x7fc03806d140 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05815dc30 0x7fc0580b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 --2- 172.21.15.50:0/1317329536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0440052a0 0x7fc05806ab90 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 >> 172.21.15.50:0/1317329536 conn(0x7fc0580b08e0 msgr2=0x7fc0580af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 shutdown_connections 2023-08-10T10:44:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.252+0000 7fc05e238640 1 -- 172.21.15.50:0/1317329536 wait complete. 2023-08-10T10:44:21.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:44:21.367 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:44:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.501+0000 7f3614ffd640 1 Processor -- start 2023-08-10T10:44:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.501+0000 7f3614ffd640 1 -- start start 2023-08-10T10:44:21.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f3614ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015ac00 0x7f361006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f3614ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3610069db0 0x7f36100cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f3614ffd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361015bcb0 con 0x7f361015a820 2023-08-10T10:44:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f3614ffd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100c5540 con 0x7f361015ac00 2023-08-10T10:44:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f3614ffd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361015b0a0 con 0x7f3610069db0 2023-08-10T10:44:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f360dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015ac00 0x7f361006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f360dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015ac00 0x7f361006c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44374/0 (socket says 172.21.15.50:44374) 2023-08-10T10:44:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.503+0000 7f360dd9b640 1 -- 172.21.15.50:0/319805878 learned_addr learned my addr 172.21.15.50:0/319805878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.504+0000 7f360ed9d640 1 --2- 172.21.15.50:0/319805878 >> v2:172.21.15.117:3300/0 conn(0x7f3610069db0 0x7f36100cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.504+0000 7f360dd9b640 1 -- 172.21.15.50:0/319805878 >> v2:172.21.15.117:3300/0 conn(0x7f3610069db0 msgr2=0x7f36100cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.504+0000 7f360dd9b640 1 --2- 172.21.15.50:0/319805878 >> v2:172.21.15.117:3300/0 conn(0x7f3610069db0 0x7f36100cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.504+0000 7f360dd9b640 1 -- 172.21.15.50:0/319805878 >> v1:172.21.15.117:6789/0 conn(0x7f361015a820 legacy=0x7f36100696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.504+0000 7f360dd9b640 1 -- 172.21.15.50:0/319805878 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361015b380 con 0x7f361015ac00 2023-08-10T10:44:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.505+0000 7f360dd9b640 1 --2- 172.21.15.50:0/319805878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015ac00 0x7f361006c180 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f361006ac10 tx=0x7f360402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbe7ed307f900fb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.505+0000 7f360d59a640 1 -- 172.21.15.50:0/319805878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040317e0 con 0x7f361015ac00 2023-08-10T10:44:21.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.505+0000 7f360d59a640 1 -- 172.21.15.50:0/319805878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604031940 con 0x7f361015ac00 2023-08-10T10:44:21.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.505+0000 7f360d59a640 1 -- 172.21.15.50:0/319805878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604031cd0 con 0x7f361015ac00 2023-08-10T10:44:21.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 -- 172.21.15.50:0/319805878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015ac00 msgr2=0x7f361006c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 --2- 172.21.15.50:0/319805878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015ac00 0x7f361006c180 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f361006ac10 tx=0x7f360402b880 comp rx=0 tx=0).stop 2023-08-10T10:44:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 -- 172.21.15.50:0/319805878 shutdown_connections 2023-08-10T10:44:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 --2- 172.21.15.50:0/319805878 >> v2:172.21.15.117:3300/0 conn(0x7f3610069db0 0x7f36100cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 --2- 172.21.15.50:0/319805878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015ac00 0x7f361006c180 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 -- 172.21.15.50:0/319805878 >> 172.21.15.50:0/319805878 conn(0x7f36100b08e0 msgr2=0x7f36100ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 -- 172.21.15.50:0/319805878 shutdown_connections 2023-08-10T10:44:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.506+0000 7f3614ffd640 1 -- 172.21.15.50:0/319805878 wait complete. 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.508+0000 7f3614ffd640 1 Processor -- start 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.508+0000 7f3614ffd640 1 -- start start 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3610069db0 0x7f36101452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f361015ac00 0x7f3610157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36100c42c0 con 0x7f361015a820 2023-08-10T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36100c45a0 con 0x7f361015ac00 2023-08-10T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.509+0000 7f3614ffd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100c4880 con 0x7f3610069db0 2023-08-10T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44382/0 (socket says 172.21.15.50:44382) 2023-08-10T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 -- 172.21.15.50:0/1472331098 learned_addr learned my addr 172.21.15.50:0/1472331098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 -- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3610069db0 msgr2=0x7f36101452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3610069db0 0x7f36101452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 -- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f361015ac00 msgr2=0x7f3610157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f361015ac00 0x7f3610157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.510+0000 7f360dd9b640 1 -- 172.21.15.50:0/1472331098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040094d0 con 0x7f361015a820 2023-08-10T10:44:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f360dd9b640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f360402b8c0 tx=0x7f36040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604032880 con 0x7f361015a820 2023-08-10T10:44:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36040329e0 con 0x7f361015a820 2023-08-10T10:44:21.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100c4b60 con 0x7f361015a820 2023-08-10T10:44:21.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604032d90 con 0x7f361015a820 2023-08-10T10:44:21.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.511+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36100c3ee0 con 0x7f361015a820 2023-08-10T10:44:21.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.512+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36100c4da0 con 0x7f361015a820 2023-08-10T10:44:21.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.513+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f360404d3f0 con 0x7f361015a820 2023-08-10T10:44:21.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.515+0000 7f35feffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 0x7f35f006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.515+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f36040ab370 con 0x7f361015a820 2023-08-10T10:44:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.515+0000 7f360e59c640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 0x7f35f006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.516+0000 7f360e59c640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 0x7f35f006d160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3600001560 tx=0x7f3600007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.519+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f36100c4da0 con 0x7f361015a820 2023-08-10T10:44:21.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:21.752+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f36100c4da0 con 0x7f361015a820 2023-08-10T10:44:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.249+0000 7f35feffd640 1 -- 172.21.15.50:0/1472331098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f36100c4da0 con 0x7f361015a820 2023-08-10T10:44:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 msgr2=0x7f35f006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 0x7f35f006d160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3600001560 tx=0x7f3600007990 comp rx=0 tx=0).stop 2023-08-10T10:44:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 msgr2=0x7f36100c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f360402b8c0 tx=0x7f36040046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 shutdown_connections 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f35f006aca0 0x7f35f006d160 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f361015ac00 0x7f3610157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015a820 0x7f36100c2200 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 --2- 172.21.15.50:0/1472331098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3610069db0 0x7f36101452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.253+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 >> 172.21.15.50:0/1472331098 conn(0x7f36100b08e0 msgr2=0x7f361006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.254+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 shutdown_connections 2023-08-10T10:44:22.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.254+0000 7f3614ffd640 1 -- 172.21.15.50:0/1472331098 wait complete. 2023-08-10T10:44:22.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:44:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.517+0000 7f8c36f42640 1 Processor -- start 2023-08-10T10:44:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.517+0000 7f8c36f42640 1 -- start start 2023-08-10T10:44:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c36f42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c3006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c36f42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3015bcb0 con 0x7f8c3015a820 2023-08-10T10:44:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c36f42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3015b0a0 con 0x7f8c3015ac00 2023-08-10T10:44:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c36f42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c5540 con 0x7f8c30069db0 2023-08-10T10:44:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c34cde640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c3015a820 0x7f8c300696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46046/0 (socket says 172.21.15.50:46046) 2023-08-10T10:44:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c34cde640 1 -- 172.21.15.50:0/2483795082 learned_addr learned my addr 172.21.15.50:0/2483795082 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c354df640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c3006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.519+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654079384 0 0) 0x7f8c3015bcb0 con 0x7f8c3015a820 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c20003520 con 0x7f8c3015a820 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1825037819 0 0) 0x7f8c20003520 con 0x7f8c3015a820 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 msgr2=0x7f8c3006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c3006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 >> v1:172.21.15.117:6789/0 conn(0x7f8c3015ac00 legacy=0x7f8c300cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3015b380 con 0x7f8c3015a820 2023-08-10T10:44:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f8c24001670 con 0x7f8c3015a820 2023-08-10T10:44:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 >> v1:172.21.15.50:6789/0 conn(0x7f8c3015a820 legacy=0x7f8c300696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c200039a0 0x7f8c20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c20004d00 0x7f8c20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c5540 con 0x7f8c200039a0 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2000ba60 con 0x7f8c20004d00 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2000bc20 con 0x7f8c30069db0 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.520+0000 7f8c34cde640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c200039a0 0x7f8c20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c354df640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c20004d00 0x7f8c20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c2ffff640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c34cde640 1 -- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 msgr2=0x7f8c200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c34cde640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c30069db0 0x7f8c200047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c34cde640 1 -- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c20004d00 msgr2=0x7f8c20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c34cde640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c20004d00 0x7f8c20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c34cde640 1 -- 172.21.15.50:0/2483795082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20003520 con 0x7f8c200039a0 2023-08-10T10:44:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.521+0000 7f8c354df640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c20004d00 0x7f8c20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.522+0000 7f8c34cde640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c200039a0 0x7f8c20003dc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c210 tx=0x7f8c200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85427b768a67a7fd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.522+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24005ad0 con 0x7f8c200039a0 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.522+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24005c30 con 0x7f8c200039a0 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.522+0000 7f8c2f7fe640 1 -- 172.21.15.50:0/2483795082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2402c890 con 0x7f8c200039a0 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 -- 172.21.15.50:0/2483795082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c200039a0 msgr2=0x7f8c20003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 --2- 172.21.15.50:0/2483795082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c200039a0 0x7f8c20003dc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c210 tx=0x7f8c200057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c354df640 1 -- 172.21.15.50:0/2483795082 reap_dead start 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 -- 172.21.15.50:0/2483795082 shutdown_connections 2023-08-10T10:44:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 -- 172.21.15.50:0/2483795082 >> 172.21.15.50:0/2483795082 conn(0x7f8c300b08e0 msgr2=0x7f8c300ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 -- 172.21.15.50:0/2483795082 shutdown_connections 2023-08-10T10:44:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.523+0000 7f8c36f42640 1 -- 172.21.15.50:0/2483795082 wait complete. 2023-08-10T10:44:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.525+0000 7f8c36f42640 1 Processor -- start 2023-08-10T10:44:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.526+0000 7f8c36f42640 1 -- start start 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c200039a0 0x7f8c301f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 0x7f8c300adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30070830 con 0x7f8c3006fe70 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300aff60 con 0x7f8c30155b00 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c36f42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300ae090 con 0x7f8c200039a0 2023-08-10T10:44:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c354df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c354df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44398/0 (socket says 172.21.15.50:44398) 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.527+0000 7f8c354df640 1 -- 172.21.15.50:0/335450685 learned_addr learned my addr 172.21.15.50:0/335450685 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c34cde640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c200039a0 0x7f8c301f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c2ffff640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 0x7f8c300adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 -- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c200039a0 msgr2=0x7f8c301f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c200039a0 0x7f8c301f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 -- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 msgr2=0x7f8c300adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 0x7f8c300adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 -- 172.21.15.50:0/335450685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c300acbd0 con 0x7f8c3006fe70 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c2ffff640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 0x7f8c300adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c354df640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8c3015bc60 tx=0x7f8c2800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.528+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28017400 con 0x7f8c3006fe70 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.529+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28011040 con 0x7f8c3006fe70 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.529+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28017780 con 0x7f8c3006fe70 2023-08-10T10:44:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.529+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c300ace80 con 0x7f8c3006fe70 2023-08-10T10:44:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.529+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c300afa40 con 0x7f8c3006fe70 2023-08-10T10:44:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.530+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300afc30 con 0x7f8c3006fe70 2023-08-10T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.531+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c280203b0 con 0x7f8c3006fe70 2023-08-10T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.532+0000 7f8c2d7fa640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 0x7f8c1406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.532+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8c280897d0 con 0x7f8c3006fe70 2023-08-10T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.532+0000 7f8c34cde640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 0x7f8c1406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.533+0000 7f8c34cde640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 0x7f8c1406d140 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034000 tx=0x7f8c24009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.536+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c28054810 con 0x7f8c3006fe70 2023-08-10T10:44:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:22.729+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c3004e270 con 0x7f8c3006fe70 2023-08-10T10:44:23.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.255+0000 7f8c2d7fa640 1 -- 172.21.15.50:0/335450685 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8c28057e30 con 0x7f8c3006fe70 2023-08-10T10:44:23.256 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:44:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 msgr2=0x7f8c1406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 0x7f8c1406d140 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034000 tx=0x7f8c24009030 comp rx=0 tx=0).stop 2023-08-10T10:44:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 msgr2=0x7f8c300702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8c3015bc60 tx=0x7f8c2800f4a0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 shutdown_connections 2023-08-10T10:44:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c3006fe70 0x7f8c300702f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c1406ac80 0x7f8c1406d140 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c30155b00 0x7f8c300adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 --2- 172.21.15.50:0/335450685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c200039a0 0x7f8c301f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.259+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 >> 172.21.15.50:0/335450685 conn(0x7f8c300b08e0 msgr2=0x7f8c300ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.260+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 shutdown_connections 2023-08-10T10:44:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.260+0000 7f8c36f42640 1 -- 172.21.15.50:0/335450685 wait complete. 2023-08-10T10:44:23.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:44:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.520+0000 7f266f064640 1 Processor -- start 2023-08-10T10:44:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.520+0000 7f266f064640 1 -- start start 2023-08-10T10:44:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.522+0000 7f266f064640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f266815cbe0 0x7f26680d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.522+0000 7f266f064640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680b4c10 0x7f26680b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.522+0000 7f266f064640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680d20d0 con 0x7f26680d2560 2023-08-10T10:44:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.522+0000 7f266f064640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266815cfc0 con 0x7f266815cbe0 2023-08-10T10:44:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.522+0000 7f266f064640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26680d14c0 con 0x7f26680b4c10 2023-08-10T10:44:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f2667fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26680d2560 0x7f26680b4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46060/0 (socket says 172.21.15.50:46060) 2023-08-10T10:44:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f2667fff640 1 -- 172.21.15.50:0/3165917579 learned_addr learned my addr 172.21.15.50:0/3165917579 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f266ce00640 1 --2- 172.21.15.50:0/3165917579 >> v2:172.21.15.117:3300/0 conn(0x7f266815cbe0 0x7f26680d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f266d601640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680b4c10 0x7f26680b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f26677fe640 1 -- 172.21.15.50:0/3165917579 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158277391 0 0) 0x7f26680d20d0 con 0x7f26680d2560 2023-08-10T10:44:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.523+0000 7f26677fe640 1 -- 172.21.15.50:0/3165917579 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003520 con 0x7f26680d2560 2023-08-10T10:44:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.524+0000 7f266ce00640 1 -- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680b4c10 msgr2=0x7f26680b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.524+0000 7f266ce00640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680b4c10 0x7f26680b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.524+0000 7f266ce00640 1 -- 172.21.15.50:0/3165917579 >> v1:172.21.15.50:6789/0 conn(0x7f26680d2560 legacy=0x7f26680b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.524+0000 7f266ce00640 1 -- 172.21.15.50:0/3165917579 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680d17a0 con 0x7f266815cbe0 2023-08-10T10:44:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.525+0000 7f266ce00640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266815cbe0 0x7f26680d0bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097a0 tx=0x7f265c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e08aa677db695a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.525+0000 7f26677fe640 1 -- 172.21.15.50:0/3165917579 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c030610 con 0x7f266815cbe0 2023-08-10T10:44:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f26677fe640 1 -- 172.21.15.50:0/3165917579 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c030770 con 0x7f266815cbe0 2023-08-10T10:44:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f26677fe640 1 -- 172.21.15.50:0/3165917579 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c030ae0 con 0x7f266815cbe0 2023-08-10T10:44:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 -- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266815cbe0 msgr2=0x7f26680d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266815cbe0 0x7f26680d0bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097a0 tx=0x7f265c02b960 comp rx=0 tx=0).stop 2023-08-10T10:44:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 -- 172.21.15.50:0/3165917579 shutdown_connections 2023-08-10T10:44:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680b4c10 0x7f26680b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 --2- 172.21.15.50:0/3165917579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266815cbe0 0x7f26680d0bc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 -- 172.21.15.50:0/3165917579 >> 172.21.15.50:0/3165917579 conn(0x7f26680702f0 msgr2=0x7f26680d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 -- 172.21.15.50:0/3165917579 shutdown_connections 2023-08-10T10:44:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.526+0000 7f266f064640 1 -- 172.21.15.50:0/3165917579 wait complete. 2023-08-10T10:44:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.528+0000 7f266f064640 1 Processor -- start 2023-08-10T10:44:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.528+0000 7f266f064640 1 -- start start 2023-08-10T10:44:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26680b4c10 0x7f26680c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 0x7f2668155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2668155f90 con 0x7f266815cbe0 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680c9ac0 con 0x7f26680b4c10 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266f064640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2668156e10 con 0x7f26680d2560 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44408/0 (socket says 172.21.15.50:44408) 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 -- 172.21.15.50:0/1804211169 learned_addr learned my addr 172.21.15.50:0/1804211169 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266ce00640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26680b4c10 0x7f26680c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f2667fff640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 0x7f2668155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 -- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 msgr2=0x7f2668155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 0x7f2668155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 -- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26680b4c10 msgr2=0x7f26680c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.530+0000 7f266d601640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26680b4c10 0x7f26680c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f266d601640 1 -- 172.21.15.50:0/1804211169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009400 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f2667fff640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 0x7f2668155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f266d601640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f266000efc0 tx=0x7f266000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660009ca0 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000f040 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26600146c0 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2668156190 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.531+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2668156750 con 0x7f266815cbe0 2023-08-10T10:44:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.533+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2668156fc0 con 0x7f266815cbe0 2023-08-10T10:44:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.534+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2660014820 con 0x7f266815cbe0 2023-08-10T10:44:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.535+0000 7f26657fa640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 0x7f264c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.535+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f266008a2f0 con 0x7f266815cbe0 2023-08-10T10:44:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.535+0000 7f266ce00640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 0x7f264c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.536+0000 7f266ce00640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 0x7f264c06d110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f265c036000 tx=0x7f265c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.540+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2668156fc0 con 0x7f266815cbe0 2023-08-10T10:44:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:23.736+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2668156f80 con 0x7f266815cbe0 2023-08-10T10:44:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.271+0000 7f26657fa640 1 -- 172.21.15.50:0/1804211169 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2660058ef0 con 0x7f266815cbe0 2023-08-10T10:44:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:44:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 msgr2=0x7f264c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 0x7f264c06d110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f265c036000 tx=0x7f265c008030 comp rx=0 tx=0).stop 2023-08-10T10:44:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 msgr2=0x7f2668155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f266000efc0 tx=0x7f266000c490 comp rx=0 tx=0).stop 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 shutdown_connections 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266815cbe0 0x7f2668155a50 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26680d2560 0x7f2668155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f264c06ac50 0x7f264c06d110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 --2- 172.21.15.50:0/1804211169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26680b4c10 0x7f26680c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.275+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 >> 172.21.15.50:0/1804211169 conn(0x7f26680702f0 msgr2=0x7f26680b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.276+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 shutdown_connections 2023-08-10T10:44:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.276+0000 7f266f064640 1 -- 172.21.15.50:0/1804211169 wait complete. 2023-08-10T10:44:24.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:44:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.536+0000 7fae0b253640 1 Processor -- start 2023-08-10T10:44:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.536+0000 7fae0b253640 1 -- start start 2023-08-10T10:44:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.537+0000 7fae0b253640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae0415a820 0x7fae0406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.537+0000 7fae0b253640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0415bcb0 con 0x7fae04069db0 2023-08-10T10:44:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.537+0000 7fae0b253640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0415b0a0 con 0x7fae0415ac00 2023-08-10T10:44:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.537+0000 7fae0b253640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040c5540 con 0x7fae0415a820 2023-08-10T10:44:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae0415a820 0x7fae0406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae0415a820 0x7fae0406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44418/0 (socket says 172.21.15.50:44418) 2023-08-10T10:44:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 -- 172.21.15.50:0/2927814368 learned_addr learned my addr 172.21.15.50:0/2927814368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 -- 172.21.15.50:0/2927814368 >> v1:172.21.15.117:6789/0 conn(0x7fae0415ac00 legacy=0x7fae040696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 -- 172.21.15.50:0/2927814368 >> v1:172.21.15.50:6789/0 conn(0x7fae04069db0 legacy=0x7fae040cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.538+0000 7fae08fef640 1 -- 172.21.15.50:0/2927814368 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0415b380 con 0x7fae0415a820 2023-08-10T10:44:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.539+0000 7fae08fef640 1 --2- 172.21.15.50:0/2927814368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae0406c180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009870 tx=0x7fadf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4780c1180e0868e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae037fe640 1 -- 172.21.15.50:0/2927814368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8031870 con 0x7fae0415a820 2023-08-10T10:44:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae037fe640 1 -- 172.21.15.50:0/2927814368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80319d0 con 0x7fae0415a820 2023-08-10T10:44:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae037fe640 1 -- 172.21.15.50:0/2927814368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8031d60 con 0x7fae0415a820 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae0b253640 1 -- 172.21.15.50:0/2927814368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 msgr2=0x7fae0406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae0b253640 1 --2- 172.21.15.50:0/2927814368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae0406c180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009870 tx=0x7fadf802b910 comp rx=0 tx=0).stop 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae0b253640 1 -- 172.21.15.50:0/2927814368 shutdown_connections 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae0b253640 1 --2- 172.21.15.50:0/2927814368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae0406c180 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.540+0000 7fae0b253640 1 -- 172.21.15.50:0/2927814368 >> 172.21.15.50:0/2927814368 conn(0x7fae040b08e0 msgr2=0x7fae040ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.541+0000 7fae0b253640 1 -- 172.21.15.50:0/2927814368 shutdown_connections 2023-08-10T10:44:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.541+0000 7fae0b253640 1 -- 172.21.15.50:0/2927814368 wait complete. 2023-08-10T10:44:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.542+0000 7fae0b253640 1 Processor -- start 2023-08-10T10:44:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.542+0000 7fae0b253640 1 -- start start 2023-08-10T10:44:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 0x7fae040b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0415ac00 0x7fae040c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040b31e0 con 0x7fae0415a820 2023-08-10T10:44:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040b1260 con 0x7fae04069db0 2023-08-10T10:44:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.543+0000 7fae0b253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040b1540 con 0x7fae0415ac00 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44422/0 (socket says 172.21.15.50:44422) 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 -- 172.21.15.50:0/652479319 learned_addr learned my addr 172.21.15.50:0/652479319 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 -- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0415ac00 msgr2=0x7fae040c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae097f0640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0415ac00 0x7fae040c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0415ac00 0x7fae040c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 -- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 msgr2=0x7fae040b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae08fef640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 0x7fae040b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 0x7fae040b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae03fff640 1 -- 172.21.15.50:0/652479319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80094d0 con 0x7fae0415a820 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.544+0000 7fae08fef640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 0x7fae040b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae03fff640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b3f0 tx=0x7fadf000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011830 con 0x7fae0415a820 2023-08-10T10:44:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0011990 con 0x7fae0415a820 2023-08-10T10:44:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011d40 con 0x7fae0415a820 2023-08-10T10:44:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae040b1820 con 0x7fae0415a820 2023-08-10T10:44:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.545+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae040c4680 con 0x7fae0415a820 2023-08-10T10:44:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.546+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0404e270 con 0x7fae0415a820 2023-08-10T10:44:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.547+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadf001a400 con 0x7fae0415a820 2023-08-10T10:44:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.548+0000 7fae017fa640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 0x7fade806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.548+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fadf0089110 con 0x7fae0415a820 2023-08-10T10:44:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.548+0000 7fae08fef640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 0x7fade806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.549+0000 7fae08fef640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 0x7fade806d110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fadf8036000 tx=0x7fadf803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.552+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fadf0054440 con 0x7fae0415a820 2023-08-10T10:44:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.753+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fae0415b630 con 0x7fae0415a820 2023-08-10T10:44:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.761+0000 7fae017fa640 1 -- 172.21.15.50:0/652479319 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadf0057a60 con 0x7fae0415a820 2023-08-10T10:44:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 msgr2=0x7fade806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 0x7fade806d110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fadf8036000 tx=0x7fadf803c040 comp rx=0 tx=0).stop 2023-08-10T10:44:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 msgr2=0x7fae041533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b3f0 tx=0x7fadf000b8b0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 shutdown_connections 2023-08-10T10:44:24.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0415ac00 0x7fae040c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae0415a820 0x7fae041533d0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fade806ac50 0x7fade806d110 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 --2- 172.21.15.50:0/652479319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae04069db0 0x7fae040b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:24.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 >> 172.21.15.50:0/652479319 conn(0x7fae040b08e0 msgr2=0x7fae0406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:24.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 shutdown_connections 2023-08-10T10:44:24.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:24.764+0000 7fae0b253640 1 -- 172.21.15.50:0/652479319 wait complete. 2023-08-10T10:44:24.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-08-10T10:44:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.013+0000 7f13d4d79640 1 Processor -- start 2023-08-10T10:44:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.013+0000 7f13d4d79640 1 -- start start 2023-08-10T10:44:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13d4d79640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13d00b3010 0x7f13d00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13d4d79640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00719f0 con 0x7f13d00c9b30 2023-08-10T10:44:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13d4d79640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00c8db0 con 0x7f13d015ccb0 2023-08-10T10:44:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13d4d79640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00c9050 con 0x7f13d00b3010 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13cdd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13d00b3010 0x7f13d00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13ced9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13d00c9b30 0x7f13d006ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50186/0 (socket says 172.21.15.50:50186) 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.015+0000 7f13ced9d640 1 -- 172.21.15.50:0/487751750 learned_addr learned my addr 172.21.15.50:0/487751750 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.016+0000 7f13cdd9b640 1 -- 172.21.15.50:0/487751750 >> v1:172.21.15.117:6789/0 conn(0x7f13d015ccb0 legacy=0x7f13d00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.016+0000 7f13cdd9b640 1 -- 172.21.15.50:0/487751750 >> v1:172.21.15.50:6789/0 conn(0x7f13d00c9b30 legacy=0x7f13d006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.016+0000 7f13cd59a640 1 -- 172.21.15.50:0/487751750 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465860419 0 0) 0x7f13d00719f0 con 0x7f13d00c9b30 2023-08-10T10:44:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.016+0000 7f13cdd9b640 1 -- 172.21.15.50:0/487751750 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00c9330 con 0x7f13d00b3010 2023-08-10T10:44:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.017+0000 7f13cdd9b640 1 --2- 172.21.15.50:0/487751750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d00b3010 0x7f13d00696a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009d90 tx=0x7f13c402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69660dabb0bdf61 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.017+0000 7f13cd59a640 1 -- 172.21.15.50:0/487751750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c402cc60 con 0x7f13d00b3010 2023-08-10T10:44:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.017+0000 7f13cd59a640 1 -- 172.21.15.50:0/487751750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c402cdc0 con 0x7f13d00b3010 2023-08-10T10:44:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.017+0000 7f13cd59a640 1 -- 172.21.15.50:0/487751750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4034660 con 0x7f13d00b3010 2023-08-10T10:44:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 -- 172.21.15.50:0/487751750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d00b3010 msgr2=0x7f13d00696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 --2- 172.21.15.50:0/487751750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d00b3010 0x7f13d00696a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009d90 tx=0x7f13c402beb0 comp rx=0 tx=0).stop 2023-08-10T10:44:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 -- 172.21.15.50:0/487751750 shutdown_connections 2023-08-10T10:44:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 --2- 172.21.15.50:0/487751750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d00b3010 0x7f13d00696a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 -- 172.21.15.50:0/487751750 >> 172.21.15.50:0/487751750 conn(0x7f13d006b590 msgr2=0x7f13d00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 -- 172.21.15.50:0/487751750 shutdown_connections 2023-08-10T10:44:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.018+0000 7f13d4d79640 1 -- 172.21.15.50:0/487751750 wait complete. 2023-08-10T10:44:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.020+0000 7f13d4d79640 1 Processor -- start 2023-08-10T10:44:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.020+0000 7f13d4d79640 1 -- start start 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13d00b3010 0x7f13d0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13d00c9b30 0x7f13d00c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00c3f90 con 0x7f13d015ccb0 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00c30c0 con 0x7f13d00b3010 2023-08-10T10:44:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.021+0000 7f13d4d79640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0158130 con 0x7f13d00c9b30 2023-08-10T10:44:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44106/0 (socket says 172.21.15.50:44106) 2023-08-10T10:44:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 -- 172.21.15.50:0/1560393462 learned_addr learned my addr 172.21.15.50:0/1560393462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ce59c640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13d00b3010 0x7f13d0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13cdd9b640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13d00c9b30 0x7f13d00c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 -- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13d00c9b30 msgr2=0x7f13d00c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13d00c9b30 0x7f13d00c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 -- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13d00b3010 msgr2=0x7f13d0157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13d00b3010 0x7f13d0157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 -- 172.21.15.50:0/1560393462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009a70 con 0x7f13d015ccb0 2023-08-10T10:44:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.022+0000 7f13ced9d640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c480 tx=0x7f13c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.023+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8005ce0 con 0x7f13d015ccb0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.023+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8005e40 con 0x7f13d015ccb0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.023+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8007290 con 0x7f13d015ccb0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.023+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00c3310 con 0x7f13d015ccb0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.023+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d00c38d0 con 0x7f13d015ccb0 2023-08-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.024+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d00c40d0 con 0x7f13d015ccb0 2023-08-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.025+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13c80074b0 con 0x7f13d015ccb0 2023-08-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.026+0000 7f13beffd640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 0x7f13b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.027+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13c8088ce0 con 0x7f13d015ccb0 2023-08-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.027+0000 7f13ce59c640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 0x7f13b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.027+0000 7f13ce59c640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 0x7f13b006d110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006fd0 tx=0x7f13c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:25.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.031+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13d00c40d0 con 0x7f13d015ccb0 2023-08-10T10:44:25.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:25.292+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f13d00c40d0 con 0x7f13d015ccb0 2023-08-10T10:44:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.284+0000 7f13beffd640 1 -- 172.21.15.50:0/1560393462 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v322) v1 ==== 133+0+0 (secure 0 0 0) 0x7f13d00c40d0 con 0x7f13d015ccb0 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 msgr2=0x7f13b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 0x7f13b006d110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006fd0 tx=0x7f13c0008040 comp rx=0 tx=0).stop 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 msgr2=0x7f13d015fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c480 tx=0x7f13c800c940 comp rx=0 tx=0).stop 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 shutdown_connections 2023-08-10T10:44:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13d015ccb0 0x7f13d015fbb0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13d00c9b30 0x7f13d00c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13b006ac50 0x7f13b006d110 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 --2- 172.21.15.50:0/1560393462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13d00b3010 0x7f13d0157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.288+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 >> 172.21.15.50:0/1560393462 conn(0x7f13d006b590 msgr2=0x7f13d015a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.289+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 shutdown_connections 2023-08-10T10:44:26.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.289+0000 7f13d4d79640 1 -- 172.21.15.50:0/1560393462 wait complete. 2023-08-10T10:44:26.312 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-10T10:44:26.313 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-08-10T10:44:26.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-08-10T10:44:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.555+0000 7fc9f1c94640 1 Processor -- start 2023-08-10T10:44:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.555+0000 7fc9f1c94640 1 -- start start 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9f1c94640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9ec15aa40 0x7fc9ec0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9f1c94640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 0x7fc9ec0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9f1c94640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec071c70 con 0x7fc9ec070e80 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9f1c94640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0713d0 con 0x7fc9ec15aa40 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9f1c94640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0716b0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9eb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9ec15aa40 0x7fc9ec0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9eb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9ec15aa40 0x7fc9ec0b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44120/0 (socket says 172.21.15.50:44120) 2023-08-10T10:44:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.557+0000 7fc9eb7fe640 1 -- 172.21.15.50:0/285275559 learned_addr learned my addr 172.21.15.50:0/285275559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eaffd640 1 --2- 172.21.15.50:0/285275559 >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 0x7fc9ec0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eb7fe640 1 -- 172.21.15.50:0/285275559 >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 msgr2=0x7fc9ec0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eb7fe640 1 --2- 172.21.15.50:0/285275559 >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 0x7fc9ec0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eb7fe640 1 -- 172.21.15.50:0/285275559 >> v1:172.21.15.50:6789/0 conn(0x7fc9ec070e80 legacy=0x7fc9ec0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eb7fe640 1 -- 172.21.15.50:0/285275559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec071990 con 0x7fc9ec15aa40 2023-08-10T10:44:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.558+0000 7fc9eaffd640 1 --2- 172.21.15.50:0/285275559 >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 0x7fc9ec0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:26.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.559+0000 7fc9eb7fe640 1 --2- 172.21.15.50:0/285275559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec0b3820 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec15e6e0 tx=0x7fc9dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98939634a088f25f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:26.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9ea7fc640 1 -- 172.21.15.50:0/285275559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc031870 con 0x7fc9ec15aa40 2023-08-10T10:44:26.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9ea7fc640 1 -- 172.21.15.50:0/285275559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0319d0 con 0x7fc9ec15aa40 2023-08-10T10:44:26.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9ea7fc640 1 -- 172.21.15.50:0/285275559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc031d60 con 0x7fc9ec15aa40 2023-08-10T10:44:26.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 -- 172.21.15.50:0/285275559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec15aa40 msgr2=0x7fc9ec0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/285275559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec0b3820 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec15e6e0 tx=0x7fc9dc02b910 comp rx=0 tx=0).stop 2023-08-10T10:44:26.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 -- 172.21.15.50:0/285275559 shutdown_connections 2023-08-10T10:44:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/285275559 >> v2:172.21.15.117:3300/0 conn(0x7fc9ec0b0c60 0x7fc9ec0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/285275559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec0b3820 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 -- 172.21.15.50:0/285275559 >> 172.21.15.50:0/285275559 conn(0x7fc9ec06b590 msgr2=0x7fc9ec0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 -- 172.21.15.50:0/285275559 shutdown_connections 2023-08-10T10:44:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.560+0000 7fc9f1c94640 1 -- 172.21.15.50:0/285275559 wait complete. 2023-08-10T10:44:26.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.562+0000 7fc9f1c94640 1 Processor -- start 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.562+0000 7fc9f1c94640 1 -- start start 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ec070e80 0x7fc9ec15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c4cd0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec15dc00 con 0x7fc9ec15aa40 2023-08-10T10:44:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.563+0000 7fc9f1c94640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec15d0c0 con 0x7fc9ec070e80 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44126/0 (socket says 172.21.15.50:44126) 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 -- 172.21.15.50:0/1872853370 learned_addr learned my addr 172.21.15.50:0/1872853370 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eb7fe640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ec070e80 0x7fc9ec15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9ebfff640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 -- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ec070e80 msgr2=0x7fc9ec15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ec070e80 0x7fc9ec15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 -- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 msgr2=0x7fc9ec148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:26.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:26.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9eaffd640 1 -- 172.21.15.50:0/1872853370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0094d0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.564+0000 7fc9ebfff640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9eaffd640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c7f0 tx=0x7fc9e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00079d0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0007b30 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000ce40 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec15d360 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.565+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec15d920 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.566+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec066390 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.567+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9e00113f0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.568+0000 7fc9d3fff640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 0x7fc9d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:26.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.568+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc9e00892c0 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.568+0000 7fc9eb7fe640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 0x7fc9d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:26.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.569+0000 7fc9eb7fe640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 0x7fc9d806d110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc036000 tx=0x7fc9dc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:26.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.573+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9e0054680 con 0x7fc9ec0b0c60 2023-08-10T10:44:26.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:26.841+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fc9ec04e270 con 0x7fc9ec0b0c60 2023-08-10T10:44:27.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.294+0000 7fc9d3fff640 1 -- 172.21.15.50:0/1872853370 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v323) v1 ==== 140+0+0 (secure 0 0 0) 0x7fc9e0057ca0 con 0x7fc9ec0b0c60 2023-08-10T10:44:27.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.297+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 msgr2=0x7fc9d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.297+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 0x7fc9d806d110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc036000 tx=0x7fc9dc03c040 comp rx=0 tx=0).stop 2023-08-10T10:44:27.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.297+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 msgr2=0x7fc9ec148930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.297+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c7f0 tx=0x7fc9e000cbf0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 shutdown_connections 2023-08-10T10:44:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d806ac50 0x7fc9d806d110 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ec15aa40 0x7fc9ec148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9ec0b0c60 0x7fc9ec148930 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 --2- 172.21.15.50:0/1872853370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ec070e80 0x7fc9ec15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 >> 172.21.15.50:0/1872853370 conn(0x7fc9ec06b590 msgr2=0x7fc9ec06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 shutdown_connections 2023-08-10T10:44:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.298+0000 7fc9f1c94640 1 -- 172.21.15.50:0/1872853370 wait complete. 2023-08-10T10:44:27.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-10T10:44:27.568 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_objectstore":"memstore"} 2023-08-10T10:44:27.569 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-10T10:44:27.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.800+0000 7fe6a0fd6640 1 Processor -- start 2023-08-10T10:44:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.801+0000 7fe6a0fd6640 1 -- start start 2023-08-10T10:44:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.802+0000 7fe6a0fd6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe69c153850 0x7fe69c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.802+0000 7fe6a0fd6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c15d010 con 0x7fe69c153c30 2023-08-10T10:44:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.802+0000 7fe6a0fd6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c15d290 con 0x7fe69c0cfd40 2023-08-10T10:44:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.802+0000 7fe6a0fd6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c15d570 con 0x7fe69c153850 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.803+0000 7fe69affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe69c153c30 0x7fe69c0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50212/0 (socket says 172.21.15.50:50212) 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.803+0000 7fe69affd640 1 -- 172.21.15.50:0/2172941933 learned_addr learned my addr 172.21.15.50:0/2172941933 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.803+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/2172941933 >> v2:172.21.15.117:3300/0 conn(0x7fe69c153850 0x7fe69c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.803+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917427542 0 0) 0x7fe69c15d010 con 0x7fe69c153c30 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.803+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe684003520 con 0x7fe69c153c30 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075672040 0 0) 0x7fe684003520 con 0x7fe69c153c30 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 >> v2:172.21.15.117:3300/0 conn(0x7fe69c153850 msgr2=0x7fe69c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 --2- 172.21.15.50:0/2172941933 >> v2:172.21.15.117:3300/0 conn(0x7fe69c153850 0x7fe69c0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 >> v1:172.21.15.117:6789/0 conn(0x7fe69c0cfd40 legacy=0x7fe69c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c15d850 con 0x7fe69c153c30 2023-08-10T10:44:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe690001690 con 0x7fe69c153c30 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 >> v1:172.21.15.50:6789/0 conn(0x7fe69c153c30 legacy=0x7fe69c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6840039e0 0x7fe684003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6840047c0 0x7fe684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 0x7fe68400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15d570 con 0x7fe684005180 2023-08-10T10:44:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400c0b0 con 0x7fe6840039e0 2023-08-10T10:44:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400c270 con 0x7fe6840047c0 2023-08-10T10:44:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69bfff640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 0x7fe68400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69bfff640 1 -- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6840047c0 msgr2=0x7fe684004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69affd640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6840047c0 0x7fe684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6840039e0 0x7fe684003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69bfff640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6840047c0 0x7fe684004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.804+0000 7fe69bfff640 1 -- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6840039e0 msgr2=0x7fe684003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.805+0000 7fe69bfff640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6840039e0 0x7fe684003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.805+0000 7fe69bfff640 1 -- 172.21.15.50:0/2172941933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684003520 con 0x7fe684005180 2023-08-10T10:44:27.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.805+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6840039e0 0x7fe684003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:27.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe69bfff640 1 -- 172.21.15.50:0/2172941933 reap_dead start 2023-08-10T10:44:27.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe69bfff640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 0x7fe68400b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d38a0 tx=0x7fe6840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec14f508f77633e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694003bc0 con 0x7fe684005180 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694003d60 con 0x7fe684005180 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe69a7fc640 1 -- 172.21.15.50:0/2172941933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694005310 con 0x7fe684005180 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 msgr2=0x7fe68400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.806+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 0x7fe68400b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d38a0 tx=0x7fe6840057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.807+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/2172941933 shutdown_connections 2023-08-10T10:44:27.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.807+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/2172941933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684005180 0x7fe68400b980 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.807+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/2172941933 >> 172.21.15.50:0/2172941933 conn(0x7fe69c069880 msgr2=0x7fe69c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.807+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/2172941933 shutdown_connections 2023-08-10T10:44:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.807+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/2172941933 wait complete. 2023-08-10T10:44:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.809+0000 7fe6a0fd6640 1 Processor -- start 2023-08-10T10:44:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.809+0000 7fe6a0fd6640 1 -- start start 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe684005180 0x7fe69c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 0x7fe69c1f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1567b0 con 0x7fe69c150ea0 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15eec0 con 0x7fe69c15ea40 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe6a0fd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0c92a0 con 0x7fe684005180 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44146/0 (socket says 172.21.15.50:44146) 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 -- 172.21.15.50:0/180184105 learned_addr learned my addr 172.21.15.50:0/180184105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe684005180 0x7fe69c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69bfff640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 0x7fe69c1f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 -- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe684005180 msgr2=0x7fe69c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe684005180 0x7fe69c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 -- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 msgr2=0x7fe69c1f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 0x7fe69c1f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69affd640 1 -- 172.21.15.50:0/180184105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0d33a0 con 0x7fe69c150ea0 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.810+0000 7fe69bfff640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 0x7fe69c1f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe69affd640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d7a0 tx=0x7fe69000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900072d0 con 0x7fe69c150ea0 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe690007430 con 0x7fe69c150ea0 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900047e0 con 0x7fe69c150ea0 2023-08-10T10:44:27.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c0d2d90 con 0x7fe69c150ea0 2023-08-10T10:44:27.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.811+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c0d3030 con 0x7fe69c150ea0 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.813+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c0d2bf0 con 0x7fe69c150ea0 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.813+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe690004940 con 0x7fe69c150ea0 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.814+0000 7fe683fff640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 0x7fe68806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.815+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe690088a50 con 0x7fe69c150ea0 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.815+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 0x7fe68806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.815+0000 7fe69b7fe640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 0x7fe68806d140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe69c156930 tx=0x7fe68c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:27.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:27.819+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe69c0d2bf0 con 0x7fe69c150ea0 2023-08-10T10:44:28.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.010+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69c0d2bf0 con 0x7fe69c150ea0 2023-08-10T10:44:28.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.012+0000 7fe683fff640 1 -- 172.21.15.50:0/180184105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+14760 (secure 0 0 0) 0x7fe69c0d2bf0 con 0x7fe69c150ea0 2023-08-10T10:44:28.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:28.014 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":102,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:24.263767+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6834/3885575175":"2023-08-11T10:44:21.239126+0000","172.21.15.117:6832/3885575175":"2023-08-11T10:44:21.239126+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 msgr2=0x7fe68806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 0x7fe68806d140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe69c156930 tx=0x7fe68c008040 comp rx=0 tx=0).stop 2023-08-10T10:44:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 msgr2=0x7fe69c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d7a0 tx=0x7fe69000dba0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 shutdown_connections 2023-08-10T10:44:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe68806ac80 0x7fe68806d140 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c15ea40 0x7fe69c1f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe69c150ea0 0x7fe69c15e500 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 --2- 172.21.15.50:0/180184105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe684005180 0x7fe69c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.014+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 >> 172.21.15.50:0/180184105 conn(0x7fe69c069880 msgr2=0x7fe69c160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.015+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 shutdown_connections 2023-08-10T10:44:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.015+0000 7fe6a0fd6640 1 -- 172.21.15.50:0/180184105 wait complete. 2023-08-10T10:44:28.036 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:44:28.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:44:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.273+0000 7f53d8fd2640 1 Processor -- start 2023-08-10T10:44:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.274+0000 7f53d8fd2640 1 -- start start 2023-08-10T10:44:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.275+0000 7f53d8fd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.275+0000 7f53d8fd2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53d40cd660 0x7f53d40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.275+0000 7f53d8fd2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d406a5c0 con 0x7f53d40b1e00 2023-08-10T10:44:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d8fd2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d406b0c0 con 0x7f53d40cd660 2023-08-10T10:44:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d8fd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d406a820 con 0x7f53d415fde0 2023-08-10T10:44:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53d40cd660 0x7f53d40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53d40cd660 0x7f53d40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44156/0 (socket says 172.21.15.50:44156) 2023-08-10T10:44:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d3fff640 1 -- 172.21.15.50:0/2310127110 learned_addr learned my addr 172.21.15.50:0/2310127110 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.276+0000 7f53d37fe640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.277+0000 7f53d3fff640 1 -- 172.21.15.50:0/2310127110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 msgr2=0x7f53d406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.277+0000 7f53d3fff640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d406a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.277+0000 7f53d3fff640 1 -- 172.21.15.50:0/2310127110 >> v1:172.21.15.117:6789/0 conn(0x7f53d40b1e00 legacy=0x7f53d40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.277+0000 7f53d3fff640 1 -- 172.21.15.50:0/2310127110 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d406ab00 con 0x7f53d40cd660 2023-08-10T10:44:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.278+0000 7f53d3fff640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40d0b20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009e50 tx=0x7f53cc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdd90941908dc39 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.278+0000 7f53d27fc640 1 -- 172.21.15.50:0/2310127110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02c9f0 con 0x7f53d40cd660 2023-08-10T10:44:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.278+0000 7f53d27fc640 1 -- 172.21.15.50:0/2310127110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc02cb50 con 0x7f53d40cd660 2023-08-10T10:44:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.278+0000 7f53d27fc640 1 -- 172.21.15.50:0/2310127110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0343f0 con 0x7f53d40cd660 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 -- 172.21.15.50:0/2310127110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 msgr2=0x7f53d40d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40d0b20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009e50 tx=0x7f53cc02be50 comp rx=0 tx=0).stop 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 -- 172.21.15.50:0/2310127110 shutdown_connections 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40d0b20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/2310127110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d406a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 -- 172.21.15.50:0/2310127110 >> 172.21.15.50:0/2310127110 conn(0x7f53d40d2900 msgr2=0x7f53d40d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 -- 172.21.15.50:0/2310127110 shutdown_connections 2023-08-10T10:44:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.279+0000 7f53d8fd2640 1 -- 172.21.15.50:0/2310127110 wait complete. 2023-08-10T10:44:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.281+0000 7f53d8fd2640 1 Processor -- start 2023-08-10T10:44:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.281+0000 7f53d8fd2640 1 -- start start 2023-08-10T10:44:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53d40b1e00 0x7f53d41497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d414a9b0 con 0x7f53d40cd660 2023-08-10T10:44:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40a9820 con 0x7f53d40b1e00 2023-08-10T10:44:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d8fd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4149da0 con 0x7f53d415fde0 2023-08-10T10:44:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.282+0000 7f53d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44158/0 (socket says 172.21.15.50:44158) 2023-08-10T10:44:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 -- 172.21.15.50:0/1614521847 learned_addr learned my addr 172.21.15.50:0/1614521847 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d37fe640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53d40b1e00 0x7f53d41497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d3fff640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 -- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 msgr2=0x7f53d415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 -- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53d40b1e00 msgr2=0x7f53d41497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53d40b1e00 0x7f53d41497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 -- 172.21.15.50:0/1614521847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009b30 con 0x7f53d40cd660 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.283+0000 7f53d2ffd640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f53c800c390 tx=0x7f53c800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.284+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80052d0 con 0x7f53d40cd660 2023-08-10T10:44:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.284+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8005430 con 0x7f53d40cd660 2023-08-10T10:44:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.284+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8003830 con 0x7f53d40cd660 2023-08-10T10:44:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.284+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d414a080 con 0x7f53d40cd660 2023-08-10T10:44:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.284+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d414a640 con 0x7f53d40cd660 2023-08-10T10:44:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.285+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d4066e30 con 0x7f53d40cd660 2023-08-10T10:44:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.286+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53c8003990 con 0x7f53d40cd660 2023-08-10T10:44:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.287+0000 7f53bbfff640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 0x7f53c006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.287+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f53c8088700 con 0x7f53d40cd660 2023-08-10T10:44:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.287+0000 7f53d37fe640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 0x7f53c006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.288+0000 7f53d37fe640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 0x7f53c006d110 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006fd0 tx=0x7f53c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.292+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53c8053ac0 con 0x7f53d40cd660 2023-08-10T10:44:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.482+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53d40d3730 con 0x7f53d40cd660 2023-08-10T10:44:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.483+0000 7f53bbfff640 1 -- 172.21.15.50:0/1614521847 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53c8088020 con 0x7f53d40cd660 2023-08-10T10:44:28.485 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:44:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 msgr2=0x7f53c006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 0x7f53c006d110 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006fd0 tx=0x7f53c4008040 comp rx=0 tx=0).stop 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 msgr2=0x7f53d40a92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f53c800c390 tx=0x7f53c800c850 comp rx=0 tx=0).stop 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 shutdown_connections 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53d415fde0 0x7f53d415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53d40cd660 0x7f53d40a92e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f53c006ac50 0x7f53c006d110 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 --2- 172.21.15.50:0/1614521847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53d40b1e00 0x7f53d41497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 >> 172.21.15.50:0/1614521847 conn(0x7f53d40d2900 msgr2=0x7f53d40cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 shutdown_connections 2023-08-10T10:44:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.486+0000 7f53d8fd2640 1 -- 172.21.15.50:0/1614521847 wait complete. 2023-08-10T10:44:28.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:44:28.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.730+0000 7f73e63e4640 1 Processor -- start 2023-08-10T10:44:28.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.730+0000 7f73e63e4640 1 -- start start 2023-08-10T10:44:28.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e63e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159070 0x7f73e00c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e63e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73e00cdfa0 0x7f73e00cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e63e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00ca230 con 0x7f73e00aff00 2023-08-10T10:44:28.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e63e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00cdb10 con 0x7f73e00cdfa0 2023-08-10T10:44:28.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e63e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00ccf00 con 0x7f73e0159070 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.732+0000 7f73e4be1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73e00cdfa0 0x7f73e00cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73e00cdfa0 0x7f73e00cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44172/0 (socket says 172.21.15.50:44172) 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 -- 172.21.15.50:0/3912153385 learned_addr learned my addr 172.21.15.50:0/3912153385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e53e2640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159070 0x7f73e00c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 -- 172.21.15.50:0/3912153385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159070 msgr2=0x7f73e00c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159070 0x7f73e00c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 -- 172.21.15.50:0/3912153385 >> v1:172.21.15.50:6789/0 conn(0x7f73e00aff00 legacy=0x7f73e006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.733+0000 7f73e4be1640 1 -- 172.21.15.50:0/3912153385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00cd1e0 con 0x7f73e00cdfa0 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.734+0000 7f73e4be1640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e00cdfa0 0x7f73e00cc6a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f73d000bb00 tx=0x7f73d002df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391df71cd81e0345 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73d7fff640 1 -- 172.21.15.50:0/3912153385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d002ece0 con 0x7f73e00cdfa0 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73d7fff640 1 -- 172.21.15.50:0/3912153385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0032070 con 0x7f73e00cdfa0 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73d7fff640 1 -- 172.21.15.50:0/3912153385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0038620 con 0x7f73e00cdfa0 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 -- 172.21.15.50:0/3912153385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e00cdfa0 msgr2=0x7f73e00cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e00cdfa0 0x7f73e00cc6a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f73d000bb00 tx=0x7f73d002df30 comp rx=0 tx=0).stop 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 -- 172.21.15.50:0/3912153385 shutdown_connections 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e00cdfa0 0x7f73e00cc6a0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3912153385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159070 0x7f73e00c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 -- 172.21.15.50:0/3912153385 >> 172.21.15.50:0/3912153385 conn(0x7f73e0069cd0 msgr2=0x7f73e00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.735+0000 7f73e63e4640 1 -- 172.21.15.50:0/3912153385 shutdown_connections 2023-08-10T10:44:28.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.736+0000 7f73e63e4640 1 -- 172.21.15.50:0/3912153385 wait complete. 2023-08-10T10:44:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.737+0000 7f73e63e4640 1 Processor -- start 2023-08-10T10:44:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.737+0000 7f73e63e4640 1 -- start start 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aff00 0x7f73e014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e00cdfa0 0x7f73e0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01e2120 con 0x7f73e0154150 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0154600 con 0x7f73e00cdfa0 2023-08-10T10:44:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.738+0000 7f73e63e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e015c410 con 0x7f73e00aff00 2023-08-10T10:44:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44184/0 (socket says 172.21.15.50:44184) 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 -- 172.21.15.50:0/3613138885 learned_addr learned my addr 172.21.15.50:0/3613138885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 -- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aff00 msgr2=0x7f73e014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e4be1640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e00cdfa0 0x7f73e0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aff00 0x7f73e014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 -- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e00cdfa0 msgr2=0x7f73e0153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e00cdfa0 0x7f73e0153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 -- 172.21.15.50:0/3613138885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d000b760 con 0x7f73e0154150 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.739+0000 7f73e5be3640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c6b0 tx=0x7f73d800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.740+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8003b70 con 0x7f73e0154150 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.740+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8003cf0 con 0x7f73e0154150 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.740+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8003ea0 con 0x7f73e0154150 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.740+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e01e17c0 con 0x7f73e0154150 2023-08-10T10:44:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.740+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e01e1a60 con 0x7f73e0154150 2023-08-10T10:44:28.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.741+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e01e2260 con 0x7f73e0154150 2023-08-10T10:44:28.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.742+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73d8005310 con 0x7f73e0154150 2023-08-10T10:44:28.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.743+0000 7f73d5ffb640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 0x7f73c406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:28.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.743+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f73d8088d50 con 0x7f73e0154150 2023-08-10T10:44:28.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.743+0000 7f73e53e2640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 0x7f73c406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:28.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.744+0000 7f73e53e2640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 0x7f73c406d140 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0098f0 tx=0x7f73dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:28.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.747+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f73e01e2260 con 0x7f73e0154150 2023-08-10T10:44:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.942+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73e00ca230 con 0x7f73e0154150 2023-08-10T10:44:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.943+0000 7f73d5ffb640 1 -- 172.21.15.50:0/3613138885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73e00ca230 con 0x7f73e0154150 2023-08-10T10:44:28.945 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:44:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 msgr2=0x7f73c406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 0x7f73c406d140 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0098f0 tx=0x7f73dc008040 comp rx=0 tx=0).stop 2023-08-10T10:44:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 msgr2=0x7f73e015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c6b0 tx=0x7f73d800cb70 comp rx=0 tx=0).stop 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 shutdown_connections 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73e0154150 0x7f73e015b6e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73c406ac80 0x7f73c406d140 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e00cdfa0 0x7f73e0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 --2- 172.21.15.50:0/3613138885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aff00 0x7f73e014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.946+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 >> 172.21.15.50:0/3613138885 conn(0x7f73e0069cd0 msgr2=0x7f73e00cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.947+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 shutdown_connections 2023-08-10T10:44:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:28.947+0000 7f73e63e4640 1 -- 172.21.15.50:0/3613138885 wait complete. 2023-08-10T10:44:28.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:44:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.195+0000 7f5092d55640 1 Processor -- start 2023-08-10T10:44:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.195+0000 7f5092d55640 1 -- start start 2023-08-10T10:44:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.196+0000 7f5092d55640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f508c15d170 0x7f508c0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5092d55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f508c0cc2a0 0x7f508c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5092d55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c161ae0 con 0x7f508c0afb60 2023-08-10T10:44:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5092d55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c15d550 con 0x7f508c0cc2a0 2023-08-10T10:44:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5092d55640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c160f60 con 0x7f508c15d170 2023-08-10T10:44:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5083fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f508c0afb60 0x7f508c070d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50230/0 (socket says 172.21.15.50:50230) 2023-08-10T10:44:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5083fff640 1 -- 172.21.15.50:0/2940430571 learned_addr learned my addr 172.21.15.50:0/2940430571 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f50912f2640 1 --2- 172.21.15.50:0/2940430571 >> v2:172.21.15.50:3300/0 conn(0x7f508c0cc2a0 0x7f508c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f5090af1640 1 --2- 172.21.15.50:0/2940430571 >> v2:172.21.15.117:3300/0 conn(0x7f508c15d170 0x7f508c0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f50912f2640 1 -- 172.21.15.50:0/2940430571 >> v2:172.21.15.117:3300/0 conn(0x7f508c15d170 msgr2=0x7f508c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f50912f2640 1 --2- 172.21.15.50:0/2940430571 >> v2:172.21.15.117:3300/0 conn(0x7f508c15d170 0x7f508c0cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f50912f2640 1 -- 172.21.15.50:0/2940430571 >> v1:172.21.15.50:6789/0 conn(0x7f508c0afb60 legacy=0x7f508c070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.198+0000 7f50912f2640 1 -- 172.21.15.50:0/2940430571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c161240 con 0x7f508c0cc2a0 2023-08-10T10:44:29.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.197+0000 7f50837fe640 1 -- 172.21.15.50:0/2940430571 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800210068 0 0) 0x7f508c161ae0 con 0x7f508c0afb60 2023-08-10T10:44:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f50912f2640 1 --2- 172.21.15.50:0/2940430571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c0cc2a0 0x7f508c0cd6d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f508c079f00 tx=0x7f508402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a601574eac2c82e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f50837fe640 1 -- 172.21.15.50:0/2940430571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508402cc70 con 0x7f508c0cc2a0 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f50837fe640 1 -- 172.21.15.50:0/2940430571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508402cdd0 con 0x7f508c0cc2a0 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f50837fe640 1 -- 172.21.15.50:0/2940430571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084034660 con 0x7f508c0cc2a0 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f5092d55640 1 -- 172.21.15.50:0/2940430571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c0cc2a0 msgr2=0x7f508c0cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.199+0000 7f5092d55640 1 --2- 172.21.15.50:0/2940430571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c0cc2a0 0x7f508c0cd6d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f508c079f00 tx=0x7f508402bec0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 -- 172.21.15.50:0/2940430571 shutdown_connections 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 --2- 172.21.15.50:0/2940430571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c0cc2a0 0x7f508c0cd6d0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 --2- 172.21.15.50:0/2940430571 >> v2:172.21.15.117:3300/0 conn(0x7f508c15d170 0x7f508c0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 -- 172.21.15.50:0/2940430571 >> 172.21.15.50:0/2940430571 conn(0x7f508c0b23e0 msgr2=0x7f508c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 -- 172.21.15.50:0/2940430571 shutdown_connections 2023-08-10T10:44:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.200+0000 7f5092d55640 1 -- 172.21.15.50:0/2940430571 wait complete. 2023-08-10T10:44:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.201+0000 7f5092d55640 1 Processor -- start 2023-08-10T10:44:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.202+0000 7f5092d55640 1 -- start start 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.202+0000 7f5092d55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f508c0afb60 0x7f508c0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.202+0000 7f5092d55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 0x7f508c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5092d55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5092d55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1f26d0 con 0x7f508c15d170 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5092d55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0ad780 con 0x7f508c0afb60 2023-08-10T10:44:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5092d55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0ada60 con 0x7f508c0cc2a0 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44216/0 (socket says 172.21.15.50:44216) 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 -- 172.21.15.50:0/3706051176 learned_addr learned my addr 172.21.15.50:0/3706051176 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5090af1640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f508c0afb60 0x7f508c0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5083fff640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 0x7f508c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 -- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 msgr2=0x7f508c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 0x7f508c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 -- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f508c0afb60 msgr2=0x7f508c0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f508c0afb60 0x7f508c0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f50912f2640 1 -- 172.21.15.50:0/3706051176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009a70 con 0x7f508c15d170 2023-08-10T10:44:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.203+0000 7f5083fff640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 0x7f508c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f50912f2640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e80 tx=0x7f5084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084040650 con 0x7f508c15d170 2023-08-10T10:44:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50840407d0 con 0x7f508c15d170 2023-08-10T10:44:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084040b80 con 0x7f508c15d170 2023-08-10T10:44:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c0add40 con 0x7f508c15d170 2023-08-10T10:44:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.204+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c158790 con 0x7f508c15d170 2023-08-10T10:44:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.205+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c0612b0 con 0x7f508c15d170 2023-08-10T10:44:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.206+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5084040ce0 con 0x7f508c15d170 2023-08-10T10:44:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.208+0000 7f50817fa640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 0x7f507806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.208+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f50840abf80 con 0x7f508c15d170 2023-08-10T10:44:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.208+0000 7f5090af1640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 0x7f507806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.209+0000 7f5090af1640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 0x7f507806d110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.212+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5084077340 con 0x7f508c15d170 2023-08-10T10:44:29.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.406+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f508c0cdf00 con 0x7f508c15d170 2023-08-10T10:44:29.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.414+0000 7f50817fa640 1 -- 172.21.15.50:0/3706051176 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f508407a960 con 0x7f508c15d170 2023-08-10T10:44:29.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.417+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 msgr2=0x7f507806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.417+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 0x7f507806d110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088008040 comp rx=0 tx=0).stop 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.417+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 msgr2=0x7f508c0aca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.417+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e80 tx=0x7f5084004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 shutdown_connections 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f508c15d170 0x7f508c0aca50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f508c0cc2a0 0x7f508c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f507806ac50 0x7f507806d110 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 --2- 172.21.15.50:0/3706051176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f508c0afb60 0x7f508c0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 >> 172.21.15.50:0/3706051176 conn(0x7f508c0b23e0 msgr2=0x7f508c0b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 shutdown_connections 2023-08-10T10:44:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:29.418+0000 7f5092d55640 1 -- 172.21.15.50:0/3706051176 wait complete. 2023-08-10T10:44:29.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:44:29.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:44:29.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:44:29.687 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:44:29.687 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:29.688 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:29.751 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:44:29.751 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:29.752 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:29.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:44:29.813 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:29.814 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:29.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:44:29.877 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:29.877 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:29.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:44:29.934 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:44:29.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.171+0000 7f3332d42640 1 Processor -- start 2023-08-10T10:44:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.171+0000 7f3332d42640 1 -- start start 2023-08-10T10:44:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f3332d42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c0b0c60 0x7f332c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f3332d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c071c70 con 0x7f332c15aa40 2023-08-10T10:44:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f3332d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0713d0 con 0x7f332c0b3f30 2023-08-10T10:44:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f3332d42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0716b0 con 0x7f332c0b0c60 2023-08-10T10:44:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f332bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c0b0c60 0x7f332c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f332bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c0b0c60 0x7f332c0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44230/0 (socket says 172.21.15.50:44230) 2023-08-10T10:44:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.173+0000 7f332bfff640 1 -- 172.21.15.50:0/1138659596 learned_addr learned my addr 172.21.15.50:0/1138659596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.174+0000 7f332bfff640 1 -- 172.21.15.50:0/1138659596 >> v1:172.21.15.117:6789/0 conn(0x7f332c0b3f30 legacy=0x7f332c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.174+0000 7f332bfff640 1 -- 172.21.15.50:0/1138659596 >> v1:172.21.15.50:6789/0 conn(0x7f332c15aa40 legacy=0x7f332c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.174+0000 7f332bfff640 1 -- 172.21.15.50:0/1138659596 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c071990 con 0x7f332c0b0c60 2023-08-10T10:44:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.175+0000 7f332bfff640 1 --2- 172.21.15.50:0/1138659596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c0c9920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3318009870 tx=0x7f331802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3349956f7c8e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.175+0000 7f332b7fe640 1 -- 172.21.15.50:0/1138659596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318031870 con 0x7f332c0b0c60 2023-08-10T10:44:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.175+0000 7f332b7fe640 1 -- 172.21.15.50:0/1138659596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33180319d0 con 0x7f332c0b0c60 2023-08-10T10:44:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.175+0000 7f332b7fe640 1 -- 172.21.15.50:0/1138659596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318031d60 con 0x7f332c0b0c60 2023-08-10T10:44:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 -- 172.21.15.50:0/1138659596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 msgr2=0x7f332c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 --2- 172.21.15.50:0/1138659596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c0c9920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3318009870 tx=0x7f331802b910 comp rx=0 tx=0).stop 2023-08-10T10:44:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 -- 172.21.15.50:0/1138659596 shutdown_connections 2023-08-10T10:44:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 --2- 172.21.15.50:0/1138659596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c0c9920 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 -- 172.21.15.50:0/1138659596 >> 172.21.15.50:0/1138659596 conn(0x7f332c06b590 msgr2=0x7f332c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 -- 172.21.15.50:0/1138659596 shutdown_connections 2023-08-10T10:44:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.176+0000 7f3332d42640 1 -- 172.21.15.50:0/1138659596 wait complete. 2023-08-10T10:44:30.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.179+0000 7f3332d42640 1 Processor -- start 2023-08-10T10:44:30.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.179+0000 7f3332d42640 1 -- start start 2023-08-10T10:44:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c0b3f30 0x7f332c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15aa40 0x7f332c1f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1f2560 con 0x7f332c0b0c60 2023-08-10T10:44:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c15ce60 con 0x7f332c15aa40 2023-08-10T10:44:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.180+0000 7f3332d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c15c250 con 0x7f332c0b3f30 2023-08-10T10:44:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44236/0 (socket says 172.21.15.50:44236) 2023-08-10T10:44:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 -- 172.21.15.50:0/2850938860 learned_addr learned my addr 172.21.15.50:0/2850938860 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 -- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c0b3f30 msgr2=0x7f332c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c0b3f30 0x7f332c15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 -- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15aa40 msgr2=0x7f332c1f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15aa40 0x7f332c1f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 -- 172.21.15.50:0/2850938860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180094d0 con 0x7f332c0b0c60 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.181+0000 7f3330ade640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f332000c400 tx=0x7f332000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.182+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200052d0 con 0x7f332c0b0c60 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.182+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320005430 con 0x7f332c0b0c60 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.182+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c15c530 con 0x7f332c0b0c60 2023-08-10T10:44:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.182+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320003830 con 0x7f332c0b0c60 2023-08-10T10:44:30.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.182+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c15caf0 con 0x7f332c0b0c60 2023-08-10T10:44:30.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.183+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c04e270 con 0x7f332c0b0c60 2023-08-10T10:44:30.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.184+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3320003990 con 0x7f332c0b0c60 2023-08-10T10:44:30.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.186+0000 7f33297fa640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.186+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f33200887e0 con 0x7f332c0b0c60 2023-08-10T10:44:30.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.186+0000 7f332bfff640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.187+0000 7f332bfff640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3318036000 tx=0x7f3318030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.190+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3320053b10 con 0x7f332c0b0c60 2023-08-10T10:44:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.419+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332c0c5130 con 0x7f332c0b0c60 2023-08-10T10:44:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.420+0000 7f33297fa640 1 -- 172.21.15.50:0/2850938860 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f3320017de0 con 0x7f332c0b0c60 2023-08-10T10:44:30.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:30.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2473446101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2473446101},{"type":"v1","addr":"172.21.15.117:6835","nonce":2473446101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/641986732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":641986732},{"type":"v1","addr":"172.21.15.117:6834","nonce":641986732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2741357718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2741357718},{"type":"v1","addr":"172.21.15.50:6836","nonce":2741357718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2370851942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2370851942},{"type":"v1","addr":"172.21.15.50:6837","nonce":2370851942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-08-10T10:44:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 44 2023-08-10T10:44:30.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 msgr2=0x7f331006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3318036000 tx=0x7f3318030000 comp rx=0 tx=0).stop 2023-08-10T10:44:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 msgr2=0x7f332c151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f332000c400 tx=0x7f332000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 shutdown_connections 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15aa40 0x7f332c1f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c0b3f30 0x7f332c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 --2- 172.21.15.50:0/2850938860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c0b0c60 0x7f332c151b90 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.422+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 >> 172.21.15.50:0/2850938860 conn(0x7f332c06b590 msgr2=0x7f332c0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.423+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 shutdown_connections 2023-08-10T10:44:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.423+0000 7f3332d42640 1 -- 172.21.15.50:0/2850938860 wait complete. 2023-08-10T10:44:30.445 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:44:30.446 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:44:30.446 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:44:30.446 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:44:30.446 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:44:30.446 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:44:30.447 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:44:30.447 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:44:30.447 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:44:30.447 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:44:30.448 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:44:30.448 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:44:30.448 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:44:30.448 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:44:30.448 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:44:30.449 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:44:30.469 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:44:30.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:44:30.470 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:44:30.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:44:30.474 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:44:30.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:44:30.480 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:44:30.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:44:30.518 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:44:30.519 DEBUG:teuthology.parallel:result is None 2023-08-10T10:44:30.526 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:44:30.526 DEBUG:teuthology.parallel:result is None 2023-08-10T10:44:30.528 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:44:30.529 DEBUG:teuthology.parallel:result is None 2023-08-10T10:44:30.536 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:44:30.537 DEBUG:teuthology.parallel:result is None 2023-08-10T10:44:30.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:44:30.684 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:44:30.684 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:44:30.695 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:44:30.695 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:44:30.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.736+0000 7fcd05fa4640 1 Processor -- start 2023-08-10T10:44:30.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.736+0000 7fcd05fa4640 1 -- start start 2023-08-10T10:44:30.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.737+0000 7fcd05fa4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd00159210 0x7fcd000ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.737+0000 7fcd05fa4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000cc460 con 0x7fcd000ad780 2023-08-10T10:44:30.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.737+0000 7fcd05fa4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd00069ca0 con 0x7fcd0006fba0 2023-08-10T10:44:30.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.737+0000 7fcd05fa4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000cc1c0 con 0x7fcd00159210 2023-08-10T10:44:30.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccfeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcd000ad780 0x7fcd0006f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50256/0 (socket says 172.21.15.50:50256) 2023-08-10T10:44:30.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccfeffd640 1 -- 172.21.15.50:0/3170609892 learned_addr learned my addr 172.21.15.50:0/3170609892 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:30.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccff7fe640 1 --2- 172.21.15.50:0/3170609892 >> v2:172.21.15.50:3300/0 conn(0x7fcd00159210 0x7fcd000ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccfe7fc640 1 -- 172.21.15.50:0/3170609892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853621794 0 0) 0x7fcd000cc460 con 0x7fcd000ad780 2023-08-10T10:44:30.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccfe7fc640 1 -- 172.21.15.50:0/3170609892 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce8003520 con 0x7fcd000ad780 2023-08-10T10:44:30.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccff7fe640 1 -- 172.21.15.50:0/3170609892 >> v1:172.21.15.117:6789/0 conn(0x7fcd0006fba0 legacy=0x7fcd000cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccff7fe640 1 -- 172.21.15.50:0/3170609892 >> v1:172.21.15.50:6789/0 conn(0x7fcd000ad780 legacy=0x7fcd0006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.738+0000 7fccff7fe640 1 -- 172.21.15.50:0/3170609892 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000ca720 con 0x7fcd00159210 2023-08-10T10:44:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.739+0000 7fccff7fe640 1 --2- 172.21.15.50:0/3170609892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000ca0f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fccf00097a0 tx=0x7fccf002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e269375dc9c293e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fccfe7fc640 1 -- 172.21.15.50:0/3170609892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0030610 con 0x7fcd00159210 2023-08-10T10:44:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fccfe7fc640 1 -- 172.21.15.50:0/3170609892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0030770 con 0x7fcd00159210 2023-08-10T10:44:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fccfe7fc640 1 -- 172.21.15.50:0/3170609892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0030b00 con 0x7fcd00159210 2023-08-10T10:44:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fcd05fa4640 1 -- 172.21.15.50:0/3170609892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 msgr2=0x7fcd000ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/3170609892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000ca0f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fccf00097a0 tx=0x7fccf002b960 comp rx=0 tx=0).stop 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fcd05fa4640 1 -- 172.21.15.50:0/3170609892 shutdown_connections 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/3170609892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000ca0f0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.740+0000 7fcd05fa4640 1 -- 172.21.15.50:0/3170609892 >> 172.21.15.50:0/3170609892 conn(0x7fcd000b08e0 msgr2=0x7fcd000ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.741+0000 7fcd05fa4640 1 -- 172.21.15.50:0/3170609892 shutdown_connections 2023-08-10T10:44:30.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.741+0000 7fcd05fa4640 1 -- 172.21.15.50:0/3170609892 wait complete. 2023-08-10T10:44:30.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.742+0000 7fcd05fa4640 1 Processor -- start 2023-08-10T10:44:30.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.742+0000 7fcd05fa4640 1 -- start start 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0006fba0 0x7fcd001f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd000ad780 0x7fcd001f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c1400 con 0x7fcd00159210 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000b1ee0 con 0x7fcd0006fba0 2023-08-10T10:44:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.743+0000 7fcd05fa4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000b15b0 con 0x7fcd000ad780 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44278/0 (socket says 172.21.15.50:44278) 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 -- 172.21.15.50:0/1525104769 learned_addr learned my addr 172.21.15.50:0/1525104769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfeffd640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd000ad780 0x7fcd001f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccff7fe640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0006fba0 0x7fcd001f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 -- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd000ad780 msgr2=0x7fcd001f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd000ad780 0x7fcd001f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 -- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0006fba0 msgr2=0x7fcd001f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0006fba0 0x7fcd001f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.744+0000 7fccfffff640 1 -- 172.21.15.50:0/1525104769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009400 con 0x7fcd00159210 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fccfffff640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c680 tx=0x7fccf800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8003b70 con 0x7fcd00159210 2023-08-10T10:44:30.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8003cd0 con 0x7fcd00159210 2023-08-10T10:44:30.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000b1890 con 0x7fcd00159210 2023-08-10T10:44:30.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8005310 con 0x7fcd00159210 2023-08-10T10:44:30.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.745+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000b1260 con 0x7fcd00159210 2023-08-10T10:44:30.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.746+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd00070670 con 0x7fcd00159210 2023-08-10T10:44:30.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.747+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccf8005470 con 0x7fcd00159210 2023-08-10T10:44:30.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.748+0000 7fcce7fff640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 0x7fccec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:30.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.748+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fccf8088fd0 con 0x7fcd00159210 2023-08-10T10:44:30.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.749+0000 7fccff7fe640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 0x7fccec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:30.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.749+0000 7fccff7fe640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 0x7fccec06d110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fccf0036000 tx=0x7fccf0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:30.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.753+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fccf8054300 con 0x7fcd00159210 2023-08-10T10:44:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:30.960+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd0004e270 con 0x7fcd00159210 2023-08-10T10:44:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.443+0000 7fcce7fff640 1 -- 172.21.15.50:0/1525104769 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7fccf8057920 con 0x7fcd00159210 2023-08-10T10:44:31.445 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:44:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.447+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 msgr2=0x7fccec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.447+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 0x7fccec06d110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fccf0036000 tx=0x7fccf0008030 comp rx=0 tx=0).stop 2023-08-10T10:44:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.447+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 msgr2=0x7fcd000b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.447+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c680 tx=0x7fccf800cb40 comp rx=0 tx=0).stop 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 shutdown_connections 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd00159210 0x7fcd000b2370 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd000ad780 0x7fcd001f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fccec06ac50 0x7fccec06d110 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 --2- 172.21.15.50:0/1525104769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0006fba0 0x7fcd001f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 >> 172.21.15.50:0/1525104769 conn(0x7fcd000b08e0 msgr2=0x7fcd0015caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 shutdown_connections 2023-08-10T10:44:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.448+0000 7fcd05fa4640 1 -- 172.21.15.50:0/1525104769 wait complete. 2023-08-10T10:44:31.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:44:31.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.696+0000 7f229866a640 1 Processor -- start 2023-08-10T10:44:31.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.696+0000 7f229866a640 1 -- start start 2023-08-10T10:44:31.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f229866a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22900afbb0 0x7f22900b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:31.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f229866a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229006d5e0 con 0x7f22900cf4b0 2023-08-10T10:44:31.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f229866a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900cfa10 con 0x7f22900aff90 2023-08-10T10:44:31.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f229866a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900d0590 con 0x7f22900afbb0 2023-08-10T10:44:31.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f2296406640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22900afbb0 0x7f22900b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f2296c07640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f22900cf4b0 0x7f2290069a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50258/0 (socket says 172.21.15.50:50258) 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.698+0000 7f2296c07640 1 -- 172.21.15.50:0/2757845856 learned_addr learned my addr 172.21.15.50:0/2757845856 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.699+0000 7f2296406640 1 -- 172.21.15.50:0/2757845856 >> v1:172.21.15.117:6789/0 conn(0x7f22900aff90 legacy=0x7f22900ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.699+0000 7f2296406640 1 -- 172.21.15.50:0/2757845856 >> v1:172.21.15.50:6789/0 conn(0x7f22900cf4b0 legacy=0x7f2290069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.699+0000 7f2296406640 1 -- 172.21.15.50:0/2757845856 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900cfcf0 con 0x7f22900afbb0 2023-08-10T10:44:31.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.699+0000 7f2295404640 1 -- 172.21.15.50:0/2757845856 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418118191 0 0) 0x7f229006d5e0 con 0x7f22900cf4b0 2023-08-10T10:44:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.700+0000 7f2296406640 1 --2- 172.21.15.50:0/2757845856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22900b23b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f228c009790 tx=0x7f228c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c0948af5afc1cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.700+0000 7f2295404640 1 -- 172.21.15.50:0/2757845856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c031830 con 0x7f22900afbb0 2023-08-10T10:44:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.700+0000 7f2295404640 1 -- 172.21.15.50:0/2757845856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c031990 con 0x7f22900afbb0 2023-08-10T10:44:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.700+0000 7f2295404640 1 -- 172.21.15.50:0/2757845856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c031d20 con 0x7f22900afbb0 2023-08-10T10:44:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 -- 172.21.15.50:0/2757845856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 msgr2=0x7f22900b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 --2- 172.21.15.50:0/2757845856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22900b23b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f228c009790 tx=0x7f228c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 -- 172.21.15.50:0/2757845856 shutdown_connections 2023-08-10T10:44:31.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 --2- 172.21.15.50:0/2757845856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22900b23b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 -- 172.21.15.50:0/2757845856 >> 172.21.15.50:0/2757845856 conn(0x7f22900d0930 msgr2=0x7f22900d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 -- 172.21.15.50:0/2757845856 shutdown_connections 2023-08-10T10:44:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.701+0000 7f229866a640 1 -- 172.21.15.50:0/2757845856 wait complete. 2023-08-10T10:44:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.703+0000 7f229866a640 1 Processor -- start 2023-08-10T10:44:31.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.703+0000 7f229866a640 1 -- start start 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22900aff90 0x7f22900b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900cf4b0 0x7f2290149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b3ef0 con 0x7f22900afbb0 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b41d0 con 0x7f22900cf4b0 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f229866a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b44b0 con 0x7f22900aff90 2023-08-10T10:44:31.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.704+0000 7f2296406640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44294/0 (socket says 172.21.15.50:44294) 2023-08-10T10:44:31.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 -- 172.21.15.50:0/687841696 learned_addr learned my addr 172.21.15.50:0/687841696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296c07640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900cf4b0 0x7f2290149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:31.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2295c05640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22900aff90 0x7f22900b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 -- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22900aff90 msgr2=0x7f22900b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22900aff90 0x7f22900b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 -- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900cf4b0 msgr2=0x7f2290149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900cf4b0 0x7f2290149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 -- 172.21.15.50:0/687841696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0093a0 con 0x7f22900afbb0 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.705+0000 7f2296406640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098b0 tx=0x7f228c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.706+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c005e60 con 0x7f22900afbb0 2023-08-10T10:44:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.706+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c006030 con 0x7f22900afbb0 2023-08-10T10:44:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.706+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0063a0 con 0x7f22900afbb0 2023-08-10T10:44:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.706+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22900b4790 con 0x7f22900afbb0 2023-08-10T10:44:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.706+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22901f2540 con 0x7f22900afbb0 2023-08-10T10:44:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.707+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229004e270 con 0x7f22900afbb0 2023-08-10T10:44:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.708+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f228c006500 con 0x7f22900afbb0 2023-08-10T10:44:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.709+0000 7f2286ffd640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 0x7f227406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.709+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f228c0aba40 con 0x7f22900afbb0 2023-08-10T10:44:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.709+0000 7f2295c05640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 0x7f227406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.710+0000 7f2295c05640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 0x7f227406d110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f229015a900 tx=0x7f2280009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:31.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.714+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f228c076e50 con 0x7f22900afbb0 2023-08-10T10:44:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.971+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f22900cffa0 con 0x7f22900afbb0 2023-08-10T10:44:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.973+0000 7f2286ffd640 1 -- 172.21.15.50:0/687841696 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f228c0067b0 con 0x7f22900afbb0 2023-08-10T10:44:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:44:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:44:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:44:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:44:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:44:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:44:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:44:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:44:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:44:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:31.998 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 msgr2=0x7f227406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 0x7f227406d110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f229015a900 tx=0x7f2280009040 comp rx=0 tx=0).stop 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 msgr2=0x7f22901f2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098b0 tx=0x7f228c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 shutdown_connections 2023-08-10T10:44:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f227406ac50 0x7f227406d110 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900cf4b0 0x7f2290149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22900aff90 0x7f22900b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 --2- 172.21.15.50:0/687841696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22900afbb0 0x7f22901f2000 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.975+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 >> 172.21.15.50:0/687841696 conn(0x7f22900d0930 msgr2=0x7f229015cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.976+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 shutdown_connections 2023-08-10T10:44:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:31.976+0000 7f229866a640 1 -- 172.21.15.50:0/687841696 wait complete. 2023-08-10T10:44:32.002 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.234+0000 7f09305ab640 1 Processor -- start 2023-08-10T10:44:32.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.235+0000 7f09305ab640 1 -- start start 2023-08-10T10:44:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.236+0000 7f09305ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 0x7f09280cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.236+0000 7f09305ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0928161180 con 0x7f09280cddb0 2023-08-10T10:44:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.236+0000 7f09305ab640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0928161460 con 0x7f092815cd60 2023-08-10T10:44:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.236+0000 7f09305ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280ce240 con 0x7f09280b8430 2023-08-10T10:44:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.237+0000 7f092eb48640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f09280cddb0 0x7f09280d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50274/0 (socket says 172.21.15.50:50274) 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.237+0000 7f092eb48640 1 -- 172.21.15.50:0/2331505966 learned_addr learned my addr 172.21.15.50:0/2331505966 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.237+0000 7f092db46640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 0x7f09280cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.237+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937713189 0 0) 0x7f0928161180 con 0x7f09280cddb0 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.237+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914003520 con 0x7f09280cddb0 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528305739 0 0) 0x7f0928161460 con 0x7f092815cd60 2023-08-10T10:44:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0928161180 con 0x7f092815cd60 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231450193 0 0) 0x7f0914003520 con 0x7f09280cddb0 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 msgr2=0x7f09280cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 0x7f09280cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 >> v1:172.21.15.117:6789/0 conn(0x7f092815cd60 legacy=0x7f0928160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0928161740 con 0x7f09280cddb0 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0920001670 con 0x7f09280cddb0 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 >> v1:172.21.15.50:6789/0 conn(0x7f09280cddb0 legacy=0x7f09280d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 0x7f0914003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f09140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914004d00 0x7f0914005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280ce240 con 0x7f0914004090 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091400ba60 con 0x7f0914004d00 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091400bc20 con 0x7f09280b8430 2023-08-10T10:44:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.238+0000 7f092db46640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f09140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.239+0000 7f092db46640 1 -- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 msgr2=0x7f0914003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.239+0000 7f092db46640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09280b8430 0x7f0914003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.239+0000 7f092db46640 1 -- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914004d00 msgr2=0x7f0914005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.239+0000 7f092db46640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914004d00 0x7f0914005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.239+0000 7f092db46640 1 -- 172.21.15.50:0/2331505966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914003520 con 0x7f0914004090 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.240+0000 7f092db46640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f09140047c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0918009ac0 tx=0x7f09140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77b0abee016636 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.240+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091802c6f0 con 0x7f0914004090 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.240+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091802c850 con 0x7f0914004090 2023-08-10T10:44:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.240+0000 7f092d345640 1 -- 172.21.15.50:0/2331505966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091802cbe0 con 0x7f0914004090 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 -- 172.21.15.50:0/2331505966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 msgr2=0x7f09140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 --2- 172.21.15.50:0/2331505966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f09140047c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0918009ac0 tx=0x7f09140057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f092eb48640 1 -- 172.21.15.50:0/2331505966 reap_dead start 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 -- 172.21.15.50:0/2331505966 shutdown_connections 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 -- 172.21.15.50:0/2331505966 >> 172.21.15.50:0/2331505966 conn(0x7f09280d2ac0 msgr2=0x7f09280d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 -- 172.21.15.50:0/2331505966 shutdown_connections 2023-08-10T10:44:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.241+0000 7f09305ab640 1 -- 172.21.15.50:0/2331505966 wait complete. 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.243+0000 7f09305ab640 1 Processor -- start 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.243+0000 7f09305ab640 1 -- start start 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09281f1dd0 0x7f09280cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 0x7f09280b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092815f360 con 0x7f0914004090 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092814d520 con 0x7f09280cc880 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f09305ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0928158300 con 0x7f09281f1dd0 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f092e347640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f092e347640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44300/0 (socket says 172.21.15.50:44300) 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f092e347640 1 -- 172.21.15.50:0/3327283315 learned_addr learned my addr 172.21.15.50:0/3327283315 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.244+0000 7f092eb48640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 0x7f09280b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 -- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09281f1dd0 msgr2=0x7f09280cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092db46640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09281f1dd0 0x7f09280cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09281f1dd0 0x7f09280cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 -- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 msgr2=0x7f09280b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 0x7f09280b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 -- 172.21.15.50:0/3327283315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092815e400 con 0x7f0914004090 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092eb48640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 0x7f09280b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f092e347640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f092400caa0 tx=0x7f092400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924003b70 con 0x7f0914004090 2023-08-10T10:44:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0924003cd0 con 0x7f0914004090 2023-08-10T10:44:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400ab20 con 0x7f0914004090 2023-08-10T10:44:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092815e6e0 con 0x7f0914004090 2023-08-10T10:44:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.245+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092815eca0 con 0x7f0914004090 2023-08-10T10:44:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.247+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092804e270 con 0x7f0914004090 2023-08-10T10:44:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.248+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f092400ac80 con 0x7f0914004090 2023-08-10T10:44:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.249+0000 7f091effd640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 0x7f090c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.249+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0924089130 con 0x7f0914004090 2023-08-10T10:44:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.249+0000 7f092db46640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 0x7f090c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.250+0000 7f092db46640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 0x7f090c06d140 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0918036000 tx=0x7f0918030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.253+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f09240545c0 con 0x7f0914004090 2023-08-10T10:44:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.455+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09280d3940 con 0x7f0914004090 2023-08-10T10:44:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.456+0000 7f091effd640 1 -- 172.21.15.50:0/3327283315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f0924057be0 con 0x7f0914004090 2023-08-10T10:44:32.458 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:32.458 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":106,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:31.451401+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:32.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 msgr2=0x7f090c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 0x7f090c06d140 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0918036000 tx=0x7f0918030000 comp rx=0 tx=0).stop 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 msgr2=0x7f092814cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f092400caa0 tx=0x7f092400cf60 comp rx=0 tx=0).stop 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 shutdown_connections 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f090c06ac80 0x7f090c06d140 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280cc880 0x7f09280b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09281f1dd0 0x7f09280cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 --2- 172.21.15.50:0/3327283315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0914004090 0x7f092814cfe0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 >> 172.21.15.50:0/3327283315 conn(0x7f09280d2ac0 msgr2=0x7f092815b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:32.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 shutdown_connections 2023-08-10T10:44:32.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.459+0000 7f09305ab640 1 -- 172.21.15.50:0/3327283315 wait complete. 2023-08-10T10:44:32.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:44:32.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:44:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.706+0000 7f1010a1f640 1 Processor -- start 2023-08-10T10:44:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.706+0000 7f1010a1f640 1 -- start start 2023-08-10T10:44:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f1010a1f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f100c0cd9b0 0x7f100c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f1010a1f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c06c320 con 0x7f100c15ae40 2023-08-10T10:44:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f1010a1f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c06b770 con 0x7f100c06cb30 2023-08-10T10:44:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f1010a1f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c06b9f0 con 0x7f100c0cd9b0 2023-08-10T10:44:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f100a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f100c15ae40 0x7f100c0cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50288/0 (socket says 172.21.15.50:50288) 2023-08-10T10:44:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f100a59c640 1 -- 172.21.15.50:0/281652609 learned_addr learned my addr 172.21.15.50:0/281652609 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:32.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.708+0000 7f1009d9b640 1 --2- 172.21.15.50:0/281652609 >> v2:172.21.15.50:3300/0 conn(0x7f100c0cd9b0 0x7f100c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.709+0000 7f100959a640 1 -- 172.21.15.50:0/281652609 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446197815 0 0) 0x7f100c06c320 con 0x7f100c15ae40 2023-08-10T10:44:32.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.709+0000 7f100959a640 1 -- 172.21.15.50:0/281652609 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff4003520 con 0x7f100c15ae40 2023-08-10T10:44:32.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.709+0000 7f1009d9b640 1 -- 172.21.15.50:0/281652609 >> v1:172.21.15.117:6789/0 conn(0x7f100c06cb30 legacy=0x7f100c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:32.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.709+0000 7f1009d9b640 1 -- 172.21.15.50:0/281652609 >> v1:172.21.15.50:6789/0 conn(0x7f100c15ae40 legacy=0x7f100c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.709+0000 7f1009d9b640 1 -- 172.21.15.50:0/281652609 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c06bcd0 con 0x7f100c0cd9b0 2023-08-10T10:44:32.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.710+0000 7f1009d9b640 1 --2- 172.21.15.50:0/281652609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c0cd9b0 0x7f100c0b1510 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f10000097a0 tx=0x7f100002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a429b960d0c6b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.710+0000 7f100959a640 1 -- 172.21.15.50:0/281652609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000031830 con 0x7f100c0cd9b0 2023-08-10T10:44:32.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.710+0000 7f100959a640 1 -- 172.21.15.50:0/281652609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000031990 con 0x7f100c0cd9b0 2023-08-10T10:44:32.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.710+0000 7f100959a640 1 -- 172.21.15.50:0/281652609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000031d20 con 0x7f100c0cd9b0 2023-08-10T10:44:32.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 -- 172.21.15.50:0/281652609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c0cd9b0 msgr2=0x7f100c0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 --2- 172.21.15.50:0/281652609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c0cd9b0 0x7f100c0b1510 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f10000097a0 tx=0x7f100002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 -- 172.21.15.50:0/281652609 shutdown_connections 2023-08-10T10:44:32.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 --2- 172.21.15.50:0/281652609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c0cd9b0 0x7f100c0b1510 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 -- 172.21.15.50:0/281652609 >> 172.21.15.50:0/281652609 conn(0x7f100c0b01b0 msgr2=0x7f100c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:32.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 -- 172.21.15.50:0/281652609 shutdown_connections 2023-08-10T10:44:32.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.711+0000 7f1010a1f640 1 -- 172.21.15.50:0/281652609 wait complete. 2023-08-10T10:44:32.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.713+0000 7f1010a1f640 1 Processor -- start 2023-08-10T10:44:32.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.713+0000 7f1010a1f640 1 -- start start 2023-08-10T10:44:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f100c0cd9b0 0x7f100c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 0x7f100c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c06f880 con 0x7f100c06cb30 2023-08-10T10:44:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c1574b0 con 0x7f100c15ae40 2023-08-10T10:44:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f1010a1f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c06ec00 con 0x7f100c0cd9b0 2023-08-10T10:44:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f100a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f100a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44316/0 (socket says 172.21.15.50:44316) 2023-08-10T10:44:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.714+0000 7f100a59c640 1 -- 172.21.15.50:0/3992829390 learned_addr learned my addr 172.21.15.50:0/3992829390 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f1009d9b640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f100c0cd9b0 0x7f100c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 -- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f100c0cd9b0 msgr2=0x7f100c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f100c0cd9b0 0x7f100c0c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 -- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 msgr2=0x7f100c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100ad9d640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 0x7f100c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 0x7f100c0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 -- 172.21.15.50:0/3992829390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000009400 con 0x7f100c06cb30 2023-08-10T10:44:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100ad9d640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 0x7f100c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f100a59c640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c440 tx=0x7f0ffc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc005ce0 con 0x7f100c06cb30 2023-08-10T10:44:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc005e40 con 0x7f100c06cb30 2023-08-10T10:44:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0072b0 con 0x7f100c06cb30 2023-08-10T10:44:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.715+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c06eee0 con 0x7f100c06cb30 2023-08-10T10:44:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.716+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c06f4a0 con 0x7f100c06cb30 2023-08-10T10:44:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.717+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0612b0 con 0x7f100c06cb30 2023-08-10T10:44:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.718+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ffc007410 con 0x7f100c06cb30 2023-08-10T10:44:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.718+0000 7f0ffaffd640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 0x7f0fec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.719+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ffc088730 con 0x7f100c06cb30 2023-08-10T10:44:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.719+0000 7f1009d9b640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 0x7f0fec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.720+0000 7f1009d9b640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 0x7f0fec06d110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1000036000 tx=0x7f1000008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.723+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ffc053bd0 con 0x7f100c06cb30 2023-08-10T10:44:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.915+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f100c0c5340 con 0x7f100c06cb30 2023-08-10T10:44:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.916+0000 7f0ffaffd640 1 -- 172.21.15.50:0/3992829390 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ffc017020 con 0x7f100c06cb30 2023-08-10T10:44:32.918 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:44:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 msgr2=0x7f0fec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 0x7f0fec06d110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1000036000 tx=0x7f1000008030 comp rx=0 tx=0).stop 2023-08-10T10:44:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 msgr2=0x7f100c156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c440 tx=0x7f0ffc00c900 comp rx=0 tx=0).stop 2023-08-10T10:44:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 shutdown_connections 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fec06ac50 0x7f0fec06d110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f100c15ae40 0x7f100c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f100c0cd9b0 0x7f100c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 --2- 172.21.15.50:0/3992829390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100c06cb30 0x7f100c156f70 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.919+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 >> 172.21.15.50:0/3992829390 conn(0x7f100c0b01b0 msgr2=0x7f100c15b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.920+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 shutdown_connections 2023-08-10T10:44:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:32.920+0000 7f1010a1f640 1 -- 172.21.15.50:0/3992829390 wait complete. 2023-08-10T10:44:32.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:44:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.161+0000 7f2a5319f640 1 Processor -- start 2023-08-10T10:44:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.161+0000 7f2a5319f640 1 -- start start 2023-08-10T10:44:33.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a5319f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a4c161260 0x7f2a4c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a5319f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a4c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a5319f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c161640 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a5319f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c1bb0 con 0x7f2a4c161260 2023-08-10T10:44:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a5319f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0adb30 con 0x7f2a4c06f3a0 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a43fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a4c0b0cd0 0x7f2a4c06ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50290/0 (socket says 172.21.15.50:50290) 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.163+0000 7f2a43fff640 1 -- 172.21.15.50:0/2351416098 learned_addr learned my addr 172.21.15.50:0/2351416098 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a5173c640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a4c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a50f3b640 1 --2- 172.21.15.50:0/2351416098 >> v2:172.21.15.117:3300/0 conn(0x7f2a4c161260 0x7f2a4c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682780401 0 0) 0x7f2a4c161640 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a34003520 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279851500 0 0) 0x7f2a34003520 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 msgr2=0x7f2a4c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a4c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 >> v2:172.21.15.117:3300/0 conn(0x7f2a4c161260 msgr2=0x7f2a4c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 --2- 172.21.15.50:0/2351416098 >> v2:172.21.15.117:3300/0 conn(0x7f2a4c161260 0x7f2a4c0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0ade10 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f2a3c001690 con 0x7f2a4c0b0cd0 2023-08-10T10:44:33.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 >> v1:172.21.15.50:6789/0 conn(0x7f2a4c0b0cd0 legacy=0x7f2a4c06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a34003970 0x7f2a34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340047c0 0x7f2a34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0adb30 con 0x7f2a340047c0 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3400b980 con 0x7f2a34003970 2023-08-10T10:44:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.164+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3400baf0 con 0x7f2a4c06f3a0 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340047c0 0x7f2a34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a50f3b640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a34003970 0x7f2a34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a5173c640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 -- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 msgr2=0x7f2a34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c06f3a0 0x7f2a34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 -- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a34003970 msgr2=0x7f2a34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a34003970 0x7f2a34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.165+0000 7f2a43fff640 1 -- 172.21.15.50:0/2351416098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34003520 con 0x7f2a340047c0 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.167+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340047c0 0x7f2a34004c40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0b0160 tx=0x7f2a340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3ca41f1b860cd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.167+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c005ad0 con 0x7f2a340047c0 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.167+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c005c30 con 0x7f2a340047c0 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.167+0000 7f2a437fe640 1 -- 172.21.15.50:0/2351416098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c02c840 con 0x7f2a340047c0 2023-08-10T10:44:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 -- 172.21.15.50:0/2351416098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340047c0 msgr2=0x7f2a34004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2351416098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340047c0 0x7f2a34004c40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0b0160 tx=0x7f2a340057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5173c640 1 -- 172.21.15.50:0/2351416098 reap_dead start 2023-08-10T10:44:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 -- 172.21.15.50:0/2351416098 shutdown_connections 2023-08-10T10:44:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 -- 172.21.15.50:0/2351416098 >> 172.21.15.50:0/2351416098 conn(0x7f2a4c0b01b0 msgr2=0x7f2a4c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 -- 172.21.15.50:0/2351416098 shutdown_connections 2023-08-10T10:44:33.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.168+0000 7f2a5319f640 1 -- 172.21.15.50:0/2351416098 wait complete. 2023-08-10T10:44:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.170+0000 7f2a5319f640 1 Processor -- start 2023-08-10T10:44:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.170+0000 7f2a5319f640 1 -- start start 2023-08-10T10:44:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0c4bd0 0x7f2a4c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c15f2f0 0x7f2a4c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c15fcb0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b3ab0 con 0x7f2a4c0c4bd0 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a5319f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b3d90 con 0x7f2a4c15f2f0 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a50f3b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a50f3b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44322/0 (socket says 172.21.15.50:44322) 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.171+0000 7f2a50f3b640 1 -- 172.21.15.50:0/2312972737 learned_addr learned my addr 172.21.15.50:0/2312972737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0c4bd0 0x7f2a4c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 -- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c15f2f0 msgr2=0x7f2a4c15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c15f2f0 0x7f2a4c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 -- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0c4bd0 msgr2=0x7f2a4c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0c4bd0 0x7f2a4c0b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 -- 172.21.15.50:0/2312972737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0b2150 con 0x7f2a4c15ca80 2023-08-10T10:44:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a50f3b640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009f90 tx=0x7f2a4800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e040 con 0x7f2a4c15ca80 2023-08-10T10:44:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800f040 con 0x7f2a4c15ca80 2023-08-10T10:44:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48015650 con 0x7f2a4c15ca80 2023-08-10T10:44:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0b2430 con 0x7f2a4c15ca80 2023-08-10T10:44:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.172+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0b37c0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.174+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c0612b0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.174+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a480157b0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.175+0000 7f2a417fa640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 0x7f2a3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.175+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a48089fb0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.176+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 0x7f2a3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.176+0000 7f2a43fff640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 0x7f2a3806d110 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.179+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a48058da0 con 0x7f2a4c15ca80 2023-08-10T10:44:33.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.370+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a4c0afe00 con 0x7f2a4c15ca80 2023-08-10T10:44:33.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.371+0000 7f2a417fa640 1 -- 172.21.15.50:0/2312972737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a48058930 con 0x7f2a4c15ca80 2023-08-10T10:44:33.373 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:44:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 msgr2=0x7f2a3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 0x7f2a3806d110 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c007000 comp rx=0 tx=0).stop 2023-08-10T10:44:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 msgr2=0x7f2a4c0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009f90 tx=0x7f2a4800f580 comp rx=0 tx=0).stop 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 shutdown_connections 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a4c15f2f0 0x7f2a4c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a3806ac50 0x7f2a3806d110 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0c4bd0 0x7f2a4c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 --2- 172.21.15.50:0/2312972737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c15ca80 0x7f2a4c0b2c30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.373+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 >> 172.21.15.50:0/2312972737 conn(0x7f2a4c0b01b0 msgr2=0x7f2a4c0cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:33.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.374+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 shutdown_connections 2023-08-10T10:44:33.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.374+0000 7f2a5319f640 1 -- 172.21.15.50:0/2312972737 wait complete. 2023-08-10T10:44:33.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:44:33.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.625+0000 7f87b8599640 1 Processor -- start 2023-08-10T10:44:33.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.625+0000 7f87b8599640 1 -- start start 2023-08-10T10:44:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b8599640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87b00b2ac0 0x7f87b0167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b8599640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b006d5e0 con 0x7f87b00aff90 2023-08-10T10:44:33.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b8599640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b00cfa10 con 0x7f87b00afbb0 2023-08-10T10:44:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b8599640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b00d0590 con 0x7f87b00b2ac0 2023-08-10T10:44:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b5b34640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87b00aff90 0x7f87b00ceda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50304/0 (socket says 172.21.15.50:50304) 2023-08-10T10:44:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b5b34640 1 -- 172.21.15.50:0/2879494354 learned_addr learned my addr 172.21.15.50:0/2879494354 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.627+0000 7f87b6b36640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87b00b2ac0 0x7f87b0167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.628+0000 7f87b5333640 1 -- 172.21.15.50:0/2879494354 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025963553 0 0) 0x7f87b006d5e0 con 0x7f87b00aff90 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.628+0000 7f87b5333640 1 -- 172.21.15.50:0/2879494354 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f879c003520 con 0x7f87b00aff90 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.628+0000 7f87b6b36640 1 -- 172.21.15.50:0/2879494354 >> v1:172.21.15.117:6789/0 conn(0x7f87b00afbb0 legacy=0x7f87b00b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.628+0000 7f87b6b36640 1 -- 172.21.15.50:0/2879494354 >> v1:172.21.15.50:6789/0 conn(0x7f87b00aff90 legacy=0x7f87b00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.628+0000 7f87b6b36640 1 -- 172.21.15.50:0/2879494354 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00cfcf0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.629+0000 7f87b6b36640 1 --2- 172.21.15.50:0/2879494354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b0167ec0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009d90 tx=0x7f87a802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220964e4a558bdc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b5333640 1 -- 172.21.15.50:0/2879494354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a802cc60 con 0x7f87b00b2ac0 2023-08-10T10:44:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b5333640 1 -- 172.21.15.50:0/2879494354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a802cdc0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b5333640 1 -- 172.21.15.50:0/2879494354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8034640 con 0x7f87b00b2ac0 2023-08-10T10:44:33.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b8599640 1 -- 172.21.15.50:0/2879494354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 msgr2=0x7f87b0167ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b8599640 1 --2- 172.21.15.50:0/2879494354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b0167ec0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009d90 tx=0x7f87a802beb0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b8599640 1 -- 172.21.15.50:0/2879494354 shutdown_connections 2023-08-10T10:44:33.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b8599640 1 --2- 172.21.15.50:0/2879494354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b0167ec0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.630+0000 7f87b8599640 1 -- 172.21.15.50:0/2879494354 >> 172.21.15.50:0/2879494354 conn(0x7f87b00d0930 msgr2=0x7f87b00d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:33.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.631+0000 7f87b8599640 1 -- 172.21.15.50:0/2879494354 shutdown_connections 2023-08-10T10:44:33.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.631+0000 7f87b8599640 1 -- 172.21.15.50:0/2879494354 wait complete. 2023-08-10T10:44:33.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.632+0000 7f87b8599640 1 Processor -- start 2023-08-10T10:44:33.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.633+0000 7f87b8599640 1 -- start start 2023-08-10T10:44:33.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 0x7f87b00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87b00aff90 0x7f87b00b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b01f6aa0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b01f3510 con 0x7f87b00aff90 2023-08-10T10:44:33.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b8599640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b01f2900 con 0x7f87b00afbb0 2023-08-10T10:44:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b6b36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b6b36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44332/0 (socket says 172.21.15.50:44332) 2023-08-10T10:44:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b6b36640 1 -- 172.21.15.50:0/3916391298 learned_addr learned my addr 172.21.15.50:0/3916391298 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b6335640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 0x7f87b00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.634+0000 7f87b5b34640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87b00aff90 0x7f87b00b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 -- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 msgr2=0x7f87b00b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 0x7f87b00b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 -- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87b00aff90 msgr2=0x7f87b00b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87b00aff90 0x7f87b00b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 -- 172.21.15.50:0/3916391298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009a70 con 0x7f87b00b2ac0 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6335640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 0x7f87b00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:44:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b6b36640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f87a802bef0 tx=0x7f87a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8004250 con 0x7f87b00b2ac0 2023-08-10T10:44:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a80043b0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80047e0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.635+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b01f2be0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.636+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b01f31a0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.637+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b00667d0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.638+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87a8048460 con 0x7f87b00b2ac0 2023-08-10T10:44:33.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.639+0000 7f87a6ffd640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 0x7f879406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:33.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.639+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f87a80abcf0 con 0x7f87b00b2ac0 2023-08-10T10:44:33.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.639+0000 7f87b6335640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 0x7f879406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:33.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.640+0000 7f87b6335640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 0x7f879406d110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f87ac003ee0 tx=0x7f87ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:33.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.644+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f87a8077170 con 0x7f87b00b2ac0 2023-08-10T10:44:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.837+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f87b004e270 con 0x7f87b00b2ac0 2023-08-10T10:44:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.838+0000 7f87a6ffd640 1 -- 172.21.15.50:0/3916391298 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+126 (secure 0 0 0) 0x7f87a804d090 con 0x7f87b00b2ac0 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:33.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:33.841 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:44:33.841 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:44:33.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:33.841 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:44:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.840+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 msgr2=0x7f879406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.840+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 0x7f879406d110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f87ac003ee0 tx=0x7f87ac009040 comp rx=0 tx=0).stop 2023-08-10T10:44:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.840+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 msgr2=0x7f87b01f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.840+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f87a802bef0 tx=0x7f87a8004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 shutdown_connections 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87b00b2ac0 0x7f87b01f6560 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f879406ac50 0x7f879406d110 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87b00aff90 0x7f87b00b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 --2- 172.21.15.50:0/3916391298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87b00afbb0 0x7f87b00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 >> 172.21.15.50:0/3916391298 conn(0x7f87b00d0930 msgr2=0x7f87b00d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 shutdown_connections 2023-08-10T10:44:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:33.841+0000 7f87b8599640 1 -- 172.21.15.50:0/3916391298 wait complete. 2023-08-10T10:44:33.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:44:33.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:44:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.087+0000 7f8c63152640 1 Processor -- start 2023-08-10T10:44:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.088+0000 7f8c63152640 1 -- start start 2023-08-10T10:44:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.089+0000 7f8c63152640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c5c15d1a0 0x7f8c5c0b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.089+0000 7f8c63152640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c069c60 con 0x7f8c5c0cc4f0 2023-08-10T10:44:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.090+0000 7f8c63152640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c0730f0 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.090+0000 7f8c63152640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c073700 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.090+0000 7f8c6194f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c5c15d1a0 0x7f8c5c0b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.090+0000 7f8c62951640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c5c0cc4f0 0x7f8c5c06b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50306/0 (socket says 172.21.15.50:50306) 2023-08-10T10:44:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.090+0000 7f8c62951640 1 -- 172.21.15.50:0/405545315 learned_addr learned my addr 172.21.15.50:0/405545315 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.091+0000 7f8c6194f640 1 -- 172.21.15.50:0/405545315 >> v1:172.21.15.117:6789/0 conn(0x7f8c5c15cdc0 legacy=0x7f8c5c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.091+0000 7f8c6194f640 1 -- 172.21.15.50:0/405545315 >> v1:172.21.15.50:6789/0 conn(0x7f8c5c0cc4f0 legacy=0x7f8c5c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.091+0000 7f8c6194f640 1 -- 172.21.15.50:0/405545315 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0696a0 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.091+0000 7f8c6114e640 1 -- 172.21.15.50:0/405545315 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104486380 0 0) 0x7f8c5c069c60 con 0x7f8c5c0cc4f0 2023-08-10T10:44:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.092+0000 7f8c6194f640 1 --2- 172.21.15.50:0/405545315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c0b1c90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0097a0 tx=0x7f8c4c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdd3dd70c9cad53 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.092+0000 7f8c6114e640 1 -- 172.21.15.50:0/405545315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c030610 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.092+0000 7f8c6114e640 1 -- 172.21.15.50:0/405545315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c030770 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.092+0000 7f8c6114e640 1 -- 172.21.15.50:0/405545315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c030b00 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 -- 172.21.15.50:0/405545315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15d1a0 msgr2=0x7f8c5c0b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 --2- 172.21.15.50:0/405545315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c0b1c90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0097a0 tx=0x7f8c4c02b960 comp rx=0 tx=0).stop 2023-08-10T10:44:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 -- 172.21.15.50:0/405545315 shutdown_connections 2023-08-10T10:44:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 --2- 172.21.15.50:0/405545315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c0b1c90 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 -- 172.21.15.50:0/405545315 >> 172.21.15.50:0/405545315 conn(0x7f8c5c0b2540 msgr2=0x7f8c5c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 -- 172.21.15.50:0/405545315 shutdown_connections 2023-08-10T10:44:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.093+0000 7f8c63152640 1 -- 172.21.15.50:0/405545315 wait complete. 2023-08-10T10:44:34.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.095+0000 7f8c63152640 1 Processor -- start 2023-08-10T10:44:34.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.095+0000 7f8c63152640 1 -- start start 2023-08-10T10:44:34.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c5c0cc4f0 0x7f8c5c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0c8f80 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1f5880 con 0x7f8c5c15d1a0 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c63152640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1f5a90 con 0x7f8c5c0cc4f0 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c6194f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c6194f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44348/0 (socket says 172.21.15.50:44348) 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c6194f640 1 -- 172.21.15.50:0/1395125473 learned_addr learned my addr 172.21.15.50:0/1395125473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c62150640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c5c0cc4f0 0x7f8c5c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.096+0000 7f8c62951640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 -- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c5c0cc4f0 msgr2=0x7f8c5c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c5c0cc4f0 0x7f8c5c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 -- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c15d1a0 msgr2=0x7f8c5c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 -- 172.21.15.50:0/1395125473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009400 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c6194f640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c000c00 tx=0x7f8c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c039c90 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c03f040 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.097+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c1f5d70 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.098+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c004030 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.098+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c1f6330 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.099+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c066e30 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.100+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c4c004190 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.101+0000 7f8c52ffd640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 0x7f8c4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.101+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c4c0ab290 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.101+0000 7f8c62150640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 0x7f8c4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.102+0000 7f8c62150640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 0x7f8c4006d110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000fb0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.105+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c4c0767b0 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.306+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8c5c0ac740 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.467+0000 7f8c52ffd640 1 -- 172.21.15.50:0/1395125473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8c4c079dd0 con 0x7f8c5c15cdc0 2023-08-10T10:44:34.470 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:44:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.474+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 msgr2=0x7f8c4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.474+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 0x7f8c4006d110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000fb0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2023-08-10T10:44:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.474+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 msgr2=0x7f8c5c06b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.474+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c000c00 tx=0x7f8c4c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 shutdown_connections 2023-08-10T10:44:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c4006ac50 0x7f8c4006d110 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c15d1a0 0x7f8c5c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c5c15cdc0 0x7f8c5c06b630 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 --2- 172.21.15.50:0/1395125473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c5c0cc4f0 0x7f8c5c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 >> 172.21.15.50:0/1395125473 conn(0x7f8c5c0b2540 msgr2=0x7f8c5c159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 shutdown_connections 2023-08-10T10:44:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.475+0000 7f8c63152640 1 -- 172.21.15.50:0/1395125473 wait complete. 2023-08-10T10:44:34.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:44:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.733+0000 7fa5a23dc640 1 Processor -- start 2023-08-10T10:44:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.733+0000 7fa5a23dc640 1 -- start start 2023-08-10T10:44:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.734+0000 7fa5a23dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa59c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.734+0000 7fa5a23dc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c160a40 con 0x7fa59c15cb90 2023-08-10T10:44:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.734+0000 7fa5a23dc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c0b4bb0 con 0x7fa59c0b4640 2023-08-10T10:44:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.734+0000 7fa5a23dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0b4e90 con 0x7fa59c15cf70 2023-08-10T10:44:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.735+0000 7fa59bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa59c15cb90 0x7fa59c0b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50312/0 (socket says 172.21.15.50:50312) 2023-08-10T10:44:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.735+0000 7fa59bfff640 1 -- 172.21.15.50:0/1389321991 learned_addr learned my addr 172.21.15.50:0/1389321991 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.735+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857572713 0 0) 0x7fa59c160a40 con 0x7fa59c15cb90 2023-08-10T10:44:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.735+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa584003520 con 0x7fa59c15cb90 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.735+0000 7fa59b7fe640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa59c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3889344165 0 0) 0x7fa584003520 con 0x7fa59c15cb90 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 msgr2=0x7fa59c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa59c160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 >> v1:172.21.15.117:6789/0 conn(0x7fa59c0b4640 legacy=0x7fa59c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0b5170 con 0x7fa59c15cb90 2023-08-10T10:44:34.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa58c0019f0 con 0x7fa59c15cb90 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 >> v1:172.21.15.50:6789/0 conn(0x7fa59c15cb90 legacy=0x7fa59c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5840039a0 0x7fa584003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa5840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa584004d00 0x7fa584005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0b4e90 con 0x7fa584004d00 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58400bb10 con 0x7fa5840039a0 2023-08-10T10:44:34.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58400bcd0 con 0x7fa59c15cf70 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa5a0979640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa584004d00 0x7fa584005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59bfff640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5840039a0 0x7fa584003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.736+0000 7fa59b7fe640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa5840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.737+0000 7fa5a0979640 1 -- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 msgr2=0x7fa5840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.737+0000 7fa5a0979640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c15cf70 0x7fa5840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.737+0000 7fa5a0979640 1 -- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5840039a0 msgr2=0x7fa584003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.737+0000 7fa5a0979640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5840039a0 0x7fa584003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.737+0000 7fa5a0979640 1 -- 172.21.15.50:0/1389321991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584003520 con 0x7fa584004d00 2023-08-10T10:44:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.738+0000 7fa5a0979640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa584004d00 0x7fa584005180 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa594001750 tx=0x7fa5840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1e1853b327c9ca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.738+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940052d0 con 0x7fa584004d00 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.738+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59402e050 con 0x7fa584004d00 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.738+0000 7fa59affd640 1 -- 172.21.15.50:0/1389321991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940035f0 con 0x7fa584004d00 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 -- 172.21.15.50:0/1389321991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa584004d00 msgr2=0x7fa584005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/1389321991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa584004d00 0x7fa584005180 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa594001750 tx=0x7fa5840057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a0979640 1 -- 172.21.15.50:0/1389321991 reap_dead start 2023-08-10T10:44:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 -- 172.21.15.50:0/1389321991 shutdown_connections 2023-08-10T10:44:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 -- 172.21.15.50:0/1389321991 >> 172.21.15.50:0/1389321991 conn(0x7fa59c0cf640 msgr2=0x7fa59c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 -- 172.21.15.50:0/1389321991 shutdown_connections 2023-08-10T10:44:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.739+0000 7fa5a23dc640 1 -- 172.21.15.50:0/1389321991 wait complete. 2023-08-10T10:44:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.741+0000 7fa5a23dc640 1 Processor -- start 2023-08-10T10:44:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.741+0000 7fa5a23dc640 1 -- start start 2023-08-10T10:44:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa584004d00 0x7fa59c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c159070 0x7fa59c14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c14b0d0 con 0x7fa59c15b340 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15bc90 con 0x7fa584004d00 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a23dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15bf70 con 0x7fa59c159070 2023-08-10T10:44:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a0979640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a0979640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44362/0 (socket says 172.21.15.50:44362) 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.742+0000 7fa5a0979640 1 -- 172.21.15.50:0/2905465498 learned_addr learned my addr 172.21.15.50:0/2905465498 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa59bfff640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa584004d00 0x7fa59c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa59b7fe640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c159070 0x7fa59c14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 -- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c159070 msgr2=0x7fa59c14ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c159070 0x7fa59c14ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 -- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa584004d00 msgr2=0x7fa59c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa584004d00 0x7fa59c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 -- 172.21.15.50:0/2905465498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c15d350 con 0x7fa59c15b340 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.743+0000 7fa5a0979640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa594001870 tx=0x7fa594001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.744+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594043070 con 0x7fa59c15b340 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.744+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594007a30 con 0x7fa59c15b340 2023-08-10T10:44:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.744+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940067d0 con 0x7fa59c15b340 2023-08-10T10:44:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.744+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c15d630 con 0x7fa59c15b340 2023-08-10T10:44:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.744+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c15b7c0 con 0x7fa59c15b340 2023-08-10T10:44:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.745+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c0612b0 con 0x7fa59c15b340 2023-08-10T10:44:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.746+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa594006930 con 0x7fa59c15b340 2023-08-10T10:44:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.747+0000 7fa598ff9640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 0x7fa58806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.747+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa5940aa5c0 con 0x7fa59c15b340 2023-08-10T10:44:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.747+0000 7fa59bfff640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 0x7fa58806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.748+0000 7fa59bfff640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 0x7fa58806d110 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0013d0 tx=0x7fa58c0020c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.752+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa594075720 con 0x7fa59c15b340 2023-08-10T10:44:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:34.943+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa59c0cd410 con 0x7fa59c15b340 2023-08-10T10:44:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:44:35.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.493+0000 7fa598ff9640 1 -- 172.21.15.50:0/2905465498 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa594078d40 con 0x7fa59c15b340 2023-08-10T10:44:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.510+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 msgr2=0x7fa58806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.510+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 0x7fa58806d110 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0013d0 tx=0x7fa58c0020c0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.510+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 msgr2=0x7fa59c15f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.510+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa594001870 tx=0x7fa594001120 comp rx=0 tx=0).stop 2023-08-10T10:44:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 shutdown_connections 2023-08-10T10:44:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa59c15b340 0x7fa59c15f800 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa59c159070 0x7fa59c14ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa58806ac50 0x7fa58806d110 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 --2- 172.21.15.50:0/2905465498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa584004d00 0x7fa59c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 >> 172.21.15.50:0/2905465498 conn(0x7fa59c0cf640 msgr2=0x7fa59c1571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:35.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.511+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 shutdown_connections 2023-08-10T10:44:35.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.512+0000 7fa5a23dc640 1 -- 172.21.15.50:0/2905465498 wait complete. 2023-08-10T10:44:35.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:44:35.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.741+0000 7f752427c640 1 Processor -- start 2023-08-10T10:44:35.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.741+0000 7f752427c640 1 -- start start 2023-08-10T10:44:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.742+0000 7f752427c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 0x7f751c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f752427c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c160a40 con 0x7f751c15cf70 2023-08-10T10:44:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f752427c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0b4bb0 con 0x7f751c1615e0 2023-08-10T10:44:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f752427c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0b4e90 con 0x7f751c15cb90 2023-08-10T10:44:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f7521817640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f751c15cf70 0x7f751c160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39848/0 (socket says 172.21.15.50:39848) 2023-08-10T10:44:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f7521817640 1 -- 172.21.15.50:0/3009527433 learned_addr learned my addr 172.21.15.50:0/3009527433 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.743+0000 7f7522018640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 0x7f751c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507729506 0 0) 0x7f751c160a40 con 0x7f751c15cf70 2023-08-10T10:44:35.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7508003520 con 0x7f751c15cf70 2023-08-10T10:44:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476835439 0 0) 0x7f7508003520 con 0x7f751c15cf70 2023-08-10T10:44:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 msgr2=0x7f751c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 0x7f751c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 >> v1:172.21.15.117:6789/0 conn(0x7f751c1615e0 legacy=0x7f751c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0b5170 con 0x7f751c15cf70 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f750c001670 con 0x7f751c15cf70 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 >> v1:172.21.15.50:6789/0 conn(0x7f751c15cf70 legacy=0x7f751c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75080039a0 0x7f7508003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75080047c0 0x7f7508004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 0x7f7508005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0b4e90 con 0x7f75080047c0 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750800ba30 con 0x7f75080039a0 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750800bbf0 con 0x7f751c15cb90 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.744+0000 7f7521817640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75080047c0 0x7f7508004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7522018640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75080039a0 0x7f7508003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7521817640 1 -- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 msgr2=0x7f7508005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7521817640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c15cb90 0x7f7508005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7521817640 1 -- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75080039a0 msgr2=0x7f7508003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7521817640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75080039a0 0x7f7508003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7521817640 1 -- 172.21.15.50:0/3009527433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508003520 con 0x7f75080047c0 2023-08-10T10:44:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.745+0000 7f7522018640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75080039a0 0x7f7508003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.746+0000 7f7521817640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75080047c0 0x7f7508004c40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c210 tx=0x7f75080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e51c23f1a0b12cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.746+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c005ad0 con 0x7f75080047c0 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.746+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c005c30 con 0x7f75080047c0 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.746+0000 7f7521016640 1 -- 172.21.15.50:0/3009527433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c02c870 con 0x7f75080047c0 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 -- 172.21.15.50:0/3009527433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75080047c0 msgr2=0x7f7508004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 --2- 172.21.15.50:0/3009527433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75080047c0 0x7f7508004c40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c210 tx=0x7f75080057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f7522819640 1 -- 172.21.15.50:0/3009527433 reap_dead start 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 -- 172.21.15.50:0/3009527433 shutdown_connections 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 -- 172.21.15.50:0/3009527433 >> 172.21.15.50:0/3009527433 conn(0x7f751c0cf640 msgr2=0x7f751c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 -- 172.21.15.50:0/3009527433 shutdown_connections 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.747+0000 7f752427c640 1 -- 172.21.15.50:0/3009527433 wait complete. 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.749+0000 7f752427c640 1 Processor -- start 2023-08-10T10:44:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.749+0000 7f752427c640 1 -- start start 2023-08-10T10:44:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75080047c0 0x7f751c0b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c0a9e00 0x7f751c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c14d590 con 0x7f751c14cbd0 2023-08-10T10:44:35.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15f130 con 0x7f751c0a9e00 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f752427c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15f410 con 0x7f75080047c0 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f7522819640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f7522819640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43328/0 (socket says 172.21.15.50:43328) 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.750+0000 7f7522819640 1 -- 172.21.15.50:0/3006348919 learned_addr learned my addr 172.21.15.50:0/3006348919 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522018640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75080047c0 0x7f751c0b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 -- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75080047c0 msgr2=0x7f751c0b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75080047c0 0x7f751c0b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7521817640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c0a9e00 0x7f751c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 -- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c0a9e00 msgr2=0x7f751c0aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c0a9e00 0x7f751c0aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 -- 172.21.15.50:0/3006348919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c15f6f0 con 0x7f751c14cbd0 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7522819640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f751c1619c0 tx=0x7f751400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514005d40 con 0x7f751c14cbd0 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400ced0 con 0x7f751c14cbd0 2023-08-10T10:44:35.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400a850 con 0x7f751c14cbd0 2023-08-10T10:44:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.751+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c15f9d0 con 0x7f751c14cbd0 2023-08-10T10:44:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.752+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c15ed20 con 0x7f751c14cbd0 2023-08-10T10:44:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.753+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c15fef0 con 0x7f751c14cbd0 2023-08-10T10:44:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.754+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7514003970 con 0x7f751c14cbd0 2023-08-10T10:44:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.755+0000 7f7512ffd640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 0x7f750006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.755+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f75140883b0 con 0x7f751c14cbd0 2023-08-10T10:44:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.755+0000 7f7522018640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 0x7f750006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.756+0000 7f7522018640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 0x7f750006d110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75180099e0 tx=0x7f7518008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:35.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.760+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f75140534d0 con 0x7f751c14cbd0 2023-08-10T10:44:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:35.993+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f751c15fef0 con 0x7f751c14cbd0 2023-08-10T10:44:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.499+0000 7f7512ffd640 1 -- 172.21.15.50:0/3006348919 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f751c15fef0 con 0x7f751c14cbd0 2023-08-10T10:44:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 13 and data pool 14 2023-08-10T10:44:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.524+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 msgr2=0x7f750006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.524+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 0x7f750006d110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75180099e0 tx=0x7f7518008040 comp rx=0 tx=0).stop 2023-08-10T10:44:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.524+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 msgr2=0x7f751c14d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.524+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f751c1619c0 tx=0x7f751400cb90 comp rx=0 tx=0).stop 2023-08-10T10:44:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 shutdown_connections 2023-08-10T10:44:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f751c14cbd0 0x7f751c14d050 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f750006ac50 0x7f750006d110 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c0a9e00 0x7f751c0aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 --2- 172.21.15.50:0/3006348919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75080047c0 0x7f751c0b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.525+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 >> 172.21.15.50:0/3006348919 conn(0x7f751c0cf640 msgr2=0x7f751c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.526+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 shutdown_connections 2023-08-10T10:44:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.526+0000 7f752427c640 1 -- 172.21.15.50:0/3006348919 wait complete. 2023-08-10T10:44:36.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.739+0000 7f37fac6a640 1 Processor -- start 2023-08-10T10:44:36.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.739+0000 7f37fac6a640 1 -- start start 2023-08-10T10:44:36.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.740+0000 7f37fac6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37f40b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.740+0000 7f37fac6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f406f6f0 con 0x7f37f40b2d70 2023-08-10T10:44:36.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.740+0000 7f37fac6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40b3200 con 0x7f37f40c1af0 2023-08-10T10:44:36.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.740+0000 7f37fac6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41617f0 con 0x7f37f4069db0 2023-08-10T10:44:36.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.741+0000 7f37f9207640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37f40b2d70 0x7f37f406fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39856/0 (socket says 172.21.15.50:39856) 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.741+0000 7f37f9207640 1 -- 172.21.15.50:0/298198544 learned_addr learned my addr 172.21.15.50:0/298198544 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.741+0000 7f37ebfff640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37f40b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.741+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701927195 0 0) 0x7f37f406f6f0 con 0x7f37f40b2d70 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.741+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc003520 con 0x7f37f40b2d70 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458749339 0 0) 0x7f37dc003520 con 0x7f37f40b2d70 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 msgr2=0x7f37f40b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:36.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37f40b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 >> v1:172.21.15.117:6789/0 conn(0x7f37f40c1af0 legacy=0x7f37f40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f406edc0 con 0x7f37f40b2d70 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f37ec001670 con 0x7f37f40b2d70 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 >> v1:172.21.15.50:6789/0 conn(0x7f37f40b2d70 legacy=0x7f37f406fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37dc003f20 0x7f37dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc004d00 0x7f37dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41617f0 con 0x7f37dc003f20 2023-08-10T10:44:36.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc00baf0 con 0x7f37dc004d00 2023-08-10T10:44:36.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc00bcb0 con 0x7f37f4069db0 2023-08-10T10:44:36.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37ebfff640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37dc003f20 0x7f37dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.742+0000 7f37f8a06640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37ebfff640 1 -- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 msgr2=0x7f37dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:36.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37ebfff640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37ebfff640 1 -- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc004d00 msgr2=0x7f37dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37ebfff640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc004d00 0x7f37dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37ebfff640 1 -- 172.21.15.50:0/298198544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc003520 con 0x7f37dc003f20 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.743+0000 7f37f8a06640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f4069db0 0x7f37dc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.744+0000 7f37ebfff640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37dc003f20 0x7f37dc0047c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009ac0 tx=0x7f37dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f543601e5fc6d6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.744+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e402c6b0 con 0x7f37dc003f20 2023-08-10T10:44:36.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.744+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e402c810 con 0x7f37dc003f20 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.744+0000 7f37eb7fe640 1 -- 172.21.15.50:0/298198544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e402cba0 con 0x7f37dc003f20 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 -- 172.21.15.50:0/298198544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37dc003f20 msgr2=0x7f37dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 --2- 172.21.15.50:0/298198544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37dc003f20 0x7f37dc0047c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009ac0 tx=0x7f37dc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37f9207640 1 -- 172.21.15.50:0/298198544 reap_dead start 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 -- 172.21.15.50:0/298198544 shutdown_connections 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 -- 172.21.15.50:0/298198544 >> 172.21.15.50:0/298198544 conn(0x7f37f406b590 msgr2=0x7f37f40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 -- 172.21.15.50:0/298198544 shutdown_connections 2023-08-10T10:44:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.745+0000 7f37fac6a640 1 -- 172.21.15.50:0/298198544 wait complete. 2023-08-10T10:44:36.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.747+0000 7f37fac6a640 1 Processor -- start 2023-08-10T10:44:36.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.747+0000 7f37fac6a640 1 -- start start 2023-08-10T10:44:36.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 0x7f37f40c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 0x7f37f40b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41564b0 con 0x7f37f41555a0 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c7180 con 0x7f37dc003f20 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37fac6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4155f60 con 0x7f37f41f9cc0 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37f9207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37f9207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43358/0 (socket says 172.21.15.50:43358) 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.748+0000 7f37f9207640 1 -- 172.21.15.50:0/1396710108 learned_addr learned my addr 172.21.15.50:0/1396710108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37ebfff640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 0x7f37f40b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f8a06640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 0x7f37f40c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 -- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 msgr2=0x7f37f40b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 0x7f37f40b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 -- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 msgr2=0x7f37f40c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 0x7f37f40c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 -- 172.21.15.50:0/1396710108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f41fa230 con 0x7f37f41555a0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f8a06640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 0x7f37f40c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37ebfff640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 0x7f37f40b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37f9207640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f37f406cb50 tx=0x7f37ec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec007440 con 0x7f37f41555a0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec0075a0 con 0x7f37f41555a0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.749+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f41fa510 con 0x7f37f41555a0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.750+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0049e0 con 0x7f37f41555a0 2023-08-10T10:44:36.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.750+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f41faad0 con 0x7f37f41555a0 2023-08-10T10:44:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.751+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f40c7330 con 0x7f37f41555a0 2023-08-10T10:44:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.752+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37ec004b40 con 0x7f37f41555a0 2023-08-10T10:44:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.753+0000 7f37e97fa640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 0x7f37e006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.754+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37ec0888b0 con 0x7f37f41555a0 2023-08-10T10:44:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.754+0000 7f37f8a06640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 0x7f37e006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.754+0000 7f37f8a06640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 0x7f37e006d140 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f37f0007fd0 tx=0x7f37f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.758+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f37f40c7330 con 0x7f37f41555a0 2023-08-10T10:44:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.954+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37f40c7330 con 0x7f37f41555a0 2023-08-10T10:44:36.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.957+0000 7f37e97fa640 1 -- 172.21.15.50:0/1396710108 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f37f40c7330 con 0x7f37f41555a0 2023-08-10T10:44:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:36.960 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:35.996102+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 msgr2=0x7f37e006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 0x7f37e006d140 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f37f0007fd0 tx=0x7f37f0009040 comp rx=0 tx=0).stop 2023-08-10T10:44:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 msgr2=0x7f37f4155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f37f406cb50 tx=0x7f37ec00c960 comp rx=0 tx=0).stop 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 shutdown_connections 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37f41555a0 0x7f37f4155a20 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37f41f9cc0 0x7f37f40b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f37e006ac80 0x7f37e006d140 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 --2- 172.21.15.50:0/1396710108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37dc003f20 0x7f37f40c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:36.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.960+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 >> 172.21.15.50:0/1396710108 conn(0x7f37f406b590 msgr2=0x7f37f4071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.961+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 shutdown_connections 2023-08-10T10:44:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:36.961+0000 7f37fac6a640 1 -- 172.21.15.50:0/1396710108 wait complete. 2023-08-10T10:44:36.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.201+0000 7f05838c5640 1 Processor -- start 2023-08-10T10:44:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.202+0000 7f05838c5640 1 -- start start 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15ccb0 0x7f057c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f057c0c9b30 0x7f057c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057c0696a0 0x7f057c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c06a090 con 0x7f057c0696a0 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0719f0 con 0x7f057c0c9b30 2023-08-10T10:44:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.203+0000 7f05838c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0c8db0 con 0x7f057c15ccb0 2023-08-10T10:44:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057c0696a0 0x7f057c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057c0696a0 0x7f057c069b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43372/0 (socket says 172.21.15.50:43372) 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 -- 172.21.15.50:0/4072289060 learned_addr learned my addr 172.21.15.50:0/4072289060 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0580e60640 1 --2- 172.21.15.50:0/4072289060 >> v2:172.21.15.117:3300/0 conn(0x7f057c0c9b30 0x7f057c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581661640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15ccb0 0x7f057c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 -- 172.21.15.50:0/4072289060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15ccb0 msgr2=0x7f057c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15ccb0 0x7f057c0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 -- 172.21.15.50:0/4072289060 >> v2:172.21.15.117:3300/0 conn(0x7f057c0c9b30 msgr2=0x7f057c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 --2- 172.21.15.50:0/4072289060 >> v2:172.21.15.117:3300/0 conn(0x7f057c0c9b30 0x7f057c0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.204+0000 7f0581e62640 1 -- 172.21.15.50:0/4072289060 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0c9050 con 0x7f057c0696a0 2023-08-10T10:44:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.205+0000 7f0581e62640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0696a0 0x7f057c069b50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f057c0ce560 tx=0x7f057402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a184a79992368b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.206+0000 7f0573fff640 1 -- 172.21.15.50:0/4072289060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057402ca80 con 0x7f057c0696a0 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.206+0000 7f0573fff640 1 -- 172.21.15.50:0/4072289060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057402cbe0 con 0x7f057c0696a0 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.206+0000 7f0573fff640 1 -- 172.21.15.50:0/4072289060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05740343f0 con 0x7f057c0696a0 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.206+0000 7f05838c5640 1 -- 172.21.15.50:0/4072289060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0696a0 msgr2=0x7f057c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.206+0000 7f05838c5640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0696a0 0x7f057c069b50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f057c0ce560 tx=0x7f057402bee0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 -- 172.21.15.50:0/4072289060 shutdown_connections 2023-08-10T10:44:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0696a0 0x7f057c069b50 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 --2- 172.21.15.50:0/4072289060 >> v2:172.21.15.117:3300/0 conn(0x7f057c0c9b30 0x7f057c0b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 --2- 172.21.15.50:0/4072289060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15ccb0 0x7f057c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 -- 172.21.15.50:0/4072289060 >> 172.21.15.50:0/4072289060 conn(0x7f057c06b590 msgr2=0x7f057c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 -- 172.21.15.50:0/4072289060 shutdown_connections 2023-08-10T10:44:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.207+0000 7f05838c5640 1 -- 172.21.15.50:0/4072289060 wait complete. 2023-08-10T10:44:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.208+0000 7f05838c5640 1 Processor -- start 2023-08-10T10:44:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 -- start start 2023-08-10T10:44:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0696a0 0x7f057c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c15ccb0 0x7f057c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c153a70 con 0x7f057c0c9b30 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c1531d0 con 0x7f057c15ccb0 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.209+0000 7f05838c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c1534b0 con 0x7f057c0696a0 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43384/0 (socket says 172.21.15.50:43384) 2023-08-10T10:44:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 -- 172.21.15.50:0/3691475138 learned_addr learned my addr 172.21.15.50:0/3691475138 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0581661640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0696a0 0x7f057c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 -- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0696a0 msgr2=0x7f057c14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0696a0 0x7f057c14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 -- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c15ccb0 msgr2=0x7f057c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c15ccb0 0x7f057c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.210+0000 7f0580e60640 1 -- 172.21.15.50:0/3691475138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009b30 con 0x7f057c0c9b30 2023-08-10T10:44:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f0580e60640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d5f0 tx=0x7f056c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c018070 con 0x7f057c0c9b30 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c004240 con 0x7f057c0c9b30 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0043f0 con 0x7f057c0c9b30 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c153790 con 0x7f057c0c9b30 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.211+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c150b80 con 0x7f057c0c9b30 2023-08-10T10:44:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.212+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c151530 con 0x7f057c0c9b30 2023-08-10T10:44:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.213+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f056c003610 con 0x7f057c0c9b30 2023-08-10T10:44:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.214+0000 7f0571ffb640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 0x7f056006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.214+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f056c0892f0 con 0x7f057c0c9b30 2023-08-10T10:44:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.215+0000 7f0581661640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 0x7f056006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.215+0000 7f0581661640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 0x7f056006d110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0578006fd0 tx=0x7f0578008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.219+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f057c151530 con 0x7f057c0c9b30 2023-08-10T10:44:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.412+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f057c151530 con 0x7f057c0c9b30 2023-08-10T10:44:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.415+0000 7f0571ffb640 1 -- 172.21.15.50:0/3691475138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f057c151530 con 0x7f057c0c9b30 2023-08-10T10:44:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:37.417 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:35.996102+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:37.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 msgr2=0x7f056006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 0x7f056006d110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0578006fd0 tx=0x7f0578008040 comp rx=0 tx=0).stop 2023-08-10T10:44:37.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 msgr2=0x7f057c1f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d5f0 tx=0x7f056c00dab0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 shutdown_connections 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f056006ac50 0x7f056006d110 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c15ccb0 0x7f057c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057c0c9b30 0x7f057c1f2f60 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 --2- 172.21.15.50:0/3691475138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0696a0 0x7f057c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 >> 172.21.15.50:0/3691475138 conn(0x7f057c06b590 msgr2=0x7f057c070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 shutdown_connections 2023-08-10T10:44:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.418+0000 7f05838c5640 1 -- 172.21.15.50:0/3691475138 wait complete. 2023-08-10T10:44:37.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:44:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.671+0000 7fb69a5c2640 1 Processor -- start 2023-08-10T10:44:37.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.671+0000 7fb69a5c2640 1 -- start start 2023-08-10T10:44:37.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb69a5c2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6940b2f00 0x7fb6940ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb69a5c2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69406b650 con 0x7fb6940cda10 2023-08-10T10:44:37.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb69a5c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69406b370 con 0x7fb69406a500 2023-08-10T10:44:37.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb69a5c2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69406b190 con 0x7fb6940b2f00 2023-08-10T10:44:37.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb6937fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6940cda10 0x7fb694160d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39864/0 (socket says 172.21.15.50:39864) 2023-08-10T10:44:37.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb6937fe640 1 -- 172.21.15.50:0/4242595244 learned_addr learned my addr 172.21.15.50:0/4242595244 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.673+0000 7fb698b5f640 1 --2- 172.21.15.50:0/4242595244 >> v2:172.21.15.50:3300/0 conn(0x7fb6940b2f00 0x7fb6940ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.674+0000 7fb692ffd640 1 -- 172.21.15.50:0/4242595244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666173677 0 0) 0x7fb69406b650 con 0x7fb6940cda10 2023-08-10T10:44:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.674+0000 7fb698b5f640 1 -- 172.21.15.50:0/4242595244 >> v1:172.21.15.117:6789/0 conn(0x7fb69406a500 legacy=0x7fb6940cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.674+0000 7fb698b5f640 1 -- 172.21.15.50:0/4242595244 >> v1:172.21.15.50:6789/0 conn(0x7fb6940cda10 legacy=0x7fb694160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.674+0000 7fb698b5f640 1 -- 172.21.15.50:0/4242595244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940afc00 con 0x7fb6940b2f00 2023-08-10T10:44:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.675+0000 7fb698b5f640 1 --2- 172.21.15.50:0/4242595244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ce4c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097a0 tx=0x7fb68c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca43d6982e6f2fe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.675+0000 7fb692ffd640 1 -- 172.21.15.50:0/4242595244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c02e070 con 0x7fb6940b2f00 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.675+0000 7fb692ffd640 1 -- 172.21.15.50:0/4242595244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0315a0 con 0x7fb6940b2f00 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.675+0000 7fb692ffd640 1 -- 172.21.15.50:0/4242595244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c031930 con 0x7fb6940b2f00 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 -- 172.21.15.50:0/4242595244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 msgr2=0x7fb6940ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/4242595244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ce4c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097a0 tx=0x7fb68c02b840 comp rx=0 tx=0).stop 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 -- 172.21.15.50:0/4242595244 shutdown_connections 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/4242595244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ce4c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 -- 172.21.15.50:0/4242595244 >> 172.21.15.50:0/4242595244 conn(0x7fb6940b23e0 msgr2=0x7fb6940b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 -- 172.21.15.50:0/4242595244 shutdown_connections 2023-08-10T10:44:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.676+0000 7fb69a5c2640 1 -- 172.21.15.50:0/4242595244 wait complete. 2023-08-10T10:44:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.678+0000 7fb69a5c2640 1 Processor -- start 2023-08-10T10:44:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.678+0000 7fb69a5c2640 1 -- start start 2023-08-10T10:44:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69406a500 0x7fb69415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6940cda10 0x7fb6940ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940affe0 con 0x7fb6940b2f00 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940af390 con 0x7fb69406a500 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb69a5c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940af0b0 con 0x7fb6940cda10 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb6937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb6937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43404/0 (socket says 172.21.15.50:43404) 2023-08-10T10:44:37.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.679+0000 7fb6937fe640 1 -- 172.21.15.50:0/2616648158 learned_addr learned my addr 172.21.15.50:0/2616648158 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:37.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb698b5f640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6940cda10 0x7fb6940ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb693fff640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69406a500 0x7fb69415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 -- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6940cda10 msgr2=0x7fb6940ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6940cda10 0x7fb6940ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 -- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69406a500 msgr2=0x7fb69415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69406a500 0x7fb69415e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:37.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 -- 172.21.15.50:0/2616648158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009400 con 0x7fb6940b2f00 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb6937fe640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3f0 tx=0x7fb68800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880074e0 con 0x7fb6940b2f00 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688007660 con 0x7fb6940b2f00 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688004a20 con 0x7fb6940b2f00 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69415cd90 con 0x7fb6940b2f00 2023-08-10T10:44:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.680+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69415d350 con 0x7fb6940b2f00 2023-08-10T10:44:37.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.682+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69415d570 con 0x7fb6940b2f00 2023-08-10T10:44:37.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.683+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb688004b80 con 0x7fb6940b2f00 2023-08-10T10:44:37.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.683+0000 7fb690ff9640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 0x7fb68006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:37.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.684+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb688089250 con 0x7fb6940b2f00 2023-08-10T10:44:37.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.684+0000 7fb693fff640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 0x7fb68006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:37.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.685+0000 7fb693fff640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 0x7fb68006d110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb684007fd0 tx=0x7fb684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:37.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.688+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb6880542f0 con 0x7fb6940b2f00 2023-08-10T10:44:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:37.917+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb6940612b0 con 0x7fb6940b2f00 2023-08-10T10:44:38.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.546+0000 7fb690ff9640 1 -- 172.21.15.50:0/2616648158 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb688057910 con 0x7fb6940b2f00 2023-08-10T10:44:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.549+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 msgr2=0x7fb68006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.549+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 0x7fb68006d110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb684007fd0 tx=0x7fb684009040 comp rx=0 tx=0).stop 2023-08-10T10:44:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.549+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 msgr2=0x7fb6940ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.549+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3f0 tx=0x7fb68800c8b0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 shutdown_connections 2023-08-10T10:44:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6940cda10 0x7fb6940ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6940b2f00 0x7fb6940ae6c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb68006ac50 0x7fb68006d110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 --2- 172.21.15.50:0/2616648158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb69406a500 0x7fb69415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 >> 172.21.15.50:0/2616648158 conn(0x7fb6940b23e0 msgr2=0x7fb6940b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:38.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 shutdown_connections 2023-08-10T10:44:38.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.550+0000 7fb69a5c2640 1 -- 172.21.15.50:0/2616648158 wait complete. 2023-08-10T10:44:38.575 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:44:38.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:44:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.809+0000 7f5fdd714640 1 Processor -- start 2023-08-10T10:44:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.809+0000 7f5fdd714640 1 -- start start 2023-08-10T10:44:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.810+0000 7f5fdd714640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fd80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fdd714640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fd8069db0 0x7f5fd815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fdd714640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd815aee0 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fdd714640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd80b2100 con 0x7f5fd8069db0 2023-08-10T10:44:38.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fdd714640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd815b1a0 con 0x7f5fd81583c0 2023-08-10T10:44:38.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fd77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fd80b1ba0 0x7f5fd80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39872/0 (socket says 172.21.15.50:39872) 2023-08-10T10:44:38.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.811+0000 7f5fd77fe640 1 -- 172.21.15.50:0/1672680137 learned_addr learned my addr 172.21.15.50:0/1672680137 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fd80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fdcf13640 1 --2- 172.21.15.50:0/1672680137 >> v2:172.21.15.117:3300/0 conn(0x7f5fd8069db0 0x7f5fd815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846287190 0 0) 0x7f5fd815aee0 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc0003520 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082021316 0 0) 0x7f5fc0003520 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 msgr2=0x7f5fd80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fd80b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 >> v2:172.21.15.117:3300/0 conn(0x7f5fd8069db0 msgr2=0x7f5fd815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 --2- 172.21.15.50:0/1672680137 >> v2:172.21.15.117:3300/0 conn(0x7f5fd8069db0 0x7f5fd815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd815b480 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5fcc001670 con 0x7f5fd80b1ba0 2023-08-10T10:44:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.812+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 >> v1:172.21.15.50:6789/0 conn(0x7f5fd80b1ba0 legacy=0x7f5fd80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fc0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc00047c0 0x7f5fc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80b2100 con 0x7f5fc00039e0 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd815b1a0 con 0x7f5fc00047c0 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc000b980 con 0x7f5fd81583c0 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fc0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd77fe640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc00047c0 0x7f5fc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fdcf13640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd7fff640 1 -- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 msgr2=0x7f5fc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd7fff640 1 -- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc00047c0 msgr2=0x7f5fc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.813+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc00047c0 0x7f5fc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.814+0000 7f5fd7fff640 1 -- 172.21.15.50:0/1672680137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0003520 con 0x7f5fc00039e0 2023-08-10T10:44:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.814+0000 7f5fdcf13640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd81583c0 0x7f5fc0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fc0003e00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009af0 tx=0x7f5fc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8350024fea0c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802c6b0 con 0x7f5fc00039e0 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc802c810 con 0x7f5fc00039e0 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fd6ffd640 1 -- 172.21.15.50:0/1672680137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802cba0 con 0x7f5fc00039e0 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fdd714640 1 -- 172.21.15.50:0/1672680137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 msgr2=0x7f5fc0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fdd714640 1 --2- 172.21.15.50:0/1672680137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fc0003e00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009af0 tx=0x7f5fc00057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.815+0000 7f5fdcf13640 1 -- 172.21.15.50:0/1672680137 reap_dead start 2023-08-10T10:44:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.816+0000 7f5fdd714640 1 -- 172.21.15.50:0/1672680137 shutdown_connections 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.816+0000 7f5fdd714640 1 -- 172.21.15.50:0/1672680137 >> 172.21.15.50:0/1672680137 conn(0x7f5fd80caf80 msgr2=0x7f5fd80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.816+0000 7f5fdd714640 1 -- 172.21.15.50:0/1672680137 shutdown_connections 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.816+0000 7f5fdd714640 1 -- 172.21.15.50:0/1672680137 wait complete. 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.817+0000 7f5fdd714640 1 Processor -- start 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.818+0000 7f5fdd714640 1 -- start start 2023-08-10T10:44:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 0x7f5fd80c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd80c9b80 0x7f5fd80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80ca550 con 0x7f5fc00039e0 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd806e8a0 con 0x7f5fd80c9b80 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fdd714640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8150f70 con 0x7f5fd8166030 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43422/0 (socket says 172.21.15.50:43422) 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 -- 172.21.15.50:0/2724389699 learned_addr learned my addr 172.21.15.50:0/2724389699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd77fe640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 0x7f5fd80c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 -- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 msgr2=0x7f5fd80c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 0x7f5fd80c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 -- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd80c9b80 msgr2=0x7f5fd80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd80c9b80 0x7f5fd80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd7fff640 1 -- 172.21.15.50:0/2724389699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80c3970 con 0x7f5fc00039e0 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.819+0000 7f5fd77fe640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 0x7f5fd80c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fd7fff640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8037040 tx=0x7f5fc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8003810 con 0x7f5fc00039e0 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8003970 con 0x7f5fc00039e0 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8003ce0 con 0x7f5fc00039e0 2023-08-10T10:44:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd80c7a40 con 0x7f5fc00039e0 2023-08-10T10:44:38.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.820+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd80c3ef0 con 0x7f5fc00039e0 2023-08-10T10:44:38.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.821+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd8066e30 con 0x7f5fc00039e0 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.822+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fc8034440 con 0x7f5fc00039e0 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.823+0000 7f5fd4ff9640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 0x7f5fc406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.823+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fc80ab440 con 0x7f5fc00039e0 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.824+0000 7f5fd77fe640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 0x7f5fc406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.824+0000 7f5fd77fe640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 0x7f5fc406d110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc000f60 tx=0x7f5fcc000ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:38.828+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5fc8076620 con 0x7f5fc00039e0 2023-08-10T10:44:39.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.054+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5fd8159a90 con 0x7f5fc00039e0 2023-08-10T10:44:39.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.550+0000 7f5fd4ff9640 1 -- 172.21.15.50:0/2724389699 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5fc80044e0 con 0x7f5fc00039e0 2023-08-10T10:44:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.553+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 msgr2=0x7f5fc406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.553+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 0x7f5fc406d110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc000f60 tx=0x7f5fcc000ef0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.553+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 msgr2=0x7f5fd8150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.553+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8037040 tx=0x7f5fc8004730 comp rx=0 tx=0).stop 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.553+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 shutdown_connections 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fc406ac50 0x7f5fc406d110 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd80c9b80 0x7f5fd80ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd8166030 0x7f5fd80c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 --2- 172.21.15.50:0/2724389699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc00039e0 0x7f5fd8150a30 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 >> 172.21.15.50:0/2724389699 conn(0x7f5fd80caf80 msgr2=0x7f5fd80696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 shutdown_connections 2023-08-10T10:44:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.554+0000 7f5fdd714640 1 -- 172.21.15.50:0/2724389699 wait complete. 2023-08-10T10:44:39.575 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:44:39.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.804+0000 7f88d6a87640 1 Processor -- start 2023-08-10T10:44:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.804+0000 7f88d6a87640 1 -- start start 2023-08-10T10:44:39.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d6a87640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88d015aa40 0x7f88d00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d6a87640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d0071c70 con 0x7f88d00ca930 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d6a87640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d006a4c0 con 0x7f88d00b0c60 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d6a87640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00713d0 con 0x7f88d015aa40 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d4823640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88d015aa40 0x7f88d00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d5024640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88d00ca930 0x7f88d0069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39878/0 (socket says 172.21.15.50:39878) 2023-08-10T10:44:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.806+0000 7f88d5024640 1 -- 172.21.15.50:0/1031746749 learned_addr learned my addr 172.21.15.50:0/1031746749 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.807+0000 7f88d4823640 1 -- 172.21.15.50:0/1031746749 >> v1:172.21.15.117:6789/0 conn(0x7f88d00b0c60 legacy=0x7f88d00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.807+0000 7f88d4823640 1 -- 172.21.15.50:0/1031746749 >> v1:172.21.15.50:6789/0 conn(0x7f88d00ca930 legacy=0x7f88d0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.807+0000 7f88d4823640 1 -- 172.21.15.50:0/1031746749 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00716b0 con 0x7f88d015aa40 2023-08-10T10:44:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.807+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1031746749 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199250477 0 0) 0x7f88d0071c70 con 0x7f88d00ca930 2023-08-10T10:44:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.808+0000 7f88d4823640 1 --2- 172.21.15.50:0/1031746749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d015aa40 0x7f88d00b3820 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f88c40097a0 tx=0x7f88c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47ccc8d68c1fdab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.808+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1031746749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c402e070 con 0x7f88d015aa40 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.808+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1031746749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c40315a0 con 0x7f88d015aa40 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.808+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1031746749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4031930 con 0x7f88d015aa40 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 -- 172.21.15.50:0/1031746749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d015aa40 msgr2=0x7f88d00b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 --2- 172.21.15.50:0/1031746749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d015aa40 0x7f88d00b3820 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f88c40097a0 tx=0x7f88c402b840 comp rx=0 tx=0).stop 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 -- 172.21.15.50:0/1031746749 shutdown_connections 2023-08-10T10:44:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 --2- 172.21.15.50:0/1031746749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d015aa40 0x7f88d00b3820 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 -- 172.21.15.50:0/1031746749 >> 172.21.15.50:0/1031746749 conn(0x7f88d006b590 msgr2=0x7f88d00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 -- 172.21.15.50:0/1031746749 shutdown_connections 2023-08-10T10:44:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.809+0000 7f88d6a87640 1 -- 172.21.15.50:0/1031746749 wait complete. 2023-08-10T10:44:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.811+0000 7f88d6a87640 1 Processor -- start 2023-08-10T10:44:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.811+0000 7f88d6a87640 1 -- start start 2023-08-10T10:44:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88d00ca930 0x7f88d0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88d015aa40 0x7f88d015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d015d450 con 0x7f88d00b0c60 2023-08-10T10:44:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00c67e0 con 0x7f88d00ca930 2023-08-10T10:44:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.812+0000 7f88d6a87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00c77b0 con 0x7f88d015aa40 2023-08-10T10:44:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43440/0 (socket says 172.21.15.50:43440) 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 -- 172.21.15.50:0/2460522039 learned_addr learned my addr 172.21.15.50:0/2460522039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88cffff640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88d00ca930 0x7f88d0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d5024640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88d015aa40 0x7f88d015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 -- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88d015aa40 msgr2=0x7f88d015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88d015aa40 0x7f88d015c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 -- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88d00ca930 msgr2=0x7f88d0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88d00ca930 0x7f88d0159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.813+0000 7f88d4823640 1 -- 172.21.15.50:0/2460522039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4009400 con 0x7f88d00b0c60 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88d4823640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f88c40097a0 tx=0x7f88c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4004230 con 0x7f88d00b0c60 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c40043b0 con 0x7f88d00b0c60 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4004520 con 0x7f88d00b0c60 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d00c69f0 con 0x7f88d00b0c60 2023-08-10T10:44:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.814+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d00c6fb0 con 0x7f88d00b0c60 2023-08-10T10:44:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.815+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d004e270 con 0x7f88d00b0c60 2023-08-10T10:44:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.816+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88c4032880 con 0x7f88d00b0c60 2023-08-10T10:44:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.817+0000 7f88cd7fa640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 0x7f88b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.817+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88c40ab7a0 con 0x7f88d00b0c60 2023-08-10T10:44:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.818+0000 7f88cffff640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 0x7f88b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.818+0000 7f88cffff640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 0x7f88b406d110 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88d015a380 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:39.822+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88c40767b0 con 0x7f88d00b0c60 2023-08-10T10:44:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.049+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88d004e270 con 0x7f88d00b0c60 2023-08-10T10:44:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.051+0000 7f88cd7fa640 1 -- 172.21.15.50:0/2460522039 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f88c4079dd0 con 0x7f88d00b0c60 2023-08-10T10:44:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:40.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:44:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:44:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 msgr2=0x7f88b406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 0x7f88b406d110 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88d015a380 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2023-08-10T10:44:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 msgr2=0x7f88d01595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f88c40097a0 tx=0x7f88c40046c0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 shutdown_connections 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88d015aa40 0x7f88d015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88b406ac50 0x7f88b406d110 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88d00ca930 0x7f88d0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 --2- 172.21.15.50:0/2460522039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d00b0c60 0x7f88d01595b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 >> 172.21.15.50:0/2460522039 conn(0x7f88d006b590 msgr2=0x7f88d0157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.053+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 shutdown_connections 2023-08-10T10:44:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.054+0000 7f88d6a87640 1 -- 172.21.15.50:0/2460522039 wait complete. 2023-08-10T10:44:40.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:44:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.281+0000 7fe441f8b640 1 Processor -- start 2023-08-10T10:44:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.281+0000 7fe441f8b640 1 -- start start 2023-08-10T10:44:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe441f8b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe43c0b3f30 0x7fe43c0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe441f8b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c071c70 con 0x7fe43c0b0c60 2023-08-10T10:44:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe441f8b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c0713d0 con 0x7fe43c15aa40 2023-08-10T10:44:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe441f8b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c0716b0 con 0x7fe43c0b3f30 2023-08-10T10:44:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe43affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe43c0b0c60 0x7fe43c0c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39892/0 (socket says 172.21.15.50:39892) 2023-08-10T10:44:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.283+0000 7fe43affd640 1 -- 172.21.15.50:0/3979021524 learned_addr learned my addr 172.21.15.50:0/3979021524 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43bfff640 1 --2- 172.21.15.50:0/3979021524 >> v2:172.21.15.50:3300/0 conn(0x7fe43c0b3f30 0x7fe43c0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354654290 0 0) 0x7fe43c071c70 con 0x7fe43c0b0c60 2023-08-10T10:44:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe424003520 con 0x7fe43c0b0c60 2023-08-10T10:44:40.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43bfff640 1 -- 172.21.15.50:0/3979021524 >> v1:172.21.15.117:6789/0 conn(0x7fe43c15aa40 legacy=0x7fe43c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43bfff640 1 -- 172.21.15.50:0/3979021524 >> v1:172.21.15.50:6789/0 conn(0x7fe43c0b0c60 legacy=0x7fe43c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470385376 0 0) 0x7fe424003520 con 0x7fe43c0b0c60 2023-08-10T10:44:40.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.284+0000 7fe43bfff640 1 -- 172.21.15.50:0/3979021524 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c071990 con 0x7fe43c0b3f30 2023-08-10T10:44:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.286+0000 7fe43bfff640 1 --2- 172.21.15.50:0/3979021524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b3f30 0x7fe43c0ca030 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe434009d90 tx=0x7fe43402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf975327f14ee6fd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.286+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430001670 con 0x7fe43c0b3f30 2023-08-10T10:44:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.286+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43402c8b0 con 0x7fe43c0b3f30 2023-08-10T10:44:40.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.286+0000 7fe43a7fc640 1 -- 172.21.15.50:0/3979021524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43402cc40 con 0x7fe43c0b3f30 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 -- 172.21.15.50:0/3979021524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b3f30 msgr2=0x7fe43c0ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 --2- 172.21.15.50:0/3979021524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b3f30 0x7fe43c0ca030 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe434009d90 tx=0x7fe43402bd80 comp rx=0 tx=0).stop 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 -- 172.21.15.50:0/3979021524 shutdown_connections 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 --2- 172.21.15.50:0/3979021524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b3f30 0x7fe43c0ca030 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 -- 172.21.15.50:0/3979021524 >> 172.21.15.50:0/3979021524 conn(0x7fe43c06b590 msgr2=0x7fe43c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 -- 172.21.15.50:0/3979021524 shutdown_connections 2023-08-10T10:44:40.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.287+0000 7fe441f8b640 1 -- 172.21.15.50:0/3979021524 wait complete. 2023-08-10T10:44:40.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.289+0000 7fe441f8b640 1 Processor -- start 2023-08-10T10:44:40.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.289+0000 7fe441f8b640 1 -- start start 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe43c0b3f30 0x7fe43c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43c15aa40 0x7fe43c0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c6d70 con 0x7fe43c0b0c60 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c7740 con 0x7fe43c0b3f30 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe441f8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c61a0 con 0x7fe43c15aa40 2023-08-10T10:44:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe43b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe43b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43452/0 (socket says 172.21.15.50:43452) 2023-08-10T10:44:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.290+0000 7fe43b7fe640 1 -- 172.21.15.50:0/1185051364 learned_addr learned my addr 172.21.15.50:0/1185051364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43affd640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe43c0b3f30 0x7fe43c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43bfff640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43c15aa40 0x7fe43c0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 -- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43c15aa40 msgr2=0x7fe43c0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43c15aa40 0x7fe43c0b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 -- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe43c0b3f30 msgr2=0x7fe43c14e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe43c0b3f30 0x7fe43c14e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 -- 172.21.15.50:0/1185051364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434009a70 con 0x7fe43c0b0c60 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.291+0000 7fe43b7fe640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c430 tx=0x7fe42c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.292+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0052d0 con 0x7fe43c0b0c60 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.292+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c005430 con 0x7fe43c0b0c60 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.292+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c003830 con 0x7fe43c0b0c60 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.292+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c0c6440 con 0x7fe43c0b0c60 2023-08-10T10:44:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.292+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c0c6a00 con 0x7fe43c0b0c60 2023-08-10T10:44:40.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.293+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c0c6bc0 con 0x7fe43c0b0c60 2023-08-10T10:44:40.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.294+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe42c003990 con 0x7fe43c0b0c60 2023-08-10T10:44:40.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.295+0000 7fe423fff640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 0x7fe42806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.295+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe42c088b90 con 0x7fe43c0b0c60 2023-08-10T10:44:40.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.295+0000 7fe43affd640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 0x7fe42806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.296+0000 7fe43affd640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 0x7fe42806d110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe43c14f350 tx=0x7fe430009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.299+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe42c057630 con 0x7fe43c0b0c60 2023-08-10T10:44:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.492+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe43c04e270 con 0x7fe43c0b0c60 2023-08-10T10:44:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.494+0000 7fe423fff640 1 -- 172.21.15.50:0/1185051364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18293 (secure 0 0 0) 0x7fe42c001120 con 0x7fe43c0b0c60 2023-08-10T10:44:40.497 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:40.497 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":110,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:44:37.522156+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:44:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 msgr2=0x7fe42806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 0x7fe42806d110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe43c14f350 tx=0x7fe430009040 comp rx=0 tx=0).stop 2023-08-10T10:44:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 msgr2=0x7fe43c0c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c430 tx=0x7fe42c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 shutdown_connections 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43c15aa40 0x7fe43c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe42806ac50 0x7fe42806d110 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.497+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe43c0b3f30 0x7fe43c14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.498+0000 7fe441f8b640 1 --2- 172.21.15.50:0/1185051364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe43c0b0c60 0x7fe43c0c7200 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.498+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 >> 172.21.15.50:0/1185051364 conn(0x7fe43c06b590 msgr2=0x7fe43c1596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.498+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 shutdown_connections 2023-08-10T10:44:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.498+0000 7fe441f8b640 1 -- 172.21.15.50:0/1185051364 wait complete. 2023-08-10T10:44:40.517 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:44:40.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:44:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.736+0000 7fdc8e114640 1 Processor -- start 2023-08-10T10:44:40.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.736+0000 7fdc8e114640 1 -- start start 2023-08-10T10:44:40.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8e114640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc881600f0 0x7fdc880ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8e114640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880b0390 0x7fdc880cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8e114640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc881604d0 con 0x7fdc880aff10 2023-08-10T10:44:40.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8e114640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc880cca30 con 0x7fdc881600f0 2023-08-10T10:44:40.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8e114640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880cc100 con 0x7fdc880b0390 2023-08-10T10:44:40.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8d112640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc881600f0 0x7fdc880ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8c911640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc880aff10 0x7fdc880ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39898/0 (socket says 172.21.15.50:39898) 2023-08-10T10:44:40.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8c911640 1 -- 172.21.15.50:0/3951280101 learned_addr learned my addr 172.21.15.50:0/3951280101 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.738+0000 7fdc8d913640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880b0390 0x7fdc880cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.739+0000 7fdc8d112640 1 -- 172.21.15.50:0/3951280101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880b0390 msgr2=0x7fdc880cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.739+0000 7fdc8d112640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880b0390 0x7fdc880cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.739+0000 7fdc8d112640 1 -- 172.21.15.50:0/3951280101 >> v1:172.21.15.50:6789/0 conn(0x7fdc880aff10 legacy=0x7fdc880ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.739+0000 7fdc7ffff640 1 -- 172.21.15.50:0/3951280101 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558966612 0 0) 0x7fdc881604d0 con 0x7fdc880aff10 2023-08-10T10:44:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.739+0000 7fdc8d112640 1 -- 172.21.15.50:0/3951280101 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880cc3e0 con 0x7fdc881600f0 2023-08-10T10:44:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.740+0000 7fdc8d112640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc881600f0 0x7fdc880ac890 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdc840097a0 tx=0x7fdc8402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4872b4e5a3f7d27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.740+0000 7fdc7ffff640 1 -- 172.21.15.50:0/3951280101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8402e070 con 0x7fdc881600f0 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.740+0000 7fdc7ffff640 1 -- 172.21.15.50:0/3951280101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc840315a0 con 0x7fdc881600f0 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.740+0000 7fdc7ffff640 1 -- 172.21.15.50:0/3951280101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84031930 con 0x7fdc881600f0 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 -- 172.21.15.50:0/3951280101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc881600f0 msgr2=0x7fdc880ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc881600f0 0x7fdc880ac890 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdc840097a0 tx=0x7fdc8402b840 comp rx=0 tx=0).stop 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 -- 172.21.15.50:0/3951280101 shutdown_connections 2023-08-10T10:44:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880b0390 0x7fdc880cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3951280101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc881600f0 0x7fdc880ac890 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 -- 172.21.15.50:0/3951280101 >> 172.21.15.50:0/3951280101 conn(0x7fdc8806ab80 msgr2=0x7fdc8806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 -- 172.21.15.50:0/3951280101 shutdown_connections 2023-08-10T10:44:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.741+0000 7fdc8e114640 1 -- 172.21.15.50:0/3951280101 wait complete. 2023-08-10T10:44:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.743+0000 7fdc8e114640 1 Processor -- start 2023-08-10T10:44:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.743+0000 7fdc8e114640 1 -- start start 2023-08-10T10:44:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880aff10 0x7fdc88155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc881600f0 0x7fdc880b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b3750 con 0x7fdc880b0390 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b3b70 con 0x7fdc881600f0 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8e114640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881562f0 con 0x7fdc880aff10 2023-08-10T10:44:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8c911640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8c911640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43464/0 (socket says 172.21.15.50:43464) 2023-08-10T10:44:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.744+0000 7fdc8c911640 1 -- 172.21.15.50:0/3145738425 learned_addr learned my addr 172.21.15.50:0/3145738425 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 -- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880aff10 msgr2=0x7fdc88155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880aff10 0x7fdc88155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 -- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc881600f0 msgr2=0x7fdc880b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc881600f0 0x7fdc880b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 -- 172.21.15.50:0/3145738425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009400 con 0x7fdc880b0390 2023-08-10T10:44:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8c911640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c500 tx=0x7fdc7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78007560 con 0x7fdc880b0390 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc780047e0 con 0x7fdc880b0390 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78004b90 con 0x7fdc880b0390 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc880b2ad0 con 0x7fdc880b0390 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.745+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc880b3090 con 0x7fdc880b0390 2023-08-10T10:44:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.746+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880b3890 con 0x7fdc880b0390 2023-08-10T10:44:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.747+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc78004cf0 con 0x7fdc880b0390 2023-08-10T10:44:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.748+0000 7fdc7dffb640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 0x7fdc6c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.748+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc78088640 con 0x7fdc880b0390 2023-08-10T10:44:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.749+0000 7fdc8d112640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 0x7fdc6c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.749+0000 7fdc8d112640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 0x7fdc6c06d110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc84030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.752+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc880b3890 con 0x7fdc880b0390 2023-08-10T10:44:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.930+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc880b0800 con 0x7fdc6c06ac50 2023-08-10T10:44:40.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.954+0000 7fdc7dffb640 1 -- 172.21.15.50:0/3145738425 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303150 (secure 0 0 0) 0x7fdc840319d0 con 0x7fdc6c06ac50 2023-08-10T10:44:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:40.961 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:44:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 msgr2=0x7fdc6c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 0x7fdc6c06d110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc84030000 comp rx=0 tx=0).stop 2023-08-10T10:44:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 msgr2=0x7fdc880b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c500 tx=0x7fdc7800c9c0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 shutdown_connections 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6c06ac50 0x7fdc6c06d110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc881600f0 0x7fdc880b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc880b0390 0x7fdc880b1f10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 --2- 172.21.15.50:0/3145738425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc880aff10 0x7fdc88155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 >> 172.21.15.50:0/3145738425 conn(0x7fdc8806ab80 msgr2=0x7fdc880ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 shutdown_connections 2023-08-10T10:44:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:40.961+0000 7fdc8e114640 1 -- 172.21.15.50:0/3145738425 wait complete. 2023-08-10T10:44:40.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-08-10T10:44:40.451357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6144,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556355,"statfs":{"total":1600000000,"available":1593708534,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.985508"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535288+0000","last_change":"2023-08-10T10:44:36.518503+0000","last_active":"2023-08-10T10:44:37.535288+0000","last_peered":"2023-08-10T10:44:37.535288+0000","last_clean":"2023-08-10T10:44:37.535288+0000","last_became_active":"2023-08-10T10:44:36.518080+0000","last_became_peered":"2023-08-10T10:44:36.518080+0000","last_unstale":"2023-08-10T10:44:37.535288+0000","last_undegraded":"2023-08-10T10:44:37.535288+0000","last_fullsized":"2023-08-10T10:44:37.535288+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:05.169919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.171779+0000","last_change":"2023-08-10T10:44:36.507554+0000","last_active":"2023-08-10T10:44:38.171779+0000","last_peered":"2023-08-10T10:44:38.171779+0000","last_clean":"2023-08-10T10:44:38.171779+0000","last_became_active":"2023-08-10T10:44:36.506627+0000","last_became_peered":"2023-08-10T10:44:36.506627+0000","last_unstale":"2023-08-10T10:44:38.171779+0000","last_undegraded":"2023-08-10T10:44:38.171779+0000","last_fullsized":"2023-08-10T10:44:38.171779+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:22.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.534697+0000","last_change":"2023-08-10T10:44:36.498617+0000","last_active":"2023-08-10T10:44:37.534697+0000","last_peered":"2023-08-10T10:44:37.534697+0000","last_clean":"2023-08-10T10:44:37.534697+0000","last_became_active":"2023-08-10T10:44:36.497708+0000","last_became_peered":"2023-08-10T10:44:36.497708+0000","last_unstale":"2023-08-10T10:44:37.534697+0000","last_undegraded":"2023-08-10T10:44:37.534697+0000","last_fullsized":"2023-08-10T10:44:37.534697+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:43.537664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.525669+0000","last_change":"2023-08-10T10:44:36.524246+0000","last_active":"2023-08-10T10:44:36.525669+0000","last_peered":"2023-08-10T10:44:36.525669+0000","last_clean":"2023-08-10T10:44:36.525669+0000","last_became_active":"2023-08-10T10:44:36.523996+0000","last_became_peered":"2023-08-10T10:44:36.523996+0000","last_unstale":"2023-08-10T10:44:36.525669+0000","last_undegraded":"2023-08-10T10:44:36.525669+0000","last_fullsized":"2023-08-10T10:44:36.525669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:17.619745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539331+0000","last_change":"2023-08-10T10:44:36.513233+0000","last_active":"2023-08-10T10:44:37.539331+0000","last_peered":"2023-08-10T10:44:37.539331+0000","last_clean":"2023-08-10T10:44:37.539331+0000","last_became_active":"2023-08-10T10:44:36.512988+0000","last_became_peered":"2023-08-10T10:44:36.512988+0000","last_unstale":"2023-08-10T10:44:37.539331+0000","last_undegraded":"2023-08-10T10:44:37.539331+0000","last_fullsized":"2023-08-10T10:44:37.539331+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:37.737621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522026+0000","last_change":"2023-08-10T10:44:36.521785+0000","last_active":"2023-08-10T10:44:36.522026+0000","last_peered":"2023-08-10T10:44:36.522026+0000","last_clean":"2023-08-10T10:44:36.522026+0000","last_became_active":"2023-08-10T10:44:36.521202+0000","last_became_peered":"2023-08-10T10:44:36.521202+0000","last_unstale":"2023-08-10T10:44:36.522026+0000","last_undegraded":"2023-08-10T10:44:36.522026+0000","last_fullsized":"2023-08-10T10:44:36.522026+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:26.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.523079+0000","last_change":"2023-08-10T10:44:36.522991+0000","last_active":"2023-08-10T10:44:36.523079+0000","last_peered":"2023-08-10T10:44:36.523079+0000","last_clean":"2023-08-10T10:44:36.523079+0000","last_became_active":"2023-08-10T10:44:36.522718+0000","last_became_peered":"2023-08-10T10:44:36.522718+0000","last_unstale":"2023-08-10T10:44:36.523079+0000","last_undegraded":"2023-08-10T10:44:36.523079+0000","last_fullsized":"2023-08-10T10:44:36.523079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:28.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521157+0000","last_change":"2023-08-10T10:44:36.520906+0000","last_active":"2023-08-10T10:44:36.521157+0000","last_peered":"2023-08-10T10:44:36.521157+0000","last_clean":"2023-08-10T10:44:36.521157+0000","last_became_active":"2023-08-10T10:44:36.519367+0000","last_became_peered":"2023-08-10T10:44:36.519367+0000","last_unstale":"2023-08-10T10:44:36.521157+0000","last_undegraded":"2023-08-10T10:44:36.521157+0000","last_fullsized":"2023-08-10T10:44:36.521157+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:38.469361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.538694+0000","last_change":"2023-08-10T10:44:36.514320+0000","last_active":"2023-08-10T10:44:37.538694+0000","last_peered":"2023-08-10T10:44:37.538694+0000","last_clean":"2023-08-10T10:44:37.538694+0000","last_became_active":"2023-08-10T10:44:36.511014+0000","last_became_peered":"2023-08-10T10:44:36.511014+0000","last_unstale":"2023-08-10T10:44:37.538694+0000","last_undegraded":"2023-08-10T10:44:37.538694+0000","last_fullsized":"2023-08-10T10:44:37.538694+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:25.664286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594992+0000","last_change":"2023-08-10T10:44:36.516489+0000","last_active":"2023-08-10T10:44:37.594992+0000","last_peered":"2023-08-10T10:44:37.594992+0000","last_clean":"2023-08-10T10:44:37.594992+0000","last_became_active":"2023-08-10T10:44:36.516222+0000","last_became_peered":"2023-08-10T10:44:36.516222+0000","last_unstale":"2023-08-10T10:44:37.594992+0000","last_undegraded":"2023-08-10T10:44:37.594992+0000","last_fullsized":"2023-08-10T10:44:37.594992+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:21:25.631903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539594+0000","last_change":"2023-08-10T10:44:36.517951+0000","last_active":"2023-08-10T10:44:37.539594+0000","last_peered":"2023-08-10T10:44:37.539594+0000","last_clean":"2023-08-10T10:44:37.539594+0000","last_became_active":"2023-08-10T10:44:36.517640+0000","last_became_peered":"2023-08-10T10:44:36.517640+0000","last_unstale":"2023-08-10T10:44:37.539594+0000","last_undegraded":"2023-08-10T10:44:37.539594+0000","last_fullsized":"2023-08-10T10:44:37.539594+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:47:38.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594475+0000","last_change":"2023-08-10T10:44:36.510291+0000","last_active":"2023-08-10T10:44:37.594475+0000","last_peered":"2023-08-10T10:44:37.594475+0000","last_clean":"2023-08-10T10:44:37.594475+0000","last_became_active":"2023-08-10T10:44:36.509752+0000","last_became_peered":"2023-08-10T10:44:36.509752+0000","last_unstale":"2023-08-10T10:44:37.594475+0000","last_undegraded":"2023-08-10T10:44:37.594475+0000","last_fullsized":"2023-08-10T10:44:37.594475+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:57.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521136+0000","last_change":"2023-08-10T10:44:36.520755+0000","last_active":"2023-08-10T10:44:36.521136+0000","last_peered":"2023-08-10T10:44:36.521136+0000","last_clean":"2023-08-10T10:44:36.521136+0000","last_became_active":"2023-08-10T10:44:36.516542+0000","last_became_peered":"2023-08-10T10:44:36.516542+0000","last_unstale":"2023-08-10T10:44:36.521136+0000","last_undegraded":"2023-08-10T10:44:36.521136+0000","last_fullsized":"2023-08-10T10:44:36.521136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:43.612964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539356+0000","last_change":"2023-08-10T10:44:36.516003+0000","last_active":"2023-08-10T10:44:37.539356+0000","last_peered":"2023-08-10T10:44:37.539356+0000","last_clean":"2023-08-10T10:44:37.539356+0000","last_became_active":"2023-08-10T10:44:36.515028+0000","last_became_peered":"2023-08-10T10:44:36.515028+0000","last_unstale":"2023-08-10T10:44:37.539356+0000","last_undegraded":"2023-08-10T10:44:37.539356+0000","last_fullsized":"2023-08-10T10:44:37.539356+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:09.905970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517201+0000","last_change":"2023-08-10T10:44:36.516432+0000","last_active":"2023-08-10T10:44:36.517201+0000","last_peered":"2023-08-10T10:44:36.517201+0000","last_clean":"2023-08-10T10:44:36.517201+0000","last_became_active":"2023-08-10T10:44:36.515370+0000","last_became_peered":"2023-08-10T10:44:36.515370+0000","last_unstale":"2023-08-10T10:44:36.517201+0000","last_undegraded":"2023-08-10T10:44:36.517201+0000","last_fullsized":"2023-08-10T10:44:36.517201+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:23:12.551859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521597+0000","last_change":"2023-08-10T10:44:36.518291+0000","last_active":"2023-08-10T10:44:36.521597+0000","last_peered":"2023-08-10T10:44:36.521597+0000","last_clean":"2023-08-10T10:44:36.521597+0000","last_became_active":"2023-08-10T10:44:36.517482+0000","last_became_peered":"2023-08-10T10:44:36.517482+0000","last_unstale":"2023-08-10T10:44:36.521597+0000","last_undegraded":"2023-08-10T10:44:36.521597+0000","last_fullsized":"2023-08-10T10:44:36.521597+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:48.890172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.526665+0000","last_change":"2023-08-10T10:44:36.526495+0000","last_active":"2023-08-10T10:44:36.526665+0000","last_peered":"2023-08-10T10:44:36.526665+0000","last_clean":"2023-08-10T10:44:36.526665+0000","last_became_active":"2023-08-10T10:44:36.526190+0000","last_became_peered":"2023-08-10T10:44:36.526190+0000","last_unstale":"2023-08-10T10:44:36.526665+0000","last_undegraded":"2023-08-10T10:44:36.526665+0000","last_fullsized":"2023-08-10T10:44:36.526665+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:27.948171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535410+0000","last_change":"2023-08-10T10:44:36.515508+0000","last_active":"2023-08-10T10:44:37.535410+0000","last_peered":"2023-08-10T10:44:37.535410+0000","last_clean":"2023-08-10T10:44:37.535410+0000","last_became_active":"2023-08-10T10:44:36.514912+0000","last_became_peered":"2023-08-10T10:44:36.514912+0000","last_unstale":"2023-08-10T10:44:37.535410+0000","last_undegraded":"2023-08-10T10:44:37.535410+0000","last_fullsized":"2023-08-10T10:44:37.535410+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:42.971480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.538891+0000","last_change":"2023-08-10T10:44:36.515840+0000","last_active":"2023-08-10T10:44:37.538891+0000","last_peered":"2023-08-10T10:44:37.538891+0000","last_clean":"2023-08-10T10:44:37.538891+0000","last_became_active":"2023-08-10T10:44:36.514645+0000","last_became_peered":"2023-08-10T10:44:36.514645+0000","last_unstale":"2023-08-10T10:44:37.538891+0000","last_undegraded":"2023-08-10T10:44:37.538891+0000","last_fullsized":"2023-08-10T10:44:37.538891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:21.997960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517222+0000","last_change":"2023-08-10T10:44:36.517017+0000","last_active":"2023-08-10T10:44:36.517222+0000","last_peered":"2023-08-10T10:44:36.517222+0000","last_clean":"2023-08-10T10:44:36.517222+0000","last_became_active":"2023-08-10T10:44:36.515766+0000","last_became_peered":"2023-08-10T10:44:36.515766+0000","last_unstale":"2023-08-10T10:44:36.517222+0000","last_undegraded":"2023-08-10T10:44:36.517222+0000","last_fullsized":"2023-08-10T10:44:36.517222+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:53:26.495365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539948+0000","last_change":"2023-08-10T10:44:36.515497+0000","last_active":"2023-08-10T10:44:37.539948+0000","last_peered":"2023-08-10T10:44:37.539948+0000","last_clean":"2023-08-10T10:44:37.539948+0000","last_became_active":"2023-08-10T10:44:36.514617+0000","last_became_peered":"2023-08-10T10:44:36.514617+0000","last_unstale":"2023-08-10T10:44:37.539948+0000","last_undegraded":"2023-08-10T10:44:37.539948+0000","last_fullsized":"2023-08-10T10:44:37.539948+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:07:43.542615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539315+0000","last_change":"2023-08-10T10:44:36.510271+0000","last_active":"2023-08-10T10:44:37.539315+0000","last_peered":"2023-08-10T10:44:37.539315+0000","last_clean":"2023-08-10T10:44:37.539315+0000","last_became_active":"2023-08-10T10:44:36.509743+0000","last_became_peered":"2023-08-10T10:44:36.509743+0000","last_unstale":"2023-08-10T10:44:37.539315+0000","last_undegraded":"2023-08-10T10:44:37.539315+0000","last_fullsized":"2023-08-10T10:44:37.539315+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:27.482350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541079+0000","last_change":"2023-08-10T10:44:36.521919+0000","last_active":"2023-08-10T10:44:37.541079+0000","last_peered":"2023-08-10T10:44:37.541079+0000","last_clean":"2023-08-10T10:44:37.541079+0000","last_became_active":"2023-08-10T10:44:36.521680+0000","last_became_peered":"2023-08-10T10:44:36.521680+0000","last_unstale":"2023-08-10T10:44:37.541079+0000","last_undegraded":"2023-08-10T10:44:37.541079+0000","last_fullsized":"2023-08-10T10:44:37.541079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:37:58.970263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535172+0000","last_change":"2023-08-10T10:44:36.506541+0000","last_active":"2023-08-10T10:44:37.535172+0000","last_peered":"2023-08-10T10:44:37.535172+0000","last_clean":"2023-08-10T10:44:37.535172+0000","last_became_active":"2023-08-10T10:44:36.505676+0000","last_became_peered":"2023-08-10T10:44:36.505676+0000","last_unstale":"2023-08-10T10:44:37.535172+0000","last_undegraded":"2023-08-10T10:44:37.535172+0000","last_fullsized":"2023-08-10T10:44:37.535172+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:30:28.613066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172438+0000","last_change":"2023-08-10T10:44:36.518756+0000","last_active":"2023-08-10T10:44:38.172438+0000","last_peered":"2023-08-10T10:44:38.172438+0000","last_clean":"2023-08-10T10:44:38.172438+0000","last_became_active":"2023-08-10T10:44:36.518514+0000","last_became_peered":"2023-08-10T10:44:36.518514+0000","last_unstale":"2023-08-10T10:44:38.172438+0000","last_undegraded":"2023-08-10T10:44:38.172438+0000","last_fullsized":"2023-08-10T10:44:38.172438+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:59.102269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540407+0000","last_change":"2023-08-10T10:44:36.515678+0000","last_active":"2023-08-10T10:44:37.540407+0000","last_peered":"2023-08-10T10:44:37.540407+0000","last_clean":"2023-08-10T10:44:37.540407+0000","last_became_active":"2023-08-10T10:44:36.515269+0000","last_became_peered":"2023-08-10T10:44:36.515269+0000","last_unstale":"2023-08-10T10:44:37.540407+0000","last_undegraded":"2023-08-10T10:44:37.540407+0000","last_fullsized":"2023-08-10T10:44:37.540407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:19.055523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594728+0000","last_change":"2023-08-10T10:44:36.519881+0000","last_active":"2023-08-10T10:44:37.594728+0000","last_peered":"2023-08-10T10:44:37.594728+0000","last_clean":"2023-08-10T10:44:37.594728+0000","last_became_active":"2023-08-10T10:44:36.518852+0000","last_became_peered":"2023-08-10T10:44:36.518852+0000","last_unstale":"2023-08-10T10:44:37.594728+0000","last_undegraded":"2023-08-10T10:44:37.594728+0000","last_fullsized":"2023-08-10T10:44:37.594728+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:10:06.088551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.520412+0000","last_change":"2023-08-10T10:44:36.520208+0000","last_active":"2023-08-10T10:44:36.520412+0000","last_peered":"2023-08-10T10:44:36.520412+0000","last_clean":"2023-08-10T10:44:36.520412+0000","last_became_active":"2023-08-10T10:44:36.515294+0000","last_became_peered":"2023-08-10T10:44:36.515294+0000","last_unstale":"2023-08-10T10:44:36.520412+0000","last_undegraded":"2023-08-10T10:44:36.520412+0000","last_fullsized":"2023-08-10T10:44:36.520412+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:13.316702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519094+0000","last_change":"2023-08-10T10:44:36.519006+0000","last_active":"2023-08-10T10:44:36.519094+0000","last_peered":"2023-08-10T10:44:36.519094+0000","last_clean":"2023-08-10T10:44:36.519094+0000","last_became_active":"2023-08-10T10:44:36.518215+0000","last_became_peered":"2023-08-10T10:44:36.518215+0000","last_unstale":"2023-08-10T10:44:36.519094+0000","last_undegraded":"2023-08-10T10:44:36.519094+0000","last_fullsized":"2023-08-10T10:44:36.519094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:18.225511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539729+0000","last_change":"2023-08-10T10:44:36.510464+0000","last_active":"2023-08-10T10:44:37.539729+0000","last_peered":"2023-08-10T10:44:37.539729+0000","last_clean":"2023-08-10T10:44:37.539729+0000","last_became_active":"2023-08-10T10:44:36.510216+0000","last_became_peered":"2023-08-10T10:44:36.510216+0000","last_unstale":"2023-08-10T10:44:37.539729+0000","last_undegraded":"2023-08-10T10:44:37.539729+0000","last_fullsized":"2023-08-10T10:44:37.539729+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:58.479391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172136+0000","last_change":"2023-08-10T10:44:36.516945+0000","last_active":"2023-08-10T10:44:38.172136+0000","last_peered":"2023-08-10T10:44:38.172136+0000","last_clean":"2023-08-10T10:44:38.172136+0000","last_became_active":"2023-08-10T10:44:36.516361+0000","last_became_peered":"2023-08-10T10:44:36.516361+0000","last_unstale":"2023-08-10T10:44:38.172136+0000","last_undegraded":"2023-08-10T10:44:38.172136+0000","last_fullsized":"2023-08-10T10:44:38.172136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:17.439338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.525627+0000","last_change":"2023-08-10T10:44:36.525536+0000","last_active":"2023-08-10T10:44:36.525627+0000","last_peered":"2023-08-10T10:44:36.525627+0000","last_clean":"2023-08-10T10:44:36.525627+0000","last_became_active":"2023-08-10T10:44:36.523012+0000","last_became_peered":"2023-08-10T10:44:36.523012+0000","last_unstale":"2023-08-10T10:44:36.525627+0000","last_undegraded":"2023-08-10T10:44:36.525627+0000","last_fullsized":"2023-08-10T10:44:36.525627+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:35.687771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521614+0000","last_change":"2023-08-10T10:44:36.518546+0000","last_active":"2023-08-10T10:44:36.521614+0000","last_peered":"2023-08-10T10:44:36.521614+0000","last_clean":"2023-08-10T10:44:36.521614+0000","last_became_active":"2023-08-10T10:44:36.517863+0000","last_became_peered":"2023-08-10T10:44:36.517863+0000","last_unstale":"2023-08-10T10:44:36.521614+0000","last_undegraded":"2023-08-10T10:44:36.521614+0000","last_fullsized":"2023-08-10T10:44:36.521614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:16:17.129132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"109'4","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541430+0000","last_change":"2023-08-10T10:44:35.512463+0000","last_active":"2023-08-10T10:44:37.541430+0000","last_peered":"2023-08-10T10:44:37.541430+0000","last_clean":"2023-08-10T10:44:37.541430+0000","last_became_active":"2023-08-10T10:44:35.512199+0000","last_became_peered":"2023-08-10T10:44:35.512199+0000","last_unstale":"2023-08-10T10:44:37.541430+0000","last_undegraded":"2023-08-10T10:44:37.541430+0000","last_fullsized":"2023-08-10T10:44:37.541430+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:24.300332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521631+0000","last_change":"2023-08-10T10:44:36.520097+0000","last_active":"2023-08-10T10:44:36.521631+0000","last_peered":"2023-08-10T10:44:36.521631+0000","last_clean":"2023-08-10T10:44:36.521631+0000","last_became_active":"2023-08-10T10:44:36.519836+0000","last_became_peered":"2023-08-10T10:44:36.519836+0000","last_unstale":"2023-08-10T10:44:36.521631+0000","last_undegraded":"2023-08-10T10:44:36.521631+0000","last_fullsized":"2023-08-10T10:44:36.521631+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:23.785682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539232+0000","last_change":"2023-08-10T10:44:35.504981+0000","last_active":"2023-08-10T10:44:37.539232+0000","last_peered":"2023-08-10T10:44:37.539232+0000","last_clean":"2023-08-10T10:44:37.539232+0000","last_became_active":"2023-08-10T10:44:35.503984+0000","last_became_peered":"2023-08-10T10:44:35.503984+0000","last_unstale":"2023-08-10T10:44:37.539232+0000","last_undegraded":"2023-08-10T10:44:37.539232+0000","last_fullsized":"2023-08-10T10:44:37.539232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:58:32.679983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.518545+0000","last_change":"2023-08-10T10:44:36.518466+0000","last_active":"2023-08-10T10:44:36.518545+0000","last_peered":"2023-08-10T10:44:36.518545+0000","last_clean":"2023-08-10T10:44:36.518545+0000","last_became_active":"2023-08-10T10:44:36.517606+0000","last_became_peered":"2023-08-10T10:44:36.517606+0000","last_unstale":"2023-08-10T10:44:36.518545+0000","last_undegraded":"2023-08-10T10:44:36.518545+0000","last_fullsized":"2023-08-10T10:44:36.518545+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:40.769554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.516708+0000","last_change":"2023-08-10T10:44:35.509660+0000","last_active":"2023-08-10T10:44:36.516708+0000","last_peered":"2023-08-10T10:44:36.516708+0000","last_clean":"2023-08-10T10:44:36.516708+0000","last_became_active":"2023-08-10T10:44:35.508182+0000","last_became_peered":"2023-08-10T10:44:35.508182+0000","last_unstale":"2023-08-10T10:44:36.516708+0000","last_undegraded":"2023-08-10T10:44:36.516708+0000","last_fullsized":"2023-08-10T10:44:36.516708+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:14:07.131688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521667+0000","last_change":"2023-08-10T10:44:36.520334+0000","last_active":"2023-08-10T10:44:36.521667+0000","last_peered":"2023-08-10T10:44:36.521667+0000","last_clean":"2023-08-10T10:44:36.521667+0000","last_became_active":"2023-08-10T10:44:36.519909+0000","last_became_peered":"2023-08-10T10:44:36.519909+0000","last_unstale":"2023-08-10T10:44:36.521667+0000","last_undegraded":"2023-08-10T10:44:36.521667+0000","last_fullsized":"2023-08-10T10:44:36.521667+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:01.020144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540499+0000","last_change":"2023-08-10T10:44:35.510417+0000","last_active":"2023-08-10T10:44:37.540499+0000","last_peered":"2023-08-10T10:44:37.540499+0000","last_clean":"2023-08-10T10:44:37.540499+0000","last_became_active":"2023-08-10T10:44:35.510133+0000","last_became_peered":"2023-08-10T10:44:35.510133+0000","last_unstale":"2023-08-10T10:44:37.540499+0000","last_undegraded":"2023-08-10T10:44:37.540499+0000","last_fullsized":"2023-08-10T10:44:37.540499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:29.974151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517285+0000","last_change":"2023-08-10T10:44:36.517177+0000","last_active":"2023-08-10T10:44:36.517285+0000","last_peered":"2023-08-10T10:44:36.517285+0000","last_clean":"2023-08-10T10:44:36.517285+0000","last_became_active":"2023-08-10T10:44:36.516107+0000","last_became_peered":"2023-08-10T10:44:36.516107+0000","last_unstale":"2023-08-10T10:44:36.517285+0000","last_undegraded":"2023-08-10T10:44:36.517285+0000","last_fullsized":"2023-08-10T10:44:36.517285+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:57.483563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540162+0000","last_change":"2023-08-10T10:44:35.500833+0000","last_active":"2023-08-10T10:44:37.540162+0000","last_peered":"2023-08-10T10:44:37.540162+0000","last_clean":"2023-08-10T10:44:37.540162+0000","last_became_active":"2023-08-10T10:44:35.499746+0000","last_became_peered":"2023-08-10T10:44:35.499746+0000","last_unstale":"2023-08-10T10:44:37.540162+0000","last_undegraded":"2023-08-10T10:44:37.540162+0000","last_fullsized":"2023-08-10T10:44:37.540162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:23.488428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540173+0000","last_change":"2023-08-10T10:44:36.523609+0000","last_active":"2023-08-10T10:44:37.540173+0000","last_peered":"2023-08-10T10:44:37.540173+0000","last_clean":"2023-08-10T10:44:37.540173+0000","last_became_active":"2023-08-10T10:44:36.523192+0000","last_became_peered":"2023-08-10T10:44:36.523192+0000","last_unstale":"2023-08-10T10:44:37.540173+0000","last_undegraded":"2023-08-10T10:44:37.540173+0000","last_fullsized":"2023-08-10T10:44:37.540173+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:32.675822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.528205+0000","last_change":"2023-08-10T10:44:35.506120+0000","last_active":"2023-08-10T10:44:36.528205+0000","last_peered":"2023-08-10T10:44:36.528205+0000","last_clean":"2023-08-10T10:44:36.528205+0000","last_became_active":"2023-08-10T10:44:35.505682+0000","last_became_peered":"2023-08-10T10:44:35.505682+0000","last_unstale":"2023-08-10T10:44:36.528205+0000","last_undegraded":"2023-08-10T10:44:36.528205+0000","last_fullsized":"2023-08-10T10:44:36.528205+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:56.136863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522269+0000","last_change":"2023-08-10T10:44:36.522050+0000","last_active":"2023-08-10T10:44:36.522269+0000","last_peered":"2023-08-10T10:44:36.522269+0000","last_clean":"2023-08-10T10:44:36.522269+0000","last_became_active":"2023-08-10T10:44:36.521808+0000","last_became_peered":"2023-08-10T10:44:36.521808+0000","last_unstale":"2023-08-10T10:44:36.522269+0000","last_undegraded":"2023-08-10T10:44:36.522269+0000","last_fullsized":"2023-08-10T10:44:36.522269+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:39:53.555097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535511+0000","last_change":"2023-08-10T10:44:35.507746+0000","last_active":"2023-08-10T10:44:37.535511+0000","last_peered":"2023-08-10T10:44:37.535511+0000","last_clean":"2023-08-10T10:44:37.535511+0000","last_became_active":"2023-08-10T10:44:35.507371+0000","last_became_peered":"2023-08-10T10:44:35.507371+0000","last_unstale":"2023-08-10T10:44:37.535511+0000","last_undegraded":"2023-08-10T10:44:37.535511+0000","last_fullsized":"2023-08-10T10:44:37.535511+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:51.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522223+0000","last_change":"2023-08-10T10:44:36.522125+0000","last_active":"2023-08-10T10:44:36.522223+0000","last_peered":"2023-08-10T10:44:36.522223+0000","last_clean":"2023-08-10T10:44:36.522223+0000","last_became_active":"2023-08-10T10:44:36.521882+0000","last_became_peered":"2023-08-10T10:44:36.521882+0000","last_unstale":"2023-08-10T10:44:36.522223+0000","last_undegraded":"2023-08-10T10:44:36.522223+0000","last_fullsized":"2023-08-10T10:44:36.522223+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:35.104157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508907+0000","last_change":"2023-08-10T10:44:35.510333+0000","last_active":"2023-08-10T10:44:36.508907+0000","last_peered":"2023-08-10T10:44:36.508907+0000","last_clean":"2023-08-10T10:44:36.508907+0000","last_became_active":"2023-08-10T10:44:35.508992+0000","last_became_peered":"2023-08-10T10:44:35.508992+0000","last_unstale":"2023-08-10T10:44:36.508907+0000","last_undegraded":"2023-08-10T10:44:36.508907+0000","last_fullsized":"2023-08-10T10:44:36.508907+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:56:50.446708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539059+0000","last_change":"2023-08-10T10:44:36.508055+0000","last_active":"2023-08-10T10:44:37.539059+0000","last_peered":"2023-08-10T10:44:37.539059+0000","last_clean":"2023-08-10T10:44:37.539059+0000","last_became_active":"2023-08-10T10:44:36.507673+0000","last_became_peered":"2023-08-10T10:44:36.507673+0000","last_unstale":"2023-08-10T10:44:37.539059+0000","last_undegraded":"2023-08-10T10:44:37.539059+0000","last_fullsized":"2023-08-10T10:44:37.539059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:22.024712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172400+0000","last_change":"2023-08-10T10:44:35.510976+0000","last_active":"2023-08-10T10:44:38.172400+0000","last_peered":"2023-08-10T10:44:38.172400+0000","last_clean":"2023-08-10T10:44:38.172400+0000","last_became_active":"2023-08-10T10:44:35.510256+0000","last_became_peered":"2023-08-10T10:44:35.510256+0000","last_unstale":"2023-08-10T10:44:38.172400+0000","last_undegraded":"2023-08-10T10:44:38.172400+0000","last_fullsized":"2023-08-10T10:44:38.172400+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:27:50.088708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.512869+0000","last_change":"2023-08-10T10:44:36.512440+0000","last_active":"2023-08-10T10:44:36.512869+0000","last_peered":"2023-08-10T10:44:36.512869+0000","last_clean":"2023-08-10T10:44:36.512869+0000","last_became_active":"2023-08-10T10:44:36.512212+0000","last_became_peered":"2023-08-10T10:44:36.512212+0000","last_unstale":"2023-08-10T10:44:36.512869+0000","last_undegraded":"2023-08-10T10:44:36.512869+0000","last_fullsized":"2023-08-10T10:44:36.512869+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:12.925129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535955+0000","last_change":"2023-08-10T10:44:35.500163+0000","last_active":"2023-08-10T10:44:37.535955+0000","last_peered":"2023-08-10T10:44:37.535955+0000","last_clean":"2023-08-10T10:44:37.535955+0000","last_became_active":"2023-08-10T10:44:35.499822+0000","last_became_peered":"2023-08-10T10:44:35.499822+0000","last_unstale":"2023-08-10T10:44:37.535955+0000","last_undegraded":"2023-08-10T10:44:37.535955+0000","last_fullsized":"2023-08-10T10:44:37.535955+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:01.026291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535805+0000","last_change":"2023-08-10T10:44:36.524190+0000","last_active":"2023-08-10T10:44:37.535805+0000","last_peered":"2023-08-10T10:44:37.535805+0000","last_clean":"2023-08-10T10:44:37.535805+0000","last_became_active":"2023-08-10T10:44:36.522168+0000","last_became_peered":"2023-08-10T10:44:36.522168+0000","last_unstale":"2023-08-10T10:44:37.535805+0000","last_undegraded":"2023-08-10T10:44:37.535805+0000","last_fullsized":"2023-08-10T10:44:37.535805+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:55.021221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"109'3","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539079+0000","last_change":"2023-08-10T10:44:35.511095+0000","last_active":"2023-08-10T10:44:37.539079+0000","last_peered":"2023-08-10T10:44:37.539079+0000","last_clean":"2023-08-10T10:44:37.539079+0000","last_became_active":"2023-08-10T10:44:35.510855+0000","last_became_peered":"2023-08-10T10:44:35.510855+0000","last_unstale":"2023-08-10T10:44:37.539079+0000","last_undegraded":"2023-08-10T10:44:37.539079+0000","last_fullsized":"2023-08-10T10:44:37.539079+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:37.295955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514458+0000","last_change":"2023-08-10T10:44:36.514262+0000","last_active":"2023-08-10T10:44:36.514458+0000","last_peered":"2023-08-10T10:44:36.514458+0000","last_clean":"2023-08-10T10:44:36.514458+0000","last_became_active":"2023-08-10T10:44:36.514022+0000","last_became_peered":"2023-08-10T10:44:36.514022+0000","last_unstale":"2023-08-10T10:44:36.514458+0000","last_undegraded":"2023-08-10T10:44:36.514458+0000","last_fullsized":"2023-08-10T10:44:36.514458+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:15.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.528488+0000","last_change":"2023-08-10T10:44:35.508029+0000","last_active":"2023-08-10T10:44:36.528488+0000","last_peered":"2023-08-10T10:44:36.528488+0000","last_clean":"2023-08-10T10:44:36.528488+0000","last_became_active":"2023-08-10T10:44:35.507771+0000","last_became_peered":"2023-08-10T10:44:35.507771+0000","last_unstale":"2023-08-10T10:44:36.528488+0000","last_undegraded":"2023-08-10T10:44:36.528488+0000","last_fullsized":"2023-08-10T10:44:36.528488+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:14.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521174+0000","last_change":"2023-08-10T10:44:36.521068+0000","last_active":"2023-08-10T10:44:36.521174+0000","last_peered":"2023-08-10T10:44:36.521174+0000","last_clean":"2023-08-10T10:44:36.521174+0000","last_became_active":"2023-08-10T10:44:36.519960+0000","last_became_peered":"2023-08-10T10:44:36.519960+0000","last_unstale":"2023-08-10T10:44:36.521174+0000","last_undegraded":"2023-08-10T10:44:36.521174+0000","last_fullsized":"2023-08-10T10:44:36.521174+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:41:13.804940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.515817+0000","last_change":"2023-08-10T10:44:35.510566+0000","last_active":"2023-08-10T10:44:36.515817+0000","last_peered":"2023-08-10T10:44:36.515817+0000","last_clean":"2023-08-10T10:44:36.515817+0000","last_became_active":"2023-08-10T10:44:35.509344+0000","last_became_peered":"2023-08-10T10:44:35.509344+0000","last_unstale":"2023-08-10T10:44:36.515817+0000","last_undegraded":"2023-08-10T10:44:36.515817+0000","last_fullsized":"2023-08-10T10:44:36.515817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:56.693156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539623+0000","last_change":"2023-08-10T10:44:36.508005+0000","last_active":"2023-08-10T10:44:37.539623+0000","last_peered":"2023-08-10T10:44:37.539623+0000","last_clean":"2023-08-10T10:44:37.539623+0000","last_became_active":"2023-08-10T10:44:36.507089+0000","last_became_peered":"2023-08-10T10:44:36.507089+0000","last_unstale":"2023-08-10T10:44:37.539623+0000","last_undegraded":"2023-08-10T10:44:37.539623+0000","last_fullsized":"2023-08-10T10:44:37.539623+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:39:39.481385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508533+0000","last_change":"2023-08-10T10:44:35.513291+0000","last_active":"2023-08-10T10:44:36.508533+0000","last_peered":"2023-08-10T10:44:36.508533+0000","last_clean":"2023-08-10T10:44:36.508533+0000","last_became_active":"2023-08-10T10:44:35.512403+0000","last_became_peered":"2023-08-10T10:44:35.512403+0000","last_unstale":"2023-08-10T10:44:36.508533+0000","last_undegraded":"2023-08-10T10:44:36.508533+0000","last_fullsized":"2023-08-10T10:44:36.508533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:15.939903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594217+0000","last_change":"2023-08-10T10:44:36.515405+0000","last_active":"2023-08-10T10:44:37.594217+0000","last_peered":"2023-08-10T10:44:37.594217+0000","last_clean":"2023-08-10T10:44:37.594217+0000","last_became_active":"2023-08-10T10:44:36.515173+0000","last_became_peered":"2023-08-10T10:44:36.515173+0000","last_unstale":"2023-08-10T10:44:37.594217+0000","last_undegraded":"2023-08-10T10:44:37.594217+0000","last_fullsized":"2023-08-10T10:44:37.594217+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:04.296346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507402+0000","last_change":"2023-08-10T10:44:35.507615+0000","last_active":"2023-08-10T10:44:36.507402+0000","last_peered":"2023-08-10T10:44:36.507402+0000","last_clean":"2023-08-10T10:44:36.507402+0000","last_became_active":"2023-08-10T10:44:35.506084+0000","last_became_peered":"2023-08-10T10:44:35.506084+0000","last_unstale":"2023-08-10T10:44:36.507402+0000","last_undegraded":"2023-08-10T10:44:36.507402+0000","last_fullsized":"2023-08-10T10:44:36.507402+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:17.007773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.595380+0000","last_change":"2023-08-10T10:44:36.502337+0000","last_active":"2023-08-10T10:44:37.595380+0000","last_peered":"2023-08-10T10:44:37.595380+0000","last_clean":"2023-08-10T10:44:37.595380+0000","last_became_active":"2023-08-10T10:44:36.501524+0000","last_became_peered":"2023-08-10T10:44:36.501524+0000","last_unstale":"2023-08-10T10:44:37.595380+0000","last_undegraded":"2023-08-10T10:44:37.595380+0000","last_fullsized":"2023-08-10T10:44:37.595380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:35.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":19,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.526143+0000","last_change":"2023-08-10T10:44:35.509636+0000","last_active":"2023-08-10T10:44:36.526143+0000","last_peered":"2023-08-10T10:44:36.526143+0000","last_clean":"2023-08-10T10:44:36.526143+0000","last_became_active":"2023-08-10T10:44:35.509361+0000","last_became_peered":"2023-08-10T10:44:35.509361+0000","last_unstale":"2023-08-10T10:44:36.526143+0000","last_undegraded":"2023-08-10T10:44:36.526143+0000","last_fullsized":"2023-08-10T10:44:36.526143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:44.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541449+0000","last_change":"2023-08-10T10:44:36.520043+0000","last_active":"2023-08-10T10:44:37.541449+0000","last_peered":"2023-08-10T10:44:37.541449+0000","last_clean":"2023-08-10T10:44:37.541449+0000","last_became_active":"2023-08-10T10:44:36.516901+0000","last_became_peered":"2023-08-10T10:44:36.516901+0000","last_unstale":"2023-08-10T10:44:37.541449+0000","last_undegraded":"2023-08-10T10:44:37.541449+0000","last_fullsized":"2023-08-10T10:44:37.541449+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:54.538183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522218+0000","last_change":"2023-08-10T10:44:35.509272+0000","last_active":"2023-08-10T10:44:36.522218+0000","last_peered":"2023-08-10T10:44:36.522218+0000","last_clean":"2023-08-10T10:44:36.522218+0000","last_became_active":"2023-08-10T10:44:35.508599+0000","last_became_peered":"2023-08-10T10:44:35.508599+0000","last_unstale":"2023-08-10T10:44:36.522218+0000","last_undegraded":"2023-08-10T10:44:36.522218+0000","last_fullsized":"2023-08-10T10:44:36.522218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:15.345506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521530+0000","last_change":"2023-08-10T10:44:36.516983+0000","last_active":"2023-08-10T10:44:36.521530+0000","last_peered":"2023-08-10T10:44:36.521530+0000","last_clean":"2023-08-10T10:44:36.521530+0000","last_became_active":"2023-08-10T10:44:36.516663+0000","last_became_peered":"2023-08-10T10:44:36.516663+0000","last_unstale":"2023-08-10T10:44:36.521530+0000","last_undegraded":"2023-08-10T10:44:36.521530+0000","last_fullsized":"2023-08-10T10:44:36.521530+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:03.543690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539227+0000","last_change":"2023-08-10T10:44:35.507355+0000","last_active":"2023-08-10T10:44:37.539227+0000","last_peered":"2023-08-10T10:44:37.539227+0000","last_clean":"2023-08-10T10:44:37.539227+0000","last_became_active":"2023-08-10T10:44:35.507112+0000","last_became_peered":"2023-08-10T10:44:35.507112+0000","last_unstale":"2023-08-10T10:44:37.539227+0000","last_undegraded":"2023-08-10T10:44:37.539227+0000","last_fullsized":"2023-08-10T10:44:37.539227+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:24.207346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521647+0000","last_change":"2023-08-10T10:44:36.520163+0000","last_active":"2023-08-10T10:44:36.521647+0000","last_peered":"2023-08-10T10:44:36.521647+0000","last_clean":"2023-08-10T10:44:36.521647+0000","last_became_active":"2023-08-10T10:44:36.518935+0000","last_became_peered":"2023-08-10T10:44:36.518935+0000","last_unstale":"2023-08-10T10:44:36.521647+0000","last_undegraded":"2023-08-10T10:44:36.521647+0000","last_fullsized":"2023-08-10T10:44:36.521647+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:26.490209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539499+0000","last_change":"2023-08-10T10:44:35.510879+0000","last_active":"2023-08-10T10:44:37.539499+0000","last_peered":"2023-08-10T10:44:37.539499+0000","last_clean":"2023-08-10T10:44:37.539499+0000","last_became_active":"2023-08-10T10:44:35.510535+0000","last_became_peered":"2023-08-10T10:44:35.510535+0000","last_unstale":"2023-08-10T10:44:37.539499+0000","last_undegraded":"2023-08-10T10:44:37.539499+0000","last_fullsized":"2023-08-10T10:44:37.539499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:30.478619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172114+0000","last_change":"2023-08-10T10:44:36.512746+0000","last_active":"2023-08-10T10:44:38.172114+0000","last_peered":"2023-08-10T10:44:38.172114+0000","last_clean":"2023-08-10T10:44:38.172114+0000","last_became_active":"2023-08-10T10:44:36.512478+0000","last_became_peered":"2023-08-10T10:44:36.512478+0000","last_unstale":"2023-08-10T10:44:38.172114+0000","last_undegraded":"2023-08-10T10:44:38.172114+0000","last_fullsized":"2023-08-10T10:44:38.172114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:42:25.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541792+0000","last_change":"2023-08-10T10:44:35.508755+0000","last_active":"2023-08-10T10:44:37.541792+0000","last_peered":"2023-08-10T10:44:37.541792+0000","last_clean":"2023-08-10T10:44:37.541792+0000","last_became_active":"2023-08-10T10:44:35.508489+0000","last_became_peered":"2023-08-10T10:44:35.508489+0000","last_unstale":"2023-08-10T10:44:37.541792+0000","last_undegraded":"2023-08-10T10:44:37.541792+0000","last_fullsized":"2023-08-10T10:44:37.541792+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:39.505891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594391+0000","last_change":"2023-08-10T10:44:36.520177+0000","last_active":"2023-08-10T10:44:37.594391+0000","last_peered":"2023-08-10T10:44:37.594391+0000","last_clean":"2023-08-10T10:44:37.594391+0000","last_became_active":"2023-08-10T10:44:36.519893+0000","last_became_peered":"2023-08-10T10:44:36.519893+0000","last_unstale":"2023-08-10T10:44:37.594391+0000","last_undegraded":"2023-08-10T10:44:37.594391+0000","last_fullsized":"2023-08-10T10:44:37.594391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:51.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508685+0000","last_change":"2023-08-10T10:44:35.513111+0000","last_active":"2023-08-10T10:44:36.508685+0000","last_peered":"2023-08-10T10:44:36.508685+0000","last_clean":"2023-08-10T10:44:36.508685+0000","last_became_active":"2023-08-10T10:44:35.511936+0000","last_became_peered":"2023-08-10T10:44:35.511936+0000","last_unstale":"2023-08-10T10:44:36.508685+0000","last_undegraded":"2023-08-10T10:44:36.508685+0000","last_fullsized":"2023-08-10T10:44:36.508685+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:09:01.961521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535079+0000","last_change":"2023-08-10T10:44:36.516042+0000","last_active":"2023-08-10T10:44:37.535079+0000","last_peered":"2023-08-10T10:44:37.535079+0000","last_clean":"2023-08-10T10:44:37.535079+0000","last_became_active":"2023-08-10T10:44:36.515794+0000","last_became_peered":"2023-08-10T10:44:36.515794+0000","last_unstale":"2023-08-10T10:44:37.535079+0000","last_undegraded":"2023-08-10T10:44:37.535079+0000","last_fullsized":"2023-08-10T10:44:37.535079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:51.940896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172287+0000","last_change":"2023-08-10T10:44:35.508086+0000","last_active":"2023-08-10T10:44:38.172287+0000","last_peered":"2023-08-10T10:44:38.172287+0000","last_clean":"2023-08-10T10:44:38.172287+0000","last_became_active":"2023-08-10T10:44:35.507792+0000","last_became_peered":"2023-08-10T10:44:35.507792+0000","last_unstale":"2023-08-10T10:44:38.172287+0000","last_undegraded":"2023-08-10T10:44:38.172287+0000","last_fullsized":"2023-08-10T10:44:38.172287+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.585465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540525+0000","last_change":"2023-08-10T10:44:36.520095+0000","last_active":"2023-08-10T10:44:37.540525+0000","last_peered":"2023-08-10T10:44:37.540525+0000","last_clean":"2023-08-10T10:44:37.540525+0000","last_became_active":"2023-08-10T10:44:36.516603+0000","last_became_peered":"2023-08-10T10:44:36.516603+0000","last_unstale":"2023-08-10T10:44:37.540525+0000","last_undegraded":"2023-08-10T10:44:37.540525+0000","last_fullsized":"2023-08-10T10:44:37.540525+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:33:12.392323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541767+0000","last_change":"2023-08-10T10:44:35.509906+0000","last_active":"2023-08-10T10:44:37.541767+0000","last_peered":"2023-08-10T10:44:37.541767+0000","last_clean":"2023-08-10T10:44:37.541767+0000","last_became_active":"2023-08-10T10:44:35.509622+0000","last_became_peered":"2023-08-10T10:44:35.509622+0000","last_unstale":"2023-08-10T10:44:37.541767+0000","last_undegraded":"2023-08-10T10:44:37.541767+0000","last_fullsized":"2023-08-10T10:44:37.541767+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:30.488590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521572+0000","last_change":"2023-08-10T10:44:36.518133+0000","last_active":"2023-08-10T10:44:36.521572+0000","last_peered":"2023-08-10T10:44:36.521572+0000","last_clean":"2023-08-10T10:44:36.521572+0000","last_became_active":"2023-08-10T10:44:36.517130+0000","last_became_peered":"2023-08-10T10:44:36.517130+0000","last_unstale":"2023-08-10T10:44:36.521572+0000","last_undegraded":"2023-08-10T10:44:36.521572+0000","last_fullsized":"2023-08-10T10:44:36.521572+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:26.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505170+0000","last_change":"2023-08-10T10:44:35.514143+0000","last_active":"2023-08-10T10:44:36.505170+0000","last_peered":"2023-08-10T10:44:36.505170+0000","last_clean":"2023-08-10T10:44:36.505170+0000","last_became_active":"2023-08-10T10:44:35.513721+0000","last_became_peered":"2023-08-10T10:44:35.513721+0000","last_unstale":"2023-08-10T10:44:36.505170+0000","last_undegraded":"2023-08-10T10:44:36.505170+0000","last_fullsized":"2023-08-10T10:44:36.505170+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:44:47.787173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519261+0000","last_change":"2023-08-10T10:44:36.519190+0000","last_active":"2023-08-10T10:44:36.519261+0000","last_peered":"2023-08-10T10:44:36.519261+0000","last_clean":"2023-08-10T10:44:36.519261+0000","last_became_active":"2023-08-10T10:44:36.518765+0000","last_became_peered":"2023-08-10T10:44:36.518765+0000","last_unstale":"2023-08-10T10:44:36.519261+0000","last_undegraded":"2023-08-10T10:44:36.519261+0000","last_fullsized":"2023-08-10T10:44:36.519261+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:30.242790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507631+0000","last_change":"2023-08-10T10:44:35.508922+0000","last_active":"2023-08-10T10:44:36.507631+0000","last_peered":"2023-08-10T10:44:36.507631+0000","last_clean":"2023-08-10T10:44:36.507631+0000","last_became_active":"2023-08-10T10:44:35.507242+0000","last_became_peered":"2023-08-10T10:44:35.507242+0000","last_unstale":"2023-08-10T10:44:36.507631+0000","last_undegraded":"2023-08-10T10:44:36.507631+0000","last_fullsized":"2023-08-10T10:44:36.507631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:34.348917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":326,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507458+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:44:36.507458+0000","last_peered":"2023-08-10T10:44:36.507458+0000","last_clean":"2023-08-10T10:44:36.507458+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:44:36.507458+0000","last_undegraded":"2023-08-10T10:44:36.507458+0000","last_fullsized":"2023-08-10T10:44:36.507458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:58.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172521+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:44:38.172521+0000","last_peered":"2023-08-10T10:44:38.172521+0000","last_clean":"2023-08-10T10:44:38.172521+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:44:38.172521+0000","last_undegraded":"2023-08-10T10:44:38.172521+0000","last_fullsized":"2023-08-10T10:44:38.172521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:20.474819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514165+0000","last_change":"2023-08-10T10:44:36.514045+0000","last_active":"2023-08-10T10:44:36.514165+0000","last_peered":"2023-08-10T10:44:36.514165+0000","last_clean":"2023-08-10T10:44:36.514165+0000","last_became_active":"2023-08-10T10:44:36.513687+0000","last_became_peered":"2023-08-10T10:44:36.513687+0000","last_unstale":"2023-08-10T10:44:36.514165+0000","last_undegraded":"2023-08-10T10:44:36.514165+0000","last_fullsized":"2023-08-10T10:44:36.514165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:17:45.794607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540676+0000","last_change":"2023-08-10T10:44:35.511348+0000","last_active":"2023-08-10T10:44:37.540676+0000","last_peered":"2023-08-10T10:44:37.540676+0000","last_clean":"2023-08-10T10:44:37.540676+0000","last_became_active":"2023-08-10T10:44:35.511046+0000","last_became_peered":"2023-08-10T10:44:35.511046+0000","last_unstale":"2023-08-10T10:44:37.540676+0000","last_undegraded":"2023-08-10T10:44:37.540676+0000","last_fullsized":"2023-08-10T10:44:37.540676+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:56.081326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505925+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:44:36.505925+0000","last_peered":"2023-08-10T10:44:36.505925+0000","last_clean":"2023-08-10T10:44:36.505925+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:44:36.505925+0000","last_undegraded":"2023-08-10T10:44:36.505925+0000","last_fullsized":"2023-08-10T10:44:36.505925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:05.942136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540133+0000","last_change":"2023-08-10T10:44:36.514861+0000","last_active":"2023-08-10T10:44:37.540133+0000","last_peered":"2023-08-10T10:44:37.540133+0000","last_clean":"2023-08-10T10:44:37.540133+0000","last_became_active":"2023-08-10T10:44:36.514569+0000","last_became_peered":"2023-08-10T10:44:36.514569+0000","last_unstale":"2023-08-10T10:44:37.540133+0000","last_undegraded":"2023-08-10T10:44:37.540133+0000","last_fullsized":"2023-08-10T10:44:37.540133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:05.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519860+0000","last_change":"2023-08-10T10:44:35.510814+0000","last_active":"2023-08-10T10:44:36.519860+0000","last_peered":"2023-08-10T10:44:36.519860+0000","last_clean":"2023-08-10T10:44:36.519860+0000","last_became_active":"2023-08-10T10:44:35.509922+0000","last_became_peered":"2023-08-10T10:44:35.509922+0000","last_unstale":"2023-08-10T10:44:36.519860+0000","last_undegraded":"2023-08-10T10:44:36.519860+0000","last_fullsized":"2023-08-10T10:44:36.519860+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:54.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.595032+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:44:37.595032+0000","last_peered":"2023-08-10T10:44:37.595032+0000","last_clean":"2023-08-10T10:44:37.595032+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:44:37.595032+0000","last_undegraded":"2023-08-10T10:44:37.595032+0000","last_fullsized":"2023-08-10T10:44:37.595032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:20.140577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540971+0000","last_change":"2023-08-10T10:44:36.503609+0000","last_active":"2023-08-10T10:44:37.540971+0000","last_peered":"2023-08-10T10:44:37.540971+0000","last_clean":"2023-08-10T10:44:37.540971+0000","last_became_active":"2023-08-10T10:44:36.503236+0000","last_became_peered":"2023-08-10T10:44:36.503236+0000","last_unstale":"2023-08-10T10:44:37.540971+0000","last_undegraded":"2023-08-10T10:44:37.540971+0000","last_fullsized":"2023-08-10T10:44:37.540971+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:33.345230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540982+0000","last_change":"2023-08-10T10:44:35.499356+0000","last_active":"2023-08-10T10:44:37.540982+0000","last_peered":"2023-08-10T10:44:37.540982+0000","last_clean":"2023-08-10T10:44:37.540982+0000","last_became_active":"2023-08-10T10:44:35.498694+0000","last_became_peered":"2023-08-10T10:44:35.498694+0000","last_unstale":"2023-08-10T10:44:37.540982+0000","last_undegraded":"2023-08-10T10:44:37.540982+0000","last_fullsized":"2023-08-10T10:44:37.540982+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:29:14.127082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172401+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:44:38.172401+0000","last_peered":"2023-08-10T10:44:38.172401+0000","last_clean":"2023-08-10T10:44:38.172401+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:44:38.172401+0000","last_undegraded":"2023-08-10T10:44:38.172401+0000","last_fullsized":"2023-08-10T10:44:38.172401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:21.388317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522046+0000","last_change":"2023-08-10T10:44:36.521950+0000","last_active":"2023-08-10T10:44:36.522046+0000","last_peered":"2023-08-10T10:44:36.522046+0000","last_clean":"2023-08-10T10:44:36.522046+0000","last_became_active":"2023-08-10T10:44:36.521530+0000","last_became_peered":"2023-08-10T10:44:36.521530+0000","last_unstale":"2023-08-10T10:44:36.522046+0000","last_undegraded":"2023-08-10T10:44:36.522046+0000","last_fullsized":"2023-08-10T10:44:36.522046+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:33.893790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172029+0000","last_change":"2023-08-10T10:44:35.506343+0000","last_active":"2023-08-10T10:44:38.172029+0000","last_peered":"2023-08-10T10:44:38.172029+0000","last_clean":"2023-08-10T10:44:38.172029+0000","last_became_active":"2023-08-10T10:44:35.506074+0000","last_became_peered":"2023-08-10T10:44:35.506074+0000","last_unstale":"2023-08-10T10:44:38.172029+0000","last_undegraded":"2023-08-10T10:44:38.172029+0000","last_fullsized":"2023-08-10T10:44:38.172029+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:14:32.496589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.506806+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:44:36.506806+0000","last_peered":"2023-08-10T10:44:36.506806+0000","last_clean":"2023-08-10T10:44:36.506806+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:44:36.506806+0000","last_undegraded":"2023-08-10T10:44:36.506806+0000","last_fullsized":"2023-08-10T10:44:36.506806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:17:46.540333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172802+0000","last_change":"2023-08-10T10:44:36.521371+0000","last_active":"2023-08-10T10:44:38.172802+0000","last_peered":"2023-08-10T10:44:38.172802+0000","last_clean":"2023-08-10T10:44:38.172802+0000","last_became_active":"2023-08-10T10:44:36.521130+0000","last_became_peered":"2023-08-10T10:44:36.521130+0000","last_unstale":"2023-08-10T10:44:38.172802+0000","last_undegraded":"2023-08-10T10:44:38.172802+0000","last_fullsized":"2023-08-10T10:44:38.172802+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:57.529878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594805+0000","last_change":"2023-08-10T10:44:35.503474+0000","last_active":"2023-08-10T10:44:37.594805+0000","last_peered":"2023-08-10T10:44:37.594805+0000","last_clean":"2023-08-10T10:44:37.594805+0000","last_became_active":"2023-08-10T10:44:35.503019+0000","last_became_peered":"2023-08-10T10:44:35.503019+0000","last_unstale":"2023-08-10T10:44:37.594805+0000","last_undegraded":"2023-08-10T10:44:37.594805+0000","last_fullsized":"2023-08-10T10:44:37.594805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:05:15.263968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505519+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:44:36.505519+0000","last_peered":"2023-08-10T10:44:36.505519+0000","last_clean":"2023-08-10T10:44:36.505519+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:44:36.505519+0000","last_undegraded":"2023-08-10T10:44:36.505519+0000","last_fullsized":"2023-08-10T10:44:36.505519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:48.742712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.171836+0000","last_change":"2023-08-10T10:44:36.515653+0000","last_active":"2023-08-10T10:44:38.171836+0000","last_peered":"2023-08-10T10:44:38.171836+0000","last_clean":"2023-08-10T10:44:38.171836+0000","last_became_active":"2023-08-10T10:44:36.515420+0000","last_became_peered":"2023-08-10T10:44:36.515420+0000","last_unstale":"2023-08-10T10:44:38.171836+0000","last_undegraded":"2023-08-10T10:44:38.171836+0000","last_fullsized":"2023-08-10T10:44:38.171836+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:26.415351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.173102+0000","last_change":"2023-08-10T10:44:35.508557+0000","last_active":"2023-08-10T10:44:38.173102+0000","last_peered":"2023-08-10T10:44:38.173102+0000","last_clean":"2023-08-10T10:44:38.173102+0000","last_became_active":"2023-08-10T10:44:35.508081+0000","last_became_peered":"2023-08-10T10:44:35.508081+0000","last_unstale":"2023-08-10T10:44:38.173102+0000","last_undegraded":"2023-08-10T10:44:38.173102+0000","last_fullsized":"2023-08-10T10:44:38.173102+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:47:55.159130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505005+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:44:36.505005+0000","last_peered":"2023-08-10T10:44:36.505005+0000","last_clean":"2023-08-10T10:44:36.505005+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:44:36.505005+0000","last_undegraded":"2023-08-10T10:44:36.505005+0000","last_fullsized":"2023-08-10T10:44:36.505005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:11.507730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514146+0000","last_change":"2023-08-10T10:44:36.513673+0000","last_active":"2023-08-10T10:44:36.514146+0000","last_peered":"2023-08-10T10:44:36.514146+0000","last_clean":"2023-08-10T10:44:36.514146+0000","last_became_active":"2023-08-10T10:44:36.513385+0000","last_became_peered":"2023-08-10T10:44:36.513385+0000","last_unstale":"2023-08-10T10:44:36.514146+0000","last_undegraded":"2023-08-10T10:44:36.514146+0000","last_fullsized":"2023-08-10T10:44:36.514146+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:02:38.369097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594360+0000","last_change":"2023-08-10T10:44:35.506909+0000","last_active":"2023-08-10T10:44:37.594360+0000","last_peered":"2023-08-10T10:44:37.594360+0000","last_clean":"2023-08-10T10:44:37.594360+0000","last_became_active":"2023-08-10T10:44:35.506240+0000","last_became_peered":"2023-08-10T10:44:35.506240+0000","last_unstale":"2023-08-10T10:44:37.594360+0000","last_undegraded":"2023-08-10T10:44:37.594360+0000","last_fullsized":"2023-08-10T10:44:37.594360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:42.575056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540950+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:44:37.540950+0000","last_peered":"2023-08-10T10:44:37.540950+0000","last_clean":"2023-08-10T10:44:37.540950+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:44:37.540950+0000","last_undegraded":"2023-08-10T10:44:37.540950+0000","last_fullsized":"2023-08-10T10:44:37.540950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:05.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194115,"statfs":{"total":200000000,"available":198774397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.071,"15min":1.123},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.175,"15min":1.0800000000000001},"min":{"1min":0.70299999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6000000000000001,"5min":5.149,"15min":5.149},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.73699999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.734,"5min":1.7370000000000001,"15min":2.1600000000000001},"last":0.755},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.1379999999999999},"min":{"1min":0.70099999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6140000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.2250000000000001},"min":{"1min":0.80700000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6060000000000001,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.79300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.5269999999999999,"5min":1.7589999999999999,"15min":2.3610000000000002},"last":1.282}]},{"osd":3,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2070000000000001,"15min":1.216},"min":{"1min":0.91600000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6839999999999999,"5min":1.766,"15min":1.766},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.327,"15min":1.3799999999999999},"min":{"1min":0.877,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.651,"5min":1.982,"15min":2.4860000000000002},"last":1.468}]},{"osd":4,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.236,"15min":1.236},"min":{"1min":0.89200000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.617,"5min":1.99,"15min":1.99},"last":1.401},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.272},"min":{"1min":0.92400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8129999999999999,"5min":6.657,"15min":6.657},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":0.93500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.901,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.486,"15min":1.4930000000000001},"min":{"1min":1.0660000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.8129999999999999,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.53}]},{"osd":6,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4870000000000001,"15min":1.573},"min":{"1min":1.1259999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.73},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.464,"15min":1.5029999999999999},"min":{"1min":1.1160000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.946,"5min":3.585,"15min":3.585},"last":1.583}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356000,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1200000000000001,"15min":1.0569999999999999},"min":{"1min":0.85699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.619,"5min":1.75,"15min":1.7509999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.109,"15min":1.002},"min":{"1min":0.91900000000000004,"5min":0.67600000000000005,"15min":0.46600000000000003},"max":{"1min":1.4359999999999999,"5min":1.659,"15min":1.659},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1160000000000001,"15min":1.069},"min":{"1min":0.67800000000000005,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2290000000000001,"15min":1.1779999999999999},"min":{"1min":0.79100000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1970000000000001,"15min":1.133},"min":{"1min":0.83699999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"max":{"1min":1.7190000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2949999999999999,"15min":1.232},"min":{"1min":0.86399999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6739999999999999,"5min":1.968,"15min":1.968},"last":1.2110000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.3400000000000001,"15min":1.222},"min":{"1min":1.089,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":1.095},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3149999999999999,"15min":1.258},"min":{"1min":1.0349999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":2.395,"15min":2.395},"last":1.157}]},{"osd":4,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2969999999999999,"15min":1.2090000000000001},"min":{"1min":0.90800000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.77,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.498},{"interface":"front","average":{"1min":1.591,"5min":1.488,"15min":1.415},"min":{"1min":1.2,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":1.964,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.4990000000000001,"15min":1.4059999999999999},"min":{"1min":1.125,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.0459999999999998,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.738,"5min":1.5660000000000001,"15min":1.496},"min":{"1min":1.325,"5min":0.84099999999999997,"15min":0.69399999999999995},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.4259999999999999,"15min":1.3680000000000001},"min":{"1min":1.2290000000000001,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":1.923,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.375},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5669999999999999,"15min":1.4830000000000001},"min":{"1min":1.2649999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9359999999999999,"5min":2.5819999999999999,"15min":2.698},"last":1.5609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194693,"statfs":{"total":200000000,"available":199365840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.171,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5720000000000001,"5min":1.833,"15min":2.5070000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.456,"15min":1.212},"min":{"1min":0.73799999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6890000000000001,"5min":32.941000000000003,"15min":32.941000000000003},"last":1.1819999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1779999999999999,"15min":1.2190000000000001},"min":{"1min":0.83299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5680000000000001,"5min":1.659,"15min":2.2450000000000001},"last":1.762},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.74399999999999999,"5min":0.71799999999999997,"15min":0.70499999999999996},"max":{"1min":1.611,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6839999999999999,"5min":1.7410000000000001,"15min":4.1980000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.1599999999999999},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.53,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2609999999999999,"15min":1.2549999999999999},"min":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6259999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.321,"15min":1.3680000000000001},"min":{"1min":0.95199999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.698,"5min":1.7989999999999999,"15min":4.0620000000000003},"last":1.704}]},{"osd":4,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.214,"15min":1.282},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.633,"5min":1.9039999999999999,"15min":2.399},"last":1.365},{"interface":"front","average":{"1min":1.391,"5min":1.3540000000000001,"15min":1.357},"min":{"1min":0.73399999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.756,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.411}]},{"osd":6,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.397,"15min":1.321},"min":{"1min":0.67000000000000004,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.091},{"interface":"front","average":{"1min":1.415,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.85899999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7250000000000001,"5min":1.98,"15min":1.98},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.472,"15min":1.484},"min":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.911,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.571,"5min":1.516,"15min":1.4910000000000001},"min":{"1min":0.82999999999999996,"5min":0.76100000000000001,"15min":0.71299999999999997},"max":{"1min":2.0070000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.825}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358008,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.151,"15min":1.137},"min":{"1min":0.68799999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6779999999999999,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.331},{"interface":"front","average":{"1min":1.306,"5min":1.2190000000000001,"15min":1.206},"min":{"1min":0.97699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.825,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.026}]},{"osd":1,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.236,"15min":1.2909999999999999},"min":{"1min":0.873,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.78200000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1990000000000001,"15min":1.1559999999999999},"min":{"1min":0.90500000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.9860000000000002,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.524,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":0.92900000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":1.111}]},{"osd":3,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2909999999999999,"15min":1.2569999999999999},"min":{"1min":0.95399999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.8109999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.141},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.3460000000000001,"15min":1.288},"min":{"1min":0.97799999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.1850000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.266}]},{"osd":5,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.3919999999999999,"15min":1.3700000000000001},"min":{"1min":0.69799999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.294},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3320000000000001,"15min":1.3},"min":{"1min":0.755,"5min":0.63100000000000001,"15min":0.42399999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.3640000000000001,"15min":1.3340000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.47599999999999998},"max":{"1min":3.0910000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.786,"5min":1.536,"15min":1.4810000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.76700000000000002},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.474,"15min":1.4279999999999999},"min":{"1min":0.82699999999999996,"5min":0.68999999999999995,"15min":0.57999999999999996},"max":{"1min":2.8860000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.5569999999999999,"15min":1.514},"min":{"1min":1.0209999999999999,"5min":0.83899999999999997,"15min":0.73499999999999999},"max":{"1min":3.2879999999999998,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.379}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358168,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":0.82099999999999995},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.4079999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1519999999999999,"15min":0.97199999999999998},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.433},"max":{"1min":1.522,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.3939999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.82999999999999996},"min":{"1min":0.44,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5549999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0800000000000001,"15min":0.93000000000000005},"min":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.34100000000000003},"max":{"1min":1.532,"5min":1.897,"15min":1.897},"last":1.456}]},{"osd":2,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0589999999999999,"15min":0.93100000000000005},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.47599999999999998},"max":{"1min":1.5209999999999999,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2250000000000001,"15min":1.0649999999999999},"min":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.46899999999999997},"max":{"1min":1.649,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3280000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.347,"15min":1.22},"min":{"1min":0.90800000000000003,"5min":0.78200000000000003,"15min":0.70599999999999996},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.286,"15min":1.1990000000000001},"min":{"1min":0.872,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.296}]},{"osd":5,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.4179999999999999,"15min":1.321},"min":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.77900000000000003},"max":{"1min":1.738,"5min":2.0059999999999998,"15min":2.125},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.4570000000000001,"15min":1.3640000000000001},"min":{"1min":0.86399999999999999,"5min":0.82699999999999996,"15min":0.78400000000000003},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":1.5700000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.385,"15min":1.266},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4910000000000001,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.984,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.496,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"max":{"1min":2.2509999999999999,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.641},{"interface":"front","average":{"1min":1.409,"5min":1.4470000000000001,"15min":1.3360000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.86199999999999999},"max":{"1min":1.8600000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.23}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358168,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.89300000000000002,"15min":0.88200000000000001},"min":{"1min":0.59299999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.5209999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.99099999999999999,"15min":0.89700000000000002},"min":{"1min":0.73799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.165}]},{"osd":1,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.103,"15min":1.0469999999999999},"min":{"1min":0.68100000000000005,"5min":0.60699999999999998,"15min":0.58499999999999996},"max":{"1min":1.641,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.621},{"interface":"front","average":{"1min":1.327,"5min":1.208,"15min":1.119},"min":{"1min":0.70599999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.821,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.345}]},{"osd":3,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":0.995,"15min":1.0109999999999999},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5620000000000001,"5min":1.6299999999999999,"15min":1.639},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.2130000000000001,"15min":1.2549999999999999},"min":{"1min":0.69899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8480000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.371}]},{"osd":4,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.407,"15min":1.425},"min":{"1min":1.054,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.415,"5min":2.415,"15min":2.6000000000000001},"last":1.734},{"interface":"front","average":{"1min":1.446,"5min":1.333,"15min":1.3009999999999999},"min":{"1min":0.96999999999999997,"5min":0.86899999999999999,"15min":0.83199999999999996},"max":{"1min":2.085,"5min":2.085,"15min":2.1520000000000001},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3149999999999999,"15min":1.276},"min":{"1min":1.0469999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.798,"5min":1.4950000000000001,"15min":1.486},"min":{"1min":1.1870000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.294,"5min":3.294,"15min":3.294},"last":1.5009999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.458,"15min":1.383},"min":{"1min":1.0920000000000001,"5min":0.88600000000000001,"15min":0.81599999999999995},"max":{"1min":2.3940000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.4139999999999999,"15min":1.359},"min":{"1min":1.127,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":1.51,"15min":1.4079999999999999},"min":{"1min":1.1319999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.3319999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.569},{"interface":"front","average":{"1min":1.76,"5min":1.492,"15min":1.4319999999999999},"min":{"1min":1.161,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":1.1479999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194692,"statfs":{"total":200000000,"available":199364751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.89600000000000002,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6240000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":0.93799999999999994},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3640000000000001,"5min":2.012,"15min":2.246},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.006,"15min":0.87},"min":{"1min":0.65600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.546,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.238,"15min":1.0569999999999999},"min":{"1min":0.86499999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5349999999999999,"5min":2.423,"15min":2.423},"last":1.153}]},{"osd":3,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.80200000000000005,"5min":0.51100000000000001,"15min":0.45400000000000001},"max":{"1min":1.5800000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.276},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0660000000000001,"15min":1.0289999999999999},"min":{"1min":0.621,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.786,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.446}]},{"osd":4,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.258,"15min":1.1579999999999999},"min":{"1min":0.85299999999999998,"5min":0.78000000000000003,"15min":0.65500000000000003},"max":{"1min":1.611,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.456,"15min":1.3839999999999999},"min":{"1min":0.999,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6950000000000001,"5min":2.343,"15min":2.343},"last":1.3899999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4139999999999999,"15min":1.359},"min":{"1min":1.028,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.901,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3939999999999999,"15min":1.302},"min":{"1min":0.96999999999999997,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":1.8700000000000001,"5min":2.73,"15min":2.73},"last":1.615}]},{"osd":6,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.4279999999999999,"15min":1.361},"min":{"1min":0.93899999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.228},{"interface":"front","average":{"1min":1.452,"5min":1.3700000000000001,"15min":1.252},"min":{"1min":0.92500000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.992,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.466,"15min":1.4319999999999999},"min":{"1min":1.165,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9710000000000001,"5min":2.742,"15min":2.742},"last":1.548},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.502,"15min":1.3939999999999999},"min":{"1min":0.82699999999999996,"5min":0.625,"15min":0.625},"max":{"1min":2.1640000000000001,"5min":2.605,"15min":2.605},"last":1.585}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194114,"statfs":{"total":200000000,"available":198773202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.075,"15min":1.0329999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51300000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.853},"last":1.343}]},{"osd":2,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.53400000000000003,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.4450000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.054},{"interface":"front","average":{"1min":1.046,"5min":1.0449999999999999,"15min":1.0229999999999999},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.597,"5min":1.7,"15min":1.7},"last":1.111}]},{"osd":3,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":0.95199999999999996},"min":{"1min":0.499,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6839999999999999,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1679999999999999,"15min":1.1160000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.7589999999999999,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.367,"15min":1.2729999999999999},"min":{"1min":0.89500000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.768,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.4710000000000001,"15min":1.405},"min":{"1min":1.0169999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.87,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.986},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.5449999999999999,"15min":1.351},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.853,"5min":16.058,"15min":16.058},"last":1.556}]},{"osd":6,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.478,"15min":1.46},"min":{"1min":0.875,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1680000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.593},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.82699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1200000000000001,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.7210000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5109999999999999,"15min":1.528},"min":{"1min":0.76500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.0899999999999999,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.615},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4970000000000001,"15min":1.419},"min":{"1min":0.85099999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9430000000000001,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.679}]}]}],"pool_statfs":[]}} 2023-08-10T10:44:40.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:44:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.253+0000 7f71f942d640 1 Processor -- start 2023-08-10T10:44:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.254+0000 7f71f942d640 1 -- start start 2023-08-10T10:44:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f942d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71f415cd60 0x7f71f4160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f942d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71f40b8430 0x7f71f40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f942d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40ce200 con 0x7f71f40cddb0 2023-08-10T10:44:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f942d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40b5bd0 con 0x7f71f415cd60 2023-08-10T10:44:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f942d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4161180 con 0x7f71f40b8430 2023-08-10T10:44:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71f415cd60 0x7f71f4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.255+0000 7f71f37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f71f40cddb0 0x7f71f40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39912/0 (socket says 172.21.15.50:39912) 2023-08-10T10:44:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f37fe640 1 -- 172.21.15.50:0/1520436869 learned_addr learned my addr 172.21.15.50:0/1520436869 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f27fc640 1 --2- 172.21.15.50:0/1520436869 >> v2:172.21.15.117:3300/0 conn(0x7f71f40b8430 0x7f71f40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f2ffd640 1 -- 172.21.15.50:0/1520436869 >> v2:172.21.15.117:3300/0 conn(0x7f71f40b8430 msgr2=0x7f71f40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f2ffd640 1 --2- 172.21.15.50:0/1520436869 >> v2:172.21.15.117:3300/0 conn(0x7f71f40b8430 0x7f71f40cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f2ffd640 1 -- 172.21.15.50:0/1520436869 >> v1:172.21.15.50:6789/0 conn(0x7f71f40cddb0 legacy=0x7f71f40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f2ffd640 1 -- 172.21.15.50:0/1520436869 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4161460 con 0x7f71f415cd60 2023-08-10T10:44:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.256+0000 7f71f1ffb640 1 -- 172.21.15.50:0/1520436869 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579619331 0 0) 0x7f71ec001490 con 0x7f71f40cddb0 2023-08-10T10:44:41.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.257+0000 7f71f2ffd640 1 --2- 172.21.15.50:0/1520436869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f415cd60 0x7f71f4160930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f71f40ceeb0 tx=0x7f71e402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf03647293861a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.257+0000 7f71f1ffb640 1 -- 172.21.15.50:0/1520436869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4030610 con 0x7f71f415cd60 2023-08-10T10:44:41.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f1ffb640 1 -- 172.21.15.50:0/1520436869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4030770 con 0x7f71f415cd60 2023-08-10T10:44:41.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f1ffb640 1 -- 172.21.15.50:0/1520436869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4030b00 con 0x7f71f415cd60 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 -- 172.21.15.50:0/1520436869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f415cd60 msgr2=0x7f71f4160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 --2- 172.21.15.50:0/1520436869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f415cd60 0x7f71f4160930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f71f40ceeb0 tx=0x7f71e402b960 comp rx=0 tx=0).stop 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 -- 172.21.15.50:0/1520436869 shutdown_connections 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 --2- 172.21.15.50:0/1520436869 >> v2:172.21.15.117:3300/0 conn(0x7f71f40b8430 0x7f71f40cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 --2- 172.21.15.50:0/1520436869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f415cd60 0x7f71f4160930 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 -- 172.21.15.50:0/1520436869 >> 172.21.15.50:0/1520436869 conn(0x7f71f40d2ac0 msgr2=0x7f71f40d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 -- 172.21.15.50:0/1520436869 shutdown_connections 2023-08-10T10:44:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.258+0000 7f71f942d640 1 -- 172.21.15.50:0/1520436869 wait complete. 2023-08-10T10:44:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.260+0000 7f71f942d640 1 Processor -- start 2023-08-10T10:44:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.260+0000 7f71f942d640 1 -- start start 2023-08-10T10:44:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71f40b8430 0x7f71f41f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71f415cd60 0x7f71f415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415e1a0 con 0x7f71f40cddb0 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415d680 con 0x7f71f40b8430 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f942d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415d900 con 0x7f71f415cd60 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43480/0 (socket says 172.21.15.50:43480) 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.261+0000 7f71f27fc640 1 -- 172.21.15.50:0/2075100530 learned_addr learned my addr 172.21.15.50:0/2075100530 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 -- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71f415cd60 msgr2=0x7f71f415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71f415cd60 0x7f71f415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 -- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71f40b8430 msgr2=0x7f71f41f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71f40b8430 0x7f71f41f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 -- 172.21.15.50:0/2075100530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009400 con 0x7f71f40cddb0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f27fc640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f71e800d800 tx=0x7f71e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800b6c0 con 0x7f71f40cddb0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e800b820 con 0x7f71f40cddb0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800bbb0 con 0x7f71f40cddb0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.262+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f415dbe0 con 0x7f71f40cddb0 2023-08-10T10:44:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.263+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f415eba0 con 0x7f71f40cddb0 2023-08-10T10:44:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.264+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f415ea00 con 0x7f71f40cddb0 2023-08-10T10:44:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.265+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71e800bd10 con 0x7f71f40cddb0 2023-08-10T10:44:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.266+0000 7f71db7fe640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 0x7f71e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.266+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71e8089a60 con 0x7f71f40cddb0 2023-08-10T10:44:41.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.266+0000 7f71f2ffd640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 0x7f71e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.267+0000 7f71f2ffd640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 0x7f71e006d110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f71e4036000 tx=0x7f71e4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.270+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f71f415ea00 con 0x7f71f40cddb0 2023-08-10T10:44:41.451 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-08-10T10:44:41.451+0000 7f15cfb69640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:44:41.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.458+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71f4161740 con 0x7f71e006ac50 2023-08-10T10:44:41.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.470+0000 7f71db7fe640 1 -- 172.21.15.50:0/2075100530 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303150 (secure 0 0 0) 0x7f71e40308e0 con 0x7f71e006ac50 2023-08-10T10:44:41.475 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:41.476 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:44:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 msgr2=0x7f71e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 0x7f71e006d110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f71e4036000 tx=0x7f71e4030000 comp rx=0 tx=0).stop 2023-08-10T10:44:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 msgr2=0x7f71f415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f71e800d800 tx=0x7f71e800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 shutdown_connections 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71f415cd60 0x7f71f415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f40cddb0 0x7f71f415d140 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f71e006ac50 0x7f71e006d110 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 --2- 172.21.15.50:0/2075100530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71f40b8430 0x7f71f41f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 >> 172.21.15.50:0/2075100530 conn(0x7f71f40d2ac0 msgr2=0x7f71f40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:41.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.475+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 shutdown_connections 2023-08-10T10:44:41.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.476+0000 7f71f942d640 1 -- 172.21.15.50:0/2075100530 wait complete. 2023-08-10T10:44:41.495 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-08-10T10:44:40.451357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6144,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556355,"statfs":{"total":1600000000,"available":1593708534,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.985508"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535288+0000","last_change":"2023-08-10T10:44:36.518503+0000","last_active":"2023-08-10T10:44:37.535288+0000","last_peered":"2023-08-10T10:44:37.535288+0000","last_clean":"2023-08-10T10:44:37.535288+0000","last_became_active":"2023-08-10T10:44:36.518080+0000","last_became_peered":"2023-08-10T10:44:36.518080+0000","last_unstale":"2023-08-10T10:44:37.535288+0000","last_undegraded":"2023-08-10T10:44:37.535288+0000","last_fullsized":"2023-08-10T10:44:37.535288+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:05.169919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.171779+0000","last_change":"2023-08-10T10:44:36.507554+0000","last_active":"2023-08-10T10:44:38.171779+0000","last_peered":"2023-08-10T10:44:38.171779+0000","last_clean":"2023-08-10T10:44:38.171779+0000","last_became_active":"2023-08-10T10:44:36.506627+0000","last_became_peered":"2023-08-10T10:44:36.506627+0000","last_unstale":"2023-08-10T10:44:38.171779+0000","last_undegraded":"2023-08-10T10:44:38.171779+0000","last_fullsized":"2023-08-10T10:44:38.171779+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:22.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.534697+0000","last_change":"2023-08-10T10:44:36.498617+0000","last_active":"2023-08-10T10:44:37.534697+0000","last_peered":"2023-08-10T10:44:37.534697+0000","last_clean":"2023-08-10T10:44:37.534697+0000","last_became_active":"2023-08-10T10:44:36.497708+0000","last_became_peered":"2023-08-10T10:44:36.497708+0000","last_unstale":"2023-08-10T10:44:37.534697+0000","last_undegraded":"2023-08-10T10:44:37.534697+0000","last_fullsized":"2023-08-10T10:44:37.534697+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:43.537664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.525669+0000","last_change":"2023-08-10T10:44:36.524246+0000","last_active":"2023-08-10T10:44:36.525669+0000","last_peered":"2023-08-10T10:44:36.525669+0000","last_clean":"2023-08-10T10:44:36.525669+0000","last_became_active":"2023-08-10T10:44:36.523996+0000","last_became_peered":"2023-08-10T10:44:36.523996+0000","last_unstale":"2023-08-10T10:44:36.525669+0000","last_undegraded":"2023-08-10T10:44:36.525669+0000","last_fullsized":"2023-08-10T10:44:36.525669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:17.619745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539331+0000","last_change":"2023-08-10T10:44:36.513233+0000","last_active":"2023-08-10T10:44:37.539331+0000","last_peered":"2023-08-10T10:44:37.539331+0000","last_clean":"2023-08-10T10:44:37.539331+0000","last_became_active":"2023-08-10T10:44:36.512988+0000","last_became_peered":"2023-08-10T10:44:36.512988+0000","last_unstale":"2023-08-10T10:44:37.539331+0000","last_undegraded":"2023-08-10T10:44:37.539331+0000","last_fullsized":"2023-08-10T10:44:37.539331+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:37.737621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522026+0000","last_change":"2023-08-10T10:44:36.521785+0000","last_active":"2023-08-10T10:44:36.522026+0000","last_peered":"2023-08-10T10:44:36.522026+0000","last_clean":"2023-08-10T10:44:36.522026+0000","last_became_active":"2023-08-10T10:44:36.521202+0000","last_became_peered":"2023-08-10T10:44:36.521202+0000","last_unstale":"2023-08-10T10:44:36.522026+0000","last_undegraded":"2023-08-10T10:44:36.522026+0000","last_fullsized":"2023-08-10T10:44:36.522026+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:26.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.523079+0000","last_change":"2023-08-10T10:44:36.522991+0000","last_active":"2023-08-10T10:44:36.523079+0000","last_peered":"2023-08-10T10:44:36.523079+0000","last_clean":"2023-08-10T10:44:36.523079+0000","last_became_active":"2023-08-10T10:44:36.522718+0000","last_became_peered":"2023-08-10T10:44:36.522718+0000","last_unstale":"2023-08-10T10:44:36.523079+0000","last_undegraded":"2023-08-10T10:44:36.523079+0000","last_fullsized":"2023-08-10T10:44:36.523079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:28.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521157+0000","last_change":"2023-08-10T10:44:36.520906+0000","last_active":"2023-08-10T10:44:36.521157+0000","last_peered":"2023-08-10T10:44:36.521157+0000","last_clean":"2023-08-10T10:44:36.521157+0000","last_became_active":"2023-08-10T10:44:36.519367+0000","last_became_peered":"2023-08-10T10:44:36.519367+0000","last_unstale":"2023-08-10T10:44:36.521157+0000","last_undegraded":"2023-08-10T10:44:36.521157+0000","last_fullsized":"2023-08-10T10:44:36.521157+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:38.469361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.538694+0000","last_change":"2023-08-10T10:44:36.514320+0000","last_active":"2023-08-10T10:44:37.538694+0000","last_peered":"2023-08-10T10:44:37.538694+0000","last_clean":"2023-08-10T10:44:37.538694+0000","last_became_active":"2023-08-10T10:44:36.511014+0000","last_became_peered":"2023-08-10T10:44:36.511014+0000","last_unstale":"2023-08-10T10:44:37.538694+0000","last_undegraded":"2023-08-10T10:44:37.538694+0000","last_fullsized":"2023-08-10T10:44:37.538694+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:25.664286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594992+0000","last_change":"2023-08-10T10:44:36.516489+0000","last_active":"2023-08-10T10:44:37.594992+0000","last_peered":"2023-08-10T10:44:37.594992+0000","last_clean":"2023-08-10T10:44:37.594992+0000","last_became_active":"2023-08-10T10:44:36.516222+0000","last_became_peered":"2023-08-10T10:44:36.516222+0000","last_unstale":"2023-08-10T10:44:37.594992+0000","last_undegraded":"2023-08-10T10:44:37.594992+0000","last_fullsized":"2023-08-10T10:44:37.594992+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:21:25.631903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539594+0000","last_change":"2023-08-10T10:44:36.517951+0000","last_active":"2023-08-10T10:44:37.539594+0000","last_peered":"2023-08-10T10:44:37.539594+0000","last_clean":"2023-08-10T10:44:37.539594+0000","last_became_active":"2023-08-10T10:44:36.517640+0000","last_became_peered":"2023-08-10T10:44:36.517640+0000","last_unstale":"2023-08-10T10:44:37.539594+0000","last_undegraded":"2023-08-10T10:44:37.539594+0000","last_fullsized":"2023-08-10T10:44:37.539594+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:47:38.611698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594475+0000","last_change":"2023-08-10T10:44:36.510291+0000","last_active":"2023-08-10T10:44:37.594475+0000","last_peered":"2023-08-10T10:44:37.594475+0000","last_clean":"2023-08-10T10:44:37.594475+0000","last_became_active":"2023-08-10T10:44:36.509752+0000","last_became_peered":"2023-08-10T10:44:36.509752+0000","last_unstale":"2023-08-10T10:44:37.594475+0000","last_undegraded":"2023-08-10T10:44:37.594475+0000","last_fullsized":"2023-08-10T10:44:37.594475+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:57.548441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521136+0000","last_change":"2023-08-10T10:44:36.520755+0000","last_active":"2023-08-10T10:44:36.521136+0000","last_peered":"2023-08-10T10:44:36.521136+0000","last_clean":"2023-08-10T10:44:36.521136+0000","last_became_active":"2023-08-10T10:44:36.516542+0000","last_became_peered":"2023-08-10T10:44:36.516542+0000","last_unstale":"2023-08-10T10:44:36.521136+0000","last_undegraded":"2023-08-10T10:44:36.521136+0000","last_fullsized":"2023-08-10T10:44:36.521136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:43.612964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539356+0000","last_change":"2023-08-10T10:44:36.516003+0000","last_active":"2023-08-10T10:44:37.539356+0000","last_peered":"2023-08-10T10:44:37.539356+0000","last_clean":"2023-08-10T10:44:37.539356+0000","last_became_active":"2023-08-10T10:44:36.515028+0000","last_became_peered":"2023-08-10T10:44:36.515028+0000","last_unstale":"2023-08-10T10:44:37.539356+0000","last_undegraded":"2023-08-10T10:44:37.539356+0000","last_fullsized":"2023-08-10T10:44:37.539356+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:09.905970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517201+0000","last_change":"2023-08-10T10:44:36.516432+0000","last_active":"2023-08-10T10:44:36.517201+0000","last_peered":"2023-08-10T10:44:36.517201+0000","last_clean":"2023-08-10T10:44:36.517201+0000","last_became_active":"2023-08-10T10:44:36.515370+0000","last_became_peered":"2023-08-10T10:44:36.515370+0000","last_unstale":"2023-08-10T10:44:36.517201+0000","last_undegraded":"2023-08-10T10:44:36.517201+0000","last_fullsized":"2023-08-10T10:44:36.517201+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:23:12.551859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521597+0000","last_change":"2023-08-10T10:44:36.518291+0000","last_active":"2023-08-10T10:44:36.521597+0000","last_peered":"2023-08-10T10:44:36.521597+0000","last_clean":"2023-08-10T10:44:36.521597+0000","last_became_active":"2023-08-10T10:44:36.517482+0000","last_became_peered":"2023-08-10T10:44:36.517482+0000","last_unstale":"2023-08-10T10:44:36.521597+0000","last_undegraded":"2023-08-10T10:44:36.521597+0000","last_fullsized":"2023-08-10T10:44:36.521597+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:48.890172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.526665+0000","last_change":"2023-08-10T10:44:36.526495+0000","last_active":"2023-08-10T10:44:36.526665+0000","last_peered":"2023-08-10T10:44:36.526665+0000","last_clean":"2023-08-10T10:44:36.526665+0000","last_became_active":"2023-08-10T10:44:36.526190+0000","last_became_peered":"2023-08-10T10:44:36.526190+0000","last_unstale":"2023-08-10T10:44:36.526665+0000","last_undegraded":"2023-08-10T10:44:36.526665+0000","last_fullsized":"2023-08-10T10:44:36.526665+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:27.948171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535410+0000","last_change":"2023-08-10T10:44:36.515508+0000","last_active":"2023-08-10T10:44:37.535410+0000","last_peered":"2023-08-10T10:44:37.535410+0000","last_clean":"2023-08-10T10:44:37.535410+0000","last_became_active":"2023-08-10T10:44:36.514912+0000","last_became_peered":"2023-08-10T10:44:36.514912+0000","last_unstale":"2023-08-10T10:44:37.535410+0000","last_undegraded":"2023-08-10T10:44:37.535410+0000","last_fullsized":"2023-08-10T10:44:37.535410+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:42.971480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.538891+0000","last_change":"2023-08-10T10:44:36.515840+0000","last_active":"2023-08-10T10:44:37.538891+0000","last_peered":"2023-08-10T10:44:37.538891+0000","last_clean":"2023-08-10T10:44:37.538891+0000","last_became_active":"2023-08-10T10:44:36.514645+0000","last_became_peered":"2023-08-10T10:44:36.514645+0000","last_unstale":"2023-08-10T10:44:37.538891+0000","last_undegraded":"2023-08-10T10:44:37.538891+0000","last_fullsized":"2023-08-10T10:44:37.538891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:21.997960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517222+0000","last_change":"2023-08-10T10:44:36.517017+0000","last_active":"2023-08-10T10:44:36.517222+0000","last_peered":"2023-08-10T10:44:36.517222+0000","last_clean":"2023-08-10T10:44:36.517222+0000","last_became_active":"2023-08-10T10:44:36.515766+0000","last_became_peered":"2023-08-10T10:44:36.515766+0000","last_unstale":"2023-08-10T10:44:36.517222+0000","last_undegraded":"2023-08-10T10:44:36.517222+0000","last_fullsized":"2023-08-10T10:44:36.517222+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:53:26.495365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539948+0000","last_change":"2023-08-10T10:44:36.515497+0000","last_active":"2023-08-10T10:44:37.539948+0000","last_peered":"2023-08-10T10:44:37.539948+0000","last_clean":"2023-08-10T10:44:37.539948+0000","last_became_active":"2023-08-10T10:44:36.514617+0000","last_became_peered":"2023-08-10T10:44:36.514617+0000","last_unstale":"2023-08-10T10:44:37.539948+0000","last_undegraded":"2023-08-10T10:44:37.539948+0000","last_fullsized":"2023-08-10T10:44:37.539948+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:07:43.542615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539315+0000","last_change":"2023-08-10T10:44:36.510271+0000","last_active":"2023-08-10T10:44:37.539315+0000","last_peered":"2023-08-10T10:44:37.539315+0000","last_clean":"2023-08-10T10:44:37.539315+0000","last_became_active":"2023-08-10T10:44:36.509743+0000","last_became_peered":"2023-08-10T10:44:36.509743+0000","last_unstale":"2023-08-10T10:44:37.539315+0000","last_undegraded":"2023-08-10T10:44:37.539315+0000","last_fullsized":"2023-08-10T10:44:37.539315+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:27.482350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541079+0000","last_change":"2023-08-10T10:44:36.521919+0000","last_active":"2023-08-10T10:44:37.541079+0000","last_peered":"2023-08-10T10:44:37.541079+0000","last_clean":"2023-08-10T10:44:37.541079+0000","last_became_active":"2023-08-10T10:44:36.521680+0000","last_became_peered":"2023-08-10T10:44:36.521680+0000","last_unstale":"2023-08-10T10:44:37.541079+0000","last_undegraded":"2023-08-10T10:44:37.541079+0000","last_fullsized":"2023-08-10T10:44:37.541079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:37:58.970263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535172+0000","last_change":"2023-08-10T10:44:36.506541+0000","last_active":"2023-08-10T10:44:37.535172+0000","last_peered":"2023-08-10T10:44:37.535172+0000","last_clean":"2023-08-10T10:44:37.535172+0000","last_became_active":"2023-08-10T10:44:36.505676+0000","last_became_peered":"2023-08-10T10:44:36.505676+0000","last_unstale":"2023-08-10T10:44:37.535172+0000","last_undegraded":"2023-08-10T10:44:37.535172+0000","last_fullsized":"2023-08-10T10:44:37.535172+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:30:28.613066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172438+0000","last_change":"2023-08-10T10:44:36.518756+0000","last_active":"2023-08-10T10:44:38.172438+0000","last_peered":"2023-08-10T10:44:38.172438+0000","last_clean":"2023-08-10T10:44:38.172438+0000","last_became_active":"2023-08-10T10:44:36.518514+0000","last_became_peered":"2023-08-10T10:44:36.518514+0000","last_unstale":"2023-08-10T10:44:38.172438+0000","last_undegraded":"2023-08-10T10:44:38.172438+0000","last_fullsized":"2023-08-10T10:44:38.172438+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:59.102269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540407+0000","last_change":"2023-08-10T10:44:36.515678+0000","last_active":"2023-08-10T10:44:37.540407+0000","last_peered":"2023-08-10T10:44:37.540407+0000","last_clean":"2023-08-10T10:44:37.540407+0000","last_became_active":"2023-08-10T10:44:36.515269+0000","last_became_peered":"2023-08-10T10:44:36.515269+0000","last_unstale":"2023-08-10T10:44:37.540407+0000","last_undegraded":"2023-08-10T10:44:37.540407+0000","last_fullsized":"2023-08-10T10:44:37.540407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:19.055523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594728+0000","last_change":"2023-08-10T10:44:36.519881+0000","last_active":"2023-08-10T10:44:37.594728+0000","last_peered":"2023-08-10T10:44:37.594728+0000","last_clean":"2023-08-10T10:44:37.594728+0000","last_became_active":"2023-08-10T10:44:36.518852+0000","last_became_peered":"2023-08-10T10:44:36.518852+0000","last_unstale":"2023-08-10T10:44:37.594728+0000","last_undegraded":"2023-08-10T10:44:37.594728+0000","last_fullsized":"2023-08-10T10:44:37.594728+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:10:06.088551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.520412+0000","last_change":"2023-08-10T10:44:36.520208+0000","last_active":"2023-08-10T10:44:36.520412+0000","last_peered":"2023-08-10T10:44:36.520412+0000","last_clean":"2023-08-10T10:44:36.520412+0000","last_became_active":"2023-08-10T10:44:36.515294+0000","last_became_peered":"2023-08-10T10:44:36.515294+0000","last_unstale":"2023-08-10T10:44:36.520412+0000","last_undegraded":"2023-08-10T10:44:36.520412+0000","last_fullsized":"2023-08-10T10:44:36.520412+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:13.316702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519094+0000","last_change":"2023-08-10T10:44:36.519006+0000","last_active":"2023-08-10T10:44:36.519094+0000","last_peered":"2023-08-10T10:44:36.519094+0000","last_clean":"2023-08-10T10:44:36.519094+0000","last_became_active":"2023-08-10T10:44:36.518215+0000","last_became_peered":"2023-08-10T10:44:36.518215+0000","last_unstale":"2023-08-10T10:44:36.519094+0000","last_undegraded":"2023-08-10T10:44:36.519094+0000","last_fullsized":"2023-08-10T10:44:36.519094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:18.225511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539729+0000","last_change":"2023-08-10T10:44:36.510464+0000","last_active":"2023-08-10T10:44:37.539729+0000","last_peered":"2023-08-10T10:44:37.539729+0000","last_clean":"2023-08-10T10:44:37.539729+0000","last_became_active":"2023-08-10T10:44:36.510216+0000","last_became_peered":"2023-08-10T10:44:36.510216+0000","last_unstale":"2023-08-10T10:44:37.539729+0000","last_undegraded":"2023-08-10T10:44:37.539729+0000","last_fullsized":"2023-08-10T10:44:37.539729+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:58.479391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172136+0000","last_change":"2023-08-10T10:44:36.516945+0000","last_active":"2023-08-10T10:44:38.172136+0000","last_peered":"2023-08-10T10:44:38.172136+0000","last_clean":"2023-08-10T10:44:38.172136+0000","last_became_active":"2023-08-10T10:44:36.516361+0000","last_became_peered":"2023-08-10T10:44:36.516361+0000","last_unstale":"2023-08-10T10:44:38.172136+0000","last_undegraded":"2023-08-10T10:44:38.172136+0000","last_fullsized":"2023-08-10T10:44:38.172136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:17.439338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.525627+0000","last_change":"2023-08-10T10:44:36.525536+0000","last_active":"2023-08-10T10:44:36.525627+0000","last_peered":"2023-08-10T10:44:36.525627+0000","last_clean":"2023-08-10T10:44:36.525627+0000","last_became_active":"2023-08-10T10:44:36.523012+0000","last_became_peered":"2023-08-10T10:44:36.523012+0000","last_unstale":"2023-08-10T10:44:36.525627+0000","last_undegraded":"2023-08-10T10:44:36.525627+0000","last_fullsized":"2023-08-10T10:44:36.525627+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:35.687771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521614+0000","last_change":"2023-08-10T10:44:36.518546+0000","last_active":"2023-08-10T10:44:36.521614+0000","last_peered":"2023-08-10T10:44:36.521614+0000","last_clean":"2023-08-10T10:44:36.521614+0000","last_became_active":"2023-08-10T10:44:36.517863+0000","last_became_peered":"2023-08-10T10:44:36.517863+0000","last_unstale":"2023-08-10T10:44:36.521614+0000","last_undegraded":"2023-08-10T10:44:36.521614+0000","last_fullsized":"2023-08-10T10:44:36.521614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:16:17.129132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"109'4","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541430+0000","last_change":"2023-08-10T10:44:35.512463+0000","last_active":"2023-08-10T10:44:37.541430+0000","last_peered":"2023-08-10T10:44:37.541430+0000","last_clean":"2023-08-10T10:44:37.541430+0000","last_became_active":"2023-08-10T10:44:35.512199+0000","last_became_peered":"2023-08-10T10:44:35.512199+0000","last_unstale":"2023-08-10T10:44:37.541430+0000","last_undegraded":"2023-08-10T10:44:37.541430+0000","last_fullsized":"2023-08-10T10:44:37.541430+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:45:24.300332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521631+0000","last_change":"2023-08-10T10:44:36.520097+0000","last_active":"2023-08-10T10:44:36.521631+0000","last_peered":"2023-08-10T10:44:36.521631+0000","last_clean":"2023-08-10T10:44:36.521631+0000","last_became_active":"2023-08-10T10:44:36.519836+0000","last_became_peered":"2023-08-10T10:44:36.519836+0000","last_unstale":"2023-08-10T10:44:36.521631+0000","last_undegraded":"2023-08-10T10:44:36.521631+0000","last_fullsized":"2023-08-10T10:44:36.521631+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:23.785682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539232+0000","last_change":"2023-08-10T10:44:35.504981+0000","last_active":"2023-08-10T10:44:37.539232+0000","last_peered":"2023-08-10T10:44:37.539232+0000","last_clean":"2023-08-10T10:44:37.539232+0000","last_became_active":"2023-08-10T10:44:35.503984+0000","last_became_peered":"2023-08-10T10:44:35.503984+0000","last_unstale":"2023-08-10T10:44:37.539232+0000","last_undegraded":"2023-08-10T10:44:37.539232+0000","last_fullsized":"2023-08-10T10:44:37.539232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:58:32.679983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.518545+0000","last_change":"2023-08-10T10:44:36.518466+0000","last_active":"2023-08-10T10:44:36.518545+0000","last_peered":"2023-08-10T10:44:36.518545+0000","last_clean":"2023-08-10T10:44:36.518545+0000","last_became_active":"2023-08-10T10:44:36.517606+0000","last_became_peered":"2023-08-10T10:44:36.517606+0000","last_unstale":"2023-08-10T10:44:36.518545+0000","last_undegraded":"2023-08-10T10:44:36.518545+0000","last_fullsized":"2023-08-10T10:44:36.518545+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:40.769554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.516708+0000","last_change":"2023-08-10T10:44:35.509660+0000","last_active":"2023-08-10T10:44:36.516708+0000","last_peered":"2023-08-10T10:44:36.516708+0000","last_clean":"2023-08-10T10:44:36.516708+0000","last_became_active":"2023-08-10T10:44:35.508182+0000","last_became_peered":"2023-08-10T10:44:35.508182+0000","last_unstale":"2023-08-10T10:44:36.516708+0000","last_undegraded":"2023-08-10T10:44:36.516708+0000","last_fullsized":"2023-08-10T10:44:36.516708+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:14:07.131688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521667+0000","last_change":"2023-08-10T10:44:36.520334+0000","last_active":"2023-08-10T10:44:36.521667+0000","last_peered":"2023-08-10T10:44:36.521667+0000","last_clean":"2023-08-10T10:44:36.521667+0000","last_became_active":"2023-08-10T10:44:36.519909+0000","last_became_peered":"2023-08-10T10:44:36.519909+0000","last_unstale":"2023-08-10T10:44:36.521667+0000","last_undegraded":"2023-08-10T10:44:36.521667+0000","last_fullsized":"2023-08-10T10:44:36.521667+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:01.020144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540499+0000","last_change":"2023-08-10T10:44:35.510417+0000","last_active":"2023-08-10T10:44:37.540499+0000","last_peered":"2023-08-10T10:44:37.540499+0000","last_clean":"2023-08-10T10:44:37.540499+0000","last_became_active":"2023-08-10T10:44:35.510133+0000","last_became_peered":"2023-08-10T10:44:35.510133+0000","last_unstale":"2023-08-10T10:44:37.540499+0000","last_undegraded":"2023-08-10T10:44:37.540499+0000","last_fullsized":"2023-08-10T10:44:37.540499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:39:29.974151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.517285+0000","last_change":"2023-08-10T10:44:36.517177+0000","last_active":"2023-08-10T10:44:36.517285+0000","last_peered":"2023-08-10T10:44:36.517285+0000","last_clean":"2023-08-10T10:44:36.517285+0000","last_became_active":"2023-08-10T10:44:36.516107+0000","last_became_peered":"2023-08-10T10:44:36.516107+0000","last_unstale":"2023-08-10T10:44:36.517285+0000","last_undegraded":"2023-08-10T10:44:36.517285+0000","last_fullsized":"2023-08-10T10:44:36.517285+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:57.483563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540162+0000","last_change":"2023-08-10T10:44:35.500833+0000","last_active":"2023-08-10T10:44:37.540162+0000","last_peered":"2023-08-10T10:44:37.540162+0000","last_clean":"2023-08-10T10:44:37.540162+0000","last_became_active":"2023-08-10T10:44:35.499746+0000","last_became_peered":"2023-08-10T10:44:35.499746+0000","last_unstale":"2023-08-10T10:44:37.540162+0000","last_undegraded":"2023-08-10T10:44:37.540162+0000","last_fullsized":"2023-08-10T10:44:37.540162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:23.488428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540173+0000","last_change":"2023-08-10T10:44:36.523609+0000","last_active":"2023-08-10T10:44:37.540173+0000","last_peered":"2023-08-10T10:44:37.540173+0000","last_clean":"2023-08-10T10:44:37.540173+0000","last_became_active":"2023-08-10T10:44:36.523192+0000","last_became_peered":"2023-08-10T10:44:36.523192+0000","last_unstale":"2023-08-10T10:44:37.540173+0000","last_undegraded":"2023-08-10T10:44:37.540173+0000","last_fullsized":"2023-08-10T10:44:37.540173+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:32.675822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.528205+0000","last_change":"2023-08-10T10:44:35.506120+0000","last_active":"2023-08-10T10:44:36.528205+0000","last_peered":"2023-08-10T10:44:36.528205+0000","last_clean":"2023-08-10T10:44:36.528205+0000","last_became_active":"2023-08-10T10:44:35.505682+0000","last_became_peered":"2023-08-10T10:44:35.505682+0000","last_unstale":"2023-08-10T10:44:36.528205+0000","last_undegraded":"2023-08-10T10:44:36.528205+0000","last_fullsized":"2023-08-10T10:44:36.528205+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:56.136863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522269+0000","last_change":"2023-08-10T10:44:36.522050+0000","last_active":"2023-08-10T10:44:36.522269+0000","last_peered":"2023-08-10T10:44:36.522269+0000","last_clean":"2023-08-10T10:44:36.522269+0000","last_became_active":"2023-08-10T10:44:36.521808+0000","last_became_peered":"2023-08-10T10:44:36.521808+0000","last_unstale":"2023-08-10T10:44:36.522269+0000","last_undegraded":"2023-08-10T10:44:36.522269+0000","last_fullsized":"2023-08-10T10:44:36.522269+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:39:53.555097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535511+0000","last_change":"2023-08-10T10:44:35.507746+0000","last_active":"2023-08-10T10:44:37.535511+0000","last_peered":"2023-08-10T10:44:37.535511+0000","last_clean":"2023-08-10T10:44:37.535511+0000","last_became_active":"2023-08-10T10:44:35.507371+0000","last_became_peered":"2023-08-10T10:44:35.507371+0000","last_unstale":"2023-08-10T10:44:37.535511+0000","last_undegraded":"2023-08-10T10:44:37.535511+0000","last_fullsized":"2023-08-10T10:44:37.535511+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:51.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522223+0000","last_change":"2023-08-10T10:44:36.522125+0000","last_active":"2023-08-10T10:44:36.522223+0000","last_peered":"2023-08-10T10:44:36.522223+0000","last_clean":"2023-08-10T10:44:36.522223+0000","last_became_active":"2023-08-10T10:44:36.521882+0000","last_became_peered":"2023-08-10T10:44:36.521882+0000","last_unstale":"2023-08-10T10:44:36.522223+0000","last_undegraded":"2023-08-10T10:44:36.522223+0000","last_fullsized":"2023-08-10T10:44:36.522223+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:35.104157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508907+0000","last_change":"2023-08-10T10:44:35.510333+0000","last_active":"2023-08-10T10:44:36.508907+0000","last_peered":"2023-08-10T10:44:36.508907+0000","last_clean":"2023-08-10T10:44:36.508907+0000","last_became_active":"2023-08-10T10:44:35.508992+0000","last_became_peered":"2023-08-10T10:44:35.508992+0000","last_unstale":"2023-08-10T10:44:36.508907+0000","last_undegraded":"2023-08-10T10:44:36.508907+0000","last_fullsized":"2023-08-10T10:44:36.508907+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:56:50.446708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539059+0000","last_change":"2023-08-10T10:44:36.508055+0000","last_active":"2023-08-10T10:44:37.539059+0000","last_peered":"2023-08-10T10:44:37.539059+0000","last_clean":"2023-08-10T10:44:37.539059+0000","last_became_active":"2023-08-10T10:44:36.507673+0000","last_became_peered":"2023-08-10T10:44:36.507673+0000","last_unstale":"2023-08-10T10:44:37.539059+0000","last_undegraded":"2023-08-10T10:44:37.539059+0000","last_fullsized":"2023-08-10T10:44:37.539059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:22.024712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172400+0000","last_change":"2023-08-10T10:44:35.510976+0000","last_active":"2023-08-10T10:44:38.172400+0000","last_peered":"2023-08-10T10:44:38.172400+0000","last_clean":"2023-08-10T10:44:38.172400+0000","last_became_active":"2023-08-10T10:44:35.510256+0000","last_became_peered":"2023-08-10T10:44:35.510256+0000","last_unstale":"2023-08-10T10:44:38.172400+0000","last_undegraded":"2023-08-10T10:44:38.172400+0000","last_fullsized":"2023-08-10T10:44:38.172400+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:27:50.088708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.512869+0000","last_change":"2023-08-10T10:44:36.512440+0000","last_active":"2023-08-10T10:44:36.512869+0000","last_peered":"2023-08-10T10:44:36.512869+0000","last_clean":"2023-08-10T10:44:36.512869+0000","last_became_active":"2023-08-10T10:44:36.512212+0000","last_became_peered":"2023-08-10T10:44:36.512212+0000","last_unstale":"2023-08-10T10:44:36.512869+0000","last_undegraded":"2023-08-10T10:44:36.512869+0000","last_fullsized":"2023-08-10T10:44:36.512869+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:12.925129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535955+0000","last_change":"2023-08-10T10:44:35.500163+0000","last_active":"2023-08-10T10:44:37.535955+0000","last_peered":"2023-08-10T10:44:37.535955+0000","last_clean":"2023-08-10T10:44:37.535955+0000","last_became_active":"2023-08-10T10:44:35.499822+0000","last_became_peered":"2023-08-10T10:44:35.499822+0000","last_unstale":"2023-08-10T10:44:37.535955+0000","last_undegraded":"2023-08-10T10:44:37.535955+0000","last_fullsized":"2023-08-10T10:44:37.535955+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:01.026291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535805+0000","last_change":"2023-08-10T10:44:36.524190+0000","last_active":"2023-08-10T10:44:37.535805+0000","last_peered":"2023-08-10T10:44:37.535805+0000","last_clean":"2023-08-10T10:44:37.535805+0000","last_became_active":"2023-08-10T10:44:36.522168+0000","last_became_peered":"2023-08-10T10:44:36.522168+0000","last_unstale":"2023-08-10T10:44:37.535805+0000","last_undegraded":"2023-08-10T10:44:37.535805+0000","last_fullsized":"2023-08-10T10:44:37.535805+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:55.021221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"109'3","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539079+0000","last_change":"2023-08-10T10:44:35.511095+0000","last_active":"2023-08-10T10:44:37.539079+0000","last_peered":"2023-08-10T10:44:37.539079+0000","last_clean":"2023-08-10T10:44:37.539079+0000","last_became_active":"2023-08-10T10:44:35.510855+0000","last_became_peered":"2023-08-10T10:44:35.510855+0000","last_unstale":"2023-08-10T10:44:37.539079+0000","last_undegraded":"2023-08-10T10:44:37.539079+0000","last_fullsized":"2023-08-10T10:44:37.539079+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:37.295955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514458+0000","last_change":"2023-08-10T10:44:36.514262+0000","last_active":"2023-08-10T10:44:36.514458+0000","last_peered":"2023-08-10T10:44:36.514458+0000","last_clean":"2023-08-10T10:44:36.514458+0000","last_became_active":"2023-08-10T10:44:36.514022+0000","last_became_peered":"2023-08-10T10:44:36.514022+0000","last_unstale":"2023-08-10T10:44:36.514458+0000","last_undegraded":"2023-08-10T10:44:36.514458+0000","last_fullsized":"2023-08-10T10:44:36.514458+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:15.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.528488+0000","last_change":"2023-08-10T10:44:35.508029+0000","last_active":"2023-08-10T10:44:36.528488+0000","last_peered":"2023-08-10T10:44:36.528488+0000","last_clean":"2023-08-10T10:44:36.528488+0000","last_became_active":"2023-08-10T10:44:35.507771+0000","last_became_peered":"2023-08-10T10:44:35.507771+0000","last_unstale":"2023-08-10T10:44:36.528488+0000","last_undegraded":"2023-08-10T10:44:36.528488+0000","last_fullsized":"2023-08-10T10:44:36.528488+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:14.205033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521174+0000","last_change":"2023-08-10T10:44:36.521068+0000","last_active":"2023-08-10T10:44:36.521174+0000","last_peered":"2023-08-10T10:44:36.521174+0000","last_clean":"2023-08-10T10:44:36.521174+0000","last_became_active":"2023-08-10T10:44:36.519960+0000","last_became_peered":"2023-08-10T10:44:36.519960+0000","last_unstale":"2023-08-10T10:44:36.521174+0000","last_undegraded":"2023-08-10T10:44:36.521174+0000","last_fullsized":"2023-08-10T10:44:36.521174+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:41:13.804940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.515817+0000","last_change":"2023-08-10T10:44:35.510566+0000","last_active":"2023-08-10T10:44:36.515817+0000","last_peered":"2023-08-10T10:44:36.515817+0000","last_clean":"2023-08-10T10:44:36.515817+0000","last_became_active":"2023-08-10T10:44:35.509344+0000","last_became_peered":"2023-08-10T10:44:35.509344+0000","last_unstale":"2023-08-10T10:44:36.515817+0000","last_undegraded":"2023-08-10T10:44:36.515817+0000","last_fullsized":"2023-08-10T10:44:36.515817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:56.693156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539623+0000","last_change":"2023-08-10T10:44:36.508005+0000","last_active":"2023-08-10T10:44:37.539623+0000","last_peered":"2023-08-10T10:44:37.539623+0000","last_clean":"2023-08-10T10:44:37.539623+0000","last_became_active":"2023-08-10T10:44:36.507089+0000","last_became_peered":"2023-08-10T10:44:36.507089+0000","last_unstale":"2023-08-10T10:44:37.539623+0000","last_undegraded":"2023-08-10T10:44:37.539623+0000","last_fullsized":"2023-08-10T10:44:37.539623+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:39:39.481385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508533+0000","last_change":"2023-08-10T10:44:35.513291+0000","last_active":"2023-08-10T10:44:36.508533+0000","last_peered":"2023-08-10T10:44:36.508533+0000","last_clean":"2023-08-10T10:44:36.508533+0000","last_became_active":"2023-08-10T10:44:35.512403+0000","last_became_peered":"2023-08-10T10:44:35.512403+0000","last_unstale":"2023-08-10T10:44:36.508533+0000","last_undegraded":"2023-08-10T10:44:36.508533+0000","last_fullsized":"2023-08-10T10:44:36.508533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:15.939903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594217+0000","last_change":"2023-08-10T10:44:36.515405+0000","last_active":"2023-08-10T10:44:37.594217+0000","last_peered":"2023-08-10T10:44:37.594217+0000","last_clean":"2023-08-10T10:44:37.594217+0000","last_became_active":"2023-08-10T10:44:36.515173+0000","last_became_peered":"2023-08-10T10:44:36.515173+0000","last_unstale":"2023-08-10T10:44:37.594217+0000","last_undegraded":"2023-08-10T10:44:37.594217+0000","last_fullsized":"2023-08-10T10:44:37.594217+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:04.296346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507402+0000","last_change":"2023-08-10T10:44:35.507615+0000","last_active":"2023-08-10T10:44:36.507402+0000","last_peered":"2023-08-10T10:44:36.507402+0000","last_clean":"2023-08-10T10:44:36.507402+0000","last_became_active":"2023-08-10T10:44:35.506084+0000","last_became_peered":"2023-08-10T10:44:35.506084+0000","last_unstale":"2023-08-10T10:44:36.507402+0000","last_undegraded":"2023-08-10T10:44:36.507402+0000","last_fullsized":"2023-08-10T10:44:36.507402+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:17.007773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.595380+0000","last_change":"2023-08-10T10:44:36.502337+0000","last_active":"2023-08-10T10:44:37.595380+0000","last_peered":"2023-08-10T10:44:37.595380+0000","last_clean":"2023-08-10T10:44:37.595380+0000","last_became_active":"2023-08-10T10:44:36.501524+0000","last_became_peered":"2023-08-10T10:44:36.501524+0000","last_unstale":"2023-08-10T10:44:37.595380+0000","last_undegraded":"2023-08-10T10:44:37.595380+0000","last_fullsized":"2023-08-10T10:44:37.595380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:35.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":19,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.526143+0000","last_change":"2023-08-10T10:44:35.509636+0000","last_active":"2023-08-10T10:44:36.526143+0000","last_peered":"2023-08-10T10:44:36.526143+0000","last_clean":"2023-08-10T10:44:36.526143+0000","last_became_active":"2023-08-10T10:44:35.509361+0000","last_became_peered":"2023-08-10T10:44:35.509361+0000","last_unstale":"2023-08-10T10:44:36.526143+0000","last_undegraded":"2023-08-10T10:44:36.526143+0000","last_fullsized":"2023-08-10T10:44:36.526143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:44.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541449+0000","last_change":"2023-08-10T10:44:36.520043+0000","last_active":"2023-08-10T10:44:37.541449+0000","last_peered":"2023-08-10T10:44:37.541449+0000","last_clean":"2023-08-10T10:44:37.541449+0000","last_became_active":"2023-08-10T10:44:36.516901+0000","last_became_peered":"2023-08-10T10:44:36.516901+0000","last_unstale":"2023-08-10T10:44:37.541449+0000","last_undegraded":"2023-08-10T10:44:37.541449+0000","last_fullsized":"2023-08-10T10:44:37.541449+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:54.538183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522218+0000","last_change":"2023-08-10T10:44:35.509272+0000","last_active":"2023-08-10T10:44:36.522218+0000","last_peered":"2023-08-10T10:44:36.522218+0000","last_clean":"2023-08-10T10:44:36.522218+0000","last_became_active":"2023-08-10T10:44:35.508599+0000","last_became_peered":"2023-08-10T10:44:35.508599+0000","last_unstale":"2023-08-10T10:44:36.522218+0000","last_undegraded":"2023-08-10T10:44:36.522218+0000","last_fullsized":"2023-08-10T10:44:36.522218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:15.345506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521530+0000","last_change":"2023-08-10T10:44:36.516983+0000","last_active":"2023-08-10T10:44:36.521530+0000","last_peered":"2023-08-10T10:44:36.521530+0000","last_clean":"2023-08-10T10:44:36.521530+0000","last_became_active":"2023-08-10T10:44:36.516663+0000","last_became_peered":"2023-08-10T10:44:36.516663+0000","last_unstale":"2023-08-10T10:44:36.521530+0000","last_undegraded":"2023-08-10T10:44:36.521530+0000","last_fullsized":"2023-08-10T10:44:36.521530+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:03.543690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539227+0000","last_change":"2023-08-10T10:44:35.507355+0000","last_active":"2023-08-10T10:44:37.539227+0000","last_peered":"2023-08-10T10:44:37.539227+0000","last_clean":"2023-08-10T10:44:37.539227+0000","last_became_active":"2023-08-10T10:44:35.507112+0000","last_became_peered":"2023-08-10T10:44:35.507112+0000","last_unstale":"2023-08-10T10:44:37.539227+0000","last_undegraded":"2023-08-10T10:44:37.539227+0000","last_fullsized":"2023-08-10T10:44:37.539227+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:24.207346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521647+0000","last_change":"2023-08-10T10:44:36.520163+0000","last_active":"2023-08-10T10:44:36.521647+0000","last_peered":"2023-08-10T10:44:36.521647+0000","last_clean":"2023-08-10T10:44:36.521647+0000","last_became_active":"2023-08-10T10:44:36.518935+0000","last_became_peered":"2023-08-10T10:44:36.518935+0000","last_unstale":"2023-08-10T10:44:36.521647+0000","last_undegraded":"2023-08-10T10:44:36.521647+0000","last_fullsized":"2023-08-10T10:44:36.521647+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:26.490209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.539499+0000","last_change":"2023-08-10T10:44:35.510879+0000","last_active":"2023-08-10T10:44:37.539499+0000","last_peered":"2023-08-10T10:44:37.539499+0000","last_clean":"2023-08-10T10:44:37.539499+0000","last_became_active":"2023-08-10T10:44:35.510535+0000","last_became_peered":"2023-08-10T10:44:35.510535+0000","last_unstale":"2023-08-10T10:44:37.539499+0000","last_undegraded":"2023-08-10T10:44:37.539499+0000","last_fullsized":"2023-08-10T10:44:37.539499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:30.478619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172114+0000","last_change":"2023-08-10T10:44:36.512746+0000","last_active":"2023-08-10T10:44:38.172114+0000","last_peered":"2023-08-10T10:44:38.172114+0000","last_clean":"2023-08-10T10:44:38.172114+0000","last_became_active":"2023-08-10T10:44:36.512478+0000","last_became_peered":"2023-08-10T10:44:36.512478+0000","last_unstale":"2023-08-10T10:44:38.172114+0000","last_undegraded":"2023-08-10T10:44:38.172114+0000","last_fullsized":"2023-08-10T10:44:38.172114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:42:25.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541792+0000","last_change":"2023-08-10T10:44:35.508755+0000","last_active":"2023-08-10T10:44:37.541792+0000","last_peered":"2023-08-10T10:44:37.541792+0000","last_clean":"2023-08-10T10:44:37.541792+0000","last_became_active":"2023-08-10T10:44:35.508489+0000","last_became_peered":"2023-08-10T10:44:35.508489+0000","last_unstale":"2023-08-10T10:44:37.541792+0000","last_undegraded":"2023-08-10T10:44:37.541792+0000","last_fullsized":"2023-08-10T10:44:37.541792+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:53:39.505891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594391+0000","last_change":"2023-08-10T10:44:36.520177+0000","last_active":"2023-08-10T10:44:37.594391+0000","last_peered":"2023-08-10T10:44:37.594391+0000","last_clean":"2023-08-10T10:44:37.594391+0000","last_became_active":"2023-08-10T10:44:36.519893+0000","last_became_peered":"2023-08-10T10:44:36.519893+0000","last_unstale":"2023-08-10T10:44:37.594391+0000","last_undegraded":"2023-08-10T10:44:37.594391+0000","last_fullsized":"2023-08-10T10:44:37.594391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:51.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.508685+0000","last_change":"2023-08-10T10:44:35.513111+0000","last_active":"2023-08-10T10:44:36.508685+0000","last_peered":"2023-08-10T10:44:36.508685+0000","last_clean":"2023-08-10T10:44:36.508685+0000","last_became_active":"2023-08-10T10:44:35.511936+0000","last_became_peered":"2023-08-10T10:44:35.511936+0000","last_unstale":"2023-08-10T10:44:36.508685+0000","last_undegraded":"2023-08-10T10:44:36.508685+0000","last_fullsized":"2023-08-10T10:44:36.508685+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:09:01.961521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.535079+0000","last_change":"2023-08-10T10:44:36.516042+0000","last_active":"2023-08-10T10:44:37.535079+0000","last_peered":"2023-08-10T10:44:37.535079+0000","last_clean":"2023-08-10T10:44:37.535079+0000","last_became_active":"2023-08-10T10:44:36.515794+0000","last_became_peered":"2023-08-10T10:44:36.515794+0000","last_unstale":"2023-08-10T10:44:37.535079+0000","last_undegraded":"2023-08-10T10:44:37.535079+0000","last_fullsized":"2023-08-10T10:44:37.535079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:51.940896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172287+0000","last_change":"2023-08-10T10:44:35.508086+0000","last_active":"2023-08-10T10:44:38.172287+0000","last_peered":"2023-08-10T10:44:38.172287+0000","last_clean":"2023-08-10T10:44:38.172287+0000","last_became_active":"2023-08-10T10:44:35.507792+0000","last_became_peered":"2023-08-10T10:44:35.507792+0000","last_unstale":"2023-08-10T10:44:38.172287+0000","last_undegraded":"2023-08-10T10:44:38.172287+0000","last_fullsized":"2023-08-10T10:44:38.172287+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.585465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540525+0000","last_change":"2023-08-10T10:44:36.520095+0000","last_active":"2023-08-10T10:44:37.540525+0000","last_peered":"2023-08-10T10:44:37.540525+0000","last_clean":"2023-08-10T10:44:37.540525+0000","last_became_active":"2023-08-10T10:44:36.516603+0000","last_became_peered":"2023-08-10T10:44:36.516603+0000","last_unstale":"2023-08-10T10:44:37.540525+0000","last_undegraded":"2023-08-10T10:44:37.540525+0000","last_fullsized":"2023-08-10T10:44:37.540525+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:33:12.392323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.541767+0000","last_change":"2023-08-10T10:44:35.509906+0000","last_active":"2023-08-10T10:44:37.541767+0000","last_peered":"2023-08-10T10:44:37.541767+0000","last_clean":"2023-08-10T10:44:37.541767+0000","last_became_active":"2023-08-10T10:44:35.509622+0000","last_became_peered":"2023-08-10T10:44:35.509622+0000","last_unstale":"2023-08-10T10:44:37.541767+0000","last_undegraded":"2023-08-10T10:44:37.541767+0000","last_fullsized":"2023-08-10T10:44:37.541767+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:30.488590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.521572+0000","last_change":"2023-08-10T10:44:36.518133+0000","last_active":"2023-08-10T10:44:36.521572+0000","last_peered":"2023-08-10T10:44:36.521572+0000","last_clean":"2023-08-10T10:44:36.521572+0000","last_became_active":"2023-08-10T10:44:36.517130+0000","last_became_peered":"2023-08-10T10:44:36.517130+0000","last_unstale":"2023-08-10T10:44:36.521572+0000","last_undegraded":"2023-08-10T10:44:36.521572+0000","last_fullsized":"2023-08-10T10:44:36.521572+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:26.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505170+0000","last_change":"2023-08-10T10:44:35.514143+0000","last_active":"2023-08-10T10:44:36.505170+0000","last_peered":"2023-08-10T10:44:36.505170+0000","last_clean":"2023-08-10T10:44:36.505170+0000","last_became_active":"2023-08-10T10:44:35.513721+0000","last_became_peered":"2023-08-10T10:44:35.513721+0000","last_unstale":"2023-08-10T10:44:36.505170+0000","last_undegraded":"2023-08-10T10:44:36.505170+0000","last_fullsized":"2023-08-10T10:44:36.505170+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:44:47.787173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519261+0000","last_change":"2023-08-10T10:44:36.519190+0000","last_active":"2023-08-10T10:44:36.519261+0000","last_peered":"2023-08-10T10:44:36.519261+0000","last_clean":"2023-08-10T10:44:36.519261+0000","last_became_active":"2023-08-10T10:44:36.518765+0000","last_became_peered":"2023-08-10T10:44:36.518765+0000","last_unstale":"2023-08-10T10:44:36.519261+0000","last_undegraded":"2023-08-10T10:44:36.519261+0000","last_fullsized":"2023-08-10T10:44:36.519261+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:30.242790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507631+0000","last_change":"2023-08-10T10:44:35.508922+0000","last_active":"2023-08-10T10:44:36.507631+0000","last_peered":"2023-08-10T10:44:36.507631+0000","last_clean":"2023-08-10T10:44:36.507631+0000","last_became_active":"2023-08-10T10:44:35.507242+0000","last_became_peered":"2023-08-10T10:44:35.507242+0000","last_unstale":"2023-08-10T10:44:36.507631+0000","last_undegraded":"2023-08-10T10:44:36.507631+0000","last_fullsized":"2023-08-10T10:44:36.507631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:34.348917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":326,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.507458+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:44:36.507458+0000","last_peered":"2023-08-10T10:44:36.507458+0000","last_clean":"2023-08-10T10:44:36.507458+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:44:36.507458+0000","last_undegraded":"2023-08-10T10:44:36.507458+0000","last_fullsized":"2023-08-10T10:44:36.507458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:58.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172521+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:44:38.172521+0000","last_peered":"2023-08-10T10:44:38.172521+0000","last_clean":"2023-08-10T10:44:38.172521+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:44:38.172521+0000","last_undegraded":"2023-08-10T10:44:38.172521+0000","last_fullsized":"2023-08-10T10:44:38.172521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:20.474819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514165+0000","last_change":"2023-08-10T10:44:36.514045+0000","last_active":"2023-08-10T10:44:36.514165+0000","last_peered":"2023-08-10T10:44:36.514165+0000","last_clean":"2023-08-10T10:44:36.514165+0000","last_became_active":"2023-08-10T10:44:36.513687+0000","last_became_peered":"2023-08-10T10:44:36.513687+0000","last_unstale":"2023-08-10T10:44:36.514165+0000","last_undegraded":"2023-08-10T10:44:36.514165+0000","last_fullsized":"2023-08-10T10:44:36.514165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:17:45.794607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540676+0000","last_change":"2023-08-10T10:44:35.511348+0000","last_active":"2023-08-10T10:44:37.540676+0000","last_peered":"2023-08-10T10:44:37.540676+0000","last_clean":"2023-08-10T10:44:37.540676+0000","last_became_active":"2023-08-10T10:44:35.511046+0000","last_became_peered":"2023-08-10T10:44:35.511046+0000","last_unstale":"2023-08-10T10:44:37.540676+0000","last_undegraded":"2023-08-10T10:44:37.540676+0000","last_fullsized":"2023-08-10T10:44:37.540676+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:56.081326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505925+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:44:36.505925+0000","last_peered":"2023-08-10T10:44:36.505925+0000","last_clean":"2023-08-10T10:44:36.505925+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:44:36.505925+0000","last_undegraded":"2023-08-10T10:44:36.505925+0000","last_fullsized":"2023-08-10T10:44:36.505925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:41:05.942136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540133+0000","last_change":"2023-08-10T10:44:36.514861+0000","last_active":"2023-08-10T10:44:37.540133+0000","last_peered":"2023-08-10T10:44:37.540133+0000","last_clean":"2023-08-10T10:44:37.540133+0000","last_became_active":"2023-08-10T10:44:36.514569+0000","last_became_peered":"2023-08-10T10:44:36.514569+0000","last_unstale":"2023-08-10T10:44:37.540133+0000","last_undegraded":"2023-08-10T10:44:37.540133+0000","last_fullsized":"2023-08-10T10:44:37.540133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:05.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.519860+0000","last_change":"2023-08-10T10:44:35.510814+0000","last_active":"2023-08-10T10:44:36.519860+0000","last_peered":"2023-08-10T10:44:36.519860+0000","last_clean":"2023-08-10T10:44:36.519860+0000","last_became_active":"2023-08-10T10:44:35.509922+0000","last_became_peered":"2023-08-10T10:44:35.509922+0000","last_unstale":"2023-08-10T10:44:36.519860+0000","last_undegraded":"2023-08-10T10:44:36.519860+0000","last_fullsized":"2023-08-10T10:44:36.519860+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:54.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.595032+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:44:37.595032+0000","last_peered":"2023-08-10T10:44:37.595032+0000","last_clean":"2023-08-10T10:44:37.595032+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:44:37.595032+0000","last_undegraded":"2023-08-10T10:44:37.595032+0000","last_fullsized":"2023-08-10T10:44:37.595032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:20.140577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540971+0000","last_change":"2023-08-10T10:44:36.503609+0000","last_active":"2023-08-10T10:44:37.540971+0000","last_peered":"2023-08-10T10:44:37.540971+0000","last_clean":"2023-08-10T10:44:37.540971+0000","last_became_active":"2023-08-10T10:44:36.503236+0000","last_became_peered":"2023-08-10T10:44:36.503236+0000","last_unstale":"2023-08-10T10:44:37.540971+0000","last_undegraded":"2023-08-10T10:44:37.540971+0000","last_fullsized":"2023-08-10T10:44:37.540971+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:33.345230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540982+0000","last_change":"2023-08-10T10:44:35.499356+0000","last_active":"2023-08-10T10:44:37.540982+0000","last_peered":"2023-08-10T10:44:37.540982+0000","last_clean":"2023-08-10T10:44:37.540982+0000","last_became_active":"2023-08-10T10:44:35.498694+0000","last_became_peered":"2023-08-10T10:44:35.498694+0000","last_unstale":"2023-08-10T10:44:37.540982+0000","last_undegraded":"2023-08-10T10:44:37.540982+0000","last_fullsized":"2023-08-10T10:44:37.540982+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:29:14.127082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172401+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:44:38.172401+0000","last_peered":"2023-08-10T10:44:38.172401+0000","last_clean":"2023-08-10T10:44:38.172401+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:44:38.172401+0000","last_undegraded":"2023-08-10T10:44:38.172401+0000","last_fullsized":"2023-08-10T10:44:38.172401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:21.388317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.522046+0000","last_change":"2023-08-10T10:44:36.521950+0000","last_active":"2023-08-10T10:44:36.522046+0000","last_peered":"2023-08-10T10:44:36.522046+0000","last_clean":"2023-08-10T10:44:36.522046+0000","last_became_active":"2023-08-10T10:44:36.521530+0000","last_became_peered":"2023-08-10T10:44:36.521530+0000","last_unstale":"2023-08-10T10:44:36.522046+0000","last_undegraded":"2023-08-10T10:44:36.522046+0000","last_fullsized":"2023-08-10T10:44:36.522046+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:33.893790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172029+0000","last_change":"2023-08-10T10:44:35.506343+0000","last_active":"2023-08-10T10:44:38.172029+0000","last_peered":"2023-08-10T10:44:38.172029+0000","last_clean":"2023-08-10T10:44:38.172029+0000","last_became_active":"2023-08-10T10:44:35.506074+0000","last_became_peered":"2023-08-10T10:44:35.506074+0000","last_unstale":"2023-08-10T10:44:38.172029+0000","last_undegraded":"2023-08-10T10:44:38.172029+0000","last_fullsized":"2023-08-10T10:44:38.172029+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:14:32.496589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.506806+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:44:36.506806+0000","last_peered":"2023-08-10T10:44:36.506806+0000","last_clean":"2023-08-10T10:44:36.506806+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:44:36.506806+0000","last_undegraded":"2023-08-10T10:44:36.506806+0000","last_fullsized":"2023-08-10T10:44:36.506806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:17:46.540333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.172802+0000","last_change":"2023-08-10T10:44:36.521371+0000","last_active":"2023-08-10T10:44:38.172802+0000","last_peered":"2023-08-10T10:44:38.172802+0000","last_clean":"2023-08-10T10:44:38.172802+0000","last_became_active":"2023-08-10T10:44:36.521130+0000","last_became_peered":"2023-08-10T10:44:36.521130+0000","last_unstale":"2023-08-10T10:44:38.172802+0000","last_undegraded":"2023-08-10T10:44:38.172802+0000","last_fullsized":"2023-08-10T10:44:38.172802+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:57.529878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594805+0000","last_change":"2023-08-10T10:44:35.503474+0000","last_active":"2023-08-10T10:44:37.594805+0000","last_peered":"2023-08-10T10:44:37.594805+0000","last_clean":"2023-08-10T10:44:37.594805+0000","last_became_active":"2023-08-10T10:44:35.503019+0000","last_became_peered":"2023-08-10T10:44:35.503019+0000","last_unstale":"2023-08-10T10:44:37.594805+0000","last_undegraded":"2023-08-10T10:44:37.594805+0000","last_fullsized":"2023-08-10T10:44:37.594805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:05:15.263968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505519+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:44:36.505519+0000","last_peered":"2023-08-10T10:44:36.505519+0000","last_clean":"2023-08-10T10:44:36.505519+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:44:36.505519+0000","last_undegraded":"2023-08-10T10:44:36.505519+0000","last_fullsized":"2023-08-10T10:44:36.505519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:48.742712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.171836+0000","last_change":"2023-08-10T10:44:36.515653+0000","last_active":"2023-08-10T10:44:38.171836+0000","last_peered":"2023-08-10T10:44:38.171836+0000","last_clean":"2023-08-10T10:44:38.171836+0000","last_became_active":"2023-08-10T10:44:36.515420+0000","last_became_peered":"2023-08-10T10:44:36.515420+0000","last_unstale":"2023-08-10T10:44:38.171836+0000","last_undegraded":"2023-08-10T10:44:38.171836+0000","last_fullsized":"2023-08-10T10:44:38.171836+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:26.415351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:38.173102+0000","last_change":"2023-08-10T10:44:35.508557+0000","last_active":"2023-08-10T10:44:38.173102+0000","last_peered":"2023-08-10T10:44:38.173102+0000","last_clean":"2023-08-10T10:44:38.173102+0000","last_became_active":"2023-08-10T10:44:35.508081+0000","last_became_peered":"2023-08-10T10:44:35.508081+0000","last_unstale":"2023-08-10T10:44:38.173102+0000","last_undegraded":"2023-08-10T10:44:38.173102+0000","last_fullsized":"2023-08-10T10:44:38.173102+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:47:55.159130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.505005+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:44:36.505005+0000","last_peered":"2023-08-10T10:44:36.505005+0000","last_clean":"2023-08-10T10:44:36.505005+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:44:36.505005+0000","last_undegraded":"2023-08-10T10:44:36.505005+0000","last_fullsized":"2023-08-10T10:44:36.505005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:11.507730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-10T10:44:36.514146+0000","last_change":"2023-08-10T10:44:36.513673+0000","last_active":"2023-08-10T10:44:36.514146+0000","last_peered":"2023-08-10T10:44:36.514146+0000","last_clean":"2023-08-10T10:44:36.514146+0000","last_became_active":"2023-08-10T10:44:36.513385+0000","last_became_peered":"2023-08-10T10:44:36.513385+0000","last_unstale":"2023-08-10T10:44:36.514146+0000","last_undegraded":"2023-08-10T10:44:36.514146+0000","last_fullsized":"2023-08-10T10:44:36.514146+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:35.466201+0000","last_clean_scrub_stamp":"2023-08-10T10:44:35.466201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:02:38.369097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.594360+0000","last_change":"2023-08-10T10:44:35.506909+0000","last_active":"2023-08-10T10:44:37.594360+0000","last_peered":"2023-08-10T10:44:37.594360+0000","last_clean":"2023-08-10T10:44:37.594360+0000","last_became_active":"2023-08-10T10:44:35.506240+0000","last_became_peered":"2023-08-10T10:44:35.506240+0000","last_unstale":"2023-08-10T10:44:37.594360+0000","last_undegraded":"2023-08-10T10:44:37.594360+0000","last_fullsized":"2023-08-10T10:44:37.594360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:44:34.449050+0000","last_clean_scrub_stamp":"2023-08-10T10:44:34.449050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:41:42.575056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-10T10:44:37.540950+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:44:37.540950+0000","last_peered":"2023-08-10T10:44:37.540950+0000","last_clean":"2023-08-10T10:44:37.540950+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:44:37.540950+0000","last_undegraded":"2023-08-10T10:44:37.540950+0000","last_fullsized":"2023-08-10T10:44:37.540950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:05.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194115,"statfs":{"total":200000000,"available":198774397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.071,"15min":1.123},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.202,"5min":1.175,"15min":1.0800000000000001},"min":{"1min":0.70299999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6000000000000001,"5min":5.149,"15min":5.149},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.73699999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.734,"5min":1.7370000000000001,"15min":2.1600000000000001},"last":0.755},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.1379999999999999},"min":{"1min":0.70099999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6140000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.2250000000000001},"min":{"1min":0.80700000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6060000000000001,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.79300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.5269999999999999,"5min":1.7589999999999999,"15min":2.3610000000000002},"last":1.282}]},{"osd":3,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2070000000000001,"15min":1.216},"min":{"1min":0.91600000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6839999999999999,"5min":1.766,"15min":1.766},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.327,"15min":1.3799999999999999},"min":{"1min":0.877,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.651,"5min":1.982,"15min":2.4860000000000002},"last":1.468}]},{"osd":4,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.236,"15min":1.236},"min":{"1min":0.89200000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.617,"5min":1.99,"15min":1.99},"last":1.401},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.272},"min":{"1min":0.92400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8129999999999999,"5min":6.657,"15min":6.657},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.431,"15min":1.4410000000000001},"min":{"1min":0.93500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.901,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.486,"15min":1.4930000000000001},"min":{"1min":1.0660000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.8129999999999999,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.53}]},{"osd":6,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4870000000000001,"15min":1.573},"min":{"1min":1.1259999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.73},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.464,"15min":1.5029999999999999},"min":{"1min":1.1160000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.946,"5min":3.585,"15min":3.585},"last":1.583}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356000,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1200000000000001,"15min":1.0569999999999999},"min":{"1min":0.85699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.619,"5min":1.75,"15min":1.7509999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.109,"15min":1.002},"min":{"1min":0.91900000000000004,"5min":0.67600000000000005,"15min":0.46600000000000003},"max":{"1min":1.4359999999999999,"5min":1.659,"15min":1.659},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1160000000000001,"15min":1.069},"min":{"1min":0.67800000000000005,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2290000000000001,"15min":1.1779999999999999},"min":{"1min":0.79100000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1970000000000001,"15min":1.133},"min":{"1min":0.83699999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"max":{"1min":1.7190000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2949999999999999,"15min":1.232},"min":{"1min":0.86399999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6739999999999999,"5min":1.968,"15min":1.968},"last":1.2110000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.3400000000000001,"15min":1.222},"min":{"1min":1.089,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":1.095},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3149999999999999,"15min":1.258},"min":{"1min":1.0349999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9319999999999999,"5min":2.395,"15min":2.395},"last":1.157}]},{"osd":4,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2969999999999999,"15min":1.2090000000000001},"min":{"1min":0.90800000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.77,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.498},{"interface":"front","average":{"1min":1.591,"5min":1.488,"15min":1.415},"min":{"1min":1.2,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":1.964,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.4990000000000001,"15min":1.4059999999999999},"min":{"1min":1.125,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.0459999999999998,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.738,"5min":1.5660000000000001,"15min":1.496},"min":{"1min":1.325,"5min":0.84099999999999997,"15min":0.69399999999999995},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.4259999999999999,"15min":1.3680000000000001},"min":{"1min":1.2290000000000001,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":1.923,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.375},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5669999999999999,"15min":1.4830000000000001},"min":{"1min":1.2649999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9359999999999999,"5min":2.5819999999999999,"15min":2.698},"last":1.5609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194693,"statfs":{"total":200000000,"available":199365840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.171,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5720000000000001,"5min":1.833,"15min":2.5070000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.456,"15min":1.212},"min":{"1min":0.73799999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6890000000000001,"5min":32.941000000000003,"15min":32.941000000000003},"last":1.1819999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1779999999999999,"15min":1.2190000000000001},"min":{"1min":0.83299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5680000000000001,"5min":1.659,"15min":2.2450000000000001},"last":1.762},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.74399999999999999,"5min":0.71799999999999997,"15min":0.70499999999999996},"max":{"1min":1.611,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.88300000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6839999999999999,"5min":1.7410000000000001,"15min":4.1980000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.1599999999999999},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.53,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2609999999999999,"15min":1.2549999999999999},"min":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6259999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.321,"15min":1.3680000000000001},"min":{"1min":0.95199999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.698,"5min":1.7989999999999999,"15min":4.0620000000000003},"last":1.704}]},{"osd":4,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.214,"15min":1.282},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.633,"5min":1.9039999999999999,"15min":2.399},"last":1.365},{"interface":"front","average":{"1min":1.391,"5min":1.3540000000000001,"15min":1.357},"min":{"1min":0.73399999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.756,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.411}]},{"osd":6,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.397,"15min":1.321},"min":{"1min":0.67000000000000004,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.091},{"interface":"front","average":{"1min":1.415,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.85899999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7250000000000001,"5min":1.98,"15min":1.98},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:25 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.472,"15min":1.484},"min":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.911,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.571,"5min":1.516,"15min":1.4910000000000001},"min":{"1min":0.82999999999999996,"5min":0.76100000000000001,"15min":0.71299999999999997},"max":{"1min":2.0070000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.825}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358008,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.151,"15min":1.137},"min":{"1min":0.68799999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6779999999999999,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.331},{"interface":"front","average":{"1min":1.306,"5min":1.2190000000000001,"15min":1.206},"min":{"1min":0.97699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.825,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.026}]},{"osd":1,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.236,"15min":1.2909999999999999},"min":{"1min":0.873,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.78200000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1990000000000001,"15min":1.1559999999999999},"min":{"1min":0.90500000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.9860000000000002,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.524,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":0.92900000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":1.111}]},{"osd":3,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2909999999999999,"15min":1.2569999999999999},"min":{"1min":0.95399999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.8109999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.141},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.3460000000000001,"15min":1.288},"min":{"1min":0.97799999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.1850000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.266}]},{"osd":5,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.3919999999999999,"15min":1.3700000000000001},"min":{"1min":0.69799999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.294},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3320000000000001,"15min":1.3},"min":{"1min":0.755,"5min":0.63100000000000001,"15min":0.42399999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.3640000000000001,"15min":1.3340000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.47599999999999998},"max":{"1min":3.0910000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.786,"5min":1.536,"15min":1.4810000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.76700000000000002},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.474,"15min":1.4279999999999999},"min":{"1min":0.82699999999999996,"5min":0.68999999999999995,"15min":0.57999999999999996},"max":{"1min":2.8860000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.5569999999999999,"15min":1.514},"min":{"1min":1.0209999999999999,"5min":0.83899999999999997,"15min":0.73499999999999999},"max":{"1min":3.2879999999999998,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.379}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358168,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95599999999999996,"15min":0.82099999999999995},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.4079999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1519999999999999,"15min":0.97199999999999998},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.433},"max":{"1min":1.522,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.3939999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.82999999999999996},"min":{"1min":0.44,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5549999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0800000000000001,"15min":0.93000000000000005},"min":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.34100000000000003},"max":{"1min":1.532,"5min":1.897,"15min":1.897},"last":1.456}]},{"osd":2,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0589999999999999,"15min":0.93100000000000005},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.47599999999999998},"max":{"1min":1.5209999999999999,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2250000000000001,"15min":1.0649999999999999},"min":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.46899999999999997},"max":{"1min":1.649,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3280000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.347,"15min":1.22},"min":{"1min":0.90800000000000003,"5min":0.78200000000000003,"15min":0.70599999999999996},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.286,"15min":1.1990000000000001},"min":{"1min":0.872,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.296}]},{"osd":5,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.4179999999999999,"15min":1.321},"min":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.77900000000000003},"max":{"1min":1.738,"5min":2.0059999999999998,"15min":2.125},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.4570000000000001,"15min":1.3640000000000001},"min":{"1min":0.86399999999999999,"5min":0.82699999999999996,"15min":0.78400000000000003},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":1.5700000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.385,"15min":1.266},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4910000000000001,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.984,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.496,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"max":{"1min":2.2509999999999999,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.641},{"interface":"front","average":{"1min":1.409,"5min":1.4470000000000001,"15min":1.3360000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.86199999999999999},"max":{"1min":1.8600000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.23}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358168,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.89300000000000002,"15min":0.88200000000000001},"min":{"1min":0.59299999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.5209999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.99099999999999999,"15min":0.89700000000000002},"min":{"1min":0.73799999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.165}]},{"osd":1,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.103,"15min":1.0469999999999999},"min":{"1min":0.68100000000000005,"5min":0.60699999999999998,"15min":0.58499999999999996},"max":{"1min":1.641,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.621},{"interface":"front","average":{"1min":1.327,"5min":1.208,"15min":1.119},"min":{"1min":0.70599999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.821,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.345}]},{"osd":3,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":0.995,"15min":1.0109999999999999},"min":{"1min":0.76000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5620000000000001,"5min":1.6299999999999999,"15min":1.639},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.2130000000000001,"15min":1.2549999999999999},"min":{"1min":0.69899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8480000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.371}]},{"osd":4,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.407,"15min":1.425},"min":{"1min":1.054,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.415,"5min":2.415,"15min":2.6000000000000001},"last":1.734},{"interface":"front","average":{"1min":1.446,"5min":1.333,"15min":1.3009999999999999},"min":{"1min":0.96999999999999997,"5min":0.86899999999999999,"15min":0.83199999999999996},"max":{"1min":2.085,"5min":2.085,"15min":2.1520000000000001},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3149999999999999,"15min":1.276},"min":{"1min":1.0469999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.798,"5min":1.4950000000000001,"15min":1.486},"min":{"1min":1.1870000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.294,"5min":3.294,"15min":3.294},"last":1.5009999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.458,"15min":1.383},"min":{"1min":1.0920000000000001,"5min":0.88600000000000001,"15min":0.81599999999999995},"max":{"1min":2.3940000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.4139999999999999,"15min":1.359},"min":{"1min":1.127,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":1.51,"15min":1.4079999999999999},"min":{"1min":1.1319999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.3319999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.569},{"interface":"front","average":{"1min":1.76,"5min":1.492,"15min":1.4319999999999999},"min":{"1min":1.161,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":1.1479999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194692,"statfs":{"total":200000000,"available":199364751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.89600000000000002,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6240000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":0.93799999999999994},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3640000000000001,"5min":2.012,"15min":2.246},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.006,"15min":0.87},"min":{"1min":0.65600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.546,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.238,"15min":1.0569999999999999},"min":{"1min":0.86499999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5349999999999999,"5min":2.423,"15min":2.423},"last":1.153}]},{"osd":3,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.155,"15min":1.0469999999999999},"min":{"1min":0.80200000000000005,"5min":0.51100000000000001,"15min":0.45400000000000001},"max":{"1min":1.5800000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.276},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0660000000000001,"15min":1.0289999999999999},"min":{"1min":0.621,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.786,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.446}]},{"osd":4,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.258,"15min":1.1579999999999999},"min":{"1min":0.85299999999999998,"5min":0.78000000000000003,"15min":0.65500000000000003},"max":{"1min":1.611,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.456,"15min":1.3839999999999999},"min":{"1min":0.999,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6950000000000001,"5min":2.343,"15min":2.343},"last":1.3899999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4139999999999999,"15min":1.359},"min":{"1min":1.028,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.901,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3939999999999999,"15min":1.302},"min":{"1min":0.96999999999999997,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":1.8700000000000001,"5min":2.73,"15min":2.73},"last":1.615}]},{"osd":6,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.4279999999999999,"15min":1.361},"min":{"1min":0.93899999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.228},{"interface":"front","average":{"1min":1.452,"5min":1.3700000000000001,"15min":1.252},"min":{"1min":0.92500000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.992,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.466,"15min":1.4319999999999999},"min":{"1min":1.165,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9710000000000001,"5min":2.742,"15min":2.742},"last":1.548},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.502,"15min":1.3939999999999999},"min":{"1min":0.82699999999999996,"5min":0.625,"15min":0.625},"max":{"1min":2.1640000000000001,"5min":2.605,"15min":2.605},"last":1.585}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194114,"statfs":{"total":200000000,"available":198773202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.075,"15min":1.0329999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51300000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.853},"last":1.343}]},{"osd":2,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.53400000000000003,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.4450000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.054},{"interface":"front","average":{"1min":1.046,"5min":1.0449999999999999,"15min":1.0229999999999999},"min":{"1min":0.51800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.597,"5min":1.7,"15min":1.7},"last":1.111}]},{"osd":3,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":0.95199999999999996},"min":{"1min":0.499,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6839999999999999,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1679999999999999,"15min":1.1160000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.7589999999999999,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.367,"15min":1.2729999999999999},"min":{"1min":0.89500000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.768,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.4710000000000001,"15min":1.405},"min":{"1min":1.0169999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":3.1739999999999999,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.87,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.986},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.5449999999999999,"15min":1.351},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.853,"5min":16.058,"15min":16.058},"last":1.556}]},{"osd":6,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.478,"15min":1.46},"min":{"1min":0.875,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1680000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.593},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.4430000000000001,"15min":1.4350000000000001},"min":{"1min":0.82699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1200000000000001,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.7210000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5109999999999999,"15min":1.528},"min":{"1min":0.76500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.0899999999999999,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.615},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4970000000000001,"15min":1.419},"min":{"1min":0.85099999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9430000000000001,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.679}]}]}],"pool_statfs":[]}} 2023-08-10T10:44:41.502 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:44:41.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:44:41.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.771+0000 7fa0411a4640 1 Processor -- start 2023-08-10T10:44:41.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.771+0000 7fa0411a4640 1 -- start start 2023-08-10T10:44:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa0411a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c0b0cd0 0x7fa03c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa0411a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c161640 con 0x7fa03c161260 2023-08-10T10:44:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa0411a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c0adb30 con 0x7fa03c0cdcb0 2023-08-10T10:44:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa0411a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c1bb0 con 0x7fa03c0b0cd0 2023-08-10T10:44:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa03ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa03c161260 0x7fa03c0ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39924/0 (socket says 172.21.15.50:39924) 2023-08-10T10:44:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.773+0000 7fa03ad9d640 1 -- 172.21.15.50:0/1875940132 learned_addr learned my addr 172.21.15.50:0/1875940132 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:41.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46184640 0 0) 0x7fa03c161640 con 0x7fa03c161260 2023-08-10T10:44:41.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa028003520 con 0x7fa03c161260 2023-08-10T10:44:41.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c0b0cd0 0x7fa03c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788531146 0 0) 0x7fa028003520 con 0x7fa03c161260 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c0b0cd0 msgr2=0x7fa03c06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c0b0cd0 0x7fa03c06ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 >> v1:172.21.15.117:6789/0 conn(0x7fa03c0cdcb0 legacy=0x7fa03c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0ade10 con 0x7fa03c161260 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa02c0019f0 con 0x7fa03c161260 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 >> v1:172.21.15.50:6789/0 conn(0x7fa03c161260 legacy=0x7fa03c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.774+0000 7fa03a59c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0280039a0 0x7fa028003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03a59c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa028004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03a59c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0280052a0 0x7fa02800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800c0a0 con 0x7fa0280047c0 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800c210 con 0x7fa0280039a0 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800c3d0 con 0x7fa0280052a0 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c0b0cd0 0x7fa03c06ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa028004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0280039a0 0x7fa028003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.775+0000 7fa03b59e640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0280052a0 0x7fa02800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.776+0000 7fa03259c640 1 -- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0280052a0 msgr2=0x7fa02800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.776+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0280052a0 0x7fa02800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.776+0000 7fa03259c640 1 -- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0280039a0 msgr2=0x7fa028003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.776+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0280039a0 0x7fa028003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.776+0000 7fa03259c640 1 -- 172.21.15.50:0/1875940132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028003520 con 0x7fa0280047c0 2023-08-10T10:44:41.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.777+0000 7fa03259c640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa028004c40 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa024006fd0 tx=0x7fa0280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a064b3f765361c1c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.777+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024032600 con 0x7fa0280047c0 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.777+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02402e050 con 0x7fa0280047c0 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.777+0000 7fa03a59c640 1 -- 172.21.15.50:0/1875940132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024032980 con 0x7fa0280047c0 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 -- 172.21.15.50:0/1875940132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 msgr2=0x7fa028004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 --2- 172.21.15.50:0/1875940132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa028004c40 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa024006fd0 tx=0x7fa0280057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa03b59e640 1 -- 172.21.15.50:0/1875940132 reap_dead start 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 -- 172.21.15.50:0/1875940132 shutdown_connections 2023-08-10T10:44:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 -- 172.21.15.50:0/1875940132 >> 172.21.15.50:0/1875940132 conn(0x7fa03c0b01b0 msgr2=0x7fa03c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 -- 172.21.15.50:0/1875940132 shutdown_connections 2023-08-10T10:44:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.778+0000 7fa0411a4640 1 -- 172.21.15.50:0/1875940132 wait complete. 2023-08-10T10:44:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.780+0000 7fa0411a4640 1 Processor -- start 2023-08-10T10:44:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.780+0000 7fa0411a4640 1 -- start start 2023-08-10T10:44:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c158a80 0x7fa03c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa03c1eaf90 0x7fa03c1eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c1eb950 con 0x7fa0280047c0 2023-08-10T10:44:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c158850 con 0x7fa03c1eaf90 2023-08-10T10:44:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa0411a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c162eb0 con 0x7fa03c158a80 2023-08-10T10:44:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43494/0 (socket says 172.21.15.50:43494) 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 -- 172.21.15.50:0/649398928 learned_addr learned my addr 172.21.15.50:0/649398928 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 -- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c158a80 msgr2=0x7fa03c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c158a80 0x7fa03c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 -- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa03c1eaf90 msgr2=0x7fa03c1eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa03c1eaf90 0x7fa03c1eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.781+0000 7fa03ad9d640 1 -- 172.21.15.50:0/649398928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c159da0 con 0x7fa0280047c0 2023-08-10T10:44:41.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007a80 tx=0x7fa02c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c013420 con 0x7fa0280047c0 2023-08-10T10:44:41.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c013580 con 0x7fa0280047c0 2023-08-10T10:44:41.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c013930 con 0x7fa0280047c0 2023-08-10T10:44:41.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c159500 con 0x7fa0280047c0 2023-08-10T10:44:41.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.782+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c159ac0 con 0x7fa0280047c0 2023-08-10T10:44:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.783+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0ca520 con 0x7fa0280047c0 2023-08-10T10:44:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.784+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa02c013a90 con 0x7fa0280047c0 2023-08-10T10:44:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.785+0000 7fa033fff640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 0x7fa01c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.785+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa02c089d80 con 0x7fa0280047c0 2023-08-10T10:44:41.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.786+0000 7fa03259c640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 0x7fa01c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.786+0000 7fa03259c640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 0x7fa01c06d140 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa024035000 tx=0x7fa02402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:41.790+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa02c054d90 con 0x7fa0280047c0 2023-08-10T10:44:42.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.054+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa03c0612b0 con 0x7fa0280047c0 2023-08-10T10:44:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.062+0000 7fa033fff640 1 -- 172.21.15.50:0/649398928 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa02c0583b0 con 0x7fa0280047c0 2023-08-10T10:44:42.064 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:44:42.064 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:44:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:44:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:44:42.065 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:44:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:44:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 msgr2=0x7fa01c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 0x7fa01c06d140 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa024035000 tx=0x7fa02402f000 comp rx=0 tx=0).stop 2023-08-10T10:44:42.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 msgr2=0x7fa03c158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007a80 tx=0x7fa02c00e530 comp rx=0 tx=0).stop 2023-08-10T10:44:42.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 shutdown_connections 2023-08-10T10:44:42.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa01c06ac80 0x7fa01c06d140 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa03c1eaf90 0x7fa03c1eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa03c158a80 0x7fa03c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 --2- 172.21.15.50:0/649398928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0280047c0 0x7fa03c158310 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 >> 172.21.15.50:0/649398928 conn(0x7fa03c0b01b0 msgr2=0x7fa03c15e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 shutdown_connections 2023-08-10T10:44:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.065+0000 7fa0411a4640 1 -- 172.21.15.50:0/649398928 wait complete. 2023-08-10T10:44:42.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.312+0000 7f5e37a14640 1 Processor -- start 2023-08-10T10:44:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.312+0000 7f5e37a14640 1 -- start start 2023-08-10T10:44:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e37a14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 0x7f5e300b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e37a14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e300b0c60 0x7f5e300b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e37a14640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e30071c70 con 0x7f5e30070e80 2023-08-10T10:44:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e37a14640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300713d0 con 0x7f5e300b0c60 2023-08-10T10:44:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e37a14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300716b0 con 0x7f5e3015aa40 2023-08-10T10:44:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e35fb1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e30070e80 0x7f5e300696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39934/0 (socket says 172.21.15.50:39934) 2023-08-10T10:44:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.314+0000 7f5e35fb1640 1 -- 172.21.15.50:0/4161340632 learned_addr learned my addr 172.21.15.50:0/4161340632 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e34faf640 1 --2- 172.21.15.50:0/4161340632 >> v2:172.21.15.117:3300/0 conn(0x7f5e300b0c60 0x7f5e300b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e357b0640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 0x7f5e300b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353780593 0 0) 0x7f5e30071c70 con 0x7f5e30070e80 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e1c003520 con 0x7f5e30070e80 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2127953808 0 0) 0x7f5e1c003520 con 0x7f5e30070e80 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 msgr2=0x7f5e300b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 0x7f5e300b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 >> v2:172.21.15.117:3300/0 conn(0x7f5e300b0c60 msgr2=0x7f5e300b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 --2- 172.21.15.50:0/4161340632 >> v2:172.21.15.117:3300/0 conn(0x7f5e300b0c60 0x7f5e300b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30071990 con 0x7f5e30070e80 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5e280019f0 con 0x7f5e30070e80 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 >> v1:172.21.15.50:6789/0 conn(0x7f5e30070e80 legacy=0x7f5e300696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.315+0000 7f5e27fff640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e1c003970 0x7f5e1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e27fff640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 0x7f5e1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e27fff640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c004d00 0x7f5e1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300713d0 con 0x7f5e1c003970 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300716b0 con 0x7f5e1c004d00 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c00b980 con 0x7f5e3015aa40 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e1c003970 0x7f5e1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 -- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 msgr2=0x7f5e1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e3015aa40 0x7f5e1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 -- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c004d00 msgr2=0x7f5e1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c004d00 0x7f5e1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.316+0000 7f5e357b0640 1 -- 172.21.15.50:0/4161340632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c003520 con 0x7f5e1c003970 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.317+0000 7f5e357b0640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e1c003970 0x7f5e1c003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009ac0 tx=0x7f5e1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8579db61f0ac489 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c02c710 con 0x7f5e1c003970 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c02c870 con 0x7f5e1c003970 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e27fff640 1 -- 172.21.15.50:0/4161340632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c02cc00 con 0x7f5e1c003970 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 -- 172.21.15.50:0/4161340632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e1c003970 msgr2=0x7f5e1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 --2- 172.21.15.50:0/4161340632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e1c003970 0x7f5e1c003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009ac0 tx=0x7f5e1c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e35fb1640 1 -- 172.21.15.50:0/4161340632 reap_dead start 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 -- 172.21.15.50:0/4161340632 shutdown_connections 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 -- 172.21.15.50:0/4161340632 >> 172.21.15.50:0/4161340632 conn(0x7f5e3006b590 msgr2=0x7f5e300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 -- 172.21.15.50:0/4161340632 shutdown_connections 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.318+0000 7f5e37a14640 1 -- 172.21.15.50:0/4161340632 wait complete. 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.320+0000 7f5e37a14640 1 Processor -- start 2023-08-10T10:44:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.320+0000 7f5e37a14640 1 -- start start 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c003970 0x7f5e300a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e300aa1e0 0x7f5e300cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a8520 con 0x7f5e3015d610 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a8800 con 0x7f5e1c003970 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.321+0000 7f5e37a14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a8ae0 con 0x7f5e300aa1e0 2023-08-10T10:44:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43520/0 (socket says 172.21.15.50:43520) 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 -- 172.21.15.50:0/2063303628 learned_addr learned my addr 172.21.15.50:0/2063303628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e357b0640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c003970 0x7f5e300a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e35fb1640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e300aa1e0 0x7f5e300cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 -- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e300aa1e0 msgr2=0x7f5e300cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e300aa1e0 0x7f5e300cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 -- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c003970 msgr2=0x7f5e300a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c003970 0x7f5e300a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 -- 172.21.15.50:0/2063303628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300a8dc0 con 0x7f5e3015d610 2023-08-10T10:44:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.322+0000 7f5e34faf640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e860 tx=0x7f5e2000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:42.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.323+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009600 con 0x7f5e3015d610 2023-08-10T10:44:42.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.323+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000c940 con 0x7f5e3015d610 2023-08-10T10:44:42.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.323+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000ccd0 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.323+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300aa720 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.323+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3015da90 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.324+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3004e270 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.325+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e20013470 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.326+0000 7f5e25ffb640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 0x7f5e1406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.326+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e200895f0 con 0x7f5e3015d610 2023-08-10T10:44:42.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.326+0000 7f5e357b0640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 0x7f5e1406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:42.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.327+0000 7f5e357b0640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 0x7f5e1406d140 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c036000 tx=0x7f5e2c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:42.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.331+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e20054690 con 0x7f5e3015d610 2023-08-10T10:44:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.567+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e300a8660 con 0x7f5e3015d610 2023-08-10T10:44:42.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.568+0000 7f5e25ffb640 1 -- 172.21.15.50:0/2063303628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f5e300a8660 con 0x7f5e3015d610 2023-08-10T10:44:42.570 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:42.570 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:44:42.570 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:44:42.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 msgr2=0x7f5e1406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 0x7f5e1406d140 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c036000 tx=0x7f5e2c030000 comp rx=0 tx=0).stop 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 msgr2=0x7f5e300a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e860 tx=0x7f5e2000ed20 comp rx=0 tx=0).stop 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 shutdown_connections 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e300aa1e0 0x7f5e300cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3015d610 0x7f5e300a9ca0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e1406ac80 0x7f5e1406d140 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 --2- 172.21.15.50:0/2063303628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e1c003970 0x7f5e300a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:42.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 >> 172.21.15.50:0/2063303628 conn(0x7f5e3006b590 msgr2=0x7f5e301581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:42.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 shutdown_connections 2023-08-10T10:44:42.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:42.571+0000 7f5e37a14640 1 -- 172.21.15.50:0/2063303628 wait complete. 2023-08-10T10:44:42.994 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:44:35.997314+0000', 'modified': '2023-08-10T10:44:39.544196+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5833}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5833': {'gid': 5833, 'name': 'd', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6834/1452491265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6832', 'nonce': 1452491265}, {'type': 'v1', 'addr': '172.21.15.117:6834', 'nonce': 1452491265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:44:42.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:44:42.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-10T10:44:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.235+0000 7f642f0b0640 1 Processor -- start 2023-08-10T10:44:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.235+0000 7f642f0b0640 1 -- start start 2023-08-10T10:44:43.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.236+0000 7f642f0b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f642815cc30 0x7f64280d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.236+0000 7f642f0b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 0x7f64280cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642f0b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64280d2630 con 0x7f64280cfc40 2023-08-10T10:44:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642f0b0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280b8010 con 0x7f642815cc30 2023-08-10T10:44:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642f0b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280d0060 con 0x7f64280d08e0 2023-08-10T10:44:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f642815cc30 0x7f64280d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f642815cc30 0x7f64280d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43522/0 (socket says 172.21.15.50:43522) 2023-08-10T10:44:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 -- 172.21.15.50:0/2687329462 learned_addr learned my addr 172.21.15.50:0/2687329462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 -- 172.21.15.50:0/2687329462 >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 msgr2=0x7f64280cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642d8ad640 1 --2- 172.21.15.50:0/2687329462 >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 0x7f64280cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 --2- 172.21.15.50:0/2687329462 >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 0x7f64280cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 -- 172.21.15.50:0/2687329462 >> v1:172.21.15.117:6789/0 conn(0x7f64280cfc40 legacy=0x7f64280d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642e0ae640 1 -- 172.21.15.50:0/2687329462 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280d0ea0 con 0x7f642815cc30 2023-08-10T10:44:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.237+0000 7f642d8ad640 1 --2- 172.21.15.50:0/2687329462 >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 0x7f64280cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.239+0000 7f642e0ae640 1 --2- 172.21.15.50:0/2687329462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642815cc30 0x7f64280d1d20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f64280b4490 tx=0x7f642402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daad4a65632ce2a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.239+0000 7f642d0ac640 1 -- 172.21.15.50:0/2687329462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424031870 con 0x7f642815cc30 2023-08-10T10:44:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.239+0000 7f642d0ac640 1 -- 172.21.15.50:0/2687329462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64240319d0 con 0x7f642815cc30 2023-08-10T10:44:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.239+0000 7f642d0ac640 1 -- 172.21.15.50:0/2687329462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424031d60 con 0x7f642815cc30 2023-08-10T10:44:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 -- 172.21.15.50:0/2687329462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642815cc30 msgr2=0x7f64280d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 --2- 172.21.15.50:0/2687329462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642815cc30 0x7f64280d1d20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f64280b4490 tx=0x7f642402b910 comp rx=0 tx=0).stop 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 -- 172.21.15.50:0/2687329462 shutdown_connections 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 --2- 172.21.15.50:0/2687329462 >> v2:172.21.15.117:3300/0 conn(0x7f64280d08e0 0x7f64280cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 --2- 172.21.15.50:0/2687329462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642815cc30 0x7f64280d1d20 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 -- 172.21.15.50:0/2687329462 >> 172.21.15.50:0/2687329462 conn(0x7f6428069880 msgr2=0x7f6428069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 -- 172.21.15.50:0/2687329462 shutdown_connections 2023-08-10T10:44:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.240+0000 7f642f0b0640 1 -- 172.21.15.50:0/2687329462 wait complete. 2023-08-10T10:44:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.242+0000 7f642f0b0640 1 Processor -- start 2023-08-10T10:44:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.242+0000 7f642f0b0640 1 -- start start 2023-08-10T10:44:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64280cfc40 0x7f6428150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 0x7f64280b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6428151340 con 0x7f64280d08e0 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280aa2a0 con 0x7f64280cfc40 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642f0b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64280aa580 con 0x7f642815cc30 2023-08-10T10:44:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43536/0 (socket says 172.21.15.50:43536) 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.243+0000 7f642d8ad640 1 -- 172.21.15.50:0/4201109404 learned_addr learned my addr 172.21.15.50:0/4201109404 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642e0ae640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64280cfc40 0x7f6428150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642e8af640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 0x7f64280b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 -- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 msgr2=0x7f64280b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 0x7f64280b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 -- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64280cfc40 msgr2=0x7f6428150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64280cfc40 0x7f6428150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 -- 172.21.15.50:0/4201109404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240094d0 con 0x7f64280d08e0 2023-08-10T10:44:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642e8af640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 0x7f64280b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f642d8ad640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f641800c7f0 tx=0x7f641800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.244+0000 7f641effd640 1 -- 172.21.15.50:0/4201109404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418007a30 con 0x7f64280d08e0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.245+0000 7f641effd640 1 -- 172.21.15.50:0/4201109404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418007b90 con 0x7f64280d08e0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.245+0000 7f641effd640 1 -- 172.21.15.50:0/4201109404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800ce40 con 0x7f64280d08e0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.245+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64280aa860 con 0x7f64280d08e0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.245+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64280aae20 con 0x7f64280d08e0 2023-08-10T10:44:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.247+0000 7f641effd640 1 -- 172.21.15.50:0/4201109404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64180113f0 con 0x7f64280d08e0 2023-08-10T10:44:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.248+0000 7f641effd640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 0x7f640c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.248+0000 7f641effd640 1 -- 172.21.15.50:0/4201109404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64180896c0 con 0x7f64280d08e0 2023-08-10T10:44:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.249+0000 7f642e0ae640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 0x7f640c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.249+0000 7f6432f67740 1 Processor -- start 2023-08-10T10:44:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.249+0000 7f6432f67740 1 -- start start 2023-08-10T10:44:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.249+0000 7f642e0ae640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 0x7f640c06d110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6424036000 tx=0x7f642403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f2259d0 con 0x558a0f2b5610 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f2230c0 con 0x558a0f2e5690 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0f21e9b0 con 0x558a0f2b9210 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43548/0 (socket says 172.21.15.50:43548) 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f642d8ad640 1 -- 172.21.15.50:0/1071153082 learned_addr learned my addr 172.21.15.50:0/1071153082 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f642e8af640 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.250+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 -- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 msgr2=0x558a0f2e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 -- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 msgr2=0x558a0f2e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 -- 172.21.15.50:0/1071153082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0f1ebc10 con 0x558a0f2b5610 2023-08-10T10:44:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6418058090 tx=0x7f641805c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f82c15d64f7fd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f640bfff640 1 -- 172.21.15.50:0/1071153082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641805e0e0 con 0x558a0f2b5610 2023-08-10T10:44:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f640bfff640 1 -- 172.21.15.50:0/1071153082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418054aa0 con 0x558a0f2b5610 2023-08-10T10:44:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.251+0000 7f640bfff640 1 -- 172.21.15.50:0/1071153082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641805e240 con 0x558a0f2b5610 2023-08-10T10:44:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 -- 172.21.15.50:0/1071153082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 msgr2=0x558a0f2e2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6418058090 tx=0x7f641805c4d0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 -- 172.21.15.50:0/1071153082 shutdown_connections 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b5610 0x558a0f2e2900 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 --2- 172.21.15.50:0/1071153082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 -- 172.21.15.50:0/1071153082 >> 172.21.15.50:0/1071153082 conn(0x558a0f2b7920 msgr2=0x558a0f3004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 -- 172.21.15.50:0/1071153082 shutdown_connections 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.252+0000 7f6432f67740 1 -- 172.21.15.50:0/1071153082 wait complete. 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.253+0000 7f6432f67740 1 -- start start 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.253+0000 7f6432f67740 1 Processor -- start 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2e5690 0x558a0f310af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f2dd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f1bf940 con 0x558a0f2b9210 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f1bf5e0 con 0x558a0f311030 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0ef85f20 con 0x558a0f2e5690 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f6432f67740 10 client.0 _ll_register_callbacks cb 0x558a0f218250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.254+0000 7f642e0ae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43564/0 (socket says 172.21.15.50:43564) 2023-08-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 -- 172.21.15.50:0/1176317738 learned_addr learned my addr 172.21.15.50:0/1176317738 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2e5690 0x558a0f310af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e8af640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f2dd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 -- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2e5690 msgr2=0x558a0f310af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2e5690 0x558a0f310af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 -- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 msgr2=0x558a0f2dd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f2dd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 -- 172.21.15.50:0/1176317738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64280aae20 con 0x558a0f2b9210 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6424009960 tx=0x7f6424004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd21725849322cde server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.255+0000 7f64097fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424044ad0 con 0x558a0f2b9210 2023-08-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a0f248bf0 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f642403f070 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6424044c30 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f6432f67740 10 client.7188 fetch_fsmap learned FSMap version 51 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x558a0f21d030 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a0f248bf0 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.256+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f642404e070 con 0x558a0f2b9210 2023-08-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 10 client.7188 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 10 client.7188 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 20 client.7188 populate_metadata read hostname 'smithi050' 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2de1e0 0x558a0f31e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 4 client.7188 mds_command: new command op to 5833 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 --> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a0f2117c0 con 0x558a0f2de1e0 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.257+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2de1e0 0x558a0f31e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.258+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2de1e0 0x558a0f31e3b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ed70722d2d05096 server_cookie=aa5789e788e20f56 in_seq=0 out_seq=0 2023-08-10T10:44:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.258+0000 7f64097fa640 10 client.7188 ms_handle_connect on v2:172.21.15.117:6832/1452491265 2023-08-10T10:44:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f64097fa640 1 -- 172.21.15.50:0/1176317738 <== mds.0 v2:172.21.15.117:6832/1452491265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558a0f2117c0 con 0x558a0f2de1e0 2023-08-10T10:44:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f64097fa640 10 client.7188 handle_command_reply: tid=0 2023-08-10T10:44:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 client.7188 shutdown 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 msgr2=0x558a0f2dbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6424009960 tx=0x7f6424004730 comp rx=0 tx=0).stop 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 shutdown_connections 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f2dd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2de1e0 0x558a0f31e3b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2e5690 0x558a0f310af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 --2- 172.21.15.50:0/1176317738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2b9210 0x558a0f2dbae0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 >> 172.21.15.50:0/1176317738 conn(0x558a0f2b5610 msgr2=0x558a0f2b9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.260+0000 7f64097fa640 0 client.7188 ms_handle_reset on v2:172.21.15.117:6832/1452491265 2023-08-10T10:44:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.261+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 shutdown_connections 2023-08-10T10:44:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.261+0000 7f6432f67740 1 -- 172.21.15.50:0/1176317738 wait complete. 2023-08-10T10:44:43.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.261+0000 7f6432f67740 20 client.7188 trim_cache size 0 max 16384 2023-08-10T10:44:43.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.278+0000 7f6432f67740 1 Processor -- start 2023-08-10T10:44:43.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.278+0000 7f6432f67740 1 -- start start 2023-08-10T10:44:43.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f2cc4e0 con 0x558a0f311030 2023-08-10T10:44:43.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f1e91d0 con 0x558a0f2e5690 2023-08-10T10:44:43.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0f2e93d0 con 0x558a0f2b9210 2023-08-10T10:44:43.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43578/0 (socket says 172.21.15.50:43578) 2023-08-10T10:44:43.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 -- 172.21.15.50:0/1714307721 learned_addr learned my addr 172.21.15.50:0/1714307721 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 -- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 msgr2=0x558a0f2b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642d8ad640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2b9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 -- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 msgr2=0x558a0f2b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2b9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e8af640 1 -- 172.21.15.50:0/1714307721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0f2528a0 con 0x558a0f311030 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.279+0000 7f642e0ae640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.280+0000 7f642e8af640 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6420007e60 tx=0x7f642000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50182f3b872a7274 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.280+0000 7f641cff9640 1 -- 172.21.15.50:0/1714307721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000c600 con 0x558a0f311030 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.280+0000 7f641cff9640 1 -- 172.21.15.50:0/1714307721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642000c760 con 0x558a0f311030 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.280+0000 7f641cff9640 1 -- 172.21.15.50:0/1714307721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000cb10 con 0x558a0f311030 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 -- 172.21.15.50:0/1714307721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 msgr2=0x558a0f2e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6420007e60 tx=0x7f642000f7c0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 -- 172.21.15.50:0/1714307721 shutdown_connections 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f311030 0x558a0f2e0cf0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f2e5690 0x558a0f2b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 --2- 172.21.15.50:0/1714307721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f2b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 -- 172.21.15.50:0/1714307721 >> 172.21.15.50:0/1714307721 conn(0x558a0f2b5610 msgr2=0x558a0f2b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 -- 172.21.15.50:0/1714307721 shutdown_connections 2023-08-10T10:44:43.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.281+0000 7f6432f67740 1 -- 172.21.15.50:0/1714307721 wait complete. 2023-08-10T10:44:43.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.282+0000 7f6432f67740 1 -- start start 2023-08-10T10:44:43.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.282+0000 7f6432f67740 1 Processor -- start 2023-08-10T10:44:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f36d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f300670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f369280 con 0x558a0f2e5690 2023-08-10T10:44:43.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0f31e3b0 con 0x558a0f311030 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0f31e810 con 0x558a0f2b9210 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f6432f67740 10 client.0 _ll_register_callbacks cb 0x7f642403a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f642d8ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43584/0 (socket says 172.21.15.50:43584) 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f642d8ad640 1 -- 172.21.15.50:0/96140581 learned_addr learned my addr 172.21.15.50:0/96140581 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f642d8ad640 1 -- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 msgr2=0x558a0f36d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.283+0000 7f642d8ad640 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f36d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f642d8ad640 1 -- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 msgr2=0x558a0f300670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f642d8ad640 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f300670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f642d8ad640 1 -- 172.21.15.50:0/96140581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6420007a90 con 0x558a0f2e5690 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f642d8ad640 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6418058090 tx=0x7f6418000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc34594830d4b6b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f64097fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418081b30 con 0x558a0f2e5690 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6418081c90 con 0x558a0f2e5690 2023-08-10T10:44:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6418054aa0 con 0x558a0f2e5690 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6418081e50 con 0x558a0f2e5690 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f6432f67740 10 client.7194 fetch_fsmap learned FSMap version 51 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.284+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x558a0f1be610 con 0x558a0f2e5690 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418054aa0 con 0x558a0f2e5690 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6418054180 con 0x558a0f2e5690 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 10 client.7194 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T10:44:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 10 client.7194 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 20 client.7194 populate_metadata read hostname 'smithi050' 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2b95f0 0x558a0f2b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 4 client.7194 mds_command: new command op to 5833 tid=0[{"prefix": "status"}] 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 --> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a0f217990 con 0x558a0f2b95f0 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.285+0000 7f642e0ae640 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2b95f0 0x558a0f2b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.286+0000 7f642e0ae640 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2b95f0 0x558a0f2b99d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd6732704ea7999d server_cookie=1cecb93dff38a53e in_seq=0 out_seq=0 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.286+0000 7f64097fa640 10 client.7194 ms_handle_connect on v2:172.21.15.117:6832/1452491265 2023-08-10T10:44:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f64097fa640 1 -- 172.21.15.50:0/96140581 <== mds.0 v2:172.21.15.117:6832/1452491265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x558a0f217990 con 0x558a0f2b95f0 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f64097fa640 10 client.7194 handle_command_reply: tid=0 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 client.7194 shutdown 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 msgr2=0x558a0f368d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6418058090 tx=0x7f6418000bc0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 shutdown_connections 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558a0f311030 0x558a0f300670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0f2e5690 0x558a0f368d40 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:6832/1452491265,v1:172.21.15.117:6834/1452491265] conn(0x558a0f2b95f0 0x558a0f2b99d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 --2- 172.21.15.50:0/96140581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558a0f2b9210 0x558a0f36d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 >> 172.21.15.50:0/96140581 conn(0x558a0f2b5610 msgr2=0x558a0f2e5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f64097fa640 0 client.7194 ms_handle_reset on v2:172.21.15.117:6832/1452491265 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 shutdown_connections 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.287+0000 7f6432f67740 1 -- 172.21.15.50:0/96140581 wait complete. 2023-08-10T10:44:43.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f6432f67740 20 client.7194 trim_cache size 0 max 16384 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5833, 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:44:43.296 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.7965437, 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 51, 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 110, 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 110, 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.600362997 2023-08-10T10:44:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:44:43.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 msgr2=0x7f640c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 0x7f640c06d110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6424036000 tx=0x7f642403c040 comp rx=0 tx=0).stop 2023-08-10T10:44:43.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 msgr2=0x7f64280b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f641800c7f0 tx=0x7f641800cbf0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 shutdown_connections 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f642815cc30 0x7f64280b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64280d08e0 0x7f64280b6f90 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f640c06ac50 0x7f640c06d110 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 --2- 172.21.15.50:0/4201109404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64280cfc40 0x7f6428150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 >> 172.21.15.50:0/4201109404 conn(0x7f6428069880 msgr2=0x7f642806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 shutdown_connections 2023-08-10T10:44:43.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.288+0000 7f642f0b0640 1 -- 172.21.15.50:0/4201109404 wait complete. 2023-08-10T10:44:43.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:44:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.530+0000 7f7d8b656640 1 Processor -- start 2023-08-10T10:44:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.530+0000 7f7d8b656640 1 -- start start 2023-08-10T10:44:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d8b656640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d8415aa40 0x7f7d840b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d8b656640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d840b0c60 0x7f7d840b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d8b656640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d84071c70 con 0x7f7d84070e80 2023-08-10T10:44:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d8b656640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840713d0 con 0x7f7d8415aa40 2023-08-10T10:44:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d8b656640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840716b0 con 0x7f7d840b0c60 2023-08-10T10:44:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d893f2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d8415aa40 0x7f7d840b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d89bf3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d84070e80 0x7f7d840696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39940/0 (socket says 172.21.15.50:39940) 2023-08-10T10:44:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d89bf3640 1 -- 172.21.15.50:0/4154353057 learned_addr learned my addr 172.21.15.50:0/4154353057 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.532+0000 7f7d88bf1640 1 --2- 172.21.15.50:0/4154353057 >> v2:172.21.15.117:3300/0 conn(0x7f7d840b0c60 0x7f7d840b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.533+0000 7f7d893f2640 1 -- 172.21.15.50:0/4154353057 >> v2:172.21.15.117:3300/0 conn(0x7f7d840b0c60 msgr2=0x7f7d840b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.533+0000 7f7d893f2640 1 --2- 172.21.15.50:0/4154353057 >> v2:172.21.15.117:3300/0 conn(0x7f7d840b0c60 0x7f7d840b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.533+0000 7f7d893f2640 1 -- 172.21.15.50:0/4154353057 >> v1:172.21.15.50:6789/0 conn(0x7f7d84070e80 legacy=0x7f7d840696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.533+0000 7f7d893f2640 1 -- 172.21.15.50:0/4154353057 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84071990 con 0x7f7d8415aa40 2023-08-10T10:44:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.534+0000 7f7d893f2640 1 --2- 172.21.15.50:0/4154353057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d840b3820 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7d8415e6e0 tx=0x7f7d8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b387f9a07a0e0f3d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.534+0000 7f7d7bfff640 1 -- 172.21.15.50:0/4154353057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8002e070 con 0x7f7d8415aa40 2023-08-10T10:44:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.534+0000 7f7d7bfff640 1 -- 172.21.15.50:0/4154353057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d800315a0 con 0x7f7d8415aa40 2023-08-10T10:44:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.534+0000 7f7d7bfff640 1 -- 172.21.15.50:0/4154353057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80031930 con 0x7f7d8415aa40 2023-08-10T10:44:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 -- 172.21.15.50:0/4154353057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 msgr2=0x7f7d840b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 --2- 172.21.15.50:0/4154353057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d840b3820 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7d8415e6e0 tx=0x7f7d8002b840 comp rx=0 tx=0).stop 2023-08-10T10:44:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 -- 172.21.15.50:0/4154353057 shutdown_connections 2023-08-10T10:44:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 --2- 172.21.15.50:0/4154353057 >> v2:172.21.15.117:3300/0 conn(0x7f7d840b0c60 0x7f7d840b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 --2- 172.21.15.50:0/4154353057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d840b3820 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 -- 172.21.15.50:0/4154353057 >> 172.21.15.50:0/4154353057 conn(0x7f7d8406b590 msgr2=0x7f7d840ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 -- 172.21.15.50:0/4154353057 shutdown_connections 2023-08-10T10:44:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.535+0000 7f7d8b656640 1 -- 172.21.15.50:0/4154353057 wait complete. 2023-08-10T10:44:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.537+0000 7f7d8b656640 1 Processor -- start 2023-08-10T10:44:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.537+0000 7f7d8b656640 1 -- start start 2023-08-10T10:44:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.538+0000 7f7d8b656640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d84070e80 0x7f7d841f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d8b656640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d840b0c60 0x7f7d84156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d8b656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d8b656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8415d6f0 con 0x7f7d8415aa40 2023-08-10T10:44:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d8b656640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84144d00 con 0x7f7d840b0c60 2023-08-10T10:44:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d8b656640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8415d030 con 0x7f7d84070e80 2023-08-10T10:44:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43602/0 (socket says 172.21.15.50:43602) 2023-08-10T10:44:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 -- 172.21.15.50:0/169956961 learned_addr learned my addr 172.21.15.50:0/169956961 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d893f2640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d84070e80 0x7f7d841f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d88bf1640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d840b0c60 0x7f7d84156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 -- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d84070e80 msgr2=0x7f7d841f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d84070e80 0x7f7d841f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 -- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d840b0c60 msgr2=0x7f7d84156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d840b0c60 0x7f7d84156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.539+0000 7f7d89bf3640 1 -- 172.21.15.50:0/169956961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009400 con 0x7f7d8415aa40 2023-08-10T10:44:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d89bf3640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00cbc0 tx=0x7f7d7c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ad40 con 0x7f7d8415aa40 2023-08-10T10:44:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c012400 con 0x7f7d8415aa40 2023-08-10T10:44:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00aea0 con 0x7f7d8415aa40 2023-08-10T10:44:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8415d310 con 0x7f7d8415aa40 2023-08-10T10:44:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.540+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8415cc90 con 0x7f7d8415aa40 2023-08-10T10:44:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.541+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8415d830 con 0x7f7d8415aa40 2023-08-10T10:44:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.543+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d7c007070 con 0x7f7d8415aa40 2023-08-10T10:44:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.543+0000 7f7d79ffb640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 0x7f7d6806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.543+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d7c089370 con 0x7f7d8415aa40 2023-08-10T10:44:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.544+0000 7f7d893f2640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 0x7f7d6806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.545+0000 7f7d893f2640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 0x7f7d6806d110 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d80036000 tx=0x7f7d8003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.547+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7d8415d830 con 0x7f7d8415aa40 2023-08-10T10:44:43.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:44:43.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:44:43.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.785+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7d8415d830 con 0x7f7d8415aa40 2023-08-10T10:44:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.786+0000 7f7d79ffb640 1 -- 172.21.15.50:0/169956961 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7d8415d830 con 0x7f7d8415aa40 2023-08-10T10:44:43.788 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:44:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 msgr2=0x7f7d6806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 0x7f7d6806d110 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d80036000 tx=0x7f7d8003d040 comp rx=0 tx=0).stop 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 msgr2=0x7f7d84156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00cbc0 tx=0x7f7d7c00a430 comp rx=0 tx=0).stop 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 shutdown_connections 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d8415aa40 0x7f7d84156e90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d6806ac50 0x7f7d6806d110 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d840b0c60 0x7f7d84156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 --2- 172.21.15.50:0/169956961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d84070e80 0x7f7d841f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:43.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 >> 172.21.15.50:0/169956961 conn(0x7f7d8406b590 msgr2=0x7f7d84151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:43.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 shutdown_connections 2023-08-10T10:44:43.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:43.789+0000 7f7d8b656640 1 -- 172.21.15.50:0/169956961 wait complete. 2023-08-10T10:44:43.808 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:44:43.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:44:43.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:44:43.809 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:44:43.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:44:43.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:44:43.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:44:43.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:44:43.811 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:44:43.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:43.812 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:44:43.866 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:44:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:44:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:44:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:44:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40842sec preferred_lft 40842sec 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:44:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:44:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.871 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:44:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:44:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:44:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:43.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:43.872 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:44:43.965 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:44:43.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:43.969 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:44:44.025 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:44:44.026 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:44:44.026 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:44:44.026 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:44:44.026 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:44:44.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.027 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:44:44.027 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:44:44.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:44:44.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:44:44.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:44:44.029 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:44:44.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.222 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:44:44.279 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:44:44.279 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:44:44.280 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:44:44.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:44:44.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:44:44.382 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:44:44.442 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:44:44.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:44:44.443 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:44:44.500 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:44:44.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:44.657 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:44.657 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:44:44.690 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:44.690 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:44:44.690 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:44:44.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:44:44.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:44:44.693 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:44:44.693 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:44:44.693 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:44:44.694 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:44:44.694 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:44:44.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:44:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:44:44.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:44.788 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:44:44.867 INFO:teuthology.orchestra.run.smithi050.stdout:client7206 2023-08-10T10:44:44.868 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:44.868 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:44.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:44:45.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.155+0000 7ff24401a640 1 Processor -- start 2023-08-10T10:44:45.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.155+0000 7ff24401a640 1 -- start start 2023-08-10T10:44:45.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff24401a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 0x7ff23c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff24401a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c071c70 con 0x7ff23c15aa40 2023-08-10T10:44:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff24401a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0713d0 con 0x7ff23c0b3f30 2023-08-10T10:44:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff24401a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0716b0 con 0x7ff23c0b0c60 2023-08-10T10:44:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff241db6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff23c15aa40 0x7ff23c0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33424/0 (socket says 172.21.15.50:33424) 2023-08-10T10:44:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff241db6640 1 -- 172.21.15.50:0/2660616152 learned_addr learned my addr 172.21.15.50:0/2660616152 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447379843 0 0) 0x7ff23c071c70 con 0x7ff23c15aa40 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003520 con 0x7ff23c15aa40 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff2415b5640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 0x7ff23c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490768588 0 0) 0x7ff228003520 con 0x7ff23c15aa40 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 msgr2=0x7ff23c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 0x7ff23c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 >> v1:172.21.15.117:6789/0 conn(0x7ff23c0b3f30 legacy=0x7ff23c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c071990 con 0x7ff23c15aa40 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff238001670 con 0x7ff23c15aa40 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 >> v1:172.21.15.50:6789/0 conn(0x7ff23c15aa40 legacy=0x7ff23c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2280039a0 0x7ff228003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 0x7ff228005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0716b0 con 0x7ff2280039a0 2023-08-10T10:44:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800bb40 con 0x7ff2280047c0 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.157+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800bd00 con 0x7ff23c0b0c60 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2280039a0 0x7ff228003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 -- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 msgr2=0x7ff228005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff23c0b0c60 0x7ff228005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 -- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2280047c0 msgr2=0x7ff228004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.158+0000 7ff241db6640 1 -- 172.21.15.50:0/2660616152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228003520 con 0x7ff2280039a0 2023-08-10T10:44:45.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff241db6640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2280039a0 0x7ff228003da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c210 tx=0x7ff2280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96083c0f951fb06b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238005ad0 con 0x7ff2280039a0 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238005c50 con 0x7ff2280039a0 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff240db4640 1 -- 172.21.15.50:0/2660616152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23802c830 con 0x7ff2280039a0 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 -- 172.21.15.50:0/2660616152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2280039a0 msgr2=0x7ff228003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 --2- 172.21.15.50:0/2660616152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2280039a0 0x7ff228003da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c210 tx=0x7ff2280057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff2425b7640 1 -- 172.21.15.50:0/2660616152 reap_dead start 2023-08-10T10:44:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 -- 172.21.15.50:0/2660616152 shutdown_connections 2023-08-10T10:44:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 -- 172.21.15.50:0/2660616152 >> 172.21.15.50:0/2660616152 conn(0x7ff23c06b590 msgr2=0x7ff23c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 -- 172.21.15.50:0/2660616152 shutdown_connections 2023-08-10T10:44:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.160+0000 7ff24401a640 1 -- 172.21.15.50:0/2660616152 wait complete. 2023-08-10T10:44:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.162+0000 7ff24401a640 1 Processor -- start 2023-08-10T10:44:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.162+0000 7ff24401a640 1 -- start start 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2280039a0 0x7ff23c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c15bb90 0x7ff23c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c152f30 con 0x7ff23c152a80 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c15d0d0 con 0x7ff23c15bb90 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.163+0000 7ff24401a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c15cc40 con 0x7ff2280039a0 2023-08-10T10:44:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38988/0 (socket says 172.21.15.50:38988) 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 -- 172.21.15.50:0/3082046348 learned_addr learned my addr 172.21.15.50:0/3082046348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff241db6640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2280039a0 0x7ff23c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2415b5640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c15bb90 0x7ff23c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 -- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2280039a0 msgr2=0x7ff23c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2280039a0 0x7ff23c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 -- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c15bb90 msgr2=0x7ff23c152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c15bb90 0x7ff23c152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.164+0000 7ff2425b7640 1 -- 172.21.15.50:0/3082046348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c15c030 con 0x7ff23c152a80 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff2425b7640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06cf00 tx=0x7ff23400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234005d40 con 0x7ff23c152a80 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400ced0 con 0x7ff23c152a80 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400a880 con 0x7ff23c152a80 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c15c310 con 0x7ff23c152a80 2023-08-10T10:44:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.165+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c15c8d0 con 0x7ff23c152a80 2023-08-10T10:44:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.166+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c15cdf0 con 0x7ff23c152a80 2023-08-10T10:44:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.167+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff23400a9e0 con 0x7ff23c152a80 2023-08-10T10:44:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.168+0000 7ff2327fc640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 0x7ff22006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.168+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff234088940 con 0x7ff23c152a80 2023-08-10T10:44:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.169+0000 7ff241db6640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 0x7ff22006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.169+0000 7ff241db6640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 0x7ff22006d140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff238034000 tx=0x7ff238009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:45.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.173+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff23c15cdf0 con 0x7ff23c152a80 2023-08-10T10:44:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.420+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff23c15ca60 con 0x7ff23c152a80 2023-08-10T10:44:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.421+0000 7ff2327fc640 1 -- 172.21.15.50:0/3082046348 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff234017060 con 0x7ff23c152a80 2023-08-10T10:44:45.422 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:44:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.423+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 msgr2=0x7ff22006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.423+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 0x7ff22006d140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff238034000 tx=0x7ff238009030 comp rx=0 tx=0).stop 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.423+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 msgr2=0x7ff23c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.423+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06cf00 tx=0x7ff23400cb90 comp rx=0 tx=0).stop 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 shutdown_connections 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff23c152a80 0x7ff23c13f5d0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff22006ac80 0x7ff22006d140 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c15bb90 0x7ff23c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 --2- 172.21.15.50:0/3082046348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2280039a0 0x7ff23c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 >> 172.21.15.50:0/3082046348 conn(0x7ff23c06b590 msgr2=0x7ff23c158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 shutdown_connections 2023-08-10T10:44:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:45.425+0000 7ff24401a640 1 -- 172.21.15.50:0/3082046348 wait complete. 2023-08-10T10:44:45.443 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:44:45.444 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:44:45.444 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:44:45.444 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:44:45.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:44:45.445 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:44:45.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:44:45.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:44:45.446 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:44:45.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.446 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:44:45.508 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:44:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:44:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:44:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:44:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.510 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:44:45.510 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:44:45.511 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:44:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:45.512 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:44:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:44:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41012sec preferred_lft 41012sec 2023-08-10T10:44:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:44:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.513 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:44:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:44:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:44:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:44:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.515 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:44:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:44:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:44:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.516 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:44:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:44:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:44:45.517 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:44:45.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.519 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:44:45.611 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:44:45.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.615 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:44:45.666 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:44:45.667 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:44:45.667 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:44:45.667 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:44:45.667 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:44:45.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.669 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:44:45.669 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:44:45.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:44:45.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:44:45.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:44:45.670 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:44:45.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.848 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:44:45.898 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:44:45.898 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:44:45.899 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:44:45.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:45.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:44:45.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:44:45.987 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:44:46.040 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:44:46.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:44:46.041 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:44:46.090 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:44:46.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:46.091 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:46.229 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:46.230 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:44:46.260 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:44:46.260 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:44:46.261 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:44:46.261 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:44:46.261 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:44:46.262 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:44:46.262 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:44:46.262 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:44:46.263 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:44:46.263 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:44:46.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:44:46.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:46.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:44:46.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:46.347 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:44:46.395 INFO:teuthology.orchestra.run.smithi117.stdout:client7215 2023-08-10T10:44:46.396 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:44:46.396 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:46.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:46.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.683+0000 7fb7e19a4640 1 Processor -- start 2023-08-10T10:44:46.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.684+0000 7fb7e19a4640 1 -- start start 2023-08-10T10:44:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.685+0000 7fb7e19a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7dc15a940 0x7fb7dc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.685+0000 7fb7e19a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15f2b0 0x7fb7dc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.685+0000 7fb7e19a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0b1f10 con 0x7fb7dc0b12c0 2023-08-10T10:44:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.685+0000 7fb7e19a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0b21f0 con 0x7fb7dc15a940 2023-08-10T10:44:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.685+0000 7fb7e19a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc15e5c0 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7dc15a940 0x7fb7dc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7dc15a940 0x7fb7dc0aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38992/0 (socket says 172.21.15.50:38992) 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 -- 172.21.15.50:0/2934079640 learned_addr learned my addr 172.21.15.50:0/2934079640 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e11a3640 1 --1- 172.21.15.50:0/2934079640 >> v1:172.21.15.50:6789/0 conn(0x7fb7dc0b12c0 0x7fb7dc0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33432/0 (socket says 172.21.15.50:33432) 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7dbfff640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15f2b0 0x7fb7dc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 -- 172.21.15.50:0/2934079640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15f2b0 msgr2=0x7fb7dc0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15f2b0 0x7fb7dc0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 -- 172.21.15.50:0/2934079640 >> v1:172.21.15.50:6789/0 conn(0x7fb7dc0b12c0 legacy=0x7fb7dc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7e09a2640 1 -- 172.21.15.50:0/2934079640 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc15e7d0 con 0x7fb7dc15a940 2023-08-10T10:44:46.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.686+0000 7fb7db7fe640 1 -- 172.21.15.50:0/2934079640 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901694272 0 0) 0x7fb7dc0b1f10 con 0x7fb7dc0b12c0 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7e09a2640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15a940 0x7fb7dc0aff10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bb99b511e2664a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7db7fe640 1 -- 172.21.15.50:0/2934079640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0031640 con 0x7fb7dc15a940 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7db7fe640 1 -- 172.21.15.50:0/2934079640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d00317a0 con 0x7fb7dc15a940 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7db7fe640 1 -- 172.21.15.50:0/2934079640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0031b30 con 0x7fb7dc15a940 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2934079640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15a940 msgr2=0x7fb7dc0aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.688+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15a940 0x7fb7dc0aff10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2934079640 shutdown_connections 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15f2b0 0x7fb7dc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2934079640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15a940 0x7fb7dc0aff10 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2934079640 >> 172.21.15.50:0/2934079640 conn(0x7fb7dc06ab80 msgr2=0x7fb7dc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2934079640 shutdown_connections 2023-08-10T10:44:46.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.689+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2934079640 wait complete. 2023-08-10T10:44:46.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.690+0000 7fb7e19a4640 1 Processor -- start 2023-08-10T10:44:46.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.691+0000 7fb7e19a4640 1 -- start start 2023-08-10T10:44:46.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc0b12c0 0x7fb7dc157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15a940 0x7fb7dc070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06fe20 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc157650 con 0x7fb7dc0b12c0 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e19a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06f1a0 con 0x7fb7dc15a940 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e11a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e11a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38998/0 (socket says 172.21.15.50:38998) 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7e11a3640 1 -- 172.21.15.50:0/2565072943 learned_addr learned my addr 172.21.15.50:0/2565072943 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.692+0000 7fb7dbfff640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15a940 0x7fb7dc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e09a2640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc0b12c0 0x7fb7dc157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 -- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15a940 msgr2=0x7fb7dc070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15a940 0x7fb7dc070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 -- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc0b12c0 msgr2=0x7fb7dc157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc0b12c0 0x7fb7dc157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 -- 172.21.15.50:0/2565072943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00094d0 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e11a3640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c700 tx=0x7fb7d400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400ce10 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400a640 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc06f480 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.693+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400a9f0 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.694+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc06fa40 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.695+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc06ff60 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.696+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7d400ab50 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.697+0000 7fb7d97fa640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 0x7fb7c006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.697+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7d4088d60 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.697+0000 7fb7e09a2640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 0x7fb7c006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:46.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.698+0000 7fb7e09a2640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 0x7fb7c006d140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0036000 tx=0x7fb7d003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:46.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.702+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb7dc06ff60 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.933+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7dc06ff60 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.934+0000 7fb7d97fa640 1 -- 172.21.15.50:0/2565072943 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fb7dc06ff60 con 0x7fb7dc15f2b0 2023-08-10T10:44:46.935 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:46.935 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:44:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:44:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 msgr2=0x7fb7c006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 0x7fb7c006d140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0036000 tx=0x7fb7d003c040 comp rx=0 tx=0).stop 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 msgr2=0x7fb7dc06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c700 tx=0x7fb7d400cbc0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 shutdown_connections 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc15f2b0 0x7fb7dc06e700 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc15a940 0x7fb7dc070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb7c006ac80 0x7fb7c006d140 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 --2- 172.21.15.50:0/2565072943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc0b12c0 0x7fb7dc157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 >> 172.21.15.50:0/2565072943 conn(0x7fb7dc06ab80 msgr2=0x7fb7dc157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 shutdown_connections 2023-08-10T10:44:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:46.937+0000 7fb7e19a4640 1 -- 172.21.15.50:0/2565072943 wait complete. 2023-08-10T10:44:46.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-10T10:44:47.198 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5833,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.691550928,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":110,"uptime":16.495363134000002} 2023-08-10T10:44:47.199 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5833, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 110, "rank_uptime": 10.691550928, "state": "up:active", "uptime": 16.495363134, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:44:47.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:44:47.458 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:44:47.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:44:47.459 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-08-10T10:44:47.459 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:47.459 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:47.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:47.515 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-08-10T10:44:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:265+0 records in 2023-08-10T10:44:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:265+0 records out 2023-08-10T10:44:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.93729 s, 143 MB/s 2023-08-10T10:44:49.518 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:49.518 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:49.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:49.563 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-08-10T10:44:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:292+0 records in 2023-08-10T10:44:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:292+0 records out 2023-08-10T10:44:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.03982 s, 150 MB/s 2023-08-10T10:44:51.701 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-10T10:44:51.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:44:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.908+0000 7fc044e21640 1 Processor -- start 2023-08-10T10:44:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.909+0000 7fc044e21640 1 -- start start 2023-08-10T10:44:51.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.910+0000 7fc044e21640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc040153850 0x7fc0400b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.910+0000 7fc044e21640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0400cfd40 0x7fc0400b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.910+0000 7fc044e21640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04015d010 con 0x7fc040153c30 2023-08-10T10:44:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.910+0000 7fc044e21640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04015d290 con 0x7fc040153850 2023-08-10T10:44:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.910+0000 7fc044e21640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04015d570 con 0x7fc0400cfd40 2023-08-10T10:44:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc040153850 0x7fc0400b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc040153850 0x7fc0400b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39006/0 (socket says 172.21.15.50:39006) 2023-08-10T10:44:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 -- 172.21.15.50:0/1675284863 learned_addr learned my addr 172.21.15.50:0/1675284863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 -- 172.21.15.50:0/1675284863 >> v2:172.21.15.117:3300/0 conn(0x7fc0400cfd40 msgr2=0x7fc0400b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 --2- 172.21.15.50:0/1675284863 >> v2:172.21.15.117:3300/0 conn(0x7fc0400cfd40 0x7fc0400b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 -- 172.21.15.50:0/1675284863 >> v1:172.21.15.50:6789/0 conn(0x7fc040153c30 legacy=0x7fc0400cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.911+0000 7fc03f7fe640 1 -- 172.21.15.50:0/1675284863 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04015d850 con 0x7fc040153850 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.912+0000 7fc03f7fe640 1 --2- 172.21.15.50:0/1675284863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc040153850 0x7fc0400b1690 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ce050 tx=0x7fc03002bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69c10838592c89a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc03effd640 1 -- 172.21.15.50:0/1675284863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03002cb30 con 0x7fc040153850 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc03effd640 1 -- 172.21.15.50:0/1675284863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03002cc90 con 0x7fc040153850 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc03effd640 1 -- 172.21.15.50:0/1675284863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300343f0 con 0x7fc040153850 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 -- 172.21.15.50:0/1675284863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc040153850 msgr2=0x7fc0400b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 --2- 172.21.15.50:0/1675284863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc040153850 0x7fc0400b1690 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ce050 tx=0x7fc03002bf90 comp rx=0 tx=0).stop 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 -- 172.21.15.50:0/1675284863 shutdown_connections 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 --2- 172.21.15.50:0/1675284863 >> v2:172.21.15.117:3300/0 conn(0x7fc0400cfd40 0x7fc0400b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 --2- 172.21.15.50:0/1675284863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc040153850 0x7fc0400b1690 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 -- 172.21.15.50:0/1675284863 >> 172.21.15.50:0/1675284863 conn(0x7fc040069880 msgr2=0x7fc040069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 -- 172.21.15.50:0/1675284863 shutdown_connections 2023-08-10T10:44:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.913+0000 7fc044e21640 1 -- 172.21.15.50:0/1675284863 wait complete. 2023-08-10T10:44:51.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.915+0000 7fc044e21640 1 Processor -- start 2023-08-10T10:44:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.915+0000 7fc044e21640 1 -- start start 2023-08-10T10:44:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc040153850 0x7fc0400c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc040153c30 0x7fc0400c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401548d0 con 0x7fc0400cfd40 2023-08-10T10:44:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401545f0 con 0x7fc040153c30 2023-08-10T10:44:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc044e21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400d0940 con 0x7fc040153850 2023-08-10T10:44:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39014/0 (socket says 172.21.15.50:39014) 2023-08-10T10:44:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.916+0000 7fc03f7fe640 1 -- 172.21.15.50:0/256675573 learned_addr learned my addr 172.21.15.50:0/256675573 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:51.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 -- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc040153850 msgr2=0x7fc0400c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:51.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc040153850 0x7fc0400c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:51.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 -- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc040153c30 msgr2=0x7fc0400c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc040153c30 0x7fc0400c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 -- 172.21.15.50:0/256675573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009b30 con 0x7fc0400cfd40 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03f7fe640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc030036040 tx=0x7fc030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03003e450 con 0x7fc0400cfd40 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03003e5b0 con 0x7fc0400cfd40 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03003e760 con 0x7fc0400cfd40 2023-08-10T10:44:51.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.917+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0400d0c20 con 0x7fc0400cfd40 2023-08-10T10:44:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.918+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0400c5bc0 con 0x7fc0400cfd40 2023-08-10T10:44:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.919+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040065eb0 con 0x7fc0400cfd40 2023-08-10T10:44:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.920+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc03003e8c0 con 0x7fc0400cfd40 2023-08-10T10:44:51.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.921+0000 7fc03cff9640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 0x7fc02006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:51.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.921+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0300ac1c0 con 0x7fc0400cfd40 2023-08-10T10:44:51.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.921+0000 7fc036ffd640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 0x7fc02006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:51.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.922+0000 7fc036ffd640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 0x7fc02006d110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0401f5f60 tx=0x7fc028007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:51.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:51.926+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc030077310 con 0x7fc0400cfd40 2023-08-10T10:44:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.112+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc0400b5460 con 0x7fc0400cfd40 2023-08-10T10:44:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.116+0000 7fc03cff9640 1 -- 172.21.15.50:0/256675573 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+36940 (secure 0 0 0) 0x7fc03007a930 con 0x7fc0400cfd40 2023-08-10T10:44:52.117 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:52.117 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 110, 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:44:37.522156+0000", 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:44:52.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:52.119 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:44:52.120 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:44:52.121 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:44:52.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:52.124 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "99", 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:52.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:52.126 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:52.129 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:52.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:44:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:44:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:44:52.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:44:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:44:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:44:52.133 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:44:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:44:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:44:52.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:44:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:52.138 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "99", 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:52.139 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:52.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:52.141 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.142 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:52.143 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:52.144 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:52.145 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:44:52.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:52.147 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:44:52.148 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:52.149 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "109", 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:52.150 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:52.151 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:52.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:52.154 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.155 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:44:52.156 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:52.158 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:52.159 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:52.160 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "110", 2023-08-10T10:44:52.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:52.162 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:52.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:52.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:52.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:52.166 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:52.168 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:44:52.175 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.176 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.178 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.180 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:44:52.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.186 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.190 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:44:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.196 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:44:52.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.200 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.201 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:44:52.204 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.206 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.210 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.211 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:44:52.214 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:52.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:44:52.219 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.220 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.221 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.225 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.226 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:44:52.228 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:44:52.229 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.230 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.231 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.233 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:52.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.239 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:52.240 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:52.241 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.243 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:44:52.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:52.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:52.249 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:52.250 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:44:52.252 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.253 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.254 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:52.255 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.258 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:52.259 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.260 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:44:52.261 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:44:52.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:44:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:44:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:44:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:44:52.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:52.264 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.118+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 msgr2=0x7fc02006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.118+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 0x7fc02006d110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0401f5f60 tx=0x7fc028007950 comp rx=0 tx=0).stop 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 msgr2=0x7fc0400c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc030036040 tx=0x7fc030004a40 comp rx=0 tx=0).stop 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 shutdown_connections 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02006ac50 0x7fc02006d110 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc040153c30 0x7fc0400c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc040153850 0x7fc0400c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 --2- 172.21.15.50:0/256675573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0400cfd40 0x7fc0400c5680 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 >> 172.21.15.50:0/256675573 conn(0x7fc040069880 msgr2=0x7fc0400b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 shutdown_connections 2023-08-10T10:44:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:52.119+0000 7fc044e21640 1 -- 172.21.15.50:0/256675573 wait complete. 2023-08-10T10:44:52.268 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:44:52.507 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:44:52.506+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-10T10:44:57.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:44:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.511+0000 7f064d25d640 1 Processor -- start 2023-08-10T10:44:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.511+0000 7f064d25d640 1 -- start start 2023-08-10T10:44:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064d25d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 0x7f06480b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064d25d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f064815f2b0 0x7f06480b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064d25d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480b1f10 con 0x7f064815a940 2023-08-10T10:44:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064d25d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480b21f0 con 0x7f064815f2b0 2023-08-10T10:44:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064d25d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064815e5c0 con 0x7f06480b0620 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f064ca5c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f064815f2b0 0x7f06480b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f0647fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f064815a940 0x7f06480aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43542/0 (socket says 172.21.15.50:43542) 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f0647fff640 1 -- 172.21.15.50:0/871355658 learned_addr learned my addr 172.21.15.50:0/871355658 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.513+0000 7f06477fe640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 0x7f06480b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f0646ffd640 1 -- 172.21.15.50:0/871355658 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423221031 0 0) 0x7f06480b1f10 con 0x7f064815a940 2023-08-10T10:44:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f0646ffd640 1 -- 172.21.15.50:0/871355658 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0630003520 con 0x7f064815a940 2023-08-10T10:44:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f064ca5c640 1 -- 172.21.15.50:0/871355658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 msgr2=0x7f06480b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f064ca5c640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 0x7f06480b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f064ca5c640 1 -- 172.21.15.50:0/871355658 >> v1:172.21.15.50:6789/0 conn(0x7f064815a940 legacy=0x7f06480aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f064ca5c640 1 -- 172.21.15.50:0/871355658 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064815e7d0 con 0x7f064815f2b0 2023-08-10T10:44:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.514+0000 7f06477fe640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 0x7f06480b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:44:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.515+0000 7f064ca5c640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815f2b0 0x7f06480b1800 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0640009d90 tx=0x7f064002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585f8b9bf0109057 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.515+0000 7f0646ffd640 1 -- 172.21.15.50:0/871355658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064002cbd0 con 0x7f064815f2b0 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.515+0000 7f0646ffd640 1 -- 172.21.15.50:0/871355658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064002cd30 con 0x7f064815f2b0 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.515+0000 7f0646ffd640 1 -- 172.21.15.50:0/871355658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064002cea0 con 0x7f064815f2b0 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 -- 172.21.15.50:0/871355658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815f2b0 msgr2=0x7f06480b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815f2b0 0x7f06480b1800 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0640009d90 tx=0x7f064002be20 comp rx=0 tx=0).stop 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 -- 172.21.15.50:0/871355658 shutdown_connections 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815f2b0 0x7f06480b1800 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 --2- 172.21.15.50:0/871355658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06480b0620 0x7f06480b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 -- 172.21.15.50:0/871355658 >> 172.21.15.50:0/871355658 conn(0x7f064806ab80 msgr2=0x7f064806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 -- 172.21.15.50:0/871355658 shutdown_connections 2023-08-10T10:44:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.516+0000 7f064d25d640 1 -- 172.21.15.50:0/871355658 wait complete. 2023-08-10T10:44:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.518+0000 7f064d25d640 1 Processor -- start 2023-08-10T10:44:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.518+0000 7f064d25d640 1 -- start start 2023-08-10T10:44:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 0x7f064815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064815f2b0 0x7f064815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064806f5f0 con 0x7f064815a940 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064806e700 con 0x7f06480b0620 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f064d25d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064806e9e0 con 0x7f064815f2b0 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f06477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.519+0000 7f06477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44306/0 (socket says 172.21.15.50:44306) 2023-08-10T10:44:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 -- 172.21.15.50:0/1904143678 learned_addr learned my addr 172.21.15.50:0/1904143678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f0647fff640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 0x7f064815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f064ca5c640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064815f2b0 0x7f064815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 -- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064815f2b0 msgr2=0x7f064815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064815f2b0 0x7f064815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 -- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 msgr2=0x7f064815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 0x7f064815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009a70 con 0x7f064815a940 2023-08-10T10:44:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f0647fff640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 0x7f064815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.520+0000 7f06477fe640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d7d0 tx=0x7f063c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.521+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c004030 con 0x7f064815a940 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.521+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c004190 con 0x7f064815a940 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.521+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064806ecc0 con 0x7f064815a940 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.521+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c004520 con 0x7f064815a940 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.521+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064806f280 con 0x7f064815a940 2023-08-10T10:44:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.522+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064806f7a0 con 0x7f064815a940 2023-08-10T10:44:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.523+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f063c0096a0 con 0x7f064815a940 2023-08-10T10:44:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.524+0000 7f0644ff9640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 0x7f063406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.524+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f063c089730 con 0x7f064815a940 2023-08-10T10:44:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.524+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f0634072da0 con 0x7f064815a940 2023-08-10T10:44:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.524+0000 7f0647fff640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 0x7f063406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.525+0000 7f0647fff640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 0x7f063406d110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0638005880 tx=0x7f0638009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.529+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f063c054740 con 0x7f064815a940 2023-08-10T10:44:57.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.721+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0648066e30 con 0x7f064815a940 2023-08-10T10:44:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.725+0000 7f0644ff9640 1 -- 172.21.15.50:0/1904143678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+37058 (secure 0 0 0) 0x7f063c057d60 con 0x7f064815a940 2023-08-10T10:44:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:57.726 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:44:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 113, 2023-08-10T10:44:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:44:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:44:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:44:55.522604+0000", 2023-08-10T10:44:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:44:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:44:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:44:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:44:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:44:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:44:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:44:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:44:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:44:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:57.738 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:57.738 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:57.738 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:57.739 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:57.739 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:57.739 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:57.739 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:57.740 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:57.740 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:57.740 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:57.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:57.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:57.741 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:57.741 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:57.741 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:57.742 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:57.742 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:57.742 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:57.742 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:57.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:44:57.746 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:44:57.747 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:44:57.747 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:44:57.747 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:57.747 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:57.747 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:44:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:57.749 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:44:57.750 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:57.751 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:57.752 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:57.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:57.754 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.755 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:57.756 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.757 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:57.758 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:57.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:44:57.761 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:57.762 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:57.763 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:57.764 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:57.765 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:57.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:57.767 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:44:57.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.769 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:57.770 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:57.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:57.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:57.772 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:57.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:57.772 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:57.772 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:44:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:57.774 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:57.775 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:57.777 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.778 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:57.779 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.780 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:44:57.781 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.783 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:57.783 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:44:57.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.783 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:57.783 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.784 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:44:57.786 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:44:57.788 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.793 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.795 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:44:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.799 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:44:57.799 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.800 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.800 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.800 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:44:57.804 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:57.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.805 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.806 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.807 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.809 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.811 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.813 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.814 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.814 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:44:57.814 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.815 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:44:57.816 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:57.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.817 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:44:57.817 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:44:57.817 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:44:57.818 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:44:57.818 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.818 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.818 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.819 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:44:57.822 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.823 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:44:57.824 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:44:57.826 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:57.830 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.831 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.832 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.833 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.833 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.833 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.833 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.834 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.835 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:44:57.835 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.836 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:44:57.836 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.837 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.837 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:44:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:44:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.841 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.842 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:44:57.842 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.844 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:44:57.844 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.844 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.845 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.845 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.846 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:44:57.846 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:44:57.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:57.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.848 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.849 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:44:57.849 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:44:57.849 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:44:57.849 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:44:57.850 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.850 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.850 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:57.850 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:57.852 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.852 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.852 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.853 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.853 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.854 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.854 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.854 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.854 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.855 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.855 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.856 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:44:57.856 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.857 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:44:57.857 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.858 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.858 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.858 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:44:57.864 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:44:57.868 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:44:57.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.872 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.874 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:57.876 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:57.877 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:44:57.883 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:57.885 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.887 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:44:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.889 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.890 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.891 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.893 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.894 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:57.895 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.896 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:44:57.897 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:44:57.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:44:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:57.900 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:44:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 msgr2=0x7f063406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 0x7f063406d110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0638005880 tx=0x7f0638009040 comp rx=0 tx=0).stop 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 msgr2=0x7f064815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d7d0 tx=0x7f063c00dc90 comp rx=0 tx=0).stop 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 shutdown_connections 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064815f2b0 0x7f064815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064815a940 0x7f064815d750 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f063406ac50 0x7f063406d110 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.727+0000 7f064d25d640 1 --2- 172.21.15.50:0/1904143678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06480b0620 0x7f064815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.728+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 >> 172.21.15.50:0/1904143678 conn(0x7f064806ab80 msgr2=0x7f06480ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.728+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 shutdown_connections 2023-08-10T10:44:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:57.728+0000 7f064d25d640 1 -- 172.21.15.50:0/1904143678 wait complete. 2023-08-10T10:44:57.904 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-10T10:44:57.904 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:57.904 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:57.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:57.969 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-08-10T10:44:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-10T10:44:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:44:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:44:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.326483 s, 161 MB/s 2023-08-10T10:44:58.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:44:58.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:44:58.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.589+0000 7ff90f90f640 1 Processor -- start 2023-08-10T10:44:58.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.589+0000 7ff90f90f640 1 -- start start 2023-08-10T10:44:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.590+0000 7ff90f90f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff9080cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.590+0000 7ff90f90f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9080cddb0 0x7ff9080d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.590+0000 7ff90f90f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff908161180 con 0x7ff90815cd60 2023-08-10T10:44:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.590+0000 7ff90f90f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080ce240 con 0x7ff9080cddb0 2023-08-10T10:44:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff90f90f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080b5bd0 con 0x7ff9080b8430 2023-08-10T10:44:58.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff90d6ab640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff90815cd60 0x7ff908160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43544/0 (socket says 172.21.15.50:43544) 2023-08-10T10:44:58.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff90d6ab640 1 -- 172.21.15.50:0/4060753032 learned_addr learned my addr 172.21.15.50:0/4060753032 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:58.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff90deac640 1 --2- 172.21.15.50:0/4060753032 >> v2:172.21.15.117:3300/0 conn(0x7ff9080cddb0 0x7ff9080d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff9080cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104499204 0 0) 0x7ff908161180 con 0x7ff90815cd60 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.591+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f4003520 con 0x7ff90815cd60 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970973379 0 0) 0x7ff8f4003520 con 0x7ff90815cd60 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 msgr2=0x7ff9080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff9080cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 >> v2:172.21.15.117:3300/0 conn(0x7ff9080cddb0 msgr2=0x7ff9080d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 --2- 172.21.15.50:0/4060753032 >> v2:172.21.15.117:3300/0 conn(0x7ff9080cddb0 0x7ff9080d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908161460 con 0x7ff90815cd60 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff904001670 con 0x7ff90815cd60 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 >> v1:172.21.15.50:6789/0 conn(0x7ff90815cd60 legacy=0x7ff908160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff8f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff8f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4004d00 0x7ff8f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080ce240 con 0x7ff8f4003ef0 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080b5bd0 con 0x7ff8f4004d00 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f400b9b0 con 0x7ff9080b8430 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.592+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff8f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90d6ab640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff8f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90deac640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4004d00 0x7ff8f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90ceaa640 1 -- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 msgr2=0x7ff8f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff8f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90ceaa640 1 -- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4004d00 msgr2=0x7ff8f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4004d00 0x7ff8f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90ceaa640 1 -- 172.21.15.50:0/4060753032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4003520 con 0x7ff8f4003ef0 2023-08-10T10:44:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90d6ab640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080b8430 0x7ff8f4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.593+0000 7ff90deac640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8f4004d00 0x7ff8f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.594+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff8f40047c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009ac0 tx=0x7ff8f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cc1b9eb3246e27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.594+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f802c6b0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.594+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f802c810 con 0x7ff8f4003ef0 2023-08-10T10:44:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.594+0000 7ff8fffff640 1 -- 172.21.15.50:0/4060753032 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f802cba0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 -- 172.21.15.50:0/4060753032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 msgr2=0x7ff8f40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 --2- 172.21.15.50:0/4060753032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff8f40047c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009ac0 tx=0x7ff8f40057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90deac640 1 -- 172.21.15.50:0/4060753032 reap_dead start 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 -- 172.21.15.50:0/4060753032 shutdown_connections 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 -- 172.21.15.50:0/4060753032 >> 172.21.15.50:0/4060753032 conn(0x7ff9080d2ac0 msgr2=0x7ff9080d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 -- 172.21.15.50:0/4060753032 shutdown_connections 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.595+0000 7ff90f90f640 1 -- 172.21.15.50:0/4060753032 wait complete. 2023-08-10T10:44:58.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.597+0000 7ff90f90f640 1 Processor -- start 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.597+0000 7ff90f90f640 1 -- start start 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080b3880 0x7ff908152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908155680 0x7ff9081573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080b3d00 con 0x7ff8f4003ef0 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081f68f0 con 0x7ff9080b3880 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90f90f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081f6050 con 0x7ff908155680 2023-08-10T10:44:58.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90d6ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90d6ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44318/0 (socket says 172.21.15.50:44318) 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.598+0000 7ff90d6ab640 1 -- 172.21.15.50:0/1738561568 learned_addr learned my addr 172.21.15.50:0/1738561568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90deac640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908155680 0x7ff9081573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080b3880 0x7ff908152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 -- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908155680 msgr2=0x7ff9081573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908155680 0x7ff9081573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 -- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080b3880 msgr2=0x7ff908152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080b3880 0x7ff908152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9081f6330 con 0x7ff8f4003ef0 2023-08-10T10:44:58.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90d6ab640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d810 tx=0x7ff90400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:58.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040074e0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff904007640 con 0x7ff8f4003ef0 2023-08-10T10:44:58.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9081f6610 con 0x7ff8f4003ef0 2023-08-10T10:44:58.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040049e0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.599+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff908153080 con 0x7ff8f4003ef0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.601+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff908153270 con 0x7ff8f4003ef0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.602+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff904004b40 con 0x7ff8f4003ef0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.603+0000 7ff8fdffb640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 0x7ff8ec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.603+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9040893e0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.603+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 0x7ff8ec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.603+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7ff8ec072da0 con 0x7ff8f4003ef0 2023-08-10T10:44:58.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.604+0000 7ff90ceaa640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 0x7ff8ec06d110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8036000 tx=0x7ff8f8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:58.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.606+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff904019060 con 0x7ff8f4003ef0 2023-08-10T10:44:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.799+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff9080b4b90 con 0x7ff8f4003ef0 2023-08-10T10:44:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.802+0000 7ff8fdffb640 1 -- 172.21.15.50:0/1738561568 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+37058 (secure 0 0 0) 0x7ff904057e80 con 0x7ff8f4003ef0 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 113, 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:44:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:44:55.522604+0000", 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:44:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:44:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:44:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:44:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:44:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:44:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:58.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:58.815 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:44:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:44:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:44:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:44:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:44:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:44:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:44:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:44:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:44:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:44:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:44:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:44:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:44:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:44:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:44:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:44:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:44:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:44:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:44:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:44:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:44:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:44:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:44:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:44:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:44:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:44:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:44:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:44:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:44:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:44:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:44:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:44:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:44:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:44:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:44:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:44:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:44:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:44:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:44:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:44:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:44:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:44:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:44:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.937 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.938 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.939 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.941 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.945 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:44:58.947 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.948 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:44:58.949 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.950 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.951 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:44:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.955 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:44:58.957 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:44:58.958 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:44:58.958 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:44:58.958 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:44:58.958 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:44:58.959 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:44:58.959 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:44:58.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.959 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:58.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:44:58.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:44:58.961 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.961 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.961 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.961 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.962 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.962 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:44:58.962 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:44:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.965 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.965 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:44:58.965 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:44:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.967 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.967 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.967 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.967 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:44:58.967 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:44:58.969 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.969 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.969 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.969 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.970 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:44:58.972 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.973 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:44:58.974 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.975 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:44:58.976 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:44:58.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:44:58.978 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:44:58.979 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:44:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 msgr2=0x7ff8ec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 0x7ff8ec06d110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8036000 tx=0x7ff8f8030000 comp rx=0 tx=0).stop 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 msgr2=0x7ff9081f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d810 tx=0x7ff90400dcd0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 shutdown_connections 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908155680 0x7ff9081573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff8ec06ac50 0x7ff8ec06d110 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080b3880 0x7ff908152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 --2- 172.21.15.50:0/1738561568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4003ef0 0x7ff9081f5a70 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.805+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 >> 172.21.15.50:0/1738561568 conn(0x7ff9080d2ac0 msgr2=0x7ff90815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.806+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 shutdown_connections 2023-08-10T10:44:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:58.806+0000 7ff90f90f640 1 -- 172.21.15.50:0/1738561568 wait complete. 2023-08-10T10:44:58.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:44:59.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.215+0000 7f2986b60640 1 Processor -- start 2023-08-10T10:44:59.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.216+0000 7f2986b60640 1 -- start start 2023-08-10T10:44:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.217+0000 7f2986b60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29800affb0 0x7f29800b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.217+0000 7f2986b60640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f29800cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.217+0000 7f2986b60640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800ca3d0 con 0x7f298015ce50 2023-08-10T10:44:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.217+0000 7f2986b60640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800b0980 con 0x7f29800affb0 2023-08-10T10:44:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.217+0000 7f2986b60640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800ca6b0 con 0x7f29800cc100 2023-08-10T10:44:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f2985b5e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f298015ce50 0x7f29800cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43550/0 (socket says 172.21.15.50:43550) 2023-08-10T10:44:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f2985b5e640 1 -- 172.21.15.50:0/1967630269 learned_addr learned my addr 172.21.15.50:0/1967630269 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:44:59.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f298635f640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f29800cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f298535d640 1 --2- 172.21.15.50:0/1967630269 >> v2:172.21.15.117:3300/0 conn(0x7f29800affb0 0x7f29800b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427323772 0 0) 0x7f29800ca3d0 con 0x7f298015ce50 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.218+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c003520 con 0x7f298015ce50 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056904138 0 0) 0x7f296c003520 con 0x7f298015ce50 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 msgr2=0x7f29800cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f29800cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 >> v2:172.21.15.117:3300/0 conn(0x7f29800affb0 msgr2=0x7f29800b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 --2- 172.21.15.50:0/1967630269 >> v2:172.21.15.117:3300/0 conn(0x7f29800affb0 0x7f29800b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800c8cb0 con 0x7f298015ce50 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f297c001670 con 0x7f298015ce50 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 >> v1:172.21.15.50:6789/0 conn(0x7f298015ce50 legacy=0x7f29800cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f296c0039e0 0x7f296c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f296c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b0980 con 0x7f296c0047c0 2023-08-10T10:44:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800ca6b0 con 0x7f296c0039e0 2023-08-10T10:44:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00dc10 con 0x7f29800cc100 2023-08-10T10:44:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f298535d640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f298635f640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f296c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.219+0000 7f298535d640 1 -- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 msgr2=0x7f296c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f298535d640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f296c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f298535d640 1 -- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f296c0039e0 msgr2=0x7f296c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:44:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f296c0039e0 0x7f296c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f298535d640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f296c0039e0 0x7f296c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f298535d640 1 -- 172.21.15.50:0/1967630269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c003520 con 0x7f296c0047c0 2023-08-10T10:44:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f298635f640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29800cc100 0x7f296c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.220+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f296c0039e0 0x7f296c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.221+0000 7f298535d640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2970009ac0 tx=0x7f296c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235ea6332868cb52 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.221+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297002c710 con 0x7f296c0047c0 2023-08-10T10:44:59.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.221+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297002c870 con 0x7f296c0047c0 2023-08-10T10:44:59.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.221+0000 7f2984b5c640 1 -- 172.21.15.50:0/1967630269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297002cc00 con 0x7f296c0047c0 2023-08-10T10:44:59.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 -- 172.21.15.50:0/1967630269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296c0047c0 msgr2=0x7f296c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 --2- 172.21.15.50:0/1967630269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2970009ac0 tx=0x7f296c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f298635f640 1 -- 172.21.15.50:0/1967630269 reap_dead start 2023-08-10T10:44:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 -- 172.21.15.50:0/1967630269 shutdown_connections 2023-08-10T10:44:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 -- 172.21.15.50:0/1967630269 >> 172.21.15.50:0/1967630269 conn(0x7f29800cafb0 msgr2=0x7f29800cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 -- 172.21.15.50:0/1967630269 shutdown_connections 2023-08-10T10:44:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.222+0000 7f2986b60640 1 -- 172.21.15.50:0/1967630269 wait complete. 2023-08-10T10:44:59.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.224+0000 7f2986b60640 1 Processor -- start 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.224+0000 7f2986b60640 1 -- start start 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 0x7f29800acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29800b31d0 0x7f2980154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980070d90 con 0x7f29800c4450 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980156a60 con 0x7f29800b31d0 2023-08-10T10:44:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f2986b60640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29801566c0 con 0x7f296c0047c0 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f298535d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f298535d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44338/0 (socket says 172.21.15.50:44338) 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.225+0000 7f298535d640 1 -- 172.21.15.50:0/1744597849 learned_addr learned my addr 172.21.15.50:0/1744597849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 0x7f29800acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298635f640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29800b31d0 0x7f2980154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 -- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 msgr2=0x7f29800acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 0x7f29800acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 -- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29800b31d0 msgr2=0x7f2980154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29800b31d0 0x7f2980154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298006e980 con 0x7f29800c4450 2023-08-10T10:44:59.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 0x7f29800acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:44:59.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f298535d640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2970037040 tx=0x7f2970004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970003810 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297002de90 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970003b70 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.226+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298006ec60 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.227+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800b37a0 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.228+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980066e30 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.229+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2970003cd0 con 0x7f29800c4450 2023-08-10T10:44:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.230+0000 7f29767fc640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 0x7f296406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.230+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29700ab420 con 0x7f29800c4450 2023-08-10T10:44:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.230+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f2964072da0 con 0x7f29800c4450 2023-08-10T10:44:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.230+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 0x7f296406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.231+0000 7f2985b5e640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 0x7f296406d110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f297c001800 tx=0x7f297c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:59.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.234+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2970076570 con 0x7f29800c4450 2023-08-10T10:44:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.466+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2980073380 con 0x7f29800c4450 2023-08-10T10:44:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.468+0000 7f29767fc640 1 -- 172.21.15.50:0/1744597849 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f297004c090 con 0x7f29800c4450 2023-08-10T10:44:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:44:59.469 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:44:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:44:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 msgr2=0x7f296406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 0x7f296406d110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f297c001800 tx=0x7f297c009040 comp rx=0 tx=0).stop 2023-08-10T10:44:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 msgr2=0x7f29800c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2970037040 tx=0x7f2970004730 comp rx=0 tx=0).stop 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 shutdown_connections 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f296406ac50 0x7f296406d110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29800b31d0 0x7f2980154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29800c4450 0x7f29800c1b60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 --2- 172.21.15.50:0/1744597849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f296c0047c0 0x7f29800acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.470+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 >> 172.21.15.50:0/1744597849 conn(0x7f29800cafb0 msgr2=0x7f298015bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.471+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 shutdown_connections 2023-08-10T10:44:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:44:59.471+0000 7f2986b60640 1 -- 172.21.15.50:0/1744597849 wait complete. 2023-08-10T10:44:59.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-10T10:44:59.735 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5833,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.227548493,"mdsmap_epoch":51,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":29.031369523999999} 2023-08-10T10:44:59.735 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5833, "mdsmap_epoch": 51, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 23.227548493, "state": "up:active", "uptime": 29.031369524, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:44:59.736 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:44:59.736 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:44:59.736 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:44:59.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:59.801 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-08-10T10:44:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:dd: failed to open 'small_file_1': Permission denied 2023-08-10T10:44:59.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:44:59.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:59.857 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-10T10:44:59.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:44:59.916 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-10T10:45:00.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:45:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.298+0000 7f6d5ffff640 1 Processor -- start 2023-08-10T10:45:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.298+0000 7f6d5ffff640 1 -- start start 2023-08-10T10:45:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d60153850 0x7f6d600b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 0x7f6d600b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d600cf630 0x7f6d600cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d600cffe0 con 0x7f6d60153850 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6015d010 con 0x7f6d600cf630 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6015d290 con 0x7f6d60153c30 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d60153850 0x7f6d600b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.300+0000 7f6d5effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d60153850 0x7f6d600b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44344/0 (socket says 172.21.15.50:44344) 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 -- 172.21.15.50:0/2574353172 learned_addr learned my addr 172.21.15.50:0/2574353172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5f7fe640 1 --2- 172.21.15.50:0/2574353172 >> v2:172.21.15.117:3300/0 conn(0x7f6d600cf630 0x7f6d600cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 -- 172.21.15.50:0/2574353172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 msgr2=0x7f6d600b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d57fff640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 0x7f6d600b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 0x7f6d600b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 -- 172.21.15.50:0/2574353172 >> v2:172.21.15.117:3300/0 conn(0x7f6d600cf630 msgr2=0x7f6d600cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 --2- 172.21.15.50:0/2574353172 >> v2:172.21.15.117:3300/0 conn(0x7f6d600cf630 0x7f6d600cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d5effd640 1 -- 172.21.15.50:0/2574353172 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6015d570 con 0x7f6d60153850 2023-08-10T10:45:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.301+0000 7f6d57fff640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 0x7f6d600b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.302+0000 7f6d5effd640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d60153850 0x7f6d600b1690 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6d6008bb50 tx=0x7f6d5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f6003dbd3ee2bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.303+0000 7f6d5e7fc640 1 -- 172.21.15.50:0/2574353172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50031870 con 0x7f6d60153850 2023-08-10T10:45:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.303+0000 7f6d5e7fc640 1 -- 172.21.15.50:0/2574353172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500319d0 con 0x7f6d60153850 2023-08-10T10:45:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.303+0000 7f6d5e7fc640 1 -- 172.21.15.50:0/2574353172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50031d60 con 0x7f6d60153850 2023-08-10T10:45:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.303+0000 7f6d5ffff640 1 -- 172.21.15.50:0/2574353172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d60153850 msgr2=0x7f6d600b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.303+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d60153850 0x7f6d600b1690 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6d6008bb50 tx=0x7f6d5002b910 comp rx=0 tx=0).stop 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 -- 172.21.15.50:0/2574353172 shutdown_connections 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/2574353172 >> v2:172.21.15.117:3300/0 conn(0x7f6d600cf630 0x7f6d600cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153c30 0x7f6d600b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/2574353172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d60153850 0x7f6d600b1690 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 -- 172.21.15.50:0/2574353172 >> 172.21.15.50:0/2574353172 conn(0x7f6d60069880 msgr2=0x7f6d60069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 -- 172.21.15.50:0/2574353172 shutdown_connections 2023-08-10T10:45:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.304+0000 7f6d5ffff640 1 -- 172.21.15.50:0/2574353172 wait complete. 2023-08-10T10:45:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.306+0000 7f6d5ffff640 1 Processor -- start 2023-08-10T10:45:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.307+0000 7f6d5ffff640 1 -- start start 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153850 0x7f6d600c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 0x7f6d60152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601f3480 con 0x7f6d600cf630 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600c63b0 con 0x7f6d60153c30 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600c6690 con 0x7f6d60153850 2023-08-10T10:45:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44346/0 (socket says 172.21.15.50:44346) 2023-08-10T10:45:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.308+0000 7f6d5effd640 1 -- 172.21.15.50:0/3042581837 learned_addr learned my addr 172.21.15.50:0/3042581837 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5f7fe640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 0x7f6d60152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 -- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153850 msgr2=0x7f6d600c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153850 0x7f6d600c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 -- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 msgr2=0x7f6d60152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 0x7f6d60152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500094d0 con 0x7f6d600cf630 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5f7fe640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 0x7f6d60152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.309+0000 7f6d5effd640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6d5002b950 tx=0x7f6d500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.310+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5003ad30 con 0x7f6d600cf630 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.310+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500443f0 con 0x7f6d600cf630 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.310+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500447a0 con 0x7f6d600cf630 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.310+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d600c6970 con 0x7f6d600cf630 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.310+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d600c6f30 con 0x7f6d600cf630 2023-08-10T10:45:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.311+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60066e30 con 0x7f6d600cf630 2023-08-10T10:45:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.312+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d5004d450 con 0x7f6d600cf630 2023-08-10T10:45:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.313+0000 7f6d577fe640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 0x7f6d4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.313+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d5002d040 con 0x7f6d600cf630 2023-08-10T10:45:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.313+0000 7f6d57fff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 0x7f6d4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.313+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f6d40072da0 con 0x7f6d600cf630 2023-08-10T10:45:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.314+0000 7f6d57fff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 0x7f6d4006d110 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006b10 tx=0x7f6d48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:00.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.318+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6d50035020 con 0x7f6d600cf630 2023-08-10T10:45:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.514+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6d600b8200 con 0x7f6d600cf630 2023-08-10T10:45:00.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.519+0000 7f6d577fe640 1 -- 172.21.15.50:0/3042581837 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+37058 (secure 0 0 0) 0x7f6d50076b50 con 0x7f6d600cf630 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 113, 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:45:00.521 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:44:55.522604+0000", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:45:00.522 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:45:00.523 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:45:00.524 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:45:00.525 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:45:00.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.525 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:45:00.525 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:45:00.525 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:45:00.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:45:00.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:45:00.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:00.526 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:00.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:00.527 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:00.527 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:00.527 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:00.528 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:00.528 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:00.528 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:00.528 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:00.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:45:00.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:45:00.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:45:00.530 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:45:00.530 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:45:00.530 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:00.530 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:00.531 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:00.531 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:00.531 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:00.531 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:00.532 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:00.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.532 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:45:00.532 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:00.533 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:00.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:00.535 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:00.536 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:00.536 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:00.536 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:00.536 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:00.536 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:00.537 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:45:00.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:45:00.540 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:45:00.541 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:00.542 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:45:00.543 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:45:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:45:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:45:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:45:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:45:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:00.546 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:00.547 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:00.548 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:00.548 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:00.548 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:00.548 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:00.548 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:00.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:00.550 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:45:00.551 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:45:00.552 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.553 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:00.554 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:00.555 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:45:00.556 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:00.557 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:00.558 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:00.559 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:00.560 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:00.561 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:00.563 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:00.564 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:00.565 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:45:00.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.565 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:00.565 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:45:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 3, 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full", 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "111", 2023-08-10T10:45:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:45:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:45:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:45:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:45:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:45:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:45:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:45:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:45:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:45:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:45:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:45:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:45:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:45:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:45:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:45:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:45:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:45:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:45:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:45:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:45:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:45:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:45:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:45:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:45:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:45:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:45:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:45:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:45:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:45:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:45:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:45:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:45:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "full", 2023-08-10T10:45:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:45:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:45:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:45:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:45:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.663 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.664 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.666 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.667 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:45:00.671 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.675 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.675 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.675 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.676 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:45:00.676 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.677 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.679 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.680 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:00.681 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:00.682 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:00.683 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.683 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:45:00.683 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.684 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.685 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.685 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:00.686 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.686 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:45:00.687 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.688 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:45:00.688 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.689 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:00.689 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.690 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:45:00.690 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.691 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.692 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:00.692 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:00.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:45:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:45:00.694 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.695 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:45:00.696 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.697 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.698 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:00.699 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.701 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.702 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:00.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:00.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:45:00.706 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:45:00.707 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:45:00.708 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:00.709 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.523+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 msgr2=0x7f6d4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.523+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 0x7f6d4006d110 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006b10 tx=0x7f6d48008040 comp rx=0 tx=0).stop 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.523+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 msgr2=0x7f6d601f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.523+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6d5002b950 tx=0x7f6d500046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 shutdown_connections 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d4006ac50 0x7f6d4006d110 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d60153c30 0x7f6d60152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d60153850 0x7f6d600c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 --2- 172.21.15.50:0/3042581837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d600cf630 0x7f6d601f2f40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 >> 172.21.15.50:0/3042581837 conn(0x7f6d60069880 msgr2=0x7f6d600b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 shutdown_connections 2023-08-10T10:45:00.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:00.524+0000 7f6d5ffff640 1 -- 172.21.15.50:0/3042581837 wait complete. 2023-08-10T10:45:00.713 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:45:01.506 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:45:01.505+0000 7fa47bf1c640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-08-10T10:45:05.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:45:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.957+0000 7f5ed747e640 1 Processor -- start 2023-08-10T10:45:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.957+0000 7f5ed747e640 1 -- start start 2023-08-10T10:45:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed747e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ed015aa40 0x7f5ed00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed747e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ed00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed747e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed0071c70 con 0x7f5ed00b0c60 2023-08-10T10:45:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed747e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed00713d0 con 0x7f5ed015aa40 2023-08-10T10:45:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed747e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00716b0 con 0x7f5ed00ca930 2023-08-10T10:45:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed4a19640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5ed00b0c60 0x7f5ed00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38194/0 (socket says 172.21.15.50:38194) 2023-08-10T10:45:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.959+0000 7f5ed4a19640 1 -- 172.21.15.50:0/1152722769 learned_addr learned my addr 172.21.15.50:0/1152722769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1152722769 >> v2:172.21.15.117:3300/0 conn(0x7f5ed015aa40 0x7f5ed00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ed00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641450165 0 0) 0x7f5ed0071c70 con 0x7f5ed00b0c60 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc003520 con 0x7f5ed00b0c60 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1452597081 0 0) 0x7f5ebc003520 con 0x7f5ed00b0c60 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 msgr2=0x7f5ed00b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ed00b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 >> v2:172.21.15.117:3300/0 conn(0x7f5ed015aa40 msgr2=0x7f5ed00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 --2- 172.21.15.50:0/1152722769 >> v2:172.21.15.117:3300/0 conn(0x7f5ed015aa40 0x7f5ed00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0071990 con 0x7f5ed00b0c60 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5ec0001670 con 0x7f5ed00b0c60 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.960+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 >> v1:172.21.15.50:6789/0 conn(0x7f5ed00b0c60 legacy=0x7f5ed00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ebc003970 0x7f5ebc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ebc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc004d00 0x7f5ebc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00713d0 con 0x7f5ebc003970 2023-08-10T10:45:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00716b0 con 0x7f5ebc004d00 2023-08-10T10:45:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00fd90 con 0x7f5ed00ca930 2023-08-10T10:45:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ebc003970 0x7f5ebc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed4a19640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ebc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 -- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 msgr2=0x7f5ebc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc004d00 0x7f5ebc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed00ca930 0x7f5ebc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 -- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc004d00 msgr2=0x7f5ebc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc004d00 0x7f5ebc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed521a640 1 -- 172.21.15.50:0/1152722769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc003520 con 0x7f5ebc003970 2023-08-10T10:45:05.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.961+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc004d00 0x7f5ebc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.963+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ebc003970 0x7f5ebc003d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009ac0 tx=0x7f5ebc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660033eb96a23572 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.963+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc02c710 con 0x7f5ebc003970 2023-08-10T10:45:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.963+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc02c870 con 0x7f5ebc003970 2023-08-10T10:45:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.963+0000 7f5ec7fff640 1 -- 172.21.15.50:0/1152722769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc02cc00 con 0x7f5ebc003970 2023-08-10T10:45:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 -- 172.21.15.50:0/1152722769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ebc003970 msgr2=0x7f5ebc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1152722769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ebc003970 0x7f5ebc003d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009ac0 tx=0x7f5ebc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed5a1b640 1 -- 172.21.15.50:0/1152722769 reap_dead start 2023-08-10T10:45:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 -- 172.21.15.50:0/1152722769 shutdown_connections 2023-08-10T10:45:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 -- 172.21.15.50:0/1152722769 >> 172.21.15.50:0/1152722769 conn(0x7f5ed006b590 msgr2=0x7f5ed00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 -- 172.21.15.50:0/1152722769 shutdown_connections 2023-08-10T10:45:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.964+0000 7f5ed747e640 1 -- 172.21.15.50:0/1152722769 wait complete. 2023-08-10T10:45:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.966+0000 7f5ed747e640 1 Processor -- start 2023-08-10T10:45:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.966+0000 7f5ed747e640 1 -- start start 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 0x7f5ed015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed015b600 0x7f5ed00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed015bb10 con 0x7f5ed014ac90 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed015bdf0 con 0x7f5ebc003970 2023-08-10T10:45:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed747e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed015c0d0 con 0x7f5ed015b600 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48718/0 (socket says 172.21.15.50:48718) 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 -- 172.21.15.50:0/1537045617 learned_addr learned my addr 172.21.15.50:0/1537045617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed4a19640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed015b600 0x7f5ed00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 0x7f5ed015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 -- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed015b600 msgr2=0x7f5ed00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:05.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed015b600 0x7f5ed00696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 -- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 msgr2=0x7f5ed015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:05.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 0x7f5ed015b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.967+0000 7f5ed5a1b640 1 -- 172.21.15.50:0/1537045617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00b27a0 con 0x7f5ed014ac90 2023-08-10T10:45:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 0x7f5ed015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ed5a1b640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00c9090 tx=0x7f5ec800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8017400 con 0x7f5ed014ac90 2023-08-10T10:45:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8011040 con 0x7f5ed014ac90 2023-08-10T10:45:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80177c0 con 0x7f5ed014ac90 2023-08-10T10:45:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed015c3b0 con 0x7f5ed014ac90 2023-08-10T10:45:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.968+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01ef180 con 0x7f5ed014ac90 2023-08-10T10:45:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.969+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed004e270 con 0x7f5ed014ac90 2023-08-10T10:45:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.970+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ec80203b0 con 0x7f5ed014ac90 2023-08-10T10:45:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.971+0000 7f5ec5ffb640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 0x7f5eb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.971+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ec8089830 con 0x7f5ed014ac90 2023-08-10T10:45:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.972+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 0x7f5eb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.972+0000 7f5ed521a640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 0x7f5eb406d110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc036000 tx=0x7f5ecc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:05.976+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5ec80548d0 con 0x7f5ed014ac90 2023-08-10T10:45:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.169+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5ed014b120 con 0x7f5ed014ac90 2023-08-10T10:45:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.173+0000 7f5ec5ffb640 1 -- 172.21.15.50:0/1537045617 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+36942 (secure 0 0 0) 0x7f5ec8057ef0 con 0x7f5ed014ac90 2023-08-10T10:45:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 116, 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:45:05.829051+0000", 2023-08-10T10:45:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:45:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:45:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:45:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:45:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:45:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:45:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:45:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:45:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:45:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:45:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:45:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:45:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:45:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:45:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:45:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:45:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:45:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:45:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:45:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:45:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:45:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:45:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:45:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:45:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:45:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:45:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:45:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:45:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:45:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:45:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:45:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:45:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:45:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:45:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:45:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:45:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:45:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:45:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:45:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:45:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:45:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:45:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:45:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:45:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:45:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:45:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:45:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:45:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:45:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:45:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:45:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:45:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:45:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.350 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:45:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 msgr2=0x7f5eb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 0x7f5eb406d110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc036000 tx=0x7f5ecc030000 comp rx=0 tx=0).stop 2023-08-10T10:45:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 msgr2=0x7f5ed0069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00c9090 tx=0x7f5ec800f4a0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 shutdown_connections 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed014ac90 0x7f5ed0069be0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed015b600 0x7f5ed00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5eb406ac50 0x7f5eb406d110 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 --2- 172.21.15.50:0/1537045617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc003970 0x7f5ed015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.176+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 >> 172.21.15.50:0/1537045617 conn(0x7f5ed006b590 msgr2=0x7f5ed0154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.177+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 shutdown_connections 2023-08-10T10:45:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.177+0000 7f5ed747e640 1 -- 172.21.15.50:0/1537045617 wait complete. 2023-08-10T10:45:06.353 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-10T10:45:06.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:45:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.594+0000 7f26551f1640 1 Processor -- start 2023-08-10T10:45:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.594+0000 7f26551f1640 1 -- start start 2023-08-10T10:45:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.595+0000 7f26551f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 0x7f26500b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.595+0000 7f26551f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26500cfd40 0x7f26500b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.595+0000 7f26551f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265015d010 con 0x7f2650153c30 2023-08-10T10:45:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.595+0000 7f26551f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265015d290 con 0x7f26500cfd40 2023-08-10T10:45:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.595+0000 7f26551f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265015d570 con 0x7f2650153850 2023-08-10T10:45:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26500cfd40 0x7f26500b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26500cfd40 0x7f26500b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48724/0 (socket says 172.21.15.50:48724) 2023-08-10T10:45:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 -- 172.21.15.50:0/918901689 learned_addr learned my addr 172.21.15.50:0/918901689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f264ffff640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 0x7f26500b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 -- 172.21.15.50:0/918901689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 msgr2=0x7f26500b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 0x7f26500b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 -- 172.21.15.50:0/918901689 >> v1:172.21.15.117:6789/0 conn(0x7f2650153c30 legacy=0x7f26500cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f26549f0640 1 -- 172.21.15.50:0/918901689 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265015d850 con 0x7f26500cfd40 2023-08-10T10:45:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.596+0000 7f264ffff640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 0x7f26500b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.597+0000 7f26549f0640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26500cfd40 0x7f26500b1bd0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2648009850 tx=0x7f264802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688d34767aaf186 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f264effd640 1 -- 172.21.15.50:0/918901689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648031830 con 0x7f26500cfd40 2023-08-10T10:45:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f264effd640 1 -- 172.21.15.50:0/918901689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648031990 con 0x7f26500cfd40 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f264effd640 1 -- 172.21.15.50:0/918901689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648031d20 con 0x7f26500cfd40 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 -- 172.21.15.50:0/918901689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26500cfd40 msgr2=0x7f26500b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26500cfd40 0x7f26500b1bd0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2648009850 tx=0x7f264802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 -- 172.21.15.50:0/918901689 shutdown_connections 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26500cfd40 0x7f26500b1bd0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 --2- 172.21.15.50:0/918901689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153850 0x7f26500b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 -- 172.21.15.50:0/918901689 >> 172.21.15.50:0/918901689 conn(0x7f2650069880 msgr2=0x7f2650069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.598+0000 7f26551f1640 1 -- 172.21.15.50:0/918901689 shutdown_connections 2023-08-10T10:45:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.599+0000 7f26551f1640 1 -- 172.21.15.50:0/918901689 wait complete. 2023-08-10T10:45:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.600+0000 7f26551f1640 1 Processor -- start 2023-08-10T10:45:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.600+0000 7f26551f1640 1 -- start start 2023-08-10T10:45:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26500cfd40 0x7f26500c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153c30 0x7f265014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650152e60 con 0x7f2650153850 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500cab60 con 0x7f26500cfd40 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.601+0000 7f26551f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26500c9f50 con 0x7f2650153c30 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48732/0 (socket says 172.21.15.50:48732) 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 -- 172.21.15.50:0/1243637740 learned_addr learned my addr 172.21.15.50:0/1243637740 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264ffff640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26500cfd40 0x7f26500c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f26549f0640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153c30 0x7f265014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 -- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153c30 msgr2=0x7f265014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153c30 0x7f265014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 -- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26500cfd40 msgr2=0x7f26500c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26500cfd40 0x7f26500c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.602+0000 7f264f7fe640 1 -- 172.21.15.50:0/1243637740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480094b0 con 0x7f2650153850 2023-08-10T10:45:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f264f7fe640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f264400b420 tx=0x7f264400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644011830 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2644011990 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644011d40 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26500ca230 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.603+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26500ca7f0 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.604+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26500cacf0 con 0x7f2650153850 2023-08-10T10:45:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.605+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f264401b460 con 0x7f2650153850 2023-08-10T10:45:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.606+0000 7f264cff9640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 0x7f263c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.607+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2644089110 con 0x7f2650153850 2023-08-10T10:45:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.607+0000 7f264ffff640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 0x7f263c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.608+0000 7f264ffff640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 0x7f263c06d110 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f26400075b0 tx=0x7f2640007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:06.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.612+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2644054120 con 0x7f2650153850 2023-08-10T10:45:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.806+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2650066e30 con 0x7f2650153850 2023-08-10T10:45:06.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.808+0000 7f264cff9640 1 -- 172.21.15.50:0/1243637740 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+36942 (secure 0 0 0) 0x7f2644057740 con 0x7f2650153850 2023-08-10T10:45:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 116, 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:45:05.829051+0000", 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:45:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:45:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 14, 2023-08-10T10:45:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:45:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:45:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:45:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:45:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 13, 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.361887+0000", 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:45:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.846 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 14, 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:44:34.998347+0000", 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:45:06.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:45:06.848 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:45:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:45:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:45:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:45:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:45:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:45:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:45:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:45:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:45:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:45:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:45:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:45:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:06.878 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.879 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.883 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:45:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:45:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:45:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:45:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:45:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.910 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:45:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:45:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:45:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:45:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:45:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 108, 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:45:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:45:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:45:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:45:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:45:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:45:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:45:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:45:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:45:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:45:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:45:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 msgr2=0x7f263c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 0x7f263c06d110 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f26400075b0 tx=0x7f2640007540 comp rx=0 tx=0).stop 2023-08-10T10:45:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 msgr2=0x7f26500c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f264400b420 tx=0x7f264400b8e0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 shutdown_connections 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2650153c30 0x7f265014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650153850 0x7f26500c83f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263c06ac50 0x7f263c06d110 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 --2- 172.21.15.50:0/1243637740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26500cfd40 0x7f26500c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 >> 172.21.15.50:0/1243637740 conn(0x7f2650069880 msgr2=0x7f26500cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 shutdown_connections 2023-08-10T10:45:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:06.811+0000 7f26551f1640 1 -- 172.21.15.50:0/1243637740 wait complete. 2023-08-10T10:45:06.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.191+0000 7fead5008640 1 Processor -- start 2023-08-10T10:45:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.191+0000 7fead5008640 1 -- start start 2023-08-10T10:45:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7fead5008640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fead00c9d00 0x7fead00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7fead5008640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00cc5a0 con 0x7fead0159830 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7fead5008640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead015d720 con 0x7fead00cd290 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7fead5008640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00b4170 con 0x7fead00c9d00 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7feacf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fead00c9d00 0x7fead00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7feacf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fead00c9d00 0x7fead00cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48742/0 (socket says 172.21.15.50:48742) 2023-08-10T10:45:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.193+0000 7feacf7fe640 1 -- 172.21.15.50:0/2247735735 learned_addr learned my addr 172.21.15.50:0/2247735735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.194+0000 7feacf7fe640 1 -- 172.21.15.50:0/2247735735 >> v1:172.21.15.117:6789/0 conn(0x7fead00cd290 legacy=0x7fead00cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.194+0000 7feacf7fe640 1 -- 172.21.15.50:0/2247735735 >> v1:172.21.15.50:6789/0 conn(0x7fead0159830 legacy=0x7fead015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.194+0000 7feacf7fe640 1 -- 172.21.15.50:0/2247735735 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0159c10 con 0x7fead00c9d00 2023-08-10T10:45:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.195+0000 7feacf7fe640 1 --2- 172.21.15.50:0/2247735735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead00cc060 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7feac400bb10 tx=0x7feac402e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121ee9ba0e8a1201 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.195+0000 7feaceffd640 1 -- 172.21.15.50:0/2247735735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4036440 con 0x7fead00c9d00 2023-08-10T10:45:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.195+0000 7feaceffd640 1 -- 172.21.15.50:0/2247735735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac40365a0 con 0x7fead00c9d00 2023-08-10T10:45:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.195+0000 7feaceffd640 1 -- 172.21.15.50:0/2247735735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4036930 con 0x7fead00c9d00 2023-08-10T10:45:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 -- 172.21.15.50:0/2247735735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 msgr2=0x7fead00cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 --2- 172.21.15.50:0/2247735735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead00cc060 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7feac400bb10 tx=0x7feac402e160 comp rx=0 tx=0).stop 2023-08-10T10:45:07.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 -- 172.21.15.50:0/2247735735 shutdown_connections 2023-08-10T10:45:07.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 --2- 172.21.15.50:0/2247735735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead00cc060 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 -- 172.21.15.50:0/2247735735 >> 172.21.15.50:0/2247735735 conn(0x7fead006ab80 msgr2=0x7fead006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:07.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 -- 172.21.15.50:0/2247735735 shutdown_connections 2023-08-10T10:45:07.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.196+0000 7fead5008640 1 -- 172.21.15.50:0/2247735735 wait complete. 2023-08-10T10:45:07.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.198+0000 7fead5008640 1 Processor -- start 2023-08-10T10:45:07.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.198+0000 7fead5008640 1 -- start start 2023-08-10T10:45:07.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cd290 0x7fead00706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead0159830 0x7fead015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015cd00 con 0x7fead00c9d00 2023-08-10T10:45:07.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015c7d0 con 0x7fead0159830 2023-08-10T10:45:07.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7fead5008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0070c00 con 0x7fead00cd290 2023-08-10T10:45:07.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7feacffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7feacffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48756/0 (socket says 172.21.15.50:48756) 2023-08-10T10:45:07.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.199+0000 7feacffff640 1 -- 172.21.15.50:0/1975437990 learned_addr learned my addr 172.21.15.50:0/1975437990 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:07.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 -- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cd290 msgr2=0x7fead00706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cd290 0x7fead00706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 -- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead0159830 msgr2=0x7fead015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead0159830 0x7fead015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 -- 172.21.15.50:0/1975437990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac400b770 con 0x7fead00c9d00 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feacffff640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7feac000c450 tx=0x7feac000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00052d0 con 0x7fead00c9d00 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0005430 con 0x7fead00c9d00 2023-08-10T10:45:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.200+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0012870 con 0x7fead00c9d00 2023-08-10T10:45:07.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.201+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead015ca20 con 0x7fead00c9d00 2023-08-10T10:45:07.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.201+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead006eb80 con 0x7fead00c9d00 2023-08-10T10:45:07.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.202+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead006e700 con 0x7fead00c9d00 2023-08-10T10:45:07.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.203+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feac00129d0 con 0x7fead00c9d00 2023-08-10T10:45:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.204+0000 7feaccff9640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 0x7feabc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.204+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feac00890a0 con 0x7fead00c9d00 2023-08-10T10:45:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.204+0000 7feacf7fe640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 0x7feabc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.205+0000 7feacf7fe640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 0x7feabc06d110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feac4038000 tx=0x7feac4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.208+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fead006e700 con 0x7fead00c9d00 2023-08-10T10:45:07.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.435+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fead006e700 con 0x7fead00c9d00 2023-08-10T10:45:07.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.437+0000 7feaccff9640 1 -- 172.21.15.50:0/1975437990 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fead006e700 con 0x7fead00c9d00 2023-08-10T10:45:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:45:07.438 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:45:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 msgr2=0x7feabc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 0x7feabc06d110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feac4038000 tx=0x7feac4008040 comp rx=0 tx=0).stop 2023-08-10T10:45:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 msgr2=0x7fead0070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7feac000c450 tx=0x7feac000c910 comp rx=0 tx=0).stop 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 shutdown_connections 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feabc06ac50 0x7feabc06d110 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fead0159830 0x7fead015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fead00cd290 0x7fead00706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 --2- 172.21.15.50:0/1975437990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead00c9d00 0x7fead0070180 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.439+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 >> 172.21.15.50:0/1975437990 conn(0x7fead006ab80 msgr2=0x7fead0156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.440+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 shutdown_connections 2023-08-10T10:45:07.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:07.440+0000 7fead5008640 1 -- 172.21.15.50:0/1975437990 wait complete. 2023-08-10T10:45:07.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-10T10:45:07.702 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":5833,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.195030791000001,"mdsmap_epoch":51,"osdmap_epoch":116,"osdmap_epoch_barrier":113,"uptime":36.998861785000003} 2023-08-10T10:45:07.703 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 5833, "mdsmap_epoch": 51, "osdmap_epoch": 116, "osdmap_epoch_barrier": 113, "rank_uptime": 31.195030791, "state": "up:active", "uptime": 36.998861785, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:45:07.704 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:45:07.704 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:07.705 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:07.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:07.771 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-10T10:45:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:45:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:45:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.395786 s, 132 MB/s 2023-08-10T10:45:08.231 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:45:08.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:08.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:08.456 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:45:08.457 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:08.458 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:08.523 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:08.524 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:08.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.778+0000 7fadcaa71640 1 Processor -- start 2023-08-10T10:45:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.779+0000 7fadcaa71640 1 -- start start 2023-08-10T10:45:08.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.780+0000 7fadcaa71640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fadc40b0620 0x7fadc40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.780+0000 7fadcaa71640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc41604d0 con 0x7fadc41600f0 2023-08-10T10:45:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.780+0000 7fadcaa71640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc40cca30 con 0x7fadc41646f0 2023-08-10T10:45:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.780+0000 7fadcaa71640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc40cc100 con 0x7fadc40b0620 2023-08-10T10:45:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.781+0000 7fadc9a6f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fadc41600f0 0x7fadc40aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38220/0 (socket says 172.21.15.50:38220) 2023-08-10T10:45:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.781+0000 7fadc9a6f640 1 -- 172.21.15.50:0/4044638294 learned_addr learned my addr 172.21.15.50:0/4044638294 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.781+0000 7fadc926e640 1 --2- 172.21.15.50:0/4044638294 >> v2:172.21.15.117:3300/0 conn(0x7fadc40b0620 0x7fadc40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.781+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892609995 0 0) 0x7fadc41604d0 con 0x7fadc41600f0 2023-08-10T10:45:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.781+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb0003520 con 0x7fadc41600f0 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656703021 0 0) 0x7fadb0003520 con 0x7fadc41600f0 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 >> v2:172.21.15.117:3300/0 conn(0x7fadc40b0620 msgr2=0x7fadc40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 --2- 172.21.15.50:0/4044638294 >> v2:172.21.15.117:3300/0 conn(0x7fadc40b0620 0x7fadc40ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 >> v1:172.21.15.117:6789/0 conn(0x7fadc41646f0 legacy=0x7fadc4166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc40cc3e0 con 0x7fadc41600f0 2023-08-10T10:45:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fadc0001670 con 0x7fadc41600f0 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 >> v1:172.21.15.50:6789/0 conn(0x7fadc41600f0 legacy=0x7fadc40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 0x7fadb0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00047c0 0x7fadb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb00051f0 0x7fadb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40cc100 con 0x7fadb00039e0 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb000c150 con 0x7fadb00047c0 2023-08-10T10:45:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb000c310 con 0x7fadb00051f0 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.782+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 0x7fadb0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc926e640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00047c0 0x7fadb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadca270640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb00051f0 0x7fadb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc9a6f640 1 -- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb00051f0 msgr2=0x7fadb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadb00051f0 0x7fadb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc9a6f640 1 -- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00047c0 msgr2=0x7fadb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00047c0 0x7fadb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc9a6f640 1 -- 172.21.15.50:0/4044638294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0003520 con 0x7fadb00039e0 2023-08-10T10:45:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadc926e640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00047c0 0x7fadb0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.783+0000 7fadca270640 1 -- 172.21.15.50:0/4044638294 reap_dead start 2023-08-10T10:45:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 0x7fadb0003e00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c240 tx=0x7fadb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8e445a581b7839 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0005ad0 con 0x7fadb00039e0 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0005c30 con 0x7fadb00039e0 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadc8a6d640 1 -- 172.21.15.50:0/4044638294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc002ca50 con 0x7fadb00039e0 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadcaa71640 1 -- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 msgr2=0x7fadb0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.785+0000 7fadcaa71640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 0x7fadb0003e00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c240 tx=0x7fadb00057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.786+0000 7fadcaa71640 1 -- 172.21.15.50:0/4044638294 shutdown_connections 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.786+0000 7fadcaa71640 1 --2- 172.21.15.50:0/4044638294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadb00039e0 0x7fadb0003e00 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.786+0000 7fadcaa71640 1 -- 172.21.15.50:0/4044638294 >> 172.21.15.50:0/4044638294 conn(0x7fadc406ab80 msgr2=0x7fadc406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.786+0000 7fadcaa71640 1 -- 172.21.15.50:0/4044638294 shutdown_connections 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.786+0000 7fadcaa71640 1 -- 172.21.15.50:0/4044638294 wait complete. 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.788+0000 7fadcaa71640 1 Processor -- start 2023-08-10T10:45:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.788+0000 7fadcaa71640 1 -- start start 2023-08-10T10:45:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 0x7fadc40af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadc414b750 0x7fadc41f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc41f6560 con 0x7fadc4151fc0 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc4152990 con 0x7fadb00039e0 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadcaa71640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40c82c0 con 0x7fadc414b750 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48784/0 (socket says 172.21.15.50:48784) 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 -- 172.21.15.50:0/2171110856 learned_addr learned my addr 172.21.15.50:0/2171110856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 0x7fadc40af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadc926e640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadc414b750 0x7fadc41f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 -- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadc414b750 msgr2=0x7fadc41f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadc414b750 0x7fadc41f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 -- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 msgr2=0x7fadc40af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 0x7fadc40af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadca270640 1 -- 172.21.15.50:0/2171110856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc40aeb70 con 0x7fadc4151fc0 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.789+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 0x7fadc40af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadca270640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fadbc007fd0 tx=0x7fadbc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003970 con 0x7fadc4151fc0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc003af0 con 0x7fadc4151fc0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc40aee50 con 0x7fadc4151fc0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003ea0 con 0x7fadc4151fc0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.790+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc40ae470 con 0x7fadc4151fc0 2023-08-10T10:45:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.791+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc40af370 con 0x7fadc4151fc0 2023-08-10T10:45:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.792+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadbc0050d0 con 0x7fadc4151fc0 2023-08-10T10:45:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.793+0000 7fadb67fc640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 0x7fada806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.793+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadbc089310 con 0x7fadc4151fc0 2023-08-10T10:45:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.794+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 0x7fada806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.794+0000 7fadc9a6f640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 0x7fada806d110 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:08.797+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fadc40af370 con 0x7fadc4151fc0 2023-08-10T10:45:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.003+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc40af370 con 0x7fadc4151fc0 2023-08-10T10:45:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.007+0000 7fadb67fc640 1 -- 172.21.15.50:0/2171110856 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+18489 (secure 0 0 0) 0x7fadc40af370 con 0x7fadc4151fc0 2023-08-10T10:45:09.009 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:09.009 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":117,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:08.857779+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.009+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 msgr2=0x7fada806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.009+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 0x7fada806d110 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc0009030 comp rx=0 tx=0).stop 2023-08-10T10:45:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.009+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 msgr2=0x7fadc4152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.009+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fadbc007fd0 tx=0x7fadbc00eb90 comp rx=0 tx=0).stop 2023-08-10T10:45:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 shutdown_connections 2023-08-10T10:45:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc4151fc0 0x7fadc4152450 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadc414b750 0x7fadc41f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fada806ac50 0x7fada806d110 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 --2- 172.21.15.50:0/2171110856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadb00039e0 0x7fadc40af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 >> 172.21.15.50:0/2171110856 conn(0x7fadc406ab80 msgr2=0x7fadc40c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 shutdown_connections 2023-08-10T10:45:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.010+0000 7fadcaa71640 1 -- 172.21.15.50:0/2171110856 wait complete. 2023-08-10T10:45:09.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:44:34.361887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:44:34.998347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:09.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.252+0000 7f5802fcb640 1 Processor -- start 2023-08-10T10:45:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.252+0000 7f5802fcb640 1 -- start start 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5802fcb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57fc0cdc60 0x7f57fc0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5802fcb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc0c9a20 con 0x7f57fc161070 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5802fcb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc164bf0 con 0x7f57fc0b0610 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5802fcb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc0ce0f0 con 0x7f57fc0cdc60 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5801fc9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57fc161070 0x7f57fc0aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38222/0 (socket says 172.21.15.50:38222) 2023-08-10T10:45:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.254+0000 7f5801fc9640 1 -- 172.21.15.50:0/3823166641 learned_addr learned my addr 172.21.15.50:0/3823166641 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998724218 0 0) 0x7f57fc0c9a20 con 0x7f57fc161070 2023-08-10T10:45:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f58027ca640 1 --2- 172.21.15.50:0/3823166641 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0cdc60 0x7f57fc0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8003520 con 0x7f57fc161070 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234908946 0 0) 0x7f57e8003520 con 0x7f57fc161070 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0cdc60 msgr2=0x7f57fc0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 --2- 172.21.15.50:0/3823166641 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0cdc60 0x7f57fc0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 >> v1:172.21.15.117:6789/0 conn(0x7f57fc0b0610 legacy=0x7f57fc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc164e40 con 0x7f57fc161070 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.255+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f57f8001670 con 0x7f57fc161070 2023-08-10T10:45:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 >> v1:172.21.15.50:6789/0 conn(0x7f57fc161070 legacy=0x7f57fc0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e80039e0 0x7f57e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e8005180 0x7f57e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0ce0f0 con 0x7f57e80047c0 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800c0b0 con 0x7f57e80039e0 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800c270 con 0x7f57e8005180 2023-08-10T10:45:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f5801fc9640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e80039e0 0x7f57e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58027ca640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e8005180 0x7f57e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 -- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e8005180 msgr2=0x7f57e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e8005180 0x7f57e800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 -- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e80039e0 msgr2=0x7f57e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e80039e0 0x7f57e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58017c8640 1 -- 172.21.15.50:0/3823166641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8003520 con 0x7f57e80047c0 2023-08-10T10:45:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.256+0000 7f58027ca640 1 -- 172.21.15.50:0/3823166641 reap_dead start 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f58017c8640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 0x7f57e8004c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f57ec001750 tx=0x7f57e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb91c0adcde7984 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0052d0 con 0x7f57e80047c0 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec02e050 con 0x7f57e80047c0 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5800fc7640 1 -- 172.21.15.50:0/3823166641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec003830 con 0x7f57e80047c0 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5802fcb640 1 -- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 msgr2=0x7f57e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 0x7f57e8004c40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f57ec001750 tx=0x7f57e80057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5802fcb640 1 -- 172.21.15.50:0/3823166641 shutdown_connections 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3823166641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.258+0000 7f5802fcb640 1 -- 172.21.15.50:0/3823166641 >> 172.21.15.50:0/3823166641 conn(0x7f57fc069cd0 msgr2=0x7f57fc0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.259+0000 7f5802fcb640 1 -- 172.21.15.50:0/3823166641 shutdown_connections 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.259+0000 7f5802fcb640 1 -- 172.21.15.50:0/3823166641 wait complete. 2023-08-10T10:45:09.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.260+0000 7f5802fcb640 1 Processor -- start 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.261+0000 7f5802fcb640 1 -- start start 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.261+0000 7f5802fcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e80047c0 0x7f57fc0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.261+0000 7f5802fcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc0c5550 0x7f57fc0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f5802fcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f5802fcb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0c5f10 con 0x7f57fc14a700 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f5802fcb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0c3f80 con 0x7f57fc0c5550 2023-08-10T10:45:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f5802fcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0c4950 con 0x7f57e80047c0 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48806/0 (socket says 172.21.15.50:48806) 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 -- 172.21.15.50:0/3340811630 learned_addr learned my addr 172.21.15.50:0/3340811630 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58017c8640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc0c5550 0x7f57fc0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f5801fc9640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e80047c0 0x7f57fc0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 -- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e80047c0 msgr2=0x7f57fc0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e80047c0 0x7f57fc0c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 -- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc0c5550 msgr2=0x7f57fc0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc0c5550 0x7f57fc0c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.262+0000 7f58027ca640 1 -- 172.21.15.50:0/3340811630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc0c3370 con 0x7f57fc14a700 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f58027ca640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f57fc071e60 tx=0x7f57f400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4016620 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40167a0 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4016b50 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0c3650 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.263+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc0c3c10 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.265+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc066e30 con 0x7f57fc14a700 2023-08-10T10:45:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.265+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57f4016cb0 con 0x7f57fc14a700 2023-08-10T10:45:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.266+0000 7f57f27fc640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 0x7f57e006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.267+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f57f408a170 con 0x7f57fc14a700 2023-08-10T10:45:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.267+0000 7f5801fc9640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 0x7f57e006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.267+0000 7f5801fc9640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 0x7f57e006d140 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001050 tx=0x7f57f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.270+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f57f4058cc0 con 0x7f57fc14a700 2023-08-10T10:45:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.463+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57fc0c40c0 con 0x7f57fc14a700 2023-08-10T10:45:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.463+0000 7f57f27fc640 1 -- 172.21.15.50:0/3340811630 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57f4058850 con 0x7f57fc14a700 2023-08-10T10:45:09.465 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 msgr2=0x7f57e006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 0x7f57e006d140 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001050 tx=0x7f57f8009040 comp rx=0 tx=0).stop 2023-08-10T10:45:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 msgr2=0x7f57fc14ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f57fc071e60 tx=0x7f57f400f520 comp rx=0 tx=0).stop 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 shutdown_connections 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57fc14a700 0x7f57fc14ab80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f57e006ac80 0x7f57e006d140 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc0c5550 0x7f57fc0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 --2- 172.21.15.50:0/3340811630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57e80047c0 0x7f57fc0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.466+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 >> 172.21.15.50:0/3340811630 conn(0x7f57fc069cd0 msgr2=0x7f57fc0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.467+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 shutdown_connections 2023-08-10T10:45:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.467+0000 7f5802fcb640 1 -- 172.21.15.50:0/3340811630 wait complete. 2023-08-10T10:45:09.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.718+0000 7fed67677640 1 Processor -- start 2023-08-10T10:45:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.718+0000 7fed67677640 1 -- start start 2023-08-10T10:45:09.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.720+0000 7fed67677640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed600b5f00 0x7fed600b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.720+0000 7fed67677640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600d0bf0 con 0x7fed600cf1e0 2023-08-10T10:45:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.720+0000 7fed67677640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600b68a0 con 0x7fed6015cde0 2023-08-10T10:45:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.720+0000 7fed67677640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600ce320 con 0x7fed600b5f00 2023-08-10T10:45:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.721+0000 7fed65c14640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed600cf1e0 0x7fed600cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38238/0 (socket says 172.21.15.50:38238) 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.721+0000 7fed65c14640 1 -- 172.21.15.50:0/3110874372 learned_addr learned my addr 172.21.15.50:0/3110874372 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.721+0000 7fed64c12640 1 --2- 172.21.15.50:0/3110874372 >> v2:172.21.15.117:3300/0 conn(0x7fed600b5f00 0x7fed600b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.721+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262409470 0 0) 0x7fed600d0bf0 con 0x7fed600cf1e0 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.721+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed4c003520 con 0x7fed600cf1e0 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348657718 0 0) 0x7fed4c003520 con 0x7fed600cf1e0 2023-08-10T10:45:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 >> v2:172.21.15.117:3300/0 conn(0x7fed600b5f00 msgr2=0x7fed600b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 --2- 172.21.15.50:0/3110874372 >> v2:172.21.15.117:3300/0 conn(0x7fed600b5f00 0x7fed600b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 >> v1:172.21.15.117:6789/0 conn(0x7fed6015cde0 legacy=0x7fed600d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600d0e40 con 0x7fed600cf1e0 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fed58001670 con 0x7fed600cf1e0 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 >> v1:172.21.15.50:6789/0 conn(0x7fed600cf1e0 legacy=0x7fed600cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0047c0 0x7fed4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c005180 0x7fed4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600ce320 con 0x7fed4c003970 2023-08-10T10:45:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c00c120 con 0x7fed4c005180 2023-08-10T10:45:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c00c2e0 con 0x7fed4c0047c0 2023-08-10T10:45:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.722+0000 7fed65413640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed64c12640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0047c0 0x7fed4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65413640 1 -- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0047c0 msgr2=0x7fed4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65413640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4c0047c0 0x7fed4c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65c14640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c005180 0x7fed4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65413640 1 -- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c005180 msgr2=0x7fed4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65413640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c005180 0x7fed4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65413640 1 -- 172.21.15.50:0/3110874372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c003520 con 0x7fed4c003970 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65c14640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4c005180 0x7fed4c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.723+0000 7fed65c14640 1 -- 172.21.15.50:0/3110874372 reap_dead start 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.724+0000 7fed65413640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed4c003d90 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fed5c001e50 tx=0x7fed4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fc0ed49873ae1c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.724+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c003b70 con 0x7fed4c003970 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.724+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c003cd0 con 0x7fed4c003970 2023-08-10T10:45:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.724+0000 7fed57fff640 1 -- 172.21.15.50:0/3110874372 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c005310 con 0x7fed4c003970 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 -- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 msgr2=0x7fed4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed4c003d90 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fed5c001e50 tx=0x7fed4c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 -- 172.21.15.50:0/3110874372 shutdown_connections 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 --2- 172.21.15.50:0/3110874372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed4c003d90 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 -- 172.21.15.50:0/3110874372 >> 172.21.15.50:0/3110874372 conn(0x7fed6006fcc0 msgr2=0x7fed600700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 -- 172.21.15.50:0/3110874372 shutdown_connections 2023-08-10T10:45:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.725+0000 7fed67677640 1 -- 172.21.15.50:0/3110874372 wait complete. 2023-08-10T10:45:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.727+0000 7fed67677640 1 Processor -- start 2023-08-10T10:45:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.727+0000 7fed67677640 1 -- start start 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 0x7fed60156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 0x7fed601566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c9bc0 con 0x7fed4c003970 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c9ea0 con 0x7fed600a9920 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed67677640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60156bf0 con 0x7fed600a94c0 2023-08-10T10:45:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed65413640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed65413640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48814/0 (socket says 172.21.15.50:48814) 2023-08-10T10:45:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.728+0000 7fed65413640 1 -- 172.21.15.50:0/1828954075 learned_addr learned my addr 172.21.15.50:0/1828954075 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed64c12640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 0x7fed60156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65c14640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 0x7fed601566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 -- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 msgr2=0x7fed60156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 0x7fed60156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 -- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 msgr2=0x7fed601566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 0x7fed601566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 -- 172.21.15.50:0/1828954075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600a9ef0 con 0x7fed4c003970 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed64c12640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 0x7fed60156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65c14640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 0x7fed601566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.729+0000 7fed65413640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fed5c02c040 tx=0x7fed5c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.730+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c03e070 con 0x7fed4c003970 2023-08-10T10:45:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.730+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c006b50 con 0x7fed4c003970 2023-08-10T10:45:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.730+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c007020 con 0x7fed4c003970 2023-08-10T10:45:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.730+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600aa1d0 con 0x7fed4c003970 2023-08-10T10:45:09.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.730+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed60156fa0 con 0x7fed4c003970 2023-08-10T10:45:09.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.731+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60157130 con 0x7fed4c003970 2023-08-10T10:45:09.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.732+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed5c007180 con 0x7fed4c003970 2023-08-10T10:45:09.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.733+0000 7fed55ffb640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 0x7fed4406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:09.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.733+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fed5c0aae50 con 0x7fed4c003970 2023-08-10T10:45:09.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.733+0000 7fed64c12640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 0x7fed4406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:09.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.734+0000 7fed64c12640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 0x7fed4406d140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fed6015c1a0 tx=0x7fed50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:09.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.738+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed5c075e70 con 0x7fed4c003970 2023-08-10T10:45:09.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.936+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed600c9ba0 con 0x7fed4c003970 2023-08-10T10:45:09.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.937+0000 7fed55ffb640 1 -- 172.21.15.50:0/1828954075 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed5c048020 con 0x7fed4c003970 2023-08-10T10:45:09.939 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 msgr2=0x7fed4406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 0x7fed4406d140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fed6015c1a0 tx=0x7fed50008040 comp rx=0 tx=0).stop 2023-08-10T10:45:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 msgr2=0x7fed600ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fed5c02c040 tx=0x7fed5c0014a0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 shutdown_connections 2023-08-10T10:45:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed4406ac80 0x7fed4406d140 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed600a9920 0x7fed601566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed600a94c0 0x7fed60156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 --2- 172.21.15.50:0/1828954075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed4c003970 0x7fed600ab3c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.940+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 >> 172.21.15.50:0/1828954075 conn(0x7fed6006fcc0 msgr2=0x7fed60157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.941+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 shutdown_connections 2023-08-10T10:45:09.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:09.941+0000 7fed67677640 1 -- 172.21.15.50:0/1828954075 wait complete. 2023-08-10T10:45:09.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:45:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.195+0000 7ff7a8863640 1 Processor -- start 2023-08-10T10:45:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.195+0000 7ff7a8863640 1 -- start start 2023-08-10T10:45:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.196+0000 7ff7a8863640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7a40696a0 0x7ff7a4069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.196+0000 7ff7a8863640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a8863640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a415aee0 con 0x7ff7a41583c0 2023-08-10T10:45:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a8863640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a406a070 con 0x7ff7a40696a0 2023-08-10T10:45:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a8863640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40b2100 con 0x7ff7a415e4d0 2023-08-10T10:45:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7a41583c0 0x7ff7a40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38246/0 (socket says 172.21.15.50:38246) 2023-08-10T10:45:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a37fe640 1 -- 172.21.15.50:0/2157809141 learned_addr learned my addr 172.21.15.50:0/2157809141 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/2157809141 >> v2:172.21.15.117:3300/0 conn(0x7ff7a40696a0 0x7ff7a4069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.197+0000 7ff7a3fff640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a27fc640 1 -- 172.21.15.50:0/2157809141 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781964626 0 0) 0x7ff7a415aee0 con 0x7ff7a41583c0 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a27fc640 1 -- 172.21.15.50:0/2157809141 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78c003520 con 0x7ff7a41583c0 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a2ffd640 1 -- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 msgr2=0x7ff7a415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a2ffd640 1 -- 172.21.15.50:0/2157809141 >> v1:172.21.15.50:6789/0 conn(0x7ff7a41583c0 legacy=0x7ff7a40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.198+0000 7ff7a2ffd640 1 -- 172.21.15.50:0/2157809141 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a415b1a0 con 0x7ff7a40696a0 2023-08-10T10:45:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.199+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a40696a0 0x7ff7a4069b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097a0 tx=0x7ff79802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b3efb7afafe115 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.200+0000 7ff7a27fc640 1 -- 172.21.15.50:0/2157809141 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79802d040 con 0x7ff7a40696a0 2023-08-10T10:45:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.200+0000 7ff7a27fc640 1 -- 172.21.15.50:0/2157809141 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798031810 con 0x7ff7a40696a0 2023-08-10T10:45:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.200+0000 7ff7a27fc640 1 -- 172.21.15.50:0/2157809141 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798031ba0 con 0x7ff7a40696a0 2023-08-10T10:45:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 -- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a40696a0 msgr2=0x7ff7a4069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a40696a0 0x7ff7a4069b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097a0 tx=0x7ff79802b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 -- 172.21.15.50:0/2157809141 shutdown_connections 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a40696a0 0x7ff7a4069b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 --2- 172.21.15.50:0/2157809141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 -- 172.21.15.50:0/2157809141 >> 172.21.15.50:0/2157809141 conn(0x7ff7a40caf80 msgr2=0x7ff7a40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 -- 172.21.15.50:0/2157809141 shutdown_connections 2023-08-10T10:45:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.201+0000 7ff7a8863640 1 -- 172.21.15.50:0/2157809141 wait complete. 2023-08-10T10:45:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.203+0000 7ff7a8863640 1 Processor -- start 2023-08-10T10:45:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.203+0000 7ff7a8863640 1 -- start start 2023-08-10T10:45:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a41583c0 0x7ff7a41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a41f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4159220 con 0x7ff7a40696a0 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4159500 con 0x7ff7a41583c0 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a8863640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a41597e0 con 0x7ff7a415e4d0 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48830/0 (socket says 172.21.15.50:48830) 2023-08-10T10:45:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a37fe640 1 -- 172.21.15.50:0/4051470687 learned_addr learned my addr 172.21.15.50:0/4051470687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a41583c0 0x7ff7a41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.204+0000 7ff7a3fff640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a41f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 -- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 msgr2=0x7ff7a41f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a41f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 -- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a41583c0 msgr2=0x7ff7a41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a41583c0 0x7ff7a41587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 -- 172.21.15.50:0/4051470687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009400 con 0x7ff7a40696a0 2023-08-10T10:45:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a37fe640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cbb0 tx=0x7ff79400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400ad40 con 0x7ff7a40696a0 2023-08-10T10:45:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794012400 con 0x7ff7a40696a0 2023-08-10T10:45:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400aea0 con 0x7ff7a40696a0 2023-08-10T10:45:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.205+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a4159ac0 con 0x7ff7a40696a0 2023-08-10T10:45:10.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.206+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40cc720 con 0x7ff7a40696a0 2023-08-10T10:45:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.207+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a40cad80 con 0x7ff7a40696a0 2023-08-10T10:45:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.208+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff794007070 con 0x7ff7a40696a0 2023-08-10T10:45:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.208+0000 7ff78bfff640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 0x7ff79006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.209+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff794089480 con 0x7ff7a40696a0 2023-08-10T10:45:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.209+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 0x7ff79006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.210+0000 7ff7a2ffd640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 0x7ff79006d140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff798036000 tx=0x7ff79803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.213+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff794054550 con 0x7ff7a40696a0 2023-08-10T10:45:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.407+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7a4159fe0 con 0x7ff7a40696a0 2023-08-10T10:45:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.408+0000 7ff78bfff640 1 -- 172.21.15.50:0/4051470687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff794057b70 con 0x7ff7a40696a0 2023-08-10T10:45:10.410 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:45:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.410+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 msgr2=0x7ff79006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.410+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 0x7ff79006d140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff798036000 tx=0x7ff79803c040 comp rx=0 tx=0).stop 2023-08-10T10:45:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.410+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 msgr2=0x7ff7a40c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.410+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cbb0 tx=0x7ff79400a430 comp rx=0 tx=0).stop 2023-08-10T10:45:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 shutdown_connections 2023-08-10T10:45:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7a415e4d0 0x7ff7a41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff79006ac80 0x7ff79006d140 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7a41583c0 0x7ff7a41587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 --2- 172.21.15.50:0/4051470687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40696a0 0x7ff7a40c9df0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 >> 172.21.15.50:0/4051470687 conn(0x7ff7a40caf80 msgr2=0x7ff7a415e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 shutdown_connections 2023-08-10T10:45:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.411+0000 7ff7a8863640 1 -- 172.21.15.50:0/4051470687 wait complete. 2023-08-10T10:45:10.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:45:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.661+0000 7fad35f08640 1 Processor -- start 2023-08-10T10:45:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.662+0000 7fad35f08640 1 -- start start 2023-08-10T10:45:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.663+0000 7fad35f08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad300ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.663+0000 7fad35f08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad300696a0 0x7fad30069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.663+0000 7fad35f08640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad300cdb20 con 0x7fad30161360 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad35f08640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3006a070 con 0x7fad300696a0 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad35f08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300cde00 con 0x7fad3015ca80 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad35707640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad300696a0 0x7fad30069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad35707640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad300696a0 0x7fad30069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48832/0 (socket says 172.21.15.50:48832) 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad35707640 1 -- 172.21.15.50:0/865280622 learned_addr learned my addr 172.21.15.50:0/865280622 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad2ffff640 1 --1- 172.21.15.50:0/865280622 >> v1:172.21.15.50:6789/0 conn(0x7fad30161360 0x7fad300cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38252/0 (socket says 172.21.15.50:38252) 2023-08-10T10:45:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.664+0000 7fad34f06640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad300ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad35707640 1 -- 172.21.15.50:0/865280622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 msgr2=0x7fad300ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad35707640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad300ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad35707640 1 -- 172.21.15.50:0/865280622 >> v1:172.21.15.50:6789/0 conn(0x7fad30161360 legacy=0x7fad300cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad35707640 1 -- 172.21.15.50:0/865280622 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300cc0d0 con 0x7fad300696a0 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad34f06640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad300ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.665+0000 7fad2f7fe640 1 -- 172.21.15.50:0/865280622 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818859492 0 0) 0x7fad300cdb20 con 0x7fad30161360 2023-08-10T10:45:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.666+0000 7fad35707640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad300696a0 0x7fad30069b30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fad28009e50 tx=0x7fad2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9bf4c869580b7d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.666+0000 7fad2f7fe640 1 -- 172.21.15.50:0/865280622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2802cb00 con 0x7fad300696a0 2023-08-10T10:45:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.666+0000 7fad2f7fe640 1 -- 172.21.15.50:0/865280622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2802cc60 con 0x7fad300696a0 2023-08-10T10:45:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.666+0000 7fad2f7fe640 1 -- 172.21.15.50:0/865280622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280343f0 con 0x7fad300696a0 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 -- 172.21.15.50:0/865280622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad300696a0 msgr2=0x7fad30069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad300696a0 0x7fad30069b30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fad28009e50 tx=0x7fad2802bf60 comp rx=0 tx=0).stop 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 -- 172.21.15.50:0/865280622 shutdown_connections 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad300696a0 0x7fad30069b30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 --2- 172.21.15.50:0/865280622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad300ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 -- 172.21.15.50:0/865280622 >> 172.21.15.50:0/865280622 conn(0x7fad300caf80 msgr2=0x7fad300cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 -- 172.21.15.50:0/865280622 shutdown_connections 2023-08-10T10:45:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.667+0000 7fad35f08640 1 -- 172.21.15.50:0/865280622 wait complete. 2023-08-10T10:45:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.669+0000 7fad35f08640 1 Processor -- start 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.669+0000 7fad35f08640 1 -- start start 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad300696a0 0x7fad3015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad30158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015e370 con 0x7fad30161360 2023-08-10T10:45:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015d760 con 0x7fad300696a0 2023-08-10T10:45:10.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.670+0000 7fad35f08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015da40 con 0x7fad3015ca80 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48840/0 (socket says 172.21.15.50:48840) 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 -- 172.21.15.50:0/3573881190 learned_addr learned my addr 172.21.15.50:0/3573881190 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad34f06640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad300696a0 0x7fad3015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad2ffff640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad30158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 -- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 msgr2=0x7fad30158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad30158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 -- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad300696a0 msgr2=0x7fad3015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad300696a0 0x7fad3015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.671+0000 7fad35707640 1 -- 172.21.15.50:0/3573881190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009b30 con 0x7fad30161360 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad35707640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fad28009e50 tx=0x7fad28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28009510 con 0x7fad30161360 2023-08-10T10:45:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2803e450 con 0x7fad30161360 2023-08-10T10:45:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2803e800 con 0x7fad30161360 2023-08-10T10:45:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3015dd20 con 0x7fad30161360 2023-08-10T10:45:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.672+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad30070910 con 0x7fad30161360 2023-08-10T10:45:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.673+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3015e4e0 con 0x7fad30161360 2023-08-10T10:45:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.674+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad2803e960 con 0x7fad30161360 2023-08-10T10:45:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.675+0000 7fad2d7fa640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 0x7fad1406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.675+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fad280ac3b0 con 0x7fad30161360 2023-08-10T10:45:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.675+0000 7fad34f06640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 0x7fad1406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.676+0000 7fad34f06640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 0x7fad1406d110 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fad24006fd0 tx=0x7fad24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.679+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad28077340 con 0x7fad30161360 2023-08-10T10:45:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.872+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad30066e30 con 0x7fad30161360 2023-08-10T10:45:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.873+0000 7fad2d7fa640 1 -- 172.21.15.50:0/3573881190 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad2807a960 con 0x7fad30161360 2023-08-10T10:45:10.875 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:45:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 msgr2=0x7fad1406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 0x7fad1406d110 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fad24006fd0 tx=0x7fad24008040 comp rx=0 tx=0).stop 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 msgr2=0x7fad300c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fad28009e50 tx=0x7fad28004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 shutdown_connections 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30161360 0x7fad300c5b20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad3015ca80 0x7fad30158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fad1406ac50 0x7fad1406d110 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 --2- 172.21.15.50:0/3573881190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad300696a0 0x7fad3015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 >> 172.21.15.50:0/3573881190 conn(0x7fad300caf80 msgr2=0x7fad300ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 shutdown_connections 2023-08-10T10:45:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:10.876+0000 7fad35f08640 1 -- 172.21.15.50:0/3573881190 wait complete. 2023-08-10T10:45:10.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:45:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.116+0000 7f444c083640 1 Processor -- start 2023-08-10T10:45:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.117+0000 7f444c083640 1 -- start start 2023-08-10T10:45:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.118+0000 7f444c083640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415a820 0x7f444406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.118+0000 7f444c083640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444415bcb0 con 0x7f4444069db0 2023-08-10T10:45:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.118+0000 7f444c083640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444415b0a0 con 0x7f444415ac00 2023-08-10T10:45:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.118+0000 7f444c083640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44440c5540 con 0x7f444415a820 2023-08-10T10:45:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415a820 0x7f444406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415a820 0x7f444406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48842/0 (socket says 172.21.15.50:48842) 2023-08-10T10:45:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 -- 172.21.15.50:0/97040021 learned_addr learned my addr 172.21.15.50:0/97040021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 -- 172.21.15.50:0/97040021 >> v1:172.21.15.117:6789/0 conn(0x7f444415ac00 legacy=0x7f44440696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 -- 172.21.15.50:0/97040021 >> v1:172.21.15.50:6789/0 conn(0x7f4444069db0 legacy=0x7f44440cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.119+0000 7f4449e1f640 1 -- 172.21.15.50:0/97040021 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444415b380 con 0x7f444415a820 2023-08-10T10:45:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.120+0000 7f4449e1f640 1 --2- 172.21.15.50:0/97040021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415a820 0x7f444406c180 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4440009870 tx=0x7f444002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18d385636a9a1e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f4448e1d640 1 -- 172.21.15.50:0/97040021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440031870 con 0x7f444415a820 2023-08-10T10:45:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f4448e1d640 1 -- 172.21.15.50:0/97040021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44400319d0 con 0x7f444415a820 2023-08-10T10:45:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f4448e1d640 1 -- 172.21.15.50:0/97040021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440031d60 con 0x7f444415a820 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 -- 172.21.15.50:0/97040021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415a820 msgr2=0x7f444406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 --2- 172.21.15.50:0/97040021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415a820 0x7f444406c180 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4440009870 tx=0x7f444002b910 comp rx=0 tx=0).stop 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 -- 172.21.15.50:0/97040021 shutdown_connections 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 --2- 172.21.15.50:0/97040021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415a820 0x7f444406c180 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 -- 172.21.15.50:0/97040021 >> 172.21.15.50:0/97040021 conn(0x7f44440b08e0 msgr2=0x7f44440ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.121+0000 7f444c083640 1 -- 172.21.15.50:0/97040021 shutdown_connections 2023-08-10T10:45:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.122+0000 7f444c083640 1 -- 172.21.15.50:0/97040021 wait complete. 2023-08-10T10:45:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.123+0000 7f444c083640 1 Processor -- start 2023-08-10T10:45:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.123+0000 7f444c083640 1 -- start start 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4444069db0 0x7f44441573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f444415ac00 0x7f444406fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444070770 con 0x7f44440702c0 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444157e80 con 0x7f4444069db0 2023-08-10T10:45:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.124+0000 7f444c083640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44440b1260 con 0x7f444415ac00 2023-08-10T10:45:11.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48848/0 (socket says 172.21.15.50:48848) 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 -- 172.21.15.50:0/1144758878 learned_addr learned my addr 172.21.15.50:0/1144758878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f4449e1f640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4444069db0 0x7f44441573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444961e640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f444415ac00 0x7f444406fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 -- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f444415ac00 msgr2=0x7f444406fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f444415ac00 0x7f444406fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 -- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4444069db0 msgr2=0x7f44441573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4444069db0 0x7f44441573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.125+0000 7f444a620640 1 -- 172.21.15.50:0/1144758878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400094d0 con 0x7f44440702c0 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f444a620640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c7d0 tx=0x7f443c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c003b70 con 0x7f44440702c0 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c003cf0 con 0x7f44440702c0 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00aa30 con 0x7f44440702c0 2023-08-10T10:45:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4444157930 con 0x7f44440702c0 2023-08-10T10:45:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.126+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44440b1790 con 0x7f44440702c0 2023-08-10T10:45:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.127+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444404e270 con 0x7f44440702c0 2023-08-10T10:45:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.128+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f443c00ab90 con 0x7f44440702c0 2023-08-10T10:45:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.129+0000 7f443a7fc640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 0x7f442806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.129+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f443c089280 con 0x7f44440702c0 2023-08-10T10:45:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.130+0000 7f4449e1f640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 0x7f442806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.131+0000 7f4449e1f640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 0x7f442806d110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4440036000 tx=0x7f444003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.134+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f443c054340 con 0x7f44440702c0 2023-08-10T10:45:11.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.338+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f444406e9d0 con 0x7f44440702c0 2023-08-10T10:45:11.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.339+0000 7f443a7fc640 1 -- 172.21.15.50:0/1144758878 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) v1 ==== 80+0+0 (secure 0 0 0) 0x7f443c003e60 con 0x7f44440702c0 2023-08-10T10:45:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:45:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.341+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 msgr2=0x7f442806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.341+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 0x7f442806d110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4440036000 tx=0x7f444003c040 comp rx=0 tx=0).stop 2023-08-10T10:45:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.341+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 msgr2=0x7f44440c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.341+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c7d0 tx=0x7f443c00cc90 comp rx=0 tx=0).stop 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 shutdown_connections 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440702c0 0x7f44440c3a00 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f444415ac00 0x7f444406fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f442806ac50 0x7f442806d110 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 --2- 172.21.15.50:0/1144758878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4444069db0 0x7f44441573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 >> 172.21.15.50:0/1144758878 conn(0x7f44440b08e0 msgr2=0x7f444415ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 shutdown_connections 2023-08-10T10:45:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.342+0000 7f444c083640 1 -- 172.21.15.50:0/1144758878 wait complete. 2023-08-10T10:45:11.361 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:45:11.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:11.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:11.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:45:11.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:11.541 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:45:11.580 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:11.581 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:11.626 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:11.627 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:11.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:11.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.957+0000 7f4c34c34640 1 Processor -- start 2023-08-10T10:45:11.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.957+0000 7f4c34c34640 1 -- start start 2023-08-10T10:45:11.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c3015cd60 0x7f4c30160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c300b8430 0x7f4c300cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c300cddb0 0x7f4c300696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300ce240 con 0x7f4c3015cd60 2023-08-10T10:45:11.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300b5bd0 con 0x7f4c300cddb0 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.958+0000 7f4c34c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30161180 con 0x7f4c300b8430 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c3015cd60 0x7f4c30160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c3015cd60 0x7f4c30160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48856/0 (socket says 172.21.15.50:48856) 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1660490395 learned_addr learned my addr 172.21.15.50:0/1660490395 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2ed9d640 1 --2- 172.21.15.50:0/1660490395 >> v2:172.21.15.117:3300/0 conn(0x7f4c300cddb0 0x7f4c300696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2dd9b640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c300b8430 0x7f4c300cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1660490395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c300b8430 msgr2=0x7f4c300cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c300b8430 0x7f4c300cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.959+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1660490395 >> v2:172.21.15.117:3300/0 conn(0x7f4c300cddb0 msgr2=0x7f4c300696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.960+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1660490395 >> v2:172.21.15.117:3300/0 conn(0x7f4c300cddb0 0x7f4c300696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.960+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1660490395 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30161460 con 0x7f4c3015cd60 2023-08-10T10:45:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.961+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c3015cd60 0x7f4c30160930 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f4c300b5490 tx=0x7f4c2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2178d89b83c6d515 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.961+0000 7f4c2d59a640 1 -- 172.21.15.50:0/1660490395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2002cb00 con 0x7f4c3015cd60 2023-08-10T10:45:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.961+0000 7f4c2d59a640 1 -- 172.21.15.50:0/1660490395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2002cc60 con 0x7f4c3015cd60 2023-08-10T10:45:11.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c2d59a640 1 -- 172.21.15.50:0/1660490395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200343f0 con 0x7f4c3015cd60 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 -- 172.21.15.50:0/1660490395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c3015cd60 msgr2=0x7f4c30160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c3015cd60 0x7f4c30160930 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f4c300b5490 tx=0x7f4c2002bf60 comp rx=0 tx=0).stop 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 -- 172.21.15.50:0/1660490395 shutdown_connections 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1660490395 >> v2:172.21.15.117:3300/0 conn(0x7f4c300cddb0 0x7f4c300696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c300b8430 0x7f4c300cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1660490395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c3015cd60 0x7f4c30160930 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 -- 172.21.15.50:0/1660490395 >> 172.21.15.50:0/1660490395 conn(0x7f4c300d2ac0 msgr2=0x7f4c300d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:11.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 -- 172.21.15.50:0/1660490395 shutdown_connections 2023-08-10T10:45:11.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.962+0000 7f4c34c34640 1 -- 172.21.15.50:0/1660490395 wait complete. 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.964+0000 7f4c34c34640 1 Processor -- start 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.964+0000 7f4c34c34640 1 -- start start 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 0x7f4c3014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c3015cd60 0x7f4c300b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300cd790 con 0x7f4c300b8430 2023-08-10T10:45:11.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3014d6c0 con 0x7f4c300cddb0 2023-08-10T10:45:11.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.965+0000 7f4c34c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3014d9a0 con 0x7f4c3015cd60 2023-08-10T10:45:11.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48870/0 (socket says 172.21.15.50:48870) 2023-08-10T10:45:11.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1297240000 learned_addr learned my addr 172.21.15.50:0/1297240000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:11.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2dd9b640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 0x7f4c3014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c3015cd60 msgr2=0x7f4c300b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2ed9d640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c3015cd60 0x7f4c300b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c3015cd60 0x7f4c300b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 msgr2=0x7f4c3014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 0x7f4c3014bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:11.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2e59c640 1 -- 172.21.15.50:0/1297240000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20009b30 con 0x7f4c300b8430 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.966+0000 7f4c2dd9b640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 0x7f4c3014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c2e59c640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000f80 tx=0x7f4c20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20009510 con 0x7f4c300b8430 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2003e450 con 0x7f4c300b8430 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2003e800 con 0x7f4c300b8430 2023-08-10T10:45:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3014dc80 con 0x7f4c300b8430 2023-08-10T10:45:11.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.967+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3014e240 con 0x7f4c300b8430 2023-08-10T10:45:11.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.968+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3004e270 con 0x7f4c300b8430 2023-08-10T10:45:11.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.969+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c2003e960 con 0x7f4c300b8430 2023-08-10T10:45:11.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.970+0000 7f4c1effd640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 0x7f4c1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:11.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.970+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4c200ac480 con 0x7f4c300b8430 2023-08-10T10:45:11.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.970+0000 7f4c2dd9b640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 0x7f4c1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:11.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.971+0000 7f4c2dd9b640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 0x7f4c1006d110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4c300cfbd0 tx=0x7f4c24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:11.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:11.975+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4c20077410 con 0x7f4c300b8430 2023-08-10T10:45:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.160+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c300d3940 con 0x7f4c300b8430 2023-08-10T10:45:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.162+0000 7f4c1effd640 1 -- 172.21.15.50:0/1297240000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18489 (secure 0 0 0) 0x7f4c2007aa30 con 0x7f4c300b8430 2023-08-10T10:45:12.165 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:12.165 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":118,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:09.860818+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.164+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 msgr2=0x7f4c1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.164+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 0x7f4c1006d110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4c300cfbd0 tx=0x7f4c24008040 comp rx=0 tx=0).stop 2023-08-10T10:45:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 msgr2=0x7f4c300cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000f80 tx=0x7f4c20004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 shutdown_connections 2023-08-10T10:45:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c3015cd60 0x7f4c300b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c1006ac50 0x7f4c1006d110 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c300cddb0 0x7f4c3014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 --2- 172.21.15.50:0/1297240000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c300b8430 0x7f4c300cd250 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 >> 172.21.15.50:0/1297240000 conn(0x7f4c300d2ac0 msgr2=0x7f4c3015bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 shutdown_connections 2023-08-10T10:45:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.165+0000 7f4c34c34640 1 -- 172.21.15.50:0/1297240000 wait complete. 2023-08-10T10:45:12.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:44:34.361887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:44:34.998347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:12.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.415+0000 7f2b72942640 1 Processor -- start 2023-08-10T10:45:12.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.415+0000 7f2b72942640 1 -- start start 2023-08-10T10:45:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b72942640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b6c15ae40 0x7f2b6c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b72942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c06cb30 0x7f2b6c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b72942640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0adcb0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b72942640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c06c320 con 0x7f2b6c15ae40 2023-08-10T10:45:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b72942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c06b770 con 0x7f2b6c06cb30 2023-08-10T10:45:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b6bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b6c15ae40 0x7f2b6c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b70edf640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b6c0cd2a0 0x7f2b6c0c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38266/0 (socket says 172.21.15.50:38266) 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b70edf640 1 -- 172.21.15.50:0/3984401888 learned_addr learned my addr 172.21.15.50:0/3984401888 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.417+0000 7f2b6b7fe640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c06cb30 0x7f2b6c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.418+0000 7f2b6bfff640 1 -- 172.21.15.50:0/3984401888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c06cb30 msgr2=0x7f2b6c0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.418+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c06cb30 0x7f2b6c0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.418+0000 7f2b6bfff640 1 -- 172.21.15.50:0/3984401888 >> v1:172.21.15.50:6789/0 conn(0x7f2b6c0cd2a0 legacy=0x7f2b6c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.418+0000 7f2b6affd640 1 -- 172.21.15.50:0/3984401888 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092149602 0 0) 0x7f2b6c0adcb0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.418+0000 7f2b6bfff640 1 -- 172.21.15.50:0/3984401888 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c06b9f0 con 0x7f2b6c15ae40 2023-08-10T10:45:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.419+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c15ae40 0x7f2b6c0b1510 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77fea53ffe6884a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b6affd640 1 -- 172.21.15.50:0/3984401888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c031830 con 0x7f2b6c15ae40 2023-08-10T10:45:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b6affd640 1 -- 172.21.15.50:0/3984401888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c031990 con 0x7f2b6c15ae40 2023-08-10T10:45:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b6affd640 1 -- 172.21.15.50:0/3984401888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c031d20 con 0x7f2b6c15ae40 2023-08-10T10:45:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b72942640 1 -- 172.21.15.50:0/3984401888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c15ae40 msgr2=0x7f2b6c0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b72942640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c15ae40 0x7f2b6c0b1510 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.420+0000 7f2b72942640 1 -- 172.21.15.50:0/3984401888 shutdown_connections 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.421+0000 7f2b72942640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c06cb30 0x7f2b6c0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.421+0000 7f2b72942640 1 --2- 172.21.15.50:0/3984401888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c15ae40 0x7f2b6c0b1510 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.421+0000 7f2b72942640 1 -- 172.21.15.50:0/3984401888 >> 172.21.15.50:0/3984401888 conn(0x7f2b6c0b01b0 msgr2=0x7f2b6c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.421+0000 7f2b72942640 1 -- 172.21.15.50:0/3984401888 shutdown_connections 2023-08-10T10:45:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.421+0000 7f2b72942640 1 -- 172.21.15.50:0/3984401888 wait complete. 2023-08-10T10:45:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.422+0000 7f2b72942640 1 Processor -- start 2023-08-10T10:45:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.423+0000 7f2b72942640 1 -- start start 2023-08-10T10:45:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 0x7f2b6c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 0x7f2b6c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c1f0cb0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0c6a20 con 0x7f2b6c06cb30 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b72942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c1f0660 con 0x7f2b6c15ae40 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48884/0 (socket says 172.21.15.50:48884) 2023-08-10T10:45:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 -- 172.21.15.50:0/5709867 learned_addr learned my addr 172.21.15.50:0/5709867 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b70edf640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 0x7f2b6c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 -- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 msgr2=0x7f2b6c0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 0x7f2b6c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 0x7f2b6c0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 -- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 msgr2=0x7f2b6c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 0x7f2b6c15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b6b7fe640 1 -- 172.21.15.50:0/5709867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c009400 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.424+0000 7f2b70edf640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 0x7f2b6c0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 0x7f2b6c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b6b7fe640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800d5c0 tx=0x7f2b5800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580125f0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58012750 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58012b00 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c1f0940 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.425+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c15e220 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.427+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c1f0e20 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.427+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b58012c60 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.428+0000 7f2b68ff9640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 0x7f2b5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.428+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2b58089ac0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.429+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 0x7f2b5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.429+0000 7f2b6bfff640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 0x7f2b5406d110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c036000 tx=0x7f2b5c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.433+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2b58054a50 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.626+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b6c0612b0 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.627+0000 7f2b68ff9640 1 -- 172.21.15.50:0/5709867 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b58058070 con 0x7f2b6c0cd2a0 2023-08-10T10:45:12.628 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:12.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.629+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 msgr2=0x7f2b5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.629+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 0x7f2b5406d110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c036000 tx=0x7f2b5c008030 comp rx=0 tx=0).stop 2023-08-10T10:45:12.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.629+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 msgr2=0x7f2b6c0c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.629+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800d5c0 tx=0x7f2b5800da80 comp rx=0 tx=0).stop 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 shutdown_connections 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b6c15ae40 0x7f2b6c0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b6c0cd2a0 0x7f2b6c0c6120 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2b5406ac50 0x7f2b5406d110 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 --2- 172.21.15.50:0/5709867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b6c06cb30 0x7f2b6c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 >> 172.21.15.50:0/5709867 conn(0x7f2b6c0b01b0 msgr2=0x7f2b6c0af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 shutdown_connections 2023-08-10T10:45:12.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.630+0000 7f2b72942640 1 -- 172.21.15.50:0/5709867 wait complete. 2023-08-10T10:45:12.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:12.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.875+0000 7fa5c54f3640 1 Processor -- start 2023-08-10T10:45:12.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.875+0000 7fa5c54f3640 1 -- start start 2023-08-10T10:45:12.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.876+0000 7fa5c54f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c0161070 0x7fa5c00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.876+0000 7fa5c54f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c00b0610 0x7fa5c00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.876+0000 7fa5c54f3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c0164bf0 con 0x7fa5c00c94e0 2023-08-10T10:45:12.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.876+0000 7fa5c54f3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c0164e40 con 0x7fa5c0161070 2023-08-10T10:45:12.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.876+0000 7fa5c54f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0165120 con 0x7fa5c00b0610 2023-08-10T10:45:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.877+0000 7fa5bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c0161070 0x7fa5c00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.877+0000 7fa5bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c0161070 0x7fa5c00cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48886/0 (socket says 172.21.15.50:48886) 2023-08-10T10:45:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.877+0000 7fa5bffff640 1 -- 172.21.15.50:0/2765468356 learned_addr learned my addr 172.21.15.50:0/2765468356 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.877+0000 7fa5c4cf2640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c00b0610 0x7fa5c00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.878+0000 7fa5bffff640 1 -- 172.21.15.50:0/2765468356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c00b0610 msgr2=0x7fa5c00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.878+0000 7fa5bffff640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c00b0610 0x7fa5c00cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.878+0000 7fa5bffff640 1 -- 172.21.15.50:0/2765468356 >> v1:172.21.15.117:6789/0 conn(0x7fa5c00c94e0 legacy=0x7fa5c00aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.878+0000 7fa5bffff640 1 -- 172.21.15.50:0/2765468356 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0165400 con 0x7fa5c0161070 2023-08-10T10:45:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.879+0000 7fa5bffff640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c0161070 0x7fa5c00cdc60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009870 tx=0x7fa5b002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bcc83e430f462 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.879+0000 7fa5bf7fe640 1 -- 172.21.15.50:0/2765468356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0030840 con 0x7fa5c0161070 2023-08-10T10:45:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.879+0000 7fa5bf7fe640 1 -- 172.21.15.50:0/2765468356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b00309a0 con 0x7fa5c0161070 2023-08-10T10:45:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.879+0000 7fa5bf7fe640 1 -- 172.21.15.50:0/2765468356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0030d30 con 0x7fa5c0161070 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 -- 172.21.15.50:0/2765468356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c0161070 msgr2=0x7fa5c00cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c0161070 0x7fa5c00cdc60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009870 tx=0x7fa5b002b980 comp rx=0 tx=0).stop 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 -- 172.21.15.50:0/2765468356 shutdown_connections 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c00b0610 0x7fa5c00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/2765468356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c0161070 0x7fa5c00cdc60 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 -- 172.21.15.50:0/2765468356 >> 172.21.15.50:0/2765468356 conn(0x7fa5c0069cd0 msgr2=0x7fa5c00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 -- 172.21.15.50:0/2765468356 shutdown_connections 2023-08-10T10:45:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.880+0000 7fa5c54f3640 1 -- 172.21.15.50:0/2765468356 wait complete. 2023-08-10T10:45:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.882+0000 7fa5c54f3640 1 Processor -- start 2023-08-10T10:45:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.882+0000 7fa5c54f3640 1 -- start start 2023-08-10T10:45:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c00b0610 0x7fa5c015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c0161070 0x7fa5c00c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c015b1a0 con 0x7fa5c00c94e0 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0164550 con 0x7fa5c00b0610 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5c54f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0161e80 con 0x7fa5c0161070 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.883+0000 7fa5b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48900/0 (socket says 172.21.15.50:48900) 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 -- 172.21.15.50:0/1860389997 learned_addr learned my addr 172.21.15.50:0/1860389997 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5bffff640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c00b0610 0x7fa5c015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5c4cf2640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c0161070 0x7fa5c00c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 -- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c0161070 msgr2=0x7fa5c00c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c0161070 0x7fa5c00c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 -- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c00b0610 msgr2=0x7fa5c015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:12.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c00b0610 0x7fa5c015ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:12.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 -- 172.21.15.50:0/1860389997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00094d0 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.884+0000 7fa5b77fe640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c870 tx=0x7fa5a800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.885+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8003b70 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.885+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a8003cf0 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.885+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800aa90 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.885+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0164270 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.885+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c0161b10 con 0x7fa5c00c94e0 2023-08-10T10:45:12.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.886+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0161690 con 0x7fa5c00c94e0 2023-08-10T10:45:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.887+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5a800abf0 con 0x7fa5c00c94e0 2023-08-10T10:45:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.888+0000 7fa5bd7fa640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 0x7fa5a006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.888+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fa5a8089460 con 0x7fa5c00c94e0 2023-08-10T10:45:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.888+0000 7fa5bffff640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 0x7fa5a006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.889+0000 7fa5bffff640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 0x7fa5a006d140 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0036000 tx=0x7fa5b003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:12.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:12.894+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa5c0161690 con 0x7fa5c00c94e0 2023-08-10T10:45:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.087+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5c0161690 con 0x7fa5c00c94e0 2023-08-10T10:45:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.088+0000 7fa5bd7fa640 1 -- 172.21.15.50:0/1860389997 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5c0161690 con 0x7fa5c00c94e0 2023-08-10T10:45:13.089 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 msgr2=0x7fa5a006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 0x7fa5a006d140 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0036000 tx=0x7fa5b003b040 comp rx=0 tx=0).stop 2023-08-10T10:45:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 msgr2=0x7fa5c01638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c870 tx=0x7fa5a800cd30 comp rx=0 tx=0).stop 2023-08-10T10:45:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 shutdown_connections 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c0161070 0x7fa5c00c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00c94e0 0x7fa5c01638d0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa5a006ac80 0x7fa5a006d140 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 --2- 172.21.15.50:0/1860389997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c00b0610 0x7fa5c015ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.090+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 >> 172.21.15.50:0/1860389997 conn(0x7fa5c0069cd0 msgr2=0x7fa5c00ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.091+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 shutdown_connections 2023-08-10T10:45:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.091+0000 7fa5c54f3640 1 -- 172.21.15.50:0/1860389997 wait complete. 2023-08-10T10:45:13.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:45:13.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.341+0000 7ff62497f640 1 Processor -- start 2023-08-10T10:45:13.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.341+0000 7ff62497f640 1 -- start start 2023-08-10T10:45:13.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff62497f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6201583c0 0x7ff6200b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff62497f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6200b1ba0 0x7ff6200696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff62497f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62015aee0 con 0x7ff620069be0 2023-08-10T10:45:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff62497f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62006a050 con 0x7ff6200b1ba0 2023-08-10T10:45:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff62497f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200b2100 con 0x7ff6201583c0 2023-08-10T10:45:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff617fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6200b1ba0 0x7ff6200696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff61ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff620069be0 0x7ff62006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38280/0 (socket says 172.21.15.50:38280) 2023-08-10T10:45:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.343+0000 7ff61ffff640 1 -- 172.21.15.50:0/511930768 learned_addr learned my addr 172.21.15.50:0/511930768 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff61f7fe640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6201583c0 0x7ff6200b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff617fff640 1 -- 172.21.15.50:0/511930768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6201583c0 msgr2=0x7ff6200b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff617fff640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6201583c0 0x7ff6200b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff617fff640 1 -- 172.21.15.50:0/511930768 >> v1:172.21.15.50:6789/0 conn(0x7ff620069be0 legacy=0x7ff62006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff617fff640 1 -- 172.21.15.50:0/511930768 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62015b1a0 con 0x7ff6200b1ba0 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.344+0000 7ff61effd640 1 -- 172.21.15.50:0/511930768 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511989840 0 0) 0x7ff62015aee0 con 0x7ff620069be0 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.345+0000 7ff617fff640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff6200696a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff6080097a0 tx=0x7ff60802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e73d587d3fd581 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff61effd640 1 -- 172.21.15.50:0/511930768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608031780 con 0x7ff6200b1ba0 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff61effd640 1 -- 172.21.15.50:0/511930768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6080318e0 con 0x7ff6200b1ba0 2023-08-10T10:45:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff61effd640 1 -- 172.21.15.50:0/511930768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608031c70 con 0x7ff6200b1ba0 2023-08-10T10:45:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 -- 172.21.15.50:0/511930768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 msgr2=0x7ff6200696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff6200696a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff6080097a0 tx=0x7ff60802b820 comp rx=0 tx=0).stop 2023-08-10T10:45:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 -- 172.21.15.50:0/511930768 shutdown_connections 2023-08-10T10:45:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff6200696a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 --2- 172.21.15.50:0/511930768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6201583c0 0x7ff6200b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 -- 172.21.15.50:0/511930768 >> 172.21.15.50:0/511930768 conn(0x7ff6200caf80 msgr2=0x7ff6200cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 -- 172.21.15.50:0/511930768 shutdown_connections 2023-08-10T10:45:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.346+0000 7ff62497f640 1 -- 172.21.15.50:0/511930768 wait complete. 2023-08-10T10:45:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.348+0000 7ff62497f640 1 Processor -- start 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.348+0000 7ff62497f640 1 -- start start 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff620069be0 0x7ff6201f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6201583c0 0x7ff6200c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201f38f0 con 0x7ff6200b1ba0 2023-08-10T10:45:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff620157040 con 0x7ff6201583c0 2023-08-10T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.349+0000 7ff62497f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200c20d0 con 0x7ff620069be0 2023-08-10T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48914/0 (socket says 172.21.15.50:48914) 2023-08-10T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 -- 172.21.15.50:0/2829774205 learned_addr learned my addr 172.21.15.50:0/2829774205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff61f7fe640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff620069be0 0x7ff6201f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff61ffff640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6201583c0 0x7ff6200c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 -- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff620069be0 msgr2=0x7ff6201f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff620069be0 0x7ff6201f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 -- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6201583c0 msgr2=0x7ff6200c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6201583c0 0x7ff6200c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.350+0000 7ff617fff640 1 -- 172.21.15.50:0/2829774205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009400 con 0x7ff6200b1ba0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff617fff640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff608034040 tx=0x7ff6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608032820 con 0x7ff6200b1ba0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6080329a0 con 0x7ff6200b1ba0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608032d50 con 0x7ff6200b1ba0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6200c2370 con 0x7ff6200b1ba0 2023-08-10T10:45:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.351+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6200c2930 con 0x7ff6200b1ba0 2023-08-10T10:45:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.353+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620066e30 con 0x7ff6200b1ba0 2023-08-10T10:45:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.353+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff60804e440 con 0x7ff6200b1ba0 2023-08-10T10:45:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.354+0000 7ff61cff9640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 0x7ff60006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.354+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff6080ab670 con 0x7ff6200b1ba0 2023-08-10T10:45:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.355+0000 7ff61f7fe640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 0x7ff60006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.355+0000 7ff61f7fe640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 0x7ff60006d160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff610006fd0 tx=0x7ff610008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.359+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff608076730 con 0x7ff6200b1ba0 2023-08-10T10:45:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.549+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6200caba0 con 0x7ff6200b1ba0 2023-08-10T10:45:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.550+0000 7ff61cff9640 1 -- 172.21.15.50:0/2829774205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff608079d50 con 0x7ff6200b1ba0 2023-08-10T10:45:13.552 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:45:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.552+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 msgr2=0x7ff60006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.552+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 0x7ff60006d160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff610006fd0 tx=0x7ff610008040 comp rx=0 tx=0).stop 2023-08-10T10:45:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.552+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 msgr2=0x7ff620156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.552+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff608034040 tx=0x7ff6080046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 shutdown_connections 2023-08-10T10:45:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff60006aca0 0x7ff60006d160 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6201583c0 0x7ff6200c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6200b1ba0 0x7ff620156b00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 --2- 172.21.15.50:0/2829774205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff620069be0 0x7ff6201f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 >> 172.21.15.50:0/2829774205 conn(0x7ff6200caf80 msgr2=0x7ff620157920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:13.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 shutdown_connections 2023-08-10T10:45:13.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.553+0000 7ff62497f640 1 -- 172.21.15.50:0/2829774205 wait complete. 2023-08-10T10:45:13.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:45:13.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:45:13.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:45:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.791+0000 7f151b8ec640 1 Processor -- start 2023-08-10T10:45:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.791+0000 7f151b8ec640 1 -- start start 2023-08-10T10:45:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f151b8ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f151415cf70 0x7f1514160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f151b8ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15140b4640 0x7f1514161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f151b8ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1514160a40 con 0x7f151415cb90 2023-08-10T10:45:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f151b8ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140b4bb0 con 0x7f151415cf70 2023-08-10T10:45:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f151b8ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b4e90 con 0x7f15140b4640 2023-08-10T10:45:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.793+0000 7f1519688640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f151415cb90 0x7f15140b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38286/0 (socket says 172.21.15.50:38286) 2023-08-10T10:45:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1519688640 1 -- 172.21.15.50:0/2581908947 learned_addr learned my addr 172.21.15.50:0/2581908947 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1518e87640 1 --2- 172.21.15.50:0/2581908947 >> v2:172.21.15.50:3300/0 conn(0x7f151415cf70 0x7f1514160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1519e89640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15140b4640 0x7f1514161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f150bfff640 1 -- 172.21.15.50:0/2581908947 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378814048 0 0) 0x7f1514160a40 con 0x7f151415cb90 2023-08-10T10:45:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1518e87640 1 -- 172.21.15.50:0/2581908947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15140b4640 msgr2=0x7f1514161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1518e87640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15140b4640 0x7f1514161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1518e87640 1 -- 172.21.15.50:0/2581908947 >> v1:172.21.15.50:6789/0 conn(0x7f151415cb90 legacy=0x7f15140b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.794+0000 7f1518e87640 1 -- 172.21.15.50:0/2581908947 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140b5170 con 0x7f151415cf70 2023-08-10T10:45:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.795+0000 7f1518e87640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151415cf70 0x7f1514160ed0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f15040097a0 tx=0x7f150402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e8a7a3430b3304 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.796+0000 7f150bfff640 1 -- 172.21.15.50:0/2581908947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150402d040 con 0x7f151415cf70 2023-08-10T10:45:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.796+0000 7f150bfff640 1 -- 172.21.15.50:0/2581908947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504031810 con 0x7f151415cf70 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.796+0000 7f150bfff640 1 -- 172.21.15.50:0/2581908947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504031ba0 con 0x7f151415cf70 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 -- 172.21.15.50:0/2581908947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151415cf70 msgr2=0x7f1514160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151415cf70 0x7f1514160ed0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f15040097a0 tx=0x7f150402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 -- 172.21.15.50:0/2581908947 shutdown_connections 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151415cf70 0x7f1514160ed0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 --2- 172.21.15.50:0/2581908947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15140b4640 0x7f1514161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 -- 172.21.15.50:0/2581908947 >> 172.21.15.50:0/2581908947 conn(0x7f15140cf640 msgr2=0x7f15140cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 -- 172.21.15.50:0/2581908947 shutdown_connections 2023-08-10T10:45:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.797+0000 7f151b8ec640 1 -- 172.21.15.50:0/2581908947 wait complete. 2023-08-10T10:45:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.800+0000 7f151b8ec640 1 Processor -- start 2023-08-10T10:45:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.800+0000 7f151b8ec640 1 -- start start 2023-08-10T10:45:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 0x7f15140c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f151415cf70 0x7f151414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151415e6c0 con 0x7f15140b4640 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140c64b0 con 0x7f151415cb90 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f151b8ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140c7630 con 0x7f151415cf70 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48928/0 (socket says 172.21.15.50:48928) 2023-08-10T10:45:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 -- 172.21.15.50:0/1045688638 learned_addr learned my addr 172.21.15.50:0/1045688638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519e89640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f151415cf70 0x7f151414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1518e87640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 0x7f15140c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 -- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f151415cf70 msgr2=0x7f151414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f151415cf70 0x7f151414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 -- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 msgr2=0x7f15140c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 0x7f15140c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1519688640 1 -- 172.21.15.50:0/1045688638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009400 con 0x7f15140b4640 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.802+0000 7f1518e87640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 0x7f15140c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f1519688640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f151000c500 tx=0x7f151000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510007560 con 0x7f15140b4640 2023-08-10T10:45:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100047e0 con 0x7f15140b4640 2023-08-10T10:45:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510004b90 con 0x7f15140b4640 2023-08-10T10:45:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151414d4b0 con 0x7f15140b4640 2023-08-10T10:45:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.803+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151415e8b0 con 0x7f15140b4640 2023-08-10T10:45:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.805+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15140612b0 con 0x7f15140b4640 2023-08-10T10:45:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.805+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1510004cf0 con 0x7f15140b4640 2023-08-10T10:45:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.807+0000 7f1509ffb640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 0x7f14f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.807+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f1510088610 con 0x7f15140b4640 2023-08-10T10:45:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.807+0000 7f1518e87640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 0x7f14f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.808+0000 7f1518e87640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 0x7f14f806d110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1504036000 tx=0x7f150403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:13.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:13.811+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15100536e0 con 0x7f15140b4640 2023-08-10T10:45:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.011+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15140d0a10 con 0x7f15140b4640 2023-08-10T10:45:14.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.012+0000 7f1509ffb640 1 -- 172.21.15.50:0/1045688638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1510056d00 con 0x7f15140b4640 2023-08-10T10:45:14.013 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:45:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.014+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 msgr2=0x7f14f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.014+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 0x7f14f806d110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1504036000 tx=0x7f150403c040 comp rx=0 tx=0).stop 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.014+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 msgr2=0x7f151415f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.014+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f151000c500 tx=0x7f151000c9c0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 shutdown_connections 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f151415cf70 0x7f151414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f14f806ac50 0x7f14f806d110 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f151415cb90 0x7f15140c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 --2- 172.21.15.50:0/1045688638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140b4640 0x7f151415f390 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 >> 172.21.15.50:0/1045688638 conn(0x7f15140cf640 msgr2=0x7f15140cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 shutdown_connections 2023-08-10T10:45:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.015+0000 7f151b8ec640 1 -- 172.21.15.50:0/1045688638 wait complete. 2023-08-10T10:45:14.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:45:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.262+0000 7f9c5f596640 1 Processor -- start 2023-08-10T10:45:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.262+0000 7f9c5f596640 1 -- start start 2023-08-10T10:45:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5f596640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c5815ac00 0x7f9c5806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5f596640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5815bcb0 con 0x7f9c58069db0 2023-08-10T10:45:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5f596640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5815b0a0 con 0x7f9c5815a820 2023-08-10T10:45:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5f596640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580c5540 con 0x7f9c5815ac00 2023-08-10T10:45:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5db33640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c58069db0 0x7f9c580cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38288/0 (socket says 172.21.15.50:38288) 2023-08-10T10:45:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5db33640 1 -- 172.21.15.50:0/3252240278 learned_addr learned my addr 172.21.15.50:0/3252240278 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.264+0000 7f9c5cb31640 1 --2- 172.21.15.50:0/3252240278 >> v2:172.21.15.117:3300/0 conn(0x7f9c5815ac00 0x7f9c5806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019738194 0 0) 0x7f9c5815bcb0 con 0x7f9c58069db0 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c44003520 con 0x7f9c58069db0 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101476469 0 0) 0x7f9c44003520 con 0x7f9c58069db0 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 >> v2:172.21.15.117:3300/0 conn(0x7f9c5815ac00 msgr2=0x7f9c5806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 --2- 172.21.15.50:0/3252240278 >> v2:172.21.15.117:3300/0 conn(0x7f9c5815ac00 0x7f9c5806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 >> v1:172.21.15.117:6789/0 conn(0x7f9c5815a820 legacy=0x7f9c580696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5815b380 con 0x7f9c58069db0 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9c50001670 con 0x7f9c58069db0 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 >> v1:172.21.15.50:6789/0 conn(0x7f9c58069db0 legacy=0x7f9c580cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c440047c0 0x7f9c44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.265+0000 7f9c4ffff640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c44005180 0x7f9c4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c5540 con 0x7f9c44003970 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c120 con 0x7f9c44005180 2023-08-10T10:45:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c2e0 con 0x7f9c440047c0 2023-08-10T10:45:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5db33640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c44005180 0x7f9c4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5cb31640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c440047c0 0x7f9c44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 -- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c440047c0 msgr2=0x7f9c44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c440047c0 0x7f9c44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 -- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c44005180 msgr2=0x7f9c4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c44005180 0x7f9c4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5d332640 1 -- 172.21.15.50:0/3252240278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44003520 con 0x7f9c44003970 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.266+0000 7f9c5db33640 1 -- 172.21.15.50:0/3252240278 reap_dead start 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.268+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c44003d90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9c54001e50 tx=0x7f9c440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafd0f990c25a0d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.268+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54003b70 con 0x7f9c44003970 2023-08-10T10:45:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.268+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54003cd0 con 0x7f9c44003970 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.268+0000 7f9c4ffff640 1 -- 172.21.15.50:0/3252240278 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005310 con 0x7f9c44003970 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 -- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 msgr2=0x7f9c44003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c44003d90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9c54001e50 tx=0x7f9c440057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 -- 172.21.15.50:0/3252240278 shutdown_connections 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3252240278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c44003d90 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 -- 172.21.15.50:0/3252240278 >> 172.21.15.50:0/3252240278 conn(0x7f9c580b08e0 msgr2=0x7f9c580ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 -- 172.21.15.50:0/3252240278 shutdown_connections 2023-08-10T10:45:14.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.269+0000 7f9c5f596640 1 -- 172.21.15.50:0/3252240278 wait complete. 2023-08-10T10:45:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.271+0000 7f9c5f596640 1 Processor -- start 2023-08-10T10:45:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.271+0000 7f9c5f596640 1 -- start start 2023-08-10T10:45:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c58158dc0 0x7f9c58159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c58159a90 0x7f9c581e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b2840 con 0x7f9c44003970 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b39b0 con 0x7f9c58159a90 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5f596640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b36d0 con 0x7f9c58158dc0 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5d332640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5d332640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48936/0 (socket says 172.21.15.50:48936) 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.272+0000 7f9c5d332640 1 -- 172.21.15.50:0/3870186208 learned_addr learned my addr 172.21.15.50:0/3870186208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5cb31640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c58158dc0 0x7f9c58159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5db33640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c58159a90 0x7f9c581e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 -- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c58158dc0 msgr2=0x7f9c58159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c58158dc0 0x7f9c58159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 -- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c58159a90 msgr2=0x7f9c581e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c58159a90 0x7f9c581e9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 -- 172.21.15.50:0/3870186208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580b2280 con 0x7f9c44003970 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.273+0000 7f9c5d332640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9c5402bf70 tx=0x7f9c540014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.274+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5403e070 con 0x7f9c44003970 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.274+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5402f440 con 0x7f9c44003970 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.274+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5402f7b0 con 0x7f9c44003970 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.274+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580b2560 con 0x7f9c44003970 2023-08-10T10:45:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.274+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58159240 con 0x7f9c44003970 2023-08-10T10:45:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.275+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5804e270 con 0x7f9c44003970 2023-08-10T10:45:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.276+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c5402f910 con 0x7f9c44003970 2023-08-10T10:45:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.277+0000 7f9c4dffb640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 0x7f9c3c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.277+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f9c540aaa10 con 0x7f9c44003970 2023-08-10T10:45:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.277+0000 7f9c5cb31640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 0x7f9c3c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.278+0000 7f9c5cb31640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 0x7f9c3c06d110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806c5d0 tx=0x7f9c48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.281+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c54075a50 con 0x7f9c44003970 2023-08-10T10:45:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.485+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9c581e42a0 con 0x7f9c44003970 2023-08-10T10:45:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.486+0000 7f9c4dffb640 1 -- 172.21.15.50:0/3870186208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9c54079070 con 0x7f9c44003970 2023-08-10T10:45:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:45:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 msgr2=0x7f9c3c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 0x7f9c3c06d110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806c5d0 tx=0x7f9c48008040 comp rx=0 tx=0).stop 2023-08-10T10:45:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 msgr2=0x7f9c581e4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9c5402bf70 tx=0x7f9c540014a0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 shutdown_connections 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.488+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c3c06ac50 0x7f9c3c06d110 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c58159a90 0x7f9c581e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c58158dc0 0x7f9c58159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 --2- 172.21.15.50:0/3870186208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44003970 0x7f9c581e4680 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 >> 172.21.15.50:0/3870186208 conn(0x7f9c580b08e0 msgr2=0x7f9c5815c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 shutdown_connections 2023-08-10T10:45:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:14.489+0000 7f9c5f596640 1 -- 172.21.15.50:0/3870186208 wait complete. 2023-08-10T10:45:14.510 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:45:14.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:14.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:14.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:45:14.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:14.642 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:45:14.692 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:14.693 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:14.757 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:45:14.757 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:14.758 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:14.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:45:14.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.057+0000 7f8cf5957640 1 Processor -- start 2023-08-10T10:45:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.058+0000 7f8cf5957640 1 -- start start 2023-08-10T10:45:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.059+0000 7f8cf5957640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 0x7f8cf00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.059+0000 7f8cf5957640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8cf0069db0 0x7f8cf00b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.059+0000 7f8cf5957640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00719f0 con 0x7f8cf00c9b30 2023-08-10T10:45:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.059+0000 7f8cf5957640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00c8db0 con 0x7f8cf0069db0 2023-08-10T10:45:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.059+0000 7f8cf5957640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c9050 con 0x7f8cf015ccb0 2023-08-10T10:45:15.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8ce7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cf00c9b30 0x7f8cf00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44928/0 (socket says 172.21.15.50:44928) 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8ce7fff640 1 -- 172.21.15.50:0/811411373 learned_addr learned my addr 172.21.15.50:0/811411373 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8ceeffd640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 0x7f8cf00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8cef7fe640 1 --2- 172.21.15.50:0/811411373 >> v2:172.21.15.117:3300/0 conn(0x7f8cf0069db0 0x7f8cf00b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189629567 0 0) 0x7f8cf00719f0 con 0x7f8cf00c9b30 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.060+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cdc003520 con 0x7f8cf00c9b30 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1753879976 0 0) 0x7f8cdc003520 con 0x7f8cf00c9b30 2023-08-10T10:45:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 msgr2=0x7f8cf00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 0x7f8cf00b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 >> v2:172.21.15.117:3300/0 conn(0x7f8cf0069db0 msgr2=0x7f8cf00b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 --2- 172.21.15.50:0/811411373 >> v2:172.21.15.117:3300/0 conn(0x7f8cf0069db0 0x7f8cf00b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00c9330 con 0x7f8cf00c9b30 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f8cd8001670 con 0x7f8cf00c9b30 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 >> v1:172.21.15.50:6789/0 conn(0x7f8cf00c9b30 legacy=0x7f8cf00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cdc003970 0x7f8cdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 0x7f8cdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c8db0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c9050 con 0x7f8cdc003970 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc00b980 con 0x7f8cf015ccb0 2023-08-10T10:45:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.061+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ceeffd640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cdc003970 0x7f8cdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ce7fff640 1 -- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 msgr2=0x7f8cdc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf015ccb0 0x7f8cdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ce7fff640 1 -- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cdc003970 msgr2=0x7f8cdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cdc003970 0x7f8cdc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.062+0000 7f8ce7fff640 1 -- 172.21.15.50:0/811411373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc003520 con 0x7f8cdc0047c0 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.063+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cdc004c40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00c9f90 tx=0x7f8cdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e91c34d4d19d6c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.063+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8005ad0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.063+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8005c30 con 0x7f8cdc0047c0 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.063+0000 7f8cee7fc640 1 -- 172.21.15.50:0/811411373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd802c890 con 0x7f8cdc0047c0 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 -- 172.21.15.50:0/811411373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 msgr2=0x7f8cdc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 --2- 172.21.15.50:0/811411373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cdc004c40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00c9f90 tx=0x7f8cdc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cef7fe640 1 -- 172.21.15.50:0/811411373 reap_dead start 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 -- 172.21.15.50:0/811411373 shutdown_connections 2023-08-10T10:45:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 -- 172.21.15.50:0/811411373 >> 172.21.15.50:0/811411373 conn(0x7f8cf006b590 msgr2=0x7f8cf00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 -- 172.21.15.50:0/811411373 shutdown_connections 2023-08-10T10:45:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.064+0000 7f8cf5957640 1 -- 172.21.15.50:0/811411373 wait complete. 2023-08-10T10:45:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.066+0000 7f8cf5957640 1 Processor -- start 2023-08-10T10:45:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.066+0000 7f8cf5957640 1 -- start start 2023-08-10T10:45:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf01586a0 0x7f8cf00c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf0157e10 0x7f8cf015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c2930 con 0x7f8cdc0047c0 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf015fa10 con 0x7f8cf01586a0 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8cf5957640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c2eb0 con 0x7f8cf0157e10 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8ceeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8ceeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42798/0 (socket says 172.21.15.50:42798) 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.067+0000 7f8ceeffd640 1 -- 172.21.15.50:0/49981062 learned_addr learned my addr 172.21.15.50:0/49981062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf01586a0 0x7f8cf00c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8cef7fe640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf0157e10 0x7f8cf015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 -- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf0157e10 msgr2=0x7f8cf015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf0157e10 0x7f8cf015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 -- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf01586a0 msgr2=0x7f8cf00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf01586a0 0x7f8cf00c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 -- 172.21.15.50:0/49981062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00c44c0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.068+0000 7f8ceeffd640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0010890 tx=0x7f8ce0010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.069+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0009610 con 0x7f8cdc0047c0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.069+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000eb60 con 0x7f8cdc0047c0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.069+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce001c400 con 0x7f8cdc0047c0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.069+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf00c47a0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.069+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00c2b40 con 0x7f8cdc0047c0 2023-08-10T10:45:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.070+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf004e270 con 0x7f8cdc0047c0 2023-08-10T10:45:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.071+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ce001c560 con 0x7f8cdc0047c0 2023-08-10T10:45:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.072+0000 7f8cecff9640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 0x7f8cd006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.072+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f8ce0089aa0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.072+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 0x7f8cd006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.073+0000 7f8ce7fff640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 0x7f8cd006d140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8034000 tx=0x7f8cd8007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.076+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ce0054ae0 con 0x7f8cdc0047c0 2023-08-10T10:45:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.312+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cf00b1070 con 0x7f8cdc0047c0 2023-08-10T10:45:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.314+0000 7f8cecff9640 1 -- 172.21.15.50:0/49981062 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f8ce0058100 con 0x7f8cdc0047c0 2023-08-10T10:45:15.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:15.316 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:45:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:45:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.316+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 msgr2=0x7f8cd006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 0x7f8cd006d140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8034000 tx=0x7f8cd8007000 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 msgr2=0x7f8cf0158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0010890 tx=0x7f8ce0010d50 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 shutdown_connections 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cf0157e10 0x7f8cf015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8cd006ac80 0x7f8cd006d140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf01586a0 0x7f8cf00c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 --2- 172.21.15.50:0/49981062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc0047c0 0x7f8cf0158bd0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 >> 172.21.15.50:0/49981062 conn(0x7f8cf006b590 msgr2=0x7f8cf015ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 shutdown_connections 2023-08-10T10:45:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.317+0000 7f8cf5957640 1 -- 172.21.15.50:0/49981062 wait complete. 2023-08-10T10:45:15.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.570+0000 7f4cad142640 1 Processor -- start 2023-08-10T10:45:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.570+0000 7f4cad142640 1 -- start start 2023-08-10T10:45:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cad142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4ca80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cad142640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca80cc5a0 con 0x7f4ca80cd290 2023-08-10T10:45:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cad142640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca815d720 con 0x7f4ca80c9d00 2023-08-10T10:45:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cad142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80b4170 con 0x7f4ca8159830 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cac941640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ca80cd290 0x7f4ca80cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44930/0 (socket says 172.21.15.50:44930) 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4cac941640 1 -- 172.21.15.50:0/1983849373 learned_addr learned my addr 172.21.15.50:0/1983849373 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.572+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4ca80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575439720 0 0) 0x7f4ca80cc5a0 con 0x7f4ca80cd290 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c94003520 con 0x7f4ca80cd290 2023-08-10T10:45:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959248495 0 0) 0x7f4c94003520 con 0x7f4ca80cd290 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 msgr2=0x7f4ca80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4ca80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 >> v1:172.21.15.117:6789/0 conn(0x7f4ca80c9d00 legacy=0x7f4ca815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8159c10 con 0x7f4ca80cd290 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4ca0001670 con 0x7f4ca80cd290 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 >> v1:172.21.15.50:6789/0 conn(0x7f4ca80cd290 legacy=0x7f4ca80cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4c94003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4c940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94004d00 0x7f4c94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9400ba60 con 0x7f4c94003a10 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9400bbd0 con 0x7f4c94004d00 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.573+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9400bd90 con 0x7f4ca8159830 2023-08-10T10:45:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4c94003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4cac941640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94004d00 0x7f4c94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca77fe640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4c940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 -- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 msgr2=0x7f4c940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca8159830 0x7f4c940047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 -- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94004d00 msgr2=0x7f4c94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94004d00 0x7f4c94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4ca7fff640 1 -- 172.21.15.50:0/1983849373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94003520 con 0x7f4c94003a10 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.574+0000 7f4cac941640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94004d00 0x7f4c94005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.575+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4c94003e30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009f90 tx=0x7f4c940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ff8a5bcdab7618 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.575+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9802cb30 con 0x7f4c94003a10 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800f040 con 0x7f4c94003a10 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4ca6ffd640 1 -- 172.21.15.50:0/1983849373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98034440 con 0x7f4c94003a10 2023-08-10T10:45:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 -- 172.21.15.50:0/1983849373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 msgr2=0x7f4c94003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 --2- 172.21.15.50:0/1983849373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4c94003e30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009f90 tx=0x7f4c940057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cac941640 1 -- 172.21.15.50:0/1983849373 reap_dead start 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 -- 172.21.15.50:0/1983849373 shutdown_connections 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 -- 172.21.15.50:0/1983849373 >> 172.21.15.50:0/1983849373 conn(0x7f4ca806ab80 msgr2=0x7f4ca806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 -- 172.21.15.50:0/1983849373 shutdown_connections 2023-08-10T10:45:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.576+0000 7f4cad142640 1 -- 172.21.15.50:0/1983849373 wait complete. 2023-08-10T10:45:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.578+0000 7f4cad142640 1 Processor -- start 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.578+0000 7f4cad142640 1 -- start start 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca80c1fa0 0x7f4ca806e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca80b03c0 0x7f4ca806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80c30b0 con 0x7f4c94003a10 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8159220 con 0x7f4ca80b03c0 2023-08-10T10:45:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4cad142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80c2430 con 0x7f4ca80c1fa0 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42820/0 (socket says 172.21.15.50:42820) 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.579+0000 7f4ca7fff640 1 -- 172.21.15.50:0/3017780798 learned_addr learned my addr 172.21.15.50:0/3017780798 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 -- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca80c1fa0 msgr2=0x7f4ca806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca80c1fa0 0x7f4ca806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 -- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca80b03c0 msgr2=0x7f4ca806ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca80b03c0 0x7f4ca806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 -- 172.21.15.50:0/3017780798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80c2710 con 0x7f4c94003a10 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.580+0000 7f4ca7fff640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4c9802c4d0 tx=0x7f4c98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.581+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98034d40 con 0x7f4c94003a10 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.581+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98040450 con 0x7f4c94003a10 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.581+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca80c29f0 con 0x7f4c94003a10 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.581+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98040800 con 0x7f4c94003a10 2023-08-10T10:45:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.581+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8071460 con 0x7f4c94003a10 2023-08-10T10:45:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.582+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8066e30 con 0x7f4c94003a10 2023-08-10T10:45:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.583+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c98040960 con 0x7f4c94003a10 2023-08-10T10:45:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.584+0000 7f4ca4ff9640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 0x7f4c8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.584+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4c980abce0 con 0x7f4c94003a10 2023-08-10T10:45:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.584+0000 7f4ca77fe640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 0x7f4c8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:15.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.585+0000 7f4ca77fe640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 0x7f4c8806d110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80ad8b0 tx=0x7f4c90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:15.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.588+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4c98076d00 con 0x7f4c94003a10 2023-08-10T10:45:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.780+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca80cd070 con 0x7f4c94003a10 2023-08-10T10:45:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.782+0000 7f4ca4ff9640 1 -- 172.21.15.50:0/3017780798 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18489 (secure 0 0 0) 0x7f4c9807a320 con 0x7f4c94003a10 2023-08-10T10:45:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:15.784 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":118,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:09.860818+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:15.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.784+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 msgr2=0x7f4c8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.784+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 0x7f4c8806d110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80ad8b0 tx=0x7f4c90009040 comp rx=0 tx=0).stop 2023-08-10T10:45:15.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.784+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 msgr2=0x7f4ca8158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:15.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.784+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4c9802c4d0 tx=0x7f4c98009750 comp rx=0 tx=0).stop 2023-08-10T10:45:15.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 shutdown_connections 2023-08-10T10:45:15.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c8806ac50 0x7f4c8806d110 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca80b03c0 0x7f4ca806ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ca80c1fa0 0x7f4ca806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 --2- 172.21.15.50:0/3017780798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c94003a10 0x7f4ca8158ce0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:15.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 >> 172.21.15.50:0/3017780798 conn(0x7f4ca806ab80 msgr2=0x7f4ca80c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:15.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 shutdown_connections 2023-08-10T10:45:15.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:15.785+0000 7f4cad142640 1 -- 172.21.15.50:0/3017780798 wait complete. 2023-08-10T10:45:15.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:44:34.361887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:44:34.998347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:15.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:16.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.035+0000 7efff7322640 1 Processor -- start 2023-08-10T10:45:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.035+0000 7efff7322640 1 -- start start 2023-08-10T10:45:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff7322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 0x7efff00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff7322640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006d330 con 0x7efff00b2ff0 2023-08-10T10:45:16.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff7322640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff00d04a0 con 0x7efff006c240 2023-08-10T10:45:16.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff7322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff0159db0 con 0x7efff00cb780 2023-08-10T10:45:16.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff6b21640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efff00b2ff0 0x7efff00b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44942/0 (socket says 172.21.15.50:44942) 2023-08-10T10:45:16.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.037+0000 7efff6b21640 1 -- 172.21.15.50:0/797700443 learned_addr learned my addr 172.21.15.50:0/797700443 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff6320640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 0x7efff00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508561052 0 0) 0x7efff006d330 con 0x7efff00b2ff0 2023-08-10T10:45:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effdc003520 con 0x7efff00b2ff0 2023-08-10T10:45:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318809189 0 0) 0x7effdc003520 con 0x7efff00b2ff0 2023-08-10T10:45:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 msgr2=0x7efff00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 0x7efff00cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 >> v1:172.21.15.117:6789/0 conn(0x7efff006c240 legacy=0x7efff00b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00b1e50 con 0x7efff00b2ff0 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7effe80019f0 con 0x7efff00b2ff0 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 >> v1:172.21.15.50:6789/0 conn(0x7efff00b2ff0 legacy=0x7efff00b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.038+0000 7efff531e640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7effdc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff531e640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 0x7effdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff531e640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc004d00 0x7effdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0159db0 con 0x7effdc003a10 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc00dca0 con 0x7effdc004d00 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc00de60 con 0x7efff00cb780 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7effdc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 -- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 msgr2=0x7effdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff00cb780 0x7effdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 -- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc004d00 msgr2=0x7effdc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6b21640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc004d00 0x7effdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc004d00 0x7effdc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6320640 1 -- 172.21.15.50:0/797700443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc003520 con 0x7effdc003a10 2023-08-10T10:45:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.039+0000 7efff6b21640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc004d00 0x7effdc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff6320640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7effdc003e30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7effec009a90 tx=0x7effdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd80dadcb7412a75 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02c600 con 0x7effdc003a10 2023-08-10T10:45:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec02c760 con 0x7effdc003a10 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff531e640 1 -- 172.21.15.50:0/797700443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02caf0 con 0x7effdc003a10 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff7322640 1 -- 172.21.15.50:0/797700443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 msgr2=0x7effdc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff7322640 1 --2- 172.21.15.50:0/797700443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7effdc003e30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7effec009a90 tx=0x7effdc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.041+0000 7efff6b21640 1 -- 172.21.15.50:0/797700443 reap_dead start 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.042+0000 7efff7322640 1 -- 172.21.15.50:0/797700443 shutdown_connections 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.042+0000 7efff7322640 1 -- 172.21.15.50:0/797700443 >> 172.21.15.50:0/797700443 conn(0x7efff00b2500 msgr2=0x7efff00b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.042+0000 7efff7322640 1 -- 172.21.15.50:0/797700443 shutdown_connections 2023-08-10T10:45:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.042+0000 7efff7322640 1 -- 172.21.15.50:0/797700443 wait complete. 2023-08-10T10:45:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.044+0000 7efff7322640 1 Processor -- start 2023-08-10T10:45:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.044+0000 7efff7322640 1 -- start start 2023-08-10T10:45:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff0158260 0x7efff00c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efff00ce050 0x7efff00ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00cea10 con 0x7effdc003a10 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c4fd0 con 0x7efff00ce050 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff7322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c52b0 con 0x7efff0158260 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff6320640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff6320640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42842/0 (socket says 172.21.15.50:42842) 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.045+0000 7efff6320640 1 -- 172.21.15.50:0/913252962 learned_addr learned my addr 172.21.15.50:0/913252962 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6b21640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efff00ce050 0x7efff00ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 -- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff0158260 msgr2=0x7efff00c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff5b1f640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff0158260 0x7efff00c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff0158260 0x7efff00c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 -- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efff00ce050 msgr2=0x7efff00ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efff00ce050 0x7efff00ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 -- 172.21.15.50:0/913252962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00c5590 con 0x7effdc003a10 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff6320640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7effec009a90 tx=0x7effec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003810 con 0x7effdc003a10 2023-08-10T10:45:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec003970 con 0x7effdc003a10 2023-08-10T10:45:16.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.046+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00c5870 con 0x7effdc003a10 2023-08-10T10:45:16.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.047+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003d20 con 0x7effdc003a10 2023-08-10T10:45:16.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.047+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00c4bc0 con 0x7effdc003a10 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.048+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0066e30 con 0x7effdc003a10 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.049+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effec040450 con 0x7effdc003a10 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.050+0000 7effe6ffd640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 0x7effd406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.050+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7effec0ab3d0 con 0x7effdc003a10 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.050+0000 7efff5b1f640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 0x7effd406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.051+0000 7efff5b1f640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 0x7effd406d140 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efff0066900 tx=0x7effe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.054+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7effec0763f0 con 0x7effdc003a10 2023-08-10T10:45:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.245+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efff0159740 con 0x7effdc003a10 2023-08-10T10:45:16.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.246+0000 7effe6ffd640 1 -- 172.21.15.50:0/913252962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7effec0044e0 con 0x7effdc003a10 2023-08-10T10:45:16.247 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 msgr2=0x7effd406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 0x7effd406d140 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efff0066900 tx=0x7effe0009040 comp rx=0 tx=0).stop 2023-08-10T10:45:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 msgr2=0x7efff014b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7effec009a90 tx=0x7effec004730 comp rx=0 tx=0).stop 2023-08-10T10:45:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 shutdown_connections 2023-08-10T10:45:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7effd406ac80 0x7effd406d140 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efff00ce050 0x7efff00ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efff0158260 0x7efff00c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 --2- 172.21.15.50:0/913252962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc003a10 0x7efff014b390 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.248+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 >> 172.21.15.50:0/913252962 conn(0x7efff00b2500 msgr2=0x7efff00b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.249+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 shutdown_connections 2023-08-10T10:45:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.249+0000 7efff7322640 1 -- 172.21.15.50:0/913252962 wait complete. 2023-08-10T10:45:16.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.494+0000 7f00cb18b640 1 Processor -- start 2023-08-10T10:45:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.494+0000 7f00cb18b640 1 -- start start 2023-08-10T10:45:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00c415cb90 0x7f00c40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00c415cf70 0x7f00c4160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 0x7f00c4161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c4160a40 con 0x7f00c415cf70 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40b4bb0 con 0x7f00c415cb90 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00cb18b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b4e90 con 0x7f00c40b4640 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00c415cf70 0x7f00c4160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00c415cf70 0x7f00c4160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42848/0 (socket says 172.21.15.50:42848) 2023-08-10T10:45:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00bbfff640 1 -- 172.21.15.50:0/51334841 learned_addr learned my addr 172.21.15.50:0/51334841 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.496+0000 7f00c8f27640 1 --2- 172.21.15.50:0/51334841 >> v2:172.21.15.117:3300/0 conn(0x7f00c415cb90 0x7f00c40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00c9728640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 0x7f00c4161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00bbfff640 1 -- 172.21.15.50:0/51334841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 msgr2=0x7f00c4161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00bbfff640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 0x7f00c4161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00bbfff640 1 -- 172.21.15.50:0/51334841 >> v2:172.21.15.117:3300/0 conn(0x7f00c415cb90 msgr2=0x7f00c40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00bbfff640 1 --2- 172.21.15.50:0/51334841 >> v2:172.21.15.117:3300/0 conn(0x7f00c415cb90 0x7f00c40b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00bbfff640 1 -- 172.21.15.50:0/51334841 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40b5170 con 0x7f00c415cf70 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.497+0000 7f00c9728640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 0x7f00c4161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.498+0000 7f00bbfff640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c4160ed0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f00c40d02c0 tx=0x7f00b402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef39c4c3b68d29d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.498+0000 7f00bb7fe640 1 -- 172.21.15.50:0/51334841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4031880 con 0x7f00c415cf70 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.498+0000 7f00bb7fe640 1 -- 172.21.15.50:0/51334841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b40319e0 con 0x7f00c415cf70 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.498+0000 7f00bb7fe640 1 -- 172.21.15.50:0/51334841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4031d70 con 0x7f00c415cf70 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 -- 172.21.15.50:0/51334841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 msgr2=0x7f00c4160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c4160ed0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f00c40d02c0 tx=0x7f00b402b920 comp rx=0 tx=0).stop 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 -- 172.21.15.50:0/51334841 shutdown_connections 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40b4640 0x7f00c4161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 --2- 172.21.15.50:0/51334841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c4160ed0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 --2- 172.21.15.50:0/51334841 >> v2:172.21.15.117:3300/0 conn(0x7f00c415cb90 0x7f00c40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 -- 172.21.15.50:0/51334841 >> 172.21.15.50:0/51334841 conn(0x7f00c40cf640 msgr2=0x7f00c40cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 -- 172.21.15.50:0/51334841 shutdown_connections 2023-08-10T10:45:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.499+0000 7f00cb18b640 1 -- 172.21.15.50:0/51334841 wait complete. 2023-08-10T10:45:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.501+0000 7f00cb18b640 1 Processor -- start 2023-08-10T10:45:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.501+0000 7f00cb18b640 1 -- start start 2023-08-10T10:45:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 0x7f00c40c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 0x7f00c41536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4153be0 con 0x7f00c415cf70 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415ecd0 con 0x7f00c40b4640 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00cb18b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4153dd0 con 0x7f00c415cb90 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00c9728640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00c9728640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42864/0 (socket says 172.21.15.50:42864) 2023-08-10T10:45:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.502+0000 7f00c9728640 1 -- 172.21.15.50:0/682965261 learned_addr learned my addr 172.21.15.50:0/682965261 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c8f27640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 0x7f00c40c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00bbfff640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 0x7f00c41536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 -- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 msgr2=0x7f00c41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 0x7f00c41536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 -- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 msgr2=0x7f00c40c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 0x7f00c40c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 -- 172.21.15.50:0/682965261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40094d0 con 0x7f00c415cf70 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00bbfff640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 0x7f00c41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c8f27640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 0x7f00c40c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.503+0000 7f00c9728640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00cef0 tx=0x7f00bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.504+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00d840 con 0x7f00c415cf70 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.504+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc00d9a0 con 0x7f00c415cf70 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.504+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00dd50 con 0x7f00c415cf70 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.504+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c415e3a0 con 0x7f00c415cf70 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.504+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c415e960 con 0x7f00c415cf70 2023-08-10T10:45:16.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.505+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c415ee40 con 0x7f00c415cf70 2023-08-10T10:45:16.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.506+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00bc01e3b0 con 0x7f00c415cf70 2023-08-10T10:45:16.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.507+0000 7f00b97fa640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 0x7f00b006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.507+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f00bc089fa0 con 0x7f00c415cf70 2023-08-10T10:45:16.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.508+0000 7f00c8f27640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 0x7f00b006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.508+0000 7f00c8f27640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 0x7f00b006d0e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00c0006fd0 tx=0x7f00c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.512+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00bc054fc0 con 0x7f00c415cf70 2023-08-10T10:45:16.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.707+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00c40612b0 con 0x7f00c415cf70 2023-08-10T10:45:16.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.707+0000 7f00b97fa640 1 -- 172.21.15.50:0/682965261 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00bc01a0a0 con 0x7f00c415cf70 2023-08-10T10:45:16.709 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:16.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 msgr2=0x7f00b006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 0x7f00b006d0e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00c0006fd0 tx=0x7f00c0008040 comp rx=0 tx=0).stop 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 msgr2=0x7f00c40c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00cef0 tx=0x7f00bc00a710 comp rx=0 tx=0).stop 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 shutdown_connections 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c415cf70 0x7f00c40c6f40 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c415cb90 0x7f00c41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00b006ac20 0x7f00b006d0e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 --2- 172.21.15.50:0/682965261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40b4640 0x7f00c40c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 >> 172.21.15.50:0/682965261 conn(0x7f00c40cf640 msgr2=0x7f00c41572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:16.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 shutdown_connections 2023-08-10T10:45:16.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.710+0000 7f00cb18b640 1 -- 172.21.15.50:0/682965261 wait complete. 2023-08-10T10:45:16.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:45:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.960+0000 7f3f5c86a640 1 Processor -- start 2023-08-10T10:45:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.960+0000 7f3f5c86a640 1 -- start start 2023-08-10T10:45:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.962+0000 7f3f5c86a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3f5806cb30 0x7f3f580b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.962+0000 7f3f5c86a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5806c320 con 0x7f3f580cd9b0 2023-08-10T10:45:16.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.962+0000 7f3f5c86a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5806b770 con 0x7f3f5815ae40 2023-08-10T10:45:16.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.962+0000 7f3f5c86a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5806b9f0 con 0x7f3f5806cb30 2023-08-10T10:45:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.963+0000 7f3f4dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f580cd9b0 0x7f3f580c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44956/0 (socket says 172.21.15.50:44956) 2023-08-10T10:45:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.963+0000 7f3f4dd9b640 1 -- 172.21.15.50:0/1328313548 learned_addr learned my addr 172.21.15.50:0/1328313548 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.963+0000 7f3f56d9d640 1 --2- 172.21.15.50:0/1328313548 >> v2:172.21.15.117:3300/0 conn(0x7f3f5806cb30 0x7f3f580b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.963+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894069962 0 0) 0x7f3f5806c320 con 0x7f3f580cd9b0 2023-08-10T10:45:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.963+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003520 con 0x7f3f580cd9b0 2023-08-10T10:45:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.964+0000 7f3f56d9d640 1 -- 172.21.15.50:0/1328313548 >> v1:172.21.15.117:6789/0 conn(0x7f3f5815ae40 legacy=0x7f3f580cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.964+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614929131 0 0) 0x7f3f44003520 con 0x7f3f580cd9b0 2023-08-10T10:45:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.964+0000 7f3f56d9d640 1 -- 172.21.15.50:0/1328313548 >> v1:172.21.15.50:6789/0 conn(0x7f3f580cd9b0 legacy=0x7f3f580c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.964+0000 7f3f56d9d640 1 -- 172.21.15.50:0/1328313548 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5806bcd0 con 0x7f3f5806cb30 2023-08-10T10:45:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.965+0000 7f3f56d9d640 1 --2- 172.21.15.50:0/1328313548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5806cb30 0x7f3f580b1510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097a0 tx=0x7f3f5002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540c0086efbe98d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.965+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5002f050 con 0x7f3f5806cb30 2023-08-10T10:45:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.965+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50031500 con 0x7f3f5806cb30 2023-08-10T10:45:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.965+0000 7f3f55d9b640 1 -- 172.21.15.50:0/1328313548 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40001670 con 0x7f3f5806cb30 2023-08-10T10:45:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 -- 172.21.15.50:0/1328313548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5806cb30 msgr2=0x7f3f580b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/1328313548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5806cb30 0x7f3f580b1510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097a0 tx=0x7f3f5002b820 comp rx=0 tx=0).stop 2023-08-10T10:45:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 -- 172.21.15.50:0/1328313548 shutdown_connections 2023-08-10T10:45:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/1328313548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5806cb30 0x7f3f580b1510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 -- 172.21.15.50:0/1328313548 >> 172.21.15.50:0/1328313548 conn(0x7f3f580b01b0 msgr2=0x7f3f580b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 -- 172.21.15.50:0/1328313548 shutdown_connections 2023-08-10T10:45:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.966+0000 7f3f5c86a640 1 -- 172.21.15.50:0/1328313548 wait complete. 2023-08-10T10:45:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.968+0000 7f3f5c86a640 1 Processor -- start 2023-08-10T10:45:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.968+0000 7f3f5c86a640 1 -- start start 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f580cd9b0 0x7f3f580703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 0x7f3f580ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581f5e50 con 0x7f3f5806cb30 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581f6130 con 0x7f3f5815ae40 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5c86a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581f6410 con 0x7f3f580cd9b0 2023-08-10T10:45:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42866/0 (socket says 172.21.15.50:42866) 2023-08-10T10:45:16.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.969+0000 7f3f5659c640 1 -- 172.21.15.50:0/2460483199 learned_addr learned my addr 172.21.15.50:0/2460483199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f4dd9b640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f580cd9b0 0x7f3f580703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 -- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f580cd9b0 msgr2=0x7f3f580703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f580cd9b0 0x7f3f580703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f56d9d640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 0x7f3f580ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 -- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 msgr2=0x7f3f580ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 0x7f3f580ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 -- 172.21.15.50:0/2460483199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009400 con 0x7f3f5806cb30 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f56d9d640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 0x7f3f580ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.970+0000 7f3f5659c640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c730 tx=0x7f3f4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.971+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48003b70 con 0x7f3f5806cb30 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.971+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48003cf0 con 0x7f3f5806cb30 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.971+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48003ea0 con 0x7f3f5806cb30 2023-08-10T10:45:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.971+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f581f66f0 con 0x7f3f5806cb30 2023-08-10T10:45:16.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.971+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f58070930 con 0x7f3f5806cb30 2023-08-10T10:45:16.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.972+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f580612b0 con 0x7f3f5806cb30 2023-08-10T10:45:16.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.973+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f4800aa90 con 0x7f3f5806cb30 2023-08-10T10:45:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.974+0000 7f3f4f7fe640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 0x7f3f3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.974+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3f48089400 con 0x7f3f5806cb30 2023-08-10T10:45:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.974+0000 7f3f4dd9b640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 0x7f3f3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.975+0000 7f3f4dd9b640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 0x7f3f3806d110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3f400017a0 tx=0x7f3f40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:16.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:16.978+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f48054390 con 0x7f3f5806cb30 2023-08-10T10:45:17.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.169+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f58065520 con 0x7f3f5806cb30 2023-08-10T10:45:17.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.170+0000 7f3f4f7fe640 1 -- 172.21.15.50:0/2460483199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f480579b0 con 0x7f3f5806cb30 2023-08-10T10:45:17.172 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:45:17.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 msgr2=0x7f3f3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 0x7f3f3806d110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3f400017a0 tx=0x7f3f40009040 comp rx=0 tx=0).stop 2023-08-10T10:45:17.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 msgr2=0x7f3f58158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c730 tx=0x7f3f4800cbf0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 shutdown_connections 2023-08-10T10:45:17.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3f3806ac50 0x7f3f3806d110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5815ae40 0x7f3f580ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f580cd9b0 0x7f3f580703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 --2- 172.21.15.50:0/2460483199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f5806cb30 0x7f3f58158ad0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 >> 172.21.15.50:0/2460483199 conn(0x7f3f580b01b0 msgr2=0x7f3f580cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 shutdown_connections 2023-08-10T10:45:17.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.173+0000 7f3f5c86a640 1 -- 172.21.15.50:0/2460483199 wait complete. 2023-08-10T10:45:17.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:45:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.421+0000 7f45e1245640 1 Processor -- start 2023-08-10T10:45:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.421+0000 7f45e1245640 1 -- start start 2023-08-10T10:45:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.423+0000 7f45e1245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.423+0000 7f45e1245640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45dc069db0 0x7f45dc0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.423+0000 7f45e1245640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0ccff0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.423+0000 7f45e1245640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0cdca0 con 0x7f45dc069db0 2023-08-10T10:45:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.423+0000 7f45e1245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0cdf80 con 0x7f45dc1599e0 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45e0a44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45dc069db0 0x7f45dc0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45dbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45db7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f45dc0c8b50 0x7f45dc0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:39060/0 (socket says 172.21.15.50:39060) 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45dbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:35796/0 (socket says 172.21.15.50:35796) 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45e0a44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45dc069db0 0x7f45dc0b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:41082/0 (socket says 172.21.15.50:41082) 2023-08-10T10:45:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.424+0000 7f45db7fe640 1 -- 172.21.15.50:0/2739764072 learned_addr learned my addr 172.21.15.50:0/2739764072 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.425+0000 7f45e0a44640 1 -- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 msgr2=0x7f45dc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.425+0000 7f45e0a44640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.425+0000 7f45e0a44640 1 -- 172.21.15.50:0/2739764072 >> v1:172.21.15.117:6789/0 conn(0x7f45dc0c8b50 legacy=0x7f45dc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.425+0000 7f45e0a44640 1 -- 172.21.15.50:0/2739764072 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0b2910 con 0x7f45dc069db0 2023-08-10T10:45:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.425+0000 7f45dbfff640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:45:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.426+0000 7f45e0a44640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0b3110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009d90 tx=0x7f45d402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72020c3200d6d9a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.426+0000 7f45daffd640 1 -- 172.21.15.50:0/2739764072 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d402cc60 con 0x7f45dc069db0 2023-08-10T10:45:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45daffd640 1 -- 172.21.15.50:0/2739764072 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d402cdc0 con 0x7f45dc069db0 2023-08-10T10:45:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45daffd640 1 -- 172.21.15.50:0/2739764072 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4034660 con 0x7f45dc069db0 2023-08-10T10:45:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 -- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 msgr2=0x7f45dc0b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0b3110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009d90 tx=0x7f45d402beb0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 -- 172.21.15.50:0/2739764072 shutdown_connections 2023-08-10T10:45:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0b3110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 --2- 172.21.15.50:0/2739764072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 -- 172.21.15.50:0/2739764072 >> 172.21.15.50:0/2739764072 conn(0x7f45dc0caf80 msgr2=0x7f45dc0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 -- 172.21.15.50:0/2739764072 shutdown_connections 2023-08-10T10:45:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.427+0000 7f45e1245640 1 -- 172.21.15.50:0/2739764072 wait complete. 2023-08-10T10:45:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.429+0000 7f45e1245640 1 Processor -- start 2023-08-10T10:45:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.429+0000 7f45e1245640 1 -- start start 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c39e0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c3550 con 0x7f45dc069db0 2023-08-10T10:45:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.430+0000 7f45e1245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc154630 con 0x7f45dc1599e0 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42876/0 (socket says 172.21.15.50:42876) 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 -- 172.21.15.50:0/2303603484 learned_addr learned my addr 172.21.15.50:0/2303603484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45e0a44640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45dbfff640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 -- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 msgr2=0x7f45dc0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 -- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 msgr2=0x7f45dc0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45db7fe640 1 -- 172.21.15.50:0/2303603484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc009400 con 0x7f45dc0c8b50 2023-08-10T10:45:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.431+0000 7f45dbfff640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45db7fe640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c480 tx=0x7f45d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0005ce0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0005e40 con 0x7f45dc0c8b50 2023-08-10T10:45:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d4009a70 con 0x7f45dc0c8b50 2023-08-10T10:45:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00072f0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.432+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc0c2c20 con 0x7f45dc0c8b50 2023-08-10T10:45:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.433+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc0cd8d0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.434+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45d0007450 con 0x7f45dc0c8b50 2023-08-10T10:45:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.435+0000 7f45d8ff9640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 0x7f45c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.435+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f45d00889e0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.436+0000 7f45dbfff640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 0x7f45c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.436+0000 7f45dbfff640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 0x7f45c806d110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d20 tx=0x7f45cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.440+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f45d0053ab0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.630+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45dc066e30 con 0x7f45dc0c8b50 2023-08-10T10:45:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.631+0000 7f45d8ff9640 1 -- 172.21.15.50:0/2303603484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45d00170a0 con 0x7f45dc0c8b50 2023-08-10T10:45:17.632 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:45:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.633+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 msgr2=0x7f45c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.633+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 0x7f45c806d110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d20 tx=0x7f45cc008040 comp rx=0 tx=0).stop 2023-08-10T10:45:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.633+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 msgr2=0x7f45dc0c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.633+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c480 tx=0x7f45d000c940 comp rx=0 tx=0).stop 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 shutdown_connections 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45dc1599e0 0x7f45dc0c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0c8b50 0x7f45dc0c1dd0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f45c806ac50 0x7f45c806d110 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 --2- 172.21.15.50:0/2303603484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45dc069db0 0x7f45dc0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 >> 172.21.15.50:0/2303603484 conn(0x7f45dc0caf80 msgr2=0x7f45dc0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 shutdown_connections 2023-08-10T10:45:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.634+0000 7f45e1245640 1 -- 172.21.15.50:0/2303603484 wait complete. 2023-08-10T10:45:17.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.875+0000 7f4e4f342640 1 Processor -- start 2023-08-10T10:45:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.875+0000 7f4e4f342640 1 -- start start 2023-08-10T10:45:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.876+0000 7f4e4f342640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e480696a0 0x7f4e48069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.876+0000 7f4e4f342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e480b1ae0 0x7f4e480b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.876+0000 7f4e4f342640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4815e1f0 con 0x7f4e48159970 2023-08-10T10:45:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4f342640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480b10d0 con 0x7f4e480696a0 2023-08-10T10:45:17.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4f342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4815d5e0 con 0x7f4e480b1ae0 2023-08-10T10:45:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4c8dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e480696a0 0x7f4e48069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4c8dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e480696a0 0x7f4e48069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:41104/0 (socket says 172.21.15.50:41104) 2023-08-10T10:45:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4c8dd640 1 -- 172.21.15.50:0/3265404605 learned_addr learned my addr 172.21.15.50:0/3265404605 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.877+0000 7f4e4d8df640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e480b1ae0 0x7f4e480b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.878+0000 7f4e4c8dd640 1 -- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e480b1ae0 msgr2=0x7f4e480b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.878+0000 7f4e4c8dd640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e480b1ae0 0x7f4e480b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.878+0000 7f4e4c8dd640 1 -- 172.21.15.50:0/3265404605 >> v1:172.21.15.117:6789/0 conn(0x7f4e48159970 legacy=0x7f4e480b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.878+0000 7f4e4c8dd640 1 -- 172.21.15.50:0/3265404605 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4806a040 con 0x7f4e480696a0 2023-08-10T10:45:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.880+0000 7f4e4c8dd640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480696a0 0x7f4e48069b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c8df865874e2e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.880+0000 7f4e3ffff640 1 -- 172.21.15.50:0/3265404605 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38030840 con 0x7f4e480696a0 2023-08-10T10:45:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.880+0000 7f4e3ffff640 1 -- 172.21.15.50:0/3265404605 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380309a0 con 0x7f4e480696a0 2023-08-10T10:45:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.880+0000 7f4e3ffff640 1 -- 172.21.15.50:0/3265404605 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38030d30 con 0x7f4e480696a0 2023-08-10T10:45:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 -- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480696a0 msgr2=0x7f4e48069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480696a0 0x7f4e48069b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3802b980 comp rx=0 tx=0).stop 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 -- 172.21.15.50:0/3265404605 shutdown_connections 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e480b1ae0 0x7f4e480b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 --2- 172.21.15.50:0/3265404605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480696a0 0x7f4e48069b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 -- 172.21.15.50:0/3265404605 >> 172.21.15.50:0/3265404605 conn(0x7f4e4806b590 msgr2=0x7f4e480ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 -- 172.21.15.50:0/3265404605 shutdown_connections 2023-08-10T10:45:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.881+0000 7f4e4f342640 1 -- 172.21.15.50:0/3265404605 wait complete. 2023-08-10T10:45:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.883+0000 7f4e4f342640 1 Processor -- start 2023-08-10T10:45:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.883+0000 7f4e4f342640 1 -- start start 2023-08-10T10:45:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480b1ae0 0x7f4e4814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e48159970 0x7f4e48155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4814e5e0 con 0x7f4e480696a0 2023-08-10T10:45:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e481f2a20 con 0x7f4e480b1ae0 2023-08-10T10:45:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4f342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48155a40 con 0x7f4e48159970 2023-08-10T10:45:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4d0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4d0de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42890/0 (socket says 172.21.15.50:42890) 2023-08-10T10:45:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.884+0000 7f4e4d0de640 1 -- 172.21.15.50:0/2987910488 learned_addr learned my addr 172.21.15.50:0/2987910488 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 -- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e48159970 msgr2=0x7f4e48155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e48159970 0x7f4e48155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4c8dd640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480b1ae0 0x7f4e4814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 -- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480b1ae0 msgr2=0x7f4e4814e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480b1ae0 0x7f4e4814e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 -- 172.21.15.50:0/2987910488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380094d0 con 0x7f4e480696a0 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4d0de640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c730 tx=0x7f4e4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44006d50 con 0x7f4e480696a0 2023-08-10T10:45:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400ce40 con 0x7f4e480696a0 2023-08-10T10:45:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44003bb0 con 0x7f4e480696a0 2023-08-10T10:45:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e481f6d80 con 0x7f4e480696a0 2023-08-10T10:45:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.885+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e481f67c0 con 0x7f4e480696a0 2023-08-10T10:45:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.886+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4804e270 con 0x7f4e480696a0 2023-08-10T10:45:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.888+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e44003d10 con 0x7f4e480696a0 2023-08-10T10:45:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.888+0000 7f4e3dffb640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 0x7f4e2c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.889+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4e44089180 con 0x7f4e480696a0 2023-08-10T10:45:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.889+0000 7f4e4c8dd640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 0x7f4e2c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.890+0000 7f4e4c8dd640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 0x7f4e2c06d110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4e38036000 tx=0x7f4e3803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:17.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:17.892+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4e44057c30 con 0x7f4e480696a0 2023-08-10T10:45:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.119+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e480b18c0 con 0x7f4e480696a0 2023-08-10T10:45:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.120+0000 7f4e3dffb640 1 -- 172.21.15.50:0/2987910488 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4e440577c0 con 0x7f4e480696a0 2023-08-10T10:45:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:18.122 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:45:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.122+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 msgr2=0x7f4e2c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.122+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 0x7f4e2c06d110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4e38036000 tx=0x7f4e3803b040 comp rx=0 tx=0).stop 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 msgr2=0x7f4e481f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c730 tx=0x7f4e4400cbf0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 shutdown_connections 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e48159970 0x7f4e48155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4e2c06ac50 0x7f4e2c06d110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e480b1ae0 0x7f4e4814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 --2- 172.21.15.50:0/2987910488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e480696a0 0x7f4e481f5e70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 >> 172.21.15.50:0/2987910488 conn(0x7f4e4806b590 msgr2=0x7f4e480cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 shutdown_connections 2023-08-10T10:45:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.123+0000 7f4e4f342640 1 -- 172.21.15.50:0/2987910488 wait complete. 2023-08-10T10:45:18.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.367+0000 7fe9ac85d640 1 Processor -- start 2023-08-10T10:45:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.367+0000 7fe9ac85d640 1 -- start start 2023-08-10T10:45:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe9ac85d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a81600f0 0x7fe9a80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe9ac85d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe9a80b0390 0x7fe9a80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe9ac85d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a81604d0 con 0x7fe9a80aff10 2023-08-10T10:45:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe9ac85d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a80cca30 con 0x7fe9a80b0390 2023-08-10T10:45:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe9ac85d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b0820 con 0x7fe9a81600f0 2023-08-10T10:45:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe99ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9a80aff10 0x7fe9a80ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44968/0 (socket says 172.21.15.50:44968) 2023-08-10T10:45:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.369+0000 7fe99ffff640 1 -- 172.21.15.50:0/1815006410 learned_addr learned my addr 172.21.15.50:0/1815006410 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a81600f0 0x7fe9a80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500653513 0 0) 0x7fe9a81604d0 con 0x7fe9a80aff10 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe994003520 con 0x7fe9a80aff10 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/1815006410 >> v2:172.21.15.117:3300/0 conn(0x7fe9a80b0390 0x7fe9a80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727270597 0 0) 0x7fe994003520 con 0x7fe9a80aff10 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a81600f0 msgr2=0x7fe9a80ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a81600f0 0x7fe9a80ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 >> v2:172.21.15.117:3300/0 conn(0x7fe9a80b0390 msgr2=0x7fe9a80cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 --2- 172.21.15.50:0/1815006410 >> v2:172.21.15.117:3300/0 conn(0x7fe9a80b0390 0x7fe9a80cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80cc100 con 0x7fe9a80aff10 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe990001670 con 0x7fe9a80aff10 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 >> v1:172.21.15.50:6789/0 conn(0x7fe9a80aff10 legacy=0x7fe9a80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9940039e0 0x7fe994003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9940047c0 0x7fe994004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe994005180 0x7fe99400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cca30 con 0x7fe994005180 2023-08-10T10:45:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b0820 con 0x7fe9940047c0 2023-08-10T10:45:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.370+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99400c0d0 con 0x7fe9940039e0 2023-08-10T10:45:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a81600f0 0x7fe9a80ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe994005180 0x7fe99400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe99ffff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9940047c0 0x7fe994004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 -- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9940039e0 msgr2=0x7fe994003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9940039e0 0x7fe994003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 -- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9940047c0 msgr2=0x7fe994004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9940047c0 0x7fe994004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe9a7fff640 1 -- 172.21.15.50:0/1815006410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994003520 con 0x7fe994005180 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.371+0000 7fe99ffff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9940047c0 0x7fe994004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.372+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe994005180 0x7fe99400b980 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0007360 tx=0x7fe9940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69074aa3178c7d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.372+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002ccf0 con 0x7fe994005180 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a002ce50 con 0x7fe994005180 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9a6ffd640 1 -- 172.21.15.50:0/1815006410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0034660 con 0x7fe994005180 2023-08-10T10:45:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 -- 172.21.15.50:0/1815006410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe994005180 msgr2=0x7fe99400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/1815006410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe994005180 0x7fe99400b980 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0007360 tx=0x7fe9940057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9a7fff640 1 -- 172.21.15.50:0/1815006410 reap_dead start 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 -- 172.21.15.50:0/1815006410 shutdown_connections 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 -- 172.21.15.50:0/1815006410 >> 172.21.15.50:0/1815006410 conn(0x7fe9a806ab80 msgr2=0x7fe9a806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 -- 172.21.15.50:0/1815006410 shutdown_connections 2023-08-10T10:45:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.373+0000 7fe9ac85d640 1 -- 172.21.15.50:0/1815006410 wait complete. 2023-08-10T10:45:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.375+0000 7fe9ac85d640 1 Processor -- start 2023-08-10T10:45:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.375+0000 7fe9ac85d640 1 -- start start 2023-08-10T10:45:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 0x7fe9a814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a806f2a0 0x7fe9a80709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80714b0 con 0x7fe9a8070f10 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b22c0 con 0x7fe994005180 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9ac85d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b25a0 con 0x7fe9a806f2a0 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.376+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42898/0 (socket says 172.21.15.50:42898) 2023-08-10T10:45:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 -- 172.21.15.50:0/3656928295 learned_addr learned my addr 172.21.15.50:0/3656928295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 0x7fe9a814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe99ffff640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a806f2a0 0x7fe9a80709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 -- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a806f2a0 msgr2=0x7fe9a80709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a806f2a0 0x7fe9a80709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 -- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 msgr2=0x7fe9a814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 0x7fe9a814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 -- 172.21.15.50:0/3656928295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80b2880 con 0x7fe9a8070f10 2023-08-10T10:45:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 0x7fe9a814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.377+0000 7fe9a7fff640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0037040 tx=0x7fe9a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.378+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002ccf0 con 0x7fe9a8070f10 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.378+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a0003990 con 0x7fe9a8070f10 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.378+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0003d20 con 0x7fe9a8070f10 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.378+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a814b1d0 con 0x7fe9a8070f10 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.378+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a80ca7e0 con 0x7fe9a8070f10 2023-08-10T10:45:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.379+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a80b2a70 con 0x7fe9a8070f10 2023-08-10T10:45:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.380+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9a003b050 con 0x7fe9a8070f10 2023-08-10T10:45:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.381+0000 7fe9a4ff9640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 0x7fe98806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.381+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fe9a00ab870 con 0x7fe9a8070f10 2023-08-10T10:45:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.381+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 0x7fe98806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.382+0000 7fe9a77fe640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 0x7fe98806d140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe9a806bc30 tx=0x7fe998008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.385+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe9a0076a50 con 0x7fe9a8070f10 2023-08-10T10:45:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.576+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a8066e30 con 0x7fe9a8070f10 2023-08-10T10:45:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.580+0000 7fe9a4ff9640 1 -- 172.21.15.50:0/3656928295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18489 (secure 0 0 0) 0x7fe9a0039090 con 0x7fe9a8070f10 2023-08-10T10:45:18.582 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:18.582 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":118,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:09.860818+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 msgr2=0x7fe98806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 0x7fe98806d140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe9a806bc30 tx=0x7fe998008040 comp rx=0 tx=0).stop 2023-08-10T10:45:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 msgr2=0x7fe9a80ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0037040 tx=0x7fe9a0004ab0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 shutdown_connections 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a8070f10 0x7fe9a80ca0c0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a806f2a0 0x7fe9a80709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.582+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe98806ac80 0x7fe98806d140 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.583+0000 7fe9ac85d640 1 --2- 172.21.15.50:0/3656928295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe994005180 0x7fe9a814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.583+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 >> 172.21.15.50:0/3656928295 conn(0x7fe9a806ab80 msgr2=0x7fe9a815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.583+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 shutdown_connections 2023-08-10T10:45:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.583+0000 7fe9ac85d640 1 -- 172.21.15.50:0/3656928295 wait complete. 2023-08-10T10:45:18.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:45:18.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.804+0000 7efd86a2a640 1 Processor -- start 2023-08-10T10:45:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.804+0000 7efd86a2a640 1 -- start start 2023-08-10T10:45:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd86a2a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd800b5e50 0x7efd8006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd86a2a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd8006ea90 0x7efd800cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd86a2a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8006eec0 con 0x7efd8015c9c0 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd86a2a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800ce7d0 con 0x7efd8006ea90 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd86a2a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800ce410 con 0x7efd800b5e50 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd85a28640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd8015c9c0 0x7efd80160640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44974/0 (socket says 172.21.15.50:44974) 2023-08-10T10:45:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.805+0000 7efd85a28640 1 -- 172.21.15.50:0/3389347476 learned_addr learned my addr 172.21.15.50:0/3389347476 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd86229640 1 --2- 172.21.15.50:0/3389347476 >> v2:172.21.15.50:3300/0 conn(0x7efd8006ea90 0x7efd800cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797694869 0 0) 0x7efd8006eec0 con 0x7efd8015c9c0 2023-08-10T10:45:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd70003520 con 0x7efd8015c9c0 2023-08-10T10:45:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd85227640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd800b5e50 0x7efd8006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd86229640 1 -- 172.21.15.50:0/3389347476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd800b5e50 msgr2=0x7efd8006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd86229640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd800b5e50 0x7efd8006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd86229640 1 -- 172.21.15.50:0/3389347476 >> v1:172.21.15.50:6789/0 conn(0x7efd8015c9c0 legacy=0x7efd80160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057781990 0 0) 0x7efd70003520 con 0x7efd8015c9c0 2023-08-10T10:45:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.806+0000 7efd86229640 1 -- 172.21.15.50:0/3389347476 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80160e70 con 0x7efd8006ea90 2023-08-10T10:45:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.807+0000 7efd86229640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800cebd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7efd780097a0 tx=0x7efd7802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715d8951224fe0f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.807+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74001a10 con 0x7efd8006ea90 2023-08-10T10:45:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.807+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7802e050 con 0x7efd8006ea90 2023-08-10T10:45:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.807+0000 7efd84a26640 1 -- 172.21.15.50:0/3389347476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78030710 con 0x7efd8006ea90 2023-08-10T10:45:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 -- 172.21.15.50:0/3389347476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 msgr2=0x7efd800cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800cebd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7efd780097a0 tx=0x7efd7802b710 comp rx=0 tx=0).stop 2023-08-10T10:45:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 -- 172.21.15.50:0/3389347476 shutdown_connections 2023-08-10T10:45:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800cebd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 --2- 172.21.15.50:0/3389347476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd800b5e50 0x7efd8006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 -- 172.21.15.50:0/3389347476 >> 172.21.15.50:0/3389347476 conn(0x7efd800d0630 msgr2=0x7efd800d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 -- 172.21.15.50:0/3389347476 shutdown_connections 2023-08-10T10:45:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.808+0000 7efd86a2a640 1 -- 172.21.15.50:0/3389347476 wait complete. 2023-08-10T10:45:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.810+0000 7efd86a2a640 1 Processor -- start 2023-08-10T10:45:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.810+0000 7efd86a2a640 1 -- start start 2023-08-10T10:45:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd800b5e50 0x7efd800cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd8015c9c0 0x7efd800cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd801f2240 con 0x7efd8006ea90 2023-08-10T10:45:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800af650 con 0x7efd800b5e50 2023-08-10T10:45:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd86a2a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd801f24e0 con 0x7efd8015c9c0 2023-08-10T10:45:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd85a28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd85a28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42916/0 (socket says 172.21.15.50:42916) 2023-08-10T10:45:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.811+0000 7efd85a28640 1 -- 172.21.15.50:0/2887646957 learned_addr learned my addr 172.21.15.50:0/2887646957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 -- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd8015c9c0 msgr2=0x7efd800cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd8015c9c0 0x7efd800cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 -- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd800b5e50 msgr2=0x7efd800cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd800b5e50 0x7efd800cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 -- 172.21.15.50:0/2887646957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009400 con 0x7efd8006ea90 2023-08-10T10:45:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd85a28640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7efd7400cac0 tx=0x7efd7400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400a700 con 0x7efd8006ea90 2023-08-10T10:45:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400a880 con 0x7efd8006ea90 2023-08-10T10:45:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd801f27c0 con 0x7efd8006ea90 2023-08-10T10:45:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400ac70 con 0x7efd8006ea90 2023-08-10T10:45:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.812+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd801f2fc0 con 0x7efd8006ea90 2023-08-10T10:45:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.813+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80066e30 con 0x7efd8006ea90 2023-08-10T10:45:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.814+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd740070d0 con 0x7efd8006ea90 2023-08-10T10:45:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.815+0000 7efd7e7fc640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 0x7efd6406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.815+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7efd74089030 con 0x7efd8006ea90 2023-08-10T10:45:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.815+0000 7efd85227640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 0x7efd6406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.816+0000 7efd85227640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 0x7efd6406d110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efd6c006fd0 tx=0x7efd6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:18.819+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd740bb330 con 0x7efd8006ea90 2023-08-10T10:45:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.048+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd8006f300 con 0x7efd8006ea90 2023-08-10T10:45:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.049+0000 7efd7e7fc640 1 -- 172.21.15.50:0/2887646957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7efd74018090 con 0x7efd8006ea90 2023-08-10T10:45:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:19.052 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:45:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:45:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 msgr2=0x7efd6406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 0x7efd6406d110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efd6c006fd0 tx=0x7efd6c008040 comp rx=0 tx=0).stop 2023-08-10T10:45:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 msgr2=0x7efd800af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7efd7400cac0 tx=0x7efd7400cf80 comp rx=0 tx=0).stop 2023-08-10T10:45:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 shutdown_connections 2023-08-10T10:45:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd8015c9c0 0x7efd800cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efd6406ac50 0x7efd6406d110 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd800b5e50 0x7efd800cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 --2- 172.21.15.50:0/2887646957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd8006ea90 0x7efd800af110 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.052+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 >> 172.21.15.50:0/2887646957 conn(0x7efd800d0630 msgr2=0x7efd800b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.053+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 shutdown_connections 2023-08-10T10:45:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.053+0000 7efd86a2a640 1 -- 172.21.15.50:0/2887646957 wait complete. 2023-08-10T10:45:19.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.300+0000 7f82af02d640 1 Processor -- start 2023-08-10T10:45:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.301+0000 7f82af02d640 1 -- start start 2023-08-10T10:45:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.302+0000 7f82af02d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f82a80c1af0 0x7f82a80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.302+0000 7f82af02d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.303+0000 7f82af02d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a806f6f0 con 0x7f82a80b2d70 2023-08-10T10:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.303+0000 7f82af02d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a81617f0 con 0x7f82a80c1af0 2023-08-10T10:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.303+0000 7f82af02d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a806a020 con 0x7f82a8069be0 2023-08-10T10:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.304+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.304+0000 7f82acdc9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f82a80c1af0 0x7f82a80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.304+0000 7f82ad5ca640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f82a80b2d70 0x7f82a80b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:39076/0 (socket says 172.21.15.50:39076) 2023-08-10T10:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.304+0000 7f82ad5ca640 1 -- 172.21.15.50:0/1949547366 learned_addr learned my addr 172.21.15.50:0/1949547366 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.304+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:35878/0 (socket says 172.21.15.50:35878) 2023-08-10T10:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.305+0000 7f82a7fff640 1 -- 172.21.15.50:0/1949547366 >> v2:172.21.15.117:3300/0 conn(0x7f82a80c1af0 msgr2=0x7f82a80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.305+0000 7f82a7fff640 1 --2- 172.21.15.50:0/1949547366 >> v2:172.21.15.117:3300/0 conn(0x7f82a80c1af0 0x7f82a80696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.305+0000 7f82a7fff640 1 -- 172.21.15.50:0/1949547366 >> v1:172.21.15.117:6789/0 conn(0x7f82a80b2d70 legacy=0x7f82a80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.305+0000 7f82a7fff640 1 -- 172.21.15.50:0/1949547366 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80b31e0 con 0x7f82a8069be0 2023-08-10T10:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.306+0000 7f82a7fff640 1 --2- 172.21.15.50:0/1949547366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82940097a0 tx=0x7f829402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78e314812558468 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82a77fe640 1 -- 172.21.15.50:0/1949547366 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294030800 con 0x7f82a8069be0 2023-08-10T10:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82a77fe640 1 -- 172.21.15.50:0/1949547366 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294030960 con 0x7f82a8069be0 2023-08-10T10:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82a77fe640 1 -- 172.21.15.50:0/1949547366 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294030cf0 con 0x7f82a8069be0 2023-08-10T10:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 -- 172.21.15.50:0/1949547366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 msgr2=0x7f82a80b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 --2- 172.21.15.50:0/1949547366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82940097a0 tx=0x7f829402b940 comp rx=0 tx=0).stop 2023-08-10T10:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 -- 172.21.15.50:0/1949547366 shutdown_connections 2023-08-10T10:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 --2- 172.21.15.50:0/1949547366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a8069be0 0x7f82a80b2830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 --2- 172.21.15.50:0/1949547366 >> v2:172.21.15.117:3300/0 conn(0x7f82a80c1af0 0x7f82a80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.307+0000 7f82af02d640 1 -- 172.21.15.50:0/1949547366 >> 172.21.15.50:0/1949547366 conn(0x7f82a806b590 msgr2=0x7f82a80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.308+0000 7f82af02d640 1 -- 172.21.15.50:0/1949547366 shutdown_connections 2023-08-10T10:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.308+0000 7f82af02d640 1 -- 172.21.15.50:0/1949547366 wait complete. 2023-08-10T10:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.309+0000 7f82af02d640 1 Processor -- start 2023-08-10T10:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.310+0000 7f82af02d640 1 -- start start 2023-08-10T10:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82a8069be0 0x7f82a81f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a80b2d70 0x7f82a815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80c26c0 con 0x7f82a80c1af0 2023-08-10T10:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8160080 con 0x7f82a8069be0 2023-08-10T10:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82af02d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80c4160 con 0x7f82a80b2d70 2023-08-10T10:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42930/0 (socket says 172.21.15.50:42930) 2023-08-10T10:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 -- 172.21.15.50:0/2238609669 learned_addr learned my addr 172.21.15.50:0/2238609669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82a7fff640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a80b2d70 0x7f82a815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82acdc9640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82a8069be0 0x7f82a81f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 -- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a80b2d70 msgr2=0x7f82a815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a80b2d70 0x7f82a815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.311+0000 7f82ad5ca640 1 -- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82a8069be0 msgr2=0x7f82a81f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82ad5ca640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82a8069be0 0x7f82a81f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82ad5ca640 1 -- 172.21.15.50:0/2238609669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009400 con 0x7f82a80c1af0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82ad5ca640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cbf0 tx=0x7f82a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000ad40 con 0x7f82a80c1af0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0012400 con 0x7f82a80c1af0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000aea0 con 0x7f82a80c1af0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a80c2070 con 0x7f82a80c1af0 2023-08-10T10:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.312+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a8160400 con 0x7f82a80c1af0 2023-08-10T10:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.313+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a80c1ed0 con 0x7f82a80c1af0 2023-08-10T10:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.315+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82a0007070 con 0x7f82a80c1af0 2023-08-10T10:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.315+0000 7f82a57fa640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 0x7f828c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.316+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f82a0089460 con 0x7f82a80c1af0 2023-08-10T10:45:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.316+0000 7f82acdc9640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 0x7f828c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.317+0000 7f82acdc9640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 0x7f828c06d140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f829c009a30 tx=0x7f829c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.320+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f82a80c1ed0 con 0x7f82a80c1af0 2023-08-10T10:45:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.553+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82a80c2870 con 0x7f82a80c1af0 2023-08-10T10:45:19.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.555+0000 7f82a57fa640 1 -- 172.21.15.50:0/2238609669 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f82a80c2870 con 0x7f82a80c1af0 2023-08-10T10:45:19.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:19.557 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:44:35.997314+0000","modified":"2023-08-10T10:44:39.544196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5833},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5833":{"gid":5833,"name":"d","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/1452491265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1452491265},{"type":"v1","addr":"172.21.15.117:6834","nonce":1452491265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-10T10:45:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 51 2023-08-10T10:45:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.557+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 msgr2=0x7f828c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.557+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 0x7f828c06d140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f829c009a30 tx=0x7f829c008040 comp rx=0 tx=0).stop 2023-08-10T10:45:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.557+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 msgr2=0x7f82a80c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.557+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cbf0 tx=0x7f82a000a430 comp rx=0 tx=0).stop 2023-08-10T10:45:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 shutdown_connections 2023-08-10T10:45:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82a80c1af0 0x7f82a80c8b80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82a80b2d70 0x7f82a815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f828c06ac80 0x7f828c06d140 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 --2- 172.21.15.50:0/2238609669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82a8069be0 0x7f82a81f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 >> 172.21.15.50:0/2238609669 conn(0x7f82a806b590 msgr2=0x7f82a8071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:19.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 shutdown_connections 2023-08-10T10:45:19.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.558+0000 7f82af02d640 1 -- 172.21.15.50:0/2238609669 wait complete. 2023-08-10T10:45:19.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.806+0000 7fb0111c8640 1 Processor -- start 2023-08-10T10:45:19.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.807+0000 7fb0111c8640 1 -- start start 2023-08-10T10:45:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.808+0000 7fb0111c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb00c0b3010 0x7fb00c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.808+0000 7fb0111c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 0x7fb00c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.808+0000 7fb0111c8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c0719f0 con 0x7fb00c15ccb0 2023-08-10T10:45:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.808+0000 7fb0111c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c0c8db0 con 0x7fb00c0b3010 2023-08-10T10:45:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.808+0000 7fb0111c8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c0c9050 con 0x7fb00c0c9b30 2023-08-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb00c0b3010 0x7fb00c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb00c0b3010 0x7fb00c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42946/0 (socket says 172.21.15.50:42946) 2023-08-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 -- 172.21.15.50:0/4204888696 learned_addr learned my addr 172.21.15.50:0/4204888696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00b59e640 1 --2- 172.21.15.50:0/4204888696 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 0x7fb00c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 -- 172.21.15.50:0/4204888696 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 msgr2=0x7fb00c069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 --2- 172.21.15.50:0/4204888696 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 0x7fb00c069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 -- 172.21.15.50:0/4204888696 >> v1:172.21.15.117:6789/0 conn(0x7fb00c15ccb0 legacy=0x7fb00c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00259c640 1 -- 172.21.15.50:0/4204888696 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0c9330 con 0x7fb00c0b3010 2023-08-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.809+0000 7fb00b59e640 1 --2- 172.21.15.50:0/4204888696 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 0x7fb00c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.810+0000 7fb00259c640 1 --2- 172.21.15.50:0/4204888696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c0b3010 0x7fb00c0696a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb00c06cb50 tx=0x7faff402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3987a1aa08ef7773 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.811+0000 7fb00a59c640 1 -- 172.21.15.50:0/4204888696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff402ca60 con 0x7fb00c0b3010 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.811+0000 7fb00a59c640 1 -- 172.21.15.50:0/4204888696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff402cbc0 con 0x7fb00c0b3010 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.811+0000 7fb00a59c640 1 -- 172.21.15.50:0/4204888696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40343f0 con 0x7fb00c0b3010 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.811+0000 7fb0111c8640 1 -- 172.21.15.50:0/4204888696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c0b3010 msgr2=0x7fb00c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.811+0000 7fb0111c8640 1 --2- 172.21.15.50:0/4204888696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c0b3010 0x7fb00c0696a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb00c06cb50 tx=0x7faff402bec0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 -- 172.21.15.50:0/4204888696 shutdown_connections 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 --2- 172.21.15.50:0/4204888696 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c9b30 0x7fb00c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 --2- 172.21.15.50:0/4204888696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c0b3010 0x7fb00c0696a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 -- 172.21.15.50:0/4204888696 >> 172.21.15.50:0/4204888696 conn(0x7fb00c06b590 msgr2=0x7fb00c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:19.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 -- 172.21.15.50:0/4204888696 shutdown_connections 2023-08-10T10:45:19.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.812+0000 7fb0111c8640 1 -- 172.21.15.50:0/4204888696 wait complete. 2023-08-10T10:45:19.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.813+0000 7fb0111c8640 1 Processor -- start 2023-08-10T10:45:19.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.814+0000 7fb0111c8640 1 -- start start 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.814+0000 7fb0111c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c0b3010 0x7fb00c0c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb0111c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 0x7fb00c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb0111c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb0111c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c0c4bd0 con 0x7fb00c15ccb0 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb0111c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c0c2710 con 0x7fb00c0c9b30 2023-08-10T10:45:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb0111c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c0c5530 con 0x7fb00c0b3010 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42958/0 (socket says 172.21.15.50:42958) 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 -- 172.21.15.50:0/3486814611 learned_addr learned my addr 172.21.15.50:0/3486814611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00ad9d640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c0b3010 0x7fb00c0c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00259c640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 0x7fb00c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 -- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c0b3010 msgr2=0x7fb00c0c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c0b3010 0x7fb00c0c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 -- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 msgr2=0x7fb00c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 0x7fb00c0c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.815+0000 7fb00b59e640 1 -- 172.21.15.50:0/3486814611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4009b30 con 0x7fb00c15ccb0 2023-08-10T10:45:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb00259c640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 0x7fb00c0c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb00b59e640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c7f0 tx=0x7fb00400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0040077c0 con 0x7fb00c15ccb0 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004007920 con 0x7fb00c15ccb0 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004007d10 con 0x7fb00c15ccb0 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c1487b0 con 0x7fb00c15ccb0 2023-08-10T10:45:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.816+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c0c4510 con 0x7fb00c15ccb0 2023-08-10T10:45:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.817+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c0c4d10 con 0x7fb00c15ccb0 2023-08-10T10:45:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.818+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0040113f0 con 0x7fb00c15ccb0 2023-08-10T10:45:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.820+0000 7fb003fff640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 0x7fafec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.820+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fb004089840 con 0x7fb00c15ccb0 2023-08-10T10:45:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.820+0000 7fb00ad9d640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 0x7fafec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.821+0000 7fb00ad9d640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 0x7fafec06d110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faffc006fd0 tx=0x7faffc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:19.824+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb00c0c4d10 con 0x7fb00c15ccb0 2023-08-10T10:45:20.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.018+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb00c0c4d10 con 0x7fb00c15ccb0 2023-08-10T10:45:20.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.020+0000 7fb003fff640 1 -- 172.21.15.50:0/3486814611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18489 (secure 0 0 0) 0x7fb00c0c4d10 con 0x7fb00c15ccb0 2023-08-10T10:45:20.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":118,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:09.860818+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:44:34.361887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-10T10:44:34.998347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:20.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.022+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 msgr2=0x7fafec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.022+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 0x7fafec06d110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faffc006fd0 tx=0x7faffc008040 comp rx=0 tx=0).stop 2023-08-10T10:45:20.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.022+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 msgr2=0x7fb00c15f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.022+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c7f0 tx=0x7fb00400ccb0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 shutdown_connections 2023-08-10T10:45:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00c15ccb0 0x7fb00c15f360 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafec06ac50 0x7fafec06d110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c9b30 0x7fb00c0c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 --2- 172.21.15.50:0/3486814611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c0b3010 0x7fb00c0c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 >> 172.21.15.50:0/3486814611 conn(0x7fb00c06b590 msgr2=0x7fb00c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:20.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 shutdown_connections 2023-08-10T10:45:20.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.023+0000 7fb0111c8640 1 -- 172.21.15.50:0/3486814611 wait complete. 2023-08-10T10:45:20.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:45:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.267+0000 7f489a204640 1 Processor -- start 2023-08-10T10:45:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.267+0000 7f489a204640 1 -- start start 2023-08-10T10:45:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.269+0000 7f489a204640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48940ac890 0x7f48940accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.269+0000 7f489a204640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489406bca0 con 0x7f48941601f0 2023-08-10T10:45:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.269+0000 7f489a204640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489406c7e0 con 0x7f4894160dd0 2023-08-10T10:45:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.269+0000 7f489a204640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48941605d0 con 0x7f48940ac890 2023-08-10T10:45:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f4892ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48940ac890 0x7f48940accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f48937fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f48941601f0 0x7f48940adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44980/0 (socket says 172.21.15.50:44980) 2023-08-10T10:45:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f48937fe640 1 -- 172.21.15.50:0/1928096519 learned_addr learned my addr 172.21.15.50:0/1928096519 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f4892ffd640 1 -- 172.21.15.50:0/1928096519 >> v1:172.21.15.117:6789/0 conn(0x7f4894160dd0 legacy=0x7f48940cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f4892ffd640 1 -- 172.21.15.50:0/1928096519 >> v1:172.21.15.50:6789/0 conn(0x7f48941601f0 legacy=0x7f48940adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.270+0000 7f4892ffd640 1 -- 172.21.15.50:0/1928096519 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489406bf40 con 0x7f48940ac890 2023-08-10T10:45:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.271+0000 7f4892ffd640 1 --2- 172.21.15.50:0/1928096519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48940accf0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f48880097a0 tx=0x7f488802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9a155051730ddf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.271+0000 7f48927fc640 1 -- 172.21.15.50:0/1928096519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488802f050 con 0x7f48940ac890 2023-08-10T10:45:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f48927fc640 1 -- 172.21.15.50:0/1928096519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4888031700 con 0x7f48940ac890 2023-08-10T10:45:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f48927fc640 1 -- 172.21.15.50:0/1928096519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888031a90 con 0x7f48940ac890 2023-08-10T10:45:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 -- 172.21.15.50:0/1928096519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 msgr2=0x7f48940accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 --2- 172.21.15.50:0/1928096519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48940accf0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f48880097a0 tx=0x7f488802b7a0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 -- 172.21.15.50:0/1928096519 shutdown_connections 2023-08-10T10:45:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 --2- 172.21.15.50:0/1928096519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48940accf0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 -- 172.21.15.50:0/1928096519 >> 172.21.15.50:0/1928096519 conn(0x7f48940698b0 msgr2=0x7f4894069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 -- 172.21.15.50:0/1928096519 shutdown_connections 2023-08-10T10:45:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.272+0000 7f489a204640 1 -- 172.21.15.50:0/1928096519 wait complete. 2023-08-10T10:45:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.274+0000 7f489a204640 1 Processor -- start 2023-08-10T10:45:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.274+0000 7f489a204640 1 -- start start 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48941601f0 0x7f48940c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894160dd0 0x7f48940cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940ae8e0 con 0x7f48940ac890 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c7480 con 0x7f48941601f0 2023-08-10T10:45:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.275+0000 7f489a204640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940aeb30 con 0x7f4894160dd0 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42974/0 (socket says 172.21.15.50:42974) 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 -- 172.21.15.50:0/2566889446 learned_addr learned my addr 172.21.15.50:0/2566889446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 -- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894160dd0 msgr2=0x7f48940cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894160dd0 0x7f48940cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 -- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48941601f0 msgr2=0x7f48940c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48941601f0 0x7f48940c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 -- 172.21.15.50:0/2566889446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009400 con 0x7f48940ac890 2023-08-10T10:45:20.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.276+0000 7f48937fe640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f488400c3c0 tx=0x7f488400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.277+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884005ce0 con 0x7f48940ac890 2023-08-10T10:45:20.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.277+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884005e40 con 0x7f48940ac890 2023-08-10T10:45:20.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.277+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884007310 con 0x7f48940ac890 2023-08-10T10:45:20.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.277+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48940aee10 con 0x7f48940ac890 2023-08-10T10:45:20.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.277+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48941557d0 con 0x7f48940ac890 2023-08-10T10:45:20.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.278+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489404e270 con 0x7f48940ac890 2023-08-10T10:45:20.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.279+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4884007530 con 0x7f48940ac890 2023-08-10T10:45:20.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.280+0000 7f487bfff640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 0x7f488006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.280+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4884088bb0 con 0x7f48940ac890 2023-08-10T10:45:20.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.280+0000 7f4892ffd640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 0x7f488006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.281+0000 7f4892ffd640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 0x7f488006d110 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4888035000 tx=0x7f4888030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.284+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4884053b50 con 0x7f48940ac890 2023-08-10T10:45:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.514+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f489406ba80 con 0x7f48940ac890 2023-08-10T10:45:20.516 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:45:20.515+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:45:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.521+0000 7f487bfff640 1 -- 172.21.15.50:0/2566889446 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4884017020 con 0x7f48940ac890 2023-08-10T10:45:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:45:20.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 msgr2=0x7f488006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 0x7f488006d110 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4888035000 tx=0x7f4888030000 comp rx=0 tx=0).stop 2023-08-10T10:45:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 msgr2=0x7f48941541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f488400c3c0 tx=0x7f488400c880 comp rx=0 tx=0).stop 2023-08-10T10:45:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 shutdown_connections 2023-08-10T10:45:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894160dd0 0x7f48940cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488006ac50 0x7f488006d110 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48941601f0 0x7f48940c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 --2- 172.21.15.50:0/2566889446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48940ac890 0x7f48941541c0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.524+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 >> 172.21.15.50:0/2566889446 conn(0x7f48940698b0 msgr2=0x7f4894154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.525+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 shutdown_connections 2023-08-10T10:45:20.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.525+0000 7f489a204640 1 -- 172.21.15.50:0/2566889446 wait complete. 2023-08-10T10:45:20.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:45:20.649 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:45:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.777+0000 7fef919ab640 1 Processor -- start 2023-08-10T10:45:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.778+0000 7fef919ab640 1 -- start start 2023-08-10T10:45:20.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.779+0000 7fef919ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef8c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.779+0000 7fef919ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef8c069db0 0x7fef8c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.779+0000 7fef919ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c15bcb0 con 0x7fef8c15ac00 2023-08-10T10:45:20.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.779+0000 7fef919ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c0c5540 con 0x7fef8c069db0 2023-08-10T10:45:20.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.779+0000 7fef919ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c15b0a0 con 0x7fef8c15a820 2023-08-10T10:45:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef827fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef8c15ac00 0x7fef8c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44986/0 (socket says 172.21.15.50:44986) 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef827fc640 1 -- 172.21.15.50:0/618142256 learned_addr learned my addr 172.21.15.50:0/618142256 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef8affd640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef8c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/618142256 >> v2:172.21.15.117:3300/0 conn(0x7fef8c069db0 0x7fef8c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740780137 0 0) 0x7fef8c15bcb0 con 0x7fef8c15ac00 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.780+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78003520 con 0x7fef8c15ac00 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 204581184 0 0) 0x7fef78003520 con 0x7fef8c15ac00 2023-08-10T10:45:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 msgr2=0x7fef8c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef8c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 >> v2:172.21.15.117:3300/0 conn(0x7fef8c069db0 msgr2=0x7fef8c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 --2- 172.21.15.50:0/618142256 >> v2:172.21.15.117:3300/0 conn(0x7fef8c069db0 0x7fef8c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c15b380 con 0x7fef8c15ac00 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fef74001670 con 0x7fef8c15ac00 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 >> v1:172.21.15.50:6789/0 conn(0x7fef8c15ac00 legacy=0x7fef8c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78003970 0x7fef78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef78004d00 0x7fef78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c5540 con 0x7fef78004d00 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c15b0a0 con 0x7fef78003970 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7800b980 con 0x7fef8c15a820 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef78004d00 0x7fef78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.781+0000 7fef8affd640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78003970 0x7fef78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef827fc640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef8b7fe640 1 -- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 msgr2=0x7fef780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef8c15a820 0x7fef780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef8b7fe640 1 -- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78003970 msgr2=0x7fef78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78003970 0x7fef78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.782+0000 7fef8b7fe640 1 -- 172.21.15.50:0/618142256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78003520 con 0x7fef78004d00 2023-08-10T10:45:20.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.783+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef78004d00 0x7fef78005180 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fef8c15bc60 tx=0x7fef780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47a1366a339d571 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.783+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8402c680 con 0x7fef78004d00 2023-08-10T10:45:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.783+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8402c7e0 con 0x7fef78004d00 2023-08-10T10:45:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.783+0000 7fef8a7fc640 1 -- 172.21.15.50:0/618142256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8402cb90 con 0x7fef78004d00 2023-08-10T10:45:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 -- 172.21.15.50:0/618142256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef78004d00 msgr2=0x7fef78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 --2- 172.21.15.50:0/618142256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef78004d00 0x7fef78005180 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fef8c15bc60 tx=0x7fef780057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef8b7fe640 1 -- 172.21.15.50:0/618142256 reap_dead start 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 -- 172.21.15.50:0/618142256 shutdown_connections 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 -- 172.21.15.50:0/618142256 >> 172.21.15.50:0/618142256 conn(0x7fef8c0b08e0 msgr2=0x7fef8c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 -- 172.21.15.50:0/618142256 shutdown_connections 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.784+0000 7fef919ab640 1 -- 172.21.15.50:0/618142256 wait complete. 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.786+0000 7fef919ab640 1 Processor -- start 2023-08-10T10:45:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.786+0000 7fef919ab640 1 -- start start 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78004d00 0x7fef8c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c0c2100 0x7fef8c0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c40b0 con 0x7fef8c0c5f60 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c2ac0 con 0x7fef8c0c2100 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef919ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c2d80 con 0x7fef78004d00 2023-08-10T10:45:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42990/0 (socket says 172.21.15.50:42990) 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.787+0000 7fef8b7fe640 1 -- 172.21.15.50:0/3994840272 learned_addr learned my addr 172.21.15.50:0/3994840272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 -- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78004d00 msgr2=0x7fef8c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78004d00 0x7fef8c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 -- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c0c2100 msgr2=0x7fef8c0c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c0c2100 0x7fef8c0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:20.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 -- 172.21.15.50:0/3994840272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0c3060 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef8b7fe640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fef8402c220 tx=0x7fef84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8403e850 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8403e9b0 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8403ed60 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c0c3340 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.788+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c0c5a40 con 0x7fef8c0c5f60 2023-08-10T10:45:20.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.789+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c04e270 con 0x7fef8c0c5f60 2023-08-10T10:45:20.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.790+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef84034440 con 0x7fef8c0c5f60 2023-08-10T10:45:20.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.791+0000 7fef88ff9640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 0x7fef6c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:20.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.791+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fef840aaf60 con 0x7fef8c0c5f60 2023-08-10T10:45:20.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.792+0000 7fef8affd640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 0x7fef6c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:20.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.792+0000 7fef8affd640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 0x7fef6c06d140 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009fd0 tx=0x7fef7c009750 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:20.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:20.796+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fef84075ea0 con 0x7fef8c0c5f60 2023-08-10T10:45:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.032+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fef8c0b3c50 con 0x7fef8c0c5f60 2023-08-10T10:45:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.529+0000 7fef88ff9640 1 -- 172.21.15.50:0/3994840272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef840390a0 con 0x7fef8c0c5f60 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 msgr2=0x7fef6c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 0x7fef6c06d140 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009fd0 tx=0x7fef7c009750 comp rx=0 tx=0).stop 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 msgr2=0x7fef8c0c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fef8402c220 tx=0x7fef84004730 comp rx=0 tx=0).stop 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 shutdown_connections 2023-08-10T10:45:21.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8c0c5f60 0x7fef8c0c6410 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef6c06ac80 0x7fef6c06d140 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c0c2100 0x7fef8c0c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 --2- 172.21.15.50:0/3994840272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78004d00 0x7fef8c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 >> 172.21.15.50:0/3994840272 conn(0x7fef8c0b08e0 msgr2=0x7fef8c0696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 shutdown_connections 2023-08-10T10:45:21.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.533+0000 7fef919ab640 1 -- 172.21.15.50:0/3994840272 wait complete. 2023-08-10T10:45:21.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:45:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.791+0000 7f04f1901640 1 Processor -- start 2023-08-10T10:45:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.791+0000 7f04f1901640 1 -- start start 2023-08-10T10:45:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.793+0000 7f04f1901640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.793+0000 7f04f1901640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.793+0000 7f04f1901640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ec0d20d0 con 0x7f04ec0d2560 2023-08-10T10:45:21.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.793+0000 7f04f1901640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ec15cfc0 con 0x7f04ec15cbe0 2023-08-10T10:45:21.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.793+0000 7f04f1901640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec0d14c0 con 0x7f04ec0b4c10 2023-08-10T10:45:21.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:41240/0 (socket says 172.21.15.50:41240) 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 -- 172.21.15.50:0/386400643 learned_addr learned my addr 172.21.15.50:0/386400643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 -- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 msgr2=0x7f04ec0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 --2- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec0b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 -- 172.21.15.50:0/386400643 >> v1:172.21.15.117:6789/0 conn(0x7f04ec0d2560 legacy=0x7f04ec0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.794+0000 7f04eaffd640 1 -- 172.21.15.50:0/386400643 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0d17a0 con 0x7f04ec15cbe0 2023-08-10T10:45:21.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.796+0000 7f04eaffd640 1 --2- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009e50 tx=0x7f04dc02bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e185bdfaa3aaad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:21.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.796+0000 7f04e9ffb640 1 -- 172.21.15.50:0/386400643 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc02cb90 con 0x7f04ec15cbe0 2023-08-10T10:45:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.796+0000 7f04e9ffb640 1 -- 172.21.15.50:0/386400643 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc02ccf0 con 0x7f04ec15cbe0 2023-08-10T10:45:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.796+0000 7f04e9ffb640 1 -- 172.21.15.50:0/386400643 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc034610 con 0x7f04ec15cbe0 2023-08-10T10:45:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 -- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec15cbe0 msgr2=0x7f04ec0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 --2- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009e50 tx=0x7f04dc02bff0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 -- 172.21.15.50:0/386400643 shutdown_connections 2023-08-10T10:45:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 --2- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec0b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 --2- 172.21.15.50:0/386400643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec15cbe0 0x7f04ec0d0bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 -- 172.21.15.50:0/386400643 >> 172.21.15.50:0/386400643 conn(0x7f04ec0702f0 msgr2=0x7f04ec0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 -- 172.21.15.50:0/386400643 shutdown_connections 2023-08-10T10:45:21.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.797+0000 7f04f1901640 1 -- 172.21.15.50:0/386400643 wait complete. 2023-08-10T10:45:21.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.799+0000 7f04f1901640 1 Processor -- start 2023-08-10T10:45:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.799+0000 7f04f1901640 1 -- start start 2023-08-10T10:45:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec0d2560 0x7f04ec15d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec15e160 con 0x7f04ec15cbe0 2023-08-10T10:45:21.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec15e670 con 0x7f04ec0d2560 2023-08-10T10:45:21.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04f1901640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec15dba0 con 0x7f04ec0b4c10 2023-08-10T10:45:21.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42994/0 (socket says 172.21.15.50:42994) 2023-08-10T10:45:21.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.800+0000 7f04eb7fe640 1 -- 172.21.15.50:0/3949592587 learned_addr learned my addr 172.21.15.50:0/3949592587 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:21.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04ea7fc640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec0d2560 0x7f04ec15d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 -- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 msgr2=0x7f04ec148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 -- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec0d2560 msgr2=0x7f04ec15d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec0d2560 0x7f04ec15d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 -- 172.21.15.50:0/3949592587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc009b30 con 0x7f04ec15cbe0 2023-08-10T10:45:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.801+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e850 tx=0x7f04e400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.802+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4009630 con 0x7f04ec15cbe0 2023-08-10T10:45:21.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.802+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e400c940 con 0x7f04ec15cbe0 2023-08-10T10:45:21.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.802+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e400ccf0 con 0x7f04ec15cbe0 2023-08-10T10:45:21.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.802+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec15de80 con 0x7f04ec15cbe0 2023-08-10T10:45:21.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.802+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec15eb70 con 0x7f04ec15cbe0 2023-08-10T10:45:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.803+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ec04e270 con 0x7f04ec15cbe0 2023-08-10T10:45:21.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.804+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04e4013470 con 0x7f04ec15cbe0 2023-08-10T10:45:21.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.805+0000 7f04d3fff640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 0x7f04d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.805+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f04e4089750 con 0x7f04ec15cbe0 2023-08-10T10:45:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.805+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 0x7f04d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.806+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 0x7f04d806d110 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04dc035000 tx=0x7f04dc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:21.810+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f04e4054720 con 0x7f04ec15cbe0 2023-08-10T10:45:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.001+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04ec0b7a80 con 0x7f04ec15cbe0 2023-08-10T10:45:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.990+0000 7f04d3fff640 1 -- 172.21.15.50:0/3949592587 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7f04e4057d40 con 0x7f04ec15cbe0 2023-08-10T10:45:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:45:22.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.994+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 msgr2=0x7f04d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:22.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.994+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 0x7f04d806d110 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04dc035000 tx=0x7f04dc030000 comp rx=0 tx=0).stop 2023-08-10T10:45:22.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 msgr2=0x7f04ec157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e850 tx=0x7f04e400ed10 comp rx=0 tx=0).stop 2023-08-10T10:45:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 shutdown_connections 2023-08-10T10:45:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec15cbe0 0x7f04ec157ca0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f04d806ac50 0x7f04d806d110 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04ec0d2560 0x7f04ec15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 --2- 172.21.15.50:0/3949592587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04ec0b4c10 0x7f04ec148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 >> 172.21.15.50:0/3949592587 conn(0x7f04ec0702f0 msgr2=0x7f04ec15b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 shutdown_connections 2023-08-10T10:45:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:22.995+0000 7f04f1901640 1 -- 172.21.15.50:0/3949592587 wait complete. 2023-08-10T10:45:23.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.253+0000 7f7b4a7ab640 1 Processor -- start 2023-08-10T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.253+0000 7f7b4a7ab640 1 -- start start 2023-08-10T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b4a7ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b4a7ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b440aff00 0x7f7b440b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b4a7ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440b0890 con 0x7f7b440b3c10 2023-08-10T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b4a7ab640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440b4480 con 0x7f7b440aff00 2023-08-10T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b4a7ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4406b1a0 con 0x7f7b440b3ff0 2023-08-10T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b49faa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b440aff00 0x7f7b440b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b497a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b440b3c10 0x7f7b4406a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44988/0 (socket says 172.21.15.50:44988) 2023-08-10T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.255+0000 7f7b497a9640 1 -- 172.21.15.50:0/643494995 learned_addr learned my addr 172.21.15.50:0/643494995 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b48fa8640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b49faa640 1 -- 172.21.15.50:0/643494995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 msgr2=0x7f7b4415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b49faa640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b49faa640 1 -- 172.21.15.50:0/643494995 >> v1:172.21.15.50:6789/0 conn(0x7f7b440b3c10 legacy=0x7f7b4406a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b49faa640 1 -- 172.21.15.50:0/643494995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4406b480 con 0x7f7b440aff00 2023-08-10T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b48fa8640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.256+0000 7f7b3bfff640 1 -- 172.21.15.50:0/643494995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019465793 0 0) 0x7f7b40001290 con 0x7f7b440b3c10 2023-08-10T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.257+0000 7f7b49faa640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440aff00 0x7f7b440b0350 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009d90 tx=0x7f7b3c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccb0e999b2c1a3d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.257+0000 7f7b3bfff640 1 -- 172.21.15.50:0/643494995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c02cc50 con 0x7f7b440aff00 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.257+0000 7f7b3bfff640 1 -- 172.21.15.50:0/643494995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c02cdb0 con 0x7f7b440aff00 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.257+0000 7f7b3bfff640 1 -- 172.21.15.50:0/643494995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c034660 con 0x7f7b440aff00 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/643494995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440aff00 msgr2=0x7f7b440b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440aff00 0x7f7b440b0350 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009d90 tx=0x7f7b3c02bea0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/643494995 shutdown_connections 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440aff00 0x7f7b440b0350 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/643494995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/643494995 >> 172.21.15.50:0/643494995 conn(0x7f7b44069f20 msgr2=0x7f7b440caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/643494995 shutdown_connections 2023-08-10T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.258+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/643494995 wait complete. 2023-08-10T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.260+0000 7f7b4a7ab640 1 Processor -- start 2023-08-10T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.260+0000 7f7b4a7ab640 1 -- start start 2023-08-10T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 0x7f7b44150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b441f2e00 con 0x7f7b440b3c10 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4415a3f0 con 0x7f7b440aff00 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b4a7ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4415b430 con 0x7f7b440b3ff0 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.261+0000 7f7b48fa8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43020/0 (socket says 172.21.15.50:43020) 2023-08-10T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 -- 172.21.15.50:0/2732159637 learned_addr learned my addr 172.21.15.50:0/2732159637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b497a9640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 0x7f7b44150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 -- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 msgr2=0x7f7b4415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b49faa640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 -- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 msgr2=0x7f7b44150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 0x7f7b44150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 -- 172.21.15.50:0/2732159637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009a70 con 0x7f7b440b3c10 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b49faa640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b497a9640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 0x7f7b44150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.262+0000 7f7b48fa8640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c7f0 tx=0x7f7b3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.263+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007820 con 0x7f7b440b3c10 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.263+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34007980 con 0x7f7b440b3c10 2023-08-10T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.263+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b44158dc0 con 0x7f7b440b3c10 2023-08-10T10:45:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.263+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007cf0 con 0x7f7b440b3c10 2023-08-10T10:45:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.263+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b44159380 con 0x7f7b440b3c10 2023-08-10T10:45:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.264+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4415b5a0 con 0x7f7b440b3c10 2023-08-10T10:45:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.265+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b340113f0 con 0x7f7b440b3c10 2023-08-10T10:45:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.266+0000 7f7b39ffb640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 0x7f7b2806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.266+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5826+0+0 (secure 0 0 0) 0x7f7b34089780 con 0x7f7b440b3c10 2023-08-10T10:45:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.267+0000 7f7b497a9640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 0x7f7b2806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.267+0000 7f7b497a9640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 0x7f7b2806d140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7b4415e430 tx=0x7f7b40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.271+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7b34054870 con 0x7f7b440b3c10 2023-08-10T10:45:23.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.469+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7b440612b0 con 0x7f7b440b3c10 2023-08-10T10:45:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.994+0000 7f7b39ffb640 1 -- 172.21.15.50:0/2732159637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7b34057e90 con 0x7f7b440b3c10 2023-08-10T10:45:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:45:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.999+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 msgr2=0x7f7b2806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.999+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 0x7f7b2806d140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7b4415e430 tx=0x7f7b40009040 comp rx=0 tx=0).stop 2023-08-10T10:45:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.999+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 msgr2=0x7f7b441f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:23.999+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c7f0 tx=0x7f7b3400ccb0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 shutdown_connections 2023-08-10T10:45:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b440b3ff0 0x7f7b4415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b440b3c10 0x7f7b441f28c0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b2806ac80 0x7f7b2806d140 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 --2- 172.21.15.50:0/2732159637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b440aff00 0x7f7b44150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 >> 172.21.15.50:0/2732159637 conn(0x7f7b44069f20 msgr2=0x7f7b440c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.000+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 shutdown_connections 2023-08-10T10:45:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.001+0000 7f7b4a7ab640 1 -- 172.21.15.50:0/2732159637 wait complete. 2023-08-10T10:45:24.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:45:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.270+0000 7f16bef6d640 1 Processor -- start 2023-08-10T10:45:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.270+0000 7f16bef6d640 1 -- start start 2023-08-10T10:45:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bef6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16b80c93e0 0x7f16b81652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bef6d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16b80b4270 0x7f16b80affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bef6d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b8164e60 con 0x7f16b80c97c0 2023-08-10T10:45:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bef6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b8162320 con 0x7f16b80c93e0 2023-08-10T10:45:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bef6d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b8165830 con 0x7f16b80b4270 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bdf6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16b80c93e0 0x7f16b81652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bdf6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16b80c93e0 0x7f16b81652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43034/0 (socket says 172.21.15.50:43034) 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.272+0000 7f16bdf6b640 1 -- 172.21.15.50:0/2390192790 learned_addr learned my addr 172.21.15.50:0/2390192790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.273+0000 7f16bdf6b640 1 -- 172.21.15.50:0/2390192790 >> v2:172.21.15.117:3300/0 conn(0x7f16b80b4270 msgr2=0x7f16b80affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.273+0000 7f16bdf6b640 1 --2- 172.21.15.50:0/2390192790 >> v2:172.21.15.117:3300/0 conn(0x7f16b80b4270 0x7f16b80affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.273+0000 7f16bdf6b640 1 -- 172.21.15.50:0/2390192790 >> v1:172.21.15.117:6789/0 conn(0x7f16b80c97c0 legacy=0x7f16b80cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.273+0000 7f16bdf6b640 1 -- 172.21.15.50:0/2390192790 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8161d60 con 0x7f16b80c93e0 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.274+0000 7f16bdf6b640 1 --2- 172.21.15.50:0/2390192790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b80c93e0 0x7f16b81652f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f16b80c9d50 tx=0x7f16b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b134693d0b7bed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.274+0000 7f16bcf69640 1 -- 172.21.15.50:0/2390192790 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4031870 con 0x7f16b80c93e0 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.274+0000 7f16bcf69640 1 -- 172.21.15.50:0/2390192790 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b40319d0 con 0x7f16b80c93e0 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.274+0000 7f16bcf69640 1 -- 172.21.15.50:0/2390192790 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4031d60 con 0x7f16b80c93e0 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 -- 172.21.15.50:0/2390192790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b80c93e0 msgr2=0x7f16b81652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 --2- 172.21.15.50:0/2390192790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b80c93e0 0x7f16b81652f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f16b80c9d50 tx=0x7f16b402b910 comp rx=0 tx=0).stop 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 -- 172.21.15.50:0/2390192790 shutdown_connections 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 --2- 172.21.15.50:0/2390192790 >> v2:172.21.15.117:3300/0 conn(0x7f16b80b4270 0x7f16b80affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 --2- 172.21.15.50:0/2390192790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b80c93e0 0x7f16b81652f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 -- 172.21.15.50:0/2390192790 >> 172.21.15.50:0/2390192790 conn(0x7f16b80cafb0 msgr2=0x7f16b80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 -- 172.21.15.50:0/2390192790 shutdown_connections 2023-08-10T10:45:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.275+0000 7f16bef6d640 1 -- 172.21.15.50:0/2390192790 wait complete. 2023-08-10T10:45:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.277+0000 7f16bef6d640 1 Processor -- start 2023-08-10T10:45:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.277+0000 7f16bef6d640 1 -- start start 2023-08-10T10:45:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16b80c93e0 0x7f16b80c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16b80c97c0 0x7f16b80c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b81f6cd0 con 0x7f16b81f6710 2023-08-10T10:45:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b81f6fb0 con 0x7f16b80c93e0 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16bef6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b81f7290 con 0x7f16b80c97c0 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16be76c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.278+0000 7f16be76c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43036/0 (socket says 172.21.15.50:43036) 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 -- 172.21.15.50:0/1170916870 learned_addr learned my addr 172.21.15.50:0/1170916870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16bdf6b640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16b80c93e0 0x7f16b80c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16bd76a640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16b80c97c0 0x7f16b80c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 -- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16b80c97c0 msgr2=0x7f16b80c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16b80c97c0 0x7f16b80c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 -- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16b80c93e0 msgr2=0x7f16b80c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16b80c93e0 0x7f16b80c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 -- 172.21.15.50:0/1170916870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40094d0 con 0x7f16b81f6710 2023-08-10T10:45:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.279+0000 7f16be76c640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f16b000b990 tx=0x7f16b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.280+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000cba0 con 0x7f16b81f6710 2023-08-10T10:45:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.280+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b000cd00 con 0x7f16b81f6710 2023-08-10T10:45:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.280+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0014680 con 0x7f16b81f6710 2023-08-10T10:45:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.280+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b81f7570 con 0x7f16b81f6710 2023-08-10T10:45:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.280+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b80c3a90 con 0x7f16b81f6710 2023-08-10T10:45:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.281+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b80c22a0 con 0x7f16b81f6710 2023-08-10T10:45:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.282+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16b001d3b0 con 0x7f16b81f6710 2023-08-10T10:45:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.283+0000 7f16ae7fc640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 0x7f169c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.283+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f16b0089190 con 0x7f16b81f6710 2023-08-10T10:45:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.283+0000 7f16bdf6b640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 0x7f169c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.284+0000 7f16bdf6b640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 0x7f169c06d110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f16b4036000 tx=0x7f16b403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.288+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f16b80c22a0 con 0x7f16b81f6710 2023-08-10T10:45:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.482+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f16b80c22a0 con 0x7f16b81f6710 2023-08-10T10:45:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.491+0000 7f16ae7fc640 1 -- 172.21.15.50:0/1170916870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16b80c22a0 con 0x7f16b81f6710 2023-08-10T10:45:24.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 msgr2=0x7f169c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 0x7f169c06d110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f16b4036000 tx=0x7f16b403c040 comp rx=0 tx=0).stop 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 msgr2=0x7f16b80b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f16b000b990 tx=0x7f16b000be50 comp rx=0 tx=0).stop 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 shutdown_connections 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16b81f6710 0x7f16b80b1030 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16b80c97c0 0x7f16b80c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f169c06ac50 0x7f169c06d110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 --2- 172.21.15.50:0/1170916870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16b80c93e0 0x7f16b80c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 >> 172.21.15.50:0/1170916870 conn(0x7f16b80cafb0 msgr2=0x7f16b806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 shutdown_connections 2023-08-10T10:45:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.494+0000 7f16bef6d640 1 -- 172.21.15.50:0/1170916870 wait complete. 2023-08-10T10:45:24.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-08-10T10:45:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.750+0000 7fdaf359e640 1 Processor -- start 2023-08-10T10:45:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.750+0000 7fdaf359e640 1 -- start start 2023-08-10T10:45:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.751+0000 7fdaf359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.751+0000 7fdaf359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdaf4069a80 0x7fdaf40ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.751+0000 7fdaf359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40b2280 con 0x7fdaf415ad00 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.751+0000 7fdaf359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40b19e0 con 0x7fdaf4069a80 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.751+0000 7fdaf359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b1cc0 con 0x7fdaf40696a0 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.752+0000 7fdaebfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdaf415ad00 0x7fdaf40cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44996/0 (socket says 172.21.15.50:44996) 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.752+0000 7fdaebfff640 1 -- 172.21.15.50:0/1451850945 learned_addr learned my addr 172.21.15.50:0/1451850945 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.752+0000 7fdaf2d9d640 1 --2- 172.21.15.50:0/1451850945 >> v2:172.21.15.50:3300/0 conn(0x7fdaf4069a80 0x7fdaf40ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.752+0000 7fdaf259c640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.752+0000 7fdaf1d9b640 1 -- 172.21.15.50:0/1451850945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260881556 0 0) 0x7fdaf40b2280 con 0x7fdaf415ad00 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.753+0000 7fdaf2d9d640 1 -- 172.21.15.50:0/1451850945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 msgr2=0x7fdaf40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.753+0000 7fdaf2d9d640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.753+0000 7fdaf2d9d640 1 -- 172.21.15.50:0/1451850945 >> v1:172.21.15.50:6789/0 conn(0x7fdaf415ad00 legacy=0x7fdaf40cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.753+0000 7fdaf2d9d640 1 -- 172.21.15.50:0/1451850945 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40b1fa0 con 0x7fdaf4069a80 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.754+0000 7fdaf2d9d640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf40ccfb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009dc0 tx=0x7fdaec02bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5b12119693d590 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.754+0000 7fdaf1d9b640 1 -- 172.21.15.50:0/1451850945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec02cba0 con 0x7fdaf4069a80 2023-08-10T10:45:24.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.754+0000 7fdaf1d9b640 1 -- 172.21.15.50:0/1451850945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec02cd00 con 0x7fdaf4069a80 2023-08-10T10:45:24.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.754+0000 7fdaf1d9b640 1 -- 172.21.15.50:0/1451850945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec034660 con 0x7fdaf4069a80 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 -- 172.21.15.50:0/1451850945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 msgr2=0x7fdaf40ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf40ccfb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009dc0 tx=0x7fdaec02bdf0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 -- 172.21.15.50:0/1451850945 shutdown_connections 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf40ccfb0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 --2- 172.21.15.50:0/1451850945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 -- 172.21.15.50:0/1451850945 >> 172.21.15.50:0/1451850945 conn(0x7fdaf40cafa0 msgr2=0x7fdaf40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 -- 172.21.15.50:0/1451850945 shutdown_connections 2023-08-10T10:45:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.755+0000 7fdaf359e640 1 -- 172.21.15.50:0/1451850945 wait complete. 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.757+0000 7fdaf359e640 1 Processor -- start 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.757+0000 7fdaf359e640 1 -- start start 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 0x7fdaf415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf414f490 con 0x7fdaf4069a80 2023-08-10T10:45:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf415b920 con 0x7fdaf415ad00 2023-08-10T10:45:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaf359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf415e030 con 0x7fdaf40696a0 2023-08-10T10:45:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43058/0 (socket says 172.21.15.50:43058) 2023-08-10T10:45:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.758+0000 7fdaebfff640 1 -- 172.21.15.50:0/3360120047 learned_addr learned my addr 172.21.15.50:0/3360120047 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 -- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 msgr2=0x7fdaf415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 -- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 msgr2=0x7fdaf415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaf2d9d640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 0x7fdaf415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 0x7fdaf415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 -- 172.21.15.50:0/3360120047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec009a70 con 0x7fdaf4069a80 2023-08-10T10:45:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaf2d9d640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 0x7fdaf415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.759+0000 7fdaebfff640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c440 tx=0x7fdadc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.760+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0074e0 con 0x7fdaf4069a80 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.760+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc007640 con 0x7fdaf4069a80 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.760+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc004a20 con 0x7fdaf4069a80 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.760+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40c68f0 con 0x7fdaf4069a80 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.760+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40c6eb0 con 0x7fdaf4069a80 2023-08-10T10:45:24.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.761+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40cf670 con 0x7fdaf4069a80 2023-08-10T10:45:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.762+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdadc004b80 con 0x7fdaf4069a80 2023-08-10T10:45:24.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.763+0000 7fdaeaffd640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 0x7fdad406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:24.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.763+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdadc0882e0 con 0x7fdaf4069a80 2023-08-10T10:45:24.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.763+0000 7fdaf259c640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 0x7fdad406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:24.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.764+0000 7fdaf259c640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 0x7fdad406d140 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdae4006a90 tx=0x7fdae4006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:24.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:24.767+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdadc057130 con 0x7fdaf4069a80 2023-08-10T10:45:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:25.031+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fdaf4066e30 con 0x7fdaf4069a80 2023-08-10T10:45:26.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.023+0000 7fdaeaffd640 1 -- 172.21.15.50:0/3360120047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v378) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdadc056cc0 con 0x7fdaf4069a80 2023-08-10T10:45:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.026+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 msgr2=0x7fdad406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.026+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 0x7fdad406d140 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdae4006a90 tx=0x7fdae4006a20 comp rx=0 tx=0).stop 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.026+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 msgr2=0x7fdaf414eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.026+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c440 tx=0x7fdadc00c900 comp rx=0 tx=0).stop 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 shutdown_connections 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdad406ac80 0x7fdad406d140 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf415ad00 0x7fdaf415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf4069a80 0x7fdaf414eb60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 --2- 172.21.15.50:0/3360120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf40696a0 0x7fdaf415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 >> 172.21.15.50:0/3360120047 conn(0x7fdaf40cafa0 msgr2=0x7fdaf4159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 shutdown_connections 2023-08-10T10:45:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.027+0000 7fdaf359e640 1 -- 172.21.15.50:0/3360120047 wait complete. 2023-08-10T10:45:26.047 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-10T10:45:26.047 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-08-10T10:45:26.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-08-10T10:45:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.265+0000 7f0cc064d640 1 Processor -- start 2023-08-10T10:45:26.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.265+0000 7f0cc064d640 1 -- start start 2023-08-10T10:45:26.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cc064d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb80b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cc064d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb80ca930 0x7f0cb80b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cc064d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb8071c70 con 0x7f0cb80b0c60 2023-08-10T10:45:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cc064d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb80713d0 con 0x7f0cb80ca930 2023-08-10T10:45:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cc064d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80716b0 con 0x7f0cb815aa40 2023-08-10T10:45:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cbdbe8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cb80b0c60 0x7f0cb80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43000/0 (socket says 172.21.15.50:43000) 2023-08-10T10:45:26.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cbdbe8640 1 -- 172.21.15.50:0/2761245404 learned_addr learned my addr 172.21.15.50:0/2761245404 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:26.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cbebea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb80ca930 0x7f0cb80b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.267+0000 7f0cbe3e9640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb80b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.268+0000 7f0cbebea640 1 -- 172.21.15.50:0/2761245404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 msgr2=0x7f0cb80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.268+0000 7f0cbebea640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb80b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.268+0000 7f0cbebea640 1 -- 172.21.15.50:0/2761245404 >> v1:172.21.15.50:6789/0 conn(0x7f0cb80b0c60 legacy=0x7f0cb80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.268+0000 7f0cbebea640 1 -- 172.21.15.50:0/2761245404 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8071990 con 0x7f0cb80ca930 2023-08-10T10:45:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.269+0000 7f0cbebea640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb80b3d60 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d90 tx=0x7f0cb002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f391e9f612f2c58 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.269+0000 7f0cbd3e7640 1 -- 172.21.15.50:0/2761245404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb002cbd0 con 0x7f0cb80ca930 2023-08-10T10:45:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.269+0000 7f0cbd3e7640 1 -- 172.21.15.50:0/2761245404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb002cd30 con 0x7f0cb80ca930 2023-08-10T10:45:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.269+0000 7f0cbd3e7640 1 -- 172.21.15.50:0/2761245404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb002cea0 con 0x7f0cb80ca930 2023-08-10T10:45:26.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 -- 172.21.15.50:0/2761245404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 msgr2=0x7f0cb80b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb80b3d60 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d90 tx=0x7f0cb002be20 comp rx=0 tx=0).stop 2023-08-10T10:45:26.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 -- 172.21.15.50:0/2761245404 shutdown_connections 2023-08-10T10:45:26.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb80b3d60 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 --2- 172.21.15.50:0/2761245404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb80b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 -- 172.21.15.50:0/2761245404 >> 172.21.15.50:0/2761245404 conn(0x7f0cb806b590 msgr2=0x7f0cb80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:26.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 -- 172.21.15.50:0/2761245404 shutdown_connections 2023-08-10T10:45:26.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.270+0000 7f0cc064d640 1 -- 172.21.15.50:0/2761245404 wait complete. 2023-08-10T10:45:26.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.272+0000 7f0cc064d640 1 Processor -- start 2023-08-10T10:45:26.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.272+0000 7f0cc064d640 1 -- start start 2023-08-10T10:45:26.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb80b0c60 0x7f0cb815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814a170 con 0x7f0cb80ca930 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80c73f0 con 0x7f0cb80b0c60 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.273+0000 7f0cc064d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb815bf90 con 0x7f0cb815aa40 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54894/0 (socket says 172.21.15.50:54894) 2023-08-10T10:45:26.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 -- 172.21.15.50:0/1894421443 learned_addr learned my addr 172.21.15.50:0/1894421443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbebea640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbe3e9640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb80b0c60 0x7f0cb815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 -- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 msgr2=0x7f0cb815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb815ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 -- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb80b0c60 msgr2=0x7f0cb815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb80b0c60 0x7f0cb815dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 -- 172.21.15.50:0/1894421443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0009a70 con 0x7f0cb80ca930 2023-08-10T10:45:26.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.274+0000 7f0cbdbe8640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c4d0 tx=0x7f0ca800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:26.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.275+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8005ce0 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.275+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8005e40 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.275+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8007270 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.275+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb815c230 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.275+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb80c7080 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.276+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb804e270 con 0x7f0cb80ca930 2023-08-10T10:45:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.277+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ca80073d0 con 0x7f0cb80ca930 2023-08-10T10:45:26.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.278+0000 7f0caeffd640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 0x7f0c9c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:26.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.278+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0ca8088750 con 0x7f0cb80ca930 2023-08-10T10:45:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.279+0000 7f0cbe3e9640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 0x7f0c9c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.279+0000 7f0cbe3e9640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 0x7f0c9c06d140 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:26.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.283+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ca8053aa0 con 0x7f0cb80ca930 2023-08-10T10:45:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:26.543+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f0cb80c7530 con 0x7f0cb80ca930 2023-08-10T10:45:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.033+0000 7f0caeffd640 1 -- 172.21.15.50:0/1894421443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v379) v1 ==== 131+0+0 (secure 0 0 0) 0x7f0ca8017020 con 0x7f0cb80ca930 2023-08-10T10:45:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 msgr2=0x7f0c9c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 0x7f0c9c06d140 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4006fd0 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 msgr2=0x7f0cb8149c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c4d0 tx=0x7f0ca800c990 comp rx=0 tx=0).stop 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 shutdown_connections 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb815aa40 0x7f0cb815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb80ca930 0x7f0cb8149c30 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9c06ac80 0x7f0c9c06d140 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 --2- 172.21.15.50:0/1894421443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb80b0c60 0x7f0cb815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 >> 172.21.15.50:0/1894421443 conn(0x7f0cb806b590 msgr2=0x7f0cb80b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 shutdown_connections 2023-08-10T10:45:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.038+0000 7f0cc064d640 1 -- 172.21.15.50:0/1894421443 wait complete. 2023-08-10T10:45:27.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:27.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.300+0000 7f38e4f9b640 1 Processor -- start 2023-08-10T10:45:27.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.300+0000 7f38e4f9b640 1 -- start start 2023-08-10T10:45:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38e4f9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38e00c9d00 0x7f38e00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38e4f9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38e00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38e4f9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e00cc5a0 con 0x7f38e0159830 2023-08-10T10:45:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38e4f9b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e00b4170 con 0x7f38e00c9d00 2023-08-10T10:45:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38e4f9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e015d720 con 0x7f38e00cd290 2023-08-10T10:45:27.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38df7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f38e0159830 0x7f38e015dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43016/0 (socket says 172.21.15.50:43016) 2023-08-10T10:45:27.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.302+0000 7f38df7fe640 1 -- 172.21.15.50:0/1821534395 learned_addr learned my addr 172.21.15.50:0/1821534395 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304588957 0 0) 0x7f38e00cc5a0 con 0x7f38e0159830 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/1821534395 >> v2:172.21.15.117:3300/0 conn(0x7f38e00c9d00 0x7f38e00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38cc003520 con 0x7f38e0159830 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38dffff640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38e00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90488148 0 0) 0x7f38cc003520 con 0x7f38e0159830 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 msgr2=0x7f38e00cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38e00cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 >> v2:172.21.15.117:3300/0 conn(0x7f38e00c9d00 msgr2=0x7f38e00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 --2- 172.21.15.50:0/1821534395 >> v2:172.21.15.117:3300/0 conn(0x7f38e00c9d00 0x7f38e00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e00cdc20 con 0x7f38e0159830 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f38d0001670 con 0x7f38e0159830 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 >> v1:172.21.15.50:6789/0 conn(0x7f38e0159830 legacy=0x7f38e015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc0039e0 0x7f38cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.303+0000 7f38deffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38deffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e015d720 con 0x7f38cc0047c0 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc00b980 con 0x7f38cc0039e0 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc00bb40 con 0x7f38e00cd290 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38df7fe640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc0039e0 0x7f38cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38dffff640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38d6ffd640 1 -- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 msgr2=0x7f38cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e00cd290 0x7f38cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38d6ffd640 1 -- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc0039e0 msgr2=0x7f38cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.304+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc0039e0 0x7f38cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.305+0000 7f38d6ffd640 1 -- 172.21.15.50:0/1821534395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc003520 con 0x7f38cc0047c0 2023-08-10T10:45:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.305+0000 7f38df7fe640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc0039e0 0x7f38cc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.306+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38cc004c40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007360 tx=0x7f38cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b226c18f56ef96 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.306+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c802ccf0 con 0x7f38cc0047c0 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.306+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c802ce50 con 0x7f38cc0047c0 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.306+0000 7f38deffd640 1 -- 172.21.15.50:0/1821534395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8034660 con 0x7f38cc0047c0 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 -- 172.21.15.50:0/1821534395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 msgr2=0x7f38cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/1821534395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38cc004c40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007360 tx=0x7f38cc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38dffff640 1 -- 172.21.15.50:0/1821534395 reap_dead start 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 -- 172.21.15.50:0/1821534395 shutdown_connections 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 -- 172.21.15.50:0/1821534395 >> 172.21.15.50:0/1821534395 conn(0x7f38e006ab80 msgr2=0x7f38e006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 -- 172.21.15.50:0/1821534395 shutdown_connections 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.307+0000 7f38e4f9b640 1 -- 172.21.15.50:0/1821534395 wait complete. 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.309+0000 7f38e4f9b640 1 Processor -- start 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.309+0000 7f38e4f9b640 1 -- start start 2023-08-10T10:45:27.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38e01515f0 0x7f38e014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e0152c40 0x7f38e01530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e0153630 con 0x7f38cc0047c0 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e0151ab0 con 0x7f38e01515f0 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38e4f9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e0151d90 con 0x7f38e0152c40 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54916/0 (socket says 172.21.15.50:54916) 2023-08-10T10:45:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.310+0000 7f38df7fe640 1 -- 172.21.15.50:0/2339103819 learned_addr learned my addr 172.21.15.50:0/2339103819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 -- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e0152c40 msgr2=0x7f38e01530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e0152c40 0x7f38e01530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 -- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38e01515f0 msgr2=0x7f38e014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38e01515f0 0x7f38e014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 -- 172.21.15.50:0/2339103819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0152070 con 0x7f38cc0047c0 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38df7fe640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e7e0 tx=0x7f38d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000c640 con 0x7f38cc0047c0 2023-08-10T10:45:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000c7a0 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000cb10 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.311+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e014c720 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.312+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e014afb0 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.313+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e014b140 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.314+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38d000cc70 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.315+0000 7f38dcff9640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 0x7f38c006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.315+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f38d0088fe0 con 0x7f38cc0047c0 2023-08-10T10:45:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.315+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 0x7f38c006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.316+0000 7f38d6ffd640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 0x7f38c006d140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007360 tx=0x7f38c802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.319+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38e014b140 con 0x7f38cc0047c0 2023-08-10T10:45:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.513+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38e014cc40 con 0x7f38cc0047c0 2023-08-10T10:45:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.514+0000 7f38dcff9640 1 -- 172.21.15.50:0/2339103819 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+14770 (secure 0 0 0) 0x7f38e014cc40 con 0x7f38cc0047c0 2023-08-10T10:45:27.515 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":121,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:23.985947+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6834/1452491265":"2023-08-11T10:45:20.516670+0000","172.21.15.117:6832/1452491265":"2023-08-11T10:45:20.516670+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 msgr2=0x7f38c006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 0x7f38c006d140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f38c8007360 tx=0x7f38c802e000 comp rx=0 tx=0).stop 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 msgr2=0x7f38e014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e7e0 tx=0x7f38d000eca0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 shutdown_connections 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38e0152c40 0x7f38e01530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38c006ac80 0x7f38c006d140 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38e01515f0 0x7f38e014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 --2- 172.21.15.50:0/2339103819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38cc0047c0 0x7f38e014aa70 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 >> 172.21.15.50:0/2339103819 conn(0x7f38e006ab80 msgr2=0x7f38e00ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 shutdown_connections 2023-08-10T10:45:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.517+0000 7f38e4f9b640 1 -- 172.21.15.50:0/2339103819 wait complete. 2023-08-10T10:45:27.538 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:27.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.776+0000 7fc2c7857640 1 Processor -- start 2023-08-10T10:45:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.776+0000 7fc2c7857640 1 -- start start 2023-08-10T10:45:27.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.777+0000 7fc2c7857640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c015cf70 0x7fc2c0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.777+0000 7fc2c7857640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c00b4640 0x7fc2c0161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.777+0000 7fc2c7857640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c0160a40 con 0x7fc2c015cb90 2023-08-10T10:45:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.777+0000 7fc2c7857640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c00b4bb0 con 0x7fc2c015cf70 2023-08-10T10:45:27.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.777+0000 7fc2c7857640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00b4e90 con 0x7fc2c00b4640 2023-08-10T10:45:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c015cf70 0x7fc2c0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c015cf70 0x7fc2c0160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54918/0 (socket says 172.21.15.50:54918) 2023-08-10T10:45:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3391617854 learned_addr learned my addr 172.21.15.50:0/3391617854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:27.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c5df4640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c00b4640 0x7fc2c0161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3391617854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c00b4640 msgr2=0x7fc2c0161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c00b4640 0x7fc2c0161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3391617854 >> v1:172.21.15.117:6789/0 conn(0x7fc2c015cb90 legacy=0x7fc2c00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.778+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3391617854 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00b5170 con 0x7fc2c015cf70 2023-08-10T10:45:27.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.779+0000 7fc2c4df2640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cf70 0x7fc2c0160ed0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009870 tx=0x7fc2b002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4297e63cfb4e42 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2b7fff640 1 -- 172.21.15.50:0/3391617854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0030840 con 0x7fc2c015cf70 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2b7fff640 1 -- 172.21.15.50:0/3391617854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b00309a0 con 0x7fc2c015cf70 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2b7fff640 1 -- 172.21.15.50:0/3391617854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0030d30 con 0x7fc2c015cf70 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 -- 172.21.15.50:0/3391617854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cf70 msgr2=0x7fc2c0160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cf70 0x7fc2c0160ed0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009870 tx=0x7fc2b002b980 comp rx=0 tx=0).stop 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 -- 172.21.15.50:0/3391617854 shutdown_connections 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c00b4640 0x7fc2c0161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3391617854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cf70 0x7fc2c0160ed0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.780+0000 7fc2c7857640 1 -- 172.21.15.50:0/3391617854 >> 172.21.15.50:0/3391617854 conn(0x7fc2c00cf640 msgr2=0x7fc2c00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.781+0000 7fc2c7857640 1 -- 172.21.15.50:0/3391617854 shutdown_connections 2023-08-10T10:45:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.781+0000 7fc2c7857640 1 -- 172.21.15.50:0/3391617854 wait complete. 2023-08-10T10:45:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.782+0000 7fc2c7857640 1 Processor -- start 2023-08-10T10:45:27.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.782+0000 7fc2c7857640 1 -- start start 2023-08-10T10:45:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 0x7fc2c01f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c015cf70 0x7fc2c00ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01f2fa0 con 0x7fc2c015cb90 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01f3280 con 0x7fc2c00b4640 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.783+0000 7fc2c7857640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01f3560 con 0x7fc2c015cf70 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54922/0 (socket says 172.21.15.50:54922) 2023-08-10T10:45:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3096373631 learned_addr learned my addr 172.21.15.50:0/3096373631 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c5df4640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c015cf70 0x7fc2c00ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c55f3640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 0x7fc2c01f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c015cf70 msgr2=0x7fc2c00ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c015cf70 0x7fc2c00ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 msgr2=0x7fc2c01f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 0x7fc2c01f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c4df2640 1 -- 172.21.15.50:0/3096373631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00094d0 con 0x7fc2c015cb90 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.784+0000 7fc2c55f3640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 0x7fc2c01f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:27.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2c4df2640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc2b002b9c0 tx=0x7fc2b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b003e070 con 0x7fc2c015cb90 2023-08-10T10:45:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b0039a10 con 0x7fc2c015cb90 2023-08-10T10:45:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c015a750 con 0x7fc2c015cb90 2023-08-10T10:45:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0039de0 con 0x7fc2c015cb90 2023-08-10T10:45:27.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.785+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c015a3b0 con 0x7fc2c015cb90 2023-08-10T10:45:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.786+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c015a5a0 con 0x7fc2c015cb90 2023-08-10T10:45:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.787+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2b004b400 con 0x7fc2c015cb90 2023-08-10T10:45:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.789+0000 7fc2b5ffb640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 0x7fc2a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:27.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.789+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc2b00ab890 con 0x7fc2c015cb90 2023-08-10T10:45:27.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.789+0000 7fc2c55f3640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 0x7fc2a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:27.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.790+0000 7fc2c55f3640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 0x7fc2a406d110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc2c01f5c30 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:27.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.793+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc2b0076bc0 con 0x7fc2c015cb90 2023-08-10T10:45:27.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.982+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2c00d35a0 con 0x7fc2c015cb90 2023-08-10T10:45:27.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.983+0000 7fc2b5ffb640 1 -- 172.21.15.50:0/3096373631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2b0034020 con 0x7fc2c015cb90 2023-08-10T10:45:27.983 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:27.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 msgr2=0x7fc2a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 0x7fc2a406d110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc2c01f5c30 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2023-08-10T10:45:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 msgr2=0x7fc2c00c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc2b002b9c0 tx=0x7fc2b00046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 shutdown_connections 2023-08-10T10:45:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2c015cf70 0x7fc2c00ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c015cb90 0x7fc2c00c9c70 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc2a406ac50 0x7fc2a406d110 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 --2- 172.21.15.50:0/3096373631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c00b4640 0x7fc2c01f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.985+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 >> 172.21.15.50:0/3096373631 conn(0x7fc2c00cf640 msgr2=0x7fc2c00d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.986+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 shutdown_connections 2023-08-10T10:45:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:27.986+0000 7fc2c7857640 1 -- 172.21.15.50:0/3096373631 wait complete. 2023-08-10T10:45:28.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:28.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.237+0000 7fcbd7b4f640 1 Processor -- start 2023-08-10T10:45:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.237+0000 7fcbd7b4f640 1 -- start start 2023-08-10T10:45:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd7b4f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbd015cf70 0x7fcbd0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd7b4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd00b4640 0x7fcbd0161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd7b4f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd0160a40 con 0x7fcbd015cb90 2023-08-10T10:45:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd7b4f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00b4bb0 con 0x7fcbd015cf70 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd7b4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00b4e90 con 0x7fcbd00b4640 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbd015cf70 0x7fcbd0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbd015cf70 0x7fcbd0160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54936/0 (socket says 172.21.15.50:54936) 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 -- 172.21.15.50:0/2054025429 learned_addr learned my addr 172.21.15.50:0/2054025429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 -- 172.21.15.50:0/2054025429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd00b4640 msgr2=0x7fcbd0161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 --2- 172.21.15.50:0/2054025429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd00b4640 0x7fcbd0161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 -- 172.21.15.50:0/2054025429 >> v1:172.21.15.117:6789/0 conn(0x7fcbd015cb90 legacy=0x7fcbd00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.239+0000 7fcbd50ea640 1 -- 172.21.15.50:0/2054025429 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00b5170 con 0x7fcbd015cf70 2023-08-10T10:45:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.240+0000 7fcbd50ea640 1 --2- 172.21.15.50:0/2054025429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd0160ed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009870 tx=0x7fcbc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dcf22d6bcd0be server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.241+0000 7fcbd48e9640 1 -- 172.21.15.50:0/2054025429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0031640 con 0x7fcbd015cf70 2023-08-10T10:45:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.241+0000 7fcbd48e9640 1 -- 172.21.15.50:0/2054025429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc00317a0 con 0x7fcbd015cf70 2023-08-10T10:45:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.241+0000 7fcbd48e9640 1 -- 172.21.15.50:0/2054025429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0031b30 con 0x7fcbd015cf70 2023-08-10T10:45:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/2054025429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 msgr2=0x7fcbd0160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/2054025429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd0160ed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009870 tx=0x7fcbc002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/2054025429 shutdown_connections 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/2054025429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd00b4640 0x7fcbd0161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/2054025429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd0160ed0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/2054025429 >> 172.21.15.50:0/2054025429 conn(0x7fcbd00cf640 msgr2=0x7fcbd00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/2054025429 shutdown_connections 2023-08-10T10:45:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.242+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/2054025429 wait complete. 2023-08-10T10:45:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.244+0000 7fcbd7b4f640 1 Processor -- start 2023-08-10T10:45:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.244+0000 7fcbd7b4f640 1 -- start start 2023-08-10T10:45:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00b4640 0x7fcbd0158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015cb90 0x7fcbd01f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015ebe0 con 0x7fcbd015cf70 2023-08-10T10:45:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd01f3060 con 0x7fcbd00b4640 2023-08-10T10:45:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd7b4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd01f3340 con 0x7fcbd015cb90 2023-08-10T10:45:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd60ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd60ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54948/0 (socket says 172.21.15.50:54948) 2023-08-10T10:45:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd60ec640 1 -- 172.21.15.50:0/3216633804 learned_addr learned my addr 172.21.15.50:0/3216633804 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd58eb640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00b4640 0x7fcbd0158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.245+0000 7fcbd50ea640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015cb90 0x7fcbd01f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 -- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015cb90 msgr2=0x7fcbd01f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015cb90 0x7fcbd01f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 -- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00b4640 msgr2=0x7fcbd0158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00b4640 0x7fcbd0158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 -- 172.21.15.50:0/3216633804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00094d0 con 0x7fcbd015cf70 2023-08-10T10:45:28.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd60ec640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800b970 tx=0x7fcbc800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800cb40 con 0x7fcbd015cf70 2023-08-10T10:45:28.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc800ccc0 con 0x7fcbd015cf70 2023-08-10T10:45:28.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8014680 con 0x7fcbd015cf70 2023-08-10T10:45:28.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd01f3620 con 0x7fcbd015cf70 2023-08-10T10:45:28.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.246+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd0159220 con 0x7fcbd015cf70 2023-08-10T10:45:28.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.248+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd015ed50 con 0x7fcbd015cf70 2023-08-10T10:45:28.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.249+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbc801d3b0 con 0x7fcbd015cf70 2023-08-10T10:45:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.249+0000 7fcbc67fc640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 0x7fcbb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.250+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcbc8089150 con 0x7fcbd015cf70 2023-08-10T10:45:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.250+0000 7fcbd58eb640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 0x7fcbb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.250+0000 7fcbd58eb640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 0x7fcbb406d110 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc004ea0 tx=0x7fcbcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.253+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbc8054500 con 0x7fcbd015cf70 2023-08-10T10:45:28.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.449+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbd00612b0 con 0x7fcbd015cf70 2023-08-10T10:45:28.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.450+0000 7fcbc67fc640 1 -- 172.21.15.50:0/3216633804 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v121) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcbc8019020 con 0x7fcbd015cf70 2023-08-10T10:45:28.451 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 msgr2=0x7fcbb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 0x7fcbb406d110 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc004ea0 tx=0x7fcbcc009040 comp rx=0 tx=0).stop 2023-08-10T10:45:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 msgr2=0x7fcbd015f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800b970 tx=0x7fcbc800be30 comp rx=0 tx=0).stop 2023-08-10T10:45:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 shutdown_connections 2023-08-10T10:45:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd015cf70 0x7fcbd015f070 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015cb90 0x7fcbd01f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcbb406ac50 0x7fcbb406d110 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 --2- 172.21.15.50:0/3216633804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00b4640 0x7fcbd0158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 >> 172.21.15.50:0/3216633804 conn(0x7fcbd00cf640 msgr2=0x7fcbd00c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 shutdown_connections 2023-08-10T10:45:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.453+0000 7fcbd7b4f640 1 -- 172.21.15.50:0/3216633804 wait complete. 2023-08-10T10:45:28.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:45:28.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.704+0000 7ff877fff640 1 Processor -- start 2023-08-10T10:45:28.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.704+0000 7ff877fff640 1 -- start start 2023-08-10T10:45:28.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff877fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8781599e0 0x7ff8780ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff877fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780ccff0 con 0x7ff878069db0 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff877fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780cdca0 con 0x7ff8780c8b50 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff877fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8780cdf80 con 0x7ff8781599e0 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff876ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8781599e0 0x7ff8780ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff8777fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff878069db0 0x7ff8780b3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43030/0 (socket says 172.21.15.50:43030) 2023-08-10T10:45:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.706+0000 7ff8777fe640 1 -- 172.21.15.50:0/165467785 learned_addr learned my addr 172.21.15.50:0/165467785 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:28.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.707+0000 7ff876ffd640 1 -- 172.21.15.50:0/165467785 >> v1:172.21.15.117:6789/0 conn(0x7ff8780c8b50 legacy=0x7ff8780696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:28.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.707+0000 7ff876ffd640 1 -- 172.21.15.50:0/165467785 >> v1:172.21.15.50:6789/0 conn(0x7ff878069db0 legacy=0x7ff8780b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.707+0000 7ff876ffd640 1 -- 172.21.15.50:0/165467785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780b2910 con 0x7ff8781599e0 2023-08-10T10:45:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.707+0000 7ff8767fc640 1 -- 172.21.15.50:0/165467785 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423283517 0 0) 0x7ff8780ccff0 con 0x7ff878069db0 2023-08-10T10:45:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.708+0000 7ff876ffd640 1 --2- 172.21.15.50:0/165467785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8781599e0 0x7ff8780ccab0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff8680097a0 tx=0x7ff86802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ed0c1df1bca3f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.708+0000 7ff8767fc640 1 -- 172.21.15.50:0/165467785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868031830 con 0x7ff8781599e0 2023-08-10T10:45:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.708+0000 7ff8767fc640 1 -- 172.21.15.50:0/165467785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868031990 con 0x7ff8781599e0 2023-08-10T10:45:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.708+0000 7ff8767fc640 1 -- 172.21.15.50:0/165467785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868031d20 con 0x7ff8781599e0 2023-08-10T10:45:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 -- 172.21.15.50:0/165467785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8781599e0 msgr2=0x7ff8780ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 --2- 172.21.15.50:0/165467785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8781599e0 0x7ff8780ccab0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff8680097a0 tx=0x7ff86802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 -- 172.21.15.50:0/165467785 shutdown_connections 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 --2- 172.21.15.50:0/165467785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8781599e0 0x7ff8780ccab0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 -- 172.21.15.50:0/165467785 >> 172.21.15.50:0/165467785 conn(0x7ff8780caf80 msgr2=0x7ff8780cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 -- 172.21.15.50:0/165467785 shutdown_connections 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.709+0000 7ff877fff640 1 -- 172.21.15.50:0/165467785 wait complete. 2023-08-10T10:45:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.711+0000 7ff877fff640 1 Processor -- start 2023-08-10T10:45:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.711+0000 7ff877fff640 1 -- start start 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 0x7ff87814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8781599e0 0x7ff8780bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c4cb0 con 0x7ff878069db0 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c5d40 con 0x7ff8781599e0 2023-08-10T10:45:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff877fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c1dd0 con 0x7ff8780c8b50 2023-08-10T10:45:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff876ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff876ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54966/0 (socket says 172.21.15.50:54966) 2023-08-10T10:45:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.712+0000 7ff876ffd640 1 -- 172.21.15.50:0/423860851 learned_addr learned my addr 172.21.15.50:0/423860851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:28.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 -- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 msgr2=0x7ff87814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff86ffff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 0x7ff87814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 0x7ff87814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 -- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8781599e0 msgr2=0x7ff8780bdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8781599e0 0x7ff8780bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 -- 172.21.15.50:0/423860851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868009400 con 0x7ff878069db0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff86ffff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 0x7ff87814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.713+0000 7ff876ffd640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff868000c00 tx=0x7ff8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.714+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868004230 con 0x7ff878069db0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.714+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868004390 con 0x7ff878069db0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.714+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780c5b10 con 0x7ff878069db0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.714+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86803a940 con 0x7ff878069db0 2023-08-10T10:45:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.714+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff878151160 con 0x7ff878069db0 2023-08-10T10:45:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.715+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780adb40 con 0x7ff878069db0 2023-08-10T10:45:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.716+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff86803aaa0 con 0x7ff878069db0 2023-08-10T10:45:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.717+0000 7ff874ff9640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 0x7ff85806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.717+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff8680ab990 con 0x7ff878069db0 2023-08-10T10:45:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.718+0000 7ff86ffff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 0x7ff85806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.718+0000 7ff86ffff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 0x7ff85806d110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff8780c1240 tx=0x7ff860009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:28.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.722+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff868076d50 con 0x7ff878069db0 2023-08-10T10:45:28.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.915+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff8780cd8d0 con 0x7ff878069db0 2023-08-10T10:45:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.924+0000 7ff874ff9640 1 -- 172.21.15.50:0/423860851 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff86807a370 con 0x7ff878069db0 2023-08-10T10:45:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.926+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 msgr2=0x7ff85806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.926+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 0x7ff85806d110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff8780c1240 tx=0x7ff860009040 comp rx=0 tx=0).stop 2023-08-10T10:45:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.926+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 msgr2=0x7ff8780c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.926+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff868000c00 tx=0x7ff8680046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 shutdown_connections 2023-08-10T10:45:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff85806ac50 0x7ff85806d110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8781599e0 0x7ff8780bdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780c8b50 0x7ff87814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 --2- 172.21.15.50:0/423860851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff878069db0 0x7ff8780c55d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 >> 172.21.15.50:0/423860851 conn(0x7ff8780caf80 msgr2=0x7ff8780cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:28.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 shutdown_connections 2023-08-10T10:45:28.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:28.927+0000 7ff877fff640 1 -- 172.21.15.50:0/423860851 wait complete. 2023-08-10T10:45:28.948 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:45:28.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:29.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:29.199 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:45:29.199 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:29.200 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:29.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:45:29.263 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:29.263 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:29.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:45:29.323 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:29.324 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:29.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:45:29.389 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:29.389 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:29.447 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:45:29.448 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:45:29.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.685+0000 7fc198645640 1 Processor -- start 2023-08-10T10:45:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.685+0000 7fc198645640 1 -- start start 2023-08-10T10:45:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc198645640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc19015aa40 0x7fc1900b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc198645640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1900b0c60 0x7fc1900b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc198645640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc190071c70 con 0x7fc190070e80 2023-08-10T10:45:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc198645640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900713d0 con 0x7fc1900b0c60 2023-08-10T10:45:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc198645640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900716b0 con 0x7fc19015aa40 2023-08-10T10:45:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc196be2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc190070e80 0x7fc1900696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43034/0 (socket says 172.21.15.50:43034) 2023-08-10T10:45:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc196be2640 1 -- 172.21.15.50:0/3309616310 learned_addr learned my addr 172.21.15.50:0/3309616310 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.687+0000 7fc195be0640 1 --2- 172.21.15.50:0/3309616310 >> v2:172.21.15.50:3300/0 conn(0x7fc1900b0c60 0x7fc1900b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc1963e1640 1 --2- 172.21.15.50:0/3309616310 >> v2:172.21.15.117:3300/0 conn(0x7fc19015aa40 0x7fc1900b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc1953df640 1 -- 172.21.15.50:0/3309616310 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523836640 0 0) 0x7fc190071c70 con 0x7fc190070e80 2023-08-10T10:45:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc1953df640 1 -- 172.21.15.50:0/3309616310 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c003520 con 0x7fc190070e80 2023-08-10T10:45:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc195be0640 1 -- 172.21.15.50:0/3309616310 >> v2:172.21.15.117:3300/0 conn(0x7fc19015aa40 msgr2=0x7fc1900b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc195be0640 1 --2- 172.21.15.50:0/3309616310 >> v2:172.21.15.117:3300/0 conn(0x7fc19015aa40 0x7fc1900b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc195be0640 1 -- 172.21.15.50:0/3309616310 >> v1:172.21.15.50:6789/0 conn(0x7fc190070e80 legacy=0x7fc1900696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.688+0000 7fc195be0640 1 -- 172.21.15.50:0/3309616310 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190071990 con 0x7fc1900b0c60 2023-08-10T10:45:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.689+0000 7fc195be0640 1 --2- 172.21.15.50:0/3309616310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1900b0c60 0x7fc1900b3d60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc1900c8dc0 tx=0x7fc18002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa5755a10e40d6f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc1953df640 1 -- 172.21.15.50:0/3309616310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18002e070 con 0x7fc1900b0c60 2023-08-10T10:45:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc1953df640 1 -- 172.21.15.50:0/3309616310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1800315a0 con 0x7fc1900b0c60 2023-08-10T10:45:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc1953df640 1 -- 172.21.15.50:0/3309616310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180031910 con 0x7fc1900b0c60 2023-08-10T10:45:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 -- 172.21.15.50:0/3309616310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1900b0c60 msgr2=0x7fc1900b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 --2- 172.21.15.50:0/3309616310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1900b0c60 0x7fc1900b3d60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc1900c8dc0 tx=0x7fc18002b840 comp rx=0 tx=0).stop 2023-08-10T10:45:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 -- 172.21.15.50:0/3309616310 shutdown_connections 2023-08-10T10:45:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 --2- 172.21.15.50:0/3309616310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1900b0c60 0x7fc1900b3d60 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 --2- 172.21.15.50:0/3309616310 >> v2:172.21.15.117:3300/0 conn(0x7fc19015aa40 0x7fc1900b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.690+0000 7fc198645640 1 -- 172.21.15.50:0/3309616310 >> 172.21.15.50:0/3309616310 conn(0x7fc19006b590 msgr2=0x7fc1900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.691+0000 7fc198645640 1 -- 172.21.15.50:0/3309616310 shutdown_connections 2023-08-10T10:45:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.691+0000 7fc198645640 1 -- 172.21.15.50:0/3309616310 wait complete. 2023-08-10T10:45:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.692+0000 7fc198645640 1 Processor -- start 2023-08-10T10:45:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.693+0000 7fc198645640 1 -- start start 2023-08-10T10:45:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.693+0000 7fc198645640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc190070e80 0x7fc19014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc198645640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 0x7fc1900c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc198645640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc198645640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901f2160 con 0x7fc19015aa40 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc198645640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901f64b0 con 0x7fc1900b0c60 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc198645640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc190150920 con 0x7fc190070e80 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54986/0 (socket says 172.21.15.50:54986) 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 -- 172.21.15.50:0/1510612473 learned_addr learned my addr 172.21.15.50:0/1510612473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc1963e1640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc190070e80 0x7fc19014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc195be0640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 0x7fc1900c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 -- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc190070e80 msgr2=0x7fc19014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc190070e80 0x7fc19014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 -- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 msgr2=0x7fc1900c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 0x7fc1900c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc196be2640 1 -- 172.21.15.50:0/1510612473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009400 con 0x7fc19015aa40 2023-08-10T10:45:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.694+0000 7fc195be0640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 0x7fc1900c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc196be2640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc18800cb40 tx=0x7fc18800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800aca0 con 0x7fc19015aa40 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18800ae00 con 0x7fc19015aa40 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188012620 con 0x7fc19015aa40 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc190150c00 con 0x7fc19015aa40 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.695+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1901f6790 con 0x7fc19015aa40 2023-08-10T10:45:29.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.696+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190150780 con 0x7fc19015aa40 2023-08-10T10:45:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.697+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc188007070 con 0x7fc19015aa40 2023-08-10T10:45:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.698+0000 7fc186ffd640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 0x7fc17406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.698+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc1880892f0 con 0x7fc19015aa40 2023-08-10T10:45:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.699+0000 7fc1963e1640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 0x7fc17406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.699+0000 7fc1963e1640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 0x7fc17406d110 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc18c006fd0 tx=0x7fc18c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.703+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc190150780 con 0x7fc19015aa40 2023-08-10T10:45:29.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.930+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc190151120 con 0x7fc19015aa40 2023-08-10T10:45:29.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.931+0000 7fc186ffd640 1 -- 172.21.15.50:0/1510612473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc188017de0 con 0x7fc19015aa40 2023-08-10T10:45:29.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:29.932 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1361187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1361187898},{"type":"v1","addr":"172.21.15.117:6835","nonce":1361187898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/2975676299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2975676299},{"type":"v1","addr":"172.21.15.50:6836","nonce":2975676299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1505634974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":1505634974},{"type":"v1","addr":"172.21.15.50:6837","nonce":1505634974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6028,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/273442333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":273442333},{"type":"v1","addr":"172.21.15.117:6834","nonce":273442333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[]} 2023-08-10T10:45:29.932 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2023-08-10T10:45:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 msgr2=0x7fc17406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 0x7fc17406d110 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc18c006fd0 tx=0x7fc18c008040 comp rx=0 tx=0).stop 2023-08-10T10:45:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 msgr2=0x7fc190154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:29.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc18800cb40 tx=0x7fc18800a060 comp rx=0 tx=0).stop 2023-08-10T10:45:29.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 shutdown_connections 2023-08-10T10:45:29.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19015aa40 0x7fc190154e30 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc17406ac50 0x7fc17406d110 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1900b0c60 0x7fc1900c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 --2- 172.21.15.50:0/1510612473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc190070e80 0x7fc19014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 >> 172.21.15.50:0/1510612473 conn(0x7fc19006b590 msgr2=0x7fc1900b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 shutdown_connections 2023-08-10T10:45:29.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:29.934+0000 7fc198645640 1 -- 172.21.15.50:0/1510612473 wait complete. 2023-08-10T10:45:29.953 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:45:29.953 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:45:29.954 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:45:29.954 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:45:29.954 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:45:29.954 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:45:29.955 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:45:29.955 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:45:29.955 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:45:29.955 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:45:29.955 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:45:29.956 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:45:29.956 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:45:29.959 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:45:29.959 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:45:29.959 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:45:29.973 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:45:29.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:45:29.980 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:45:29.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:45:29.985 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:45:29.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:45:29.987 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:45:29.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:45:30.033 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:45:30.034 DEBUG:teuthology.parallel:result is None 2023-08-10T10:45:30.035 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:45:30.035 DEBUG:teuthology.parallel:result is None 2023-08-10T10:45:30.042 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:45:30.042 DEBUG:teuthology.parallel:result is None 2023-08-10T10:45:30.043 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:45:30.043 DEBUG:teuthology.parallel:result is None 2023-08-10T10:45:30.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:45:30.198 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:45:30.198 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:45:30.199 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:45:30.201 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:45:30.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.236+0000 7fc8b7f55640 1 Processor -- start 2023-08-10T10:45:30.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.237+0000 7fc8b7f55640 1 -- start start 2023-08-10T10:45:30.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b7f55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8b01570f0 0x7fc8b00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b7f55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 0x7fc8b00cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b7f55640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b015d2a0 con 0x7fc8b00cf680 2023-08-10T10:45:30.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b7f55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00cfaf0 con 0x7fc8b01570f0 2023-08-10T10:45:30.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b7f55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b015d580 con 0x7fc8b00ce970 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b5cf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8b01570f0 0x7fc8b00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b5cf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8b01570f0 0x7fc8b00ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55026/0 (socket says 172.21.15.50:55026) 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/1946853553 learned_addr learned my addr 172.21.15.50:0/1946853553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.238+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 0x7fc8b00cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.239+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/1946853553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 msgr2=0x7fc8b00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.239+0000 7fc8b5cf1640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 0x7fc8b00cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.239+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/1946853553 >> v1:172.21.15.117:6789/0 conn(0x7fc8b00cf680 legacy=0x7fc8b00adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.239+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/1946853553 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b015d860 con 0x7fc8b01570f0 2023-08-10T10:45:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.239+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 0x7fc8b00cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.240+0000 7fc8b5cf1640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b01570f0 0x7fc8b00ce430 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3630181fc6401422 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.240+0000 7fc8b4cef640 1 -- 172.21.15.50:0/1946853553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031640 con 0x7fc8b01570f0 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.240+0000 7fc8b4cef640 1 -- 172.21.15.50:0/1946853553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0317a0 con 0x7fc8b01570f0 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.240+0000 7fc8b4cef640 1 -- 172.21.15.50:0/1946853553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031b30 con 0x7fc8b01570f0 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 -- 172.21.15.50:0/1946853553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b01570f0 msgr2=0x7fc8b00ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b01570f0 0x7fc8b00ce430 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 -- 172.21.15.50:0/1946853553 shutdown_connections 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00ce970 0x7fc8b00cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/1946853553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b01570f0 0x7fc8b00ce430 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 -- 172.21.15.50:0/1946853553 >> 172.21.15.50:0/1946853553 conn(0x7fc8b00698b0 msgr2=0x7fc8b0069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 -- 172.21.15.50:0/1946853553 shutdown_connections 2023-08-10T10:45:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.241+0000 7fc8b7f55640 1 -- 172.21.15.50:0/1946853553 wait complete. 2023-08-10T10:45:30.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.243+0000 7fc8b7f55640 1 Processor -- start 2023-08-10T10:45:30.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.243+0000 7fc8b7f55640 1 -- start start 2023-08-10T10:45:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 0x7fc8b00c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b01570f0 0x7fc8b01f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b1ba0 con 0x7fc8b00ce970 2023-08-10T10:45:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00c4fb0 con 0x7fc8b01570f0 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b7f55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b1df0 con 0x7fc8b00cf680 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b5cf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b5cf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55028/0 (socket says 172.21.15.50:55028) 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.244+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/3477065614 learned_addr learned my addr 172.21.15.50:0/3477065614 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 0x7fc8b00c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b64f2640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b01570f0 0x7fc8b01f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 msgr2=0x7fc8b00c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 0x7fc8b00c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b01570f0 msgr2=0x7fc8b01f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b01570f0 0x7fc8b01f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 -- 172.21.15.50:0/3477065614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0009400 con 0x7fc8b00ce970 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 0x7fc8b00c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.245+0000 7fc8b5cf1640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.246+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac03a930 con 0x7fc8b00ce970 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.246+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac03aa90 con 0x7fc8b00ce970 2023-08-10T10:45:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.246+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac03ae40 con 0x7fc8b00ce970 2023-08-10T10:45:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.246+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac0094d0 con 0x7fc8b00ce970 2023-08-10T10:45:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.246+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b00b23b0 con 0x7fc8b00ce970 2023-08-10T10:45:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.247+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b004e270 con 0x7fc8b00ce970 2023-08-10T10:45:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.248+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8ac02f050 con 0x7fc8b00ce970 2023-08-10T10:45:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.249+0000 7fc8a67fc640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 0x7fc89406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.249+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc8ac0aaf90 con 0x7fc8b00ce970 2023-08-10T10:45:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.249+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 0x7fc89406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.250+0000 7fc8b54f0640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 0x7fc89406d110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00660d0 tx=0x7fc8a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.253+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc8ac076350 con 0x7fc8b00ce970 2023-08-10T10:45:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:30.456+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc8b00b25a0 con 0x7fc8b00ce970 2023-08-10T10:45:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.069+0000 7fc8a67fc640 1 -- 172.21.15.50:0/3477065614 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc8ac035080 con 0x7fc8b00ce970 2023-08-10T10:45:31.070 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:45:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 msgr2=0x7fc89406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 0x7fc89406d110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00660d0 tx=0x7fc8a0008040 comp rx=0 tx=0).stop 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 msgr2=0x7fc8b00cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac0046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 shutdown_connections 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc89406ac50 0x7fc89406d110 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b01570f0 0x7fc8b01f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b00cf680 0x7fc8b00c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 --2- 172.21.15.50:0/3477065614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8b00ce970 0x7fc8b00cbc80 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.073+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 >> 172.21.15.50:0/3477065614 conn(0x7fc8b00698b0 msgr2=0x7fc8b00c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.074+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 shutdown_connections 2023-08-10T10:45:31.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.074+0000 7fc8b7f55640 1 -- 172.21.15.50:0/3477065614 wait complete. 2023-08-10T10:45:31.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:45:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.313+0000 7f2618834640 1 Processor -- start 2023-08-10T10:45:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.313+0000 7f2618834640 1 -- start start 2023-08-10T10:45:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f2618834640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f261415aa40 0x7f26140b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f2618834640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 0x7f26140b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f2618834640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2614071c70 con 0x7f2614070e80 2023-08-10T10:45:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f2618834640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140713d0 con 0x7f261415aa40 2023-08-10T10:45:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f2618834640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140716b0 con 0x7f26140b0c60 2023-08-10T10:45:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.315+0000 7f261259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f261415aa40 0x7f26140b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f2612d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2614070e80 0x7f26140696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43054/0 (socket says 172.21.15.50:43054) 2023-08-10T10:45:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f2612d9d640 1 -- 172.21.15.50:0/3495903908 learned_addr learned my addr 172.21.15.50:0/3495903908 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f260bfff640 1 --2- 172.21.15.50:0/3495903908 >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 0x7f26140b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f261259c640 1 -- 172.21.15.50:0/3495903908 >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 msgr2=0x7f26140b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f261259c640 1 --2- 172.21.15.50:0/3495903908 >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 0x7f26140b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f261259c640 1 -- 172.21.15.50:0/3495903908 >> v1:172.21.15.50:6789/0 conn(0x7f2614070e80 legacy=0x7f26140696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f261259c640 1 -- 172.21.15.50:0/3495903908 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614071990 con 0x7f261415aa40 2023-08-10T10:45:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.316+0000 7f260bfff640 1 --2- 172.21.15.50:0/3495903908 >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 0x7f26140b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.317+0000 7f261259c640 1 --2- 172.21.15.50:0/3495903908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261415aa40 0x7f26140b3820 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f261415e6e0 tx=0x7f260402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1523bd6a6642979f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.317+0000 7f2611d9b640 1 -- 172.21.15.50:0/3495903908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260402e070 con 0x7f261415aa40 2023-08-10T10:45:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2611d9b640 1 -- 172.21.15.50:0/3495903908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040315a0 con 0x7f261415aa40 2023-08-10T10:45:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2611d9b640 1 -- 172.21.15.50:0/3495903908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604031930 con 0x7f261415aa40 2023-08-10T10:45:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 -- 172.21.15.50:0/3495903908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261415aa40 msgr2=0x7f26140b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 --2- 172.21.15.50:0/3495903908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261415aa40 0x7f26140b3820 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f261415e6e0 tx=0x7f260402b840 comp rx=0 tx=0).stop 2023-08-10T10:45:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 -- 172.21.15.50:0/3495903908 shutdown_connections 2023-08-10T10:45:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 --2- 172.21.15.50:0/3495903908 >> v2:172.21.15.117:3300/0 conn(0x7f26140b0c60 0x7f26140b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 --2- 172.21.15.50:0/3495903908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261415aa40 0x7f26140b3820 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 -- 172.21.15.50:0/3495903908 >> 172.21.15.50:0/3495903908 conn(0x7f261406b590 msgr2=0x7f26140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 -- 172.21.15.50:0/3495903908 shutdown_connections 2023-08-10T10:45:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.318+0000 7f2618834640 1 -- 172.21.15.50:0/3495903908 wait complete. 2023-08-10T10:45:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.320+0000 7f2618834640 1 Processor -- start 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.320+0000 7f2618834640 1 -- start start 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 0x7f2614146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261415aa40 0x7f2614159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415d3c0 con 0x7f2614070e80 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415cbd0 con 0x7f26140b0c60 2023-08-10T10:45:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f2618834640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261415b390 con 0x7f261415aa40 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f261259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f261259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55044/0 (socket says 172.21.15.50:55044) 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.321+0000 7f261259c640 1 -- 172.21.15.50:0/1454985980 learned_addr learned my addr 172.21.15.50:0/1454985980 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f260bfff640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 0x7f2614146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f2612d9d640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261415aa40 0x7f2614159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 -- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261415aa40 msgr2=0x7f2614159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261415aa40 0x7f2614159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 -- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 msgr2=0x7f2614146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 0x7f2614146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 -- 172.21.15.50:0/1454985980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009400 con 0x7f2614070e80 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f260bfff640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 0x7f2614146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.322+0000 7f261259c640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f260402be50 tx=0x7f26040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.323+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604032900 con 0x7f2614070e80 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.323+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604032a60 con 0x7f2614070e80 2023-08-10T10:45:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.323+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604032e10 con 0x7f2614070e80 2023-08-10T10:45:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.323+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261415b670 con 0x7f2614070e80 2023-08-10T10:45:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.323+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261415bc30 con 0x7f2614070e80 2023-08-10T10:45:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.324+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614066390 con 0x7f2614070e80 2023-08-10T10:45:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.325+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26040453f0 con 0x7f2614070e80 2023-08-10T10:45:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.326+0000 7f260affd640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 0x7f25f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.326+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f26040ab330 con 0x7f2614070e80 2023-08-10T10:45:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.326+0000 7f260bfff640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 0x7f25f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.327+0000 7f260bfff640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 0x7f25f406d110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006fd0 tx=0x7f25fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.330+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2604076840 con 0x7f2614070e80 2023-08-10T10:45:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.593+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f261404e270 con 0x7f2614070e80 2023-08-10T10:45:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.594+0000 7f260affd640 1 -- 172.21.15.50:0/1454985980 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2604079e60 con 0x7f2614070e80 2023-08-10T10:45:31.595 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:31.595 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:45:31.595 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:45:31.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:45:31.596 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.597 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:45:31.597 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:45:31.598 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:45:31.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:45:31.599 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:45:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:45:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.601 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.604 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.605 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:45:31.606 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:45:31.607 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:45:31.611 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.612 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:45:31.613 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:45:31.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:45:31.616 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:45:31.617 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.618 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:31.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:31.621 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:45:31.621 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:45:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.596+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 msgr2=0x7f25f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.596+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 0x7f25f406d110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006fd0 tx=0x7f25fc008040 comp rx=0 tx=0).stop 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.596+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 msgr2=0x7f261415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.596+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f260402be50 tx=0x7f26040046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 shutdown_connections 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261415aa40 0x7f2614159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f25f406ac50 0x7f25f406d110 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26140b0c60 0x7f2614146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 --2- 172.21.15.50:0/1454985980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2614070e80 0x7f261415ce80 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 >> 172.21.15.50:0/1454985980 conn(0x7f261406b590 msgr2=0x7f26140cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 shutdown_connections 2023-08-10T10:45:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.597+0000 7f2618834640 1 -- 172.21.15.50:0/1454985980 wait complete. 2023-08-10T10:45:31.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.851+0000 7f9c4b48a640 1 Processor -- start 2023-08-10T10:45:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.851+0000 7f9c4b48a640 1 -- start start 2023-08-10T10:45:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.852+0000 7f9c4b48a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.852+0000 7f9c4b48a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c440cfd40 0x7f9c440b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4b48a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4415d010 con 0x7f9c44153c30 2023-08-10T10:45:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4b48a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4415d290 con 0x7f9c440cfd40 2023-08-10T10:45:31.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4b48a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4415d570 con 0x7f9c44153850 2023-08-10T10:45:31.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4a488640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4a488640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:50096/0 (socket says 172.21.15.50:50096) 2023-08-10T10:45:31.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.853+0000 7f9c4a488640 1 -- 172.21.15.50:0/2829965942 learned_addr learned my addr 172.21.15.50:0/2829965942 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.854+0000 7f9c4ac89640 1 --2- 172.21.15.50:0/2829965942 >> v2:172.21.15.117:3300/0 conn(0x7f9c440cfd40 0x7f9c440b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.854+0000 7f9c4a488640 1 -- 172.21.15.50:0/2829965942 >> v2:172.21.15.117:3300/0 conn(0x7f9c440cfd40 msgr2=0x7f9c440b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.854+0000 7f9c4a488640 1 --2- 172.21.15.50:0/2829965942 >> v2:172.21.15.117:3300/0 conn(0x7f9c440cfd40 0x7f9c440b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.854+0000 7f9c4a488640 1 -- 172.21.15.50:0/2829965942 >> v1:172.21.15.117:6789/0 conn(0x7f9c44153c30 legacy=0x7f9c440cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.854+0000 7f9c4a488640 1 -- 172.21.15.50:0/2829965942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4415d850 con 0x7f9c44153850 2023-08-10T10:45:31.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.856+0000 7f9c4a488640 1 --2- 172.21.15.50:0/2829965942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c4002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7639756f962779 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c49486640 1 -- 172.21.15.50:0/2829965942 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40030840 con 0x7f9c44153850 2023-08-10T10:45:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c49486640 1 -- 172.21.15.50:0/2829965942 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c400309a0 con 0x7f9c44153850 2023-08-10T10:45:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c49486640 1 -- 172.21.15.50:0/2829965942 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40030d30 con 0x7f9c44153850 2023-08-10T10:45:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 -- 172.21.15.50:0/2829965942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 msgr2=0x7f9c440b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/2829965942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c4002b980 comp rx=0 tx=0).stop 2023-08-10T10:45:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 -- 172.21.15.50:0/2829965942 shutdown_connections 2023-08-10T10:45:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/2829965942 >> v2:172.21.15.117:3300/0 conn(0x7f9c440cfd40 0x7f9c440b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/2829965942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153850 0x7f9c440b1690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.857+0000 7f9c4b48a640 1 -- 172.21.15.50:0/2829965942 >> 172.21.15.50:0/2829965942 conn(0x7f9c44069880 msgr2=0x7f9c44069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.858+0000 7f9c4b48a640 1 -- 172.21.15.50:0/2829965942 shutdown_connections 2023-08-10T10:45:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.858+0000 7f9c4b48a640 1 -- 172.21.15.50:0/2829965942 wait complete. 2023-08-10T10:45:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.860+0000 7f9c4b48a640 1 Processor -- start 2023-08-10T10:45:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.860+0000 7f9c4b48a640 1 -- start start 2023-08-10T10:45:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c440cfd40 0x7f9c44151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153c30 0x7f9c44155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c441524f0 con 0x7f9c44153850 2023-08-10T10:45:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c441541d0 con 0x7f9c440cfd40 2023-08-10T10:45:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c4b48a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c441544b0 con 0x7f9c44153c30 2023-08-10T10:45:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.861+0000 7f9c49c87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55050/0 (socket says 172.21.15.50:55050) 2023-08-10T10:45:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 -- 172.21.15.50:0/1921289360 learned_addr learned my addr 172.21.15.50:0/1921289360 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c4ac89640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153c30 0x7f9c44155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c4a488640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c440cfd40 0x7f9c44151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 -- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153c30 msgr2=0x7f9c44155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153c30 0x7f9c44155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 -- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c440cfd40 msgr2=0x7f9c44151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c440cfd40 0x7f9c44151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 -- 172.21.15.50:0/1921289360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400094d0 con 0x7f9c44153850 2023-08-10T10:45:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.862+0000 7f9c49c87640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c400 tx=0x7f9c3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.863+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340052d0 con 0x7f9c44153850 2023-08-10T10:45:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.863+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34005430 con 0x7f9c44153850 2023-08-10T10:45:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.863+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34003830 con 0x7f9c44153850 2023-08-10T10:45:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.863+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44154790 con 0x7f9c44153850 2023-08-10T10:45:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.863+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c44154d50 con 0x7f9c44153850 2023-08-10T10:45:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.864+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c44066e30 con 0x7f9c44153850 2023-08-10T10:45:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.865+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c34003990 con 0x7f9c44153850 2023-08-10T10:45:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.866+0000 7f9c3affd640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 0x7f9c2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.866+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c34088700 con 0x7f9c44153850 2023-08-10T10:45:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.866+0000 7f9c4a488640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 0x7f9c2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.867+0000 7f9c4a488640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 0x7f9c2806d110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c40036000 tx=0x7f9c40008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:31.873+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c34053af0 con 0x7f9c44153850 2023-08-10T10:45:32.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.067+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c440b50f0 con 0x7f9c44153850 2023-08-10T10:45:32.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.068+0000 7f9c3affd640 1 -- 172.21.15.50:0/1921289360 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f9c34057110 con 0x7f9c44153850 2023-08-10T10:45:32.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":125,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:31.079187+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:32.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 msgr2=0x7f9c2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 0x7f9c2806d110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c40036000 tx=0x7f9c40008030 comp rx=0 tx=0).stop 2023-08-10T10:45:32.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 msgr2=0x7f9c440c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c400 tx=0x7f9c3400c8c0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 shutdown_connections 2023-08-10T10:45:32.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c44153c30 0x7f9c44155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c44153850 0x7f9c440c8200 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c2806ac50 0x7f9c2806d110 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 --2- 172.21.15.50:0/1921289360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c440cfd40 0x7f9c44151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.071+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 >> 172.21.15.50:0/1921289360 conn(0x7f9c44069880 msgr2=0x7f9c44069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:32.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.072+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 shutdown_connections 2023-08-10T10:45:32.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.072+0000 7f9c4b48a640 1 -- 172.21.15.50:0/1921289360 wait complete. 2023-08-10T10:45:32.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:32.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.315+0000 7f866a456640 1 Processor -- start 2023-08-10T10:45:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.315+0000 7f866a456640 1 -- start start 2023-08-10T10:45:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f866a456640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86641615e0 0x7f866406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f866a456640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8664160a40 con 0x7f866415cb90 2023-08-10T10:45:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f866a456640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640b4bb0 con 0x7f866415cf70 2023-08-10T10:45:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f866a456640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640b4e90 con 0x7f86641615e0 2023-08-10T10:45:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f8663fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f866415cb90 0x7f86640b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43058/0 (socket says 172.21.15.50:43058) 2023-08-10T10:45:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.316+0000 7f8663fff640 1 -- 172.21.15.50:0/2007304944 learned_addr learned my addr 172.21.15.50:0/2007304944 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910502793 0 0) 0x7f8664160a40 con 0x7f866415cb90 2023-08-10T10:45:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c003520 con 0x7f866415cb90 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f86689f3640 1 --2- 172.21.15.50:0/2007304944 >> v2:172.21.15.117:3300/0 conn(0x7f86641615e0 0x7f866406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906967122 0 0) 0x7f864c003520 con 0x7f866415cb90 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 >> v2:172.21.15.117:3300/0 conn(0x7f86641615e0 msgr2=0x7f866406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 --2- 172.21.15.50:0/2007304944 >> v2:172.21.15.117:3300/0 conn(0x7f86641615e0 0x7f866406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 >> v1:172.21.15.117:6789/0 conn(0x7f866415cf70 legacy=0x7f8664160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640b5170 con 0x7f866415cb90 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f86540019f0 con 0x7f866415cb90 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 >> v1:172.21.15.50:6789/0 conn(0x7f866415cb90 legacy=0x7f86640b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864c0047c0 0x7f864c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640b4e90 con 0x7f864c003970 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c0b0 con 0x7f864c005180 2023-08-10T10:45:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.317+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c270 con 0x7f864c0047c0 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f86689f3640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 -- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864c0047c0 msgr2=0x7f864c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864c0047c0 0x7f864c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 -- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c005180 msgr2=0x7f864c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f8663fff640 1 -- 172.21.15.50:0/2007304944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c003520 con 0x7f864c003970 2023-08-10T10:45:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f86689f3640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.318+0000 7f86689f3640 1 -- 172.21.15.50:0/2007304944 reap_dead start 2023-08-10T10:45:32.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.319+0000 7f8663fff640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 0x7f864c003d70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8654002230 tx=0x7f864c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812b4d327f077823 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654034630 con 0x7f864c003970 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865402f070 con 0x7f864c003970 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f8662ffd640 1 -- 172.21.15.50:0/2007304944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86540349d0 con 0x7f864c003970 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 -- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 msgr2=0x7f864c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 0x7f864c003d70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8654002230 tx=0x7f864c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 -- 172.21.15.50:0/2007304944 shutdown_connections 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 --2- 172.21.15.50:0/2007304944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 -- 172.21.15.50:0/2007304944 >> 172.21.15.50:0/2007304944 conn(0x7f86640cf640 msgr2=0x7f86640cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 -- 172.21.15.50:0/2007304944 shutdown_connections 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.320+0000 7f866a456640 1 -- 172.21.15.50:0/2007304944 wait complete. 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.322+0000 7f866a456640 1 Processor -- start 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.322+0000 7f866a456640 1 -- start start 2023-08-10T10:45:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 0x7f8664153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8664151410 0x7f86641562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664151890 con 0x7f8664151e90 2023-08-10T10:45:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664156810 con 0x7f864c003970 2023-08-10T10:45:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.323+0000 7f866a456640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664152850 con 0x7f8664151410 2023-08-10T10:45:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55064/0 (socket says 172.21.15.50:55064) 2023-08-10T10:45:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 -- 172.21.15.50:0/808159559 learned_addr learned my addr 172.21.15.50:0/808159559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f8663fff640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 0x7f8664153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86637fe640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8664151410 0x7f86641562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 -- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8664151410 msgr2=0x7f86641562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8664151410 0x7f86641562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 -- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 msgr2=0x7f8664153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 0x7f8664153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 -- 172.21.15.50:0/808159559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86641544a0 con 0x7f8664151e90 2023-08-10T10:45:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f8663fff640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 0x7f8664153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.324+0000 7f86689f3640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f86640713d0 tx=0x7f865c00e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.325+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0042f0 con 0x7f8664151e90 2023-08-10T10:45:32.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.325+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c004470 con 0x7f8664151e90 2023-08-10T10:45:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.325+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866415bf10 con 0x7f8664151e90 2023-08-10T10:45:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.325+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c003850 con 0x7f8664151e90 2023-08-10T10:45:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.325+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640c67e0 con 0x7f8664151e90 2023-08-10T10:45:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.326+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866415c430 con 0x7f8664151e90 2023-08-10T10:45:32.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.327+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f865c0039b0 con 0x7f8664151e90 2023-08-10T10:45:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.328+0000 7f8660ff9640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 0x7f865006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.328+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f865c088950 con 0x7f8664151e90 2023-08-10T10:45:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.328+0000 7f8663fff640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 0x7f865006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.329+0000 7f8663fff640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 0x7f865006d140 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f8654036040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.332+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f866415c430 con 0x7f8664151e90 2023-08-10T10:45:32.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.527+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86640c6640 con 0x7f8664151e90 2023-08-10T10:45:32.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.527+0000 7f8660ff9640 1 -- 172.21.15.50:0/808159559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86640c6640 con 0x7f8664151e90 2023-08-10T10:45:32.528 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:32.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 msgr2=0x7f865006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 0x7f865006d140 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f8654036040 comp rx=0 tx=0).stop 2023-08-10T10:45:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 msgr2=0x7f8664152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f86640713d0 tx=0x7f865c00e8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 shutdown_connections 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8664151e90 0x7f8664152310 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8664151410 0x7f86641562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f865006ac80 0x7f865006d140 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 --2- 172.21.15.50:0/808159559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f864c003970 0x7f8664153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.530+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 >> 172.21.15.50:0/808159559 conn(0x7f86640cf640 msgr2=0x7f86640c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.531+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 shutdown_connections 2023-08-10T10:45:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.531+0000 7f866a456640 1 -- 172.21.15.50:0/808159559 wait complete. 2023-08-10T10:45:32.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.788+0000 7f43a2663640 1 Processor -- start 2023-08-10T10:45:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.788+0000 7f43a2663640 1 -- start start 2023-08-10T10:45:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a2663640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 0x7f439c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a2663640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c0c94e0 0x7f439c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a2663640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c164bf0 con 0x7f439c161070 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a2663640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0c9990 con 0x7f439c0c94e0 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a2663640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c164e40 con 0x7f439c0b0610 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.790+0000 7f43a1e62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c0c94e0 0x7f439c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c0c94e0 0x7f439c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55070/0 (socket says 172.21.15.50:55070) 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 -- 172.21.15.50:0/4101454037 learned_addr learned my addr 172.21.15.50:0/4101454037 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a0e60640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 0x7f439c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 -- 172.21.15.50:0/4101454037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 msgr2=0x7f439c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 0x7f439c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 -- 172.21.15.50:0/4101454037 >> v1:172.21.15.117:6789/0 conn(0x7f439c161070 legacy=0x7f439c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a1e62640 1 -- 172.21.15.50:0/4101454037 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c165120 con 0x7f439c0c94e0 2023-08-10T10:45:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.791+0000 7f43a0e60640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 0x7f439c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:32.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.792+0000 7f43a1e62640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0c94e0 0x7f439c0cc590 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4394009e50 tx=0x7f439402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76913505141ca44f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.792+0000 7f4393fff640 1 -- 172.21.15.50:0/4101454037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439402ca80 con 0x7f439c0c94e0 2023-08-10T10:45:32.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f4393fff640 1 -- 172.21.15.50:0/4101454037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439402cbe0 con 0x7f439c0c94e0 2023-08-10T10:45:32.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f4393fff640 1 -- 172.21.15.50:0/4101454037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43940343f0 con 0x7f439c0c94e0 2023-08-10T10:45:32.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 -- 172.21.15.50:0/4101454037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0c94e0 msgr2=0x7f439c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0c94e0 0x7f439c0cc590 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4394009e50 tx=0x7f439402bee0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 -- 172.21.15.50:0/4101454037 shutdown_connections 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0c94e0 0x7f439c0cc590 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 --2- 172.21.15.50:0/4101454037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0b0610 0x7f439c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 -- 172.21.15.50:0/4101454037 >> 172.21.15.50:0/4101454037 conn(0x7f439c069cd0 msgr2=0x7f439c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:32.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 -- 172.21.15.50:0/4101454037 shutdown_connections 2023-08-10T10:45:32.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.793+0000 7f43a2663640 1 -- 172.21.15.50:0/4101454037 wait complete. 2023-08-10T10:45:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.795+0000 7f43a2663640 1 Processor -- start 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.795+0000 7f43a2663640 1 -- start start 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0c94e0 0x7f439c06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f439c161070 0x7f439c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c2430 con 0x7f439c0b0610 2023-08-10T10:45:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c15a4e0 con 0x7f439c161070 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.796+0000 7f43a2663640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c06ed20 con 0x7f439c0c94e0 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55074/0 (socket says 172.21.15.50:55074) 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 -- 172.21.15.50:0/1635147532 learned_addr learned my addr 172.21.15.50:0/1635147532 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 -- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0c94e0 msgr2=0x7f439c06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0c94e0 0x7f439c06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 -- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f439c161070 msgr2=0x7f439c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f439c161070 0x7f439c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 -- 172.21.15.50:0/1635147532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394009b30 con 0x7f439c0b0610 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.797+0000 7f43a1661640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f439800b3f0 tx=0x7f439800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.798+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011830 con 0x7f439c0b0610 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.798+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398011990 con 0x7f439c0b0610 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.798+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011d40 con 0x7f439c0b0610 2023-08-10T10:45:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.798+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c15a780 con 0x7f439c0b0610 2023-08-10T10:45:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.798+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0c2050 con 0x7f439c0b0610 2023-08-10T10:45:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.799+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c066e30 con 0x7f439c0b0610 2023-08-10T10:45:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.800+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f439801a400 con 0x7f439c0b0610 2023-08-10T10:45:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.802+0000 7f4391ffb640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 0x7f438006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.802+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4398088fc0 con 0x7f439c0b0610 2023-08-10T10:45:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.802+0000 7f43a0e60640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 0x7f438006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.803+0000 7f43a0e60640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 0x7f438006d110 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f438c006fd0 tx=0x7f438c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:32.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.806+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f43980543b0 con 0x7f439c0b0610 2023-08-10T10:45:32.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.997+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f439c0b0b50 con 0x7f439c0b0610 2023-08-10T10:45:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:32.998+0000 7f4391ffb640 1 -- 172.21.15.50:0/1635147532 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43980150a0 con 0x7f439c0b0610 2023-08-10T10:45:32.998 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:33.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.000+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 msgr2=0x7f438006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.000+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 0x7f438006d110 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f438c006fd0 tx=0x7f438c008040 comp rx=0 tx=0).stop 2023-08-10T10:45:33.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.000+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 msgr2=0x7f439c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.000+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f439800b3f0 tx=0x7f439800b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 shutdown_connections 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f438006ac50 0x7f438006d110 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f439c161070 0x7f439c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439c0c94e0 0x7f439c06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 --2- 172.21.15.50:0/1635147532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c0b0610 0x7f439c0ccd30 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 >> 172.21.15.50:0/1635147532 conn(0x7f439c069cd0 msgr2=0x7f439c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:33.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 shutdown_connections 2023-08-10T10:45:33.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.001+0000 7f43a2663640 1 -- 172.21.15.50:0/1635147532 wait complete. 2023-08-10T10:45:33.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:45:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.238+0000 7f455eec2640 1 Processor -- start 2023-08-10T10:45:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.238+0000 7f455eec2640 1 -- start start 2023-08-10T10:45:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.239+0000 7f455eec2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f45580ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455eec2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45580b40b0 con 0x7f45580c14e0 2023-08-10T10:45:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455eec2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45580cc100 con 0x7f4558161140 2023-08-10T10:45:33.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455eec2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580cc3e0 con 0x7f45580b0620 2023-08-10T10:45:33.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455e6c1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45580c14e0 0x7f45580cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43064/0 (socket says 172.21.15.50:43064) 2023-08-10T10:45:33.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455e6c1640 1 -- 172.21.15.50:0/3598305427 learned_addr learned my addr 172.21.15.50:0/3598305427 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:33.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455d6bf640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f45580ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.240+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968927946 0 0) 0x7f45580b40b0 con 0x7f45580c14e0 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4544003520 con 0x7f45580c14e0 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857815344 0 0) 0x7f4544003520 con 0x7f45580c14e0 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 msgr2=0x7f45580ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f45580ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 >> v1:172.21.15.117:6789/0 conn(0x7f4558161140 legacy=0x7f45580aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580cc6c0 con 0x7f45580c14e0 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f45500019f0 con 0x7f45580c14e0 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 >> v1:172.21.15.50:6789/0 conn(0x7f45580c14e0 legacy=0x7f45580cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4544003a10 0x7f4544003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4544004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f4544005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580cc3e0 con 0x7f45440047c0 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454400ba80 con 0x7f4544003a10 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.241+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454400bc40 con 0x7f45580b0620 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4544004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455dec0640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4544003a10 0x7f4544003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455e6c1640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f4544005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 -- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 msgr2=0x7f4544005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b0620 0x7f4544005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 -- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4544003a10 msgr2=0x7f4544003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4544003a10 0x7f4544003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.242+0000 7f455d6bf640 1 -- 172.21.15.50:0/3598305427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544003520 con 0x7f45440047c0 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.243+0000 7f455d6bf640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4544004c40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ac0 tx=0x7f45440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8c88e5c8b01628 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.243+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454802c6b0 con 0x7f45440047c0 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.243+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454802c810 con 0x7f45440047c0 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455cebe640 1 -- 172.21.15.50:0/3598305427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454802cba0 con 0x7f45440047c0 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 -- 172.21.15.50:0/3598305427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 msgr2=0x7f4544004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 --2- 172.21.15.50:0/3598305427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4544004c40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ac0 tx=0x7f45440057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455e6c1640 1 -- 172.21.15.50:0/3598305427 reap_dead start 2023-08-10T10:45:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 -- 172.21.15.50:0/3598305427 shutdown_connections 2023-08-10T10:45:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 -- 172.21.15.50:0/3598305427 >> 172.21.15.50:0/3598305427 conn(0x7f455806ab80 msgr2=0x7f455806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 -- 172.21.15.50:0/3598305427 shutdown_connections 2023-08-10T10:45:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.244+0000 7f455eec2640 1 -- 172.21.15.50:0/3598305427 wait complete. 2023-08-10T10:45:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.246+0000 7f455eec2640 1 Processor -- start 2023-08-10T10:45:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.246+0000 7f455eec2640 1 -- start start 2023-08-10T10:45:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 0x7f45580ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b1f20 0x7f45580ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455815add0 con 0x7f45440047c0 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45581626f0 con 0x7f45580b1ac0 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.247+0000 7f455eec2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b1450 con 0x7f45580b1f20 2023-08-10T10:45:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55082/0 (socket says 172.21.15.50:55082) 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 -- 172.21.15.50:0/553311294 learned_addr learned my addr 172.21.15.50:0/553311294 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455d6bf640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 0x7f45580ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 -- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b1f20 msgr2=0x7f45580ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455e6c1640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b1f20 0x7f45580ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b1f20 0x7f45580ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 -- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 msgr2=0x7f45580ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 0x7f45580ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455dec0640 1 -- 172.21.15.50:0/553311294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580b1730 con 0x7f45440047c0 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.248+0000 7f455d6bf640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 0x7f45580ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f455dec0640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f455400e550 tx=0x7f455400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540052e0 con 0x7f45440047c0 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554005440 con 0x7f45440047c0 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554003810 con 0x7f45440047c0 2023-08-10T10:45:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4558162940 con 0x7f45440047c0 2023-08-10T10:45:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.249+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4558071450 con 0x7f45440047c0 2023-08-10T10:45:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.250+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4558066e30 con 0x7f45440047c0 2023-08-10T10:45:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.251+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4554003970 con 0x7f45440047c0 2023-08-10T10:45:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.252+0000 7f454e7fc640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 0x7f453c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.252+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4554088ec0 con 0x7f45440047c0 2023-08-10T10:45:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.252+0000 7f455d6bf640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 0x7f453c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.253+0000 7f455d6bf640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 0x7f453c06d110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4548036000 tx=0x7f4548030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.257+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f45540542b0 con 0x7f45440047c0 2023-08-10T10:45:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.452+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45580ae130 con 0x7f45440047c0 2023-08-10T10:45:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.453+0000 7f454e7fc640 1 -- 172.21.15.50:0/553311294 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) v1 ==== 84+0+126 (secure 0 0 0) 0x7f45540578d0 con 0x7f45440047c0 2023-08-10T10:45:33.454 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:33.454 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:45:33.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:33.454 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:45:33.455 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:45:33.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:45:33.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:45:33.455 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:45:33.455 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:45:33.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:45:33.456 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:45:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 msgr2=0x7f453c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 0x7f453c06d110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4548036000 tx=0x7f4548030000 comp rx=0 tx=0).stop 2023-08-10T10:45:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 msgr2=0x7f4558070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f455400e550 tx=0x7f455400ea10 comp rx=0 tx=0).stop 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 shutdown_connections 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45580b1f20 0x7f45580ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f453c06ac50 0x7f453c06d110 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45580b1ac0 0x7f45580ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 --2- 172.21.15.50:0/553311294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45440047c0 0x7f4558070f10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 >> 172.21.15.50:0/553311294 conn(0x7f455806ab80 msgr2=0x7f455815fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 shutdown_connections 2023-08-10T10:45:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.456+0000 7f455eec2640 1 -- 172.21.15.50:0/553311294 wait complete. 2023-08-10T10:45:33.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:45:33.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:45:33.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.708+0000 7f5a6d6bf640 1 Processor -- start 2023-08-10T10:45:33.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.708+0000 7f5a6d6bf640 1 -- start start 2023-08-10T10:45:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a6d6bf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a681601a0 0x7f5a680ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a6d6bf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680cb270 con 0x7f5a680cdb60 2023-08-10T10:45:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a6d6bf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680cec40 con 0x7f5a680b5bc0 2023-08-10T10:45:33.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a6d6bf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680cf7c0 con 0x7f5a681601a0 2023-08-10T10:45:33.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a667fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5a680cdb60 0x7f5a680b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43070/0 (socket says 172.21.15.50:43070) 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.710+0000 7f5a667fc640 1 -- 172.21.15.50:0/263802690 learned_addr learned my addr 172.21.15.50:0/263802690 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a66ffd640 1 --2- 172.21.15.50:0/263802690 >> v2:172.21.15.117:3300/0 conn(0x7f5a681601a0 0x7f5a680ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560868960 0 0) 0x7f5a680cb270 con 0x7f5a680cdb60 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a50003520 con 0x7f5a680cdb60 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123778444 0 0) 0x7f5a50003520 con 0x7f5a680cdb60 2023-08-10T10:45:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 >> v2:172.21.15.117:3300/0 conn(0x7f5a681601a0 msgr2=0x7f5a680ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 --2- 172.21.15.50:0/263802690 >> v2:172.21.15.117:3300/0 conn(0x7f5a681601a0 0x7f5a680ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 >> v1:172.21.15.117:6789/0 conn(0x7f5a680b5bc0 legacy=0x7f5a680cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680cef20 con 0x7f5a680cdb60 2023-08-10T10:45:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5a5c001670 con 0x7f5a680cdb60 2023-08-10T10:45:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 >> v1:172.21.15.50:6789/0 conn(0x7f5a680cdb60 legacy=0x7f5a680b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a50003970 0x7f5a50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a500047c0 0x7f5a50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680cf7c0 con 0x7f5a50005180 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5000c0d0 con 0x7f5a500047c0 2023-08-10T10:45:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.711+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5000c290 con 0x7f5a50003970 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a667fc640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a500047c0 0x7f5a50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a66ffd640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a50003970 0x7f5a50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 -- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a50003970 msgr2=0x7f5a50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a50003970 0x7f5a50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 -- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a500047c0 msgr2=0x7f5a50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a500047c0 0x7f5a50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.712+0000 7f5a677fe640 1 -- 172.21.15.50:0/263802690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50003520 con 0x7f5a50005180 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.714+0000 7f5a677fe640 1 -- 172.21.15.50:0/263802690 reap_dead start 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.714+0000 7f5a677fe640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a5000b980 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5a60001e50 tx=0x7f5a500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305439d991f3ba3e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.714+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60003b70 con 0x7f5a50005180 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.714+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60003d10 con 0x7f5a50005180 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.714+0000 7f5a65ffb640 1 -- 172.21.15.50:0/263802690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60005310 con 0x7f5a50005180 2023-08-10T10:45:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 msgr2=0x7f5a5000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a5000b980 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5a60001e50 tx=0x7f5a500057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/263802690 shutdown_connections 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/263802690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a5000b980 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/263802690 >> 172.21.15.50:0/263802690 conn(0x7f5a680b3740 msgr2=0x7f5a680b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/263802690 shutdown_connections 2023-08-10T10:45:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.715+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/263802690 wait complete. 2023-08-10T10:45:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.718+0000 7f5a6d6bf640 1 Processor -- start 2023-08-10T10:45:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.718+0000 7f5a6d6bf640 1 -- start start 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a6815a310 0x7f5a68150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 0x7f5a680ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815a170 con 0x7f5a50005180 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ae860 con 0x7f5a680adea0 2023-08-10T10:45:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.719+0000 7f5a6d6bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6809e2a0 con 0x7f5a6815a310 2023-08-10T10:45:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55106/0 (socket says 172.21.15.50:55106) 2023-08-10T10:45:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 -- 172.21.15.50:0/53969185 learned_addr learned my addr 172.21.15.50:0/53969185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a677fe640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 0x7f5a680ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 -- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a6815a310 msgr2=0x7f5a68150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a667fc640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a6815a310 0x7f5a68150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a6815a310 0x7f5a68150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 -- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 msgr2=0x7f5a680ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 0x7f5a680ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 -- 172.21.15.50:0/53969185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6809d3d0 con 0x7f5a50005180 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a677fe640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 0x7f5a680ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.720+0000 7f5a66ffd640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800f510 tx=0x7f5a5800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.721+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58014670 con 0x7f5a50005180 2023-08-10T10:45:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.721+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a580147d0 con 0x7f5a50005180 2023-08-10T10:45:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.721+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58014b60 con 0x7f5a50005180 2023-08-10T10:45:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.721+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6809d690 con 0x7f5a50005180 2023-08-10T10:45:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.721+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6809dc50 con 0x7f5a50005180 2023-08-10T10:45:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.722+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6804e270 con 0x7f5a50005180 2023-08-10T10:45:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.723+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a58014cc0 con 0x7f5a50005180 2023-08-10T10:45:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.724+0000 7f5a4f7fe640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 0x7f5a5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.724+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5a580897a0 con 0x7f5a50005180 2023-08-10T10:45:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.724+0000 7f5a667fc640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 0x7f5a5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.725+0000 7f5a667fc640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 0x7f5a5406d110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c001b40 tx=0x7f5a5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.729+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5a58054c30 con 0x7f5a50005180 2023-08-10T10:45:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:33.919+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5a680b3500 con 0x7f5a50005180 2023-08-10T10:45:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.084+0000 7f5a4f7fe640 1 -- 172.21.15.50:0/53969185 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5a58058250 con 0x7f5a50005180 2023-08-10T10:45:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:45:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.091+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 msgr2=0x7f5a5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.091+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 0x7f5a5406d110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c001b40 tx=0x7f5a5c009040 comp rx=0 tx=0).stop 2023-08-10T10:45:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.091+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 msgr2=0x7f5a6809ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.091+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800f510 tx=0x7f5a5800f9d0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 shutdown_connections 2023-08-10T10:45:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a5406ac50 0x7f5a5406d110 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a680adea0 0x7f5a680ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a6815a310 0x7f5a68150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 --2- 172.21.15.50:0/53969185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a50005180 0x7f5a6809ce90 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 >> 172.21.15.50:0/53969185 conn(0x7f5a680b3740 msgr2=0x7f5a6815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 shutdown_connections 2023-08-10T10:45:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.092+0000 7f5a6d6bf640 1 -- 172.21.15.50:0/53969185 wait complete. 2023-08-10T10:45:34.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:45:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.350+0000 7f7e14f44640 1 Processor -- start 2023-08-10T10:45:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.350+0000 7f7e14f44640 1 -- start start 2023-08-10T10:45:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.351+0000 7f7e14f44640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e10161070 0x7f7e100cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e14f44640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e10164bf0 con 0x7f7e100b0610 2023-08-10T10:45:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e14f44640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e10164e40 con 0x7f7e100c94e0 2023-08-10T10:45:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e14f44640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e10165120 con 0x7f7e10161070 2023-08-10T10:45:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e0f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e10161070 0x7f7e100cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e0ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7e100b0610 0x7f7e100cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43074/0 (socket says 172.21.15.50:43074) 2023-08-10T10:45:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e0ffff640 1 -- 172.21.15.50:0/3883791765 learned_addr learned my addr 172.21.15.50:0/3883791765 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/3883791765 >> v1:172.21.15.117:6789/0 conn(0x7f7e100c94e0 legacy=0x7f7e100aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.352+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/3883791765 >> v1:172.21.15.50:6789/0 conn(0x7f7e100b0610 legacy=0x7f7e100cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.353+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/3883791765 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10165400 con 0x7f7e10161070 2023-08-10T10:45:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.353+0000 7f7e0e7fc640 1 -- 172.21.15.50:0/3883791765 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258881732 0 0) 0x7f7e10164bf0 con 0x7f7e100b0610 2023-08-10T10:45:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.354+0000 7f7e0f7fe640 1 --2- 172.21.15.50:0/3883791765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e10161070 0x7f7e100cdc60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097a0 tx=0x7f7e0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990fb839c9d35750 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.354+0000 7f7e0e7fc640 1 -- 172.21.15.50:0/3883791765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00031830 con 0x7f7e10161070 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.354+0000 7f7e0e7fc640 1 -- 172.21.15.50:0/3883791765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00031990 con 0x7f7e10161070 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.354+0000 7f7e0e7fc640 1 -- 172.21.15.50:0/3883791765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00031d20 con 0x7f7e10161070 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 -- 172.21.15.50:0/3883791765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e10161070 msgr2=0x7f7e100cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 --2- 172.21.15.50:0/3883791765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e10161070 0x7f7e100cdc60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097a0 tx=0x7f7e0002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 -- 172.21.15.50:0/3883791765 shutdown_connections 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 --2- 172.21.15.50:0/3883791765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e10161070 0x7f7e100cdc60 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 -- 172.21.15.50:0/3883791765 >> 172.21.15.50:0/3883791765 conn(0x7f7e10069cd0 msgr2=0x7f7e100caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 -- 172.21.15.50:0/3883791765 shutdown_connections 2023-08-10T10:45:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.355+0000 7f7e14f44640 1 -- 172.21.15.50:0/3883791765 wait complete. 2023-08-10T10:45:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.357+0000 7f7e14f44640 1 Processor -- start 2023-08-10T10:45:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.357+0000 7f7e14f44640 1 -- start start 2023-08-10T10:45:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e100c94e0 0x7f7e1014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 0x7f7e1014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1015f8d0 con 0x7f7e100b0610 2023-08-10T10:45:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10071750 con 0x7f7e10161070 2023-08-10T10:45:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e14f44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1015efa0 con 0x7f7e100c94e0 2023-08-10T10:45:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55128/0 (socket says 172.21.15.50:55128) 2023-08-10T10:45:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.358+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/1951677139 learned_addr learned my addr 172.21.15.50:0/1951677139 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0ffff640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 0x7f7e1014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0effd640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e100c94e0 0x7f7e1014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e100c94e0 msgr2=0x7f7e1014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e100c94e0 0x7f7e1014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 msgr2=0x7f7e1014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 0x7f7e1014fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 -- 172.21.15.50:0/1951677139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009400 con 0x7f7e100b0610 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0ffff640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 0x7f7e1014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7e0f7fe640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097a0 tx=0x7f7e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000317d0 con 0x7f7e100b0610 2023-08-10T10:45:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.359+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00004030 con 0x7f7e100b0610 2023-08-10T10:45:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.360+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1015f280 con 0x7f7e100b0610 2023-08-10T10:45:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.360+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000043e0 con 0x7f7e100b0610 2023-08-10T10:45:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.360+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1015fd60 con 0x7f7e100b0610 2023-08-10T10:45:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.361+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e10066e30 con 0x7f7e100b0610 2023-08-10T10:45:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.362+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e00043070 con 0x7f7e100b0610 2023-08-10T10:45:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.363+0000 7f7df7fff640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 0x7f7dfc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.363+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7e000ab410 con 0x7f7e100b0610 2023-08-10T10:45:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.363+0000 7f7e0effd640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 0x7f7dfc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.364+0000 7f7e0effd640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 0x7f7dfc06d140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7e04007fd0 tx=0x7f7e04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.367+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7e00076780 con 0x7f7e100b0610 2023-08-10T10:45:34.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:34.557+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7e100cbaf0 con 0x7f7e100b0610 2023-08-10T10:45:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.093+0000 7f7df7fff640 1 -- 172.21.15.50:0/1951677139 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7e00079da0 con 0x7f7e100b0610 2023-08-10T10:45:35.107 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:45:35.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 msgr2=0x7f7dfc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 0x7f7dfc06d140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7e04007fd0 tx=0x7f7e04009040 comp rx=0 tx=0).stop 2023-08-10T10:45:35.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 msgr2=0x7f7e10071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7e000097a0 tx=0x7f7e000046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 shutdown_connections 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7dfc06ac80 0x7f7dfc06d140 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e10161070 0x7f7e1014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e100c94e0 0x7f7e1014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 --2- 172.21.15.50:0/1951677139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e100b0610 0x7f7e10071070 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.111+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 >> 172.21.15.50:0/1951677139 conn(0x7f7e10069cd0 msgr2=0x7f7e100cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:35.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.112+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 shutdown_connections 2023-08-10T10:45:35.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.112+0000 7f7e14f44640 1 -- 172.21.15.50:0/1951677139 wait complete. 2023-08-10T10:45:35.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:45:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.342+0000 7f186d699640 1 Processor -- start 2023-08-10T10:45:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.342+0000 7f186d699640 1 -- start start 2023-08-10T10:45:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f186d699640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f186815ae40 0x7f18680b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f186d699640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186806c320 con 0x7f186806cb30 2023-08-10T10:45:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f186d699640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186806b770 con 0x7f18680cd9b0 2023-08-10T10:45:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f186d699640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186806b9f0 con 0x7f186815ae40 2023-08-10T10:45:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f18667fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f186806cb30 0x7f18680cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48176/0 (socket says 172.21.15.50:48176) 2023-08-10T10:45:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.344+0000 7f18667fc640 1 -- 172.21.15.50:0/4027417614 learned_addr learned my addr 172.21.15.50:0/4027417614 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890420041 0 0) 0x7f186806c320 con 0x7f186806cb30 2023-08-10T10:45:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1866ffd640 1 --2- 172.21.15.50:0/4027417614 >> v2:172.21.15.117:3300/0 conn(0x7f186815ae40 0x7f18680b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1850003520 con 0x7f186806cb30 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830194452 0 0) 0x7f1850003520 con 0x7f186806cb30 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 >> v2:172.21.15.117:3300/0 conn(0x7f186815ae40 msgr2=0x7f18680b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 --2- 172.21.15.50:0/4027417614 >> v2:172.21.15.117:3300/0 conn(0x7f186815ae40 0x7f18680b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 >> v1:172.21.15.117:6789/0 conn(0x7f18680cd9b0 legacy=0x7f18680c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186806bcd0 con 0x7f186806cb30 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f185c001670 con 0x7f186806cb30 2023-08-10T10:45:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 >> v1:172.21.15.50:6789/0 conn(0x7f186806cb30 legacy=0x7f18680cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 0x7f185000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186806b9f0 con 0x7f1850005180 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185000c020 con 0x7f18500047c0 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.345+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185000c1e0 con 0x7f1850003970 2023-08-10T10:45:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 0x7f185000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f1866ffd640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 -- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003970 msgr2=0x7f1850003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18667fc640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 -- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18500047c0 msgr2=0x7f1850004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18677fe640 1 -- 172.21.15.50:0/4027417614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850003520 con 0x7f1850005180 2023-08-10T10:45:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.346+0000 7f18667fc640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.347+0000 7f18677fe640 1 -- 172.21.15.50:0/4027417614 reap_dead start 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f18677fe640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 0x7f185000b980 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1860001e20 tx=0x7f18500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9500080c182505 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860003b70 con 0x7f1850005180 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860003cd0 con 0x7f1850005180 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f1865ffb640 1 -- 172.21.15.50:0/4027417614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860005310 con 0x7f1850005180 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f186d699640 1 -- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 msgr2=0x7f185000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f186d699640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 0x7f185000b980 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1860001e20 tx=0x7f18500057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f186d699640 1 -- 172.21.15.50:0/4027417614 shutdown_connections 2023-08-10T10:45:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f186d699640 1 --2- 172.21.15.50:0/4027417614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850005180 0x7f185000b980 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.348+0000 7f186d699640 1 -- 172.21.15.50:0/4027417614 >> 172.21.15.50:0/4027417614 conn(0x7f18680b01b0 msgr2=0x7f18680b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.349+0000 7f186d699640 1 -- 172.21.15.50:0/4027417614 shutdown_connections 2023-08-10T10:45:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.349+0000 7f186d699640 1 -- 172.21.15.50:0/4027417614 wait complete. 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.350+0000 7f186d699640 1 Processor -- start 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.351+0000 7f186d699640 1 -- start start 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 0x7f1868157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18680ca240 0x7f18681586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680ca6c0 con 0x7f18680c83f0 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c4760 con 0x7f1850005180 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f186d699640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c4a40 con 0x7f18680ca240 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f18667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f18667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39646/0 (socket says 172.21.15.50:39646) 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f18667fc640 1 -- 172.21.15.50:0/3807828021 learned_addr learned my addr 172.21.15.50:0/3807828021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f1866ffd640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 0x7f1868157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.352+0000 7f18677fe640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18680ca240 0x7f18681586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 -- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18680ca240 msgr2=0x7f18681586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18680ca240 0x7f18681586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 -- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 msgr2=0x7f1868157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 0x7f1868157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 -- 172.21.15.50:0/3807828021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680c4d20 con 0x7f18680c83f0 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f1866ffd640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 0x7f1868157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f18667fc640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f185c00d8b0 tx=0x7f185c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:35.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0074e0 con 0x7f18680c83f0 2023-08-10T10:45:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c007640 con 0x7f18680c83f0 2023-08-10T10:45:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0049e0 con 0x7f18680c83f0 2023-08-10T10:45:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680c5000 con 0x7f18680c83f0 2023-08-10T10:45:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.353+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1868158410 con 0x7f18680c83f0 2023-08-10T10:45:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.355+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680612b0 con 0x7f18680c83f0 2023-08-10T10:45:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.356+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f185c004b40 con 0x7f18680c83f0 2023-08-10T10:45:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.357+0000 7f184f7fe640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 0x7f185406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.357+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f185c089140 con 0x7f18680c83f0 2023-08-10T10:45:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.357+0000 7f1866ffd640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 0x7f185406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.358+0000 7f1866ffd640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 0x7f185406d140 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f18681f5710 tx=0x7f1858008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.361+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f185c054230 con 0x7f18680c83f0 2023-08-10T10:45:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:35.595+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18680b14e0 con 0x7f18680c83f0 2023-08-10T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.157+0000 7f184f7fe640 1 -- 172.21.15.50:0/3807828021 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f185c057850 con 0x7f18680c83f0 2023-08-10T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 15 and data pool 16 2023-08-10T10:45:36.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.161+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 msgr2=0x7f185406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.161+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 0x7f185406d140 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f18681f5710 tx=0x7f1858008040 comp rx=0 tx=0).stop 2023-08-10T10:45:36.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.162+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 msgr2=0x7f18680c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.162+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f185c00d8b0 tx=0x7f185c00dd70 comp rx=0 tx=0).stop 2023-08-10T10:45:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.163+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 shutdown_connections 2023-08-10T10:45:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.164+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18680ca240 0x7f18681586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.164+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18680c83f0 0x7f18680c9d00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.164+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f185406ac80 0x7f185406d140 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.164+0000 7f186d699640 1 --2- 172.21.15.50:0/3807828021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1850005180 0x7f1868157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.164+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 >> 172.21.15.50:0/3807828021 conn(0x7f18680b01b0 msgr2=0x7f18680ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:36.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.165+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 shutdown_connections 2023-08-10T10:45:36.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.165+0000 7f186d699640 1 -- 172.21.15.50:0/3807828021 wait complete. 2023-08-10T10:45:36.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:36.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.382+0000 7fba82a2c640 1 Processor -- start 2023-08-10T10:45:36.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.383+0000 7fba82a2c640 1 -- start start 2023-08-10T10:45:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.384+0000 7fba82a2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba7c15a940 0x7fba7c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.384+0000 7fba82a2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba7c15f2b0 0x7fba7c0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.384+0000 7fba82a2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0b1f10 con 0x7fba7c0b12c0 2023-08-10T10:45:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.384+0000 7fba82a2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0b21f0 con 0x7fba7c15f2b0 2023-08-10T10:45:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.384+0000 7fba82a2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15e5c0 con 0x7fba7c15a940 2023-08-10T10:45:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba7c15f2b0 0x7fba7c0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba7c15f2b0 0x7fba7c0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39652/0 (socket says 172.21.15.50:39652) 2023-08-10T10:45:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 -- 172.21.15.50:0/1749101265 learned_addr learned my addr 172.21.15.50:0/1749101265 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:36.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 -- 172.21.15.50:0/1749101265 >> v2:172.21.15.117:3300/0 conn(0x7fba7c15a940 msgr2=0x7fba7c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:36.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 --2- 172.21.15.50:0/1749101265 >> v2:172.21.15.117:3300/0 conn(0x7fba7c15a940 0x7fba7c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 -- 172.21.15.50:0/1749101265 >> v1:172.21.15.117:6789/0 conn(0x7fba7c0b12c0 legacy=0x7fba7c0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:36.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.385+0000 7fba81229640 1 -- 172.21.15.50:0/1749101265 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c15e7d0 con 0x7fba7c15f2b0 2023-08-10T10:45:36.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.386+0000 7fba81229640 1 --2- 172.21.15.50:0/1749101265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15f2b0 0x7fba7c0b0450 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ce2e0 tx=0x7fba6c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e196bd6359fa7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba80a28640 1 -- 172.21.15.50:0/1749101265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0317e0 con 0x7fba7c15f2b0 2023-08-10T10:45:36.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba80a28640 1 -- 172.21.15.50:0/1749101265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c031940 con 0x7fba7c15f2b0 2023-08-10T10:45:36.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba80a28640 1 -- 172.21.15.50:0/1749101265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c031cd0 con 0x7fba7c15f2b0 2023-08-10T10:45:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 -- 172.21.15.50:0/1749101265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15f2b0 msgr2=0x7fba7c0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 --2- 172.21.15.50:0/1749101265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15f2b0 0x7fba7c0b0450 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ce2e0 tx=0x7fba6c02b880 comp rx=0 tx=0).stop 2023-08-10T10:45:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 -- 172.21.15.50:0/1749101265 shutdown_connections 2023-08-10T10:45:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 --2- 172.21.15.50:0/1749101265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15f2b0 0x7fba7c0b0450 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 --2- 172.21.15.50:0/1749101265 >> v2:172.21.15.117:3300/0 conn(0x7fba7c15a940 0x7fba7c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.387+0000 7fba82a2c640 1 -- 172.21.15.50:0/1749101265 >> 172.21.15.50:0/1749101265 conn(0x7fba7c06ab80 msgr2=0x7fba7c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:36.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.388+0000 7fba82a2c640 1 -- 172.21.15.50:0/1749101265 shutdown_connections 2023-08-10T10:45:36.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.388+0000 7fba82a2c640 1 -- 172.21.15.50:0/1749101265 wait complete. 2023-08-10T10:45:36.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.389+0000 7fba82a2c640 1 Processor -- start 2023-08-10T10:45:36.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.389+0000 7fba82a2c640 1 -- start start 2023-08-10T10:45:36.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba7c0b12c0 0x7fba7c0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba7c15f2b0 0x7fba7c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c6770 con 0x7fba7c15a940 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15e310 con 0x7fba7c0b12c0 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.390+0000 7fba82a2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c5bf0 con 0x7fba7c15f2b0 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39666/0 (socket says 172.21.15.50:39666) 2023-08-10T10:45:36.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 -- 172.21.15.50:0/769729570 learned_addr learned my addr 172.21.15.50:0/769729570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81a2a640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba7c0b12c0 0x7fba7c0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba8222b640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba7c15f2b0 0x7fba7c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 -- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba7c15f2b0 msgr2=0x7fba7c1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba7c15f2b0 0x7fba7c1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 -- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba7c0b12c0 msgr2=0x7fba7c0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba7c0b12c0 0x7fba7c0c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.391+0000 7fba81229640 1 -- 172.21.15.50:0/769729570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c0094d0 con 0x7fba7c15a940 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba81229640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fba6c02b8c0 tx=0x7fba6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c032940 con 0x7fba7c15a940 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c032aa0 con 0x7fba7c15a940 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c032e50 con 0x7fba7c15a940 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0c5ed0 con 0x7fba7c15a940 2023-08-10T10:45:36.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.392+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0c6490 con 0x7fba7c15a940 2023-08-10T10:45:36.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.393+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0b2be0 con 0x7fba7c15a940 2023-08-10T10:45:36.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.395+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba6c0453f0 con 0x7fba7c15a940 2023-08-10T10:45:36.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.395+0000 7fba727fc640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 0x7fba6006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.395+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba6c0abfe0 con 0x7fba7c15a940 2023-08-10T10:45:36.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.396+0000 7fba81a2a640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 0x7fba6006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.396+0000 7fba81a2a640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 0x7fba6006d110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fba7c159c20 tx=0x7fba78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.398+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fba6c077260 con 0x7fba7c15a940 2023-08-10T10:45:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.594+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba7c066e30 con 0x7fba7c15a940 2023-08-10T10:45:36.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.598+0000 7fba727fc640 1 -- 172.21.15.50:0/769729570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18296 (secure 0 0 0) 0x7fba6c053070 con 0x7fba7c15a940 2023-08-10T10:45:36.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:36.599 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":128,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:35.596383+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:36.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.600+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 msgr2=0x7fba6006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.600+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 0x7fba6006d110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fba7c159c20 tx=0x7fba78008040 comp rx=0 tx=0).stop 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.600+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 msgr2=0x7fba7c15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.600+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fba6c02b8c0 tx=0x7fba6c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 shutdown_connections 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba7c15f2b0 0x7fba7c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba7c15a940 0x7fba7c15ddd0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba6006ac50 0x7fba6006d110 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 --2- 172.21.15.50:0/769729570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba7c0b12c0 0x7fba7c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 >> 172.21.15.50:0/769729570 conn(0x7fba7c06ab80 msgr2=0x7fba7c0af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 shutdown_connections 2023-08-10T10:45:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.601+0000 7fba82a2c640 1 -- 172.21.15.50:0/769729570 wait complete. 2023-08-10T10:45:36.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.839+0000 7fde981c8640 1 Processor -- start 2023-08-10T10:45:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.839+0000 7fde981c8640 1 -- start start 2023-08-10T10:45:36.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.840+0000 7fde981c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde900b0c60 0x7fde900c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.840+0000 7fde981c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 0x7fde900c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde981c8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde90071c70 con 0x7fde9015aa40 2023-08-10T10:45:36.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde981c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900713d0 con 0x7fde900b0c60 2023-08-10T10:45:36.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde981c8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900716b0 con 0x7fde900b3f30 2023-08-10T10:45:36.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde95763640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde900b0c60 0x7fde900c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde95763640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde900b0c60 0x7fde900c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39674/0 (socket says 172.21.15.50:39674) 2023-08-10T10:45:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde95763640 1 -- 172.21.15.50:0/2099293888 learned_addr learned my addr 172.21.15.50:0/2099293888 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde96765640 1 --2- 172.21.15.50:0/2099293888 >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 0x7fde900c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde95763640 1 -- 172.21.15.50:0/2099293888 >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 msgr2=0x7fde900c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.841+0000 7fde95763640 1 --2- 172.21.15.50:0/2099293888 >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 0x7fde900c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.842+0000 7fde95763640 1 -- 172.21.15.50:0/2099293888 >> v1:172.21.15.117:6789/0 conn(0x7fde9015aa40 legacy=0x7fde900b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:36.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.842+0000 7fde95763640 1 -- 172.21.15.50:0/2099293888 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90071990 con 0x7fde900b0c60 2023-08-10T10:45:36.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.842+0000 7fde96765640 1 --2- 172.21.15.50:0/2099293888 >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 0x7fde900c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.843+0000 7fde95763640 1 --2- 172.21.15.50:0/2099293888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde900c9920 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fde900cb110 tx=0x7fde8002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aa02d50a9b9263 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.843+0000 7fde94f62640 1 -- 172.21.15.50:0/2099293888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800317e0 con 0x7fde900b0c60 2023-08-10T10:45:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.843+0000 7fde94f62640 1 -- 172.21.15.50:0/2099293888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80031940 con 0x7fde900b0c60 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.843+0000 7fde94f62640 1 -- 172.21.15.50:0/2099293888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031cd0 con 0x7fde900b0c60 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 -- 172.21.15.50:0/2099293888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 msgr2=0x7fde900c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 --2- 172.21.15.50:0/2099293888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde900c9920 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fde900cb110 tx=0x7fde8002b880 comp rx=0 tx=0).stop 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 -- 172.21.15.50:0/2099293888 shutdown_connections 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 --2- 172.21.15.50:0/2099293888 >> v2:172.21.15.117:3300/0 conn(0x7fde900b3f30 0x7fde900c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 --2- 172.21.15.50:0/2099293888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde900c9920 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 -- 172.21.15.50:0/2099293888 >> 172.21.15.50:0/2099293888 conn(0x7fde9006b590 msgr2=0x7fde900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 -- 172.21.15.50:0/2099293888 shutdown_connections 2023-08-10T10:45:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.844+0000 7fde981c8640 1 -- 172.21.15.50:0/2099293888 wait complete. 2023-08-10T10:45:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.846+0000 7fde981c8640 1 Processor -- start 2023-08-10T10:45:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.846+0000 7fde981c8640 1 -- start start 2023-08-10T10:45:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900b3f30 0x7fde900c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9015aa40 0x7fde901f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90154cb0 con 0x7fde900b0c60 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90153c90 con 0x7fde9015aa40 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde981c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde90153080 con 0x7fde900b3f30 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde95f64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde95f64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39688/0 (socket says 172.21.15.50:39688) 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.847+0000 7fde95f64640 1 -- 172.21.15.50:0/146567439 learned_addr learned my addr 172.21.15.50:0/146567439 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde96765640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9015aa40 0x7fde901f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95763640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900b3f30 0x7fde900c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 -- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900b3f30 msgr2=0x7fde900c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900b3f30 0x7fde900c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 -- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9015aa40 msgr2=0x7fde901f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9015aa40 0x7fde901f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 -- 172.21.15.50:0/146567439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800094d0 con 0x7fde900b0c60 2023-08-10T10:45:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.848+0000 7fde95f64640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b3f0 tx=0x7fde8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.849+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011830 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.849+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c011990 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.849+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011d40 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.849+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90153360 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.849+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90153920 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.850+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9004e270 con 0x7fde900b0c60 2023-08-10T10:45:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.851+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde8c01a400 con 0x7fde900b0c60 2023-08-10T10:45:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.852+0000 7fde867fc640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 0x7fde7406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.852+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde8c0892a0 con 0x7fde900b0c60 2023-08-10T10:45:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.852+0000 7fde95763640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 0x7fde7406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:36.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.853+0000 7fde95763640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 0x7fde7406d110 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fde80036000 tx=0x7fde8003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:36.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:36.857+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde8c054340 con 0x7fde900b0c60 2023-08-10T10:45:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.051+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde90151ea0 con 0x7fde900b0c60 2023-08-10T10:45:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.053+0000 7fde867fc640 1 -- 172.21.15.50:0/146567439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18296 (secure 0 0 0) 0x7fde8c057960 con 0x7fde900b0c60 2023-08-10T10:45:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:37.054 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":128,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:35.596383+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 msgr2=0x7fde7406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 0x7fde7406d110 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fde80036000 tx=0x7fde8003d040 comp rx=0 tx=0).stop 2023-08-10T10:45:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 msgr2=0x7fde90151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b3f0 tx=0x7fde8c00b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 shutdown_connections 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde7406ac50 0x7fde7406d110 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9015aa40 0x7fde901f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900b3f30 0x7fde900c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 --2- 172.21.15.50:0/146567439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900b0c60 0x7fde90151960 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.055+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 >> 172.21.15.50:0/146567439 conn(0x7fde9006b590 msgr2=0x7fde90156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.056+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 shutdown_connections 2023-08-10T10:45:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.056+0000 7fde981c8640 1 -- 172.21.15.50:0/146567439 wait complete. 2023-08-10T10:45:37.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:45:37.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.317+0000 7f5fe075d640 1 Processor -- start 2023-08-10T10:45:37.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.317+0000 7f5fe075d640 1 -- start start 2023-08-10T10:45:37.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fe075d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fe075d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fd806cb30 0x7f5fd80ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fe075d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd80adcb0 con 0x7f5fd815ae40 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fe075d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd806c320 con 0x7f5fd806cb30 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fe075d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd806b770 con 0x7f5fd80cd9b0 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fde4f9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fd815ae40 0x7f5fd80cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48190/0 (socket says 172.21.15.50:48190) 2023-08-10T10:45:37.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fde4f9640 1 -- 172.21.15.50:0/3906322637 learned_addr learned my addr 172.21.15.50:0/3906322637 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:37.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.319+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/3906322637 >> v2:172.21.15.50:3300/0 conn(0x7f5fd806cb30 0x7f5fd80ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fddcf8640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176332933 0 0) 0x7f5fd80adcb0 con 0x7f5fd815ae40 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc4003520 con 0x7f5fd815ae40 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdecfa640 1 -- 172.21.15.50:0/3906322637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 msgr2=0x7f5fd80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266937130 0 0) 0x7f5fc4003520 con 0x7f5fd815ae40 2023-08-10T10:45:37.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdecfa640 1 -- 172.21.15.50:0/3906322637 >> v1:172.21.15.50:6789/0 conn(0x7f5fd815ae40 legacy=0x7f5fd80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.320+0000 7f5fdecfa640 1 -- 172.21.15.50:0/3906322637 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd806b9f0 con 0x7f5fd806cb30 2023-08-10T10:45:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.321+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd806cb30 0x7f5fd80ad770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faafec087cc840e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.322+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4001670 con 0x7f5fd806cb30 2023-08-10T10:45:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.322+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd002c8a0 con 0x7f5fd806cb30 2023-08-10T10:45:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.322+0000 7f5fdd4f7640 1 -- 172.21.15.50:0/3906322637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002cc10 con 0x7f5fd806cb30 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.322+0000 7f5fe075d640 1 -- 172.21.15.50:0/3906322637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd806cb30 msgr2=0x7f5fd80ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.322+0000 7f5fe075d640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd806cb30 0x7f5fd80ad770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd002bd70 comp rx=0 tx=0).stop 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 -- 172.21.15.50:0/3906322637 shutdown_connections 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd806cb30 0x7f5fd80ad770 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 --2- 172.21.15.50:0/3906322637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 -- 172.21.15.50:0/3906322637 >> 172.21.15.50:0/3906322637 conn(0x7f5fd80b01b0 msgr2=0x7f5fd80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 -- 172.21.15.50:0/3906322637 shutdown_connections 2023-08-10T10:45:37.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.323+0000 7f5fe075d640 1 -- 172.21.15.50:0/3906322637 wait complete. 2023-08-10T10:45:37.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.325+0000 7f5fe075d640 1 Processor -- start 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.325+0000 7f5fe075d640 1 -- start start 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 0x7f5fd814ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd81f2ee0 con 0x7f5fd815ae40 2023-08-10T10:45:37.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd81f22d0 con 0x7f5fd806cb30 2023-08-10T10:45:37.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fe075d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd81f25b0 con 0x7f5fd80cd9b0 2023-08-10T10:45:37.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fdecfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fdecfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39712/0 (socket says 172.21.15.50:39712) 2023-08-10T10:45:37.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.326+0000 7f5fdecfa640 1 -- 172.21.15.50:0/1515512578 learned_addr learned my addr 172.21.15.50:0/1515512578 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:37.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fddcf8640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fde4f9640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 0x7f5fd814ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 -- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 msgr2=0x7f5fd80c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 -- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 msgr2=0x7f5fd814ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 0x7f5fd814ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:37.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 -- 172.21.15.50:0/1515512578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd0009a70 con 0x7f5fd815ae40 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fde4f9640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 0x7f5fd814ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fdecfa640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002dea0 con 0x7f5fd815ae40 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0009450 con 0x7f5fd815ae40 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0004490 con 0x7f5fd815ae40 2023-08-10T10:45:37.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.327+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd81f2890 con 0x7f5fd815ae40 2023-08-10T10:45:37.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.328+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd81f1fd0 con 0x7f5fd815ae40 2023-08-10T10:45:37.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.329+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd80cddd0 con 0x7f5fd815ae40 2023-08-10T10:45:37.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.330+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fd00045f0 con 0x7f5fd815ae40 2023-08-10T10:45:37.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.331+0000 7f5fceffd640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 0x7f5fbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.331+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd00abc80 con 0x7f5fd815ae40 2023-08-10T10:45:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.331+0000 7f5fde4f9640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 0x7f5fbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.332+0000 7f5fde4f9640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 0x7f5fbc06d110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40011e0 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:37.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.335+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5fd0076c90 con 0x7f5fd815ae40 2023-08-10T10:45:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:37.563+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5fd80612b0 con 0x7f5fd815ae40 2023-08-10T10:45:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.163+0000 7f5fceffd640 1 -- 172.21.15.50:0/1515512578 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5fd007a2b0 con 0x7f5fd815ae40 2023-08-10T10:45:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.166+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 msgr2=0x7f5fbc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.166+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 0x7f5fbc06d110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40011e0 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.166+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 msgr2=0x7f5fd80c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.166+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd0004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 shutdown_connections 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd815ae40 0x7f5fd80c3fd0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd80cd9b0 0x7f5fd80c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5fbc06ac50 0x7f5fbc06d110 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 --2- 172.21.15.50:0/1515512578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd806cb30 0x7f5fd814ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 >> 172.21.15.50:0/1515512578 conn(0x7f5fd80b01b0 msgr2=0x7f5fd81589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 shutdown_connections 2023-08-10T10:45:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.167+0000 7f5fe075d640 1 -- 172.21.15.50:0/1515512578 wait complete. 2023-08-10T10:45:38.190 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:45:38.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:45:38.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.414+0000 7f1241cf5640 1 Processor -- start 2023-08-10T10:45:38.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.415+0000 7f1241cf5640 1 -- start start 2023-08-10T10:45:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.416+0000 7f1241cf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 0x7f123c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.416+0000 7f1241cf5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f123c0ada90 0x7f123c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.416+0000 7f1241cf5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0adf10 con 0x7f123c0ca360 2023-08-10T10:45:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.416+0000 7f1241cf5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0ca7f0 con 0x7f123c0ada90 2023-08-10T10:45:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.416+0000 7f1241cf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c06ebb0 con 0x7f123c159c10 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f123c0ada90 0x7f123c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f123c0ada90 0x7f123c0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39716/0 (socket says 172.21.15.50:39716) 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 -- 172.21.15.50:0/4123590398 learned_addr learned my addr 172.21.15.50:0/4123590398 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f123b7fe640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 0x7f123c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 -- 172.21.15.50:0/4123590398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 msgr2=0x7f123c0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 0x7f123c0b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 -- 172.21.15.50:0/4123590398 >> v1:172.21.15.117:6789/0 conn(0x7f123c0ca360 legacy=0x7f123c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f1232ffd640 1 -- 172.21.15.50:0/4123590398 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c06ee90 con 0x7f123c0ada90 2023-08-10T10:45:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.417+0000 7f123b7fe640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 0x7f123c0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.418+0000 7f1232ffd640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c9e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f122400bb10 tx=0x7f122402e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff5863a20ac538 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.419+0000 7f123affd640 1 -- 172.21.15.50:0/4123590398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122402ee80 con 0x7f123c0ada90 2023-08-10T10:45:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.419+0000 7f123affd640 1 -- 172.21.15.50:0/4123590398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224036440 con 0x7f123c0ada90 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.419+0000 7f123affd640 1 -- 172.21.15.50:0/4123590398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240367b0 con 0x7f123c0ada90 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.419+0000 7f1241cf5640 1 -- 172.21.15.50:0/4123590398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 msgr2=0x7f123c0c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.419+0000 7f1241cf5640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c9e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f122400bb10 tx=0x7f122402e0d0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 -- 172.21.15.50:0/4123590398 shutdown_connections 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c9e20 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 --2- 172.21.15.50:0/4123590398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c159c10 0x7f123c0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 -- 172.21.15.50:0/4123590398 >> 172.21.15.50:0/4123590398 conn(0x7f123c0b01b0 msgr2=0x7f123c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 -- 172.21.15.50:0/4123590398 shutdown_connections 2023-08-10T10:45:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.420+0000 7f1241cf5640 1 -- 172.21.15.50:0/4123590398 wait complete. 2023-08-10T10:45:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.421+0000 7f1241cf5640 1 Processor -- start 2023-08-10T10:45:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.422+0000 7f1241cf5640 1 -- start start 2023-08-10T10:45:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 0x7f123c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 0x7f123c0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1f1fc0 con 0x7f123c0ada90 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1f13b0 con 0x7f123c159c10 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1241cf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1f1690 con 0x7f123c0ca360 2023-08-10T10:45:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39722/0 (socket says 172.21.15.50:39722) 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 -- 172.21.15.50:0/507434756 learned_addr learned my addr 172.21.15.50:0/507434756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1232ffd640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 0x7f123c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123bfff640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 0x7f123c0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 -- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 msgr2=0x7f123c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 0x7f123c1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 -- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 msgr2=0x7f123c0b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 0x7f123c0b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123b7fe640 1 -- 172.21.15.50:0/507434756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122400b770 con 0x7f123c0ada90 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f1232ffd640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 0x7f123c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.423+0000 7f123bfff640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 0x7f123c0b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f123b7fe640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c7f0 tx=0x7f122c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c007a30 con 0x7f123c0ada90 2023-08-10T10:45:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c007b90 con 0x7f123c0ada90 2023-08-10T10:45:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ce40 con 0x7f123c0ada90 2023-08-10T10:45:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c1f1970 con 0x7f123c0ada90 2023-08-10T10:45:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.424+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c1f1060 con 0x7f123c0ada90 2023-08-10T10:45:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.425+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c0612b0 con 0x7f123c0ada90 2023-08-10T10:45:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.426+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f122c0113f0 con 0x7f123c0ada90 2023-08-10T10:45:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.428+0000 7f1238ff9640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 0x7f121c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.428+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f122c089710 con 0x7f123c0ada90 2023-08-10T10:45:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.428+0000 7f1232ffd640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 0x7f121c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.429+0000 7f1232ffd640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 0x7f121c06d110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1224038000 tx=0x7f1224032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.433+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f122c054720 con 0x7f123c0ada90 2023-08-10T10:45:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:38.669+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f123c0cced0 con 0x7f123c0ada90 2023-08-10T10:45:39.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.175+0000 7f1238ff9640 1 -- 172.21.15.50:0/507434756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f122c087e60 con 0x7f123c0ada90 2023-08-10T10:45:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 msgr2=0x7f121c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 0x7f121c06d110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1224038000 tx=0x7f1224032000 comp rx=0 tx=0).stop 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 msgr2=0x7f123c0c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c7f0 tx=0x7f122c00cbf0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 shutdown_connections 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f121c06ac50 0x7f121c06d110 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f123c159c10 0x7f123c0b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f123c0ca360 0x7f123c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 --2- 172.21.15.50:0/507434756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f123c0ada90 0x7f123c0c33b0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 >> 172.21.15.50:0/507434756 conn(0x7f123c0b01b0 msgr2=0x7f123c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 shutdown_connections 2023-08-10T10:45:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.179+0000 7f1241cf5640 1 -- 172.21.15.50:0/507434756 wait complete. 2023-08-10T10:45:39.200 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:45:39.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.416+0000 7fde17a9b640 1 Processor -- start 2023-08-10T10:45:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.416+0000 7fde17a9b640 1 -- start start 2023-08-10T10:45:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.417+0000 7fde17a9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde1015f370 0x7fde100cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde17a9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100cf3c0 0x7fde1015a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde17a9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde100b0000 con 0x7fde100afc20 2023-08-10T10:45:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde17a9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde100cf850 con 0x7fde1015f370 2023-08-10T10:45:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde17a9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100cbe60 con 0x7fde100cf3c0 2023-08-10T10:45:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15036640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde1015f370 0x7fde100cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15837640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde100afc20 0x7fde100cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48202/0 (socket says 172.21.15.50:48202) 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15837640 1 -- 172.21.15.50:0/82145953 learned_addr learned my addr 172.21.15.50:0/82145953 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15036640 1 -- 172.21.15.50:0/82145953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100cf3c0 msgr2=0x7fde1015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15036640 1 --2- 172.21.15.50:0/82145953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100cf3c0 0x7fde1015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15036640 1 -- 172.21.15.50:0/82145953 >> v1:172.21.15.50:6789/0 conn(0x7fde100afc20 legacy=0x7fde100cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.418+0000 7fde15036640 1 -- 172.21.15.50:0/82145953 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100cc140 con 0x7fde1015f370 2023-08-10T10:45:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde15036640 1 --2- 172.21.15.50:0/82145953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100cee80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fde000097d0 tx=0x7fde0002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e1b261d98915e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde14835640 1 -- 172.21.15.50:0/82145953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0002d040 con 0x7fde1015f370 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde14835640 1 -- 172.21.15.50:0/82145953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00031810 con 0x7fde1015f370 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde14835640 1 -- 172.21.15.50:0/82145953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00031ba0 con 0x7fde1015f370 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde17a9b640 1 -- 172.21.15.50:0/82145953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 msgr2=0x7fde100cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.420+0000 7fde17a9b640 1 --2- 172.21.15.50:0/82145953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100cee80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fde000097d0 tx=0x7fde0002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 -- 172.21.15.50:0/82145953 shutdown_connections 2023-08-10T10:45:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 --2- 172.21.15.50:0/82145953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100cee80 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 --2- 172.21.15.50:0/82145953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100cf3c0 0x7fde1015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 -- 172.21.15.50:0/82145953 >> 172.21.15.50:0/82145953 conn(0x7fde100d0930 msgr2=0x7fde100d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 -- 172.21.15.50:0/82145953 shutdown_connections 2023-08-10T10:45:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.421+0000 7fde17a9b640 1 -- 172.21.15.50:0/82145953 wait complete. 2023-08-10T10:45:39.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.422+0000 7fde17a9b640 1 Processor -- start 2023-08-10T10:45:39.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.423+0000 7fde17a9b640 1 -- start start 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100afc20 0x7fde10159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde100cf3c0 0x7fde100c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100c72a0 con 0x7fde1015f370 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100c64d0 con 0x7fde100cf3c0 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde17a9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100c6720 con 0x7fde100afc20 2023-08-10T10:45:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde16038640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde16038640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39730/0 (socket says 172.21.15.50:39730) 2023-08-10T10:45:39.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde16038640 1 -- 172.21.15.50:0/1610507787 learned_addr learned my addr 172.21.15.50:0/1610507787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:39.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde15837640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100afc20 0x7fde10159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.424+0000 7fde15036640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde100cf3c0 0x7fde100c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 -- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100afc20 msgr2=0x7fde10159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100afc20 0x7fde10159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 -- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde100cf3c0 msgr2=0x7fde100c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde100cf3c0 0x7fde100c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 -- 172.21.15.50:0/1610507787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009400 con 0x7fde1015f370 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde16038640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b450 tx=0x7fde0800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011890 con 0x7fde1015f370 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde080119f0 con 0x7fde1015f370 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde100c6a00 con 0x7fde1015f370 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.425+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011d80 con 0x7fde1015f370 2023-08-10T10:45:39.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.426+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde100c6fc0 con 0x7fde1015f370 2023-08-10T10:45:39.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.427+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1004e270 con 0x7fde1015f370 2023-08-10T10:45:39.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.428+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde0801a400 con 0x7fde1015f370 2023-08-10T10:45:39.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.429+0000 7fde067fc640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 0x7fddf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.429+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde08089810 con 0x7fde1015f370 2023-08-10T10:45:39.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.429+0000 7fde15837640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 0x7fddf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.430+0000 7fde15837640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 0x7fddf406d110 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fde0c001460 tx=0x7fde0c0016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.433+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde08054820 con 0x7fde1015f370 2023-08-10T10:45:39.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.660+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde100cec60 con 0x7fde1015f370 2023-08-10T10:45:39.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.661+0000 7fde067fc640 1 -- 172.21.15.50:0/1610507787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fde08057e40 con 0x7fde1015f370 2023-08-10T10:45:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:39.663 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:45:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:45:39.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 msgr2=0x7fddf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 0x7fddf406d110 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fde0c001460 tx=0x7fde0c0016a0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 msgr2=0x7fde100c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b450 tx=0x7fde0800b910 comp rx=0 tx=0).stop 2023-08-10T10:45:39.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 shutdown_connections 2023-08-10T10:45:39.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1015f370 0x7fde100c5f90 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fddf406ac50 0x7fddf406d110 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde100cf3c0 0x7fde100c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 --2- 172.21.15.50:0/1610507787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde100afc20 0x7fde10159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 >> 172.21.15.50:0/1610507787 conn(0x7fde100d0930 msgr2=0x7fde100ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 shutdown_connections 2023-08-10T10:45:39.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.664+0000 7fde17a9b640 1 -- 172.21.15.50:0/1610507787 wait complete. 2023-08-10T10:45:39.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:39.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.898+0000 7fdd64ca6640 1 Processor -- start 2023-08-10T10:45:39.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.898+0000 7fdd64ca6640 1 -- start start 2023-08-10T10:45:39.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd64ca6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd600b0c60 0x7fdd600c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd64ca6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd60071c70 con 0x7fdd6015aa40 2023-08-10T10:45:39.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd64ca6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600713d0 con 0x7fdd600b3f30 2023-08-10T10:45:39.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd64ca6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd600716b0 con 0x7fdd600b0c60 2023-08-10T10:45:39.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd5e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd6015aa40 0x7fdd600b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48216/0 (socket says 172.21.15.50:48216) 2023-08-10T10:45:39.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd5e59c640 1 -- 172.21.15.50:0/536260096 learned_addr learned my addr 172.21.15.50:0/536260096 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:39.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd55d9b640 1 --2- 172.21.15.50:0/536260096 >> v2:172.21.15.50:3300/0 conn(0x7fdd600b0c60 0x7fdd600c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.900+0000 7fdd55d9b640 1 -- 172.21.15.50:0/536260096 >> v1:172.21.15.117:6789/0 conn(0x7fdd600b3f30 legacy=0x7fdd600c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:39.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.901+0000 7fdd55d9b640 1 -- 172.21.15.50:0/536260096 >> v1:172.21.15.50:6789/0 conn(0x7fdd6015aa40 legacy=0x7fdd600b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.901+0000 7fdd5dd9b640 1 -- 172.21.15.50:0/536260096 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787180229 0 0) 0x7fdd60071c70 con 0x7fdd6015aa40 2023-08-10T10:45:39.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.901+0000 7fdd55d9b640 1 -- 172.21.15.50:0/536260096 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60071990 con 0x7fdd600b0c60 2023-08-10T10:45:39.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.902+0000 7fdd55d9b640 1 --2- 172.21.15.50:0/536260096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c9920 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009d90 tx=0x7fdd4802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13a87f08e7f162f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.902+0000 7fdd5dd9b640 1 -- 172.21.15.50:0/536260096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4802cc70 con 0x7fdd600b0c60 2023-08-10T10:45:39.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.902+0000 7fdd5dd9b640 1 -- 172.21.15.50:0/536260096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4802cdd0 con 0x7fdd600b0c60 2023-08-10T10:45:39.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.902+0000 7fdd5dd9b640 1 -- 172.21.15.50:0/536260096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48034660 con 0x7fdd600b0c60 2023-08-10T10:45:39.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 -- 172.21.15.50:0/536260096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 msgr2=0x7fdd600c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/536260096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c9920 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009d90 tx=0x7fdd4802bec0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 -- 172.21.15.50:0/536260096 shutdown_connections 2023-08-10T10:45:39.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/536260096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c9920 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 -- 172.21.15.50:0/536260096 >> 172.21.15.50:0/536260096 conn(0x7fdd6006b590 msgr2=0x7fdd600ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:39.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 -- 172.21.15.50:0/536260096 shutdown_connections 2023-08-10T10:45:39.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.903+0000 7fdd64ca6640 1 -- 172.21.15.50:0/536260096 wait complete. 2023-08-10T10:45:39.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.905+0000 7fdd64ca6640 1 Processor -- start 2023-08-10T10:45:39.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.906+0000 7fdd64ca6640 1 -- start start 2023-08-10T10:45:39.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.906+0000 7fdd64ca6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.906+0000 7fdd64ca6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600b3f30 0x7fdd601f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.906+0000 7fdd64ca6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 0x7fdd600c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd64ca6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c8650 con 0x7fdd600b0c60 2023-08-10T10:45:39.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd64ca6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c7720 con 0x7fdd6015aa40 2023-08-10T10:45:39.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd64ca6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c6e80 con 0x7fdd600b3f30 2023-08-10T10:45:39.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39740/0 (socket says 172.21.15.50:39740) 2023-08-10T10:45:39.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 -- 172.21.15.50:0/230229160 learned_addr learned my addr 172.21.15.50:0/230229160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:39.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 -- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600b3f30 msgr2=0x7fdd601f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600b3f30 0x7fdd601f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 -- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 msgr2=0x7fdd600c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:39.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5ed9d640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 0x7fdd600c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 0x7fdd600c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:39.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5e59c640 1 -- 172.21.15.50:0/230229160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48009a70 con 0x7fdd600b0c60 2023-08-10T10:45:39.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.907+0000 7fdd5ed9d640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 0x7fdd600c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:39.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd5e59c640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c3f0 tx=0x7fdd5000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500074e0 con 0x7fdd600b0c60 2023-08-10T10:45:39.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50007640 con 0x7fdd600b0c60 2023-08-10T10:45:39.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50004a00 con 0x7fdd600b0c60 2023-08-10T10:45:39.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600c7160 con 0x7fdd600b0c60 2023-08-10T10:45:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.908+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd601f2780 con 0x7fdd600b0c60 2023-08-10T10:45:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.909+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd601f25f0 con 0x7fdd600b0c60 2023-08-10T10:45:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.910+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd50004b60 con 0x7fdd600b0c60 2023-08-10T10:45:39.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.911+0000 7fdd577fe640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 0x7fdd4006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:39.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.911+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd500893b0 con 0x7fdd600b0c60 2023-08-10T10:45:39.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.911+0000 7fdd55d9b640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 0x7fdd4006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:39.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.912+0000 7fdd55d9b640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 0x7fdd4006d110 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdd48036000 tx=0x7fdd4802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:39.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:39.915+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdd500543c0 con 0x7fdd600b0c60 2023-08-10T10:45:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.106+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd601f2970 con 0x7fdd600b0c60 2023-08-10T10:45:40.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.108+0000 7fdd577fe640 1 -- 172.21.15.50:0/230229160 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18283 (secure 0 0 0) 0x7fdd500579e0 con 0x7fdd600b0c60 2023-08-10T10:45:40.109 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:40.109 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":129,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:37.121468+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 msgr2=0x7fdd4006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 0x7fdd4006d110 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdd48036000 tx=0x7fdd4802e000 comp rx=0 tx=0).stop 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 msgr2=0x7fdd600c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c3f0 tx=0x7fdd5000c8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 shutdown_connections 2023-08-10T10:45:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdd4006ac50 0x7fdd4006d110 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd6015aa40 0x7fdd600c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600b3f30 0x7fdd601f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 --2- 172.21.15.50:0/230229160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd600b0c60 0x7fdd600c67e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.110+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 >> 172.21.15.50:0/230229160 conn(0x7fdd6006b590 msgr2=0x7fdd60150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.111+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 shutdown_connections 2023-08-10T10:45:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.111+0000 7fdd64ca6640 1 -- 172.21.15.50:0/230229160 wait complete. 2023-08-10T10:45:40.130 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:45:40.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:45:40.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.359+0000 7f038f59e640 1 Processor -- start 2023-08-10T10:45:40.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.359+0000 7f038f59e640 1 -- start start 2023-08-10T10:45:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.360+0000 7f038f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f039015a940 0x7f03900aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.360+0000 7f038f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f039015f2b0 0x7f03900b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.360+0000 7f038f59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900b1f10 con 0x7f03900b12c0 2023-08-10T10:45:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.360+0000 7f038f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900b21f0 con 0x7f039015f2b0 2023-08-10T10:45:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.360+0000 7f038f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039015e5c0 con 0x7f039015a940 2023-08-10T10:45:40.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f039015f2b0 0x7f03900b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f039015f2b0 0x7f03900b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39746/0 (socket says 172.21.15.50:39746) 2023-08-10T10:45:40.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 -- 172.21.15.50:0/3162067854 learned_addr learned my addr 172.21.15.50:0/3162067854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:40.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 -- 172.21.15.50:0/3162067854 >> v2:172.21.15.117:3300/0 conn(0x7f039015a940 msgr2=0x7f03900aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 --2- 172.21.15.50:0/3162067854 >> v2:172.21.15.117:3300/0 conn(0x7f039015a940 0x7f03900aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 -- 172.21.15.50:0/3162067854 >> v1:172.21.15.117:6789/0 conn(0x7f03900b12c0 legacy=0x7f03900b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.361+0000 7f038dd9b640 1 -- 172.21.15.50:0/3162067854 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039015e7d0 con 0x7f039015f2b0 2023-08-10T10:45:40.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.362+0000 7f038dd9b640 1 --2- 172.21.15.50:0/3162067854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f03900b0450 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f03900ce2e0 tx=0x7f038402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26911672e46dbf74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038d59a640 1 -- 172.21.15.50:0/3162067854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038402c9f0 con 0x7f039015f2b0 2023-08-10T10:45:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038d59a640 1 -- 172.21.15.50:0/3162067854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038402cb50 con 0x7f039015f2b0 2023-08-10T10:45:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038d59a640 1 -- 172.21.15.50:0/3162067854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840343f0 con 0x7f039015f2b0 2023-08-10T10:45:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038f59e640 1 -- 172.21.15.50:0/3162067854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 msgr2=0x7f03900b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038f59e640 1 --2- 172.21.15.50:0/3162067854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f03900b0450 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f03900ce2e0 tx=0x7f038402be50 comp rx=0 tx=0).stop 2023-08-10T10:45:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038f59e640 1 -- 172.21.15.50:0/3162067854 shutdown_connections 2023-08-10T10:45:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038f59e640 1 --2- 172.21.15.50:0/3162067854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f03900b0450 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.363+0000 7f038f59e640 1 --2- 172.21.15.50:0/3162067854 >> v2:172.21.15.117:3300/0 conn(0x7f039015a940 0x7f03900aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.364+0000 7f038f59e640 1 -- 172.21.15.50:0/3162067854 >> 172.21.15.50:0/3162067854 conn(0x7f039006ab80 msgr2=0x7f039006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.364+0000 7f038f59e640 1 -- 172.21.15.50:0/3162067854 shutdown_connections 2023-08-10T10:45:40.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.364+0000 7f038f59e640 1 -- 172.21.15.50:0/3162067854 wait complete. 2023-08-10T10:45:40.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.365+0000 7f038f59e640 1 Processor -- start 2023-08-10T10:45:40.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.366+0000 7f038f59e640 1 -- start start 2023-08-10T10:45:40.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03900b12c0 0x7f0390150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039015a940 0x7f039015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039015d5d0 con 0x7f039015f2b0 2023-08-10T10:45:40.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039015b540 con 0x7f039015a940 2023-08-10T10:45:40.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039015cd70 con 0x7f03900b12c0 2023-08-10T10:45:40.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39756/0 (socket says 172.21.15.50:39756) 2023-08-10T10:45:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 -- 172.21.15.50:0/623086916 learned_addr learned my addr 172.21.15.50:0/623086916 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038dd9b640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039015a940 0x7f039015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038e59c640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03900b12c0 0x7f0390150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 -- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03900b12c0 msgr2=0x7f0390150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03900b12c0 0x7f0390150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 -- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039015a940 msgr2=0x7f039015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.367+0000 7f038ed9d640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039015a940 0x7f039015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f038ed9d640 1 -- 172.21.15.50:0/623086916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009b30 con 0x7f039015f2b0 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f038ed9d640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f038800b490 tx=0x7f038800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388011830 con 0x7f039015f2b0 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03880119b0 con 0x7f039015f2b0 2023-08-10T10:45:40.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388011d60 con 0x7f039015f2b0 2023-08-10T10:45:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039015bf10 con 0x7f039015f2b0 2023-08-10T10:45:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.368+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039015d2f0 con 0x7f039015f2b0 2023-08-10T10:45:40.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.369+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039015b6b0 con 0x7f039015f2b0 2023-08-10T10:45:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.371+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f038801a400 con 0x7f039015f2b0 2023-08-10T10:45:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.372+0000 7f037effd640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 0x7f037006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.372+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0388089510 con 0x7f039015f2b0 2023-08-10T10:45:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.372+0000 7f038e59c640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 0x7f037006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.373+0000 7f038e59c640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 0x7f037006d140 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0390159800 tx=0x7f0380008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.376+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03880545b0 con 0x7f039015f2b0 2023-08-10T10:45:40.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.567+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f039015ed90 con 0x7f037006ac80 2023-08-10T10:45:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.582+0000 7f037effd640 1 -- 172.21.15.50:0/623086916 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303301 (secure 0 0 0) 0x7f038000bdc0 con 0x7f037006ac80 2023-08-10T10:45:40.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:40.587 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.586+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 msgr2=0x7f037006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.586+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 0x7f037006d140 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0390159800 tx=0x7f0380008040 comp rx=0 tx=0).stop 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.586+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 msgr2=0x7f039015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.586+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f038800b490 tx=0x7f038800b950 comp rx=0 tx=0).stop 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 shutdown_connections 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f039015f2b0 0x7f039015b9d0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f037006ac80 0x7f037006d140 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039015a940 0x7f039015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 --2- 172.21.15.50:0/623086916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03900b12c0 0x7f0390150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 >> 172.21.15.50:0/623086916 conn(0x7f039006ab80 msgr2=0x7f03900c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:40.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 shutdown_connections 2023-08-10T10:45:40.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.587+0000 7f038f59e640 1 -- 172.21.15.50:0/623086916 wait complete. 2023-08-10T10:45:40.606 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-08-10T10:45:40.471047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7104,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555395,"statfs":{"total":1600000000,"available":1592724964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001916"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916087+0000","last_change":"2023-08-10T10:45:36.142581+0000","last_active":"2023-08-10T10:45:37.916087+0000","last_peered":"2023-08-10T10:45:37.916087+0000","last_clean":"2023-08-10T10:45:37.916087+0000","last_became_active":"2023-08-10T10:45:36.142275+0000","last_became_peered":"2023-08-10T10:45:36.142275+0000","last_unstale":"2023-08-10T10:45:37.916087+0000","last_undegraded":"2023-08-10T10:45:37.916087+0000","last_fullsized":"2023-08-10T10:45:37.916087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:05.704607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292812+0000","last_change":"2023-08-10T10:45:36.151094+0000","last_active":"2023-08-10T10:45:37.292812+0000","last_peered":"2023-08-10T10:45:37.292812+0000","last_clean":"2023-08-10T10:45:37.292812+0000","last_became_active":"2023-08-10T10:45:36.150644+0000","last_became_peered":"2023-08-10T10:45:36.150644+0000","last_unstale":"2023-08-10T10:45:37.292812+0000","last_undegraded":"2023-08-10T10:45:37.292812+0000","last_fullsized":"2023-08-10T10:45:37.292812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:32.944050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915240+0000","last_change":"2023-08-10T10:45:36.151769+0000","last_active":"2023-08-10T10:45:37.915240+0000","last_peered":"2023-08-10T10:45:37.915240+0000","last_clean":"2023-08-10T10:45:37.915240+0000","last_became_active":"2023-08-10T10:45:36.151412+0000","last_became_peered":"2023-08-10T10:45:36.151412+0000","last_unstale":"2023-08-10T10:45:37.915240+0000","last_undegraded":"2023-08-10T10:45:37.915240+0000","last_fullsized":"2023-08-10T10:45:37.915240+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:51.129317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916898+0000","last_change":"2023-08-10T10:45:36.147427+0000","last_active":"2023-08-10T10:45:37.916898+0000","last_peered":"2023-08-10T10:45:37.916898+0000","last_clean":"2023-08-10T10:45:37.916898+0000","last_became_active":"2023-08-10T10:45:36.143186+0000","last_became_peered":"2023-08-10T10:45:36.143186+0000","last_unstale":"2023-08-10T10:45:37.916898+0000","last_undegraded":"2023-08-10T10:45:37.916898+0000","last_fullsized":"2023-08-10T10:45:37.916898+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:07.938384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126491+0000","last_change":"2023-08-10T10:45:36.144047+0000","last_active":"2023-08-10T10:45:37.126491+0000","last_peered":"2023-08-10T10:45:37.126491+0000","last_clean":"2023-08-10T10:45:37.126491+0000","last_became_active":"2023-08-10T10:45:36.143555+0000","last_became_peered":"2023-08-10T10:45:36.143555+0000","last_unstale":"2023-08-10T10:45:37.126491+0000","last_undegraded":"2023-08-10T10:45:37.126491+0000","last_fullsized":"2023-08-10T10:45:37.126491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:53.668585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293595+0000","last_change":"2023-08-10T10:45:36.150623+0000","last_active":"2023-08-10T10:45:37.293595+0000","last_peered":"2023-08-10T10:45:37.293595+0000","last_clean":"2023-08-10T10:45:37.293595+0000","last_became_active":"2023-08-10T10:45:36.149272+0000","last_became_peered":"2023-08-10T10:45:36.149272+0000","last_unstale":"2023-08-10T10:45:37.293595+0000","last_undegraded":"2023-08-10T10:45:37.293595+0000","last_fullsized":"2023-08-10T10:45:37.293595+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:33.664515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292244+0000","last_change":"2023-08-10T10:45:36.150933+0000","last_active":"2023-08-10T10:45:37.292244+0000","last_peered":"2023-08-10T10:45:37.292244+0000","last_clean":"2023-08-10T10:45:37.292244+0000","last_became_active":"2023-08-10T10:45:36.150239+0000","last_became_peered":"2023-08-10T10:45:36.150239+0000","last_unstale":"2023-08-10T10:45:37.292244+0000","last_undegraded":"2023-08-10T10:45:37.292244+0000","last_fullsized":"2023-08-10T10:45:37.292244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:26.954723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127821+0000","last_change":"2023-08-10T10:45:36.141674+0000","last_active":"2023-08-10T10:45:37.127821+0000","last_peered":"2023-08-10T10:45:37.127821+0000","last_clean":"2023-08-10T10:45:37.127821+0000","last_became_active":"2023-08-10T10:45:36.140993+0000","last_became_peered":"2023-08-10T10:45:36.140993+0000","last_unstale":"2023-08-10T10:45:37.127821+0000","last_undegraded":"2023-08-10T10:45:37.127821+0000","last_fullsized":"2023-08-10T10:45:37.127821+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:51:01.199223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292230+0000","last_change":"2023-08-10T10:45:36.157735+0000","last_active":"2023-08-10T10:45:37.292230+0000","last_peered":"2023-08-10T10:45:37.292230+0000","last_clean":"2023-08-10T10:45:37.292230+0000","last_became_active":"2023-08-10T10:45:36.157476+0000","last_became_peered":"2023-08-10T10:45:36.157476+0000","last_unstale":"2023-08-10T10:45:37.292230+0000","last_undegraded":"2023-08-10T10:45:37.292230+0000","last_fullsized":"2023-08-10T10:45:37.292230+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:24.425170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126869+0000","last_change":"2023-08-10T10:45:36.152290+0000","last_active":"2023-08-10T10:45:37.126869+0000","last_peered":"2023-08-10T10:45:37.126869+0000","last_clean":"2023-08-10T10:45:37.126869+0000","last_became_active":"2023-08-10T10:45:36.151681+0000","last_became_peered":"2023-08-10T10:45:36.151681+0000","last_unstale":"2023-08-10T10:45:37.126869+0000","last_undegraded":"2023-08-10T10:45:37.126869+0000","last_fullsized":"2023-08-10T10:45:37.126869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:31.711494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290306+0000","last_change":"2023-08-10T10:45:36.154671+0000","last_active":"2023-08-10T10:45:37.290306+0000","last_peered":"2023-08-10T10:45:37.290306+0000","last_clean":"2023-08-10T10:45:37.290306+0000","last_became_active":"2023-08-10T10:45:36.154304+0000","last_became_peered":"2023-08-10T10:45:36.154304+0000","last_unstale":"2023-08-10T10:45:37.290306+0000","last_undegraded":"2023-08-10T10:45:37.290306+0000","last_fullsized":"2023-08-10T10:45:37.290306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:37.763630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129107+0000","last_change":"2023-08-10T10:45:36.147924+0000","last_active":"2023-08-10T10:45:37.129107+0000","last_peered":"2023-08-10T10:45:37.129107+0000","last_clean":"2023-08-10T10:45:37.129107+0000","last_became_active":"2023-08-10T10:45:36.147511+0000","last_became_peered":"2023-08-10T10:45:36.147511+0000","last_unstale":"2023-08-10T10:45:37.129107+0000","last_undegraded":"2023-08-10T10:45:37.129107+0000","last_fullsized":"2023-08-10T10:45:37.129107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:27.739628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916270+0000","last_change":"2023-08-10T10:45:36.154848+0000","last_active":"2023-08-10T10:45:37.916270+0000","last_peered":"2023-08-10T10:45:37.916270+0000","last_clean":"2023-08-10T10:45:37.916270+0000","last_became_active":"2023-08-10T10:45:36.154597+0000","last_became_peered":"2023-08-10T10:45:36.154597+0000","last_unstale":"2023-08-10T10:45:37.916270+0000","last_undegraded":"2023-08-10T10:45:37.916270+0000","last_fullsized":"2023-08-10T10:45:37.916270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:38.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291902+0000","last_change":"2023-08-10T10:45:36.150501+0000","last_active":"2023-08-10T10:45:37.291902+0000","last_peered":"2023-08-10T10:45:37.291902+0000","last_clean":"2023-08-10T10:45:37.291902+0000","last_became_active":"2023-08-10T10:45:36.150205+0000","last_became_peered":"2023-08-10T10:45:36.150205+0000","last_unstale":"2023-08-10T10:45:37.291902+0000","last_undegraded":"2023-08-10T10:45:37.291902+0000","last_fullsized":"2023-08-10T10:45:37.291902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:00.684278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290948+0000","last_change":"2023-08-10T10:45:36.154306+0000","last_active":"2023-08-10T10:45:37.290948+0000","last_peered":"2023-08-10T10:45:37.290948+0000","last_clean":"2023-08-10T10:45:37.290948+0000","last_became_active":"2023-08-10T10:45:36.154053+0000","last_became_peered":"2023-08-10T10:45:36.154053+0000","last_unstale":"2023-08-10T10:45:37.290948+0000","last_undegraded":"2023-08-10T10:45:37.290948+0000","last_fullsized":"2023-08-10T10:45:37.290948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:31.080416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291689+0000","last_change":"2023-08-10T10:45:36.150040+0000","last_active":"2023-08-10T10:45:37.291689+0000","last_peered":"2023-08-10T10:45:37.291689+0000","last_clean":"2023-08-10T10:45:37.291689+0000","last_became_active":"2023-08-10T10:45:36.149730+0000","last_became_peered":"2023-08-10T10:45:36.149730+0000","last_unstale":"2023-08-10T10:45:37.291689+0000","last_undegraded":"2023-08-10T10:45:37.291689+0000","last_fullsized":"2023-08-10T10:45:37.291689+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:51:37.387622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916226+0000","last_change":"2023-08-10T10:45:36.153792+0000","last_active":"2023-08-10T10:45:37.916226+0000","last_peered":"2023-08-10T10:45:37.916226+0000","last_clean":"2023-08-10T10:45:37.916226+0000","last_became_active":"2023-08-10T10:45:36.153542+0000","last_became_peered":"2023-08-10T10:45:36.153542+0000","last_unstale":"2023-08-10T10:45:37.916226+0000","last_undegraded":"2023-08-10T10:45:37.916226+0000","last_fullsized":"2023-08-10T10:45:37.916226+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:40.824534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292444+0000","last_change":"2023-08-10T10:45:36.156179+0000","last_active":"2023-08-10T10:45:37.292444+0000","last_peered":"2023-08-10T10:45:37.292444+0000","last_clean":"2023-08-10T10:45:37.292444+0000","last_became_active":"2023-08-10T10:45:36.155437+0000","last_became_peered":"2023-08-10T10:45:36.155437+0000","last_unstale":"2023-08-10T10:45:37.292444+0000","last_undegraded":"2023-08-10T10:45:37.292444+0000","last_fullsized":"2023-08-10T10:45:37.292444+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:16.511975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915246+0000","last_change":"2023-08-10T10:45:36.159118+0000","last_active":"2023-08-10T10:45:37.915246+0000","last_peered":"2023-08-10T10:45:37.915246+0000","last_clean":"2023-08-10T10:45:37.915246+0000","last_became_active":"2023-08-10T10:45:36.158160+0000","last_became_peered":"2023-08-10T10:45:36.158160+0000","last_unstale":"2023-08-10T10:45:37.915246+0000","last_undegraded":"2023-08-10T10:45:37.915246+0000","last_fullsized":"2023-08-10T10:45:37.915246+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:03.751551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129464+0000","last_change":"2023-08-10T10:45:36.158436+0000","last_active":"2023-08-10T10:45:37.129464+0000","last_peered":"2023-08-10T10:45:37.129464+0000","last_clean":"2023-08-10T10:45:37.129464+0000","last_became_active":"2023-08-10T10:45:36.156649+0000","last_became_peered":"2023-08-10T10:45:36.156649+0000","last_unstale":"2023-08-10T10:45:37.129464+0000","last_undegraded":"2023-08-10T10:45:37.129464+0000","last_fullsized":"2023-08-10T10:45:37.129464+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:14.163816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128066+0000","last_change":"2023-08-10T10:45:36.145934+0000","last_active":"2023-08-10T10:45:37.128066+0000","last_peered":"2023-08-10T10:45:37.128066+0000","last_clean":"2023-08-10T10:45:37.128066+0000","last_became_active":"2023-08-10T10:45:36.145113+0000","last_became_peered":"2023-08-10T10:45:36.145113+0000","last_unstale":"2023-08-10T10:45:37.128066+0000","last_undegraded":"2023-08-10T10:45:37.128066+0000","last_fullsized":"2023-08-10T10:45:37.128066+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:17:03.614477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126318+0000","last_change":"2023-08-10T10:45:36.151000+0000","last_active":"2023-08-10T10:45:37.126318+0000","last_peered":"2023-08-10T10:45:37.126318+0000","last_clean":"2023-08-10T10:45:37.126318+0000","last_became_active":"2023-08-10T10:45:36.150613+0000","last_became_peered":"2023-08-10T10:45:36.150613+0000","last_unstale":"2023-08-10T10:45:37.126318+0000","last_undegraded":"2023-08-10T10:45:37.126318+0000","last_fullsized":"2023-08-10T10:45:37.126318+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:57.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915642+0000","last_change":"2023-08-10T10:45:36.153026+0000","last_active":"2023-08-10T10:45:37.915642+0000","last_peered":"2023-08-10T10:45:37.915642+0000","last_clean":"2023-08-10T10:45:37.915642+0000","last_became_active":"2023-08-10T10:45:36.152756+0000","last_became_peered":"2023-08-10T10:45:36.152756+0000","last_unstale":"2023-08-10T10:45:37.915642+0000","last_undegraded":"2023-08-10T10:45:37.915642+0000","last_fullsized":"2023-08-10T10:45:37.915642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.577999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.125976+0000","last_change":"2023-08-10T10:45:36.145731+0000","last_active":"2023-08-10T10:45:37.125976+0000","last_peered":"2023-08-10T10:45:37.125976+0000","last_clean":"2023-08-10T10:45:37.125976+0000","last_became_active":"2023-08-10T10:45:36.145466+0000","last_became_peered":"2023-08-10T10:45:36.145466+0000","last_unstale":"2023-08-10T10:45:37.125976+0000","last_undegraded":"2023-08-10T10:45:37.125976+0000","last_fullsized":"2023-08-10T10:45:37.125976+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:12.358886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129818+0000","last_change":"2023-08-10T10:45:36.158900+0000","last_active":"2023-08-10T10:45:37.129818+0000","last_peered":"2023-08-10T10:45:37.129818+0000","last_clean":"2023-08-10T10:45:37.129818+0000","last_became_active":"2023-08-10T10:45:36.157828+0000","last_became_peered":"2023-08-10T10:45:36.157828+0000","last_unstale":"2023-08-10T10:45:37.129818+0000","last_undegraded":"2023-08-10T10:45:37.129818+0000","last_fullsized":"2023-08-10T10:45:37.129818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:41.858698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129552+0000","last_change":"2023-08-10T10:45:36.157535+0000","last_active":"2023-08-10T10:45:37.129552+0000","last_peered":"2023-08-10T10:45:37.129552+0000","last_clean":"2023-08-10T10:45:37.129552+0000","last_became_active":"2023-08-10T10:45:36.157072+0000","last_became_peered":"2023-08-10T10:45:36.157072+0000","last_unstale":"2023-08-10T10:45:37.129552+0000","last_undegraded":"2023-08-10T10:45:37.129552+0000","last_fullsized":"2023-08-10T10:45:37.129552+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:47:58.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290433+0000","last_change":"2023-08-10T10:45:36.158719+0000","last_active":"2023-08-10T10:45:37.290433+0000","last_peered":"2023-08-10T10:45:37.290433+0000","last_clean":"2023-08-10T10:45:37.290433+0000","last_became_active":"2023-08-10T10:45:36.157578+0000","last_became_peered":"2023-08-10T10:45:36.157578+0000","last_unstale":"2023-08-10T10:45:37.290433+0000","last_undegraded":"2023-08-10T10:45:37.290433+0000","last_fullsized":"2023-08-10T10:45:37.290433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:01.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292811+0000","last_change":"2023-08-10T10:45:36.157783+0000","last_active":"2023-08-10T10:45:37.292811+0000","last_peered":"2023-08-10T10:45:37.292811+0000","last_clean":"2023-08-10T10:45:37.292811+0000","last_became_active":"2023-08-10T10:45:36.157347+0000","last_became_peered":"2023-08-10T10:45:36.157347+0000","last_unstale":"2023-08-10T10:45:37.292811+0000","last_undegraded":"2023-08-10T10:45:37.292811+0000","last_fullsized":"2023-08-10T10:45:37.292811+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:32.523380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127329+0000","last_change":"2023-08-10T10:45:36.154137+0000","last_active":"2023-08-10T10:45:37.127329+0000","last_peered":"2023-08-10T10:45:37.127329+0000","last_clean":"2023-08-10T10:45:37.127329+0000","last_became_active":"2023-08-10T10:45:36.153782+0000","last_became_peered":"2023-08-10T10:45:36.153782+0000","last_unstale":"2023-08-10T10:45:37.127329+0000","last_undegraded":"2023-08-10T10:45:37.127329+0000","last_fullsized":"2023-08-10T10:45:37.127329+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:33.871989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.130136+0000","last_change":"2023-08-10T10:45:36.158684+0000","last_active":"2023-08-10T10:45:37.130136+0000","last_peered":"2023-08-10T10:45:37.130136+0000","last_clean":"2023-08-10T10:45:37.130136+0000","last_became_active":"2023-08-10T10:45:36.157386+0000","last_became_peered":"2023-08-10T10:45:36.157386+0000","last_unstale":"2023-08-10T10:45:37.130136+0000","last_undegraded":"2023-08-10T10:45:37.130136+0000","last_fullsized":"2023-08-10T10:45:37.130136+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:26.954723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291295+0000","last_change":"2023-08-10T10:45:36.150995+0000","last_active":"2023-08-10T10:45:37.291295+0000","last_peered":"2023-08-10T10:45:37.291295+0000","last_clean":"2023-08-10T10:45:37.291295+0000","last_became_active":"2023-08-10T10:45:36.150076+0000","last_became_peered":"2023-08-10T10:45:36.150076+0000","last_unstale":"2023-08-10T10:45:37.291295+0000","last_undegraded":"2023-08-10T10:45:37.291295+0000","last_fullsized":"2023-08-10T10:45:37.291295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:21:47.407969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127904+0000","last_change":"2023-08-10T10:45:36.148748+0000","last_active":"2023-08-10T10:45:37.127904+0000","last_peered":"2023-08-10T10:45:37.127904+0000","last_clean":"2023-08-10T10:45:37.127904+0000","last_became_active":"2023-08-10T10:45:36.148382+0000","last_became_peered":"2023-08-10T10:45:36.148382+0000","last_unstale":"2023-08-10T10:45:37.127904+0000","last_undegraded":"2023-08-10T10:45:37.127904+0000","last_fullsized":"2023-08-10T10:45:37.127904+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:00.652399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917029+0000","last_change":"2023-08-10T10:45:36.159404+0000","last_active":"2023-08-10T10:45:37.917029+0000","last_peered":"2023-08-10T10:45:37.917029+0000","last_clean":"2023-08-10T10:45:37.917029+0000","last_became_active":"2023-08-10T10:45:36.158798+0000","last_became_peered":"2023-08-10T10:45:36.158798+0000","last_unstale":"2023-08-10T10:45:37.917029+0000","last_undegraded":"2023-08-10T10:45:37.917029+0000","last_fullsized":"2023-08-10T10:45:37.917029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:48.644130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"128'4","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916957+0000","last_change":"2023-08-10T10:45:35.108931+0000","last_active":"2023-08-10T10:45:37.916957+0000","last_peered":"2023-08-10T10:45:37.916957+0000","last_clean":"2023-08-10T10:45:37.916957+0000","last_became_active":"2023-08-10T10:45:35.108691+0000","last_became_peered":"2023-08-10T10:45:35.108691+0000","last_unstale":"2023-08-10T10:45:37.916957+0000","last_undegraded":"2023-08-10T10:45:37.916957+0000","last_fullsized":"2023-08-10T10:45:37.916957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:09.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128229+0000","last_change":"2023-08-10T10:45:36.141854+0000","last_active":"2023-08-10T10:45:37.128229+0000","last_peered":"2023-08-10T10:45:37.128229+0000","last_clean":"2023-08-10T10:45:37.128229+0000","last_became_active":"2023-08-10T10:45:36.141367+0000","last_became_peered":"2023-08-10T10:45:36.141367+0000","last_unstale":"2023-08-10T10:45:37.128229+0000","last_undegraded":"2023-08-10T10:45:37.128229+0000","last_fullsized":"2023-08-10T10:45:37.128229+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:56.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127628+0000","last_change":"2023-08-10T10:45:35.101198+0000","last_active":"2023-08-10T10:45:37.127628+0000","last_peered":"2023-08-10T10:45:37.127628+0000","last_clean":"2023-08-10T10:45:37.127628+0000","last_became_active":"2023-08-10T10:45:35.099918+0000","last_became_peered":"2023-08-10T10:45:35.099918+0000","last_unstale":"2023-08-10T10:45:37.127628+0000","last_undegraded":"2023-08-10T10:45:37.127628+0000","last_fullsized":"2023-08-10T10:45:37.127628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.164970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129306+0000","last_change":"2023-08-10T10:45:36.150594+0000","last_active":"2023-08-10T10:45:37.129306+0000","last_peered":"2023-08-10T10:45:37.129306+0000","last_clean":"2023-08-10T10:45:37.129306+0000","last_became_active":"2023-08-10T10:45:36.150166+0000","last_became_peered":"2023-08-10T10:45:36.150166+0000","last_unstale":"2023-08-10T10:45:37.129306+0000","last_undegraded":"2023-08-10T10:45:37.129306+0000","last_fullsized":"2023-08-10T10:45:37.129306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:53:21.181624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.130463+0000","last_change":"2023-08-10T10:45:35.103566+0000","last_active":"2023-08-10T10:45:37.130463+0000","last_peered":"2023-08-10T10:45:37.130463+0000","last_clean":"2023-08-10T10:45:37.130463+0000","last_became_active":"2023-08-10T10:45:35.103073+0000","last_became_peered":"2023-08-10T10:45:35.103073+0000","last_unstale":"2023-08-10T10:45:37.130463+0000","last_undegraded":"2023-08-10T10:45:37.130463+0000","last_fullsized":"2023-08-10T10:45:37.130463+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.604658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.289993+0000","last_change":"2023-08-10T10:45:36.152475+0000","last_active":"2023-08-10T10:45:37.289993+0000","last_peered":"2023-08-10T10:45:37.289993+0000","last_clean":"2023-08-10T10:45:37.289993+0000","last_became_active":"2023-08-10T10:45:36.152236+0000","last_became_peered":"2023-08-10T10:45:36.152236+0000","last_unstale":"2023-08-10T10:45:37.289993+0000","last_undegraded":"2023-08-10T10:45:37.289993+0000","last_fullsized":"2023-08-10T10:45:37.289993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:17.650302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126360+0000","last_change":"2023-08-10T10:45:35.092226+0000","last_active":"2023-08-10T10:45:37.126360+0000","last_peered":"2023-08-10T10:45:37.126360+0000","last_clean":"2023-08-10T10:45:37.126360+0000","last_became_active":"2023-08-10T10:45:35.091607+0000","last_became_peered":"2023-08-10T10:45:35.091607+0000","last_unstale":"2023-08-10T10:45:37.126360+0000","last_undegraded":"2023-08-10T10:45:37.126360+0000","last_fullsized":"2023-08-10T10:45:37.126360+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:02:56.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917682+0000","last_change":"2023-08-10T10:45:36.144195+0000","last_active":"2023-08-10T10:45:37.917682+0000","last_peered":"2023-08-10T10:45:37.917682+0000","last_clean":"2023-08-10T10:45:37.917682+0000","last_became_active":"2023-08-10T10:45:36.143737+0000","last_became_peered":"2023-08-10T10:45:36.143737+0000","last_unstale":"2023-08-10T10:45:37.917682+0000","last_undegraded":"2023-08-10T10:45:37.917682+0000","last_fullsized":"2023-08-10T10:45:37.917682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:40.481792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291240+0000","last_change":"2023-08-10T10:45:35.104582+0000","last_active":"2023-08-10T10:45:37.291240+0000","last_peered":"2023-08-10T10:45:37.291240+0000","last_clean":"2023-08-10T10:45:37.291240+0000","last_became_active":"2023-08-10T10:45:35.104298+0000","last_became_peered":"2023-08-10T10:45:35.104298+0000","last_unstale":"2023-08-10T10:45:37.291240+0000","last_undegraded":"2023-08-10T10:45:37.291240+0000","last_fullsized":"2023-08-10T10:45:37.291240+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:54.892974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916650+0000","last_change":"2023-08-10T10:45:36.159276+0000","last_active":"2023-08-10T10:45:37.916650+0000","last_peered":"2023-08-10T10:45:37.916650+0000","last_clean":"2023-08-10T10:45:37.916650+0000","last_became_active":"2023-08-10T10:45:36.158483+0000","last_became_peered":"2023-08-10T10:45:36.158483+0000","last_unstale":"2023-08-10T10:45:37.916650+0000","last_undegraded":"2023-08-10T10:45:37.916650+0000","last_fullsized":"2023-08-10T10:45:37.916650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:09.765646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290563+0000","last_change":"2023-08-10T10:45:35.105897+0000","last_active":"2023-08-10T10:45:37.290563+0000","last_peered":"2023-08-10T10:45:37.290563+0000","last_clean":"2023-08-10T10:45:37.290563+0000","last_became_active":"2023-08-10T10:45:35.105308+0000","last_became_peered":"2023-08-10T10:45:35.105308+0000","last_unstale":"2023-08-10T10:45:37.290563+0000","last_undegraded":"2023-08-10T10:45:37.290563+0000","last_fullsized":"2023-08-10T10:45:37.290563+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:42.663832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293173+0000","last_change":"2023-08-10T10:45:36.157598+0000","last_active":"2023-08-10T10:45:37.293173+0000","last_peered":"2023-08-10T10:45:37.293173+0000","last_clean":"2023-08-10T10:45:37.293173+0000","last_became_active":"2023-08-10T10:45:36.156991+0000","last_became_peered":"2023-08-10T10:45:36.156991+0000","last_unstale":"2023-08-10T10:45:37.293173+0000","last_undegraded":"2023-08-10T10:45:37.293173+0000","last_fullsized":"2023-08-10T10:45:37.293173+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:01.781369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129146+0000","last_change":"2023-08-10T10:45:35.101503+0000","last_active":"2023-08-10T10:45:37.129146+0000","last_peered":"2023-08-10T10:45:37.129146+0000","last_clean":"2023-08-10T10:45:37.129146+0000","last_became_active":"2023-08-10T10:45:35.100944+0000","last_became_peered":"2023-08-10T10:45:35.100944+0000","last_unstale":"2023-08-10T10:45:37.129146+0000","last_undegraded":"2023-08-10T10:45:37.129146+0000","last_fullsized":"2023-08-10T10:45:37.129146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:08.741548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917760+0000","last_change":"2023-08-10T10:45:36.145702+0000","last_active":"2023-08-10T10:45:37.917760+0000","last_peered":"2023-08-10T10:45:37.917760+0000","last_clean":"2023-08-10T10:45:37.917760+0000","last_became_active":"2023-08-10T10:45:36.145318+0000","last_became_peered":"2023-08-10T10:45:36.145318+0000","last_unstale":"2023-08-10T10:45:37.917760+0000","last_undegraded":"2023-08-10T10:45:37.917760+0000","last_fullsized":"2023-08-10T10:45:37.917760+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:38.647797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.918171+0000","last_change":"2023-08-10T10:45:35.111646+0000","last_active":"2023-08-10T10:45:37.918171+0000","last_peered":"2023-08-10T10:45:37.918171+0000","last_clean":"2023-08-10T10:45:37.918171+0000","last_became_active":"2023-08-10T10:45:35.111267+0000","last_became_peered":"2023-08-10T10:45:35.111267+0000","last_unstale":"2023-08-10T10:45:37.918171+0000","last_undegraded":"2023-08-10T10:45:37.918171+0000","last_fullsized":"2023-08-10T10:45:37.918171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:26.734183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916446+0000","last_change":"2023-08-10T10:45:36.152698+0000","last_active":"2023-08-10T10:45:37.916446+0000","last_peered":"2023-08-10T10:45:37.916446+0000","last_clean":"2023-08-10T10:45:37.916446+0000","last_became_active":"2023-08-10T10:45:36.152178+0000","last_became_peered":"2023-08-10T10:45:36.152178+0000","last_unstale":"2023-08-10T10:45:37.916446+0000","last_undegraded":"2023-08-10T10:45:37.916446+0000","last_fullsized":"2023-08-10T10:45:37.916446+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:32.037616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129751+0000","last_change":"2023-08-10T10:45:35.107368+0000","last_active":"2023-08-10T10:45:37.129751+0000","last_peered":"2023-08-10T10:45:37.129751+0000","last_clean":"2023-08-10T10:45:37.129751+0000","last_became_active":"2023-08-10T10:45:35.106393+0000","last_became_peered":"2023-08-10T10:45:35.106393+0000","last_unstale":"2023-08-10T10:45:37.129751+0000","last_undegraded":"2023-08-10T10:45:37.129751+0000","last_fullsized":"2023-08-10T10:45:37.129751+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:21:46.402523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127052+0000","last_change":"2023-08-10T10:45:36.151961+0000","last_active":"2023-08-10T10:45:37.127052+0000","last_peered":"2023-08-10T10:45:37.127052+0000","last_clean":"2023-08-10T10:45:37.127052+0000","last_became_active":"2023-08-10T10:45:36.150797+0000","last_became_peered":"2023-08-10T10:45:36.150797+0000","last_unstale":"2023-08-10T10:45:37.127052+0000","last_undegraded":"2023-08-10T10:45:37.127052+0000","last_fullsized":"2023-08-10T10:45:37.127052+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:48.264583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916600+0000","last_change":"2023-08-10T10:45:35.107081+0000","last_active":"2023-08-10T10:45:37.916600+0000","last_peered":"2023-08-10T10:45:37.916600+0000","last_clean":"2023-08-10T10:45:37.916600+0000","last_became_active":"2023-08-10T10:45:35.106785+0000","last_became_peered":"2023-08-10T10:45:35.106785+0000","last_unstale":"2023-08-10T10:45:37.916600+0000","last_undegraded":"2023-08-10T10:45:37.916600+0000","last_fullsized":"2023-08-10T10:45:37.916600+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:37:48.414837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127477+0000","last_change":"2023-08-10T10:45:36.138232+0000","last_active":"2023-08-10T10:45:37.127477+0000","last_peered":"2023-08-10T10:45:37.127477+0000","last_clean":"2023-08-10T10:45:37.127477+0000","last_became_active":"2023-08-10T10:45:36.137275+0000","last_became_peered":"2023-08-10T10:45:36.137275+0000","last_unstale":"2023-08-10T10:45:37.127477+0000","last_undegraded":"2023-08-10T10:45:37.127477+0000","last_fullsized":"2023-08-10T10:45:37.127477+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:22.899169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"128'3","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292308+0000","last_change":"2023-08-10T10:45:35.109827+0000","last_active":"2023-08-10T10:45:37.292308+0000","last_peered":"2023-08-10T10:45:37.292308+0000","last_clean":"2023-08-10T10:45:37.292308+0000","last_became_active":"2023-08-10T10:45:35.109444+0000","last_became_peered":"2023-08-10T10:45:35.109444+0000","last_unstale":"2023-08-10T10:45:37.292308+0000","last_undegraded":"2023-08-10T10:45:37.292308+0000","last_fullsized":"2023-08-10T10:45:37.292308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:24.300514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126201+0000","last_change":"2023-08-10T10:45:36.141127+0000","last_active":"2023-08-10T10:45:37.126201+0000","last_peered":"2023-08-10T10:45:37.126201+0000","last_clean":"2023-08-10T10:45:37.126201+0000","last_became_active":"2023-08-10T10:45:36.138968+0000","last_became_peered":"2023-08-10T10:45:36.138968+0000","last_unstale":"2023-08-10T10:45:37.126201+0000","last_undegraded":"2023-08-10T10:45:37.126201+0000","last_fullsized":"2023-08-10T10:45:37.126201+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:47.761985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"128'6","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291893+0000","last_change":"2023-08-10T10:45:35.110874+0000","last_active":"2023-08-10T10:45:37.291893+0000","last_peered":"2023-08-10T10:45:37.291893+0000","last_clean":"2023-08-10T10:45:37.291893+0000","last_became_active":"2023-08-10T10:45:35.110526+0000","last_became_peered":"2023-08-10T10:45:35.110526+0000","last_unstale":"2023-08-10T10:45:37.291893+0000","last_undegraded":"2023-08-10T10:45:37.291893+0000","last_fullsized":"2023-08-10T10:45:37.291893+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:40.853252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291132+0000","last_change":"2023-08-10T10:45:36.157893+0000","last_active":"2023-08-10T10:45:37.291132+0000","last_peered":"2023-08-10T10:45:37.291132+0000","last_clean":"2023-08-10T10:45:37.291132+0000","last_became_active":"2023-08-10T10:45:36.153890+0000","last_became_peered":"2023-08-10T10:45:36.153890+0000","last_unstale":"2023-08-10T10:45:37.291132+0000","last_undegraded":"2023-08-10T10:45:37.291132+0000","last_fullsized":"2023-08-10T10:45:37.291132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:35.710642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127242+0000","last_change":"2023-08-10T10:45:35.089805+0000","last_active":"2023-08-10T10:45:37.127242+0000","last_peered":"2023-08-10T10:45:37.127242+0000","last_clean":"2023-08-10T10:45:37.127242+0000","last_became_active":"2023-08-10T10:45:35.089157+0000","last_became_peered":"2023-08-10T10:45:35.089157+0000","last_unstale":"2023-08-10T10:45:37.127242+0000","last_undegraded":"2023-08-10T10:45:37.127242+0000","last_fullsized":"2023-08-10T10:45:37.127242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:10:10.502666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293822+0000","last_change":"2023-08-10T10:45:36.153395+0000","last_active":"2023-08-10T10:45:37.293822+0000","last_peered":"2023-08-10T10:45:37.293822+0000","last_clean":"2023-08-10T10:45:37.293822+0000","last_became_active":"2023-08-10T10:45:36.153085+0000","last_became_peered":"2023-08-10T10:45:36.153085+0000","last_unstale":"2023-08-10T10:45:37.293822+0000","last_undegraded":"2023-08-10T10:45:37.293822+0000","last_fullsized":"2023-08-10T10:45:37.293822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:19.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.918078+0000","last_change":"2023-08-10T10:45:35.104317+0000","last_active":"2023-08-10T10:45:37.918078+0000","last_peered":"2023-08-10T10:45:37.918078+0000","last_clean":"2023-08-10T10:45:37.918078+0000","last_became_active":"2023-08-10T10:45:35.104024+0000","last_became_peered":"2023-08-10T10:45:35.104024+0000","last_unstale":"2023-08-10T10:45:37.918078+0000","last_undegraded":"2023-08-10T10:45:37.918078+0000","last_fullsized":"2023-08-10T10:45:37.918078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.521981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127968+0000","last_change":"2023-08-10T10:45:36.151457+0000","last_active":"2023-08-10T10:45:37.127968+0000","last_peered":"2023-08-10T10:45:37.127968+0000","last_clean":"2023-08-10T10:45:37.127968+0000","last_became_active":"2023-08-10T10:45:36.150961+0000","last_became_peered":"2023-08-10T10:45:36.150961+0000","last_unstale":"2023-08-10T10:45:37.127968+0000","last_undegraded":"2023-08-10T10:45:37.127968+0000","last_fullsized":"2023-08-10T10:45:37.127968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:35.148809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128198+0000","last_change":"2023-08-10T10:45:35.105917+0000","last_active":"2023-08-10T10:45:37.128198+0000","last_peered":"2023-08-10T10:45:37.128198+0000","last_clean":"2023-08-10T10:45:37.128198+0000","last_became_active":"2023-08-10T10:45:35.102617+0000","last_became_peered":"2023-08-10T10:45:35.102617+0000","last_unstale":"2023-08-10T10:45:37.128198+0000","last_undegraded":"2023-08-10T10:45:37.128198+0000","last_fullsized":"2023-08-10T10:45:37.128198+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:50:42.214826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916257+0000","last_change":"2023-08-10T10:45:36.152705+0000","last_active":"2023-08-10T10:45:37.916257+0000","last_peered":"2023-08-10T10:45:37.916257+0000","last_clean":"2023-08-10T10:45:37.916257+0000","last_became_active":"2023-08-10T10:45:36.152402+0000","last_became_peered":"2023-08-10T10:45:36.152402+0000","last_unstale":"2023-08-10T10:45:37.916257+0000","last_undegraded":"2023-08-10T10:45:37.916257+0000","last_fullsized":"2023-08-10T10:45:37.916257+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:36.396232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"128'8","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128427+0000","last_change":"2023-08-10T10:45:35.104573+0000","last_active":"2023-08-10T10:45:37.128427+0000","last_peered":"2023-08-10T10:45:37.128427+0000","last_clean":"2023-08-10T10:45:37.128427+0000","last_became_active":"2023-08-10T10:45:35.102845+0000","last_became_peered":"2023-08-10T10:45:35.102845+0000","last_unstale":"2023-08-10T10:45:37.128427+0000","last_undegraded":"2023-08-10T10:45:37.128427+0000","last_fullsized":"2023-08-10T10:45:37.128427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:37.642352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916894+0000","last_change":"2023-08-10T10:45:36.143199+0000","last_active":"2023-08-10T10:45:37.916894+0000","last_peered":"2023-08-10T10:45:37.916894+0000","last_clean":"2023-08-10T10:45:37.916894+0000","last_became_active":"2023-08-10T10:45:36.142861+0000","last_became_peered":"2023-08-10T10:45:36.142861+0000","last_unstale":"2023-08-10T10:45:37.916894+0000","last_undegraded":"2023-08-10T10:45:37.916894+0000","last_fullsized":"2023-08-10T10:45:37.916894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:54:24.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126496+0000","last_change":"2023-08-10T10:45:35.095221+0000","last_active":"2023-08-10T10:45:37.126496+0000","last_peered":"2023-08-10T10:45:37.126496+0000","last_clean":"2023-08-10T10:45:37.126496+0000","last_became_active":"2023-08-10T10:45:35.094592+0000","last_became_peered":"2023-08-10T10:45:35.094592+0000","last_unstale":"2023-08-10T10:45:37.126496+0000","last_undegraded":"2023-08-10T10:45:37.126496+0000","last_fullsized":"2023-08-10T10:45:37.126496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:59.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128717+0000","last_change":"2023-08-10T10:45:36.143321+0000","last_active":"2023-08-10T10:45:37.128717+0000","last_peered":"2023-08-10T10:45:37.128717+0000","last_clean":"2023-08-10T10:45:37.128717+0000","last_became_active":"2023-08-10T10:45:36.142828+0000","last_became_peered":"2023-08-10T10:45:36.142828+0000","last_unstale":"2023-08-10T10:45:37.128717+0000","last_undegraded":"2023-08-10T10:45:37.128717+0000","last_fullsized":"2023-08-10T10:45:37.128717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:50.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916977+0000","last_change":"2023-08-10T10:45:35.108271+0000","last_active":"2023-08-10T10:45:37.916977+0000","last_peered":"2023-08-10T10:45:37.916977+0000","last_clean":"2023-08-10T10:45:37.916977+0000","last_became_active":"2023-08-10T10:45:35.107916+0000","last_became_peered":"2023-08-10T10:45:35.107916+0000","last_unstale":"2023-08-10T10:45:37.916977+0000","last_undegraded":"2023-08-10T10:45:37.916977+0000","last_fullsized":"2023-08-10T10:45:37.916977+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:49.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916629+0000","last_change":"2023-08-10T10:45:36.157492+0000","last_active":"2023-08-10T10:45:37.916629+0000","last_peered":"2023-08-10T10:45:37.916629+0000","last_clean":"2023-08-10T10:45:37.916629+0000","last_became_active":"2023-08-10T10:45:36.157233+0000","last_became_peered":"2023-08-10T10:45:36.157233+0000","last_unstale":"2023-08-10T10:45:37.916629+0000","last_undegraded":"2023-08-10T10:45:37.916629+0000","last_fullsized":"2023-08-10T10:45:37.916629+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:07.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292588+0000","last_change":"2023-08-10T10:45:35.109973+0000","last_active":"2023-08-10T10:45:37.292588+0000","last_peered":"2023-08-10T10:45:37.292588+0000","last_clean":"2023-08-10T10:45:37.292588+0000","last_became_active":"2023-08-10T10:45:35.109528+0000","last_became_peered":"2023-08-10T10:45:35.109528+0000","last_unstale":"2023-08-10T10:45:37.292588+0000","last_undegraded":"2023-08-10T10:45:37.292588+0000","last_fullsized":"2023-08-10T10:45:37.292588+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:56:36.886488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290089+0000","last_change":"2023-08-10T10:45:36.152351+0000","last_active":"2023-08-10T10:45:37.290089+0000","last_peered":"2023-08-10T10:45:37.290089+0000","last_clean":"2023-08-10T10:45:37.290089+0000","last_became_active":"2023-08-10T10:45:36.150114+0000","last_became_peered":"2023-08-10T10:45:36.150114+0000","last_unstale":"2023-08-10T10:45:37.290089+0000","last_undegraded":"2023-08-10T10:45:37.290089+0000","last_fullsized":"2023-08-10T10:45:37.290089+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:43:21.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127397+0000","last_change":"2023-08-10T10:45:35.111126+0000","last_active":"2023-08-10T10:45:37.127397+0000","last_peered":"2023-08-10T10:45:37.127397+0000","last_clean":"2023-08-10T10:45:37.127397+0000","last_became_active":"2023-08-10T10:45:35.109868+0000","last_became_peered":"2023-08-10T10:45:35.109868+0000","last_unstale":"2023-08-10T10:45:37.127397+0000","last_undegraded":"2023-08-10T10:45:37.127397+0000","last_fullsized":"2023-08-10T10:45:37.127397+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:06:47.676240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127919+0000","last_change":"2023-08-10T10:45:36.149107+0000","last_active":"2023-08-10T10:45:37.127919+0000","last_peered":"2023-08-10T10:45:37.127919+0000","last_clean":"2023-08-10T10:45:37.127919+0000","last_became_active":"2023-08-10T10:45:36.148469+0000","last_became_peered":"2023-08-10T10:45:36.148469+0000","last_unstale":"2023-08-10T10:45:37.127919+0000","last_undegraded":"2023-08-10T10:45:37.127919+0000","last_fullsized":"2023-08-10T10:45:37.127919+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:47.393733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129910+0000","last_change":"2023-08-10T10:45:35.108837+0000","last_active":"2023-08-10T10:45:37.129910+0000","last_peered":"2023-08-10T10:45:37.129910+0000","last_clean":"2023-08-10T10:45:37.129910+0000","last_became_active":"2023-08-10T10:45:35.108237+0000","last_became_peered":"2023-08-10T10:45:35.108237+0000","last_unstale":"2023-08-10T10:45:37.129910+0000","last_undegraded":"2023-08-10T10:45:37.129910+0000","last_fullsized":"2023-08-10T10:45:37.129910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:23.419725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127780+0000","last_change":"2023-08-10T10:45:36.152804+0000","last_active":"2023-08-10T10:45:37.127780+0000","last_peered":"2023-08-10T10:45:37.127780+0000","last_clean":"2023-08-10T10:45:37.127780+0000","last_became_active":"2023-08-10T10:45:36.152461+0000","last_became_peered":"2023-08-10T10:45:36.152461+0000","last_unstale":"2023-08-10T10:45:37.127780+0000","last_undegraded":"2023-08-10T10:45:37.127780+0000","last_fullsized":"2023-08-10T10:45:37.127780+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:41:37.601492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128373+0000","last_change":"2023-08-10T10:45:35.106383+0000","last_active":"2023-08-10T10:45:37.128373+0000","last_peered":"2023-08-10T10:45:37.128373+0000","last_clean":"2023-08-10T10:45:37.128373+0000","last_became_active":"2023-08-10T10:45:35.103458+0000","last_became_peered":"2023-08-10T10:45:35.103458+0000","last_unstale":"2023-08-10T10:45:37.128373+0000","last_undegraded":"2023-08-10T10:45:37.128373+0000","last_fullsized":"2023-08-10T10:45:37.128373+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:42:12.406802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293020+0000","last_change":"2023-08-10T10:45:36.155050+0000","last_active":"2023-08-10T10:45:37.293020+0000","last_peered":"2023-08-10T10:45:37.293020+0000","last_clean":"2023-08-10T10:45:37.293020+0000","last_became_active":"2023-08-10T10:45:36.154617+0000","last_became_peered":"2023-08-10T10:45:36.154617+0000","last_unstale":"2023-08-10T10:45:37.293020+0000","last_undegraded":"2023-08-10T10:45:37.293020+0000","last_fullsized":"2023-08-10T10:45:37.293020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:47.296207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293494+0000","last_change":"2023-08-10T10:45:35.110725+0000","last_active":"2023-08-10T10:45:37.293494+0000","last_peered":"2023-08-10T10:45:37.293494+0000","last_clean":"2023-08-10T10:45:37.293494+0000","last_became_active":"2023-08-10T10:45:35.110269+0000","last_became_peered":"2023-08-10T10:45:35.110269+0000","last_unstale":"2023-08-10T10:45:37.293494+0000","last_undegraded":"2023-08-10T10:45:37.293494+0000","last_fullsized":"2023-08-10T10:45:37.293494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:25.854225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290248+0000","last_change":"2023-08-10T10:45:36.153424+0000","last_active":"2023-08-10T10:45:37.290248+0000","last_peered":"2023-08-10T10:45:37.290248+0000","last_clean":"2023-08-10T10:45:37.290248+0000","last_became_active":"2023-08-10T10:45:36.153096+0000","last_became_peered":"2023-08-10T10:45:36.153096+0000","last_unstale":"2023-08-10T10:45:37.290248+0000","last_undegraded":"2023-08-10T10:45:37.290248+0000","last_fullsized":"2023-08-10T10:45:37.290248+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:55.231350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127883+0000","last_change":"2023-08-10T10:45:35.100887+0000","last_active":"2023-08-10T10:45:37.127883+0000","last_peered":"2023-08-10T10:45:37.127883+0000","last_clean":"2023-08-10T10:45:37.127883+0000","last_became_active":"2023-08-10T10:45:35.099095+0000","last_became_peered":"2023-08-10T10:45:35.099095+0000","last_unstale":"2023-08-10T10:45:37.127883+0000","last_undegraded":"2023-08-10T10:45:37.127883+0000","last_fullsized":"2023-08-10T10:45:37.127883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:23.281542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290804+0000","last_change":"2023-08-10T10:45:36.158960+0000","last_active":"2023-08-10T10:45:37.290804+0000","last_peered":"2023-08-10T10:45:37.290804+0000","last_clean":"2023-08-10T10:45:37.290804+0000","last_became_active":"2023-08-10T10:45:36.158279+0000","last_became_peered":"2023-08-10T10:45:36.158279+0000","last_unstale":"2023-08-10T10:45:37.290804+0000","last_undegraded":"2023-08-10T10:45:37.290804+0000","last_fullsized":"2023-08-10T10:45:37.290804+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:59:27.826583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128267+0000","last_change":"2023-08-10T10:45:35.109626+0000","last_active":"2023-08-10T10:45:37.128267+0000","last_peered":"2023-08-10T10:45:37.128267+0000","last_clean":"2023-08-10T10:45:37.128267+0000","last_became_active":"2023-08-10T10:45:35.109093+0000","last_became_peered":"2023-08-10T10:45:35.109093+0000","last_unstale":"2023-08-10T10:45:37.128267+0000","last_undegraded":"2023-08-10T10:45:37.128267+0000","last_fullsized":"2023-08-10T10:45:37.128267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:26:11.918564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":360,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293239+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:45:37.293239+0000","last_peered":"2023-08-10T10:45:37.293239+0000","last_clean":"2023-08-10T10:45:37.293239+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:45:37.293239+0000","last_undegraded":"2023-08-10T10:45:37.293239+0000","last_fullsized":"2023-08-10T10:45:37.293239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:41:22.536775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":220,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290691+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:45:37.290691+0000","last_peered":"2023-08-10T10:45:37.290691+0000","last_clean":"2023-08-10T10:45:37.290691+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:45:37.290691+0000","last_undegraded":"2023-08-10T10:45:37.290691+0000","last_fullsized":"2023-08-10T10:45:37.290691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:47.471623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293272+0000","last_change":"2023-08-10T10:45:36.150826+0000","last_active":"2023-08-10T10:45:37.293272+0000","last_peered":"2023-08-10T10:45:37.293272+0000","last_clean":"2023-08-10T10:45:37.293272+0000","last_became_active":"2023-08-10T10:45:36.149649+0000","last_became_peered":"2023-08-10T10:45:36.149649+0000","last_unstale":"2023-08-10T10:45:37.293272+0000","last_undegraded":"2023-08-10T10:45:37.293272+0000","last_fullsized":"2023-08-10T10:45:37.293272+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:04.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292049+0000","last_change":"2023-08-10T10:45:35.106725+0000","last_active":"2023-08-10T10:45:37.292049+0000","last_peered":"2023-08-10T10:45:37.292049+0000","last_clean":"2023-08-10T10:45:37.292049+0000","last_became_active":"2023-08-10T10:45:35.106420+0000","last_became_peered":"2023-08-10T10:45:35.106420+0000","last_unstale":"2023-08-10T10:45:37.292049+0000","last_undegraded":"2023-08-10T10:45:37.292049+0000","last_fullsized":"2023-08-10T10:45:37.292049+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:51.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292561+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:45:37.292561+0000","last_peered":"2023-08-10T10:45:37.292561+0000","last_clean":"2023-08-10T10:45:37.292561+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:45:37.292561+0000","last_undegraded":"2023-08-10T10:45:37.292561+0000","last_fullsized":"2023-08-10T10:45:37.292561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:45.430896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126695+0000","last_change":"2023-08-10T10:45:36.152125+0000","last_active":"2023-08-10T10:45:37.126695+0000","last_peered":"2023-08-10T10:45:37.126695+0000","last_clean":"2023-08-10T10:45:37.126695+0000","last_became_active":"2023-08-10T10:45:36.151361+0000","last_became_peered":"2023-08-10T10:45:36.151361+0000","last_unstale":"2023-08-10T10:45:37.126695+0000","last_undegraded":"2023-08-10T10:45:37.126695+0000","last_fullsized":"2023-08-10T10:45:37.126695+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:31.418841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291414+0000","last_change":"2023-08-10T10:45:35.109751+0000","last_active":"2023-08-10T10:45:37.291414+0000","last_peered":"2023-08-10T10:45:37.291414+0000","last_clean":"2023-08-10T10:45:37.291414+0000","last_became_active":"2023-08-10T10:45:35.109401+0000","last_became_peered":"2023-08-10T10:45:35.109401+0000","last_unstale":"2023-08-10T10:45:37.291414+0000","last_undegraded":"2023-08-10T10:45:37.291414+0000","last_fullsized":"2023-08-10T10:45:37.291414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:00:12.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128515+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:45:37.128515+0000","last_peered":"2023-08-10T10:45:37.128515+0000","last_clean":"2023-08-10T10:45:37.128515+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:45:37.128515+0000","last_undegraded":"2023-08-10T10:45:37.128515+0000","last_fullsized":"2023-08-10T10:45:37.128515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:51.187867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128017+0000","last_change":"2023-08-10T10:45:36.142449+0000","last_active":"2023-08-10T10:45:37.128017+0000","last_peered":"2023-08-10T10:45:37.128017+0000","last_clean":"2023-08-10T10:45:37.128017+0000","last_became_active":"2023-08-10T10:45:36.142150+0000","last_became_peered":"2023-08-10T10:45:36.142150+0000","last_unstale":"2023-08-10T10:45:37.128017+0000","last_undegraded":"2023-08-10T10:45:37.128017+0000","last_fullsized":"2023-08-10T10:45:37.128017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:21.601994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292422+0000","last_change":"2023-08-10T10:45:35.109807+0000","last_active":"2023-08-10T10:45:37.292422+0000","last_peered":"2023-08-10T10:45:37.292422+0000","last_clean":"2023-08-10T10:45:37.292422+0000","last_became_active":"2023-08-10T10:45:35.108966+0000","last_became_peered":"2023-08-10T10:45:35.108966+0000","last_unstale":"2023-08-10T10:45:37.292422+0000","last_undegraded":"2023-08-10T10:45:37.292422+0000","last_fullsized":"2023-08-10T10:45:37.292422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.604658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":220,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291619+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:45:37.291619+0000","last_peered":"2023-08-10T10:45:37.291619+0000","last_clean":"2023-08-10T10:45:37.291619+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:45:37.291619+0000","last_undegraded":"2023-08-10T10:45:37.291619+0000","last_fullsized":"2023-08-10T10:45:37.291619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:37.304749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917137+0000","last_change":"2023-08-10T10:45:36.154151+0000","last_active":"2023-08-10T10:45:37.917137+0000","last_peered":"2023-08-10T10:45:37.917137+0000","last_clean":"2023-08-10T10:45:37.917137+0000","last_became_active":"2023-08-10T10:45:36.153872+0000","last_became_peered":"2023-08-10T10:45:36.153872+0000","last_unstale":"2023-08-10T10:45:37.917137+0000","last_undegraded":"2023-08-10T10:45:37.917137+0000","last_fullsized":"2023-08-10T10:45:37.917137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:25.580631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293574+0000","last_change":"2023-08-10T10:45:35.111422+0000","last_active":"2023-08-10T10:45:37.293574+0000","last_peered":"2023-08-10T10:45:37.293574+0000","last_clean":"2023-08-10T10:45:37.293574+0000","last_became_active":"2023-08-10T10:45:35.111195+0000","last_became_peered":"2023-08-10T10:45:35.111195+0000","last_unstale":"2023-08-10T10:45:37.293574+0000","last_undegraded":"2023-08-10T10:45:37.293574+0000","last_fullsized":"2023-08-10T10:45:37.293574+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:38.464316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":224,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127597+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:45:37.127597+0000","last_peered":"2023-08-10T10:45:37.127597+0000","last_clean":"2023-08-10T10:45:37.127597+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:45:37.127597+0000","last_undegraded":"2023-08-10T10:45:37.127597+0000","last_fullsized":"2023-08-10T10:45:37.127597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:51.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128216+0000","last_change":"2023-08-10T10:45:36.149282+0000","last_active":"2023-08-10T10:45:37.128216+0000","last_peered":"2023-08-10T10:45:37.128216+0000","last_clean":"2023-08-10T10:45:37.128216+0000","last_became_active":"2023-08-10T10:45:36.148862+0000","last_became_peered":"2023-08-10T10:45:36.148862+0000","last_unstale":"2023-08-10T10:45:37.128216+0000","last_undegraded":"2023-08-10T10:45:37.128216+0000","last_fullsized":"2023-08-10T10:45:37.128216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:50:38.076668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128343+0000","last_change":"2023-08-10T10:45:35.105931+0000","last_active":"2023-08-10T10:45:37.128343+0000","last_peered":"2023-08-10T10:45:37.128343+0000","last_clean":"2023-08-10T10:45:37.128343+0000","last_became_active":"2023-08-10T10:45:35.105011+0000","last_became_peered":"2023-08-10T10:45:35.105011+0000","last_unstale":"2023-08-10T10:45:37.128343+0000","last_undegraded":"2023-08-10T10:45:37.128343+0000","last_fullsized":"2023-08-10T10:45:37.128343+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:44.576481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292286+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:45:37.292286+0000","last_peered":"2023-08-10T10:45:37.292286+0000","last_clean":"2023-08-10T10:45:37.292286+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:45:37.292286+0000","last_undegraded":"2023-08-10T10:45:37.292286+0000","last_fullsized":"2023-08-10T10:45:37.292286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:10.051636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915900+0000","last_change":"2023-08-10T10:45:36.149558+0000","last_active":"2023-08-10T10:45:37.915900+0000","last_peered":"2023-08-10T10:45:37.915900+0000","last_clean":"2023-08-10T10:45:37.915900+0000","last_became_active":"2023-08-10T10:45:36.149281+0000","last_became_peered":"2023-08-10T10:45:36.149281+0000","last_unstale":"2023-08-10T10:45:37.915900+0000","last_undegraded":"2023-08-10T10:45:37.915900+0000","last_fullsized":"2023-08-10T10:45:37.915900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:20.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128404+0000","last_change":"2023-08-10T10:45:35.107217+0000","last_active":"2023-08-10T10:45:37.128404+0000","last_peered":"2023-08-10T10:45:37.128404+0000","last_clean":"2023-08-10T10:45:37.128404+0000","last_became_active":"2023-08-10T10:45:35.106901+0000","last_became_peered":"2023-08-10T10:45:35.106901+0000","last_unstale":"2023-08-10T10:45:37.128404+0000","last_undegraded":"2023-08-10T10:45:37.128404+0000","last_fullsized":"2023-08-10T10:45:37.128404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:31.473584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":224,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126408+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:45:37.126408+0000","last_peered":"2023-08-10T10:45:37.126408+0000","last_clean":"2023-08-10T10:45:37.126408+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:45:37.126408+0000","last_undegraded":"2023-08-10T10:45:37.126408+0000","last_fullsized":"2023-08-10T10:45:37.126408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:13.787883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915994+0000","last_change":"2023-08-10T10:45:36.145752+0000","last_active":"2023-08-10T10:45:37.915994+0000","last_peered":"2023-08-10T10:45:37.915994+0000","last_clean":"2023-08-10T10:45:37.915994+0000","last_became_active":"2023-08-10T10:45:36.145414+0000","last_became_peered":"2023-08-10T10:45:36.145414+0000","last_unstale":"2023-08-10T10:45:37.915994+0000","last_undegraded":"2023-08-10T10:45:37.915994+0000","last_fullsized":"2023-08-10T10:45:37.915994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:33.706110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127756+0000","last_change":"2023-08-10T10:45:35.097554+0000","last_active":"2023-08-10T10:45:37.127756+0000","last_peered":"2023-08-10T10:45:37.127756+0000","last_clean":"2023-08-10T10:45:37.127756+0000","last_became_active":"2023-08-10T10:45:35.096878+0000","last_became_peered":"2023-08-10T10:45:35.096878+0000","last_unstale":"2023-08-10T10:45:37.127756+0000","last_undegraded":"2023-08-10T10:45:37.127756+0000","last_fullsized":"2023-08-10T10:45:37.127756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:28.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293033+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:45:37.293033+0000","last_peered":"2023-08-10T10:45:37.293033+0000","last_clean":"2023-08-10T10:45:37.293033+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:45:37.293033+0000","last_undegraded":"2023-08-10T10:45:37.293033+0000","last_fullsized":"2023-08-10T10:45:37.293033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:17.539757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1321,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193990,"statfs":{"total":200000000,"available":198646357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1000000000000001,"15min":1.1279999999999999},"min":{"1min":0.57999999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":4.4550000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.0840000000000001},"min":{"1min":0.58999999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":5.149,"15min":5.149},"last":7.3570000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.173,"15min":1.1419999999999999},"min":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":4.6470000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.1519999999999999,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":8.0830000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.196,"15min":1.2170000000000001},"min":{"1min":0.70199999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5229999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":7.4329999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":4.5700000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.21,"15min":1.212},"min":{"1min":0.76300000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.556,"5min":1.766,"15min":1.766},"last":6.5190000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.98599999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":6.069}]},{"osd":4,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.26,"15min":1.236},"min":{"1min":0.85399999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.825,"5min":1.99,"15min":1.99},"last":7.1950000000000003},{"interface":"front","average":{"1min":1.278,"5min":1.3089999999999999,"15min":1.2729999999999999},"min":{"1min":0.755,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.74,"5min":6.657,"15min":6.657},"last":7.4950000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.1659999999999999,"5min":0.60599999999999998,"15min":0.59699999999999998},"max":{"1min":3.3940000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":6.0090000000000003},{"interface":"front","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.488},"min":{"1min":0.95599999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0699999999999998,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":7.5529999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5349999999999999,"15min":1.5740000000000001},"min":{"1min":1.238,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.3140000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":8.859},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.484,"15min":1.4970000000000001},"min":{"1min":1.077,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0099999999999998,"5min":3.585,"15min":3.585},"last":7.1139999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199234717,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.113,"15min":1.0589999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6279999999999999,"5min":1.75,"15min":1.7509999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.01},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.46600000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":1.2509999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1140000000000001,"15min":1.069},"min":{"1min":0.72399999999999998,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.302,"15min":2.302},"last":1.355},{"interface":"front","average":{"1min":1.234,"5min":1.256,"15min":1.1830000000000001},"min":{"1min":0.83899999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.819,"5min":2.052,"15min":2.052},"last":2.052}]},{"osd":2,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.198,"15min":1.139},"min":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.72299999999999998},"max":{"1min":1.7230000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.476},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2749999999999999,"15min":1.2270000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6339999999999999,"5min":1.968,"15min":1.968},"last":1.429}]},{"osd":3,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3460000000000001,"15min":1.228},"min":{"1min":0.80700000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6719999999999999,"5min":3.177,"15min":3.177},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.321,"15min":1.262},"min":{"1min":0.84299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.71,"5min":2.395,"15min":2.395},"last":1.718}]},{"osd":4,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2829999999999999,"15min":1.214},"min":{"1min":0.60699999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.7010000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.494,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":2.0009999999999999,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.9670000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.478,"15min":1.407},"min":{"1min":0.69999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.802,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5760000000000001,"15min":1.4990000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":2.1139999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.867}]},{"osd":7,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.429,"15min":1.371},"min":{"1min":1.0089999999999999,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":2.0600000000000001,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5589999999999999,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.016,"5min":2.5819999999999999,"15min":2.698},"last":1.7549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194568,"statfs":{"total":200000000,"available":199237904,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1339999999999999,"15min":1.0920000000000001},"min":{"1min":0.73299999999999998,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":2.5070000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.4790000000000001,"15min":1.214},"min":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.64000000000000001},"max":{"1min":1.6899999999999999,"5min":32.941000000000003,"15min":32.941000000000003},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.68899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.762,"5min":1.762,"15min":2.2450000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.165,"15min":1.208},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.651,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.635}]},{"osd":2,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.24,"15min":1.323},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.857,"5min":1.857,"15min":4.1980000000000004},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.1950000000000001,"15min":1.159},"min":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5920000000000001,"5min":1.653,"15min":1.73},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.26},"min":{"1min":0.81899999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7410000000000001,"5min":1.7669999999999999,"15min":1.7709999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3080000000000001,"15min":1.363},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.8120000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.2310000000000001,"15min":1.2869999999999999},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3660000000000001,"15min":1.3600000000000001},"min":{"1min":0.85299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7689999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5149999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3879999999999999,"15min":1.3280000000000001},"min":{"1min":0.80200000000000005,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":2.04},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3979999999999999,"15min":1.387},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":1.9650000000000001,"15min":1.98},"last":1.6699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4830000000000001,"15min":1.488},"min":{"1min":0.90400000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.831,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.498,"15min":1.4910000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.893}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":2.2559999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.538,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.286},"min":{"1min":0.93100000000000005,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.7809999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.159,"15min":1.141},"min":{"1min":0.747,"5min":0.67900000000000005,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.4950000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2050000000000001,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.66000000000000003,"15min":0.621},"max":{"1min":1.48,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.347,"15min":1.304},"min":{"1min":1.083,"5min":0.85099999999999998,"15min":0.70499999999999996},"max":{"1min":1.835,"5min":4.226,"15min":4.226},"last":1.538}]},{"osd":3,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3069999999999999,"15min":1.256},"min":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.893,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.554},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3700000000000001,"15min":1.2909999999999999},"min":{"1min":0.91500000000000004,"5min":0.82699999999999996,"15min":0.67000000000000004},"max":{"1min":2.5600000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.577}]},{"osd":5,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.385,"15min":1.363},"min":{"1min":0.876,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":1.863,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.024},{"interface":"front","average":{"1min":1.252,"5min":1.3340000000000001,"15min":1.298},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.42399999999999999},"max":{"1min":1.6859999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.389}]},{"osd":6,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.375,"15min":1.335},"min":{"1min":0.746,"5min":0.746,"15min":0.47599999999999998},"max":{"1min":2.6190000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.228},{"interface":"front","average":{"1min":1.425,"5min":1.5429999999999999,"15min":1.4790000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.76700000000000002},"max":{"1min":1.7529999999999999,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.169}]},{"osd":7,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.502,"15min":1.4339999999999999},"min":{"1min":0.999,"5min":0.82699999999999996,"15min":0.57999999999999996},"max":{"1min":1.8859999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.611},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5880000000000001,"15min":1.5189999999999999},"min":{"1min":1.054,"5min":0.96699999999999997,"15min":0.73499999999999999},"max":{"1min":2.6659999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.728}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242956,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92500000000000004,"15min":0.83099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.6060000000000001,"5min":1.8140000000000001,"15min":2.1019999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.145,"15min":0.98799999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.9590000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93700000000000006,"15min":0.83899999999999997},"min":{"1min":0.54500000000000004,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.353,"5min":1.5569999999999999,"15min":1.6599999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0649999999999999,"15min":0.93999999999999995},"min":{"1min":0.54100000000000004,"5min":0.51100000000000001,"15min":0.34100000000000003},"max":{"1min":1.587,"5min":1.752,"15min":1.897},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0229999999999999,"15min":0.94099999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.181,"15min":1.069},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.46899999999999997},"max":{"1min":1.5309999999999999,"5min":1.958,"15min":2.0430000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.8169999999999999,"5min":1.427,"15min":1.264},"min":{"1min":0.86699999999999999,"5min":0.78200000000000003,"15min":0.70599999999999996},"max":{"1min":9.8149999999999995,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.266,"15min":1.202},"min":{"1min":0.83199999999999996,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":1.5940000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4019999999999999,"15min":1.3240000000000001},"min":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":1.835,"5min":1.8400000000000001,"15min":2.125},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.4219999999999999,"15min":1.3660000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1890000000000001,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":1.286}]},{"osd":6,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.383,"15min":1.2789999999999999},"min":{"1min":0.88200000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.345},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4570000000000001,"15min":1.399},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9279999999999999,"5min":1.984,"15min":2.1539999999999999},"last":1.48}]},{"osd":7,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4750000000000001,"15min":1.431},"min":{"1min":0.88900000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.421,"15min":1.3420000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.881,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.24}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.44800000000000001,"15min":0.44500000000000001},"max":{"1min":1.3779999999999999,"5min":1.464,"15min":1.5209999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.999,"15min":0.90300000000000002},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.443},"max":{"1min":1.468,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.0529999999999999},"min":{"1min":0.70299999999999996,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.621,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.181},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.234,"15min":1.127},"min":{"1min":0.58799999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.242}]},{"osd":3,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.59499999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.226,"15min":1.246},"min":{"1min":0.63400000000000001,"5min":0.626,"15min":0.57599999999999996},"max":{"1min":1.5960000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.5920000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4119999999999999,"15min":1.419},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.82699999999999996},"max":{"1min":1.734,"5min":2.415,"15min":2.6000000000000001},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.387,"15min":1.3160000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.83199999999999996},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.333}]},{"osd":5,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3160000000000001,"15min":1.274},"min":{"1min":0.89600000000000002,"5min":0.85099999999999998,"15min":0.81000000000000005},"max":{"1min":1.5760000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.292},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.5009999999999999,"15min":1.482},"min":{"1min":0.91500000000000004,"5min":0.876,"15min":0.86599999999999999},"max":{"1min":1.8480000000000001,"5min":3.294,"15min":3.294},"last":1.806}]},{"osd":6,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.454,"15min":1.387},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.81599999999999995},"max":{"1min":1.9930000000000001,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.4179999999999999,"15min":1.3580000000000001},"min":{"1min":0.89500000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8879999999999999,"5min":2.444,"15min":2.444},"last":1.5669999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.528,"15min":1.419},"min":{"1min":1.1240000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.125,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4730000000000001,"15min":1.4259999999999999},"min":{"1min":0.99399999999999999,"5min":0.89900000000000002,"15min":0.81100000000000005},"max":{"1min":1.655,"5min":2.556,"15min":2.556},"last":1.7669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89800000000000002,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.3220000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0009999999999999,"15min":0.94499999999999995},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":1.647,"5min":2.012,"15min":2.246},"last":0.749}]},{"osd":2,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.038,"15min":0.88900000000000001},"min":{"1min":0.54300000000000004,"5min":0.5,"15min":0.436},"max":{"1min":1.792,"5min":1.8320000000000001,"15min":2.0209999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2470000000000001,"15min":1.069},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.671,"5min":2.423,"15min":2.423},"last":1.069}]},{"osd":3,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1910000000000001,"15min":1.0629999999999999},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.45400000000000001},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0900000000000001,"15min":1.036},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42399999999999999},"max":{"1min":1.8,"5min":1.9059999999999999,"15min":2.8940000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.2749999999999999,"15min":1.1739999999999999},"min":{"1min":0.93600000000000005,"5min":0.78000000000000003,"15min":0.65500000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.4690000000000001,"15min":1.3919999999999999},"min":{"1min":1.0449999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2989999999999999,"5min":2.343,"15min":2.343},"last":1.6499999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.417,"15min":1.363},"min":{"1min":0.94999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.98,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.113},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4350000000000001,"15min":1.3180000000000001},"min":{"1min":0.98399999999999999,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":2.387,"5min":2.73,"15min":2.73},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4299999999999999,"15min":1.3660000000000001},"min":{"1min":0.85899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.444},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4179999999999999,"15min":1.2709999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.77300000000000002},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.462}]},{"osd":7,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4950000000000001,"15min":1.4379999999999999},"min":{"1min":1.1259999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.742},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.5149999999999999,"15min":1.4019999999999999},"min":{"1min":0.82699999999999996,"5min":0.625,"15min":0.625},"max":{"1min":2.0379999999999998,"5min":2.1640000000000001,"15min":2.605},"last":1.5169999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1315,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193996,"statfs":{"total":200000000,"available":198652535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.27,"5min":1.546,"15min":1.546},"last":8.6899999999999995},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.0369999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.411,"5min":1.633,"15min":1.853},"last":11.173}]},{"osd":2,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.026,"15min":1.0249999999999999},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.5760000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":2.7240000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.617,"5min":1.7,"15min":1.7},"last":1.694}]},{"osd":3,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.034,"15min":0.95599999999999996},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.585,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":4.8570000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1970000000000001,"15min":1.117},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.9670000000000001,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":10.739000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.387,"15min":1.282},"min":{"1min":1.1220000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.734,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":4.6980000000000004},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4099999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.883,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":2.1230000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.736,"5min":1.9259999999999999,"15min":1.986},"last":1.522},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.5409999999999999,"15min":1.353},"min":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6719999999999999,"5min":16.058,"15min":16.058},"last":7.532}]},{"osd":6,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.482,"15min":1.456},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8220000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":2.4790000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4430000000000001,"15min":1.4339999999999999},"min":{"1min":0.94199999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9179999999999999,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.5049999999999999,"15min":1.522},"min":{"1min":1.038,"5min":0.752,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.786},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4990000000000001,"15min":1.423},"min":{"1min":1.0389999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.778,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":4.9939999999999998}]}]}],"pool_statfs":[]}} 2023-08-10T10:45:40.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:45:40.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.880+0000 7fa46fc2c640 1 Processor -- start 2023-08-10T10:45:40.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.880+0000 7fa46fc2c640 1 -- start start 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46fc2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4680cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46fc2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4680cddb0 0x7fa4680d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46fc2c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa468161180 con 0x7fa46815cd60 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46fc2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680ce240 con 0x7fa4680cddb0 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46fc2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b5bd0 con 0x7fa4680b8430 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46d9c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa46815cd60 0x7fa468160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48218/0 (socket says 172.21.15.50:48218) 2023-08-10T10:45:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.882+0000 7fa46d9c8640 1 -- 172.21.15.50:0/1373795149 learned_addr learned my addr 172.21.15.50:0/1373795149 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410903960 0 0) 0x7fa468161180 con 0x7fa46815cd60 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46e1c9640 1 --2- 172.21.15.50:0/1373795149 >> v2:172.21.15.117:3300/0 conn(0x7fa4680cddb0 0x7fa4680d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4680cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa454003520 con 0x7fa46815cd60 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3421555019 0 0) 0x7fa454003520 con 0x7fa46815cd60 2023-08-10T10:45:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 msgr2=0x7fa4680cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4680cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 >> v2:172.21.15.117:3300/0 conn(0x7fa4680cddb0 msgr2=0x7fa4680d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 --2- 172.21.15.50:0/1373795149 >> v2:172.21.15.117:3300/0 conn(0x7fa4680cddb0 0x7fa4680d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468161460 con 0x7fa46815cd60 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa464001670 con 0x7fa46815cd60 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 >> v1:172.21.15.50:6789/0 conn(0x7fa46815cd60 legacy=0x7fa468160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.883+0000 7fa46c9c6640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454003970 0x7fa454003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46c9c6640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46c9c6640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454004d00 0x7fa454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680ce240 con 0x7fa454003970 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b5bd0 con 0x7fa454004d00 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45400b980 con 0x7fa4680b8430 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454003970 0x7fa454003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 -- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 msgr2=0x7fa4540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 -- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454004d00 msgr2=0x7fa454005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454004d00 0x7fa454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d9c8640 1 -- 172.21.15.50:0/1373795149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454003520 con 0x7fa454003970 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.884+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4680b8430 0x7fa4540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.885+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454003970 0x7fa454003d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c290 tx=0x7fa4540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b2ec5e60ae1bae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464005ad0 con 0x7fa454003970 2023-08-10T10:45:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464005c30 con 0x7fa454003970 2023-08-10T10:45:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46c9c6640 1 -- 172.21.15.50:0/1373795149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46402c8d0 con 0x7fa454003970 2023-08-10T10:45:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46fc2c640 1 -- 172.21.15.50:0/1373795149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454003970 msgr2=0x7fa454003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/1373795149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454003970 0x7fa454003d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c290 tx=0x7fa4540057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46e1c9640 1 -- 172.21.15.50:0/1373795149 reap_dead start 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46fc2c640 1 -- 172.21.15.50:0/1373795149 shutdown_connections 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.886+0000 7fa46fc2c640 1 -- 172.21.15.50:0/1373795149 >> 172.21.15.50:0/1373795149 conn(0x7fa4680d2ac0 msgr2=0x7fa4680d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.887+0000 7fa46fc2c640 1 -- 172.21.15.50:0/1373795149 shutdown_connections 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.887+0000 7fa46fc2c640 1 -- 172.21.15.50:0/1373795149 wait complete. 2023-08-10T10:45:40.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.888+0000 7fa46fc2c640 1 Processor -- start 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.889+0000 7fa46fc2c640 1 -- start start 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454003970 0x7fa46815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46815f470 0x7fa46815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46815e930 con 0x7fa4681541e0 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46815fe60 con 0x7fa454003970 2023-08-10T10:45:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46fc2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa468156110 con 0x7fa46815f470 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46d1c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46d1c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39780/0 (socket says 172.21.15.50:39780) 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46d1c7640 1 -- 172.21.15.50:0/3985813087 learned_addr learned my addr 172.21.15.50:0/3985813087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454003970 0x7fa46815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.890+0000 7fa46e1c9640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46815f470 0x7fa46815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 -- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46815f470 msgr2=0x7fa46815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46815f470 0x7fa46815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 -- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454003970 msgr2=0x7fa46815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:40.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454003970 0x7fa46815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:40.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 -- 172.21.15.50:0/3985813087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46815dcb0 con 0x7fa4681541e0 2023-08-10T10:45:40.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46d1c7640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa4580108e0 tx=0x7fa458010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ec20 con 0x7fa4681541e0 2023-08-10T10:45:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800ed80 con 0x7fa4681541e0 2023-08-10T10:45:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46815df90 con 0x7fa4681541e0 2023-08-10T10:45:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45801c600 con 0x7fa4681541e0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.891+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46815e550 con 0x7fa4681541e0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.893+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46815e710 con 0x7fa4681541e0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.894+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa45801c760 con 0x7fa4681541e0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.894+0000 7fa45e7fc640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 0x7fa44c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.895+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa458089b50 con 0x7fa4681541e0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.895+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 0x7fa44c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.896+0000 7fa46d9c8640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 0x7fa44c06d140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa464034000 tx=0x7fa464007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:40.899+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa458058680 con 0x7fa4681541e0 2023-08-10T10:45:41.076 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:45:41.076+0000 7fe14a8dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:45:41.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.085+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4680d0c00 con 0x7fa44c06ac80 2023-08-10T10:45:41.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.098+0000 7fa45e7fc640 1 -- 172.21.15.50:0/3985813087 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303301 (secure 0 0 0) 0x7fa464005970 con 0x7fa44c06ac80 2023-08-10T10:45:41.100 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:41.104 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:45:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 msgr2=0x7fa44c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 0x7fa44c06d140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa464034000 tx=0x7fa464007000 comp rx=0 tx=0).stop 2023-08-10T10:45:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 msgr2=0x7fa46815d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa4580108e0 tx=0x7fa458010da0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 shutdown_connections 2023-08-10T10:45:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46815f470 0x7fa46815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4681541e0 0x7fa46815d680 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa44c06ac80 0x7fa44c06d140 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 --2- 172.21.15.50:0/3985813087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa454003970 0x7fa46815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 >> 172.21.15.50:0/3985813087 conn(0x7fa4680d2ac0 msgr2=0x7fa46815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.105+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 shutdown_connections 2023-08-10T10:45:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.106+0000 7fa46fc2c640 1 -- 172.21.15.50:0/3985813087 wait complete. 2023-08-10T10:45:41.125 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-08-10T10:45:40.471047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7104,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555395,"statfs":{"total":1600000000,"available":1592724964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001916"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916087+0000","last_change":"2023-08-10T10:45:36.142581+0000","last_active":"2023-08-10T10:45:37.916087+0000","last_peered":"2023-08-10T10:45:37.916087+0000","last_clean":"2023-08-10T10:45:37.916087+0000","last_became_active":"2023-08-10T10:45:36.142275+0000","last_became_peered":"2023-08-10T10:45:36.142275+0000","last_unstale":"2023-08-10T10:45:37.916087+0000","last_undegraded":"2023-08-10T10:45:37.916087+0000","last_fullsized":"2023-08-10T10:45:37.916087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:05.704607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292812+0000","last_change":"2023-08-10T10:45:36.151094+0000","last_active":"2023-08-10T10:45:37.292812+0000","last_peered":"2023-08-10T10:45:37.292812+0000","last_clean":"2023-08-10T10:45:37.292812+0000","last_became_active":"2023-08-10T10:45:36.150644+0000","last_became_peered":"2023-08-10T10:45:36.150644+0000","last_unstale":"2023-08-10T10:45:37.292812+0000","last_undegraded":"2023-08-10T10:45:37.292812+0000","last_fullsized":"2023-08-10T10:45:37.292812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:32.944050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915240+0000","last_change":"2023-08-10T10:45:36.151769+0000","last_active":"2023-08-10T10:45:37.915240+0000","last_peered":"2023-08-10T10:45:37.915240+0000","last_clean":"2023-08-10T10:45:37.915240+0000","last_became_active":"2023-08-10T10:45:36.151412+0000","last_became_peered":"2023-08-10T10:45:36.151412+0000","last_unstale":"2023-08-10T10:45:37.915240+0000","last_undegraded":"2023-08-10T10:45:37.915240+0000","last_fullsized":"2023-08-10T10:45:37.915240+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:51.129317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916898+0000","last_change":"2023-08-10T10:45:36.147427+0000","last_active":"2023-08-10T10:45:37.916898+0000","last_peered":"2023-08-10T10:45:37.916898+0000","last_clean":"2023-08-10T10:45:37.916898+0000","last_became_active":"2023-08-10T10:45:36.143186+0000","last_became_peered":"2023-08-10T10:45:36.143186+0000","last_unstale":"2023-08-10T10:45:37.916898+0000","last_undegraded":"2023-08-10T10:45:37.916898+0000","last_fullsized":"2023-08-10T10:45:37.916898+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:07.938384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126491+0000","last_change":"2023-08-10T10:45:36.144047+0000","last_active":"2023-08-10T10:45:37.126491+0000","last_peered":"2023-08-10T10:45:37.126491+0000","last_clean":"2023-08-10T10:45:37.126491+0000","last_became_active":"2023-08-10T10:45:36.143555+0000","last_became_peered":"2023-08-10T10:45:36.143555+0000","last_unstale":"2023-08-10T10:45:37.126491+0000","last_undegraded":"2023-08-10T10:45:37.126491+0000","last_fullsized":"2023-08-10T10:45:37.126491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:53.668585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293595+0000","last_change":"2023-08-10T10:45:36.150623+0000","last_active":"2023-08-10T10:45:37.293595+0000","last_peered":"2023-08-10T10:45:37.293595+0000","last_clean":"2023-08-10T10:45:37.293595+0000","last_became_active":"2023-08-10T10:45:36.149272+0000","last_became_peered":"2023-08-10T10:45:36.149272+0000","last_unstale":"2023-08-10T10:45:37.293595+0000","last_undegraded":"2023-08-10T10:45:37.293595+0000","last_fullsized":"2023-08-10T10:45:37.293595+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:33.664515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292244+0000","last_change":"2023-08-10T10:45:36.150933+0000","last_active":"2023-08-10T10:45:37.292244+0000","last_peered":"2023-08-10T10:45:37.292244+0000","last_clean":"2023-08-10T10:45:37.292244+0000","last_became_active":"2023-08-10T10:45:36.150239+0000","last_became_peered":"2023-08-10T10:45:36.150239+0000","last_unstale":"2023-08-10T10:45:37.292244+0000","last_undegraded":"2023-08-10T10:45:37.292244+0000","last_fullsized":"2023-08-10T10:45:37.292244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:26.954723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127821+0000","last_change":"2023-08-10T10:45:36.141674+0000","last_active":"2023-08-10T10:45:37.127821+0000","last_peered":"2023-08-10T10:45:37.127821+0000","last_clean":"2023-08-10T10:45:37.127821+0000","last_became_active":"2023-08-10T10:45:36.140993+0000","last_became_peered":"2023-08-10T10:45:36.140993+0000","last_unstale":"2023-08-10T10:45:37.127821+0000","last_undegraded":"2023-08-10T10:45:37.127821+0000","last_fullsized":"2023-08-10T10:45:37.127821+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:51:01.199223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292230+0000","last_change":"2023-08-10T10:45:36.157735+0000","last_active":"2023-08-10T10:45:37.292230+0000","last_peered":"2023-08-10T10:45:37.292230+0000","last_clean":"2023-08-10T10:45:37.292230+0000","last_became_active":"2023-08-10T10:45:36.157476+0000","last_became_peered":"2023-08-10T10:45:36.157476+0000","last_unstale":"2023-08-10T10:45:37.292230+0000","last_undegraded":"2023-08-10T10:45:37.292230+0000","last_fullsized":"2023-08-10T10:45:37.292230+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:24.425170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126869+0000","last_change":"2023-08-10T10:45:36.152290+0000","last_active":"2023-08-10T10:45:37.126869+0000","last_peered":"2023-08-10T10:45:37.126869+0000","last_clean":"2023-08-10T10:45:37.126869+0000","last_became_active":"2023-08-10T10:45:36.151681+0000","last_became_peered":"2023-08-10T10:45:36.151681+0000","last_unstale":"2023-08-10T10:45:37.126869+0000","last_undegraded":"2023-08-10T10:45:37.126869+0000","last_fullsized":"2023-08-10T10:45:37.126869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:31.711494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290306+0000","last_change":"2023-08-10T10:45:36.154671+0000","last_active":"2023-08-10T10:45:37.290306+0000","last_peered":"2023-08-10T10:45:37.290306+0000","last_clean":"2023-08-10T10:45:37.290306+0000","last_became_active":"2023-08-10T10:45:36.154304+0000","last_became_peered":"2023-08-10T10:45:36.154304+0000","last_unstale":"2023-08-10T10:45:37.290306+0000","last_undegraded":"2023-08-10T10:45:37.290306+0000","last_fullsized":"2023-08-10T10:45:37.290306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:37.763630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129107+0000","last_change":"2023-08-10T10:45:36.147924+0000","last_active":"2023-08-10T10:45:37.129107+0000","last_peered":"2023-08-10T10:45:37.129107+0000","last_clean":"2023-08-10T10:45:37.129107+0000","last_became_active":"2023-08-10T10:45:36.147511+0000","last_became_peered":"2023-08-10T10:45:36.147511+0000","last_unstale":"2023-08-10T10:45:37.129107+0000","last_undegraded":"2023-08-10T10:45:37.129107+0000","last_fullsized":"2023-08-10T10:45:37.129107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:27.739628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916270+0000","last_change":"2023-08-10T10:45:36.154848+0000","last_active":"2023-08-10T10:45:37.916270+0000","last_peered":"2023-08-10T10:45:37.916270+0000","last_clean":"2023-08-10T10:45:37.916270+0000","last_became_active":"2023-08-10T10:45:36.154597+0000","last_became_peered":"2023-08-10T10:45:36.154597+0000","last_unstale":"2023-08-10T10:45:37.916270+0000","last_undegraded":"2023-08-10T10:45:37.916270+0000","last_fullsized":"2023-08-10T10:45:37.916270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:38.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291902+0000","last_change":"2023-08-10T10:45:36.150501+0000","last_active":"2023-08-10T10:45:37.291902+0000","last_peered":"2023-08-10T10:45:37.291902+0000","last_clean":"2023-08-10T10:45:37.291902+0000","last_became_active":"2023-08-10T10:45:36.150205+0000","last_became_peered":"2023-08-10T10:45:36.150205+0000","last_unstale":"2023-08-10T10:45:37.291902+0000","last_undegraded":"2023-08-10T10:45:37.291902+0000","last_fullsized":"2023-08-10T10:45:37.291902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:00.684278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290948+0000","last_change":"2023-08-10T10:45:36.154306+0000","last_active":"2023-08-10T10:45:37.290948+0000","last_peered":"2023-08-10T10:45:37.290948+0000","last_clean":"2023-08-10T10:45:37.290948+0000","last_became_active":"2023-08-10T10:45:36.154053+0000","last_became_peered":"2023-08-10T10:45:36.154053+0000","last_unstale":"2023-08-10T10:45:37.290948+0000","last_undegraded":"2023-08-10T10:45:37.290948+0000","last_fullsized":"2023-08-10T10:45:37.290948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:34:31.080416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291689+0000","last_change":"2023-08-10T10:45:36.150040+0000","last_active":"2023-08-10T10:45:37.291689+0000","last_peered":"2023-08-10T10:45:37.291689+0000","last_clean":"2023-08-10T10:45:37.291689+0000","last_became_active":"2023-08-10T10:45:36.149730+0000","last_became_peered":"2023-08-10T10:45:36.149730+0000","last_unstale":"2023-08-10T10:45:37.291689+0000","last_undegraded":"2023-08-10T10:45:37.291689+0000","last_fullsized":"2023-08-10T10:45:37.291689+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:51:37.387622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916226+0000","last_change":"2023-08-10T10:45:36.153792+0000","last_active":"2023-08-10T10:45:37.916226+0000","last_peered":"2023-08-10T10:45:37.916226+0000","last_clean":"2023-08-10T10:45:37.916226+0000","last_became_active":"2023-08-10T10:45:36.153542+0000","last_became_peered":"2023-08-10T10:45:36.153542+0000","last_unstale":"2023-08-10T10:45:37.916226+0000","last_undegraded":"2023-08-10T10:45:37.916226+0000","last_fullsized":"2023-08-10T10:45:37.916226+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:40.824534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292444+0000","last_change":"2023-08-10T10:45:36.156179+0000","last_active":"2023-08-10T10:45:37.292444+0000","last_peered":"2023-08-10T10:45:37.292444+0000","last_clean":"2023-08-10T10:45:37.292444+0000","last_became_active":"2023-08-10T10:45:36.155437+0000","last_became_peered":"2023-08-10T10:45:36.155437+0000","last_unstale":"2023-08-10T10:45:37.292444+0000","last_undegraded":"2023-08-10T10:45:37.292444+0000","last_fullsized":"2023-08-10T10:45:37.292444+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:16.511975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915246+0000","last_change":"2023-08-10T10:45:36.159118+0000","last_active":"2023-08-10T10:45:37.915246+0000","last_peered":"2023-08-10T10:45:37.915246+0000","last_clean":"2023-08-10T10:45:37.915246+0000","last_became_active":"2023-08-10T10:45:36.158160+0000","last_became_peered":"2023-08-10T10:45:36.158160+0000","last_unstale":"2023-08-10T10:45:37.915246+0000","last_undegraded":"2023-08-10T10:45:37.915246+0000","last_fullsized":"2023-08-10T10:45:37.915246+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:03.751551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129464+0000","last_change":"2023-08-10T10:45:36.158436+0000","last_active":"2023-08-10T10:45:37.129464+0000","last_peered":"2023-08-10T10:45:37.129464+0000","last_clean":"2023-08-10T10:45:37.129464+0000","last_became_active":"2023-08-10T10:45:36.156649+0000","last_became_peered":"2023-08-10T10:45:36.156649+0000","last_unstale":"2023-08-10T10:45:37.129464+0000","last_undegraded":"2023-08-10T10:45:37.129464+0000","last_fullsized":"2023-08-10T10:45:37.129464+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:14.163816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128066+0000","last_change":"2023-08-10T10:45:36.145934+0000","last_active":"2023-08-10T10:45:37.128066+0000","last_peered":"2023-08-10T10:45:37.128066+0000","last_clean":"2023-08-10T10:45:37.128066+0000","last_became_active":"2023-08-10T10:45:36.145113+0000","last_became_peered":"2023-08-10T10:45:36.145113+0000","last_unstale":"2023-08-10T10:45:37.128066+0000","last_undegraded":"2023-08-10T10:45:37.128066+0000","last_fullsized":"2023-08-10T10:45:37.128066+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:17:03.614477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126318+0000","last_change":"2023-08-10T10:45:36.151000+0000","last_active":"2023-08-10T10:45:37.126318+0000","last_peered":"2023-08-10T10:45:37.126318+0000","last_clean":"2023-08-10T10:45:37.126318+0000","last_became_active":"2023-08-10T10:45:36.150613+0000","last_became_peered":"2023-08-10T10:45:36.150613+0000","last_unstale":"2023-08-10T10:45:37.126318+0000","last_undegraded":"2023-08-10T10:45:37.126318+0000","last_fullsized":"2023-08-10T10:45:37.126318+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:57.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915642+0000","last_change":"2023-08-10T10:45:36.153026+0000","last_active":"2023-08-10T10:45:37.915642+0000","last_peered":"2023-08-10T10:45:37.915642+0000","last_clean":"2023-08-10T10:45:37.915642+0000","last_became_active":"2023-08-10T10:45:36.152756+0000","last_became_peered":"2023-08-10T10:45:36.152756+0000","last_unstale":"2023-08-10T10:45:37.915642+0000","last_undegraded":"2023-08-10T10:45:37.915642+0000","last_fullsized":"2023-08-10T10:45:37.915642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.577999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.125976+0000","last_change":"2023-08-10T10:45:36.145731+0000","last_active":"2023-08-10T10:45:37.125976+0000","last_peered":"2023-08-10T10:45:37.125976+0000","last_clean":"2023-08-10T10:45:37.125976+0000","last_became_active":"2023-08-10T10:45:36.145466+0000","last_became_peered":"2023-08-10T10:45:36.145466+0000","last_unstale":"2023-08-10T10:45:37.125976+0000","last_undegraded":"2023-08-10T10:45:37.125976+0000","last_fullsized":"2023-08-10T10:45:37.125976+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:12.358886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129818+0000","last_change":"2023-08-10T10:45:36.158900+0000","last_active":"2023-08-10T10:45:37.129818+0000","last_peered":"2023-08-10T10:45:37.129818+0000","last_clean":"2023-08-10T10:45:37.129818+0000","last_became_active":"2023-08-10T10:45:36.157828+0000","last_became_peered":"2023-08-10T10:45:36.157828+0000","last_unstale":"2023-08-10T10:45:37.129818+0000","last_undegraded":"2023-08-10T10:45:37.129818+0000","last_fullsized":"2023-08-10T10:45:37.129818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:41.858698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129552+0000","last_change":"2023-08-10T10:45:36.157535+0000","last_active":"2023-08-10T10:45:37.129552+0000","last_peered":"2023-08-10T10:45:37.129552+0000","last_clean":"2023-08-10T10:45:37.129552+0000","last_became_active":"2023-08-10T10:45:36.157072+0000","last_became_peered":"2023-08-10T10:45:36.157072+0000","last_unstale":"2023-08-10T10:45:37.129552+0000","last_undegraded":"2023-08-10T10:45:37.129552+0000","last_fullsized":"2023-08-10T10:45:37.129552+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:47:58.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290433+0000","last_change":"2023-08-10T10:45:36.158719+0000","last_active":"2023-08-10T10:45:37.290433+0000","last_peered":"2023-08-10T10:45:37.290433+0000","last_clean":"2023-08-10T10:45:37.290433+0000","last_became_active":"2023-08-10T10:45:36.157578+0000","last_became_peered":"2023-08-10T10:45:36.157578+0000","last_unstale":"2023-08-10T10:45:37.290433+0000","last_undegraded":"2023-08-10T10:45:37.290433+0000","last_fullsized":"2023-08-10T10:45:37.290433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:01.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292811+0000","last_change":"2023-08-10T10:45:36.157783+0000","last_active":"2023-08-10T10:45:37.292811+0000","last_peered":"2023-08-10T10:45:37.292811+0000","last_clean":"2023-08-10T10:45:37.292811+0000","last_became_active":"2023-08-10T10:45:36.157347+0000","last_became_peered":"2023-08-10T10:45:36.157347+0000","last_unstale":"2023-08-10T10:45:37.292811+0000","last_undegraded":"2023-08-10T10:45:37.292811+0000","last_fullsized":"2023-08-10T10:45:37.292811+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:32.523380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127329+0000","last_change":"2023-08-10T10:45:36.154137+0000","last_active":"2023-08-10T10:45:37.127329+0000","last_peered":"2023-08-10T10:45:37.127329+0000","last_clean":"2023-08-10T10:45:37.127329+0000","last_became_active":"2023-08-10T10:45:36.153782+0000","last_became_peered":"2023-08-10T10:45:36.153782+0000","last_unstale":"2023-08-10T10:45:37.127329+0000","last_undegraded":"2023-08-10T10:45:37.127329+0000","last_fullsized":"2023-08-10T10:45:37.127329+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:33.871989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.130136+0000","last_change":"2023-08-10T10:45:36.158684+0000","last_active":"2023-08-10T10:45:37.130136+0000","last_peered":"2023-08-10T10:45:37.130136+0000","last_clean":"2023-08-10T10:45:37.130136+0000","last_became_active":"2023-08-10T10:45:36.157386+0000","last_became_peered":"2023-08-10T10:45:36.157386+0000","last_unstale":"2023-08-10T10:45:37.130136+0000","last_undegraded":"2023-08-10T10:45:37.130136+0000","last_fullsized":"2023-08-10T10:45:37.130136+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:42:26.954723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291295+0000","last_change":"2023-08-10T10:45:36.150995+0000","last_active":"2023-08-10T10:45:37.291295+0000","last_peered":"2023-08-10T10:45:37.291295+0000","last_clean":"2023-08-10T10:45:37.291295+0000","last_became_active":"2023-08-10T10:45:36.150076+0000","last_became_peered":"2023-08-10T10:45:36.150076+0000","last_unstale":"2023-08-10T10:45:37.291295+0000","last_undegraded":"2023-08-10T10:45:37.291295+0000","last_fullsized":"2023-08-10T10:45:37.291295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:21:47.407969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127904+0000","last_change":"2023-08-10T10:45:36.148748+0000","last_active":"2023-08-10T10:45:37.127904+0000","last_peered":"2023-08-10T10:45:37.127904+0000","last_clean":"2023-08-10T10:45:37.127904+0000","last_became_active":"2023-08-10T10:45:36.148382+0000","last_became_peered":"2023-08-10T10:45:36.148382+0000","last_unstale":"2023-08-10T10:45:37.127904+0000","last_undegraded":"2023-08-10T10:45:37.127904+0000","last_fullsized":"2023-08-10T10:45:37.127904+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:00.652399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917029+0000","last_change":"2023-08-10T10:45:36.159404+0000","last_active":"2023-08-10T10:45:37.917029+0000","last_peered":"2023-08-10T10:45:37.917029+0000","last_clean":"2023-08-10T10:45:37.917029+0000","last_became_active":"2023-08-10T10:45:36.158798+0000","last_became_peered":"2023-08-10T10:45:36.158798+0000","last_unstale":"2023-08-10T10:45:37.917029+0000","last_undegraded":"2023-08-10T10:45:37.917029+0000","last_fullsized":"2023-08-10T10:45:37.917029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:48.644130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"128'4","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916957+0000","last_change":"2023-08-10T10:45:35.108931+0000","last_active":"2023-08-10T10:45:37.916957+0000","last_peered":"2023-08-10T10:45:37.916957+0000","last_clean":"2023-08-10T10:45:37.916957+0000","last_became_active":"2023-08-10T10:45:35.108691+0000","last_became_peered":"2023-08-10T10:45:35.108691+0000","last_unstale":"2023-08-10T10:45:37.916957+0000","last_undegraded":"2023-08-10T10:45:37.916957+0000","last_fullsized":"2023-08-10T10:45:37.916957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:09.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128229+0000","last_change":"2023-08-10T10:45:36.141854+0000","last_active":"2023-08-10T10:45:37.128229+0000","last_peered":"2023-08-10T10:45:37.128229+0000","last_clean":"2023-08-10T10:45:37.128229+0000","last_became_active":"2023-08-10T10:45:36.141367+0000","last_became_peered":"2023-08-10T10:45:36.141367+0000","last_unstale":"2023-08-10T10:45:37.128229+0000","last_undegraded":"2023-08-10T10:45:37.128229+0000","last_fullsized":"2023-08-10T10:45:37.128229+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:56.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127628+0000","last_change":"2023-08-10T10:45:35.101198+0000","last_active":"2023-08-10T10:45:37.127628+0000","last_peered":"2023-08-10T10:45:37.127628+0000","last_clean":"2023-08-10T10:45:37.127628+0000","last_became_active":"2023-08-10T10:45:35.099918+0000","last_became_peered":"2023-08-10T10:45:35.099918+0000","last_unstale":"2023-08-10T10:45:37.127628+0000","last_undegraded":"2023-08-10T10:45:37.127628+0000","last_fullsized":"2023-08-10T10:45:37.127628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.164970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129306+0000","last_change":"2023-08-10T10:45:36.150594+0000","last_active":"2023-08-10T10:45:37.129306+0000","last_peered":"2023-08-10T10:45:37.129306+0000","last_clean":"2023-08-10T10:45:37.129306+0000","last_became_active":"2023-08-10T10:45:36.150166+0000","last_became_peered":"2023-08-10T10:45:36.150166+0000","last_unstale":"2023-08-10T10:45:37.129306+0000","last_undegraded":"2023-08-10T10:45:37.129306+0000","last_fullsized":"2023-08-10T10:45:37.129306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:53:21.181624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.130463+0000","last_change":"2023-08-10T10:45:35.103566+0000","last_active":"2023-08-10T10:45:37.130463+0000","last_peered":"2023-08-10T10:45:37.130463+0000","last_clean":"2023-08-10T10:45:37.130463+0000","last_became_active":"2023-08-10T10:45:35.103073+0000","last_became_peered":"2023-08-10T10:45:35.103073+0000","last_unstale":"2023-08-10T10:45:37.130463+0000","last_undegraded":"2023-08-10T10:45:37.130463+0000","last_fullsized":"2023-08-10T10:45:37.130463+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.604658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.289993+0000","last_change":"2023-08-10T10:45:36.152475+0000","last_active":"2023-08-10T10:45:37.289993+0000","last_peered":"2023-08-10T10:45:37.289993+0000","last_clean":"2023-08-10T10:45:37.289993+0000","last_became_active":"2023-08-10T10:45:36.152236+0000","last_became_peered":"2023-08-10T10:45:36.152236+0000","last_unstale":"2023-08-10T10:45:37.289993+0000","last_undegraded":"2023-08-10T10:45:37.289993+0000","last_fullsized":"2023-08-10T10:45:37.289993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:17.650302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126360+0000","last_change":"2023-08-10T10:45:35.092226+0000","last_active":"2023-08-10T10:45:37.126360+0000","last_peered":"2023-08-10T10:45:37.126360+0000","last_clean":"2023-08-10T10:45:37.126360+0000","last_became_active":"2023-08-10T10:45:35.091607+0000","last_became_peered":"2023-08-10T10:45:35.091607+0000","last_unstale":"2023-08-10T10:45:37.126360+0000","last_undegraded":"2023-08-10T10:45:37.126360+0000","last_fullsized":"2023-08-10T10:45:37.126360+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:02:56.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917682+0000","last_change":"2023-08-10T10:45:36.144195+0000","last_active":"2023-08-10T10:45:37.917682+0000","last_peered":"2023-08-10T10:45:37.917682+0000","last_clean":"2023-08-10T10:45:37.917682+0000","last_became_active":"2023-08-10T10:45:36.143737+0000","last_became_peered":"2023-08-10T10:45:36.143737+0000","last_unstale":"2023-08-10T10:45:37.917682+0000","last_undegraded":"2023-08-10T10:45:37.917682+0000","last_fullsized":"2023-08-10T10:45:37.917682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:40.481792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291240+0000","last_change":"2023-08-10T10:45:35.104582+0000","last_active":"2023-08-10T10:45:37.291240+0000","last_peered":"2023-08-10T10:45:37.291240+0000","last_clean":"2023-08-10T10:45:37.291240+0000","last_became_active":"2023-08-10T10:45:35.104298+0000","last_became_peered":"2023-08-10T10:45:35.104298+0000","last_unstale":"2023-08-10T10:45:37.291240+0000","last_undegraded":"2023-08-10T10:45:37.291240+0000","last_fullsized":"2023-08-10T10:45:37.291240+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:54.892974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916650+0000","last_change":"2023-08-10T10:45:36.159276+0000","last_active":"2023-08-10T10:45:37.916650+0000","last_peered":"2023-08-10T10:45:37.916650+0000","last_clean":"2023-08-10T10:45:37.916650+0000","last_became_active":"2023-08-10T10:45:36.158483+0000","last_became_peered":"2023-08-10T10:45:36.158483+0000","last_unstale":"2023-08-10T10:45:37.916650+0000","last_undegraded":"2023-08-10T10:45:37.916650+0000","last_fullsized":"2023-08-10T10:45:37.916650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:09.765646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290563+0000","last_change":"2023-08-10T10:45:35.105897+0000","last_active":"2023-08-10T10:45:37.290563+0000","last_peered":"2023-08-10T10:45:37.290563+0000","last_clean":"2023-08-10T10:45:37.290563+0000","last_became_active":"2023-08-10T10:45:35.105308+0000","last_became_peered":"2023-08-10T10:45:35.105308+0000","last_unstale":"2023-08-10T10:45:37.290563+0000","last_undegraded":"2023-08-10T10:45:37.290563+0000","last_fullsized":"2023-08-10T10:45:37.290563+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:42.663832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293173+0000","last_change":"2023-08-10T10:45:36.157598+0000","last_active":"2023-08-10T10:45:37.293173+0000","last_peered":"2023-08-10T10:45:37.293173+0000","last_clean":"2023-08-10T10:45:37.293173+0000","last_became_active":"2023-08-10T10:45:36.156991+0000","last_became_peered":"2023-08-10T10:45:36.156991+0000","last_unstale":"2023-08-10T10:45:37.293173+0000","last_undegraded":"2023-08-10T10:45:37.293173+0000","last_fullsized":"2023-08-10T10:45:37.293173+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:01.781369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129146+0000","last_change":"2023-08-10T10:45:35.101503+0000","last_active":"2023-08-10T10:45:37.129146+0000","last_peered":"2023-08-10T10:45:37.129146+0000","last_clean":"2023-08-10T10:45:37.129146+0000","last_became_active":"2023-08-10T10:45:35.100944+0000","last_became_peered":"2023-08-10T10:45:35.100944+0000","last_unstale":"2023-08-10T10:45:37.129146+0000","last_undegraded":"2023-08-10T10:45:37.129146+0000","last_fullsized":"2023-08-10T10:45:37.129146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:08.741548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917760+0000","last_change":"2023-08-10T10:45:36.145702+0000","last_active":"2023-08-10T10:45:37.917760+0000","last_peered":"2023-08-10T10:45:37.917760+0000","last_clean":"2023-08-10T10:45:37.917760+0000","last_became_active":"2023-08-10T10:45:36.145318+0000","last_became_peered":"2023-08-10T10:45:36.145318+0000","last_unstale":"2023-08-10T10:45:37.917760+0000","last_undegraded":"2023-08-10T10:45:37.917760+0000","last_fullsized":"2023-08-10T10:45:37.917760+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:38.647797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.918171+0000","last_change":"2023-08-10T10:45:35.111646+0000","last_active":"2023-08-10T10:45:37.918171+0000","last_peered":"2023-08-10T10:45:37.918171+0000","last_clean":"2023-08-10T10:45:37.918171+0000","last_became_active":"2023-08-10T10:45:35.111267+0000","last_became_peered":"2023-08-10T10:45:35.111267+0000","last_unstale":"2023-08-10T10:45:37.918171+0000","last_undegraded":"2023-08-10T10:45:37.918171+0000","last_fullsized":"2023-08-10T10:45:37.918171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:26.734183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916446+0000","last_change":"2023-08-10T10:45:36.152698+0000","last_active":"2023-08-10T10:45:37.916446+0000","last_peered":"2023-08-10T10:45:37.916446+0000","last_clean":"2023-08-10T10:45:37.916446+0000","last_became_active":"2023-08-10T10:45:36.152178+0000","last_became_peered":"2023-08-10T10:45:36.152178+0000","last_unstale":"2023-08-10T10:45:37.916446+0000","last_undegraded":"2023-08-10T10:45:37.916446+0000","last_fullsized":"2023-08-10T10:45:37.916446+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:32.037616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129751+0000","last_change":"2023-08-10T10:45:35.107368+0000","last_active":"2023-08-10T10:45:37.129751+0000","last_peered":"2023-08-10T10:45:37.129751+0000","last_clean":"2023-08-10T10:45:37.129751+0000","last_became_active":"2023-08-10T10:45:35.106393+0000","last_became_peered":"2023-08-10T10:45:35.106393+0000","last_unstale":"2023-08-10T10:45:37.129751+0000","last_undegraded":"2023-08-10T10:45:37.129751+0000","last_fullsized":"2023-08-10T10:45:37.129751+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:21:46.402523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127052+0000","last_change":"2023-08-10T10:45:36.151961+0000","last_active":"2023-08-10T10:45:37.127052+0000","last_peered":"2023-08-10T10:45:37.127052+0000","last_clean":"2023-08-10T10:45:37.127052+0000","last_became_active":"2023-08-10T10:45:36.150797+0000","last_became_peered":"2023-08-10T10:45:36.150797+0000","last_unstale":"2023-08-10T10:45:37.127052+0000","last_undegraded":"2023-08-10T10:45:37.127052+0000","last_fullsized":"2023-08-10T10:45:37.127052+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:48.264583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916600+0000","last_change":"2023-08-10T10:45:35.107081+0000","last_active":"2023-08-10T10:45:37.916600+0000","last_peered":"2023-08-10T10:45:37.916600+0000","last_clean":"2023-08-10T10:45:37.916600+0000","last_became_active":"2023-08-10T10:45:35.106785+0000","last_became_peered":"2023-08-10T10:45:35.106785+0000","last_unstale":"2023-08-10T10:45:37.916600+0000","last_undegraded":"2023-08-10T10:45:37.916600+0000","last_fullsized":"2023-08-10T10:45:37.916600+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:37:48.414837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127477+0000","last_change":"2023-08-10T10:45:36.138232+0000","last_active":"2023-08-10T10:45:37.127477+0000","last_peered":"2023-08-10T10:45:37.127477+0000","last_clean":"2023-08-10T10:45:37.127477+0000","last_became_active":"2023-08-10T10:45:36.137275+0000","last_became_peered":"2023-08-10T10:45:36.137275+0000","last_unstale":"2023-08-10T10:45:37.127477+0000","last_undegraded":"2023-08-10T10:45:37.127477+0000","last_fullsized":"2023-08-10T10:45:37.127477+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:22.899169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"128'3","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292308+0000","last_change":"2023-08-10T10:45:35.109827+0000","last_active":"2023-08-10T10:45:37.292308+0000","last_peered":"2023-08-10T10:45:37.292308+0000","last_clean":"2023-08-10T10:45:37.292308+0000","last_became_active":"2023-08-10T10:45:35.109444+0000","last_became_peered":"2023-08-10T10:45:35.109444+0000","last_unstale":"2023-08-10T10:45:37.292308+0000","last_undegraded":"2023-08-10T10:45:37.292308+0000","last_fullsized":"2023-08-10T10:45:37.292308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:24.300514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126201+0000","last_change":"2023-08-10T10:45:36.141127+0000","last_active":"2023-08-10T10:45:37.126201+0000","last_peered":"2023-08-10T10:45:37.126201+0000","last_clean":"2023-08-10T10:45:37.126201+0000","last_became_active":"2023-08-10T10:45:36.138968+0000","last_became_peered":"2023-08-10T10:45:36.138968+0000","last_unstale":"2023-08-10T10:45:37.126201+0000","last_undegraded":"2023-08-10T10:45:37.126201+0000","last_fullsized":"2023-08-10T10:45:37.126201+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:47.761985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"128'6","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291893+0000","last_change":"2023-08-10T10:45:35.110874+0000","last_active":"2023-08-10T10:45:37.291893+0000","last_peered":"2023-08-10T10:45:37.291893+0000","last_clean":"2023-08-10T10:45:37.291893+0000","last_became_active":"2023-08-10T10:45:35.110526+0000","last_became_peered":"2023-08-10T10:45:35.110526+0000","last_unstale":"2023-08-10T10:45:37.291893+0000","last_undegraded":"2023-08-10T10:45:37.291893+0000","last_fullsized":"2023-08-10T10:45:37.291893+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:40.853252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291132+0000","last_change":"2023-08-10T10:45:36.157893+0000","last_active":"2023-08-10T10:45:37.291132+0000","last_peered":"2023-08-10T10:45:37.291132+0000","last_clean":"2023-08-10T10:45:37.291132+0000","last_became_active":"2023-08-10T10:45:36.153890+0000","last_became_peered":"2023-08-10T10:45:36.153890+0000","last_unstale":"2023-08-10T10:45:37.291132+0000","last_undegraded":"2023-08-10T10:45:37.291132+0000","last_fullsized":"2023-08-10T10:45:37.291132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:35.710642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127242+0000","last_change":"2023-08-10T10:45:35.089805+0000","last_active":"2023-08-10T10:45:37.127242+0000","last_peered":"2023-08-10T10:45:37.127242+0000","last_clean":"2023-08-10T10:45:37.127242+0000","last_became_active":"2023-08-10T10:45:35.089157+0000","last_became_peered":"2023-08-10T10:45:35.089157+0000","last_unstale":"2023-08-10T10:45:37.127242+0000","last_undegraded":"2023-08-10T10:45:37.127242+0000","last_fullsized":"2023-08-10T10:45:37.127242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:10:10.502666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293822+0000","last_change":"2023-08-10T10:45:36.153395+0000","last_active":"2023-08-10T10:45:37.293822+0000","last_peered":"2023-08-10T10:45:37.293822+0000","last_clean":"2023-08-10T10:45:37.293822+0000","last_became_active":"2023-08-10T10:45:36.153085+0000","last_became_peered":"2023-08-10T10:45:36.153085+0000","last_unstale":"2023-08-10T10:45:37.293822+0000","last_undegraded":"2023-08-10T10:45:37.293822+0000","last_fullsized":"2023-08-10T10:45:37.293822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:19.074211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.918078+0000","last_change":"2023-08-10T10:45:35.104317+0000","last_active":"2023-08-10T10:45:37.918078+0000","last_peered":"2023-08-10T10:45:37.918078+0000","last_clean":"2023-08-10T10:45:37.918078+0000","last_became_active":"2023-08-10T10:45:35.104024+0000","last_became_peered":"2023-08-10T10:45:35.104024+0000","last_unstale":"2023-08-10T10:45:37.918078+0000","last_undegraded":"2023-08-10T10:45:37.918078+0000","last_fullsized":"2023-08-10T10:45:37.918078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:49.521981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127968+0000","last_change":"2023-08-10T10:45:36.151457+0000","last_active":"2023-08-10T10:45:37.127968+0000","last_peered":"2023-08-10T10:45:37.127968+0000","last_clean":"2023-08-10T10:45:37.127968+0000","last_became_active":"2023-08-10T10:45:36.150961+0000","last_became_peered":"2023-08-10T10:45:36.150961+0000","last_unstale":"2023-08-10T10:45:37.127968+0000","last_undegraded":"2023-08-10T10:45:37.127968+0000","last_fullsized":"2023-08-10T10:45:37.127968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:35.148809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128198+0000","last_change":"2023-08-10T10:45:35.105917+0000","last_active":"2023-08-10T10:45:37.128198+0000","last_peered":"2023-08-10T10:45:37.128198+0000","last_clean":"2023-08-10T10:45:37.128198+0000","last_became_active":"2023-08-10T10:45:35.102617+0000","last_became_peered":"2023-08-10T10:45:35.102617+0000","last_unstale":"2023-08-10T10:45:37.128198+0000","last_undegraded":"2023-08-10T10:45:37.128198+0000","last_fullsized":"2023-08-10T10:45:37.128198+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:50:42.214826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916257+0000","last_change":"2023-08-10T10:45:36.152705+0000","last_active":"2023-08-10T10:45:37.916257+0000","last_peered":"2023-08-10T10:45:37.916257+0000","last_clean":"2023-08-10T10:45:37.916257+0000","last_became_active":"2023-08-10T10:45:36.152402+0000","last_became_peered":"2023-08-10T10:45:36.152402+0000","last_unstale":"2023-08-10T10:45:37.916257+0000","last_undegraded":"2023-08-10T10:45:37.916257+0000","last_fullsized":"2023-08-10T10:45:37.916257+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:36.396232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"128'8","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128427+0000","last_change":"2023-08-10T10:45:35.104573+0000","last_active":"2023-08-10T10:45:37.128427+0000","last_peered":"2023-08-10T10:45:37.128427+0000","last_clean":"2023-08-10T10:45:37.128427+0000","last_became_active":"2023-08-10T10:45:35.102845+0000","last_became_peered":"2023-08-10T10:45:35.102845+0000","last_unstale":"2023-08-10T10:45:37.128427+0000","last_undegraded":"2023-08-10T10:45:37.128427+0000","last_fullsized":"2023-08-10T10:45:37.128427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:37.642352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916894+0000","last_change":"2023-08-10T10:45:36.143199+0000","last_active":"2023-08-10T10:45:37.916894+0000","last_peered":"2023-08-10T10:45:37.916894+0000","last_clean":"2023-08-10T10:45:37.916894+0000","last_became_active":"2023-08-10T10:45:36.142861+0000","last_became_peered":"2023-08-10T10:45:36.142861+0000","last_unstale":"2023-08-10T10:45:37.916894+0000","last_undegraded":"2023-08-10T10:45:37.916894+0000","last_fullsized":"2023-08-10T10:45:37.916894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:54:24.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126496+0000","last_change":"2023-08-10T10:45:35.095221+0000","last_active":"2023-08-10T10:45:37.126496+0000","last_peered":"2023-08-10T10:45:37.126496+0000","last_clean":"2023-08-10T10:45:37.126496+0000","last_became_active":"2023-08-10T10:45:35.094592+0000","last_became_peered":"2023-08-10T10:45:35.094592+0000","last_unstale":"2023-08-10T10:45:37.126496+0000","last_undegraded":"2023-08-10T10:45:37.126496+0000","last_fullsized":"2023-08-10T10:45:37.126496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:59.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128717+0000","last_change":"2023-08-10T10:45:36.143321+0000","last_active":"2023-08-10T10:45:37.128717+0000","last_peered":"2023-08-10T10:45:37.128717+0000","last_clean":"2023-08-10T10:45:37.128717+0000","last_became_active":"2023-08-10T10:45:36.142828+0000","last_became_peered":"2023-08-10T10:45:36.142828+0000","last_unstale":"2023-08-10T10:45:37.128717+0000","last_undegraded":"2023-08-10T10:45:37.128717+0000","last_fullsized":"2023-08-10T10:45:37.128717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:50.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916977+0000","last_change":"2023-08-10T10:45:35.108271+0000","last_active":"2023-08-10T10:45:37.916977+0000","last_peered":"2023-08-10T10:45:37.916977+0000","last_clean":"2023-08-10T10:45:37.916977+0000","last_became_active":"2023-08-10T10:45:35.107916+0000","last_became_peered":"2023-08-10T10:45:35.107916+0000","last_unstale":"2023-08-10T10:45:37.916977+0000","last_undegraded":"2023-08-10T10:45:37.916977+0000","last_fullsized":"2023-08-10T10:45:37.916977+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:49.051950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.916629+0000","last_change":"2023-08-10T10:45:36.157492+0000","last_active":"2023-08-10T10:45:37.916629+0000","last_peered":"2023-08-10T10:45:37.916629+0000","last_clean":"2023-08-10T10:45:37.916629+0000","last_became_active":"2023-08-10T10:45:36.157233+0000","last_became_peered":"2023-08-10T10:45:36.157233+0000","last_unstale":"2023-08-10T10:45:37.916629+0000","last_undegraded":"2023-08-10T10:45:37.916629+0000","last_fullsized":"2023-08-10T10:45:37.916629+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:07.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292588+0000","last_change":"2023-08-10T10:45:35.109973+0000","last_active":"2023-08-10T10:45:37.292588+0000","last_peered":"2023-08-10T10:45:37.292588+0000","last_clean":"2023-08-10T10:45:37.292588+0000","last_became_active":"2023-08-10T10:45:35.109528+0000","last_became_peered":"2023-08-10T10:45:35.109528+0000","last_unstale":"2023-08-10T10:45:37.292588+0000","last_undegraded":"2023-08-10T10:45:37.292588+0000","last_fullsized":"2023-08-10T10:45:37.292588+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:56:36.886488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290089+0000","last_change":"2023-08-10T10:45:36.152351+0000","last_active":"2023-08-10T10:45:37.290089+0000","last_peered":"2023-08-10T10:45:37.290089+0000","last_clean":"2023-08-10T10:45:37.290089+0000","last_became_active":"2023-08-10T10:45:36.150114+0000","last_became_peered":"2023-08-10T10:45:36.150114+0000","last_unstale":"2023-08-10T10:45:37.290089+0000","last_undegraded":"2023-08-10T10:45:37.290089+0000","last_fullsized":"2023-08-10T10:45:37.290089+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:43:21.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127397+0000","last_change":"2023-08-10T10:45:35.111126+0000","last_active":"2023-08-10T10:45:37.127397+0000","last_peered":"2023-08-10T10:45:37.127397+0000","last_clean":"2023-08-10T10:45:37.127397+0000","last_became_active":"2023-08-10T10:45:35.109868+0000","last_became_peered":"2023-08-10T10:45:35.109868+0000","last_unstale":"2023-08-10T10:45:37.127397+0000","last_undegraded":"2023-08-10T10:45:37.127397+0000","last_fullsized":"2023-08-10T10:45:37.127397+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:06:47.676240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127919+0000","last_change":"2023-08-10T10:45:36.149107+0000","last_active":"2023-08-10T10:45:37.127919+0000","last_peered":"2023-08-10T10:45:37.127919+0000","last_clean":"2023-08-10T10:45:37.127919+0000","last_became_active":"2023-08-10T10:45:36.148469+0000","last_became_peered":"2023-08-10T10:45:36.148469+0000","last_unstale":"2023-08-10T10:45:37.127919+0000","last_undegraded":"2023-08-10T10:45:37.127919+0000","last_fullsized":"2023-08-10T10:45:37.127919+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:47.393733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.129910+0000","last_change":"2023-08-10T10:45:35.108837+0000","last_active":"2023-08-10T10:45:37.129910+0000","last_peered":"2023-08-10T10:45:37.129910+0000","last_clean":"2023-08-10T10:45:37.129910+0000","last_became_active":"2023-08-10T10:45:35.108237+0000","last_became_peered":"2023-08-10T10:45:35.108237+0000","last_unstale":"2023-08-10T10:45:37.129910+0000","last_undegraded":"2023-08-10T10:45:37.129910+0000","last_fullsized":"2023-08-10T10:45:37.129910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:23.419725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127780+0000","last_change":"2023-08-10T10:45:36.152804+0000","last_active":"2023-08-10T10:45:37.127780+0000","last_peered":"2023-08-10T10:45:37.127780+0000","last_clean":"2023-08-10T10:45:37.127780+0000","last_became_active":"2023-08-10T10:45:36.152461+0000","last_became_peered":"2023-08-10T10:45:36.152461+0000","last_unstale":"2023-08-10T10:45:37.127780+0000","last_undegraded":"2023-08-10T10:45:37.127780+0000","last_fullsized":"2023-08-10T10:45:37.127780+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:41:37.601492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128373+0000","last_change":"2023-08-10T10:45:35.106383+0000","last_active":"2023-08-10T10:45:37.128373+0000","last_peered":"2023-08-10T10:45:37.128373+0000","last_clean":"2023-08-10T10:45:37.128373+0000","last_became_active":"2023-08-10T10:45:35.103458+0000","last_became_peered":"2023-08-10T10:45:35.103458+0000","last_unstale":"2023-08-10T10:45:37.128373+0000","last_undegraded":"2023-08-10T10:45:37.128373+0000","last_fullsized":"2023-08-10T10:45:37.128373+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:42:12.406802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293020+0000","last_change":"2023-08-10T10:45:36.155050+0000","last_active":"2023-08-10T10:45:37.293020+0000","last_peered":"2023-08-10T10:45:37.293020+0000","last_clean":"2023-08-10T10:45:37.293020+0000","last_became_active":"2023-08-10T10:45:36.154617+0000","last_became_peered":"2023-08-10T10:45:36.154617+0000","last_unstale":"2023-08-10T10:45:37.293020+0000","last_undegraded":"2023-08-10T10:45:37.293020+0000","last_fullsized":"2023-08-10T10:45:37.293020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:47.296207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293494+0000","last_change":"2023-08-10T10:45:35.110725+0000","last_active":"2023-08-10T10:45:37.293494+0000","last_peered":"2023-08-10T10:45:37.293494+0000","last_clean":"2023-08-10T10:45:37.293494+0000","last_became_active":"2023-08-10T10:45:35.110269+0000","last_became_peered":"2023-08-10T10:45:35.110269+0000","last_unstale":"2023-08-10T10:45:37.293494+0000","last_undegraded":"2023-08-10T10:45:37.293494+0000","last_fullsized":"2023-08-10T10:45:37.293494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:25.854225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290248+0000","last_change":"2023-08-10T10:45:36.153424+0000","last_active":"2023-08-10T10:45:37.290248+0000","last_peered":"2023-08-10T10:45:37.290248+0000","last_clean":"2023-08-10T10:45:37.290248+0000","last_became_active":"2023-08-10T10:45:36.153096+0000","last_became_peered":"2023-08-10T10:45:36.153096+0000","last_unstale":"2023-08-10T10:45:37.290248+0000","last_undegraded":"2023-08-10T10:45:37.290248+0000","last_fullsized":"2023-08-10T10:45:37.290248+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:55.231350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127883+0000","last_change":"2023-08-10T10:45:35.100887+0000","last_active":"2023-08-10T10:45:37.127883+0000","last_peered":"2023-08-10T10:45:37.127883+0000","last_clean":"2023-08-10T10:45:37.127883+0000","last_became_active":"2023-08-10T10:45:35.099095+0000","last_became_peered":"2023-08-10T10:45:35.099095+0000","last_unstale":"2023-08-10T10:45:37.127883+0000","last_undegraded":"2023-08-10T10:45:37.127883+0000","last_fullsized":"2023-08-10T10:45:37.127883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:23.281542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290804+0000","last_change":"2023-08-10T10:45:36.158960+0000","last_active":"2023-08-10T10:45:37.290804+0000","last_peered":"2023-08-10T10:45:37.290804+0000","last_clean":"2023-08-10T10:45:37.290804+0000","last_became_active":"2023-08-10T10:45:36.158279+0000","last_became_peered":"2023-08-10T10:45:36.158279+0000","last_unstale":"2023-08-10T10:45:37.290804+0000","last_undegraded":"2023-08-10T10:45:37.290804+0000","last_fullsized":"2023-08-10T10:45:37.290804+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:59:27.826583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128267+0000","last_change":"2023-08-10T10:45:35.109626+0000","last_active":"2023-08-10T10:45:37.128267+0000","last_peered":"2023-08-10T10:45:37.128267+0000","last_clean":"2023-08-10T10:45:37.128267+0000","last_became_active":"2023-08-10T10:45:35.109093+0000","last_became_peered":"2023-08-10T10:45:35.109093+0000","last_unstale":"2023-08-10T10:45:37.128267+0000","last_undegraded":"2023-08-10T10:45:37.128267+0000","last_fullsized":"2023-08-10T10:45:37.128267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:26:11.918564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":360,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293239+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:45:37.293239+0000","last_peered":"2023-08-10T10:45:37.293239+0000","last_clean":"2023-08-10T10:45:37.293239+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:45:37.293239+0000","last_undegraded":"2023-08-10T10:45:37.293239+0000","last_fullsized":"2023-08-10T10:45:37.293239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:41:22.536775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":220,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.290691+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:45:37.290691+0000","last_peered":"2023-08-10T10:45:37.290691+0000","last_clean":"2023-08-10T10:45:37.290691+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:45:37.290691+0000","last_undegraded":"2023-08-10T10:45:37.290691+0000","last_fullsized":"2023-08-10T10:45:37.290691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:47.471623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293272+0000","last_change":"2023-08-10T10:45:36.150826+0000","last_active":"2023-08-10T10:45:37.293272+0000","last_peered":"2023-08-10T10:45:37.293272+0000","last_clean":"2023-08-10T10:45:37.293272+0000","last_became_active":"2023-08-10T10:45:36.149649+0000","last_became_peered":"2023-08-10T10:45:36.149649+0000","last_unstale":"2023-08-10T10:45:37.293272+0000","last_undegraded":"2023-08-10T10:45:37.293272+0000","last_fullsized":"2023-08-10T10:45:37.293272+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:04.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292049+0000","last_change":"2023-08-10T10:45:35.106725+0000","last_active":"2023-08-10T10:45:37.292049+0000","last_peered":"2023-08-10T10:45:37.292049+0000","last_clean":"2023-08-10T10:45:37.292049+0000","last_became_active":"2023-08-10T10:45:35.106420+0000","last_became_peered":"2023-08-10T10:45:35.106420+0000","last_unstale":"2023-08-10T10:45:37.292049+0000","last_undegraded":"2023-08-10T10:45:37.292049+0000","last_fullsized":"2023-08-10T10:45:37.292049+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:51.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292561+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:45:37.292561+0000","last_peered":"2023-08-10T10:45:37.292561+0000","last_clean":"2023-08-10T10:45:37.292561+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:45:37.292561+0000","last_undegraded":"2023-08-10T10:45:37.292561+0000","last_fullsized":"2023-08-10T10:45:37.292561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:45.430896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126695+0000","last_change":"2023-08-10T10:45:36.152125+0000","last_active":"2023-08-10T10:45:37.126695+0000","last_peered":"2023-08-10T10:45:37.126695+0000","last_clean":"2023-08-10T10:45:37.126695+0000","last_became_active":"2023-08-10T10:45:36.151361+0000","last_became_peered":"2023-08-10T10:45:36.151361+0000","last_unstale":"2023-08-10T10:45:37.126695+0000","last_undegraded":"2023-08-10T10:45:37.126695+0000","last_fullsized":"2023-08-10T10:45:37.126695+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:31.418841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291414+0000","last_change":"2023-08-10T10:45:35.109751+0000","last_active":"2023-08-10T10:45:37.291414+0000","last_peered":"2023-08-10T10:45:37.291414+0000","last_clean":"2023-08-10T10:45:37.291414+0000","last_became_active":"2023-08-10T10:45:35.109401+0000","last_became_peered":"2023-08-10T10:45:35.109401+0000","last_unstale":"2023-08-10T10:45:37.291414+0000","last_undegraded":"2023-08-10T10:45:37.291414+0000","last_fullsized":"2023-08-10T10:45:37.291414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:00:12.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128515+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:45:37.128515+0000","last_peered":"2023-08-10T10:45:37.128515+0000","last_clean":"2023-08-10T10:45:37.128515+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:45:37.128515+0000","last_undegraded":"2023-08-10T10:45:37.128515+0000","last_fullsized":"2023-08-10T10:45:37.128515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:51.187867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128017+0000","last_change":"2023-08-10T10:45:36.142449+0000","last_active":"2023-08-10T10:45:37.128017+0000","last_peered":"2023-08-10T10:45:37.128017+0000","last_clean":"2023-08-10T10:45:37.128017+0000","last_became_active":"2023-08-10T10:45:36.142150+0000","last_became_peered":"2023-08-10T10:45:36.142150+0000","last_unstale":"2023-08-10T10:45:37.128017+0000","last_undegraded":"2023-08-10T10:45:37.128017+0000","last_fullsized":"2023-08-10T10:45:37.128017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:21.601994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292422+0000","last_change":"2023-08-10T10:45:35.109807+0000","last_active":"2023-08-10T10:45:37.292422+0000","last_peered":"2023-08-10T10:45:37.292422+0000","last_clean":"2023-08-10T10:45:37.292422+0000","last_became_active":"2023-08-10T10:45:35.108966+0000","last_became_peered":"2023-08-10T10:45:35.108966+0000","last_unstale":"2023-08-10T10:45:37.292422+0000","last_undegraded":"2023-08-10T10:45:37.292422+0000","last_fullsized":"2023-08-10T10:45:37.292422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.604658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":220,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.291619+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:45:37.291619+0000","last_peered":"2023-08-10T10:45:37.291619+0000","last_clean":"2023-08-10T10:45:37.291619+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:45:37.291619+0000","last_undegraded":"2023-08-10T10:45:37.291619+0000","last_fullsized":"2023-08-10T10:45:37.291619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:37.304749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.917137+0000","last_change":"2023-08-10T10:45:36.154151+0000","last_active":"2023-08-10T10:45:37.917137+0000","last_peered":"2023-08-10T10:45:37.917137+0000","last_clean":"2023-08-10T10:45:37.917137+0000","last_became_active":"2023-08-10T10:45:36.153872+0000","last_became_peered":"2023-08-10T10:45:36.153872+0000","last_unstale":"2023-08-10T10:45:37.917137+0000","last_undegraded":"2023-08-10T10:45:37.917137+0000","last_fullsized":"2023-08-10T10:45:37.917137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:25.580631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293574+0000","last_change":"2023-08-10T10:45:35.111422+0000","last_active":"2023-08-10T10:45:37.293574+0000","last_peered":"2023-08-10T10:45:37.293574+0000","last_clean":"2023-08-10T10:45:37.293574+0000","last_became_active":"2023-08-10T10:45:35.111195+0000","last_became_peered":"2023-08-10T10:45:35.111195+0000","last_unstale":"2023-08-10T10:45:37.293574+0000","last_undegraded":"2023-08-10T10:45:37.293574+0000","last_fullsized":"2023-08-10T10:45:37.293574+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:38.464316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":224,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127597+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:45:37.127597+0000","last_peered":"2023-08-10T10:45:37.127597+0000","last_clean":"2023-08-10T10:45:37.127597+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:45:37.127597+0000","last_undegraded":"2023-08-10T10:45:37.127597+0000","last_fullsized":"2023-08-10T10:45:37.127597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:51.849455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128216+0000","last_change":"2023-08-10T10:45:36.149282+0000","last_active":"2023-08-10T10:45:37.128216+0000","last_peered":"2023-08-10T10:45:37.128216+0000","last_clean":"2023-08-10T10:45:37.128216+0000","last_became_active":"2023-08-10T10:45:36.148862+0000","last_became_peered":"2023-08-10T10:45:36.148862+0000","last_unstale":"2023-08-10T10:45:37.128216+0000","last_undegraded":"2023-08-10T10:45:37.128216+0000","last_fullsized":"2023-08-10T10:45:37.128216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:50:38.076668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128343+0000","last_change":"2023-08-10T10:45:35.105931+0000","last_active":"2023-08-10T10:45:37.128343+0000","last_peered":"2023-08-10T10:45:37.128343+0000","last_clean":"2023-08-10T10:45:37.128343+0000","last_became_active":"2023-08-10T10:45:35.105011+0000","last_became_peered":"2023-08-10T10:45:35.105011+0000","last_unstale":"2023-08-10T10:45:37.128343+0000","last_undegraded":"2023-08-10T10:45:37.128343+0000","last_fullsized":"2023-08-10T10:45:37.128343+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:44.576481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.292286+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:45:37.292286+0000","last_peered":"2023-08-10T10:45:37.292286+0000","last_clean":"2023-08-10T10:45:37.292286+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:45:37.292286+0000","last_undegraded":"2023-08-10T10:45:37.292286+0000","last_fullsized":"2023-08-10T10:45:37.292286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:10.051636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915900+0000","last_change":"2023-08-10T10:45:36.149558+0000","last_active":"2023-08-10T10:45:37.915900+0000","last_peered":"2023-08-10T10:45:37.915900+0000","last_clean":"2023-08-10T10:45:37.915900+0000","last_became_active":"2023-08-10T10:45:36.149281+0000","last_became_peered":"2023-08-10T10:45:36.149281+0000","last_unstale":"2023-08-10T10:45:37.915900+0000","last_undegraded":"2023-08-10T10:45:37.915900+0000","last_fullsized":"2023-08-10T10:45:37.915900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:20.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.128404+0000","last_change":"2023-08-10T10:45:35.107217+0000","last_active":"2023-08-10T10:45:37.128404+0000","last_peered":"2023-08-10T10:45:37.128404+0000","last_clean":"2023-08-10T10:45:37.128404+0000","last_became_active":"2023-08-10T10:45:35.106901+0000","last_became_peered":"2023-08-10T10:45:35.106901+0000","last_unstale":"2023-08-10T10:45:37.128404+0000","last_undegraded":"2023-08-10T10:45:37.128404+0000","last_fullsized":"2023-08-10T10:45:37.128404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:02:31.473584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":224,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.126408+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:45:37.126408+0000","last_peered":"2023-08-10T10:45:37.126408+0000","last_clean":"2023-08-10T10:45:37.126408+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:45:37.126408+0000","last_undegraded":"2023-08-10T10:45:37.126408+0000","last_fullsized":"2023-08-10T10:45:37.126408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:13.787883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.915994+0000","last_change":"2023-08-10T10:45:36.145752+0000","last_active":"2023-08-10T10:45:37.915994+0000","last_peered":"2023-08-10T10:45:37.915994+0000","last_clean":"2023-08-10T10:45:37.915994+0000","last_became_active":"2023-08-10T10:45:36.145414+0000","last_became_peered":"2023-08-10T10:45:36.145414+0000","last_unstale":"2023-08-10T10:45:37.915994+0000","last_undegraded":"2023-08-10T10:45:37.915994+0000","last_fullsized":"2023-08-10T10:45:37.915994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:35.073509+0000","last_clean_scrub_stamp":"2023-08-10T10:45:35.073509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:33.706110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.127756+0000","last_change":"2023-08-10T10:45:35.097554+0000","last_active":"2023-08-10T10:45:37.127756+0000","last_peered":"2023-08-10T10:45:37.127756+0000","last_clean":"2023-08-10T10:45:37.127756+0000","last_became_active":"2023-08-10T10:45:35.096878+0000","last_became_peered":"2023-08-10T10:45:35.096878+0000","last_unstale":"2023-08-10T10:45:37.127756+0000","last_undegraded":"2023-08-10T10:45:37.127756+0000","last_fullsized":"2023-08-10T10:45:37.127756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:45:34.068063+0000","last_clean_scrub_stamp":"2023-08-10T10:45:34.068063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:28.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-10T10:45:37.293033+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:45:37.293033+0000","last_peered":"2023-08-10T10:45:37.293033+0000","last_clean":"2023-08-10T10:45:37.293033+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:45:37.293033+0000","last_undegraded":"2023-08-10T10:45:37.293033+0000","last_fullsized":"2023-08-10T10:45:37.293033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:17.539757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1321,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193990,"statfs":{"total":200000000,"available":198646357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1000000000000001,"15min":1.1279999999999999},"min":{"1min":0.57999999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":4.4550000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.0840000000000001},"min":{"1min":0.58999999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":5.149,"15min":5.149},"last":7.3570000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.173,"15min":1.1419999999999999},"min":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":4.6470000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.1519999999999999,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":8.0830000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.196,"15min":1.2170000000000001},"min":{"1min":0.70199999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5229999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":7.4329999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":4.5700000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.21,"15min":1.212},"min":{"1min":0.76300000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.556,"5min":1.766,"15min":1.766},"last":6.5190000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.98599999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":6.069}]},{"osd":4,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.26,"15min":1.236},"min":{"1min":0.85399999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.825,"5min":1.99,"15min":1.99},"last":7.1950000000000003},{"interface":"front","average":{"1min":1.278,"5min":1.3089999999999999,"15min":1.2729999999999999},"min":{"1min":0.755,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.74,"5min":6.657,"15min":6.657},"last":7.4950000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.1659999999999999,"5min":0.60599999999999998,"15min":0.59699999999999998},"max":{"1min":3.3940000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":6.0090000000000003},{"interface":"front","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.488},"min":{"1min":0.95599999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0699999999999998,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":7.5529999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5349999999999999,"15min":1.5740000000000001},"min":{"1min":1.238,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.3140000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":8.859},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.484,"15min":1.4970000000000001},"min":{"1min":1.077,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0099999999999998,"5min":3.585,"15min":3.585},"last":7.1139999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199234717,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.113,"15min":1.0589999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6279999999999999,"5min":1.75,"15min":1.7509999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.01},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.46600000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":1.2509999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1140000000000001,"15min":1.069},"min":{"1min":0.72399999999999998,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.302,"15min":2.302},"last":1.355},{"interface":"front","average":{"1min":1.234,"5min":1.256,"15min":1.1830000000000001},"min":{"1min":0.83899999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.819,"5min":2.052,"15min":2.052},"last":2.052}]},{"osd":2,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.198,"15min":1.139},"min":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.72299999999999998},"max":{"1min":1.7230000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.476},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2749999999999999,"15min":1.2270000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6339999999999999,"5min":1.968,"15min":1.968},"last":1.429}]},{"osd":3,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3460000000000001,"15min":1.228},"min":{"1min":0.80700000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6719999999999999,"5min":3.177,"15min":3.177},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.321,"15min":1.262},"min":{"1min":0.84299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.71,"5min":2.395,"15min":2.395},"last":1.718}]},{"osd":4,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2829999999999999,"15min":1.214},"min":{"1min":0.60699999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.7010000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.494,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":2.0009999999999999,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.9670000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.478,"15min":1.407},"min":{"1min":0.69999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.802,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5760000000000001,"15min":1.4990000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":2.1139999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.867}]},{"osd":7,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.429,"15min":1.371},"min":{"1min":1.0089999999999999,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":2.0600000000000001,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5589999999999999,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.016,"5min":2.5819999999999999,"15min":2.698},"last":1.7549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194568,"statfs":{"total":200000000,"available":199237904,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1339999999999999,"15min":1.0920000000000001},"min":{"1min":0.73299999999999998,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":2.5070000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.4790000000000001,"15min":1.214},"min":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.64000000000000001},"max":{"1min":1.6899999999999999,"5min":32.941000000000003,"15min":32.941000000000003},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.68899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.762,"5min":1.762,"15min":2.2450000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.165,"15min":1.208},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.651,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.635}]},{"osd":2,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.24,"15min":1.323},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.857,"5min":1.857,"15min":4.1980000000000004},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.1950000000000001,"15min":1.159},"min":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5920000000000001,"5min":1.653,"15min":1.73},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.26},"min":{"1min":0.81899999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7410000000000001,"5min":1.7669999999999999,"15min":1.7709999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3080000000000001,"15min":1.363},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.8120000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.2310000000000001,"15min":1.2869999999999999},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3660000000000001,"15min":1.3600000000000001},"min":{"1min":0.85299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7689999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5149999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3879999999999999,"15min":1.3280000000000001},"min":{"1min":0.80200000000000005,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":2.04},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3979999999999999,"15min":1.387},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":1.9650000000000001,"15min":1.98},"last":1.6699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4830000000000001,"15min":1.488},"min":{"1min":0.90400000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.831,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.498,"15min":1.4910000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.893}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":2.2559999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.538,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.286},"min":{"1min":0.93100000000000005,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.7809999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.159,"15min":1.141},"min":{"1min":0.747,"5min":0.67900000000000005,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.4950000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2050000000000001,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.66000000000000003,"15min":0.621},"max":{"1min":1.48,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.347,"15min":1.304},"min":{"1min":1.083,"5min":0.85099999999999998,"15min":0.70499999999999996},"max":{"1min":1.835,"5min":4.226,"15min":4.226},"last":1.538}]},{"osd":3,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3069999999999999,"15min":1.256},"min":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.893,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.554},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3700000000000001,"15min":1.2909999999999999},"min":{"1min":0.91500000000000004,"5min":0.82699999999999996,"15min":0.67000000000000004},"max":{"1min":2.5600000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.577}]},{"osd":5,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.385,"15min":1.363},"min":{"1min":0.876,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":1.863,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.024},{"interface":"front","average":{"1min":1.252,"5min":1.3340000000000001,"15min":1.298},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.42399999999999999},"max":{"1min":1.6859999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.389}]},{"osd":6,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.375,"15min":1.335},"min":{"1min":0.746,"5min":0.746,"15min":0.47599999999999998},"max":{"1min":2.6190000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.228},{"interface":"front","average":{"1min":1.425,"5min":1.5429999999999999,"15min":1.4790000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.76700000000000002},"max":{"1min":1.7529999999999999,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.169}]},{"osd":7,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.502,"15min":1.4339999999999999},"min":{"1min":0.999,"5min":0.82699999999999996,"15min":0.57999999999999996},"max":{"1min":1.8859999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.611},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5880000000000001,"15min":1.5189999999999999},"min":{"1min":1.054,"5min":0.96699999999999997,"15min":0.73499999999999999},"max":{"1min":2.6659999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.728}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242956,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92500000000000004,"15min":0.83099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.6060000000000001,"5min":1.8140000000000001,"15min":2.1019999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.145,"15min":0.98799999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.9590000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93700000000000006,"15min":0.83899999999999997},"min":{"1min":0.54500000000000004,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.353,"5min":1.5569999999999999,"15min":1.6599999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0649999999999999,"15min":0.93999999999999995},"min":{"1min":0.54100000000000004,"5min":0.51100000000000001,"15min":0.34100000000000003},"max":{"1min":1.587,"5min":1.752,"15min":1.897},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0229999999999999,"15min":0.94099999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.181,"15min":1.069},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.46899999999999997},"max":{"1min":1.5309999999999999,"5min":1.958,"15min":2.0430000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.8169999999999999,"5min":1.427,"15min":1.264},"min":{"1min":0.86699999999999999,"5min":0.78200000000000003,"15min":0.70599999999999996},"max":{"1min":9.8149999999999995,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.266,"15min":1.202},"min":{"1min":0.83199999999999996,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":1.5940000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4019999999999999,"15min":1.3240000000000001},"min":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":1.835,"5min":1.8400000000000001,"15min":2.125},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.4219999999999999,"15min":1.3660000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1890000000000001,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":1.286}]},{"osd":6,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.383,"15min":1.2789999999999999},"min":{"1min":0.88200000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.345},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4570000000000001,"15min":1.399},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9279999999999999,"5min":1.984,"15min":2.1539999999999999},"last":1.48}]},{"osd":7,"last update":"Thu Aug 10 10:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4750000000000001,"15min":1.431},"min":{"1min":0.88900000000000001,"5min":0.754,"15min":0.754},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.421,"15min":1.3420000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.881,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.24}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.44800000000000001,"15min":0.44500000000000001},"max":{"1min":1.3779999999999999,"5min":1.464,"15min":1.5209999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.999,"15min":0.90300000000000002},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.443},"max":{"1min":1.468,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.135,"15min":1.0529999999999999},"min":{"1min":0.70299999999999996,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.621,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.181},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.234,"15min":1.127},"min":{"1min":0.58799999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.242}]},{"osd":3,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.59499999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.226,"15min":1.246},"min":{"1min":0.63400000000000001,"5min":0.626,"15min":0.57599999999999996},"max":{"1min":1.5960000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.5920000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4119999999999999,"15min":1.419},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.82699999999999996},"max":{"1min":1.734,"5min":2.415,"15min":2.6000000000000001},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.387,"15min":1.3160000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.83199999999999996},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.333}]},{"osd":5,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3160000000000001,"15min":1.274},"min":{"1min":0.89600000000000002,"5min":0.85099999999999998,"15min":0.81000000000000005},"max":{"1min":1.5760000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.292},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.5009999999999999,"15min":1.482},"min":{"1min":0.91500000000000004,"5min":0.876,"15min":0.86599999999999999},"max":{"1min":1.8480000000000001,"5min":3.294,"15min":3.294},"last":1.806}]},{"osd":6,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.454,"15min":1.387},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.81599999999999995},"max":{"1min":1.9930000000000001,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.4179999999999999,"15min":1.3580000000000001},"min":{"1min":0.89500000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8879999999999999,"5min":2.444,"15min":2.444},"last":1.5669999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.528,"15min":1.419},"min":{"1min":1.1240000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.125,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4730000000000001,"15min":1.4259999999999999},"min":{"1min":0.99399999999999999,"5min":0.89900000000000002,"15min":0.81100000000000005},"max":{"1min":1.655,"5min":2.556,"15min":2.556},"last":1.7669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89800000000000002,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.3220000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0009999999999999,"15min":0.94499999999999995},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":1.647,"5min":2.012,"15min":2.246},"last":0.749}]},{"osd":2,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.038,"15min":0.88900000000000001},"min":{"1min":0.54300000000000004,"5min":0.5,"15min":0.436},"max":{"1min":1.792,"5min":1.8320000000000001,"15min":2.0209999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2470000000000001,"15min":1.069},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.671,"5min":2.423,"15min":2.423},"last":1.069}]},{"osd":3,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1910000000000001,"15min":1.0629999999999999},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.45400000000000001},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0900000000000001,"15min":1.036},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42399999999999999},"max":{"1min":1.8,"5min":1.9059999999999999,"15min":2.8940000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.2749999999999999,"15min":1.1739999999999999},"min":{"1min":0.93600000000000005,"5min":0.78000000000000003,"15min":0.65500000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.4690000000000001,"15min":1.3919999999999999},"min":{"1min":1.0449999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2989999999999999,"5min":2.343,"15min":2.343},"last":1.6499999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.417,"15min":1.363},"min":{"1min":0.94999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.98,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.113},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4350000000000001,"15min":1.3180000000000001},"min":{"1min":0.98399999999999999,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":2.387,"5min":2.73,"15min":2.73},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4299999999999999,"15min":1.3660000000000001},"min":{"1min":0.85899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.444},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4179999999999999,"15min":1.2709999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.77300000000000002},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.462}]},{"osd":7,"last update":"Thu Aug 10 10:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4950000000000001,"15min":1.4379999999999999},"min":{"1min":1.1259999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.742},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.5149999999999999,"15min":1.4019999999999999},"min":{"1min":0.82699999999999996,"5min":0.625,"15min":0.625},"max":{"1min":2.0379999999999998,"5min":2.1640000000000001,"15min":2.605},"last":1.5169999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1315,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193996,"statfs":{"total":200000000,"available":198652535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.27,"5min":1.546,"15min":1.546},"last":8.6899999999999995},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.0369999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.411,"5min":1.633,"15min":1.853},"last":11.173}]},{"osd":2,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.026,"15min":1.0249999999999999},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.5760000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":2.7240000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.617,"5min":1.7,"15min":1.7},"last":1.694}]},{"osd":3,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.034,"15min":0.95599999999999996},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.585,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":4.8570000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1970000000000001,"15min":1.117},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.9670000000000001,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":10.739000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.387,"15min":1.282},"min":{"1min":1.1220000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.734,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":4.6980000000000004},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4099999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.883,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":2.1230000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.736,"5min":1.9259999999999999,"15min":1.986},"last":1.522},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.5409999999999999,"15min":1.353},"min":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6719999999999999,"5min":16.058,"15min":16.058},"last":7.532}]},{"osd":6,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.482,"15min":1.456},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8220000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":2.4790000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4430000000000001,"15min":1.4339999999999999},"min":{"1min":0.94199999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9179999999999999,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.5049999999999999,"15min":1.522},"min":{"1min":1.038,"5min":0.752,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.786},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4990000000000001,"15min":1.423},"min":{"1min":1.0389999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.778,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":4.9939999999999998}]}]}],"pool_statfs":[]}} 2023-08-10T10:45:41.132 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:45:41.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:45:41.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.410+0000 7f566f36a640 1 Processor -- start 2023-08-10T10:45:41.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.411+0000 7f566f36a640 1 -- start start 2023-08-10T10:45:41.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566f36a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f566815ae40 0x7f56680b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566f36a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56680cd9b0 0x7f56680ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566f36a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56680adcb0 con 0x7f566806cb30 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566f36a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566806c320 con 0x7f56680cd9b0 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566f36a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566806b770 con 0x7f566815ae40 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566c905640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f566806cb30 0x7f56680cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48228/0 (socket says 172.21.15.50:48228) 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566c905640 1 -- 172.21.15.50:0/946931526 learned_addr learned my addr 172.21.15.50:0/946931526 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.412+0000 7f566d907640 1 --2- 172.21.15.50:0/946931526 >> v2:172.21.15.50:3300/0 conn(0x7f56680cd9b0 0x7f56680ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f566d106640 1 --2- 172.21.15.50:0/946931526 >> v2:172.21.15.117:3300/0 conn(0x7f566815ae40 0x7f56680b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f566d907640 1 -- 172.21.15.50:0/946931526 >> v2:172.21.15.117:3300/0 conn(0x7f566815ae40 msgr2=0x7f56680b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f566d907640 1 --2- 172.21.15.50:0/946931526 >> v2:172.21.15.117:3300/0 conn(0x7f566815ae40 0x7f56680b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f565ffff640 1 -- 172.21.15.50:0/946931526 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249420451 0 0) 0x7f56680adcb0 con 0x7f566806cb30 2023-08-10T10:45:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f566d907640 1 -- 172.21.15.50:0/946931526 >> v1:172.21.15.50:6789/0 conn(0x7f566806cb30 legacy=0x7f56680cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.413+0000 7f566d907640 1 -- 172.21.15.50:0/946931526 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566806b9f0 con 0x7f56680cd9b0 2023-08-10T10:45:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.414+0000 7f566d907640 1 --2- 172.21.15.50:0/946931526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56680cd9b0 0x7f56680ad770 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f566806e6f0 tx=0x7f566002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c338261629df00a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.414+0000 7f565ffff640 1 -- 172.21.15.50:0/946931526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566002cc80 con 0x7f56680cd9b0 2023-08-10T10:45:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.414+0000 7f565ffff640 1 -- 172.21.15.50:0/946931526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566002cde0 con 0x7f56680cd9b0 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.414+0000 7f565ffff640 1 -- 172.21.15.50:0/946931526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660034660 con 0x7f56680cd9b0 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 -- 172.21.15.50:0/946931526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56680cd9b0 msgr2=0x7f56680ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 --2- 172.21.15.50:0/946931526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56680cd9b0 0x7f56680ad770 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f566806e6f0 tx=0x7f566002bed0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 -- 172.21.15.50:0/946931526 shutdown_connections 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 --2- 172.21.15.50:0/946931526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56680cd9b0 0x7f56680ad770 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 --2- 172.21.15.50:0/946931526 >> v2:172.21.15.117:3300/0 conn(0x7f566815ae40 0x7f56680b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 -- 172.21.15.50:0/946931526 >> 172.21.15.50:0/946931526 conn(0x7f56680b01b0 msgr2=0x7f56680b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 -- 172.21.15.50:0/946931526 shutdown_connections 2023-08-10T10:45:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.415+0000 7f566f36a640 1 -- 172.21.15.50:0/946931526 wait complete. 2023-08-10T10:45:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.417+0000 7f566f36a640 1 Processor -- start 2023-08-10T10:45:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.417+0000 7f566f36a640 1 -- start start 2023-08-10T10:45:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56680cd9b0 0x7f566815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566815ae40 0x7f56680c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668157220 con 0x7f566806cb30 2023-08-10T10:45:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56680c2390 con 0x7f566815ae40 2023-08-10T10:45:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.418+0000 7f566f36a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56680c2670 con 0x7f56680cd9b0 2023-08-10T10:45:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39792/0 (socket says 172.21.15.50:39792) 2023-08-10T10:45:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 -- 172.21.15.50:0/619879401 learned_addr learned my addr 172.21.15.50:0/619879401 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 -- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56680cd9b0 msgr2=0x7f566815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56680cd9b0 0x7f566815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 -- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566815ae40 msgr2=0x7f56680c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566815ae40 0x7f56680c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 -- 172.21.15.50:0/619879401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660009a70 con 0x7f566806cb30 2023-08-10T10:45:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.419+0000 7f566d106640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f566400d5f0 tx=0x7f566400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.420+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640125f0 con 0x7f566806cb30 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.420+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664012750 con 0x7f566806cb30 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.420+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664012b00 con 0x7f566806cb30 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.420+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56680c2950 con 0x7f566806cb30 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.420+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566815c050 con 0x7f566806cb30 2023-08-10T10:45:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.421+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56680612b0 con 0x7f566806cb30 2023-08-10T10:45:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.422+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5664012c60 con 0x7f566806cb30 2023-08-10T10:45:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.423+0000 7f565dffb640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 0x7f564c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.423+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56640899a0 con 0x7f566806cb30 2023-08-10T10:45:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.423+0000 7f566c905640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 0x7f564c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.424+0000 7f566c905640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 0x7f564c06d140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5658007fd0 tx=0x7f5658007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.427+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5664054a40 con 0x7f566806cb30 2023-08-10T10:45:41.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.697+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f56680ad4b0 con 0x7f566806cb30 2023-08-10T10:45:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.705+0000 7f565dffb640 1 -- 172.21.15.50:0/619879401 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5664058060 con 0x7f566806cb30 2023-08-10T10:45:41.706 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:45:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:45:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:45:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:45:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:45:41.707 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:45:41.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 msgr2=0x7f564c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 0x7f564c06d140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5658007fd0 tx=0x7f5658007960 comp rx=0 tx=0).stop 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 msgr2=0x7f5668156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f566400d5f0 tx=0x7f566400dab0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 shutdown_connections 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f564c06ac80 0x7f564c06d140 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566815ae40 0x7f56680c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56680cd9b0 0x7f566815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 --2- 172.21.15.50:0/619879401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f566806cb30 0x7f5668156ce0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.708+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 >> 172.21.15.50:0/619879401 conn(0x7f56680b01b0 msgr2=0x7f56680af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.709+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 shutdown_connections 2023-08-10T10:45:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.709+0000 7f566f36a640 1 -- 172.21.15.50:0/619879401 wait complete. 2023-08-10T10:45:41.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:41.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.951+0000 7fa2ab59e640 1 Processor -- start 2023-08-10T10:45:41.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.951+0000 7fa2ab59e640 1 -- start start 2023-08-10T10:45:41.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2ab59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac15a940 0x7fa2ac0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2ab59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2ac0b19d0 0x7fa2ac0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2ab59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0b1f10 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2ab59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0b21f0 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2ab59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac15e5c0 con 0x7fa2ac15a940 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2aad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2ac0b19d0 0x7fa2ac0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2a9d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2ac15f2b0 0x7fa2ac0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48232/0 (socket says 172.21.15.50:48232) 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.953+0000 7fa2a9d9b640 1 -- 172.21.15.50:0/3311651713 learned_addr learned my addr 172.21.15.50:0/3311651713 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2aa59c640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac15a940 0x7fa2ac0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3311651713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac15a940 msgr2=0x7fa2ac0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:41.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2aad9d640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac15a940 0x7fa2ac0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3311651713 >> v1:172.21.15.50:6789/0 conn(0x7fa2ac15f2b0 legacy=0x7fa2ac0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3311651713 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac15e7d0 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.954+0000 7fa2a959a640 1 -- 172.21.15.50:0/3311651713 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148615566 0 0) 0x7fa2ac0b1f10 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.955+0000 7fa2aad9d640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac0b19d0 0x7fa2ac0b0450 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5648c58230761c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.955+0000 7fa2a959a640 1 -- 172.21.15.50:0/3311651713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a402cbc0 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.955+0000 7fa2a959a640 1 -- 172.21.15.50:0/3311651713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a402cd20 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.955+0000 7fa2a959a640 1 -- 172.21.15.50:0/3311651713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4034660 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3311651713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac0b19d0 msgr2=0x7fa2ac0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac0b19d0 0x7fa2ac0b0450 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a402be10 comp rx=0 tx=0).stop 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3311651713 shutdown_connections 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac0b19d0 0x7fa2ac0b0450 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3311651713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac15a940 0x7fa2ac0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3311651713 >> 172.21.15.50:0/3311651713 conn(0x7fa2ac06ab80 msgr2=0x7fa2ac06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3311651713 shutdown_connections 2023-08-10T10:45:41.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.956+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3311651713 wait complete. 2023-08-10T10:45:41.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.958+0000 7fa2ab59e640 1 Processor -- start 2023-08-10T10:45:41.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.958+0000 7fa2ab59e640 1 -- start start 2023-08-10T10:45:41.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0b19d0 0x7fa2ac1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 0x7fa2ac0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06ef10 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06e700 con 0x7fa2ac15a940 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2ab59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06e950 con 0x7fa2ac0b19d0 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39816/0 (socket says 172.21.15.50:39816) 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.959+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3601152319 learned_addr learned my addr 172.21.15.50:0/3601152319 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2a9d9b640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 0x7fa2ac0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0b19d0 msgr2=0x7fa2ac1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0b19d0 0x7fa2ac1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 msgr2=0x7fa2ac0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:41.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 0x7fa2ac0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 -- 172.21.15.50:0/3601152319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009a70 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2a9d9b640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 0x7fa2ac0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2aad9d640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4003b90 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a402ce90 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac06ec30 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.960+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4004030 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.961+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0708f0 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.962+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac070ae0 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.963+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2a403b050 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.964+0000 7fa29affd640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 0x7fa28c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:41.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.964+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2a40ab960 con 0x7fa2ac15f2b0 2023-08-10T10:45:41.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.964+0000 7fa2aa59c640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 0x7fa28c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:41.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.965+0000 7fa2aa59c640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 0x7fa28c06d110 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa29c006fd0 tx=0x7fa29c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:41.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:41.969+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa2a4076a10 con 0x7fa2ac15f2b0 2023-08-10T10:45:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.202+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2ac066e30 con 0x7fa2ac15f2b0 2023-08-10T10:45:42.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.202+0000 7fa29affd640 1 -- 172.21.15.50:0/3601152319 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fa2a407a030 con 0x7fa2ac15f2b0 2023-08-10T10:45:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:42.204 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:45:42.204 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:45:42.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 msgr2=0x7fa28c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 0x7fa28c06d110 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa29c006fd0 tx=0x7fa29c008040 comp rx=0 tx=0).stop 2023-08-10T10:45:42.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 msgr2=0x7fa2ac070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a4004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:42.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 shutdown_connections 2023-08-10T10:45:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac15f2b0 0x7fa2ac070e10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa28c06ac50 0x7fa28c06d110 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac15a940 0x7fa2ac0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 --2- 172.21.15.50:0/3601152319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0b19d0 0x7fa2ac1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.205+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 >> 172.21.15.50:0/3601152319 conn(0x7fa2ac06ab80 msgr2=0x7fa2ac0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.206+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 shutdown_connections 2023-08-10T10:45:42.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.206+0000 7fa2ab59e640 1 -- 172.21.15.50:0/3601152319 wait complete. 2023-08-10T10:45:42.628 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:45:35.597193+0000', 'modified': '2023-08-10T10:45:39.161017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7539}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7539': {'gid': 7539, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6837/37638804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6835', 'nonce': 37638804}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 37638804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:45:42.628 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:45:42.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:45:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.870+0000 7f796bfff640 1 Processor -- start 2023-08-10T10:45:42.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.870+0000 7f796bfff640 1 -- start start 2023-08-10T10:45:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.871+0000 7f796bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f796c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.871+0000 7f796bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f796c0d28b0 0x7f796c0d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796bfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c160370 con 0x7f796c0cd960 2023-08-10T10:45:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0d0b90 con 0x7f796c0d28b0 2023-08-10T10:45:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1614d0 con 0x7f796c15ff90 2023-08-10T10:45:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f796c0cd960 0x7f796c0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48234/0 (socket says 172.21.15.50:48234) 2023-08-10T10:45:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796a7fc640 1 -- 172.21.15.50:0/3471315231 learned_addr learned my addr 172.21.15.50:0/3471315231 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:42.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796b7fe640 1 --2- 172.21.15.50:0/3471315231 >> v2:172.21.15.117:3300/0 conn(0x7f796c0d28b0 0x7f796c0d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f796affd640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f796c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584494525 0 0) 0x7f7960001110 con 0x7f796c0cd960 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.872+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7954003520 con 0x7f796c0cd960 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 46239173 0 0) 0x7f7954003520 con 0x7f796c0cd960 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 msgr2=0x7f796c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f796c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 >> v2:172.21.15.117:3300/0 conn(0x7f796c0d28b0 msgr2=0x7f796c0d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 --2- 172.21.15.50:0/3471315231 >> v2:172.21.15.117:3300/0 conn(0x7f796c0d28b0 0x7f796c0d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0d0d90 con 0x7f796c0cd960 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7960001800 con 0x7f796c0cd960 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 >> v1:172.21.15.50:6789/0 conn(0x7f796c0cd960 legacy=0x7f796c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79540039e0 0x7f7954003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f79540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954004d00 0x7f7954005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0d0b90 con 0x7f7954004d00 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1614d0 con 0x7f79540039e0 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795400b980 con 0x7f796c15ff90 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.873+0000 7f796b7fe640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954004d00 0x7f7954005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796affd640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79540039e0 0x7f7954003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796a7fc640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f79540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796b7fe640 1 -- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 msgr2=0x7f79540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796b7fe640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796c15ff90 0x7f79540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796b7fe640 1 -- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79540039e0 msgr2=0x7f7954003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796b7fe640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79540039e0 0x7f7954003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796b7fe640 1 -- 172.21.15.50:0/3471315231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954003520 con 0x7f7954004d00 2023-08-10T10:45:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.874+0000 7f796affd640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79540039e0 0x7f7954003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:42.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.875+0000 7f796b7fe640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954004d00 0x7f7954005180 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ac0 tx=0x7f79540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2aff1ca4fafa86 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.875+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796402c710 con 0x7f7954004d00 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796402c870 con 0x7f7954004d00 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f7969ffb640 1 -- 172.21.15.50:0/3471315231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796402cc00 con 0x7f7954004d00 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 -- 172.21.15.50:0/3471315231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954004d00 msgr2=0x7f7954005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 --2- 172.21.15.50:0/3471315231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954004d00 0x7f7954005180 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ac0 tx=0x7f79540057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796b7fe640 1 -- 172.21.15.50:0/3471315231 reap_dead start 2023-08-10T10:45:42.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 -- 172.21.15.50:0/3471315231 shutdown_connections 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 -- 172.21.15.50:0/3471315231 >> 172.21.15.50:0/3471315231 conn(0x7f796c069ac0 msgr2=0x7f796c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 -- 172.21.15.50:0/3471315231 shutdown_connections 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.876+0000 7f796bfff640 1 -- 172.21.15.50:0/3471315231 wait complete. 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.878+0000 7f796bfff640 1 Processor -- start 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.878+0000 7f796bfff640 1 -- start start 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 0x7f796c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 0x7f796c1f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1f3cd0 con 0x7f796c1f4d70 2023-08-10T10:45:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1f3fb0 con 0x7f796c0c75a0 2023-08-10T10:45:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1f4290 con 0x7f7954004d00 2023-08-10T10:45:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.879+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39828/0 (socket says 172.21.15.50:39828) 2023-08-10T10:45:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 -- 172.21.15.50:0/630211791 learned_addr learned my addr 172.21.15.50:0/630211791 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796a7fc640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 0x7f796c1f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796affd640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 0x7f796c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 -- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 msgr2=0x7f796c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 0x7f796c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 -- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 msgr2=0x7f796c1f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 0x7f796c1f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 -- 172.21.15.50:0/630211791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c1f4570 con 0x7f796c1f4d70 2023-08-10T10:45:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796a7fc640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 0x7f796c1f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796affd640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 0x7f796c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.880+0000 7f796b7fe640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ac0 tx=0x7f7964004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.881+0000 7f79537fe640 1 -- 172.21.15.50:0/630211791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964003810 con 0x7f796c1f4d70 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.881+0000 7f79537fe640 1 -- 172.21.15.50:0/630211791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964003970 con 0x7f796c1f4d70 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.881+0000 7f79537fe640 1 -- 172.21.15.50:0/630211791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964003d20 con 0x7f796c1f4d70 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.881+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c1f4850 con 0x7f796c1f4d70 2023-08-10T10:45:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.881+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1f3910 con 0x7f796c1f4d70 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.883+0000 7f79537fe640 1 -- 172.21.15.50:0/630211791 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f796403e440 con 0x7f796c1f4d70 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.884+0000 7f79537fe640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 0x7f795806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.884+0000 7f79537fe640 1 -- 172.21.15.50:0/630211791 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7964000e40 con 0x7f796c1f4d70 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.885+0000 7f796affd640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 0x7f795806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.885+0000 7f7974426740 1 Processor -- start 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.885+0000 7f796affd640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 0x7f795806d140 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f795c007440 tx=0x7f795c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.885+0000 7f7974426740 1 -- start start 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 0x562ee8556900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8556e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee84999d0 con 0x562ee8559690 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee84970c0 con 0x562ee852d210 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee84929b0 con 0x562ee8529610 2023-08-10T10:45:42.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f796affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f796affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39836/0 (socket says 172.21.15.50:39836) 2023-08-10T10:45:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.886+0000 7f796affd640 1 -- 172.21.15.50:0/2215171424 learned_addr learned my addr 172.21.15.50:0/2215171424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796a7fc640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 0x562ee8556900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796b7fe640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8556e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 -- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 msgr2=0x562ee8556900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 0x562ee8556900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 -- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 msgr2=0x562ee8556e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8556e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 -- 172.21.15.50:0/2215171424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ee845fc10 con 0x562ee8559690 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796a7fc640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 0x562ee8556900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796b7fe640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8556e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.887+0000 7f796affd640 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f795c0177f0 tx=0x7f795c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d27961daf431e3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7950ff9640 1 -- 172.21.15.50:0/2215171424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00e040 con 0x562ee8559690 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7950ff9640 1 -- 172.21.15.50:0/2215171424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c003b90 con 0x562ee8559690 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7950ff9640 1 -- 172.21.15.50:0/2215171424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c015990 con 0x562ee8559690 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 -- 172.21.15.50:0/2215171424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 msgr2=0x562ee8559a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f795c0177f0 tx=0x7f795c014000 comp rx=0 tx=0).stop 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 -- 172.21.15.50:0/2215171424 shutdown_connections 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8556e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8529610 0x562ee8556900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 --2- 172.21.15.50:0/2215171424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee8559a70 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 -- 172.21.15.50:0/2215171424 >> 172.21.15.50:0/2215171424 conn(0x562ee852b920 msgr2=0x562ee85744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 -- 172.21.15.50:0/2215171424 shutdown_connections 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.888+0000 7f7974426740 1 -- 172.21.15.50:0/2215171424 wait complete. 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.889+0000 7f7974426740 1 -- start start 2023-08-10T10:45:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.889+0000 7f7974426740 1 Processor -- start 2023-08-10T10:45:42.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8554130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8560050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee8433940 con 0x562ee8559690 2023-08-10T10:45:42.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee84335e0 con 0x562ee855fbd0 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee81f9f20 con 0x562ee852d210 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f7974426740 10 client.0 _ll_register_callbacks cb 0x562ee848c250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39850/0 (socket says 172.21.15.50:39850) 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 -- 172.21.15.50:0/461001880 learned_addr learned my addr 172.21.15.50:0/461001880 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796affd640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8554130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796b7fe640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8560050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 -- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 msgr2=0x562ee8554130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8554130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 -- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 msgr2=0x562ee8560050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8560050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796a7fc640 1 -- 172.21.15.50:0/461001880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c0174a0 con 0x562ee8559690 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.891+0000 7f796affd640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8554130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f796a7fc640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f79600104c0 tx=0x7f7960010980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67f31b8b73880ce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7949ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960013770 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ee84bcbf0 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79600138d0 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7960013a90 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7974426740 10 client.7689 fetch_fsmap learned FSMap version 59 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.892+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x562ee8491030 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ee84bcbf0 con 0x562ee8559690 2023-08-10T10:45:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 59) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7960013bf0 con 0x562ee8559690 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 10 client.7689 fetch_fsmap finished waiting for FSMap version 59 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 10 client.7689 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 20 client.7689 populate_metadata read hostname 'smithi050' 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85848e0 0x562ee8584cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 4 client.7689 mds_command: new command op to 7539 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 --> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ee84857c0 con 0x562ee85848e0 2023-08-10T10:45:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.893+0000 7f796affd640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85848e0 0x562ee8584cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.894+0000 7f796affd640 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85848e0 0x562ee8584cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653fc465e5f065f0 server_cookie=5eab328cf89621 in_seq=0 out_seq=0 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.894+0000 7f7949ffb640 10 client.7689 ms_handle_connect on v2:172.21.15.50:6835/37638804 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.894+0000 7f7949ffb640 1 -- 172.21.15.50:0/461001880 <== mds.0 v2:172.21.15.50:6835/37638804 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562ee84857c0 con 0x562ee85848e0 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.894+0000 7f7949ffb640 10 client.7689 handle_command_reply: tid=0 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 client.7689 shutdown 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 msgr2=0x562ee855a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f79600104c0 tx=0x7f7960010980 comp rx=0 tx=0).stop 2023-08-10T10:45:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 shutdown_connections 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8560050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a310 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85848e0 0x562ee8584cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 --2- 172.21.15.50:0/461001880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8554130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 >> 172.21.15.50:0/461001880 conn(0x562ee8529610 msgr2=0x562ee85779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7949ffb640 0 client.7689 ms_handle_reset on v2:172.21.15.50:6835/37638804 2023-08-10T10:45:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 shutdown_connections 2023-08-10T10:45:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 1 -- 172.21.15.50:0/461001880 wait complete. 2023-08-10T10:45:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.895+0000 7f7974426740 20 client.7689 trim_cache size 0 max 16384 2023-08-10T10:45:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.912+0000 7f7974426740 1 Processor -- start 2023-08-10T10:45:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.912+0000 7f7974426740 1 -- start start 2023-08-10T10:45:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8559a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8559690 0x562ee855a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee855ffd0 con 0x562ee855fbd0 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee854ed50 con 0x562ee852d210 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee85613d0 con 0x562ee8559690 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39862/0 (socket says 172.21.15.50:39862) 2023-08-10T10:45:42.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.913+0000 7f796b7fe640 1 -- 172.21.15.50:0/626827795 learned_addr learned my addr 172.21.15.50:0/626827795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796a7fc640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8559690 0x562ee855a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796affd640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8559a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 -- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8559690 msgr2=0x562ee855a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8559690 0x562ee855a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 -- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 msgr2=0x562ee8559a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8559a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 -- 172.21.15.50:0/626827795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ee84c68a0 con 0x562ee855fbd0 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796affd640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8559a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f796b7fe640 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f796402c380 tx=0x7f7964079770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5720752bcb58c2b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f79517fa640 1 -- 172.21.15.50:0/626827795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964081bc0 con 0x562ee855fbd0 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f79517fa640 1 -- 172.21.15.50:0/626827795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964077c10 con 0x562ee855fbd0 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.914+0000 7f79517fa640 1 -- 172.21.15.50:0/626827795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964075f80 con 0x562ee855fbd0 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 -- 172.21.15.50:0/626827795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 msgr2=0x562ee8555740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f796402c380 tx=0x7f7964079770 comp rx=0 tx=0).stop 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 -- 172.21.15.50:0/626827795 shutdown_connections 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee855fbd0 0x562ee8555740 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee8559690 0x562ee855a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 --2- 172.21.15.50:0/626827795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee852d210 0x562ee8559a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 -- 172.21.15.50:0/626827795 >> 172.21.15.50:0/626827795 conn(0x562ee8529610 msgr2=0x562ee855d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 -- 172.21.15.50:0/626827795 shutdown_connections 2023-08-10T10:45:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.915+0000 7f7974426740 1 -- 172.21.15.50:0/626827795 wait complete. 2023-08-10T10:45:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.916+0000 7f7974426740 1 -- start start 2023-08-10T10:45:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.916+0000 7f7974426740 1 Processor -- start 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8528690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8528dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee8578170 con 0x562ee8559690 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee8583050 con 0x562ee855fbd0 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee855f610 con 0x562ee852d210 2023-08-10T10:45:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.917+0000 7f7974426740 10 client.0 _ll_register_callbacks cb 0x7f7960005cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39872/0 (socket says 172.21.15.50:39872) 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 -- 172.21.15.50:0/3104668698 learned_addr learned my addr 172.21.15.50:0/3104668698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 -- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 msgr2=0x562ee8528690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8528690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 -- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 msgr2=0x562ee8528dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8528dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 -- 172.21.15.50:0/3104668698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1f3910 con 0x562ee8559690 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f796a7fc640 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f79600104c0 tx=0x7f7960001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0991daa2673f799 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.918+0000 7f7949ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960013770 con 0x562ee8559690 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7960010e80 con 0x562ee8559690 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f795c003b90 con 0x562ee8559690 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7960014a10 con 0x562ee8559690 2023-08-10T10:45:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 10 client.7695 fetch_fsmap learned FSMap version 59 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x562ee8432610 con 0x562ee8559690 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c003b90 con 0x562ee8559690 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 59) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f79600138d0 con 0x562ee8559690 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 10 client.7695 fetch_fsmap finished waiting for FSMap version 59 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 10 client.7695 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 20 client.7695 populate_metadata read hostname 'smithi050' 2023-08-10T10:45:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85dfde0 0x562ee85e01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 4 client.7695 mds_command: new command op to 7539 tid=0[{"prefix": "status"}] 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.919+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 --> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562ee848b990 con 0x562ee85dfde0 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f796affd640 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85dfde0 0x562ee85e01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f796affd640 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85dfde0 0x562ee85e01c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583eb39d180aa37f server_cookie=6d01ea767d8a21d0 in_seq=0 out_seq=0 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f7949ffb640 10 client.7695 ms_handle_connect on v2:172.21.15.50:6835/37638804 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f7949ffb640 1 -- 172.21.15.50:0/3104668698 <== mds.0 v2:172.21.15.50:6835/37638804 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x562ee848b990 con 0x562ee85dfde0 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f7949ffb640 10 client.7695 handle_command_reply: tid=0 2023-08-10T10:45:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f7974426740 1 client.7695 shutdown 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.920+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 msgr2=0x562ee855a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f79600104c0 tx=0x7f7960001ac0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 shutdown_connections 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ee855fbd0 0x562ee8528dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ee8559690 0x562ee855a840 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.50:6835/37638804,v1:172.21.15.50:6837/37638804] conn(0x562ee85dfde0 0x562ee85e01c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 --2- 172.21.15.50:0/3104668698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ee852d210 0x562ee8528690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 >> 172.21.15.50:0/3104668698 conn(0x562ee8529610 msgr2=0x562ee855d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7949ffb640 0 client.7695 ms_handle_reset on v2:172.21.15.50:6835/37638804 2023-08-10T10:45:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 shutdown_connections 2023-08-10T10:45:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 1 -- 172.21.15.50:0/3104668698 wait complete. 2023-08-10T10:45:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.921+0000 7f7974426740 20 client.7695 trim_cache size 0 max 16384 2023-08-10T10:45:42.928 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7539, 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.7651732830000002, 2023-08-10T10:45:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 59, 2023-08-10T10:45:42.930 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 129, 2023-08-10T10:45:42.930 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 129, 2023-08-10T10:45:42.930 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.718005205000001 2023-08-10T10:45:42.930 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 msgr2=0x7f795806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 0x7f795806d140 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f795c007440 tx=0x7f795c00b040 comp rx=0 tx=0).stop 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 msgr2=0x7f796c1f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ac0 tx=0x7f7964004730 comp rx=0 tx=0).stop 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 shutdown_connections 2023-08-10T10:45:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f796c1f4d70 0x7f796c1f51f0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f795806ac80 0x7f795806d140 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f796c0c75a0 0x7f796c1f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 --2- 172.21.15.50:0/630211791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7954004d00 0x7f796c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 >> 172.21.15.50:0/630211791 conn(0x7f796c069ac0 msgr2=0x7f796c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 shutdown_connections 2023-08-10T10:45:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:42.922+0000 7f796bfff640 1 -- 172.21.15.50:0/630211791 wait complete. 2023-08-10T10:45:42.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:45:43.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.157+0000 7fabcffff640 1 Processor -- start 2023-08-10T10:45:43.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.157+0000 7fabcffff640 1 -- start start 2023-08-10T10:45:43.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabcffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd0159830 0x7fabd00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabcffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabd0069db0 0x7fabd00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabcffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd015def0 con 0x7fabd00cde40 2023-08-10T10:45:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabcffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00ce350 con 0x7fabd0069db0 2023-08-10T10:45:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabcffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd015e380 con 0x7fabd0159830 2023-08-10T10:45:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabce7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabd00cde40 0x7fabd00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48238/0 (socket says 172.21.15.50:48238) 2023-08-10T10:45:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.159+0000 7fabce7fc640 1 -- 172.21.15.50:0/2403261814 learned_addr learned my addr 172.21.15.50:0/2403261814 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcf7fe640 1 --2- 172.21.15.50:0/2403261814 >> v2:172.21.15.50:3300/0 conn(0x7fabd0069db0 0x7fabd00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabceffd640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd0159830 0x7fabd00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcdffb640 1 -- 172.21.15.50:0/2403261814 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046053335 0 0) 0x7fabd015def0 con 0x7fabd00cde40 2023-08-10T10:45:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcdffb640 1 -- 172.21.15.50:0/2403261814 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb8003520 con 0x7fabd00cde40 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcf7fe640 1 -- 172.21.15.50:0/2403261814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd0159830 msgr2=0x7fabd00cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcf7fe640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd0159830 0x7fabd00cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcf7fe640 1 -- 172.21.15.50:0/2403261814 >> v1:172.21.15.50:6789/0 conn(0x7fabd00cde40 legacy=0x7fabd00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.160+0000 7fabcf7fe640 1 -- 172.21.15.50:0/2403261814 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd015d5c0 con 0x7fabd0069db0 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.161+0000 7fabcf7fe640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd00cc420 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009d90 tx=0x7fabc802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb4992014925442 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.161+0000 7fabcdffb640 1 -- 172.21.15.50:0/2403261814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc802cc60 con 0x7fabd0069db0 2023-08-10T10:45:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.161+0000 7fabcdffb640 1 -- 172.21.15.50:0/2403261814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc802cdc0 con 0x7fabd0069db0 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcdffb640 1 -- 172.21.15.50:0/2403261814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8034660 con 0x7fabd0069db0 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 -- 172.21.15.50:0/2403261814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 msgr2=0x7fabd00cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd00cc420 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009d90 tx=0x7fabc802beb0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 -- 172.21.15.50:0/2403261814 shutdown_connections 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd00cc420 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 --2- 172.21.15.50:0/2403261814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd0159830 0x7fabd00cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 -- 172.21.15.50:0/2403261814 >> 172.21.15.50:0/2403261814 conn(0x7fabd00cafa0 msgr2=0x7fabd00cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 -- 172.21.15.50:0/2403261814 shutdown_connections 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.162+0000 7fabcffff640 1 -- 172.21.15.50:0/2403261814 wait complete. 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.164+0000 7fabcffff640 1 Processor -- start 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.164+0000 7fabcffff640 1 -- start start 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00cde40 0x7fabd00c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd0159830 0x7fabd00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c40c0 con 0x7fabd0069db0 2023-08-10T10:45:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c3ad0 con 0x7fabd0159830 2023-08-10T10:45:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabcffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c3db0 con 0x7fabd00cde40 2023-08-10T10:45:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39884/0 (socket says 172.21.15.50:39884) 2023-08-10T10:45:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.165+0000 7fabceffd640 1 -- 172.21.15.50:0/1489425520 learned_addr learned my addr 172.21.15.50:0/1489425520 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 -- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00cde40 msgr2=0x7fabd00c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00cde40 0x7fabd00c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 -- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd0159830 msgr2=0x7fabd00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd0159830 0x7fabd00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 -- 172.21.15.50:0/1489425520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009a70 con 0x7fabd0069db0 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabceffd640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d5f0 tx=0x7fabc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00125f0 con 0x7fabd0069db0 2023-08-10T10:45:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc0012750 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0012b00 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.166+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd015ba50 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.167+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd006b330 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.168+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd006b520 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.169+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabc0012c60 con 0x7fabd0069db0 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.169+0000 7fabb7fff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 0x7fabbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.170+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabc0089a50 con 0x7fabd0069db0 2023-08-10T10:45:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.170+0000 7fabce7fc640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 0x7fabbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.170+0000 7fabce7fc640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 0x7fabbc06d110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fabd00711c0 tx=0x7fabc4007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.174+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fabc0054a60 con 0x7fabd0069db0 2023-08-10T10:45:43.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.400+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fabd0066e30 con 0x7fabd0069db0 2023-08-10T10:45:43.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.401+0000 7fabb7fff640 1 -- 172.21.15.50:0/1489425520 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fabc0058080 con 0x7fabd0069db0 2023-08-10T10:45:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 msgr2=0x7fabbc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 0x7fabbc06d110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fabd00711c0 tx=0x7fabc4007930 comp rx=0 tx=0).stop 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 msgr2=0x7fabd006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d5f0 tx=0x7fabc000dab0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 shutdown_connections 2023-08-10T10:45:43.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fabbc06ac50 0x7fabbc06d110 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd0159830 0x7fabd00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00cde40 0x7fabd00c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 --2- 172.21.15.50:0/1489425520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd0069db0 0x7fabd006adf0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 >> 172.21.15.50:0/1489425520 conn(0x7fabd00cafa0 msgr2=0x7fabd00ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 shutdown_connections 2023-08-10T10:45:43.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:43.403+0000 7fabcffff640 1 -- 172.21.15.50:0/1489425520 wait complete. 2023-08-10T10:45:43.422 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:45:43.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:45:43.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:45:43.423 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:45:43.424 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:43.424 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:45:43.424 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:45:43.425 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:45:43.425 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:45:43.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.426 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:45:43.479 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:45:43.480 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:45:43.480 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:45:43.480 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.480 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:45:43.480 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.481 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:43.481 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:43.481 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:45:43.482 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:43.482 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:43.482 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:45:43.482 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:45:43.482 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40782sec preferred_lft 40782sec 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:43.483 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:45:43.484 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.485 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:45:43.485 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:45:43.485 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:45:43.485 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.485 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:45:43.486 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:45:43.486 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:45:43.486 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:43.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.487 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:45:43.573 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:45:43.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.578 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:45:43.630 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:45:43.630 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:45:43.630 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:45:43.630 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:45:43.631 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:45:43.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.631 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:45:43.632 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:45:43.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:45:43.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:45:43.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:45:43.634 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:45:43.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.830 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:45:43.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:45:43.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:45:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:45:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:45:43.888 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:45:43.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:43.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:45:44.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:45:44.026 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:44.130 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:45:44.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:45:44.130 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:44.185 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:45:44.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:44.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:44.336 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:44.336 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:45:44.371 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:44.371 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:45:44.371 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:45:44.371 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:45:44.371 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:45:44.373 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:45:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:45:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:45:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:45:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:45:44.377 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:45:44.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:44.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:44.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:44.480 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:44.562 INFO:teuthology.orchestra.run.smithi050.stdout:client6151 2023-08-10T10:45:44.563 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:44.563 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:44.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:45:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.851+0000 7f922c8d3640 1 Processor -- start 2023-08-10T10:45:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.851+0000 7f922c8d3640 1 -- start start 2023-08-10T10:45:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f922c8d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92280b0c60 0x7f92280c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f922c8d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92280b3f30 0x7f92280c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f922c8d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9228071c70 con 0x7f922815aa40 2023-08-10T10:45:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f922c8d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280713d0 con 0x7f92280b3f30 2023-08-10T10:45:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f922c8d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280716b0 con 0x7f92280b0c60 2023-08-10T10:45:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f9226d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92280b3f30 0x7f92280c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f9226d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92280b3f30 0x7f92280c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39886/0 (socket says 172.21.15.50:39886) 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.853+0000 7f9226d9d640 1 -- 172.21.15.50:0/4005789102 learned_addr learned my addr 172.21.15.50:0/4005789102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.854+0000 7f921dd9b640 1 --2- 172.21.15.50:0/4005789102 >> v2:172.21.15.117:3300/0 conn(0x7f92280b0c60 0x7f92280c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.854+0000 7f9226d9d640 1 -- 172.21.15.50:0/4005789102 >> v2:172.21.15.117:3300/0 conn(0x7f92280b0c60 msgr2=0x7f92280c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.854+0000 7f9226d9d640 1 --2- 172.21.15.50:0/4005789102 >> v2:172.21.15.117:3300/0 conn(0x7f92280b0c60 0x7f92280c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.854+0000 7f9226d9d640 1 -- 172.21.15.50:0/4005789102 >> v1:172.21.15.117:6789/0 conn(0x7f922815aa40 legacy=0x7f92280b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.854+0000 7f9226d9d640 1 -- 172.21.15.50:0/4005789102 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228071990 con 0x7f92280b3f30 2023-08-10T10:45:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.855+0000 7f9226d9d640 1 --2- 172.21.15.50:0/4005789102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280c9e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f922815e6e0 tx=0x7f922002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a2b7412ed08ad7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.855+0000 7f9225d9b640 1 -- 172.21.15.50:0/4005789102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92200317e0 con 0x7f92280b3f30 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.855+0000 7f9225d9b640 1 -- 172.21.15.50:0/4005789102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220031940 con 0x7f92280b3f30 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.855+0000 7f9225d9b640 1 -- 172.21.15.50:0/4005789102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220031cd0 con 0x7f92280b3f30 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 -- 172.21.15.50:0/4005789102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 msgr2=0x7f92280c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 --2- 172.21.15.50:0/4005789102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280c9e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f922815e6e0 tx=0x7f922002b880 comp rx=0 tx=0).stop 2023-08-10T10:45:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 -- 172.21.15.50:0/4005789102 shutdown_connections 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 --2- 172.21.15.50:0/4005789102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280c9e60 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 --2- 172.21.15.50:0/4005789102 >> v2:172.21.15.117:3300/0 conn(0x7f92280b0c60 0x7f92280c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 -- 172.21.15.50:0/4005789102 >> 172.21.15.50:0/4005789102 conn(0x7f922806b590 msgr2=0x7f92280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 -- 172.21.15.50:0/4005789102 shutdown_connections 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.856+0000 7f922c8d3640 1 -- 172.21.15.50:0/4005789102 wait complete. 2023-08-10T10:45:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.858+0000 7f922c8d3640 1 Processor -- start 2023-08-10T10:45:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.858+0000 7f922c8d3640 1 -- start start 2023-08-10T10:45:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 0x7f9228155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f922815aa40 0x7f922814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228156e50 con 0x7f92280b3f30 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228156030 con 0x7f92280b0c60 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f922c8d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9228156310 con 0x7f922815aa40 2023-08-10T10:45:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f921dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f921dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39896/0 (socket says 172.21.15.50:39896) 2023-08-10T10:45:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.859+0000 7f921dd9b640 1 -- 172.21.15.50:0/1715718078 learned_addr learned my addr 172.21.15.50:0/1715718078 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f9226d9d640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f922815aa40 0x7f922814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f922659c640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 0x7f9228155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 -- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f922815aa40 msgr2=0x7f922814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f922815aa40 0x7f922814e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 -- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 msgr2=0x7f9228155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 0x7f9228155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 -- 172.21.15.50:0/1715718078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200094d0 con 0x7f92280b3f30 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f922659c640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 0x7f9228155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921dd9b640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9210007ef0 tx=0x7f921000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210014620 con 0x7f92280b3f30 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210014780 con 0x7f92280b3f30 2023-08-10T10:45:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.860+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210014b30 con 0x7f92280b3f30 2023-08-10T10:45:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.861+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92281565f0 con 0x7f92280b3f30 2023-08-10T10:45:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.861+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228153990 con 0x7f92280b3f30 2023-08-10T10:45:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.862+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9228153b20 con 0x7f92280b3f30 2023-08-10T10:45:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.863+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9210014c90 con 0x7f92280b3f30 2023-08-10T10:45:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.864+0000 7f921f7fe640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 0x7f920806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.864+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9210089f20 con 0x7f92280b3f30 2023-08-10T10:45:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.864+0000 7f922659c640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 0x7f920806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.865+0000 7f922659c640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 0x7f920806d110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f921800a830 tx=0x7f9218008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:44.868+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9210054fc0 con 0x7f92280b3f30 2023-08-10T10:45:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.101+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9228157000 con 0x7f92280b3f30 2023-08-10T10:45:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.102+0000 7f921f7fe640 1 -- 172.21.15.50:0/1715718078 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9228157000 con 0x7f92280b3f30 2023-08-10T10:45:45.102 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:45:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.104+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 msgr2=0x7f920806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.104+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 0x7f920806d110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f921800a830 tx=0x7f9218008040 comp rx=0 tx=0).stop 2023-08-10T10:45:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.104+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 msgr2=0x7f92280cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.104+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9210007ef0 tx=0x7f921000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:45:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 shutdown_connections 2023-08-10T10:45:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f922815aa40 0x7f922814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92280b3f30 0x7f92280cce50 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f920806ac50 0x7f920806d110 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 --2- 172.21.15.50:0/1715718078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92280b0c60 0x7f9228155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 >> 172.21.15.50:0/1715718078 conn(0x7f922806b590 msgr2=0x7f9228159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.105+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 shutdown_connections 2023-08-10T10:45:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:45.106+0000 7f922c8d3640 1 -- 172.21.15.50:0/1715718078 wait complete. 2023-08-10T10:45:45.125 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:45:45.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:45:45.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:45:45.126 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:45:45.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:45.127 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:45:45.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:45:45.127 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:45:45.127 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:45:45.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.128 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:45:45.191 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:45:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:45:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:45:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 40952sec preferred_lft 40952sec 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:45:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.194 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:45:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:45:45.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.197 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:45:45.292 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:45:45.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.296 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:45:45.350 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:45:45.350 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:45:45.350 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:45:45.351 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:45:45.351 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:45:45.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.352 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:45:45.352 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:45:45.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:45:45.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:45:45.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:45:45.354 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:45:45.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.534 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:45:45.585 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:45:45.586 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:45:45.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:45:45.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:45:45.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:45:45.679 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:45.730 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:45:45.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:45:45.731 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:45.776 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:45:45.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:45.909 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:45.910 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:45:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:45:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:45:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:45:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:45:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:45:45.946 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:45:45.946 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:45:45.946 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:45:45.946 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:45:45.946 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:45:45.949 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:45:45.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:45.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:46.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:46.027 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:46.080 INFO:teuthology.orchestra.run.smithi117.stdout:client5735 2023-08-10T10:45:46.080 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:46.081 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:46.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:46.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.368+0000 7f8024ed9640 1 Processor -- start 2023-08-10T10:45:46.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.369+0000 7f8024ed9640 1 -- start start 2023-08-10T10:45:46.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.370+0000 7f8024ed9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8020159970 0x7f80200b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.370+0000 7f8024ed9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8020069db0 0x7f80200b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.370+0000 7f8024ed9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802015e1f0 con 0x7f80200b0f00 2023-08-10T10:45:46.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.370+0000 7f8024ed9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802015d5e0 con 0x7f8020069db0 2023-08-10T10:45:46.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.370+0000 7f8024ed9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802015d8c0 con 0x7f8020159970 2023-08-10T10:45:46.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8020069db0 0x7f80200b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:46.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8020069db0 0x7f80200b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34576/0 (socket says 172.21.15.50:34576) 2023-08-10T10:45:46.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 -- 172.21.15.50:0/1875054863 learned_addr learned my addr 172.21.15.50:0/1875054863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:46.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801e59c640 1 --2- 172.21.15.50:0/1875054863 >> v2:172.21.15.117:3300/0 conn(0x7f8020159970 0x7f80200b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:46.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 -- 172.21.15.50:0/1875054863 >> v2:172.21.15.117:3300/0 conn(0x7f8020159970 msgr2=0x7f80200b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:46.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 --2- 172.21.15.50:0/1875054863 >> v2:172.21.15.117:3300/0 conn(0x7f8020159970 0x7f80200b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 -- 172.21.15.50:0/1875054863 >> v1:172.21.15.117:6789/0 conn(0x7f80200b0f00 legacy=0x7f80200696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:46.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.371+0000 7f801ed9d640 1 -- 172.21.15.50:0/1875054863 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802015dba0 con 0x7f8020069db0 2023-08-10T10:45:46.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.372+0000 7f801ed9d640 1 --2- 172.21.15.50:0/1875054863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020069db0 0x7f80200b1ae0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f80200ce530 tx=0x7f801802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783dbf80dada21df server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:46.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.373+0000 7f801dd9b640 1 -- 172.21.15.50:0/1875054863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801802ca80 con 0x7f8020069db0 2023-08-10T10:45:46.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.373+0000 7f801dd9b640 1 -- 172.21.15.50:0/1875054863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801802cbe0 con 0x7f8020069db0 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.373+0000 7f801dd9b640 1 -- 172.21.15.50:0/1875054863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180343f0 con 0x7f8020069db0 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.373+0000 7f8024ed9640 1 -- 172.21.15.50:0/1875054863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020069db0 msgr2=0x7f80200b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.373+0000 7f8024ed9640 1 --2- 172.21.15.50:0/1875054863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020069db0 0x7f80200b1ae0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f80200ce530 tx=0x7f801802bee0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 -- 172.21.15.50:0/1875054863 shutdown_connections 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 --2- 172.21.15.50:0/1875054863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020069db0 0x7f80200b1ae0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 --2- 172.21.15.50:0/1875054863 >> v2:172.21.15.117:3300/0 conn(0x7f8020159970 0x7f80200b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 -- 172.21.15.50:0/1875054863 >> 172.21.15.50:0/1875054863 conn(0x7f802006b590 msgr2=0x7f80200ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 -- 172.21.15.50:0/1875054863 shutdown_connections 2023-08-10T10:45:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.374+0000 7f8024ed9640 1 -- 172.21.15.50:0/1875054863 wait complete. 2023-08-10T10:45:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.375+0000 7f8024ed9640 1 Processor -- start 2023-08-10T10:45:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.376+0000 7f8024ed9640 1 -- start start 2023-08-10T10:45:46.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.376+0000 7f8024ed9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8020069db0 0x7f8020165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.376+0000 7f8024ed9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8024ed9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020159970 0x7f80200c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8024ed9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c8630 con 0x7f80200b0f00 2023-08-10T10:45:46.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8024ed9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020166520 con 0x7f8020069db0 2023-08-10T10:45:46.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8024ed9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8020166800 con 0x7f8020159970 2023-08-10T10:45:46.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:46.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34584/0 (socket says 172.21.15.50:34584) 2023-08-10T10:45:46.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 -- 172.21.15.50:0/4075971442 learned_addr learned my addr 172.21.15.50:0/4075971442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:46.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 -- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020159970 msgr2=0x7f80200c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:46.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020159970 0x7f80200c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 -- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8020069db0 msgr2=0x7f8020165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:46.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8020069db0 0x7f8020165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.377+0000 7f8017fff640 1 -- 172.21.15.50:0/4075971442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009b30 con 0x7f80200b0f00 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8017fff640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f800800c410 tx=0x7f800800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080035f0 con 0x7f80200b0f00 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008003750 con 0x7f80200b0f00 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008003b40 con 0x7f80200b0f00 2023-08-10T10:45:46.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020166ae0 con 0x7f80200b0f00 2023-08-10T10:45:46.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.378+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80201670a0 con 0x7f80200b0f00 2023-08-10T10:45:46.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.379+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802015d000 con 0x7f80200b0f00 2023-08-10T10:45:46.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.381+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8008003ca0 con 0x7f80200b0f00 2023-08-10T10:45:46.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.382+0000 7f8016ffd640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 0x7f800006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:46.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.382+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8008088710 con 0x7f80200b0f00 2023-08-10T10:45:46.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.382+0000 7f801e59c640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 0x7f800006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:46.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.383+0000 7f801e59c640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 0x7f800006d140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8010006fd0 tx=0x7f8010008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:46.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.386+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8008053720 con 0x7f80200b0f00 2023-08-10T10:45:46.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.622+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80200668c0 con 0x7f80200b0f00 2023-08-10T10:45:46.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.622+0000 7f8016ffd640 1 -- 172.21.15.50:0/4075971442 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f8008086e60 con 0x7f80200b0f00 2023-08-10T10:45:46.624 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:46.624 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:45:46.624 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:45:46.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 msgr2=0x7f800006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:46.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 0x7f800006d140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8010006fd0 tx=0x7f8010008040 comp rx=0 tx=0).stop 2023-08-10T10:45:46.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 msgr2=0x7f80200c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:46.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f800800c410 tx=0x7f800800c8d0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 shutdown_connections 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020159970 0x7f80200c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80200b0f00 0x7f80200c80f0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f800006ac80 0x7f800006d140 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 --2- 172.21.15.50:0/4075971442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8020069db0 0x7f8020165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 >> 172.21.15.50:0/4075971442 conn(0x7f802006b590 msgr2=0x7f80200cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:46.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 shutdown_connections 2023-08-10T10:45:46.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:46.625+0000 7f8024ed9640 1 -- 172.21.15.50:0/4075971442 wait complete. 2023-08-10T10:45:46.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:45:46.889 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":7539,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.717801089,"mdsmap_epoch":59,"osdmap_epoch":129,"osdmap_epoch_barrier":129,"uptime":16.670632035000001} 2023-08-10T10:45:46.890 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 7539, "mdsmap_epoch": 59, "osdmap_epoch": 129, "osdmap_epoch_barrier": 129, "rank_uptime": 10.717801089, "state": "up:active", "uptime": 16.670632035, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:45:46.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-10T10:45:47.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.125+0000 7f14189c2640 1 Processor -- start 2023-08-10T10:45:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.125+0000 7f14189c2640 1 -- start start 2023-08-10T10:45:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.126+0000 7f14189c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1414157460 0x7f141415a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.126+0000 7f14189c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14140cd730 0x7f141415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.126+0000 7f14189c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141406fa90 con 0x7f14140cd2d0 2023-08-10T10:45:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.126+0000 7f14189c2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141415ad60 con 0x7f1414157460 2023-08-10T10:45:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.126+0000 7f14189c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1414157840 con 0x7f14140cd730 2023-08-10T10:45:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.127+0000 7f141259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1414157460 0x7f141415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.127+0000 7f141259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1414157460 0x7f141415a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42938/0 (socket says 172.21.15.50:42938) 2023-08-10T10:45:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.127+0000 7f141259c640 1 -- 172.21.15.50:0/3320705677 learned_addr learned my addr 172.21.15.50:0/3320705677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.127+0000 7f1412d9d640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14140cd730 0x7f141415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.128+0000 7f141259c640 1 -- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14140cd730 msgr2=0x7f141415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.128+0000 7f141259c640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14140cd730 0x7f141415daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.128+0000 7f141259c640 1 -- 172.21.15.50:0/3320705677 >> v1:172.21.15.117:6789/0 conn(0x7f14140cd2d0 legacy=0x7f141415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.128+0000 7f141259c640 1 -- 172.21.15.50:0/3320705677 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141406a970 con 0x7f1414157460 2023-08-10T10:45:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.130+0000 7f141259c640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1414157460 0x7f141415a820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e80 tx=0x7f140402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e30cb26f21177f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f141159a640 1 -- 172.21.15.50:0/3320705677 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140402caf0 con 0x7f1414157460 2023-08-10T10:45:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f141159a640 1 -- 172.21.15.50:0/3320705677 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140402cc50 con 0x7f1414157460 2023-08-10T10:45:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f141159a640 1 -- 172.21.15.50:0/3320705677 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040343f0 con 0x7f1414157460 2023-08-10T10:45:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 -- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1414157460 msgr2=0x7f141415a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1414157460 0x7f141415a820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e80 tx=0x7f140402bf50 comp rx=0 tx=0).stop 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 -- 172.21.15.50:0/3320705677 shutdown_connections 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14140cd730 0x7f141415daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 --2- 172.21.15.50:0/3320705677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1414157460 0x7f141415a820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 -- 172.21.15.50:0/3320705677 >> 172.21.15.50:0/3320705677 conn(0x7f14140b08e0 msgr2=0x7f14140ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.131+0000 7f14189c2640 1 -- 172.21.15.50:0/3320705677 shutdown_connections 2023-08-10T10:45:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.132+0000 7f14189c2640 1 -- 172.21.15.50:0/3320705677 wait complete. 2023-08-10T10:45:47.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.133+0000 7f14189c2640 1 Processor -- start 2023-08-10T10:45:47.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.133+0000 7f14189c2640 1 -- start start 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14140cd2d0 0x7f14140acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 0x7f14141f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141662f0 con 0x7f14140cd730 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141665d0 con 0x7f14140cd2d0 2023-08-10T10:45:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.134+0000 7f14189c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14141668b0 con 0x7f1414157460 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34592/0 (socket says 172.21.15.50:34592) 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 -- 172.21.15.50:0/3592315795 learned_addr learned my addr 172.21.15.50:0/3592315795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f141259c640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14140cd2d0 0x7f14140acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1412d9d640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 0x7f14141f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 -- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 msgr2=0x7f14141f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 0x7f14141f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 -- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14140cd2d0 msgr2=0x7f14140acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14140cd2d0 0x7f14140acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1411d9b640 1 -- 172.21.15.50:0/3592315795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009b30 con 0x7f14140cd730 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.135+0000 7f1412d9d640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 0x7f14141f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f1411d9b640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f140800c400 tx=0x7f140800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080052d0 con 0x7f14140cd730 2023-08-10T10:45:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408005430 con 0x7f14140cd730 2023-08-10T10:45:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408003830 con 0x7f14140cd730 2023-08-10T10:45:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1414166b90 con 0x7f14140cd730 2023-08-10T10:45:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.136+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1414165f10 con 0x7f14140cd730 2023-08-10T10:45:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.138+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14140cdc70 con 0x7f14140cd730 2023-08-10T10:45:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.138+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1408003990 con 0x7f14140cd730 2023-08-10T10:45:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.139+0000 7f1402ffd640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 0x7f13f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.139+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1408088a30 con 0x7f14140cd730 2023-08-10T10:45:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.140+0000 7f141259c640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 0x7f13f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.140+0000 7f141259c640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 0x7f13f406d110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1404035000 tx=0x7f1404030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:47.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.144+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1408053af0 con 0x7f14140cd730 2023-08-10T10:45:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.334+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f141404e270 con 0x7f14140cd730 2023-08-10T10:45:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.555+0000 7f1402ffd640 1 -- 172.21.15.50:0/3592315795 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1408057110 con 0x7f14140cd730 2023-08-10T10:45:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-10T10:45:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.558+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 msgr2=0x7f13f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.558+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 0x7f13f406d110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1404035000 tx=0x7f1404030000 comp rx=0 tx=0).stop 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.558+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 msgr2=0x7f14141f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f140800c400 tx=0x7f140800c8c0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 shutdown_connections 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1414157460 0x7f14141f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14140cd730 0x7f14141f5d50 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f13f406ac50 0x7f13f406d110 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 --2- 172.21.15.50:0/3592315795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14140cd2d0 0x7f14140acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 >> 172.21.15.50:0/3592315795 conn(0x7f14140b08e0 msgr2=0x7f14141592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 shutdown_connections 2023-08-10T10:45:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:47.559+0000 7f14189c2640 1 -- 172.21.15.50:0/3592315795 wait complete. 2023-08-10T10:45:47.580 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:45:47.581 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:45:47.581 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:45:47.581 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:45:47.581 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:45:47.582 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:45:47.582 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:45:47.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:47.910 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:48.021 INFO:teuthology.orchestra.run.smithi050.stdout:client6151 2023-08-10T10:45:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:48.022 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client6151/osdmap') 2023-08-10T10:45:48.123 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 129 barrier 129 flags 0x588000 2023-08-10T10:45:48.123 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:45:48.124 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:45:48.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:45:48.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:45:48.126 INFO:teuthology.orchestra.run.smithi050.stderr:904 bytes copied, 9.2274e-05 s, 9.8 MB/s 2023-08-10T10:45:48.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-08-10T10:45:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.352+0000 7fe6beee0640 1 Processor -- start 2023-08-10T10:45:48.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.353+0000 7fe6beee0640 1 -- start start 2023-08-10T10:45:48.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.354+0000 7fe6beee0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b8165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.354+0000 7fe6beee0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b80c8e80 0x7fe6b80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.354+0000 7fe6beee0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b80c9bb0 con 0x7fe6b80c1a10 2023-08-10T10:45:48.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.354+0000 7fe6beee0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8165a70 con 0x7fe6b80c8e80 2023-08-10T10:45:48.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.354+0000 7fe6beee0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80c95f0 con 0x7fe6b8069db0 2023-08-10T10:45:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b80c8e80 0x7fe6b80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6b80c8e80 0x7fe6b80ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34600/0 (socket says 172.21.15.50:34600) 2023-08-10T10:45:48.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 -- 172.21.15.50:0/1305575452 learned_addr learned my addr 172.21.15.50:0/1305575452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6bd6dd640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b8165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 -- 172.21.15.50:0/1305575452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 msgr2=0x7fe6b8165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b8165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 -- 172.21.15.50:0/1305575452 >> v1:172.21.15.117:6789/0 conn(0x7fe6b80c1a10 legacy=0x7fe6b80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:48.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.355+0000 7fe6be6df640 1 -- 172.21.15.50:0/1305575452 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80c98d0 con 0x7fe6b80c8e80 2023-08-10T10:45:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.357+0000 7fe6be6df640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80ccda0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7ac3d32db558b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:48.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.357+0000 7fe6bcedc640 1 -- 172.21.15.50:0/1305575452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b002cb00 con 0x7fe6b80c8e80 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.357+0000 7fe6bcedc640 1 -- 172.21.15.50:0/1305575452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b002cc60 con 0x7fe6b80c8e80 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.357+0000 7fe6bcedc640 1 -- 172.21.15.50:0/1305575452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00343f0 con 0x7fe6b80c8e80 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 -- 172.21.15.50:0/1305575452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 msgr2=0x7fe6b80ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80ccda0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b002bf60 comp rx=0 tx=0).stop 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 -- 172.21.15.50:0/1305575452 shutdown_connections 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80ccda0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:48.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 --2- 172.21.15.50:0/1305575452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b8165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:48.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 -- 172.21.15.50:0/1305575452 >> 172.21.15.50:0/1305575452 conn(0x7fe6b80cafa0 msgr2=0x7fe6b80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:48.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 -- 172.21.15.50:0/1305575452 shutdown_connections 2023-08-10T10:45:48.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.358+0000 7fe6beee0640 1 -- 172.21.15.50:0/1305575452 wait complete. 2023-08-10T10:45:48.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.360+0000 7fe6beee0640 1 Processor -- start 2023-08-10T10:45:48.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.360+0000 7fe6beee0640 1 -- start start 2023-08-10T10:45:48.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b81f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6b80c1a10 0x7fe6b80c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80c67e0 con 0x7fe6b80c8e80 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8070c60 con 0x7fe6b80c1a10 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6beee0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8071750 con 0x7fe6b8069db0 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6be6df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6be6df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34610/0 (socket says 172.21.15.50:34610) 2023-08-10T10:45:48.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.361+0000 7fe6be6df640 1 -- 172.21.15.50:0/3453042241 learned_addr learned my addr 172.21.15.50:0/3453042241 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:48.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6bd6dd640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6b80c1a10 0x7fe6b80c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6bdede640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b81f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 -- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 msgr2=0x7fe6b81f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:48.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b81f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:48.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 -- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6b80c1a10 msgr2=0x7fe6b80c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6b80c1a10 0x7fe6b80c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 -- 172.21.15.50:0/3453042241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0009b30 con 0x7fe6b80c8e80 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6bdede640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b81f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6be6df640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0009510 con 0x7fe6b80c8e80 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b003e450 con 0x7fe6b80c8e80 2023-08-10T10:45:48.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b8070eb0 con 0x7fe6b80c8e80 2023-08-10T10:45:48.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.362+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b003e800 con 0x7fe6b80c8e80 2023-08-10T10:45:48.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.363+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b8071470 con 0x7fe6b80c8e80 2023-08-10T10:45:48.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.364+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b80c6920 con 0x7fe6b80c8e80 2023-08-10T10:45:48.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.365+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6b003e960 con 0x7fe6b80c8e80 2023-08-10T10:45:48.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.366+0000 7fe6ae7fc640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 0x7fe69c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:48.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.366+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6b00ac330 con 0x7fe6b80c8e80 2023-08-10T10:45:48.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.367+0000 7fe6bdede640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 0x7fe69c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:48.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.367+0000 7fe6bdede640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 0x7fe69c06d110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4000f60 tx=0x7fe6b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:48.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.371+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe6b80c6920 con 0x7fe6b80c8e80 2023-08-10T10:45:48.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:48.572+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fe6b80c6920 con 0x7fe6b80c8e80 2023-08-10T10:45:49.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.577+0000 7fe6ae7fc640 1 -- 172.21.15.50:0/3453042241 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v131) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe6b80c6920 con 0x7fe6b80c8e80 2023-08-10T10:45:49.579 INFO:teuthology.orchestra.run.smithi050.stderr:pauserd,pausewr is set 2023-08-10T10:45:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.580+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 msgr2=0x7fe69c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.580+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 0x7fe69c06d110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4000f60 tx=0x7fe6b4009040 comp rx=0 tx=0).stop 2023-08-10T10:45:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 msgr2=0x7fe6b80c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b0004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 shutdown_connections 2023-08-10T10:45:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6b80c8e80 0x7fe6b80c45b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe69c06ac50 0x7fe69c06d110 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6b80c1a10 0x7fe6b80c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 --2- 172.21.15.50:0/3453042241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6b8069db0 0x7fe6b81f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 >> 172.21.15.50:0/3453042241 conn(0x7fe6b80cafa0 msgr2=0x7fe6b80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:49.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 shutdown_connections 2023-08-10T10:45:49.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.581+0000 7fe6beee0640 1 -- 172.21.15.50:0/3453042241 wait complete. 2023-08-10T10:45:49.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-08-10T10:45:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.835+0000 7f307ffff640 1 Processor -- start 2023-08-10T10:45:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.835+0000 7f307ffff640 1 -- start start 2023-08-10T10:45:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.836+0000 7f307ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 0x7f3080160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307ffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3080160370 con 0x7f30800d28b0 2023-08-10T10:45:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307ffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30800d0d90 con 0x7f30800cd960 2023-08-10T10:45:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800d0b90 con 0x7f308015ff90 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30800d28b0 0x7f30800b5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56824/0 (socket says 172.21.15.50:56824) 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307f7fe640 1 -- 172.21.15.50:0/2307731428 learned_addr learned my addr 172.21.15.50:0/2307731428 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307effd640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 0x7f3080160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.837+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405096939 0 0) 0x7f3078001110 con 0x7f30800d28b0 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3068003520 con 0x7f30800d28b0 2023-08-10T10:45:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110711944 0 0) 0x7f3068003520 con 0x7f30800d28b0 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 msgr2=0x7f3080160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 0x7f3080160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 >> v1:172.21.15.117:6789/0 conn(0x7f30800cd960 legacy=0x7f30800d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800d1070 con 0x7f30800d28b0 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3078001800 con 0x7f30800d28b0 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 >> v1:172.21.15.50:6789/0 conn(0x7f30800d28b0 legacy=0x7f30800b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3068003a10 0x7f3068003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 0x7f30680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068004d00 0x7f3068005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800d0b90 con 0x7f3068003a10 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306800ba90 con 0x7f3068004d00 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306800bc50 con 0x7f308015ff90 2023-08-10T10:45:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.838+0000 7f307effd640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3068003a10 0x7f3068003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307effd640 1 -- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 msgr2=0x7f30680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307effd640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f308015ff90 0x7f30680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307f7fe640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068004d00 0x7f3068005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307effd640 1 -- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068004d00 msgr2=0x7f3068005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307effd640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068004d00 0x7f3068005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307effd640 1 -- 172.21.15.50:0/2307731428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068003520 con 0x7f3068003a10 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.839+0000 7f307f7fe640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068004d00 0x7f3068005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.840+0000 7f307effd640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3068003a10 0x7f3068003e30 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3070009a90 tx=0x7f30680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6de9dad4731962 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.840+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307002c600 con 0x7f3068003a10 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.840+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307002c760 con 0x7f3068003a10 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.840+0000 7f307dffb640 1 -- 172.21.15.50:0/2307731428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307002caf0 con 0x7f3068003a10 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 -- 172.21.15.50:0/2307731428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3068003a10 msgr2=0x7f3068003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 --2- 172.21.15.50:0/2307731428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3068003a10 0x7f3068003e30 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3070009a90 tx=0x7f30680057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307f7fe640 1 -- 172.21.15.50:0/2307731428 reap_dead start 2023-08-10T10:45:49.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 -- 172.21.15.50:0/2307731428 shutdown_connections 2023-08-10T10:45:49.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 -- 172.21.15.50:0/2307731428 >> 172.21.15.50:0/2307731428 conn(0x7f3080069ac0 msgr2=0x7f3080069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:49.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 -- 172.21.15.50:0/2307731428 shutdown_connections 2023-08-10T10:45:49.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.841+0000 7f307ffff640 1 -- 172.21.15.50:0/2307731428 wait complete. 2023-08-10T10:45:49.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.843+0000 7f307ffff640 1 Processor -- start 2023-08-10T10:45:49.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.843+0000 7f307ffff640 1 -- start start 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3068003a10 0x7f30800abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 0x7f308014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308014d800 con 0x7f308014df30 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800cc3b0 con 0x7f30800ac240 2023-08-10T10:45:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800ac6c0 con 0x7f3068003a10 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34642/0 (socket says 172.21.15.50:34642) 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.844+0000 7f307f7fe640 1 -- 172.21.15.50:0/1320851939 learned_addr learned my addr 172.21.15.50:0/1320851939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307e7fc640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 0x7f308014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307effd640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3068003a10 0x7f30800abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 -- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3068003a10 msgr2=0x7f30800abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3068003a10 0x7f30800abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 -- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 msgr2=0x7f308014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 0x7f308014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800cc0d0 con 0x7f308014df30 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307e7fc640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 0x7f308014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f307f7fe640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f30800d0260 tx=0x7f307800d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.845+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078007440 con 0x7f308014df30 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.846+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780075a0 con 0x7f308014df30 2023-08-10T10:45:49.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.846+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078004a00 con 0x7f308014df30 2023-08-10T10:45:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.846+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308014ba70 con 0x7f308014df30 2023-08-10T10:45:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.846+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308014c030 con 0x7f308014df30 2023-08-10T10:45:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.847+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080066e30 con 0x7f308014df30 2023-08-10T10:45:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.848+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3078004b60 con 0x7f308014df30 2023-08-10T10:45:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.849+0000 7f30677fe640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 0x7f306c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.849+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3078088a10 con 0x7f308014df30 2023-08-10T10:45:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.849+0000 7f307effd640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 0x7f306c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.849+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=132+}) v3 -- 0x7f306c072da0 con 0x7f308014df30 2023-08-10T10:45:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.850+0000 7f307effd640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 0x7f306c06d110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3070036000 tx=0x7f3070030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:49.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:49.854+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f307801a020 con 0x7f308014df30 2023-08-10T10:45:50.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.054+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f3080160370 con 0x7f308014df30 2023-08-10T10:45:50.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.575+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(132..132 src has 1..132) v4 ==== 288+0+0 (secure 0 0 0) 0x7f307805b6a0 con 0x7f308014df30 2023-08-10T10:45:50.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.575+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f306c073650 con 0x7f308014df30 2023-08-10T10:45:50.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.584+0000 7f30677fe640 1 -- 172.21.15.50:0/1320851939 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3080160370 con 0x7f308014df30 2023-08-10T10:45:50.586 INFO:teuthology.orchestra.run.smithi050.stderr:pauserd,pausewr is unset 2023-08-10T10:45:50.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.588+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 msgr2=0x7f306c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.588+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 0x7f306c06d110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3070036000 tx=0x7f3070030000 comp rx=0 tx=0).stop 2023-08-10T10:45:50.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.588+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 msgr2=0x7f308014e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.588+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f30800d0260 tx=0x7f307800d900 comp rx=0 tx=0).stop 2023-08-10T10:45:50.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 shutdown_connections 2023-08-10T10:45:50.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f308014df30 0x7f308014e3e0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f306c06ac50 0x7f306c06d110 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30800ac240 0x7f308014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 --2- 172.21.15.50:0/1320851939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3068003a10 0x7f30800abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 >> 172.21.15.50:0/1320851939 conn(0x7f3080069ac0 msgr2=0x7f30800d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 shutdown_connections 2023-08-10T10:45:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.589+0000 7f307ffff640 1 -- 172.21.15.50:0/1320851939 wait complete. 2023-08-10T10:45:50.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:50.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.822+0000 7f71364b4640 1 Processor -- start 2023-08-10T10:45:50.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.823+0000 7f71364b4640 1 -- start start 2023-08-10T10:45:50.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f71364b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7130069db0 0x7f71300b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f71364b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713006f6f0 con 0x7f71300c1af0 2023-08-10T10:45:50.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f71364b4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713006edc0 con 0x7f71300b2d70 2023-08-10T10:45:50.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f71364b4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71301617f0 con 0x7f7130069db0 2023-08-10T10:45:50.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f712ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f71300c1af0 0x7f71300696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56830/0 (socket says 172.21.15.50:56830) 2023-08-10T10:45:50.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.824+0000 7f712ffff640 1 -- 172.21.15.50:0/2075512753 learned_addr learned my addr 172.21.15.50:0/2075512753 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:50.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2075512753 >> v2:172.21.15.50:3300/0 conn(0x7f7130069db0 0x7f71300b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335762299 0 0) 0x7f713006f6f0 con 0x7f71300c1af0 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7118003520 con 0x7f71300c1af0 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 376528409 0 0) 0x7f7118003520 con 0x7f71300c1af0 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 >> v2:172.21.15.50:3300/0 conn(0x7f7130069db0 msgr2=0x7f71300b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 --2- 172.21.15.50:0/2075512753 >> v2:172.21.15.50:3300/0 conn(0x7f7130069db0 0x7f71300b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 >> v1:172.21.15.117:6789/0 conn(0x7f71300b2d70 legacy=0x7f713006fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713006f0a0 con 0x7f71300c1af0 2023-08-10T10:45:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f71200019f0 con 0x7f71300c1af0 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 >> v1:172.21.15.50:6789/0 conn(0x7f71300c1af0 legacy=0x7f71300696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.825+0000 7f712effd640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f7118003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712effd640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71180047c0 0x7f7118004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712effd640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118005180 0x7f711800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71301617f0 con 0x7f7118003970 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711800c030 con 0x7f71180047c0 2023-08-10T10:45:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711800c1f0 con 0x7f7118005180 2023-08-10T10:45:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f7118003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71180047c0 0x7f7118004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f7134a51640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118005180 0x7f711800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 -- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118005180 msgr2=0x7f711800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118005180 0x7f711800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 -- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71180047c0 msgr2=0x7f7118004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71180047c0 0x7f7118004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712ffff640 1 -- 172.21.15.50:0/2075512753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118003520 con 0x7f7118003970 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f7134a51640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118005180 0x7f711800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71180047c0 0x7f7118004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.826+0000 7f7134a51640 1 -- 172.21.15.50:0/2075512753 reap_dead start 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f712ffff640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f7118003d90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f712000a830 tx=0x7f71180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e996be1ba8ff17f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200072d0 con 0x7f7118003970 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712002f070 con 0x7f7118003970 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f712effd640 1 -- 172.21.15.50:0/2075512753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200076f0 con 0x7f7118003970 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f71364b4640 1 -- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 msgr2=0x7f7118003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.828+0000 7f71364b4640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f7118003d90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f712000a830 tx=0x7f71180057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.829+0000 7f71364b4640 1 -- 172.21.15.50:0/2075512753 shutdown_connections 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.829+0000 7f71364b4640 1 --2- 172.21.15.50:0/2075512753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f7118003d90 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.829+0000 7f71364b4640 1 -- 172.21.15.50:0/2075512753 >> 172.21.15.50:0/2075512753 conn(0x7f713006b590 msgr2=0x7f71300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.829+0000 7f71364b4640 1 -- 172.21.15.50:0/2075512753 shutdown_connections 2023-08-10T10:45:50.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.829+0000 7f71364b4640 1 -- 172.21.15.50:0/2075512753 wait complete. 2023-08-10T10:45:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.831+0000 7f71364b4640 1 Processor -- start 2023-08-10T10:45:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.831+0000 7f71364b4640 1 -- start start 2023-08-10T10:45:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c8290 0x7f71300c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300c5790 0x7f713015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713015db10 con 0x7f7118003970 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130164500 con 0x7f71300c8290 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f71364b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713015dc70 con 0x7f71300c5790 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34662/0 (socket says 172.21.15.50:34662) 2023-08-10T10:45:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 -- 172.21.15.50:0/2214558643 learned_addr learned my addr 172.21.15.50:0/2214558643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 -- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300c5790 msgr2=0x7f713015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300c5790 0x7f713015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c8290 0x7f71300c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 -- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c8290 msgr2=0x7f71300c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c8290 0x7f71300c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.832+0000 7f712ffff640 1 -- 172.21.15.50:0/2214558643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300c4a30 con 0x7f7118003970 2023-08-10T10:45:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f712ffff640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f712000a950 tx=0x7f7120001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200070d0 con 0x7f7118003970 2023-08-10T10:45:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120007230 con 0x7f7118003970 2023-08-10T10:45:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200075a0 con 0x7f7118003970 2023-08-10T10:45:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713015dec0 con 0x7f7118003970 2023-08-10T10:45:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.833+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713015e480 con 0x7f7118003970 2023-08-10T10:45:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.835+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713015e610 con 0x7f7118003970 2023-08-10T10:45:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.836+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7120031030 con 0x7f7118003970 2023-08-10T10:45:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.836+0000 7f712cff9640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 0x7f711c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.837+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71200ab650 con 0x7f7118003970 2023-08-10T10:45:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.837+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 0x7f711c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.837+0000 7f712f7fe640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 0x7f711c06d110 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f71300c7cd0 tx=0x7f7124008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:50.844+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f71200766f0 con 0x7f7118003970 2023-08-10T10:45:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.035+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f713015e610 con 0x7f7118003970 2023-08-10T10:45:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.037+0000 7f712cff9640 1 -- 172.21.15.50:0/2214558643 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f7120079d10 con 0x7f7118003970 2023-08-10T10:45:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:51.039 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 msgr2=0x7f711c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 0x7f711c06d110 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f71300c7cd0 tx=0x7f7124008040 comp rx=0 tx=0).stop 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 msgr2=0x7f713015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f712000a950 tx=0x7f7120001d80 comp rx=0 tx=0).stop 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 shutdown_connections 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300c5790 0x7f713015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f711c06ac50 0x7f711c06d110 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c8290 0x7f71300c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 --2- 172.21.15.50:0/2214558643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7118003970 0x7f713015d5d0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 >> 172.21.15.50:0/2214558643 conn(0x7f713006b590 msgr2=0x7f7130160b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 shutdown_connections 2023-08-10T10:45:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.040+0000 7f71364b4640 1 -- 172.21.15.50:0/2214558643 wait complete. 2023-08-10T10:45:51.061 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:45:51.062 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:45:51.062 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:45:51.062 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:45:51.062 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:45:51.063 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:45:51.063 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:45:51.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:51.379 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:51.486 INFO:teuthology.orchestra.run.smithi050.stdout:client6151 2023-08-10T10:45:51.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:51.487 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client6151/osdmap') 2023-08-10T10:45:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 129 barrier 129 flags 0x588000 2023-08-10T10:45:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:45:51.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:45:51.593 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:45:51.593 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:45:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:45:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:45:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:904 bytes copied, 0.000108469 s, 8.3 MB/s 2023-08-10T10:45:51.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.818+0000 7fec7ef00640 1 Processor -- start 2023-08-10T10:45:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.818+0000 7fec7ef00640 1 -- start start 2023-08-10T10:45:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7ef00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec7815a940 0x7fec780aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7ef00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec780b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7ef00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780b1f10 con 0x7fec780b12c0 2023-08-10T10:45:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7ef00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec780b21f0 con 0x7fec7815a940 2023-08-10T10:45:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7ef00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815e5c0 con 0x7fec7815f2b0 2023-08-10T10:45:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7defe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec7815a940 0x7fec780aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7e6ff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec780b12c0 0x7fec780b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56840/0 (socket says 172.21.15.50:56840) 2023-08-10T10:45:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.820+0000 7fec7e6ff640 1 -- 172.21.15.50:0/4149847124 learned_addr learned my addr 172.21.15.50:0/4149847124 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7d6fd640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec780b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7defe640 1 -- 172.21.15.50:0/4149847124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 msgr2=0x7fec780b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7defe640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec780b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7defe640 1 -- 172.21.15.50:0/4149847124 >> v1:172.21.15.50:6789/0 conn(0x7fec780b12c0 legacy=0x7fec780b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7cefc640 1 -- 172.21.15.50:0/4149847124 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827466859 0 0) 0x7fec780b1f10 con 0x7fec780b12c0 2023-08-10T10:45:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.821+0000 7fec7defe640 1 -- 172.21.15.50:0/4149847124 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7815e7d0 con 0x7fec7815a940 2023-08-10T10:45:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.822+0000 7fec7defe640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec7815a940 0x7fec780aff10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5661757ad778eb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.822+0000 7fec7cefc640 1 -- 172.21.15.50:0/4149847124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7402e070 con 0x7fec7815a940 2023-08-10T10:45:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.822+0000 7fec7cefc640 1 -- 172.21.15.50:0/4149847124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec740315a0 con 0x7fec7815a940 2023-08-10T10:45:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.822+0000 7fec7cefc640 1 -- 172.21.15.50:0/4149847124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74031930 con 0x7fec7815a940 2023-08-10T10:45:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 -- 172.21.15.50:0/4149847124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec7815a940 msgr2=0x7fec780aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec7815a940 0x7fec780aff10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec7402b840 comp rx=0 tx=0).stop 2023-08-10T10:45:51.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 -- 172.21.15.50:0/4149847124 shutdown_connections 2023-08-10T10:45:51.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec780b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 --2- 172.21.15.50:0/4149847124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec7815a940 0x7fec780aff10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 -- 172.21.15.50:0/4149847124 >> 172.21.15.50:0/4149847124 conn(0x7fec7806ab80 msgr2=0x7fec7806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 -- 172.21.15.50:0/4149847124 shutdown_connections 2023-08-10T10:45:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.823+0000 7fec7ef00640 1 -- 172.21.15.50:0/4149847124 wait complete. 2023-08-10T10:45:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.825+0000 7fec7ef00640 1 Processor -- start 2023-08-10T10:45:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.825+0000 7fec7ef00640 1 -- start start 2023-08-10T10:45:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec7815a940 0x7fec78154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec78154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c1fa0 con 0x7fec780b12c0 2023-08-10T10:45:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c2280 con 0x7fec7815a940 2023-08-10T10:45:51.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.826+0000 7fec7ef00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c2560 con 0x7fec7815f2b0 2023-08-10T10:45:51.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:51.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34668/0 (socket says 172.21.15.50:34668) 2023-08-10T10:45:51.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 -- 172.21.15.50:0/2873363041 learned_addr learned my addr 172.21.15.50:0/2873363041 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 -- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 msgr2=0x7fec78154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec78154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 -- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec7815a940 msgr2=0x7fec78154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec7815a940 0x7fec78154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.827+0000 7fec7defe640 1 -- 172.21.15.50:0/2873363041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74009400 con 0x7fec780b12c0 2023-08-10T10:45:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec7defe640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74004230 con 0x7fec780b12c0 2023-08-10T10:45:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74031f00 con 0x7fec780b12c0 2023-08-10T10:45:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74032640 con 0x7fec780b12c0 2023-08-10T10:45:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec780c2840 con 0x7fec780b12c0 2023-08-10T10:45:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.828+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7815de20 con 0x7fec780b12c0 2023-08-10T10:45:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.829+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780c2d60 con 0x7fec780b12c0 2023-08-10T10:45:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.830+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec740327a0 con 0x7fec780b12c0 2023-08-10T10:45:51.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.831+0000 7fec6e7fc640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 0x7fec5c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:51.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.831+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec740ab5c0 con 0x7fec780b12c0 2023-08-10T10:45:51.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.831+0000 7fec7d6fd640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 0x7fec5c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:51.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.832+0000 7fec7d6fd640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 0x7fec5c06d110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec780ca550 tx=0x7fec68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:51.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:51.835+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec780c2d60 con 0x7fec780b12c0 2023-08-10T10:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.062+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec780c2d60 con 0x7fec780b12c0 2023-08-10T10:45:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.064+0000 7fec6e7fc640 1 -- 172.21.15.50:0/2873363041 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fec780c2d60 con 0x7fec780b12c0 2023-08-10T10:45:52.066 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:52.066 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:45:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:45:52.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 msgr2=0x7fec5c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 0x7fec5c06d110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec780ca550 tx=0x7fec68008040 comp rx=0 tx=0).stop 2023-08-10T10:45:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 msgr2=0x7fec780cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec740046c0 comp rx=0 tx=0).stop 2023-08-10T10:45:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 shutdown_connections 2023-08-10T10:45:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815f2b0 0x7fec78154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec5c06ac50 0x7fec5c06d110 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec7815a940 0x7fec78154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 --2- 172.21.15.50:0/2873363041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec780b12c0 0x7fec780cc2d0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.066+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 >> 172.21.15.50:0/2873363041 conn(0x7fec7806ab80 msgr2=0x7fec780b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.067+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 shutdown_connections 2023-08-10T10:45:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:52.067+0000 7fec7ef00640 1 -- 172.21.15.50:0/2873363041 wait complete. 2023-08-10T10:45:52.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 132 2023-08-10T10:45:52.329 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-08-10T10:45:52.329 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:45:52.330 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:45:52.330 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-10T10:45:52.330 DEBUG:teuthology.orchestra.run.smithi050:> os.fchmod(fd, 0O666) 2023-08-10T10:45:52.330 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(fd) 2023-08-10T10:45:52.331 DEBUG:teuthology.orchestra.run.smithi050:> os.close(fd) 2023-08-10T10:45:52.331 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:45:52.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:52.692 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:52.772 INFO:teuthology.orchestra.run.smithi050.stdout:client6151 2023-08-10T10:45:52.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:52.773 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client6151/osdmap') 2023-08-10T10:45:52.878 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 132 barrier 132 flags 0x588000 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:45:52.879 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:45:52.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:45:52.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:45:52.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:45:52.881 INFO:teuthology.orchestra.run.smithi050.stderr:904 bytes copied, 0.00010097 s, 9.0 MB/s 2023-08-10T10:45:52.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:52.883 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:45:52.945 INFO:teuthology.orchestra.run.smithi050.stdout:client6151 2023-08-10T10:45:52.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:52.946 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6795d532-1ac6-4473-b42c-017ab0d4d08a.client6151/osdmap') 2023-08-10T10:45:53.048 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 132 barrier 132 flags 0x588000 2023-08-10T10:45:53.048 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:53.048 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:53.048 INFO:teuthology.orchestra.run.smithi050.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd0 (2)172.21.15.50:6819 100% (exists, up) 100% -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd1 (2)172.21.15.50:6816 100% (exists, up) 100% -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd2 (2)172.21.15.50:6800 100% (exists, up) 100% -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd3 (2)172.21.15.50:6808 100% (exists, up) 100% -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd4 (2)172.21.15.117:6816 100% (exists, up) 100% -1 2023-08-10T10:45:53.049 INFO:teuthology.orchestra.run.smithi050.stdout:osd5 (2)172.21.15.117:6800 100% (exists, up) 100% -1 2023-08-10T10:45:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:osd6 (2)172.21.15.117:6808 100% (exists, up) 100% -1 2023-08-10T10:45:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:osd7 (2)172.21.15.117:6824 100% (exists, up) 100% -1 2023-08-10T10:45:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records in 2023-08-10T10:45:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+1 records out 2023-08-10T10:45:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:904 bytes copied, 9.204e-05 s, 9.8 MB/s 2023-08-10T10:45:53.052 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:45:53.052 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:45:53.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:53.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:45:53.302 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:45:53.302 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:53.302 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:53.365 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:53.366 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:53.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:53.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.657+0000 7f7629596640 1 Processor -- start 2023-08-10T10:45:53.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.658+0000 7f7629596640 1 -- start start 2023-08-10T10:45:53.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.659+0000 7f7629596640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76240b8430 0x7f76240cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7629596640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76240ce200 con 0x7f762415cd60 2023-08-10T10:45:53.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7629596640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7624161180 con 0x7f76240cddb0 2023-08-10T10:45:53.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7629596640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76240b5bd0 con 0x7f76240b8430 2023-08-10T10:45:53.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7622ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f762415cd60 0x7f7624160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56842/0 (socket says 172.21.15.50:56842) 2023-08-10T10:45:53.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7622ffd640 1 -- 172.21.15.50:0/239332083 learned_addr learned my addr 172.21.15.50:0/239332083 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:53.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f76227fc640 1 --2- 172.21.15.50:0/239332083 >> v2:172.21.15.117:3300/0 conn(0x7f76240b8430 0x7f76240cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209193696 0 0) 0x7f7614001490 con 0x7f762415cd60 2023-08-10T10:45:53.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.660+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f760c003520 con 0x7f762415cd60 2023-08-10T10:45:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462102526 0 0) 0x7f760c003520 con 0x7f762415cd60 2023-08-10T10:45:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 >> v2:172.21.15.117:3300/0 conn(0x7f76240b8430 msgr2=0x7f76240cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 --2- 172.21.15.50:0/239332083 >> v2:172.21.15.117:3300/0 conn(0x7f76240b8430 0x7f76240cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 >> v1:172.21.15.117:6789/0 conn(0x7f76240cddb0 legacy=0x7f76240d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624161460 con 0x7f762415cd60 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7614001b80 con 0x7f762415cd60 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 >> v1:172.21.15.50:6789/0 conn(0x7f762415cd60 legacy=0x7f7624160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 0x7f760c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f760c0047c0 0x7f760c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c005180 0x7f760c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76240b5bd0 con 0x7f760c003970 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c00c000 con 0x7f760c005180 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c00c1c0 con 0x7f760c0047c0 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.661+0000 7f7622ffd640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 0x7f760c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f7622ffd640 1 -- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f760c0047c0 msgr2=0x7f760c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f7622ffd640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f760c0047c0 0x7f760c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f7622ffd640 1 -- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c005180 msgr2=0x7f760c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f7622ffd640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c005180 0x7f760c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f7622ffd640 1 -- 172.21.15.50:0/239332083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c003520 con 0x7f760c003970 2023-08-10T10:45:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.662+0000 7f76237fe640 1 -- 172.21.15.50:0/239332083 reap_dead start 2023-08-10T10:45:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.663+0000 7f7622ffd640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 0x7f760c003d70 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f761400a810 tx=0x7f760c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50969ef2dee1a481 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.663+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614034630 con 0x7f760c003970 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.663+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761402f070 con 0x7f760c003970 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.663+0000 7f7621ffb640 1 -- 172.21.15.50:0/239332083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76140349f0 con 0x7f760c003970 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 -- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 msgr2=0x7f760c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 0x7f760c003d70 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f761400a810 tx=0x7f760c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 -- 172.21.15.50:0/239332083 shutdown_connections 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 --2- 172.21.15.50:0/239332083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760c003970 0x7f760c003d70 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 -- 172.21.15.50:0/239332083 >> 172.21.15.50:0/239332083 conn(0x7f76240d2ac0 msgr2=0x7f76240d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 -- 172.21.15.50:0/239332083 shutdown_connections 2023-08-10T10:45:53.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.664+0000 7f7629596640 1 -- 172.21.15.50:0/239332083 wait complete. 2023-08-10T10:45:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.666+0000 7f7629596640 1 Processor -- start 2023-08-10T10:45:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.666+0000 7f7629596640 1 -- start start 2023-08-10T10:45:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 0x7f7624159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762415e360 0x7f762415e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624159b50 con 0x7f76240c9b00 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762415ded0 con 0x7f760c003970 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f7629596640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762415d2c0 con 0x7f762415e360 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.667+0000 7f76227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34692/0 (socket says 172.21.15.50:34692) 2023-08-10T10:45:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 -- 172.21.15.50:0/4002811272 learned_addr learned my addr 172.21.15.50:0/4002811272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f7622ffd640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 0x7f7624159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76237fe640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762415e360 0x7f762415e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 -- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762415e360 msgr2=0x7f762415e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762415e360 0x7f762415e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 -- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 msgr2=0x7f7624159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 0x7f7624159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 -- 172.21.15.50:0/4002811272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762415d5a0 con 0x7f76240c9b00 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f7622ffd640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 0x7f7624159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.668+0000 7f76227fc640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f761800e890 tx=0x7f761800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.669+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800c8e0 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.669+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761800ca60 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.669+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800ce10 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.669+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762415d880 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.669+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762415f7c0 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.670+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762404e270 con 0x7f76240c9b00 2023-08-10T10:45:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.671+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7618013470 con 0x7f76240c9b00 2023-08-10T10:45:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.672+0000 7f760b7fe640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 0x7f761006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.672+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7618089560 con 0x7f76240c9b00 2023-08-10T10:45:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.673+0000 7f7622ffd640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 0x7f761006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.674+0000 7f7622ffd640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 0x7f761006d140 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f761400a810 tx=0x7f761402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:53.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.677+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7618054570 con 0x7f76240c9b00 2023-08-10T10:45:53.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.868+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76240d3940 con 0x7f76240c9b00 2023-08-10T10:45:53.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.870+0000 7f760b7fe640 1 -- 172.21.15.50:0/4002811272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f7618057b90 con 0x7f76240c9b00 2023-08-10T10:45:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:53.874 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:53.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.873+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 msgr2=0x7f761006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.873+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 0x7f761006d140 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f761400a810 tx=0x7f761402f000 comp rx=0 tx=0).stop 2023-08-10T10:45:53.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.873+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 msgr2=0x7f76240c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:53.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.873+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f761800e890 tx=0x7f761800ed50 comp rx=0 tx=0).stop 2023-08-10T10:45:53.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 shutdown_connections 2023-08-10T10:45:53.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762415e360 0x7f762415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76240c9b00 0x7f76240c9f80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f761006ac80 0x7f761006d140 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 --2- 172.21.15.50:0/4002811272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f760c003970 0x7f7624159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:53.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 >> 172.21.15.50:0/4002811272 conn(0x7f76240d2ac0 msgr2=0x7f76240696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:53.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 shutdown_connections 2023-08-10T10:45:53.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:53.874+0000 7f7629596640 1 -- 172.21.15.50:0/4002811272 wait complete. 2023-08-10T10:45:53.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:45:33.973819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:45:34.611242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:53.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.127+0000 7ff46ee63640 1 Processor -- start 2023-08-10T10:45:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.128+0000 7ff46ee63640 1 -- start start 2023-08-10T10:45:54.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.129+0000 7ff46ee63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4680b0610 0x7ff4681679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.129+0000 7ff46ee63640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680ad6e0 con 0x7ff468161350 2023-08-10T10:45:54.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.129+0000 7ff46ee63640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680cdaf0 con 0x7ff468160f70 2023-08-10T10:45:54.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.129+0000 7ff46ee63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4680acb10 con 0x7ff4680b0610 2023-08-10T10:45:54.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46d660640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff468161350 0x7ff4680aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56844/0 (socket says 172.21.15.50:56844) 2023-08-10T10:45:54.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46d660640 1 -- 172.21.15.50:0/3835397488 learned_addr learned my addr 172.21.15.50:0/3835397488 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:54.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584996482 0 0) 0x7ff4680ad6e0 con 0x7ff468161350 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46e662640 1 --2- 172.21.15.50:0/3835397488 >> v2:172.21.15.117:3300/0 conn(0x7ff4680b0610 0x7ff4681679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff454003520 con 0x7ff468161350 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446094254 0 0) 0x7ff454003520 con 0x7ff468161350 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 >> v2:172.21.15.117:3300/0 conn(0x7ff4680b0610 msgr2=0x7ff4681679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 --2- 172.21.15.50:0/3835397488 >> v2:172.21.15.117:3300/0 conn(0x7ff4680b0610 0x7ff4681679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 >> v1:172.21.15.117:6789/0 conn(0x7ff468160f70 legacy=0x7ff46815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46815dee0 con 0x7ff468161350 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff458001670 con 0x7ff468161350 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.130+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 >> v1:172.21.15.50:6789/0 conn(0x7ff468161350 legacy=0x7ff4680aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff454003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540047c0 0x7ff454004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4540051f0 0x7ff45400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680acb10 con 0x7ff4540039e0 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45400c150 con 0x7ff4540051f0 2023-08-10T10:45:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45400c310 con 0x7ff4540047c0 2023-08-10T10:45:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff454003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46d660640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540047c0 0x7ff454004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 -- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540047c0 msgr2=0x7ff454004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:54.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540047c0 0x7ff454004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 -- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4540051f0 msgr2=0x7ff45400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46e662640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4540051f0 0x7ff45400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4540051f0 0x7ff45400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46de61640 1 -- 172.21.15.50:0/3835397488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454003520 con 0x7ff4540039e0 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.131+0000 7ff46e662640 1 -- 172.21.15.50:0/3835397488 reap_dead start 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46de61640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff454003e00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff464001750 tx=0x7ff4540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe0bdcc501a571d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640052d0 con 0x7ff4540039e0 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46402e050 con 0x7ff4540039e0 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46ce5f640 1 -- 172.21.15.50:0/3835397488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464003830 con 0x7ff4540039e0 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46ee63640 1 -- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 msgr2=0x7ff454003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.133+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff454003e00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff464001750 tx=0x7ff4540057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.134+0000 7ff46ee63640 1 -- 172.21.15.50:0/3835397488 shutdown_connections 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.134+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3835397488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff454003e00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.134+0000 7ff46ee63640 1 -- 172.21.15.50:0/3835397488 >> 172.21.15.50:0/3835397488 conn(0x7ff468069cd0 msgr2=0x7ff4680caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.134+0000 7ff46ee63640 1 -- 172.21.15.50:0/3835397488 shutdown_connections 2023-08-10T10:45:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.134+0000 7ff46ee63640 1 -- 172.21.15.50:0/3835397488 wait complete. 2023-08-10T10:45:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.135+0000 7ff46ee63640 1 Processor -- start 2023-08-10T10:45:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.136+0000 7ff46ee63640 1 -- start start 2023-08-10T10:45:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.136+0000 7ff46ee63640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46ee63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680c3d20 0x7ff4680c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46ee63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4680c9930 0x7ff4680c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46ee63640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680ca2f0 con 0x7ff4540039e0 2023-08-10T10:45:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46ee63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680b11e0 con 0x7ff4680c9930 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46ee63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff468153060 con 0x7ff4680c3d20 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34714/0 (socket says 172.21.15.50:34714) 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 -- 172.21.15.50:0/3437245431 learned_addr learned my addr 172.21.15.50:0/3437245431 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 -- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680c3d20 msgr2=0x7ff4680c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680c3d20 0x7ff4680c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 -- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4680c9930 msgr2=0x7ff4680c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4680c9930 0x7ff4680c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.137+0000 7ff46de61640 1 -- 172.21.15.50:0/3437245431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680b1480 con 0x7ff4540039e0 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff46de61640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff464005040 tx=0x7ff464001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464007a30 con 0x7ff4540039e0 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4640069e0 con 0x7ff4540039e0 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464006d70 con 0x7ff4540039e0 2023-08-10T10:45:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4680b1760 con 0x7ff4540039e0 2023-08-10T10:45:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.138+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4680b1d20 con 0x7ff4540039e0 2023-08-10T10:45:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.139+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4680b1eb0 con 0x7ff4540039e0 2023-08-10T10:45:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.140+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4640035f0 con 0x7ff4540039e0 2023-08-10T10:45:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.142+0000 7ff45e7fc640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 0x7ff44c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.142+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4640ab640 con 0x7ff4540039e0 2023-08-10T10:45:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.142+0000 7ff46d660640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 0x7ff44c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.143+0000 7ff46d660640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 0x7ff44c06d110 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff4680ca610 tx=0x7ff458009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.145+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff464076770 con 0x7ff4540039e0 2023-08-10T10:45:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.333+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff468066e30 con 0x7ff4540039e0 2023-08-10T10:45:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.334+0000 7ff45e7fc640 1 -- 172.21.15.50:0/3437245431 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff464079d90 con 0x7ff4540039e0 2023-08-10T10:45:54.336 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 msgr2=0x7ff44c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 0x7ff44c06d110 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff4680ca610 tx=0x7ff458009040 comp rx=0 tx=0).stop 2023-08-10T10:45:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 msgr2=0x7ff468152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff464005040 tx=0x7ff464001120 comp rx=0 tx=0).stop 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 shutdown_connections 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff44c06ac50 0x7ff44c06d110 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4680c9930 0x7ff4680c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680c3d20 0x7ff4680c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 --2- 172.21.15.50:0/3437245431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540039e0 0x7ff468152570 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 >> 172.21.15.50:0/3437245431 conn(0x7ff468069cd0 msgr2=0x7ff4680cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.336+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 shutdown_connections 2023-08-10T10:45:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.337+0000 7ff46ee63640 1 -- 172.21.15.50:0/3437245431 wait complete. 2023-08-10T10:45:54.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.576+0000 7fc528a5d640 1 Processor -- start 2023-08-10T10:45:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.576+0000 7fc528a5d640 1 -- start start 2023-08-10T10:45:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.578+0000 7fc528a5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 0x7fc52406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.578+0000 7fc528a5d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 0x7fc5240d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.578+0000 7fc528a5d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52406a5c0 con 0x7fc5240b1e00 2023-08-10T10:45:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.578+0000 7fc528a5d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52406b0c0 con 0x7fc5240cd660 2023-08-10T10:45:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.578+0000 7fc528a5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52406a820 con 0x7fc52415fde0 2023-08-10T10:45:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc523fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 0x7fc5240d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc5237fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 0x7fc52406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc523fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 0x7fc5240d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:43048/0 (socket says 172.21.15.50:43048) 2023-08-10T10:45:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc523fff640 1 -- 172.21.15.50:0/3715910732 learned_addr learned my addr 172.21.15.50:0/3715910732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc5237fe640 1 -- 172.21.15.50:0/3715910732 >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 msgr2=0x7fc5240d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc5237fe640 1 --2- 172.21.15.50:0/3715910732 >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 0x7fc5240d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc5237fe640 1 -- 172.21.15.50:0/3715910732 >> v1:172.21.15.117:6789/0 conn(0x7fc5240b1e00 legacy=0x7fc5240ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.579+0000 7fc5237fe640 1 -- 172.21.15.50:0/3715910732 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52406ab00 con 0x7fc52415fde0 2023-08-10T10:45:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.581+0000 7fc5237fe640 1 --2- 172.21.15.50:0/3715910732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 0x7fc52406a080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b647b173609ad94 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.581+0000 7fc5227fc640 1 -- 172.21.15.50:0/3715910732 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51402f050 con 0x7fc52415fde0 2023-08-10T10:45:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc5227fc640 1 -- 172.21.15.50:0/3715910732 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514031700 con 0x7fc52415fde0 2023-08-10T10:45:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc5227fc640 1 -- 172.21.15.50:0/3715910732 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031a90 con 0x7fc52415fde0 2023-08-10T10:45:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 -- 172.21.15.50:0/3715910732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 msgr2=0x7fc52406a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 --2- 172.21.15.50:0/3715910732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 0x7fc52406a080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b7a0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 -- 172.21.15.50:0/3715910732 shutdown_connections 2023-08-10T10:45:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 --2- 172.21.15.50:0/3715910732 >> v2:172.21.15.117:3300/0 conn(0x7fc5240cd660 0x7fc5240d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 --2- 172.21.15.50:0/3715910732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc52415fde0 0x7fc52406a080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 -- 172.21.15.50:0/3715910732 >> 172.21.15.50:0/3715910732 conn(0x7fc5240d2900 msgr2=0x7fc5240d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 -- 172.21.15.50:0/3715910732 shutdown_connections 2023-08-10T10:45:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.582+0000 7fc528a5d640 1 -- 172.21.15.50:0/3715910732 wait complete. 2023-08-10T10:45:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.584+0000 7fc528a5d640 1 Processor -- start 2023-08-10T10:45:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.584+0000 7fc528a5d640 1 -- start start 2023-08-10T10:45:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5240b1e00 0x7fc52414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5240cd660 0x7fc5240b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f1d80 con 0x7fc52415fde0 2023-08-10T10:45:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f54d0 con 0x7fc5240b1e00 2023-08-10T10:45:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc528a5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f5770 con 0x7fc5240cd660 2023-08-10T10:45:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc523fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc523fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34722/0 (socket says 172.21.15.50:34722) 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.585+0000 7fc523fff640 1 -- 172.21.15.50:0/2064307514 learned_addr learned my addr 172.21.15.50:0/2064307514 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 -- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5240cd660 msgr2=0x7fc5240b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5240cd660 0x7fc5240b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 -- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5240b1e00 msgr2=0x7fc52414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc5237fe640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5240b1e00 0x7fc52414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5240b1e00 0x7fc52414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 -- 172.21.15.50:0/2064307514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514009400 con 0x7fc52415fde0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.586+0000 7fc523fff640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00efc0 tx=0x7fc51c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.587+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00cd20 con 0x7fc52415fde0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.587+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00f040 con 0x7fc52415fde0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.587+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5241f5a50 con 0x7fc52415fde0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.587+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c003bd0 con 0x7fc52415fde0 2023-08-10T10:45:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.587+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5241f6010 con 0x7fc52415fde0 2023-08-10T10:45:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.588+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5241f6230 con 0x7fc52415fde0 2023-08-10T10:45:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.589+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc51c003d30 con 0x7fc52415fde0 2023-08-10T10:45:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.590+0000 7fc50bfff640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.590+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc51c089bd0 con 0x7fc52415fde0 2023-08-10T10:45:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.590+0000 7fc5237fe640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.591+0000 7fc5237fe640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc514035000 tx=0x7fc514008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.594+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc51c054be0 con 0x7fc52415fde0 2023-08-10T10:45:54.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.787+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc524066e30 con 0x7fc52415fde0 2023-08-10T10:45:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.788+0000 7fc50bfff640 1 -- 172.21.15.50:0/2064307514 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc51c058200 con 0x7fc52415fde0 2023-08-10T10:45:54.789 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 msgr2=0x7fc51006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc514035000 tx=0x7fc514008030 comp rx=0 tx=0).stop 2023-08-10T10:45:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 msgr2=0x7fc5240b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00efc0 tx=0x7fc51c00c490 comp rx=0 tx=0).stop 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 shutdown_connections 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52415fde0 0x7fc5240b6790 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5240cd660 0x7fc5240b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc51006ac50 0x7fc51006d110 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 --2- 172.21.15.50:0/2064307514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5240b1e00 0x7fc52414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.790+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 >> 172.21.15.50:0/2064307514 conn(0x7fc5240d2900 msgr2=0x7fc52415f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.791+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 shutdown_connections 2023-08-10T10:45:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:54.791+0000 7fc528a5d640 1 -- 172.21.15.50:0/2064307514 wait complete. 2023-08-10T10:45:54.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:45:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.029+0000 7fb3ade45640 1 Processor -- start 2023-08-10T10:45:55.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.029+0000 7fb3ade45640 1 -- start start 2023-08-10T10:45:55.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.030+0000 7fb3ade45640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3a81583c0 0x7fb3a80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.030+0000 7fb3ade45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.030+0000 7fb3ade45640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a815aee0 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.030+0000 7fb3ade45640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80b2100 con 0x7fb3a81583c0 2023-08-10T10:45:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.030+0000 7fb3ade45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a815b1a0 con 0x7fb3a8069db0 2023-08-10T10:45:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ace43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3a81583c0 0x7fb3a80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3a7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb3a80b1ba0 0x7fb3a80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48674/0 (socket says 172.21.15.50:48674) 2023-08-10T10:45:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3a7fff640 1 -- 172.21.15.50:0/212151693 learned_addr learned my addr 172.21.15.50:0/212151693 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ad644640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ace43640 1 -- 172.21.15.50:0/212151693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 msgr2=0x7fb3a815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ace43640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ace43640 1 -- 172.21.15.50:0/212151693 >> v1:172.21.15.50:6789/0 conn(0x7fb3a80b1ba0 legacy=0x7fb3a80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ace43640 1 -- 172.21.15.50:0/212151693 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a815b480 con 0x7fb3a81583c0 2023-08-10T10:45:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3ad644640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:55.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.031+0000 7fb3a77fe640 1 -- 172.21.15.50:0/212151693 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98003570 0 0) 0x7fb3a815aee0 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.032+0000 7fb3ace43640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a81583c0 0x7fb3a80b1660 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097a0 tx=0x7fb39c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d62531a6f0c26f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.032+0000 7fb3a77fe640 1 -- 172.21.15.50:0/212151693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c02d040 con 0x7fb3a81583c0 2023-08-10T10:45:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.032+0000 7fb3a77fe640 1 -- 172.21.15.50:0/212151693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c031810 con 0x7fb3a81583c0 2023-08-10T10:45:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.032+0000 7fb3a77fe640 1 -- 172.21.15.50:0/212151693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c031ba0 con 0x7fb3a81583c0 2023-08-10T10:45:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 -- 172.21.15.50:0/212151693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a81583c0 msgr2=0x7fb3a80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a81583c0 0x7fb3a80b1660 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097a0 tx=0x7fb39c02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 -- 172.21.15.50:0/212151693 shutdown_connections 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 --2- 172.21.15.50:0/212151693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a81583c0 0x7fb3a80b1660 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 -- 172.21.15.50:0/212151693 >> 172.21.15.50:0/212151693 conn(0x7fb3a80caf80 msgr2=0x7fb3a80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 -- 172.21.15.50:0/212151693 shutdown_connections 2023-08-10T10:45:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.033+0000 7fb3ade45640 1 -- 172.21.15.50:0/212151693 wait complete. 2023-08-10T10:45:55.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.035+0000 7fb3ade45640 1 Processor -- start 2023-08-10T10:45:55.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.035+0000 7fb3ade45640 1 -- start start 2023-08-10T10:45:55.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a806f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3a81583c0 0x7fb3a81efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80c2440 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f06b0 con 0x7fb3a81583c0 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3ade45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f0990 con 0x7fb3a8069db0 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35134/0 (socket says 172.21.15.50:35134) 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.036+0000 7fb3a7fff640 1 -- 172.21.15.50:0/1166167119 learned_addr learned my addr 172.21.15.50:0/1166167119 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:55.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 -- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 msgr2=0x7fb3a806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 -- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3a81583c0 msgr2=0x7fb3a81efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3a81583c0 0x7fb3a81efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 -- 172.21.15.50:0/1166167119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c009400 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a7fff640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c4b0 tx=0x7fb39400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3940074e0 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.037+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb394007660 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.038+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394004a20 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.038+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a81f0c70 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.038+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a806fd90 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.039+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a8066e30 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.040+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb394004b80 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.041+0000 7fb3a57fa640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 0x7fb38c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.041+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb394088720 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.041+0000 7fb3ace43640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 0x7fb38c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.042+0000 7fb3ace43640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 0x7fb38c06d110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb39c036000 tx=0x7fb39c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.045+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb3940537f0 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.235+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3a80c2580 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.235+0000 7fb3a57fa640 1 -- 172.21.15.50:0/1166167119 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb394056e10 con 0x7fb3a80b1ba0 2023-08-10T10:45:55.237 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:45:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 msgr2=0x7fb38c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 0x7fb38c06d110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb39c036000 tx=0x7fb39c030000 comp rx=0 tx=0).stop 2023-08-10T10:45:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 msgr2=0x7fb3a8156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c4b0 tx=0x7fb39400c970 comp rx=0 tx=0).stop 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 shutdown_connections 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb38c06ac50 0x7fb38c06d110 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3a81583c0 0x7fb3a81efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a80b1ba0 0x7fb3a8156cb0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 --2- 172.21.15.50:0/1166167119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3a8069db0 0x7fb3a806f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.238+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 >> 172.21.15.50:0/1166167119 conn(0x7fb3a80caf80 msgr2=0x7fb3a80c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.239+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 shutdown_connections 2023-08-10T10:45:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.239+0000 7fb3ade45640 1 -- 172.21.15.50:0/1166167119 wait complete. 2023-08-10T10:45:55.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:45:55.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.475+0000 7f7bb5e57640 1 Processor -- start 2023-08-10T10:45:55.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.475+0000 7f7bb5e57640 1 -- start start 2023-08-10T10:45:55.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.476+0000 7f7bb5e57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 0x7f7bb00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.476+0000 7f7bb5e57640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7bb00ada90 0x7f7bb006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.476+0000 7f7bb5e57640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb00adf20 con 0x7f7bb0159c10 2023-08-10T10:45:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.476+0000 7f7bb5e57640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb006ebb0 con 0x7f7bb00ada90 2023-08-10T10:45:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.476+0000 7f7bb5e57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb006ee90 con 0x7f7bb00ca530 2023-08-10T10:45:55.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7bb0159c10 0x7f7bb00c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48680/0 (socket says 172.21.15.50:48680) 2023-08-10T10:45:55.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baf7fe640 1 -- 172.21.15.50:0/4176303838 learned_addr learned my addr 172.21.15.50:0/4176303838 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:55.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baffff640 1 --2- 172.21.15.50:0/4176303838 >> v2:172.21.15.117:3300/0 conn(0x7f7bb00ada90 0x7f7bb006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744178147 0 0) 0x7f7bb00adf20 con 0x7f7bb0159c10 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b9c005730 con 0x7f7bb0159c10 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 0x7f7bb00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.477+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3223999255 0 0) 0x7f7b9c005730 con 0x7f7bb0159c10 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 msgr2=0x7f7bb00b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 0x7f7bb00b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 >> v2:172.21.15.117:3300/0 conn(0x7f7bb00ada90 msgr2=0x7f7bb006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 --2- 172.21.15.50:0/4176303838 >> v2:172.21.15.117:3300/0 conn(0x7f7bb00ada90 0x7f7bb006a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb006f170 con 0x7f7bb0159c10 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7ba0001670 con 0x7f7bb0159c10 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 >> v1:172.21.15.50:6789/0 conn(0x7f7bb0159c10 legacy=0x7f7bb00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7b9c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c0069d0 0x7f7b9c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 0x7f7b9c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb006ebb0 con 0x7f7b9c005b80 2023-08-10T10:45:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb006ee90 con 0x7f7b9c0069d0 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c00db90 con 0x7f7bb00ca530 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7b9c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c0069d0 0x7f7b9c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baf7fe640 1 -- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 msgr2=0x7f7b9c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb00ca530 0x7f7b9c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baf7fe640 1 -- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c0069d0 msgr2=0x7f7b9c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.478+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c0069d0 0x7f7b9c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.479+0000 7f7baf7fe640 1 -- 172.21.15.50:0/4176303838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c005730 con 0x7f7b9c005b80 2023-08-10T10:45:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.479+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c0069d0 0x7f7b9c006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:55.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.480+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7b9c005fa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c270 tx=0x7f7b9c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfbf0a336f9b7c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.480+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba002cae0 con 0x7f7b9c005b80 2023-08-10T10:45:55.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.480+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba002cc40 con 0x7f7b9c005b80 2023-08-10T10:45:55.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.480+0000 7f7baeffd640 1 -- 172.21.15.50:0/4176303838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba00058d0 con 0x7f7b9c005b80 2023-08-10T10:45:55.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 -- 172.21.15.50:0/4176303838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 msgr2=0x7f7b9c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/4176303838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7b9c005fa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c270 tx=0x7f7b9c007a00 comp rx=0 tx=0).stop 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7baffff640 1 -- 172.21.15.50:0/4176303838 reap_dead start 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 -- 172.21.15.50:0/4176303838 shutdown_connections 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 -- 172.21.15.50:0/4176303838 >> 172.21.15.50:0/4176303838 conn(0x7f7bb00b01b0 msgr2=0x7f7bb00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 -- 172.21.15.50:0/4176303838 shutdown_connections 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.481+0000 7f7bb5e57640 1 -- 172.21.15.50:0/4176303838 wait complete. 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.483+0000 7f7bb5e57640 1 Processor -- start 2023-08-10T10:45:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.483+0000 7f7bb5e57640 1 -- start start 2023-08-10T10:45:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb015c800 0x7f7bb0156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bb00b32b0 0x7f7bb00b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00b3c70 con 0x7f7b9c005b80 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb015d000 con 0x7f7bb00b32b0 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7bb5e57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb01e44e0 con 0x7f7bb015c800 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7baf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7baf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35154/0 (socket says 172.21.15.50:35154) 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7baf7fe640 1 -- 172.21.15.50:0/3928881222 learned_addr learned my addr 172.21.15.50:0/3928881222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.484+0000 7f7baffff640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bb00b32b0 0x7f7bb00b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb015c800 0x7f7bb0156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 -- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb015c800 msgr2=0x7f7bb0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb015c800 0x7f7bb0156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 -- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bb00b32b0 msgr2=0x7f7bb00b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bb00b32b0 0x7f7bb00b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 -- 172.21.15.50:0/3928881222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb01e47c0 con 0x7f7b9c005b80 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7baf7fe640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c210 tx=0x7f7ba0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba003c040 con 0x7f7b9c005b80 2023-08-10T10:45:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0004bf0 con 0x7f7b9c005b80 2023-08-10T10:45:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007070 con 0x7f7b9c005b80 2023-08-10T10:45:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.485+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb01e4aa0 con 0x7f7b9c005b80 2023-08-10T10:45:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.486+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb0157090 con 0x7f7b9c005b80 2023-08-10T10:45:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.487+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb01e4620 con 0x7f7b9c005b80 2023-08-10T10:45:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.488+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ba0032070 con 0x7f7b9c005b80 2023-08-10T10:45:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.488+0000 7f7bacff9640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 0x7f7b9006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.489+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ba00aa4a0 con 0x7f7b9c005b80 2023-08-10T10:45:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.489+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 0x7f7b9006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.489+0000 7f7ba7fff640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 0x7f7b9006d140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00b3ec0 tx=0x7f7b98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.493+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7bb01e4620 con 0x7f7b9c005b80 2023-08-10T10:45:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.683+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bb01e4620 con 0x7f7b9c005b80 2023-08-10T10:45:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.684+0000 7f7bacff9640 1 -- 172.21.15.50:0/3928881222 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7bb01e4620 con 0x7f7b9c005b80 2023-08-10T10:45:55.686 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:45:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 msgr2=0x7f7b9006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 0x7f7b9006d140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00b3ec0 tx=0x7f7b98008040 comp rx=0 tx=0).stop 2023-08-10T10:45:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 msgr2=0x7f7bb01f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c210 tx=0x7f7ba0001a00 comp rx=0 tx=0).stop 2023-08-10T10:45:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 shutdown_connections 2023-08-10T10:45:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b9006ac80 0x7f7b9006d140 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bb00b32b0 0x7f7bb00b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bb015c800 0x7f7bb0156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.686+0000 7f7bb5e57640 1 --2- 172.21.15.50:0/3928881222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b9c005b80 0x7f7bb01f60f0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.687+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 >> 172.21.15.50:0/3928881222 conn(0x7f7bb00b01b0 msgr2=0x7f7bb00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.687+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 shutdown_connections 2023-08-10T10:45:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.687+0000 7f7bb5e57640 1 -- 172.21.15.50:0/3928881222 wait complete. 2023-08-10T10:45:55.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:45:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.935+0000 7f3937056640 1 Processor -- start 2023-08-10T10:45:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.935+0000 7f3937056640 1 -- start start 2023-08-10T10:45:55.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3937056640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 0x7f393006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3937056640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3930164cf0 con 0x7f393006d690 2023-08-10T10:45:55.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3937056640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393006dad0 con 0x7f39301651d0 2023-08-10T10:45:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3937056640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300ce950 con 0x7f39300cfc80 2023-08-10T10:45:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3935853640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f393006d690 0x7f39300ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48690/0 (socket says 172.21.15.50:48690) 2023-08-10T10:45:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3935853640 1 -- 172.21.15.50:0/2494733560 learned_addr learned my addr 172.21.15.50:0/2494733560 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.937+0000 7f3936054640 1 --2- 172.21.15.50:0/2494733560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 0x7f393006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.938+0000 7f3936054640 1 -- 172.21.15.50:0/2494733560 >> v1:172.21.15.117:6789/0 conn(0x7f39301651d0 legacy=0x7f393006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.938+0000 7f3936054640 1 -- 172.21.15.50:0/2494733560 >> v1:172.21.15.50:6789/0 conn(0x7f393006d690 legacy=0x7f39300ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.938+0000 7f3936054640 1 -- 172.21.15.50:0/2494733560 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393006ad80 con 0x7f39300cfc80 2023-08-10T10:45:55.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.940+0000 7f3936054640 1 --2- 172.21.15.50:0/2494733560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 0x7f393006a6e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f392c009dc0 tx=0x7f392c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be623f35cec1b816 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3935052640 1 -- 172.21.15.50:0/2494733560 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c02cd50 con 0x7f39300cfc80 2023-08-10T10:45:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3935052640 1 -- 172.21.15.50:0/2494733560 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c034440 con 0x7f39300cfc80 2023-08-10T10:45:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3935052640 1 -- 172.21.15.50:0/2494733560 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0347d0 con 0x7f39300cfc80 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3937056640 1 -- 172.21.15.50:0/2494733560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 msgr2=0x7f393006a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3937056640 1 --2- 172.21.15.50:0/2494733560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 0x7f393006a6e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f392c009dc0 tx=0x7f392c02bfa0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3937056640 1 -- 172.21.15.50:0/2494733560 shutdown_connections 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3937056640 1 --2- 172.21.15.50:0/2494733560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39300cfc80 0x7f393006a6e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.942+0000 7f3937056640 1 -- 172.21.15.50:0/2494733560 >> 172.21.15.50:0/2494733560 conn(0x7f39300d06a0 msgr2=0x7f39300d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:55.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.943+0000 7f3937056640 1 -- 172.21.15.50:0/2494733560 shutdown_connections 2023-08-10T10:45:55.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.943+0000 7f3937056640 1 -- 172.21.15.50:0/2494733560 wait complete. 2023-08-10T10:45:55.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.944+0000 7f3937056640 1 Processor -- start 2023-08-10T10:45:55.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.944+0000 7f3937056640 1 -- start start 2023-08-10T10:45:55.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39300cfc80 0x7f3930161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39301651d0 0x7f39300c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39301fafb0 con 0x7f393006d690 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39301fa330 con 0x7f39300cfc80 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.945+0000 7f3937056640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39301fa610 con 0x7f39301651d0 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35156/0 (socket says 172.21.15.50:35156) 2023-08-10T10:45:55.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 -- 172.21.15.50:0/3948168104 learned_addr learned my addr 172.21.15.50:0/3948168104 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 -- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39301651d0 msgr2=0x7f39300c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39301651d0 0x7f39300c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 -- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39300cfc80 msgr2=0x7f3930161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39300cfc80 0x7f3930161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.946+0000 7f3936054640 1 -- 172.21.15.50:0/3948168104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009a70 con 0x7f393006d690 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3936054640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f392c000f80 tx=0x7f392c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c03e620 con 0x7f393006d690 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c03e780 con 0x7f393006d690 2023-08-10T10:45:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c03eb30 con 0x7f393006d690 2023-08-10T10:45:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39301fa8f0 con 0x7f393006d690 2023-08-10T10:45:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.947+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39301501f0 con 0x7f393006d690 2023-08-10T10:45:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.948+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39301fb0f0 con 0x7f393006d690 2023-08-10T10:45:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.949+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f392c03b050 con 0x7f393006d690 2023-08-10T10:45:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.950+0000 7f3926ffd640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 0x7f391406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.950+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f392c0abfe0 con 0x7f393006d690 2023-08-10T10:45:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.951+0000 7f3935853640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 0x7f391406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.951+0000 7f3935853640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 0x7f391406d110 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39300c6fd0 tx=0x7f3920007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:55.955+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f392c077010 con 0x7f393006d690 2023-08-10T10:45:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.158+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3930066e30 con 0x7f393006d690 2023-08-10T10:45:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.159+0000 7f3926ffd640 1 -- 172.21.15.50:0/3948168104 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) v1 ==== 80+0+0 (secure 0 0 0) 0x7f392c039080 con 0x7f393006d690 2023-08-10T10:45:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:45:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 msgr2=0x7f391406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 0x7f391406d110 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39300c6fd0 tx=0x7f3920007a40 comp rx=0 tx=0).stop 2023-08-10T10:45:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 msgr2=0x7f393014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f392c000f80 tx=0x7f392c004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 shutdown_connections 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39301651d0 0x7f39300c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f391406ac50 0x7f391406d110 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39300cfc80 0x7f3930161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 --2- 172.21.15.50:0/3948168104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393006d690 0x7f393014fcb0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 >> 172.21.15.50:0/3948168104 conn(0x7f39300d06a0 msgr2=0x7f393006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 shutdown_connections 2023-08-10T10:45:56.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.162+0000 7f3937056640 1 -- 172.21.15.50:0/3948168104 wait complete. 2023-08-10T10:45:56.183 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:45:56.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:56.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:45:56.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:45:56.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:56.363 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:45:56.404 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:56.405 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:56.457 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:56.457 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:56.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:45:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.765+0000 7fe885f7f640 1 Processor -- start 2023-08-10T10:45:56.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.765+0000 7fe885f7f640 1 -- start start 2023-08-10T10:45:56.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe885f7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800b0620 0x7fe8800ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe885f7f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8801604d0 con 0x7fe8801646f0 2023-08-10T10:45:56.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe885f7f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800cca30 con 0x7fe8801600f0 2023-08-10T10:45:56.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe885f7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800cc100 con 0x7fe8800b0620 2023-08-10T10:45:56.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe88577e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8801646f0 0x7fe880166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48704/0 (socket says 172.21.15.50:48704) 2023-08-10T10:45:56.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe88577e640 1 -- 172.21.15.50:0/2219892893 learned_addr learned my addr 172.21.15.50:0/2219892893 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:56.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.767+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800b0620 0x7fe8800ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431275345 0 0) 0x7fe8801604d0 con 0x7fe8801646f0 2023-08-10T10:45:56.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe870003520 con 0x7fe8801646f0 2023-08-10T10:45:56.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3171991844 0 0) 0x7fe870003520 con 0x7fe8801646f0 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800b0620 msgr2=0x7fe8800ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800b0620 0x7fe8800ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 >> v1:172.21.15.117:6789/0 conn(0x7fe8801600f0 legacy=0x7fe8800aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800cc3e0 con 0x7fe8801646f0 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe8780019f0 con 0x7fe8801646f0 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 >> v1:172.21.15.50:6789/0 conn(0x7fe8801646f0 legacy=0x7fe880166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe870003a10 0x7fe870003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe870004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe870005180 0x7fe87000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800cc100 con 0x7fe8700047c0 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87000c100 con 0x7fe870005180 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.768+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87000c2c0 con 0x7fe870003a10 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe870004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe884f7d640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe870003a10 0x7fe870003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe88577e640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe870005180 0x7fe87000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 -- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe870003a10 msgr2=0x7fe870003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe870003a10 0x7fe870003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 -- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe870005180 msgr2=0x7fe87000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe870005180 0x7fe87000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe87ffff640 1 -- 172.21.15.50:0/2219892893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870003520 con 0x7fe8700047c0 2023-08-10T10:45:56.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.769+0000 7fe884f7d640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe870003a10 0x7fe870003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:56.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.771+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe870004c40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe8800ce430 tx=0x7fe8700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04334e7f783171e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:56.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.771+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c02c580 con 0x7fe8700047c0 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.771+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c02c6e0 con 0x7fe8700047c0 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.771+0000 7fe87f7fe640 1 -- 172.21.15.50:0/2219892893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c02ca50 con 0x7fe8700047c0 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 -- 172.21.15.50:0/2219892893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 msgr2=0x7fe870004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2219892893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe870004c40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe8800ce430 tx=0x7fe8700057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe88577e640 1 -- 172.21.15.50:0/2219892893 reap_dead start 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 -- 172.21.15.50:0/2219892893 shutdown_connections 2023-08-10T10:45:56.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 -- 172.21.15.50:0/2219892893 >> 172.21.15.50:0/2219892893 conn(0x7fe88006ab80 msgr2=0x7fe88006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:56.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 -- 172.21.15.50:0/2219892893 shutdown_connections 2023-08-10T10:45:56.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.772+0000 7fe885f7f640 1 -- 172.21.15.50:0/2219892893 wait complete. 2023-08-10T10:45:56.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.774+0000 7fe885f7f640 1 Processor -- start 2023-08-10T10:45:56.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.774+0000 7fe885f7f640 1 -- start start 2023-08-10T10:45:56.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8800ae160 0x7fe88006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800ae5e0 0x7fe88006f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800aee90 con 0x7fe8700047c0 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880071ac0 con 0x7fe8800ae160 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe885f7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c6710 con 0x7fe8800ae5e0 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35168/0 (socket says 172.21.15.50:35168) 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 -- 172.21.15.50:0/2309092338 learned_addr learned my addr 172.21.15.50:0/2309092338 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:56.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 -- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800ae5e0 msgr2=0x7fe88006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800ae5e0 0x7fe88006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 -- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8800ae160 msgr2=0x7fe88006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8800ae160 0x7fe88006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.775+0000 7fe884f7d640 1 -- 172.21.15.50:0/2309092338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800aebb0 con 0x7fe8700047c0 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe884f7d640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe87400e580 tx=0x7fe87400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740052e0 con 0x7fe8700047c0 2023-08-10T10:45:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874005440 con 0x7fe8700047c0 2023-08-10T10:45:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874003830 con 0x7fe8700047c0 2023-08-10T10:45:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800c69b0 con 0x7fe8700047c0 2023-08-10T10:45:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.776+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe880163fe0 con 0x7fe8700047c0 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.778+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880066e30 con 0x7fe8700047c0 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.778+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe874003990 con 0x7fe8700047c0 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.779+0000 7fe87d7fa640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 0x7fe86406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.779+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8740892c0 con 0x7fe8700047c0 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.780+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 0x7fe86406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.780+0000 7fe87ffff640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 0x7fe86406d110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe86c036000 tx=0x7fe86c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.784+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8740542e0 con 0x7fe8700047c0 2023-08-10T10:45:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.980+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe880067910 con 0x7fe8700047c0 2023-08-10T10:45:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.981+0000 7fe87d7fa640 1 -- 172.21.15.50:0/2309092338 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fe874057900 con 0x7fe8700047c0 2023-08-10T10:45:56.983 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:45:56.984 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:45:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 msgr2=0x7fe86406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 0x7fe86406d110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe86c036000 tx=0x7fe86c02e000 comp rx=0 tx=0).stop 2023-08-10T10:45:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 msgr2=0x7fe8801514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe87400e580 tx=0x7fe87400ea40 comp rx=0 tx=0).stop 2023-08-10T10:45:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 shutdown_connections 2023-08-10T10:45:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8800ae5e0 0x7fe88006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe86406ac50 0x7fe86406d110 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8800ae160 0x7fe88006edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 --2- 172.21.15.50:0/2309092338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8700047c0 0x7fe8801514f0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.984+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 >> 172.21.15.50:0/2309092338 conn(0x7fe88006ab80 msgr2=0x7fe88006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.985+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 shutdown_connections 2023-08-10T10:45:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:56.985+0000 7fe885f7f640 1 -- 172.21.15.50:0/2309092338 wait complete. 2023-08-10T10:45:57.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:45:33.973819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:45:34.611242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:45:57.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:45:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.227+0000 7f435ee8d640 1 Processor -- start 2023-08-10T10:45:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.228+0000 7f435ee8d640 1 -- start start 2023-08-10T10:45:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.229+0000 7f435ee8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f435806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.229+0000 7f435ee8d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43580b1e00 0x7f43580ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.229+0000 7f435ee8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435806a5c0 con 0x7f43580cd490 2023-08-10T10:45:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.229+0000 7f435ee8d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435806b0c0 con 0x7f43580b1e00 2023-08-10T10:45:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.229+0000 7f435ee8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580cd920 con 0x7f435815fde0 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435e68c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43580cd490 0x7f43581604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48712/0 (socket says 172.21.15.50:48712) 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435e68c640 1 -- 172.21.15.50:0/2965097738 learned_addr learned my addr 172.21.15.50:0/2965097738 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435de8b640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f435806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435d68a640 1 --2- 172.21.15.50:0/2965097738 >> v2:172.21.15.117:3300/0 conn(0x7f43580b1e00 0x7f43580ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060527345 0 0) 0x7f435806a5c0 con 0x7f43580cd490 2023-08-10T10:45:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.230+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4344003520 con 0x7f43580cd490 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3801767049 0 0) 0x7f4344003520 con 0x7f43580cd490 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 msgr2=0x7f435806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f435806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 >> v2:172.21.15.117:3300/0 conn(0x7f43580b1e00 msgr2=0x7f43580ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 --2- 172.21.15.50:0/2965097738 >> v2:172.21.15.117:3300/0 conn(0x7f43580b1e00 0x7f43580ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435806a820 con 0x7f43580cd490 2023-08-10T10:45:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4350001670 con 0x7f43580cd490 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 >> v1:172.21.15.50:6789/0 conn(0x7f43580cd490 legacy=0x7f43581604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f43440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f43440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4344004d00 0x7f4344005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435806b0c0 con 0x7f4344003f60 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580cd920 con 0x7f4344004d00 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434400bae0 con 0x7f435815fde0 2023-08-10T10:45:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.231+0000 7f435d68a640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f43440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435de8b640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f43440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435e68c640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4344004d00 0x7f4344005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435d68a640 1 -- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 msgr2=0x7f43440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435d68a640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435815fde0 0x7f43440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435d68a640 1 -- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4344004d00 msgr2=0x7f4344005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435d68a640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4344004d00 0x7f4344005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435d68a640 1 -- 172.21.15.50:0/2965097738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344003520 con 0x7f4344003f60 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.232+0000 7f435e68c640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4344004d00 0x7f4344005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.233+0000 7f435d68a640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f43440047c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ac0 tx=0x7f43440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d8ef3581213ebd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.233+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434802c710 con 0x7f4344003f60 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.233+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434802c870 con 0x7f4344003f60 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.233+0000 7f435ce89640 1 -- 172.21.15.50:0/2965097738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434802cc00 con 0x7f4344003f60 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 -- 172.21.15.50:0/2965097738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 msgr2=0x7f43440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 --2- 172.21.15.50:0/2965097738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f43440047c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ac0 tx=0x7f43440057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435e68c640 1 -- 172.21.15.50:0/2965097738 reap_dead start 2023-08-10T10:45:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 -- 172.21.15.50:0/2965097738 shutdown_connections 2023-08-10T10:45:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 -- 172.21.15.50:0/2965097738 >> 172.21.15.50:0/2965097738 conn(0x7f43580d2900 msgr2=0x7f43580d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 -- 172.21.15.50:0/2965097738 shutdown_connections 2023-08-10T10:45:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.234+0000 7f435ee8d640 1 -- 172.21.15.50:0/2965097738 wait complete. 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.236+0000 7f435ee8d640 1 Processor -- start 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.236+0000 7f435ee8d640 1 -- start start 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4358158290 0x7f4358156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4358156740 0x7f43581f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358156bc0 con 0x7f4344003f60 2023-08-10T10:45:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b6e90 con 0x7f4358156740 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435ee8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b7170 con 0x7f4358158290 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.237+0000 7f435de8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35190/0 (socket says 172.21.15.50:35190) 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 -- 172.21.15.50:0/3374918875 learned_addr learned my addr 172.21.15.50:0/3374918875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435d68a640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4358158290 0x7f4358156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 -- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4358158290 msgr2=0x7f4358156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4358158290 0x7f4358156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 -- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4358156740 msgr2=0x7f43581f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4358156740 0x7f43581f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 -- 172.21.15.50:0/3374918875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580b7450 con 0x7f4344003f60 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.238+0000 7f435de8b640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f4354007f30 tx=0x7f4354011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.239+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400e030 con 0x7f4344003f60 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.239+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354016470 con 0x7f4344003f60 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.239+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43580b7730 con 0x7f4344003f60 2023-08-10T10:45:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.239+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354016820 con 0x7f4344003f60 2023-08-10T10:45:57.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.239+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4358149d00 con 0x7f4344003f60 2023-08-10T10:45:57.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.240+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358066e30 con 0x7f4344003f60 2023-08-10T10:45:57.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.241+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4354016980 con 0x7f4344003f60 2023-08-10T10:45:57.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.242+0000 7f434e7fc640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 0x7f433c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.243+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f435400f070 con 0x7f4344003f60 2023-08-10T10:45:57.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.243+0000 7f435d68a640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 0x7f433c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.244+0000 7f435d68a640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 0x7f433c06d140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4348036000 tx=0x7f4348030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.247+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4354055400 con 0x7f4344003f60 2023-08-10T10:45:57.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.439+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43580b7b10 con 0x7f4344003f60 2023-08-10T10:45:57.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.439+0000 7f434e7fc640 1 -- 172.21.15.50:0/3374918875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4354058a20 con 0x7f4344003f60 2023-08-10T10:45:57.441 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:45:57.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 msgr2=0x7f433c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 0x7f433c06d140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4348036000 tx=0x7f4348030000 comp rx=0 tx=0).stop 2023-08-10T10:45:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 msgr2=0x7f4358149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f4354007f30 tx=0x7f4354011660 comp rx=0 tx=0).stop 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 shutdown_connections 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.442+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f433c06ac80 0x7f433c06d140 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4358156740 0x7f43581f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4358158290 0x7f4358156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 --2- 172.21.15.50:0/3374918875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344003f60 0x7f4358149340 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 >> 172.21.15.50:0/3374918875 conn(0x7f43580d2900 msgr2=0x7f43580cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 shutdown_connections 2023-08-10T10:45:57.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.443+0000 7f435ee8d640 1 -- 172.21.15.50:0/3374918875 wait complete. 2023-08-10T10:45:57.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:45:57.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.692+0000 7fa7ea887640 1 Processor -- start 2023-08-10T10:45:57.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.692+0000 7fa7ea887640 1 -- start start 2023-08-10T10:45:57.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7ea887640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7e415ae40 0x7fa7e40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7ea887640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e406cb30 0x7fa7e40ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7ea887640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40adcb0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7ea887640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e406c320 con 0x7fa7e415ae40 2023-08-10T10:45:57.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7ea887640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e406b770 con 0x7fa7e406cb30 2023-08-10T10:45:57.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7e415ae40 0x7fa7e40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7e3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7e415ae40 0x7fa7e40b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35194/0 (socket says 172.21.15.50:35194) 2023-08-10T10:45:57.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.694+0000 7fa7e3fff640 1 -- 172.21.15.50:0/4018885158 learned_addr learned my addr 172.21.15.50:0/4018885158 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:57.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.695+0000 7fa7db7fe640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e406cb30 0x7fa7e40ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.695+0000 7fa7e3fff640 1 -- 172.21.15.50:0/4018885158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e406cb30 msgr2=0x7fa7e40ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.695+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e406cb30 0x7fa7e40ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.695+0000 7fa7e3fff640 1 -- 172.21.15.50:0/4018885158 >> v1:172.21.15.117:6789/0 conn(0x7fa7e40cd2a0 legacy=0x7fa7e40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:57.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.695+0000 7fa7e3fff640 1 -- 172.21.15.50:0/4018885158 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e406b9f0 con 0x7fa7e415ae40 2023-08-10T10:45:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.696+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e415ae40 0x7fa7e40b1510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009870 tx=0x7fa7d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7d81b32ba8c36d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.696+0000 7fa7e37fe640 1 -- 172.21.15.50:0/4018885158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4031640 con 0x7fa7e415ae40 2023-08-10T10:45:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.696+0000 7fa7e37fe640 1 -- 172.21.15.50:0/4018885158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d40317a0 con 0x7fa7e415ae40 2023-08-10T10:45:57.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.696+0000 7fa7e37fe640 1 -- 172.21.15.50:0/4018885158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4031b30 con 0x7fa7e415ae40 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 -- 172.21.15.50:0/4018885158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e415ae40 msgr2=0x7fa7e40b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e415ae40 0x7fa7e40b1510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009870 tx=0x7fa7d402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 -- 172.21.15.50:0/4018885158 shutdown_connections 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e406cb30 0x7fa7e40ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 --2- 172.21.15.50:0/4018885158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e415ae40 0x7fa7e40b1510 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 -- 172.21.15.50:0/4018885158 >> 172.21.15.50:0/4018885158 conn(0x7fa7e40b01b0 msgr2=0x7fa7e40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:57.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 -- 172.21.15.50:0/4018885158 shutdown_connections 2023-08-10T10:45:57.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.697+0000 7fa7ea887640 1 -- 172.21.15.50:0/4018885158 wait complete. 2023-08-10T10:45:57.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.699+0000 7fa7ea887640 1 Processor -- start 2023-08-10T10:45:57.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.699+0000 7fa7ea887640 1 -- start start 2023-08-10T10:45:57.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 0x7fa7e4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 0x7fa7e415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e41588a0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e415b630 con 0x7fa7e406cb30 2023-08-10T10:45:57.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7ea887640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40c68f0 con 0x7fa7e415ae40 2023-08-10T10:45:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.700+0000 7fa7db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35202/0 (socket says 172.21.15.50:35202) 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 -- 172.21.15.50:0/3024969205 learned_addr learned my addr 172.21.15.50:0/3024969205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 0x7fa7e4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7e8e24640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 0x7fa7e415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 -- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 msgr2=0x7fa7e415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 0x7fa7e415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 -- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 msgr2=0x7fa7e4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 0x7fa7e4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 -- 172.21.15.50:0/3024969205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40094d0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 0x7fa7e4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7e8e24640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 0x7fa7e415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.701+0000 7fa7db7fe640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c7c0 tx=0x7fa7cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.702+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc007820 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.702+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc007980 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.702+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc007cf0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.702+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e40c6bd0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.702+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e40c6eb0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.703+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e415b7e0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.704+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7cc0113f0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.705+0000 7fa7e17fa640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 0x7fa7c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.706+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7cc089180 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.706+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 0x7fa7c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:57.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.707+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 0x7fa7c406d110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4036000 tx=0x7fa7d403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:57.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.710+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa7e415b7e0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.903+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7e415b7a0 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.904+0000 7fa7e17fa640 1 -- 172.21.15.50:0/3024969205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7cc054220 con 0x7fa7e40cd2a0 2023-08-10T10:45:57.905 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:45:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.907+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 msgr2=0x7fa7c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.907+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 0x7fa7c406d110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4036000 tx=0x7fa7d403c040 comp rx=0 tx=0).stop 2023-08-10T10:45:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.907+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 msgr2=0x7fa7e415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.907+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c7c0 tx=0x7fa7cc00cc80 comp rx=0 tx=0).stop 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 shutdown_connections 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7e415ae40 0x7fa7e415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7e40cd2a0 0x7fa7e415bac0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa7c406ac50 0x7fa7c406d110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 --2- 172.21.15.50:0/3024969205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7e406cb30 0x7fa7e4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:57.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 >> 172.21.15.50:0/3024969205 conn(0x7fa7e40b01b0 msgr2=0x7fa7e4065380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 shutdown_connections 2023-08-10T10:45:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:57.908+0000 7fa7ea887640 1 -- 172.21.15.50:0/3024969205 wait complete. 2023-08-10T10:45:57.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:45:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.139+0000 7f4986a67640 1 Processor -- start 2023-08-10T10:45:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.139+0000 7f4986a67640 1 -- start start 2023-08-10T10:45:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4986a67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f49800b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4986a67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f498006cb30 0x7f49800ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4986a67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49800adcb0 con 0x7f498015ae40 2023-08-10T10:45:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4986a67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498006c320 con 0x7f498006cb30 2023-08-10T10:45:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4986a67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498006b770 con 0x7f49800cd9b0 2023-08-10T10:45:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4984803640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f498015ae40 0x7f49800cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48724/0 (socket says 172.21.15.50:48724) 2023-08-10T10:45:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.141+0000 7f4984803640 1 -- 172.21.15.50:0/1268859526 learned_addr learned my addr 172.21.15.50:0/1268859526 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497ffff640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f49800b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f4985004640 1 --2- 172.21.15.50:0/1268859526 >> v2:172.21.15.117:3300/0 conn(0x7f498006cb30 0x7f49800ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792879933 0 0) 0x7f49800adcb0 con 0x7f498015ae40 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4968003520 con 0x7f498015ae40 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234126784 0 0) 0x7f4968003520 con 0x7f498015ae40 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 msgr2=0x7f49800b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f49800b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 >> v2:172.21.15.117:3300/0 conn(0x7f498006cb30 msgr2=0x7f49800ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 --2- 172.21.15.50:0/1268859526 >> v2:172.21.15.117:3300/0 conn(0x7f498006cb30 0x7f49800ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498006b9f0 con 0x7f498015ae40 2023-08-10T10:45:58.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f4970001670 con 0x7f498015ae40 2023-08-10T10:45:58.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 >> v1:172.21.15.50:6789/0 conn(0x7f498015ae40 legacy=0x7f49800cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f4968003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.142+0000 7f497f7fe640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4968003ef0 0x7f49680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f497f7fe640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4968004d00 0x7f4968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498006c320 con 0x7f4968004d00 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498006b770 con 0x7f4968003ef0 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496800b980 con 0x7f49800cd9b0 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4968004d00 0x7f4968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4984803640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f4968003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 -- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 msgr2=0x7f4968003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f4968003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f497ffff640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4968003ef0 0x7f49680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 -- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4968003ef0 msgr2=0x7f49680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:58.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4968003ef0 0x7f49680047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4985004640 1 -- 172.21.15.50:0/1268859526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968003520 con 0x7f4968004d00 2023-08-10T10:45:58.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.143+0000 7f4984803640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49800cd9b0 0x7f4968003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:58.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.144+0000 7f4985004640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4968004d00 0x7f4968005180 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f498006cf50 tx=0x7f49680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975e9d62abe58e6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497802c6b0 con 0x7f4968004d00 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497802c810 con 0x7f4968004d00 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f497f7fe640 1 -- 172.21.15.50:0/1268859526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497802cba0 con 0x7f4968004d00 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f4986a67640 1 -- 172.21.15.50:0/1268859526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4968004d00 msgr2=0x7f4968005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f4986a67640 1 --2- 172.21.15.50:0/1268859526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4968004d00 0x7f4968005180 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f498006cf50 tx=0x7f49680057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f4985004640 1 -- 172.21.15.50:0/1268859526 reap_dead start 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f4986a67640 1 -- 172.21.15.50:0/1268859526 shutdown_connections 2023-08-10T10:45:58.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.145+0000 7f4986a67640 1 -- 172.21.15.50:0/1268859526 >> 172.21.15.50:0/1268859526 conn(0x7f49800b01b0 msgr2=0x7f49800b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.146+0000 7f4986a67640 1 -- 172.21.15.50:0/1268859526 shutdown_connections 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.146+0000 7f4986a67640 1 -- 172.21.15.50:0/1268859526 wait complete. 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.147+0000 7f4986a67640 1 Processor -- start 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 -- start start 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 0x7f4980157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 0x7f49800c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498015df60 con 0x7f49800cc270 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49800ccc60 con 0x7f498015cd20 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.148+0000 7f4986a67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4980158450 con 0x7f4968004d00 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35218/0 (socket says 172.21.15.50:35218) 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 -- 172.21.15.50:0/3118697092 learned_addr learned my addr 172.21.15.50:0/3118697092 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4984803640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 0x7f4980157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f497ffff640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 0x7f49800c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 -- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 msgr2=0x7f4980157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 0x7f4980157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 -- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 msgr2=0x7f49800c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 0x7f49800c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4985004640 1 -- 172.21.15.50:0/3118697092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498015d2e0 con 0x7f49800cc270 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f497ffff640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 0x7f49800c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.149+0000 7f4984803640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 0x7f4980157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:58.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f4985004640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4978037040 tx=0x7f4978004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978043070 con 0x7f49800cc270 2023-08-10T10:45:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49780044a0 con 0x7f49800cc270 2023-08-10T10:45:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497802c6b0 con 0x7f49800cc270 2023-08-10T10:45:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498015d5c0 con 0x7f49800cc270 2023-08-10T10:45:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.150+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498015db80 con 0x7f49800cc270 2023-08-10T10:45:58.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.151+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49800c9b90 con 0x7f49800cc270 2023-08-10T10:45:58.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.152+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4978003850 con 0x7f49800cc270 2023-08-10T10:45:58.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.153+0000 7f497d7fa640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 0x7f496c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.153+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49780aaac0 con 0x7f49800cc270 2023-08-10T10:45:58.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.153+0000 7f4984803640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 0x7f496c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.154+0000 7f4984803640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 0x7f496c06d140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f49700017a0 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.157+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4978075ad0 con 0x7f49800cc270 2023-08-10T10:45:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.352+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49800612b0 con 0x7f49800cc270 2023-08-10T10:45:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.353+0000 7f497d7fa640 1 -- 172.21.15.50:0/3118697092 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49780790f0 con 0x7f49800cc270 2023-08-10T10:45:58.354 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:45:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.355+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 msgr2=0x7f496c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.355+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 0x7f496c06d140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f49700017a0 tx=0x7f4970009040 comp rx=0 tx=0).stop 2023-08-10T10:45:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.355+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 msgr2=0x7f49800cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.355+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4978037040 tx=0x7f4978004730 comp rx=0 tx=0).stop 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 shutdown_connections 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49800cc270 0x7f49800cc720 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f496c06ac80 0x7f496c06d140 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f498015cd20 0x7f49800c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 --2- 172.21.15.50:0/3118697092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4968004d00 0x7f4980157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 >> 172.21.15.50:0/3118697092 conn(0x7f49800b01b0 msgr2=0x7f49800b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 shutdown_connections 2023-08-10T10:45:58.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.356+0000 7f4986a67640 1 -- 172.21.15.50:0/3118697092 wait complete. 2023-08-10T10:45:58.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:45:58.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.605+0000 7fe53a10f640 1 Processor -- start 2023-08-10T10:45:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.605+0000 7fe53a10f640 1 -- start start 2023-08-10T10:45:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe53a10f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53415cbb0 0x7fe5341612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe53a10f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5340c9420 0x7fe5340c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe53a10f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe534161800 con 0x7fe5340c98b0 2023-08-10T10:45:58.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe53a10f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534160870 con 0x7fe5340c9420 2023-08-10T10:45:58.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe53a10f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340ca370 con 0x7fe53415cbb0 2023-08-10T10:45:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe533fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5340c9420 0x7fe5340c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe533fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5340c9420 0x7fe5340c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35230/0 (socket says 172.21.15.50:35230) 2023-08-10T10:45:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.607+0000 7fe533fff640 1 -- 172.21.15.50:0/2028243014 learned_addr learned my addr 172.21.15.50:0/2028243014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.608+0000 7fe5337fe640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53415cbb0 0x7fe5341612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.608+0000 7fe533fff640 1 -- 172.21.15.50:0/2028243014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53415cbb0 msgr2=0x7fe5341612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.608+0000 7fe533fff640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53415cbb0 0x7fe5341612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.608+0000 7fe533fff640 1 -- 172.21.15.50:0/2028243014 >> v1:172.21.15.50:6789/0 conn(0x7fe5340c98b0 legacy=0x7fe5340c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.608+0000 7fe533fff640 1 -- 172.21.15.50:0/2028243014 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340ca650 con 0x7fe5340c9420 2023-08-10T10:45:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.609+0000 7fe533fff640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5340c9420 0x7fe5340c9d10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbedcaa101a289f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.609+0000 7fe5327fc640 1 -- 172.21.15.50:0/2028243014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c02ca80 con 0x7fe5340c9420 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.609+0000 7fe5327fc640 1 -- 172.21.15.50:0/2028243014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c02cbe0 con 0x7fe5340c9420 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.609+0000 7fe5327fc640 1 -- 172.21.15.50:0/2028243014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0343f0 con 0x7fe5340c9420 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 -- 172.21.15.50:0/2028243014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5340c9420 msgr2=0x7fe5340c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5340c9420 0x7fe5340c9d10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c02bee0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 -- 172.21.15.50:0/2028243014 shutdown_connections 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5340c9420 0x7fe5340c9d10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 --2- 172.21.15.50:0/2028243014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53415cbb0 0x7fe5341612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 -- 172.21.15.50:0/2028243014 >> 172.21.15.50:0/2028243014 conn(0x7fe5340b01b0 msgr2=0x7fe5340b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:58.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 -- 172.21.15.50:0/2028243014 shutdown_connections 2023-08-10T10:45:58.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.610+0000 7fe53a10f640 1 -- 172.21.15.50:0/2028243014 wait complete. 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.612+0000 7fe53a10f640 1 Processor -- start 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.612+0000 7fe53a10f640 1 -- start start 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5340c9420 0x7fe5340ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 0x7fe5341f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534159540 con 0x7fe53415cbb0 2023-08-10T10:45:58.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53406b0c0 con 0x7fe5340c98b0 2023-08-10T10:45:58.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe53a10f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340ad590 con 0x7fe5340c9420 2023-08-10T10:45:58.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe533fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe533fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35238/0 (socket says 172.21.15.50:35238) 2023-08-10T10:45:58.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.613+0000 7fe533fff640 1 -- 172.21.15.50:0/89419700 learned_addr learned my addr 172.21.15.50:0/89419700 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe5337fe640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5340c9420 0x7fe5340ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 -- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5340c9420 msgr2=0x7fe5340ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5340c9420 0x7fe5340ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 -- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 msgr2=0x7fe5341f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe532ffd640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 0x7fe5341f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 0x7fe5341f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 -- 172.21.15.50:0/89419700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009b30 con 0x7fe53415cbb0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe532ffd640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 0x7fe5341f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.614+0000 7fe533fff640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.615+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c009510 con 0x7fe53415cbb0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.615+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c03e450 con 0x7fe53415cbb0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.615+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c03e800 con 0x7fe53415cbb0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.615+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5340ad830 con 0x7fe53415cbb0 2023-08-10T10:45:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.615+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53406aa70 con 0x7fe53415cbb0 2023-08-10T10:45:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.616+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53406b230 con 0x7fe53415cbb0 2023-08-10T10:45:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.617+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe52c02cd50 con 0x7fe53415cbb0 2023-08-10T10:45:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.618+0000 7fe51bfff640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 0x7fe52006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.618+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe52c0abd60 con 0x7fe53415cbb0 2023-08-10T10:45:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.618+0000 7fe5337fe640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 0x7fe52006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.619+0000 7fe5337fe640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 0x7fe52006d140 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.622+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe52c076d70 con 0x7fe53415cbb0 2023-08-10T10:45:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.813+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5340612b0 con 0x7fe53415cbb0 2023-08-10T10:45:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.814+0000 7fe51bfff640 1 -- 172.21.15.50:0/89419700 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe52c07a390 con 0x7fe53415cbb0 2023-08-10T10:45:58.816 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:45:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 msgr2=0x7fe52006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 0x7fe52006d140 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).stop 2023-08-10T10:45:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 msgr2=0x7fe5340c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c004a40 comp rx=0 tx=0).stop 2023-08-10T10:45:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 shutdown_connections 2023-08-10T10:45:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe53415cbb0 0x7fe5340c3b60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52006ac80 0x7fe52006d140 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.816+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5340c98b0 0x7fe5341f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.817+0000 7fe53a10f640 1 --2- 172.21.15.50:0/89419700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5340c9420 0x7fe5340ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.817+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 >> 172.21.15.50:0/89419700 conn(0x7fe5340b01b0 msgr2=0x7fe53415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.817+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 shutdown_connections 2023-08-10T10:45:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:58.817+0000 7fe53a10f640 1 -- 172.21.15.50:0/89419700 wait complete. 2023-08-10T10:45:58.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:45:59.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.065+0000 7f247562c640 1 Processor -- start 2023-08-10T10:45:59.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.065+0000 7f247562c640 1 -- start start 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f247562c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 0x7f24700cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f247562c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24700ce340 0x7f24700ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f247562c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247015e440 con 0x7f247015a8f0 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f247562c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700ced30 con 0x7f24700ce340 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f247562c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247015e720 con 0x7f24700b6270 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f246ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f247015a8f0 0x7f24700cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48742/0 (socket says 172.21.15.50:48742) 2023-08-10T10:45:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.066+0000 7f246ffff640 1 -- 172.21.15.50:0/2418860943 learned_addr learned my addr 172.21.15.50:0/2418860943 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636137890 0 0) 0x7f247015e440 con 0x7f247015a8f0 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f245c003520 con 0x7f247015a8f0 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f24677fe640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 0x7f24700cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f2474e2b640 1 --2- 172.21.15.50:0/2418860943 >> v2:172.21.15.117:3300/0 conn(0x7f24700ce340 0x7f24700ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289637835 0 0) 0x7f245c003520 con 0x7f247015a8f0 2023-08-10T10:45:59.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 msgr2=0x7f24700cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 0x7f24700cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 >> v2:172.21.15.117:3300/0 conn(0x7f24700ce340 msgr2=0x7f24700ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 --2- 172.21.15.50:0/2418860943 >> v2:172.21.15.117:3300/0 conn(0x7f24700ce340 0x7f24700ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247015ea00 con 0x7f247015a8f0 2023-08-10T10:45:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f24600019f0 con 0x7f247015a8f0 2023-08-10T10:45:59.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 >> v1:172.21.15.50:6789/0 conn(0x7f247015a8f0 legacy=0x7f24700cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c0039e0 0x7f245c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0047c0 0x7f245c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 0x7f245c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700ced30 con 0x7f245c0039e0 2023-08-10T10:45:59.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247015e720 con 0x7f245c0047c0 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.067+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c00bab0 con 0x7f24700b6270 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c0039e0 0x7f245c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 -- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 msgr2=0x7f245c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24700b6270 0x7f245c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 -- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0047c0 msgr2=0x7f245c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0047c0 0x7f245c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.068+0000 7f246ffff640 1 -- 172.21.15.50:0/2418860943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c003520 con 0x7f245c0039e0 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.069+0000 7f246ffff640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c0039e0 0x7f245c003e00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f246000a830 tx=0x7f245c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f587f84b903a0a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.069+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246002cea0 con 0x7f245c0039e0 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246002f070 con 0x7f245c0039e0 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f246f7fe640 1 -- 172.21.15.50:0/2418860943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460034890 con 0x7f245c0039e0 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 -- 172.21.15.50:0/2418860943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c0039e0 msgr2=0x7f245c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 --2- 172.21.15.50:0/2418860943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c0039e0 0x7f245c003e00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f246000a830 tx=0x7f245c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f2474e2b640 1 -- 172.21.15.50:0/2418860943 reap_dead start 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 -- 172.21.15.50:0/2418860943 shutdown_connections 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 -- 172.21.15.50:0/2418860943 >> 172.21.15.50:0/2418860943 conn(0x7f247006d3c0 msgr2=0x7f24700b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 -- 172.21.15.50:0/2418860943 shutdown_connections 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.070+0000 7f247562c640 1 -- 172.21.15.50:0/2418860943 wait complete. 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.072+0000 7f247562c640 1 Processor -- start 2023-08-10T10:45:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.073+0000 7f247562c640 1 -- start start 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 0x7f2470158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 0x7f24700b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700ad8e0 con 0x7f24700b2830 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700adbc0 con 0x7f245c0039e0 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f247562c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700adea0 con 0x7f2470159030 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35256/0 (socket says 172.21.15.50:35256) 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 -- 172.21.15.50:0/1962114870 learned_addr learned my addr 172.21.15.50:0/1962114870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f246ffff640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 0x7f2470158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f24677fe640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 0x7f24700b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 -- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 msgr2=0x7f24700b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 0x7f24700b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 -- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 msgr2=0x7f2470158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 0x7f2470158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f2474e2b640 1 -- 172.21.15.50:0/1962114870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700ae180 con 0x7f24700b2830 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f24677fe640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 0x7f24700b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.074+0000 7f246ffff640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 0x7f2470158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f2474e2b640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f24700d1870 tx=0x7f246800d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468017070 con 0x7f24700b2830 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468004020 con 0x7f24700b2830 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468004210 con 0x7f24700b2830 2023-08-10T10:45:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700ae460 con 0x7f24700b2830 2023-08-10T10:45:59.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.075+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700b2ce0 con 0x7f24700b2830 2023-08-10T10:45:59.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.076+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700ae650 con 0x7f24700b2830 2023-08-10T10:45:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.077+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2468004370 con 0x7f24700b2830 2023-08-10T10:45:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.079+0000 7f246d7fa640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 0x7f245006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.079+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2468088cd0 con 0x7f24700b2830 2023-08-10T10:45:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.079+0000 7f246ffff640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 0x7f245006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.080+0000 7f246ffff640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 0x7f245006d140 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f246000a830 tx=0x7f2460009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.083+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2468053d70 con 0x7f24700b2830 2023-08-10T10:45:59.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.298+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2470066e30 con 0x7f24700b2830 2023-08-10T10:45:59.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.299+0000 7f246d7fa640 1 -- 172.21.15.50:0/1962114870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2468057390 con 0x7f24700b2830 2023-08-10T10:45:59.300 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:45:59.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.301+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 msgr2=0x7f245006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.301+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 0x7f245006d140 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f246000a830 tx=0x7f2460009030 comp rx=0 tx=0).stop 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.301+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 msgr2=0x7f2470149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.301+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f24700d1870 tx=0x7f246800d7e0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 shutdown_connections 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24700b2830 0x7f2470149890 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2470159030 0x7f24700b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f245006ac80 0x7f245006d140 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 --2- 172.21.15.50:0/1962114870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f245c0039e0 0x7f2470158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 >> 172.21.15.50:0/1962114870 conn(0x7f247006d3c0 msgr2=0x7f2470069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:59.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 shutdown_connections 2023-08-10T10:45:59.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.302+0000 7f247562c640 1 -- 172.21.15.50:0/1962114870 wait complete. 2023-08-10T10:45:59.323 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:45:59.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:59.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:45:59.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:45:59.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:45:59.452 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:45:59.501 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:45:59.501 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:59.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:45:59.565 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:45:59.565 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:45:59.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:45:59.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:45:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.860+0000 7f30a1808640 1 Processor -- start 2023-08-10T10:45:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.861+0000 7f30a1808640 1 -- start start 2023-08-10T10:45:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c15cb90 0x7f309c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 0x7f309c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f309c0cfc20 0x7f309c0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0d00b0 con 0x7f309c0cfc20 2023-08-10T10:45:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0d1630 con 0x7f309c0d22e0 2023-08-10T10:45:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.862+0000 7f30a1808640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0d0a20 con 0x7f309c15cb90 2023-08-10T10:45:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f309c0cfc20 0x7f309c0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f309c0cfc20 0x7f309c0d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35266/0 (socket says 172.21.15.50:35266) 2023-08-10T10:45:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 -- 172.21.15.50:0/1574994990 learned_addr learned my addr 172.21.15.50:0/1574994990 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a0806640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c15cb90 0x7f309c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f309bfff640 1 --2- 172.21.15.50:0/1574994990 >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 0x7f309c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 -- 172.21.15.50:0/1574994990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c15cb90 msgr2=0x7f309c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c15cb90 0x7f309c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 -- 172.21.15.50:0/1574994990 >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 msgr2=0x7f309c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 --2- 172.21.15.50:0/1574994990 >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 0x7f309c0cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f30a1007640 1 -- 172.21.15.50:0/1574994990 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c0d0d00 con 0x7f309c0cfc20 2023-08-10T10:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.863+0000 7f309bfff640 1 --2- 172.21.15.50:0/1574994990 >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 0x7f309c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.864+0000 7f30a1007640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0d2820 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f309c0d3920 tx=0x7f309402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5585b04e21de3ede server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.864+0000 7f309b7fe640 1 -- 172.21.15.50:0/1574994990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309402c9f0 con 0x7f309c0cfc20 2023-08-10T10:45:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f309b7fe640 1 -- 172.21.15.50:0/1574994990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309402cb50 con 0x7f309c0cfc20 2023-08-10T10:45:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f309b7fe640 1 -- 172.21.15.50:0/1574994990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30940343f0 con 0x7f309c0cfc20 2023-08-10T10:45:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 -- 172.21.15.50:0/1574994990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 msgr2=0x7f309c0d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0d2820 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f309c0d3920 tx=0x7f309402be50 comp rx=0 tx=0).stop 2023-08-10T10:45:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 -- 172.21.15.50:0/1574994990 shutdown_connections 2023-08-10T10:45:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0d2820 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 --2- 172.21.15.50:0/1574994990 >> v2:172.21.15.117:3300/0 conn(0x7f309c0d22e0 0x7f309c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 --2- 172.21.15.50:0/1574994990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c15cb90 0x7f309c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 -- 172.21.15.50:0/1574994990 >> 172.21.15.50:0/1574994990 conn(0x7f309c069880 msgr2=0x7f309c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 -- 172.21.15.50:0/1574994990 shutdown_connections 2023-08-10T10:45:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.865+0000 7f30a1808640 1 -- 172.21.15.50:0/1574994990 wait complete. 2023-08-10T10:45:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.867+0000 7f30a1808640 1 Processor -- start 2023-08-10T10:45:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.867+0000 7f30a1808640 1 -- start start 2023-08-10T10:45:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c0d22e0 0x7f309c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309c15cb90 0x7f309c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0cadc0 con 0x7f309c0cfc20 2023-08-10T10:45:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0cb790 con 0x7f309c15cb90 2023-08-10T10:45:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a1808640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0ca1b0 con 0x7f309c0d22e0 2023-08-10T10:45:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.868+0000 7f30a0806640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35278/0 (socket says 172.21.15.50:35278) 2023-08-10T10:45:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 -- 172.21.15.50:0/732036813 learned_addr learned my addr 172.21.15.50:0/732036813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:45:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 -- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c0d22e0 msgr2=0x7f309c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c0d22e0 0x7f309c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 -- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309c15cb90 msgr2=0x7f309c15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309c15cb90 0x7f309c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 -- 172.21.15.50:0/732036813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094009b30 con 0x7f309c0cfc20 2023-08-10T10:45:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30a0806640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f309000d800 tx=0x7f309000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.869+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000b6c0 con 0x7f309c0cfc20 2023-08-10T10:45:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.870+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000b820 con 0x7f309c0cfc20 2023-08-10T10:45:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.870+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000bbb0 con 0x7f309c0cfc20 2023-08-10T10:45:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.870+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c0ca490 con 0x7f309c0cfc20 2023-08-10T10:45:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.870+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c0caa50 con 0x7f309c0cfc20 2023-08-10T10:45:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.871+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c0cc650 con 0x7f309c0cfc20 2023-08-10T10:45:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.872+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f309000bd10 con 0x7f309c0cfc20 2023-08-10T10:45:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.873+0000 7f30997fa640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 0x7f308006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.873+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30900899d0 con 0x7f309c0cfc20 2023-08-10T10:45:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.873+0000 7f309bfff640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 0x7f308006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.874+0000 7f309bfff640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 0x7f308006d110 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3088006fd0 tx=0x7f3088008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:45:59.877+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f309c0cc650 con 0x7f309c0cfc20 2023-08-10T10:46:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.105+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f309c0cc650 con 0x7f309c0cfc20 2023-08-10T10:46:00.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.106+0000 7f30997fa640 1 -- 172.21.15.50:0/732036813 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f309c0cc650 con 0x7f309c0cfc20 2023-08-10T10:46:00.108 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:00.108 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:46:00.108 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:46:00.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.108+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 msgr2=0x7f308006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.108+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 0x7f308006d110 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3088006fd0 tx=0x7f3088008040 comp rx=0 tx=0).stop 2023-08-10T10:46:00.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.108+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 msgr2=0x7f309c0cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.108+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f309000d800 tx=0x7f309000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 shutdown_connections 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f308006ac50 0x7f308006d110 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309c15cb90 0x7f309c15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f309c0d22e0 0x7f309c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 --2- 172.21.15.50:0/732036813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f309c0cfc20 0x7f309c0cb250 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 >> 172.21.15.50:0/732036813 conn(0x7f309c069880 msgr2=0x7f309c0cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:00.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 shutdown_connections 2023-08-10T10:46:00.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.109+0000 7f30a1808640 1 -- 172.21.15.50:0/732036813 wait complete. 2023-08-10T10:46:00.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:00.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.356+0000 7f363a034640 1 Processor -- start 2023-08-10T10:46:00.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.356+0000 7f363a034640 1 -- start start 2023-08-10T10:46:00.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f363a034640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f363415cd60 0x7f3634160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f363a034640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36340b8430 0x7f36340cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f363a034640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340ce200 con 0x7f36340cddb0 2023-08-10T10:46:00.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f363a034640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340b5bd0 con 0x7f363415cd60 2023-08-10T10:46:00.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f363a034640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3634161180 con 0x7f36340b8430 2023-08-10T10:46:00.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f3633fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36340cddb0 0x7f36340696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48750/0 (socket says 172.21.15.50:48750) 2023-08-10T10:46:00.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.357+0000 7f3633fff640 1 -- 172.21.15.50:0/3072227325 learned_addr learned my addr 172.21.15.50:0/3072227325 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:00.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f36337fe640 1 --2- 172.21.15.50:0/3072227325 >> v2:172.21.15.50:3300/0 conn(0x7f363415cd60 0x7f3634160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f362affd640 1 --2- 172.21.15.50:0/3072227325 >> v2:172.21.15.117:3300/0 conn(0x7f36340b8430 0x7f36340cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f3632ffd640 1 -- 172.21.15.50:0/3072227325 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120711381 0 0) 0x7f362c001490 con 0x7f36340cddb0 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f3632ffd640 1 -- 172.21.15.50:0/3072227325 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3620003520 con 0x7f36340cddb0 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f36337fe640 1 -- 172.21.15.50:0/3072227325 >> v2:172.21.15.117:3300/0 conn(0x7f36340b8430 msgr2=0x7f36340cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f36337fe640 1 --2- 172.21.15.50:0/3072227325 >> v2:172.21.15.117:3300/0 conn(0x7f36340b8430 0x7f36340cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f36337fe640 1 -- 172.21.15.50:0/3072227325 >> v1:172.21.15.50:6789/0 conn(0x7f36340cddb0 legacy=0x7f36340696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.358+0000 7f36337fe640 1 -- 172.21.15.50:0/3072227325 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634161460 con 0x7f363415cd60 2023-08-10T10:46:00.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.359+0000 7f36337fe640 1 --2- 172.21.15.50:0/3072227325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f3634160930 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f36340ceeb0 tx=0x7f362402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d6c324c1f2cb4c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f3632ffd640 1 -- 172.21.15.50:0/3072227325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624030610 con 0x7f363415cd60 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f3632ffd640 1 -- 172.21.15.50:0/3072227325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624030770 con 0x7f363415cd60 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f3632ffd640 1 -- 172.21.15.50:0/3072227325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624030ae0 con 0x7f363415cd60 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 -- 172.21.15.50:0/3072227325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 msgr2=0x7f3634160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 --2- 172.21.15.50:0/3072227325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f3634160930 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f36340ceeb0 tx=0x7f362402b960 comp rx=0 tx=0).stop 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 -- 172.21.15.50:0/3072227325 shutdown_connections 2023-08-10T10:46:00.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 --2- 172.21.15.50:0/3072227325 >> v2:172.21.15.117:3300/0 conn(0x7f36340b8430 0x7f36340cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 --2- 172.21.15.50:0/3072227325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f3634160930 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.360+0000 7f363a034640 1 -- 172.21.15.50:0/3072227325 >> 172.21.15.50:0/3072227325 conn(0x7f36340d2ac0 msgr2=0x7f36340d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.361+0000 7f363a034640 1 -- 172.21.15.50:0/3072227325 shutdown_connections 2023-08-10T10:46:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.361+0000 7f363a034640 1 -- 172.21.15.50:0/3072227325 wait complete. 2023-08-10T10:46:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.362+0000 7f363a034640 1 Processor -- start 2023-08-10T10:46:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.362+0000 7f363a034640 1 -- start start 2023-08-10T10:46:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 0x7f36341570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 0x7f36340b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36340caea0 con 0x7f363415cd60 2023-08-10T10:46:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36341f67e0 con 0x7f36340cddb0 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.363+0000 7f363a034640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340ca570 con 0x7f36340b8430 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35288/0 (socket says 172.21.15.50:35288) 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 -- 172.21.15.50:0/3689736578 learned_addr learned my addr 172.21.15.50:0/3689736578 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f36337fe640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 0x7f36341570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f362affd640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 0x7f36340b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 -- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 msgr2=0x7f36341570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 0x7f36341570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 -- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 msgr2=0x7f36340b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 0x7f36340b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 -- 172.21.15.50:0/3689736578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624009400 con 0x7f363415cd60 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f362affd640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 0x7f36340b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:00.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f36337fe640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 0x7f36341570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.364+0000 7f3633fff640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f362c00cb40 tx=0x7f362c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.365+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00aca0 con 0x7f363415cd60 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.365+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00ae00 con 0x7f363415cd60 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.365+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36340ca850 con 0x7f363415cd60 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.365+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c012620 con 0x7f363415cd60 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.365+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3634157600 con 0x7f363415cd60 2023-08-10T10:46:00.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.366+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36340d0bc0 con 0x7f363415cd60 2023-08-10T10:46:00.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.367+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f362c007070 con 0x7f363415cd60 2023-08-10T10:46:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.368+0000 7f3630ff9640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 0x7f361406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.368+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f362c089440 con 0x7f363415cd60 2023-08-10T10:46:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.368+0000 7f36337fe640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 0x7f361406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.369+0000 7f36337fe640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 0x7f361406d110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3624036000 tx=0x7f3624008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.373+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f362c054450 con 0x7f363415cd60 2023-08-10T10:46:00.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.564+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36340ce200 con 0x7f363415cd60 2023-08-10T10:46:00.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.567+0000 7f3630ff9640 1 -- 172.21.15.50:0/3689736578 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f36340ce200 con 0x7f363415cd60 2023-08-10T10:46:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:00.570 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:00.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.570+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 msgr2=0x7f361406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.570+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 0x7f361406d110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3624036000 tx=0x7f3624008030 comp rx=0 tx=0).stop 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.570+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 msgr2=0x7f36340b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.570+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f362c00cb40 tx=0x7f362c00a060 comp rx=0 tx=0).stop 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 shutdown_connections 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363415cd60 0x7f36340b34d0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f361406ac50 0x7f361406d110 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36340cddb0 0x7f36340b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 --2- 172.21.15.50:0/3689736578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36340b8430 0x7f36341570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 >> 172.21.15.50:0/3689736578 conn(0x7f36340d2ac0 msgr2=0x7f36340b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:00.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 shutdown_connections 2023-08-10T10:46:00.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.571+0000 7f363a034640 1 -- 172.21.15.50:0/3689736578 wait complete. 2023-08-10T10:46:00.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:45:33.973819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:45:34.611242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:46:00.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:46:00.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.821+0000 7fa28d6cc640 1 Processor -- start 2023-08-10T10:46:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.821+0000 7fa28d6cc640 1 -- start start 2023-08-10T10:46:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2880afd00 0x7fa2880ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa288070d00 0x7fa288071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880716d0 con 0x7fa288070d00 2023-08-10T10:46:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28806b590 con 0x7fa2880afd00 2023-08-10T10:46:00.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa28d6cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b2fa0 con 0x7fa2880c3680 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa2877fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa288070d00 0x7fa288071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa2877fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa288070d00 0x7fa288071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35300/0 (socket says 172.21.15.50:35300) 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa2877fe640 1 -- 172.21.15.50:0/65377986 learned_addr learned my addr 172.21.15.50:0/65377986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.823+0000 7fa2867fc640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa286ffd640 1 --2- 172.21.15.50:0/65377986 >> v2:172.21.15.117:3300/0 conn(0x7fa2880afd00 0x7fa2880ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2877fe640 1 -- 172.21.15.50:0/65377986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 msgr2=0x7fa2880cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2877fe640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2877fe640 1 -- 172.21.15.50:0/65377986 >> v2:172.21.15.117:3300/0 conn(0x7fa2880afd00 msgr2=0x7fa2880ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2877fe640 1 --2- 172.21.15.50:0/65377986 >> v2:172.21.15.117:3300/0 conn(0x7fa2880afd00 0x7fa2880ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2877fe640 1 -- 172.21.15.50:0/65377986 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880b3280 con 0x7fa288070d00 2023-08-10T10:46:00.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.824+0000 7fa2867fc640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.825+0000 7fa2877fe640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa288071190 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa288073d10 tx=0x7fa28002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b496128cff33d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.825+0000 7fa285ffb640 1 -- 172.21.15.50:0/65377986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280031870 con 0x7fa288070d00 2023-08-10T10:46:00.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa285ffb640 1 -- 172.21.15.50:0/65377986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2800319d0 con 0x7fa288070d00 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa285ffb640 1 -- 172.21.15.50:0/65377986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280031d60 con 0x7fa288070d00 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 -- 172.21.15.50:0/65377986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 msgr2=0x7fa288071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa288071190 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa288073d10 tx=0x7fa28002b910 comp rx=0 tx=0).stop 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 -- 172.21.15.50:0/65377986 shutdown_connections 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa288071190 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/65377986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/65377986 >> v2:172.21.15.117:3300/0 conn(0x7fa2880afd00 0x7fa2880ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 -- 172.21.15.50:0/65377986 >> 172.21.15.50:0/65377986 conn(0x7fa2880b23e0 msgr2=0x7fa2880b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 -- 172.21.15.50:0/65377986 shutdown_connections 2023-08-10T10:46:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.826+0000 7fa28d6cc640 1 -- 172.21.15.50:0/65377986 wait complete. 2023-08-10T10:46:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.828+0000 7fa28d6cc640 1 Processor -- start 2023-08-10T10:46:00.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.828+0000 7fa28d6cc640 1 -- start start 2023-08-10T10:46:00.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 0x7fa288164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b5e20 con 0x7fa288070d00 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c6700 con 0x7fa2880afd00 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.829+0000 7fa28d6cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c69e0 con 0x7fa2880c3680 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35312/0 (socket says 172.21.15.50:35312) 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 -- 172.21.15.50:0/3430643484 learned_addr learned my addr 172.21.15.50:0/3430643484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa2867fc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 0x7fa288164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 -- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 msgr2=0x7fa2880c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 -- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 msgr2=0x7fa288164610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 0x7fa288164610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:00.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 -- 172.21.15.50:0/3430643484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800094d0 con 0x7fa288070d00 2023-08-10T10:46:00.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa2867fc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 0x7fa288164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:00.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.830+0000 7fa286ffd640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa278007e60 tx=0x7fa27800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.831+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278014620 con 0x7fa288070d00 2023-08-10T10:46:00.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.831+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800ee90 con 0x7fa288070d00 2023-08-10T10:46:00.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.831+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780149a0 con 0x7fa288070d00 2023-08-10T10:46:00.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.831+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2880c6cc0 con 0x7fa288070d00 2023-08-10T10:46:00.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.831+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa288156bc0 con 0x7fa288070d00 2023-08-10T10:46:00.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.832+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2880612b0 con 0x7fa288070d00 2023-08-10T10:46:00.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.833+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa278014b00 con 0x7fa288070d00 2023-08-10T10:46:00.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.834+0000 7fa27f7fe640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 0x7fa26806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.834+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa278089e60 con 0x7fa288070d00 2023-08-10T10:46:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.834+0000 7fa2867fc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 0x7fa26806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.835+0000 7fa2867fc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 0x7fa26806d110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa270006fd0 tx=0x7fa270008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:00.838+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa278054e70 con 0x7fa288070d00 2023-08-10T10:46:01.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.033+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2880b6870 con 0x7fa288070d00 2023-08-10T10:46:01.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.034+0000 7fa27f7fe640 1 -- 172.21.15.50:0/3430643484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa278009980 con 0x7fa288070d00 2023-08-10T10:46:01.036 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:46:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 msgr2=0x7fa26806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 0x7fa26806d110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa270006fd0 tx=0x7fa270008040 comp rx=0 tx=0).stop 2023-08-10T10:46:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 msgr2=0x7fa2881570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa278007e60 tx=0x7fa27800e4b0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 shutdown_connections 2023-08-10T10:46:01.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2880c3680 0x7fa2880c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa26806ac50 0x7fa26806d110 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2880afd00 0x7fa288164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 --2- 172.21.15.50:0/3430643484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa288070d00 0x7fa2881570a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 >> 172.21.15.50:0/3430643484 conn(0x7fa2880b23e0 msgr2=0x7fa2880cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 shutdown_connections 2023-08-10T10:46:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.037+0000 7fa28d6cc640 1 -- 172.21.15.50:0/3430643484 wait complete. 2023-08-10T10:46:01.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:46:01.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.287+0000 7f2a703f3640 1 Processor -- start 2023-08-10T10:46:01.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.288+0000 7f2a703f3640 1 -- start start 2023-08-10T10:46:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.289+0000 7f2a703f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a6815cf70 0x7f2a68160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.289+0000 7f2a703f3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a680b4640 0x7f2a68161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.289+0000 7f2a703f3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a68160a40 con 0x7f2a6815cb90 2023-08-10T10:46:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.289+0000 7f2a703f3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680b4bb0 con 0x7f2a6815cf70 2023-08-10T10:46:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.289+0000 7f2a703f3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680b4e90 con 0x7f2a680b4640 2023-08-10T10:46:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.290+0000 7f2a6e18f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a6815cb90 0x7f2a680b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48756/0 (socket says 172.21.15.50:48756) 2023-08-10T10:46:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.290+0000 7f2a6e18f640 1 -- 172.21.15.50:0/1171600968 learned_addr learned my addr 172.21.15.50:0/1171600968 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.290+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/1171600968 >> v2:172.21.15.50:3300/0 conn(0x7f2a6815cf70 0x7f2a68160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.290+0000 7f2a6e990640 1 --2- 172.21.15.50:0/1171600968 >> v2:172.21.15.117:3300/0 conn(0x7f2a680b4640 0x7f2a68161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.290+0000 7f2a6d18d640 1 -- 172.21.15.50:0/1171600968 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355282928 0 0) 0x7f2a68160a40 con 0x7f2a6815cb90 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.291+0000 7f2a6d98e640 1 -- 172.21.15.50:0/1171600968 >> v2:172.21.15.117:3300/0 conn(0x7f2a680b4640 msgr2=0x7f2a68161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.291+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/1171600968 >> v2:172.21.15.117:3300/0 conn(0x7f2a680b4640 0x7f2a68161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.291+0000 7f2a6d98e640 1 -- 172.21.15.50:0/1171600968 >> v1:172.21.15.50:6789/0 conn(0x7f2a6815cb90 legacy=0x7f2a680b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.291+0000 7f2a6d98e640 1 -- 172.21.15.50:0/1171600968 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680b5170 con 0x7f2a6815cf70 2023-08-10T10:46:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.292+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/1171600968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6815cf70 0x7f2a68160ed0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2a681609b0 tx=0x7f2a5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7de1dde2f80fc25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.292+0000 7f2a6d18d640 1 -- 172.21.15.50:0/1171600968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58031830 con 0x7f2a6815cf70 2023-08-10T10:46:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.292+0000 7f2a6d18d640 1 -- 172.21.15.50:0/1171600968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58031990 con 0x7f2a6815cf70 2023-08-10T10:46:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.292+0000 7f2a6d18d640 1 -- 172.21.15.50:0/1171600968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58031d20 con 0x7f2a6815cf70 2023-08-10T10:46:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 -- 172.21.15.50:0/1171600968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6815cf70 msgr2=0x7f2a68160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 --2- 172.21.15.50:0/1171600968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6815cf70 0x7f2a68160ed0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2a681609b0 tx=0x7f2a5802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 -- 172.21.15.50:0/1171600968 shutdown_connections 2023-08-10T10:46:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 --2- 172.21.15.50:0/1171600968 >> v2:172.21.15.117:3300/0 conn(0x7f2a680b4640 0x7f2a68161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 --2- 172.21.15.50:0/1171600968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6815cf70 0x7f2a68160ed0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 -- 172.21.15.50:0/1171600968 >> 172.21.15.50:0/1171600968 conn(0x7f2a680cf640 msgr2=0x7f2a680cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 -- 172.21.15.50:0/1171600968 shutdown_connections 2023-08-10T10:46:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.293+0000 7f2a703f3640 1 -- 172.21.15.50:0/1171600968 wait complete. 2023-08-10T10:46:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.296+0000 7f2a703f3640 1 Processor -- start 2023-08-10T10:46:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.296+0000 7f2a703f3640 1 -- start start 2023-08-10T10:46:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6815cb90 0x7f2a6815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6815cf70 0x7f2a6814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6815e4d0 con 0x7f2a680b4640 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6815e7b0 con 0x7f2a6815cb90 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a703f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6815ea90 con 0x7f2a6815cf70 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35328/0 (socket says 172.21.15.50:35328) 2023-08-10T10:46:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 -- 172.21.15.50:0/807498693 learned_addr learned my addr 172.21.15.50:0/807498693 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6815cb90 0x7f2a6815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 -- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6815cf70 msgr2=0x7f2a6814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6815cf70 0x7f2a6814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 -- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6815cb90 msgr2=0x7f2a6815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6815cb90 0x7f2a6815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.298+0000 7f2a6e18f640 1 -- 172.21.15.50:0/807498693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009400 con 0x7f2a680b4640 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a6e18f640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400c4d0 tx=0x7f2a6400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640074e0 con 0x7f2a680b4640 2023-08-10T10:46:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64007660 con 0x7f2a680b4640 2023-08-10T10:46:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6815ed70 con 0x7f2a680b4640 2023-08-10T10:46:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64004a20 con 0x7f2a680b4640 2023-08-10T10:46:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.299+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680c9690 con 0x7f2a680b4640 2023-08-10T10:46:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.300+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a680612b0 con 0x7f2a680b4640 2023-08-10T10:46:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.302+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a64004b80 con 0x7f2a680b4640 2023-08-10T10:46:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.303+0000 7f2a5effd640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 0x7f2a4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.303+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a640889d0 con 0x7f2a680b4640 2023-08-10T10:46:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.303+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 0x7f2a4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.304+0000 7f2a6d98e640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 0x7f2a4c06d110 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a58036000 tx=0x7f2a5803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.307+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a64053a70 con 0x7f2a680b4640 2023-08-10T10:46:01.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.496+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a680d0a10 con 0x7f2a680b4640 2023-08-10T10:46:01.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.497+0000 7f2a5effd640 1 -- 172.21.15.50:0/807498693 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a640180a0 con 0x7f2a680b4640 2023-08-10T10:46:01.499 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:46:01.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 msgr2=0x7f2a4c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 0x7f2a4c06d110 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a58036000 tx=0x7f2a5803c040 comp rx=0 tx=0).stop 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 msgr2=0x7f2a680c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400c4d0 tx=0x7f2a6400c990 comp rx=0 tx=0).stop 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 shutdown_connections 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6815cf70 0x7f2a6814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2a4c06ac50 0x7f2a4c06d110 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6815cb90 0x7f2a6815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 --2- 172.21.15.50:0/807498693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a680b4640 0x7f2a680c9150 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 >> 172.21.15.50:0/807498693 conn(0x7f2a680cf640 msgr2=0x7f2a68156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 shutdown_connections 2023-08-10T10:46:01.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.500+0000 7f2a703f3640 1 -- 172.21.15.50:0/807498693 wait complete. 2023-08-10T10:46:01.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:46:01.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.752+0000 7f6306e6a640 1 Processor -- start 2023-08-10T10:46:01.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.753+0000 7f6306e6a640 1 -- start start 2023-08-10T10:46:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 0x7f63000ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63000b2f00 0x7f63000cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63000696a0 0x7f63000cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630006b190 con 0x7f63000b2f00 2023-08-10T10:46:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000affe0 con 0x7f63000696a0 2023-08-10T10:46:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.754+0000 7f6306e6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630006b650 con 0x7f630006a500 2023-08-10T10:46:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63000b2f00 0x7f63000cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63000b2f00 0x7f63000cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35342/0 (socket says 172.21.15.50:35342) 2023-08-10T10:46:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 -- 172.21.15.50:0/3103833108 learned_addr learned my addr 172.21.15.50:0/3103833108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f6304c06640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 0x7f63000ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 -- 172.21.15.50:0/3103833108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 msgr2=0x7f63000ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 0x7f63000ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 -- 172.21.15.50:0/3103833108 >> v2:172.21.15.117:3300/0 conn(0x7f63000696a0 msgr2=0x7f63000cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 --2- 172.21.15.50:0/3103833108 >> v2:172.21.15.117:3300/0 conn(0x7f63000696a0 0x7f63000cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f62f7fff640 1 -- 172.21.15.50:0/3103833108 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630006b370 con 0x7f63000b2f00 2023-08-10T10:46:01.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.755+0000 7f6304c06640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 0x7f63000ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.757+0000 7f62f7fff640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63000b2f00 0x7f63000cd300 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6300073090 tx=0x7f62f002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b9ae9dea0917c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.757+0000 7f62f77fe640 1 -- 172.21.15.50:0/3103833108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0031760 con 0x7f63000b2f00 2023-08-10T10:46:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.757+0000 7f62f77fe640 1 -- 172.21.15.50:0/3103833108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00318c0 con 0x7f63000b2f00 2023-08-10T10:46:01.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.757+0000 7f62f77fe640 1 -- 172.21.15.50:0/3103833108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0031c50 con 0x7f63000b2f00 2023-08-10T10:46:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 -- 172.21.15.50:0/3103833108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63000b2f00 msgr2=0x7f63000cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63000b2f00 0x7f63000cd300 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6300073090 tx=0x7f62f002b800 comp rx=0 tx=0).stop 2023-08-10T10:46:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 -- 172.21.15.50:0/3103833108 shutdown_connections 2023-08-10T10:46:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 --2- 172.21.15.50:0/3103833108 >> v2:172.21.15.117:3300/0 conn(0x7f63000696a0 0x7f63000cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63000b2f00 0x7f63000cd300 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 --2- 172.21.15.50:0/3103833108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f630006a500 0x7f63000ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 -- 172.21.15.50:0/3103833108 >> 172.21.15.50:0/3103833108 conn(0x7f63000b23e0 msgr2=0x7f63000b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 -- 172.21.15.50:0/3103833108 shutdown_connections 2023-08-10T10:46:01.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.758+0000 7f6306e6a640 1 -- 172.21.15.50:0/3103833108 wait complete. 2023-08-10T10:46:01.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.760+0000 7f6306e6a640 1 Processor -- start 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.760+0000 7f6306e6a640 1 -- start start 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000696a0 0x7f63000b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63000b2f00 0x7f63000c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b4b50 con 0x7f630006a500 2023-08-10T10:46:01.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000ae040 con 0x7f63000696a0 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f6306e6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000ae320 con 0x7f63000b2f00 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.761+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35344/0 (socket says 172.21.15.50:35344) 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 -- 172.21.15.50:0/1117263181 learned_addr learned my addr 172.21.15.50:0/1117263181 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f6304c06640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000696a0 0x7f63000b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 -- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63000b2f00 msgr2=0x7f63000c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63000b2f00 0x7f63000c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 -- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000696a0 msgr2=0x7f63000b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000696a0 0x7f63000b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 -- 172.21.15.50:0/1117263181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00094d0 con 0x7f630006a500 2023-08-10T10:46:01.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.762+0000 7f62f7fff640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f62f002b840 tx=0x7f62f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.763+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f003b800 con 0x7f630006a500 2023-08-10T10:46:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.763+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f003b9a0 con 0x7f630006a500 2023-08-10T10:46:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.763+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f003bd50 con 0x7f630006a500 2023-08-10T10:46:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.763+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63000ae600 con 0x7f630006a500 2023-08-10T10:46:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.763+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63000b47f0 con 0x7f630006a500 2023-08-10T10:46:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.764+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63000aeb20 con 0x7f630006a500 2023-08-10T10:46:01.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.765+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62f004e450 con 0x7f630006a500 2023-08-10T10:46:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.766+0000 7f62f57fa640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 0x7f62ec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.767+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62f002f050 con 0x7f630006a500 2023-08-10T10:46:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.767+0000 7f6304c06640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 0x7f62ec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.768+0000 7f6304c06640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 0x7f62ec06d110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0075b0 tx=0x7f62fc007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.772+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f63000aeb20 con 0x7f630006a500 2023-08-10T10:46:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.961+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63000aeb20 con 0x7f630006a500 2023-08-10T10:46:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.962+0000 7f62f57fa640 1 -- 172.21.15.50:0/1117263181 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63000aeb20 con 0x7f630006a500 2023-08-10T10:46:01.963 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:46:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 msgr2=0x7f62ec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 0x7f62ec06d110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0075b0 tx=0x7f62fc007540 comp rx=0 tx=0).stop 2023-08-10T10:46:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 msgr2=0x7f63001f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f62f002b840 tx=0x7f62f00046c0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 shutdown_connections 2023-08-10T10:46:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63000b2f00 0x7f63000c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f630006a500 0x7f63001f21e0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f62ec06ac50 0x7f62ec06d110 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 --2- 172.21.15.50:0/1117263181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000696a0 0x7f63000b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 >> 172.21.15.50:0/1117263181 conn(0x7f63000b23e0 msgr2=0x7f63000cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 shutdown_connections 2023-08-10T10:46:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:01.964+0000 7f6306e6a640 1 -- 172.21.15.50:0/1117263181 wait complete. 2023-08-10T10:46:01.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:46:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.217+0000 7f8c0eb8b640 1 Processor -- start 2023-08-10T10:46:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.218+0000 7f8c0eb8b640 1 -- start start 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0eb8b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c081612c0 0x7f8c080c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0eb8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8c0806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0eb8b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c08160870 con 0x7f8c0815cbb0 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0eb8b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c080c9660 con 0x7f8c081612c0 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0eb8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080ca370 con 0x7f8c080c9250 2023-08-10T10:46:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0c927640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c0815cbb0 0x7f8c080c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48762/0 (socket says 172.21.15.50:48762) 2023-08-10T10:46:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.219+0000 7f8c0c927640 1 -- 172.21.15.50:0/694159327 learned_addr learned my addr 172.21.15.50:0/694159327 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c07fff640 1 --2- 172.21.15.50:0/694159327 >> v2:172.21.15.117:3300/0 conn(0x7f8c081612c0 0x7f8c080c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c0d128640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8c0806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001463134 0 0) 0x7f8c08160870 con 0x7f8c0815cbb0 2023-08-10T10:46:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf8003520 con 0x7f8c0815cbb0 2023-08-10T10:46:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614206840 0 0) 0x7f8bf8003520 con 0x7f8c0815cbb0 2023-08-10T10:46:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 msgr2=0x7f8c0806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8c0806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 >> v2:172.21.15.117:3300/0 conn(0x7f8c081612c0 msgr2=0x7f8c080c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 --2- 172.21.15.50:0/694159327 >> v2:172.21.15.117:3300/0 conn(0x7f8c081612c0 0x7f8c080c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c080ca650 con 0x7f8c0815cbb0 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f8bfc001670 con 0x7f8c0815cbb0 2023-08-10T10:46:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 >> v1:172.21.15.50:6789/0 conn(0x7f8c0815cbb0 legacy=0x7f8c080c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf8003970 0x7f8bf8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8bf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8bf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c9660 con 0x7f8bf80047c0 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080ca370 con 0x7f8bf8003970 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.220+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf800b980 con 0x7f8c080c9250 2023-08-10T10:46:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8bf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c0d128640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8bf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 -- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 msgr2=0x7f8bf8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c080c9250 0x7f8bf8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 -- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf8003970 msgr2=0x7f8bf8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c0c927640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf8003970 0x7f8bf8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf8003970 0x7f8bf8003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.221+0000 7f8c07fff640 1 -- 172.21.15.50:0/694159327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8003520 con 0x7f8bf80047c0 2023-08-10T10:46:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.222+0000 7f8c07fff640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8bf8004c40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009af0 tx=0x7f8bf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc99be647107186 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf402c710 con 0x7f8bf80047c0 2023-08-10T10:46:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf402c870 con 0x7f8bf80047c0 2023-08-10T10:46:02.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c077fe640 1 -- 172.21.15.50:0/694159327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf402cc00 con 0x7f8bf80047c0 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/694159327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 msgr2=0x7f8bf8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/694159327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8bf8004c40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009af0 tx=0x7f8bf80057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0d128640 1 -- 172.21.15.50:0/694159327 reap_dead start 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/694159327 shutdown_connections 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/694159327 >> 172.21.15.50:0/694159327 conn(0x7f8c080b01b0 msgr2=0x7f8c080b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/694159327 shutdown_connections 2023-08-10T10:46:02.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.223+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/694159327 wait complete. 2023-08-10T10:46:02.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.225+0000 7f8c0eb8b640 1 Processor -- start 2023-08-10T10:46:02.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.225+0000 7f8c0eb8b640 1 -- start start 2023-08-10T10:46:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.226+0000 7f8c0eb8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.226+0000 7f8c0eb8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 0x7f8c080b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0eb8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 0x7f8c080b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0eb8b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0806c170 con 0x7f8bf80047c0 2023-08-10T10:46:02.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0eb8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0815d030 con 0x7f8c080b28c0 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0eb8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0806b8d0 con 0x7f8c0815f0a0 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35354/0 (socket says 172.21.15.50:35354) 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 -- 172.21.15.50:0/3004094472 learned_addr learned my addr 172.21.15.50:0/3004094472 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0d128640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 0x7f8c080b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c07fff640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 0x7f8c080b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 -- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 msgr2=0x7f8c080b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 0x7f8c080b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 -- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 msgr2=0x7f8c080b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 0x7f8c080b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0c927640 1 -- 172.21.15.50:0/3004094472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0806bbb0 con 0x7f8bf80047c0 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c0d128640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 0x7f8c080b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.227+0000 7f8c07fff640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 0x7f8c080b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c0c927640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00d7a0 tx=0x7f8bfc00dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0072d0 con 0x7f8bf80047c0 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc007430 con 0x7f8bf80047c0 2023-08-10T10:46:02.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0047e0 con 0x7f8bf80047c0 2023-08-10T10:46:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0806be90 con 0x7f8bf80047c0 2023-08-10T10:46:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.228+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c080b3280 con 0x7f8bf80047c0 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.229+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c080612b0 con 0x7f8bf80047c0 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.230+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bfc004940 con 0x7f8bf80047c0 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.231+0000 7f8c057fa640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 0x7f8bec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.231+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bfc088ca0 con 0x7f8bf80047c0 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.232+0000 7f8c07fff640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 0x7f8bec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.233+0000 7f8c07fff640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 0x7f8bec06d110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4036000 tx=0x7f8bf4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.236+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8bfc053d60 con 0x7f8bf80047c0 2023-08-10T10:46:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.429+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c080ad810 con 0x7f8bf80047c0 2023-08-10T10:46:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.430+0000 7f8c057fa640 1 -- 172.21.15.50:0/3004094472 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8bfc0190a0 con 0x7f8bf80047c0 2023-08-10T10:46:02.431 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:46:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 msgr2=0x7f8bec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 0x7f8bec06d110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4036000 tx=0x7f8bf4030000 comp rx=0 tx=0).stop 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 msgr2=0x7f8c080c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00d7a0 tx=0x7f8bfc00dba0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 shutdown_connections 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8bec06ac50 0x7f8bec06d110 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b28c0 0x7f8c080b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815f0a0 0x7f8c080b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 --2- 172.21.15.50:0/3004094472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80047c0 0x7f8c080c8200 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.432+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 >> 172.21.15.50:0/3004094472 conn(0x7f8c080b01b0 msgr2=0x7f8c080af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.433+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 shutdown_connections 2023-08-10T10:46:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.433+0000 7f8c0eb8b640 1 -- 172.21.15.50:0/3004094472 wait complete. 2023-08-10T10:46:02.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.682+0000 7f6198c7c640 1 Processor -- start 2023-08-10T10:46:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.682+0000 7f6198c7c640 1 -- start start 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f6198c7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61940b3f30 0x7f61940ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f6198c7c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6194071c70 con 0x7f61940b0c60 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f6198c7c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940713d0 con 0x7f619415aa40 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f6198c7c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61940716b0 con 0x7f61940b3f30 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f618bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61940b0c60 0x7f61940c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48778/0 (socket says 172.21.15.50:48778) 2023-08-10T10:46:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.684+0000 7f618bfff640 1 -- 172.21.15.50:0/2302851692 learned_addr learned my addr 172.21.15.50:0/2302851692 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.685+0000 7f6192d9d640 1 --2- 172.21.15.50:0/2302851692 >> v2:172.21.15.50:3300/0 conn(0x7f61940b3f30 0x7f61940ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.685+0000 7f6192d9d640 1 -- 172.21.15.50:0/2302851692 >> v1:172.21.15.117:6789/0 conn(0x7f619415aa40 legacy=0x7f61940b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.685+0000 7f6192d9d640 1 -- 172.21.15.50:0/2302851692 >> v1:172.21.15.50:6789/0 conn(0x7f61940b0c60 legacy=0x7f61940c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.685+0000 7f6191d9b640 1 -- 172.21.15.50:0/2302851692 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135636586 0 0) 0x7f6194071c70 con 0x7f61940b0c60 2023-08-10T10:46:02.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.685+0000 7f6192d9d640 1 -- 172.21.15.50:0/2302851692 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194071990 con 0x7f61940b3f30 2023-08-10T10:46:02.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.686+0000 7f6192d9d640 1 --2- 172.21.15.50:0/2302851692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b3f30 0x7f61940ca030 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f618c009d90 tx=0x7f618c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0c0909841e4deb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.686+0000 7f6191d9b640 1 -- 172.21.15.50:0/2302851692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c02cc60 con 0x7f61940b3f30 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6191d9b640 1 -- 172.21.15.50:0/2302851692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c02cdc0 con 0x7f61940b3f30 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6191d9b640 1 -- 172.21.15.50:0/2302851692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c034660 con 0x7f61940b3f30 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 -- 172.21.15.50:0/2302851692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b3f30 msgr2=0x7f61940ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 --2- 172.21.15.50:0/2302851692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b3f30 0x7f61940ca030 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f618c009d90 tx=0x7f618c02beb0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 -- 172.21.15.50:0/2302851692 shutdown_connections 2023-08-10T10:46:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 --2- 172.21.15.50:0/2302851692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b3f30 0x7f61940ca030 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 -- 172.21.15.50:0/2302851692 >> 172.21.15.50:0/2302851692 conn(0x7f619406b590 msgr2=0x7f61940ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 -- 172.21.15.50:0/2302851692 shutdown_connections 2023-08-10T10:46:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.687+0000 7f6198c7c640 1 -- 172.21.15.50:0/2302851692 wait complete. 2023-08-10T10:46:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.689+0000 7f6198c7c640 1 Processor -- start 2023-08-10T10:46:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.689+0000 7f6198c7c640 1 -- start start 2023-08-10T10:46:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 0x7f61940c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f619415aa40 0x7f61940c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c8ce0 con 0x7f61940b0c60 2023-08-10T10:46:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c4910 con 0x7f61940b3f30 2023-08-10T10:46:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f6198c7c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c8060 con 0x7f619415aa40 2023-08-10T10:46:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f619259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f619259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35374/0 (socket says 172.21.15.50:35374) 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.690+0000 7f619259c640 1 -- 172.21.15.50:0/1976063273 learned_addr learned my addr 172.21.15.50:0/1976063273 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f6192d9d640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f619415aa40 0x7f61940c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 -- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f619415aa40 msgr2=0x7f61940c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f619415aa40 0x7f61940c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 -- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 msgr2=0x7f61940c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f618bfff640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 0x7f61940c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 0x7f61940c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 -- 172.21.15.50:0/1976063273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009a70 con 0x7f61940b0c60 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f618bfff640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 0x7f61940c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.691+0000 7f619259c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f618400c3c0 tx=0x7f618400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.692+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61840052d0 con 0x7f61940b0c60 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.692+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6184005450 con 0x7f61940b0c60 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.692+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61940c8340 con 0x7f61940b0c60 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.692+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184007260 con 0x7f61940b0c60 2023-08-10T10:46:02.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.692+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61940c8900 con 0x7f61940b0c60 2023-08-10T10:46:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.693+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619404e270 con 0x7f61940b0c60 2023-08-10T10:46:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.694+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61840073c0 con 0x7f61940b0c60 2023-08-10T10:46:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.695+0000 7f618affd640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 0x7f617406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.695+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6184088900 con 0x7f61940b0c60 2023-08-10T10:46:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.695+0000 7f618bfff640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 0x7f617406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.696+0000 7f618bfff640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 0x7f617406d110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61941552e0 tx=0x7f617c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.699+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6184053910 con 0x7f61940b0c60 2023-08-10T10:46:02.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.928+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61940b0710 con 0x7f61940b0c60 2023-08-10T10:46:02.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.929+0000 7f618affd640 1 -- 172.21.15.50:0/1976063273 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f6184056f30 con 0x7f61940b0c60 2023-08-10T10:46:02.931 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:02.931 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:46:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:46:02.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 msgr2=0x7f617406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 0x7f617406d110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61941552e0 tx=0x7f617c009040 comp rx=0 tx=0).stop 2023-08-10T10:46:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 msgr2=0x7f619415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f618400c3c0 tx=0x7f618400c880 comp rx=0 tx=0).stop 2023-08-10T10:46:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 shutdown_connections 2023-08-10T10:46:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f619415aa40 0x7f61940c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617406ac50 0x7f617406d110 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61940b3f30 0x7f61940c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 --2- 172.21.15.50:0/1976063273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61940b0c60 0x7f619415dcc0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 >> 172.21.15.50:0/1976063273 conn(0x7f619406b590 msgr2=0x7f61940696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 shutdown_connections 2023-08-10T10:46:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:02.932+0000 7f6198c7c640 1 -- 172.21.15.50:0/1976063273 wait complete. 2023-08-10T10:46:02.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.183+0000 7f8fa759e640 1 Processor -- start 2023-08-10T10:46:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.183+0000 7f8fa759e640 1 -- start start 2023-08-10T10:46:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 0x7f8fa80cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80cc5a0 con 0x7f8fa80c9d00 2023-08-10T10:46:03.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa80b4170 con 0x7f8fa80cd290 2023-08-10T10:46:03.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815d720 con 0x7f8fa8159830 2023-08-10T10:46:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa6d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 0x7f8fa80cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:58544/0 (socket says 172.21.15.50:58544) 2023-08-10T10:46:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.185+0000 7f8fa659c640 1 -- 172.21.15.50:0/536287702 learned_addr learned my addr 172.21.15.50:0/536287702 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa5d9b640 1 -- 172.21.15.50:0/536287702 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377201766 0 0) 0x7f8fa80cc5a0 con 0x7f8fa80c9d00 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa5d9b640 1 -- 172.21.15.50:0/536287702 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f94003520 con 0x7f8fa80c9d00 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa659c640 1 -- 172.21.15.50:0/536287702 >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 msgr2=0x7f8fa80cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa659c640 1 --2- 172.21.15.50:0/536287702 >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 0x7f8fa80cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa659c640 1 -- 172.21.15.50:0/536287702 >> v1:172.21.15.117:6789/0 conn(0x7f8fa80c9d00 legacy=0x7f8fa815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa659c640 1 -- 172.21.15.50:0/536287702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80cdc20 con 0x7f8fa8159830 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.186+0000 7f8fa6d9d640 1 --2- 172.21.15.50:0/536287702 >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 0x7f8fa80cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:46:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.188+0000 7f8fa659c640 1 --2- 172.21.15.50:0/536287702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800bb10 tx=0x7f8f9802e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08aec339f0963aa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.188+0000 7f8fa5d9b640 1 -- 172.21.15.50:0/536287702 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98036440 con 0x7f8fa8159830 2023-08-10T10:46:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.188+0000 7f8fa5d9b640 1 -- 172.21.15.50:0/536287702 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980365a0 con 0x7f8fa8159830 2023-08-10T10:46:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.188+0000 7f8fa5d9b640 1 -- 172.21.15.50:0/536287702 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98036910 con 0x7f8fa8159830 2023-08-10T10:46:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 -- 172.21.15.50:0/536287702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 msgr2=0x7f8fa80cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 --2- 172.21.15.50:0/536287702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800bb10 tx=0x7f8f9802e160 comp rx=0 tx=0).stop 2023-08-10T10:46:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 -- 172.21.15.50:0/536287702 shutdown_connections 2023-08-10T10:46:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 --2- 172.21.15.50:0/536287702 >> v2:172.21.15.117:3300/0 conn(0x7f8fa80cd290 0x7f8fa80cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 --2- 172.21.15.50:0/536287702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa8159830 0x7f8fa80cc060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 -- 172.21.15.50:0/536287702 >> 172.21.15.50:0/536287702 conn(0x7f8fa806ab80 msgr2=0x7f8fa806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 -- 172.21.15.50:0/536287702 shutdown_connections 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.189+0000 7f8fa759e640 1 -- 172.21.15.50:0/536287702 wait complete. 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.191+0000 7f8fa759e640 1 Processor -- start 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.191+0000 7f8fa759e640 1 -- start start 2023-08-10T10:46:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa80c9d00 0x7f8fa806f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa80cd290 0x7f8fa80c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c2170 con 0x7f8fa8159830 2023-08-10T10:46:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c2cb0 con 0x7f8fa80cd290 2023-08-10T10:46:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81590c0 con 0x7f8fa80c9d00 2023-08-10T10:46:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35388/0 (socket says 172.21.15.50:35388) 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8fa6d9d640 1 -- 172.21.15.50:0/2321252356 learned_addr learned my addr 172.21.15.50:0/2321252356 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa659c640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa80c9d00 0x7f8fa806f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.192+0000 7f8f9ffff640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa80cd290 0x7f8fa80c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 -- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa80c9d00 msgr2=0x7f8fa806f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa80c9d00 0x7f8fa806f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 -- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa80cd290 msgr2=0x7f8fa80c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa80cd290 0x7f8fa80c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 -- 172.21.15.50:0/2321252356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009a70 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa6d9d640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000efc0 tx=0x7f8fa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0009cd0 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000f040 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0003990 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.193+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9800b770 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.194+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80c2660 con 0x7f8fa8159830 2023-08-10T10:46:03.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.195+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80c2e40 con 0x7f8fa8159830 2023-08-10T10:46:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.196+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fa0014480 con 0x7f8fa8159830 2023-08-10T10:46:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.196+0000 7f8f9effd640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 0x7f8f8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.197+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fa008a140 con 0x7f8fa8159830 2023-08-10T10:46:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.197+0000 7f8fa659c640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 0x7f8f8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.198+0000 7f8fa659c640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 0x7f8f8806d110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8f98038000 tx=0x7f8f98032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.201+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8fa0058c80 con 0x7f8fa8159830 2023-08-10T10:46:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.394+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fa8066e30 con 0x7f8fa8159830 2023-08-10T10:46:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.397+0000 7f8f9effd640 1 -- 172.21.15.50:0/2321252356 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f8fa0058810 con 0x7f8fa8159830 2023-08-10T10:46:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:03.399 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.399+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 msgr2=0x7f8f8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.399+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 0x7f8f8806d110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8f98038000 tx=0x7f8f98032000 comp rx=0 tx=0).stop 2023-08-10T10:46:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.399+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 msgr2=0x7f8fa80c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.399+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000efc0 tx=0x7f8fa000c490 comp rx=0 tx=0).stop 2023-08-10T10:46:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 shutdown_connections 2023-08-10T10:46:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8159830 0x7f8fa80c3680 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8f8806ac50 0x7f8f8806d110 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa80cd290 0x7f8fa80c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 --2- 172.21.15.50:0/2321252356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa80c9d00 0x7f8fa806f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 >> 172.21.15.50:0/2321252356 conn(0x7f8fa806ab80 msgr2=0x7f8fa80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 shutdown_connections 2023-08-10T10:46:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.400+0000 7f8fa759e640 1 -- 172.21.15.50:0/2321252356 wait complete. 2023-08-10T10:46:03.420 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:46:03.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.654+0000 7f9847fff640 1 Processor -- start 2023-08-10T10:46:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.654+0000 7f9847fff640 1 -- start start 2023-08-10T10:46:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.655+0000 7f9847fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98480b0620 0x7f98480ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.655+0000 7f9847fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98481646f0 0x7f9848166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.655+0000 7f9847fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98481604d0 con 0x7f98481600f0 2023-08-10T10:46:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f9847fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480cca30 con 0x7f98481646f0 2023-08-10T10:46:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f9847fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480cc100 con 0x7f98480b0620 2023-08-10T10:46:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98481646f0 0x7f9848166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98481646f0 0x7f9848166ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35392/0 (socket says 172.21.15.50:35392) 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 -- 172.21.15.50:0/915385403 learned_addr learned my addr 172.21.15.50:0/915385403 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98467fc640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98480b0620 0x7f98480ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 -- 172.21.15.50:0/915385403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98480b0620 msgr2=0x7f98480ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98480b0620 0x7f98480ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 -- 172.21.15.50:0/915385403 >> v1:172.21.15.117:6789/0 conn(0x7f98481600f0 legacy=0x7f98480aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.656+0000 7f98477fe640 1 -- 172.21.15.50:0/915385403 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480cc3e0 con 0x7f98481646f0 2023-08-10T10:46:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f98477fe640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98481646f0 0x7f9848166ae0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9840009870 tx=0x7f984002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a614be349f564ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f9845ffb640 1 -- 172.21.15.50:0/915385403 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840031640 con 0x7f98481646f0 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f9845ffb640 1 -- 172.21.15.50:0/915385403 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400317a0 con 0x7f98481646f0 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f9845ffb640 1 -- 172.21.15.50:0/915385403 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840031b30 con 0x7f98481646f0 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f9847fff640 1 -- 172.21.15.50:0/915385403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98481646f0 msgr2=0x7f9848166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.658+0000 7f9847fff640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98481646f0 0x7f9848166ae0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9840009870 tx=0x7f984002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 -- 172.21.15.50:0/915385403 shutdown_connections 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98481646f0 0x7f9848166ae0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 --2- 172.21.15.50:0/915385403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98480b0620 0x7f98480ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 -- 172.21.15.50:0/915385403 >> 172.21.15.50:0/915385403 conn(0x7f984806ab80 msgr2=0x7f984806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 -- 172.21.15.50:0/915385403 shutdown_connections 2023-08-10T10:46:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.659+0000 7f9847fff640 1 -- 172.21.15.50:0/915385403 wait complete. 2023-08-10T10:46:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.660+0000 7f9847fff640 1 Processor -- start 2023-08-10T10:46:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.661+0000 7f9847fff640 1 -- start start 2023-08-10T10:46:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98481600f0 0x7f98480aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98481646f0 0x7f984814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480b3450 con 0x7f98480b0620 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480b3730 con 0x7f98481600f0 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9847fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480b3a10 con 0x7f98481646f0 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35396/0 (socket says 172.21.15.50:35396) 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 -- 172.21.15.50:0/1215470243 learned_addr learned my addr 172.21.15.50:0/1215470243 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f98477fe640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98481646f0 0x7f984814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f98467fc640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98481600f0 0x7f98480aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 -- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98481646f0 msgr2=0x7f984814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98481646f0 0x7f984814f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 -- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98481600f0 msgr2=0x7f98480aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98481600f0 0x7f98480aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.662+0000 7f9846ffd640 1 -- 172.21.15.50:0/1215470243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400094d0 con 0x7f98480b0620 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f9846ffd640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f983800c870 tx=0x7f983800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838003b70 con 0x7f98480b0620 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838003cf0 con 0x7f98480b0620 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800aa90 con 0x7f98480b0620 2023-08-10T10:46:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98480b3cf0 con 0x7f98480b0620 2023-08-10T10:46:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.663+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98480af3c0 con 0x7f98480b0620 2023-08-10T10:46:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.665+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98480b3ee0 con 0x7f98480b0620 2023-08-10T10:46:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.665+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f983800abf0 con 0x7f98480b0620 2023-08-10T10:46:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.666+0000 7f982f7fe640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 0x7f983406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.667+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9838089340 con 0x7f98480b0620 2023-08-10T10:46:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.667+0000 7f98467fc640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 0x7f983406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.668+0000 7f98467fc640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 0x7f983406d140 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f98480b03c0 tx=0x7f983c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.671+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98380543f0 con 0x7f98480b0620 2023-08-10T10:46:03.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.901+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9848066e30 con 0x7f98480b0620 2023-08-10T10:46:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.902+0000 7f982f7fe640 1 -- 172.21.15.50:0/1215470243 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f9838003e60 con 0x7f98480b0620 2023-08-10T10:46:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:03.904 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:46:03.904 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:46:03.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 msgr2=0x7f983406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 0x7f983406d140 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f98480b03c0 tx=0x7f983c008040 comp rx=0 tx=0).stop 2023-08-10T10:46:03.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 msgr2=0x7f9848071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:03.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f983800c870 tx=0x7f983800cd30 comp rx=0 tx=0).stop 2023-08-10T10:46:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 shutdown_connections 2023-08-10T10:46:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98481646f0 0x7f984814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f983406ac80 0x7f983406d140 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98481600f0 0x7f98480aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 --2- 172.21.15.50:0/1215470243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98480b0620 0x7f9848071350 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:03.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 >> 172.21.15.50:0/1215470243 conn(0x7f984806ab80 msgr2=0x7f98480cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:03.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 shutdown_connections 2023-08-10T10:46:03.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:03.905+0000 7f9847fff640 1 -- 172.21.15.50:0/1215470243 wait complete. 2023-08-10T10:46:03.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.138+0000 7f88ef30f640 1 Processor -- start 2023-08-10T10:46:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.139+0000 7f88ef30f640 1 -- start start 2023-08-10T10:46:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.140+0000 7f88ef30f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 0x7f88e8160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.140+0000 7f88ef30f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.140+0000 7f88ef30f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e8161180 con 0x7f88e80b8430 2023-08-10T10:46:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.140+0000 7f88ef30f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80b5bd0 con 0x7f88e815cd60 2023-08-10T10:46:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.140+0000 7f88ef30f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8161460 con 0x7f88e80cdf80 2023-08-10T10:46:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.141+0000 7f88ed8ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.141+0000 7f88ed8ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:58588/0 (socket says 172.21.15.50:58588) 2023-08-10T10:46:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.141+0000 7f88ed8ac640 1 -- 172.21.15.50:0/3978836728 learned_addr learned my addr 172.21.15.50:0/3978836728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.141+0000 7f88ed0ab640 1 --2- 172.21.15.50:0/3978836728 >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 0x7f88e8160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.142+0000 7f88ed8ac640 1 -- 172.21.15.50:0/3978836728 >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 msgr2=0x7f88e8160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.142+0000 7f88ed8ac640 1 --2- 172.21.15.50:0/3978836728 >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 0x7f88e8160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.142+0000 7f88ed8ac640 1 -- 172.21.15.50:0/3978836728 >> v1:172.21.15.117:6789/0 conn(0x7f88e80b8430 legacy=0x7f88e80cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.142+0000 7f88ed8ac640 1 -- 172.21.15.50:0/3978836728 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8161740 con 0x7f88e80cdf80 2023-08-10T10:46:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.142+0000 7f88ed0ab640 1 --2- 172.21.15.50:0/3978836728 >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 0x7f88e8160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:46:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.143+0000 7f88ed8ac640 1 --2- 172.21.15.50:0/3978836728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82a3a4c680a1866d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.143+0000 7f88dffff640 1 -- 172.21.15.50:0/3978836728 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e002f830 con 0x7f88e80cdf80 2023-08-10T10:46:04.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88dffff640 1 -- 172.21.15.50:0/3978836728 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e002f990 con 0x7f88e80cdf80 2023-08-10T10:46:04.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88dffff640 1 -- 172.21.15.50:0/3978836728 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e002fd20 con 0x7f88e80cdf80 2023-08-10T10:46:04.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 -- 172.21.15.50:0/3978836728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 msgr2=0x7f88e80d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 --2- 172.21.15.50:0/3978836728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e002ba10 comp rx=0 tx=0).stop 2023-08-10T10:46:04.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 -- 172.21.15.50:0/3978836728 shutdown_connections 2023-08-10T10:46:04.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 --2- 172.21.15.50:0/3978836728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80cdf80 0x7f88e80d1400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 --2- 172.21.15.50:0/3978836728 >> v2:172.21.15.117:3300/0 conn(0x7f88e815cd60 0x7f88e8160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 -- 172.21.15.50:0/3978836728 >> 172.21.15.50:0/3978836728 conn(0x7f88e80d2ac0 msgr2=0x7f88e80d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 -- 172.21.15.50:0/3978836728 shutdown_connections 2023-08-10T10:46:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.144+0000 7f88ef30f640 1 -- 172.21.15.50:0/3978836728 wait complete. 2023-08-10T10:46:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.146+0000 7f88ef30f640 1 Processor -- start 2023-08-10T10:46:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.146+0000 7f88ef30f640 1 -- start start 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80b8430 0x7f88e8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e80cdf80 0x7f88e8155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815e930 con 0x7f88e815cd60 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81f2a20 con 0x7f88e80cdf80 2023-08-10T10:46:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.147+0000 7f88ef30f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81f2d00 con 0x7f88e80b8430 2023-08-10T10:46:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35400/0 (socket says 172.21.15.50:35400) 2023-08-10T10:46:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 -- 172.21.15.50:0/1095674590 learned_addr learned my addr 172.21.15.50:0/1095674590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed0ab640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80b8430 0x7f88e8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 -- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80b8430 msgr2=0x7f88e8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80b8430 0x7f88e8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 -- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e80cdf80 msgr2=0x7f88e8155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e80cdf80 0x7f88e8155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.148+0000 7f88ed8ac640 1 -- 172.21.15.50:0/1095674590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4009a70 con 0x7f88e815cd60 2023-08-10T10:46:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ed8ac640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0037bc0 con 0x7f88e815cd60 2023-08-10T10:46:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0037d40 con 0x7f88e815cd60 2023-08-10T10:46:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0041640 con 0x7f88e815cd60 2023-08-10T10:46:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00094d0 con 0x7f88e815cd60 2023-08-10T10:46:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.149+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e815eb40 con 0x7f88e815cd60 2023-08-10T10:46:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.150+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e804e270 con 0x7f88e815cd60 2023-08-10T10:46:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.151+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88e00417a0 con 0x7f88e815cd60 2023-08-10T10:46:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.152+0000 7f88ddffb640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 0x7f88cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.153+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88e003c070 con 0x7f88e815cd60 2023-08-10T10:46:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.153+0000 7f88ed0ab640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 0x7f88cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.153+0000 7f88ed0ab640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 0x7f88cc06d110 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007560 tx=0x7f88e400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.157+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88e0077190 con 0x7f88e815cd60 2023-08-10T10:46:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.389+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88e80d3940 con 0x7f88e815cd60 2023-08-10T10:46:04.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.391+0000 7f88ddffb640 1 -- 172.21.15.50:0/1095674590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f88e007a7b0 con 0x7f88e815cd60 2023-08-10T10:46:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:04.393 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:45:35.597193+0000","modified":"2023-08-10T10:45:39.161017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7539":{"gid":7539,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/37638804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":37638804},{"type":"v1","addr":"172.21.15.50:6837","nonce":37638804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-10T10:46:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2023-08-10T10:46:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 msgr2=0x7f88cc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 0x7f88cc06d110 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007560 tx=0x7f88e400b040 comp rx=0 tx=0).stop 2023-08-10T10:46:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 msgr2=0x7f88e81f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e0004730 comp rx=0 tx=0).stop 2023-08-10T10:46:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 shutdown_connections 2023-08-10T10:46:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e815cd60 0x7f88e81f21f0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f88cc06ac50 0x7f88cc06d110 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e80cdf80 0x7f88e8155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 --2- 172.21.15.50:0/1095674590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e80b8430 0x7f88e8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 >> 172.21.15.50:0/1095674590 conn(0x7f88e80d2ac0 msgr2=0x7f88e815c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:04.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 shutdown_connections 2023-08-10T10:46:04.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.393+0000 7f88ef30f640 1 -- 172.21.15.50:0/1095674590 wait complete. 2023-08-10T10:46:04.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:04.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.604+0000 7f4cb6e63640 1 Processor -- start 2023-08-10T10:46:04.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.604+0000 7f4cb6e63640 1 -- start start 2023-08-10T10:46:04.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.606+0000 7f4cb6e63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb0153850 0x7f4cb00b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.606+0000 7f4cb6e63640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cb00cfd40 0x7f4cb00b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.606+0000 7f4cb6e63640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb015d010 con 0x7f4cb0153c30 2023-08-10T10:46:04.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.606+0000 7f4cb6e63640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb015d290 con 0x7f4cb00cfd40 2023-08-10T10:46:04.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.606+0000 7f4cb6e63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb015d570 con 0x7f4cb0153850 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb6662640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cb00cfd40 0x7f4cb00b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb5e61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb0153850 0x7f4cb00b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb5660640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4cb0153c30 0x7f4cb00cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48782/0 (socket says 172.21.15.50:48782) 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb5660640 1 -- 172.21.15.50:0/3256059197 learned_addr learned my addr 172.21.15.50:0/3256059197 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb6662640 1 -- 172.21.15.50:0/3256059197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb0153850 msgr2=0x7f4cb00b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:04.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb6662640 1 --2- 172.21.15.50:0/3256059197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb0153850 0x7f4cb00b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb6662640 1 -- 172.21.15.50:0/3256059197 >> v1:172.21.15.50:6789/0 conn(0x7f4cb0153c30 legacy=0x7f4cb00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.607+0000 7f4cb6662640 1 -- 172.21.15.50:0/3256059197 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb015d850 con 0x7f4cb00cfd40 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.608+0000 7f4cb6662640 1 --2- 172.21.15.50:0/3256059197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb00cfd40 0x7f4cb00b1bd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009d90 tx=0x7f4ca802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533152aec992cf85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb4e5f640 1 -- 172.21.15.50:0/3256059197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca802cc60 con 0x7f4cb00cfd40 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb4e5f640 1 -- 172.21.15.50:0/3256059197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca802cdc0 con 0x7f4cb00cfd40 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb4e5f640 1 -- 172.21.15.50:0/3256059197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8034660 con 0x7f4cb00cfd40 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3256059197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb00cfd40 msgr2=0x7f4cb00b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3256059197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb00cfd40 0x7f4cb00b1bd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009d90 tx=0x7f4ca802beb0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3256059197 shutdown_connections 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3256059197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb00cfd40 0x7f4cb00b1bd0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3256059197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb0153850 0x7f4cb00b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3256059197 >> 172.21.15.50:0/3256059197 conn(0x7f4cb0069880 msgr2=0x7f4cb0069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3256059197 shutdown_connections 2023-08-10T10:46:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.609+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3256059197 wait complete. 2023-08-10T10:46:04.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.611+0000 7f4cb6e63640 1 Processor -- start 2023-08-10T10:46:04.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.611+0000 7f4cb6e63640 1 -- start start 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb00cfd40 0x7f4cb01e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb0153c30 0x7f4cb00d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb014d6e0 con 0x7f4cb0153850 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00d0ce0 con 0x7f4cb0153c30 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb6e63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00d2da0 con 0x7f4cb00cfd40 2023-08-10T10:46:04.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb5660640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb5660640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35406/0 (socket says 172.21.15.50:35406) 2023-08-10T10:46:04.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.612+0000 7f4cb5660640 1 -- 172.21.15.50:0/3367302257 learned_addr learned my addr 172.21.15.50:0/3367302257 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 -- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb00cfd40 msgr2=0x7f4cb01e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb00cfd40 0x7f4cb01e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 -- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb0153c30 msgr2=0x7f4cb00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb0153c30 0x7f4cb00d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 -- 172.21.15.50:0/3367302257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8009a70 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb5660640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c480 tx=0x7f4ca000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0005ce0 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0005e40 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb00d3080 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00072f0 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.613+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb00d3640 con 0x7f4cb0153850 2023-08-10T10:46:04.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.614+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0066e30 con 0x7f4cb0153850 2023-08-10T10:46:04.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.616+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ca0007510 con 0x7f4cb0153850 2023-08-10T10:46:04.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.616+0000 7f4ca67fc640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 0x7f4c9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:04.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.617+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ca0088a10 con 0x7f4cb0153850 2023-08-10T10:46:04.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.617+0000 7f4cb5e61640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 0x7f4c9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:04.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.617+0000 7f4cb5e61640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 0x7f4c9406d110 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006a90 tx=0x7f4cac006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.621+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4ca0053b60 con 0x7f4cb0153850 2023-08-10T10:46:04.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.803+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cb00b50f0 con 0x7f4cb0153850 2023-08-10T10:46:04.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.805+0000 7f4ca67fc640 1 -- 172.21.15.50:0/3367302257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f4ca0017090 con 0x7f4cb0153850 2023-08-10T10:46:04.807 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:04.807 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:45:50.573302+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:45:33.973819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-10T10:45:34.611242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 msgr2=0x7f4c9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 0x7f4c9406d110 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006a90 tx=0x7f4cac006a20 comp rx=0 tx=0).stop 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 msgr2=0x7f4cb014d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c480 tx=0x7f4ca000c940 comp rx=0 tx=0).stop 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 shutdown_connections 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4c9406ac50 0x7f4c9406d110 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb0153c30 0x7f4cb00d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb0153850 0x7f4cb014d1a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 --2- 172.21.15.50:0/3367302257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb00cfd40 0x7f4cb01e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 >> 172.21.15.50:0/3367302257 conn(0x7f4cb0069880 msgr2=0x7f4cb0069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 shutdown_connections 2023-08-10T10:46:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:04.808+0000 7f4cb6e63640 1 -- 172.21.15.50:0/3367302257 wait complete. 2023-08-10T10:46:04.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:46:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.045+0000 7fb4c3bfd640 1 Processor -- start 2023-08-10T10:46:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.045+0000 7fb4c3bfd640 1 -- start start 2023-08-10T10:46:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.046+0000 7fb4c3bfd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4bc0cd730 0x7fb4bc0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.046+0000 7fb4c3bfd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4bc0b5af0 0x7fb4bc0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.046+0000 7fb4c3bfd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0d1220 con 0x7fb4bc15ce00 2023-08-10T10:46:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c3bfd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0d2930 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c3bfd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b8a30 con 0x7fb4bc0cd730 2023-08-10T10:46:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c219a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4bc0b5af0 0x7fb4bc0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c1198640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4bc15ce00 0x7fb4bc0cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55622/0 (socket says 172.21.15.50:55622) 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c1198640 1 -- 172.21.15.50:0/280584430 learned_addr learned my addr 172.21.15.50:0/280584430 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c1999640 1 --2- 172.21.15.50:0/280584430 >> v2:172.21.15.117:3300/0 conn(0x7fb4bc0cd730 0x7fb4bc0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c219a640 1 -- 172.21.15.50:0/280584430 >> v2:172.21.15.117:3300/0 conn(0x7fb4bc0cd730 msgr2=0x7fb4bc0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c219a640 1 --2- 172.21.15.50:0/280584430 >> v2:172.21.15.117:3300/0 conn(0x7fb4bc0cd730 0x7fb4bc0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c219a640 1 -- 172.21.15.50:0/280584430 >> v1:172.21.15.50:6789/0 conn(0x7fb4bc15ce00 legacy=0x7fb4bc0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c219a640 1 -- 172.21.15.50:0/280584430 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0b1e70 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.047+0000 7fb4c0997640 1 -- 172.21.15.50:0/280584430 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478996122 0 0) 0x7fb4bc0d1220 con 0x7fb4bc15ce00 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c219a640 1 --2- 172.21.15.50:0/280584430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc0b5af0 0x7fb4bc0d16b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0b5620 tx=0x7fb4b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2dfe611a7adcf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c0997640 1 -- 172.21.15.50:0/280584430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b402cc80 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c0997640 1 -- 172.21.15.50:0/280584430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b402cde0 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c0997640 1 -- 172.21.15.50:0/280584430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4034660 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/280584430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc0b5af0 msgr2=0x7fb4bc0d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/280584430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc0b5af0 0x7fb4bc0d16b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0b5620 tx=0x7fb4b402bed0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/280584430 shutdown_connections 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/280584430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc0b5af0 0x7fb4bc0d16b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/280584430 >> v2:172.21.15.117:3300/0 conn(0x7fb4bc0cd730 0x7fb4bc0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/280584430 >> 172.21.15.50:0/280584430 conn(0x7fb4bc0d2c60 msgr2=0x7fb4bc0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.049+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/280584430 shutdown_connections 2023-08-10T10:46:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.050+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/280584430 wait complete. 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.051+0000 7fb4c3bfd640 1 Processor -- start 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.051+0000 7fb4c3bfd640 1 -- start start 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4bc0b5af0 0x7fb4bc152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4bc0cd730 0x7fb4bc0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0c7640 con 0x7fb4bc15ce00 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cb050 con 0x7fb4bc0cd730 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.052+0000 7fb4c3bfd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cbb90 con 0x7fb4bc0b5af0 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56278/0 (socket says 172.21.15.50:56278) 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 -- 172.21.15.50:0/4031802687 learned_addr learned my addr 172.21.15.50:0/4031802687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c1999640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4bc0b5af0 0x7fb4bc152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c1198640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4bc0cd730 0x7fb4bc0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 -- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4bc0b5af0 msgr2=0x7fb4bc152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4bc0b5af0 0x7fb4bc152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 -- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4bc0cd730 msgr2=0x7fb4bc0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4bc0cd730 0x7fb4bc0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 -- 172.21.15.50:0/4031802687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b4009a70 con 0x7fb4bc15ce00 2023-08-10T10:46:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.053+0000 7fb4c219a640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009e80 tx=0x7fb4b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.054+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4040650 con 0x7fb4bc15ce00 2023-08-10T10:46:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.054+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b40407b0 con 0x7fb4bc15ce00 2023-08-10T10:46:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.054+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4040b60 con 0x7fb4bc15ce00 2023-08-10T10:46:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.054+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc152000 con 0x7fb4bc15ce00 2023-08-10T10:46:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.054+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0cb5d0 con 0x7fb4bc15ce00 2023-08-10T10:46:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.055+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc152510 con 0x7fb4bc15ce00 2023-08-10T10:46:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.056+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4b4040cc0 con 0x7fb4bc15ce00 2023-08-10T10:46:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.057+0000 7fb4b27fc640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 0x7fb4a006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.057+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4b40ac200 con 0x7fb4bc15ce00 2023-08-10T10:46:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.057+0000 7fb4c1999640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 0x7fb4a006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.058+0000 7fb4c1999640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 0x7fb4a006d110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8006fd0 tx=0x7fb4b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.061+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4b40772a0 con 0x7fb4bc15ce00 2023-08-10T10:46:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.292+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb4bc04e270 con 0x7fb4bc15ce00 2023-08-10T10:46:05.294 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:46:05.293+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:46:05.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.300+0000 7fb4b27fc640 1 -- 172.21.15.50:0/4031802687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb4b4009450 con 0x7fb4bc15ce00 2023-08-10T10:46:05.302 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:46:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.304+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 msgr2=0x7fb4a006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.304+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 0x7fb4a006d110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8006fd0 tx=0x7fb4b8008040 comp rx=0 tx=0).stop 2023-08-10T10:46:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.304+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 msgr2=0x7fb4bc151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.304+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009e80 tx=0x7fb4b4004a40 comp rx=0 tx=0).stop 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 shutdown_connections 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4bc15ce00 0x7fb4bc151ac0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a006ac50 0x7fb4a006d110 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4bc0cd730 0x7fb4bc0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 --2- 172.21.15.50:0/4031802687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4bc0b5af0 0x7fb4bc152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 >> 172.21.15.50:0/4031802687 conn(0x7fb4bc0d2c60 msgr2=0x7fb4bc0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 shutdown_connections 2023-08-10T10:46:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.305+0000 7fb4c3bfd640 1 -- 172.21.15.50:0/4031802687 wait complete. 2023-08-10T10:46:05.317 INFO:tasks.ceph.mds.c.smithi050.stderr: -4963> 2023-08-10T10:45:41.076+0000 7fe14a8dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:46:05.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:46:05.392 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:46:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.524+0000 7f219f0a7640 1 Processor -- start 2023-08-10T10:46:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.524+0000 7f219f0a7640 1 -- start start 2023-08-10T10:46:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219f0a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f219815a820 0x7f219806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219f0a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219f0a7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219815bcb0 con 0x7f21980b40e0 2023-08-10T10:46:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219f0a7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980c5540 con 0x7f219815a820 2023-08-10T10:46:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219f0a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219815b0a0 con 0x7f219815ac00 2023-08-10T10:46:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219ce43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f219815a820 0x7f219806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219ce43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f219815a820 0x7f219806c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56308/0 (socket says 172.21.15.50:56308) 2023-08-10T10:46:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219d644640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f21980b40e0 0x7f219815e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55650/0 (socket says 172.21.15.50:55650) 2023-08-10T10:46:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.526+0000 7f219ce43640 1 -- 172.21.15.50:0/3373370227 learned_addr learned my addr 172.21.15.50:0/3373370227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f218ffff640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f219ce43640 1 -- 172.21.15.50:0/3373370227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 msgr2=0x7f21980696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f219ce43640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f219ce43640 1 -- 172.21.15.50:0/3373370227 >> v1:172.21.15.50:6789/0 conn(0x7f21980b40e0 legacy=0x7f219815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f219ce43640 1 -- 172.21.15.50:0/3373370227 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219815b380 con 0x7f219815a820 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.527+0000 7f218f7fe640 1 -- 172.21.15.50:0/3373370227 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712824930 0 0) 0x7f219815bcb0 con 0x7f21980b40e0 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.528+0000 7f219ce43640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f219806c180 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2194009e50 tx=0x7f219402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0499dacc0fa2f17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.528+0000 7f218f7fe640 1 -- 172.21.15.50:0/3373370227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219402cb00 con 0x7f219815a820 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.528+0000 7f218f7fe640 1 -- 172.21.15.50:0/3373370227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219402cc60 con 0x7f219815a820 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.528+0000 7f218f7fe640 1 -- 172.21.15.50:0/3373370227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940343f0 con 0x7f219815a820 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 -- 172.21.15.50:0/3373370227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 msgr2=0x7f219806c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f219806c180 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2194009e50 tx=0x7f219402bf60 comp rx=0 tx=0).stop 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 -- 172.21.15.50:0/3373370227 shutdown_connections 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 --2- 172.21.15.50:0/3373370227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f219806c180 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 -- 172.21.15.50:0/3373370227 >> 172.21.15.50:0/3373370227 conn(0x7f21980b08e0 msgr2=0x7f21980ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 -- 172.21.15.50:0/3373370227 shutdown_connections 2023-08-10T10:46:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.529+0000 7f219f0a7640 1 -- 172.21.15.50:0/3373370227 wait complete. 2023-08-10T10:46:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.531+0000 7f219f0a7640 1 Processor -- start 2023-08-10T10:46:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.532+0000 7f219f0a7640 1 -- start start 2023-08-10T10:46:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 0x7f21980cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c31f0 con 0x7f219815a820 2023-08-10T10:46:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980b2510 con 0x7f21980b40e0 2023-08-10T10:46:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f219f0a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c2950 con 0x7f219815ac00 2023-08-10T10:46:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f218ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f218ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56314/0 (socket says 172.21.15.50:56314) 2023-08-10T10:46:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.533+0000 7f218ffff640 1 -- 172.21.15.50:0/2466408284 learned_addr learned my addr 172.21.15.50:0/2466408284 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f219ce43640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 0x7f21980cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f219d644640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 -- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 msgr2=0x7f21980ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 -- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 msgr2=0x7f21980cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 0x7f21980cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 -- 172.21.15.50:0/2466408284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009b30 con 0x7f219815a820 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f219ce43640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 0x7f21980cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218ffff640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f218800d5f0 tx=0x7f218800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880125f0 con 0x7f219815a820 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188012750 con 0x7f219815a820 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188012b00 con 0x7f219815a820 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.534+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21980c2c30 con 0x7f219815a820 2023-08-10T10:46:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.535+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21980c2640 con 0x7f219815a820 2023-08-10T10:46:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.536+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21980b22e0 con 0x7f219815a820 2023-08-10T10:46:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.537+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2188012c60 con 0x7f219815a820 2023-08-10T10:46:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.538+0000 7f218d7fa640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 0x7f218406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.538+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2188089a40 con 0x7f219815a820 2023-08-10T10:46:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.538+0000 7f219ce43640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 0x7f218406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.539+0000 7f219ce43640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 0x7f218406d110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2194035000 tx=0x7f2194030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.542+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2188054a80 con 0x7f219815a820 2023-08-10T10:46:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:05.776+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f219804e270 con 0x7f219815a820 2023-08-10T10:46:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.305+0000 7f218d7fa640 1 -- 172.21.15.50:0/2466408284 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21880580a0 con 0x7f219815a820 2023-08-10T10:46:06.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 msgr2=0x7f218406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 0x7f218406d110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2194035000 tx=0x7f2194030000 comp rx=0 tx=0).stop 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 msgr2=0x7f21980c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f218800d5f0 tx=0x7f218800dab0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 shutdown_connections 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f219815ac00 0x7f21980ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f219815a820 0x7f21980c2100 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f218406ac50 0x7f218406d110 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 --2- 172.21.15.50:0/2466408284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21980b40e0 0x7f21980cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 >> 172.21.15.50:0/2466408284 conn(0x7f21980b08e0 msgr2=0x7f219815d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:06.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 shutdown_connections 2023-08-10T10:46:06.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.308+0000 7f219f0a7640 1 -- 172.21.15.50:0/2466408284 wait complete. 2023-08-10T10:46:06.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:46:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.565+0000 7f7f43fff640 1 Processor -- start 2023-08-10T10:46:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.565+0000 7f7f43fff640 1 -- start start 2023-08-10T10:46:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f43fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f4415cbc0 0x7f7f44161180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440696a0 0x7f7f440cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f43fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440cfea0 con 0x7f7f440cfa10 2023-08-10T10:46:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f43fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440cd590 con 0x7f7f4415cbc0 2023-08-10T10:46:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f43fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440733f0 con 0x7f7f440696a0 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f42ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f4415cbc0 0x7f7f44161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f437fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7f440cfa10 0x7f7f440b1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55658/0 (socket says 172.21.15.50:55658) 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.567+0000 7f7f437fe640 1 -- 172.21.15.50:0/2782069868 learned_addr learned my addr 172.21.15.50:0/2782069868 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f427fc640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440696a0 0x7f7f440cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f41ffb640 1 -- 172.21.15.50:0/2782069868 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606736281 0 0) 0x7f7f3c001490 con 0x7f7f440cfa10 2023-08-10T10:46:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f41ffb640 1 -- 172.21.15.50:0/2782069868 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c003520 con 0x7f7f440cfa10 2023-08-10T10:46:06.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f42ffd640 1 -- 172.21.15.50:0/2782069868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440696a0 msgr2=0x7f7f440cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:06.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f42ffd640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440696a0 0x7f7f440cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f42ffd640 1 -- 172.21.15.50:0/2782069868 >> v1:172.21.15.50:6789/0 conn(0x7f7f440cfa10 legacy=0x7f7f440b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.568+0000 7f7f42ffd640 1 -- 172.21.15.50:0/2782069868 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440736b0 con 0x7f7f4415cbc0 2023-08-10T10:46:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.569+0000 7f7f42ffd640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f4415cbc0 0x7f7f44161180 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f7f340097a0 tx=0x7f7f3402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867eb755b87414b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.569+0000 7f7f41ffb640 1 -- 172.21.15.50:0/2782069868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34031780 con 0x7f7f4415cbc0 2023-08-10T10:46:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.569+0000 7f7f41ffb640 1 -- 172.21.15.50:0/2782069868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f340318e0 con 0x7f7f4415cbc0 2023-08-10T10:46:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f41ffb640 1 -- 172.21.15.50:0/2782069868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34031c50 con 0x7f7f4415cbc0 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 -- 172.21.15.50:0/2782069868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f4415cbc0 msgr2=0x7f7f44161180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f4415cbc0 0x7f7f44161180 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f7f340097a0 tx=0x7f7f3402b820 comp rx=0 tx=0).stop 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 -- 172.21.15.50:0/2782069868 shutdown_connections 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440696a0 0x7f7f440cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 --2- 172.21.15.50:0/2782069868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f4415cbc0 0x7f7f44161180 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 -- 172.21.15.50:0/2782069868 >> 172.21.15.50:0/2782069868 conn(0x7f7f440b2500 msgr2=0x7f7f440b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 -- 172.21.15.50:0/2782069868 shutdown_connections 2023-08-10T10:46:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.570+0000 7f7f43fff640 1 -- 172.21.15.50:0/2782069868 wait complete. 2023-08-10T10:46:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.572+0000 7f7f43fff640 1 Processor -- start 2023-08-10T10:46:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.572+0000 7f7f43fff640 1 -- start start 2023-08-10T10:46:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440cfa10 0x7f7f440ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f4415cbc0 0x7f7f440ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414ba70 con 0x7f7f440696a0 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4409b190 con 0x7f7f4415cbc0 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f43fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4409d440 con 0x7f7f440cfa10 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56326/0 (socket says 172.21.15.50:56326) 2023-08-10T10:46:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 -- 172.21.15.50:0/3008107156 learned_addr learned my addr 172.21.15.50:0/3008107156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f427fc640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440cfa10 0x7f7f440ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 -- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440cfa10 msgr2=0x7f7f440ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440cfa10 0x7f7f440ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 -- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f4415cbc0 msgr2=0x7f7f440ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f4415cbc0 0x7f7f440ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.574+0000 7f7f42ffd640 1 -- 172.21.15.50:0/3008107156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009400 con 0x7f7f440696a0 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f42ffd640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7f34000c00 tx=0x7f7f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34032820 con 0x7f7f440696a0 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34032980 con 0x7f7f440696a0 2023-08-10T10:46:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34032d30 con 0x7f7f440696a0 2023-08-10T10:46:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4414b0d0 con 0x7f7f440696a0 2023-08-10T10:46:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.575+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4414b690 con 0x7f7f440696a0 2023-08-10T10:46:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.576+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4406a070 con 0x7f7f440696a0 2023-08-10T10:46:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.577+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f3404e450 con 0x7f7f440696a0 2023-08-10T10:46:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.580+0000 7f7f2b7fe640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 0x7f7f3006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.580+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7f340ab5b0 con 0x7f7f440696a0 2023-08-10T10:46:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.580+0000 7f7f427fc640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 0x7f7f3006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:06.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.581+0000 7f7f427fc640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 0x7f7f3006d110 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f38006fd0 tx=0x7f7f38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.584+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f340766a0 con 0x7f7f440696a0 2023-08-10T10:46:06.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:06.776+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f44066e30 con 0x7f7f440696a0 2023-08-10T10:46:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.544+0000 7f7f2b7fe640 1 -- 172.21.15.50:0/3008107156 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7f34079cc0 con 0x7f7f440696a0 2023-08-10T10:46:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:46:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 msgr2=0x7f7f3006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 0x7f7f3006d110 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f38006fd0 tx=0x7f7f38008040 comp rx=0 tx=0).stop 2023-08-10T10:46:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 msgr2=0x7f7f4409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7f34000c00 tx=0x7f7f340046c0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 shutdown_connections 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f3006ac50 0x7f7f3006d110 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f4415cbc0 0x7f7f440ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440cfa10 0x7f7f440ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 --2- 172.21.15.50:0/3008107156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440696a0 0x7f7f4409cf00 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.548+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 >> 172.21.15.50:0/3008107156 conn(0x7f7f440b2500 msgr2=0x7f7f440ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:07.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.549+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 shutdown_connections 2023-08-10T10:46:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.549+0000 7f7f43fff640 1 -- 172.21.15.50:0/3008107156 wait complete. 2023-08-10T10:46:07.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:46:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.809+0000 7ff6165be640 1 Processor -- start 2023-08-10T10:46:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.810+0000 7ff6165be640 1 -- start start 2023-08-10T10:46:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.811+0000 7ff6165be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff61015ac00 0x7ff61006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.811+0000 7ff6165be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.811+0000 7ff6165be640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61015bcb0 con 0x7ff61015a820 2023-08-10T10:46:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.811+0000 7ff6165be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100c5540 con 0x7ff61015ac00 2023-08-10T10:46:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.811+0000 7ff6165be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61015b0a0 con 0x7ff610069db0 2023-08-10T10:46:07.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.812+0000 7ff614b5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.812+0000 7ff614b5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:48548/0 (socket says 172.21.15.50:48548) 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.812+0000 7ff614b5b640 1 -- 172.21.15.50:0/2577345577 learned_addr learned my addr 172.21.15.50:0/2577345577 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.812+0000 7ff607fff640 1 --2- 172.21.15.50:0/2577345577 >> v2:172.21.15.117:3300/0 conn(0x7ff61015ac00 0x7ff61006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.813+0000 7ff614b5b640 1 -- 172.21.15.50:0/2577345577 >> v2:172.21.15.117:3300/0 conn(0x7ff61015ac00 msgr2=0x7ff61006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.813+0000 7ff614b5b640 1 --2- 172.21.15.50:0/2577345577 >> v2:172.21.15.117:3300/0 conn(0x7ff61015ac00 0x7ff61006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.813+0000 7ff60f7fe640 1 -- 172.21.15.50:0/2577345577 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093261894 0 0) 0x7ff61015bcb0 con 0x7ff61015a820 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.813+0000 7ff614b5b640 1 -- 172.21.15.50:0/2577345577 >> v1:172.21.15.117:6789/0 conn(0x7ff61015a820 legacy=0x7ff6100696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.813+0000 7ff614b5b640 1 -- 172.21.15.50:0/2577345577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61015b380 con 0x7ff610069db0 2023-08-10T10:46:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.815+0000 7ff614b5b640 1 --2- 172.21.15.50:0/2577345577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff608009e50 tx=0x7ff60802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd950592af07c9f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.816+0000 7ff60f7fe640 1 -- 172.21.15.50:0/2577345577 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60802cb00 con 0x7ff610069db0 2023-08-10T10:46:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.816+0000 7ff60f7fe640 1 -- 172.21.15.50:0/2577345577 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60802cc60 con 0x7ff610069db0 2023-08-10T10:46:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.816+0000 7ff60f7fe640 1 -- 172.21.15.50:0/2577345577 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080343f0 con 0x7ff610069db0 2023-08-10T10:46:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.816+0000 7ff6165be640 1 -- 172.21.15.50:0/2577345577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 msgr2=0x7ff6100cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.816+0000 7ff6165be640 1 --2- 172.21.15.50:0/2577345577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff608009e50 tx=0x7ff60802bf60 comp rx=0 tx=0).stop 2023-08-10T10:46:07.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 -- 172.21.15.50:0/2577345577 shutdown_connections 2023-08-10T10:46:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 --2- 172.21.15.50:0/2577345577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff610069db0 0x7ff6100cc370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 --2- 172.21.15.50:0/2577345577 >> v2:172.21.15.117:3300/0 conn(0x7ff61015ac00 0x7ff61006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 -- 172.21.15.50:0/2577345577 >> 172.21.15.50:0/2577345577 conn(0x7ff6100b08e0 msgr2=0x7ff6100ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 -- 172.21.15.50:0/2577345577 shutdown_connections 2023-08-10T10:46:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.817+0000 7ff6165be640 1 -- 172.21.15.50:0/2577345577 wait complete. 2023-08-10T10:46:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.818+0000 7ff6165be640 1 Processor -- start 2023-08-10T10:46:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.819+0000 7ff6165be640 1 -- start start 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 0x7ff6101f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff61015ac00 0x7ff610159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6101f6570 con 0x7ff610069db0 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c9bd0 con 0x7ff61015a820 2023-08-10T10:46:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff6165be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6101587a0 con 0x7ff61015ac00 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56332/0 (socket says 172.21.15.50:56332) 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 -- 172.21.15.50:0/3973301860 learned_addr learned my addr 172.21.15.50:0/3973301860 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff614b5b640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff61015ac00 0x7ff610159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff607fff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 0x7ff6101f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 -- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff61015ac00 msgr2=0x7ff610159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff61015ac00 0x7ff610159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 -- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 msgr2=0x7ff6101f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 0x7ff6101f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.820+0000 7ff60ffff640 1 -- 172.21.15.50:0/3973301860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009b30 con 0x7ff610069db0 2023-08-10T10:46:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff607fff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 0x7ff6101f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff60ffff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c4b0 tx=0x7ff60000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600005480 con 0x7ff610069db0 2023-08-10T10:46:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6000035f0 con 0x7ff610069db0 2023-08-10T10:46:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff610158a80 con 0x7ff610069db0 2023-08-10T10:46:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6000039e0 con 0x7ff610069db0 2023-08-10T10:46:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.821+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff610159f10 con 0x7ff610069db0 2023-08-10T10:46:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.822+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff610158fa0 con 0x7ff610069db0 2023-08-10T10:46:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.823+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff600003b40 con 0x7ff610069db0 2023-08-10T10:46:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.824+0000 7ff60d7fa640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 0x7ff5f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.825+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5710+0+0 (secure 0 0 0) 0x7ff600088a10 con 0x7ff610069db0 2023-08-10T10:46:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.825+0000 7ff607fff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 0x7ff5f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.826+0000 7ff607fff640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 0x7ff5f006d110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6100cccb0 tx=0x7ff5f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:07.829+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff610158fa0 con 0x7ff610069db0 2023-08-10T10:46:08.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.024+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6100b40b0 con 0x7ff610069db0 2023-08-10T10:46:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.562+0000 7ff60d7fa640 1 -- 172.21.15.50:0/3973301860 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff600017020 con 0x7ff610069db0 2023-08-10T10:46:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:46:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 msgr2=0x7ff5f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 0x7ff5f006d110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6100cccb0 tx=0x7ff5f8008040 comp rx=0 tx=0).stop 2023-08-10T10:46:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 msgr2=0x7ff6101f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c4b0 tx=0x7ff60000c970 comp rx=0 tx=0).stop 2023-08-10T10:46:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 shutdown_connections 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff61015ac00 0x7ff610159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff5f006ac50 0x7ff5f006d110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff61015a820 0x7ff6101f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 --2- 172.21.15.50:0/3973301860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff610069db0 0x7ff6101f1ac0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.566+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 >> 172.21.15.50:0/3973301860 conn(0x7ff6100b08e0 msgr2=0x7ff6100cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.567+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 shutdown_connections 2023-08-10T10:46:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.567+0000 7ff6165be640 1 -- 172.21.15.50:0/3973301860 wait complete. 2023-08-10T10:46:08.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:46:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.827+0000 7f21c1446640 1 Processor -- start 2023-08-10T10:46:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.827+0000 7f21c1446640 1 -- start start 2023-08-10T10:46:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.828+0000 7f21c1446640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21bc15ce00 0x7f21bc0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.829+0000 7f21c1446640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 0x7f21bc0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.829+0000 7f21c1446640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0d1220 con 0x7f21bc0cd730 2023-08-10T10:46:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.829+0000 7f21c1446640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0d2930 con 0x7f21bc15ce00 2023-08-10T10:46:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.829+0000 7f21c1446640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b8a30 con 0x7f21bc0b5af0 2023-08-10T10:46:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.829+0000 7f21bb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 0x7f21bc0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21baffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f21bc0cd730 0x7f21bc0cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:39444/0 (socket says 172.21.15.50:39444) 2023-08-10T10:46:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21baffd640 1 -- 172.21.15.50:0/3130643505 learned_addr learned my addr 172.21.15.50:0/3130643505 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21ba7fc640 1 --2- 172.21.15.50:0/3130643505 >> v2:172.21.15.117:3300/0 conn(0x7f21bc15ce00 0x7f21bc0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21bb7fe640 1 -- 172.21.15.50:0/3130643505 >> v2:172.21.15.117:3300/0 conn(0x7f21bc15ce00 msgr2=0x7f21bc0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21bb7fe640 1 --2- 172.21.15.50:0/3130643505 >> v2:172.21.15.117:3300/0 conn(0x7f21bc15ce00 0x7f21bc0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21bb7fe640 1 -- 172.21.15.50:0/3130643505 >> v1:172.21.15.117:6789/0 conn(0x7f21bc0cd730 legacy=0x7f21bc0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.830+0000 7f21bb7fe640 1 -- 172.21.15.50:0/3130643505 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0b1e70 con 0x7f21bc0b5af0 2023-08-10T10:46:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.832+0000 7f21bb7fe640 1 --2- 172.21.15.50:0/3130643505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 0x7f21bc0d16b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f21b40097a0 tx=0x7f21b402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9720644bc2b24888 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.832+0000 7f21b9ffb640 1 -- 172.21.15.50:0/3130643505 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b402d040 con 0x7f21bc0b5af0 2023-08-10T10:46:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.832+0000 7f21b9ffb640 1 -- 172.21.15.50:0/3130643505 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b4031810 con 0x7f21bc0b5af0 2023-08-10T10:46:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.832+0000 7f21b9ffb640 1 -- 172.21.15.50:0/3130643505 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4031ba0 con 0x7f21bc0b5af0 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 -- 172.21.15.50:0/3130643505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 msgr2=0x7f21bc0d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 --2- 172.21.15.50:0/3130643505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 0x7f21bc0d16b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f21b40097a0 tx=0x7f21b402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 -- 172.21.15.50:0/3130643505 shutdown_connections 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 --2- 172.21.15.50:0/3130643505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc0b5af0 0x7f21bc0d16b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 --2- 172.21.15.50:0/3130643505 >> v2:172.21.15.117:3300/0 conn(0x7f21bc15ce00 0x7f21bc0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 -- 172.21.15.50:0/3130643505 >> 172.21.15.50:0/3130643505 conn(0x7f21bc0d2c60 msgr2=0x7f21bc0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 -- 172.21.15.50:0/3130643505 shutdown_connections 2023-08-10T10:46:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.833+0000 7f21c1446640 1 -- 172.21.15.50:0/3130643505 wait complete. 2023-08-10T10:46:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.835+0000 7f21c1446640 1 Processor -- start 2023-08-10T10:46:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.835+0000 7f21c1446640 1 -- start start 2023-08-10T10:46:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21bc0b5af0 0x7f21bc14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc15ce00 0x7f21bc0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0a9460 con 0x7f21bc0cd730 2023-08-10T10:46:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c73e0 con 0x7f21bc0b5af0 2023-08-10T10:46:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21c1446640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c7eb0 con 0x7f21bc15ce00 2023-08-10T10:46:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.836+0000 7f21ba7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56336/0 (socket says 172.21.15.50:56336) 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 -- 172.21.15.50:0/490636747 learned_addr learned my addr 172.21.15.50:0/490636747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21bb7fe640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc15ce00 0x7f21bc0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21baffd640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21bc0b5af0 0x7f21bc14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 -- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc15ce00 msgr2=0x7f21bc0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc15ce00 0x7f21bc0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 -- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21bc0b5af0 msgr2=0x7f21bc14a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21bc0b5af0 0x7f21bc14a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 -- 172.21.15.50:0/490636747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4009400 con 0x7f21bc0cd730 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.837+0000 7f21ba7fc640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f21a400e870 tx=0x7f21a400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.838+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40094f0 con 0x7f21bc0cd730 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.838+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400c940 con 0x7f21bc0cd730 2023-08-10T10:46:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.838+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400ccf0 con 0x7f21bc0cd730 2023-08-10T10:46:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.838+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0c8190 con 0x7f21bc0cd730 2023-08-10T10:46:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.838+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc14a990 con 0x7f21bc0cd730 2023-08-10T10:46:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.839+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc04e270 con 0x7f21bc0cd730 2023-08-10T10:46:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.840+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21a4013470 con 0x7f21bc0cd730 2023-08-10T10:46:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.841+0000 7f21b37fe640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 0x7f219c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.841+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f21a4089330 con 0x7f21bc0cd730 2023-08-10T10:46:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.841+0000 7f21baffd640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 0x7f219c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.842+0000 7f21baffd640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 0x7f219c06d110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005c00 tx=0x7f21ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:08.846+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f21a4054660 con 0x7f21bc0cd730 2023-08-10T10:46:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.042+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f21bc073510 con 0x7f21bc0cd730 2023-08-10T10:46:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.047+0000 7f21b37fe640 1 -- 172.21.15.50:0/490636747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21a4057c80 con 0x7f21bc0cd730 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 msgr2=0x7f219c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 0x7f219c06d110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005c00 tx=0x7f21ac009040 comp rx=0 tx=0).stop 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 msgr2=0x7f21bc15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f21a400e870 tx=0x7f21a400ed30 comp rx=0 tx=0).stop 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 shutdown_connections 2023-08-10T10:46:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21bc15ce00 0x7f21bc0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21bc0cd730 0x7f21bc15d1e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f219c06ac50 0x7f219c06d110 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 --2- 172.21.15.50:0/490636747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21bc0b5af0 0x7f21bc14a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 >> 172.21.15.50:0/490636747 conn(0x7f21bc0d2c60 msgr2=0x7f21bc0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.050+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 shutdown_connections 2023-08-10T10:46:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.051+0000 7f21c1446640 1 -- 172.21.15.50:0/490636747 wait complete. 2023-08-10T10:46:09.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-08-10T10:46:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.299+0000 7f01150fa640 1 Processor -- start 2023-08-10T10:46:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.300+0000 7f01150fa640 1 -- start start 2023-08-10T10:46:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.301+0000 7f01150fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01100b0c60 0x7f01100c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.301+0000 7f01150fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0110071c70 con 0x7f01100b3f30 2023-08-10T10:46:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.301+0000 7f01150fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01100713d0 con 0x7f011015aa40 2023-08-10T10:46:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.301+0000 7f01150fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100716b0 con 0x7f01100b0c60 2023-08-10T10:46:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.301+0000 7f0107fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01100b0c60 0x7f01100c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.302+0000 7f0107fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01100b0c60 0x7f01100c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56344/0 (socket says 172.21.15.50:56344) 2023-08-10T10:46:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.302+0000 7f0107fff640 1 -- 172.21.15.50:0/2999907418 learned_addr learned my addr 172.21.15.50:0/2999907418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.302+0000 7f0107fff640 1 -- 172.21.15.50:0/2999907418 >> v1:172.21.15.117:6789/0 conn(0x7f011015aa40 legacy=0x7f01100b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.302+0000 7f0107fff640 1 -- 172.21.15.50:0/2999907418 >> v1:172.21.15.50:6789/0 conn(0x7f01100b3f30 legacy=0x7f01100c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.302+0000 7f0107fff640 1 -- 172.21.15.50:0/2999907418 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110071990 con 0x7f01100b0c60 2023-08-10T10:46:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.303+0000 7f0107fff640 1 --2- 172.21.15.50:0/2999907418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01100b0c60 0x7f01100c9920 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6f288a0fe11627 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f010e59c640 1 -- 172.21.15.50:0/2999907418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8031870 con 0x7f01100b0c60 2023-08-10T10:46:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f010e59c640 1 -- 172.21.15.50:0/2999907418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f80319d0 con 0x7f01100b0c60 2023-08-10T10:46:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f010e59c640 1 -- 172.21.15.50:0/2999907418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8031d60 con 0x7f01100b0c60 2023-08-10T10:46:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 -- 172.21.15.50:0/2999907418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01100b0c60 msgr2=0x7f01100c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 --2- 172.21.15.50:0/2999907418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01100b0c60 0x7f01100c9920 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802b910 comp rx=0 tx=0).stop 2023-08-10T10:46:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 -- 172.21.15.50:0/2999907418 shutdown_connections 2023-08-10T10:46:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 --2- 172.21.15.50:0/2999907418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01100b0c60 0x7f01100c9920 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 -- 172.21.15.50:0/2999907418 >> 172.21.15.50:0/2999907418 conn(0x7f011006b590 msgr2=0x7f01100ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.304+0000 7f01150fa640 1 -- 172.21.15.50:0/2999907418 shutdown_connections 2023-08-10T10:46:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.305+0000 7f01150fa640 1 -- 172.21.15.50:0/2999907418 wait complete. 2023-08-10T10:46:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.306+0000 7f01150fa640 1 Processor -- start 2023-08-10T10:46:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.306+0000 7f01150fa640 1 -- start start 2023-08-10T10:46:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.307+0000 7f01150fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01100b0c60 0x7f01100b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.307+0000 7f01150fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01100b3f30 0x7f01100b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f01150fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f01150fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110155030 con 0x7f011015aa40 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f01150fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011015dfa0 con 0x7f01100b3f30 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f01150fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01101540d0 con 0x7f01100b0c60 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56360/0 (socket says 172.21.15.50:56360) 2023-08-10T10:46:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 -- 172.21.15.50:0/1860460130 learned_addr learned my addr 172.21.15.50:0/1860460130 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010ed9d640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01100b0c60 0x7f01100b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f0107fff640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01100b3f30 0x7f01100b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 -- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01100b0c60 msgr2=0x7f01100b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01100b0c60 0x7f01100b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 -- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01100b3f30 msgr2=0x7f01100b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01100b3f30 0x7f01100b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.308+0000 7f010f59e640 1 -- 172.21.15.50:0/1860460130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80094d0 con 0x7f011015aa40 2023-08-10T10:46:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f010f59e640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f010800c7a0 tx=0x7f010800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108003b70 con 0x7f011015aa40 2023-08-10T10:46:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108003cf0 con 0x7f011015aa40 2023-08-10T10:46:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01101543b0 con 0x7f011015aa40 2023-08-10T10:46:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108003ea0 con 0x7f011015aa40 2023-08-10T10:46:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.309+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0110154970 con 0x7f011015aa40 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.310+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100b1b50 con 0x7f011015aa40 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.311+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f010800aa90 con 0x7f011015aa40 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.312+0000 7f01077fe640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 0x7f00f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.312+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0108088ff0 con 0x7f011015aa40 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.313+0000 7f010ed9d640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 0x7f00f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.313+0000 7f010ed9d640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 0x7f00f006d110 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0100006fd0 tx=0x7f0100008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.317+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f01100b1b50 con 0x7f011015aa40 2023-08-10T10:46:09.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:09.583+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f01100b1b50 con 0x7f011015aa40 2023-08-10T10:46:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.572+0000 7f01077fe640 1 -- 172.21.15.50:0/1860460130 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v421) v1 ==== 128+0+0 (secure 0 0 0) 0x7f01100b1b50 con 0x7f011015aa40 2023-08-10T10:46:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.576+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 msgr2=0x7f00f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.576+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 0x7f00f006d110 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0100006fd0 tx=0x7f0100008040 comp rx=0 tx=0).stop 2023-08-10T10:46:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.576+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 msgr2=0x7f01100b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.576+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f010800c7a0 tx=0x7f010800cc60 comp rx=0 tx=0).stop 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 shutdown_connections 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f011015aa40 0x7f01100b28b0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f00f006ac50 0x7f00f006d110 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01100b3f30 0x7f01100b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 --2- 172.21.15.50:0/1860460130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01100b0c60 0x7f01100b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 >> 172.21.15.50:0/1860460130 conn(0x7f011006b590 msgr2=0x7f01100cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 shutdown_connections 2023-08-10T10:46:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.577+0000 7f01150fa640 1 -- 172.21.15.50:0/1860460130 wait complete. 2023-08-10T10:46:10.599 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-10T10:46:10.599 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-08-10T10:46:10.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-08-10T10:46:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.831+0000 7f8352fcf640 1 Processor -- start 2023-08-10T10:46:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.831+0000 7f8352fcf640 1 -- start start 2023-08-10T10:46:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8352fcf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f834c15ccb0 0x7f834c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8352fcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c069db0 0x7f834c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8352fcf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834c0719f0 con 0x7f834c0c9b30 2023-08-10T10:46:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8352fcf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c0c8db0 con 0x7f834c15ccb0 2023-08-10T10:46:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8352fcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0c9050 con 0x7f834c069db0 2023-08-10T10:46:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8350d6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f834c15ccb0 0x7f834c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8350d6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f834c15ccb0 0x7f834c0b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56368/0 (socket says 172.21.15.50:56368) 2023-08-10T10:46:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.833+0000 7f8350d6b640 1 -- 172.21.15.50:0/389891309 learned_addr learned my addr 172.21.15.50:0/389891309 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.834+0000 7f835156c640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c069db0 0x7f834c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.834+0000 7f8350d6b640 1 -- 172.21.15.50:0/389891309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c069db0 msgr2=0x7f834c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.834+0000 7f8350d6b640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c069db0 0x7f834c0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.834+0000 7f8350d6b640 1 -- 172.21.15.50:0/389891309 >> v1:172.21.15.117:6789/0 conn(0x7f834c0c9b30 legacy=0x7f834c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.834+0000 7f8350d6b640 1 -- 172.21.15.50:0/389891309 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0c9330 con 0x7f834c15ccb0 2023-08-10T10:46:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.836+0000 7f8350d6b640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c15ccb0 0x7f834c0b2900 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8340009870 tx=0x7f834002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be9bccbed659f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f834b7fe640 1 -- 172.21.15.50:0/389891309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340030840 con 0x7f834c15ccb0 2023-08-10T10:46:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f834b7fe640 1 -- 172.21.15.50:0/389891309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400309a0 con 0x7f834c15ccb0 2023-08-10T10:46:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f834b7fe640 1 -- 172.21.15.50:0/389891309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340030d30 con 0x7f834c15ccb0 2023-08-10T10:46:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f8352fcf640 1 -- 172.21.15.50:0/389891309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c15ccb0 msgr2=0x7f834c0b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f8352fcf640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c15ccb0 0x7f834c0b2900 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8340009870 tx=0x7f834002b980 comp rx=0 tx=0).stop 2023-08-10T10:46:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.837+0000 7f8352fcf640 1 -- 172.21.15.50:0/389891309 shutdown_connections 2023-08-10T10:46:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.838+0000 7f8352fcf640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c069db0 0x7f834c0b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.838+0000 7f8352fcf640 1 --2- 172.21.15.50:0/389891309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c15ccb0 0x7f834c0b2900 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.838+0000 7f8352fcf640 1 -- 172.21.15.50:0/389891309 >> 172.21.15.50:0/389891309 conn(0x7f834c06b590 msgr2=0x7f834c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.838+0000 7f8352fcf640 1 -- 172.21.15.50:0/389891309 shutdown_connections 2023-08-10T10:46:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.838+0000 7f8352fcf640 1 -- 172.21.15.50:0/389891309 wait complete. 2023-08-10T10:46:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.839+0000 7f8352fcf640 1 Processor -- start 2023-08-10T10:46:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.840+0000 7f8352fcf640 1 -- start start 2023-08-10T10:46:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834c069db0 0x7f834c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 0x7f834c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c15e840 con 0x7f834c0c9b30 2023-08-10T10:46:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c15dfa0 con 0x7f834c069db0 2023-08-10T10:46:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8352fcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c15e280 con 0x7f834c15ccb0 2023-08-10T10:46:10.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f834bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f834bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56380/0 (socket says 172.21.15.50:56380) 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f834bfff640 1 -- 172.21.15.50:0/3488278656 learned_addr learned my addr 172.21.15.50:0/3488278656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f835156c640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 0x7f834c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.841+0000 7f8350d6b640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834c069db0 0x7f834c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 -- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 msgr2=0x7f834c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 0x7f834c0b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 -- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834c069db0 msgr2=0x7f834c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834c069db0 0x7f834c158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 -- 172.21.15.50:0/3488278656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400094d0 con 0x7f834c0c9b30 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f835156c640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 0x7f834c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f834bfff640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f833800c400 tx=0x7f833800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83380052d0 con 0x7f834c0c9b30 2023-08-10T10:46:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338005430 con 0x7f834c0c9b30 2023-08-10T10:46:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338003850 con 0x7f834c0c9b30 2023-08-10T10:46:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c15e560 con 0x7f834c0c9b30 2023-08-10T10:46:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.842+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c15d200 con 0x7f834c0c9b30 2023-08-10T10:46:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.843+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c0ad7d0 con 0x7f834c0c9b30 2023-08-10T10:46:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.844+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83380039b0 con 0x7f834c0c9b30 2023-08-10T10:46:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.845+0000 7f83497fa640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 0x7f833006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.846+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8338088810 con 0x7f834c0c9b30 2023-08-10T10:46:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.846+0000 7f8350d6b640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 0x7f833006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.847+0000 7f8350d6b640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 0x7f833006d110 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8340036000 tx=0x7f834003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:10.850+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8338053c00 con 0x7f834c0c9b30 2023-08-10T10:46:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.111+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f834c04e270 con 0x7f834c0c9b30 2023-08-10T10:46:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.575+0000 7f83497fa640 1 -- 172.21.15.50:0/3488278656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v422) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8338057220 con 0x7f834c0c9b30 2023-08-10T10:46:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 msgr2=0x7f833006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 0x7f833006d110 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8340036000 tx=0x7f834003b040 comp rx=0 tx=0).stop 2023-08-10T10:46:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 msgr2=0x7f834c0b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f833800c400 tx=0x7f833800c8c0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 shutdown_connections 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f834c15ccb0 0x7f834c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f834c0c9b30 0x7f834c0b1b50 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f833006ac50 0x7f833006d110 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 --2- 172.21.15.50:0/3488278656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834c069db0 0x7f834c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.578+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 >> 172.21.15.50:0/3488278656 conn(0x7f834c06b590 msgr2=0x7f834c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.579+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 shutdown_connections 2023-08-10T10:46:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.579+0000 7f8352fcf640 1 -- 172.21.15.50:0/3488278656 wait complete. 2023-08-10T10:46:11.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.829+0000 7f5f4ae44640 1 Processor -- start 2023-08-10T10:46:11.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.829+0000 7f5f4ae44640 1 -- start start 2023-08-10T10:46:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.830+0000 7f5f4ae44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f4406e550 0x7f5f440cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.830+0000 7f5f4ae44640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f44071470 0x7f5f4406e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f4ae44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4415a930 0x7f5f4406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f4ae44640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440cce30 con 0x7f5f44071470 2023-08-10T10:46:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f4ae44640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4406ee70 con 0x7f5f4406e550 2023-08-10T10:46:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f4ae44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440cc220 con 0x7f5f4415a930 2023-08-10T10:46:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f49641640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f44071470 0x7f5f4406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f49641640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f44071470 0x7f5f4406e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56394/0 (socket says 172.21.15.50:56394) 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f49641640 1 -- 172.21.15.50:0/1415882452 learned_addr learned my addr 172.21.15.50:0/1415882452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f4a643640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4415a930 0x7f5f4406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.831+0000 7f5f49e42640 1 --2- 172.21.15.50:0/1415882452 >> v2:172.21.15.117:3300/0 conn(0x7f5f4406e550 0x7f5f440cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.832+0000 7f5f49641640 1 -- 172.21.15.50:0/1415882452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4415a930 msgr2=0x7f5f4406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.832+0000 7f5f49641640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4415a930 0x7f5f4406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.832+0000 7f5f49641640 1 -- 172.21.15.50:0/1415882452 >> v2:172.21.15.117:3300/0 conn(0x7f5f4406e550 msgr2=0x7f5f440cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.832+0000 7f5f49641640 1 --2- 172.21.15.50:0/1415882452 >> v2:172.21.15.117:3300/0 conn(0x7f5f4406e550 0x7f5f440cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.832+0000 7f5f49641640 1 -- 172.21.15.50:0/1415882452 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440cc500 con 0x7f5f44071470 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.833+0000 7f5f49641640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f44071470 0x7f5f4406e930 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406f1a0 tx=0x7f5f3002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f820e4288fddb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.833+0000 7f5f48e40640 1 -- 172.21.15.50:0/1415882452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30031860 con 0x7f5f44071470 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.833+0000 7f5f48e40640 1 -- 172.21.15.50:0/1415882452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300319c0 con 0x7f5f44071470 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.833+0000 7f5f48e40640 1 -- 172.21.15.50:0/1415882452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30031d50 con 0x7f5f44071470 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 -- 172.21.15.50:0/1415882452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f44071470 msgr2=0x7f5f4406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f44071470 0x7f5f4406e930 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406f1a0 tx=0x7f5f3002b900 comp rx=0 tx=0).stop 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 -- 172.21.15.50:0/1415882452 shutdown_connections 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f4415a930 0x7f5f4406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/1415882452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f44071470 0x7f5f4406e930 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/1415882452 >> v2:172.21.15.117:3300/0 conn(0x7f5f4406e550 0x7f5f440cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 -- 172.21.15.50:0/1415882452 >> 172.21.15.50:0/1415882452 conn(0x7f5f440d0630 msgr2=0x7f5f440d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 -- 172.21.15.50:0/1415882452 shutdown_connections 2023-08-10T10:46:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.834+0000 7f5f4ae44640 1 -- 172.21.15.50:0/1415882452 wait complete. 2023-08-10T10:46:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.836+0000 7f5f4ae44640 1 Processor -- start 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.836+0000 7f5f4ae44640 1 -- start start 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4406e550 0x7f5f440b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f44071470 0x7f5f4415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f5210 con 0x7f5f4415a930 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f53f0 con 0x7f5f4406e550 2023-08-10T10:46:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4ae44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f56d0 con 0x7f5f44071470 2023-08-10T10:46:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4a643640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4a643640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56408/0 (socket says 172.21.15.50:56408) 2023-08-10T10:46:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.837+0000 7f5f4a643640 1 -- 172.21.15.50:0/2194932570 learned_addr learned my addr 172.21.15.50:0/2194932570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f49641640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f44071470 0x7f5f4415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 -- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f44071470 msgr2=0x7f5f4415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f44071470 0x7f5f4415cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 -- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4406e550 msgr2=0x7f5f440b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4406e550 0x7f5f440b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 -- 172.21.15.50:0/2194932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300094d0 con 0x7f5f4415a930 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4a643640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00d4e0 tx=0x7f5f3c00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0125f0 con 0x7f5f4415a930 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c012770 con 0x7f5f4415a930 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c012b20 con 0x7f5f4415a930 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.838+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441f59b0 con 0x7f5f4415a930 2023-08-10T10:46:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.839+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f441f5f70 con 0x7f5f4415a930 2023-08-10T10:46:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.840+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f44066e30 con 0x7f5f4415a930 2023-08-10T10:46:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.841+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f3c012c80 con 0x7f5f4415a930 2023-08-10T10:46:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.842+0000 7f5f427fc640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 0x7f5f2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.842+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f3c0895c0 con 0x7f5f4415a930 2023-08-10T10:46:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.842+0000 7f5f49e42640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 0x7f5f2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.843+0000 7f5f49e42640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 0x7f5f2806d110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f380070b0 tx=0x7f5f38007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:11.848+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f3c054980 con 0x7f5f4415a930 2023-08-10T10:46:12.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.043+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f4406f470 con 0x7f5f4415a930 2023-08-10T10:46:12.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.044+0000 7f5f427fc640 1 -- 172.21.15.50:0/2194932570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14764 (secure 0 0 0) 0x7f5f3c057fa0 con 0x7f5f4415a930 2023-08-10T10:46:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:12.046 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":135,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:08.540877+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/37638804":"2023-08-11T10:46:05.294280+0000","172.21.15.50:6835/37638804":"2023-08-11T10:46:05.294280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 msgr2=0x7f5f2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 0x7f5f2806d110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f380070b0 tx=0x7f5f38007040 comp rx=0 tx=0).stop 2023-08-10T10:46:12.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 msgr2=0x7f5f440ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00d4e0 tx=0x7f5f3c00d9a0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 shutdown_connections 2023-08-10T10:46:12.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4415a930 0x7f5f440ae550 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f44071470 0x7f5f4415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5f2806ac50 0x7f5f2806d110 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 --2- 172.21.15.50:0/2194932570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f4406e550 0x7f5f440b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.047+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 >> 172.21.15.50:0/2194932570 conn(0x7f5f440d0630 msgr2=0x7f5f440cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.048+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 shutdown_connections 2023-08-10T10:46:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.048+0000 7f5f4ae44640 1 -- 172.21.15.50:0/2194932570 wait complete. 2023-08-10T10:46:12.067 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:46:12.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:46:12.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.299+0000 7f9530de1640 1 Processor -- start 2023-08-10T10:46:12.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.299+0000 7f9530de1640 1 -- start start 2023-08-10T10:46:12.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9530de1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f952c0c9420 0x7f952c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9530de1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c160870 con 0x7f952c1612c0 2023-08-10T10:46:12.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9530de1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0ca370 con 0x7f952c15cbb0 2023-08-10T10:46:12.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9530de1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c0ca650 con 0x7f952c0c9420 2023-08-10T10:46:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9523fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f952c1612c0 0x7f952c0c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55678/0 (socket says 172.21.15.50:55678) 2023-08-10T10:46:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.301+0000 7f9523fff640 1 -- 172.21.15.50:0/4013740512 learned_addr learned my addr 172.21.15.50:0/4013740512 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:12.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f952ad9d640 1 --2- 172.21.15.50:0/4013740512 >> v2:172.21.15.117:3300/0 conn(0x7f952c0c9420 0x7f952c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020370271 0 0) 0x7f952c160870 con 0x7f952c1612c0 2023-08-10T10:46:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9518003520 con 0x7f952c1612c0 2023-08-10T10:46:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054432981 0 0) 0x7f9518003520 con 0x7f952c1612c0 2023-08-10T10:46:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 >> v2:172.21.15.117:3300/0 conn(0x7f952c0c9420 msgr2=0x7f952c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 --2- 172.21.15.50:0/4013740512 >> v2:172.21.15.117:3300/0 conn(0x7f952c0c9420 0x7f952c06f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 >> v1:172.21.15.117:6789/0 conn(0x7f952c15cbb0 legacy=0x7f952c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c160ac0 con 0x7f952c1612c0 2023-08-10T10:46:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9514001670 con 0x7f952c1612c0 2023-08-10T10:46:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 >> v1:172.21.15.50:6789/0 conn(0x7f952c1612c0 legacy=0x7f952c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9518003970 0x7f9518003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95180047c0 0x7f9518004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f951800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ca650 con 0x7f9518005180 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951800c120 con 0x7f95180047c0 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.302+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951800c2e0 con 0x7f9518003970 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f951800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952a59c640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9518003970 0x7f9518003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 -- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9518003970 msgr2=0x7f9518003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9518003970 0x7f9518003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f9523fff640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95180047c0 0x7f9518004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 -- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95180047c0 msgr2=0x7f9518004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95180047c0 0x7f9518004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952ad9d640 1 -- 172.21.15.50:0/4013740512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518003520 con 0x7f9518005180 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f952a59c640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9518003970 0x7f9518003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.303+0000 7f9523fff640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95180047c0 0x7f9518004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.304+0000 7f952ad9d640 1 -- 172.21.15.50:0/4013740512 reap_dead start 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.304+0000 7f952ad9d640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f951800b980 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9524009fc0 tx=0x7f95180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472052b099a98813 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952402cc30 con 0x7f9518005180 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400f040 con 0x7f9518005180 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9529d9b640 1 -- 172.21.15.50:0/4013740512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524003990 con 0x7f9518005180 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 -- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 msgr2=0x7f951800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f951800b980 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9524009fc0 tx=0x7f95180057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 -- 172.21.15.50:0/4013740512 shutdown_connections 2023-08-10T10:46:12.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 --2- 172.21.15.50:0/4013740512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f951800b980 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 -- 172.21.15.50:0/4013740512 >> 172.21.15.50:0/4013740512 conn(0x7f952c0b01b0 msgr2=0x7f952c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:12.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.305+0000 7f9530de1640 1 -- 172.21.15.50:0/4013740512 shutdown_connections 2023-08-10T10:46:12.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.306+0000 7f9530de1640 1 -- 172.21.15.50:0/4013740512 wait complete. 2023-08-10T10:46:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.307+0000 7f9530de1640 1 Processor -- start 2023-08-10T10:46:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.308+0000 7f9530de1640 1 -- start start 2023-08-10T10:46:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0c7e10 0x7f952c0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0c8290 0x7f952c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c3730 con 0x7f9518005180 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c39d0 con 0x7f952c0c8290 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f9530de1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c3cb0 con 0x7f952c0c7e10 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56426/0 (socket says 172.21.15.50:56426) 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 -- 172.21.15.50:0/1476035249 learned_addr learned my addr 172.21.15.50:0/1476035249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 -- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0c7e10 msgr2=0x7f952c0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0c7e10 0x7f952c0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 -- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0c8290 msgr2=0x7f952c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0c8290 0x7f952c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.309+0000 7f952a59c640 1 -- 172.21.15.50:0/1476035249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0c3f90 con 0x7f9518005180 2023-08-10T10:46:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f952a59c640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f951c00d770 tx=0x7f951c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c005270 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0053d0 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00b8f0 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0c4270 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.310+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0c21f0 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.311+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0612b0 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.313+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f951c00ba50 con 0x7f9518005180 2023-08-10T10:46:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.314+0000 7f9522ffd640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 0x7f950c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.314+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f951c089160 con 0x7f9518005180 2023-08-10T10:46:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.314+0000 7f9523fff640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 0x7f950c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.315+0000 7f9523fff640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 0x7f950c06d140 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f952c0cd910 tx=0x7f9514009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.318+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f951c054490 con 0x7f9518005180 2023-08-10T10:46:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.512+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f952c0adb60 con 0x7f9518005180 2023-08-10T10:46:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.513+0000 7f9522ffd640 1 -- 172.21.15.50:0/1476035249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f951c057ab0 con 0x7f9518005180 2023-08-10T10:46:12.513 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:46:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.515+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 msgr2=0x7f950c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.515+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 0x7f950c06d140 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f952c0cd910 tx=0x7f9514009040 comp rx=0 tx=0).stop 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 msgr2=0x7f952c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f951c00d770 tx=0x7f951c00dc30 comp rx=0 tx=0).stop 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 shutdown_connections 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f950c06ac80 0x7f950c06d140 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0c8290 0x7f952c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0c7e10 0x7f952c0ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 --2- 172.21.15.50:0/1476035249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9518005180 0x7f952c159ea0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 >> 172.21.15.50:0/1476035249 conn(0x7f952c0b01b0 msgr2=0x7f952c15b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 shutdown_connections 2023-08-10T10:46:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.516+0000 7f9530de1640 1 -- 172.21.15.50:0/1476035249 wait complete. 2023-08-10T10:46:12.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:46:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.761+0000 7fdced234640 1 Processor -- start 2023-08-10T10:46:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.761+0000 7fdced234640 1 -- start start 2023-08-10T10:46:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.762+0000 7fdced234640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 0x7fdce8160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.762+0000 7fdced234640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce80b4640 0x7fdce8161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdced234640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8160a40 con 0x7fdce815cb90 2023-08-10T10:46:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdced234640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80b4bb0 con 0x7fdce80b4640 2023-08-10T10:46:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdced234640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b4e90 con 0x7fdce815cf70 2023-08-10T10:46:12.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce80b4640 0x7fdce8161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce80b4640 0x7fdce8161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56440/0 (socket says 172.21.15.50:56440) 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 -- 172.21.15.50:0/4150916484 learned_addr learned my addr 172.21.15.50:0/4150916484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdcde59c640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 0x7fdce8160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 -- 172.21.15.50:0/4150916484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 msgr2=0x7fdce8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 0x7fdce8160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 -- 172.21.15.50:0/4150916484 >> v1:172.21.15.50:6789/0 conn(0x7fdce815cb90 legacy=0x7fdce80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdce759e640 1 -- 172.21.15.50:0/4150916484 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80b5170 con 0x7fdce80b4640 2023-08-10T10:46:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.763+0000 7fdcde59c640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 0x7fdce8160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.765+0000 7fdce759e640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce80b4640 0x7fdce8161410 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009870 tx=0x7fdce002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1d7d598dadc515 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.765+0000 7fdce659c640 1 -- 172.21.15.50:0/4150916484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0030840 con 0x7fdce80b4640 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.765+0000 7fdce659c640 1 -- 172.21.15.50:0/4150916484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce00309a0 con 0x7fdce80b4640 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.765+0000 7fdce659c640 1 -- 172.21.15.50:0/4150916484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0030d30 con 0x7fdce80b4640 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 -- 172.21.15.50:0/4150916484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce80b4640 msgr2=0x7fdce8161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce80b4640 0x7fdce8161410 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009870 tx=0x7fdce002b980 comp rx=0 tx=0).stop 2023-08-10T10:46:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 -- 172.21.15.50:0/4150916484 shutdown_connections 2023-08-10T10:46:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce80b4640 0x7fdce8161410 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 --2- 172.21.15.50:0/4150916484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cf70 0x7fdce8160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 -- 172.21.15.50:0/4150916484 >> 172.21.15.50:0/4150916484 conn(0x7fdce80cf640 msgr2=0x7fdce80cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 -- 172.21.15.50:0/4150916484 shutdown_connections 2023-08-10T10:46:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.766+0000 7fdced234640 1 -- 172.21.15.50:0/4150916484 wait complete. 2023-08-10T10:46:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.768+0000 7fdced234640 1 Processor -- start 2023-08-10T10:46:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.768+0000 7fdced234640 1 -- start start 2023-08-10T10:46:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdce80b4640 0x7fdce80cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 0x7fdce815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81510d0 con 0x7fdce815cf70 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80cac50 con 0x7fdce80b4640 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdced234640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80caf30 con 0x7fdce815cb90 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56446/0 (socket says 172.21.15.50:56446) 2023-08-10T10:46:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 -- 172.21.15.50:0/2068917214 learned_addr learned my addr 172.21.15.50:0/2068917214 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdcde59c640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 0x7fdce815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce6d9d640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdce80b4640 0x7fdce80cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 -- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 msgr2=0x7fdce815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 0x7fdce815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.769+0000 7fdce759e640 1 -- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdce80b4640 msgr2=0x7fdce80cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdce759e640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdce80b4640 0x7fdce80cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdce759e640 1 -- 172.21.15.50:0/2068917214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00094d0 con 0x7fdce815cf70 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdcde59c640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 0x7fdce815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdce759e640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009870 tx=0x7fdce0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce00307d0 con 0x7fdce815cf70 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0043400 con 0x7fdce815cf70 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80cb210 con 0x7fdce815cf70 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce00437b0 con 0x7fdce815cf70 2023-08-10T10:46:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.770+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80cb7d0 con 0x7fdce815cf70 2023-08-10T10:46:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.772+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8066390 con 0x7fdce815cf70 2023-08-10T10:46:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.773+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdce0043910 con 0x7fdce815cf70 2023-08-10T10:46:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.774+0000 7fdcdffff640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 0x7fdcc806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.774+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdce003e070 con 0x7fdce815cf70 2023-08-10T10:46:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.774+0000 7fdce6d9d640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 0x7fdcc806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.775+0000 7fdce6d9d640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 0x7fdcc806d110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8007fd0 tx=0x7fdcd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.778+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdce00777c0 con 0x7fdce815cf70 2023-08-10T10:46:12.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.968+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdce806ac60 con 0x7fdce815cf70 2023-08-10T10:46:12.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.968+0000 7fdcdffff640 1 -- 172.21.15.50:0/2068917214 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdce007ade0 con 0x7fdce815cf70 2023-08-10T10:46:12.969 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:46:12.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 msgr2=0x7fdcc806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 0x7fdcc806d110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8007fd0 tx=0x7fdcd8009040 comp rx=0 tx=0).stop 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 msgr2=0x7fdce815b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009870 tx=0x7fdce0004730 comp rx=0 tx=0).stop 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 shutdown_connections 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce815cf70 0x7fdce815b980 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdce815cb90 0x7fdce815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdcc806ac50 0x7fdcc806d110 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 --2- 172.21.15.50:0/2068917214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdce80b4640 0x7fdce80cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 >> 172.21.15.50:0/2068917214 conn(0x7fdce80cf640 msgr2=0x7fdce80b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 shutdown_connections 2023-08-10T10:46:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:12.971+0000 7fdced234640 1 -- 172.21.15.50:0/2068917214 wait complete. 2023-08-10T10:46:12.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:46:13.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.213+0000 7f7c4afc4640 1 Processor -- start 2023-08-10T10:46:13.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.213+0000 7f7c4afc4640 1 -- start start 2023-08-10T10:46:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.214+0000 7f7c4afc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c440c15e0 0x7f7c440c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.214+0000 7f7c4afc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440696a0 0x7f7c44069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.214+0000 7f7c4afc4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440cc8d0 con 0x7f7c44160fa0 2023-08-10T10:46:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c4afc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4406a070 con 0x7f7c440c15e0 2023-08-10T10:46:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c4afc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440ccbb0 con 0x7f7c440696a0 2023-08-10T10:46:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c497c1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c440c15e0 0x7f7c440c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c497c1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c440c15e0 0x7f7c440c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56448/0 (socket says 172.21.15.50:56448) 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c497c1640 1 -- 172.21.15.50:0/3675334717 learned_addr learned my addr 172.21.15.50:0/3675334717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.215+0000 7f7c4a7c3640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440696a0 0x7f7c44069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.216+0000 7f7c497c1640 1 -- 172.21.15.50:0/3675334717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440696a0 msgr2=0x7f7c44069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.216+0000 7f7c497c1640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440696a0 0x7f7c44069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.216+0000 7f7c497c1640 1 -- 172.21.15.50:0/3675334717 >> v1:172.21.15.50:6789/0 conn(0x7f7c44160fa0 legacy=0x7f7c440cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.216+0000 7f7c497c1640 1 -- 172.21.15.50:0/3675334717 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440cce90 con 0x7f7c440c15e0 2023-08-10T10:46:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.216+0000 7f7c48fc0640 1 -- 172.21.15.50:0/3675334717 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186398849 0 0) 0x7f7c440cc8d0 con 0x7f7c44160fa0 2023-08-10T10:46:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.217+0000 7f7c497c1640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440c15e0 0x7f7c440c97b0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d965f4bc03d3909 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.217+0000 7f7c48fc0640 1 -- 172.21.15.50:0/3675334717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34030840 con 0x7f7c440c15e0 2023-08-10T10:46:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.217+0000 7f7c48fc0640 1 -- 172.21.15.50:0/3675334717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340309a0 con 0x7f7c440c15e0 2023-08-10T10:46:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.217+0000 7f7c48fc0640 1 -- 172.21.15.50:0/3675334717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34030d30 con 0x7f7c440c15e0 2023-08-10T10:46:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3675334717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440c15e0 msgr2=0x7f7c440c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440c15e0 0x7f7c440c97b0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402b980 comp rx=0 tx=0).stop 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3675334717 shutdown_connections 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440c15e0 0x7f7c440c97b0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3675334717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440696a0 0x7f7c44069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3675334717 >> 172.21.15.50:0/3675334717 conn(0x7f7c440caf80 msgr2=0x7f7c440cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3675334717 shutdown_connections 2023-08-10T10:46:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.218+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3675334717 wait complete. 2023-08-10T10:46:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.220+0000 7f7c4afc4640 1 Processor -- start 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.220+0000 7f7c4afc4640 1 -- start start 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440c15e0 0x7f7c441f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 0x7f7c440c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440ced20 con 0x7f7c440696a0 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440c6d10 con 0x7f7c44160fa0 2023-08-10T10:46:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c4afc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441fab80 con 0x7f7c440c15e0 2023-08-10T10:46:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c49fc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c49fc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56464/0 (socket says 172.21.15.50:56464) 2023-08-10T10:46:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.221+0000 7f7c49fc2640 1 -- 172.21.15.50:0/3654410989 learned_addr learned my addr 172.21.15.50:0/3654410989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c4a7c3640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 0x7f7c440c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c497c1640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440c15e0 0x7f7c441f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 -- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440c15e0 msgr2=0x7f7c441f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440c15e0 0x7f7c441f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 -- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 msgr2=0x7f7c440c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 0x7f7c440c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 -- 172.21.15.50:0/3654410989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340094d0 con 0x7f7c440696a0 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c4a7c3640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 0x7f7c440c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c49fc2640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c440 tx=0x7f7c4000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40005480 con 0x7f7c440696a0 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c400035f0 con 0x7f7c440696a0 2023-08-10T10:46:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400039a0 con 0x7f7c440696a0 2023-08-10T10:46:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.222+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c440cf250 con 0x7f7c440696a0 2023-08-10T10:46:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.223+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440c66c0 con 0x7f7c440696a0 2023-08-10T10:46:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.224+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4406cc20 con 0x7f7c440696a0 2023-08-10T10:46:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.225+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c40003b00 con 0x7f7c440696a0 2023-08-10T10:46:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.226+0000 7f7c3a7fc640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 0x7f7c2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.226+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7c400886e0 con 0x7f7c440696a0 2023-08-10T10:46:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.226+0000 7f7c497c1640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 0x7f7c2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.227+0000 7f7c497c1640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 0x7f7c2806d110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7c34036000 tx=0x7f7c3403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.230+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7c40053aa0 con 0x7f7c440696a0 2023-08-10T10:46:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.421+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7c44066e30 con 0x7f7c440696a0 2023-08-10T10:46:13.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.427+0000 7f7c3a7fc640 1 -- 172.21.15.50:0/3654410989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c400170c0 con 0x7f7c440696a0 2023-08-10T10:46:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 msgr2=0x7f7c2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 0x7f7c2806d110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7c34036000 tx=0x7f7c3403b040 comp rx=0 tx=0).stop 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 msgr2=0x7f7c441fa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c440 tx=0x7f7c4000c900 comp rx=0 tx=0).stop 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 shutdown_connections 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c2806ac50 0x7f7c2806d110 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c44160fa0 0x7f7c440c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c440c15e0 0x7f7c441f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 --2- 172.21.15.50:0/3654410989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c440696a0 0x7f7c441fa640 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:13.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 >> 172.21.15.50:0/3654410989 conn(0x7f7c440caf80 msgr2=0x7f7c440cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:13.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 shutdown_connections 2023-08-10T10:46:13.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:13.431+0000 7f7c4afc4640 1 -- 172.21.15.50:0/3654410989 wait complete. 2023-08-10T10:46:13.449 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:46:13.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:46:13.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:46:13.697 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:46:13.698 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:13.698 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:13.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:46:13.762 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:46:13.762 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:13.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:46:13.821 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:13.822 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:13.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:46:13.884 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:46:13.884 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:13.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:46:13.943 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:46:13.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:14.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:46:14.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:46:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.172+0000 7fa6f3cec640 1 Processor -- start 2023-08-10T10:46:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.172+0000 7fa6f3cec640 1 -- start start 2023-08-10T10:46:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f3cec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6ec0b0c60 0x7fa6ec0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f3cec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec071c70 con 0x7fa6ec15aa40 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f3cec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec0713d0 con 0x7fa6ec0b3f30 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f3cec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec0716b0 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f1a88640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6ec15aa40 0x7fa6ec0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55696/0 (socket says 172.21.15.50:55696) 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f1a88640 1 -- 172.21.15.50:0/1605758244 learned_addr learned my addr 172.21.15.50:0/1605758244 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.174+0000 7fa6f1287640 1 --2- 172.21.15.50:0/1605758244 >> v2:172.21.15.50:3300/0 conn(0x7fa6ec0b0c60 0x7fa6ec0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.175+0000 7fa6f0a86640 1 -- 172.21.15.50:0/1605758244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634516929 0 0) 0x7fa6ec071c70 con 0x7fa6ec15aa40 2023-08-10T10:46:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.175+0000 7fa6f0a86640 1 -- 172.21.15.50:0/1605758244 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8003520 con 0x7fa6ec15aa40 2023-08-10T10:46:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.175+0000 7fa6f1287640 1 -- 172.21.15.50:0/1605758244 >> v1:172.21.15.117:6789/0 conn(0x7fa6ec0b3f30 legacy=0x7fa6ec0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.175+0000 7fa6f1287640 1 -- 172.21.15.50:0/1605758244 >> v1:172.21.15.50:6789/0 conn(0x7fa6ec15aa40 legacy=0x7fa6ec0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.175+0000 7fa6f1287640 1 -- 172.21.15.50:0/1605758244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec071990 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.176+0000 7fa6f1287640 1 --2- 172.21.15.50:0/1605758244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec0b0c60 0x7fa6ec0c9920 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0097a0 tx=0x7fa6dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c881e3fa6f9f24 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.176+0000 7fa6f0a86640 1 -- 172.21.15.50:0/1605758244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc031830 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.176+0000 7fa6f0a86640 1 -- 172.21.15.50:0/1605758244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc031990 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.176+0000 7fa6f0a86640 1 -- 172.21.15.50:0/1605758244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc031d00 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 -- 172.21.15.50:0/1605758244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec0b0c60 msgr2=0x7fa6ec0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/1605758244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec0b0c60 0x7fa6ec0c9920 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0097a0 tx=0x7fa6dc02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 -- 172.21.15.50:0/1605758244 shutdown_connections 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/1605758244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec0b0c60 0x7fa6ec0c9920 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 -- 172.21.15.50:0/1605758244 >> 172.21.15.50:0/1605758244 conn(0x7fa6ec06b590 msgr2=0x7fa6ec0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:14.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 -- 172.21.15.50:0/1605758244 shutdown_connections 2023-08-10T10:46:14.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.177+0000 7fa6f3cec640 1 -- 172.21.15.50:0/1605758244 wait complete. 2023-08-10T10:46:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.179+0000 7fa6f3cec640 1 Processor -- start 2023-08-10T10:46:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.179+0000 7fa6f3cec640 1 -- start start 2023-08-10T10:46:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6ec0b0c60 0x7fa6ec14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 0x7fa6ec156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c8300 con 0x7fa6ec15aa40 2023-08-10T10:46:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec14bd40 con 0x7fa6ec0b3f30 2023-08-10T10:46:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.180+0000 7fa6f3cec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec14b450 con 0x7fa6ec0b0c60 2023-08-10T10:46:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56490/0 (socket says 172.21.15.50:56490) 2023-08-10T10:46:14.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 -- 172.21.15.50:0/3030298143 learned_addr learned my addr 172.21.15.50:0/3030298143 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:14.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f1a88640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6ec0b0c60 0x7fa6ec14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f1287640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 0x7fa6ec156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 -- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6ec0b0c60 msgr2=0x7fa6ec14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6ec0b0c60 0x7fa6ec14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 -- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 msgr2=0x7fa6ec156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 0x7fa6ec156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f2289640 1 -- 172.21.15.50:0/3030298143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc009400 con 0x7fa6ec15aa40 2023-08-10T10:46:14.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.181+0000 7fa6f1287640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 0x7fa6ec156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:14.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6f2289640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c7a0 tx=0x7fa6e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4003b70 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4003cf0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400aa90 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec156d00 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.182+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec14b9d0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.183+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec14beb0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.184+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6e400abf0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.185+0000 7fa6e27fc640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 0x7fa6d006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.185+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa6e4088fe0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.185+0000 7fa6f1a88640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 0x7fa6d006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.186+0000 7fa6f1a88640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 0x7fa6d006d110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80011e0 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.189+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa6e40543a0 con 0x7fa6ec15aa40 2023-08-10T10:46:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.419+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6ec04e270 con 0x7fa6ec15aa40 2023-08-10T10:46:14.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.419+0000 7fa6e27fc640 1 -- 172.21.15.50:0/3030298143 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa6e4003e60 con 0x7fa6ec15aa40 2023-08-10T10:46:14.420 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:14.420 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3563071951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3563071951},{"type":"v1","addr":"172.21.15.117:6833","nonce":3563071951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/1069180788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1069180788},{"type":"v1","addr":"172.21.15.50:6836","nonce":1069180788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3381087844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3381087844},{"type":"v1","addr":"172.21.15.117:6835","nonce":3381087844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/195966800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":195966800},{"type":"v1","addr":"172.21.15.50:6837","nonce":195966800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[]} 2023-08-10T10:46:14.421 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 61 2023-08-10T10:46:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.422+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 msgr2=0x7fa6d006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.422+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 0x7fa6d006d110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80011e0 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2023-08-10T10:46:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.422+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 msgr2=0x7fa6ec0c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.422+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c7a0 tx=0x7fa6e400cc60 comp rx=0 tx=0).stop 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.422+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 shutdown_connections 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6ec15aa40 0x7fa6ec0c7dc0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6d006ac50 0x7fa6d006d110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec0b3f30 0x7fa6ec156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 --2- 172.21.15.50:0/3030298143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6ec0b0c60 0x7fa6ec14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 >> 172.21.15.50:0/3030298143 conn(0x7fa6ec06b590 msgr2=0x7fa6ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 shutdown_connections 2023-08-10T10:46:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.423+0000 7fa6f3cec640 1 -- 172.21.15.50:0/3030298143 wait complete. 2023-08-10T10:46:14.443 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:46:14.443 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:46:14.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:46:14.443 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:46:14.444 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:46:14.444 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:46:14.444 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:46:14.444 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:46:14.445 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:46:14.445 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:46:14.445 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:46:14.445 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:46:14.445 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:46:14.446 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:46:14.446 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:46:14.446 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:46:14.468 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:46:14.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:46:14.471 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:46:14.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:46:14.506 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:46:14.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:46:14.508 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:46:14.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:46:14.518 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:46:14.519 DEBUG:teuthology.parallel:result is None 2023-08-10T10:46:14.525 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:46:14.526 DEBUG:teuthology.parallel:result is None 2023-08-10T10:46:14.555 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:46:14.556 DEBUG:teuthology.parallel:result is None 2023-08-10T10:46:14.562 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:46:14.563 DEBUG:teuthology.parallel:result is None 2023-08-10T10:46:14.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:46:14.692 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:46:14.693 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:46:14.726 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:46:14.735 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:46:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.770+0000 7f71a0da2640 1 Processor -- start 2023-08-10T10:46:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.770+0000 7f71a0da2640 1 -- start start 2023-08-10T10:46:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.771+0000 7f71a0da2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f719c0cd730 0x7f719c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.771+0000 7f71a0da2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0d1220 con 0x7f719c15ce00 2023-08-10T10:46:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.771+0000 7f71a0da2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0b8a30 con 0x7f719c0b5af0 2023-08-10T10:46:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.771+0000 7f71a0da2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0d2930 con 0x7f719c0cd730 2023-08-10T10:46:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.771+0000 7f719a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f719c0cd730 0x7f719c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f719a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f719c0cd730 0x7f719c0d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56526/0 (socket says 172.21.15.50:56526) 2023-08-10T10:46:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f719a59c640 1 -- 172.21.15.50:0/305708410 learned_addr learned my addr 172.21.15.50:0/305708410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f7199d9b640 1 --1- 172.21.15.50:0/305708410 >> v1:172.21.15.50:6789/0 conn(0x7f719c15ce00 0x7f719c0cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55716/0 (socket says 172.21.15.50:55716) 2023-08-10T10:46:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f719a59c640 1 -- 172.21.15.50:0/305708410 >> v1:172.21.15.117:6789/0 conn(0x7f719c0b5af0 legacy=0x7f719c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f719a59c640 1 -- 172.21.15.50:0/305708410 >> v1:172.21.15.50:6789/0 conn(0x7f719c15ce00 legacy=0x7f719c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.772+0000 7f719a59c640 1 -- 172.21.15.50:0/305708410 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0b1e70 con 0x7f719c0cd730 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.773+0000 7f719a59c640 1 --2- 172.21.15.50:0/305708410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0cd730 0x7f719c0d23f0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f718c009870 tx=0x7f718c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2453a8e14f9db07 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.773+0000 7f719959a640 1 -- 172.21.15.50:0/305708410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c02f850 con 0x7f719c0cd730 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f719959a640 1 -- 172.21.15.50:0/305708410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c02f9b0 con 0x7f719c0cd730 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f719959a640 1 -- 172.21.15.50:0/305708410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c02fd40 con 0x7f719c0cd730 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 -- 172.21.15.50:0/305708410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0cd730 msgr2=0x7f719c0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 --2- 172.21.15.50:0/305708410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0cd730 0x7f719c0d23f0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f718c009870 tx=0x7f718c02ba30 comp rx=0 tx=0).stop 2023-08-10T10:46:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 -- 172.21.15.50:0/305708410 shutdown_connections 2023-08-10T10:46:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 --2- 172.21.15.50:0/305708410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0cd730 0x7f719c0d23f0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 -- 172.21.15.50:0/305708410 >> 172.21.15.50:0/305708410 conn(0x7f719c0d2c60 msgr2=0x7f719c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 -- 172.21.15.50:0/305708410 shutdown_connections 2023-08-10T10:46:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.774+0000 7f71a0da2640 1 -- 172.21.15.50:0/305708410 wait complete. 2023-08-10T10:46:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.776+0000 7f71a0da2640 1 Processor -- start 2023-08-10T10:46:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.776+0000 7f71a0da2640 1 -- start start 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0cd730 0x7f719c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 0x7f719c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c14f410 con 0x7f719c0b5af0 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c74b0 con 0x7f719c15ce00 2023-08-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f71a0da2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1f20d0 con 0x7f719c0cd730 2023-08-10T10:46:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f719a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f719a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56532/0 (socket says 172.21.15.50:56532) 2023-08-10T10:46:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.777+0000 7f719a59c640 1 -- 172.21.15.50:0/171214784 learned_addr learned my addr 172.21.15.50:0/171214784 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 -- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0cd730 msgr2=0x7f719c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0cd730 0x7f719c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 -- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 msgr2=0x7f719c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719ad9d640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 0x7f719c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 0x7f719c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 -- 172.21.15.50:0/171214784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0094d0 con 0x7f719c0b5af0 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719ad9d640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 0x7f719c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f719a59c640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f718c02ba70 tx=0x7f718c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c02f820 con 0x7f719c0b5af0 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c042480 con 0x7f719c0b5af0 2023-08-10T10:46:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.778+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c042850 con 0x7f719c0b5af0 2023-08-10T10:46:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.779+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0c6ea0 con 0x7f719c0b5af0 2023-08-10T10:46:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.779+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c160030 con 0x7f719c0b5af0 2023-08-10T10:46:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.780+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c04e270 con 0x7f719c0b5af0 2023-08-10T10:46:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.781+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f718c02d3e0 con 0x7f719c0b5af0 2023-08-10T10:46:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.781+0000 7f7192ffd640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 0x7f717c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.782+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f718c03c070 con 0x7f719c0b5af0 2023-08-10T10:46:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.782+0000 7f7199d9b640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 0x7f717c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.782+0000 7f7199d9b640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 0x7f717c06d110 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f719c1f5710 tx=0x7f71840079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.786+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f718c076ff0 con 0x7f719c0b5af0 2023-08-10T10:46:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:14.990+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f719c0b5020 con 0x7f719c0b5af0 2023-08-10T10:46:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.613+0000 7f7192ffd640 1 -- 172.21.15.50:0/171214784 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7f718c047080 con 0x7f719c0b5af0 2023-08-10T10:46:15.614 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:46:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 msgr2=0x7f717c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 0x7f717c06d110 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f719c1f5710 tx=0x7f71840079c0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 msgr2=0x7f719c1f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f718c02ba70 tx=0x7f718c004730 comp rx=0 tx=0).stop 2023-08-10T10:46:15.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 shutdown_connections 2023-08-10T10:46:15.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f717c06ac50 0x7f717c06d110 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c15ce00 0x7f719c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0cd730 0x7f719c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 --2- 172.21.15.50:0/171214784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719c0b5af0 0x7f719c1f1b90 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 >> 172.21.15.50:0/171214784 conn(0x7f719c0d2c60 msgr2=0x7f719c0b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 shutdown_connections 2023-08-10T10:46:15.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.617+0000 7f71a0da2640 1 -- 172.21.15.50:0/171214784 wait complete. 2023-08-10T10:46:15.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:46:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.870+0000 7f469e70f640 1 Processor -- start 2023-08-10T10:46:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.871+0000 7f469e70f640 1 -- start start 2023-08-10T10:46:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469e70f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4698161140 0x7f46980aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469e70f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46980c14e0 0x7f46980b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469e70f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46980b40b0 con 0x7f46980c9770 2023-08-10T10:46:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469e70f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46980cc100 con 0x7f46980c14e0 2023-08-10T10:46:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469e70f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46980cc3e0 con 0x7f4698161140 2023-08-10T10:46:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469df0e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46980c9770 0x7f46980cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49424/0 (socket says 172.21.15.50:49424) 2023-08-10T10:46:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469df0e640 1 -- 172.21.15.50:0/1711698387 learned_addr learned my addr 172.21.15.50:0/1711698387 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.872+0000 7f469cf0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46980c14e0 0x7f46980b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f469d70d640 1 --2- 172.21.15.50:0/1711698387 >> v2:172.21.15.117:3300/0 conn(0x7f4698161140 0x7f46980aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f4697fff640 1 -- 172.21.15.50:0/1711698387 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465914974 0 0) 0x7f46980b40b0 con 0x7f46980c9770 2023-08-10T10:46:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f469cf0c640 1 -- 172.21.15.50:0/1711698387 >> v2:172.21.15.117:3300/0 conn(0x7f4698161140 msgr2=0x7f46980aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f469cf0c640 1 --2- 172.21.15.50:0/1711698387 >> v2:172.21.15.117:3300/0 conn(0x7f4698161140 0x7f46980aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f469cf0c640 1 -- 172.21.15.50:0/1711698387 >> v1:172.21.15.50:6789/0 conn(0x7f46980c9770 legacy=0x7f46980cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.873+0000 7f469cf0c640 1 -- 172.21.15.50:0/1711698387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980cc6c0 con 0x7f46980c14e0 2023-08-10T10:46:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.874+0000 7f469cf0c640 1 --2- 172.21.15.50:0/1711698387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46980c14e0 0x7f46980b0450 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f469806bc30 tx=0x7f468c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee0c93a33f5eb65 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.874+0000 7f4697fff640 1 -- 172.21.15.50:0/1711698387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c030610 con 0x7f46980c14e0 2023-08-10T10:46:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.874+0000 7f4697fff640 1 -- 172.21.15.50:0/1711698387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c030770 con 0x7f46980c14e0 2023-08-10T10:46:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f4697fff640 1 -- 172.21.15.50:0/1711698387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c030b00 con 0x7f46980c14e0 2023-08-10T10:46:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 -- 172.21.15.50:0/1711698387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46980c14e0 msgr2=0x7f46980b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 --2- 172.21.15.50:0/1711698387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46980c14e0 0x7f46980b0450 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f469806bc30 tx=0x7f468c02b960 comp rx=0 tx=0).stop 2023-08-10T10:46:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 -- 172.21.15.50:0/1711698387 shutdown_connections 2023-08-10T10:46:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 --2- 172.21.15.50:0/1711698387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46980c14e0 0x7f46980b0450 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 --2- 172.21.15.50:0/1711698387 >> v2:172.21.15.117:3300/0 conn(0x7f4698161140 0x7f46980aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 -- 172.21.15.50:0/1711698387 >> 172.21.15.50:0/1711698387 conn(0x7f469806ab80 msgr2=0x7f469806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:15.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.875+0000 7f469e70f640 1 -- 172.21.15.50:0/1711698387 shutdown_connections 2023-08-10T10:46:15.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.876+0000 7f469e70f640 1 -- 172.21.15.50:0/1711698387 wait complete. 2023-08-10T10:46:15.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.877+0000 7f469e70f640 1 Processor -- start 2023-08-10T10:46:15.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.877+0000 7f469e70f640 1 -- start start 2023-08-10T10:46:15.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.878+0000 7f469e70f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46980c14e0 0x7f46980c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.878+0000 7f469e70f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46980c9770 0x7f46981f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469e70f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469e70f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46981f9eb0 con 0x7f4698161140 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469e70f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698159750 con 0x7f46980c9770 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469e70f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46980c2500 con 0x7f46980c14e0 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60046/0 (socket says 172.21.15.50:60046) 2023-08-10T10:46:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 -- 172.21.15.50:0/1404025787 learned_addr learned my addr 172.21.15.50:0/1404025787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:15.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469d70d640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46980c14e0 0x7f46980c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469cf0c640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46980c9770 0x7f46981f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 -- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46980c14e0 msgr2=0x7f46980c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46980c14e0 0x7f46980c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 -- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46980c9770 msgr2=0x7f46981f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46980c9770 0x7f46981f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.879+0000 7f469df0e640 1 -- 172.21.15.50:0/1404025787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009400 con 0x7f4698161140 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f469df0e640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f469000c480 tx=0x7f469000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:15.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900074e0 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690007660 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690004a20 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46981fa0e0 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.880+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46981fa6a0 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.881+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46981fa890 con 0x7f4698161140 2023-08-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.883+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4690004b80 con 0x7f4698161140 2023-08-10T10:46:15.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.884+0000 7f4695ffb640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 0x7f468406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:15.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.884+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4690088260 con 0x7f4698161140 2023-08-10T10:46:15.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.884+0000 7f469d70d640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 0x7f468406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:15.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.885+0000 7f469d70d640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 0x7f468406d140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f46880099c0 tx=0x7f4688003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:15.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:15.888+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f46900537b0 con 0x7f4698161140 2023-08-10T10:46:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.150+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4698066e30 con 0x7f4698161140 2023-08-10T10:46:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.151+0000 7f4695ffb640 1 -- 172.21.15.50:0/1404025787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4690056dd0 con 0x7f4698161140 2023-08-10T10:46:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:16.152 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:46:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:46:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:46:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:46:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:46:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:46:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:46:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:46:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:46:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:46:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:46:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:46:16.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:16.179 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:16.179 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 msgr2=0x7f468406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 0x7f468406d140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f46880099c0 tx=0x7f4688003990 comp rx=0 tx=0).stop 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 msgr2=0x7f46980c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f469000c480 tx=0x7f469000c940 comp rx=0 tx=0).stop 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 shutdown_connections 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698161140 0x7f46980c1fc0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f468406ac80 0x7f468406d140 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46980c9770 0x7f46981f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 --2- 172.21.15.50:0/1404025787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46980c14e0 0x7f46980c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 >> 172.21.15.50:0/1404025787 conn(0x7f469806ab80 msgr2=0x7f469815cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 shutdown_connections 2023-08-10T10:46:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.154+0000 7f469e70f640 1 -- 172.21.15.50:0/1404025787 wait complete. 2023-08-10T10:46:16.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.412+0000 7fa6f5d49640 1 Processor -- start 2023-08-10T10:46:16.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.412+0000 7fa6f5d49640 1 -- start start 2023-08-10T10:46:16.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f5d49640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6f015f510 0x7fa6f00ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f5d49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f015d010 con 0x7fa6f0153850 2023-08-10T10:46:16.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f5d49640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f015d290 con 0x7fa6f00b1da0 2023-08-10T10:46:16.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f5d49640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f015d570 con 0x7fa6f015f510 2023-08-10T10:46:16.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f4d47640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6f0153850 0x7fa6f00b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49434/0 (socket says 172.21.15.50:49434) 2023-08-10T10:46:16.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f4d47640 1 -- 172.21.15.50:0/252431062 learned_addr learned my addr 172.21.15.50:0/252431062 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.414+0000 7fa6f5548640 1 --2- 172.21.15.50:0/252431062 >> v2:172.21.15.117:3300/0 conn(0x7fa6f015f510 0x7fa6f00ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170994651 0 0) 0x7fa6f015d010 con 0x7fa6f0153850 2023-08-10T10:46:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8003520 con 0x7fa6f0153850 2023-08-10T10:46:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201921971 0 0) 0x7fa6d8003520 con 0x7fa6f0153850 2023-08-10T10:46:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 >> v2:172.21.15.117:3300/0 conn(0x7fa6f015f510 msgr2=0x7fa6f00ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 --2- 172.21.15.50:0/252431062 >> v2:172.21.15.117:3300/0 conn(0x7fa6f015f510 0x7fa6f00ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 >> v1:172.21.15.117:6789/0 conn(0x7fa6f00b1da0 legacy=0x7fa6f00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f015d850 con 0x7fa6f0153850 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa6ec001670 con 0x7fa6f0153850 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 >> v1:172.21.15.50:6789/0 conn(0x7fa6f0153850 legacy=0x7fa6f00b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 0x7fa6d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80047c0 0x7fa6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d8005180 0x7fa6d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f015d570 con 0x7fa6d80039e0 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800c0b0 con 0x7fa6d8005180 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800c270 con 0x7fa6d80047c0 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.415+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 0x7fa6d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f5548640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d8005180 0x7fa6d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6e7fff640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80047c0 0x7fa6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f4d47640 1 -- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80047c0 msgr2=0x7fa6d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80047c0 0x7fa6d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f4d47640 1 -- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d8005180 msgr2=0x7fa6d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d8005180 0x7fa6d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f4d47640 1 -- 172.21.15.50:0/252431062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8003520 con 0x7fa6d80039e0 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f5548640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d8005180 0x7fa6d800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6f5548640 1 -- 172.21.15.50:0/252431062 reap_dead start 2023-08-10T10:46:16.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.416+0000 7fa6e7fff640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80047c0 0x7fa6d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.417+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 0x7fa6d8003e00 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c190 tx=0x7fa6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddebd945d689a60 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.417+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec005ad0 con 0x7fa6d80039e0 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec005c30 con 0x7fa6d80039e0 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6e77fe640 1 -- 172.21.15.50:0/252431062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec02ca70 con 0x7fa6d80039e0 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 -- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 msgr2=0x7fa6d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 0x7fa6d8003e00 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c190 tx=0x7fa6d80057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 -- 172.21.15.50:0/252431062 shutdown_connections 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/252431062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d80039e0 0x7fa6d8003e00 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 -- 172.21.15.50:0/252431062 >> 172.21.15.50:0/252431062 conn(0x7fa6f0069880 msgr2=0x7fa6f0069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 -- 172.21.15.50:0/252431062 shutdown_connections 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.418+0000 7fa6f5d49640 1 -- 172.21.15.50:0/252431062 wait complete. 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.420+0000 7fa6f5d49640 1 Processor -- start 2023-08-10T10:46:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.420+0000 7fa6f5d49640 1 -- start start 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 0x7fa6f01f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 0x7fa6f00b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f00cba00 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01f3e70 con 0x7fa6f01f31f0 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.421+0000 7fa6f5d49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01f5b50 con 0x7fa6d80039e0 2023-08-10T10:46:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60050/0 (socket says 172.21.15.50:60050) 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 -- 172.21.15.50:0/336119421 learned_addr learned my addr 172.21.15.50:0/336119421 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 0x7fa6f01f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6f5548640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 0x7fa6f00b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 -- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 msgr2=0x7fa6f01f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 0x7fa6f01f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 -- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 msgr2=0x7fa6f00b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 0x7fa6f00b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 -- 172.21.15.50:0/336119421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00cbea0 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 0x7fa6f01f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6f5548640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 0x7fa6f00b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.422+0000 7fa6e7fff640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000d4a0 tx=0x7fa6e000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.423+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0005480 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.423+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0007030 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.423+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0007400 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.423+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00cae80 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.423+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f00cb440 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.424+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f0066e30 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.425+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6e0007560 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.426+0000 7fa6e57fa640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 0x7fa6dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.426+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa6e00885c0 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.426+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 0x7fa6dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.427+0000 7fa6f4d47640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 0x7fa6dc06d110 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034000 tx=0x7fa6ec009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.430+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa6e00539d0 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.628+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f00d07a0 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.629+0000 7fa6e57fa640 1 -- 172.21.15.50:0/336119421 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+14639 (secure 0 0 0) 0x7fa6e0056ff0 con 0x7fa6f00ca9c0 2023-08-10T10:46:16.630 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:16.631 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":139,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:15.624708+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 msgr2=0x7fa6dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 0x7fa6dc06d110 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034000 tx=0x7fa6ec009030 comp rx=0 tx=0).stop 2023-08-10T10:46:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 msgr2=0x7fa6f01f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000d4a0 tx=0x7fa6e000d960 comp rx=0 tx=0).stop 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 shutdown_connections 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa6dc06ac50 0x7fa6dc06d110 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f01f31f0 0x7fa6f00b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f00ca9c0 0x7fa6f01f5610 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 --2- 172.21.15.50:0/336119421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80039e0 0x7fa6f01f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 >> 172.21.15.50:0/336119421 conn(0x7fa6f0069880 msgr2=0x7fa6f006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 shutdown_connections 2023-08-10T10:46:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.632+0000 7fa6f5d49640 1 -- 172.21.15.50:0/336119421 wait complete. 2023-08-10T10:46:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:46:16.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:46:16.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.877+0000 7f872810c640 1 Processor -- start 2023-08-10T10:46:16.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.878+0000 7f872810c640 1 -- start start 2023-08-10T10:46:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.879+0000 7f872810c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 0x7f87200b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.879+0000 7f872810c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87201615e0 0x7f872006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f872810c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720160a40 con 0x7f872015cf70 2023-08-10T10:46:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f872810c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200b4bb0 con 0x7f87201615e0 2023-08-10T10:46:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f872810c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b4e90 con 0x7f872015cb90 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f87256a7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f872015cf70 0x7f8720160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49450/0 (socket says 172.21.15.50:49450) 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f87256a7640 1 -- 172.21.15.50:0/4113355575 learned_addr learned my addr 172.21.15.50:0/4113355575 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f8725ea8640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 0x7f87200b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.880+0000 7f87266a9640 1 --2- 172.21.15.50:0/4113355575 >> v2:172.21.15.117:3300/0 conn(0x7f87201615e0 0x7f872006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633454491 0 0) 0x7f8720160a40 con 0x7f872015cf70 2023-08-10T10:46:16.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c003520 con 0x7f872015cf70 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132625261 0 0) 0x7f870c003520 con 0x7f872015cf70 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 msgr2=0x7f87200b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 0x7f87200b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 >> v2:172.21.15.117:3300/0 conn(0x7f87201615e0 msgr2=0x7f872006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 --2- 172.21.15.50:0/4113355575 >> v2:172.21.15.117:3300/0 conn(0x7f87201615e0 0x7f872006fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200b5170 con 0x7f872015cf70 2023-08-10T10:46:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f8710001670 con 0x7f872015cf70 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f87266a9640 1 --2- 172.21.15.50:0/4113355575 >> v2:172.21.15.117:3300/0 conn(0x7f87201615e0 0x7f872006fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 >> v1:172.21.15.50:6789/0 conn(0x7f872015cf70 legacy=0x7f8720160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c003970 0x7f870c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 0x7f870c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870c004d00 0x7f870c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b4bb0 con 0x7f870c003970 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b4e90 con 0x7f870c004d00 2023-08-10T10:46:16.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c00b980 con 0x7f872015cb90 2023-08-10T10:46:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.881+0000 7f8725ea8640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c003970 0x7f870c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f87266a9640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870c004d00 0x7f870c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f8725ea8640 1 -- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 msgr2=0x7f870c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f8725ea8640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872015cb90 0x7f870c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f8725ea8640 1 -- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870c004d00 msgr2=0x7f870c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f8725ea8640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870c004d00 0x7f870c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.882+0000 7f8725ea8640 1 -- 172.21.15.50:0/4113355575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c003520 con 0x7f870c003970 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.883+0000 7f8725ea8640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c003970 0x7f870c003d90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ac0 tx=0x7f870c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932211b6f6ec265d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.883+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c02c710 con 0x7f870c003970 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.883+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c02c870 con 0x7f870c003970 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.883+0000 7f8724ea6640 1 -- 172.21.15.50:0/4113355575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c02cc00 con 0x7f870c003970 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 -- 172.21.15.50:0/4113355575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c003970 msgr2=0x7f870c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 --2- 172.21.15.50:0/4113355575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c003970 0x7f870c003d90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ac0 tx=0x7f870c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f87266a9640 1 -- 172.21.15.50:0/4113355575 reap_dead start 2023-08-10T10:46:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 -- 172.21.15.50:0/4113355575 shutdown_connections 2023-08-10T10:46:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 -- 172.21.15.50:0/4113355575 >> 172.21.15.50:0/4113355575 conn(0x7f87200cf640 msgr2=0x7f87200cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 -- 172.21.15.50:0/4113355575 shutdown_connections 2023-08-10T10:46:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.884+0000 7f872810c640 1 -- 172.21.15.50:0/4113355575 wait complete. 2023-08-10T10:46:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.886+0000 7f872810c640 1 Processor -- start 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.886+0000 7f872810c640 1 -- start start 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 0x7f87200c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 0x7f872015f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87201545c0 con 0x7f8720158640 2023-08-10T10:46:16.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872015e480 con 0x7f87201541e0 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f872810c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200cb610 con 0x7f87200cb190 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f87256a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f87256a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60074/0 (socket says 172.21.15.50:60074) 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.887+0000 7f87256a7640 1 -- 172.21.15.50:0/2087647572 learned_addr learned my addr 172.21.15.50:0/2087647572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f8725ea8640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 0x7f87200c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87266a9640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 0x7f872015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 -- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 msgr2=0x7f872015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 0x7f872015f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 -- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 msgr2=0x7f87200c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 0x7f87200c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 -- 172.21.15.50:0/2087647572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872015e6d0 con 0x7f8720158640 2023-08-10T10:46:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87266a9640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 0x7f872015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f8725ea8640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 0x7f87200c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87256a7640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f871000caa0 tx=0x7f871000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.888+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710004cb0 con 0x7f8720158640 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.889+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710004e10 con 0x7f8720158640 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.889+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710007310 con 0x7f8720158640 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.889+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872015e9b0 con 0x7f8720158640 2023-08-10T10:46:16.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.889+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872015ef70 con 0x7f8720158640 2023-08-10T10:46:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.890+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200612b0 con 0x7f8720158640 2023-08-10T10:46:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.891+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8710007470 con 0x7f8720158640 2023-08-10T10:46:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.892+0000 7f87167fc640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 0x7f870406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.892+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f87100885c0 con 0x7f8720158640 2023-08-10T10:46:16.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.892+0000 7f8725ea8640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 0x7f870406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:16.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.893+0000 7f8725ea8640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 0x7f870406d140 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f871c036000 tx=0x7f871c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:16.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:16.896+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f87100539b0 con 0x7f8720158640 2023-08-10T10:46:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.089+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87200d0a10 con 0x7f8720158640 2023-08-10T10:46:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.090+0000 7f87167fc640 1 -- 172.21.15.50:0/2087647572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8710018020 con 0x7f8720158640 2023-08-10T10:46:17.090 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 msgr2=0x7f870406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 0x7f870406d140 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f871c036000 tx=0x7f871c030000 comp rx=0 tx=0).stop 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 msgr2=0x7f87200cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f871000caa0 tx=0x7f871000cf60 comp rx=0 tx=0).stop 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 shutdown_connections 2023-08-10T10:46:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87200cb190 0x7f872015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8720158640 0x7f87200cac50 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f870406ac80 0x7f870406d140 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 --2- 172.21.15.50:0/2087647572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87201541e0 0x7f87200c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 >> 172.21.15.50:0/2087647572 conn(0x7f87200cf640 msgr2=0x7f87200b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 shutdown_connections 2023-08-10T10:46:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.092+0000 7f872810c640 1 -- 172.21.15.50:0/2087647572 wait complete. 2023-08-10T10:46:17.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:46:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.346+0000 7f063478b640 1 Processor -- start 2023-08-10T10:46:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.347+0000 7f063478b640 1 -- start start 2023-08-10T10:46:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.348+0000 7f063478b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f062c15cb90 0x7f062c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.348+0000 7f063478b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f062c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.348+0000 7f063478b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c160a40 con 0x7f062c0b4640 2023-08-10T10:46:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.348+0000 7f063478b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c0b4bb0 con 0x7f062c15cb90 2023-08-10T10:46:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.348+0000 7f063478b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b4e90 con 0x7f062c15cf70 2023-08-10T10:46:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0632d28640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f062c0b4640 0x7f062c06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49458/0 (socket says 172.21.15.50:49458) 2023-08-10T10:46:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0632d28640 1 -- 172.21.15.50:0/4023880088 learned_addr learned my addr 172.21.15.50:0/4023880088 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0632527640 1 --2- 172.21.15.50:0/4023880088 >> v2:172.21.15.117:3300/0 conn(0x7f062c15cb90 0x7f062c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631d26640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f062c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985126389 0 0) 0x7f062c160a40 con 0x7f062c0b4640 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0618003520 con 0x7f062c0b4640 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276716926 0 0) 0x7f0618003520 con 0x7f062c0b4640 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 msgr2=0x7f062c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f062c160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 >> v2:172.21.15.117:3300/0 conn(0x7f062c15cb90 msgr2=0x7f062c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 --2- 172.21.15.50:0/4023880088 >> v2:172.21.15.117:3300/0 conn(0x7f062c15cb90 0x7f062c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0b5170 con 0x7f062c0b4640 2023-08-10T10:46:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.349+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f06240019f0 con 0x7f062c0b4640 2023-08-10T10:46:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 >> v1:172.21.15.50:6789/0 conn(0x7f062c0b4640 legacy=0x7f062c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f0618003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0618003ef0 0x7f06180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f0618005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b4bb0 con 0x7f0618004d00 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b4e90 con 0x7f0618003ef0 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061800b980 con 0x7f062c15cf70 2023-08-10T10:46:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632d28640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f0618005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632527640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f0618003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0631d26640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0618003ef0 0x7f06180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632d28640 1 -- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 msgr2=0x7f0618003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632d28640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c15cf70 0x7f0618003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632d28640 1 -- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0618003ef0 msgr2=0x7f06180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.350+0000 7f0632d28640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0618003ef0 0x7f06180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.351+0000 7f0632d28640 1 -- 172.21.15.50:0/4023880088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618003520 con 0x7f0618004d00 2023-08-10T10:46:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.351+0000 7f0631d26640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0618003ef0 0x7f06180047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f0632d28640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f0618005180 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f062400a860 tx=0x7f06180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed09b292fb329cc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624034630 con 0x7f0618004d00 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062402f070 con 0x7f0618004d00 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f0631525640 1 -- 172.21.15.50:0/4023880088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624034a30 con 0x7f0618004d00 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f063478b640 1 -- 172.21.15.50:0/4023880088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 msgr2=0x7f0618005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f063478b640 1 --2- 172.21.15.50:0/4023880088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f0618005180 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f062400a860 tx=0x7f06180057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f0632d28640 1 -- 172.21.15.50:0/4023880088 reap_dead start 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f063478b640 1 -- 172.21.15.50:0/4023880088 shutdown_connections 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.352+0000 7f063478b640 1 -- 172.21.15.50:0/4023880088 >> 172.21.15.50:0/4023880088 conn(0x7f062c0cf640 msgr2=0x7f062c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.353+0000 7f063478b640 1 -- 172.21.15.50:0/4023880088 shutdown_connections 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.353+0000 7f063478b640 1 -- 172.21.15.50:0/4023880088 wait complete. 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.354+0000 7f063478b640 1 Processor -- start 2023-08-10T10:46:17.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.354+0000 7f063478b640 1 -- start start 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062c0c7db0 0x7f062c14ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c14a280 0x7f062c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c14bfd0 con 0x7f0618004d00 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1524a0 con 0x7f062c0c7db0 2023-08-10T10:46:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.355+0000 7f063478b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c14b350 con 0x7f062c14a280 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60080/0 (socket says 172.21.15.50:60080) 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 -- 172.21.15.50:0/1209666084 learned_addr learned my addr 172.21.15.50:0/1209666084 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 -- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c14a280 msgr2=0x7f062c14d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c14a280 0x7f062c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 -- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062c0c7db0 msgr2=0x7f062c14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062c0c7db0 0x7f062c14ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 -- 172.21.15.50:0/1209666084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c14b630 con 0x7f0618004d00 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.356+0000 7f0632527640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f06280116d0 tx=0x7f0628011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.357+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800f940 con 0x7f0618004d00 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.357+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800faa0 con 0x7f0618004d00 2023-08-10T10:46:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.357+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800fe10 con 0x7f0618004d00 2023-08-10T10:46:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.357+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c14b910 con 0x7f0618004d00 2023-08-10T10:46:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.357+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c14af20 con 0x7f0618004d00 2023-08-10T10:46:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.358+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c0612b0 con 0x7f0618004d00 2023-08-10T10:46:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.359+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0628015460 con 0x7f0618004d00 2023-08-10T10:46:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.361+0000 7f0622ffd640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 0x7f061006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.361+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06280896e0 con 0x7f0618004d00 2023-08-10T10:46:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.361+0000 7f0631d26640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 0x7f061006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.361+0000 7f0631d26640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 0x7f061006d140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f062c14db30 tx=0x7f061c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.365+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0628054af0 con 0x7f0618004d00 2023-08-10T10:46:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.553+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f062c0d0a10 con 0x7f0618004d00 2023-08-10T10:46:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.554+0000 7f0622ffd640 1 -- 172.21.15.50:0/1209666084 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0628058110 con 0x7f0618004d00 2023-08-10T10:46:17.555 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:46:17.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 msgr2=0x7f061006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 0x7f061006d140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f062c14db30 tx=0x7f061c008040 comp rx=0 tx=0).stop 2023-08-10T10:46:17.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 msgr2=0x7f062c14a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f06280116d0 tx=0x7f0628011b90 comp rx=0 tx=0).stop 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 shutdown_connections 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f062c14a280 0x7f062c14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f061006ac80 0x7f061006d140 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062c0c7db0 0x7f062c14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 --2- 172.21.15.50:0/1209666084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0618004d00 0x7f062c14a9e0 secure :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f06280116d0 tx=0x7f0628011b90 comp rx=0 tx=0).stop 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.557+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 >> 172.21.15.50:0/1209666084 conn(0x7f062c0cf640 msgr2=0x7f062c0cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.558+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 shutdown_connections 2023-08-10T10:46:17.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.558+0000 7f063478b640 1 -- 172.21.15.50:0/1209666084 wait complete. 2023-08-10T10:46:17.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:46:17.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.802+0000 7f1a033a4640 1 Processor -- start 2023-08-10T10:46:17.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.803+0000 7f1a033a4640 1 -- start start 2023-08-10T10:46:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.804+0000 7f1a033a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc159970 0x7f19fc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.804+0000 7f1a033a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19fc069db0 0x7f19fc0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.804+0000 7f1a033a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19fc15e1f0 con 0x7f19fc0b0f00 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.804+0000 7f1a033a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19fc15d5e0 con 0x7f19fc069db0 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.804+0000 7f1a033a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc15d8c0 con 0x7f19fc159970 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19fc069db0 0x7f19fc0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19fc069db0 0x7f19fc0b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60088/0 (socket says 172.21.15.50:60088) 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 -- 172.21.15.50:0/1619962614 learned_addr learned my addr 172.21.15.50:0/1619962614 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01140640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc159970 0x7f19fc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 -- 172.21.15.50:0/1619962614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc159970 msgr2=0x7f19fc0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc159970 0x7f19fc0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 -- 172.21.15.50:0/1619962614 >> v1:172.21.15.117:6789/0 conn(0x7f19fc0b0f00 legacy=0x7f19fc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.805+0000 7f1a01941640 1 -- 172.21.15.50:0/1619962614 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc15dba0 con 0x7f19fc069db0 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.806+0000 7f1a01941640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc069db0 0x7f19fc0b1ae0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d150 tx=0x7f19f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e272dbde753ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.807+0000 7f19f3fff640 1 -- 172.21.15.50:0/1619962614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f402ea80 con 0x7f19fc069db0 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.807+0000 7f19f3fff640 1 -- 172.21.15.50:0/1619962614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f402ebe0 con 0x7f19fc069db0 2023-08-10T10:46:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.807+0000 7f19f3fff640 1 -- 172.21.15.50:0/1619962614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4009600 con 0x7f19fc069db0 2023-08-10T10:46:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 -- 172.21.15.50:0/1619962614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc069db0 msgr2=0x7f19fc0b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc069db0 0x7f19fc0b1ae0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d150 tx=0x7f19f402e0e0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 -- 172.21.15.50:0/1619962614 shutdown_connections 2023-08-10T10:46:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc069db0 0x7f19fc0b1ae0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 --2- 172.21.15.50:0/1619962614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc159970 0x7f19fc0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 -- 172.21.15.50:0/1619962614 >> 172.21.15.50:0/1619962614 conn(0x7f19fc06b590 msgr2=0x7f19fc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 -- 172.21.15.50:0/1619962614 shutdown_connections 2023-08-10T10:46:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.808+0000 7f1a033a4640 1 -- 172.21.15.50:0/1619962614 wait complete. 2023-08-10T10:46:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.810+0000 7f1a033a4640 1 Processor -- start 2023-08-10T10:46:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.810+0000 7f1a033a4640 1 -- start start 2023-08-10T10:46:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc069db0 0x7f19fc0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 0x7f19fc0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c3500 con 0x7f19fc159970 2023-08-10T10:46:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c8600 con 0x7f19fc0b0f00 2023-08-10T10:46:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a033a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0c2880 con 0x7f19fc069db0 2023-08-10T10:46:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a01941640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a01941640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60090/0 (socket says 172.21.15.50:60090) 2023-08-10T10:46:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.812+0000 7f1a01941640 1 -- 172.21.15.50:0/3401012172 learned_addr learned my addr 172.21.15.50:0/3401012172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a0093f640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 0x7f19fc0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01140640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc069db0 0x7f19fc0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 -- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc069db0 msgr2=0x7f19fc0c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc069db0 0x7f19fc0c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 -- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 msgr2=0x7f19fc0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 0x7f19fc0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 -- 172.21.15.50:0/3401012172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f400bd40 con 0x7f19fc159970 2023-08-10T10:46:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a0093f640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 0x7f19fc0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f1a01941640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f19f4038040 tx=0x7f19f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.813+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f402ea80 con 0x7f19fc159970 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.814+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4036800 con 0x7f19fc159970 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.814+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4036bb0 con 0x7f19fc159970 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.814+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc0c2b60 con 0x7f19fc159970 2023-08-10T10:46:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.814+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc0c3120 con 0x7f19fc159970 2023-08-10T10:46:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.815+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc0c3640 con 0x7f19fc159970 2023-08-10T10:46:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.816+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f402ed50 con 0x7f19fc159970 2023-08-10T10:46:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.817+0000 7f19f1ffb640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 0x7f19e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.817+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f19f40ac280 con 0x7f19fc159970 2023-08-10T10:46:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.817+0000 7f1a01140640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 0x7f19e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.818+0000 7f1a01140640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 0x7f19e006d110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006fd0 tx=0x7f19f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:17.821+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f19fc0c3640 con 0x7f19fc159970 2023-08-10T10:46:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.015+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f19fc0c3640 con 0x7f19fc159970 2023-08-10T10:46:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.016+0000 7f19f1ffb640 1 -- 172.21.15.50:0/3401012172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+126 (secure 0 0 0) 0x7f19fc0c3640 con 0x7f19fc159970 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:18.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:18.018 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:46:18.018 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:46:18.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:18.018 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:46:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.018+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 msgr2=0x7f19e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.018+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 0x7f19e006d110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006fd0 tx=0x7f19f8008040 comp rx=0 tx=0).stop 2023-08-10T10:46:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.018+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 msgr2=0x7f19fc14cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.018+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f19f4038040 tx=0x7f19f4004a40 comp rx=0 tx=0).stop 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 shutdown_connections 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19fc159970 0x7f19fc14cbb0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f19e006ac50 0x7f19e006d110 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19fc0b0f00 0x7f19fc0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 --2- 172.21.15.50:0/3401012172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19fc069db0 0x7f19fc0c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 >> 172.21.15.50:0/3401012172 conn(0x7f19fc06b590 msgr2=0x7f19fc070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 shutdown_connections 2023-08-10T10:46:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.019+0000 7f1a033a4640 1 -- 172.21.15.50:0/3401012172 wait complete. 2023-08-10T10:46:18.039 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:46:18.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:46:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.273+0000 7fcaa5c08640 1 Processor -- start 2023-08-10T10:46:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.273+0000 7fcaa5c08640 1 -- start start 2023-08-10T10:46:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa5c08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fcaa00c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa5c08640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00acda0 con 0x7fcaa00cd260 2023-08-10T10:46:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa5c08640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00ad080 con 0x7fcaa00ac900 2023-08-10T10:46:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa5c08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00ade40 con 0x7fcaa0160700 2023-08-10T10:46:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa4c06640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcaa00cd260 0x7fcaa015c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49464/0 (socket says 172.21.15.50:49464) 2023-08-10T10:46:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa4c06640 1 -- 172.21.15.50:0/1299232349 learned_addr learned my addr 172.21.15.50:0/1299232349 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fcaa5407640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fcaa00c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833723531 0 0) 0x7fcaa00acda0 con 0x7fcaa00cd260 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.275+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca90003520 con 0x7fcaa00cd260 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956707649 0 0) 0x7fca90003520 con 0x7fcaa00cd260 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 msgr2=0x7fcaa00c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fcaa00c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 >> v1:172.21.15.117:6789/0 conn(0x7fcaa00ac900 legacy=0x7fcaa00c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00ad360 con 0x7fcaa00cd260 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fca94001670 con 0x7fcaa00cd260 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 >> v1:172.21.15.50:6789/0 conn(0x7fcaa00cd260 legacy=0x7fcaa015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fca90003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca90003f90 0x7fca900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90004d00 0x7fca90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00ade40 con 0x7fca90003f90 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000bae0 con 0x7fca90004d00 2023-08-10T10:46:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000bca0 con 0x7fcaa0160700 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.276+0000 7fca9ffff640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca90003f90 0x7fca900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fcaa4c06640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fca90003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fcaa5407640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90004d00 0x7fca90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fca9ffff640 1 -- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 msgr2=0x7fca90003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fca9ffff640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa0160700 0x7fca90003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fca9ffff640 1 -- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90004d00 msgr2=0x7fca90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fca9ffff640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90004d00 0x7fca90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fca9ffff640 1 -- 172.21.15.50:0/1299232349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90003520 con 0x7fca90003f90 2023-08-10T10:46:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.277+0000 7fcaa5407640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90004d00 0x7fca90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.278+0000 7fca9ffff640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca90003f90 0x7fca900047c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fca8c001750 tx=0x7fca900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb3c2b3a698c634 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.278+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0052d0 con 0x7fca90003f90 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.278+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c02e050 con 0x7fca90003f90 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.278+0000 7fca9f7fe640 1 -- 172.21.15.50:0/1299232349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c003830 con 0x7fca90003f90 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 -- 172.21.15.50:0/1299232349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca90003f90 msgr2=0x7fca900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/1299232349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca90003f90 0x7fca900047c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fca8c001750 tx=0x7fca900057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5407640 1 -- 172.21.15.50:0/1299232349 reap_dead start 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 -- 172.21.15.50:0/1299232349 shutdown_connections 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 -- 172.21.15.50:0/1299232349 >> 172.21.15.50:0/1299232349 conn(0x7fcaa00b0050 msgr2=0x7fcaa00b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 -- 172.21.15.50:0/1299232349 shutdown_connections 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.279+0000 7fcaa5c08640 1 -- 172.21.15.50:0/1299232349 wait complete. 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.281+0000 7fcaa5c08640 1 Processor -- start 2023-08-10T10:46:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.281+0000 7fcaa5c08640 1 -- start start 2023-08-10T10:46:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90003f90 0x7fcaa00c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa00b3b70 0x7fcaa0070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa01553b0 con 0x7fcaa01549f0 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00c7440 con 0x7fca90003f90 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.282+0000 7fcaa5c08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00c7720 con 0x7fcaa00b3b70 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60102/0 (socket says 172.21.15.50:60102) 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 -- 172.21.15.50:0/774589437 learned_addr learned my addr 172.21.15.50:0/774589437 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fca9ffff640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa00b3b70 0x7fcaa0070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 -- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa00b3b70 msgr2=0x7fcaa0070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa00b3b70 0x7fcaa0070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 -- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90003f90 msgr2=0x7fcaa00c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa4c06640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90003f90 0x7fcaa00c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90003f90 0x7fcaa00c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 -- 172.21.15.50:0/774589437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00c7a00 con 0x7fcaa01549f0 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.283+0000 7fcaa5407640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0160b10 tx=0x7fca9800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.284+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98017400 con 0x7fcaa01549f0 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.284+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98011040 con 0x7fcaa01549f0 2023-08-10T10:46:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.284+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa00c7ce0 con 0x7fcaa01549f0 2023-08-10T10:46:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.284+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980177c0 con 0x7fcaa01549f0 2023-08-10T10:46:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.284+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00b2460 con 0x7fcaa01549f0 2023-08-10T10:46:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.285+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa00c8200 con 0x7fcaa01549f0 2023-08-10T10:46:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.286+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca980203b0 con 0x7fcaa01549f0 2023-08-10T10:46:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.287+0000 7fca9d7fa640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 0x7fca8406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.287+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca98089530 con 0x7fcaa01549f0 2023-08-10T10:46:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.287+0000 7fcaa4c06640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 0x7fca8406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.288+0000 7fcaa4c06640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 0x7fca8406d140 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fca94001050 tx=0x7fca94001130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.291+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcaa00c8200 con 0x7fcaa01549f0 2023-08-10T10:46:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.482+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcaa00c8200 con 0x7fcaa01549f0 2023-08-10T10:46:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.629+0000 7fca9d7fa640 1 -- 172.21.15.50:0/774589437 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcaa00c8200 con 0x7fcaa01549f0 2023-08-10T10:46:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:46:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.634+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 msgr2=0x7fca8406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.634+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 0x7fca8406d140 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fca94001050 tx=0x7fca94001130 comp rx=0 tx=0).stop 2023-08-10T10:46:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.634+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 msgr2=0x7fcaa0154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.634+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0160b10 tx=0x7fca9800f4a0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 shutdown_connections 2023-08-10T10:46:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaa01549f0 0x7fcaa0154e70 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaa00b3b70 0x7fcaa0070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fca8406ac80 0x7fca8406d140 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 --2- 172.21.15.50:0/774589437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca90003f90 0x7fcaa00c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 >> 172.21.15.50:0/774589437 conn(0x7fcaa00b0050 msgr2=0x7fcaa00af030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.636+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 shutdown_connections 2023-08-10T10:46:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.637+0000 7fcaa5c08640 1 -- 172.21.15.50:0/774589437 wait complete. 2023-08-10T10:46:18.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:46:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.886+0000 7f264c094640 1 Processor -- start 2023-08-10T10:46:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.886+0000 7f264c094640 1 -- start start 2023-08-10T10:46:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264c094640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26440b5f00 0x7f26440b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264c094640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26440cf1e0 0x7f26440cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264c094640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26440d0bf0 con 0x7f264415cde0 2023-08-10T10:46:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264c094640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26440b68a0 con 0x7f26440cf1e0 2023-08-10T10:46:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264c094640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26440ce320 con 0x7f26440b5f00 2023-08-10T10:46:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264a631640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26440cf1e0 0x7f26440cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264a631640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26440cf1e0 0x7f26440cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60104/0 (socket says 172.21.15.50:60104) 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264a631640 1 -- 172.21.15.50:0/1453603809 learned_addr learned my addr 172.21.15.50:0/1453603809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.888+0000 7f264962f640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26440b5f00 0x7f26440b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.889+0000 7f264a631640 1 -- 172.21.15.50:0/1453603809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26440b5f00 msgr2=0x7f26440b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.889+0000 7f264a631640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26440b5f00 0x7f26440b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.889+0000 7f264a631640 1 -- 172.21.15.50:0/1453603809 >> v1:172.21.15.50:6789/0 conn(0x7f264415cde0 legacy=0x7f26440d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.889+0000 7f264a631640 1 -- 172.21.15.50:0/1453603809 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440d0e40 con 0x7f26440cf1e0 2023-08-10T10:46:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.890+0000 7f264a631640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440cf1e0 0x7f26440cf670 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcc2654b4a417fb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.890+0000 7f2648e2e640 1 -- 172.21.15.50:0/1453603809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c02cb00 con 0x7f26440cf1e0 2023-08-10T10:46:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.890+0000 7f2648e2e640 1 -- 172.21.15.50:0/1453603809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c02cc60 con 0x7f26440cf1e0 2023-08-10T10:46:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.890+0000 7f2648e2e640 1 -- 172.21.15.50:0/1453603809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0343f0 con 0x7f26440cf1e0 2023-08-10T10:46:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 -- 172.21.15.50:0/1453603809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440cf1e0 msgr2=0x7f26440cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440cf1e0 0x7f26440cf670 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c02bf60 comp rx=0 tx=0).stop 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 -- 172.21.15.50:0/1453603809 shutdown_connections 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440cf1e0 0x7f26440cf670 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 --2- 172.21.15.50:0/1453603809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26440b5f00 0x7f26440b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 -- 172.21.15.50:0/1453603809 >> 172.21.15.50:0/1453603809 conn(0x7f264406fcc0 msgr2=0x7f26440700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 -- 172.21.15.50:0/1453603809 shutdown_connections 2023-08-10T10:46:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.891+0000 7f264c094640 1 -- 172.21.15.50:0/1453603809 wait complete. 2023-08-10T10:46:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.893+0000 7f264c094640 1 Processor -- start 2023-08-10T10:46:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.893+0000 7f264c094640 1 -- start start 2023-08-10T10:46:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26440cf1e0 0x7f26440c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f264415cde0 0x7f264415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264414e060 con 0x7f26440b5f00 2023-08-10T10:46:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26440cc130 con 0x7f26440cf1e0 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f264c094640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264414daa0 con 0x7f264415cde0 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f2649e30640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f2649e30640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60114/0 (socket says 172.21.15.50:60114) 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.894+0000 7f2649e30640 1 -- 172.21.15.50:0/3322591021 learned_addr learned my addr 172.21.15.50:0/3322591021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f264a631640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f264415cde0 0x7f264415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f264962f640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26440cf1e0 0x7f26440c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 -- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f264415cde0 msgr2=0x7f264415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f264415cde0 0x7f264415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 -- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26440cf1e0 msgr2=0x7f26440c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26440cf1e0 0x7f26440c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 -- 172.21.15.50:0/3322591021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c009b30 con 0x7f26440b5f00 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.895+0000 7f2649e30640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f263400c450 tx=0x7f263400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.896+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340052d0 con 0x7f26440b5f00 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.896+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2634005430 con 0x7f26440b5f00 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.896+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634012870 con 0x7f26440b5f00 2023-08-10T10:46:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.896+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264414dd80 con 0x7f26440b5f00 2023-08-10T10:46:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.896+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26440cc6b0 con 0x7f26440b5f00 2023-08-10T10:46:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.897+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26440612b0 con 0x7f26440b5f00 2023-08-10T10:46:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.898+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26340129d0 con 0x7f26440b5f00 2023-08-10T10:46:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.899+0000 7f26427fc640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 0x7f263006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.899+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2634088ec0 con 0x7f26440b5f00 2023-08-10T10:46:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.899+0000 7f264962f640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 0x7f263006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.900+0000 7f264962f640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 0x7f263006d110 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2638006fd0 tx=0x7f2638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:18.904+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f26340540b0 con 0x7f26440b5f00 2023-08-10T10:46:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.095+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f26440d09d0 con 0x7f26440b5f00 2023-08-10T10:46:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.648+0000 7f26427fc640 1 -- 172.21.15.50:0/3322591021 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) v1 ==== 170+0+0 (secure 0 0 0) 0x7f26340576d0 con 0x7f26440b5f00 2023-08-10T10:46:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:46:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.658+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 msgr2=0x7f263006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.658+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 0x7f263006d110 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2638006fd0 tx=0x7f2638008040 comp rx=0 tx=0).stop 2023-08-10T10:46:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.658+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 msgr2=0x7f26440c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.658+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f263400c450 tx=0x7f263400c910 comp rx=0 tx=0).stop 2023-08-10T10:46:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 shutdown_connections 2023-08-10T10:46:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f264415cde0 0x7f264415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f263006ac50 0x7f263006d110 secure :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2638006fd0 tx=0x7f2638008040 comp rx=0 tx=0).stop 2023-08-10T10:46:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26440cf1e0 0x7f26440c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 --2- 172.21.15.50:0/3322591021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26440b5f00 0x7f26440c8380 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.659+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 >> 172.21.15.50:0/3322591021 conn(0x7f264406fcc0 msgr2=0x7f2644152cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:19.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.663+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 shutdown_connections 2023-08-10T10:46:19.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.663+0000 7f264c094640 1 -- 172.21.15.50:0/3322591021 wait complete. 2023-08-10T10:46:19.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:46:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.885+0000 7f6630da2640 1 Processor -- start 2023-08-10T10:46:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.885+0000 7f6630da2640 1 -- start start 2023-08-10T10:46:19.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.886+0000 7f6630da2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f662c15cf70 0x7f662c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.886+0000 7f6630da2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c0b4640 0x7f662c161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.886+0000 7f6630da2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c160a40 con 0x7f662c15cb90 2023-08-10T10:46:19.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.886+0000 7f6630da2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0b4bb0 con 0x7f662c15cf70 2023-08-10T10:46:19.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.886+0000 7f6630da2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0b4e90 con 0x7f662c0b4640 2023-08-10T10:46:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.887+0000 7f6621d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f662c15cf70 0x7f662c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.887+0000 7f6621d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f662c15cf70 0x7f662c160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:47436/0 (socket says 172.21.15.50:47436) 2023-08-10T10:46:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.887+0000 7f6621d9b640 1 -- 172.21.15.50:0/4219273566 learned_addr learned my addr 172.21.15.50:0/4219273566 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.887+0000 7f662ad9d640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c0b4640 0x7f662c161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.888+0000 7f6621d9b640 1 -- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c0b4640 msgr2=0x7f662c161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.888+0000 7f6621d9b640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c0b4640 0x7f662c161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.888+0000 7f6621d9b640 1 -- 172.21.15.50:0/4219273566 >> v1:172.21.15.117:6789/0 conn(0x7f662c15cb90 legacy=0x7f662c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.888+0000 7f6621d9b640 1 -- 172.21.15.50:0/4219273566 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0b5170 con 0x7f662c15cf70 2023-08-10T10:46:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.889+0000 7f6621d9b640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c160ed0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6614009870 tx=0x7f661402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a4b0d0921a204 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.890+0000 7f6629d9b640 1 -- 172.21.15.50:0/4219273566 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614030840 con 0x7f662c15cf70 2023-08-10T10:46:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.890+0000 7f6629d9b640 1 -- 172.21.15.50:0/4219273566 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140309a0 con 0x7f662c15cf70 2023-08-10T10:46:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.890+0000 7f6629d9b640 1 -- 172.21.15.50:0/4219273566 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614030d30 con 0x7f662c15cf70 2023-08-10T10:46:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.890+0000 7f6630da2640 1 -- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 msgr2=0x7f662c160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.890+0000 7f6630da2640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c160ed0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6614009870 tx=0x7f661402b980 comp rx=0 tx=0).stop 2023-08-10T10:46:19.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 -- 172.21.15.50:0/4219273566 shutdown_connections 2023-08-10T10:46:19.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c0b4640 0x7f662c161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 --2- 172.21.15.50:0/4219273566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c160ed0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 -- 172.21.15.50:0/4219273566 >> 172.21.15.50:0/4219273566 conn(0x7f662c0cf640 msgr2=0x7f662c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:19.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 -- 172.21.15.50:0/4219273566 shutdown_connections 2023-08-10T10:46:19.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.891+0000 7f6630da2640 1 -- 172.21.15.50:0/4219273566 wait complete. 2023-08-10T10:46:19.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.893+0000 7f6630da2640 1 Processor -- start 2023-08-10T10:46:19.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.893+0000 7f6630da2640 1 -- start start 2023-08-10T10:46:19.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c15cb90 0x7f662c0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1f6e20 con 0x7f662c0b4640 2023-08-10T10:46:19.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c15a830 con 0x7f662c15cf70 2023-08-10T10:46:19.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f6630da2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c15aad0 con 0x7f662c15cb90 2023-08-10T10:46:19.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f662a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f662a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60122/0 (socket says 172.21.15.50:60122) 2023-08-10T10:46:19.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.894+0000 7f662a59c640 1 -- 172.21.15.50:0/2002178383 learned_addr learned my addr 172.21.15.50:0/2002178383 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:19.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f6621d9b640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c15cb90 0x7f662c0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662ad9d640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 -- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c15cb90 msgr2=0x7f662c0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c15cb90 0x7f662c0c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 -- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 msgr2=0x7f662c15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:19.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:19.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 -- 172.21.15.50:0/2002178383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66140094d0 con 0x7f662c0b4640 2023-08-10T10:46:19.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f662a59c640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c870 tx=0x7f661c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:19.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c003b70 con 0x7f662c0b4640 2023-08-10T10:46:19.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c003cf0 con 0x7f662c0b4640 2023-08-10T10:46:19.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00aa90 con 0x7f662c0b4640 2023-08-10T10:46:19.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.895+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c15adb0 con 0x7f662c0b4640 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.896+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c15b370 con 0x7f662c0b4640 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.897+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c0612b0 con 0x7f662c0b4640 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.898+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f661c00abf0 con 0x7f662c0b4640 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.899+0000 7f66237fe640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 0x7f660c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.899+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f661c089d90 con 0x7f662c0b4640 2023-08-10T10:46:19.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.900+0000 7f6621d9b640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 0x7f660c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:19.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.900+0000 7f6621d9b640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 0x7f660c06d110 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6614036000 tx=0x7f661403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:19.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:19.903+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f661c054f10 con 0x7f662c0b4640 2023-08-10T10:46:20.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.141+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f662c161730 con 0x7f662c0b4640 2023-08-10T10:46:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.708+0000 7f66237fe640 1 -- 172.21.15.50:0/2002178383 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7f661c003e60 con 0x7f662c0b4640 2023-08-10T10:46:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 17 and data pool 18 2023-08-10T10:46:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.719+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 msgr2=0x7f660c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.719+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 0x7f660c06d110 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6614036000 tx=0x7f661403b040 comp rx=0 tx=0).stop 2023-08-10T10:46:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 msgr2=0x7f662c1f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c870 tx=0x7f661c00cd30 comp rx=0 tx=0).stop 2023-08-10T10:46:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 shutdown_connections 2023-08-10T10:46:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f660c06ac50 0x7f660c06d110 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f662c15cf70 0x7f662c15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f662c15cb90 0x7f662c0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 --2- 172.21.15.50:0/2002178383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c0b4640 0x7f662c1f68e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.720+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 >> 172.21.15.50:0/2002178383 conn(0x7f662c0cf640 msgr2=0x7f662c06fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.721+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 shutdown_connections 2023-08-10T10:46:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.721+0000 7f6630da2640 1 -- 172.21.15.50:0/2002178383 wait complete. 2023-08-10T10:46:20.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.936+0000 7efdd6b24640 1 Processor -- start 2023-08-10T10:46:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.936+0000 7efdd6b24640 1 -- start start 2023-08-10T10:46:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd6b24640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efdd015ccb0 0x7efdd00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd6b24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdd00b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd6b24640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd00719f0 con 0x7efdd00c9b30 2023-08-10T10:46:20.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd6b24640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd00c8db0 con 0x7efdd015ccb0 2023-08-10T10:46:20.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd6b24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c9050 con 0x7efdd0069db0 2023-08-10T10:46:20.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdcffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efdd00c9b30 0x7efdd00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49478/0 (socket says 172.21.15.50:49478) 2023-08-10T10:46:20.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdcffff640 1 -- 172.21.15.50:0/432031095 learned_addr learned my addr 172.21.15.50:0/432031095 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.938+0000 7efdd50c1640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdd00b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdd48c0640 1 --2- 172.21.15.50:0/432031095 >> v2:172.21.15.117:3300/0 conn(0x7efdd015ccb0 0x7efdd00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947419033 0 0) 0x7efdd00719f0 con 0x7efdd00c9b30 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc0003520 con 0x7efdd00c9b30 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546676585 0 0) 0x7efdc0003520 con 0x7efdd00c9b30 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 msgr2=0x7efdd00b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdd00b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 >> v2:172.21.15.117:3300/0 conn(0x7efdd015ccb0 msgr2=0x7efdd00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 --2- 172.21.15.50:0/432031095 >> v2:172.21.15.117:3300/0 conn(0x7efdd015ccb0 0x7efdd00b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00c9330 con 0x7efdd00c9b30 2023-08-10T10:46:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7efdbc001690 con 0x7efdd00c9b30 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 >> v1:172.21.15.50:6789/0 conn(0x7efdd00c9b30 legacy=0x7efdd00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdc0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0003ef0 0x7efdc00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdc0004d00 0x7efdc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c8db0 con 0x7efdc0004d00 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c9050 con 0x7efdc0003ef0 2023-08-10T10:46:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.939+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc000b980 con 0x7efdd0069db0 2023-08-10T10:46:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdc0004d00 0x7efdc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdcffff640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0003ef0 0x7efdc00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd48c0640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdc0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 -- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 msgr2=0x7efdc0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0069db0 0x7efdc0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 -- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0003ef0 msgr2=0x7efdc00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0003ef0 0x7efdc00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.940+0000 7efdd50c1640 1 -- 172.21.15.50:0/432031095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0003520 con 0x7efdc0004d00 2023-08-10T10:46:20.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.941+0000 7efdd50c1640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdc0004d00 0x7efdc0005180 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7efdd00c5740 tx=0x7efdc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd213008a7305363 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.941+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc802cb90 con 0x7efdc0004d00 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.941+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800f040 con 0x7efdc0004d00 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdcf7fe640 1 -- 172.21.15.50:0/432031095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8034440 con 0x7efdc0004d00 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 -- 172.21.15.50:0/432031095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdc0004d00 msgr2=0x7efdc0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 --2- 172.21.15.50:0/432031095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdc0004d00 0x7efdc0005180 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7efdd00c5740 tx=0x7efdc00057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd50c1640 1 -- 172.21.15.50:0/432031095 reap_dead start 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 -- 172.21.15.50:0/432031095 shutdown_connections 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 -- 172.21.15.50:0/432031095 >> 172.21.15.50:0/432031095 conn(0x7efdd006b590 msgr2=0x7efdd00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 -- 172.21.15.50:0/432031095 shutdown_connections 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.942+0000 7efdd6b24640 1 -- 172.21.15.50:0/432031095 wait complete. 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.944+0000 7efdd6b24640 1 Processor -- start 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.944+0000 7efdd6b24640 1 -- start start 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 0x7efdd015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0159ca0 0x7efdd015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd015a660 con 0x7efdd00c7b50 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c7fd0 con 0x7efdc0004d00 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.945+0000 7efdd6b24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd015d790 con 0x7efdd0159ca0 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60154/0 (socket says 172.21.15.50:60154) 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 -- 172.21.15.50:0/4107875988 learned_addr learned my addr 172.21.15.50:0/4107875988 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdd48c0640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 0x7efdd015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdd50c1640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0159ca0 0x7efdd015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 -- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0159ca0 msgr2=0x7efdd015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0159ca0 0x7efdd015a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 -- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 msgr2=0x7efdd015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 0x7efdd015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdcffff640 1 -- 172.21.15.50:0/4107875988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd015da70 con 0x7efdd00c7b50 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.946+0000 7efdd48c0640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 0x7efdd015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdcffff640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00e7f0 tx=0x7efdbc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00c870 con 0x7efdd00c7b50 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc00c9d0 con 0x7efdd00c7b50 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00cd80 con 0x7efdd00c7b50 2023-08-10T10:46:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd015dd50 con 0x7efdd00c7b50 2023-08-10T10:46:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.947+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd015e310 con 0x7efdd00c7b50 2023-08-10T10:46:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.948+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd004e270 con 0x7efdd00c7b50 2023-08-10T10:46:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.949+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdbc01d460 con 0x7efdd00c7b50 2023-08-10T10:46:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.950+0000 7efdcd7fa640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 0x7efdb406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.950+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdbc089490 con 0x7efdd00c7b50 2023-08-10T10:46:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.950+0000 7efdd48c0640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 0x7efdb406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.951+0000 7efdd48c0640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 0x7efdb406d140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009a80 tx=0x7efdc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:20.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:20.955+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efdbc054530 con 0x7efdd00c7b50 2023-08-10T10:46:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.149+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdd006f1a0 con 0x7efdd00c7b50 2023-08-10T10:46:21.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.151+0000 7efdcd7fa640 1 -- 172.21.15.50:0/4107875988 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18364 (secure 0 0 0) 0x7efdbc057b50 con 0x7efdd00c7b50 2023-08-10T10:46:21.152 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:21.152 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":142,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:20.142465+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 msgr2=0x7efdb406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 0x7efdb406d140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009a80 tx=0x7efdc4008040 comp rx=0 tx=0).stop 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 msgr2=0x7efdd015f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00e7f0 tx=0x7efdbc00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 shutdown_connections 2023-08-10T10:46:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd0159ca0 0x7efdd015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd00c7b50 0x7efdd015f020 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efdb406ac80 0x7efdb406d140 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 --2- 172.21.15.50:0/4107875988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdc0004d00 0x7efdd015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 >> 172.21.15.50:0/4107875988 conn(0x7efdd006b590 msgr2=0x7efdd00cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 shutdown_connections 2023-08-10T10:46:21.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.154+0000 7efdd6b24640 1 -- 172.21.15.50:0/4107875988 wait complete. 2023-08-10T10:46:21.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:21.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.394+0000 7f2584ab0640 1 Processor -- start 2023-08-10T10:46:21.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.394+0000 7f2584ab0640 1 -- start start 2023-08-10T10:46:21.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.396+0000 7f2584ab0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 0x7f25800b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.396+0000 7f2584ab0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800b1f10 con 0x7f258015f2b0 2023-08-10T10:46:21.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.396+0000 7f2584ab0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258015e7d0 con 0x7f258015a940 2023-08-10T10:46:21.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.396+0000 7f2584ab0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b21f0 con 0x7f25800b0620 2023-08-10T10:46:21.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.397+0000 7f257ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f258015f2b0 0x7f25800ca740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49492/0 (socket says 172.21.15.50:49492) 2023-08-10T10:46:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.397+0000 7f257ffff640 1 -- 172.21.15.50:0/1942587846 learned_addr learned my addr 172.21.15.50:0/1942587846 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.397+0000 7f2577fff640 1 --2- 172.21.15.50:0/1942587846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 0x7f25800b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.397+0000 7f257effd640 1 -- 172.21.15.50:0/1942587846 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368331462 0 0) 0x7f25800b1f10 con 0x7f258015f2b0 2023-08-10T10:46:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.397+0000 7f257effd640 1 -- 172.21.15.50:0/1942587846 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c003520 con 0x7f258015f2b0 2023-08-10T10:46:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.398+0000 7f2577fff640 1 -- 172.21.15.50:0/1942587846 >> v1:172.21.15.117:6789/0 conn(0x7f258015a940 legacy=0x7f25800aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.398+0000 7f2577fff640 1 -- 172.21.15.50:0/1942587846 >> v1:172.21.15.50:6789/0 conn(0x7f258015f2b0 legacy=0x7f25800ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.398+0000 7f2577fff640 1 -- 172.21.15.50:0/1942587846 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258015eab0 con 0x7f25800b0620 2023-08-10T10:46:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.399+0000 7f2577fff640 1 --2- 172.21.15.50:0/1942587846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 0x7f25800b12c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25680097d0 tx=0x7f256802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e3a5fbd1be01320 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f257effd640 1 -- 172.21.15.50:0/1942587846 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256802d040 con 0x7f25800b0620 2023-08-10T10:46:21.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f257effd640 1 -- 172.21.15.50:0/1942587846 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2568031810 con 0x7f25800b0620 2023-08-10T10:46:21.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f257effd640 1 -- 172.21.15.50:0/1942587846 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568031ba0 con 0x7f25800b0620 2023-08-10T10:46:21.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 -- 172.21.15.50:0/1942587846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 msgr2=0x7f25800b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 --2- 172.21.15.50:0/1942587846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 0x7f25800b12c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25680097d0 tx=0x7f256802b8b0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 -- 172.21.15.50:0/1942587846 shutdown_connections 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 --2- 172.21.15.50:0/1942587846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25800b0620 0x7f25800b12c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 -- 172.21.15.50:0/1942587846 >> 172.21.15.50:0/1942587846 conn(0x7f258006ab80 msgr2=0x7f258006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.400+0000 7f2584ab0640 1 -- 172.21.15.50:0/1942587846 shutdown_connections 2023-08-10T10:46:21.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.401+0000 7f2584ab0640 1 -- 172.21.15.50:0/1942587846 wait complete. 2023-08-10T10:46:21.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.403+0000 7f2584ab0640 1 Processor -- start 2023-08-10T10:46:21.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.403+0000 7f2584ab0640 1 -- start start 2023-08-10T10:46:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f258015a940 0x7f25800ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 0x7f25800ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580070640 con 0x7f25800b0620 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580070920 con 0x7f258015f2b0 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.404+0000 7f2584ab0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2580070c00 con 0x7f258015a940 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60166/0 (socket says 172.21.15.50:60166) 2023-08-10T10:46:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 -- 172.21.15.50:0/2055844175 learned_addr learned my addr 172.21.15.50:0/2055844175 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f2577fff640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f258015a940 0x7f25800ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 -- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f258015a940 msgr2=0x7f25800ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f258015a940 0x7f25800ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 -- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 msgr2=0x7f25800ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257ffff640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 0x7f25800ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 0x7f25800ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257f7fe640 1 -- 172.21.15.50:0/2055844175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009400 con 0x7f25800b0620 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.405+0000 7f257ffff640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 0x7f25800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f257f7fe640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f257000c400 tx=0x7f257000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700052d0 con 0x7f25800b0620 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570005450 con 0x7f25800b0620 2023-08-10T10:46:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570007260 con 0x7f25800b0620 2023-08-10T10:46:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580070ee0 con 0x7f25800b0620 2023-08-10T10:46:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.406+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258014bfe0 con 0x7f25800b0620 2023-08-10T10:46:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.407+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800713a0 con 0x7f25800b0620 2023-08-10T10:46:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.409+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25700073c0 con 0x7f25800b0620 2023-08-10T10:46:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.410+0000 7f257cff9640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 0x7f256006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.410+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2570088910 con 0x7f25800b0620 2023-08-10T10:46:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.410+0000 7f2577fff640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 0x7f256006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.411+0000 7f2577fff640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 0x7f256006d110 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2568036000 tx=0x7f256803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.416+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f25700539b0 con 0x7f25800b0620 2023-08-10T10:46:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.613+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2580066e30 con 0x7f25800b0620 2023-08-10T10:46:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.615+0000 7f257cff9640 1 -- 172.21.15.50:0/2055844175 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f2570056fd0 con 0x7f25800b0620 2023-08-10T10:46:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:21.617 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":142,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:20.142465+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 msgr2=0x7f256006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 0x7f256006d110 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2568036000 tx=0x7f256803c040 comp rx=0 tx=0).stop 2023-08-10T10:46:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 msgr2=0x7f258014baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f257000c400 tx=0x7f257000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 shutdown_connections 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f256006ac50 0x7f256006d110 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258015f2b0 0x7f25800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f258015a940 0x7f25800ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 --2- 172.21.15.50:0/2055844175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25800b0620 0x7f258014baa0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.619+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 >> 172.21.15.50:0/2055844175 conn(0x7f258006ab80 msgr2=0x7f25800cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.620+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 shutdown_connections 2023-08-10T10:46:21.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.620+0000 7f2584ab0640 1 -- 172.21.15.50:0/2055844175 wait complete. 2023-08-10T10:46:21.622 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:46:21.620+0000 7f4d290a3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:46:21.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:46:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.864+0000 7f2e2f59e640 1 Processor -- start 2023-08-10T10:46:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.864+0000 7f2e2f59e640 1 -- start start 2023-08-10T10:46:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.865+0000 7f2e2f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 0x7f2e300cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.865+0000 7f2e2f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e300b2190 0x7f2e300b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.865+0000 7f2e2f59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3006c380 con 0x7f2e3015a800 2023-08-10T10:46:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.865+0000 7f2e2f59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e30071d20 con 0x7f2e300b2190 2023-08-10T10:46:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.865+0000 7f2e2f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300b2ae0 con 0x7f2e3015abe0 2023-08-10T10:46:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e300b2190 0x7f2e300b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e300b2190 0x7f2e300b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60176/0 (socket says 172.21.15.50:60176) 2023-08-10T10:46:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 -- 172.21.15.50:0/3810953288 learned_addr learned my addr 172.21.15.50:0/3810953288 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2dd9b640 1 --2- 172.21.15.50:0/3810953288 >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 0x7f2e300cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 -- 172.21.15.50:0/3810953288 >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 msgr2=0x7f2e300cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 --2- 172.21.15.50:0/3810953288 >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 0x7f2e300cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 -- 172.21.15.50:0/3810953288 >> v1:172.21.15.50:6789/0 conn(0x7f2e3015a800 legacy=0x7f2e30071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2ed9d640 1 -- 172.21.15.50:0/3810953288 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300b3560 con 0x7f2e300b2190 2023-08-10T10:46:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.866+0000 7f2e2dd9b640 1 --2- 172.21.15.50:0/3810953288 >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 0x7f2e300cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:21.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.867+0000 7f2e2ed9d640 1 --2- 172.21.15.50:0/3810953288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e300b25a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2e30071e80 tx=0x7f2e2802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd145f3694a080a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2d59a640 1 -- 172.21.15.50:0/3810953288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2802cba0 con 0x7f2e300b2190 2023-08-10T10:46:21.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2d59a640 1 -- 172.21.15.50:0/3810953288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2802cd00 con 0x7f2e300b2190 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2d59a640 1 -- 172.21.15.50:0/3810953288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28034610 con 0x7f2e300b2190 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 -- 172.21.15.50:0/3810953288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 msgr2=0x7f2e300b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/3810953288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e300b25a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2e30071e80 tx=0x7f2e2802c000 comp rx=0 tx=0).stop 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 -- 172.21.15.50:0/3810953288 shutdown_connections 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/3810953288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e300b25a0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/3810953288 >> v2:172.21.15.117:3300/0 conn(0x7f2e3015abe0 0x7f2e300cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.868+0000 7f2e2f59e640 1 -- 172.21.15.50:0/3810953288 >> 172.21.15.50:0/3810953288 conn(0x7f2e300cd190 msgr2=0x7f2e300cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.869+0000 7f2e2f59e640 1 -- 172.21.15.50:0/3810953288 shutdown_connections 2023-08-10T10:46:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.869+0000 7f2e2f59e640 1 -- 172.21.15.50:0/3810953288 wait complete. 2023-08-10T10:46:21.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.870+0000 7f2e2f59e640 1 Processor -- start 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.871+0000 7f2e2f59e640 1 -- start start 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e3015a800 0x7f2e3015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e3015abe0 0x7f2e3015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30150a40 con 0x7f2e300b2190 2023-08-10T10:46:21.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30150450 con 0x7f2e3015a800 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301f0ef0 con 0x7f2e3015abe0 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60180/0 (socket says 172.21.15.50:60180) 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 -- 172.21.15.50:0/1536269918 learned_addr learned my addr 172.21.15.50:0/1536269918 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2dd9b640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e3015a800 0x7f2e3015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2ed9d640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e3015abe0 0x7f2e3015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 -- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e3015abe0 msgr2=0x7f2e3015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e3015abe0 0x7f2e3015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 -- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e3015a800 msgr2=0x7f2e3015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e3015a800 0x7f2e3015c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.872+0000 7f2e2e59c640 1 -- 172.21.15.50:0/1536269918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009b30 con 0x7f2e300b2190 2023-08-10T10:46:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e2e59c640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c450 tx=0x7f2e2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200052d0 con 0x7f2e300b2190 2023-08-10T10:46:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20005430 con 0x7f2e300b2190 2023-08-10T10:46:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20012870 con 0x7f2e300b2190 2023-08-10T10:46:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30156c10 con 0x7f2e300b2190 2023-08-10T10:46:21.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.873+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301f05c0 con 0x7f2e300b2190 2023-08-10T10:46:21.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.874+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3006bff0 con 0x7f2e300b2190 2023-08-10T10:46:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.875+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e200129d0 con 0x7f2e300b2190 2023-08-10T10:46:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.876+0000 7f2e1effd640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 0x7f2e1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:21.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.876+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e20089180 con 0x7f2e300b2190 2023-08-10T10:46:21.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.877+0000 7f2e2dd9b640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 0x7f2e1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:21.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.877+0000 7f2e2dd9b640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 0x7f2e1006d110 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e300cf5d0 tx=0x7f2e24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:21.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:21.881+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e3006bff0 con 0x7f2e300b2190 2023-08-10T10:46:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.109+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e3006bff0 con 0x7f2e300b2190 2023-08-10T10:46:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.698+0000 7f2e1effd640 1 -- 172.21.15.50:0/1536269918 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e3006bff0 con 0x7f2e300b2190 2023-08-10T10:46:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 msgr2=0x7f2e1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 0x7f2e1006d110 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e300cf5d0 tx=0x7f2e24008040 comp rx=0 tx=0).stop 2023-08-10T10:46:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 msgr2=0x7f2e301efcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c450 tx=0x7f2e2000c910 comp rx=0 tx=0).stop 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 shutdown_connections 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e3015abe0 0x7f2e3015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2e1006ac50 0x7f2e1006d110 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e3015a800 0x7f2e3015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 --2- 172.21.15.50:0/1536269918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e300b2190 0x7f2e301efcb0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 >> 172.21.15.50:0/1536269918 conn(0x7f2e300cd190 msgr2=0x7f2e30159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 shutdown_connections 2023-08-10T10:46:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.703+0000 7f2e2f59e640 1 -- 172.21.15.50:0/1536269918 wait complete. 2023-08-10T10:46:22.726 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:46:22.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:46:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.964+0000 7fab20867640 1 Processor -- start 2023-08-10T10:46:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.964+0000 7fab20867640 1 -- start start 2023-08-10T10:46:22.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.966+0000 7fab20867640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab1c161260 0x7fab1c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.966+0000 7fab20867640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c06f3a0 0x7fab1c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.966+0000 7fab20867640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c161640 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.966+0000 7fab20867640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0c1bb0 con 0x7fab1c161260 2023-08-10T10:46:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.966+0000 7fab20867640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0adb30 con 0x7fab1c06f3a0 2023-08-10T10:46:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab1c161260 0x7fab1c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab1c161260 0x7fab1c0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60196/0 (socket says 172.21.15.50:60196) 2023-08-10T10:46:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 -- 172.21.15.50:0/3448134264 learned_addr learned my addr 172.21.15.50:0/3448134264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1ad9d640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c06f3a0 0x7fab1c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 -- 172.21.15.50:0/3448134264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c06f3a0 msgr2=0x7fab1c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c06f3a0 0x7fab1c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 -- 172.21.15.50:0/3448134264 >> v1:172.21.15.117:6789/0 conn(0x7fab1c0b0cd0 legacy=0x7fab1c06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.967+0000 7fab1a59c640 1 -- 172.21.15.50:0/3448134264 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0ade10 con 0x7fab1c161260 2023-08-10T10:46:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.968+0000 7fab1a59c640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c161260 0x7fab1c0ca520 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06e6f0 tx=0x7fab0c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3110608d904cc69 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab1959a640 1 -- 172.21.15.50:0/3448134264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0317c0 con 0x7fab1c161260 2023-08-10T10:46:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab1959a640 1 -- 172.21.15.50:0/3448134264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c031920 con 0x7fab1c161260 2023-08-10T10:46:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab1959a640 1 -- 172.21.15.50:0/3448134264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c031cb0 con 0x7fab1c161260 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 -- 172.21.15.50:0/3448134264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c161260 msgr2=0x7fab1c0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c161260 0x7fab1c0ca520 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06e6f0 tx=0x7fab0c02b860 comp rx=0 tx=0).stop 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 -- 172.21.15.50:0/3448134264 shutdown_connections 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c06f3a0 0x7fab1c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 --2- 172.21.15.50:0/3448134264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c161260 0x7fab1c0ca520 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 -- 172.21.15.50:0/3448134264 >> 172.21.15.50:0/3448134264 conn(0x7fab1c0b01b0 msgr2=0x7fab1c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 -- 172.21.15.50:0/3448134264 shutdown_connections 2023-08-10T10:46:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.969+0000 7fab20867640 1 -- 172.21.15.50:0/3448134264 wait complete. 2023-08-10T10:46:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.971+0000 7fab20867640 1 Processor -- start 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.971+0000 7fab20867640 1 -- start start 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab1c06f3a0 0x7fab1c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c161260 0x7fab1c0c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c15b2f0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0b1530 con 0x7fab1c06f3a0 2023-08-10T10:46:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.972+0000 7fab20867640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0b1810 con 0x7fab1c161260 2023-08-10T10:46:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60206/0 (socket says 172.21.15.50:60206) 2023-08-10T10:46:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 -- 172.21.15.50:0/2646164807 learned_addr learned my addr 172.21.15.50:0/2646164807 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab1a59c640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab1c06f3a0 0x7fab1c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab1ad9d640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c161260 0x7fab1c0c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 -- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c161260 msgr2=0x7fab1c0c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c161260 0x7fab1c0c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 -- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab1c06f3a0 msgr2=0x7fab1c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab1c06f3a0 0x7fab1c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 -- 172.21.15.50:0/2646164807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0094d0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.973+0000 7fab19d9b640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c3f0 tx=0x7fab1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.974+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10016070 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.974+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10007020 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.974+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100073b0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.974+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c0b1af0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.974+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c0b20b0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.975+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c0612b0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.976+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab10007510 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.977+0000 7fab0affd640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 0x7faafc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.977+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab10088dc0 con 0x7fab1c0b0cd0 2023-08-10T10:46:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.977+0000 7fab1a59c640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 0x7faafc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.978+0000 7fab1a59c640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 0x7faafc06d140 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fab0c036000 tx=0x7fab0c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:22.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:22.982+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab10053dd0 con 0x7fab1c0b0cd0 2023-08-10T10:46:23.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.214+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab1c0b2270 con 0x7fab1c0b0cd0 2023-08-10T10:46:23.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.710+0000 7fab0affd640 1 -- 172.21.15.50:0/2646164807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab100573f0 con 0x7fab1c0b0cd0 2023-08-10T10:46:23.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.713+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 msgr2=0x7faafc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.713+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 0x7faafc06d140 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fab0c036000 tx=0x7fab0c03d040 comp rx=0 tx=0).stop 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.713+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 msgr2=0x7fab1c0b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.713+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c3f0 tx=0x7fab1000c8b0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 shutdown_connections 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1c161260 0x7fab1c0c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1c0b0cd0 0x7fab1c0b25d0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faafc06ac80 0x7faafc06d140 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 --2- 172.21.15.50:0/2646164807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab1c06f3a0 0x7fab1c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 >> 172.21.15.50:0/2646164807 conn(0x7fab1c0b01b0 msgr2=0x7fab1c15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:23.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 shutdown_connections 2023-08-10T10:46:23.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.714+0000 7fab20867640 1 -- 172.21.15.50:0/2646164807 wait complete. 2023-08-10T10:46:23.736 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:46:23.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.968+0000 7fb26a5b2640 1 Processor -- start 2023-08-10T10:46:23.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.968+0000 7fb26a5b2640 1 -- start start 2023-08-10T10:46:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb26a5b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2640b1da0 0x7fb2640cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb26a5b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb26a5b2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26415d010 con 0x7fb264153850 2023-08-10T10:46:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb26a5b2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26415d290 con 0x7fb2640b1da0 2023-08-10T10:46:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb26a5b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26415d570 con 0x7fb264153c30 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb2695b0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb264153850 0x7fb2640b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49518/0 (socket says 172.21.15.50:49518) 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb2695b0640 1 -- 172.21.15.50:0/1836420381 learned_addr learned my addr 172.21.15.50:0/1836420381 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb268daf640 1 --2- 172.21.15.50:0/1836420381 >> v2:172.21.15.50:3300/0 conn(0x7fb2640b1da0 0x7fb2640cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb268daf640 1 -- 172.21.15.50:0/1836420381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 msgr2=0x7fb2640cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.970+0000 7fb269db1640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.971+0000 7fb268daf640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.971+0000 7fb25bfff640 1 -- 172.21.15.50:0/1836420381 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763273390 0 0) 0x7fb26415d010 con 0x7fb264153850 2023-08-10T10:46:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.971+0000 7fb268daf640 1 -- 172.21.15.50:0/1836420381 >> v1:172.21.15.50:6789/0 conn(0x7fb264153850 legacy=0x7fb2640b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.971+0000 7fb268daf640 1 -- 172.21.15.50:0/1836420381 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26415d850 con 0x7fb2640b1da0 2023-08-10T10:46:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.971+0000 7fb269db1640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb268daf640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2640b1da0 0x7fb2640cf630 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097a0 tx=0x7fb25402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8b508c6080f1dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb25bfff640 1 -- 172.21.15.50:0/1836420381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25402d040 con 0x7fb2640b1da0 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb25bfff640 1 -- 172.21.15.50:0/1836420381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254031810 con 0x7fb2640b1da0 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb25bfff640 1 -- 172.21.15.50:0/1836420381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254031ba0 con 0x7fb2640b1da0 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb26a5b2640 1 -- 172.21.15.50:0/1836420381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2640b1da0 msgr2=0x7fb2640cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.972+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2640b1da0 0x7fb2640cf630 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097a0 tx=0x7fb25402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 -- 172.21.15.50:0/1836420381 shutdown_connections 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2640b1da0 0x7fb2640cf630 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/1836420381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 -- 172.21.15.50:0/1836420381 >> 172.21.15.50:0/1836420381 conn(0x7fb264069880 msgr2=0x7fb264069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 -- 172.21.15.50:0/1836420381 shutdown_connections 2023-08-10T10:46:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.973+0000 7fb26a5b2640 1 -- 172.21.15.50:0/1836420381 wait complete. 2023-08-10T10:46:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.975+0000 7fb26a5b2640 1 Processor -- start 2023-08-10T10:46:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.975+0000 7fb26a5b2640 1 -- start start 2023-08-10T10:46:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2640cbd90 0x7fb2640d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264153500 con 0x7fb264153850 2023-08-10T10:46:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640d21a0 con 0x7fb2640cbd90 2023-08-10T10:46:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb26a5b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640d1590 con 0x7fb264153c30 2023-08-10T10:46:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60226/0 (socket says 172.21.15.50:60226) 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 -- 172.21.15.50:0/198762859 learned_addr learned my addr 172.21.15.50:0/198762859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 -- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 msgr2=0x7fb2640cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.976+0000 7fb2695b0640 1 -- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2640cbd90 msgr2=0x7fb2640d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb269db1640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2640cbd90 0x7fb2640d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb2695b0640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2640cbd90 0x7fb2640d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb2695b0640 1 -- 172.21.15.50:0/198762859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009400 con 0x7fb264153850 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb2695b0640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c4d0 tx=0x7fb26000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2600074e0 con 0x7fb264153850 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb260007660 con 0x7fb264153850 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260004a20 con 0x7fb264153850 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2640d1870 con 0x7fb264153850 2023-08-10T10:46:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.977+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2640d1e30 con 0x7fb264153850 2023-08-10T10:46:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.978+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2641f28f0 con 0x7fb264153850 2023-08-10T10:46:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.979+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb260004b80 con 0x7fb264153850 2023-08-10T10:46:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.980+0000 7fb259ffb640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 0x7fb24806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.980+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb260088700 con 0x7fb264153850 2023-08-10T10:46:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.981+0000 7fb268daf640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 0x7fb24806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.982+0000 7fb268daf640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 0x7fb24806d0e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb254036000 tx=0x7fb254030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:23.985+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb260053710 con 0x7fb264153850 2023-08-10T10:46:24.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.213+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb264066e30 con 0x7fb264153850 2023-08-10T10:46:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.214+0000 7fb259ffb640 1 -- 172.21.15.50:0/198762859 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fb260056d30 con 0x7fb264153850 2023-08-10T10:46:24.215 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:24.215 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:46:24.215 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:46:24.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.216+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 msgr2=0x7fb24806d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.216+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 0x7fb24806d0e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb254036000 tx=0x7fb254030000 comp rx=0 tx=0).stop 2023-08-10T10:46:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 msgr2=0x7fb264152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c4d0 tx=0x7fb26000c990 comp rx=0 tx=0).stop 2023-08-10T10:46:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 shutdown_connections 2023-08-10T10:46:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb24806ac20 0x7fb24806d0e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2640cbd90 0x7fb2640d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb264153c30 0x7fb2640cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 --2- 172.21.15.50:0/198762859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb264153850 0x7fb264152fc0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 >> 172.21.15.50:0/198762859 conn(0x7fb264069880 msgr2=0x7fb2640b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 shutdown_connections 2023-08-10T10:46:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.217+0000 7fb26a5b2640 1 -- 172.21.15.50:0/198762859 wait complete. 2023-08-10T10:46:24.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:46:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.447+0000 7fe74ec45640 1 Processor -- start 2023-08-10T10:46:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.447+0000 7fe74ec45640 1 -- start start 2023-08-10T10:46:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74ec45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7480c9d00 0x7fe7480cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74ec45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cd290 0x7fe7480cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74ec45640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480cc5a0 con 0x7fe748159830 2023-08-10T10:46:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74ec45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7480b4170 con 0x7fe7480c9d00 2023-08-10T10:46:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74ec45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815d720 con 0x7fe7480cd290 2023-08-10T10:46:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74dc43640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe748159830 0x7fe74815dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49528/0 (socket says 172.21.15.50:49528) 2023-08-10T10:46:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74dc43640 1 -- 172.21.15.50:0/1642146975 learned_addr learned my addr 172.21.15.50:0/1642146975 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74d442640 1 --2- 172.21.15.50:0/1642146975 >> v2:172.21.15.117:3300/0 conn(0x7fe7480c9d00 0x7fe7480cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cd290 0x7fe7480cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.449+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834096913 0 0) 0x7fe7480cc5a0 con 0x7fe748159830 2023-08-10T10:46:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe734003520 con 0x7fe748159830 2023-08-10T10:46:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132479094 0 0) 0x7fe734003520 con 0x7fe748159830 2023-08-10T10:46:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cd290 msgr2=0x7fe7480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cd290 0x7fe7480cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 >> v2:172.21.15.117:3300/0 conn(0x7fe7480c9d00 msgr2=0x7fe7480cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 --2- 172.21.15.50:0/1642146975 >> v2:172.21.15.117:3300/0 conn(0x7fe7480c9d00 0x7fe7480cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480cdc20 con 0x7fe748159830 2023-08-10T10:46:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe744001670 con 0x7fe748159830 2023-08-10T10:46:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 >> v1:172.21.15.50:6789/0 conn(0x7fe748159830 legacy=0x7fe74815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7340039e0 0x7fe734003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7340047c0 0x7fe734004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe734005180 0x7fe73400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815d720 con 0x7fe734005180 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73400bef0 con 0x7fe7340039e0 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73400c0b0 con 0x7fe7340047c0 2023-08-10T10:46:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.450+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7480cd290 0x7fe7480cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe734005180 0x7fe73400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74dc43640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7340039e0 0x7fe734003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74d442640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7340047c0 0x7fe734004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 -- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7340047c0 msgr2=0x7fe734004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7340047c0 0x7fe734004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 -- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7340039e0 msgr2=0x7fe734003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7340039e0 0x7fe734003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74e444640 1 -- 172.21.15.50:0/1642146975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734003520 con 0x7fe734005180 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.451+0000 7fe74dc43640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7340039e0 0x7fe734003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.452+0000 7fe74e444640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe734005180 0x7fe73400b980 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fe74806ccb0 tx=0x7fe7340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ec80a49434b475 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74002cc60 con 0x7fe734005180 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74002cdc0 con 0x7fe734005180 2023-08-10T10:46:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74cc41640 1 -- 172.21.15.50:0/1642146975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740003bb0 con 0x7fe734005180 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74ec45640 1 -- 172.21.15.50:0/1642146975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe734005180 msgr2=0x7fe73400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1642146975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe734005180 0x7fe73400b980 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fe74806ccb0 tx=0x7fe7340057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74e444640 1 -- 172.21.15.50:0/1642146975 reap_dead start 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74ec45640 1 -- 172.21.15.50:0/1642146975 shutdown_connections 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74ec45640 1 -- 172.21.15.50:0/1642146975 >> 172.21.15.50:0/1642146975 conn(0x7fe74806ab80 msgr2=0x7fe74806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.453+0000 7fe74ec45640 1 -- 172.21.15.50:0/1642146975 shutdown_connections 2023-08-10T10:46:24.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.454+0000 7fe74ec45640 1 -- 172.21.15.50:0/1642146975 wait complete. 2023-08-10T10:46:24.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.455+0000 7fe74ec45640 1 Processor -- start 2023-08-10T10:46:24.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.455+0000 7fe74ec45640 1 -- start start 2023-08-10T10:46:24.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734005180 0x7fe74814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 0x7fe7480b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480c2f70 con 0x7fe7481532b0 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815b170 con 0x7fe748153710 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74ec45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815b450 con 0x7fe734005180 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.456+0000 7fe74d442640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60250/0 (socket says 172.21.15.50:60250) 2023-08-10T10:46:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 -- 172.21.15.50:0/1246444505 learned_addr learned my addr 172.21.15.50:0/1246444505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74e444640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 0x7fe7480b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74dc43640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734005180 0x7fe74814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 -- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734005180 msgr2=0x7fe74814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734005180 0x7fe74814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 -- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 msgr2=0x7fe7480b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 0x7fe7480b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 -- 172.21.15.50:0/1246444505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74815b730 con 0x7fe7481532b0 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74e444640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 0x7fe7480b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.457+0000 7fe74d442640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe7380116d0 tx=0x7fe738011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.458+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73800f9c0 con 0x7fe7481532b0 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.458+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73800fb20 con 0x7fe7481532b0 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.458+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73800fe90 con 0x7fe7481532b0 2023-08-10T10:46:24.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.458+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74815ba10 con 0x7fe7481532b0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.458+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74815ae80 con 0x7fe7481532b0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.459+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748066e30 con 0x7fe7481532b0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.460+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe738015460 con 0x7fe7481532b0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.461+0000 7fe73e7fc640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 0x7fe72c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.461+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe738089a90 con 0x7fe7481532b0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.461+0000 7fe74dc43640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 0x7fe72c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.462+0000 7fe74dc43640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 0x7fe72c06d140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe7440059d0 tx=0x7fe744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.465+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7380585e0 con 0x7fe7481532b0 2023-08-10T10:46:24.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.663+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7480cd070 con 0x7fe7481532b0 2023-08-10T10:46:24.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.665+0000 7fe73e7fc640 1 -- 172.21.15.50:0/1246444505 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fe738058170 con 0x7fe7481532b0 2023-08-10T10:46:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:24.666 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":143,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:21.665741+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:46:24.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.667+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 msgr2=0x7fe72c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.667+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 0x7fe72c06d140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe7440059d0 tx=0x7fe744009040 comp rx=0 tx=0).stop 2023-08-10T10:46:24.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.667+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 msgr2=0x7fe7480c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.667+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe7380116d0 tx=0x7fe738011b90 comp rx=0 tx=0).stop 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 shutdown_connections 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe72c06ac80 0x7fe72c06d140 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe748153710 0x7fe7480b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7481532b0 0x7fe7480c4610 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 --2- 172.21.15.50:0/1246444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe734005180 0x7fe74814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 >> 172.21.15.50:0/1246444505 conn(0x7fe74806ab80 msgr2=0x7fe7480cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:24.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 shutdown_connections 2023-08-10T10:46:24.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.668+0000 7fe74ec45640 1 -- 172.21.15.50:0/1246444505 wait complete. 2023-08-10T10:46:24.687 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:46:24.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:46:24.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.915+0000 7fcff73e8640 1 Processor -- start 2023-08-10T10:46:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.915+0000 7fcff73e8640 1 -- start start 2023-08-10T10:46:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.916+0000 7fcff73e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcff015ccb0 0x7fcff00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff73e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff00719f0 con 0x7fcff00c9b30 2023-08-10T10:46:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff73e8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff00c8db0 con 0x7fcff0069db0 2023-08-10T10:46:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff73e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00c9050 con 0x7fcff015ccb0 2023-08-10T10:46:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff4983640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcff00c9b30 0x7fcff00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49590/0 (socket says 172.21.15.50:49590) 2023-08-10T10:46:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff4983640 1 -- 172.21.15.50:0/1209601556 learned_addr learned my addr 172.21.15.50:0/1209601556 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcff5184640 1 --2- 172.21.15.50:0/1209601556 >> v2:172.21.15.117:3300/0 conn(0x7fcff015ccb0 0x7fcff00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753580606 0 0) 0x7fcff00719f0 con 0x7fcff00c9b30 2023-08-10T10:46:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.917+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc003520 con 0x7fcff00c9b30 2023-08-10T10:46:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233345456 0 0) 0x7fcfdc003520 con 0x7fcff00c9b30 2023-08-10T10:46:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 >> v2:172.21.15.117:3300/0 conn(0x7fcff015ccb0 msgr2=0x7fcff00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 --2- 172.21.15.50:0/1209601556 >> v2:172.21.15.117:3300/0 conn(0x7fcff015ccb0 0x7fcff00b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 >> v1:172.21.15.117:6789/0 conn(0x7fcff0069db0 legacy=0x7fcff006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00c9330 con 0x7fcff00c9b30 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fcfe0001670 con 0x7fcff00c9b30 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 >> v1:172.21.15.50:6789/0 conn(0x7fcff00c9b30 legacy=0x7fcff00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfdc003970 0x7fcfdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcfdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfdc005180 0x7fcfdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c9050 con 0x7fcfdc0047c0 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00c020 con 0x7fcfdc005180 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00c1e0 con 0x7fcfdc003970 2023-08-10T10:46:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.918+0000 7fcff4983640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcfdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff5985640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfdc005180 0x7fcfdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff5184640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfdc003970 0x7fcfdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff4983640 1 -- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfdc003970 msgr2=0x7fcfdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff4983640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfdc003970 0x7fcfdc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff4983640 1 -- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfdc005180 msgr2=0x7fcfdc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff4983640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfdc005180 0x7fcfdc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff4983640 1 -- 172.21.15.50:0/1209601556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc003520 con 0x7fcfdc0047c0 2023-08-10T10:46:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff5985640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfdc005180 0x7fcfdc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.919+0000 7fcff5985640 1 -- 172.21.15.50:0/1209601556 reap_dead start 2023-08-10T10:46:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.920+0000 7fcff4983640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcfdc004c40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0007fd0 tx=0x7fcfdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986790308cbae764 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.920+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0005ad0 con 0x7fcfdc0047c0 2023-08-10T10:46:24.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.920+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0005c30 con 0x7fcfdc0047c0 2023-08-10T10:46:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.920+0000 7fcfe7fff640 1 -- 172.21.15.50:0/1209601556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe002cab0 con 0x7fcfdc0047c0 2023-08-10T10:46:24.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 -- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 msgr2=0x7fcfdc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcfdc004c40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0007fd0 tx=0x7fcfdc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 -- 172.21.15.50:0/1209601556 shutdown_connections 2023-08-10T10:46:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1209601556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcfdc004c40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 -- 172.21.15.50:0/1209601556 >> 172.21.15.50:0/1209601556 conn(0x7fcff006b590 msgr2=0x7fcff00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:24.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 -- 172.21.15.50:0/1209601556 shutdown_connections 2023-08-10T10:46:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.921+0000 7fcff73e8640 1 -- 172.21.15.50:0/1209601556 wait complete. 2023-08-10T10:46:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.923+0000 7fcff73e8640 1 Processor -- start 2023-08-10T10:46:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.923+0000 7fcff73e8640 1 -- start start 2023-08-10T10:46:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff00c5790 0x7fcff00c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff00afd00 0x7fcff00b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c6e60 con 0x7fcfdc0047c0 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c6250 con 0x7fcff00c5790 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff73e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c6530 con 0x7fcff00afd00 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff5184640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff5184640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51930/0 (socket says 172.21.15.50:51930) 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.924+0000 7fcff5184640 1 -- 172.21.15.50:0/1494101272 learned_addr learned my addr 172.21.15.50:0/1494101272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5985640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff00afd00 0x7fcff00b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff4983640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff00c5790 0x7fcff00c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 -- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff00afd00 msgr2=0x7fcff00b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff00afd00 0x7fcff00b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 -- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff00c5790 msgr2=0x7fcff00c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff00c5790 0x7fcff00c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 -- 172.21.15.50:0/1494101272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00c6810 con 0x7fcfdc0047c0 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff5184640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0108e0 tx=0x7fcfec010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00eb60 con 0x7fcfdc0047c0 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec00ecc0 con 0x7fcfdc0047c0 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec01c400 con 0x7fcfdc0047c0 2023-08-10T10:46:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.925+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff00c6af0 con 0x7fcfdc0047c0 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.926+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff00b06c0 con 0x7fcfdc0047c0 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.927+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff004e270 con 0x7fcfdc0047c0 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.928+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfec01c560 con 0x7fcfdc0047c0 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.928+0000 7fcfe5ffb640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 0x7fcfd406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.929+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfec089c40 con 0x7fcfdc0047c0 2023-08-10T10:46:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.929+0000 7fcff4983640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 0x7fcfd406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.930+0000 7fcff4983640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 0x7fcfd406d140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:24.933+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcfec054d00 con 0x7fcfdc0047c0 2023-08-10T10:46:25.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.124+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcff00c9610 con 0x7fcfd406ac80 2023-08-10T10:46:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.137+0000 7fcfe5ffb640 1 -- 172.21.15.50:0/1494101272 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303191 (secure 0 0 0) 0x7fcfe00058f0 con 0x7fcfd406ac80 2023-08-10T10:46:25.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:46:25.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 msgr2=0x7fcfd406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 0x7fcfd406d140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe0009030 comp rx=0 tx=0).stop 2023-08-10T10:46:25.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 msgr2=0x7fcff00c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0108e0 tx=0x7fcfec010da0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 shutdown_connections 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff00afd00 0x7fcff00b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcfd406ac80 0x7fcfd406d140 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff00c5790 0x7fcff00c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.144+0000 7fcff73e8640 1 --2- 172.21.15.50:0/1494101272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfdc0047c0 0x7fcff00c7f30 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.145+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 >> 172.21.15.50:0/1494101272 conn(0x7fcff006b590 msgr2=0x7fcff00cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:25.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.145+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 shutdown_connections 2023-08-10T10:46:25.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.145+0000 7fcff73e8640 1 -- 172.21.15.50:0/1494101272 wait complete. 2023-08-10T10:46:25.163 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2023-08-10T10:46:24.485553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7791,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554708,"statfs":{"total":1600000000,"available":1592021578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.859817"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675000+0000","last_change":"2023-08-10T10:46:20.684808+0000","last_active":"2023-08-10T10:46:21.675000+0000","last_peered":"2023-08-10T10:46:21.675000+0000","last_clean":"2023-08-10T10:46:21.675000+0000","last_became_active":"2023-08-10T10:46:20.684123+0000","last_became_peered":"2023-08-10T10:46:20.684123+0000","last_unstale":"2023-08-10T10:46:21.675000+0000","last_undegraded":"2023-08-10T10:46:21.675000+0000","last_fullsized":"2023-08-10T10:46:21.675000+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:50.303655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150802+0000","last_change":"2023-08-10T10:46:20.679983+0000","last_active":"2023-08-10T10:46:22.150802+0000","last_peered":"2023-08-10T10:46:22.150802+0000","last_clean":"2023-08-10T10:46:22.150802+0000","last_became_active":"2023-08-10T10:46:20.679205+0000","last_became_peered":"2023-08-10T10:46:20.679205+0000","last_unstale":"2023-08-10T10:46:22.150802+0000","last_undegraded":"2023-08-10T10:46:22.150802+0000","last_fullsized":"2023-08-10T10:46:22.150802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:51.249104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150830+0000","last_change":"2023-08-10T10:46:20.712855+0000","last_active":"2023-08-10T10:46:22.150830+0000","last_peered":"2023-08-10T10:46:22.150830+0000","last_clean":"2023-08-10T10:46:22.150830+0000","last_became_active":"2023-08-10T10:46:20.709450+0000","last_became_peered":"2023-08-10T10:46:20.709450+0000","last_unstale":"2023-08-10T10:46:22.150830+0000","last_undegraded":"2023-08-10T10:46:22.150830+0000","last_fullsized":"2023-08-10T10:46:22.150830+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:43.567741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152233+0000","last_change":"2023-08-10T10:46:20.685373+0000","last_active":"2023-08-10T10:46:22.152233+0000","last_peered":"2023-08-10T10:46:22.152233+0000","last_clean":"2023-08-10T10:46:22.152233+0000","last_became_active":"2023-08-10T10:46:20.684335+0000","last_became_peered":"2023-08-10T10:46:20.684335+0000","last_unstale":"2023-08-10T10:46:22.152233+0000","last_undegraded":"2023-08-10T10:46:22.152233+0000","last_fullsized":"2023-08-10T10:46:22.152233+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:10.960908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675297+0000","last_change":"2023-08-10T10:46:20.693984+0000","last_active":"2023-08-10T10:46:21.675297+0000","last_peered":"2023-08-10T10:46:21.675297+0000","last_clean":"2023-08-10T10:46:21.675297+0000","last_became_active":"2023-08-10T10:46:20.693561+0000","last_became_peered":"2023-08-10T10:46:20.693561+0000","last_unstale":"2023-08-10T10:46:21.675297+0000","last_undegraded":"2023-08-10T10:46:21.675297+0000","last_fullsized":"2023-08-10T10:46:21.675297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:25.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152238+0000","last_change":"2023-08-10T10:46:20.710524+0000","last_active":"2023-08-10T10:46:22.152238+0000","last_peered":"2023-08-10T10:46:22.152238+0000","last_clean":"2023-08-10T10:46:22.152238+0000","last_became_active":"2023-08-10T10:46:20.710259+0000","last_became_peered":"2023-08-10T10:46:20.710259+0000","last_unstale":"2023-08-10T10:46:22.152238+0000","last_undegraded":"2023-08-10T10:46:22.152238+0000","last_fullsized":"2023-08-10T10:46:22.152238+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:35.275585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152371+0000","last_change":"2023-08-10T10:46:20.709301+0000","last_active":"2023-08-10T10:46:22.152371+0000","last_peered":"2023-08-10T10:46:22.152371+0000","last_clean":"2023-08-10T10:46:22.152371+0000","last_became_active":"2023-08-10T10:46:20.698165+0000","last_became_peered":"2023-08-10T10:46:20.698165+0000","last_unstale":"2023-08-10T10:46:22.152371+0000","last_undegraded":"2023-08-10T10:46:22.152371+0000","last_fullsized":"2023-08-10T10:46:22.152371+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:06.714423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152088+0000","last_change":"2023-08-10T10:46:20.711049+0000","last_active":"2023-08-10T10:46:22.152088+0000","last_peered":"2023-08-10T10:46:22.152088+0000","last_clean":"2023-08-10T10:46:22.152088+0000","last_became_active":"2023-08-10T10:46:20.708386+0000","last_became_peered":"2023-08-10T10:46:20.708386+0000","last_unstale":"2023-08-10T10:46:22.152088+0000","last_undegraded":"2023-08-10T10:46:22.152088+0000","last_fullsized":"2023-08-10T10:46:22.152088+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:55.921576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151618+0000","last_change":"2023-08-10T10:46:20.684987+0000","last_active":"2023-08-10T10:46:22.151618+0000","last_peered":"2023-08-10T10:46:22.151618+0000","last_clean":"2023-08-10T10:46:22.151618+0000","last_became_active":"2023-08-10T10:46:20.683324+0000","last_became_peered":"2023-08-10T10:46:20.683324+0000","last_unstale":"2023-08-10T10:46:22.151618+0000","last_undegraded":"2023-08-10T10:46:22.151618+0000","last_fullsized":"2023-08-10T10:46:22.151618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.772259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672869+0000","last_change":"2023-08-10T10:46:20.702843+0000","last_active":"2023-08-10T10:46:21.672869+0000","last_peered":"2023-08-10T10:46:21.672869+0000","last_clean":"2023-08-10T10:46:21.672869+0000","last_became_active":"2023-08-10T10:46:20.702245+0000","last_became_peered":"2023-08-10T10:46:20.702245+0000","last_unstale":"2023-08-10T10:46:21.672869+0000","last_undegraded":"2023-08-10T10:46:21.672869+0000","last_fullsized":"2023-08-10T10:46:21.672869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:49:51.530075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675610+0000","last_change":"2023-08-10T10:46:20.698132+0000","last_active":"2023-08-10T10:46:21.675610+0000","last_peered":"2023-08-10T10:46:21.675610+0000","last_clean":"2023-08-10T10:46:21.675610+0000","last_became_active":"2023-08-10T10:46:20.697812+0000","last_became_peered":"2023-08-10T10:46:20.697812+0000","last_unstale":"2023-08-10T10:46:21.675610+0000","last_undegraded":"2023-08-10T10:46:21.675610+0000","last_fullsized":"2023-08-10T10:46:21.675610+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:50.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152743+0000","last_change":"2023-08-10T10:46:20.696996+0000","last_active":"2023-08-10T10:46:22.152743+0000","last_peered":"2023-08-10T10:46:22.152743+0000","last_clean":"2023-08-10T10:46:22.152743+0000","last_became_active":"2023-08-10T10:46:20.695487+0000","last_became_peered":"2023-08-10T10:46:20.695487+0000","last_unstale":"2023-08-10T10:46:22.152743+0000","last_undegraded":"2023-08-10T10:46:22.152743+0000","last_fullsized":"2023-08-10T10:46:22.152743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.077208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672267+0000","last_change":"2023-08-10T10:46:20.700451+0000","last_active":"2023-08-10T10:46:21.672267+0000","last_peered":"2023-08-10T10:46:21.672267+0000","last_clean":"2023-08-10T10:46:21.672267+0000","last_became_active":"2023-08-10T10:46:20.698959+0000","last_became_peered":"2023-08-10T10:46:20.698959+0000","last_unstale":"2023-08-10T10:46:21.672267+0000","last_undegraded":"2023-08-10T10:46:21.672267+0000","last_fullsized":"2023-08-10T10:46:21.672267+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:12.462038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150289+0000","last_change":"2023-08-10T10:46:20.704456+0000","last_active":"2023-08-10T10:46:22.150289+0000","last_peered":"2023-08-10T10:46:22.150289+0000","last_clean":"2023-08-10T10:46:22.150289+0000","last_became_active":"2023-08-10T10:46:20.703046+0000","last_became_peered":"2023-08-10T10:46:20.703046+0000","last_unstale":"2023-08-10T10:46:22.150289+0000","last_undegraded":"2023-08-10T10:46:22.150289+0000","last_fullsized":"2023-08-10T10:46:22.150289+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:14.983590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675840+0000","last_change":"2023-08-10T10:46:20.699237+0000","last_active":"2023-08-10T10:46:21.675840+0000","last_peered":"2023-08-10T10:46:21.675840+0000","last_clean":"2023-08-10T10:46:21.675840+0000","last_became_active":"2023-08-10T10:46:20.698792+0000","last_became_peered":"2023-08-10T10:46:20.698792+0000","last_unstale":"2023-08-10T10:46:21.675840+0000","last_undegraded":"2023-08-10T10:46:21.675840+0000","last_fullsized":"2023-08-10T10:46:21.675840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:56.909740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152388+0000","last_change":"2023-08-10T10:46:20.713846+0000","last_active":"2023-08-10T10:46:22.152388+0000","last_peered":"2023-08-10T10:46:22.152388+0000","last_clean":"2023-08-10T10:46:22.152388+0000","last_became_active":"2023-08-10T10:46:20.713583+0000","last_became_peered":"2023-08-10T10:46:20.713583+0000","last_unstale":"2023-08-10T10:46:22.152388+0000","last_undegraded":"2023-08-10T10:46:22.152388+0000","last_fullsized":"2023-08-10T10:46:22.152388+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:31.466439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672272+0000","last_change":"2023-08-10T10:46:20.701031+0000","last_active":"2023-08-10T10:46:21.672272+0000","last_peered":"2023-08-10T10:46:21.672272+0000","last_clean":"2023-08-10T10:46:21.672272+0000","last_became_active":"2023-08-10T10:46:20.700349+0000","last_became_peered":"2023-08-10T10:46:20.700349+0000","last_unstale":"2023-08-10T10:46:21.672272+0000","last_undegraded":"2023-08-10T10:46:21.672272+0000","last_fullsized":"2023-08-10T10:46:21.672272+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.703172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151054+0000","last_change":"2023-08-10T10:46:20.686993+0000","last_active":"2023-08-10T10:46:22.151054+0000","last_peered":"2023-08-10T10:46:22.151054+0000","last_clean":"2023-08-10T10:46:22.151054+0000","last_became_active":"2023-08-10T10:46:20.685689+0000","last_became_peered":"2023-08-10T10:46:20.685689+0000","last_unstale":"2023-08-10T10:46:22.151054+0000","last_undegraded":"2023-08-10T10:46:22.151054+0000","last_fullsized":"2023-08-10T10:46:22.151054+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:15.435141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151240+0000","last_change":"2023-08-10T10:46:20.699106+0000","last_active":"2023-08-10T10:46:22.151240+0000","last_peered":"2023-08-10T10:46:22.151240+0000","last_clean":"2023-08-10T10:46:22.151240+0000","last_became_active":"2023-08-10T10:46:20.698128+0000","last_became_peered":"2023-08-10T10:46:20.698128+0000","last_unstale":"2023-08-10T10:46:22.151240+0000","last_undegraded":"2023-08-10T10:46:22.151240+0000","last_fullsized":"2023-08-10T10:46:22.151240+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:35:45.996853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674322+0000","last_change":"2023-08-10T10:46:20.714851+0000","last_active":"2023-08-10T10:46:21.674322+0000","last_peered":"2023-08-10T10:46:21.674322+0000","last_clean":"2023-08-10T10:46:21.674322+0000","last_became_active":"2023-08-10T10:46:20.714606+0000","last_became_peered":"2023-08-10T10:46:20.714606+0000","last_unstale":"2023-08-10T10:46:21.674322+0000","last_undegraded":"2023-08-10T10:46:21.674322+0000","last_fullsized":"2023-08-10T10:46:21.674322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:48:42.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153068+0000","last_change":"2023-08-10T10:46:20.707798+0000","last_active":"2023-08-10T10:46:22.153068+0000","last_peered":"2023-08-10T10:46:22.153068+0000","last_clean":"2023-08-10T10:46:22.153068+0000","last_became_active":"2023-08-10T10:46:20.707470+0000","last_became_peered":"2023-08-10T10:46:20.707470+0000","last_unstale":"2023-08-10T10:46:22.153068+0000","last_undegraded":"2023-08-10T10:46:22.153068+0000","last_fullsized":"2023-08-10T10:46:22.153068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:57:19.297315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675299+0000","last_change":"2023-08-10T10:46:20.680367+0000","last_active":"2023-08-10T10:46:21.675299+0000","last_peered":"2023-08-10T10:46:21.675299+0000","last_clean":"2023-08-10T10:46:21.675299+0000","last_became_active":"2023-08-10T10:46:20.679597+0000","last_became_peered":"2023-08-10T10:46:20.679597+0000","last_unstale":"2023-08-10T10:46:21.675299+0000","last_undegraded":"2023-08-10T10:46:21.675299+0000","last_fullsized":"2023-08-10T10:46:21.675299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:11.665746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155058+0000","last_change":"2023-08-10T10:46:20.689301+0000","last_active":"2023-08-10T10:46:22.155058+0000","last_peered":"2023-08-10T10:46:22.155058+0000","last_clean":"2023-08-10T10:46:22.155058+0000","last_became_active":"2023-08-10T10:46:20.688590+0000","last_became_peered":"2023-08-10T10:46:20.688590+0000","last_unstale":"2023-08-10T10:46:22.155058+0000","last_undegraded":"2023-08-10T10:46:22.155058+0000","last_fullsized":"2023-08-10T10:46:22.155058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:54.873099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153790+0000","last_change":"2023-08-10T10:46:20.700405+0000","last_active":"2023-08-10T10:46:22.153790+0000","last_peered":"2023-08-10T10:46:22.153790+0000","last_clean":"2023-08-10T10:46:22.153790+0000","last_became_active":"2023-08-10T10:46:20.700005+0000","last_became_peered":"2023-08-10T10:46:20.700005+0000","last_unstale":"2023-08-10T10:46:22.153790+0000","last_undegraded":"2023-08-10T10:46:22.153790+0000","last_fullsized":"2023-08-10T10:46:22.153790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:50.953049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154378+0000","last_change":"2023-08-10T10:46:20.698018+0000","last_active":"2023-08-10T10:46:22.154378+0000","last_peered":"2023-08-10T10:46:22.154378+0000","last_clean":"2023-08-10T10:46:22.154378+0000","last_became_active":"2023-08-10T10:46:20.697765+0000","last_became_peered":"2023-08-10T10:46:20.697765+0000","last_unstale":"2023-08-10T10:46:22.154378+0000","last_undegraded":"2023-08-10T10:46:22.154378+0000","last_fullsized":"2023-08-10T10:46:22.154378+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:33.288513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674183+0000","last_change":"2023-08-10T10:46:20.713675+0000","last_active":"2023-08-10T10:46:21.674183+0000","last_peered":"2023-08-10T10:46:21.674183+0000","last_clean":"2023-08-10T10:46:21.674183+0000","last_became_active":"2023-08-10T10:46:20.712732+0000","last_became_peered":"2023-08-10T10:46:20.712732+0000","last_unstale":"2023-08-10T10:46:21.674183+0000","last_undegraded":"2023-08-10T10:46:21.674183+0000","last_fullsized":"2023-08-10T10:46:21.674183+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:05.732478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151372+0000","last_change":"2023-08-10T10:46:20.696781+0000","last_active":"2023-08-10T10:46:22.151372+0000","last_peered":"2023-08-10T10:46:22.151372+0000","last_clean":"2023-08-10T10:46:22.151372+0000","last_became_active":"2023-08-10T10:46:20.696342+0000","last_became_peered":"2023-08-10T10:46:20.696342+0000","last_unstale":"2023-08-10T10:46:22.151372+0000","last_undegraded":"2023-08-10T10:46:22.151372+0000","last_fullsized":"2023-08-10T10:46:22.151372+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:50:52.730815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151390+0000","last_change":"2023-08-10T10:46:20.709626+0000","last_active":"2023-08-10T10:46:22.151390+0000","last_peered":"2023-08-10T10:46:22.151390+0000","last_clean":"2023-08-10T10:46:22.151390+0000","last_became_active":"2023-08-10T10:46:20.699192+0000","last_became_peered":"2023-08-10T10:46:20.699192+0000","last_unstale":"2023-08-10T10:46:22.151390+0000","last_undegraded":"2023-08-10T10:46:22.151390+0000","last_fullsized":"2023-08-10T10:46:22.151390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.211932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673925+0000","last_change":"2023-08-10T10:46:20.706325+0000","last_active":"2023-08-10T10:46:21.673925+0000","last_peered":"2023-08-10T10:46:21.673925+0000","last_clean":"2023-08-10T10:46:21.673925+0000","last_became_active":"2023-08-10T10:46:20.706051+0000","last_became_peered":"2023-08-10T10:46:20.706051+0000","last_unstale":"2023-08-10T10:46:21.673925+0000","last_undegraded":"2023-08-10T10:46:21.673925+0000","last_fullsized":"2023-08-10T10:46:21.673925+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:35.078280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150943+0000","last_change":"2023-08-10T10:46:20.676042+0000","last_active":"2023-08-10T10:46:22.150943+0000","last_peered":"2023-08-10T10:46:22.150943+0000","last_clean":"2023-08-10T10:46:22.150943+0000","last_became_active":"2023-08-10T10:46:20.675313+0000","last_became_peered":"2023-08-10T10:46:20.675313+0000","last_unstale":"2023-08-10T10:46:22.150943+0000","last_undegraded":"2023-08-10T10:46:22.150943+0000","last_fullsized":"2023-08-10T10:46:22.150943+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:39:12.539183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152309+0000","last_change":"2023-08-10T10:46:20.708858+0000","last_active":"2023-08-10T10:46:22.152309+0000","last_peered":"2023-08-10T10:46:22.152309+0000","last_clean":"2023-08-10T10:46:22.152309+0000","last_became_active":"2023-08-10T10:46:20.708549+0000","last_became_peered":"2023-08-10T10:46:20.708549+0000","last_unstale":"2023-08-10T10:46:22.152309+0000","last_undegraded":"2023-08-10T10:46:22.152309+0000","last_fullsized":"2023-08-10T10:46:22.152309+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:21.938476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151520+0000","last_change":"2023-08-10T10:46:20.699956+0000","last_active":"2023-08-10T10:46:22.151520+0000","last_peered":"2023-08-10T10:46:22.151520+0000","last_clean":"2023-08-10T10:46:22.151520+0000","last_became_active":"2023-08-10T10:46:20.698845+0000","last_became_peered":"2023-08-10T10:46:20.698845+0000","last_unstale":"2023-08-10T10:46:22.151520+0000","last_undegraded":"2023-08-10T10:46:22.151520+0000","last_fullsized":"2023-08-10T10:46:22.151520+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:15.631269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672353+0000","last_change":"2023-08-10T10:46:20.702071+0000","last_active":"2023-08-10T10:46:21.672353+0000","last_peered":"2023-08-10T10:46:21.672353+0000","last_clean":"2023-08-10T10:46:21.672353+0000","last_became_active":"2023-08-10T10:46:20.701315+0000","last_became_peered":"2023-08-10T10:46:20.701315+0000","last_unstale":"2023-08-10T10:46:21.672353+0000","last_undegraded":"2023-08-10T10:46:21.672353+0000","last_fullsized":"2023-08-10T10:46:21.672353+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:04.553427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"142'4","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153791+0000","last_change":"2023-08-10T10:46:19.658885+0000","last_active":"2023-08-10T10:46:22.153791+0000","last_peered":"2023-08-10T10:46:22.153791+0000","last_clean":"2023-08-10T10:46:22.153791+0000","last_became_active":"2023-08-10T10:46:19.658390+0000","last_became_peered":"2023-08-10T10:46:19.658390+0000","last_unstale":"2023-08-10T10:46:22.153791+0000","last_undegraded":"2023-08-10T10:46:22.153791+0000","last_fullsized":"2023-08-10T10:46:22.153791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:04.736064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152923+0000","last_change":"2023-08-10T10:46:20.710802+0000","last_active":"2023-08-10T10:46:22.152923+0000","last_peered":"2023-08-10T10:46:22.152923+0000","last_clean":"2023-08-10T10:46:22.152923+0000","last_became_active":"2023-08-10T10:46:20.710382+0000","last_became_peered":"2023-08-10T10:46:20.710382+0000","last_unstale":"2023-08-10T10:46:22.152923+0000","last_undegraded":"2023-08-10T10:46:22.152923+0000","last_fullsized":"2023-08-10T10:46:22.152923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:13.422796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673184+0000","last_change":"2023-08-10T10:46:19.656636+0000","last_active":"2023-08-10T10:46:21.673184+0000","last_peered":"2023-08-10T10:46:21.673184+0000","last_clean":"2023-08-10T10:46:21.673184+0000","last_became_active":"2023-08-10T10:46:19.656158+0000","last_became_peered":"2023-08-10T10:46:19.656158+0000","last_unstale":"2023-08-10T10:46:21.673184+0000","last_undegraded":"2023-08-10T10:46:21.673184+0000","last_fullsized":"2023-08-10T10:46:21.673184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:10.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154127+0000","last_change":"2023-08-10T10:46:20.711511+0000","last_active":"2023-08-10T10:46:22.154127+0000","last_peered":"2023-08-10T10:46:22.154127+0000","last_clean":"2023-08-10T10:46:22.154127+0000","last_became_active":"2023-08-10T10:46:20.711202+0000","last_became_peered":"2023-08-10T10:46:20.711202+0000","last_unstale":"2023-08-10T10:46:22.154127+0000","last_undegraded":"2023-08-10T10:46:22.154127+0000","last_fullsized":"2023-08-10T10:46:22.154127+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:31.847061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154966+0000","last_change":"2023-08-10T10:46:19.655387+0000","last_active":"2023-08-10T10:46:22.154966+0000","last_peered":"2023-08-10T10:46:22.154966+0000","last_clean":"2023-08-10T10:46:22.154966+0000","last_became_active":"2023-08-10T10:46:19.654937+0000","last_became_peered":"2023-08-10T10:46:19.654937+0000","last_unstale":"2023-08-10T10:46:22.154966+0000","last_undegraded":"2023-08-10T10:46:22.154966+0000","last_fullsized":"2023-08-10T10:46:22.154966+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:21:59.526953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154742+0000","last_change":"2023-08-10T10:46:20.705622+0000","last_active":"2023-08-10T10:46:22.154742+0000","last_peered":"2023-08-10T10:46:22.154742+0000","last_clean":"2023-08-10T10:46:22.154742+0000","last_became_active":"2023-08-10T10:46:20.705173+0000","last_became_peered":"2023-08-10T10:46:20.705173+0000","last_unstale":"2023-08-10T10:46:22.154742+0000","last_undegraded":"2023-08-10T10:46:22.154742+0000","last_fullsized":"2023-08-10T10:46:22.154742+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:55.086314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673047+0000","last_change":"2023-08-10T10:46:19.653136+0000","last_active":"2023-08-10T10:46:21.673047+0000","last_peered":"2023-08-10T10:46:21.673047+0000","last_clean":"2023-08-10T10:46:21.673047+0000","last_became_active":"2023-08-10T10:46:19.652828+0000","last_became_peered":"2023-08-10T10:46:19.652828+0000","last_unstale":"2023-08-10T10:46:21.673047+0000","last_undegraded":"2023-08-10T10:46:21.673047+0000","last_fullsized":"2023-08-10T10:46:21.673047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:32.361809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673045+0000","last_change":"2023-08-10T10:46:20.694968+0000","last_active":"2023-08-10T10:46:21.673045+0000","last_peered":"2023-08-10T10:46:21.673045+0000","last_clean":"2023-08-10T10:46:21.673045+0000","last_became_active":"2023-08-10T10:46:20.694286+0000","last_became_peered":"2023-08-10T10:46:20.694286+0000","last_unstale":"2023-08-10T10:46:21.673045+0000","last_undegraded":"2023-08-10T10:46:21.673045+0000","last_fullsized":"2023-08-10T10:46:21.673045+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:53.274622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675832+0000","last_change":"2023-08-10T10:46:19.655332+0000","last_active":"2023-08-10T10:46:21.675832+0000","last_peered":"2023-08-10T10:46:21.675832+0000","last_clean":"2023-08-10T10:46:21.675832+0000","last_became_active":"2023-08-10T10:46:19.654651+0000","last_became_peered":"2023-08-10T10:46:19.654651+0000","last_unstale":"2023-08-10T10:46:21.675832+0000","last_undegraded":"2023-08-10T10:46:21.675832+0000","last_fullsized":"2023-08-10T10:46:21.675832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:54.906649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675088+0000","last_change":"2023-08-10T10:46:20.685365+0000","last_active":"2023-08-10T10:46:21.675088+0000","last_peered":"2023-08-10T10:46:21.675088+0000","last_clean":"2023-08-10T10:46:21.675088+0000","last_became_active":"2023-08-10T10:46:20.684873+0000","last_became_peered":"2023-08-10T10:46:20.684873+0000","last_unstale":"2023-08-10T10:46:21.675088+0000","last_undegraded":"2023-08-10T10:46:21.675088+0000","last_fullsized":"2023-08-10T10:46:21.675088+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:46.044427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151764+0000","last_change":"2023-08-10T10:46:19.656679+0000","last_active":"2023-08-10T10:46:22.151764+0000","last_peered":"2023-08-10T10:46:22.151764+0000","last_clean":"2023-08-10T10:46:22.151764+0000","last_became_active":"2023-08-10T10:46:19.655467+0000","last_became_peered":"2023-08-10T10:46:19.655467+0000","last_unstale":"2023-08-10T10:46:22.151764+0000","last_undegraded":"2023-08-10T10:46:22.151764+0000","last_fullsized":"2023-08-10T10:46:22.151764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:15:17.043138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151285+0000","last_change":"2023-08-10T10:46:20.686333+0000","last_active":"2023-08-10T10:46:22.151285+0000","last_peered":"2023-08-10T10:46:22.151285+0000","last_clean":"2023-08-10T10:46:22.151285+0000","last_became_active":"2023-08-10T10:46:20.683527+0000","last_became_peered":"2023-08-10T10:46:20.683527+0000","last_unstale":"2023-08-10T10:46:22.151285+0000","last_undegraded":"2023-08-10T10:46:22.151285+0000","last_fullsized":"2023-08-10T10:46:22.151285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:22.867082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154778+0000","last_change":"2023-08-10T10:46:19.657520+0000","last_active":"2023-08-10T10:46:22.154778+0000","last_peered":"2023-08-10T10:46:22.154778+0000","last_clean":"2023-08-10T10:46:22.154778+0000","last_became_active":"2023-08-10T10:46:19.657086+0000","last_became_peered":"2023-08-10T10:46:19.657086+0000","last_unstale":"2023-08-10T10:46:22.154778+0000","last_undegraded":"2023-08-10T10:46:22.154778+0000","last_fullsized":"2023-08-10T10:46:22.154778+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:23.669831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672420+0000","last_change":"2023-08-10T10:46:20.687374+0000","last_active":"2023-08-10T10:46:21.672420+0000","last_peered":"2023-08-10T10:46:21.672420+0000","last_clean":"2023-08-10T10:46:21.672420+0000","last_became_active":"2023-08-10T10:46:20.686642+0000","last_became_peered":"2023-08-10T10:46:20.686642+0000","last_unstale":"2023-08-10T10:46:21.672420+0000","last_undegraded":"2023-08-10T10:46:21.672420+0000","last_fullsized":"2023-08-10T10:46:21.672420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:30.039166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153828+0000","last_change":"2023-08-10T10:46:19.663387+0000","last_active":"2023-08-10T10:46:22.153828+0000","last_peered":"2023-08-10T10:46:22.153828+0000","last_clean":"2023-08-10T10:46:22.153828+0000","last_became_active":"2023-08-10T10:46:19.662850+0000","last_became_peered":"2023-08-10T10:46:19.662850+0000","last_unstale":"2023-08-10T10:46:22.153828+0000","last_undegraded":"2023-08-10T10:46:22.153828+0000","last_fullsized":"2023-08-10T10:46:22.153828+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:33:10.468718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151872+0000","last_change":"2023-08-10T10:46:20.711589+0000","last_active":"2023-08-10T10:46:22.151872+0000","last_peered":"2023-08-10T10:46:22.151872+0000","last_clean":"2023-08-10T10:46:22.151872+0000","last_became_active":"2023-08-10T10:46:20.711191+0000","last_became_peered":"2023-08-10T10:46:20.711191+0000","last_unstale":"2023-08-10T10:46:22.151872+0000","last_undegraded":"2023-08-10T10:46:22.151872+0000","last_fullsized":"2023-08-10T10:46:22.151872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:40.449273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672836+0000","last_change":"2023-08-10T10:46:19.661401+0000","last_active":"2023-08-10T10:46:21.672836+0000","last_peered":"2023-08-10T10:46:21.672836+0000","last_clean":"2023-08-10T10:46:21.672836+0000","last_became_active":"2023-08-10T10:46:19.660020+0000","last_became_peered":"2023-08-10T10:46:19.660020+0000","last_unstale":"2023-08-10T10:46:21.672836+0000","last_undegraded":"2023-08-10T10:46:21.672836+0000","last_fullsized":"2023-08-10T10:46:21.672836+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:28:11.959424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676006+0000","last_change":"2023-08-10T10:46:20.676262+0000","last_active":"2023-08-10T10:46:21.676006+0000","last_peered":"2023-08-10T10:46:21.676006+0000","last_clean":"2023-08-10T10:46:21.676006+0000","last_became_active":"2023-08-10T10:46:20.675439+0000","last_became_peered":"2023-08-10T10:46:20.675439+0000","last_unstale":"2023-08-10T10:46:21.676006+0000","last_undegraded":"2023-08-10T10:46:21.676006+0000","last_fullsized":"2023-08-10T10:46:21.676006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:32.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674516+0000","last_change":"2023-08-10T10:46:19.661082+0000","last_active":"2023-08-10T10:46:21.674516+0000","last_peered":"2023-08-10T10:46:21.674516+0000","last_clean":"2023-08-10T10:46:21.674516+0000","last_became_active":"2023-08-10T10:46:19.660822+0000","last_became_peered":"2023-08-10T10:46:19.660822+0000","last_unstale":"2023-08-10T10:46:21.674516+0000","last_undegraded":"2023-08-10T10:46:21.674516+0000","last_fullsized":"2023-08-10T10:46:21.674516+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:22:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153244+0000","last_change":"2023-08-10T10:46:20.710644+0000","last_active":"2023-08-10T10:46:22.153244+0000","last_peered":"2023-08-10T10:46:22.153244+0000","last_clean":"2023-08-10T10:46:22.153244+0000","last_became_active":"2023-08-10T10:46:20.710048+0000","last_became_peered":"2023-08-10T10:46:20.710048+0000","last_unstale":"2023-08-10T10:46:22.153244+0000","last_undegraded":"2023-08-10T10:46:22.153244+0000","last_fullsized":"2023-08-10T10:46:22.153244+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:59.260966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153434+0000","last_change":"2023-08-10T10:46:19.657908+0000","last_active":"2023-08-10T10:46:22.153434+0000","last_peered":"2023-08-10T10:46:22.153434+0000","last_clean":"2023-08-10T10:46:22.153434+0000","last_became_active":"2023-08-10T10:46:19.657590+0000","last_became_peered":"2023-08-10T10:46:19.657590+0000","last_unstale":"2023-08-10T10:46:22.153434+0000","last_undegraded":"2023-08-10T10:46:22.153434+0000","last_fullsized":"2023-08-10T10:46:22.153434+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:16.123167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154443+0000","last_change":"2023-08-10T10:46:20.699626+0000","last_active":"2023-08-10T10:46:22.154443+0000","last_peered":"2023-08-10T10:46:22.154443+0000","last_clean":"2023-08-10T10:46:22.154443+0000","last_became_active":"2023-08-10T10:46:20.699353+0000","last_became_peered":"2023-08-10T10:46:20.699353+0000","last_unstale":"2023-08-10T10:46:22.154443+0000","last_undegraded":"2023-08-10T10:46:22.154443+0000","last_fullsized":"2023-08-10T10:46:22.154443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:11:09.539255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152046+0000","last_change":"2023-08-10T10:46:19.658812+0000","last_active":"2023-08-10T10:46:22.152046+0000","last_peered":"2023-08-10T10:46:22.152046+0000","last_clean":"2023-08-10T10:46:22.152046+0000","last_became_active":"2023-08-10T10:46:19.658483+0000","last_became_peered":"2023-08-10T10:46:19.658483+0000","last_unstale":"2023-08-10T10:46:22.152046+0000","last_undegraded":"2023-08-10T10:46:22.152046+0000","last_fullsized":"2023-08-10T10:46:22.152046+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:17.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152509+0000","last_change":"2023-08-10T10:46:20.709075+0000","last_active":"2023-08-10T10:46:22.152509+0000","last_peered":"2023-08-10T10:46:22.152509+0000","last_clean":"2023-08-10T10:46:22.152509+0000","last_became_active":"2023-08-10T10:46:20.708834+0000","last_became_peered":"2023-08-10T10:46:20.708834+0000","last_unstale":"2023-08-10T10:46:22.152509+0000","last_undegraded":"2023-08-10T10:46:22.152509+0000","last_fullsized":"2023-08-10T10:46:22.152509+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:09.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152132+0000","last_change":"2023-08-10T10:46:19.656846+0000","last_active":"2023-08-10T10:46:22.152132+0000","last_peered":"2023-08-10T10:46:22.152132+0000","last_clean":"2023-08-10T10:46:22.152132+0000","last_became_active":"2023-08-10T10:46:19.656006+0000","last_became_peered":"2023-08-10T10:46:19.656006+0000","last_unstale":"2023-08-10T10:46:22.152132+0000","last_undegraded":"2023-08-10T10:46:22.152132+0000","last_fullsized":"2023-08-10T10:46:22.152132+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:34.444606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151296+0000","last_change":"2023-08-10T10:46:20.699116+0000","last_active":"2023-08-10T10:46:22.151296+0000","last_peered":"2023-08-10T10:46:22.151296+0000","last_clean":"2023-08-10T10:46:22.151296+0000","last_became_active":"2023-08-10T10:46:20.698618+0000","last_became_peered":"2023-08-10T10:46:20.698618+0000","last_unstale":"2023-08-10T10:46:22.151296+0000","last_undegraded":"2023-08-10T10:46:22.151296+0000","last_fullsized":"2023-08-10T10:46:22.151296+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:39.737711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153128+0000","last_change":"2023-08-10T10:46:19.651480+0000","last_active":"2023-08-10T10:46:22.153128+0000","last_peered":"2023-08-10T10:46:22.153128+0000","last_clean":"2023-08-10T10:46:22.153128+0000","last_became_active":"2023-08-10T10:46:19.650935+0000","last_became_peered":"2023-08-10T10:46:19.650935+0000","last_unstale":"2023-08-10T10:46:22.153128+0000","last_undegraded":"2023-08-10T10:46:22.153128+0000","last_fullsized":"2023-08-10T10:46:22.153128+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:35.090088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150972+0000","last_change":"2023-08-10T10:46:20.704711+0000","last_active":"2023-08-10T10:46:22.150972+0000","last_peered":"2023-08-10T10:46:22.150972+0000","last_clean":"2023-08-10T10:46:22.150972+0000","last_became_active":"2023-08-10T10:46:20.704001+0000","last_became_peered":"2023-08-10T10:46:20.704001+0000","last_unstale":"2023-08-10T10:46:22.150972+0000","last_undegraded":"2023-08-10T10:46:22.150972+0000","last_fullsized":"2023-08-10T10:46:22.150972+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:03.433051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152194+0000","last_change":"2023-08-10T10:46:19.663017+0000","last_active":"2023-08-10T10:46:22.152194+0000","last_peered":"2023-08-10T10:46:22.152194+0000","last_clean":"2023-08-10T10:46:22.152194+0000","last_became_active":"2023-08-10T10:46:19.662779+0000","last_became_peered":"2023-08-10T10:46:19.662779+0000","last_unstale":"2023-08-10T10:46:22.152194+0000","last_undegraded":"2023-08-10T10:46:22.152194+0000","last_fullsized":"2023-08-10T10:46:22.152194+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:55.894813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155007+0000","last_change":"2023-08-10T10:46:20.705507+0000","last_active":"2023-08-10T10:46:22.155007+0000","last_peered":"2023-08-10T10:46:22.155007+0000","last_clean":"2023-08-10T10:46:22.155007+0000","last_became_active":"2023-08-10T10:46:20.705165+0000","last_became_peered":"2023-08-10T10:46:20.705165+0000","last_unstale":"2023-08-10T10:46:22.155007+0000","last_undegraded":"2023-08-10T10:46:22.155007+0000","last_fullsized":"2023-08-10T10:46:22.155007+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:19:54.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153771+0000","last_change":"2023-08-10T10:46:19.655068+0000","last_active":"2023-08-10T10:46:22.153771+0000","last_peered":"2023-08-10T10:46:22.153771+0000","last_clean":"2023-08-10T10:46:22.153771+0000","last_became_active":"2023-08-10T10:46:19.654602+0000","last_became_peered":"2023-08-10T10:46:19.654602+0000","last_unstale":"2023-08-10T10:46:22.153771+0000","last_undegraded":"2023-08-10T10:46:22.153771+0000","last_fullsized":"2023-08-10T10:46:22.153771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:04.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153674+0000","last_change":"2023-08-10T10:46:20.698038+0000","last_active":"2023-08-10T10:46:22.153674+0000","last_peered":"2023-08-10T10:46:22.153674+0000","last_clean":"2023-08-10T10:46:22.153674+0000","last_became_active":"2023-08-10T10:46:20.697074+0000","last_became_peered":"2023-08-10T10:46:20.697074+0000","last_unstale":"2023-08-10T10:46:22.153674+0000","last_undegraded":"2023-08-10T10:46:22.153674+0000","last_fullsized":"2023-08-10T10:46:22.153674+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:44.751483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153429+0000","last_change":"2023-08-10T10:46:19.658366+0000","last_active":"2023-08-10T10:46:22.153429+0000","last_peered":"2023-08-10T10:46:22.153429+0000","last_clean":"2023-08-10T10:46:22.153429+0000","last_became_active":"2023-08-10T10:46:19.657888+0000","last_became_peered":"2023-08-10T10:46:19.657888+0000","last_unstale":"2023-08-10T10:46:22.153429+0000","last_undegraded":"2023-08-10T10:46:22.153429+0000","last_fullsized":"2023-08-10T10:46:22.153429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:54:52.011689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672411+0000","last_change":"2023-08-10T10:46:20.700098+0000","last_active":"2023-08-10T10:46:21.672411+0000","last_peered":"2023-08-10T10:46:21.672411+0000","last_clean":"2023-08-10T10:46:21.672411+0000","last_became_active":"2023-08-10T10:46:20.699494+0000","last_became_peered":"2023-08-10T10:46:20.699494+0000","last_unstale":"2023-08-10T10:46:21.672411+0000","last_undegraded":"2023-08-10T10:46:21.672411+0000","last_fullsized":"2023-08-10T10:46:21.672411+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:23:29.802125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154124+0000","last_change":"2023-08-10T10:46:19.662307+0000","last_active":"2023-08-10T10:46:22.154124+0000","last_peered":"2023-08-10T10:46:22.154124+0000","last_clean":"2023-08-10T10:46:22.154124+0000","last_became_active":"2023-08-10T10:46:19.662111+0000","last_became_peered":"2023-08-10T10:46:19.662111+0000","last_unstale":"2023-08-10T10:46:22.154124+0000","last_undegraded":"2023-08-10T10:46:22.154124+0000","last_fullsized":"2023-08-10T10:46:22.154124+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:21.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155226+0000","last_change":"2023-08-10T10:46:20.687025+0000","last_active":"2023-08-10T10:46:22.155226+0000","last_peered":"2023-08-10T10:46:22.155226+0000","last_clean":"2023-08-10T10:46:22.155226+0000","last_became_active":"2023-08-10T10:46:20.686270+0000","last_became_peered":"2023-08-10T10:46:20.686270+0000","last_unstale":"2023-08-10T10:46:22.155226+0000","last_undegraded":"2023-08-10T10:46:22.155226+0000","last_fullsized":"2023-08-10T10:46:22.155226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:07.672138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152415+0000","last_change":"2023-08-10T10:46:19.660776+0000","last_active":"2023-08-10T10:46:22.152415+0000","last_peered":"2023-08-10T10:46:22.152415+0000","last_clean":"2023-08-10T10:46:22.152415+0000","last_became_active":"2023-08-10T10:46:19.660320+0000","last_became_peered":"2023-08-10T10:46:19.660320+0000","last_unstale":"2023-08-10T10:46:22.152415+0000","last_undegraded":"2023-08-10T10:46:22.152415+0000","last_fullsized":"2023-08-10T10:46:22.152415+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:35.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673961+0000","last_change":"2023-08-10T10:46:20.703446+0000","last_active":"2023-08-10T10:46:21.673961+0000","last_peered":"2023-08-10T10:46:21.673961+0000","last_clean":"2023-08-10T10:46:21.673961+0000","last_became_active":"2023-08-10T10:46:20.703183+0000","last_became_peered":"2023-08-10T10:46:20.703183+0000","last_unstale":"2023-08-10T10:46:21.673961+0000","last_undegraded":"2023-08-10T10:46:21.673961+0000","last_fullsized":"2023-08-10T10:46:21.673961+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:12.290482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153973+0000","last_change":"2023-08-10T10:46:19.663097+0000","last_active":"2023-08-10T10:46:22.153973+0000","last_peered":"2023-08-10T10:46:22.153973+0000","last_clean":"2023-08-10T10:46:22.153973+0000","last_became_active":"2023-08-10T10:46:19.662442+0000","last_became_peered":"2023-08-10T10:46:19.662442+0000","last_unstale":"2023-08-10T10:46:22.153973+0000","last_undegraded":"2023-08-10T10:46:22.153973+0000","last_fullsized":"2023-08-10T10:46:22.153973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:05.675860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151420+0000","last_change":"2023-08-10T10:46:20.695118+0000","last_active":"2023-08-10T10:46:22.151420+0000","last_peered":"2023-08-10T10:46:22.151420+0000","last_clean":"2023-08-10T10:46:22.151420+0000","last_became_active":"2023-08-10T10:46:20.694268+0000","last_became_peered":"2023-08-10T10:46:20.694268+0000","last_unstale":"2023-08-10T10:46:22.151420+0000","last_undegraded":"2023-08-10T10:46:22.151420+0000","last_fullsized":"2023-08-10T10:46:22.151420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:39.187207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676303+0000","last_change":"2023-08-10T10:46:19.655211+0000","last_active":"2023-08-10T10:46:21.676303+0000","last_peered":"2023-08-10T10:46:21.676303+0000","last_clean":"2023-08-10T10:46:21.676303+0000","last_became_active":"2023-08-10T10:46:19.654723+0000","last_became_peered":"2023-08-10T10:46:19.654723+0000","last_unstale":"2023-08-10T10:46:21.676303+0000","last_undegraded":"2023-08-10T10:46:21.676303+0000","last_fullsized":"2023-08-10T10:46:21.676303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:41.300929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151524+0000","last_change":"2023-08-10T10:46:20.710615+0000","last_active":"2023-08-10T10:46:22.151524+0000","last_peered":"2023-08-10T10:46:22.151524+0000","last_clean":"2023-08-10T10:46:22.151524+0000","last_became_active":"2023-08-10T10:46:20.707529+0000","last_became_peered":"2023-08-10T10:46:20.707529+0000","last_unstale":"2023-08-10T10:46:22.151524+0000","last_undegraded":"2023-08-10T10:46:22.151524+0000","last_fullsized":"2023-08-10T10:46:22.151524+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:50.303655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676054+0000","last_change":"2023-08-10T10:46:19.655501+0000","last_active":"2023-08-10T10:46:21.676054+0000","last_peered":"2023-08-10T10:46:21.676054+0000","last_clean":"2023-08-10T10:46:21.676054+0000","last_became_active":"2023-08-10T10:46:19.655077+0000","last_became_peered":"2023-08-10T10:46:19.655077+0000","last_unstale":"2023-08-10T10:46:21.676054+0000","last_undegraded":"2023-08-10T10:46:21.676054+0000","last_fullsized":"2023-08-10T10:46:21.676054+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:40.649983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151776+0000","last_change":"2023-08-10T10:46:20.695090+0000","last_active":"2023-08-10T10:46:22.151776+0000","last_peered":"2023-08-10T10:46:22.151776+0000","last_clean":"2023-08-10T10:46:22.151776+0000","last_became_active":"2023-08-10T10:46:20.694723+0000","last_became_peered":"2023-08-10T10:46:20.694723+0000","last_unstale":"2023-08-10T10:46:22.151776+0000","last_undegraded":"2023-08-10T10:46:22.151776+0000","last_fullsized":"2023-08-10T10:46:22.151776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:47.207011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152455+0000","last_change":"2023-08-10T10:46:19.662973+0000","last_active":"2023-08-10T10:46:22.152455+0000","last_peered":"2023-08-10T10:46:22.152455+0000","last_clean":"2023-08-10T10:46:22.152455+0000","last_became_active":"2023-08-10T10:46:19.662575+0000","last_became_peered":"2023-08-10T10:46:19.662575+0000","last_unstale":"2023-08-10T10:46:22.152455+0000","last_undegraded":"2023-08-10T10:46:22.152455+0000","last_fullsized":"2023-08-10T10:46:22.152455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:45:55.085569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672674+0000","last_change":"2023-08-10T10:46:20.686374+0000","last_active":"2023-08-10T10:46:21.672674+0000","last_peered":"2023-08-10T10:46:21.672674+0000","last_clean":"2023-08-10T10:46:21.672674+0000","last_became_active":"2023-08-10T10:46:20.685556+0000","last_became_peered":"2023-08-10T10:46:20.685556+0000","last_unstale":"2023-08-10T10:46:21.672674+0000","last_undegraded":"2023-08-10T10:46:21.672674+0000","last_fullsized":"2023-08-10T10:46:21.672674+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:42.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151924+0000","last_change":"2023-08-10T10:46:19.658369+0000","last_active":"2023-08-10T10:46:22.151924+0000","last_peered":"2023-08-10T10:46:22.151924+0000","last_clean":"2023-08-10T10:46:22.151924+0000","last_became_active":"2023-08-10T10:46:19.658075+0000","last_became_peered":"2023-08-10T10:46:19.658075+0000","last_unstale":"2023-08-10T10:46:22.151924+0000","last_undegraded":"2023-08-10T10:46:22.151924+0000","last_fullsized":"2023-08-10T10:46:22.151924+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:18:35.256220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154431+0000","last_change":"2023-08-10T10:46:20.702430+0000","last_active":"2023-08-10T10:46:22.154431+0000","last_peered":"2023-08-10T10:46:22.154431+0000","last_clean":"2023-08-10T10:46:22.154431+0000","last_became_active":"2023-08-10T10:46:20.702183+0000","last_became_peered":"2023-08-10T10:46:20.702183+0000","last_unstale":"2023-08-10T10:46:22.154431+0000","last_undegraded":"2023-08-10T10:46:22.154431+0000","last_fullsized":"2023-08-10T10:46:22.154431+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:48.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"142'8","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151868+0000","last_change":"2023-08-10T10:46:19.640383+0000","last_active":"2023-08-10T10:46:22.151868+0000","last_peered":"2023-08-10T10:46:22.151868+0000","last_clean":"2023-08-10T10:46:22.151868+0000","last_became_active":"2023-08-10T10:46:19.639727+0000","last_became_peered":"2023-08-10T10:46:19.639727+0000","last_unstale":"2023-08-10T10:46:22.151868+0000","last_undegraded":"2023-08-10T10:46:22.151868+0000","last_fullsized":"2023-08-10T10:46:22.151868+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:24.118506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153373+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:46:22.153373+0000","last_peered":"2023-08-10T10:46:22.153373+0000","last_clean":"2023-08-10T10:46:22.153373+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:46:22.153373+0000","last_undegraded":"2023-08-10T10:46:22.153373+0000","last_fullsized":"2023-08-10T10:46:22.153373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:44.046165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153288+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:46:22.153288+0000","last_peered":"2023-08-10T10:46:22.153288+0000","last_clean":"2023-08-10T10:46:22.153288+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:46:22.153288+0000","last_undegraded":"2023-08-10T10:46:22.153288+0000","last_fullsized":"2023-08-10T10:46:22.153288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:10.051636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153413+0000","last_change":"2023-08-10T10:46:20.707317+0000","last_active":"2023-08-10T10:46:22.153413+0000","last_peered":"2023-08-10T10:46:22.153413+0000","last_clean":"2023-08-10T10:46:22.153413+0000","last_became_active":"2023-08-10T10:46:20.706893+0000","last_became_peered":"2023-08-10T10:46:20.706893+0000","last_unstale":"2023-08-10T10:46:22.153413+0000","last_undegraded":"2023-08-10T10:46:22.153413+0000","last_fullsized":"2023-08-10T10:46:22.153413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:02.201155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151877+0000","last_change":"2023-08-10T10:46:19.640710+0000","last_active":"2023-08-10T10:46:22.151877+0000","last_peered":"2023-08-10T10:46:22.151877+0000","last_clean":"2023-08-10T10:46:22.151877+0000","last_became_active":"2023-08-10T10:46:19.640061+0000","last_became_peered":"2023-08-10T10:46:19.640061+0000","last_unstale":"2023-08-10T10:46:22.151877+0000","last_undegraded":"2023-08-10T10:46:22.151877+0000","last_fullsized":"2023-08-10T10:46:22.151877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:49.058902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152727+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:46:22.152727+0000","last_peered":"2023-08-10T10:46:22.152727+0000","last_clean":"2023-08-10T10:46:22.152727+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:46:22.152727+0000","last_undegraded":"2023-08-10T10:46:22.152727+0000","last_fullsized":"2023-08-10T10:46:22.152727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:18.217287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672625+0000","last_change":"2023-08-10T10:46:20.685361+0000","last_active":"2023-08-10T10:46:21.672625+0000","last_peered":"2023-08-10T10:46:21.672625+0000","last_clean":"2023-08-10T10:46:21.672625+0000","last_became_active":"2023-08-10T10:46:20.684718+0000","last_became_peered":"2023-08-10T10:46:20.684718+0000","last_unstale":"2023-08-10T10:46:21.672625+0000","last_undegraded":"2023-08-10T10:46:21.672625+0000","last_fullsized":"2023-08-10T10:46:21.672625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:46.554591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151854+0000","last_change":"2023-08-10T10:46:19.659098+0000","last_active":"2023-08-10T10:46:22.151854+0000","last_peered":"2023-08-10T10:46:22.151854+0000","last_clean":"2023-08-10T10:46:22.151854+0000","last_became_active":"2023-08-10T10:46:19.658740+0000","last_became_peered":"2023-08-10T10:46:19.658740+0000","last_unstale":"2023-08-10T10:46:22.151854+0000","last_undegraded":"2023-08-10T10:46:22.151854+0000","last_fullsized":"2023-08-10T10:46:22.151854+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:10.650820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":234,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673961+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:46:21.673961+0000","last_peered":"2023-08-10T10:46:21.673961+0000","last_clean":"2023-08-10T10:46:21.673961+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:46:21.673961+0000","last_undegraded":"2023-08-10T10:46:21.673961+0000","last_fullsized":"2023-08-10T10:46:21.673961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:48.775694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674315+0000","last_change":"2023-08-10T10:46:20.713039+0000","last_active":"2023-08-10T10:46:21.674315+0000","last_peered":"2023-08-10T10:46:21.674315+0000","last_clean":"2023-08-10T10:46:21.674315+0000","last_became_active":"2023-08-10T10:46:20.708073+0000","last_became_peered":"2023-08-10T10:46:20.708073+0000","last_unstale":"2023-08-10T10:46:21.674315+0000","last_undegraded":"2023-08-10T10:46:21.674315+0000","last_fullsized":"2023-08-10T10:46:21.674315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:58.714669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151688+0000","last_change":"2023-08-10T10:46:19.650083+0000","last_active":"2023-08-10T10:46:22.151688+0000","last_peered":"2023-08-10T10:46:22.151688+0000","last_clean":"2023-08-10T10:46:22.151688+0000","last_became_active":"2023-08-10T10:46:19.649413+0000","last_became_peered":"2023-08-10T10:46:19.649413+0000","last_unstale":"2023-08-10T10:46:22.151688+0000","last_undegraded":"2023-08-10T10:46:22.151688+0000","last_fullsized":"2023-08-10T10:46:22.151688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.029501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152534+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:46:22.152534+0000","last_peered":"2023-08-10T10:46:22.152534+0000","last_clean":"2023-08-10T10:46:22.152534+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:46:22.152534+0000","last_undegraded":"2023-08-10T10:46:22.152534+0000","last_fullsized":"2023-08-10T10:46:22.152534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:25:31.424509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151936+0000","last_change":"2023-08-10T10:46:20.698398+0000","last_active":"2023-08-10T10:46:22.151936+0000","last_peered":"2023-08-10T10:46:22.151936+0000","last_clean":"2023-08-10T10:46:22.151936+0000","last_became_active":"2023-08-10T10:46:20.697752+0000","last_became_peered":"2023-08-10T10:46:20.697752+0000","last_unstale":"2023-08-10T10:46:22.151936+0000","last_undegraded":"2023-08-10T10:46:22.151936+0000","last_fullsized":"2023-08-10T10:46:22.151936+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:56:09.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154013+0000","last_change":"2023-08-10T10:46:19.660033+0000","last_active":"2023-08-10T10:46:22.154013+0000","last_peered":"2023-08-10T10:46:22.154013+0000","last_clean":"2023-08-10T10:46:22.154013+0000","last_became_active":"2023-08-10T10:46:19.659719+0000","last_became_peered":"2023-08-10T10:46:19.659719+0000","last_unstale":"2023-08-10T10:46:22.154013+0000","last_undegraded":"2023-08-10T10:46:22.154013+0000","last_fullsized":"2023-08-10T10:46:22.154013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:38.767277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":248,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673125+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:46:21.673125+0000","last_peered":"2023-08-10T10:46:21.673125+0000","last_clean":"2023-08-10T10:46:21.673125+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:46:21.673125+0000","last_undegraded":"2023-08-10T10:46:21.673125+0000","last_fullsized":"2023-08-10T10:46:21.673125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:03.593810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154845+0000","last_change":"2023-08-10T10:46:20.706039+0000","last_active":"2023-08-10T10:46:22.154845+0000","last_peered":"2023-08-10T10:46:22.154845+0000","last_clean":"2023-08-10T10:46:22.154845+0000","last_became_active":"2023-08-10T10:46:20.705876+0000","last_became_peered":"2023-08-10T10:46:20.705876+0000","last_unstale":"2023-08-10T10:46:22.154845+0000","last_undegraded":"2023-08-10T10:46:22.154845+0000","last_fullsized":"2023-08-10T10:46:22.154845+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:39.367323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152334+0000","last_change":"2023-08-10T10:46:19.656941+0000","last_active":"2023-08-10T10:46:22.152334+0000","last_peered":"2023-08-10T10:46:22.152334+0000","last_clean":"2023-08-10T10:46:22.152334+0000","last_became_active":"2023-08-10T10:46:19.653848+0000","last_became_peered":"2023-08-10T10:46:19.653848+0000","last_unstale":"2023-08-10T10:46:22.152334+0000","last_undegraded":"2023-08-10T10:46:22.152334+0000","last_fullsized":"2023-08-10T10:46:22.152334+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:44.220205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152414+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:46:22.152414+0000","last_peered":"2023-08-10T10:46:22.152414+0000","last_clean":"2023-08-10T10:46:22.152414+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:46:22.152414+0000","last_undegraded":"2023-08-10T10:46:22.152414+0000","last_fullsized":"2023-08-10T10:46:22.152414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:07.702202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151347+0000","last_change":"2023-08-10T10:46:20.702722+0000","last_active":"2023-08-10T10:46:22.151347+0000","last_peered":"2023-08-10T10:46:22.151347+0000","last_clean":"2023-08-10T10:46:22.151347+0000","last_became_active":"2023-08-10T10:46:20.702263+0000","last_became_peered":"2023-08-10T10:46:20.702263+0000","last_unstale":"2023-08-10T10:46:22.151347+0000","last_undegraded":"2023-08-10T10:46:22.151347+0000","last_fullsized":"2023-08-10T10:46:22.151347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:08.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"142'3","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155175+0000","last_change":"2023-08-10T10:46:19.656322+0000","last_active":"2023-08-10T10:46:22.155175+0000","last_peered":"2023-08-10T10:46:22.155175+0000","last_clean":"2023-08-10T10:46:22.155175+0000","last_became_active":"2023-08-10T10:46:19.652897+0000","last_became_peered":"2023-08-10T10:46:19.652897+0000","last_unstale":"2023-08-10T10:46:22.155175+0000","last_undegraded":"2023-08-10T10:46:22.155175+0000","last_fullsized":"2023-08-10T10:46:22.155175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:33.847573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672436+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:46:21.672436+0000","last_peered":"2023-08-10T10:46:21.672436+0000","last_clean":"2023-08-10T10:46:21.672436+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:46:21.672436+0000","last_undegraded":"2023-08-10T10:46:21.672436+0000","last_fullsized":"2023-08-10T10:46:21.672436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.707693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152703+0000","last_change":"2023-08-10T10:46:20.707995+0000","last_active":"2023-08-10T10:46:22.152703+0000","last_peered":"2023-08-10T10:46:22.152703+0000","last_clean":"2023-08-10T10:46:22.152703+0000","last_became_active":"2023-08-10T10:46:20.707730+0000","last_became_peered":"2023-08-10T10:46:20.707730+0000","last_unstale":"2023-08-10T10:46:22.152703+0000","last_undegraded":"2023-08-10T10:46:22.152703+0000","last_fullsized":"2023-08-10T10:46:22.152703+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:09.856813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"142'6","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151347+0000","last_change":"2023-08-10T10:46:19.640327+0000","last_active":"2023-08-10T10:46:22.151347+0000","last_peered":"2023-08-10T10:46:22.151347+0000","last_clean":"2023-08-10T10:46:22.151347+0000","last_became_active":"2023-08-10T10:46:19.639634+0000","last_became_peered":"2023-08-10T10:46:19.639634+0000","last_unstale":"2023-08-10T10:46:22.151347+0000","last_undegraded":"2023-08-10T10:46:22.151347+0000","last_fullsized":"2023-08-10T10:46:22.151347+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:58.815817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151569+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:46:22.151569+0000","last_peered":"2023-08-10T10:46:22.151569+0000","last_clean":"2023-08-10T10:46:22.151569+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:46:22.151569+0000","last_undegraded":"2023-08-10T10:46:22.151569+0000","last_fullsized":"2023-08-10T10:46:22.151569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:03.764202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1406,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198559481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1000000000000001,"15min":1.1279999999999999},"min":{"1min":0.57999999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.2},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.0840000000000001},"min":{"1min":0.58999999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":5.149,"15min":5.149},"last":0.872}]},{"osd":1,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.173,"15min":1.1419999999999999},"min":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.1519999999999999,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.196,"15min":1.2170000000000001},"min":{"1min":0.70199999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5229999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.524},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.21,"15min":1.212},"min":{"1min":0.76300000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.556,"5min":1.766,"15min":1.766},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.98599999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.329}]},{"osd":4,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.26,"15min":1.236},"min":{"1min":0.85399999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.825,"5min":1.99,"15min":1.99},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.3089999999999999,"15min":1.2729999999999999},"min":{"1min":0.755,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.74,"5min":6.657,"15min":6.657},"last":1.6579999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.1659999999999999,"5min":0.60599999999999998,"15min":0.59699999999999998},"max":{"1min":3.3940000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.488},"min":{"1min":0.95599999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0699999999999998,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.764}]},{"osd":6,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5349999999999999,"15min":1.5740000000000001},"min":{"1min":1.238,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.3140000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.569},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.484,"15min":1.4970000000000001},"min":{"1min":1.077,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0099999999999998,"5min":3.585,"15min":3.585},"last":1.8129999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199150043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.113,"15min":1.0589999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6279999999999999,"5min":1.75,"15min":1.7509999999999999},"last":1.288},{"interface":"front","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.01},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.46600000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":0.90300000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1140000000000001,"15min":1.069},"min":{"1min":0.72399999999999998,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.302,"15min":2.302},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.256,"15min":1.1830000000000001},"min":{"1min":0.83899999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.819,"5min":2.052,"15min":2.052},"last":1.194}]},{"osd":2,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.198,"15min":1.139},"min":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.72299999999999998},"max":{"1min":1.7230000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.262},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2749999999999999,"15min":1.2270000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6339999999999999,"5min":1.968,"15min":1.968},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3460000000000001,"15min":1.228},"min":{"1min":0.80700000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6719999999999999,"5min":3.177,"15min":3.177},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.321,"15min":1.262},"min":{"1min":0.84299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.71,"5min":2.395,"15min":2.395},"last":1.123}]},{"osd":4,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2829999999999999,"15min":1.214},"min":{"1min":0.60699999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.7010000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.494,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":2.0009999999999999,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.478,"15min":1.407},"min":{"1min":0.69999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.802,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.163},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5760000000000001,"15min":1.4990000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":2.1139999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.429,"15min":1.371},"min":{"1min":1.0089999999999999,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":2.0600000000000001,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5589999999999999,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.016,"5min":2.5819999999999999,"15min":2.698},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199151484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1339999999999999,"15min":1.0920000000000001},"min":{"1min":0.73299999999999998,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":2.5070000000000001},"last":1.21},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.4790000000000001,"15min":1.214},"min":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.64000000000000001},"max":{"1min":1.6899999999999999,"5min":32.941000000000003,"15min":32.941000000000003},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.68899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.762,"5min":1.762,"15min":2.2450000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.165,"15min":1.208},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.651,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.117}]},{"osd":2,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.24,"15min":1.323},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.857,"5min":1.857,"15min":4.1980000000000004},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1950000000000001,"15min":1.159},"min":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5920000000000001,"5min":1.653,"15min":1.73},"last":1.337}]},{"osd":3,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.26},"min":{"1min":0.81899999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7410000000000001,"5min":1.7669999999999999,"15min":1.7709999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3080000000000001,"15min":1.363},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.397}]},{"osd":4,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.2310000000000001,"15min":1.2869999999999999},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.518},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3660000000000001,"15min":1.3600000000000001},"min":{"1min":0.85299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7689999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3879999999999999,"15min":1.3280000000000001},"min":{"1min":0.80200000000000005,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3979999999999999,"15min":1.387},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":1.9650000000000001,"15min":1.98},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4830000000000001,"15min":1.488},"min":{"1min":0.90400000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.831,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.498,"15min":1.4910000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.5369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":2.2559999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.538,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.907}]},{"osd":1,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.286},"min":{"1min":0.93100000000000005,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.7809999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.242},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.159,"15min":1.141},"min":{"1min":0.747,"5min":0.67900000000000005,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2050000000000001,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.66000000000000003,"15min":0.621},"max":{"1min":1.48,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.347,"15min":1.304},"min":{"1min":1.083,"5min":0.85099999999999998,"15min":0.70499999999999996},"max":{"1min":1.835,"5min":4.226,"15min":4.226},"last":1.7989999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3069999999999999,"15min":1.256},"min":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.893,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3700000000000001,"15min":1.2909999999999999},"min":{"1min":0.91500000000000004,"5min":0.82699999999999996,"15min":0.67000000000000004},"max":{"1min":2.5600000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.091}]},{"osd":5,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.385,"15min":1.363},"min":{"1min":0.876,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":1.863,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.51},{"interface":"front","average":{"1min":1.252,"5min":1.3340000000000001,"15min":1.298},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.42399999999999999},"max":{"1min":1.6859999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.7390000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.375,"15min":1.335},"min":{"1min":0.746,"5min":0.746,"15min":0.47599999999999998},"max":{"1min":2.6190000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5429999999999999,"15min":1.4790000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.76700000000000002},"max":{"1min":1.7529999999999999,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.992}]},{"osd":7,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.502,"15min":1.4339999999999999},"min":{"1min":0.999,"5min":0.82699999999999996,"15min":0.57999999999999996},"max":{"1min":1.8859999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5880000000000001,"15min":1.5189999999999999},"min":{"1min":1.054,"5min":0.96699999999999997,"15min":0.73499999999999999},"max":{"1min":2.6659999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.76}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92500000000000004,"15min":0.84299999999999997},"min":{"1min":0.56899999999999995,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.4990000000000001,"5min":1.629,"15min":2.1019999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.167,"15min":1.0029999999999999},"min":{"1min":0.55500000000000005,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.627,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94699999999999995,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.4370000000000001,"5min":1.5569999999999999,"15min":1.6599999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0820000000000001,"15min":0.95199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.34100000000000003},"max":{"1min":1.615,"5min":1.752,"15min":1.897},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0369999999999999,"15min":0.94999999999999996},"min":{"1min":0.48599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5349999999999999,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1739999999999999,"15min":1.0760000000000001},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.46899999999999997},"max":{"1min":1.514,"5min":1.958,"15min":2.0430000000000001},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.4159999999999999,"15min":1.2669999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.70599999999999996},"max":{"1min":1.6120000000000001,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.2050000000000001},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":1.786,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.409,"15min":1.3320000000000001},"min":{"1min":0.94599999999999995,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":1.889,"5min":1.889,"15min":2.125},"last":1.179},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4390000000000001,"15min":1.3680000000000001},"min":{"1min":0.91600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.736,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3779999999999999,"15min":1.2809999999999999},"min":{"1min":0.97199999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.663,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.403},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.8280000000000001,"5min":1.984,"15min":2.1539999999999999},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.4970000000000001,"15min":1.4319999999999999},"min":{"1min":1.0069999999999999,"5min":0.81699999999999995,"15min":0.754},"max":{"1min":1.7410000000000001,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4219999999999999,"15min":1.3440000000000001},"min":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7290000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199150625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.3540000000000001,"5min":1.464,"15min":1.5209999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.90400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6000000000000001,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.6000000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.1200000000000001,"15min":1.05},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.23,"15min":1.1279999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.835,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.835}]},{"osd":3,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1,"15min":0.995},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.50900000000000001},"max":{"1min":1.3740000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.2130000000000001,"15min":1.23},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5920000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.206}]},{"osd":4,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.393,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.84499999999999997,"15min":0.82699999999999996},"max":{"1min":1.7150000000000001,"5min":2.415,"15min":2.6000000000000001},"last":1.341},{"interface":"front","average":{"1min":1.163,"5min":1.3580000000000001,"15min":1.3080000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.306,"15min":1.2689999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6439999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.486,"15min":1.4710000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.806,"5min":3.294,"15min":3.294},"last":1.5549999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4530000000000001,"15min":1.3859999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":1.821,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.4159999999999999,"15min":1.355},"min":{"1min":0.97399999999999998,"5min":0.86499999999999999,"15min":0.79700000000000004},"max":{"1min":1.7050000000000001,"5min":2.444,"15min":2.444},"last":1.647}]},{"osd":7,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5229999999999999,"15min":1.419},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4650000000000001,"15min":1.421},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.81100000000000005},"max":{"1min":1.788,"5min":2.556,"15min":2.556},"last":1.714}]}]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199150603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89700000000000002,"15min":0.83799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.4259999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99299999999999999,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":1.4910000000000001,"5min":2.012,"15min":2.246},"last":0.752}]},{"osd":2,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0169999999999999,"15min":0.89900000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.436},"max":{"1min":1.6220000000000001,"5min":1.792,"15min":2.0209999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.22,"15min":1.083},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45600000000000002},"max":{"1min":1.7370000000000001,"5min":1.7589999999999999,"15min":2.423},"last":1.048}]},{"osd":3,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1910000000000001,"15min":1.073},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.9910000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.0409999999999999},"min":{"1min":0.65300000000000002,"5min":0.45200000000000001,"15min":0.42399999999999999},"max":{"1min":1.4530000000000001,"5min":1.9059999999999999,"15min":2.8940000000000001},"last":1.323}]},{"osd":4,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.1850000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":2.0259999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.022},{"interface":"front","average":{"1min":1.452,"5min":1.4670000000000001,"15min":1.399},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.0830000000000002,"5min":2.343,"15min":2.343},"last":1.5}]},{"osd":5,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.423,"15min":1.371},"min":{"1min":0.93100000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.913,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4279999999999999,"15min":1.331},"min":{"1min":0.94599999999999995,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":1.962,"5min":2.73,"15min":2.73},"last":1.371}]},{"osd":6,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.429,"15min":1.3720000000000001},"min":{"1min":0.82899999999999996,"5min":0.81399999999999995,"15min":0.78400000000000003},"max":{"1min":1.8440000000000001,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.425,"15min":1.284},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":2.0800000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.097}]},{"osd":7,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.5049999999999999,"15min":1.4430000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.742},"last":1.399},{"interface":"front","average":{"1min":1.482,"5min":1.504,"15min":1.411},"min":{"1min":0.85099999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.9830000000000001,"5min":2.1640000000000001,"15min":2.605},"last":1.4470000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193907,"statfs":{"total":200000000,"available":198561254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.27,"5min":1.546,"15min":1.546},"last":1.046},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.0369999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.411,"5min":1.633,"15min":1.853},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.026,"15min":1.0249999999999999},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.5760000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.256},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.617,"5min":1.7,"15min":1.7},"last":1.089}]},{"osd":3,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.034,"15min":0.95599999999999996},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.585,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1970000000000001,"15min":1.117},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.9670000000000001,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":1.393}]},{"osd":4,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.387,"15min":1.282},"min":{"1min":1.1220000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.734,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.726},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4099999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.883,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.7749999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.736,"5min":1.9259999999999999,"15min":1.986},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.5409999999999999,"15min":1.353},"min":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6719999999999999,"5min":16.058,"15min":16.058},"last":1.302}]},{"osd":6,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.482,"15min":1.456},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8220000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.657},{"interface":"front","average":{"1min":1.407,"5min":1.4430000000000001,"15min":1.4339999999999999},"min":{"1min":0.94199999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9179999999999999,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.5049999999999999,"15min":1.522},"min":{"1min":1.038,"5min":0.752,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4990000000000001,"15min":1.423},"min":{"1min":1.0389999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.778,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.601}]}]}],"pool_statfs":[]}} 2023-08-10T10:46:25.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:46:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.438+0000 7fc6c1d24640 1 Processor -- start 2023-08-10T10:46:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.438+0000 7fc6c1d24640 1 -- start start 2023-08-10T10:46:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6c1d24640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6bc15aa40 0x7fc6bc0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6c1d24640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6c1d24640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc071c70 con 0x7fc6bc070e80 2023-08-10T10:46:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6c1d24640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0713d0 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6c1d24640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0716b0 con 0x7fc6bc15aa40 2023-08-10T10:46:25.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.440+0000 7fc6b2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51946/0 (socket says 172.21.15.50:51946) 2023-08-10T10:46:25.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 -- 172.21.15.50:0/3063281781 learned_addr learned my addr 172.21.15.50:0/3063281781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:25.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6bb7fe640 1 --2- 172.21.15.50:0/3063281781 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc15aa40 0x7fc6bc0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 -- 172.21.15.50:0/3063281781 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc15aa40 msgr2=0x7fc6bc0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:25.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 --2- 172.21.15.50:0/3063281781 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc15aa40 0x7fc6bc0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 -- 172.21.15.50:0/3063281781 >> v1:172.21.15.117:6789/0 conn(0x7fc6bc070e80 legacy=0x7fc6bc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:25.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.441+0000 7fc6b2ffd640 1 -- 172.21.15.50:0/3063281781 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc071990 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.443+0000 7fc6b2ffd640 1 --2- 172.21.15.50:0/3063281781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c8dc0 tx=0x7fc6a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d754ca62221613b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6baffd640 1 -- 172.21.15.50:0/3063281781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4031870 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6baffd640 1 -- 172.21.15.50:0/3063281781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40319d0 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6baffd640 1 -- 172.21.15.50:0/3063281781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4031d60 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 -- 172.21.15.50:0/3063281781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0b0c60 msgr2=0x7fc6bc0b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/3063281781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c8dc0 tx=0x7fc6a402b910 comp rx=0 tx=0).stop 2023-08-10T10:46:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 -- 172.21.15.50:0/3063281781 shutdown_connections 2023-08-10T10:46:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/3063281781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b3d60 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/3063281781 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc15aa40 0x7fc6bc0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 -- 172.21.15.50:0/3063281781 >> 172.21.15.50:0/3063281781 conn(0x7fc6bc06b590 msgr2=0x7fc6bc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.444+0000 7fc6c1d24640 1 -- 172.21.15.50:0/3063281781 shutdown_connections 2023-08-10T10:46:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.445+0000 7fc6c1d24640 1 -- 172.21.15.50:0/3063281781 wait complete. 2023-08-10T10:46:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.446+0000 7fc6c1d24640 1 Processor -- start 2023-08-10T10:46:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.447+0000 7fc6c1d24640 1 -- start start 2023-08-10T10:46:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc15aa40 0x7fc6bc15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0b3100 con 0x7fc6bc070e80 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0b2b40 con 0x7fc6bc0b0c60 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6c1d24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0b2e20 con 0x7fc6bc15aa40 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51954/0 (socket says 172.21.15.50:51954) 2023-08-10T10:46:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 -- 172.21.15.50:0/601505560 learned_addr learned my addr 172.21.15.50:0/601505560 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6b2ffd640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bbfff640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc15aa40 0x7fc6bc15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 -- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc15aa40 msgr2=0x7fc6bc15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc15aa40 0x7fc6bc15daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 -- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc0b0c60 msgr2=0x7fc6bc0b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.448+0000 7fc6bb7fe640 1 -- 172.21.15.50:0/601505560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40094d0 con 0x7fc6bc070e80 2023-08-10T10:46:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6bb7fe640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00d5f0 tx=0x7fc6ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0125f0 con 0x7fc6bc070e80 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac012750 con 0x7fc6bc070e80 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc1572d0 con 0x7fc6bc070e80 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac012b00 con 0x7fc6bc070e80 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.449+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1517e0 con 0x7fc6bc070e80 2023-08-10T10:46:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.450+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc04e270 con 0x7fc6bc070e80 2023-08-10T10:46:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.451+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6ac012c60 con 0x7fc6bc070e80 2023-08-10T10:46:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.453+0000 7fc6b8ff9640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 0x7fc69c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.453+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6ac089a60 con 0x7fc6bc070e80 2023-08-10T10:46:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.453+0000 7fc6b2ffd640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 0x7fc69c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.454+0000 7fc6b2ffd640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 0x7fc69c06d110 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4036000 tx=0x7fc6a403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:25.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.457+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc6ac054a70 con 0x7fc6bc070e80 2023-08-10T10:46:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.645+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6bc157790 con 0x7fc69c06ac50 2023-08-10T10:46:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.668+0000 7fc6b8ff9640 1 -- 172.21.15.50:0/601505560 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303191 (secure 0 0 0) 0x7fc6bc157790 con 0x7fc69c06ac50 2023-08-10T10:46:25.672 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:25.673 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:46:25.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.674+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 msgr2=0x7fc69c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.674+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 0x7fc69c06d110 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4036000 tx=0x7fc6a403c040 comp rx=0 tx=0).stop 2023-08-10T10:46:25.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.674+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 msgr2=0x7fc6bc151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.674+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00d5f0 tx=0x7fc6ac00dab0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 shutdown_connections 2023-08-10T10:46:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc15aa40 0x7fc6bc15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc69c06ac50 0x7fc69c06d110 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc0b0c60 0x7fc6bc0b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 --2- 172.21.15.50:0/601505560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc070e80 0x7fc6bc151aa0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 >> 172.21.15.50:0/601505560 conn(0x7fc6bc06b590 msgr2=0x7fc6bc0cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:25.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 shutdown_connections 2023-08-10T10:46:25.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.675+0000 7fc6c1d24640 1 -- 172.21.15.50:0/601505560 wait complete. 2023-08-10T10:46:25.696 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2023-08-10T10:46:24.485553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7791,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554708,"statfs":{"total":1600000000,"available":1592021578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.859817"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675000+0000","last_change":"2023-08-10T10:46:20.684808+0000","last_active":"2023-08-10T10:46:21.675000+0000","last_peered":"2023-08-10T10:46:21.675000+0000","last_clean":"2023-08-10T10:46:21.675000+0000","last_became_active":"2023-08-10T10:46:20.684123+0000","last_became_peered":"2023-08-10T10:46:20.684123+0000","last_unstale":"2023-08-10T10:46:21.675000+0000","last_undegraded":"2023-08-10T10:46:21.675000+0000","last_fullsized":"2023-08-10T10:46:21.675000+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:50.303655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150802+0000","last_change":"2023-08-10T10:46:20.679983+0000","last_active":"2023-08-10T10:46:22.150802+0000","last_peered":"2023-08-10T10:46:22.150802+0000","last_clean":"2023-08-10T10:46:22.150802+0000","last_became_active":"2023-08-10T10:46:20.679205+0000","last_became_peered":"2023-08-10T10:46:20.679205+0000","last_unstale":"2023-08-10T10:46:22.150802+0000","last_undegraded":"2023-08-10T10:46:22.150802+0000","last_fullsized":"2023-08-10T10:46:22.150802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:51.249104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150830+0000","last_change":"2023-08-10T10:46:20.712855+0000","last_active":"2023-08-10T10:46:22.150830+0000","last_peered":"2023-08-10T10:46:22.150830+0000","last_clean":"2023-08-10T10:46:22.150830+0000","last_became_active":"2023-08-10T10:46:20.709450+0000","last_became_peered":"2023-08-10T10:46:20.709450+0000","last_unstale":"2023-08-10T10:46:22.150830+0000","last_undegraded":"2023-08-10T10:46:22.150830+0000","last_fullsized":"2023-08-10T10:46:22.150830+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:43.567741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152233+0000","last_change":"2023-08-10T10:46:20.685373+0000","last_active":"2023-08-10T10:46:22.152233+0000","last_peered":"2023-08-10T10:46:22.152233+0000","last_clean":"2023-08-10T10:46:22.152233+0000","last_became_active":"2023-08-10T10:46:20.684335+0000","last_became_peered":"2023-08-10T10:46:20.684335+0000","last_unstale":"2023-08-10T10:46:22.152233+0000","last_undegraded":"2023-08-10T10:46:22.152233+0000","last_fullsized":"2023-08-10T10:46:22.152233+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:10.960908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675297+0000","last_change":"2023-08-10T10:46:20.693984+0000","last_active":"2023-08-10T10:46:21.675297+0000","last_peered":"2023-08-10T10:46:21.675297+0000","last_clean":"2023-08-10T10:46:21.675297+0000","last_became_active":"2023-08-10T10:46:20.693561+0000","last_became_peered":"2023-08-10T10:46:20.693561+0000","last_unstale":"2023-08-10T10:46:21.675297+0000","last_undegraded":"2023-08-10T10:46:21.675297+0000","last_fullsized":"2023-08-10T10:46:21.675297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:25.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152238+0000","last_change":"2023-08-10T10:46:20.710524+0000","last_active":"2023-08-10T10:46:22.152238+0000","last_peered":"2023-08-10T10:46:22.152238+0000","last_clean":"2023-08-10T10:46:22.152238+0000","last_became_active":"2023-08-10T10:46:20.710259+0000","last_became_peered":"2023-08-10T10:46:20.710259+0000","last_unstale":"2023-08-10T10:46:22.152238+0000","last_undegraded":"2023-08-10T10:46:22.152238+0000","last_fullsized":"2023-08-10T10:46:22.152238+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:35.275585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152371+0000","last_change":"2023-08-10T10:46:20.709301+0000","last_active":"2023-08-10T10:46:22.152371+0000","last_peered":"2023-08-10T10:46:22.152371+0000","last_clean":"2023-08-10T10:46:22.152371+0000","last_became_active":"2023-08-10T10:46:20.698165+0000","last_became_peered":"2023-08-10T10:46:20.698165+0000","last_unstale":"2023-08-10T10:46:22.152371+0000","last_undegraded":"2023-08-10T10:46:22.152371+0000","last_fullsized":"2023-08-10T10:46:22.152371+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:06.714423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152088+0000","last_change":"2023-08-10T10:46:20.711049+0000","last_active":"2023-08-10T10:46:22.152088+0000","last_peered":"2023-08-10T10:46:22.152088+0000","last_clean":"2023-08-10T10:46:22.152088+0000","last_became_active":"2023-08-10T10:46:20.708386+0000","last_became_peered":"2023-08-10T10:46:20.708386+0000","last_unstale":"2023-08-10T10:46:22.152088+0000","last_undegraded":"2023-08-10T10:46:22.152088+0000","last_fullsized":"2023-08-10T10:46:22.152088+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:55.921576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151618+0000","last_change":"2023-08-10T10:46:20.684987+0000","last_active":"2023-08-10T10:46:22.151618+0000","last_peered":"2023-08-10T10:46:22.151618+0000","last_clean":"2023-08-10T10:46:22.151618+0000","last_became_active":"2023-08-10T10:46:20.683324+0000","last_became_peered":"2023-08-10T10:46:20.683324+0000","last_unstale":"2023-08-10T10:46:22.151618+0000","last_undegraded":"2023-08-10T10:46:22.151618+0000","last_fullsized":"2023-08-10T10:46:22.151618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.772259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672869+0000","last_change":"2023-08-10T10:46:20.702843+0000","last_active":"2023-08-10T10:46:21.672869+0000","last_peered":"2023-08-10T10:46:21.672869+0000","last_clean":"2023-08-10T10:46:21.672869+0000","last_became_active":"2023-08-10T10:46:20.702245+0000","last_became_peered":"2023-08-10T10:46:20.702245+0000","last_unstale":"2023-08-10T10:46:21.672869+0000","last_undegraded":"2023-08-10T10:46:21.672869+0000","last_fullsized":"2023-08-10T10:46:21.672869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:49:51.530075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675610+0000","last_change":"2023-08-10T10:46:20.698132+0000","last_active":"2023-08-10T10:46:21.675610+0000","last_peered":"2023-08-10T10:46:21.675610+0000","last_clean":"2023-08-10T10:46:21.675610+0000","last_became_active":"2023-08-10T10:46:20.697812+0000","last_became_peered":"2023-08-10T10:46:20.697812+0000","last_unstale":"2023-08-10T10:46:21.675610+0000","last_undegraded":"2023-08-10T10:46:21.675610+0000","last_fullsized":"2023-08-10T10:46:21.675610+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:50.073828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152743+0000","last_change":"2023-08-10T10:46:20.696996+0000","last_active":"2023-08-10T10:46:22.152743+0000","last_peered":"2023-08-10T10:46:22.152743+0000","last_clean":"2023-08-10T10:46:22.152743+0000","last_became_active":"2023-08-10T10:46:20.695487+0000","last_became_peered":"2023-08-10T10:46:20.695487+0000","last_unstale":"2023-08-10T10:46:22.152743+0000","last_undegraded":"2023-08-10T10:46:22.152743+0000","last_fullsized":"2023-08-10T10:46:22.152743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.077208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672267+0000","last_change":"2023-08-10T10:46:20.700451+0000","last_active":"2023-08-10T10:46:21.672267+0000","last_peered":"2023-08-10T10:46:21.672267+0000","last_clean":"2023-08-10T10:46:21.672267+0000","last_became_active":"2023-08-10T10:46:20.698959+0000","last_became_peered":"2023-08-10T10:46:20.698959+0000","last_unstale":"2023-08-10T10:46:21.672267+0000","last_undegraded":"2023-08-10T10:46:21.672267+0000","last_fullsized":"2023-08-10T10:46:21.672267+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:12.462038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150289+0000","last_change":"2023-08-10T10:46:20.704456+0000","last_active":"2023-08-10T10:46:22.150289+0000","last_peered":"2023-08-10T10:46:22.150289+0000","last_clean":"2023-08-10T10:46:22.150289+0000","last_became_active":"2023-08-10T10:46:20.703046+0000","last_became_peered":"2023-08-10T10:46:20.703046+0000","last_unstale":"2023-08-10T10:46:22.150289+0000","last_undegraded":"2023-08-10T10:46:22.150289+0000","last_fullsized":"2023-08-10T10:46:22.150289+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:14.983590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675840+0000","last_change":"2023-08-10T10:46:20.699237+0000","last_active":"2023-08-10T10:46:21.675840+0000","last_peered":"2023-08-10T10:46:21.675840+0000","last_clean":"2023-08-10T10:46:21.675840+0000","last_became_active":"2023-08-10T10:46:20.698792+0000","last_became_peered":"2023-08-10T10:46:20.698792+0000","last_unstale":"2023-08-10T10:46:21.675840+0000","last_undegraded":"2023-08-10T10:46:21.675840+0000","last_fullsized":"2023-08-10T10:46:21.675840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:56.909740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152388+0000","last_change":"2023-08-10T10:46:20.713846+0000","last_active":"2023-08-10T10:46:22.152388+0000","last_peered":"2023-08-10T10:46:22.152388+0000","last_clean":"2023-08-10T10:46:22.152388+0000","last_became_active":"2023-08-10T10:46:20.713583+0000","last_became_peered":"2023-08-10T10:46:20.713583+0000","last_unstale":"2023-08-10T10:46:22.152388+0000","last_undegraded":"2023-08-10T10:46:22.152388+0000","last_fullsized":"2023-08-10T10:46:22.152388+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:31.466439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672272+0000","last_change":"2023-08-10T10:46:20.701031+0000","last_active":"2023-08-10T10:46:21.672272+0000","last_peered":"2023-08-10T10:46:21.672272+0000","last_clean":"2023-08-10T10:46:21.672272+0000","last_became_active":"2023-08-10T10:46:20.700349+0000","last_became_peered":"2023-08-10T10:46:20.700349+0000","last_unstale":"2023-08-10T10:46:21.672272+0000","last_undegraded":"2023-08-10T10:46:21.672272+0000","last_fullsized":"2023-08-10T10:46:21.672272+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:25.703172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151054+0000","last_change":"2023-08-10T10:46:20.686993+0000","last_active":"2023-08-10T10:46:22.151054+0000","last_peered":"2023-08-10T10:46:22.151054+0000","last_clean":"2023-08-10T10:46:22.151054+0000","last_became_active":"2023-08-10T10:46:20.685689+0000","last_became_peered":"2023-08-10T10:46:20.685689+0000","last_unstale":"2023-08-10T10:46:22.151054+0000","last_undegraded":"2023-08-10T10:46:22.151054+0000","last_fullsized":"2023-08-10T10:46:22.151054+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:15.435141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151240+0000","last_change":"2023-08-10T10:46:20.699106+0000","last_active":"2023-08-10T10:46:22.151240+0000","last_peered":"2023-08-10T10:46:22.151240+0000","last_clean":"2023-08-10T10:46:22.151240+0000","last_became_active":"2023-08-10T10:46:20.698128+0000","last_became_peered":"2023-08-10T10:46:20.698128+0000","last_unstale":"2023-08-10T10:46:22.151240+0000","last_undegraded":"2023-08-10T10:46:22.151240+0000","last_fullsized":"2023-08-10T10:46:22.151240+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:35:45.996853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674322+0000","last_change":"2023-08-10T10:46:20.714851+0000","last_active":"2023-08-10T10:46:21.674322+0000","last_peered":"2023-08-10T10:46:21.674322+0000","last_clean":"2023-08-10T10:46:21.674322+0000","last_became_active":"2023-08-10T10:46:20.714606+0000","last_became_peered":"2023-08-10T10:46:20.714606+0000","last_unstale":"2023-08-10T10:46:21.674322+0000","last_undegraded":"2023-08-10T10:46:21.674322+0000","last_fullsized":"2023-08-10T10:46:21.674322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:48:42.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153068+0000","last_change":"2023-08-10T10:46:20.707798+0000","last_active":"2023-08-10T10:46:22.153068+0000","last_peered":"2023-08-10T10:46:22.153068+0000","last_clean":"2023-08-10T10:46:22.153068+0000","last_became_active":"2023-08-10T10:46:20.707470+0000","last_became_peered":"2023-08-10T10:46:20.707470+0000","last_unstale":"2023-08-10T10:46:22.153068+0000","last_undegraded":"2023-08-10T10:46:22.153068+0000","last_fullsized":"2023-08-10T10:46:22.153068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:57:19.297315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675299+0000","last_change":"2023-08-10T10:46:20.680367+0000","last_active":"2023-08-10T10:46:21.675299+0000","last_peered":"2023-08-10T10:46:21.675299+0000","last_clean":"2023-08-10T10:46:21.675299+0000","last_became_active":"2023-08-10T10:46:20.679597+0000","last_became_peered":"2023-08-10T10:46:20.679597+0000","last_unstale":"2023-08-10T10:46:21.675299+0000","last_undegraded":"2023-08-10T10:46:21.675299+0000","last_fullsized":"2023-08-10T10:46:21.675299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:11.665746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155058+0000","last_change":"2023-08-10T10:46:20.689301+0000","last_active":"2023-08-10T10:46:22.155058+0000","last_peered":"2023-08-10T10:46:22.155058+0000","last_clean":"2023-08-10T10:46:22.155058+0000","last_became_active":"2023-08-10T10:46:20.688590+0000","last_became_peered":"2023-08-10T10:46:20.688590+0000","last_unstale":"2023-08-10T10:46:22.155058+0000","last_undegraded":"2023-08-10T10:46:22.155058+0000","last_fullsized":"2023-08-10T10:46:22.155058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:54.873099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153790+0000","last_change":"2023-08-10T10:46:20.700405+0000","last_active":"2023-08-10T10:46:22.153790+0000","last_peered":"2023-08-10T10:46:22.153790+0000","last_clean":"2023-08-10T10:46:22.153790+0000","last_became_active":"2023-08-10T10:46:20.700005+0000","last_became_peered":"2023-08-10T10:46:20.700005+0000","last_unstale":"2023-08-10T10:46:22.153790+0000","last_undegraded":"2023-08-10T10:46:22.153790+0000","last_fullsized":"2023-08-10T10:46:22.153790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:50.953049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154378+0000","last_change":"2023-08-10T10:46:20.698018+0000","last_active":"2023-08-10T10:46:22.154378+0000","last_peered":"2023-08-10T10:46:22.154378+0000","last_clean":"2023-08-10T10:46:22.154378+0000","last_became_active":"2023-08-10T10:46:20.697765+0000","last_became_peered":"2023-08-10T10:46:20.697765+0000","last_unstale":"2023-08-10T10:46:22.154378+0000","last_undegraded":"2023-08-10T10:46:22.154378+0000","last_fullsized":"2023-08-10T10:46:22.154378+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:33.288513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674183+0000","last_change":"2023-08-10T10:46:20.713675+0000","last_active":"2023-08-10T10:46:21.674183+0000","last_peered":"2023-08-10T10:46:21.674183+0000","last_clean":"2023-08-10T10:46:21.674183+0000","last_became_active":"2023-08-10T10:46:20.712732+0000","last_became_peered":"2023-08-10T10:46:20.712732+0000","last_unstale":"2023-08-10T10:46:21.674183+0000","last_undegraded":"2023-08-10T10:46:21.674183+0000","last_fullsized":"2023-08-10T10:46:21.674183+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:05.732478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151372+0000","last_change":"2023-08-10T10:46:20.696781+0000","last_active":"2023-08-10T10:46:22.151372+0000","last_peered":"2023-08-10T10:46:22.151372+0000","last_clean":"2023-08-10T10:46:22.151372+0000","last_became_active":"2023-08-10T10:46:20.696342+0000","last_became_peered":"2023-08-10T10:46:20.696342+0000","last_unstale":"2023-08-10T10:46:22.151372+0000","last_undegraded":"2023-08-10T10:46:22.151372+0000","last_fullsized":"2023-08-10T10:46:22.151372+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:50:52.730815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151390+0000","last_change":"2023-08-10T10:46:20.709626+0000","last_active":"2023-08-10T10:46:22.151390+0000","last_peered":"2023-08-10T10:46:22.151390+0000","last_clean":"2023-08-10T10:46:22.151390+0000","last_became_active":"2023-08-10T10:46:20.699192+0000","last_became_peered":"2023-08-10T10:46:20.699192+0000","last_unstale":"2023-08-10T10:46:22.151390+0000","last_undegraded":"2023-08-10T10:46:22.151390+0000","last_fullsized":"2023-08-10T10:46:22.151390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.211932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673925+0000","last_change":"2023-08-10T10:46:20.706325+0000","last_active":"2023-08-10T10:46:21.673925+0000","last_peered":"2023-08-10T10:46:21.673925+0000","last_clean":"2023-08-10T10:46:21.673925+0000","last_became_active":"2023-08-10T10:46:20.706051+0000","last_became_peered":"2023-08-10T10:46:20.706051+0000","last_unstale":"2023-08-10T10:46:21.673925+0000","last_undegraded":"2023-08-10T10:46:21.673925+0000","last_fullsized":"2023-08-10T10:46:21.673925+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:35.078280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150943+0000","last_change":"2023-08-10T10:46:20.676042+0000","last_active":"2023-08-10T10:46:22.150943+0000","last_peered":"2023-08-10T10:46:22.150943+0000","last_clean":"2023-08-10T10:46:22.150943+0000","last_became_active":"2023-08-10T10:46:20.675313+0000","last_became_peered":"2023-08-10T10:46:20.675313+0000","last_unstale":"2023-08-10T10:46:22.150943+0000","last_undegraded":"2023-08-10T10:46:22.150943+0000","last_fullsized":"2023-08-10T10:46:22.150943+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:39:12.539183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152309+0000","last_change":"2023-08-10T10:46:20.708858+0000","last_active":"2023-08-10T10:46:22.152309+0000","last_peered":"2023-08-10T10:46:22.152309+0000","last_clean":"2023-08-10T10:46:22.152309+0000","last_became_active":"2023-08-10T10:46:20.708549+0000","last_became_peered":"2023-08-10T10:46:20.708549+0000","last_unstale":"2023-08-10T10:46:22.152309+0000","last_undegraded":"2023-08-10T10:46:22.152309+0000","last_fullsized":"2023-08-10T10:46:22.152309+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:21.938476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151520+0000","last_change":"2023-08-10T10:46:20.699956+0000","last_active":"2023-08-10T10:46:22.151520+0000","last_peered":"2023-08-10T10:46:22.151520+0000","last_clean":"2023-08-10T10:46:22.151520+0000","last_became_active":"2023-08-10T10:46:20.698845+0000","last_became_peered":"2023-08-10T10:46:20.698845+0000","last_unstale":"2023-08-10T10:46:22.151520+0000","last_undegraded":"2023-08-10T10:46:22.151520+0000","last_fullsized":"2023-08-10T10:46:22.151520+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:15.631269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672353+0000","last_change":"2023-08-10T10:46:20.702071+0000","last_active":"2023-08-10T10:46:21.672353+0000","last_peered":"2023-08-10T10:46:21.672353+0000","last_clean":"2023-08-10T10:46:21.672353+0000","last_became_active":"2023-08-10T10:46:20.701315+0000","last_became_peered":"2023-08-10T10:46:20.701315+0000","last_unstale":"2023-08-10T10:46:21.672353+0000","last_undegraded":"2023-08-10T10:46:21.672353+0000","last_fullsized":"2023-08-10T10:46:21.672353+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:04.553427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"142'4","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153791+0000","last_change":"2023-08-10T10:46:19.658885+0000","last_active":"2023-08-10T10:46:22.153791+0000","last_peered":"2023-08-10T10:46:22.153791+0000","last_clean":"2023-08-10T10:46:22.153791+0000","last_became_active":"2023-08-10T10:46:19.658390+0000","last_became_peered":"2023-08-10T10:46:19.658390+0000","last_unstale":"2023-08-10T10:46:22.153791+0000","last_undegraded":"2023-08-10T10:46:22.153791+0000","last_fullsized":"2023-08-10T10:46:22.153791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:04.736064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152923+0000","last_change":"2023-08-10T10:46:20.710802+0000","last_active":"2023-08-10T10:46:22.152923+0000","last_peered":"2023-08-10T10:46:22.152923+0000","last_clean":"2023-08-10T10:46:22.152923+0000","last_became_active":"2023-08-10T10:46:20.710382+0000","last_became_peered":"2023-08-10T10:46:20.710382+0000","last_unstale":"2023-08-10T10:46:22.152923+0000","last_undegraded":"2023-08-10T10:46:22.152923+0000","last_fullsized":"2023-08-10T10:46:22.152923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:13.422796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673184+0000","last_change":"2023-08-10T10:46:19.656636+0000","last_active":"2023-08-10T10:46:21.673184+0000","last_peered":"2023-08-10T10:46:21.673184+0000","last_clean":"2023-08-10T10:46:21.673184+0000","last_became_active":"2023-08-10T10:46:19.656158+0000","last_became_peered":"2023-08-10T10:46:19.656158+0000","last_unstale":"2023-08-10T10:46:21.673184+0000","last_undegraded":"2023-08-10T10:46:21.673184+0000","last_fullsized":"2023-08-10T10:46:21.673184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:10.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154127+0000","last_change":"2023-08-10T10:46:20.711511+0000","last_active":"2023-08-10T10:46:22.154127+0000","last_peered":"2023-08-10T10:46:22.154127+0000","last_clean":"2023-08-10T10:46:22.154127+0000","last_became_active":"2023-08-10T10:46:20.711202+0000","last_became_peered":"2023-08-10T10:46:20.711202+0000","last_unstale":"2023-08-10T10:46:22.154127+0000","last_undegraded":"2023-08-10T10:46:22.154127+0000","last_fullsized":"2023-08-10T10:46:22.154127+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:31.847061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154966+0000","last_change":"2023-08-10T10:46:19.655387+0000","last_active":"2023-08-10T10:46:22.154966+0000","last_peered":"2023-08-10T10:46:22.154966+0000","last_clean":"2023-08-10T10:46:22.154966+0000","last_became_active":"2023-08-10T10:46:19.654937+0000","last_became_peered":"2023-08-10T10:46:19.654937+0000","last_unstale":"2023-08-10T10:46:22.154966+0000","last_undegraded":"2023-08-10T10:46:22.154966+0000","last_fullsized":"2023-08-10T10:46:22.154966+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:21:59.526953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154742+0000","last_change":"2023-08-10T10:46:20.705622+0000","last_active":"2023-08-10T10:46:22.154742+0000","last_peered":"2023-08-10T10:46:22.154742+0000","last_clean":"2023-08-10T10:46:22.154742+0000","last_became_active":"2023-08-10T10:46:20.705173+0000","last_became_peered":"2023-08-10T10:46:20.705173+0000","last_unstale":"2023-08-10T10:46:22.154742+0000","last_undegraded":"2023-08-10T10:46:22.154742+0000","last_fullsized":"2023-08-10T10:46:22.154742+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:55.086314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673047+0000","last_change":"2023-08-10T10:46:19.653136+0000","last_active":"2023-08-10T10:46:21.673047+0000","last_peered":"2023-08-10T10:46:21.673047+0000","last_clean":"2023-08-10T10:46:21.673047+0000","last_became_active":"2023-08-10T10:46:19.652828+0000","last_became_peered":"2023-08-10T10:46:19.652828+0000","last_unstale":"2023-08-10T10:46:21.673047+0000","last_undegraded":"2023-08-10T10:46:21.673047+0000","last_fullsized":"2023-08-10T10:46:21.673047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:32.361809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673045+0000","last_change":"2023-08-10T10:46:20.694968+0000","last_active":"2023-08-10T10:46:21.673045+0000","last_peered":"2023-08-10T10:46:21.673045+0000","last_clean":"2023-08-10T10:46:21.673045+0000","last_became_active":"2023-08-10T10:46:20.694286+0000","last_became_peered":"2023-08-10T10:46:20.694286+0000","last_unstale":"2023-08-10T10:46:21.673045+0000","last_undegraded":"2023-08-10T10:46:21.673045+0000","last_fullsized":"2023-08-10T10:46:21.673045+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:53.274622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675832+0000","last_change":"2023-08-10T10:46:19.655332+0000","last_active":"2023-08-10T10:46:21.675832+0000","last_peered":"2023-08-10T10:46:21.675832+0000","last_clean":"2023-08-10T10:46:21.675832+0000","last_became_active":"2023-08-10T10:46:19.654651+0000","last_became_peered":"2023-08-10T10:46:19.654651+0000","last_unstale":"2023-08-10T10:46:21.675832+0000","last_undegraded":"2023-08-10T10:46:21.675832+0000","last_fullsized":"2023-08-10T10:46:21.675832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:54.906649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.675088+0000","last_change":"2023-08-10T10:46:20.685365+0000","last_active":"2023-08-10T10:46:21.675088+0000","last_peered":"2023-08-10T10:46:21.675088+0000","last_clean":"2023-08-10T10:46:21.675088+0000","last_became_active":"2023-08-10T10:46:20.684873+0000","last_became_peered":"2023-08-10T10:46:20.684873+0000","last_unstale":"2023-08-10T10:46:21.675088+0000","last_undegraded":"2023-08-10T10:46:21.675088+0000","last_fullsized":"2023-08-10T10:46:21.675088+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:46.044427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151764+0000","last_change":"2023-08-10T10:46:19.656679+0000","last_active":"2023-08-10T10:46:22.151764+0000","last_peered":"2023-08-10T10:46:22.151764+0000","last_clean":"2023-08-10T10:46:22.151764+0000","last_became_active":"2023-08-10T10:46:19.655467+0000","last_became_peered":"2023-08-10T10:46:19.655467+0000","last_unstale":"2023-08-10T10:46:22.151764+0000","last_undegraded":"2023-08-10T10:46:22.151764+0000","last_fullsized":"2023-08-10T10:46:22.151764+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:15:17.043138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151285+0000","last_change":"2023-08-10T10:46:20.686333+0000","last_active":"2023-08-10T10:46:22.151285+0000","last_peered":"2023-08-10T10:46:22.151285+0000","last_clean":"2023-08-10T10:46:22.151285+0000","last_became_active":"2023-08-10T10:46:20.683527+0000","last_became_peered":"2023-08-10T10:46:20.683527+0000","last_unstale":"2023-08-10T10:46:22.151285+0000","last_undegraded":"2023-08-10T10:46:22.151285+0000","last_fullsized":"2023-08-10T10:46:22.151285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:22.867082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154778+0000","last_change":"2023-08-10T10:46:19.657520+0000","last_active":"2023-08-10T10:46:22.154778+0000","last_peered":"2023-08-10T10:46:22.154778+0000","last_clean":"2023-08-10T10:46:22.154778+0000","last_became_active":"2023-08-10T10:46:19.657086+0000","last_became_peered":"2023-08-10T10:46:19.657086+0000","last_unstale":"2023-08-10T10:46:22.154778+0000","last_undegraded":"2023-08-10T10:46:22.154778+0000","last_fullsized":"2023-08-10T10:46:22.154778+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:23.669831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672420+0000","last_change":"2023-08-10T10:46:20.687374+0000","last_active":"2023-08-10T10:46:21.672420+0000","last_peered":"2023-08-10T10:46:21.672420+0000","last_clean":"2023-08-10T10:46:21.672420+0000","last_became_active":"2023-08-10T10:46:20.686642+0000","last_became_peered":"2023-08-10T10:46:20.686642+0000","last_unstale":"2023-08-10T10:46:21.672420+0000","last_undegraded":"2023-08-10T10:46:21.672420+0000","last_fullsized":"2023-08-10T10:46:21.672420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:30.039166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153828+0000","last_change":"2023-08-10T10:46:19.663387+0000","last_active":"2023-08-10T10:46:22.153828+0000","last_peered":"2023-08-10T10:46:22.153828+0000","last_clean":"2023-08-10T10:46:22.153828+0000","last_became_active":"2023-08-10T10:46:19.662850+0000","last_became_peered":"2023-08-10T10:46:19.662850+0000","last_unstale":"2023-08-10T10:46:22.153828+0000","last_undegraded":"2023-08-10T10:46:22.153828+0000","last_fullsized":"2023-08-10T10:46:22.153828+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:33:10.468718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151872+0000","last_change":"2023-08-10T10:46:20.711589+0000","last_active":"2023-08-10T10:46:22.151872+0000","last_peered":"2023-08-10T10:46:22.151872+0000","last_clean":"2023-08-10T10:46:22.151872+0000","last_became_active":"2023-08-10T10:46:20.711191+0000","last_became_peered":"2023-08-10T10:46:20.711191+0000","last_unstale":"2023-08-10T10:46:22.151872+0000","last_undegraded":"2023-08-10T10:46:22.151872+0000","last_fullsized":"2023-08-10T10:46:22.151872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:40.449273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672836+0000","last_change":"2023-08-10T10:46:19.661401+0000","last_active":"2023-08-10T10:46:21.672836+0000","last_peered":"2023-08-10T10:46:21.672836+0000","last_clean":"2023-08-10T10:46:21.672836+0000","last_became_active":"2023-08-10T10:46:19.660020+0000","last_became_peered":"2023-08-10T10:46:19.660020+0000","last_unstale":"2023-08-10T10:46:21.672836+0000","last_undegraded":"2023-08-10T10:46:21.672836+0000","last_fullsized":"2023-08-10T10:46:21.672836+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:28:11.959424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676006+0000","last_change":"2023-08-10T10:46:20.676262+0000","last_active":"2023-08-10T10:46:21.676006+0000","last_peered":"2023-08-10T10:46:21.676006+0000","last_clean":"2023-08-10T10:46:21.676006+0000","last_became_active":"2023-08-10T10:46:20.675439+0000","last_became_peered":"2023-08-10T10:46:20.675439+0000","last_unstale":"2023-08-10T10:46:21.676006+0000","last_undegraded":"2023-08-10T10:46:21.676006+0000","last_fullsized":"2023-08-10T10:46:21.676006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:32.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674516+0000","last_change":"2023-08-10T10:46:19.661082+0000","last_active":"2023-08-10T10:46:21.674516+0000","last_peered":"2023-08-10T10:46:21.674516+0000","last_clean":"2023-08-10T10:46:21.674516+0000","last_became_active":"2023-08-10T10:46:19.660822+0000","last_became_peered":"2023-08-10T10:46:19.660822+0000","last_unstale":"2023-08-10T10:46:21.674516+0000","last_undegraded":"2023-08-10T10:46:21.674516+0000","last_fullsized":"2023-08-10T10:46:21.674516+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:22:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153244+0000","last_change":"2023-08-10T10:46:20.710644+0000","last_active":"2023-08-10T10:46:22.153244+0000","last_peered":"2023-08-10T10:46:22.153244+0000","last_clean":"2023-08-10T10:46:22.153244+0000","last_became_active":"2023-08-10T10:46:20.710048+0000","last_became_peered":"2023-08-10T10:46:20.710048+0000","last_unstale":"2023-08-10T10:46:22.153244+0000","last_undegraded":"2023-08-10T10:46:22.153244+0000","last_fullsized":"2023-08-10T10:46:22.153244+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:59.260966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153434+0000","last_change":"2023-08-10T10:46:19.657908+0000","last_active":"2023-08-10T10:46:22.153434+0000","last_peered":"2023-08-10T10:46:22.153434+0000","last_clean":"2023-08-10T10:46:22.153434+0000","last_became_active":"2023-08-10T10:46:19.657590+0000","last_became_peered":"2023-08-10T10:46:19.657590+0000","last_unstale":"2023-08-10T10:46:22.153434+0000","last_undegraded":"2023-08-10T10:46:22.153434+0000","last_fullsized":"2023-08-10T10:46:22.153434+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:16.123167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154443+0000","last_change":"2023-08-10T10:46:20.699626+0000","last_active":"2023-08-10T10:46:22.154443+0000","last_peered":"2023-08-10T10:46:22.154443+0000","last_clean":"2023-08-10T10:46:22.154443+0000","last_became_active":"2023-08-10T10:46:20.699353+0000","last_became_peered":"2023-08-10T10:46:20.699353+0000","last_unstale":"2023-08-10T10:46:22.154443+0000","last_undegraded":"2023-08-10T10:46:22.154443+0000","last_fullsized":"2023-08-10T10:46:22.154443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:11:09.539255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152046+0000","last_change":"2023-08-10T10:46:19.658812+0000","last_active":"2023-08-10T10:46:22.152046+0000","last_peered":"2023-08-10T10:46:22.152046+0000","last_clean":"2023-08-10T10:46:22.152046+0000","last_became_active":"2023-08-10T10:46:19.658483+0000","last_became_peered":"2023-08-10T10:46:19.658483+0000","last_unstale":"2023-08-10T10:46:22.152046+0000","last_undegraded":"2023-08-10T10:46:22.152046+0000","last_fullsized":"2023-08-10T10:46:22.152046+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:17.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152509+0000","last_change":"2023-08-10T10:46:20.709075+0000","last_active":"2023-08-10T10:46:22.152509+0000","last_peered":"2023-08-10T10:46:22.152509+0000","last_clean":"2023-08-10T10:46:22.152509+0000","last_became_active":"2023-08-10T10:46:20.708834+0000","last_became_peered":"2023-08-10T10:46:20.708834+0000","last_unstale":"2023-08-10T10:46:22.152509+0000","last_undegraded":"2023-08-10T10:46:22.152509+0000","last_fullsized":"2023-08-10T10:46:22.152509+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:09.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152132+0000","last_change":"2023-08-10T10:46:19.656846+0000","last_active":"2023-08-10T10:46:22.152132+0000","last_peered":"2023-08-10T10:46:22.152132+0000","last_clean":"2023-08-10T10:46:22.152132+0000","last_became_active":"2023-08-10T10:46:19.656006+0000","last_became_peered":"2023-08-10T10:46:19.656006+0000","last_unstale":"2023-08-10T10:46:22.152132+0000","last_undegraded":"2023-08-10T10:46:22.152132+0000","last_fullsized":"2023-08-10T10:46:22.152132+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:34.444606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151296+0000","last_change":"2023-08-10T10:46:20.699116+0000","last_active":"2023-08-10T10:46:22.151296+0000","last_peered":"2023-08-10T10:46:22.151296+0000","last_clean":"2023-08-10T10:46:22.151296+0000","last_became_active":"2023-08-10T10:46:20.698618+0000","last_became_peered":"2023-08-10T10:46:20.698618+0000","last_unstale":"2023-08-10T10:46:22.151296+0000","last_undegraded":"2023-08-10T10:46:22.151296+0000","last_fullsized":"2023-08-10T10:46:22.151296+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:58:39.737711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153128+0000","last_change":"2023-08-10T10:46:19.651480+0000","last_active":"2023-08-10T10:46:22.153128+0000","last_peered":"2023-08-10T10:46:22.153128+0000","last_clean":"2023-08-10T10:46:22.153128+0000","last_became_active":"2023-08-10T10:46:19.650935+0000","last_became_peered":"2023-08-10T10:46:19.650935+0000","last_unstale":"2023-08-10T10:46:22.153128+0000","last_undegraded":"2023-08-10T10:46:22.153128+0000","last_fullsized":"2023-08-10T10:46:22.153128+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:35.090088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.150972+0000","last_change":"2023-08-10T10:46:20.704711+0000","last_active":"2023-08-10T10:46:22.150972+0000","last_peered":"2023-08-10T10:46:22.150972+0000","last_clean":"2023-08-10T10:46:22.150972+0000","last_became_active":"2023-08-10T10:46:20.704001+0000","last_became_peered":"2023-08-10T10:46:20.704001+0000","last_unstale":"2023-08-10T10:46:22.150972+0000","last_undegraded":"2023-08-10T10:46:22.150972+0000","last_fullsized":"2023-08-10T10:46:22.150972+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:03.433051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152194+0000","last_change":"2023-08-10T10:46:19.663017+0000","last_active":"2023-08-10T10:46:22.152194+0000","last_peered":"2023-08-10T10:46:22.152194+0000","last_clean":"2023-08-10T10:46:22.152194+0000","last_became_active":"2023-08-10T10:46:19.662779+0000","last_became_peered":"2023-08-10T10:46:19.662779+0000","last_unstale":"2023-08-10T10:46:22.152194+0000","last_undegraded":"2023-08-10T10:46:22.152194+0000","last_fullsized":"2023-08-10T10:46:22.152194+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:55.894813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155007+0000","last_change":"2023-08-10T10:46:20.705507+0000","last_active":"2023-08-10T10:46:22.155007+0000","last_peered":"2023-08-10T10:46:22.155007+0000","last_clean":"2023-08-10T10:46:22.155007+0000","last_became_active":"2023-08-10T10:46:20.705165+0000","last_became_peered":"2023-08-10T10:46:20.705165+0000","last_unstale":"2023-08-10T10:46:22.155007+0000","last_undegraded":"2023-08-10T10:46:22.155007+0000","last_fullsized":"2023-08-10T10:46:22.155007+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:19:54.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153771+0000","last_change":"2023-08-10T10:46:19.655068+0000","last_active":"2023-08-10T10:46:22.153771+0000","last_peered":"2023-08-10T10:46:22.153771+0000","last_clean":"2023-08-10T10:46:22.153771+0000","last_became_active":"2023-08-10T10:46:19.654602+0000","last_became_peered":"2023-08-10T10:46:19.654602+0000","last_unstale":"2023-08-10T10:46:22.153771+0000","last_undegraded":"2023-08-10T10:46:22.153771+0000","last_fullsized":"2023-08-10T10:46:22.153771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:04.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153674+0000","last_change":"2023-08-10T10:46:20.698038+0000","last_active":"2023-08-10T10:46:22.153674+0000","last_peered":"2023-08-10T10:46:22.153674+0000","last_clean":"2023-08-10T10:46:22.153674+0000","last_became_active":"2023-08-10T10:46:20.697074+0000","last_became_peered":"2023-08-10T10:46:20.697074+0000","last_unstale":"2023-08-10T10:46:22.153674+0000","last_undegraded":"2023-08-10T10:46:22.153674+0000","last_fullsized":"2023-08-10T10:46:22.153674+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:44.751483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153429+0000","last_change":"2023-08-10T10:46:19.658366+0000","last_active":"2023-08-10T10:46:22.153429+0000","last_peered":"2023-08-10T10:46:22.153429+0000","last_clean":"2023-08-10T10:46:22.153429+0000","last_became_active":"2023-08-10T10:46:19.657888+0000","last_became_peered":"2023-08-10T10:46:19.657888+0000","last_unstale":"2023-08-10T10:46:22.153429+0000","last_undegraded":"2023-08-10T10:46:22.153429+0000","last_fullsized":"2023-08-10T10:46:22.153429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:54:52.011689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672411+0000","last_change":"2023-08-10T10:46:20.700098+0000","last_active":"2023-08-10T10:46:21.672411+0000","last_peered":"2023-08-10T10:46:21.672411+0000","last_clean":"2023-08-10T10:46:21.672411+0000","last_became_active":"2023-08-10T10:46:20.699494+0000","last_became_peered":"2023-08-10T10:46:20.699494+0000","last_unstale":"2023-08-10T10:46:21.672411+0000","last_undegraded":"2023-08-10T10:46:21.672411+0000","last_fullsized":"2023-08-10T10:46:21.672411+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:23:29.802125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154124+0000","last_change":"2023-08-10T10:46:19.662307+0000","last_active":"2023-08-10T10:46:22.154124+0000","last_peered":"2023-08-10T10:46:22.154124+0000","last_clean":"2023-08-10T10:46:22.154124+0000","last_became_active":"2023-08-10T10:46:19.662111+0000","last_became_peered":"2023-08-10T10:46:19.662111+0000","last_unstale":"2023-08-10T10:46:22.154124+0000","last_undegraded":"2023-08-10T10:46:22.154124+0000","last_fullsized":"2023-08-10T10:46:22.154124+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:21.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155226+0000","last_change":"2023-08-10T10:46:20.687025+0000","last_active":"2023-08-10T10:46:22.155226+0000","last_peered":"2023-08-10T10:46:22.155226+0000","last_clean":"2023-08-10T10:46:22.155226+0000","last_became_active":"2023-08-10T10:46:20.686270+0000","last_became_peered":"2023-08-10T10:46:20.686270+0000","last_unstale":"2023-08-10T10:46:22.155226+0000","last_undegraded":"2023-08-10T10:46:22.155226+0000","last_fullsized":"2023-08-10T10:46:22.155226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:23:07.672138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152415+0000","last_change":"2023-08-10T10:46:19.660776+0000","last_active":"2023-08-10T10:46:22.152415+0000","last_peered":"2023-08-10T10:46:22.152415+0000","last_clean":"2023-08-10T10:46:22.152415+0000","last_became_active":"2023-08-10T10:46:19.660320+0000","last_became_peered":"2023-08-10T10:46:19.660320+0000","last_unstale":"2023-08-10T10:46:22.152415+0000","last_undegraded":"2023-08-10T10:46:22.152415+0000","last_fullsized":"2023-08-10T10:46:22.152415+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:35.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673961+0000","last_change":"2023-08-10T10:46:20.703446+0000","last_active":"2023-08-10T10:46:21.673961+0000","last_peered":"2023-08-10T10:46:21.673961+0000","last_clean":"2023-08-10T10:46:21.673961+0000","last_became_active":"2023-08-10T10:46:20.703183+0000","last_became_peered":"2023-08-10T10:46:20.703183+0000","last_unstale":"2023-08-10T10:46:21.673961+0000","last_undegraded":"2023-08-10T10:46:21.673961+0000","last_fullsized":"2023-08-10T10:46:21.673961+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:12.290482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153973+0000","last_change":"2023-08-10T10:46:19.663097+0000","last_active":"2023-08-10T10:46:22.153973+0000","last_peered":"2023-08-10T10:46:22.153973+0000","last_clean":"2023-08-10T10:46:22.153973+0000","last_became_active":"2023-08-10T10:46:19.662442+0000","last_became_peered":"2023-08-10T10:46:19.662442+0000","last_unstale":"2023-08-10T10:46:22.153973+0000","last_undegraded":"2023-08-10T10:46:22.153973+0000","last_fullsized":"2023-08-10T10:46:22.153973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:05.675860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151420+0000","last_change":"2023-08-10T10:46:20.695118+0000","last_active":"2023-08-10T10:46:22.151420+0000","last_peered":"2023-08-10T10:46:22.151420+0000","last_clean":"2023-08-10T10:46:22.151420+0000","last_became_active":"2023-08-10T10:46:20.694268+0000","last_became_peered":"2023-08-10T10:46:20.694268+0000","last_unstale":"2023-08-10T10:46:22.151420+0000","last_undegraded":"2023-08-10T10:46:22.151420+0000","last_fullsized":"2023-08-10T10:46:22.151420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:39.187207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676303+0000","last_change":"2023-08-10T10:46:19.655211+0000","last_active":"2023-08-10T10:46:21.676303+0000","last_peered":"2023-08-10T10:46:21.676303+0000","last_clean":"2023-08-10T10:46:21.676303+0000","last_became_active":"2023-08-10T10:46:19.654723+0000","last_became_peered":"2023-08-10T10:46:19.654723+0000","last_unstale":"2023-08-10T10:46:21.676303+0000","last_undegraded":"2023-08-10T10:46:21.676303+0000","last_fullsized":"2023-08-10T10:46:21.676303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:41.300929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151524+0000","last_change":"2023-08-10T10:46:20.710615+0000","last_active":"2023-08-10T10:46:22.151524+0000","last_peered":"2023-08-10T10:46:22.151524+0000","last_clean":"2023-08-10T10:46:22.151524+0000","last_became_active":"2023-08-10T10:46:20.707529+0000","last_became_peered":"2023-08-10T10:46:20.707529+0000","last_unstale":"2023-08-10T10:46:22.151524+0000","last_undegraded":"2023-08-10T10:46:22.151524+0000","last_fullsized":"2023-08-10T10:46:22.151524+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:50.303655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.676054+0000","last_change":"2023-08-10T10:46:19.655501+0000","last_active":"2023-08-10T10:46:21.676054+0000","last_peered":"2023-08-10T10:46:21.676054+0000","last_clean":"2023-08-10T10:46:21.676054+0000","last_became_active":"2023-08-10T10:46:19.655077+0000","last_became_peered":"2023-08-10T10:46:19.655077+0000","last_unstale":"2023-08-10T10:46:21.676054+0000","last_undegraded":"2023-08-10T10:46:21.676054+0000","last_fullsized":"2023-08-10T10:46:21.676054+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:40.649983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151776+0000","last_change":"2023-08-10T10:46:20.695090+0000","last_active":"2023-08-10T10:46:22.151776+0000","last_peered":"2023-08-10T10:46:22.151776+0000","last_clean":"2023-08-10T10:46:22.151776+0000","last_became_active":"2023-08-10T10:46:20.694723+0000","last_became_peered":"2023-08-10T10:46:20.694723+0000","last_unstale":"2023-08-10T10:46:22.151776+0000","last_undegraded":"2023-08-10T10:46:22.151776+0000","last_fullsized":"2023-08-10T10:46:22.151776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:47.207011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152455+0000","last_change":"2023-08-10T10:46:19.662973+0000","last_active":"2023-08-10T10:46:22.152455+0000","last_peered":"2023-08-10T10:46:22.152455+0000","last_clean":"2023-08-10T10:46:22.152455+0000","last_became_active":"2023-08-10T10:46:19.662575+0000","last_became_peered":"2023-08-10T10:46:19.662575+0000","last_unstale":"2023-08-10T10:46:22.152455+0000","last_undegraded":"2023-08-10T10:46:22.152455+0000","last_fullsized":"2023-08-10T10:46:22.152455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:45:55.085569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672674+0000","last_change":"2023-08-10T10:46:20.686374+0000","last_active":"2023-08-10T10:46:21.672674+0000","last_peered":"2023-08-10T10:46:21.672674+0000","last_clean":"2023-08-10T10:46:21.672674+0000","last_became_active":"2023-08-10T10:46:20.685556+0000","last_became_peered":"2023-08-10T10:46:20.685556+0000","last_unstale":"2023-08-10T10:46:21.672674+0000","last_undegraded":"2023-08-10T10:46:21.672674+0000","last_fullsized":"2023-08-10T10:46:21.672674+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:42.265281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151924+0000","last_change":"2023-08-10T10:46:19.658369+0000","last_active":"2023-08-10T10:46:22.151924+0000","last_peered":"2023-08-10T10:46:22.151924+0000","last_clean":"2023-08-10T10:46:22.151924+0000","last_became_active":"2023-08-10T10:46:19.658075+0000","last_became_peered":"2023-08-10T10:46:19.658075+0000","last_unstale":"2023-08-10T10:46:22.151924+0000","last_undegraded":"2023-08-10T10:46:22.151924+0000","last_fullsized":"2023-08-10T10:46:22.151924+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:18:35.256220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154431+0000","last_change":"2023-08-10T10:46:20.702430+0000","last_active":"2023-08-10T10:46:22.154431+0000","last_peered":"2023-08-10T10:46:22.154431+0000","last_clean":"2023-08-10T10:46:22.154431+0000","last_became_active":"2023-08-10T10:46:20.702183+0000","last_became_peered":"2023-08-10T10:46:20.702183+0000","last_unstale":"2023-08-10T10:46:22.154431+0000","last_undegraded":"2023-08-10T10:46:22.154431+0000","last_fullsized":"2023-08-10T10:46:22.154431+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:48.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"142'8","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151868+0000","last_change":"2023-08-10T10:46:19.640383+0000","last_active":"2023-08-10T10:46:22.151868+0000","last_peered":"2023-08-10T10:46:22.151868+0000","last_clean":"2023-08-10T10:46:22.151868+0000","last_became_active":"2023-08-10T10:46:19.639727+0000","last_became_peered":"2023-08-10T10:46:19.639727+0000","last_unstale":"2023-08-10T10:46:22.151868+0000","last_undegraded":"2023-08-10T10:46:22.151868+0000","last_fullsized":"2023-08-10T10:46:22.151868+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:00:24.118506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":383,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153373+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:46:22.153373+0000","last_peered":"2023-08-10T10:46:22.153373+0000","last_clean":"2023-08-10T10:46:22.153373+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:46:22.153373+0000","last_undegraded":"2023-08-10T10:46:22.153373+0000","last_fullsized":"2023-08-10T10:46:22.153373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:44.046165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153288+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:46:22.153288+0000","last_peered":"2023-08-10T10:46:22.153288+0000","last_clean":"2023-08-10T10:46:22.153288+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:46:22.153288+0000","last_undegraded":"2023-08-10T10:46:22.153288+0000","last_fullsized":"2023-08-10T10:46:22.153288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:10.051636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.153413+0000","last_change":"2023-08-10T10:46:20.707317+0000","last_active":"2023-08-10T10:46:22.153413+0000","last_peered":"2023-08-10T10:46:22.153413+0000","last_clean":"2023-08-10T10:46:22.153413+0000","last_became_active":"2023-08-10T10:46:20.706893+0000","last_became_peered":"2023-08-10T10:46:20.706893+0000","last_unstale":"2023-08-10T10:46:22.153413+0000","last_undegraded":"2023-08-10T10:46:22.153413+0000","last_fullsized":"2023-08-10T10:46:22.153413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:02.201155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151877+0000","last_change":"2023-08-10T10:46:19.640710+0000","last_active":"2023-08-10T10:46:22.151877+0000","last_peered":"2023-08-10T10:46:22.151877+0000","last_clean":"2023-08-10T10:46:22.151877+0000","last_became_active":"2023-08-10T10:46:19.640061+0000","last_became_peered":"2023-08-10T10:46:19.640061+0000","last_unstale":"2023-08-10T10:46:22.151877+0000","last_undegraded":"2023-08-10T10:46:22.151877+0000","last_fullsized":"2023-08-10T10:46:22.151877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:49.058902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152727+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:46:22.152727+0000","last_peered":"2023-08-10T10:46:22.152727+0000","last_clean":"2023-08-10T10:46:22.152727+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:46:22.152727+0000","last_undegraded":"2023-08-10T10:46:22.152727+0000","last_fullsized":"2023-08-10T10:46:22.152727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:18.217287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672625+0000","last_change":"2023-08-10T10:46:20.685361+0000","last_active":"2023-08-10T10:46:21.672625+0000","last_peered":"2023-08-10T10:46:21.672625+0000","last_clean":"2023-08-10T10:46:21.672625+0000","last_became_active":"2023-08-10T10:46:20.684718+0000","last_became_peered":"2023-08-10T10:46:20.684718+0000","last_unstale":"2023-08-10T10:46:21.672625+0000","last_undegraded":"2023-08-10T10:46:21.672625+0000","last_fullsized":"2023-08-10T10:46:21.672625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:46.554591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151854+0000","last_change":"2023-08-10T10:46:19.659098+0000","last_active":"2023-08-10T10:46:22.151854+0000","last_peered":"2023-08-10T10:46:22.151854+0000","last_clean":"2023-08-10T10:46:22.151854+0000","last_became_active":"2023-08-10T10:46:19.658740+0000","last_became_peered":"2023-08-10T10:46:19.658740+0000","last_unstale":"2023-08-10T10:46:22.151854+0000","last_undegraded":"2023-08-10T10:46:22.151854+0000","last_fullsized":"2023-08-10T10:46:22.151854+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:10.650820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":234,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673961+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:46:21.673961+0000","last_peered":"2023-08-10T10:46:21.673961+0000","last_clean":"2023-08-10T10:46:21.673961+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:46:21.673961+0000","last_undegraded":"2023-08-10T10:46:21.673961+0000","last_fullsized":"2023-08-10T10:46:21.673961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:27:48.775694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.674315+0000","last_change":"2023-08-10T10:46:20.713039+0000","last_active":"2023-08-10T10:46:21.674315+0000","last_peered":"2023-08-10T10:46:21.674315+0000","last_clean":"2023-08-10T10:46:21.674315+0000","last_became_active":"2023-08-10T10:46:20.708073+0000","last_became_peered":"2023-08-10T10:46:20.708073+0000","last_unstale":"2023-08-10T10:46:21.674315+0000","last_undegraded":"2023-08-10T10:46:21.674315+0000","last_fullsized":"2023-08-10T10:46:21.674315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:43:58.714669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151688+0000","last_change":"2023-08-10T10:46:19.650083+0000","last_active":"2023-08-10T10:46:22.151688+0000","last_peered":"2023-08-10T10:46:22.151688+0000","last_clean":"2023-08-10T10:46:22.151688+0000","last_became_active":"2023-08-10T10:46:19.649413+0000","last_became_peered":"2023-08-10T10:46:19.649413+0000","last_unstale":"2023-08-10T10:46:22.151688+0000","last_undegraded":"2023-08-10T10:46:22.151688+0000","last_fullsized":"2023-08-10T10:46:22.151688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.029501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152534+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:46:22.152534+0000","last_peered":"2023-08-10T10:46:22.152534+0000","last_clean":"2023-08-10T10:46:22.152534+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:46:22.152534+0000","last_undegraded":"2023-08-10T10:46:22.152534+0000","last_fullsized":"2023-08-10T10:46:22.152534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:25:31.424509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151936+0000","last_change":"2023-08-10T10:46:20.698398+0000","last_active":"2023-08-10T10:46:22.151936+0000","last_peered":"2023-08-10T10:46:22.151936+0000","last_clean":"2023-08-10T10:46:22.151936+0000","last_became_active":"2023-08-10T10:46:20.697752+0000","last_became_peered":"2023-08-10T10:46:20.697752+0000","last_unstale":"2023-08-10T10:46:22.151936+0000","last_undegraded":"2023-08-10T10:46:22.151936+0000","last_fullsized":"2023-08-10T10:46:22.151936+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:56:09.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154013+0000","last_change":"2023-08-10T10:46:19.660033+0000","last_active":"2023-08-10T10:46:22.154013+0000","last_peered":"2023-08-10T10:46:22.154013+0000","last_clean":"2023-08-10T10:46:22.154013+0000","last_became_active":"2023-08-10T10:46:19.659719+0000","last_became_peered":"2023-08-10T10:46:19.659719+0000","last_unstale":"2023-08-10T10:46:22.154013+0000","last_undegraded":"2023-08-10T10:46:22.154013+0000","last_fullsized":"2023-08-10T10:46:22.154013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:38.767277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":248,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.673125+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:46:21.673125+0000","last_peered":"2023-08-10T10:46:21.673125+0000","last_clean":"2023-08-10T10:46:21.673125+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:46:21.673125+0000","last_undegraded":"2023-08-10T10:46:21.673125+0000","last_fullsized":"2023-08-10T10:46:21.673125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:03.593810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.154845+0000","last_change":"2023-08-10T10:46:20.706039+0000","last_active":"2023-08-10T10:46:22.154845+0000","last_peered":"2023-08-10T10:46:22.154845+0000","last_clean":"2023-08-10T10:46:22.154845+0000","last_became_active":"2023-08-10T10:46:20.705876+0000","last_became_peered":"2023-08-10T10:46:20.705876+0000","last_unstale":"2023-08-10T10:46:22.154845+0000","last_undegraded":"2023-08-10T10:46:22.154845+0000","last_fullsized":"2023-08-10T10:46:22.154845+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:39.367323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152334+0000","last_change":"2023-08-10T10:46:19.656941+0000","last_active":"2023-08-10T10:46:22.152334+0000","last_peered":"2023-08-10T10:46:22.152334+0000","last_clean":"2023-08-10T10:46:22.152334+0000","last_became_active":"2023-08-10T10:46:19.653848+0000","last_became_peered":"2023-08-10T10:46:19.653848+0000","last_unstale":"2023-08-10T10:46:22.152334+0000","last_undegraded":"2023-08-10T10:46:22.152334+0000","last_fullsized":"2023-08-10T10:46:22.152334+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:44.220205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152414+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:46:22.152414+0000","last_peered":"2023-08-10T10:46:22.152414+0000","last_clean":"2023-08-10T10:46:22.152414+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:46:22.152414+0000","last_undegraded":"2023-08-10T10:46:22.152414+0000","last_fullsized":"2023-08-10T10:46:22.152414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:07.702202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151347+0000","last_change":"2023-08-10T10:46:20.702722+0000","last_active":"2023-08-10T10:46:22.151347+0000","last_peered":"2023-08-10T10:46:22.151347+0000","last_clean":"2023-08-10T10:46:22.151347+0000","last_became_active":"2023-08-10T10:46:20.702263+0000","last_became_peered":"2023-08-10T10:46:20.702263+0000","last_unstale":"2023-08-10T10:46:22.151347+0000","last_undegraded":"2023-08-10T10:46:22.151347+0000","last_fullsized":"2023-08-10T10:46:22.151347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:08.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"142'3","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.155175+0000","last_change":"2023-08-10T10:46:19.656322+0000","last_active":"2023-08-10T10:46:22.155175+0000","last_peered":"2023-08-10T10:46:22.155175+0000","last_clean":"2023-08-10T10:46:22.155175+0000","last_became_active":"2023-08-10T10:46:19.652897+0000","last_became_peered":"2023-08-10T10:46:19.652897+0000","last_unstale":"2023-08-10T10:46:22.155175+0000","last_undegraded":"2023-08-10T10:46:22.155175+0000","last_fullsized":"2023-08-10T10:46:22.155175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:33.847573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:21.672436+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:46:21.672436+0000","last_peered":"2023-08-10T10:46:21.672436+0000","last_clean":"2023-08-10T10:46:21.672436+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:46:21.672436+0000","last_undegraded":"2023-08-10T10:46:21.672436+0000","last_fullsized":"2023-08-10T10:46:21.672436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.707693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.152703+0000","last_change":"2023-08-10T10:46:20.707995+0000","last_active":"2023-08-10T10:46:22.152703+0000","last_peered":"2023-08-10T10:46:22.152703+0000","last_clean":"2023-08-10T10:46:22.152703+0000","last_became_active":"2023-08-10T10:46:20.707730+0000","last_became_peered":"2023-08-10T10:46:20.707730+0000","last_unstale":"2023-08-10T10:46:22.152703+0000","last_undegraded":"2023-08-10T10:46:22.152703+0000","last_fullsized":"2023-08-10T10:46:22.152703+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:19.624362+0000","last_clean_scrub_stamp":"2023-08-10T10:46:19.624362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:58:09.856813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"142'6","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151347+0000","last_change":"2023-08-10T10:46:19.640327+0000","last_active":"2023-08-10T10:46:22.151347+0000","last_peered":"2023-08-10T10:46:22.151347+0000","last_clean":"2023-08-10T10:46:22.151347+0000","last_became_active":"2023-08-10T10:46:19.639634+0000","last_became_peered":"2023-08-10T10:46:19.639634+0000","last_unstale":"2023-08-10T10:46:22.151347+0000","last_undegraded":"2023-08-10T10:46:22.151347+0000","last_fullsized":"2023-08-10T10:46:22.151347+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:46:18.609436+0000","last_clean_scrub_stamp":"2023-08-10T10:46:18.609436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:58.815817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-08-10T10:46:22.151569+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:46:22.151569+0000","last_peered":"2023-08-10T10:46:22.151569+0000","last_clean":"2023-08-10T10:46:22.151569+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:46:22.151569+0000","last_undegraded":"2023-08-10T10:46:22.151569+0000","last_fullsized":"2023-08-10T10:46:22.151569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:03.764202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1406,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198559481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1000000000000001,"15min":1.1279999999999999},"min":{"1min":0.57999999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.2},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.0840000000000001},"min":{"1min":0.58999999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":5.149,"15min":5.149},"last":0.872}]},{"osd":1,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.173,"15min":1.1419999999999999},"min":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.1519999999999999,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.196,"15min":1.2170000000000001},"min":{"1min":0.70199999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5229999999999999,"5min":5.2709999999999999,"15min":5.2709999999999999},"last":1.524},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.21,"15min":1.212},"min":{"1min":0.76300000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.556,"5min":1.766,"15min":1.766},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.98599999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.329}]},{"osd":4,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.26,"15min":1.236},"min":{"1min":0.85399999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.825,"5min":1.99,"15min":1.99},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.3089999999999999,"15min":1.2729999999999999},"min":{"1min":0.755,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.74,"5min":6.657,"15min":6.657},"last":1.6579999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.1659999999999999,"5min":0.60599999999999998,"15min":0.59699999999999998},"max":{"1min":3.3940000000000001,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.488},"min":{"1min":0.95599999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0699999999999998,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":1.764}]},{"osd":6,"last update":"Thu Aug 10 10:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5349999999999999,"15min":1.5740000000000001},"min":{"1min":1.238,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.3140000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.569},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.484,"15min":1.4970000000000001},"min":{"1min":1.077,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0099999999999998,"5min":3.585,"15min":3.585},"last":1.8129999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199150043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.113,"15min":1.0589999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6279999999999999,"5min":1.75,"15min":1.7509999999999999},"last":1.288},{"interface":"front","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.01},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.46600000000000003},"max":{"1min":1.579,"5min":1.659,"15min":1.659},"last":0.90300000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1140000000000001,"15min":1.069},"min":{"1min":0.72399999999999998,"5min":0.624,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.302,"15min":2.302},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.256,"15min":1.1830000000000001},"min":{"1min":0.83899999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.819,"5min":2.052,"15min":2.052},"last":1.194}]},{"osd":2,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.198,"15min":1.139},"min":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.72299999999999998},"max":{"1min":1.7230000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.262},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.2749999999999999,"15min":1.2270000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6339999999999999,"5min":1.968,"15min":1.968},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3460000000000001,"15min":1.228},"min":{"1min":0.80700000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6719999999999999,"5min":3.177,"15min":3.177},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.321,"15min":1.262},"min":{"1min":0.84299999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.71,"5min":2.395,"15min":2.395},"last":1.123}]},{"osd":4,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2829999999999999,"15min":1.214},"min":{"1min":0.60699999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.7010000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.494,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":2.0009999999999999,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.478,"15min":1.407},"min":{"1min":0.69999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.802,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.163},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5760000000000001,"15min":1.4990000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":2.1139999999999999,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.429,"15min":1.371},"min":{"1min":1.0089999999999999,"5min":0.60499999999999998,"15min":0.57699999999999996},"max":{"1min":2.0600000000000001,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5589999999999999,"15min":1.4870000000000001},"min":{"1min":0.96999999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.016,"5min":2.5819999999999999,"15min":2.698},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199151484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1339999999999999,"15min":1.0920000000000001},"min":{"1min":0.73299999999999998,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":2.5070000000000001},"last":1.21},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.4790000000000001,"15min":1.214},"min":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.64000000000000001},"max":{"1min":1.6899999999999999,"5min":32.941000000000003,"15min":32.941000000000003},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.68899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.762,"5min":1.762,"15min":2.2450000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.165,"15min":1.208},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.651,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.117}]},{"osd":2,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.24,"15min":1.323},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.857,"5min":1.857,"15min":4.1980000000000004},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1950000000000001,"15min":1.159},"min":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5920000000000001,"5min":1.653,"15min":1.73},"last":1.337}]},{"osd":3,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2809999999999999,"15min":1.26},"min":{"1min":0.81899999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7410000000000001,"5min":1.7669999999999999,"15min":1.7709999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3080000000000001,"15min":1.363},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.397}]},{"osd":4,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.2310000000000001,"15min":1.2869999999999999},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.518},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3660000000000001,"15min":1.3600000000000001},"min":{"1min":0.85299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7689999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3879999999999999,"15min":1.3280000000000001},"min":{"1min":0.80200000000000005,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3979999999999999,"15min":1.387},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":1.9650000000000001,"15min":1.98},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:45:27 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.4830000000000001,"15min":1.488},"min":{"1min":0.90400000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.831,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.498,"15min":1.4910000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.5369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":2.2559999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.538,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.907}]},{"osd":1,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.286},"min":{"1min":0.93100000000000005,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.7809999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.242},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.159,"15min":1.141},"min":{"1min":0.747,"5min":0.67900000000000005,"15min":0.58499999999999996},"max":{"1min":1.79,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.2050000000000001,"15min":1.1539999999999999},"min":{"1min":0.78500000000000003,"5min":0.66000000000000003,"15min":0.621},"max":{"1min":1.48,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.347,"15min":1.304},"min":{"1min":1.083,"5min":0.85099999999999998,"15min":0.70499999999999996},"max":{"1min":1.835,"5min":4.226,"15min":4.226},"last":1.7989999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.3069999999999999,"15min":1.256},"min":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.893,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3700000000000001,"15min":1.2909999999999999},"min":{"1min":0.91500000000000004,"5min":0.82699999999999996,"15min":0.67000000000000004},"max":{"1min":2.5600000000000001,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.091}]},{"osd":5,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.385,"15min":1.363},"min":{"1min":0.876,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":1.863,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.51},{"interface":"front","average":{"1min":1.252,"5min":1.3340000000000001,"15min":1.298},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.42399999999999999},"max":{"1min":1.6859999999999999,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.7390000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.375,"15min":1.335},"min":{"1min":0.746,"5min":0.746,"15min":0.47599999999999998},"max":{"1min":2.6190000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5429999999999999,"15min":1.4790000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.76700000000000002},"max":{"1min":1.7529999999999999,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.992}]},{"osd":7,"last update":"Thu Aug 10 10:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.502,"15min":1.4339999999999999},"min":{"1min":0.999,"5min":0.82699999999999996,"15min":0.57999999999999996},"max":{"1min":1.8859999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5880000000000001,"15min":1.5189999999999999},"min":{"1min":1.054,"5min":0.96699999999999997,"15min":0.73499999999999999},"max":{"1min":2.6659999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.76}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92500000000000004,"15min":0.84299999999999997},"min":{"1min":0.56899999999999995,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.4990000000000001,"5min":1.629,"15min":2.1019999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.167,"15min":1.0029999999999999},"min":{"1min":0.55500000000000005,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.627,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94699999999999995,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.4370000000000001,"5min":1.5569999999999999,"15min":1.6599999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0820000000000001,"15min":0.95199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.34100000000000003},"max":{"1min":1.615,"5min":1.752,"15min":1.897},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0369999999999999,"15min":0.94999999999999996},"min":{"1min":0.48599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5349999999999999,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1739999999999999,"15min":1.0760000000000001},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.46899999999999997},"max":{"1min":1.514,"5min":1.958,"15min":2.0430000000000001},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.4159999999999999,"15min":1.2669999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.70599999999999996},"max":{"1min":1.6120000000000001,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.2609999999999999,"15min":1.2050000000000001},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.71399999999999997},"max":{"1min":1.786,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.409,"15min":1.3320000000000001},"min":{"1min":0.94599999999999995,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":1.889,"5min":1.889,"15min":2.125},"last":1.179},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4390000000000001,"15min":1.3680000000000001},"min":{"1min":0.91600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.736,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3779999999999999,"15min":1.2809999999999999},"min":{"1min":0.97199999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.663,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.403},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.8280000000000001,"5min":1.984,"15min":2.1539999999999999},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.4970000000000001,"15min":1.4319999999999999},"min":{"1min":1.0069999999999999,"5min":0.81699999999999995,"15min":0.754},"max":{"1min":1.7410000000000001,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4219999999999999,"15min":1.3440000000000001},"min":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7290000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199150625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.3540000000000001,"5min":1.464,"15min":1.5209999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97899999999999998,"15min":0.90400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6000000000000001,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.6000000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.1200000000000001,"15min":1.05},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.425,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.23,"15min":1.1279999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.835,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.835}]},{"osd":3,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1,"15min":0.995},"min":{"1min":0.54200000000000004,"5min":0.51900000000000002,"15min":0.50900000000000001},"max":{"1min":1.3740000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.2130000000000001,"15min":1.23},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5920000000000001,"5min":1.863,"15min":3.6920000000000002},"last":1.206}]},{"osd":4,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.393,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.84499999999999997,"15min":0.82699999999999996},"max":{"1min":1.7150000000000001,"5min":2.415,"15min":2.6000000000000001},"last":1.341},{"interface":"front","average":{"1min":1.163,"5min":1.3580000000000001,"15min":1.3080000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.306,"15min":1.2689999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6439999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.486,"15min":1.4710000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.806,"5min":3.294,"15min":3.294},"last":1.5549999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4530000000000001,"15min":1.3859999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":1.821,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.4159999999999999,"15min":1.355},"min":{"1min":0.97399999999999998,"5min":0.86499999999999999,"15min":0.79700000000000004},"max":{"1min":1.7050000000000001,"5min":2.444,"15min":2.444},"last":1.647}]},{"osd":7,"last update":"Thu Aug 10 10:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5229999999999999,"15min":1.419},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4650000000000001,"15min":1.421},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.81100000000000005},"max":{"1min":1.788,"5min":2.556,"15min":2.556},"last":1.714}]}]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199150603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89700000000000002,"15min":0.83799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.4259999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99299999999999999,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":1.4910000000000001,"5min":2.012,"15min":2.246},"last":0.752}]},{"osd":2,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0169999999999999,"15min":0.89900000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.436},"max":{"1min":1.6220000000000001,"5min":1.792,"15min":2.0209999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.22,"15min":1.083},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45600000000000002},"max":{"1min":1.7370000000000001,"5min":1.7589999999999999,"15min":2.423},"last":1.048}]},{"osd":3,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1910000000000001,"15min":1.073},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.9910000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.0409999999999999},"min":{"1min":0.65300000000000002,"5min":0.45200000000000001,"15min":0.42399999999999999},"max":{"1min":1.4530000000000001,"5min":1.9059999999999999,"15min":2.8940000000000001},"last":1.323}]},{"osd":4,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.274,"15min":1.1850000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":2.0259999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.022},{"interface":"front","average":{"1min":1.452,"5min":1.4670000000000001,"15min":1.399},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.0830000000000002,"5min":2.343,"15min":2.343},"last":1.5}]},{"osd":5,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.423,"15min":1.371},"min":{"1min":0.93100000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.913,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4279999999999999,"15min":1.331},"min":{"1min":0.94599999999999995,"5min":0.79400000000000004,"15min":0.71699999999999997},"max":{"1min":1.962,"5min":2.73,"15min":2.73},"last":1.371}]},{"osd":6,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.429,"15min":1.3720000000000001},"min":{"1min":0.82899999999999996,"5min":0.81399999999999995,"15min":0.78400000000000003},"max":{"1min":1.8440000000000001,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.425,"15min":1.284},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":2.0800000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.097}]},{"osd":7,"last update":"Thu Aug 10 10:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.5049999999999999,"15min":1.4430000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.742},"last":1.399},{"interface":"front","average":{"1min":1.482,"5min":1.504,"15min":1.411},"min":{"1min":0.85099999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.9830000000000001,"5min":2.1640000000000001,"15min":2.605},"last":1.4470000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193907,"statfs":{"total":200000000,"available":198561254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.27,"5min":1.546,"15min":1.546},"last":1.046},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.077,"15min":1.0369999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.411,"5min":1.633,"15min":1.853},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.026,"15min":1.0249999999999999},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":1.5760000000000001,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.256},{"interface":"front","average":{"1min":1.071,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.617,"5min":1.7,"15min":1.7},"last":1.089}]},{"osd":3,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.034,"15min":0.95599999999999996},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.585,"5min":5.9980000000000002,"15min":5.9980000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1970000000000001,"15min":1.117},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.9670000000000001,"5min":2.3290000000000002,"15min":2.8700000000000001},"last":1.393}]},{"osd":4,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.387,"15min":1.282},"min":{"1min":1.1220000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.734,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":1.726},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4099999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.883,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.7749999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.736,"5min":1.9259999999999999,"15min":1.986},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.5409999999999999,"15min":1.353},"min":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6719999999999999,"5min":16.058,"15min":16.058},"last":1.302}]},{"osd":6,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.482,"15min":1.456},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8220000000000001,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.657},{"interface":"front","average":{"1min":1.407,"5min":1.4430000000000001,"15min":1.4339999999999999},"min":{"1min":0.94199999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9179999999999999,"5min":2.1789999999999998,"15min":3.2240000000000002},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:45:25 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.5049999999999999,"15min":1.522},"min":{"1min":1.038,"5min":0.752,"15min":0.752},"max":{"1min":1.8360000000000001,"5min":2.8940000000000001,"15min":3.3330000000000002},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4990000000000001,"15min":1.423},"min":{"1min":1.0389999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.778,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":1.601}]}]}],"pool_statfs":[]}} 2023-08-10T10:46:25.704 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:46:25.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:46:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.983+0000 7fb1b5ddd640 1 Processor -- start 2023-08-10T10:46:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.983+0000 7fb1b5ddd640 1 -- start start 2023-08-10T10:46:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.984+0000 7fb1b5ddd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb1b00c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.984+0000 7fb1b5ddd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b00b1370 con 0x7fb1b00aff00 2023-08-10T10:46:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.984+0000 7fb1b5ddd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b00b1650 con 0x7fb1b015aa50 2023-08-10T10:46:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.984+0000 7fb1b5ddd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b015ae30 con 0x7fb1b00b4130 2023-08-10T10:46:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.985+0000 7fb1b55dc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1b00aff00 0x7fb1b00cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49592/0 (socket says 172.21.15.50:49592) 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.985+0000 7fb1b55dc640 1 -- 172.21.15.50:0/3856245969 learned_addr learned my addr 172.21.15.50:0/3856245969 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.985+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb1b00c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.985+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925146384 0 0) 0x7fb1b00b1370 con 0x7fb1b00aff00 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.985+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb198003520 con 0x7fb1b00aff00 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355901005 0 0) 0x7fb198003520 con 0x7fb1b00aff00 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 msgr2=0x7fb1b00c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb1b00c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 >> v1:172.21.15.117:6789/0 conn(0x7fb1b015aa50 legacy=0x7fb1b00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00b1930 con 0x7fb1b00aff00 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb1a80019f0 con 0x7fb1b00aff00 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 >> v1:172.21.15.50:6789/0 conn(0x7fb1b00aff00 legacy=0x7fb1b00cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb198003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb198003f90 0x7fb1980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198004d00 0x7fb198005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b015ae30 con 0x7fb198003f90 2023-08-10T10:46:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19800bb70 con 0x7fb198004d00 2023-08-10T10:46:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19800bd30 con 0x7fb1b00b4130 2023-08-10T10:46:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.986+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb198003f90 0x7fb1980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1b55dc640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198004d00 0x7fb198005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1b4ddb640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb198003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1a7fff640 1 -- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 msgr2=0x7fb198003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b00b4130 0x7fb198003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1a7fff640 1 -- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198004d00 msgr2=0x7fb198005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198004d00 0x7fb198005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.987+0000 7fb1a7fff640 1 -- 172.21.15.50:0/3856245969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198003520 con 0x7fb198003f90 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.988+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb198003f90 0x7fb1980047c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ac0 tx=0x7fb1980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37901fb24fe23d64 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.988+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a002c6b0 con 0x7fb198003f90 2023-08-10T10:46:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.988+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a002c810 con 0x7fb198003f90 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.988+0000 7fb1a77fe640 1 -- 172.21.15.50:0/3856245969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a002cba0 con 0x7fb198003f90 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/3856245969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb198003f90 msgr2=0x7fb1980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/3856245969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb198003f90 0x7fb1980047c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ac0 tx=0x7fb1980057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b55dc640 1 -- 172.21.15.50:0/3856245969 reap_dead start 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/3856245969 shutdown_connections 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/3856245969 >> 172.21.15.50:0/3856245969 conn(0x7fb1b0069cd0 msgr2=0x7fb1b00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/3856245969 shutdown_connections 2023-08-10T10:46:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.989+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/3856245969 wait complete. 2023-08-10T10:46:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.991+0000 7fb1b5ddd640 1 Processor -- start 2023-08-10T10:46:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.991+0000 7fb1b5ddd640 1 -- start start 2023-08-10T10:46:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198003f90 0x7fb1b00c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b015bfb0 0x7fb1b00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b006e7e0 con 0x7fb1b014fbb0 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c6160 con 0x7fb198003f90 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b5ddd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c6440 con 0x7fb1b015bfb0 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b55dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b55dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51966/0 (socket says 172.21.15.50:51966) 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.992+0000 7fb1b55dc640 1 -- 172.21.15.50:0/188209411 learned_addr learned my addr 172.21.15.50:0/188209411 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1a7fff640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b015bfb0 0x7fb1b00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b4ddb640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198003f90 0x7fb1b00c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 -- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b015bfb0 msgr2=0x7fb1b00c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b015bfb0 0x7fb1b00c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 -- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198003f90 msgr2=0x7fb1b00c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198003f90 0x7fb1b00c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 -- 172.21.15.50:0/188209411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00c6720 con 0x7fb1b014fbb0 2023-08-10T10:46:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.993+0000 7fb1b55dc640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00cad70 tx=0x7fb1a8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.994+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800eb00 con 0x7fb1b014fbb0 2023-08-10T10:46:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.994+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800ec80 con 0x7fb1b014fbb0 2023-08-10T10:46:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.994+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00c6a00 con 0x7fb1b014fbb0 2023-08-10T10:46:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.994+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8013420 con 0x7fb1b014fbb0 2023-08-10T10:46:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.994+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b0150030 con 0x7fb1b014fbb0 2023-08-10T10:46:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.995+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b01501c0 con 0x7fb1b014fbb0 2023-08-10T10:46:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.996+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1a80135a0 con 0x7fb1b014fbb0 2023-08-10T10:46:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.997+0000 7fb1a57fa640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 0x7fb19c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.998+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1a8089a00 con 0x7fb1b014fbb0 2023-08-10T10:46:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.998+0000 7fb1b4ddb640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 0x7fb19c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:25.999+0000 7fb1b4ddb640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 0x7fb19c06d110 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00717e0 tx=0x7fb1ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.002+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb1a8054a10 con 0x7fb1b014fbb0 2023-08-10T10:46:26.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.269+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb1b0066e30 con 0x7fb1b014fbb0 2023-08-10T10:46:26.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.277+0000 7fb1a57fa640 1 -- 172.21.15.50:0/188209411 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb1a8058030 con 0x7fb1b014fbb0 2023-08-10T10:46:26.278 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:46:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:46:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:46:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:46:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:46:26.279 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:46:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 msgr2=0x7fb19c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 0x7fb19c06d110 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00717e0 tx=0x7fb1ac009040 comp rx=0 tx=0).stop 2023-08-10T10:46:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 msgr2=0x7fb1b00c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00cad70 tx=0x7fb1a8007bc0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 shutdown_connections 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b014fbb0 0x7fb1b00c9b20 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1b015bfb0 0x7fb1b00c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb19c06ac50 0x7fb19c06d110 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 --2- 172.21.15.50:0/188209411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb198003f90 0x7fb1b00c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.280+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 >> 172.21.15.50:0/188209411 conn(0x7fb1b0069cd0 msgr2=0x7fb1b00b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:26.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.281+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 shutdown_connections 2023-08-10T10:46:26.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.281+0000 7fb1b5ddd640 1 -- 172.21.15.50:0/188209411 wait complete. 2023-08-10T10:46:26.301 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.530+0000 7f198b59e640 1 Processor -- start 2023-08-10T10:46:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.531+0000 7f198b59e640 1 -- start start 2023-08-10T10:46:26.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198b59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f198c0c9d00 0x7f198c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f198c0cd290 0x7f198c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0cc5a0 con 0x7f198c159830 2023-08-10T10:46:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c0b4170 con 0x7f198c0cd290 2023-08-10T10:46:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198b59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c15d720 con 0x7f198c0c9d00 2023-08-10T10:46:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.532+0000 7f198ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f198c0cd290 0x7f198c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f198c0cd290 0x7f198c0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51978/0 (socket says 172.21.15.50:51978) 2023-08-10T10:46:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 -- 172.21.15.50:0/207131632 learned_addr learned my addr 172.21.15.50:0/207131632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f1989d9b640 1 --2- 172.21.15.50:0/207131632 >> v2:172.21.15.117:3300/0 conn(0x7f198c0c9d00 0x7f198c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 -- 172.21.15.50:0/207131632 >> v2:172.21.15.117:3300/0 conn(0x7f198c0c9d00 msgr2=0x7f198c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 --2- 172.21.15.50:0/207131632 >> v2:172.21.15.117:3300/0 conn(0x7f198c0c9d00 0x7f198c0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 -- 172.21.15.50:0/207131632 >> v1:172.21.15.117:6789/0 conn(0x7f198c159830 legacy=0x7f198c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.533+0000 7f198ad9d640 1 -- 172.21.15.50:0/207131632 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c159c10 con 0x7f198c0cd290 2023-08-10T10:46:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.534+0000 7f198ad9d640 1 --2- 172.21.15.50:0/207131632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c0cd290 0x7f198c0cd6a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f198c0cbcf0 tx=0x7f198402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562160e0fa3a82fc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198959a640 1 -- 172.21.15.50:0/207131632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198402ee90 con 0x7f198c0cd290 2023-08-10T10:46:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198959a640 1 -- 172.21.15.50:0/207131632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984036440 con 0x7f198c0cd290 2023-08-10T10:46:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198959a640 1 -- 172.21.15.50:0/207131632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19840367d0 con 0x7f198c0cd290 2023-08-10T10:46:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 -- 172.21.15.50:0/207131632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c0cd290 msgr2=0x7f198c0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 --2- 172.21.15.50:0/207131632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c0cd290 0x7f198c0cd6a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f198c0cbcf0 tx=0x7f198402e0e0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 -- 172.21.15.50:0/207131632 shutdown_connections 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 --2- 172.21.15.50:0/207131632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c0cd290 0x7f198c0cd6a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 --2- 172.21.15.50:0/207131632 >> v2:172.21.15.117:3300/0 conn(0x7f198c0c9d00 0x7f198c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 -- 172.21.15.50:0/207131632 >> 172.21.15.50:0/207131632 conn(0x7f198c06ab80 msgr2=0x7f198c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.535+0000 7f198b59e640 1 -- 172.21.15.50:0/207131632 shutdown_connections 2023-08-10T10:46:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.536+0000 7f198b59e640 1 -- 172.21.15.50:0/207131632 wait complete. 2023-08-10T10:46:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.537+0000 7f198b59e640 1 Processor -- start 2023-08-10T10:46:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.538+0000 7f198b59e640 1 -- start start 2023-08-10T10:46:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 0x7f198c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f198c0cd290 0x7f198c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f6810 con 0x7f198c159830 2023-08-10T10:46:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f6530 con 0x7f198c0c9d00 2023-08-10T10:46:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c15b0c0 con 0x7f198c0cd290 2023-08-10T10:46:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51980/0 (socket says 172.21.15.50:51980) 2023-08-10T10:46:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 -- 172.21.15.50:0/4199766220 learned_addr learned my addr 172.21.15.50:0/4199766220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198a59c640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 0x7f198c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 -- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f198c0cd290 msgr2=0x7f198c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f198c0cd290 0x7f198c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 -- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 msgr2=0x7f198c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 0x7f198c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198ad9d640 1 -- 172.21.15.50:0/4199766220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198400b770 con 0x7f198c159830 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.539+0000 7f198a59c640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 0x7f198c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f198ad9d640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f198400b2c0 tx=0x7f19840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984034850 con 0x7f198c159830 2023-08-10T10:46:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19840349b0 con 0x7f198c159830 2023-08-10T10:46:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984034d60 con 0x7f198c159830 2023-08-10T10:46:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c15b3a0 con 0x7f198c159830 2023-08-10T10:46:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.540+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c1551e0 con 0x7f198c159830 2023-08-10T10:46:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.542+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c1553c0 con 0x7f198c159830 2023-08-10T10:46:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.542+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19840403e0 con 0x7f198c159830 2023-08-10T10:46:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.544+0000 7f197affd640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 0x7f196c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.544+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19840ab850 con 0x7f198c159830 2023-08-10T10:46:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.544+0000 7f198a59c640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 0x7f196c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.545+0000 7f198a59c640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 0x7f196c06d110 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f197c004520 tx=0x7f197c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.549+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1984076860 con 0x7f198c159830 2023-08-10T10:46:26.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.782+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f198c15b8c0 con 0x7f198c159830 2023-08-10T10:46:26.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.783+0000 7f197affd640 1 -- 172.21.15.50:0/4199766220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f198c15b8c0 con 0x7f198c159830 2023-08-10T10:46:26.784 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:26.784 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:46:26.785 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:46:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.786+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 msgr2=0x7f196c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.786+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 0x7f196c06d110 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f197c004520 tx=0x7f197c009040 comp rx=0 tx=0).stop 2023-08-10T10:46:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.786+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 msgr2=0x7f198c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.786+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f198400b2c0 tx=0x7f19840046c0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 shutdown_connections 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c159830 0x7f198c0b3260 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f198c0cd290 0x7f198c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f196c06ac50 0x7f196c06d110 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 --2- 172.21.15.50:0/4199766220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f198c0c9d00 0x7f198c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 >> 172.21.15.50:0/4199766220 conn(0x7f198c06ab80 msgr2=0x7f198c0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 shutdown_connections 2023-08-10T10:46:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:26.787+0000 7f198b59e640 1 -- 172.21.15.50:0/4199766220 wait complete. 2023-08-10T10:46:27.208 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:46:20.143240+0000', 'modified': '2023-08-10T10:46:23.695887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8010}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8010': {'gid': 8010, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6837/935015286', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 935015286}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 935015286}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:46:27.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:46:27.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:46:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.450+0000 7ff1086a7640 1 Processor -- start 2023-08-10T10:46:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.450+0000 7ff1086a7640 1 -- start start 2023-08-10T10:46:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.452+0000 7ff1086a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff10006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.452+0000 7ff1086a7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10015bcb0 con 0x7ff10015a820 2023-08-10T10:46:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.452+0000 7ff1086a7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10015b0a0 con 0x7ff100069db0 2023-08-10T10:46:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.452+0000 7ff1086a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c5540 con 0x7ff10015ac00 2023-08-10T10:46:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff106443640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff10015a820 0x7ff1000696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49604/0 (socket says 172.21.15.50:49604) 2023-08-10T10:46:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff106443640 1 -- 172.21.15.50:0/2308892248 learned_addr learned my addr 172.21.15.50:0/2308892248 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105c42640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff10006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582728145 0 0) 0x7ff10015bcb0 con 0x7ff10015a820 2023-08-10T10:46:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e8003520 con 0x7ff10015a820 2023-08-10T10:46:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077020104 0 0) 0x7ff0e8003520 con 0x7ff10015a820 2023-08-10T10:46:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 msgr2=0x7ff10006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff10006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 >> v1:172.21.15.117:6789/0 conn(0x7ff100069db0 legacy=0x7ff1000cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10015b380 con 0x7ff10015a820 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff0f0001670 con 0x7ff10015a820 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.453+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 >> v1:172.21.15.50:6789/0 conn(0x7ff10015a820 legacy=0x7ff1000696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e80039a0 0x7ff0e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff0e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8004d00 0x7ff0e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c5540 con 0x7ff0e8004d00 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e800ba60 con 0x7ff0e80039a0 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e800bc20 con 0x7ff10015ac00 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8004d00 0x7ff0e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105c42640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff0e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106443640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e80039a0 0x7ff0e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 -- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 msgr2=0x7ff0e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff0e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 -- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e80039a0 msgr2=0x7ff0e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e80039a0 0x7ff0e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106c44640 1 -- 172.21.15.50:0/2308892248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e8003520 con 0x7ff0e8004d00 2023-08-10T10:46:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff105c42640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff10015ac00 0x7ff0e80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:27.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.454+0000 7ff106443640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e80039a0 0x7ff0e8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff106c44640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8004d00 0x7ff0e8005180 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff1000adb40 tx=0x7ff0e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67aa67ee2a728760 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8003b70 con 0x7ff0e8004d00 2023-08-10T10:46:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8003cd0 con 0x7ff0e8004d00 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff105441640 1 -- 172.21.15.50:0/2308892248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8005310 con 0x7ff0e8004d00 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff1086a7640 1 -- 172.21.15.50:0/2308892248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8004d00 msgr2=0x7ff0e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff1086a7640 1 --2- 172.21.15.50:0/2308892248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8004d00 0x7ff0e8005180 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff1000adb40 tx=0x7ff0e80057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.456+0000 7ff106c44640 1 -- 172.21.15.50:0/2308892248 reap_dead start 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.457+0000 7ff1086a7640 1 -- 172.21.15.50:0/2308892248 shutdown_connections 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.457+0000 7ff1086a7640 1 -- 172.21.15.50:0/2308892248 >> 172.21.15.50:0/2308892248 conn(0x7ff1000b08e0 msgr2=0x7ff1000ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.457+0000 7ff1086a7640 1 -- 172.21.15.50:0/2308892248 shutdown_connections 2023-08-10T10:46:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.457+0000 7ff1086a7640 1 -- 172.21.15.50:0/2308892248 wait complete. 2023-08-10T10:46:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.458+0000 7ff1086a7640 1 Processor -- start 2023-08-10T10:46:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.459+0000 7ff1086a7640 1 -- start start 2023-08-10T10:46:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 0x7ff1000c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 0x7ff1000ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1001f2110 con 0x7ff10014d3b0 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10014d830 con 0x7ff1000add20 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff1086a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000b24b0 con 0x7ff0e8004d00 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51998/0 (socket says 172.21.15.50:51998) 2023-08-10T10:46:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 -- 172.21.15.50:0/1352001451 learned_addr learned my addr 172.21.15.50:0/1352001451 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff106c44640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 0x7ff1000ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff106443640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 0x7ff1000c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 -- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 msgr2=0x7ff1000c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 0x7ff1000c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 -- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 msgr2=0x7ff1000ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 0x7ff1000ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff105c42640 1 -- 172.21.15.50:0/1352001451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000ae490 con 0x7ff10014d3b0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff106c44640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 0x7ff1000ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.460+0000 7ff106443640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 0x7ff1000c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff105c42640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0108b0 tx=0x7ff0fc010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff0f6ffd640 1 -- 172.21.15.50:0/1352001451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00eb60 con 0x7ff10014d3b0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff0f6ffd640 1 -- 172.21.15.50:0/1352001451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00ecc0 con 0x7ff10014d3b0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff0f6ffd640 1 -- 172.21.15.50:0/1352001451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc01c400 con 0x7ff10014d3b0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1000ae770 con 0x7ff10014d3b0 2023-08-10T10:46:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.461+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1000ae1a0 con 0x7ff10014d3b0 2023-08-10T10:46:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.464+0000 7ff0f6ffd640 1 -- 172.21.15.50:0/1352001451 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0fc01c560 con 0x7ff10014d3b0 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.465+0000 7ff0f6ffd640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 0x7ff0ec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.465+0000 7ff0f6ffd640 1 -- 172.21.15.50:0/1352001451 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0fc089a80 con 0x7ff10014d3b0 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.465+0000 7ff106443640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 0x7ff0ec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.466+0000 7ff10b222740 1 Processor -- start 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.466+0000 7ff10b222740 1 -- start start 2023-08-10T10:46:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.466+0000 7ff106443640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 0x7ff0ec06d140 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0001eb0 tx=0x7ff0f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bdb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bab440 0x555f20bd8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20b1b9d0 con 0x555f20baf040 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20b190c0 con 0x555f20bab440 2023-08-10T10:46:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f20b149b0 con 0x555f20bdb4c0 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff106c44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff106c44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52002/0 (socket says 172.21.15.50:52002) 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.467+0000 7ff106c44640 1 -- 172.21.15.50:0/3907152473 learned_addr learned my addr 172.21.15.50:0/3907152473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106443640 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bdb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff105c42640 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bab440 0x555f20bd8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 -- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 msgr2=0x555f20bdb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bdb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 -- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bab440 msgr2=0x555f20bd8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bab440 0x555f20bd8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 -- 172.21.15.50:0/3907152473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f20ae1c10 con 0x555f20baf040 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff106c44640 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8001ee0 tx=0x7ff0f8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf9d4c6a21cdb1e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff0e7fff640 1 -- 172.21.15.50:0/3907152473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8003b70 con 0x555f20baf040 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.468+0000 7ff0e7fff640 1 -- 172.21.15.50:0/3907152473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8003e40 con 0x555f20baf040 2023-08-10T10:46:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff0e7fff640 1 -- 172.21.15.50:0/3907152473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80052d0 con 0x555f20baf040 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 -- 172.21.15.50:0/3907152473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 msgr2=0x555f20bd8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8001ee0 tx=0x7ff0f8030000 comp rx=0 tx=0).stop 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 -- 172.21.15.50:0/3907152473 shutdown_connections 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bd8c70 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bab440 0x555f20bd8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 --2- 172.21.15.50:0/3907152473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bdb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 -- 172.21.15.50:0/3907152473 >> 172.21.15.50:0/3907152473 conn(0x555f20bad750 msgr2=0x555f20bf62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 -- 172.21.15.50:0/3907152473 shutdown_connections 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.469+0000 7ff10b222740 1 -- 172.21.15.50:0/3907152473 wait complete. 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.470+0000 7ff10b222740 1 -- start start 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.470+0000 7ff10b222740 1 Processor -- start 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bc89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20c05f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20ab5940 con 0x555f20baf040 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20ab55e0 con 0x555f20bdb4c0 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f2087bf20 con 0x555f20bde5d0 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.471+0000 7ff10b222740 10 client.0 _ll_register_callbacks cb 0x555f20b0e250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52006/0 (socket says 172.21.15.50:52006) 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 -- 172.21.15.50:0/389646492 learned_addr learned my addr 172.21.15.50:0/389646492 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff105c42640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bc89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 -- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 msgr2=0x555f20c05f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20c05f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 -- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 msgr2=0x555f20bc89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bc89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 -- 172.21.15.50:0/389646492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e8003520 con 0x555f20baf040 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff106443640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec00 tx=0x7ff0f0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb5c1148459b8b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.472+0000 7ff0e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:46:27.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000c050 con 0x555f20baf040 2023-08-10T10:46:27.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0f0022bf0 con 0x555f20baf040 2023-08-10T10:46:27.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f20b3ebf0 con 0x555f20baf040 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0f0005e70 con 0x555f20baf040 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 10 client.8148 fetch_fsmap learned FSMap version 67 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x555f20b13030 con 0x555f20baf040 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f20b3ebf0 con 0x555f20baf040 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff0f0013690 con 0x555f20baf040 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 10 client.8148 fetch_fsmap finished waiting for FSMap version 67 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 10 client.8148 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:46:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 20 client.8148 populate_metadata read hostname 'smithi050' 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20c116c0 0x555f20c13ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 4 client.8148 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.473+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 --> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f20b077c0 con 0x555f20c116c0 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.474+0000 7ff105c42640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20c116c0 0x555f20c13ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.474+0000 7ff105c42640 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20c116c0 0x555f20c13ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91b0f91facd94fa server_cookie=211f29f8857cf09b in_seq=0 out_seq=0 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.474+0000 7ff0e57fa640 10 client.8148 ms_handle_connect on v2:172.21.15.50:6836/935015286 2023-08-10T10:46:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff0e57fa640 1 -- 172.21.15.50:0/389646492 <== mds.0 v2:172.21.15.50:6836/935015286 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x555f20b077c0 con 0x555f20c116c0 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff0e57fa640 10 client.8148 handle_command_reply: tid=0 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 client.8148 shutdown 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 msgr2=0x555f20bdd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec00 tx=0x7ff0f0001a00 comp rx=0 tx=0).stop 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 shutdown_connections 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20c116c0 0x555f20c13ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20c05f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bc89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 --2- 172.21.15.50:0/389646492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bdd9e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff0e57fa640 0 client.8148 ms_handle_reset on v2:172.21.15.50:6836/935015286 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.475+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 >> 172.21.15.50:0/389646492 conn(0x555f20bab440 msgr2=0x555f20baf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.476+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 shutdown_connections 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.476+0000 7ff10b222740 1 -- 172.21.15.50:0/389646492 wait complete. 2023-08-10T10:46:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.476+0000 7ff10b222740 20 client.8148 trim_cache size 0 max 16384 2023-08-10T10:46:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.493+0000 7ff10b222740 1 Processor -- start 2023-08-10T10:46:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.493+0000 7ff10b222740 1 -- start start 2023-08-10T10:46:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bda890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20bdadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20c103e0 con 0x555f20baf040 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20bfa090 con 0x555f20bdb4c0 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f20bde420 con 0x555f20bde5d0 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52016/0 (socket says 172.21.15.50:52016) 2023-08-10T10:46:27.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.494+0000 7ff106443640 1 -- 172.21.15.50:0/1280313663 learned_addr learned my addr 172.21.15.50:0/1280313663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 -- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 msgr2=0x555f20bdadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20bdadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 -- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 msgr2=0x555f20bda890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bda890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 -- 172.21.15.50:0/1280313663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f20b488a0 con 0x555f20baf040 2023-08-10T10:46:27.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff106443640 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005c80 tx=0x7ff0f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f515639fca2d79c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff0f4ff9640 1 -- 172.21.15.50:0/1280313663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000c070 con 0x555f20baf040 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff0f4ff9640 1 -- 172.21.15.50:0/1280313663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000d040 con 0x555f20baf040 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.495+0000 7ff0f4ff9640 1 -- 172.21.15.50:0/1280313663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0005e70 con 0x555f20baf040 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 -- 172.21.15.50:0/1280313663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 msgr2=0x555f20bf8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005c80 tx=0x7ff0f001f000 comp rx=0 tx=0).stop 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 -- 172.21.15.50:0/1280313663 shutdown_connections 2023-08-10T10:46:27.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bde5d0 0x555f20bdadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bdb4c0 0x555f20bda890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 --2- 172.21.15.50:0/1280313663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20bf8a50 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 -- 172.21.15.50:0/1280313663 >> 172.21.15.50:0/1280313663 conn(0x555f20bab440 msgr2=0x555f20bdf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 -- 172.21.15.50:0/1280313663 shutdown_connections 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.496+0000 7ff10b222740 1 -- 172.21.15.50:0/1280313663 wait complete. 2023-08-10T10:46:27.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.497+0000 7ff10b222740 1 -- start start 2023-08-10T10:46:27.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.497+0000 7ff10b222740 1 Processor -- start 2023-08-10T10:46:27.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bf7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bde5d0 0x555f20c5f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20c155c0 con 0x555f20baf040 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20bf8010 con 0x555f20bde5d0 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f20bd5f60 con 0x555f20bdb4c0 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff10b222740 10 client.0 _ll_register_callbacks cb 0x7ff0f0007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:46:27.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52018/0 (socket says 172.21.15.50:52018) 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 -- 172.21.15.50:0/1138509179 learned_addr learned my addr 172.21.15.50:0/1138509179 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 -- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 msgr2=0x555f20bf7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bf7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 -- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bde5d0 msgr2=0x555f20c5f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bde5d0 0x555f20c5f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.498+0000 7ff106443640 1 -- 172.21.15.50:0/1138509179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f20b13030 con 0x555f20baf040 2023-08-10T10:46:27.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff106443640 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec00 tx=0x7ff0f0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151b95ffb7bbb34e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff0e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000c070 con 0x555f20baf040 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0f0022450 con 0x555f20baf040 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0f8003e40 con 0x555f20baf040 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0f0013ea0 con 0x555f20baf040 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff10b222740 10 client.8154 fetch_fsmap learned FSMap version 67 2023-08-10T10:46:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.499+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x555f20ab4610 con 0x555f20baf040 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8003e40 con 0x555f20baf040 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff0f003d070 con 0x555f20baf040 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 10 client.8154 fetch_fsmap finished waiting for FSMap version 67 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 10 client.8154 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 20 client.8154 populate_metadata read hostname 'smithi050' 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20be0130 0x555f20bda890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 4 client.8154 mds_command: new command op to 8010 tid=0[{"prefix": "status"}] 2023-08-10T10:46:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 --> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f20b0d990 con 0x555f20be0130 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.500+0000 7ff105c42640 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20be0130 0x555f20bda890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff105c42640 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20be0130 0x555f20bda890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f8af2a91886a5 server_cookie=edff9d39995ba562 in_seq=0 out_seq=0 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff0e57fa640 10 client.8154 ms_handle_connect on v2:172.21.15.50:6836/935015286 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff0e57fa640 1 -- 172.21.15.50:0/1138509179 <== mds.0 v2:172.21.15.50:6836/935015286 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555f20b0d990 con 0x555f20be0130 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff0e57fa640 10 client.8154 handle_command_reply: tid=0 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 client.8154 shutdown 2023-08-10T10:46:27.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 msgr2=0x555f20c41560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec00 tx=0x7ff0f0007000 comp rx=0 tx=0).stop 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 shutdown_connections 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:6836/935015286,v1:172.21.15.50:6837/935015286] conn(0x555f20be0130 0x555f20bda890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f20bde5d0 0x555f20c5f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f20bdb4c0 0x555f20bf7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 --2- 172.21.15.50:0/1138509179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f20baf040 0x555f20c41560 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff0e57fa640 0 client.8154 ms_handle_reset on v2:172.21.15.50:6836/935015286 2023-08-10T10:46:27.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 >> 172.21.15.50:0/1138509179 conn(0x555f20bab440 msgr2=0x555f20bd7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 shutdown_connections 2023-08-10T10:46:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.501+0000 7ff10b222740 1 -- 172.21.15.50:0/1138509179 wait complete. 2023-08-10T10:46:27.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff10b222740 20 client.8154 trim_cache size 0 max 16384 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8010, 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:46:27.509 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.7987930800000003, 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 67, 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 143, 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 143, 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.761079569 2023-08-10T10:46:27.510 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 msgr2=0x7ff0ec06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 0x7ff0ec06d140 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0001eb0 tx=0x7ff0f0009040 comp rx=0 tx=0).stop 2023-08-10T10:46:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 msgr2=0x7ff1001f1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0108b0 tx=0x7ff0fc010d70 comp rx=0 tx=0).stop 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 shutdown_connections 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff0ec06ac80 0x7ff0ec06d140 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1000add20 0x7ff1000ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff10014d3b0 0x7ff1001f1bd0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 --2- 172.21.15.50:0/1352001451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e8004d00 0x7ff1000c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 >> 172.21.15.50:0/1352001451 conn(0x7ff1000b08e0 msgr2=0x7ff10015d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 shutdown_connections 2023-08-10T10:46:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.502+0000 7ff1086a7640 1 -- 172.21.15.50:0/1352001451 wait complete. 2023-08-10T10:46:27.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:46:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.731+0000 7f5e91a98640 1 Processor -- start 2023-08-10T10:46:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.731+0000 7f5e91a98640 1 -- start start 2023-08-10T10:46:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e91a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e8c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e91a98640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0b2280 con 0x7f5e8c0696a0 2023-08-10T10:46:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e91a98640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0b19e0 con 0x7f5e8c15ad00 2023-08-10T10:46:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e91a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b1cc0 con 0x7f5e8c0b1370 2023-08-10T10:46:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e90a96640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e8c0696a0 0x7f5e8c0cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49618/0 (socket says 172.21.15.50:49618) 2023-08-10T10:46:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e90a96640 1 -- 172.21.15.50:0/25914680 learned_addr learned my addr 172.21.15.50:0/25914680 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:27.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.733+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842756700 0 0) 0x7f5e8c0b2280 con 0x7f5e8c0696a0 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c003520 con 0x7f5e8c0696a0 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e91297640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e8c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526858121 0 0) 0x7f5e7c003520 con 0x7f5e8c0696a0 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 msgr2=0x7f5e8c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e8c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 >> v1:172.21.15.117:6789/0 conn(0x7f5e8c15ad00 legacy=0x7f5e8c069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0b1fa0 con 0x7f5e8c0696a0 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5e80001670 con 0x7f5e8c0696a0 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e91297640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e8c0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 >> v1:172.21.15.50:6789/0 conn(0x7f5e8c0696a0 legacy=0x7f5e8c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0039a0 0x7f5e7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0047c0 0x7f5e7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b1cc0 con 0x7f5e7c0047c0 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c00bab0 con 0x7f5e7c0039a0 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.734+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c00bc70 con 0x7f5e8c0b1370 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0047c0 0x7f5e7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e90a96640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0039a0 0x7f5e7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e91297640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 -- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 msgr2=0x7f5e7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e8c0b1370 0x7f5e7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 -- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0039a0 msgr2=0x7f5e7c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:27.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0039a0 0x7f5e7c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.735+0000 7f5e8bfff640 1 -- 172.21.15.50:0/25914680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c003520 con 0x7f5e7c0047c0 2023-08-10T10:46:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.736+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0047c0 0x7f5e7c004c40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001750 tx=0x7f5e7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50bc3f55ab00c5d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780052d0 con 0x7f5e7c0047c0 2023-08-10T10:46:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7802e050 con 0x7f5e7c0047c0 2023-08-10T10:46:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e8b7fe640 1 -- 172.21.15.50:0/25914680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780035f0 con 0x7f5e7c0047c0 2023-08-10T10:46:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 -- 172.21.15.50:0/25914680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0047c0 msgr2=0x7f5e7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 --2- 172.21.15.50:0/25914680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0047c0 0x7f5e7c004c40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001750 tx=0x7f5e7c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91297640 1 -- 172.21.15.50:0/25914680 reap_dead start 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 -- 172.21.15.50:0/25914680 shutdown_connections 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 -- 172.21.15.50:0/25914680 >> 172.21.15.50:0/25914680 conn(0x7f5e8c0cafa0 msgr2=0x7f5e8c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 -- 172.21.15.50:0/25914680 shutdown_connections 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.737+0000 7f5e91a98640 1 -- 172.21.15.50:0/25914680 wait complete. 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.739+0000 7f5e91a98640 1 Processor -- start 2023-08-10T10:46:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.739+0000 7f5e91a98640 1 -- start start 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e7c0047c0 0x7f5e8c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 0x7f5e8c1444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c7420 con 0x7f5e8c1587a0 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c143d10 con 0x7f5e8c144020 2023-08-10T10:46:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.740+0000 7f5e91a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c15b2b0 con 0x7f5e7c0047c0 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52028/0 (socket says 172.21.15.50:52028) 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 -- 172.21.15.50:0/661665485 learned_addr learned my addr 172.21.15.50:0/661665485 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e90a96640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e7c0047c0 0x7f5e8c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e91297640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 0x7f5e8c1444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 -- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e7c0047c0 msgr2=0x7f5e8c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e7c0047c0 0x7f5e8c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 -- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 msgr2=0x7f5e8c1444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 0x7f5e8c1444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e8bfff640 1 -- 172.21.15.50:0/661665485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c15b590 con 0x7f5e8c1587a0 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.741+0000 7f5e91297640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 0x7f5e8c1444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e8bfff640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5e78008fd0 tx=0x7f5e78001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780076c0 con 0x7f5e8c1587a0 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78007a30 con 0x7f5e8c1587a0 2023-08-10T10:46:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c15b870 con 0x7f5e8c1587a0 2023-08-10T10:46:27.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78006c00 con 0x7f5e8c1587a0 2023-08-10T10:46:27.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.742+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0c7a20 con 0x7f5e8c1587a0 2023-08-10T10:46:27.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.743+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c0c7180 con 0x7f5e8c1587a0 2023-08-10T10:46:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.745+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e780035f0 con 0x7f5e8c1587a0 2023-08-10T10:46:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.746+0000 7f5e897fa640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 0x7f5e7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.746+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e780ab5d0 con 0x7f5e8c1587a0 2023-08-10T10:46:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.746+0000 7f5e90a96640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 0x7f5e7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.746+0000 7f5e90a96640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 0x7f5e7006d110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5e80007d20 tx=0x7f5e80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.750+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e8c0c7180 con 0x7f5e8c1587a0 2023-08-10T10:46:27.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.982+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e8c0c7180 con 0x7f5e8c1587a0 2023-08-10T10:46:27.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.983+0000 7f5e897fa640 1 -- 172.21.15.50:0/661665485 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5e8c0c7180 con 0x7f5e8c1587a0 2023-08-10T10:46:27.984 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:46:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 msgr2=0x7f5e7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 0x7f5e7006d110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5e80007d20 tx=0x7f5e80009040 comp rx=0 tx=0).stop 2023-08-10T10:46:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 msgr2=0x7f5e8c1437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5e78008fd0 tx=0x7f5e78001120 comp rx=0 tx=0).stop 2023-08-10T10:46:27.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 shutdown_connections 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5e7006ac50 0x7f5e7006d110 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8c144020 0x7f5e8c1444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c1587a0 0x7f5e8c1437d0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 --2- 172.21.15.50:0/661665485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e7c0047c0 0x7f5e8c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 >> 172.21.15.50:0/661665485 conn(0x7f5e8c0cafa0 msgr2=0x7f5e8c159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 shutdown_connections 2023-08-10T10:46:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:27.986+0000 7f5e91a98640 1 -- 172.21.15.50:0/661665485 wait complete. 2023-08-10T10:46:28.006 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:46:28.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:46:28.007 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:46:28.007 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:46:28.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:46:28.007 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:46:28.008 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:46:28.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:46:28.008 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:46:28.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.009 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:46:28.062 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:46:28.062 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:46:28.062 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:46:28.062 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.062 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:28.063 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40738sec preferred_lft 40738sec 2023-08-10T10:46:28.064 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:46:28.065 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.065 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:28.065 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:28.065 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:46:28.065 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:46:28.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:46:28.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:28.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.069 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:46:28.165 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:46:28.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.170 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:46:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:46:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:46:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:46:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:46:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:46:28.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.229 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:46:28.229 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:46:28.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:46:28.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:46:28.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:46:28.231 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:46:28.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.436 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:46:28.492 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:46:28.493 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:46:28.494 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:46:28.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:46:28.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:46:28.599 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:46:28.655 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:46:28.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:46:28.656 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:46:28.712 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:46:28.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:28.866 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:28.867 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:46:28.899 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:28.900 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:46:28.900 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:46:28.900 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:46:28.900 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:46:28.902 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:46:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:46:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:46:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:46:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:46:28.906 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:46:28.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:46:28.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:28.992 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:46:29.063 INFO:teuthology.orchestra.run.smithi050.stdout:client6379 2023-08-10T10:46:29.063 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:29.064 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:29.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:46:29.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.339+0000 7f02ca48e640 1 Processor -- start 2023-08-10T10:46:29.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.339+0000 7f02ca48e640 1 -- start start 2023-08-10T10:46:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.341+0000 7f02ca48e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c415aa40 0x7f02c40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.341+0000 7f02ca48e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c4071c70 con 0x7f02c40b0c60 2023-08-10T10:46:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.341+0000 7f02ca48e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c406a4c0 con 0x7f02c40ca930 2023-08-10T10:46:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.341+0000 7f02ca48e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40713d0 con 0x7f02c415aa40 2023-08-10T10:46:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c415aa40 0x7f02c40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02c40b0c60 0x7f02c40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49626/0 (socket says 172.21.15.50:49626) 2023-08-10T10:46:29.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c37fe640 1 -- 172.21.15.50:0/315860513 learned_addr learned my addr 172.21.15.50:0/315860513 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c2ffd640 1 -- 172.21.15.50:0/315860513 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721148667 0 0) 0x7f02c4071c70 con 0x7f02c40b0c60 2023-08-10T10:46:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c3fff640 1 -- 172.21.15.50:0/315860513 >> v1:172.21.15.117:6789/0 conn(0x7f02c40ca930 legacy=0x7f02c4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c3fff640 1 -- 172.21.15.50:0/315860513 >> v1:172.21.15.50:6789/0 conn(0x7f02c40b0c60 legacy=0x7f02c40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.342+0000 7f02c3fff640 1 -- 172.21.15.50:0/315860513 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40716b0 con 0x7f02c415aa40 2023-08-10T10:46:29.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02c3fff640 1 --2- 172.21.15.50:0/315860513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c415aa40 0x7f02c40b3820 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097a0 tx=0x7f02b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835e15921e3e447f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:29.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02c2ffd640 1 -- 172.21.15.50:0/315860513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4031830 con 0x7f02c415aa40 2023-08-10T10:46:29.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02c2ffd640 1 -- 172.21.15.50:0/315860513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4031990 con 0x7f02c415aa40 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02c2ffd640 1 -- 172.21.15.50:0/315860513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4031d20 con 0x7f02c415aa40 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02ca48e640 1 -- 172.21.15.50:0/315860513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c415aa40 msgr2=0x7f02c40b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.344+0000 7f02ca48e640 1 --2- 172.21.15.50:0/315860513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c415aa40 0x7f02c40b3820 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097a0 tx=0x7f02b402b8d0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.345+0000 7f02ca48e640 1 -- 172.21.15.50:0/315860513 shutdown_connections 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.345+0000 7f02ca48e640 1 --2- 172.21.15.50:0/315860513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c415aa40 0x7f02c40b3820 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.345+0000 7f02ca48e640 1 -- 172.21.15.50:0/315860513 >> 172.21.15.50:0/315860513 conn(0x7f02c406b590 msgr2=0x7f02c40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:29.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.345+0000 7f02ca48e640 1 -- 172.21.15.50:0/315860513 shutdown_connections 2023-08-10T10:46:29.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.345+0000 7f02ca48e640 1 -- 172.21.15.50:0/315860513 wait complete. 2023-08-10T10:46:29.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.346+0000 7f02ca48e640 1 Processor -- start 2023-08-10T10:46:29.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.347+0000 7f02ca48e640 1 -- start start 2023-08-10T10:46:29.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c40b0c60 0x7f02c41f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:29.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:29.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c415aa40 0x7f02c40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:29.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40c6a60 con 0x7f02c40ca930 2023-08-10T10:46:29.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c415b2c0 con 0x7f02c40b0c60 2023-08-10T10:46:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02ca48e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c41514c0 con 0x7f02c415aa40 2023-08-10T10:46:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52040/0 (socket says 172.21.15.50:52040) 2023-08-10T10:46:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 -- 172.21.15.50:0/4279132787 learned_addr learned my addr 172.21.15.50:0/4279132787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c3fff640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c40b0c60 0x7f02c41f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c8a2b640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c415aa40 0x7f02c40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 -- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c415aa40 msgr2=0x7f02c40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c415aa40 0x7f02c40cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 -- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c40b0c60 msgr2=0x7f02c41f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.348+0000 7f02c37fe640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c40b0c60 0x7f02c41f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02c37fe640 1 -- 172.21.15.50:0/4279132787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4009400 con 0x7f02c40ca930 2023-08-10T10:46:29.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02c37fe640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c500 tx=0x7f02b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:29.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80074e0 con 0x7f02c40ca930 2023-08-10T10:46:29.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8007640 con 0x7f02c40ca930 2023-08-10T10:46:29.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8004a20 con 0x7f02c40ca930 2023-08-10T10:46:29.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c40c64a0 con 0x7f02c40ca930 2023-08-10T10:46:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.349+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c415af50 con 0x7f02c40ca930 2023-08-10T10:46:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.350+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c404e270 con 0x7f02c40ca930 2023-08-10T10:46:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.351+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02b8004b80 con 0x7f02c40ca930 2023-08-10T10:46:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.352+0000 7f02c0ff9640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 0x7f02b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:29.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.352+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02b80887d0 con 0x7f02c40ca930 2023-08-10T10:46:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.353+0000 7f02c3fff640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 0x7f02b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.354+0000 7f02c3fff640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 0x7f02b006d110 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.357+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f02b8053870 con 0x7f02c40ca930 2023-08-10T10:46:29.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.587+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02c40caec0 con 0x7f02c40ca930 2023-08-10T10:46:29.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.588+0000 7f02c0ff9640 1 -- 172.21.15.50:0/4279132787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f02b8018060 con 0x7f02c40ca930 2023-08-10T10:46:29.590 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:46:29.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 msgr2=0x7f02b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 0x7f02b006d110 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b403c040 comp rx=0 tx=0).stop 2023-08-10T10:46:29.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 msgr2=0x7f02c40cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:29.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c500 tx=0x7f02b800c9c0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 shutdown_connections 2023-08-10T10:46:29.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c415aa40 0x7f02c40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40ca930 0x7f02c40cd300 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f02b006ac50 0x7f02b006d110 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 --2- 172.21.15.50:0/4279132787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c40b0c60 0x7f02c41f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 >> 172.21.15.50:0/4279132787 conn(0x7f02c406b590 msgr2=0x7f02c40cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 shutdown_connections 2023-08-10T10:46:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:29.591+0000 7f02ca48e640 1 -- 172.21.15.50:0/4279132787 wait complete. 2023-08-10T10:46:29.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:46:29.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:46:29.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:46:29.614 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:46:29.614 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:46:29.614 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:46:29.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:46:29.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:46:29.615 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:46:29.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:29.616 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:46:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:46:29.676 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:46:29.676 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:46:29.676 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:29.677 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 40908sec preferred_lft 40908sec 2023-08-10T10:46:29.678 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:46:29.679 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:46:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:46:29.681 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:46:29.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:29.682 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:46:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:46:29.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:29.774 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:46:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:46:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:46:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:46:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:46:29.826 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:46:29.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:29.828 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:46:29.828 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:46:29.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:46:29.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:46:29.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:46:29.829 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:46:30.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:30.076 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:46:30.121 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:46:30.121 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:46:30.121 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:46:30.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:30.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:46:30.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:46:30.255 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:46:30.307 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:46:30.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:46:30.308 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:46:30.356 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:46:30.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:30.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:30.543 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:30.543 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:46:30.576 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:46:30.577 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:46:30.577 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:46:30.577 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:46:30.578 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:46:30.578 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:46:30.578 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:46:30.579 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:46:30.579 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:46:30.579 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:46:30.582 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:46:30.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:30.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:46:30.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:30.667 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:46:30.725 INFO:teuthology.orchestra.run.smithi117.stdout:client8172 2023-08-10T10:46:30.725 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:46:30.725 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:30.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:31.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.014+0000 7fe95b62d640 1 Processor -- start 2023-08-10T10:46:31.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.014+0000 7fe95b62d640 1 -- start start 2023-08-10T10:46:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.015+0000 7fe95b62d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe9540696a0 0x7fe954069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.015+0000 7fe95b62d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95415e1f0 con 0x7fe954159970 2023-08-10T10:46:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.015+0000 7fe95b62d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95406a040 con 0x7fe9540b1ae0 2023-08-10T10:46:31.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.015+0000 7fe95b62d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9540b10d0 con 0x7fe9540696a0 2023-08-10T10:46:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.016+0000 7fe9593c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe954159970 0x7fe9540b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49628/0 (socket says 172.21.15.50:49628) 2023-08-10T10:46:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.016+0000 7fe9593c9640 1 -- 172.21.15.50:0/2000482092 learned_addr learned my addr 172.21.15.50:0/2000482092 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.016+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815037576 0 0) 0x7fe95415e1f0 con 0x7fe954159970 2023-08-10T10:46:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.016+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe940003520 con 0x7fe954159970 2023-08-10T10:46:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2000482092 >> v2:172.21.15.117:3300/0 conn(0x7fe9540696a0 0x7fe954069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1834188181 0 0) 0x7fe940003520 con 0x7fe954159970 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 >> v2:172.21.15.117:3300/0 conn(0x7fe9540696a0 msgr2=0x7fe954069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 --2- 172.21.15.50:0/2000482092 >> v2:172.21.15.117:3300/0 conn(0x7fe9540696a0 0x7fe954069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 >> v1:172.21.15.117:6789/0 conn(0x7fe9540b1ae0 legacy=0x7fe9540b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95415d5e0 con 0x7fe954159970 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe950001690 con 0x7fe954159970 2023-08-10T10:46:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 >> v1:172.21.15.50:6789/0 conn(0x7fe954159970 legacy=0x7fe9540b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940003970 0x7fe940003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 0x7fe940004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe940005180 0x7fe94000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540b10d0 con 0x7fe9400047c0 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000c0d0 con 0x7fe940003970 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000c290 con 0x7fe940005180 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.017+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 0x7fe940004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe9593c9640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940003970 0x7fe940003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe959bca640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe940005180 0x7fe94000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe958bc8640 1 -- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe940005180 msgr2=0x7fe94000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe940005180 0x7fe94000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe958bc8640 1 -- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940003970 msgr2=0x7fe940003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940003970 0x7fe940003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe958bc8640 1 -- 172.21.15.50:0/2000482092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940003520 con 0x7fe9400047c0 2023-08-10T10:46:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.018+0000 7fe959bca640 1 -- 172.21.15.50:0/2000482092 reap_dead start 2023-08-10T10:46:31.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.020+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 0x7fe940004c40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe94400ba30 tx=0x7fe9400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c922d146f53da91 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.020+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944032640 con 0x7fe9400047c0 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.020+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9440327a0 con 0x7fe9400047c0 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.020+0000 7fe94bfff640 1 -- 172.21.15.50:0/2000482092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944032b30 con 0x7fe9400047c0 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 -- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 msgr2=0x7fe940004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 0x7fe940004c40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe94400ba30 tx=0x7fe9400057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 -- 172.21.15.50:0/2000482092 shutdown_connections 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2000482092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9400047c0 0x7fe940004c40 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 -- 172.21.15.50:0/2000482092 >> 172.21.15.50:0/2000482092 conn(0x7fe95406b590 msgr2=0x7fe9540ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:31.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 -- 172.21.15.50:0/2000482092 shutdown_connections 2023-08-10T10:46:31.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.021+0000 7fe95b62d640 1 -- 172.21.15.50:0/2000482092 wait complete. 2023-08-10T10:46:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.023+0000 7fe95b62d640 1 Processor -- start 2023-08-10T10:46:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.023+0000 7fe95b62d640 1 -- start start 2023-08-10T10:46:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9400047c0 0x7fe954143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 0x7fe9540cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540cd1d0 con 0x7fe9540ccd50 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95414c2e0 con 0x7fe95414d870 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe95b62d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95415a7b0 con 0x7fe9400047c0 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52070/0 (socket says 172.21.15.50:52070) 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 -- 172.21.15.50:0/2919279734 learned_addr learned my addr 172.21.15.50:0/2919279734 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 0x7fe9540cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 -- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9400047c0 msgr2=0x7fe954143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe9593c9640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9400047c0 0x7fe954143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9400047c0 0x7fe954143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 -- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 msgr2=0x7fe9540cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 0x7fe9540cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe959bca640 1 -- 172.21.15.50:0/2919279734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954144180 con 0x7fe9540ccd50 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.024+0000 7fe958bc8640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 0x7fe9540cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe959bca640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe94c000f80 tx=0x7fe94c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c003b80 con 0x7fe9540ccd50 2023-08-10T10:46:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c003d00 con 0x7fe9540ccd50 2023-08-10T10:46:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c005310 con 0x7fe9540ccd50 2023-08-10T10:46:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe954159e80 con 0x7fe9540ccd50 2023-08-10T10:46:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.025+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95415a440 con 0x7fe9540ccd50 2023-08-10T10:46:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.026+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95415a5d0 con 0x7fe9540ccd50 2023-08-10T10:46:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.027+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe94c005470 con 0x7fe9540ccd50 2023-08-10T10:46:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.028+0000 7fe949ffb640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 0x7fe93806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.028+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe94c0892a0 con 0x7fe9540ccd50 2023-08-10T10:46:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.029+0000 7fe9593c9640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 0x7fe93806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.029+0000 7fe9593c9640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 0x7fe93806d140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe954067de0 tx=0x7fe950009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.033+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe94c054340 con 0x7fe9540ccd50 2023-08-10T10:46:31.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.268+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe95404e270 con 0x7fe9540ccd50 2023-08-10T10:46:31.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.269+0000 7fe949ffb640 1 -- 172.21.15.50:0/2919279734 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fe94c057960 con 0x7fe9540ccd50 2023-08-10T10:46:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:31.271 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:46:31.271 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:46:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 msgr2=0x7fe93806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 0x7fe93806d140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe954067de0 tx=0x7fe950009040 comp rx=0 tx=0).stop 2023-08-10T10:46:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 msgr2=0x7fe95415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe94c000f80 tx=0x7fe94c00ea00 comp rx=0 tx=0).stop 2023-08-10T10:46:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 shutdown_connections 2023-08-10T10:46:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9540ccd50 0x7fe95415ac40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe93806ac80 0x7fe93806d140 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe95414d870 0x7fe9540cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 --2- 172.21.15.50:0/2919279734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9400047c0 0x7fe954143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 >> 172.21.15.50:0/2919279734 conn(0x7fe95406b590 msgr2=0x7fe9540c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 shutdown_connections 2023-08-10T10:46:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.272+0000 7fe95b62d640 1 -- 172.21.15.50:0/2919279734 wait complete. 2023-08-10T10:46:31.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:46:31.544 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":8010,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.825340239000001,"mdsmap_epoch":67,"osdmap_epoch":143,"osdmap_epoch_barrier":143,"uptime":16.787639792} 2023-08-10T10:46:31.544 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 8010, "mdsmap_epoch": 67, "osdmap_epoch": 143, "osdmap_epoch_barrier": 143, "rank_uptime": 10.825340239, "state": "up:active", "uptime": 16.787639792, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:46:31.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-10T10:46:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.780+0000 7f7d1076b640 1 Processor -- start 2023-08-10T10:46:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.781+0000 7f7d1076b640 1 -- start start 2023-08-10T10:46:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.782+0000 7f7d1076b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0815cac0 0x7f7d080d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.782+0000 7f7d1076b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d080d0fe0 0x7f7d080d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.782+0000 7f7d1076b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080b6ba0 con 0x7f7d080d2ec0 2023-08-10T10:46:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.782+0000 7f7d1076b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d080d3370 con 0x7f7d0815cac0 2023-08-10T10:46:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.782+0000 7f7d1076b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d080d2090 con 0x7f7d080d0fe0 2023-08-10T10:46:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0815cac0 0x7f7d080d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d0815cac0 0x7f7d080d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52086/0 (socket says 172.21.15.50:52086) 2023-08-10T10:46:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 -- 172.21.15.50:0/118373963 learned_addr learned my addr 172.21.15.50:0/118373963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0dd06640 1 --2- 172.21.15.50:0/118373963 >> v2:172.21.15.117:3300/0 conn(0x7f7d080d0fe0 0x7f7d080d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 -- 172.21.15.50:0/118373963 >> v2:172.21.15.117:3300/0 conn(0x7f7d080d0fe0 msgr2=0x7f7d080d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 --2- 172.21.15.50:0/118373963 >> v2:172.21.15.117:3300/0 conn(0x7f7d080d0fe0 0x7f7d080d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 -- 172.21.15.50:0/118373963 >> v1:172.21.15.50:6789/0 conn(0x7f7d080d2ec0 legacy=0x7f7d080b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.783+0000 7f7d0e507640 1 -- 172.21.15.50:0/118373963 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080d1480 con 0x7f7d0815cac0 2023-08-10T10:46:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.784+0000 7f7d0e507640 1 --2- 172.21.15.50:0/118373963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d080d0aa0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7d080b8140 tx=0x7f7d0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4ee8538fb596c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.785+0000 7f7d0d505640 1 -- 172.21.15.50:0/118373963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04031870 con 0x7f7d0815cac0 2023-08-10T10:46:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.785+0000 7f7d0d505640 1 -- 172.21.15.50:0/118373963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d040319d0 con 0x7f7d0815cac0 2023-08-10T10:46:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.785+0000 7f7d0d505640 1 -- 172.21.15.50:0/118373963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04031d60 con 0x7f7d0815cac0 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.785+0000 7f7d1076b640 1 -- 172.21.15.50:0/118373963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 msgr2=0x7f7d080d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.785+0000 7f7d1076b640 1 --2- 172.21.15.50:0/118373963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d080d0aa0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7d080b8140 tx=0x7f7d0402b910 comp rx=0 tx=0).stop 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 -- 172.21.15.50:0/118373963 shutdown_connections 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 --2- 172.21.15.50:0/118373963 >> v2:172.21.15.117:3300/0 conn(0x7f7d080d0fe0 0x7f7d080d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 --2- 172.21.15.50:0/118373963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d080d0aa0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 -- 172.21.15.50:0/118373963 >> 172.21.15.50:0/118373963 conn(0x7f7d080700e0 msgr2=0x7f7d080704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 -- 172.21.15.50:0/118373963 shutdown_connections 2023-08-10T10:46:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.786+0000 7f7d1076b640 1 -- 172.21.15.50:0/118373963 wait complete. 2023-08-10T10:46:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.788+0000 7f7d1076b640 1 Processor -- start 2023-08-10T10:46:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.788+0000 7f7d1076b640 1 -- start start 2023-08-10T10:46:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d080d0fe0 0x7f7d080cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d080d2ec0 0x7f7d0814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080caf80 con 0x7f7d0815cac0 2023-08-10T10:46:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080cb260 con 0x7f7d080d0fe0 2023-08-10T10:46:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d1076b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080cb540 con 0x7f7d080d2ec0 2023-08-10T10:46:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d0ed08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d0ed08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52094/0 (socket says 172.21.15.50:52094) 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d0ed08640 1 -- 172.21.15.50:0/4168066697 learned_addr learned my addr 172.21.15.50:0/4168066697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d0e507640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d080d0fe0 0x7f7d080cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.789+0000 7f7d0dd06640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d080d2ec0 0x7f7d0814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 -- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d080d2ec0 msgr2=0x7f7d0814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d080d2ec0 0x7f7d0814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 -- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d080d0fe0 msgr2=0x7f7d080cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d080d0fe0 0x7f7d080cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 -- 172.21.15.50:0/4168066697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040094d0 con 0x7f7d0815cac0 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d0ed08640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c7a0 tx=0x7f7d0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003b70 con 0x7f7d0815cac0 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00003cf0 con 0x7f7d0815cac0 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003ea0 con 0x7f7d0815cac0 2023-08-10T10:46:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d080cb820 con 0x7f7d0815cac0 2023-08-10T10:46:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.790+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0814dbb0 con 0x7f7d0815cac0 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.792+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d080cd1e0 con 0x7f7d0815cac0 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.793+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d0000aa90 con 0x7f7d0815cac0 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.794+0000 7f7cfeffd640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 0x7f7cec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.794+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d000890c0 con 0x7f7d0815cac0 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.794+0000 7f7d0e507640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 0x7f7cec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.795+0000 7f7d0e507640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 0x7f7cec06d140 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7d04036000 tx=0x7f7d0403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.798+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7d00054200 con 0x7f7d0815cac0 2023-08-10T10:46:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:31.990+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f7d080b6ba0 con 0x7f7d0815cac0 2023-08-10T10:46:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.767+0000 7f7cfeffd640 1 -- 172.21.15.50:0/4168066697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v144) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7d080b6ba0 con 0x7f7d0815cac0 2023-08-10T10:46:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-10T10:46:32.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 msgr2=0x7f7cec06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 0x7f7cec06d140 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7d04036000 tx=0x7f7d0403c040 comp rx=0 tx=0).stop 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 msgr2=0x7f7d08158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c7a0 tx=0x7f7d0000cc60 comp rx=0 tx=0).stop 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 shutdown_connections 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d0815cac0 0x7f7d08158290 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d080d2ec0 0x7f7d0814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7cec06ac80 0x7f7cec06d140 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 --2- 172.21.15.50:0/4168066697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d080d0fe0 0x7f7d080cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 >> 172.21.15.50:0/4168066697 conn(0x7f7d080700e0 msgr2=0x7f7d0815b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 shutdown_connections 2023-08-10T10:46:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:32.772+0000 7f7d1076b640 1 -- 172.21.15.50:0/4168066697 wait complete. 2023-08-10T10:46:32.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:46:33.045 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:46:33.045 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:46:33.046 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-08-10T10:46:33.046 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:33.046 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:33.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:33.102 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-08-10T10:46:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:16+0 records in 2023-08-10T10:46:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:16+0 records out 2023-08-10T10:46:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.174505 s, 96.1 MB/s 2023-08-10T10:46:33.342 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:33.342 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:33.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:33.392 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-08-10T10:46:33.624 INFO:teuthology.orchestra.run.smithi050.stderr:17+0 records in 2023-08-10T10:46:33.624 INFO:teuthology.orchestra.run.smithi050.stderr:17+0 records out 2023-08-10T10:46:33.624 INFO:teuthology.orchestra.run.smithi050.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.178598 s, 99.8 MB/s 2023-08-10T10:46:33.625 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-10T10:46:33.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:33.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.834+0000 7f23db026640 1 Processor -- start 2023-08-10T10:46:33.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.835+0000 7f23db026640 1 -- start start 2023-08-10T10:46:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.836+0000 7f23db026640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23d40cdf80 0x7f23d4167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.836+0000 7f23db026640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d4161180 con 0x7f23d40b8430 2023-08-10T10:46:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.836+0000 7f23db026640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d4161460 con 0x7f23d415cd60 2023-08-10T10:46:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.836+0000 7f23db026640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40b5bd0 con 0x7f23d40cdf80 2023-08-10T10:46:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f23d40b8430 0x7f23d40cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49642/0 (socket says 172.21.15.50:49642) 2023-08-10T10:46:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d3fff640 1 -- 172.21.15.50:0/3186880654 learned_addr learned my addr 172.21.15.50:0/3186880654 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d95c3640 1 --2- 172.21.15.50:0/3186880654 >> v2:172.21.15.50:3300/0 conn(0x7f23d40cdf80 0x7f23d4167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d37fe640 1 -- 172.21.15.50:0/3186880654 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517612807 0 0) 0x7f23d4161180 con 0x7f23d40b8430 2023-08-10T10:46:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d37fe640 1 -- 172.21.15.50:0/3186880654 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c4003520 con 0x7f23d40b8430 2023-08-10T10:46:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d95c3640 1 -- 172.21.15.50:0/3186880654 >> v1:172.21.15.117:6789/0 conn(0x7f23d415cd60 legacy=0x7f23d4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d95c3640 1 -- 172.21.15.50:0/3186880654 >> v1:172.21.15.50:6789/0 conn(0x7f23d40b8430 legacy=0x7f23d40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.837+0000 7f23d95c3640 1 -- 172.21.15.50:0/3186880654 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4161740 con 0x7f23d40cdf80 2023-08-10T10:46:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23d95c3640 1 --2- 172.21.15.50:0/3186880654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40cdf80 0x7f23d4167c60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009d90 tx=0x7f23cc02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf9eefb5b8c2253 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23d37fe640 1 -- 172.21.15.50:0/3186880654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc02cd80 con 0x7f23d40cdf80 2023-08-10T10:46:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23d37fe640 1 -- 172.21.15.50:0/3186880654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc034440 con 0x7f23d40cdf80 2023-08-10T10:46:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23d37fe640 1 -- 172.21.15.50:0/3186880654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0347b0 con 0x7f23d40cdf80 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23db026640 1 -- 172.21.15.50:0/3186880654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40cdf80 msgr2=0x7f23d4167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.839+0000 7f23db026640 1 --2- 172.21.15.50:0/3186880654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40cdf80 0x7f23d4167c60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009d90 tx=0x7f23cc02bfd0 comp rx=0 tx=0).stop 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.840+0000 7f23db026640 1 -- 172.21.15.50:0/3186880654 shutdown_connections 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.840+0000 7f23db026640 1 --2- 172.21.15.50:0/3186880654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40cdf80 0x7f23d4167c60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.840+0000 7f23db026640 1 -- 172.21.15.50:0/3186880654 >> 172.21.15.50:0/3186880654 conn(0x7f23d40d2ac0 msgr2=0x7f23d40d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.840+0000 7f23db026640 1 -- 172.21.15.50:0/3186880654 shutdown_connections 2023-08-10T10:46:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.840+0000 7f23db026640 1 -- 172.21.15.50:0/3186880654 wait complete. 2023-08-10T10:46:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.841+0000 7f23db026640 1 Processor -- start 2023-08-10T10:46:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.842+0000 7f23db026640 1 -- start start 2023-08-10T10:46:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d40cdf80 0x7f23d40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d415cd60 0x7f23d40caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41f28d0 con 0x7f23d40b8430 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41f2b50 con 0x7f23d40cdf80 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23db026640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40cb920 con 0x7f23d415cd60 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23d8dc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23d8dc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52104/0 (socket says 172.21.15.50:52104) 2023-08-10T10:46:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23d8dc2640 1 -- 172.21.15.50:0/2305433123 learned_addr learned my addr 172.21.15.50:0/2305433123 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23d3fff640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d40cdf80 0x7f23d40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.843+0000 7f23d95c3640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d415cd60 0x7f23d40caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 -- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d415cd60 msgr2=0x7f23d40caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d415cd60 0x7f23d40caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 -- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d40cdf80 msgr2=0x7f23d40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d40cdf80 0x7f23d40ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 -- 172.21.15.50:0/2305433123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009a70 con 0x7f23d40b8430 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d8dc2640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c480 tx=0x7f23c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80052d0 con 0x7f23d40b8430 2023-08-10T10:46:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8005430 con 0x7f23d40b8430 2023-08-10T10:46:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8012870 con 0x7f23d40b8430 2023-08-10T10:46:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d414e3e0 con 0x7f23d40b8430 2023-08-10T10:46:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.844+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d40cb360 con 0x7f23d40b8430 2023-08-10T10:46:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.846+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d4066390 con 0x7f23d40b8430 2023-08-10T10:46:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.847+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23c80129d0 con 0x7f23d40b8430 2023-08-10T10:46:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.848+0000 7f23d17fa640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 0x7f23b806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.848+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23c8089080 con 0x7f23d40b8430 2023-08-10T10:46:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.848+0000 7f23d3fff640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 0x7f23b806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.849+0000 7f23d3fff640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 0x7f23b806d140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f23d40b7940 tx=0x7f23c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:33.852+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f23c80bb330 con 0x7f23d40b8430 2023-08-10T10:46:34.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.045+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f23d404e270 con 0x7f23d40b8430 2023-08-10T10:46:34.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.047+0000 7f23d17fa640 1 -- 172.21.15.50:0/2305433123 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+37005 (secure 0 0 0) 0x7f23c8054120 con 0x7f23d40b8430 2023-08-10T10:46:34.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:34.050 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:34.050 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 144, 2023-08-10T10:46:34.050 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:34.050 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:34.051 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:32.749339+0000", 2023-08-10T10:46:34.051 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:34.051 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:34.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:34.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:34.052 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:34.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:34.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:34.055 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:34.056 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:34.057 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:34.058 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:34.059 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:34.060 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:34.061 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:34.062 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:34.063 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:34.064 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:34.065 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:34.066 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:34.067 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:34.069 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:34.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:34.071 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.072 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:34.073 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.074 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:34.075 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:34.077 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:34.078 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:34.080 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:34.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:34.084 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:34.085 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:34.086 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.087 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:34.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:34.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:34.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "144", 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:34.091 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:34.092 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:34.093 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:34.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:34.095 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:34.097 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:34.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.099 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:34.105 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.106 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.107 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.108 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.109 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.110 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.112 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:34.115 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.117 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.118 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.119 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.120 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.128 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.129 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.130 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.137 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.138 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.139 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.140 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:34.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.149 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.150 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:34.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:34.156 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.159 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.165 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.167 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:34.171 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:34.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.179 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.180 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.181 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.183 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.184 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:34.185 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:34.188 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:34.189 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:34.191 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:34.192 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:34.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:34.193 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 msgr2=0x7f23b806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 0x7f23b806d140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f23d40b7940 tx=0x7f23c0009040 comp rx=0 tx=0).stop 2023-08-10T10:46:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 msgr2=0x7f23d414dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c480 tx=0x7f23c800c940 comp rx=0 tx=0).stop 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 shutdown_connections 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d415cd60 0x7f23d40caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23b806ac80 0x7f23b806d140 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d40cdf80 0x7f23d40ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 --2- 172.21.15.50:0/2305433123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23d40b8430 0x7f23d414dea0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.050+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 >> 172.21.15.50:0/2305433123 conn(0x7f23d40d2ac0 msgr2=0x7f23d40d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.051+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 shutdown_connections 2023-08-10T10:46:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:34.051+0000 7f23db026640 1 -- 172.21.15.50:0/2305433123 wait complete. 2023-08-10T10:46:34.196 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:46:39.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.437+0000 7fcb10f67640 1 Processor -- start 2023-08-10T10:46:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.437+0000 7fcb10f67640 1 -- start start 2023-08-10T10:46:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.438+0000 7fcb10f67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcb0c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.438+0000 7fcb10f67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c15d010 con 0x7fcb0c153850 2023-08-10T10:46:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.438+0000 7fcb10f67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c15d290 con 0x7fcb0c0b1da0 2023-08-10T10:46:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.438+0000 7fcb10f67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c15d570 con 0x7fcb0c15f510 2023-08-10T10:46:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.439+0000 7fcb0b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb0c153850 0x7fcb0c0b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54336/0 (socket says 172.21.15.50:54336) 2023-08-10T10:46:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.439+0000 7fcb0b7fe640 1 -- 172.21.15.50:0/3451161533 learned_addr learned my addr 172.21.15.50:0/3451161533 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.439+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985871827 0 0) 0x7fcb0c15d010 con 0x7fcb0c153850 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.439+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf8003520 con 0x7fcb0c153850 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.439+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcb0c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206593870 0 0) 0x7fcaf8003520 con 0x7fcb0c153850 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 msgr2=0x7fcb0c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcb0c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 >> v1:172.21.15.117:6789/0 conn(0x7fcb0c0b1da0 legacy=0x7fcb0c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c15d850 con 0x7fcb0c153850 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fcafc001670 con 0x7fcb0c153850 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 >> v1:172.21.15.50:6789/0 conn(0x7fcb0c153850 legacy=0x7fcb0c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8003a10 0x7fcaf8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcaf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcaf80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c15d570 con 0x7fcaf8004d50 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf800bb70 con 0x7fcaf8003a10 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf800bd30 con 0x7fcb0c15f510 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcaf80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb0b7fe640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8003a10 0x7fcaf8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.440+0000 7fcb03fff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcaf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.441+0000 7fcb0bfff640 1 -- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 msgr2=0x7fcaf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.441+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c15f510 0x7fcaf80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.441+0000 7fcb0bfff640 1 -- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8003a10 msgr2=0x7fcaf8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.441+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8003a10 0x7fcaf8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.441+0000 7fcb0bfff640 1 -- 172.21.15.50:0/3451161533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8003520 con 0x7fcaf8004d50 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.442+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcaf80051d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007330 tx=0x7fcaf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102de3cfa8d75aba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.442+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0402cca0 con 0x7fcaf8004d50 2023-08-10T10:46:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.442+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0402ce00 con 0x7fcaf8004d50 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.442+0000 7fcb0affd640 1 -- 172.21.15.50:0/3451161533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04034680 con 0x7fcaf8004d50 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 -- 172.21.15.50:0/3451161533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 msgr2=0x7fcaf80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 --2- 172.21.15.50:0/3451161533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcaf80051d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007330 tx=0x7fcaf80057f0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb0bfff640 1 -- 172.21.15.50:0/3451161533 reap_dead start 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 -- 172.21.15.50:0/3451161533 shutdown_connections 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 -- 172.21.15.50:0/3451161533 >> 172.21.15.50:0/3451161533 conn(0x7fcb0c069880 msgr2=0x7fcb0c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 -- 172.21.15.50:0/3451161533 shutdown_connections 2023-08-10T10:46:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.443+0000 7fcb10f67640 1 -- 172.21.15.50:0/3451161533 wait complete. 2023-08-10T10:46:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.445+0000 7fcb10f67640 1 Processor -- start 2023-08-10T10:46:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.445+0000 7fcb10f67640 1 -- start start 2023-08-10T10:46:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c9970 0x7fcb0c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 0x7fcb0c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0cc240 con 0x7fcaf8004d50 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0cb5e0 con 0x7fcb0c150ea0 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb10f67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0cb8a0 con 0x7fcb0c0c9970 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59142/0 (socket says 172.21.15.50:59142) 2023-08-10T10:46:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0b7fe640 1 -- 172.21.15.50:0/233030659 learned_addr learned my addr 172.21.15.50:0/233030659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb03fff640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c9970 0x7fcb0c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 0x7fcb0c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0b7fe640 1 -- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c9970 msgr2=0x7fcb0c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.446+0000 7fcb0b7fe640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c9970 0x7fcb0c0cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb0b7fe640 1 -- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 msgr2=0x7fcb0c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb0b7fe640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 0x7fcb0c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb0b7fe640 1 -- 172.21.15.50:0/233030659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0cbb80 con 0x7fcaf8004d50 2023-08-10T10:46:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb0bfff640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 0x7fcb0c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb0b7fe640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0072c0 tx=0x7fcafc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00f960 con 0x7fcaf8004d50 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00fac0 con 0x7fcaf8004d50 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00fe70 con 0x7fcaf8004d50 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c0cbe60 con 0x7fcaf8004d50 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.447+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c0c9df0 con 0x7fcaf8004d50 2023-08-10T10:46:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.448+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c0cc380 con 0x7fcaf8004d50 2023-08-10T10:46:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.449+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcafc01d460 con 0x7fcaf8004d50 2023-08-10T10:46:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.450+0000 7fcb08ff9640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 0x7fcaec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.450+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcafc089700 con 0x7fcaf8004d50 2023-08-10T10:46:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.451+0000 7fcb03fff640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 0x7fcaec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.451+0000 7fcb03fff640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 0x7fcaec06d140 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007fd0 tx=0x7fcaf4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:39.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.456+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb0c0cc380 con 0x7fcaf8004d50 2023-08-10T10:46:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.656+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcb0c0cc380 con 0x7fcaf8004d50 2023-08-10T10:46:39.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.660+0000 7fcb08ff9640 1 -- 172.21.15.50:0/233030659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+37005 (secure 0 0 0) 0x7fcb0c0cc380 con 0x7fcaf8004d50 2023-08-10T10:46:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:39.662 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 144, 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:32.749339+0000", 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "144", 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:39.761 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.764 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.765 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.766 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.770 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:39.770 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:39.772 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.775 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.777 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.781 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.784 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:39.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.788 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:39.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:39.791 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.793 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:39.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:39.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:39.798 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:39.799 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:39.799 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.799 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.799 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:39.800 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:39.801 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:39.803 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.805 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:39.805 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:39.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:39.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:39.809 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:39.810 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:39.811 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.812 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.813 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.813 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:39.813 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.815 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:39.816 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.817 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.818 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.820 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.821 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:39.823 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:39.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:39.827 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:39.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:39.828 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 msgr2=0x7fcaec06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 0x7fcaec06d140 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007fd0 tx=0x7fcaf4009040 comp rx=0 tx=0).stop 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 msgr2=0x7fcb0c1f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0072c0 tx=0x7fcafc007780 comp rx=0 tx=0).stop 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 shutdown_connections 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaec06ac80 0x7fcaec06d140 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c150ea0 0x7fcb0c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c9970 0x7fcb0c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 --2- 172.21.15.50:0/233030659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8004d50 0x7fcb0c1f6680 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 >> 172.21.15.50:0/233030659 conn(0x7fcb0c069880 msgr2=0x7fcb0c1519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 shutdown_connections 2023-08-10T10:46:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:39.663+0000 7fcb10f67640 1 -- 172.21.15.50:0/233030659 wait complete. 2023-08-10T10:46:39.832 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:46:44.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:46:44.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:46:44.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.070+0000 7fea5bbc9640 1 Processor -- start 2023-08-10T10:46:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.070+0000 7fea5bbc9640 1 -- start start 2023-08-10T10:46:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.071+0000 7fea5bbc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 0x7fea540cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.071+0000 7fea5bbc9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 0x7fea5415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.071+0000 7fea5bbc9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea540b0000 con 0x7fea540afc20 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.071+0000 7fea5bbc9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea540cf850 con 0x7fea540cf3c0 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.071+0000 7fea5bbc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea540cbe60 con 0x7fea5415f370 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.072+0000 7fea59965640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea540afc20 0x7fea540cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57214/0 (socket says 172.21.15.50:57214) 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.072+0000 7fea59965640 1 -- 172.21.15.50:0/2509353304 learned_addr learned my addr 172.21.15.50:0/2509353304 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.072+0000 7fea59164640 1 --2- 172.21.15.50:0/2509353304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 0x7fea540cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.072+0000 7fea5a166640 1 --2- 172.21.15.50:0/2509353304 >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 0x7fea5415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.072+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320278559 0 0) 0x7fea540b0000 con 0x7fea540afc20 2023-08-10T10:46:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea40003520 con 0x7fea540afc20 2023-08-10T10:46:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212531818 0 0) 0x7fea40003520 con 0x7fea540afc20 2023-08-10T10:46:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea59164640 1 -- 172.21.15.50:0/2509353304 >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 msgr2=0x7fea5415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea59164640 1 --2- 172.21.15.50:0/2509353304 >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 0x7fea5415a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea59164640 1 -- 172.21.15.50:0/2509353304 >> v1:172.21.15.50:6789/0 conn(0x7fea540afc20 legacy=0x7fea540cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea59164640 1 -- 172.21.15.50:0/2509353304 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540cc140 con 0x7fea5415f370 2023-08-10T10:46:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.073+0000 7fea5a166640 1 --2- 172.21.15.50:0/2509353304 >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 0x7fea5415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:46:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.075+0000 7fea59164640 1 --2- 172.21.15.50:0/2509353304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 0x7fea540cee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea440097a0 tx=0x7fea4402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eefa667336e88cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.075+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50001b70 con 0x7fea5415f370 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.075+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4402e050 con 0x7fea5415f370 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.075+0000 7fea58963640 1 -- 172.21.15.50:0/2509353304 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44030730 con 0x7fea5415f370 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 -- 172.21.15.50:0/2509353304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 msgr2=0x7fea540cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/2509353304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 0x7fea540cee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea440097a0 tx=0x7fea4402b790 comp rx=0 tx=0).stop 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 -- 172.21.15.50:0/2509353304 shutdown_connections 2023-08-10T10:46:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/2509353304 >> v2:172.21.15.117:3300/0 conn(0x7fea540cf3c0 0x7fea5415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/2509353304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea5415f370 0x7fea540cee80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 -- 172.21.15.50:0/2509353304 >> 172.21.15.50:0/2509353304 conn(0x7fea540d0930 msgr2=0x7fea540d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 -- 172.21.15.50:0/2509353304 shutdown_connections 2023-08-10T10:46:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.076+0000 7fea5bbc9640 1 -- 172.21.15.50:0/2509353304 wait complete. 2023-08-10T10:46:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.078+0000 7fea5bbc9640 1 Processor -- start 2023-08-10T10:46:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.078+0000 7fea5bbc9640 1 -- start start 2023-08-10T10:46:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea540afc20 0x7fea540c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea540cf3c0 0x7fea541562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea54156820 con 0x7fea5415f370 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea540b4d00 con 0x7fea540cf3c0 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5bbc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea540b3a50 con 0x7fea540afc20 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5a166640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5a166640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41158/0 (socket says 172.21.15.50:41158) 2023-08-10T10:46:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.079+0000 7fea5a166640 1 -- 172.21.15.50:0/3180109549 learned_addr learned my addr 172.21.15.50:0/3180109549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea59164640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea540cf3c0 0x7fea541562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 -- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea540afc20 msgr2=0x7fea540c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea540afc20 0x7fea540c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 -- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea540cf3c0 msgr2=0x7fea541562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea540cf3c0 0x7fea541562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c009400 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5a166640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e930 tx=0x7fea4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c009700 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00ca00 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea44009400 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00cd90 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.080+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea540b4010 con 0x7fea5415f370 2023-08-10T10:46:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.081+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea540cc6e0 con 0x7fea5415f370 2023-08-10T10:46:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.082+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea4c013470 con 0x7fea5415f370 2023-08-10T10:46:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.083+0000 7fea4a7fc640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 0x7fea3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.083+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea4c0890a0 con 0x7fea5415f370 2023-08-10T10:46:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.084+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fea38072da0 con 0x7fea5415f370 2023-08-10T10:46:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.084+0000 7fea59965640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 0x7fea3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.085+0000 7fea59965640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 0x7fea3806d110 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea500016e0 tx=0x7fea50001f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.088+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fea540cc6e0 con 0x7fea5415f370 2023-08-10T10:46:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.278+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fea540cc6e0 con 0x7fea5415f370 2023-08-10T10:46:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.282+0000 7fea4a7fc640 1 -- 172.21.15.50:0/3180109549 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+37024 (secure 0 0 0) 0x7fea540cc6e0 con 0x7fea5415f370 2023-08-10T10:46:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:45.284 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 145, 2023-08-10T10:46:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:41.545752+0000", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:45.304 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "145", 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.396 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.398 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:45.427 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 msgr2=0x7fea3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 0x7fea3806d110 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea500016e0 tx=0x7fea50001f00 comp rx=0 tx=0).stop 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 msgr2=0x7fea541f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e930 tx=0x7fea4c00edf0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 shutdown_connections 2023-08-10T10:46:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea5415f370 0x7fea541f56b0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fea3806ac50 0x7fea3806d110 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea540cf3c0 0x7fea541562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 --2- 172.21.15.50:0/3180109549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea540afc20 0x7fea540c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 >> 172.21.15.50:0/3180109549 conn(0x7fea540d0930 msgr2=0x7fea540adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 shutdown_connections 2023-08-10T10:46:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:45.285+0000 7fea5bbc9640 1 -- 172.21.15.50:0/3180109549 wait complete. 2023-08-10T10:46:45.431 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-10T10:46:45.431 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:46:45.432 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:46:45.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:45.496 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-08-10T10:46:45.930 INFO:teuthology.orchestra.run.smithi050.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-10T10:46:45.930 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:46:45.931 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:46:45.931 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.371776 s, 141 MB/s 2023-08-10T10:46:45.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:46:45.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:46.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.141+0000 7f257160d640 1 Processor -- start 2023-08-10T10:46:46.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.141+0000 7f257160d640 1 -- start start 2023-08-10T10:46:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f257160d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f256c0b0c60 0x7f256c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f257160d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f256c0b3f30 0x7f256c0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f257160d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c071c70 con 0x7f256c15aa40 2023-08-10T10:46:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f257160d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0713d0 con 0x7f256c0b3f30 2023-08-10T10:46:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f257160d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0716b0 con 0x7f256c0b0c60 2023-08-10T10:46:46.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f256c0b3f30 0x7f256c0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f256c0b3f30 0x7f256c0c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41170/0 (socket says 172.21.15.50:41170) 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 -- 172.21.15.50:0/2639907090 learned_addr learned my addr 172.21.15.50:0/2639907090 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256affd640 1 --1- 172.21.15.50:0/2639907090 >> v1:172.21.15.50:6789/0 conn(0x7f256c15aa40 0x7f256c0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57222/0 (socket says 172.21.15.50:57222) 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256a7fc640 1 --2- 172.21.15.50:0/2639907090 >> v2:172.21.15.117:3300/0 conn(0x7f256c0b0c60 0x7f256c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 -- 172.21.15.50:0/2639907090 >> v2:172.21.15.117:3300/0 conn(0x7f256c0b0c60 msgr2=0x7f256c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 --2- 172.21.15.50:0/2639907090 >> v2:172.21.15.117:3300/0 conn(0x7f256c0b0c60 0x7f256c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 -- 172.21.15.50:0/2639907090 >> v1:172.21.15.50:6789/0 conn(0x7f256c15aa40 legacy=0x7f256c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.143+0000 7f256b7fe640 1 -- 172.21.15.50:0/2639907090 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c071990 con 0x7f256c0b3f30 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.144+0000 7f256b7fe640 1 --2- 172.21.15.50:0/2639907090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c0c9e60 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f256c15e6e0 tx=0x7f256402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f1eb2baf47f26e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.144+0000 7f2569ffb640 1 -- 172.21.15.50:0/2639907090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256402ca80 con 0x7f256c0b3f30 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.144+0000 7f2569ffb640 1 -- 172.21.15.50:0/2639907090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256402cbe0 con 0x7f256c0b3f30 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.144+0000 7f2569ffb640 1 -- 172.21.15.50:0/2639907090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640343f0 con 0x7f256c0b3f30 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 -- 172.21.15.50:0/2639907090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 msgr2=0x7f256c0c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 --2- 172.21.15.50:0/2639907090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c0c9e60 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f256c15e6e0 tx=0x7f256402bee0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 -- 172.21.15.50:0/2639907090 shutdown_connections 2023-08-10T10:46:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 --2- 172.21.15.50:0/2639907090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c0c9e60 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 --2- 172.21.15.50:0/2639907090 >> v2:172.21.15.117:3300/0 conn(0x7f256c0b0c60 0x7f256c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 -- 172.21.15.50:0/2639907090 >> 172.21.15.50:0/2639907090 conn(0x7f256c06b590 msgr2=0x7f256c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 -- 172.21.15.50:0/2639907090 shutdown_connections 2023-08-10T10:46:46.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.145+0000 7f257160d640 1 -- 172.21.15.50:0/2639907090 wait complete. 2023-08-10T10:46:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.147+0000 7f257160d640 1 Processor -- start 2023-08-10T10:46:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.147+0000 7f257160d640 1 -- start start 2023-08-10T10:46:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f256c0b0c60 0x7f256c146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 0x7f256c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c1566d0 con 0x7f256c0b3f30 2023-08-10T10:46:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c155ac0 con 0x7f256c15aa40 2023-08-10T10:46:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.148+0000 7f257160d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c155da0 con 0x7f256c0b0c60 2023-08-10T10:46:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41176/0 (socket says 172.21.15.50:41176) 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 -- 172.21.15.50:0/2656735157 learned_addr learned my addr 172.21.15.50:0/2656735157 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 -- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f256c0b0c60 msgr2=0x7f256c146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256b7fe640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 0x7f256c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f256c0b0c60 0x7f256c146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 -- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 msgr2=0x7f256c156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 0x7f256c156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009b30 con 0x7f256c0b3f30 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256b7fe640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 0x7f256c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.149+0000 7f256a7fc640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f256000d800 tx=0x7f256000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.150+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000b6c0 con 0x7f256c0b3f30 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.150+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000b820 con 0x7f256c0b3f30 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.150+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000bbb0 con 0x7f256c0b3f30 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.150+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c156080 con 0x7f256c0b3f30 2023-08-10T10:46:46.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.150+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c146e80 con 0x7f256c0b3f30 2023-08-10T10:46:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.151+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c04e270 con 0x7f256c0b3f30 2023-08-10T10:46:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.152+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f256000bd10 con 0x7f256c0b3f30 2023-08-10T10:46:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.153+0000 7f25537fe640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 0x7f255806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.153+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2560089b80 con 0x7f256c0b3f30 2023-08-10T10:46:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.154+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f2558072da0 con 0x7f256c0b3f30 2023-08-10T10:46:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.154+0000 7f256affd640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 0x7f255806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.154+0000 7f256affd640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 0x7f255806d110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f255c001540 tx=0x7f255c0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.157+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2560089e60 con 0x7f256c0b3f30 2023-08-10T10:46:46.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.348+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f256c06fc00 con 0x7f256c0b3f30 2023-08-10T10:46:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.352+0000 7f25537fe640 1 -- 172.21.15.50:0/2656735157 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+37024 (secure 0 0 0) 0x7f2560054b00 con 0x7f256c0b3f30 2023-08-10T10:46:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:46.354 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 145, 2023-08-10T10:46:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:41.545752+0000", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "145", 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:46.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:46.527 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.354+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 msgr2=0x7f255806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.354+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 0x7f255806d110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f255c001540 tx=0x7f255c0079c0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.354+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 msgr2=0x7f256c152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.354+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f256000d800 tx=0x7f256000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 shutdown_connections 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f255806ac50 0x7f255806d110 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f256c15aa40 0x7f256c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c0b3f30 0x7f256c152dc0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 --2- 172.21.15.50:0/2656735157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f256c0b0c60 0x7f256c146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 >> 172.21.15.50:0/2656735157 conn(0x7f256c06b590 msgr2=0x7f256c0696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:46.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 shutdown_connections 2023-08-10T10:46:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.355+0000 7f257160d640 1 -- 172.21.15.50:0/2656735157 wait complete. 2023-08-10T10:46:46.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:46:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.772+0000 7fdbf726a640 1 Processor -- start 2023-08-10T10:46:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.772+0000 7fdbf726a640 1 -- start start 2023-08-10T10:46:46.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.773+0000 7fdbf726a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 0x7fdbf00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.773+0000 7fdbf726a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdbf00ca930 0x7fdbf00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.773+0000 7fdbf726a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf0071c70 con 0x7fdbf00b0c60 2023-08-10T10:46:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.773+0000 7fdbf726a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf00713d0 con 0x7fdbf00ca930 2023-08-10T10:46:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.773+0000 7fdbf726a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00716b0 con 0x7fdbf015aa40 2023-08-10T10:46:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdbf00ca930 0x7fdbf00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdbf00ca930 0x7fdbf00b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41190/0 (socket says 172.21.15.50:41190) 2023-08-10T10:46:46.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 -- 172.21.15.50:0/1101903939 learned_addr learned my addr 172.21.15.50:0/1101903939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:46.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 -- 172.21.15.50:0/1101903939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 msgr2=0x7fdbf00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:46.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5006640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 0x7fdbf00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 0x7fdbf00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 -- 172.21.15.50:0/1101903939 >> v1:172.21.15.117:6789/0 conn(0x7fdbf00b0c60 legacy=0x7fdbf00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:46.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5807640 1 -- 172.21.15.50:0/1101903939 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0071990 con 0x7fdbf00ca930 2023-08-10T10:46:46.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.775+0000 7fdbf5006640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 0x7fdbf00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:46.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf5807640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00ca930 0x7fdbf00b3d60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009e50 tx=0x7fdbe802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f18e749bb8e1af1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbe7fff640 1 -- 172.21.15.50:0/1101903939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe802c9e0 con 0x7fdbf00ca930 2023-08-10T10:46:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbe7fff640 1 -- 172.21.15.50:0/1101903939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe802cb40 con 0x7fdbf00ca930 2023-08-10T10:46:46.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbe7fff640 1 -- 172.21.15.50:0/1101903939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80343f0 con 0x7fdbf00ca930 2023-08-10T10:46:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 -- 172.21.15.50:0/1101903939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00ca930 msgr2=0x7fdbf00b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00ca930 0x7fdbf00b3d60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009e50 tx=0x7fdbe802be40 comp rx=0 tx=0).stop 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 -- 172.21.15.50:0/1101903939 shutdown_connections 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00ca930 0x7fdbf00b3d60 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1101903939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf015aa40 0x7fdbf00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 -- 172.21.15.50:0/1101903939 >> 172.21.15.50:0/1101903939 conn(0x7fdbf006b590 msgr2=0x7fdbf00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 -- 172.21.15.50:0/1101903939 shutdown_connections 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.777+0000 7fdbf726a640 1 -- 172.21.15.50:0/1101903939 wait complete. 2023-08-10T10:46:46.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.779+0000 7fdbf726a640 1 Processor -- start 2023-08-10T10:46:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.779+0000 7fdbf726a640 1 -- start start 2023-08-10T10:46:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 0x7fdbf00c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 0x7fdbf0142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0140a60 con 0x7fdbf00b0c60 2023-08-10T10:46:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00c4dc0 con 0x7fdbf015aa40 2023-08-10T10:46:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0156cb0 con 0x7fdbf00ca930 2023-08-10T10:46:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41198/0 (socket says 172.21.15.50:41198) 2023-08-10T10:46:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 -- 172.21.15.50:0/1318936829 learned_addr learned my addr 172.21.15.50:0/1318936829 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5807640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 0x7fdbf0142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 -- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 msgr2=0x7fdbf00c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf4805640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 0x7fdbf00c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 0x7fdbf00c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 -- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 msgr2=0x7fdbf0142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 0x7fdbf0142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8009b30 con 0x7fdbf00b0c60 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5807640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 0x7fdbf0142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf4805640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 0x7fdbf00c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf5006640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c7f0 tx=0x7fdbec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec007820 con 0x7fdbf00b0c60 2023-08-10T10:46:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec007980 con 0x7fdbf00b0c60 2023-08-10T10:46:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0140d00 con 0x7fdbf00b0c60 2023-08-10T10:46:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.781+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec007cf0 con 0x7fdbf00b0c60 2023-08-10T10:46:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.782+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf01412c0 con 0x7fdbf00b0c60 2023-08-10T10:46:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.784+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf004e270 con 0x7fdbf00b0c60 2023-08-10T10:46:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.785+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbec0113f0 con 0x7fdbf00b0c60 2023-08-10T10:46:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.785+0000 7fdbe5ffb640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 0x7fdbd406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.785+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbec089930 con 0x7fdbf00b0c60 2023-08-10T10:46:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.785+0000 7fdbf4805640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 0x7fdbd406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.785+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fdbd4072da0 con 0x7fdbf00b0c60 2023-08-10T10:46:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.787+0000 7fdbf4805640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 0x7fdbd406d110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdbf01524f0 tx=0x7fdbe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:46.791+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdbec01f020 con 0x7fdbf00b0c60 2023-08-10T10:46:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.019+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbf00b0500 con 0x7fdbf00b0c60 2023-08-10T10:46:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.020+0000 7fdbe5ffb640 1 -- 172.21.15.50:0/1318936829 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fdbec0548b0 con 0x7fdbf00b0c60 2023-08-10T10:46:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:47.021 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:46:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:46:47.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 msgr2=0x7fdbd406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 0x7fdbd406d110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdbf01524f0 tx=0x7fdbe0009040 comp rx=0 tx=0).stop 2023-08-10T10:46:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 msgr2=0x7fdbf00c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c7f0 tx=0x7fdbec00ccb0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 shutdown_connections 2023-08-10T10:46:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdbd406ac50 0x7fdbd406d110 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf015aa40 0x7fdbf0142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbf00ca930 0x7fdbf00c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 --2- 172.21.15.50:0/1318936829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbf00b0c60 0x7fdbf00c4880 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.022+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 >> 172.21.15.50:0/1318936829 conn(0x7fdbf006b590 msgr2=0x7fdbf00b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:47.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.023+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 shutdown_connections 2023-08-10T10:46:47.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.023+0000 7fdbf726a640 1 -- 172.21.15.50:0/1318936829 wait complete. 2023-08-10T10:46:47.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:46:47.277 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":8010,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.557851841000002,"mdsmap_epoch":67,"osdmap_epoch":145,"osdmap_epoch_barrier":145,"uptime":32.520151362999997} 2023-08-10T10:46:47.277 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 8010, "mdsmap_epoch": 67, "osdmap_epoch": 145, "osdmap_epoch_barrier": 145, "rank_uptime": 26.557851841, "state": "up:active", "uptime": 32.520151363, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:46:47.278 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:46:47.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:47.278 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-10T10:46:47.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:46:47.341 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-10T10:46:47.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.642+0000 7fa6b562c640 1 Processor -- start 2023-08-10T10:46:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.642+0000 7fa6b562c640 1 -- start start 2023-08-10T10:46:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.643+0000 7fa6b562c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6b015c950 0x7fa6b00cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6b562c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 0x7fa6b00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6b562c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00cb610 con 0x7fa6b01605d0 2023-08-10T10:46:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6b562c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00ce6b0 con 0x7fa6b015c950 2023-08-10T10:46:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6b562c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00b3bd0 con 0x7fa6b00cac80 2023-08-10T10:46:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6affff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6b015c950 0x7fa6b00cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6affff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6b015c950 0x7fa6b00cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41202/0 (socket says 172.21.15.50:41202) 2023-08-10T10:46:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6affff640 1 -- 172.21.15.50:0/4242040307 learned_addr learned my addr 172.21.15.50:0/4242040307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6affff640 1 -- 172.21.15.50:0/4242040307 >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 msgr2=0x7fa6b00cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6b4e2b640 1 --2- 172.21.15.50:0/4242040307 >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 0x7fa6b00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.644+0000 7fa6affff640 1 --2- 172.21.15.50:0/4242040307 >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 0x7fa6b00cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.645+0000 7fa6affff640 1 -- 172.21.15.50:0/4242040307 >> v1:172.21.15.50:6789/0 conn(0x7fa6b01605d0 legacy=0x7fa6b00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.645+0000 7fa6af7fe640 1 -- 172.21.15.50:0/4242040307 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611054584 0 0) 0x7fa698001110 con 0x7fa6b01605d0 2023-08-10T10:46:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.645+0000 7fa6affff640 1 -- 172.21.15.50:0/4242040307 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0160b40 con 0x7fa6b015c950 2023-08-10T10:46:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.645+0000 7fa6b4e2b640 1 --2- 172.21.15.50:0/4242040307 >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 0x7fa6b00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.646+0000 7fa6affff640 1 --2- 172.21.15.50:0/4242040307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b00cfd30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0160510 tx=0x7fa6a002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c170a6908fd6de0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.646+0000 7fa6af7fe640 1 -- 172.21.15.50:0/4242040307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0030880 con 0x7fa6b015c950 2023-08-10T10:46:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.646+0000 7fa6af7fe640 1 -- 172.21.15.50:0/4242040307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00309e0 con 0x7fa6b015c950 2023-08-10T10:46:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.646+0000 7fa6af7fe640 1 -- 172.21.15.50:0/4242040307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0030d70 con 0x7fa6b015c950 2023-08-10T10:46:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 -- 172.21.15.50:0/4242040307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 msgr2=0x7fa6b00cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4242040307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b00cfd30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0160510 tx=0x7fa6a002b9c0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 -- 172.21.15.50:0/4242040307 shutdown_connections 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4242040307 >> v2:172.21.15.117:3300/0 conn(0x7fa6b00cac80 0x7fa6b00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4242040307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b00cfd30 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 -- 172.21.15.50:0/4242040307 >> 172.21.15.50:0/4242040307 conn(0x7fa6b00d0630 msgr2=0x7fa6b00d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 -- 172.21.15.50:0/4242040307 shutdown_connections 2023-08-10T10:46:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.647+0000 7fa6b562c640 1 -- 172.21.15.50:0/4242040307 wait complete. 2023-08-10T10:46:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.649+0000 7fa6b562c640 1 Processor -- start 2023-08-10T10:46:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.649+0000 7fa6b562c640 1 -- start start 2023-08-10T10:46:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b00cac80 0x7fa6b00698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b01605d0 0x7fa6b01f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00ad8e0 con 0x7fa6b015c950 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00ae180 con 0x7fa6b01605d0 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b562c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0069e10 con 0x7fa6b00cac80 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41206/0 (socket says 172.21.15.50:41206) 2023-08-10T10:46:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6a77fe640 1 -- 172.21.15.50:0/4011045915 learned_addr learned my addr 172.21.15.50:0/4011045915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6affff640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b00cac80 0x7fa6b00698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.651+0000 7fa6b4e2b640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b01605d0 0x7fa6b01f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 -- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b00cac80 msgr2=0x7fa6b00698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b00cac80 0x7fa6b00698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 -- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b01605d0 msgr2=0x7fa6b01f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b01605d0 0x7fa6b01f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00094d0 con 0x7fa6b015c950 2023-08-10T10:46:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6a77fe640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c470 tx=0x7fa69800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698005480 con 0x7fa6b015c950 2023-08-10T10:46:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980035f0 con 0x7fa6b015c950 2023-08-10T10:46:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980039a0 con 0x7fa6b015c950 2023-08-10T10:46:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b015fbc0 con 0x7fa6b015c950 2023-08-10T10:46:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.652+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00ade10 con 0x7fa6b015c950 2023-08-10T10:46:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.654+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b0066e30 con 0x7fa6b015c950 2023-08-10T10:46:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.654+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa698003b00 con 0x7fa6b015c950 2023-08-10T10:46:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.655+0000 7fa6ad7fa640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 0x7fa69006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.655+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa698088840 con 0x7fa6b015c950 2023-08-10T10:46:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.656+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fa690072d90 con 0x7fa6b015c950 2023-08-10T10:46:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.656+0000 7fa6affff640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 0x7fa69006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.656+0000 7fa6affff640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 0x7fa69006d110 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0036000 tx=0x7fa6a0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.660+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa698017060 con 0x7fa6b015c950 2023-08-10T10:46:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.854+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa6b00cb610 con 0x7fa6b015c950 2023-08-10T10:46:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.858+0000 7fa6ad7fa640 1 -- 172.21.15.50:0/4011045915 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+37024 (secure 0 0 0) 0x7fa6b00cb610 con 0x7fa6b015c950 2023-08-10T10:46:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:47.860 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 145, 2023-08-10T10:46:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:41.545752+0000", 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "145", 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.967 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:48.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 msgr2=0x7fa69006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 0x7fa69006d110 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0036000 tx=0x7fa6a0008030 comp rx=0 tx=0).stop 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 msgr2=0x7fa6b015f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c470 tx=0x7fa69800c930 comp rx=0 tx=0).stop 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 shutdown_connections 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa69006ac50 0x7fa69006d110 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:48.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b01605d0 0x7fa6b01f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6b015c950 0x7fa6b015f150 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 --2- 172.21.15.50:0/4011045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b00cac80 0x7fa6b00698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 >> 172.21.15.50:0/4011045915 conn(0x7fa6b00d0630 msgr2=0x7fa6b00712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 shutdown_connections 2023-08-10T10:46:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:47.862+0000 7fa6b562c640 1 -- 172.21.15.50:0/4011045915 wait complete. 2023-08-10T10:46:48.010 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:46:53.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.254+0000 7f4d4130c640 1 Processor -- start 2023-08-10T10:46:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.255+0000 7f4d4130c640 1 -- start start 2023-08-10T10:46:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.256+0000 7f4d4130c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d3c15cd60 0x7f4d3c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.256+0000 7f4d4130c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c161180 con 0x7f4d3c0cdf80 2023-08-10T10:46:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.256+0000 7f4d4130c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c161460 con 0x7f4d3c0b8430 2023-08-10T10:46:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.256+0000 7f4d4130c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c0b5bd0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d3c15cd60 0x7f4d3c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d3c15cd60 0x7f4d3c160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41220/0 (socket says 172.21.15.50:41220) 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d3c0cdf80 0x7f4d3c0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57238/0 (socket says 172.21.15.50:57238) 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 -- 172.21.15.50:0/3269552562 learned_addr learned my addr 172.21.15.50:0/3269552562 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 -- 172.21.15.50:0/3269552562 >> v1:172.21.15.117:6789/0 conn(0x7f4d3c0b8430 legacy=0x7f4d3c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 -- 172.21.15.50:0/3269552562 >> v1:172.21.15.50:6789/0 conn(0x7f4d3c0cdf80 legacy=0x7f4d3c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3affd640 1 -- 172.21.15.50:0/3269552562 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c161740 con 0x7f4d3c15cd60 2023-08-10T10:46:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.257+0000 7f4d3a7fc640 1 -- 172.21.15.50:0/3269552562 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832816998 0 0) 0x7f4d3c161180 con 0x7f4d3c0cdf80 2023-08-10T10:46:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.258+0000 7f4d3affd640 1 --2- 172.21.15.50:0/3269552562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c160930 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b29460a78c9d4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d3a7fc640 1 -- 172.21.15.50:0/3269552562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c02f840 con 0x7f4d3c15cd60 2023-08-10T10:46:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d3a7fc640 1 -- 172.21.15.50:0/3269552562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c02f9a0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d3a7fc640 1 -- 172.21.15.50:0/3269552562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c02fd30 con 0x7f4d3c15cd60 2023-08-10T10:46:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d4130c640 1 -- 172.21.15.50:0/3269552562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 msgr2=0x7f4d3c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d4130c640 1 --2- 172.21.15.50:0/3269552562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c160930 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c02ba20 comp rx=0 tx=0).stop 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d4130c640 1 -- 172.21.15.50:0/3269552562 shutdown_connections 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d4130c640 1 --2- 172.21.15.50:0/3269552562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c160930 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.259+0000 7f4d4130c640 1 -- 172.21.15.50:0/3269552562 >> 172.21.15.50:0/3269552562 conn(0x7f4d3c0d2ac0 msgr2=0x7f4d3c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.260+0000 7f4d4130c640 1 -- 172.21.15.50:0/3269552562 shutdown_connections 2023-08-10T10:46:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.260+0000 7f4d4130c640 1 -- 172.21.15.50:0/3269552562 wait complete. 2023-08-10T10:46:53.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.261+0000 7f4d4130c640 1 Processor -- start 2023-08-10T10:46:53.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.262+0000 7f4d4130c640 1 -- start start 2023-08-10T10:46:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.262+0000 7f4d4130c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d3c0b8430 0x7f4d3c1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.262+0000 7f4d4130c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 0x7f4d3c15fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d4130c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d4130c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c1f2470 con 0x7f4d3c15cd60 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d4130c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c15d4b0 con 0x7f4d3c0cdf80 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d4130c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c156360 con 0x7f4d3c0b8430 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41224/0 (socket says 172.21.15.50:41224) 2023-08-10T10:46:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d3b7fe640 1 -- 172.21.15.50:0/1571845950 learned_addr learned my addr 172.21.15.50:0/1571845950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:53.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d33fff640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 0x7f4d3c15fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.263+0000 7f4d3affd640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d3c0b8430 0x7f4d3c1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 -- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d3c0b8430 msgr2=0x7f4d3c1f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d3c0b8430 0x7f4d3c1f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 -- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 msgr2=0x7f4d3c15fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 0x7f4d3c15fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0094d0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d33fff640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 0x7f4d3c15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d3b7fe640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c780 tx=0x7f4d3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400ce90 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400a640 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c156640 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400aa70 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.264+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c15d140 con 0x7f4d3c15cd60 2023-08-10T10:46:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.265+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c04e270 con 0x7f4d3c15cd60 2023-08-10T10:46:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.267+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d3400abd0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.267+0000 7f4d337fe640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 0x7f4d1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.268+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d34088db0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.268+0000 7f4d3affd640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 0x7f4d1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.268+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f4d1c072da0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.268+0000 7f4d3affd640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 0x7f4d1c06d110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c036000 tx=0x7f4d2c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.272+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d34018060 con 0x7f4d3c15cd60 2023-08-10T10:46:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.465+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4d3c15d5f0 con 0x7f4d3c15cd60 2023-08-10T10:46:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.468+0000 7f4d337fe640 1 -- 172.21.15.50:0/1571845950 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+37024 (secure 0 0 0) 0x7f4d3408d070 con 0x7f4d3c15cd60 2023-08-10T10:46:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:53.469 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 145, 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:41.545752+0000", 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:46:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "145", 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.543 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:53.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:53.571 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.574 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.576 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:53.576 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.577 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:53.578 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.578 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.579 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:53.579 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.579 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:53.580 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.581 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:53.582 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.583 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.584 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.585 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.586 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.587 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:53.588 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:53.590 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.591 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:53.592 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.594 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:53.595 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.598 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.600 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:53.601 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.604 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.605 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.605 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.606 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:53.606 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.608 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:53.608 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:53.608 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:53.609 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:53.609 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.609 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.609 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.610 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.611 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:53.611 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.611 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.611 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.612 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.612 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.612 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.613 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.613 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.613 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.613 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.614 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.614 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.614 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.615 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:53.615 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.616 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:53.617 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.617 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.617 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.618 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.618 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.619 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.620 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.622 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.624 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:53.624 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:53.624 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:53.632 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:53.634 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:53.636 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:53.637 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.638 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.639 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.641 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.642 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.643 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.644 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.645 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.646 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:53.647 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.648 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:53.649 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:53.650 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:53.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:53.652 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:53.653 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:53.653 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:53.653 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:53.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:53.654 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:53.655 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:53.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 msgr2=0x7f4d1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 0x7f4d1c06d110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c036000 tx=0x7f4d2c008030 comp rx=0 tx=0).stop 2023-08-10T10:46:53.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 msgr2=0x7f4d3c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:53.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c780 tx=0x7f4d3400cc40 comp rx=0 tx=0).stop 2023-08-10T10:46:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 shutdown_connections 2023-08-10T10:46:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d3c15cd60 0x7f4d3c157450 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4d1c06ac50 0x7f4d1c06d110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3c0cdf80 0x7f4d3c15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 --2- 172.21.15.50:0/1571845950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d3c0b8430 0x7f4d3c1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:53.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 >> 172.21.15.50:0/1571845950 conn(0x7f4d3c0d2ac0 msgr2=0x7f4d3c0b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:53.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 shutdown_connections 2023-08-10T10:46:53.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:53.471+0000 7f4d4130c640 1 -- 172.21.15.50:0/1571845950 wait complete. 2023-08-10T10:46:53.659 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:46:58.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.898+0000 7f0d0e979640 1 Processor -- start 2023-08-10T10:46:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.899+0000 7f0d0e979640 1 -- start start 2023-08-10T10:46:58.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d0e979640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d0815cd60 0x7f0d08160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d0e979640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d080b8430 0x7f0d080cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d0e979640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d08161180 con 0x7f0d080cddb0 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d0e979640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080ce240 con 0x7f0d0815cd60 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d0e979640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080b5bd0 con 0x7f0d080b8430 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.900+0000 7f0d07fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d0815cd60 0x7f0d08160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d0815cd60 0x7f0d08160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46560/0 (socket says 172.21.15.50:46560) 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 -- 172.21.15.50:0/1212535232 learned_addr learned my addr 172.21.15.50:0/1212535232 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 -- 172.21.15.50:0/1212535232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d080b8430 msgr2=0x7f0d080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 --2- 172.21.15.50:0/1212535232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d080b8430 0x7f0d080cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 -- 172.21.15.50:0/1212535232 >> v1:172.21.15.117:6789/0 conn(0x7f0d080cddb0 legacy=0x7f0d080696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.901+0000 7f0d07fff640 1 -- 172.21.15.50:0/1212535232 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08161460 con 0x7f0d0815cd60 2023-08-10T10:46:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.902+0000 7f0d07fff640 1 --2- 172.21.15.50:0/1212535232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0815cd60 0x7f0d08160930 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009870 tx=0x7f0cf802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3738621dd22ba0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.902+0000 7f0d06ffd640 1 -- 172.21.15.50:0/1212535232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8030840 con 0x7f0d0815cd60 2023-08-10T10:46:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d06ffd640 1 -- 172.21.15.50:0/1212535232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf80309a0 con 0x7f0d0815cd60 2023-08-10T10:46:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d06ffd640 1 -- 172.21.15.50:0/1212535232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8030d30 con 0x7f0d0815cd60 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 -- 172.21.15.50:0/1212535232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0815cd60 msgr2=0x7f0d08160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 --2- 172.21.15.50:0/1212535232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0815cd60 0x7f0d08160930 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009870 tx=0x7f0cf802b980 comp rx=0 tx=0).stop 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 -- 172.21.15.50:0/1212535232 shutdown_connections 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 --2- 172.21.15.50:0/1212535232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d080b8430 0x7f0d080cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 --2- 172.21.15.50:0/1212535232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d0815cd60 0x7f0d08160930 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 -- 172.21.15.50:0/1212535232 >> 172.21.15.50:0/1212535232 conn(0x7f0d080d2ac0 msgr2=0x7f0d080d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 -- 172.21.15.50:0/1212535232 shutdown_connections 2023-08-10T10:46:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.903+0000 7f0d0e979640 1 -- 172.21.15.50:0/1212535232 wait complete. 2023-08-10T10:46:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.905+0000 7f0d0e979640 1 Processor -- start 2023-08-10T10:46:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.905+0000 7f0d0e979640 1 -- start start 2023-08-10T10:46:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d080cddb0 0x7f0d081572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0815cd60 0x7f0d0815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081f5bc0 con 0x7f0d080b8430 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081f6ae0 con 0x7f0d080cddb0 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.906+0000 7f0d0e979640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0815df30 con 0x7f0d0815cd60 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46570/0 (socket says 172.21.15.50:46570) 2023-08-10T10:46:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 -- 172.21.15.50:0/149711511 learned_addr learned my addr 172.21.15.50:0/149711511 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 -- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0815cd60 msgr2=0x7f0d0815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0815cd60 0x7f0d0815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 -- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d080cddb0 msgr2=0x7f0d081572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d080cddb0 0x7f0d081572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.907+0000 7f0d07fff640 1 -- 172.21.15.50:0/149711511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80094d0 con 0x7f0d080b8430 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d07fff640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009870 tx=0x7f0cf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80307f0 con 0x7f0d080b8430 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8043400 con 0x7f0d080b8430 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80437b0 con 0x7f0d080b8430 2023-08-10T10:46:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08157800 con 0x7f0d080b8430 2023-08-10T10:46:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.908+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0815dc50 con 0x7f0d080b8430 2023-08-10T10:46:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.909+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d080d0bc0 con 0x7f0d080b8430 2023-08-10T10:46:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.910+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cf8043910 con 0x7f0d080b8430 2023-08-10T10:46:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.911+0000 7f0d04ff9640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 0x7f0ce806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.911+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cf803e070 con 0x7f0d080b8430 2023-08-10T10:46:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.911+0000 7f0d077fe640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 0x7f0ce806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.912+0000 7f0d077fe640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 0x7f0ce806d140 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d080c93a0 tx=0x7f0cf0009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:58.916+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0cf80777f0 con 0x7f0d080b8430 2023-08-10T10:46:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.110+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0d0804e270 con 0x7f0d080b8430 2023-08-10T10:46:59.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.113+0000 7f0d04ff9640 1 -- 172.21.15.50:0/149711511 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+37005 (secure 0 0 0) 0x7f0cf807ae10 con 0x7f0d080b8430 2023-08-10T10:46:59.114 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 146, 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:56.557074+0000", 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:59.116 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:59.117 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:59.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.120 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:59.121 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.123 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.124 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:59.129 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.132 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.133 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:59.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.136 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.138 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.139 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.146 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.147 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.147 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.147 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.147 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.147 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.148 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.148 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.148 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:59.152 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:59.153 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:59.154 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.155 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:59.156 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "146", 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.160 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.160 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:59.160 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.161 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.164 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.164 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.166 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:59.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:59.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.177 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.179 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.180 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.181 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.183 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:59.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:59.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:59.190 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.191 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:59.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:59.196 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:59.199 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.200 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.201 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.202 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.204 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:59.209 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:59.210 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.212 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.214 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:59.216 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:59.219 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.220 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:59.220 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:59.221 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:59.222 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.226 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.227 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:59.228 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.229 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.231 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.232 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.233 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:59.239 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.242 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.243 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.244 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.246 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.248 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.250 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.253 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:59.254 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.256 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.260 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.261 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.262 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:59.264 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:59.265 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:59.266 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:59.267 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.268 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 msgr2=0x7f0ce806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 0x7f0ce806d140 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d080c93a0 tx=0x7f0cf0009250 comp rx=0 tx=0).stop 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 msgr2=0x7f0d081f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009870 tx=0x7f0cf8004730 comp rx=0 tx=0).stop 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 shutdown_connections 2023-08-10T10:46:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0815cd60 0x7f0d0815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ce806ac80 0x7f0ce806d140 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d080cddb0 0x7f0d081572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 --2- 172.21.15.50:0/149711511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d080b8430 0x7f0d081f65a0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 >> 172.21.15.50:0/149711511 conn(0x7f0d080d2ac0 msgr2=0x7f0d080cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 shutdown_connections 2023-08-10T10:46:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.116+0000 7f0d0e979640 1 -- 172.21.15.50:0/149711511 wait complete. 2023-08-10T10:46:59.272 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-10T10:46:59.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:46:59.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.513+0000 7f3e5a5c4640 1 Processor -- start 2023-08-10T10:46:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.513+0000 7f3e5a5c4640 1 -- start start 2023-08-10T10:46:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.514+0000 7f3e5a5c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.514+0000 7f3e5a5c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 0x7f3e540b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.514+0000 7f3e5a5c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e540d0580 con 0x7f3e54071090 2023-08-10T10:46:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.514+0000 7f3e5a5c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e54071b40 con 0x7f3e540b3c60 2023-08-10T10:46:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.514+0000 7f3e5a5c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540cf0e0 con 0x7f3e5415ceb0 2023-08-10T10:46:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.515+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.516+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:43654/0 (socket says 172.21.15.50:43654) 2023-08-10T10:46:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.516+0000 7f3e58b61640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3e54071090 0x7f3e54160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:33738/0 (socket says 172.21.15.50:33738) 2023-08-10T10:46:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.516+0000 7f3e53fff640 1 -- 172.21.15.50:0/2975201962 learned_addr learned my addr 172.21.15.50:0/2975201962 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.516+0000 7f3e4b7fe640 1 --2- 172.21.15.50:0/2975201962 >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 0x7f3e540b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e53fff640 1 -- 172.21.15.50:0/2975201962 >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 msgr2=0x7f3e540b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:46:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e53fff640 1 --2- 172.21.15.50:0/2975201962 >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 0x7f3e540b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e53fff640 1 -- 172.21.15.50:0/2975201962 >> v1:172.21.15.117:6789/0 conn(0x7f3e54071090 legacy=0x7f3e54160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e53fff640 1 -- 172.21.15.50:0/2975201962 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54071580 con 0x7f3e5415ceb0 2023-08-10T10:46:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e537fe640 1 -- 172.21.15.50:0/2975201962 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303721237 0 0) 0x7f3e540d0580 con 0x7f3e54071090 2023-08-10T10:46:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.517+0000 7f3e4b7fe640 1 --2- 172.21.15.50:0/2975201962 >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 0x7f3e540b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:46:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.518+0000 7f3e53fff640 1 --2- 172.21.15.50:0/2975201962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e4402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=772fb024daed9c32 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e537fe640 1 -- 172.21.15.50:0/2975201962 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44030840 con 0x7f3e5415ceb0 2023-08-10T10:46:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e537fe640 1 -- 172.21.15.50:0/2975201962 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e440309a0 con 0x7f3e5415ceb0 2023-08-10T10:46:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e537fe640 1 -- 172.21.15.50:0/2975201962 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44030d30 con 0x7f3e5415ceb0 2023-08-10T10:46:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/2975201962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 msgr2=0x7f3e54070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/2975201962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e4402b980 comp rx=0 tx=0).stop 2023-08-10T10:46:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/2975201962 shutdown_connections 2023-08-10T10:46:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/2975201962 >> v2:172.21.15.117:3300/0 conn(0x7f3e540b3c60 0x7f3e540b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/2975201962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e54070b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.519+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/2975201962 >> 172.21.15.50:0/2975201962 conn(0x7f3e540cd2d0 msgr2=0x7f3e540cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.520+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/2975201962 shutdown_connections 2023-08-10T10:46:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.520+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/2975201962 wait complete. 2023-08-10T10:46:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.521+0000 7f3e5a5c4640 1 Processor -- start 2023-08-10T10:46:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.522+0000 7f3e5a5c4640 1 -- start start 2023-08-10T10:46:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.522+0000 7f3e5a5c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e5a5c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e540b3c60 0x7f3e541f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e5a5c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e541f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e5a5c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540ca870 con 0x7f3e54071090 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e5a5c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540c5d60 con 0x7f3e540b3c60 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e5a5c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540c6040 con 0x7f3e5415ceb0 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46586/0 (socket says 172.21.15.50:46586) 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 -- 172.21.15.50:0/3391444355 learned_addr learned my addr 172.21.15.50:0/3391444355 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e58b61640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e541f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e4b7fe640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e540b3c60 0x7f3e541f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 -- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 msgr2=0x7f3e541f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e541f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 -- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e540b3c60 msgr2=0x7f3e541f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e540b3c60 0x7f3e541f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e53fff640 1 -- 172.21.15.50:0/3391444355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c009a70 con 0x7f3e54071090 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.523+0000 7f3e58b61640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e541f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:46:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e53fff640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44039a90 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44039bf0 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440433f0 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e440094d0 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.524+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541f3e60 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.526+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5404e270 con 0x7f3e54071090 2023-08-10T10:46:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.526+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e44042390 con 0x7f3e54071090 2023-08-10T10:46:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.528+0000 7f3e517fa640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 0x7f3e3406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.528+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e440ab630 con 0x7f3e54071090 2023-08-10T10:46:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.528+0000 7f3e4b7fe640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 0x7f3e3406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.529+0000 7f3e4b7fe640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 0x7f3e3406d110 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3e540cc280 tx=0x7f3e3c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.532+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3e440766d0 con 0x7f3e54071090 2023-08-10T10:46:59.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.730+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3e5415c4f0 con 0x7f3e54071090 2023-08-10T10:46:59.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.734+0000 7f3e517fa640 1 -- 172.21.15.50:0/3391444355 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+37005 (secure 0 0 0) 0x7f3e44079cf0 con 0x7f3e54071090 2023-08-10T10:46:59.735 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:46:59.735 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 146, 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:46:56.557074+0000", 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:46:59.736 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:46:59.737 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:46:59.738 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 18, 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:46:59.739 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:46:59.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.741 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.742 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:46:59.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.744 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.745 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.748 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.750 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.751 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:46:59.751 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:46:59.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:46:59.752 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.753 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:46:59.754 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.755 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:46:59.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.757 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.758 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.759 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.764 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.765 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 17, 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:18.537056+0000", 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.767 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:46:59.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "142", 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.771 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.773 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.774 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.774 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.774 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.775 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.776 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:46:59.777 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.779 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 18, 2023-08-10T10:46:59.779 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:46:59.780 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:46:19.150540+0000", 2023-08-10T10:46:59.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:46:59.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:46:59.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:46:59.780 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:46:59.781 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:46:59.782 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "146", 2023-08-10T10:46:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:46:59.784 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:46:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:46:59.786 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:46:59.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:46:59.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:46:59.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:46:59.787 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:46:59.787 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:46:59.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:46:59.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.788 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:46:59.788 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:46:59.789 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:46:59.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:46:59.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:46:59.789 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:46:59.790 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:46:59.790 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:46:59.790 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:46:59.791 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:46:59.791 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:46:59.791 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:46:59.791 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:46:59.791 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.792 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.3799999952316284, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.3799999952316284, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:46:59.793 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.794 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.795 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.796 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.800 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:46:59.800 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:46:59.801 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:46:59.805 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.806 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.806 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.807 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.809 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:46:59.809 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.812 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:46:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:46:59.816 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:46:59.817 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:59.818 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.819 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.820 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.820 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.820 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.820 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.821 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:46:59.821 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.822 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.824 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:46:59.824 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.824 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:46:59.825 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:46:59.827 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.828 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.829 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.831 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:46:59.834 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.835 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:46:59.836 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.839 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.840 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:59.841 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.842 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:46:59.844 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.845 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.846 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:46:59.849 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.851 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.852 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.852 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:59.852 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.853 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:46:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.856 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:46:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:46:59.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:46:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.864 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:46:59.866 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.867 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:46:59.868 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.868 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:46:59.870 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:46:59.872 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:46:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:59.874 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:46:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 141, 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.876 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:46:59.878 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:46:59.880 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:46:59.884 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:46:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:46:59.887 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.888 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:46:59.889 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.891 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.892 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.893 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:46:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:46:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:46:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:46:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:46:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:46:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:46:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:46:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:46:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:46:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:46:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:46:59.901 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:46:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 msgr2=0x7f3e3406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 0x7f3e3406d110 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3e540cc280 tx=0x7f3e3c00b040 comp rx=0 tx=0).stop 2023-08-10T10:46:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 msgr2=0x7f3e540ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e44004730 comp rx=0 tx=0).stop 2023-08-10T10:46:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 shutdown_connections 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e5415ceb0 0x7f3e541f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3e3406ac50 0x7f3e3406d110 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e540b3c60 0x7f3e541f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 --2- 172.21.15.50:0/3391444355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e54071090 0x7f3e540ca330 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 >> 172.21.15.50:0/3391444355 conn(0x7f3e540cd2d0 msgr2=0x7f3e540b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 shutdown_connections 2023-08-10T10:46:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:46:59.737+0000 7f3e5a5c4640 1 -- 172.21.15.50:0/3391444355 wait complete. 2023-08-10T10:46:59.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:00.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.145+0000 7f8ddffff640 1 Processor -- start 2023-08-10T10:47:00.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.145+0000 7f8ddffff640 1 -- start start 2023-08-10T10:47:00.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.147+0000 7f8ddffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8de00b0620 0x7f8de00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:00.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.147+0000 7f8ddffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de00b1f10 con 0x7f8de015f2b0 2023-08-10T10:47:00.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.147+0000 7f8ddffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de015e7d0 con 0x7f8de015a940 2023-08-10T10:47:00.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.147+0000 7f8ddffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de00b21f0 con 0x7f8de00b0620 2023-08-10T10:47:00.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8dd7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8de00b0620 0x7f8de00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:00.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8ddf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8de015f2b0 0x7f8de00ca740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34780/0 (socket says 172.21.15.50:34780) 2023-08-10T10:47:00.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8ddf7fe640 1 -- 172.21.15.50:0/3453214217 learned_addr learned my addr 172.21.15.50:0/3453214217 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:00.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8dd7fff640 1 -- 172.21.15.50:0/3453214217 >> v1:172.21.15.117:6789/0 conn(0x7f8de015a940 legacy=0x7f8de00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8dd7fff640 1 -- 172.21.15.50:0/3453214217 >> v1:172.21.15.50:6789/0 conn(0x7f8de015f2b0 legacy=0x7f8de00ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8dd7fff640 1 -- 172.21.15.50:0/3453214217 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de015eab0 con 0x7f8de00b0620 2023-08-10T10:47:00.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.148+0000 7f8dde7fc640 1 -- 172.21.15.50:0/3453214217 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780236629 0 0) 0x7f8de00b1f10 con 0x7f8de015f2b0 2023-08-10T10:47:00.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8dd7fff640 1 --2- 172.21.15.50:0/3453214217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de00b0620 0x7f8de00b12c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80097a0 tx=0x7f8dc802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2697122c79962f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:00.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8dde7fc640 1 -- 172.21.15.50:0/3453214217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8031830 con 0x7f8de00b0620 2023-08-10T10:47:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8dde7fc640 1 -- 172.21.15.50:0/3453214217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8031990 con 0x7f8de00b0620 2023-08-10T10:47:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8dde7fc640 1 -- 172.21.15.50:0/3453214217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8031d20 con 0x7f8de00b0620 2023-08-10T10:47:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8ddffff640 1 -- 172.21.15.50:0/3453214217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de00b0620 msgr2=0x7f8de00b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.150+0000 7f8ddffff640 1 --2- 172.21.15.50:0/3453214217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de00b0620 0x7f8de00b12c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80097a0 tx=0x7f8dc802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.151+0000 7f8ddffff640 1 -- 172.21.15.50:0/3453214217 shutdown_connections 2023-08-10T10:47:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.151+0000 7f8ddffff640 1 --2- 172.21.15.50:0/3453214217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de00b0620 0x7f8de00b12c0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.151+0000 7f8ddffff640 1 -- 172.21.15.50:0/3453214217 >> 172.21.15.50:0/3453214217 conn(0x7f8de006ab80 msgr2=0x7f8de006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.151+0000 7f8ddffff640 1 -- 172.21.15.50:0/3453214217 shutdown_connections 2023-08-10T10:47:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.151+0000 7f8ddffff640 1 -- 172.21.15.50:0/3453214217 wait complete. 2023-08-10T10:47:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.153+0000 7f8ddffff640 1 Processor -- start 2023-08-10T10:47:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.153+0000 7f8ddffff640 1 -- start start 2023-08-10T10:47:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de00b0620 0x7f8de00c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de015a940 0x7f8de00c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00c7ae0 con 0x7f8de015f2b0 2023-08-10T10:47:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00c5aa0 con 0x7f8de015a940 2023-08-10T10:47:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00c5d00 con 0x7f8de00b0620 2023-08-10T10:47:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46600/0 (socket says 172.21.15.50:46600) 2023-08-10T10:47:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.154+0000 7f8ddf7fe640 1 -- 172.21.15.50:0/4198479207 learned_addr learned my addr 172.21.15.50:0/4198479207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddeffd640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de00b0620 0x7f8de00c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8dd7fff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de015a940 0x7f8de00c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 -- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de00b0620 msgr2=0x7f8de00c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de00b0620 0x7f8de00c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 -- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de015a940 msgr2=0x7f8de00c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de015a940 0x7f8de00c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 -- 172.21.15.50:0/4198479207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8009400 con 0x7f8de015f2b0 2023-08-10T10:47:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8ddf7fe640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800c6d0 tx=0x7f8dd800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.155+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8004d60 con 0x7f8de015f2b0 2023-08-10T10:47:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.156+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd800a640 con 0x7f8de015f2b0 2023-08-10T10:47:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.156+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de00c5fe0 con 0x7f8de015f2b0 2023-08-10T10:47:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.156+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800aa70 con 0x7f8de015f2b0 2023-08-10T10:47:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.156+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de00c65a0 con 0x7f8de015f2b0 2023-08-10T10:47:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.157+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de0066e30 con 0x7f8de015f2b0 2023-08-10T10:47:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.158+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dd80070d0 con 0x7f8de015f2b0 2023-08-10T10:47:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.159+0000 7f8dd77fe640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 0x7f8dc006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.160+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8dd8088c60 con 0x7f8de015f2b0 2023-08-10T10:47:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.160+0000 7f8ddeffd640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 0x7f8dc006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.160+0000 7f8ddeffd640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 0x7f8dc006d110 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0000f60 tx=0x7f8dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.164+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8dd8053c70 con 0x7f8de015f2b0 2023-08-10T10:47:00.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.394+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8de00b0dc0 con 0x7f8de015f2b0 2023-08-10T10:47:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.395+0000 7f8dd77fe640 1 -- 172.21.15.50:0/4198479207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f8dd8057290 con 0x7f8de015f2b0 2023-08-10T10:47:00.395 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:00.396 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:47:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:47:00.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 msgr2=0x7f8dc006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 0x7f8dc006d110 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0000f60 tx=0x7f8dd0009040 comp rx=0 tx=0).stop 2023-08-10T10:47:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 msgr2=0x7f8de01597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800c6d0 tx=0x7f8dd800cb90 comp rx=0 tx=0).stop 2023-08-10T10:47:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 shutdown_connections 2023-08-10T10:47:00.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de015f2b0 0x7f8de01597c0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dc006ac50 0x7f8dc006d110 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de015a940 0x7f8de00c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 --2- 172.21.15.50:0/4198479207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de00b0620 0x7f8de00c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 >> 172.21.15.50:0/4198479207 conn(0x7f8de006ab80 msgr2=0x7f8de0071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 shutdown_connections 2023-08-10T10:47:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:00.397+0000 7f8ddffff640 1 -- 172.21.15.50:0/4198479207 wait complete. 2023-08-10T10:47:00.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:47:00.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":8010,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.935652867999998,"mdsmap_epoch":67,"osdmap_epoch":146,"osdmap_epoch_barrier":145,"uptime":45.897941754999998} 2023-08-10T10:47:00.654 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 8010, "mdsmap_epoch": 67, "osdmap_epoch": 146, "osdmap_epoch_barrier": 145, "rank_uptime": 39.935652868, "state": "up:active", "uptime": 45.897941755, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:47:00.655 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:47:00.655 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:00.655 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:00.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:00.711 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-10T10:47:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:47:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:47:01.168 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.39896 s, 131 MB/s 2023-08-10T10:47:01.169 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:47:01.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:47:01.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:47:01.386 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:47:01.386 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:01.387 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:01.448 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:01.449 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:01.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:01.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.738+0000 7f2c93871640 1 Processor -- start 2023-08-10T10:47:01.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.738+0000 7f2c93871640 1 -- start start 2023-08-10T10:47:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.739+0000 7f2c93871640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c15cd60 0x7f2c8c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.739+0000 7f2c93871640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c161180 con 0x7f2c8c0b8430 2023-08-10T10:47:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.740+0000 7f2c93871640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c161460 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.740+0000 7f2c93871640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8c0b5bd0 con 0x7f2c8c15cd60 2023-08-10T10:47:01.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.740+0000 7f2c9160d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c15cd60 0x7f2c8c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:01.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.740+0000 7f2c9160d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c15cd60 0x7f2c8c160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46610/0 (socket says 172.21.15.50:46610) 2023-08-10T10:47:01.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.740+0000 7f2c9160d640 1 -- 172.21.15.50:0/2826316204 learned_addr learned my addr 172.21.15.50:0/2826316204 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:01.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.741+0000 7f2c9160d640 1 -- 172.21.15.50:0/2826316204 >> v1:172.21.15.117:6789/0 conn(0x7f2c8c0cdf80 legacy=0x7f2c8c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.741+0000 7f2c9160d640 1 -- 172.21.15.50:0/2826316204 >> v1:172.21.15.50:6789/0 conn(0x7f2c8c0b8430 legacy=0x7f2c8c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.741+0000 7f2c9160d640 1 -- 172.21.15.50:0/2826316204 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c161740 con 0x7f2c8c15cd60 2023-08-10T10:47:01.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.741+0000 7f2c83fff640 1 -- 172.21.15.50:0/2826316204 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73524049 0 0) 0x7f2c8c161180 con 0x7f2c8c0b8430 2023-08-10T10:47:01.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.742+0000 7f2c9160d640 1 --2- 172.21.15.50:0/2826316204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c160930 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009e50 tx=0x7f2c8802c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3b80aa1c3f616 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:01.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.742+0000 7f2c83fff640 1 -- 172.21.15.50:0/2826316204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8802cc30 con 0x7f2c8c15cd60 2023-08-10T10:47:01.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.742+0000 7f2c83fff640 1 -- 172.21.15.50:0/2826316204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8802cd90 con 0x7f2c8c15cd60 2023-08-10T10:47:01.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.742+0000 7f2c83fff640 1 -- 172.21.15.50:0/2826316204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88034610 con 0x7f2c8c15cd60 2023-08-10T10:47:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 -- 172.21.15.50:0/2826316204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c15cd60 msgr2=0x7f2c8c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 --2- 172.21.15.50:0/2826316204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c160930 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009e50 tx=0x7f2c8802c090 comp rx=0 tx=0).stop 2023-08-10T10:47:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 -- 172.21.15.50:0/2826316204 shutdown_connections 2023-08-10T10:47:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 --2- 172.21.15.50:0/2826316204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c160930 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 -- 172.21.15.50:0/2826316204 >> 172.21.15.50:0/2826316204 conn(0x7f2c8c0d2ac0 msgr2=0x7f2c8c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:01.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 -- 172.21.15.50:0/2826316204 shutdown_connections 2023-08-10T10:47:01.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.743+0000 7f2c93871640 1 -- 172.21.15.50:0/2826316204 wait complete. 2023-08-10T10:47:01.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.745+0000 7f2c93871640 1 Processor -- start 2023-08-10T10:47:01.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.746+0000 7f2c93871640 1 -- start start 2023-08-10T10:47:01.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8c0b8430 0x7f2c8c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:01.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c150090 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c154060 con 0x7f2c8c15cd60 2023-08-10T10:47:01.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c93871640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c154470 con 0x7f2c8c0b8430 2023-08-10T10:47:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c90e0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c90e0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46618/0 (socket says 172.21.15.50:46618) 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.747+0000 7f2c90e0c640 1 -- 172.21.15.50:0/890843501 learned_addr learned my addr 172.21.15.50:0/890843501 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c9160d640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8c0b8430 0x7f2c8c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c91e0e640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 -- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8c0b8430 msgr2=0x7f2c8c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8c0b8430 0x7f2c8c14fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 -- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8c15cd60 msgr2=0x7f2c8c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 -- 172.21.15.50:0/890843501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c88009b30 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.748+0000 7f2c90e0c640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c3c0 tx=0x7f2c7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.749+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0035f0 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.749+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c003770 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.749+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c003b20 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.749+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8c154710 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.749+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c1550e0 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.750+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8c154950 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.751+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c7c003c80 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.752+0000 7f2c81ffb640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 0x7f2c7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:01.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.752+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c7c088ab0 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.752+0000 7f2c9160d640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 0x7f2c7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:01.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.753+0000 7f2c9160d640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 0x7f2c7006d110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2c88035000 tx=0x7f2c88030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.756+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2c8c154950 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.951+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c8c154c60 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.954+0000 7f2c81ffb640 1 -- 172.21.15.50:0/890843501 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f2c8c154c60 con 0x7f2c8c0cdf80 2023-08-10T10:47:01.955 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:01.955 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":146,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:56.557074+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 msgr2=0x7f2c7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 0x7f2c7006d110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2c88035000 tx=0x7f2c88030000 comp rx=0 tx=0).stop 2023-08-10T10:47:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 msgr2=0x7f2c8c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c3c0 tx=0x7f2c7c00c880 comp rx=0 tx=0).stop 2023-08-10T10:47:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 shutdown_connections 2023-08-10T10:47:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2c7006ac50 0x7f2c7006d110 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8c15cd60 0x7f2c8c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0cdf80 0x7f2c8c1588a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 --2- 172.21.15.50:0/890843501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8c0b8430 0x7f2c8c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 >> 172.21.15.50:0/890843501 conn(0x7f2c8c0d2ac0 msgr2=0x7f2c8c0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 shutdown_connections 2023-08-10T10:47:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:01.957+0000 7f2c93871640 1 -- 172.21.15.50:0/890843501 wait complete. 2023-08-10T10:47:01.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:46:18.537056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:46:19.150540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:01.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.211+0000 7f5ab57a4640 1 Processor -- start 2023-08-10T10:47:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.211+0000 7f5ab57a4640 1 -- start start 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ab0159790 0x7f5ab00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab00b3490 0x7f5ab006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ab006b0c0 0x7f5ab015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab006b550 con 0x7f5ab0159790 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab00cc380 con 0x7f5ab006b0c0 2023-08-10T10:47:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.213+0000 7f5ab57a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0159b70 con 0x7f5ab00b3490 2023-08-10T10:47:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ab0159790 0x7f5ab00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ab0159790 0x7f5ab00b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46630/0 (socket says 172.21.15.50:46630) 2023-08-10T10:47:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 -- 172.21.15.50:0/2191635225 learned_addr learned my addr 172.21.15.50:0/2191635225 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaf7fe640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab00b3490 0x7f5ab006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5ab4fa3640 1 --2- 172.21.15.50:0/2191635225 >> v2:172.21.15.117:3300/0 conn(0x7f5ab006b0c0 0x7f5ab015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 -- 172.21.15.50:0/2191635225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab00b3490 msgr2=0x7f5ab006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab00b3490 0x7f5ab006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 -- 172.21.15.50:0/2191635225 >> v2:172.21.15.117:3300/0 conn(0x7f5ab006b0c0 msgr2=0x7f5ab015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 --2- 172.21.15.50:0/2191635225 >> v2:172.21.15.117:3300/0 conn(0x7f5ab006b0c0 0x7f5ab015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.214+0000 7f5aaffff640 1 -- 172.21.15.50:0/2191635225 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00cc590 con 0x7f5ab0159790 2023-08-10T10:47:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5aaffff640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab0159790 0x7f5ab00b24a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00cbbc0 tx=0x7f5aa002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92bf08c02cdf799 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5aaeffd640 1 -- 172.21.15.50:0/2191635225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0031870 con 0x7f5ab0159790 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5aaeffd640 1 -- 172.21.15.50:0/2191635225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00319d0 con 0x7f5ab0159790 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5aaeffd640 1 -- 172.21.15.50:0/2191635225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0031d60 con 0x7f5ab0159790 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5ab57a4640 1 -- 172.21.15.50:0/2191635225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab0159790 msgr2=0x7f5ab00b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.216+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab0159790 0x7f5ab00b24a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00cbbc0 tx=0x7f5aa002b910 comp rx=0 tx=0).stop 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 -- 172.21.15.50:0/2191635225 shutdown_connections 2023-08-10T10:47:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/2191635225 >> v2:172.21.15.117:3300/0 conn(0x7f5ab006b0c0 0x7f5ab015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab00b3490 0x7f5ab006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/2191635225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab0159790 0x7f5ab00b24a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 -- 172.21.15.50:0/2191635225 >> 172.21.15.50:0/2191635225 conn(0x7f5ab0069cd0 msgr2=0x7f5ab00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 -- 172.21.15.50:0/2191635225 shutdown_connections 2023-08-10T10:47:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.217+0000 7f5ab57a4640 1 -- 172.21.15.50:0/2191635225 wait complete. 2023-08-10T10:47:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.218+0000 7f5ab57a4640 1 Processor -- start 2023-08-10T10:47:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.219+0000 7f5ab57a4640 1 -- start start 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab00b3490 0x7f5ab00c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab0159790 0x7f5ab0150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00719b0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0070a70 con 0x7f5ab00b3490 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5ab57a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0070d50 con 0x7f5ab0159790 2023-08-10T10:47:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46632/0 (socket says 172.21.15.50:46632) 2023-08-10T10:47:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 -- 172.21.15.50:0/1688946944 learned_addr learned my addr 172.21.15.50:0/1688946944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 -- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab0159790 msgr2=0x7f5ab0150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab0159790 0x7f5ab0150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 -- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab00b3490 msgr2=0x7f5ab00c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab00b3490 0x7f5ab00c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.220+0000 7f5aaffff640 1 -- 172.21.15.50:0/1688946944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00094d0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5aaffff640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f5aa002b950 tx=0x7f5aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa003ad30 con 0x7f5ab006b0c0 2023-08-10T10:47:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00443f0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00447a0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab0145da0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.221+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab0145a40 con 0x7f5ab006b0c0 2023-08-10T10:47:02.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.223+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab01462c0 con 0x7f5ab006b0c0 2023-08-10T10:47:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.224+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5aa004d450 con 0x7f5ab006b0c0 2023-08-10T10:47:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.225+0000 7f5aacff9640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 0x7f5a9c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.225+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5aa002d040 con 0x7f5ab006b0c0 2023-08-10T10:47:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.225+0000 7f5aaf7fe640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 0x7f5a9c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.226+0000 7f5aaf7fe640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 0x7f5a9c06d110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0151540 tx=0x7f5aa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.229+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5aa0076b00 con 0x7f5ab006b0c0 2023-08-10T10:47:02.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.421+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab0066e30 con 0x7f5ab006b0c0 2023-08-10T10:47:02.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.422+0000 7f5aacff9640 1 -- 172.21.15.50:0/1688946944 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa0035020 con 0x7f5ab006b0c0 2023-08-10T10:47:02.422 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:47:02.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 msgr2=0x7f5a9c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 0x7f5a9c06d110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0151540 tx=0x7f5aa4008040 comp rx=0 tx=0).stop 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 msgr2=0x7f5ab00af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f5aa002b950 tx=0x7f5aa00046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 shutdown_connections 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ab0159790 0x7f5ab0150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5a9c06ac50 0x7f5a9c06d110 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ab00b3490 0x7f5ab00c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 --2- 172.21.15.50:0/1688946944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ab006b0c0 0x7f5ab00af860 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.424+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 >> 172.21.15.50:0/1688946944 conn(0x7f5ab0069cd0 msgr2=0x7f5ab00cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:02.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.425+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 shutdown_connections 2023-08-10T10:47:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.425+0000 7f5ab57a4640 1 -- 172.21.15.50:0/1688946944 wait complete. 2023-08-10T10:47:02.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:47:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.677+0000 7f0a01e3d640 1 Processor -- start 2023-08-10T10:47:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.677+0000 7f0a01e3d640 1 -- start start 2023-08-10T10:47:02.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.679+0000 7f0a01e3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.679+0000 7f0a01e3d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09fc15e570 0x7f09fc15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.679+0000 7f0a01e3d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc15af80 con 0x7f09fc0b0b20 2023-08-10T10:47:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.679+0000 7f0a01e3d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc15efc0 con 0x7f09fc15e570 2023-08-10T10:47:02.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.679+0000 7f0a01e3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc15f2a0 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.680+0000 7f09fb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.680+0000 7f09fb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:43710/0 (socket says 172.21.15.50:43710) 2023-08-10T10:47:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.680+0000 7f09fb7fe640 1 -- 172.21.15.50:0/3221392442 learned_addr learned my addr 172.21.15.50:0/3221392442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.680+0000 7f09f3fff640 1 --2- 172.21.15.50:0/3221392442 >> v2:172.21.15.117:3300/0 conn(0x7f09fc15e570 0x7f09fc15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.681+0000 7f09fb7fe640 1 -- 172.21.15.50:0/3221392442 >> v2:172.21.15.117:3300/0 conn(0x7f09fc15e570 msgr2=0x7f09fc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.681+0000 7f09fb7fe640 1 --2- 172.21.15.50:0/3221392442 >> v2:172.21.15.117:3300/0 conn(0x7f09fc15e570 0x7f09fc15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.681+0000 7f09fb7fe640 1 -- 172.21.15.50:0/3221392442 >> v1:172.21.15.117:6789/0 conn(0x7f09fc0b0b20 legacy=0x7f09fc0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.681+0000 7f09fb7fe640 1 -- 172.21.15.50:0/3221392442 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc15b240 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.682+0000 7f09fb7fe640 1 --2- 172.21.15.50:0/3221392442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009870 tx=0x7f09ec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4710bc101b4f5a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f09faffd640 1 -- 172.21.15.50:0/3221392442 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec031640 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f09faffd640 1 -- 172.21.15.50:0/3221392442 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec0317a0 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f09faffd640 1 -- 172.21.15.50:0/3221392442 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec031b30 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3221392442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 msgr2=0x7f09fc15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3221392442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009870 tx=0x7f09ec02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3221392442 shutdown_connections 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3221392442 >> v2:172.21.15.117:3300/0 conn(0x7f09fc15e570 0x7f09fc15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3221392442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0ce7c0 0x7f09fc15ba40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3221392442 >> 172.21.15.50:0/3221392442 conn(0x7f09fc06b3e0 msgr2=0x7f09fc06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3221392442 shutdown_connections 2023-08-10T10:47:02.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.683+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3221392442 wait complete. 2023-08-10T10:47:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.685+0000 7f0a01e3d640 1 Processor -- start 2023-08-10T10:47:02.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.685+0000 7f0a01e3d640 1 -- start start 2023-08-10T10:47:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.686+0000 7f0a01e3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b0b20 0x7f09fc0af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.686+0000 7f0a01e3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc0ce7c0 0x7f09fc158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f0a01e3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f0a01e3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc155590 con 0x7f09fc15e570 2023-08-10T10:47:02.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f0a01e3d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc155ae0 con 0x7f09fc0ce7c0 2023-08-10T10:47:02.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f0a01e3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc14d440 con 0x7f09fc0b0b20 2023-08-10T10:47:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46638/0 (socket says 172.21.15.50:46638) 2023-08-10T10:47:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 -- 172.21.15.50:0/3168784737 learned_addr learned my addr 172.21.15.50:0/3168784737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fb7fe640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b0b20 0x7f09fc0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09f3fff640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc0ce7c0 0x7f09fc158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 -- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b0b20 msgr2=0x7f09fc0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b0b20 0x7f09fc0af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 -- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc0ce7c0 msgr2=0x7f09fc158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc0ce7c0 0x7f09fc158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.687+0000 7f09fbfff640 1 -- 172.21.15.50:0/3168784737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0094d0 con 0x7f09fc15e570 2023-08-10T10:47:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f09fbfff640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c760 tx=0x7f09f400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4006da0 con 0x7f09fc15e570 2023-08-10T10:47:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400ce10 con 0x7f09fc15e570 2023-08-10T10:47:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc14d720 con 0x7f09fc15e570 2023-08-10T10:47:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4003c00 con 0x7f09fc15e570 2023-08-10T10:47:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.688+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0af7b0 con 0x7f09fc15e570 2023-08-10T10:47:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.689+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc073810 con 0x7f09fc15e570 2023-08-10T10:47:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.690+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09f400a850 con 0x7f09fc15e570 2023-08-10T10:47:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.691+0000 7f09f8ff9640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 0x7f09dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.691+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09f4089060 con 0x7f09fc15e570 2023-08-10T10:47:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.692+0000 7f09fb7fe640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 0x7f09dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.692+0000 7f09fb7fe640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 0x7f09dc06d110 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f09ec036000 tx=0x7f09ec03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.696+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f09f40bb330 con 0x7f09fc15e570 2023-08-10T10:47:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.891+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09fc0af940 con 0x7f09fc15e570 2023-08-10T10:47:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.892+0000 7f09f8ff9640 1 -- 172.21.15.50:0/3168784737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09f4054100 con 0x7f09fc15e570 2023-08-10T10:47:02.893 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:47:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 msgr2=0x7f09dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 0x7f09dc06d110 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f09ec036000 tx=0x7f09ec03c040 comp rx=0 tx=0).stop 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 msgr2=0x7f09fc1586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c760 tx=0x7f09f400cc20 comp rx=0 tx=0).stop 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 shutdown_connections 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09fc15e570 0x7f09fc1586d0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f09dc06ac50 0x7f09dc06d110 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc0ce7c0 0x7f09fc158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 --2- 172.21.15.50:0/3168784737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b0b20 0x7f09fc0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 >> 172.21.15.50:0/3168784737 conn(0x7f09fc06b3e0 msgr2=0x7f09fc0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 shutdown_connections 2023-08-10T10:47:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:02.895+0000 7f0a01e3d640 1 -- 172.21.15.50:0/3168784737 wait complete. 2023-08-10T10:47:02.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:47:03.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.151+0000 7f28e2b22640 1 Processor -- start 2023-08-10T10:47:03.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.152+0000 7f28e2b22640 1 -- start start 2023-08-10T10:47:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.153+0000 7f28e2b22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28dc0b1b80 0x7f28dc0d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.153+0000 7f28e2b22640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc06a150 con 0x7f28dc0cd170 2023-08-10T10:47:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.153+0000 7f28e2b22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc06a3f0 con 0x7f28dc0b5910 2023-08-10T10:47:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.153+0000 7f28e2b22640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0cdfd0 con 0x7f28dc0b1b80 2023-08-10T10:47:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.154+0000 7f28e1b20640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28dc0cd170 0x7f28dc0cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34788/0 (socket says 172.21.15.50:34788) 2023-08-10T10:47:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.154+0000 7f28e1b20640 1 -- 172.21.15.50:0/1292921973 learned_addr learned my addr 172.21.15.50:0/1292921973 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.154+0000 7f28e131f640 1 --2- 172.21.15.50:0/1292921973 >> v2:172.21.15.117:3300/0 conn(0x7f28dc0b1b80 0x7f28dc0d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.154+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932359328 0 0) 0x7f28dc06a150 con 0x7f28dc0cd170 2023-08-10T10:47:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.154+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c8003520 con 0x7f28dc0cd170 2023-08-10T10:47:03.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222834588 0 0) 0x7f28c8003520 con 0x7f28dc0cd170 2023-08-10T10:47:03.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 >> v2:172.21.15.117:3300/0 conn(0x7f28dc0b1b80 msgr2=0x7f28dc0d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:03.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 --2- 172.21.15.50:0/1292921973 >> v2:172.21.15.117:3300/0 conn(0x7f28dc0b1b80 0x7f28dc0d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 >> v1:172.21.15.117:6789/0 conn(0x7f28dc0b5910 legacy=0x7f28dc0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc06a6d0 con 0x7f28dc0cd170 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f28d80017f0 con 0x7f28dc0cd170 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 >> v1:172.21.15.50:6789/0 conn(0x7f28dc0cd170 legacy=0x7f28dc0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c8003a30 0x7f28c8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 0x7f28c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c80051d0 0x7f28c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c0e0 con 0x7f28c80047c0 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c220 con 0x7f28c8003a30 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.155+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c3e0 con 0x7f28c80051d0 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 0x7f28c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e1b20640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c8003a30 0x7f28c8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 -- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c80051d0 msgr2=0x7f28c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c80051d0 0x7f28c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 -- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c8003a30 msgr2=0x7f28c8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:03.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c8003a30 0x7f28c8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e131f640 1 -- 172.21.15.50:0/1292921973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8003520 con 0x7f28c80047c0 2023-08-10T10:47:03.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.156+0000 7f28e2321640 1 -- 172.21.15.50:0/1292921973 reap_dead start 2023-08-10T10:47:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.157+0000 7f28e131f640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 0x7f28c8004c40 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009ac0 tx=0x7f28c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5da4f4947cd49c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc02c6b0 con 0x7f28c80047c0 2023-08-10T10:47:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc02c810 con 0x7f28c80047c0 2023-08-10T10:47:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e0b1e640 1 -- 172.21.15.50:0/1292921973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc02cba0 con 0x7f28c80047c0 2023-08-10T10:47:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 -- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 msgr2=0x7f28c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 0x7f28c8004c40 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009ac0 tx=0x7f28c80057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 -- 172.21.15.50:0/1292921973 shutdown_connections 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 --2- 172.21.15.50:0/1292921973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80047c0 0x7f28c8004c40 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 -- 172.21.15.50:0/1292921973 >> 172.21.15.50:0/1292921973 conn(0x7f28dc0d2910 msgr2=0x7f28dc0d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 -- 172.21.15.50:0/1292921973 shutdown_connections 2023-08-10T10:47:03.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.158+0000 7f28e2b22640 1 -- 172.21.15.50:0/1292921973 wait complete. 2023-08-10T10:47:03.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.160+0000 7f28e2b22640 1 Processor -- start 2023-08-10T10:47:03.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.160+0000 7f28e2b22640 1 -- start start 2023-08-10T10:47:03.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c80047c0 0x7f28dc1f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0c8080 0x7f28dc0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0cc620 con 0x7f28dc0c84e0 2023-08-10T10:47:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c9b80 con 0x7f28c80047c0 2023-08-10T10:47:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.161+0000 7f28e2b22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c9e60 con 0x7f28dc0c8080 2023-08-10T10:47:03.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46662/0 (socket says 172.21.15.50:46662) 2023-08-10T10:47:03.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 -- 172.21.15.50:0/2536726126 learned_addr learned my addr 172.21.15.50:0/2536726126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e131f640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0c8080 0x7f28dc0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 -- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0c8080 msgr2=0x7f28dc0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0c8080 0x7f28dc0cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 -- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c80047c0 msgr2=0x7f28dc1f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c80047c0 0x7f28dc1f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 -- 172.21.15.50:0/2536726126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0ca140 con 0x7f28dc0c84e0 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.162+0000 7f28e2321640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0d28c0 tx=0x7f28d400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.163+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4005d40 con 0x7f28dc0c84e0 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.163+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400ced0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.163+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4005ea0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.163+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc1f64d0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.163+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc0cc2a0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.164+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc0c99e0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.165+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28d400a850 con 0x7f28dc0c84e0 2023-08-10T10:47:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.166+0000 7f28d27fc640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 0x7f28c006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.166+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28d40884a0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.166+0000 7f28e1b20640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 0x7f28c006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.167+0000 7f28e1b20640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 0x7f28c006d110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28d8007880 tx=0x7f28d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.170+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f28dc0c99e0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.361+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28dc0c99e0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.362+0000 7f28d27fc640 1 -- 172.21.15.50:0/2536726126 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28dc0c99e0 con 0x7f28dc0c84e0 2023-08-10T10:47:03.363 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:47:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 msgr2=0x7f28c006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 0x7f28c006d110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28d8007880 tx=0x7f28d8009040 comp rx=0 tx=0).stop 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 msgr2=0x7f28dc1f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0d28c0 tx=0x7f28d400cb90 comp rx=0 tx=0).stop 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 shutdown_connections 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc0c84e0 0x7f28dc1f48e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0c8080 0x7f28dc0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f28c006ac50 0x7f28c006d110 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 --2- 172.21.15.50:0/2536726126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c80047c0 0x7f28dc1f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 >> 172.21.15.50:0/2536726126 conn(0x7f28dc0d2910 msgr2=0x7f28dc15ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 shutdown_connections 2023-08-10T10:47:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.365+0000 7f28e2b22640 1 -- 172.21.15.50:0/2536726126 wait complete. 2023-08-10T10:47:03.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:47:03.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.617+0000 7fe369de8640 1 Processor -- start 2023-08-10T10:47:03.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.617+0000 7fe369de8640 1 -- start start 2023-08-10T10:47:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.618+0000 7fe369de8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3640ca530 0x7fe3640b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.618+0000 7fe369de8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3640ada90 0x7fe36406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.618+0000 7fe369de8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640adec0 con 0x7fe364159c10 2023-08-10T10:47:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.618+0000 7fe369de8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36406ebb0 con 0x7fe3640ca530 2023-08-10T10:47:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.618+0000 7fe369de8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36406ee90 con 0x7fe3640ada90 2023-08-10T10:47:03.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe3637fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe364159c10 0x7fe3640c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34790/0 (socket says 172.21.15.50:34790) 2023-08-10T10:47:03.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe3637fe640 1 -- 172.21.15.50:0/1061959743 learned_addr learned my addr 172.21.15.50:0/1061959743 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:03.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe362ffd640 1 --2- 172.21.15.50:0/1061959743 >> v2:172.21.15.50:3300/0 conn(0x7fe3640ca530 0x7fe3640b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe363fff640 1 --2- 172.21.15.50:0/1061959743 >> v2:172.21.15.117:3300/0 conn(0x7fe3640ada90 0x7fe36406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918807878 0 0) 0x7fe3640adec0 con 0x7fe364159c10 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.619+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe350003520 con 0x7fe364159c10 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.620+0000 7fe362ffd640 1 -- 172.21.15.50:0/1061959743 >> v2:172.21.15.117:3300/0 conn(0x7fe3640ada90 msgr2=0x7fe36406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.620+0000 7fe362ffd640 1 --2- 172.21.15.50:0/1061959743 >> v2:172.21.15.117:3300/0 conn(0x7fe3640ada90 0x7fe36406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.620+0000 7fe362ffd640 1 -- 172.21.15.50:0/1061959743 >> v1:172.21.15.50:6789/0 conn(0x7fe364159c10 legacy=0x7fe3640c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.620+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1394359329 0 0) 0x7fe350003520 con 0x7fe364159c10 2023-08-10T10:47:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.620+0000 7fe362ffd640 1 -- 172.21.15.50:0/1061959743 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36406f170 con 0x7fe3640ca530 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.621+0000 7fe362ffd640 1 --2- 172.21.15.50:0/1061959743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ca530 0x7fe3640b0cd0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ce5c0 tx=0x7fe34c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0ab1b04a061281 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.621+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540019f0 con 0x7fe3640ca530 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.621+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c02e050 con 0x7fe3640ca530 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.621+0000 7fe3627fc640 1 -- 172.21.15.50:0/1061959743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c030710 con 0x7fe3640ca530 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 -- 172.21.15.50:0/1061959743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ca530 msgr2=0x7fe3640b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 --2- 172.21.15.50:0/1061959743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ca530 0x7fe3640b0cd0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ce5c0 tx=0x7fe34c02b710 comp rx=0 tx=0).stop 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 -- 172.21.15.50:0/1061959743 shutdown_connections 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 --2- 172.21.15.50:0/1061959743 >> v2:172.21.15.117:3300/0 conn(0x7fe3640ada90 0x7fe36406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 --2- 172.21.15.50:0/1061959743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ca530 0x7fe3640b0cd0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 -- 172.21.15.50:0/1061959743 >> 172.21.15.50:0/1061959743 conn(0x7fe3640b01b0 msgr2=0x7fe3640b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 -- 172.21.15.50:0/1061959743 shutdown_connections 2023-08-10T10:47:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.622+0000 7fe369de8640 1 -- 172.21.15.50:0/1061959743 wait complete. 2023-08-10T10:47:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.624+0000 7fe369de8640 1 Processor -- start 2023-08-10T10:47:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.624+0000 7fe369de8640 1 -- start start 2023-08-10T10:47:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3640ca530 0x7fe3640c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 0x7fe36414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c3b40 con 0x7fe3640ada90 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c2310 con 0x7fe364159c10 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe369de8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c2560 con 0x7fe3640ca530 2023-08-10T10:47:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe3637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe3637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46686/0 (socket says 172.21.15.50:46686) 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.625+0000 7fe3637fe640 1 -- 172.21.15.50:0/2844221382 learned_addr learned my addr 172.21.15.50:0/2844221382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe363fff640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 0x7fe36414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 -- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3640ca530 msgr2=0x7fe3640c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3640ca530 0x7fe3640c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 -- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 msgr2=0x7fe36414c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 0x7fe36414c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 -- 172.21.15.50:0/2844221382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c009400 con 0x7fe3640ada90 2023-08-10T10:47:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe363fff640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 0x7fe36414c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.626+0000 7fe3637fe640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe35400cc70 tx=0x7fe35400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.627+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400ce80 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.627+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354012400 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.627+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354012790 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.627+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640c2840 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.627+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3640c2e00 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.628+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3640612b0 con 0x7fe3640ada90 2023-08-10T10:47:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.629+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe354007070 con 0x7fe3640ada90 2023-08-10T10:47:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.630+0000 7fe35bfff640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 0x7fe34406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.630+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe354089680 con 0x7fe3640ada90 2023-08-10T10:47:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.630+0000 7fe362ffd640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 0x7fe34406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.631+0000 7fe362ffd640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 0x7fe34406d110 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe34c034000 tx=0x7fe34c02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.634+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe354054720 con 0x7fe3640ada90 2023-08-10T10:47:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.826+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe36406a6e0 con 0x7fe3640ada90 2023-08-10T10:47:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.827+0000 7fe35bfff640 1 -- 172.21.15.50:0/2844221382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe354057d40 con 0x7fe3640ada90 2023-08-10T10:47:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:47:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 msgr2=0x7fe34406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 0x7fe34406d110 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe34c034000 tx=0x7fe34c02f000 comp rx=0 tx=0).stop 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 msgr2=0x7fe3640c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe35400cc70 tx=0x7fe35400a430 comp rx=0 tx=0).stop 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 shutdown_connections 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe34406ac50 0x7fe34406d110 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364159c10 0x7fe36414c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3640ca530 0x7fe3640c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 --2- 172.21.15.50:0/2844221382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3640ada90 0x7fe3640c3600 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 >> 172.21.15.50:0/2844221382 conn(0x7fe3640b01b0 msgr2=0x7fe3640c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 shutdown_connections 2023-08-10T10:47:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:03.830+0000 7fe369de8640 1 -- 172.21.15.50:0/2844221382 wait complete. 2023-08-10T10:47:03.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:47:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.072+0000 7f2e0dc93640 1 Processor -- start 2023-08-10T10:47:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.072+0000 7f2e0dc93640 1 -- start start 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0dc93640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e080b1370 0x7f2e080ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0dc93640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e080b2280 con 0x7f2e080696a0 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0dc93640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e080b19e0 con 0x7f2e0815ad00 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0dc93640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e080b1cc0 con 0x7f2e080b1370 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0cc91640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e080696a0 0x7f2e080cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34802/0 (socket says 172.21.15.50:34802) 2023-08-10T10:47:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0cc91640 1 -- 172.21.15.50:0/1395325799 learned_addr learned my addr 172.21.15.50:0/1395325799 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.074+0000 7f2e0d492640 1 --2- 172.21.15.50:0/1395325799 >> v2:172.21.15.50:3300/0 conn(0x7f2e080b1370 0x7f2e080ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.075+0000 7f2dff7fe640 1 -- 172.21.15.50:0/1395325799 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406379714 0 0) 0x7f2e080b2280 con 0x7f2e080696a0 2023-08-10T10:47:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.075+0000 7f2e0d492640 1 -- 172.21.15.50:0/1395325799 >> v1:172.21.15.117:6789/0 conn(0x7f2e0815ad00 legacy=0x7f2e08069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.075+0000 7f2e0d492640 1 -- 172.21.15.50:0/1395325799 >> v1:172.21.15.50:6789/0 conn(0x7f2e080696a0 legacy=0x7f2e080cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.075+0000 7f2e0d492640 1 -- 172.21.15.50:0/1395325799 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080b1fa0 con 0x7f2e080b1370 2023-08-10T10:47:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.076+0000 7f2e0d492640 1 --2- 172.21.15.50:0/1395325799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e080b1370 0x7f2e080ccfb0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009d90 tx=0x7f2e0002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ca5fb313798cd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.076+0000 7f2dff7fe640 1 -- 172.21.15.50:0/1395325799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0002ccf0 con 0x7f2e080b1370 2023-08-10T10:47:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.076+0000 7f2dff7fe640 1 -- 172.21.15.50:0/1395325799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0002ce50 con 0x7f2e080b1370 2023-08-10T10:47:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.076+0000 7f2dff7fe640 1 -- 172.21.15.50:0/1395325799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00034660 con 0x7f2e080b1370 2023-08-10T10:47:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1395325799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e080b1370 msgr2=0x7f2e080ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1395325799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e080b1370 0x7f2e080ccfb0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009d90 tx=0x7f2e0002bf40 comp rx=0 tx=0).stop 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1395325799 shutdown_connections 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1395325799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e080b1370 0x7f2e080ccfb0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1395325799 >> 172.21.15.50:0/1395325799 conn(0x7f2e080cafa0 msgr2=0x7f2e080cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1395325799 shutdown_connections 2023-08-10T10:47:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.077+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1395325799 wait complete. 2023-08-10T10:47:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.079+0000 7f2e0dc93640 1 Processor -- start 2023-08-10T10:47:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.079+0000 7f2e0dc93640 1 -- start start 2023-08-10T10:47:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e080696a0 0x7f2e080c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 0x7f2e081f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080c7d30 con 0x7f2e0815ad00 2023-08-10T10:47:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080c70f0 con 0x7f2e080b1370 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0dc93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080c7390 con 0x7f2e080696a0 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0d492640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0d492640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46714/0 (socket says 172.21.15.50:46714) 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0d492640 1 -- 172.21.15.50:0/1355491503 learned_addr learned my addr 172.21.15.50:0/1355491503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.080+0000 7f2e0cc91640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e080696a0 0x7f2e080c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 -- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e080696a0 msgr2=0x7f2e080c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e080696a0 0x7f2e080c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2dfffff640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 0x7f2e081f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 -- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 msgr2=0x7f2e081f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 0x7f2e081f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 -- 172.21.15.50:0/1355491503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009a70 con 0x7f2e0815ad00 2023-08-10T10:47:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2dfffff640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 0x7f2e081f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0d492640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2e00037040 tx=0x7f2e00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0003d600 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0003d760 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0003daf0 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.081+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e080c7670 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.082+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e080ca230 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.083+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e080ca3c0 con 0x7f2e0815ad00 2023-08-10T10:47:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.083+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e0003b040 con 0x7f2e0815ad00 2023-08-10T10:47:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.084+0000 7f2dfd7fa640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 0x7f2df406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.085+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e000abbc0 con 0x7f2e0815ad00 2023-08-10T10:47:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.085+0000 7f2e0cc91640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 0x7f2df406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.086+0000 7f2e0cc91640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 0x7f2df406d110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007fd0 tx=0x7f2e04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.089+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e00076c60 con 0x7f2e0815ad00 2023-08-10T10:47:04.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.295+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e080c7e70 con 0x7f2e0815ad00 2023-08-10T10:47:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.296+0000 7f2dfd7fa640 1 -- 172.21.15.50:0/1355491503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v146) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e080c7e70 con 0x7f2e0815ad00 2023-08-10T10:47:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:47:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 msgr2=0x7f2df406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 0x7f2df406d110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007fd0 tx=0x7f2e04009040 comp rx=0 tx=0).stop 2023-08-10T10:47:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 msgr2=0x7f2e08152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2e00037040 tx=0x7f2e00004a40 comp rx=0 tx=0).stop 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 shutdown_connections 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e0815ad00 0x7f2e08152550 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2df406ac50 0x7f2df406d110 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e080b1370 0x7f2e081f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 --2- 172.21.15.50:0/1355491503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e080696a0 0x7f2e080c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.298+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 >> 172.21.15.50:0/1355491503 conn(0x7f2e080cafa0 msgr2=0x7f2e080ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.299+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 shutdown_connections 2023-08-10T10:47:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.299+0000 7f2e0dc93640 1 -- 172.21.15.50:0/1355491503 wait complete. 2023-08-10T10:47:04.318 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:47:04.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:04.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:47:04.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:47:04.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:04.511 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:47:04.552 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:04.552 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:04.606 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:04.606 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:04.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.886+0000 7f1113045640 1 Processor -- start 2023-08-10T10:47:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.886+0000 7f1113045640 1 -- start start 2023-08-10T10:47:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1113045640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f110c153850 0x7f110c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1113045640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c15d010 con 0x7f110c0cfd40 2023-08-10T10:47:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1113045640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c15d290 con 0x7f110c153c30 2023-08-10T10:47:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1113045640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c15d570 con 0x7f110c153850 2023-08-10T10:47:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1112043640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f110c153850 0x7f110c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1112844640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f110c0cfd40 0x7f110c0ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43010/0 (socket says 172.21.15.50:43010) 2023-08-10T10:47:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.888+0000 7f1112844640 1 -- 172.21.15.50:0/1117297391 learned_addr learned my addr 172.21.15.50:0/1117297391 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.889+0000 7f1112043640 1 -- 172.21.15.50:0/1117297391 >> v1:172.21.15.117:6789/0 conn(0x7f110c153c30 legacy=0x7f110c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.889+0000 7f1112043640 1 -- 172.21.15.50:0/1117297391 >> v1:172.21.15.50:6789/0 conn(0x7f110c0cfd40 legacy=0x7f110c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.889+0000 7f1112043640 1 -- 172.21.15.50:0/1117297391 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c15d850 con 0x7f110c153850 2023-08-10T10:47:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.889+0000 7f1111041640 1 -- 172.21.15.50:0/1117297391 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313033016 0 0) 0x7f110c15d010 con 0x7f110c0cfd40 2023-08-10T10:47:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.890+0000 7f1112043640 1 --2- 172.21.15.50:0/1117297391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153850 0x7f110c0b1690 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f1108009d90 tx=0x7f110802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd972baae90e9437 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.890+0000 7f1111041640 1 -- 172.21.15.50:0/1117297391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110802cc60 con 0x7f110c153850 2023-08-10T10:47:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.890+0000 7f1111041640 1 -- 172.21.15.50:0/1117297391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110802cdc0 con 0x7f110c153850 2023-08-10T10:47:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.890+0000 7f1111041640 1 -- 172.21.15.50:0/1117297391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108034660 con 0x7f110c153850 2023-08-10T10:47:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 -- 172.21.15.50:0/1117297391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153850 msgr2=0x7f110c0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 --2- 172.21.15.50:0/1117297391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153850 0x7f110c0b1690 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f1108009d90 tx=0x7f110802beb0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 -- 172.21.15.50:0/1117297391 shutdown_connections 2023-08-10T10:47:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 --2- 172.21.15.50:0/1117297391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153850 0x7f110c0b1690 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 -- 172.21.15.50:0/1117297391 >> 172.21.15.50:0/1117297391 conn(0x7f110c069880 msgr2=0x7f110c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 -- 172.21.15.50:0/1117297391 shutdown_connections 2023-08-10T10:47:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.891+0000 7f1113045640 1 -- 172.21.15.50:0/1117297391 wait complete. 2023-08-10T10:47:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.893+0000 7f1113045640 1 Processor -- start 2023-08-10T10:47:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.893+0000 7f1113045640 1 -- start start 2023-08-10T10:47:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 0x7f110c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 0x7f110c1e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c14d3d0 con 0x7f110c153c30 2023-08-10T10:47:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1e7fc0 con 0x7f110c0cfd40 2023-08-10T10:47:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.894+0000 7f1113045640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1e8580 con 0x7f110c153850 2023-08-10T10:47:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45226/0 (socket says 172.21.15.50:45226) 2023-08-10T10:47:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 -- 172.21.15.50:0/3346148458 learned_addr learned my addr 172.21.15.50:0/3346148458 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112043640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 0x7f110c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1111842640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 0x7f110c1e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 -- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 msgr2=0x7f110c1e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 0x7f110c1e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 -- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 msgr2=0x7f110c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 0x7f110c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 -- 172.21.15.50:0/3346148458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009a70 con 0x7f110c153c30 2023-08-10T10:47:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1111842640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 0x7f110c1e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112043640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 0x7f110c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.895+0000 7f1112844640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f110400c410 tx=0x7f110400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.896+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104005d30 con 0x7f110c153c30 2023-08-10T10:47:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.896+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104005e90 con 0x7f110c153c30 2023-08-10T10:47:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.896+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040072f0 con 0x7f110c153c30 2023-08-10T10:47:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.896+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c1e7000 con 0x7f110c153c30 2023-08-10T10:47:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.896+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c1e8210 con 0x7f110c153c30 2023-08-10T10:47:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.897+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c1e8730 con 0x7f110c153c30 2023-08-10T10:47:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.898+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1104007450 con 0x7f110c153c30 2023-08-10T10:47:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.899+0000 7f1102ffd640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 0x7f10f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.899+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1104088a60 con 0x7f110c153c30 2023-08-10T10:47:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.900+0000 7f1112043640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 0x7f10f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.900+0000 7f1112043640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 0x7f10f006d110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1108036000 tx=0x7f1108030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:04.904+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f110c1e8730 con 0x7f110c153c30 2023-08-10T10:47:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.095+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f110c1e86f0 con 0x7f110c153c30 2023-08-10T10:47:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.097+0000 7f1102ffd640 1 -- 172.21.15.50:0/3346148458 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f1104017090 con 0x7f110c153c30 2023-08-10T10:47:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:05.099 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":146,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:46:56.557074+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 msgr2=0x7f10f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 0x7f10f006d110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1108036000 tx=0x7f1108030000 comp rx=0 tx=0).stop 2023-08-10T10:47:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 msgr2=0x7f110c1e8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f110400c410 tx=0x7f110400c8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 shutdown_connections 2023-08-10T10:47:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c153c30 0x7f110c1e8f50 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f110c153850 0x7f110c1e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f10f006ac50 0x7f10f006d110 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 --2- 172.21.15.50:0/3346148458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f110c0cfd40 0x7f110c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 >> 172.21.15.50:0/3346148458 conn(0x7f110c069880 msgr2=0x7f110c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 shutdown_connections 2023-08-10T10:47:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.100+0000 7f1113045640 1 -- 172.21.15.50:0/3346148458 wait complete. 2023-08-10T10:47:05.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:46:18.537056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:46:19.150540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:05.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.352+0000 7f5920e21640 1 Processor -- start 2023-08-10T10:47:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.352+0000 7f5920e21640 1 -- start start 2023-08-10T10:47:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.354+0000 7f5920e21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 0x7f591c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.354+0000 7f5920e21640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c0ad6e0 con 0x7f591c160f70 2023-08-10T10:47:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.354+0000 7f5920e21640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c0acb10 con 0x7f591c0b0440 2023-08-10T10:47:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.354+0000 7f5920e21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0b08f0 con 0x7f591c161350 2023-08-10T10:47:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.355+0000 7f591b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f591c160f70 0x7f591c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43016/0 (socket says 172.21.15.50:43016) 2023-08-10T10:47:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.355+0000 7f591b7fe640 1 -- 172.21.15.50:0/3616773029 learned_addr learned my addr 172.21.15.50:0/3616773029 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.355+0000 7f591affd640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 0x7f591c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.355+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077143540 0 0) 0x7f591c0ad6e0 con 0x7f591c160f70 2023-08-10T10:47:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.355+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5904003520 con 0x7f591c160f70 2023-08-10T10:47:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950266007 0 0) 0x7f5904003520 con 0x7f591c160f70 2023-08-10T10:47:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 msgr2=0x7f591c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 0x7f591c0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 >> v1:172.21.15.117:6789/0 conn(0x7f591c0b0440 legacy=0x7f591c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c15dee0 con 0x7f591c160f70 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f590c001670 con 0x7f591c160f70 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 >> v1:172.21.15.50:6789/0 conn(0x7f591c160f70 legacy=0x7f591c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904003a10 0x7f5904003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59040047c0 0x7f5904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 0x7f5904005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0b08f0 con 0x7f5904003a10 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590400ba80 con 0x7f59040047c0 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.356+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590400bc40 con 0x7f591c161350 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904003a10 0x7f5904003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 -- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 msgr2=0x7f5904005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f591c161350 0x7f5904005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 -- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59040047c0 msgr2=0x7f5904004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59040047c0 0x7f5904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.357+0000 7f591b7fe640 1 -- 172.21.15.50:0/3616773029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904003520 con 0x7f5904003a10 2023-08-10T10:47:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.358+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904003a10 0x7f5904003e30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c240 tx=0x7f59040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b60e69b8006a65f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c005ad0 con 0x7f5904003a10 2023-08-10T10:47:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c005c30 con 0x7f5904003a10 2023-08-10T10:47:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f591a7fc640 1 -- 172.21.15.50:0/3616773029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c02c8b0 con 0x7f5904003a10 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 -- 172.21.15.50:0/3616773029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904003a10 msgr2=0x7f5904003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 --2- 172.21.15.50:0/3616773029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904003a10 0x7f5904003e30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c240 tx=0x7f59040057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f591bfff640 1 -- 172.21.15.50:0/3616773029 reap_dead start 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 -- 172.21.15.50:0/3616773029 shutdown_connections 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 -- 172.21.15.50:0/3616773029 >> 172.21.15.50:0/3616773029 conn(0x7f591c069cd0 msgr2=0x7f591c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 -- 172.21.15.50:0/3616773029 shutdown_connections 2023-08-10T10:47:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.359+0000 7f5920e21640 1 -- 172.21.15.50:0/3616773029 wait complete. 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.361+0000 7f5920e21640 1 Processor -- start 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.361+0000 7f5920e21640 1 -- start start 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5904003a10 0x7f591c0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f591c0b36a0 0x7f591c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0b1b80 con 0x7f591c0b11c0 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0af4e0 con 0x7f591c0b36a0 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f5920e21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0ae960 con 0x7f5904003a10 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.362+0000 7f591bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45244/0 (socket says 172.21.15.50:45244) 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 -- 172.21.15.50:0/3472556844 learned_addr learned my addr 172.21.15.50:0/3472556844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591affd640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f591c0b36a0 0x7f591c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5904003a10 0x7f591c0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 -- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5904003a10 msgr2=0x7f591c0c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5904003a10 0x7f591c0c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 -- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f591c0b36a0 msgr2=0x7f591c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f591c0b36a0 0x7f591c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 -- 172.21.15.50:0/3472556844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0aec40 con 0x7f591c0b11c0 2023-08-10T10:47:05.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.363+0000 7f591bfff640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f591c0c93c0 tx=0x7f591400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.364+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914005d40 con 0x7f591c0b11c0 2023-08-10T10:47:05.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.364+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591400a610 con 0x7f591c0b11c0 2023-08-10T10:47:05.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.364+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400a9c0 con 0x7f591c0b11c0 2023-08-10T10:47:05.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.364+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c0aef20 con 0x7f591c0b11c0 2023-08-10T10:47:05.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.364+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c0ae580 con 0x7f591c0b11c0 2023-08-10T10:47:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.365+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c066e30 con 0x7f591c0b11c0 2023-08-10T10:47:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.366+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f591400ab20 con 0x7f591c0b11c0 2023-08-10T10:47:05.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.367+0000 7f5903fff640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 0x7f590806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.367+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5914088440 con 0x7f591c0b11c0 2023-08-10T10:47:05.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.367+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 0x7f590806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.368+0000 7f591b7fe640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 0x7f590806d110 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f590c034000 tx=0x7f590c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.371+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f59140534f0 con 0x7f591c0b11c0 2023-08-10T10:47:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.565+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f591c0cbaf0 con 0x7f591c0b11c0 2023-08-10T10:47:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.566+0000 7f5903fff640 1 -- 172.21.15.50:0/3472556844 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5914056b10 con 0x7f591c0b11c0 2023-08-10T10:47:05.567 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:47:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 msgr2=0x7f590806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 0x7f590806d110 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f590c034000 tx=0x7f590c009030 comp rx=0 tx=0).stop 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 msgr2=0x7f591c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f591c0c93c0 tx=0x7f591400cb90 comp rx=0 tx=0).stop 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 shutdown_connections 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f591c0b11c0 0x7f591c0b1640 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f590806ac50 0x7f590806d110 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f591c0b36a0 0x7f591c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 --2- 172.21.15.50:0/3472556844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5904003a10 0x7f591c0c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 >> 172.21.15.50:0/3472556844 conn(0x7f591c069cd0 msgr2=0x7f591c156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 shutdown_connections 2023-08-10T10:47:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.569+0000 7f5920e21640 1 -- 172.21.15.50:0/3472556844 wait complete. 2023-08-10T10:47:05.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:47:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.811+0000 7f884eb57640 1 Processor -- start 2023-08-10T10:47:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.811+0000 7f884eb57640 1 -- start start 2023-08-10T10:47:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.813+0000 7f884eb57640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.813+0000 7f884eb57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.813+0000 7f884eb57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8848160a40 con 0x7f884815cf70 2023-08-10T10:47:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.813+0000 7f884eb57640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480b4bb0 con 0x7f884815cb90 2023-08-10T10:47:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.813+0000 7f884eb57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480b4e90 con 0x7f88481615e0 2023-08-10T10:47:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.814+0000 7f884c8f3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.814+0000 7f884d0f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.814+0000 7f884c8f3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35522/0 (socket says 172.21.15.50:35522) 2023-08-10T10:47:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.814+0000 7f884c8f3640 1 -- 172.21.15.50:0/3946984312 learned_addr learned my addr 172.21.15.50:0/3946984312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f883f7fe640 1 -- 172.21.15.50:0/3946984312 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143274918 0 0) 0x7f8848160a40 con 0x7f884815cf70 2023-08-10T10:47:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f884d0f4640 1 -- 172.21.15.50:0/3946984312 >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 msgr2=0x7f88480b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f884d0f4640 1 --2- 172.21.15.50:0/3946984312 >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f884d0f4640 1 -- 172.21.15.50:0/3946984312 >> v1:172.21.15.117:6789/0 conn(0x7f884815cf70 legacy=0x7f8848160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f884d0f4640 1 -- 172.21.15.50:0/3946984312 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480b5170 con 0x7f88481615e0 2023-08-10T10:47:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.815+0000 7f884c8f3640 1 --2- 172.21.15.50:0/3946984312 >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:47:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.817+0000 7f884d0f4640 1 --2- 172.21.15.50:0/3946984312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884806fcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88400097a0 tx=0x7f884002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1660555d4387de22 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f883f7fe640 1 -- 172.21.15.50:0/3946984312 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884002d040 con 0x7f88481615e0 2023-08-10T10:47:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f883f7fe640 1 -- 172.21.15.50:0/3946984312 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840031810 con 0x7f88481615e0 2023-08-10T10:47:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f883f7fe640 1 -- 172.21.15.50:0/3946984312 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840031ba0 con 0x7f88481615e0 2023-08-10T10:47:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 -- 172.21.15.50:0/3946984312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 msgr2=0x7f884806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 --2- 172.21.15.50:0/3946984312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884806fcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88400097a0 tx=0x7f884002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 -- 172.21.15.50:0/3946984312 shutdown_connections 2023-08-10T10:47:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 --2- 172.21.15.50:0/3946984312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884806fcc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 --2- 172.21.15.50:0/3946984312 >> v2:172.21.15.117:3300/0 conn(0x7f884815cb90 0x7f88480b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.818+0000 7f884eb57640 1 -- 172.21.15.50:0/3946984312 >> 172.21.15.50:0/3946984312 conn(0x7f88480cf640 msgr2=0x7f88480cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.819+0000 7f884eb57640 1 -- 172.21.15.50:0/3946984312 shutdown_connections 2023-08-10T10:47:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.819+0000 7f884eb57640 1 -- 172.21.15.50:0/3946984312 wait complete. 2023-08-10T10:47:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.820+0000 7f884eb57640 1 Processor -- start 2023-08-10T10:47:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.821+0000 7f884eb57640 1 -- start start 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.821+0000 7f884eb57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884815cb90 0x7f884814dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.821+0000 7f884eb57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884eb57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884eb57640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481f2610 con 0x7f884815cf70 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884eb57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848151100 con 0x7f884815cb90 2023-08-10T10:47:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884eb57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88481f2250 con 0x7f88481615e0 2023-08-10T10:47:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45260/0 (socket says 172.21.15.50:45260) 2023-08-10T10:47:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 -- 172.21.15.50:0/4042299624 learned_addr learned my addr 172.21.15.50:0/4042299624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884c8f3640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884815cb90 0x7f884814dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f884d0f4640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 -- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 msgr2=0x7f884814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884814cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 -- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884815cb90 msgr2=0x7f884814dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884815cb90 0x7f884814dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.822+0000 7f883ffff640 1 -- 172.21.15.50:0/4042299624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009b30 con 0x7f884815cf70 2023-08-10T10:47:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f883ffff640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f883800c4e0 tx=0x7f883800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838005480 con 0x7f884815cf70 2023-08-10T10:47:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88380035f0 con 0x7f884815cf70 2023-08-10T10:47:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380039c0 con 0x7f884815cf70 2023-08-10T10:47:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8840009400 con 0x7f884815cf70 2023-08-10T10:47:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.823+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884814e7a0 con 0x7f884815cf70 2023-08-10T10:47:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.824+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88480612b0 con 0x7f884815cf70 2023-08-10T10:47:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.825+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8838003b20 con 0x7f884815cf70 2023-08-10T10:47:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.826+0000 7f883d7fa640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 0x7f883406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.826+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88380889e0 con 0x7f884815cf70 2023-08-10T10:47:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.827+0000 7f884c8f3640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 0x7f883406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.827+0000 7f884c8f3640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 0x7f883406d110 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f884815e270 tx=0x7f884400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:05.831+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8838053aa0 con 0x7f884815cf70 2023-08-10T10:47:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.022+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8848154650 con 0x7f884815cf70 2023-08-10T10:47:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.023+0000 7f883d7fa640 1 -- 172.21.15.50:0/4042299624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8838017020 con 0x7f884815cf70 2023-08-10T10:47:06.024 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:47:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.025+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 msgr2=0x7f883406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.025+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 0x7f883406d110 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f884815e270 tx=0x7f884400b040 comp rx=0 tx=0).stop 2023-08-10T10:47:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.025+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 msgr2=0x7f8848153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.025+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f883800c4e0 tx=0x7f883800c9a0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 shutdown_connections 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88481615e0 0x7f884814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f884815cf70 0x7f8848153f70 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f883406ac50 0x7f883406d110 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 --2- 172.21.15.50:0/4042299624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884815cb90 0x7f884814dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 >> 172.21.15.50:0/4042299624 conn(0x7f88480cf640 msgr2=0x7f88480c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:06.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 shutdown_connections 2023-08-10T10:47:06.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.026+0000 7f884eb57640 1 -- 172.21.15.50:0/4042299624 wait complete. 2023-08-10T10:47:06.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:47:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.275+0000 7f4072534640 1 Processor -- start 2023-08-10T10:47:06.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.275+0000 7f4072534640 1 -- start start 2023-08-10T10:47:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4072534640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f406c15ff90 0x7f406c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4072534640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c160370 con 0x7f406c0cd960 2023-08-10T10:47:06.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4072534640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0d0d90 con 0x7f406c0d28b0 2023-08-10T10:47:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4072534640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0d0b90 con 0x7f406c15ff90 2023-08-10T10:47:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4070d31640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f406c0cd960 0x7f406c0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43032/0 (socket says 172.21.15.50:43032) 2023-08-10T10:47:06.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.277+0000 7f4070d31640 1 -- 172.21.15.50:0/2309720560 learned_addr learned my addr 172.21.15.50:0/2309720560 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:06.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4071532640 1 --2- 172.21.15.50:0/2309720560 >> v2:172.21.15.117:3300/0 conn(0x7f406c15ff90 0x7f406c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847445830 0 0) 0x7f405c001490 con 0x7f406c0cd960 2023-08-10T10:47:06.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4058003520 con 0x7f406c0cd960 2023-08-10T10:47:06.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384964260 0 0) 0x7f4058003520 con 0x7f406c0cd960 2023-08-10T10:47:06.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 >> v2:172.21.15.117:3300/0 conn(0x7f406c15ff90 msgr2=0x7f406c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 --2- 172.21.15.50:0/2309720560 >> v2:172.21.15.117:3300/0 conn(0x7f406c15ff90 0x7f406c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 >> v1:172.21.15.117:6789/0 conn(0x7f406c0d28b0 legacy=0x7f406c0d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0d1070 con 0x7f406c0cd960 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.278+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f405c001b80 con 0x7f406c0cd960 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 >> v1:172.21.15.50:6789/0 conn(0x7f406c0cd960 legacy=0x7f406c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580039e0 0x7f4058003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 0x7f4058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4058005180 0x7f405800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0d0b90 con 0x7f40580047c0 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405800c0b0 con 0x7f40580039e0 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405800c270 con 0x7f4058005180 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 0x7f4058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4071532640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580039e0 0x7f4058003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 -- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4058005180 msgr2=0x7f405800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4058005180 0x7f405800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 -- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580039e0 msgr2=0x7f4058003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580039e0 0x7f4058003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4070d31640 1 -- 172.21.15.50:0/2309720560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058003520 con 0x7f40580047c0 2023-08-10T10:47:06.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.279+0000 7f4071532640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580039e0 0x7f4058003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:06.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.280+0000 7f4071d33640 1 -- 172.21.15.50:0/2309720560 reap_dead start 2023-08-10T10:47:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4070d31640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 0x7f4058004c40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f405c00a830 tx=0x7f40580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ae5db34c5cb2cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c034630 con 0x7f40580047c0 2023-08-10T10:47:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c02f070 con 0x7f40580047c0 2023-08-10T10:47:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4063fff640 1 -- 172.21.15.50:0/2309720560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c034a30 con 0x7f40580047c0 2023-08-10T10:47:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4072534640 1 -- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 msgr2=0x7f4058004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.281+0000 7f4072534640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 0x7f4058004c40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f405c00a830 tx=0x7f40580057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.282+0000 7f4072534640 1 -- 172.21.15.50:0/2309720560 shutdown_connections 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.282+0000 7f4072534640 1 --2- 172.21.15.50:0/2309720560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40580047c0 0x7f4058004c40 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.282+0000 7f4072534640 1 -- 172.21.15.50:0/2309720560 >> 172.21.15.50:0/2309720560 conn(0x7f406c069ac0 msgr2=0x7f406c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.282+0000 7f4072534640 1 -- 172.21.15.50:0/2309720560 shutdown_connections 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.282+0000 7f4072534640 1 -- 172.21.15.50:0/2309720560 wait complete. 2023-08-10T10:47:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.284+0000 7f4072534640 1 Processor -- start 2023-08-10T10:47:06.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.284+0000 7f4072534640 1 -- start start 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 0x7f406c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f406c0cc140 0x7f406c0aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0cc5f0 con 0x7f406c15ea20 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1e69f0 con 0x7f40580047c0 2023-08-10T10:47:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4072534640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1e6cd0 con 0x7f406c0cc140 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4070d31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4070d31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45272/0 (socket says 172.21.15.50:45272) 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.285+0000 7f4070d31640 1 -- 172.21.15.50:0/1401182848 learned_addr learned my addr 172.21.15.50:0/1401182848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4071532640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 0x7f406c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4071d33640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f406c0cc140 0x7f406c0aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 -- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f406c0cc140 msgr2=0x7f406c0aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f406c0cc140 0x7f406c0aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 -- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 msgr2=0x7f406c15e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 0x7f406c15e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 -- 172.21.15.50:0/1401182848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c1e6fb0 con 0x7f406c15ea20 2023-08-10T10:47:06.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4071532640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 0x7f406c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:06.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.286+0000 7f4070d31640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f405c02cb70 tx=0x7f405c001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.287+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c004d60 con 0x7f406c15ea20 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.287+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c034430 con 0x7f406c15ea20 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.287+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0347a0 con 0x7f406c15ea20 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.287+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c1e7290 con 0x7f406c15ea20 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.287+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c15e6d0 con 0x7f406c15ea20 2023-08-10T10:47:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.288+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c066e30 con 0x7f406c15ea20 2023-08-10T10:47:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.289+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f405c031030 con 0x7f406c15ea20 2023-08-10T10:47:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.290+0000 7f4061ffb640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 0x7f405006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.290+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f405c0ab3c0 con 0x7f406c15ea20 2023-08-10T10:47:06.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.290+0000 7f4071532640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 0x7f405006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.291+0000 7f4071532640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 0x7f405006d140 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f406c0c5e90 tx=0x7f4068008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.294+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f405c076460 con 0x7f406c15ea20 2023-08-10T10:47:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.486+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f406c160370 con 0x7f406c15ea20 2023-08-10T10:47:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.486+0000 7f4061ffb640 1 -- 172.21.15.50:0/1401182848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7f406c160370 con 0x7f406c15ea20 2023-08-10T10:47:06.487 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:47:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 msgr2=0x7f405006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 0x7f405006d140 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f406c0c5e90 tx=0x7f4068008040 comp rx=0 tx=0).stop 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 msgr2=0x7f406c0cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f405c02cb70 tx=0x7f405c001f10 comp rx=0 tx=0).stop 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 shutdown_connections 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f406c0cc140 0x7f406c0aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f406c15ea20 0x7f406c0cbc00 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f405006ac80 0x7f405006d140 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 --2- 172.21.15.50:0/1401182848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40580047c0 0x7f406c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.489+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 >> 172.21.15.50:0/1401182848 conn(0x7f406c069ac0 msgr2=0x7f406c0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.490+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 shutdown_connections 2023-08-10T10:47:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.490+0000 7f4072534640 1 -- 172.21.15.50:0/1401182848 wait complete. 2023-08-10T10:47:06.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:47:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.737+0000 7f0cba08a640 1 Processor -- start 2023-08-10T10:47:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.737+0000 7f0cba08a640 1 -- start start 2023-08-10T10:47:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0cb4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cba08a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0cb415e4d0 0x7f0cb415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cba08a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb406a040 con 0x7f0cb41583c0 2023-08-10T10:47:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cba08a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb415aee0 con 0x7f0cb415e4d0 2023-08-10T10:47:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cba08a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b2100 con 0x7f0cb40696a0 2023-08-10T10:47:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cb9088640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cb41583c0 0x7f0cb40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43048/0 (socket says 172.21.15.50:43048) 2023-08-10T10:47:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cb9088640 1 -- 172.21.15.50:0/4203511816 learned_addr learned my addr 172.21.15.50:0/4203511816 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:06.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0cb4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.739+0000 7f0cb9889640 1 --2- 172.21.15.50:0/4203511816 >> v2:172.21.15.117:3300/0 conn(0x7f0cb415e4d0 0x7f0cb415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414753658 0 0) 0x7f0cb406a040 con 0x7f0cb41583c0 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca0003520 con 0x7f0cb41583c0 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3806302914 0 0) 0x7f0ca0003520 con 0x7f0cb41583c0 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 msgr2=0x7f0cb4069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0cb4069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 >> v2:172.21.15.117:3300/0 conn(0x7f0cb415e4d0 msgr2=0x7f0cb415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 --2- 172.21.15.50:0/4203511816 >> v2:172.21.15.117:3300/0 conn(0x7f0cb415e4d0 0x7f0cb415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb415b1a0 con 0x7f0cb41583c0 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0cb0001670 con 0x7f0cb41583c0 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 >> v1:172.21.15.50:6789/0 conn(0x7f0cb41583c0 legacy=0x7f0cb40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415aee0 con 0x7f0ca00047c0 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b2100 con 0x7f0ca00039e0 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca000b980 con 0x7f0cb40696a0 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.740+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb9889640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb8887640 1 -- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 msgr2=0x7f0ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40696a0 0x7f0ca0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb8887640 1 -- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0ca0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.741+0000 7f0cb8887640 1 -- 172.21.15.50:0/4203511816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0003520 con 0x7f0ca00047c0 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.742+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009af0 tx=0x7f0ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472533979a28bfde server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.742+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca402c6b0 con 0x7f0ca00047c0 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.742+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca402c810 con 0x7f0ca00047c0 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.742+0000 7f0cabfff640 1 -- 172.21.15.50:0/4203511816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca402cba0 con 0x7f0ca00047c0 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 -- 172.21.15.50:0/4203511816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 msgr2=0x7f0ca0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4203511816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0ca0004c40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009af0 tx=0x7f0ca00057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cb9889640 1 -- 172.21.15.50:0/4203511816 reap_dead start 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 -- 172.21.15.50:0/4203511816 shutdown_connections 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 -- 172.21.15.50:0/4203511816 >> 172.21.15.50:0/4203511816 conn(0x7f0cb40caf80 msgr2=0x7f0cb40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 -- 172.21.15.50:0/4203511816 shutdown_connections 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.743+0000 7f0cba08a640 1 -- 172.21.15.50:0/4203511816 wait complete. 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.745+0000 7f0cba08a640 1 Processor -- start 2023-08-10T10:47:06.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.745+0000 7f0cba08a640 1 -- start start 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c55d0 0x7f0cb4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c7630 0x7f0cb40adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4156aa0 con 0x7f0ca00047c0 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41568c0 con 0x7f0cb40c7630 2023-08-10T10:47:06.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cba08a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40c5b40 con 0x7f0cb40c55d0 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45278/0 (socket says 172.21.15.50:45278) 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 -- 172.21.15.50:0/4102466701 learned_addr learned my addr 172.21.15.50:0/4102466701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 -- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c55d0 msgr2=0x7f0cb4156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c55d0 0x7f0cb4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 -- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c7630 msgr2=0x7f0cb40adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c7630 0x7f0cb40adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.746+0000 7f0cb9088640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40c5e20 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0cb9088640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00074e0 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0007640 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004a20 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb40c6100 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.747+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40c7ab0 con 0x7f0ca00047c0 2023-08-10T10:47:06.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.748+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb4066e30 con 0x7f0ca00047c0 2023-08-10T10:47:06.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.749+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cb0004c40 con 0x7f0ca00047c0 2023-08-10T10:47:06.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.750+0000 7f0ca9ffb640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 0x7f0c9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.750+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cb0088970 con 0x7f0ca00047c0 2023-08-10T10:47:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.750+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f0c98072da0 con 0x7f0ca00047c0 2023-08-10T10:47:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.750+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 0x7f0c9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.751+0000 7f0cb8887640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 0x7f0c9806d110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4036000 tx=0x7f0ca402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:06.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.755+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0cb0053a10 con 0x7f0ca00047c0 2023-08-10T10:47:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.944+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cb415f210 con 0x7f0ca00047c0 2023-08-10T10:47:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.944+0000 7f0ca9ffb640 1 -- 172.21.15.50:0/4102466701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cb0057030 con 0x7f0ca00047c0 2023-08-10T10:47:06.945 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:47:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 msgr2=0x7f0c9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 0x7f0c9806d110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4036000 tx=0x7f0ca402e000 comp rx=0 tx=0).stop 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 msgr2=0x7f0cb406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 shutdown_connections 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0c9806ac50 0x7f0c9806d110 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c7630 0x7f0cb40adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c55d0 0x7f0cb4156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 --2- 172.21.15.50:0/4102466701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00047c0 0x7f0cb406fcd0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:06.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 >> 172.21.15.50:0/4102466701 conn(0x7f0cb40caf80 msgr2=0x7f0cb40cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:06.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 shutdown_connections 2023-08-10T10:47:06.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:06.947+0000 7f0cba08a640 1 -- 172.21.15.50:0/4102466701 wait complete. 2023-08-10T10:47:06.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:47:07.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.181+0000 7f1e4d586640 1 Processor -- start 2023-08-10T10:47:07.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.181+0000 7f1e4d586640 1 -- start start 2023-08-10T10:47:07.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 0x7f1e4815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e480af8b0 0x7f1e480b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e480b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4815ef20 con 0x7f1e480af8b0 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4815e940 con 0x7f1e4815ab10 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e4d586640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480b62a0 con 0x7f1e4815aef0 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e3e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e480af8b0 0x7f1e480b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e3e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e480af8b0 0x7f1e480b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45280/0 (socket says 172.21.15.50:45280) 2023-08-10T10:47:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.183+0000 7f1e3e7fc640 1 -- 172.21.15.50:0/3444429835 learned_addr learned my addr 172.21.15.50:0/3444429835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e477fe640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e480b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e46ffd640 1 --2- 172.21.15.50:0/3444429835 >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 0x7f1e4815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e3e7fc640 1 -- 172.21.15.50:0/3444429835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 msgr2=0x7f1e480b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e480b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e3e7fc640 1 -- 172.21.15.50:0/3444429835 >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 msgr2=0x7f1e4815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/3444429835 >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 0x7f1e4815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e3e7fc640 1 -- 172.21.15.50:0/3444429835 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4815ebb0 con 0x7f1e480af8b0 2023-08-10T10:47:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e477fe640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e480b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:07.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.184+0000 7f1e46ffd640 1 --2- 172.21.15.50:0/3444429835 >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 0x7f1e4815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:07.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.185+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e480b22f0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1e480cd250 tx=0x7f1e3002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e613d75ba8f3d116 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.185+0000 7f1e467fc640 1 -- 172.21.15.50:0/3444429835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e300317f0 con 0x7f1e480af8b0 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.185+0000 7f1e467fc640 1 -- 172.21.15.50:0/3444429835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30031950 con 0x7f1e480af8b0 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e467fc640 1 -- 172.21.15.50:0/3444429835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30031ce0 con 0x7f1e480af8b0 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 -- 172.21.15.50:0/3444429835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 msgr2=0x7f1e480b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e480b22f0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1e480cd250 tx=0x7f1e3002b890 comp rx=0 tx=0).stop 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 -- 172.21.15.50:0/3444429835 shutdown_connections 2023-08-10T10:47:07.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e480b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 --2- 172.21.15.50:0/3444429835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e480b22f0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 --2- 172.21.15.50:0/3444429835 >> v2:172.21.15.117:3300/0 conn(0x7f1e4815ab10 0x7f1e4815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 -- 172.21.15.50:0/3444429835 >> 172.21.15.50:0/3444429835 conn(0x7f1e480cd2f0 msgr2=0x7f1e480cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 -- 172.21.15.50:0/3444429835 shutdown_connections 2023-08-10T10:47:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.186+0000 7f1e4d586640 1 -- 172.21.15.50:0/3444429835 wait complete. 2023-08-10T10:47:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.188+0000 7f1e4d586640 1 Processor -- start 2023-08-10T10:47:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.188+0000 7f1e4d586640 1 -- start start 2023-08-10T10:47:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4815ab10 0x7f1e480b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e4815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480c7940 con 0x7f1e480af8b0 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481f2630 con 0x7f1e4815ab10 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.189+0000 7f1e4d586640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481f2910 con 0x7f1e4815aef0 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45288/0 (socket says 172.21.15.50:45288) 2023-08-10T10:47:07.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 -- 172.21.15.50:0/1449305859 learned_addr learned my addr 172.21.15.50:0/1449305859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e477fe640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e4815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4815ab10 0x7f1e480b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 -- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 msgr2=0x7f1e4815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e4815c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 -- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4815ab10 msgr2=0x7f1e480b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4815ab10 0x7f1e480b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300094d0 con 0x7f1e480af8b0 2023-08-10T10:47:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.190+0000 7f1e46ffd640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800c7f0 tx=0x7f1e3800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.191+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38007a30 con 0x7f1e480af8b0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.191+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38007b90 con 0x7f1e480af8b0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.191+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800ce40 con 0x7f1e480af8b0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.191+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e481f2bf0 con 0x7f1e480af8b0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.191+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4815a250 con 0x7f1e480af8b0 2023-08-10T10:47:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.192+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4804e270 con 0x7f1e480af8b0 2023-08-10T10:47:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.193+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e380113f0 con 0x7f1e480af8b0 2023-08-10T10:47:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.194+0000 7f1e3ffff640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 0x7f1e2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.194+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e38089710 con 0x7f1e480af8b0 2023-08-10T10:47:07.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.194+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f1e28072da0 con 0x7f1e480af8b0 2023-08-10T10:47:07.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.194+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 0x7f1e2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.195+0000 7f1e3e7fc640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 0x7f1e2806d110 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1e30036000 tx=0x7f1e3003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.198+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e38087e60 con 0x7f1e480af8b0 2023-08-10T10:47:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.406+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e480cb920 con 0x7f1e480af8b0 2023-08-10T10:47:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.407+0000 7f1e3ffff640 1 -- 172.21.15.50:0/1449305859 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v147) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e38087e60 con 0x7f1e480af8b0 2023-08-10T10:47:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:47:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 msgr2=0x7f1e2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 0x7f1e2806d110 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1e30036000 tx=0x7f1e3003d040 comp rx=0 tx=0).stop 2023-08-10T10:47:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 msgr2=0x7f1e48159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800c7f0 tx=0x7f1e3800cbf0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 shutdown_connections 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e4815aef0 0x7f1e4815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1e2806ac50 0x7f1e2806d110 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e4815ab10 0x7f1e480b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 --2- 172.21.15.50:0/1449305859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e480af8b0 0x7f1e48159d10 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.410+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 >> 172.21.15.50:0/1449305859 conn(0x7f1e480cd2f0 msgr2=0x7f1e480cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.411+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 shutdown_connections 2023-08-10T10:47:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.411+0000 7f1e4d586640 1 -- 172.21.15.50:0/1449305859 wait complete. 2023-08-10T10:47:07.430 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:47:07.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:07.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:47:07.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:47:07.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:07.561 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:47:07.613 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:07.613 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:07.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:47:07.680 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:07.680 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:07.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:47:07.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.974+0000 7f3242ab8640 1 Processor -- start 2023-08-10T10:47:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.974+0000 7f3242ab8640 1 -- start start 2023-08-10T10:47:07.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3242ab8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f323c159970 0x7f323c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3242ab8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c0b0f00 0x7f323c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3242ab8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c15e1f0 con 0x7f323c069be0 2023-08-10T10:47:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3242ab8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c06a070 con 0x7f323c159970 2023-08-10T10:47:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3242ab8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15d5e0 con 0x7f323c0b0f00 2023-08-10T10:47:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.976+0000 7f3241055640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f323c069be0 0x7f323c0c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43058/0 (socket says 172.21.15.50:43058) 2023-08-10T10:47:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3241055640 1 -- 172.21.15.50:0/423225709 learned_addr learned my addr 172.21.15.50:0/423225709 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3240854640 1 --2- 172.21.15.50:0/423225709 >> v2:172.21.15.50:3300/0 conn(0x7f323c159970 0x7f323c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f323bfff640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c0b0f00 0x7f323c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f323b7fe640 1 -- 172.21.15.50:0/423225709 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541194573 0 0) 0x7f323c15e1f0 con 0x7f323c069be0 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f323b7fe640 1 -- 172.21.15.50:0/423225709 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f322c003520 con 0x7f323c069be0 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3240854640 1 -- 172.21.15.50:0/423225709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c0b0f00 msgr2=0x7f323c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3240854640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c0b0f00 0x7f323c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3240854640 1 -- 172.21.15.50:0/423225709 >> v1:172.21.15.50:6789/0 conn(0x7f323c069be0 legacy=0x7f323c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.977+0000 7f3240854640 1 -- 172.21.15.50:0/423225709 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c15d8c0 con 0x7f323c159970 2023-08-10T10:47:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.978+0000 7f3240854640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c159970 0x7f323c0b09c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f323002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92035bb7ed1c92 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f323b7fe640 1 -- 172.21.15.50:0/423225709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323002d040 con 0x7f323c159970 2023-08-10T10:47:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f323b7fe640 1 -- 172.21.15.50:0/423225709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230031810 con 0x7f323c159970 2023-08-10T10:47:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f323b7fe640 1 -- 172.21.15.50:0/423225709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230031b80 con 0x7f323c159970 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 -- 172.21.15.50:0/423225709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c159970 msgr2=0x7f323c0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c159970 0x7f323c0b09c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f32300097a0 tx=0x7f323002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 -- 172.21.15.50:0/423225709 shutdown_connections 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c0b0f00 0x7f323c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 --2- 172.21.15.50:0/423225709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c159970 0x7f323c0b09c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.979+0000 7f3242ab8640 1 -- 172.21.15.50:0/423225709 >> 172.21.15.50:0/423225709 conn(0x7f323c06b590 msgr2=0x7f323c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.980+0000 7f3242ab8640 1 -- 172.21.15.50:0/423225709 shutdown_connections 2023-08-10T10:47:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.980+0000 7f3242ab8640 1 -- 172.21.15.50:0/423225709 wait complete. 2023-08-10T10:47:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.981+0000 7f3242ab8640 1 Processor -- start 2023-08-10T10:47:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.982+0000 7f3242ab8640 1 -- start start 2023-08-10T10:47:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c069be0 0x7f323c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 0x7f323c1edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1ee0b0 con 0x7f323c0b0f00 2023-08-10T10:47:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c14b3f0 con 0x7f323c159970 2023-08-10T10:47:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3242ab8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0c4bf0 con 0x7f323c069be0 2023-08-10T10:47:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45302/0 (socket says 172.21.15.50:45302) 2023-08-10T10:47:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 -- 172.21.15.50:0/2127794465 learned_addr learned my addr 172.21.15.50:0/2127794465 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3240854640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c069be0 0x7f323c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f3241055640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 0x7f323c1edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 -- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c069be0 msgr2=0x7f323c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c069be0 0x7f323c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.983+0000 7f323bfff640 1 -- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 msgr2=0x7f323c1edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f323bfff640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 0x7f323c1edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f323bfff640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009400 con 0x7f323c0b0f00 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f3241055640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 0x7f323c1edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f323bfff640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f322800d800 tx=0x7f322800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800b6c0 con 0x7f323c0b0f00 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800b820 con 0x7f323c0b0f00 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c0c4ed0 con 0x7f323c0b0f00 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800bbb0 con 0x7f323c0b0f00 2023-08-10T10:47:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.984+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c15bdc0 con 0x7f323c0b0f00 2023-08-10T10:47:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.986+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c15bf80 con 0x7f323c0b0f00 2023-08-10T10:47:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.986+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f322800bd10 con 0x7f323c0b0f00 2023-08-10T10:47:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.987+0000 7f32397fa640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 0x7f322006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.987+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3228089a40 con 0x7f323c0b0f00 2023-08-10T10:47:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.988+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f3220072dd0 con 0x7f323c0b0f00 2023-08-10T10:47:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.988+0000 7f3240854640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 0x7f322006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.988+0000 7f3240854640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 0x7f322006d140 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3230036000 tx=0x7f323003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:07.992+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3228054ae0 con 0x7f323c0b0f00 2023-08-10T10:47:08.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.219+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f323c04e270 con 0x7f323c0b0f00 2023-08-10T10:47:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.220+0000 7f32397fa640 1 -- 172.21.15.50:0/2127794465 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f3228058100 con 0x7f323c0b0f00 2023-08-10T10:47:08.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:08.222 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:47:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:47:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 msgr2=0x7f322006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 0x7f322006d140 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3230036000 tx=0x7f323003c040 comp rx=0 tx=0).stop 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 msgr2=0x7f323c0c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f322800d800 tx=0x7f322800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 shutdown_connections 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f322006ac80 0x7f322006d140 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f323c159970 0x7f323c1edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c0b0f00 0x7f323c0c21f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 --2- 172.21.15.50:0/2127794465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323c069be0 0x7f323c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 >> 172.21.15.50:0/2127794465 conn(0x7f323c06b590 msgr2=0x7f323c0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 shutdown_connections 2023-08-10T10:47:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.223+0000 7f3242ab8640 1 -- 172.21.15.50:0/2127794465 wait complete. 2023-08-10T10:47:08.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.474+0000 7f3c8f9f5640 1 Processor -- start 2023-08-10T10:47:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.474+0000 7f3c8f9f5640 1 -- start start 2023-08-10T10:47:08.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8f9f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c880c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8f9f5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c88071c70 con 0x7f3c880b3f30 2023-08-10T10:47:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8f9f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880713d0 con 0x7f3c8815aa40 2023-08-10T10:47:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8f9f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880716b0 con 0x7f3c880b0c60 2023-08-10T10:47:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8df92640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c880b3f30 0x7f3c880c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43074/0 (socket says 172.21.15.50:43074) 2023-08-10T10:47:08.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8df92640 1 -- 172.21.15.50:0/579567514 learned_addr learned my addr 172.21.15.50:0/579567514 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.476+0000 7f3c8cf90640 1 --2- 172.21.15.50:0/579567514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c880c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694871660 0 0) 0x7f3c88071c70 con 0x7f3c880b3f30 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c74003520 con 0x7f3c880b3f30 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c8cf90640 1 -- 172.21.15.50:0/579567514 >> v1:172.21.15.117:6789/0 conn(0x7f3c8815aa40 legacy=0x7f3c880b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273437181 0 0) 0x7f3c74003520 con 0x7f3c880b3f30 2023-08-10T10:47:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c8cf90640 1 -- 172.21.15.50:0/579567514 >> v1:172.21.15.50:6789/0 conn(0x7f3c880b3f30 legacy=0x7f3c880c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.477+0000 7f3c8cf90640 1 -- 172.21.15.50:0/579567514 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88071990 con 0x7f3c880b0c60 2023-08-10T10:47:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.478+0000 7f3c8cf90640 1 --2- 172.21.15.50:0/579567514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c880c9920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097d0 tx=0x7f3c7802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711f0ffb1829cbd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.479+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80001670 con 0x7f3c880b0c60 2023-08-10T10:47:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.479+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7802e050 con 0x7f3c880b0c60 2023-08-10T10:47:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.479+0000 7f3c7ffff640 1 -- 172.21.15.50:0/579567514 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78030710 con 0x7f3c880b0c60 2023-08-10T10:47:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.479+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/579567514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 msgr2=0x7f3c880c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.479+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/579567514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c880c9920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097d0 tx=0x7f3c7802b770 comp rx=0 tx=0).stop 2023-08-10T10:47:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.480+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/579567514 shutdown_connections 2023-08-10T10:47:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.480+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/579567514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c880c9920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.480+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/579567514 >> 172.21.15.50:0/579567514 conn(0x7f3c8806b590 msgr2=0x7f3c880ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.480+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/579567514 shutdown_connections 2023-08-10T10:47:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.480+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/579567514 wait complete. 2023-08-10T10:47:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.482+0000 7f3c8f9f5640 1 Processor -- start 2023-08-10T10:47:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.482+0000 7f3c8f9f5640 1 -- start start 2023-08-10T10:47:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c881f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8815aa40 0x7f3c88154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c8590 con 0x7f3c880b3f30 2023-08-10T10:47:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88153cc0 con 0x7f3c8815aa40 2023-08-10T10:47:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8f9f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88153fa0 con 0x7f3c880b0c60 2023-08-10T10:47:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8cf90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8cf90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45306/0 (socket says 172.21.15.50:45306) 2023-08-10T10:47:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8cf90640 1 -- 172.21.15.50:0/4013383633 learned_addr learned my addr 172.21.15.50:0/4013383633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.483+0000 7f3c8d791640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c881f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 -- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 msgr2=0x7f3c881f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c881f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 -- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8815aa40 msgr2=0x7f3c88154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8815aa40 0x7f3c88154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009400 con 0x7f3c880b3f30 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8d791640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c881f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8cf90640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3c78000c00 tx=0x7f3c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7803d890 con 0x7f3c880b3f30 2023-08-10T10:47:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7803da10 con 0x7f3c880b3f30 2023-08-10T10:47:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7803ddc0 con 0x7f3c880b3f30 2023-08-10T10:47:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c88154280 con 0x7f3c880b3f30 2023-08-10T10:47:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.484+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c881f38b0 con 0x7f3c880b3f30 2023-08-10T10:47:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.485+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c881547a0 con 0x7f3c880b3f30 2023-08-10T10:47:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.487+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c78039040 con 0x7f3c880b3f30 2023-08-10T10:47:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.488+0000 7f3c7dffb640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 0x7f3c6c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.488+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c780ab4c0 con 0x7f3c880b3f30 2023-08-10T10:47:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.488+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f3c6c072da0 con 0x7f3c880b3f30 2023-08-10T10:47:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.488+0000 7f3c8d791640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 0x7f3c6c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.489+0000 7f3c8d791640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 0x7f3c6c06d110 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b3310 tx=0x7f3c84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.492+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c7804d060 con 0x7f3c880b3f30 2023-08-10T10:47:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.685+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c8804e270 con 0x7f3c880b3f30 2023-08-10T10:47:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.688+0000 7f3c7dffb640 1 -- 172.21.15.50:0/4013383633 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+18377 (secure 0 0 0) 0x7f3c78037070 con 0x7f3c880b3f30 2023-08-10T10:47:08.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:08.690 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":147,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:06.562447+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 msgr2=0x7f3c6c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 0x7f3c6c06d110 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b3310 tx=0x7f3c84009040 comp rx=0 tx=0).stop 2023-08-10T10:47:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 msgr2=0x7f3c880c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3c78000c00 tx=0x7f3c780046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 shutdown_connections 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3c6c06ac50 0x7f3c6c06d110 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8815aa40 0x7f3c88154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c880b3f30 0x7f3c880c7bd0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 --2- 172.21.15.50:0/4013383633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c880b0c60 0x7f3c881f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 >> 172.21.15.50:0/4013383633 conn(0x7f3c8806b590 msgr2=0x7f3c88150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.692+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 shutdown_connections 2023-08-10T10:47:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.693+0000 7f3c8f9f5640 1 -- 172.21.15.50:0/4013383633 wait complete. 2023-08-10T10:47:08.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:46:18.537056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:46:19.150540+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:08.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.949+0000 7f243da67640 1 Processor -- start 2023-08-10T10:47:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.950+0000 7f243da67640 1 -- start start 2023-08-10T10:47:08.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.951+0000 7f243da67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f24380b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.951+0000 7f243da67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380adf20 con 0x7f2438159c10 2023-08-10T10:47:08.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.951+0000 7f243da67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243806ebb0 con 0x7f24380ada90 2023-08-10T10:47:08.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.951+0000 7f243da67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243806ee90 con 0x7f24380ca530 2023-08-10T10:47:08.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.952+0000 7f24377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2438159c10 0x7f24380c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43088/0 (socket says 172.21.15.50:43088) 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.952+0000 7f24377fe640 1 -- 172.21.15.50:0/1326880302 learned_addr learned my addr 172.21.15.50:0/1326880302 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.952+0000 7f242effd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f24380b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.952+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742188991 0 0) 0x7f24380adf20 con 0x7f2438159c10 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.952+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2424005730 con 0x7f2438159c10 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370147372 0 0) 0x7f2424005730 con 0x7f2438159c10 2023-08-10T10:47:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 msgr2=0x7f24380b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f24380b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 >> v1:172.21.15.117:6789/0 conn(0x7f24380ada90 legacy=0x7f243806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243806f170 con 0x7f2438159c10 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f2428001670 con 0x7f2438159c10 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 >> v1:172.21.15.50:6789/0 conn(0x7f2438159c10 legacy=0x7f24380c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f2424005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24240060f0 0x7f24240069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2424006f10 0x7f2424007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243806ee90 con 0x7f24240060f0 2023-08-10T10:47:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242400ff90 con 0x7f2424006f10 2023-08-10T10:47:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24240100d0 con 0x7f24380ca530 2023-08-10T10:47:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f242effd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24240060f0 0x7f24240069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.953+0000 7f24377fe640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f2424005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f2437fff640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2424006f10 0x7f2424007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f242effd640 1 -- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 msgr2=0x7f2424005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f242effd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380ca530 0x7f2424005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f242effd640 1 -- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2424006f10 msgr2=0x7f2424007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f242effd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2424006f10 0x7f2424007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f242effd640 1 -- 172.21.15.50:0/1326880302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424005730 con 0x7f24240060f0 2023-08-10T10:47:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.954+0000 7f2437fff640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2424006f10 0x7f2424007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.955+0000 7f242effd640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24240060f0 0x7f24240069d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2420009fc0 tx=0x7f2424007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa36ff7758a2bad5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.955+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242002cc20 con 0x7f24240060f0 2023-08-10T10:47:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.955+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000f040 con 0x7f24240060f0 2023-08-10T10:47:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.955+0000 7f2436ffd640 1 -- 172.21.15.50:0/1326880302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420034440 con 0x7f24240060f0 2023-08-10T10:47:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 -- 172.21.15.50:0/1326880302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24240060f0 msgr2=0x7f24240069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 --2- 172.21.15.50:0/1326880302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24240060f0 0x7f24240069d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2420009fc0 tx=0x7f2424007a00 comp rx=0 tx=0).stop 2023-08-10T10:47:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f2437fff640 1 -- 172.21.15.50:0/1326880302 reap_dead start 2023-08-10T10:47:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 -- 172.21.15.50:0/1326880302 shutdown_connections 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 -- 172.21.15.50:0/1326880302 >> 172.21.15.50:0/1326880302 conn(0x7f24380b01b0 msgr2=0x7f24380b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 -- 172.21.15.50:0/1326880302 shutdown_connections 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.956+0000 7f243da67640 1 -- 172.21.15.50:0/1326880302 wait complete. 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.958+0000 7f243da67640 1 Processor -- start 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.958+0000 7f243da67640 1 -- start start 2023-08-10T10:47:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24240060f0 0x7f24380c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815bc60 0x7f243815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243815c620 con 0x7f24380c41d0 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380c77a0 con 0x7f243815bc60 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f243da67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24381f1630 con 0x7f24240060f0 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f242effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f242effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45334/0 (socket says 172.21.15.50:45334) 2023-08-10T10:47:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.959+0000 7f242effd640 1 -- 172.21.15.50:0/658214678 learned_addr learned my addr 172.21.15.50:0/658214678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f24377fe640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24240060f0 0x7f24380c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 -- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24240060f0 msgr2=0x7f24380c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24240060f0 0x7f24380c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 -- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815bc60 msgr2=0x7f243815c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815bc60 0x7f243815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24381ede70 con 0x7f24380c41d0 2023-08-10T10:47:08.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f242effd640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f242002c690 tx=0x7f2420009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420034bd0 con 0x7f24380c41d0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420034d30 con 0x7f24380c41d0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420034ea0 con 0x7f24380c41d0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24381f18d0 con 0x7f24380c41d0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.960+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24381f1e90 con 0x7f24380c41d0 2023-08-10T10:47:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.962+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24380612b0 con 0x7f24380c41d0 2023-08-10T10:47:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.963+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2420040450 con 0x7f24380c41d0 2023-08-10T10:47:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.963+0000 7f2434ff9640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.964+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24200abde0 con 0x7f24380c41d0 2023-08-10T10:47:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.964+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f2418072da0 con 0x7f24380c41d0 2023-08-10T10:47:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.964+0000 7f24377fe640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.964+0000 7f24377fe640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2428001050 tx=0x7f2428001d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:08.968+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2420076df0 con 0x7f24380c41d0 2023-08-10T10:47:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.159+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2438069fe0 con 0x7f24380c41d0 2023-08-10T10:47:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.160+0000 7f2434ff9640 1 -- 172.21.15.50:0/658214678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24200440a0 con 0x7f24380c41d0 2023-08-10T10:47:09.161 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 msgr2=0x7f241806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2428001050 tx=0x7f2428001d40 comp rx=0 tx=0).stop 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 msgr2=0x7f24381ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f242002c690 tx=0x7f2420009750 comp rx=0 tx=0).stop 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 shutdown_connections 2023-08-10T10:47:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f241806ac50 0x7f241806d110 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815bc60 0x7f243815c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24380c41d0 0x7f24381ed930 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 --2- 172.21.15.50:0/658214678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24240060f0 0x7f24380c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 >> 172.21.15.50:0/658214678 conn(0x7f24380b01b0 msgr2=0x7f24380c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 shutdown_connections 2023-08-10T10:47:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.163+0000 7f243da67640 1 -- 172.21.15.50:0/658214678 wait complete. 2023-08-10T10:47:09.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:47:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.416+0000 7f9402246640 1 Processor -- start 2023-08-10T10:47:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.416+0000 7f9402246640 1 -- start start 2023-08-10T10:47:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93fc15cf70 0x7f93fc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93fc0b4640 0x7f93fc161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc160a40 con 0x7f93fc15cf70 2023-08-10T10:47:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0b4bb0 con 0x7f93fc0b4640 2023-08-10T10:47:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.417+0000 7f9402246640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0b4e90 con 0x7f93fc15cb90 2023-08-10T10:47:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93fc15cf70 0x7f93fc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93fc15cf70 0x7f93fc160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45344/0 (socket says 172.21.15.50:45344) 2023-08-10T10:47:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 -- 172.21.15.50:0/1624933108 learned_addr learned my addr 172.21.15.50:0/1624933108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93fb7fe640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93fbfff640 1 --2- 172.21.15.50:0/1624933108 >> v2:172.21.15.117:3300/0 conn(0x7f93fc0b4640 0x7f93fc161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 -- 172.21.15.50:0/1624933108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 msgr2=0x7f93fc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 -- 172.21.15.50:0/1624933108 >> v2:172.21.15.117:3300/0 conn(0x7f93fc0b4640 msgr2=0x7f93fc161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 --2- 172.21.15.50:0/1624933108 >> v2:172.21.15.117:3300/0 conn(0x7f93fc0b4640 0x7f93fc161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.418+0000 7f93faffd640 1 -- 172.21.15.50:0/1624933108 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0b5170 con 0x7f93fc15cf70 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.419+0000 7f93faffd640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc160ed0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0718c0 tx=0x7f93f002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8b624507950e1c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.419+0000 7f93fa7fc640 1 -- 172.21.15.50:0/1624933108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0031860 con 0x7f93fc15cf70 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f93fa7fc640 1 -- 172.21.15.50:0/1624933108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f00319c0 con 0x7f93fc15cf70 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f93fa7fc640 1 -- 172.21.15.50:0/1624933108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0031d50 con 0x7f93fc15cf70 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 -- 172.21.15.50:0/1624933108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 msgr2=0x7f93fc160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc160ed0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0718c0 tx=0x7f93f002b900 comp rx=0 tx=0).stop 2023-08-10T10:47:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 -- 172.21.15.50:0/1624933108 shutdown_connections 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 --2- 172.21.15.50:0/1624933108 >> v2:172.21.15.117:3300/0 conn(0x7f93fc0b4640 0x7f93fc161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc160ed0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 --2- 172.21.15.50:0/1624933108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 -- 172.21.15.50:0/1624933108 >> 172.21.15.50:0/1624933108 conn(0x7f93fc0cf640 msgr2=0x7f93fc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 -- 172.21.15.50:0/1624933108 shutdown_connections 2023-08-10T10:47:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.420+0000 7f9402246640 1 -- 172.21.15.50:0/1624933108 wait complete. 2023-08-10T10:47:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.422+0000 7f9402246640 1 Processor -- start 2023-08-10T10:47:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.422+0000 7f9402246640 1 -- start start 2023-08-10T10:47:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93fc0b4640 0x7f93fc14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc14d5b0 con 0x7f93fc15cf70 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc15dff0 con 0x7f93fc0b4640 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.423+0000 7f9402246640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0cb0f0 con 0x7f93fc15cb90 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45350/0 (socket says 172.21.15.50:45350) 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 -- 172.21.15.50:0/604810628 learned_addr learned my addr 172.21.15.50:0/604810628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fb7fe640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93fc0b4640 0x7f93fc14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93faffd640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 -- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 msgr2=0x7f93fc0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 -- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93fc0b4640 msgr2=0x7f93fc14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93fc0b4640 0x7f93fc14d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.424+0000 7f93fbfff640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00094d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f93fbfff640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f93f400ccf0 tx=0x7f93f400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4003b90 con 0x7f93fc15cf70 2023-08-10T10:47:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4003cf0 con 0x7f93fc15cf70 2023-08-10T10:47:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004240 con 0x7f93fc15cf70 2023-08-10T10:47:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc0cb3d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.425+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc0cb6b0 con 0x7f93fc15cf70 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.426+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc15e4d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.427+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93f40043a0 con 0x7f93fc15cf70 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.429+0000 7f93e3fff640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 0x7f93e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.429+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93f4012070 con 0x7f93fc15cf70 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.429+0000 7f93fb7fe640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 0x7f93e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.429+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f93e8072da0 con 0x7f93fc15cf70 2023-08-10T10:47:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.430+0000 7f93fb7fe640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 0x7f93e806d110 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f93ec006fd0 tx=0x7f93ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.433+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f93fc15e4d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.621+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93fc15e4d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.622+0000 7f93e3fff640 1 -- 172.21.15.50:0/604810628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93fc15e4d0 con 0x7f93fc15cf70 2023-08-10T10:47:09.624 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:47:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.624+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 msgr2=0x7f93e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.624+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 0x7f93e806d110 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f93ec006fd0 tx=0x7f93ec008040 comp rx=0 tx=0).stop 2023-08-10T10:47:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.624+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 msgr2=0x7f93fc14e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.624+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f93f400ccf0 tx=0x7f93f400a660 comp rx=0 tx=0).stop 2023-08-10T10:47:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 shutdown_connections 2023-08-10T10:47:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93fc15cf70 0x7f93fc14e170 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93fc15cb90 0x7f93fc0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f93e806ac50 0x7f93e806d110 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 --2- 172.21.15.50:0/604810628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93fc0b4640 0x7f93fc14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 >> 172.21.15.50:0/604810628 conn(0x7f93fc0cf640 msgr2=0x7f93fc0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 shutdown_connections 2023-08-10T10:47:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.625+0000 7f9402246640 1 -- 172.21.15.50:0/604810628 wait complete. 2023-08-10T10:47:09.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:47:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.865+0000 7fe8c2acc640 1 Processor -- start 2023-08-10T10:47:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.865+0000 7fe8c2acc640 1 -- start start 2023-08-10T10:47:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c2acc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c2acc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c2acc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0adcb0 con 0x7fe8bc06cb30 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c2acc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc06c320 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c2acc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc06b770 con 0x7fe8bc15ae40 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45360/0 (socket says 172.21.15.50:45360) 2023-08-10T10:47:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 -- 172.21.15.50:0/589697911 learned_addr learned my addr 172.21.15.50:0/589697911 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c0868640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 -- 172.21.15.50:0/589697911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 msgr2=0x7fe8bc0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.867+0000 7fe8c1069640 1 -- 172.21.15.50:0/589697911 >> v1:172.21.15.117:6789/0 conn(0x7fe8bc06cb30 legacy=0x7fe8bc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.868+0000 7fe8c1069640 1 -- 172.21.15.50:0/589697911 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc06b9f0 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.869+0000 7fe8c1069640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009e50 tx=0x7fe8b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77416b1af2f12f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.869+0000 7fe8bb7fe640 1 -- 172.21.15.50:0/589697911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b402ca70 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.869+0000 7fe8bb7fe640 1 -- 172.21.15.50:0/589697911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b402cbd0 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.869+0000 7fe8bb7fe640 1 -- 172.21.15.50:0/589697911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40343f0 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.869+0000 7fe8c2acc640 1 -- 172.21.15.50:0/589697911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc0cd9b0 msgr2=0x7fe8bc0ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009e50 tx=0x7fe8b402bed0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 -- 172.21.15.50:0/589697911 shutdown_connections 2023-08-10T10:47:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc0ad770 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/589697911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 -- 172.21.15.50:0/589697911 >> 172.21.15.50:0/589697911 conn(0x7fe8bc0b01b0 msgr2=0x7fe8bc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 -- 172.21.15.50:0/589697911 shutdown_connections 2023-08-10T10:47:09.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.870+0000 7fe8c2acc640 1 -- 172.21.15.50:0/589697911 wait complete. 2023-08-10T10:47:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.871+0000 7fe8c2acc640 1 Processor -- start 2023-08-10T10:47:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 -- start start 2023-08-10T10:47:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc1e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1e4a20 con 0x7fe8bc06cb30 2023-08-10T10:47:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1e4c80 con 0x7fe8bc0cd9b0 2023-08-10T10:47:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.872+0000 7fe8c2acc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1e60e0 con 0x7fe8bc15ae40 2023-08-10T10:47:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45362/0 (socket says 172.21.15.50:45362) 2023-08-10T10:47:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 -- 172.21.15.50:0/512057025 learned_addr learned my addr 172.21.15.50:0/512057025 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 -- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 msgr2=0x7fe8bc0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8bbfff640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc1e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 -- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8bc0cd9b0 msgr2=0x7fe8bc1e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc1e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.873+0000 7fe8c0868640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009b30 con 0x7fe8bc06cb30 2023-08-10T10:47:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8c0868640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d5f0 tx=0x7fe8b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00125f0 con 0x7fe8bc06cb30 2023-08-10T10:47:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0012750 con 0x7fe8bc06cb30 2023-08-10T10:47:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0012ae0 con 0x7fe8bc06cb30 2023-08-10T10:47:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc1e6380 con 0x7fe8bc06cb30 2023-08-10T10:47:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.874+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc1e6940 con 0x7fe8bc06cb30 2023-08-10T10:47:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.875+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc0612b0 con 0x7fe8bc06cb30 2023-08-10T10:47:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.876+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8b0012c40 con 0x7fe8bc06cb30 2023-08-10T10:47:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.877+0000 7fe8b97fa640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 0x7fe8a006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.877+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8b0089a90 con 0x7fe8bc06cb30 2023-08-10T10:47:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.877+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fe8a0072da0 con 0x7fe8bc06cb30 2023-08-10T10:47:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.877+0000 7fe8bbfff640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 0x7fe8a006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.878+0000 7fe8bbfff640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 0x7fe8a006d110 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0c5040 tx=0x7fe8a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:09.881+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8b0054aa0 con 0x7fe8bc06cb30 2023-08-10T10:47:10.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.069+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8bc159700 con 0x7fe8bc06cb30 2023-08-10T10:47:10.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.070+0000 7fe8b97fa640 1 -- 172.21.15.50:0/512057025 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v147) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8b00580c0 con 0x7fe8bc06cb30 2023-08-10T10:47:10.072 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:47:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 msgr2=0x7fe8a006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 0x7fe8a006d110 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0c5040 tx=0x7fe8a8008040 comp rx=0 tx=0).stop 2023-08-10T10:47:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 msgr2=0x7fe8bc1e44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000d5f0 tx=0x7fe8b000dab0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 shutdown_connections 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8bc15ae40 0x7fe8bc0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe8a006ac50 0x7fe8a006d110 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8bc0cd9b0 0x7fe8bc1e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 --2- 172.21.15.50:0/512057025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8bc06cb30 0x7fe8bc1e44e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 >> 172.21.15.50:0/512057025 conn(0x7fe8bc0b01b0 msgr2=0x7fe8bc0ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:10.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 shutdown_connections 2023-08-10T10:47:10.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.073+0000 7fe8c2acc640 1 -- 172.21.15.50:0/512057025 wait complete. 2023-08-10T10:47:10.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:47:10.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.323+0000 7f9d6cf5c640 1 Processor -- start 2023-08-10T10:47:10.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.323+0000 7f9d6cf5c640 1 -- start start 2023-08-10T10:47:10.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d6cf5c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d6815ca80 0x7f9d680ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d6cf5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d68069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d6cf5c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680cdb20 con 0x7f9d68161360 2023-08-10T10:47:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d6cf5c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6806a050 con 0x7f9d6815ca80 2023-08-10T10:47:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d6cf5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cde00 con 0x7f9d680696a0 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.325+0000 7f9d677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d6815ca80 0x7f9d680ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d6815ca80 0x7f9d680ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45366/0 (socket says 172.21.15.50:45366) 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 -- 172.21.15.50:0/1806072671 learned_addr learned my addr 172.21.15.50:0/1806072671 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d67fff640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d68069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 -- 172.21.15.50:0/1806072671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 msgr2=0x7f9d68069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d68069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 -- 172.21.15.50:0/1806072671 >> v1:172.21.15.117:6789/0 conn(0x7f9d68161360 legacy=0x7f9d680cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.326+0000 7f9d677fe640 1 -- 172.21.15.50:0/1806072671 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680cc0d0 con 0x7f9d6815ca80 2023-08-10T10:47:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.327+0000 7f9d677fe640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d6815ca80 0x7f9d680ccbb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009870 tx=0x7f9d5802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baa9b3b2cc16444 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.328+0000 7f9d667fc640 1 -- 172.21.15.50:0/1806072671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580317c0 con 0x7f9d6815ca80 2023-08-10T10:47:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.328+0000 7f9d667fc640 1 -- 172.21.15.50:0/1806072671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d58031920 con 0x7f9d6815ca80 2023-08-10T10:47:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.328+0000 7f9d667fc640 1 -- 172.21.15.50:0/1806072671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031cb0 con 0x7f9d6815ca80 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.328+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/1806072671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d6815ca80 msgr2=0x7f9d680ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.328+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d6815ca80 0x7f9d680ccbb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009870 tx=0x7f9d5802b860 comp rx=0 tx=0).stop 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/1806072671 shutdown_connections 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d68069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/1806072671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d6815ca80 0x7f9d680ccbb0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/1806072671 >> 172.21.15.50:0/1806072671 conn(0x7f9d680caf80 msgr2=0x7f9d680cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/1806072671 shutdown_connections 2023-08-10T10:47:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.329+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/1806072671 wait complete. 2023-08-10T10:47:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.331+0000 7f9d6cf5c640 1 Processor -- start 2023-08-10T10:47:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.331+0000 7f9d6cf5c640 1 -- start start 2023-08-10T10:47:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d6815f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d6815ca80 0x7f9d6815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c6070 con 0x7f9d68161360 2023-08-10T10:47:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c6350 con 0x7f9d6815ca80 2023-08-10T10:47:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d6cf5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c6630 con 0x7f9d680696a0 2023-08-10T10:47:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45370/0 (socket says 172.21.15.50:45370) 2023-08-10T10:47:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d67fff640 1 -- 172.21.15.50:0/639271891 learned_addr learned my addr 172.21.15.50:0/639271891 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.332+0000 7f9d677fe640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d6815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 -- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 msgr2=0x7f9d6815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d6815f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 -- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d6815ca80 msgr2=0x7f9d6815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d66ffd640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d6815ca80 0x7f9d6815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d6815ca80 0x7f9d6815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580094d0 con 0x7f9d68161360 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d67fff640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007e60 tx=0x7f9d6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60014420 con 0x7f9d68161360 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600145a0 con 0x7f9d68161360 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60014950 con 0x7f9d68161360 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.333+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d680c6910 con 0x7f9d68161360 2023-08-10T10:47:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.334+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6815eef0 con 0x7f9d68161360 2023-08-10T10:47:10.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.335+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d680acbd0 con 0x7f9d68161360 2023-08-10T10:47:10.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.336+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d60014ab0 con 0x7f9d68161360 2023-08-10T10:47:10.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.337+0000 7f9d4ffff640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 0x7f9d5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.337+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d60089df0 con 0x7f9d68161360 2023-08-10T10:47:10.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.337+0000 7f9d677fe640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 0x7f9d5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.337+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f9d54072da0 con 0x7f9d68161360 2023-08-10T10:47:10.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.338+0000 7f9d677fe640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 0x7f9d5406d110 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d58036000 tx=0x7f9d5803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.341+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9d60058920 con 0x7f9d68161360 2023-08-10T10:47:10.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.532+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d680c61b0 con 0x7f9d68161360 2023-08-10T10:47:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.533+0000 7f9d4ffff640 1 -- 172.21.15.50:0/639271891 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d680c61b0 con 0x7f9d68161360 2023-08-10T10:47:10.535 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:47:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.535+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 msgr2=0x7f9d5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.535+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 0x7f9d5406d110 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d58036000 tx=0x7f9d5803d040 comp rx=0 tx=0).stop 2023-08-10T10:47:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 msgr2=0x7f9d681f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007e60 tx=0x7f9d6000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 shutdown_connections 2023-08-10T10:47:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d68161360 0x7f9d681f1e20 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d5406ac50 0x7f9d5406d110 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d6815ca80 0x7f9d6815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 --2- 172.21.15.50:0/639271891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d680696a0 0x7f9d6815f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 >> 172.21.15.50:0/639271891 conn(0x7f9d680caf80 msgr2=0x7f9d680b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 shutdown_connections 2023-08-10T10:47:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.536+0000 7f9d6cf5c640 1 -- 172.21.15.50:0/639271891 wait complete. 2023-08-10T10:47:10.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.784+0000 7f2f6c524640 1 Processor -- start 2023-08-10T10:47:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.785+0000 7f2f6c524640 1 -- start start 2023-08-10T10:47:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.786+0000 7f2f6c524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 0x7f2f640696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.786+0000 7f2f6c524640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.786+0000 7f2f6c524640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640719f0 con 0x7f2f6415ccb0 2023-08-10T10:47:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.786+0000 7f2f6c524640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640c8db0 con 0x7f2f640c9b30 2023-08-10T10:47:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.786+0000 7f2f6c524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640c9050 con 0x7f2f640b3010 2023-08-10T10:47:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.787+0000 7f2f6aac1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.787+0000 7f2f6aac1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35626/0 (socket says 172.21.15.50:35626) 2023-08-10T10:47:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.787+0000 7f2f6aac1640 1 -- 172.21.15.50:0/3756865713 learned_addr learned my addr 172.21.15.50:0/3756865713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.787+0000 7f2f69abf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 0x7f2f640696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.788+0000 7f2f69abf640 1 -- 172.21.15.50:0/3756865713 >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 msgr2=0x7f2f64069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.788+0000 7f2f69abf640 1 --2- 172.21.15.50:0/3756865713 >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.788+0000 7f2f69abf640 1 -- 172.21.15.50:0/3756865713 >> v1:172.21.15.117:6789/0 conn(0x7f2f6415ccb0 legacy=0x7f2f640b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.788+0000 7f2f69abf640 1 -- 172.21.15.50:0/3756865713 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640c9330 con 0x7f2f640b3010 2023-08-10T10:47:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.788+0000 7f2f6aac1640 1 --2- 172.21.15.50:0/3756865713 >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:47:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.790+0000 7f2f69abf640 1 --2- 172.21.15.50:0/3756865713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 0x7f2f640696a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097a0 tx=0x7f2f5402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969b7397151814ad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.790+0000 7f2f692be640 1 -- 172.21.15.50:0/3756865713 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5402d040 con 0x7f2f640b3010 2023-08-10T10:47:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f692be640 1 -- 172.21.15.50:0/3756865713 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54031810 con 0x7f2f640b3010 2023-08-10T10:47:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f692be640 1 -- 172.21.15.50:0/3756865713 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54031ba0 con 0x7f2f640b3010 2023-08-10T10:47:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 -- 172.21.15.50:0/3756865713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 msgr2=0x7f2f640696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3756865713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 0x7f2f640696a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097a0 tx=0x7f2f5402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 -- 172.21.15.50:0/3756865713 shutdown_connections 2023-08-10T10:47:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3756865713 >> v2:172.21.15.117:3300/0 conn(0x7f2f640c9b30 0x7f2f64069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3756865713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f640b3010 0x7f2f640696a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 -- 172.21.15.50:0/3756865713 >> 172.21.15.50:0/3756865713 conn(0x7f2f6406b590 msgr2=0x7f2f640ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 -- 172.21.15.50:0/3756865713 shutdown_connections 2023-08-10T10:47:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.791+0000 7f2f6c524640 1 -- 172.21.15.50:0/3756865713 wait complete. 2023-08-10T10:47:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.793+0000 7f2f6c524640 1 Processor -- start 2023-08-10T10:47:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.793+0000 7f2f6c524640 1 -- start start 2023-08-10T10:47:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 0x7f2f640c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f6415ccb0 0x7f2f6406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64150120 con 0x7f2f640c9b30 2023-08-10T10:47:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640c5e20 con 0x7f2f640b3010 2023-08-10T10:47:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.794+0000 7f2f6c524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640c61e0 con 0x7f2f6415ccb0 2023-08-10T10:47:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45386/0 (socket says 172.21.15.50:45386) 2023-08-10T10:47:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 -- 172.21.15.50:0/3156791636 learned_addr learned my addr 172.21.15.50:0/3156791636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f6a2c0640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 0x7f2f640c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f6aac1640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f6415ccb0 0x7f2f6406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 -- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f6415ccb0 msgr2=0x7f2f6406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f6415ccb0 0x7f2f6406ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 -- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 msgr2=0x7f2f640c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 0x7f2f640c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f69abf640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009b30 con 0x7f2f640c9b30 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.795+0000 7f2f6a2c0640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 0x7f2f640c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f69abf640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f2f540098c0 tx=0x7f2f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5403ace0 con 0x7f2f640c9b30 2023-08-10T10:47:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5403ae60 con 0x7f2f640c9b30 2023-08-10T10:47:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54044640 con 0x7f2f640c9b30 2023-08-10T10:47:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f54009400 con 0x7f2f640c9b30 2023-08-10T10:47:10.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.796+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f640c67a0 con 0x7f2f640c9b30 2023-08-10T10:47:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.798+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6404e270 con 0x7f2f640c9b30 2023-08-10T10:47:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.798+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f5404d440 con 0x7f2f640c9b30 2023-08-10T10:47:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.799+0000 7f2f5affd640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 0x7f2f4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.800+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f540ab850 con 0x7f2f640c9b30 2023-08-10T10:47:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.800+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f2f48072da0 con 0x7f2f640c9b30 2023-08-10T10:47:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.800+0000 7f2f6a2c0640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 0x7f2f4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.801+0000 7f2f6a2c0640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 0x7f2f4806d110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2f60001660 tx=0x7f2f60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:10.804+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2f54076860 con 0x7f2f640c9b30 2023-08-10T10:47:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.035+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f640cab50 con 0x7f2f640c9b30 2023-08-10T10:47:11.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.036+0000 7f2f5affd640 1 -- 172.21.15.50:0/3156791636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f2f54035030 con 0x7f2f640c9b30 2023-08-10T10:47:11.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:11.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:47:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:47:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 msgr2=0x7f2f4806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 0x7f2f4806d110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2f60001660 tx=0x7f2f60009040 comp rx=0 tx=0).stop 2023-08-10T10:47:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 msgr2=0x7f2f6414fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f2f540098c0 tx=0x7f2f540046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 shutdown_connections 2023-08-10T10:47:11.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f6415ccb0 0x7f2f6406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f640c9b30 0x7f2f6414fbe0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f4806ac50 0x7f2f4806d110 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 --2- 172.21.15.50:0/3156791636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f640b3010 0x7f2f640c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 >> 172.21.15.50:0/3156791636 conn(0x7f2f6406b590 msgr2=0x7f2f640cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:11.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 shutdown_connections 2023-08-10T10:47:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.039+0000 7f2f6c524640 1 -- 172.21.15.50:0/3156791636 wait complete. 2023-08-10T10:47:11.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.286+0000 7fec60898640 1 Processor -- start 2023-08-10T10:47:11.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.287+0000 7fec60898640 1 -- start start 2023-08-10T10:47:11.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.288+0000 7fec60898640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec5c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.288+0000 7fec60898640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec5c0b19d0 0x7fec5c0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.288+0000 7fec60898640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0b1f10 con 0x7fec5c15f2b0 2023-08-10T10:47:11.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec60898640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0b21f0 con 0x7fec5c0b19d0 2023-08-10T10:47:11.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec60898640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15e5c0 con 0x7fec5c15a940 2023-08-10T10:47:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec5c15f2b0 0x7fec5c0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43098/0 (socket says 172.21.15.50:43098) 2023-08-10T10:47:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5affd640 1 -- 172.21.15.50:0/2505531487 learned_addr learned my addr 172.21.15.50:0/2505531487 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec5c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5bfff640 1 --2- 172.21.15.50:0/2505531487 >> v2:172.21.15.117:3300/0 conn(0x7fec5c0b19d0 0x7fec5c0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759469520 0 0) 0x7fec5c0b1f10 con 0x7fec5c15f2b0 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.289+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec44003520 con 0x7fec5c15f2b0 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275978244 0 0) 0x7fec44003520 con 0x7fec5c15f2b0 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 msgr2=0x7fec5c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec5c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 >> v2:172.21.15.117:3300/0 conn(0x7fec5c0b19d0 msgr2=0x7fec5c0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 --2- 172.21.15.50:0/2505531487 >> v2:172.21.15.117:3300/0 conn(0x7fec5c0b19d0 0x7fec5c0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15e7d0 con 0x7fec5c15f2b0 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fec50001690 con 0x7fec5c15f2b0 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 >> v1:172.21.15.50:6789/0 conn(0x7fec5c15f2b0 legacy=0x7fec5c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec440039e0 0x7fec44003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec44004d00 0x7fec44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15e5c0 con 0x7fec440039e0 2023-08-10T10:47:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4400b980 con 0x7fec44004d00 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4400bb10 con 0x7fec5c15a940 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.290+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec440039e0 0x7fec44003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5affd640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5b7fe640 1 -- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 msgr2=0x7fec440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5bfff640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec44004d00 0x7fec44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5b7fe640 1 -- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec44004d00 msgr2=0x7fec44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec44004d00 0x7fec44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5b7fe640 1 -- 172.21.15.50:0/2505531487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44003520 con 0x7fec440039e0 2023-08-10T10:47:11.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.291+0000 7fec5affd640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c15a940 0x7fec440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:11.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.292+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec440039e0 0x7fec44003e00 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009ac0 tx=0x7fec440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9e1c918c566e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.292+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c02c6b0 con 0x7fec440039e0 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.292+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c02c810 con 0x7fec440039e0 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.292+0000 7fec5a7fc640 1 -- 172.21.15.50:0/2505531487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c02cba0 con 0x7fec440039e0 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 -- 172.21.15.50:0/2505531487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec440039e0 msgr2=0x7fec44003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 --2- 172.21.15.50:0/2505531487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec440039e0 0x7fec44003e00 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009ac0 tx=0x7fec440057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec5bfff640 1 -- 172.21.15.50:0/2505531487 reap_dead start 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 -- 172.21.15.50:0/2505531487 shutdown_connections 2023-08-10T10:47:11.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 -- 172.21.15.50:0/2505531487 >> 172.21.15.50:0/2505531487 conn(0x7fec5c06ab80 msgr2=0x7fec5c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 -- 172.21.15.50:0/2505531487 shutdown_connections 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.293+0000 7fec60898640 1 -- 172.21.15.50:0/2505531487 wait complete. 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.295+0000 7fec60898640 1 Processor -- start 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.295+0000 7fec60898640 1 -- start start 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 0x7fec5c070300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c0c3b90 0x7fec5c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0715d0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c070840 con 0x7fec440039e0 2023-08-10T10:47:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec60898640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c070a50 con 0x7fec5c0c3b90 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45398/0 (socket says 172.21.15.50:45398) 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.296+0000 7fec5bfff640 1 -- 172.21.15.50:0/365836457 learned_addr learned my addr 172.21.15.50:0/365836457 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5affd640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c0c3b90 0x7fec5c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 0x7fec5c070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 -- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c0c3b90 msgr2=0x7fec5c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c0c3b90 0x7fec5c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 -- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 msgr2=0x7fec5c070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 0x7fec5c070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c070d30 con 0x7fec5c15b5e0 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 0x7fec5c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec5bfff640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b1080 tx=0x7fec5400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54017400 con 0x7fec5c15b5e0 2023-08-10T10:47:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54011040 con 0x7fec5c15b5e0 2023-08-10T10:47:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540177c0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.297+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c071010 con 0x7fec5c15b5e0 2023-08-10T10:47:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.298+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0c4010 con 0x7fec5c15b5e0 2023-08-10T10:47:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.299+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c066e30 con 0x7fec5c15b5e0 2023-08-10T10:47:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.300+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec54017920 con 0x7fec5c15b5e0 2023-08-10T10:47:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.301+0000 7fec43fff640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 0x7fec4806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.301+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec540898c0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.301+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 0x7fec4806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.301+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fec48072dd0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.302+0000 7fec5b7fe640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 0x7fec4806d140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec4c036000 tx=0x7fec4c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.305+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec540548d0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.497+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec5c0b17b0 con 0x7fec5c15b5e0 2023-08-10T10:47:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.501+0000 7fec43fff640 1 -- 172.21.15.50:0/365836457 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+18377 (secure 0 0 0) 0x7fec5401c070 con 0x7fec5c15b5e0 2023-08-10T10:47:11.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:11.503 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":147,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:06.562447+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.503+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 msgr2=0x7fec4806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.503+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 0x7fec4806d140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec4c036000 tx=0x7fec4c030000 comp rx=0 tx=0).stop 2023-08-10T10:47:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.503+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 msgr2=0x7fec5c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.503+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b1080 tx=0x7fec5400f4a0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 shutdown_connections 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c15b5e0 0x7fec5c15ba60 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec5c0c3b90 0x7fec5c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fec4806ac80 0x7fec4806d140 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 --2- 172.21.15.50:0/365836457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec440039e0 0x7fec5c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 >> 172.21.15.50:0/365836457 conn(0x7fec5c06ab80 msgr2=0x7fec5c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 shutdown_connections 2023-08-10T10:47:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.504+0000 7fec60898640 1 -- 172.21.15.50:0/365836457 wait complete. 2023-08-10T10:47:11.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:47:11.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.744+0000 7fdc83fff640 1 Processor -- start 2023-08-10T10:47:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.744+0000 7fdc83fff640 1 -- start start 2023-08-10T10:47:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b1da0 0x7fdc840cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc83fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc84153c30 0x7fdc840cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc83fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8415d010 con 0x7fdc84153850 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc83fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8415d290 con 0x7fdc84153c30 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc83fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8415d570 con 0x7fdc840b1da0 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc82ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc84153850 0x7fdc840b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43110/0 (socket says 172.21.15.50:43110) 2023-08-10T10:47:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.746+0000 7fdc82ffd640 1 -- 172.21.15.50:0/859005849 learned_addr learned my addr 172.21.15.50:0/859005849 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b1da0 0x7fdc840cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745154756 0 0) 0x7fdc8415d010 con 0x7fdc84153850 2023-08-10T10:47:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc70003520 con 0x7fdc84153850 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc837fe640 1 --2- 172.21.15.50:0/859005849 >> v2:172.21.15.117:3300/0 conn(0x7fdc84153c30 0x7fdc840cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336542202 0 0) 0x7fdc70003520 con 0x7fdc84153850 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b1da0 msgr2=0x7fdc840cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b1da0 0x7fdc840cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 >> v2:172.21.15.117:3300/0 conn(0x7fdc84153c30 msgr2=0x7fdc840cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 --2- 172.21.15.50:0/859005849 >> v2:172.21.15.117:3300/0 conn(0x7fdc84153c30 0x7fdc840cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8415d850 con 0x7fdc84153850 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fdc74001670 con 0x7fdc84153850 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 >> v1:172.21.15.50:6789/0 conn(0x7fdc84153850 legacy=0x7fdc840b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700039e0 0x7fdc70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc70005180 0x7fdc7000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8415d290 con 0x7fdc700047c0 2023-08-10T10:47:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8415d570 con 0x7fdc700039e0 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.747+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7000bec0 con 0x7fdc70005180 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc837fe640 1 --2- 172.21.15.50:0/859005849 >> v2:172.21.15.117:3300/0 conn(0x7fdc84153c30 0x7fdc840cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc82ffd640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700039e0 0x7fdc70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc837fe640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc70005180 0x7fdc7000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 -- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc70005180 msgr2=0x7fdc7000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc70005180 0x7fdc7000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 -- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700039e0 msgr2=0x7fdc70003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700039e0 0x7fdc70003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.748+0000 7fdc7bfff640 1 -- 172.21.15.50:0/859005849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70003520 con 0x7fdc700047c0 2023-08-10T10:47:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc70004c40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009ac0 tx=0x7fdc700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef9fc43605be4a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c02c6b0 con 0x7fdc700047c0 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c02c810 con 0x7fdc700047c0 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc827fc640 1 -- 172.21.15.50:0/859005849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c02cba0 con 0x7fdc700047c0 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc83fff640 1 -- 172.21.15.50:0/859005849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 msgr2=0x7fdc70004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc83fff640 1 --2- 172.21.15.50:0/859005849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc70004c40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009ac0 tx=0x7fdc700057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.750+0000 7fdc837fe640 1 -- 172.21.15.50:0/859005849 reap_dead start 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.751+0000 7fdc83fff640 1 -- 172.21.15.50:0/859005849 shutdown_connections 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.751+0000 7fdc83fff640 1 -- 172.21.15.50:0/859005849 >> 172.21.15.50:0/859005849 conn(0x7fdc84069880 msgr2=0x7fdc84069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.751+0000 7fdc83fff640 1 -- 172.21.15.50:0/859005849 shutdown_connections 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.751+0000 7fdc83fff640 1 -- 172.21.15.50:0/859005849 wait complete. 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.753+0000 7fdc83fff640 1 Processor -- start 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.753+0000 7fdc83fff640 1 -- start start 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc84151ca0 0x7fdc840b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b5e30 0x7fdc841f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b62a0 con 0x7fdc700047c0 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840ca120 con 0x7fdc84151ca0 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc83fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c9af0 con 0x7fdc840b5e30 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45418/0 (socket says 172.21.15.50:45418) 2023-08-10T10:47:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 -- 172.21.15.50:0/3222546534 learned_addr learned my addr 172.21.15.50:0/3222546534 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 -- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b5e30 msgr2=0x7fdc841f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b5e30 0x7fdc841f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 -- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc84151ca0 msgr2=0x7fdc840b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.754+0000 7fdc82ffd640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc84151ca0 0x7fdc840b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc82ffd640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc841f2e20 con 0x7fdc700047c0 2023-08-10T10:47:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc82ffd640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fdc74000fb0 tx=0x7fdc74004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400f660 con 0x7fdc700047c0 2023-08-10T10:47:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400f800 con 0x7fdc700047c0 2023-08-10T10:47:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400fbb0 con 0x7fdc700047c0 2023-08-10T10:47:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840c9db0 con 0x7fdc700047c0 2023-08-10T10:47:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.755+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc841f25e0 con 0x7fdc700047c0 2023-08-10T10:47:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.757+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840c9950 con 0x7fdc700047c0 2023-08-10T10:47:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.758+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc7400fd10 con 0x7fdc700047c0 2023-08-10T10:47:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.759+0000 7fdc80ff9640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 0x7fdc6406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.759+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc740894b0 con 0x7fdc700047c0 2023-08-10T10:47:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.759+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 0x7fdc6406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.760+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fdc64072dd0 con 0x7fdc700047c0 2023-08-10T10:47:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.760+0000 7fdc7bfff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 0x7fdc6406d140 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c036000 tx=0x7fdc6c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.764+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc840c9950 con 0x7fdc700047c0 2023-08-10T10:47:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.997+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc840c9950 con 0x7fdc700047c0 2023-08-10T10:47:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:11.998+0000 7fdc80ff9640 1 -- 172.21.15.50:0/3222546534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fdc840c9950 con 0x7fdc700047c0 2023-08-10T10:47:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:12.001 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:47:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:47:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 msgr2=0x7fdc6406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 0x7fdc6406d140 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c036000 tx=0x7fdc6c02e000 comp rx=0 tx=0).stop 2023-08-10T10:47:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 msgr2=0x7fdc840ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fdc74000fb0 tx=0x7fdc74004f90 comp rx=0 tx=0).stop 2023-08-10T10:47:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 shutdown_connections 2023-08-10T10:47:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc840b5e30 0x7fdc841f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc6406ac80 0x7fdc6406d140 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc84151ca0 0x7fdc840b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 --2- 172.21.15.50:0/3222546534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc700047c0 0x7fdc840ca5b0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 >> 172.21.15.50:0/3222546534 conn(0x7fdc84069880 msgr2=0x7fdc840b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 shutdown_connections 2023-08-10T10:47:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.001+0000 7fdc83fff640 1 -- 172.21.15.50:0/3222546534 wait complete. 2023-08-10T10:47:12.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.248+0000 7f897b560640 1 Processor -- start 2023-08-10T10:47:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.248+0000 7f897b560640 1 -- start start 2023-08-10T10:47:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.249+0000 7f897b560640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89740b1da0 0x7f89740cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897b560640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89740cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897b560640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897415d010 con 0x7f8974153850 2023-08-10T10:47:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897b560640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897415d290 con 0x7f89740b1da0 2023-08-10T10:47:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897b560640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897415d570 con 0x7f8974153c30 2023-08-10T10:47:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897a55e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8974153850 0x7f89740b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43120/0 (socket says 172.21.15.50:43120) 2023-08-10T10:47:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897a55e640 1 -- 172.21.15.50:0/3484708847 learned_addr learned my addr 172.21.15.50:0/3484708847 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f897ad5f640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89740cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.250+0000 7f8979d5d640 1 --2- 172.21.15.50:0/3484708847 >> v2:172.21.15.117:3300/0 conn(0x7f89740b1da0 0x7f89740cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464053865 0 0) 0x7f897415d010 con 0x7f8974153850 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8960003520 con 0x7f8974153850 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2012225906 0 0) 0x7f8960003520 con 0x7f8974153850 2023-08-10T10:47:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 msgr2=0x7f89740cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89740cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 >> v2:172.21.15.117:3300/0 conn(0x7f89740b1da0 msgr2=0x7f89740cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 --2- 172.21.15.50:0/3484708847 >> v2:172.21.15.117:3300/0 conn(0x7f89740b1da0 0x7f89740cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897415d850 con 0x7f8974153850 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f89700019f0 con 0x7f8974153850 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 >> v1:172.21.15.50:6789/0 conn(0x7f8974153850 legacy=0x7f89740b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89600039e0 0x7f8960003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f8960005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897415d290 con 0x7f8960004d00 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897415d570 con 0x7f89600039e0 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.251+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896000b980 con 0x7f8974153c30 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f8960005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f8979d5d640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897a55e640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89600039e0 0x7f8960003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 -- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 msgr2=0x7f89600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:12.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974153c30 0x7f89600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 -- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89600039e0 msgr2=0x7f8960003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:12.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89600039e0 0x7f8960003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.252+0000 7f897ad5f640 1 -- 172.21.15.50:0/3484708847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960003520 con 0x7f8960004d00 2023-08-10T10:47:12.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.253+0000 7f897ad5f640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f8960005180 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f896c009ab0 tx=0x7f89600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5722c160f901e904 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0059e0 con 0x7f8960004d00 2023-08-10T10:47:12.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c005b40 con 0x7f8960004d00 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897955c640 1 -- 172.21.15.50:0/3484708847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c02c770 con 0x7f8960004d00 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897b560640 1 -- 172.21.15.50:0/3484708847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 msgr2=0x7f8960005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897b560640 1 --2- 172.21.15.50:0/3484708847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f8960005180 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f896c009ab0 tx=0x7f89600057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897ad5f640 1 -- 172.21.15.50:0/3484708847 reap_dead start 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897b560640 1 -- 172.21.15.50:0/3484708847 shutdown_connections 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.254+0000 7f897b560640 1 -- 172.21.15.50:0/3484708847 >> 172.21.15.50:0/3484708847 conn(0x7f8974069880 msgr2=0x7f8974069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.255+0000 7f897b560640 1 -- 172.21.15.50:0/3484708847 shutdown_connections 2023-08-10T10:47:12.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.255+0000 7f897b560640 1 -- 172.21.15.50:0/3484708847 wait complete. 2023-08-10T10:47:12.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.257+0000 7f897b560640 1 Processor -- start 2023-08-10T10:47:12.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.257+0000 7f897b560640 1 -- start start 2023-08-10T10:47:12.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 0x7f89741f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89740b5930 0x7f89740b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b62f0 con 0x7f8960004d00 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740cbb90 con 0x7f89740b5930 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897b560640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89740cbe10 con 0x7f89740b0c10 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45436/0 (socket says 172.21.15.50:45436) 2023-08-10T10:47:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 -- 172.21.15.50:0/448241311 learned_addr learned my addr 172.21.15.50:0/448241311 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f8979d5d640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 0x7f89741f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 -- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 msgr2=0x7f89741f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 0x7f89741f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 -- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89740b5930 msgr2=0x7f89740b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89740b5930 0x7f89740b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f897a55e640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740cc0f0 con 0x7f8960004d00 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.258+0000 7f8979d5d640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 0x7f89741f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f897a55e640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8970002230 tx=0x7f897000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000edd0 con 0x7f8960004d00 2023-08-10T10:47:12.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970013420 con 0x7f8960004d00 2023-08-10T10:47:12.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700137d0 con 0x7f8960004d00 2023-08-10T10:47:12.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89740cc3d0 con 0x7f8960004d00 2023-08-10T10:47:12.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.259+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740d35c0 con 0x7f8960004d00 2023-08-10T10:47:12.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.260+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89740cc8f0 con 0x7f8960004d00 2023-08-10T10:47:12.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.261+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8970013930 con 0x7f8960004d00 2023-08-10T10:47:12.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.262+0000 7f896affd640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 0x7f895806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.262+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8970089cc0 con 0x7f8960004d00 2023-08-10T10:47:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.263+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f8958072da0 con 0x7f8960004d00 2023-08-10T10:47:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.263+0000 7f8979d5d640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 0x7f895806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.263+0000 7f8979d5d640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 0x7f895806d110 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89740c89c0 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.267+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f89740cc8f0 con 0x7f8960004d00 2023-08-10T10:47:12.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.499+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89740cc8f0 con 0x7f8960004d00 2023-08-10T10:47:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.500+0000 7f896affd640 1 -- 172.21.15.50:0/448241311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f89740cc8f0 con 0x7f8960004d00 2023-08-10T10:47:12.502 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:12.502 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:46:20.143240+0000","modified":"2023-08-10T10:46:23.695887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/935015286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":935015286},{"type":"v1","addr":"172.21.15.50:6837","nonce":935015286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-10T10:47:12.502 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2023-08-10T10:47:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.502+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 msgr2=0x7f895806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.502+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 0x7f895806d110 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89740c89c0 tx=0x7f8964008040 comp rx=0 tx=0).stop 2023-08-10T10:47:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 msgr2=0x7f89740b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8970002230 tx=0x7f897000e530 comp rx=0 tx=0).stop 2023-08-10T10:47:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 shutdown_connections 2023-08-10T10:47:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f895806ac50 0x7f895806d110 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89740b5930 0x7f89740b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89740b0c10 0x7f89741f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 --2- 172.21.15.50:0/448241311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8960004d00 0x7f89740b6bc0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 >> 172.21.15.50:0/448241311 conn(0x7f8974069880 msgr2=0x7f89740b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 shutdown_connections 2023-08-10T10:47:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.503+0000 7f897b560640 1 -- 172.21.15.50:0/448241311 wait complete. 2023-08-10T10:47:12.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.754+0000 7f107b342640 1 Processor -- start 2023-08-10T10:47:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.754+0000 7f107b342640 1 -- start start 2023-08-10T10:47:12.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.756+0000 7f107b342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 0x7f10740aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.756+0000 7f107b342640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10740b19d0 0x7f10740b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.756+0000 7f107b342640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10740b1f10 con 0x7f107415f2b0 2023-08-10T10:47:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.756+0000 7f107b342640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740b21f0 con 0x7f10740b19d0 2023-08-10T10:47:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.756+0000 7f107b342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107415e5c0 con 0x7f107415a940 2023-08-10T10:47:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.757+0000 7f107ab41640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10740b19d0 0x7f10740b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.757+0000 7f107a340640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 0x7f10740aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.757+0000 7f107ab41640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10740b19d0 0x7f10740b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:35720/0 (socket says 172.21.15.50:35720) 2023-08-10T10:47:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.757+0000 7f107ab41640 1 -- 172.21.15.50:0/1588565765 learned_addr learned my addr 172.21.15.50:0/1588565765 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:12.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.758+0000 7f107ab41640 1 -- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 msgr2=0x7f10740aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.758+0000 7f107ab41640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 0x7f10740aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.758+0000 7f107ab41640 1 -- 172.21.15.50:0/1588565765 >> v1:172.21.15.117:6789/0 conn(0x7f107415f2b0 legacy=0x7f10740b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.758+0000 7f107ab41640 1 -- 172.21.15.50:0/1588565765 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107415e7d0 con 0x7f10740b19d0 2023-08-10T10:47:12.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.758+0000 7f107a340640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 0x7f10740aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:47:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.759+0000 7f107ab41640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10740b19d0 0x7f10740b0450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f106c009e50 tx=0x7f106c02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce173a5175b38bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.759+0000 7f107933e640 1 -- 172.21.15.50:0/1588565765 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c02ca60 con 0x7f10740b19d0 2023-08-10T10:47:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.759+0000 7f107933e640 1 -- 172.21.15.50:0/1588565765 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c02cbc0 con 0x7f10740b19d0 2023-08-10T10:47:12.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.759+0000 7f107933e640 1 -- 172.21.15.50:0/1588565765 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0343f0 con 0x7f10740b19d0 2023-08-10T10:47:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 -- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10740b19d0 msgr2=0x7f10740b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10740b19d0 0x7f10740b0450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f106c009e50 tx=0x7f106c02bec0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 -- 172.21.15.50:0/1588565765 shutdown_connections 2023-08-10T10:47:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10740b19d0 0x7f10740b0450 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 --2- 172.21.15.50:0/1588565765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107415a940 0x7f10740aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 -- 172.21.15.50:0/1588565765 >> 172.21.15.50:0/1588565765 conn(0x7f107406ab80 msgr2=0x7f107406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 -- 172.21.15.50:0/1588565765 shutdown_connections 2023-08-10T10:47:12.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.760+0000 7f107b342640 1 -- 172.21.15.50:0/1588565765 wait complete. 2023-08-10T10:47:12.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.763+0000 7f107b342640 1 Processor -- start 2023-08-10T10:47:12.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.763+0000 7f107b342640 1 -- start start 2023-08-10T10:47:12.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10740b19d0 0x7f10740c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107415a940 0x7f10741f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074158340 con 0x7f107415f2b0 2023-08-10T10:47:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10741576c0 con 0x7f107415a940 2023-08-10T10:47:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107b342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10741579a0 con 0x7f10740b19d0 2023-08-10T10:47:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.764+0000 7f107ab41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45442/0 (socket says 172.21.15.50:45442) 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 -- 172.21.15.50:0/2436902636 learned_addr learned my addr 172.21.15.50:0/2436902636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107a340640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10740b19d0 0x7f10740c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f1079b3f640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107415a940 0x7f10741f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 -- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10740b19d0 msgr2=0x7f10740c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10740b19d0 0x7f10740c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 -- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107415a940 msgr2=0x7f10741f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107415a940 0x7f10741f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070009400 con 0x7f107415f2b0 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.765+0000 7f107ab41640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f106c009e50 tx=0x7f106c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.766+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c009510 con 0x7f107415f2b0 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.766+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c03e450 con 0x7f107415f2b0 2023-08-10T10:47:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.766+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c03e800 con 0x7f107415f2b0 2023-08-10T10:47:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.766+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c009b30 con 0x7f107415f2b0 2023-08-10T10:47:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.766+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074157f60 con 0x7f107415f2b0 2023-08-10T10:47:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.767+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1074158480 con 0x7f107415f2b0 2023-08-10T10:47:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.768+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f106c03e960 con 0x7f107415f2b0 2023-08-10T10:47:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.769+0000 7f106affd640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 0x7f105806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.769+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f106c0ac1b0 con 0x7f107415f2b0 2023-08-10T10:47:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.769+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f1058072da0 con 0x7f107415f2b0 2023-08-10T10:47:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.769+0000 7f107a340640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 0x7f105806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.770+0000 7f107a340640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 0x7f105806d110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1070009bc0 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.773+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1074158480 con 0x7f107415f2b0 2023-08-10T10:47:12.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.966+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1074158480 con 0x7f107415f2b0 2023-08-10T10:47:12.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.968+0000 7f106affd640 1 -- 172.21.15.50:0/2436902636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+18377 (secure 0 0 0) 0x7f1074158480 con 0x7f107415f2b0 2023-08-10T10:47:12.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:12.970 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":147,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:06.562447+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:46:18.537056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-10T10:46:19.150540+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.970+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 msgr2=0x7f105806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 0x7f105806d110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1070009bc0 tx=0x7f1070008040 comp rx=0 tx=0).stop 2023-08-10T10:47:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 msgr2=0x7f107406e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f106c009e50 tx=0x7f106c004a40 comp rx=0 tx=0).stop 2023-08-10T10:47:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 shutdown_connections 2023-08-10T10:47:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107415f2b0 0x7f107406e700 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f105806ac50 0x7f105806d110 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107415a940 0x7f10741f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 --2- 172.21.15.50:0/2436902636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10740b19d0 0x7f10740c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 >> 172.21.15.50:0/2436902636 conn(0x7f107406ab80 msgr2=0x7f1074159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 shutdown_connections 2023-08-10T10:47:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:12.971+0000 7f107b342640 1 -- 172.21.15.50:0/2436902636 wait complete. 2023-08-10T10:47:12.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:47:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.223+0000 7fde7b2c5640 1 Processor -- start 2023-08-10T10:47:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.223+0000 7fde7b2c5640 1 -- start start 2023-08-10T10:47:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.225+0000 7fde7b2c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde740cd730 0x7fde740d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.225+0000 7fde7b2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde740cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.225+0000 7fde7b2c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde740d1220 con 0x7fde740b5af0 2023-08-10T10:47:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.225+0000 7fde7b2c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740d2930 con 0x7fde740cd730 2023-08-10T10:47:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.225+0000 7fde7b2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740b8a30 con 0x7fde7415ce00 2023-08-10T10:47:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79061640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde740cd730 0x7fde740d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79862640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde740b5af0 0x7fde740d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43126/0 (socket says 172.21.15.50:43126) 2023-08-10T10:47:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79862640 1 -- 172.21.15.50:0/1805183153 learned_addr learned my addr 172.21.15.50:0/1805183153 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde78860640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde740cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79061640 1 -- 172.21.15.50:0/1805183153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 msgr2=0x7fde740cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79061640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde740cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79061640 1 -- 172.21.15.50:0/1805183153 >> v1:172.21.15.50:6789/0 conn(0x7fde740b5af0 legacy=0x7fde740d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde79061640 1 -- 172.21.15.50:0/1805183153 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740b1e70 con 0x7fde740cd730 2023-08-10T10:47:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.226+0000 7fde6bfff640 1 -- 172.21.15.50:0/1805183153 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123487687 0 0) 0x7fde740d1220 con 0x7fde740b5af0 2023-08-10T10:47:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.227+0000 7fde79061640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740cd730 0x7fde740d23f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fde700097a0 tx=0x7fde7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a694dcb8d3fceee4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde6bfff640 1 -- 172.21.15.50:0/1805183153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70031830 con 0x7fde740cd730 2023-08-10T10:47:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde6bfff640 1 -- 172.21.15.50:0/1805183153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70031990 con 0x7fde740cd730 2023-08-10T10:47:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde6bfff640 1 -- 172.21.15.50:0/1805183153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70031d20 con 0x7fde740cd730 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 -- 172.21.15.50:0/1805183153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740cd730 msgr2=0x7fde740d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740cd730 0x7fde740d23f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fde700097a0 tx=0x7fde7002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 -- 172.21.15.50:0/1805183153 shutdown_connections 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde740cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/1805183153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740cd730 0x7fde740d23f0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 -- 172.21.15.50:0/1805183153 >> 172.21.15.50:0/1805183153 conn(0x7fde740d2c60 msgr2=0x7fde740d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 -- 172.21.15.50:0/1805183153 shutdown_connections 2023-08-10T10:47:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.228+0000 7fde7b2c5640 1 -- 172.21.15.50:0/1805183153 wait complete. 2023-08-10T10:47:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.230+0000 7fde7b2c5640 1 Processor -- start 2023-08-10T10:47:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.230+0000 7fde7b2c5640 1 -- start start 2023-08-10T10:47:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde740cd730 0x7fde7415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde7415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740c6730 con 0x7fde740b5af0 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7415f7c0 con 0x7fde740cd730 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde7b2c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740b3bd0 con 0x7fde7415ce00 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.231+0000 7fde79061640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45458/0 (socket says 172.21.15.50:45458) 2023-08-10T10:47:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 -- 172.21.15.50:0/2931608220 learned_addr learned my addr 172.21.15.50:0/2931608220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79862640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde7415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 -- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 msgr2=0x7fde7415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde78860640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde740cd730 0x7fde7415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde7415f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 -- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde740cd730 msgr2=0x7fde7415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde740cd730 0x7fde7415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009400 con 0x7fde740b5af0 2023-08-10T10:47:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.232+0000 7fde79061640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fde7002bee0 tx=0x7fde700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.233+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7003ba70 con 0x7fde740b5af0 2023-08-10T10:47:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.233+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7003bbf0 con 0x7fde740b5af0 2023-08-10T10:47:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.233+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700433f0 con 0x7fde740b5af0 2023-08-10T10:47:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.233+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde740c6980 con 0x7fde740b5af0 2023-08-10T10:47:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.233+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde740c6f40 con 0x7fde740b5af0 2023-08-10T10:47:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.234+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde740c7130 con 0x7fde740b5af0 2023-08-10T10:47:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.235+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde7004c3b0 con 0x7fde740b5af0 2023-08-10T10:47:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.236+0000 7fde69ffb640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 0x7fde5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.236+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde700ab560 con 0x7fde740b5af0 2023-08-10T10:47:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.237+0000 7fde78860640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 0x7fde5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.237+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fde58072da0 con 0x7fde740b5af0 2023-08-10T10:47:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.237+0000 7fde78860640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 0x7fde5806d110 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde64006fd0 tx=0x7fde64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.241+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde70048060 con 0x7fde740b5af0 2023-08-10T10:47:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.473+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde7404e270 con 0x7fde740b5af0 2023-08-10T10:47:13.475 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:47:13.474+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:47:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.479+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(148..148 src has 1..148) v4 ==== 374+0+0 (secure 0 0 0) 0x7fde7007e280 con 0x7fde740b5af0 2023-08-10T10:47:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.479+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fde58073650 con 0x7fde740b5af0 2023-08-10T10:47:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.484+0000 7fde69ffb640 1 -- 172.21.15.50:0/2931608220 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde70076600 con 0x7fde740b5af0 2023-08-10T10:47:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:47:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.490+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 msgr2=0x7fde5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.490+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 0x7fde5806d110 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde64006fd0 tx=0x7fde64008040 comp rx=0 tx=0).stop 2023-08-10T10:47:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.490+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 msgr2=0x7fde74148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.490+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fde7002bee0 tx=0x7fde700046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 shutdown_connections 2023-08-10T10:47:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7415ce00 0x7fde7415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde5806ac50 0x7fde5806d110 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde740cd730 0x7fde7415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 --2- 172.21.15.50:0/2931608220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde740b5af0 0x7fde74148d50 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 >> 172.21.15.50:0/2931608220 conn(0x7fde740d2c60 msgr2=0x7fde7415bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 shutdown_connections 2023-08-10T10:47:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.491+0000 7fde7b2c5640 1 -- 172.21.15.50:0/2931608220 wait complete. 2023-08-10T10:47:13.498 INFO:tasks.ceph.mds.c.smithi050.stderr: -9637> 2023-08-10T10:46:21.620+0000 7f4d290a3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:47:13.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:47:13.568 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:47:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.726+0000 7f3506e0f640 1 Processor -- start 2023-08-10T10:47:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.726+0000 7f3506e0f640 1 -- start start 2023-08-10T10:47:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f3506e0f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f35000cf3b0 0x7f35000d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f3506e0f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3500160b60 con 0x7f350015ce70 2023-08-10T10:47:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f3506e0f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000b8200 con 0x7f35000b1a30 2023-08-10T10:47:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f3506e0f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3500161700 con 0x7f35000cf3b0 2023-08-10T10:47:13.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f350560c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f350015ce70 0x7f35000cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43142/0 (socket says 172.21.15.50:43142) 2023-08-10T10:47:13.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.728+0000 7f350560c640 1 -- 172.21.15.50:0/2387701737 learned_addr learned my addr 172.21.15.50:0/2387701737 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:13.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3505e0d640 1 --2- 172.21.15.50:0/2387701737 >> v2:172.21.15.117:3300/0 conn(0x7f35000cf3b0 0x7f35000d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387498162 0 0) 0x7f3500160b60 con 0x7f350015ce70 2023-08-10T10:47:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34ec003520 con 0x7f350015ce70 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128893382 0 0) 0x7f34ec003520 con 0x7f350015ce70 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 >> v2:172.21.15.117:3300/0 conn(0x7f35000cf3b0 msgr2=0x7f35000d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 --2- 172.21.15.50:0/2387701737 >> v2:172.21.15.117:3300/0 conn(0x7f35000cf3b0 0x7f35000d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.729+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 >> v1:172.21.15.117:6789/0 conn(0x7f35000b1a30 legacy=0x7f3500160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000b8750 con 0x7f350015ce70 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f34f0001670 con 0x7f350015ce70 2023-08-10T10:47:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 >> v1:172.21.15.50:6789/0 conn(0x7f350015ce70 legacy=0x7f35000cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec003970 0x7f34ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34ec0047c0 0x7f34ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 0x7f34ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3500161700 con 0x7f34ec005180 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec00c020 con 0x7f34ec003970 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec00c1e0 con 0x7f34ec0047c0 2023-08-10T10:47:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f350660e640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 0x7f34ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f3505e0d640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec003970 0x7f34ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.730+0000 7f350560c640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34ec0047c0 0x7f34ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.731+0000 7f350660e640 1 -- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34ec0047c0 msgr2=0x7f34ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.731+0000 7f350660e640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34ec0047c0 0x7f34ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.731+0000 7f350660e640 1 -- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec003970 msgr2=0x7f34ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.731+0000 7f350660e640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec003970 0x7f34ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.731+0000 7f350660e640 1 -- 172.21.15.50:0/2387701737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec003520 con 0x7f34ec005180 2023-08-10T10:47:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.732+0000 7f350660e640 1 -- 172.21.15.50:0/2387701737 reap_dead start 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.732+0000 7f350660e640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 0x7f34ec00b980 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f34f8001e50 tx=0x7f34ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1386cafba23980 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.732+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8003b70 con 0x7f34ec005180 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.732+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8003d10 con 0x7f34ec005180 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.732+0000 7f3504e0b640 1 -- 172.21.15.50:0/2387701737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8005310 con 0x7f34ec005180 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 -- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 msgr2=0x7f34ec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 0x7f34ec00b980 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f34f8001e50 tx=0x7f34ec0057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 -- 172.21.15.50:0/2387701737 shutdown_connections 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 --2- 172.21.15.50:0/2387701737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34ec005180 0x7f34ec00b980 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 -- 172.21.15.50:0/2387701737 >> 172.21.15.50:0/2387701737 conn(0x7f35000696a0 msgr2=0x7f3500069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 -- 172.21.15.50:0/2387701737 shutdown_connections 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.733+0000 7f3506e0f640 1 -- 172.21.15.50:0/2387701737 wait complete. 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.735+0000 7f3506e0f640 1 Processor -- start 2023-08-10T10:47:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.735+0000 7f3506e0f640 1 -- start start 2023-08-10T10:47:13.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 0x7f35001f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 0x7f35000cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000cb5a0 con 0x7f35000c99b0 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350015df10 con 0x7f34ec005180 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3506e0f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350015e1f0 con 0x7f35000cbff0 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f350660e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f350660e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45490/0 (socket says 172.21.15.50:45490) 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f350660e640 1 -- 172.21.15.50:0/4203582540 learned_addr learned my addr 172.21.15.50:0/4203582540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.736+0000 7f3505e0d640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 0x7f35001f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 -- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 msgr2=0x7f35000cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350560c640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 0x7f35000cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 0x7f35000cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 -- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 msgr2=0x7f35001f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 0x7f35001f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000cb7f0 con 0x7f35000c99b0 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f3505e0d640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 0x7f35001f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350560c640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 0x7f35000cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f350660e640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005040 tx=0x7f34f80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8006d50 con 0x7f35000c99b0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8039480 con 0x7f35000c99b0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80397f0 con 0x7f35000c99b0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000cbad0 con 0x7f35000c99b0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.737+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350015e8e0 con 0x7f35000c99b0 2023-08-10T10:47:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.738+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35000612b0 con 0x7f35000c99b0 2023-08-10T10:47:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.739+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34f8039950 con 0x7f35000c99b0 2023-08-10T10:47:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.740+0000 7f34f67fc640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 0x7f34e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.741+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f34f80ab1f0 con 0x7f35000c99b0 2023-08-10T10:47:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.741+0000 7f3505e0d640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 0x7f34e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.741+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f34e4072eb0 con 0x7f35000c99b0 2023-08-10T10:47:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.741+0000 7f3505e0d640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 0x7f34e406d110 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0093d0 tx=0x7f34fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.745+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f34f80762e0 con 0x7f35000c99b0 2023-08-10T10:47:13.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:13.977+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35000b1810 con 0x7f35000c99b0 2023-08-10T10:47:14.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:14.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.486+0000 7f34f67fc640 1 -- 172.21.15.50:0/4203582540 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34f8047020 con 0x7f35000c99b0 2023-08-10T10:47:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 msgr2=0x7f34e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 0x7f34e406d110 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0093d0 tx=0x7f34fc008040 comp rx=0 tx=0).stop 2023-08-10T10:47:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 msgr2=0x7f35000c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005040 tx=0x7f34f80014a0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 shutdown_connections 2023-08-10T10:47:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35000c99b0 0x7f35000c9e30 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35000cbff0 0x7f35000cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f34e406ac50 0x7f34e406d110 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 --2- 172.21.15.50:0/4203582540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34ec005180 0x7f35001f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.490+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 >> 172.21.15.50:0/4203582540 conn(0x7f35000696a0 msgr2=0x7f35000cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.491+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 shutdown_connections 2023-08-10T10:47:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.491+0000 7f3506e0f640 1 -- 172.21.15.50:0/4203582540 wait complete. 2023-08-10T10:47:14.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:47:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.797+0000 7f8ad34c5640 1 Processor -- start 2023-08-10T10:47:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.797+0000 7f8ad34c5640 1 -- start start 2023-08-10T10:47:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad34c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8acc15ac00 0x7f8acc06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad34c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8acc069db0 0x7f8acc0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad34c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc15bcb0 con 0x7f8acc15a820 2023-08-10T10:47:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad34c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0c5540 con 0x7f8acc069db0 2023-08-10T10:47:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad34c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc15b0a0 con 0x7f8acc15ac00 2023-08-10T10:47:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad1261640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8acc15a820 0x7f8acc0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43148/0 (socket says 172.21.15.50:43148) 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad1261640 1 -- 172.21.15.50:0/3834104894 learned_addr learned my addr 172.21.15.50:0/3834104894 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/3834104894 >> v2:172.21.15.50:3300/0 conn(0x7f8acc069db0 0x7f8acc0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ad0a60640 1 --2- 172.21.15.50:0/3834104894 >> v2:172.21.15.117:3300/0 conn(0x7f8acc15ac00 0x7f8acc06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.799+0000 7f8ac3fff640 1 -- 172.21.15.50:0/3834104894 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841759814 0 0) 0x7f8acc15bcb0 con 0x7f8acc15a820 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.800+0000 7f8ac3fff640 1 -- 172.21.15.50:0/3834104894 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab8003520 con 0x7f8acc15a820 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.800+0000 7f8ad1a62640 1 -- 172.21.15.50:0/3834104894 >> v2:172.21.15.117:3300/0 conn(0x7f8acc15ac00 msgr2=0x7f8acc06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.800+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/3834104894 >> v2:172.21.15.117:3300/0 conn(0x7f8acc15ac00 0x7f8acc06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.800+0000 7f8ad1a62640 1 -- 172.21.15.50:0/3834104894 >> v1:172.21.15.50:6789/0 conn(0x7f8acc15a820 legacy=0x7f8acc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.800+0000 7f8ad1a62640 1 -- 172.21.15.50:0/3834104894 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc15b380 con 0x7f8acc069db0 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.801+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/3834104894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc069db0 0x7f8acc0cc370 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0cdf20 tx=0x7f8ac402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c34f2c49f8fb36 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.801+0000 7f8ac3fff640 1 -- 172.21.15.50:0/3834104894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac402cbf0 con 0x7f8acc069db0 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.801+0000 7f8ac3fff640 1 -- 172.21.15.50:0/3834104894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac402cd50 con 0x7f8acc069db0 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.801+0000 7f8ac3fff640 1 -- 172.21.15.50:0/3834104894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4034640 con 0x7f8acc069db0 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 -- 172.21.15.50:0/3834104894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc069db0 msgr2=0x7f8acc0cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/3834104894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc069db0 0x7f8acc0cc370 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0cdf20 tx=0x7f8ac402be40 comp rx=0 tx=0).stop 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 -- 172.21.15.50:0/3834104894 shutdown_connections 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/3834104894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc069db0 0x7f8acc0cc370 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/3834104894 >> v2:172.21.15.117:3300/0 conn(0x7f8acc15ac00 0x7f8acc06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 -- 172.21.15.50:0/3834104894 >> 172.21.15.50:0/3834104894 conn(0x7f8acc0b08e0 msgr2=0x7f8acc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 -- 172.21.15.50:0/3834104894 shutdown_connections 2023-08-10T10:47:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.802+0000 7f8ad34c5640 1 -- 172.21.15.50:0/3834104894 wait complete. 2023-08-10T10:47:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.804+0000 7f8ad34c5640 1 Processor -- start 2023-08-10T10:47:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.804+0000 7f8ad34c5640 1 -- start start 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8acc069db0 0x7f8acc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 0x7f8acc0af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc149ef0 con 0x7f8acc15ac00 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c5aa0 con 0x7f8acc15a820 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad34c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c5d80 con 0x7f8acc069db0 2023-08-10T10:47:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad1a62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:14.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad1a62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45510/0 (socket says 172.21.15.50:45510) 2023-08-10T10:47:14.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.805+0000 7f8ad1a62640 1 -- 172.21.15.50:0/1584848161 learned_addr learned my addr 172.21.15.50:0/1584848161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 -- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8acc069db0 msgr2=0x7f8acc1499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8acc069db0 0x7f8acc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 -- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 msgr2=0x7f8acc0af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad0a60640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 0x7f8acc0af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 0x7f8acc0af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009a70 con 0x7f8acc15ac00 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad0a60640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 0x7f8acc0af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.806+0000 7f8ad1a62640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009e80 tx=0x7f8ac4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.807+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004880 con 0x7f8acc15ac00 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.807+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac4009450 con 0x7f8acc15ac00 2023-08-10T10:47:14.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.807+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc0c6060 con 0x7f8acc15ac00 2023-08-10T10:47:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.807+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4034660 con 0x7f8acc15ac00 2023-08-10T10:47:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.807+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc0c6620 con 0x7f8acc15ac00 2023-08-10T10:47:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.808+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc069b90 con 0x7f8acc15ac00 2023-08-10T10:47:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.809+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ac403b030 con 0x7f8acc15ac00 2023-08-10T10:47:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.810+0000 7f8ac1ffb640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 0x7f8ab006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.810+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8ac40ab820 con 0x7f8acc15ac00 2023-08-10T10:47:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.810+0000 7f8ad1261640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 0x7f8ab006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.810+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f8ab0072eb0 con 0x7f8acc15ac00 2023-08-10T10:47:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.811+0000 7f8ad1261640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 0x7f8ab006d110 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8000f60 tx=0x7f8ac80078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:14.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:14.814+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ac4076890 con 0x7f8acc15ac00 2023-08-10T10:47:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.009+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8acc04e270 con 0x7f8acc15ac00 2023-08-10T10:47:15.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.926+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(149..149 src has 1..149) v4 ==== 296+0+0 (secure 0 0 0) 0x7f8ac407e510 con 0x7f8acc15ac00 2023-08-10T10:47:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.927+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f8ab00712e0 con 0x7f8acc15ac00 2023-08-10T10:47:15.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.932+0000 7f8ac1ffb640 1 -- 172.21.15.50:0/1584848161 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8ac404b030 con 0x7f8acc15ac00 2023-08-10T10:47:15.939 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:47:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.942+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 msgr2=0x7f8ab006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.942+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 0x7f8ab006d110 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8000f60 tx=0x7f8ac80078f0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.942+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 msgr2=0x7f8acc158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:15.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.942+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009e80 tx=0x7f8ac4004a40 comp rx=0 tx=0).stop 2023-08-10T10:47:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 shutdown_connections 2023-08-10T10:47:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc15ac00 0x7f8acc158860 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8ab006ac50 0x7f8ab006d110 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8acc15a820 0x7f8acc0af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 --2- 172.21.15.50:0/1584848161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8acc069db0 0x7f8acc1499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 >> 172.21.15.50:0/1584848161 conn(0x7f8acc0b08e0 msgr2=0x7f8acc15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 shutdown_connections 2023-08-10T10:47:15.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:15.943+0000 7f8ad34c5640 1 -- 172.21.15.50:0/1584848161 wait complete. 2023-08-10T10:47:15.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:47:16.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.192+0000 7fe659a08640 1 Processor -- start 2023-08-10T10:47:16.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.193+0000 7fe659a08640 1 -- start start 2023-08-10T10:47:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.194+0000 7fe659a08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6540b3cf0 0x7fe6540b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.194+0000 7fe659a08640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe654159c60 con 0x7fe654159880 2023-08-10T10:47:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.194+0000 7fe659a08640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6540c9e20 con 0x7fe6540cde60 2023-08-10T10:47:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.194+0000 7fe659a08640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540ca100 con 0x7fe6540b3cf0 2023-08-10T10:47:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe658a06640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe654159880 0x7fe6540cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40416/0 (socket says 172.21.15.50:40416) 2023-08-10T10:47:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe658a06640 1 -- 172.21.15.50:0/4056721562 learned_addr learned my addr 172.21.15.50:0/4056721562 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe659207640 1 --2- 172.21.15.50:0/4056721562 >> v2:172.21.15.50:3300/0 conn(0x7fe6540b3cf0 0x7fe6540b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe659207640 1 -- 172.21.15.50:0/4056721562 >> v1:172.21.15.117:6789/0 conn(0x7fe6540cde60 legacy=0x7fe6540cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe659207640 1 -- 172.21.15.50:0/4056721562 >> v1:172.21.15.50:6789/0 conn(0x7fe654159880 legacy=0x7fe6540cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.195+0000 7fe659207640 1 -- 172.21.15.50:0/4056721562 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540ca3e0 con 0x7fe6540b3cf0 2023-08-10T10:47:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.196+0000 7fe659207640 1 --2- 172.21.15.50:0/4056721562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540b3cf0 0x7fe6540b2510 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b377e1ee396082f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.197+0000 7fe64b7fe640 1 -- 172.21.15.50:0/4056721562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c031830 con 0x7fe6540b3cf0 2023-08-10T10:47:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.197+0000 7fe64b7fe640 1 -- 172.21.15.50:0/4056721562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c031990 con 0x7fe6540b3cf0 2023-08-10T10:47:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.197+0000 7fe64b7fe640 1 -- 172.21.15.50:0/4056721562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c031d20 con 0x7fe6540b3cf0 2023-08-10T10:47:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.197+0000 7fe659a08640 1 -- 172.21.15.50:0/4056721562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540b3cf0 msgr2=0x7fe6540b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.197+0000 7fe659a08640 1 --2- 172.21.15.50:0/4056721562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540b3cf0 0x7fe6540b2510 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.198+0000 7fe659a08640 1 -- 172.21.15.50:0/4056721562 shutdown_connections 2023-08-10T10:47:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.198+0000 7fe659a08640 1 --2- 172.21.15.50:0/4056721562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540b3cf0 0x7fe6540b2510 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.198+0000 7fe659a08640 1 -- 172.21.15.50:0/4056721562 >> 172.21.15.50:0/4056721562 conn(0x7fe654069f20 msgr2=0x7fe6540caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.198+0000 7fe659a08640 1 -- 172.21.15.50:0/4056721562 shutdown_connections 2023-08-10T10:47:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.198+0000 7fe659a08640 1 -- 172.21.15.50:0/4056721562 wait complete. 2023-08-10T10:47:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.199+0000 7fe659a08640 1 Processor -- start 2023-08-10T10:47:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 -- start start 2023-08-10T10:47:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6540b3cf0 0x7fe654070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6540cde60 0x7fe654070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540711d0 con 0x7fe654159880 2023-08-10T10:47:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540714b0 con 0x7fe6540b3cf0 2023-08-10T10:47:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.200+0000 7fe659a08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe654159e50 con 0x7fe6540cde60 2023-08-10T10:47:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32978/0 (socket says 172.21.15.50:32978) 2023-08-10T10:47:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 -- 172.21.15.50:0/3385440612 learned_addr learned my addr 172.21.15.50:0/3385440612 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe658a06640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6540b3cf0 0x7fe654070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 -- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6540cde60 msgr2=0x7fe654070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6540cde60 0x7fe654070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 -- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6540b3cf0 msgr2=0x7fe654070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6540b3cf0 0x7fe654070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.201+0000 7fe659207640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009400 con 0x7fe654159880 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe659207640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0098c0 tx=0x7fe64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c03b9f0 con 0x7fe654159880 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c03bb50 con 0x7fe654159880 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0453f0 con 0x7fe654159880 2023-08-10T10:47:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65415a130 con 0x7fe654159880 2023-08-10T10:47:16.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.202+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65415c9b0 con 0x7fe654159880 2023-08-10T10:47:16.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.203+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65415a650 con 0x7fe654159880 2023-08-10T10:47:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.204+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe64c045550 con 0x7fe654159880 2023-08-10T10:47:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.205+0000 7fe6497fa640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 0x7fe64006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.205+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fe64c0ab8e0 con 0x7fe654159880 2023-08-10T10:47:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.206+0000 7fe658a06640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 0x7fe64006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.206+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fe640072040 con 0x7fe654159880 2023-08-10T10:47:16.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.206+0000 7fe658a06640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 0x7fe64006d110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe650001460 tx=0x7fe650009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:16.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.209+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe64c035060 con 0x7fe654159880 2023-08-10T10:47:16.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.401+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe654071310 con 0x7fe654159880 2023-08-10T10:47:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.930+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(150..150 src has 1..150) v4 ==== 296+0+0 (secure 0 0 0) 0x7fe64c0ab030 con 0x7fe654159880 2023-08-10T10:47:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.931+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fe640070dd0 con 0x7fe654159880 2023-08-10T10:47:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.937+0000 7fe6497fa640 1 -- 172.21.15.50:0/3385440612 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v150) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe654071310 con 0x7fe654159880 2023-08-10T10:47:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:47:16.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.948+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 msgr2=0x7fe64006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.948+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 0x7fe64006d110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe650001460 tx=0x7fe650009040 comp rx=0 tx=0).stop 2023-08-10T10:47:16.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.948+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 msgr2=0x7fe654144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:16.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.948+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0098c0 tx=0x7fe64c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 shutdown_connections 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe654159880 0x7fe654144fa0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6540cde60 0x7fe654070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe64006ac50 0x7fe64006d110 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 --2- 172.21.15.50:0/3385440612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6540b3cf0 0x7fe654070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.949+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 >> 172.21.15.50:0/3385440612 conn(0x7fe654069f20 msgr2=0x7fe6540b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:16.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.951+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 shutdown_connections 2023-08-10T10:47:16.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:16.951+0000 7fe659a08640 1 -- 172.21.15.50:0/3385440612 wait complete. 2023-08-10T10:47:16.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:47:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.185+0000 7f9db3f6a640 1 Processor -- start 2023-08-10T10:47:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.185+0000 7f9db3f6a640 1 -- start start 2023-08-10T10:47:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.187+0000 7f9db3f6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9dac069db0 0x7f9dac06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.187+0000 7f9db3f6a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac15bcb0 con 0x7f9dac15a820 2023-08-10T10:47:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.187+0000 7f9db3f6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac15b0a0 con 0x7f9dac15ac00 2023-08-10T10:47:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.187+0000 7f9db3f6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0c5540 con 0x7f9dac069db0 2023-08-10T10:47:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.187+0000 7f9db1d06640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9dac15a820 0x7f9dac0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40418/0 (socket says 172.21.15.50:40418) 2023-08-10T10:47:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.188+0000 7f9db1d06640 1 -- 172.21.15.50:0/341399446 learned_addr learned my addr 172.21.15.50:0/341399446 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.188+0000 7f9db2507640 1 --2- 172.21.15.50:0/341399446 >> v2:172.21.15.117:3300/0 conn(0x7f9dac069db0 0x7f9dac06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.188+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809430570 0 0) 0x7f9dac15bcb0 con 0x7f9dac15a820 2023-08-10T10:47:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.188+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d98003520 con 0x7f9dac15a820 2023-08-10T10:47:17.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.189+0000 7f9db2507640 1 -- 172.21.15.50:0/341399446 >> v1:172.21.15.117:6789/0 conn(0x7f9dac15ac00 legacy=0x7f9dac0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.189+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710142202 0 0) 0x7f9d98003520 con 0x7f9dac15a820 2023-08-10T10:47:17.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.189+0000 7f9db2507640 1 -- 172.21.15.50:0/341399446 >> v1:172.21.15.50:6789/0 conn(0x7f9dac15a820 legacy=0x7f9dac0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.189+0000 7f9db2507640 1 -- 172.21.15.50:0/341399446 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac15b380 con 0x7f9dac069db0 2023-08-10T10:47:17.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.190+0000 7f9db2507640 1 --2- 172.21.15.50:0/341399446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac069db0 0x7f9dac06c180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009d90 tx=0x7f9da402bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae12ab125ef2aa98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.191+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8001670 con 0x7f9dac069db0 2023-08-10T10:47:17.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.191+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da402c8c0 con 0x7f9dac069db0 2023-08-10T10:47:17.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.191+0000 7f9db0d04640 1 -- 172.21.15.50:0/341399446 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da402cc50 con 0x7f9dac069db0 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.191+0000 7f9db3f6a640 1 -- 172.21.15.50:0/341399446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac069db0 msgr2=0x7f9dac06c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.191+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/341399446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac069db0 0x7f9dac06c180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009d90 tx=0x7f9da402bd90 comp rx=0 tx=0).stop 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.192+0000 7f9db3f6a640 1 -- 172.21.15.50:0/341399446 shutdown_connections 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.192+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/341399446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac069db0 0x7f9dac06c180 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.192+0000 7f9db3f6a640 1 -- 172.21.15.50:0/341399446 >> 172.21.15.50:0/341399446 conn(0x7f9dac0b08e0 msgr2=0x7f9dac0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:17.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.192+0000 7f9db3f6a640 1 -- 172.21.15.50:0/341399446 shutdown_connections 2023-08-10T10:47:17.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.192+0000 7f9db3f6a640 1 -- 172.21.15.50:0/341399446 wait complete. 2023-08-10T10:47:17.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.193+0000 7f9db3f6a640 1 Processor -- start 2023-08-10T10:47:17.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.194+0000 7f9db3f6a640 1 -- start start 2023-08-10T10:47:17.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac15a820 0x7f9dac0c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 0x7f9dac0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0ca090 con 0x7f9dac069db0 2023-08-10T10:47:17.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0ca370 con 0x7f9dac15ac00 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db3f6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0b1de0 con 0x7f9dac15a820 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db1d06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db1d06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32990/0 (socket says 172.21.15.50:32990) 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db1d06640 1 -- 172.21.15.50:0/3894593325 learned_addr learned my addr 172.21.15.50:0/3894593325 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db2507640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 0x7f9dac0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db1d06640 1 -- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac15a820 msgr2=0x7f9dac0c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.195+0000 7f9db1505640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac15a820 0x7f9dac0c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db1d06640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac15a820 0x7f9dac0c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db1d06640 1 -- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 msgr2=0x7f9dac0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db1d06640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 0x7f9dac0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db1d06640 1 -- 172.21.15.50:0/3894593325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4009a70 con 0x7f9dac069db0 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db2507640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 0x7f9dac0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db1d06640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c760 tx=0x7f9da800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005ad0 con 0x7f9dac069db0 2023-08-10T10:47:17.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8005c30 con 0x7f9dac069db0 2023-08-10T10:47:17.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0b20c0 con 0x7f9dac069db0 2023-08-10T10:47:17.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8007070 con 0x7f9dac069db0 2023-08-10T10:47:17.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.196+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac1f2410 con 0x7f9dac069db0 2023-08-10T10:47:17.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.197+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0b22e0 con 0x7f9dac069db0 2023-08-10T10:47:17.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.198+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9da80071d0 con 0x7f9dac069db0 2023-08-10T10:47:17.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.199+0000 7f9da27fc640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 0x7f9d9006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.199+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9da8088f10 con 0x7f9dac069db0 2023-08-10T10:47:17.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.200+0000 7f9db1505640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 0x7f9d9006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.200+0000 7f9db1505640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 0x7f9d9006d110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cae20 tx=0x7f9d9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.204+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9da80542d0 con 0x7f9dac069db0 2023-08-10T10:47:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.394+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9dac04e270 con 0x7f9dac069db0 2023-08-10T10:47:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.401+0000 7f9da27fc640 1 -- 172.21.15.50:0/3894593325 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9da80578f0 con 0x7f9dac069db0 2023-08-10T10:47:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.403+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 msgr2=0x7f9d9006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.403+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 0x7f9d9006d110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cae20 tx=0x7f9d9c009040 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.403+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 msgr2=0x7f9dac155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.403+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c760 tx=0x7f9da800cc20 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 shutdown_connections 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9d9006ac50 0x7f9d9006d110 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dac15ac00 0x7f9dac0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dac15a820 0x7f9dac0c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 --2- 172.21.15.50:0/3894593325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac069db0 0x7f9dac155b50 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 >> 172.21.15.50:0/3894593325 conn(0x7f9dac0b08e0 msgr2=0x7f9dac06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 shutdown_connections 2023-08-10T10:47:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.404+0000 7f9db3f6a640 1 -- 172.21.15.50:0/3894593325 wait complete. 2023-08-10T10:47:17.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-08-10T10:47:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.643+0000 7f603368e640 1 Processor -- start 2023-08-10T10:47:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.644+0000 7f603368e640 1 -- start start 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f602c15cd60 0x7f602c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c0b8430 0x7f602c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f602c0cddb0 0x7f602c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0ce240 con 0x7f602c15cd60 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0b5bd0 con 0x7f602c0cddb0 2023-08-10T10:47:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.645+0000 7f603368e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c161180 con 0x7f602c0b8430 2023-08-10T10:47:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f602c15cd60 0x7f602c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f602c15cd60 0x7f602c160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33004/0 (socket says 172.21.15.50:33004) 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 -- 172.21.15.50:0/2905581878 learned_addr learned my addr 172.21.15.50:0/2905581878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f6030c29640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c0b8430 0x7f602c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f6031c2b640 1 --2- 172.21.15.50:0/2905581878 >> v2:172.21.15.117:3300/0 conn(0x7f602c0cddb0 0x7f602c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 -- 172.21.15.50:0/2905581878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c0b8430 msgr2=0x7f602c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c0b8430 0x7f602c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 -- 172.21.15.50:0/2905581878 >> v2:172.21.15.117:3300/0 conn(0x7f602c0cddb0 msgr2=0x7f602c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 --2- 172.21.15.50:0/2905581878 >> v2:172.21.15.117:3300/0 conn(0x7f602c0cddb0 0x7f602c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.646+0000 7f603142a640 1 -- 172.21.15.50:0/2905581878 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c161460 con 0x7f602c15cd60 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.648+0000 7f603142a640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c15cd60 0x7f602c160930 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f602c0b5490 tx=0x7f602802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f984091eb0d9520a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.648+0000 7f6023fff640 1 -- 172.21.15.50:0/2905581878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602802cb00 con 0x7f602c15cd60 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.648+0000 7f6023fff640 1 -- 172.21.15.50:0/2905581878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602802cc60 con 0x7f602c15cd60 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.648+0000 7f6023fff640 1 -- 172.21.15.50:0/2905581878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280343f0 con 0x7f602c15cd60 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 -- 172.21.15.50:0/2905581878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c15cd60 msgr2=0x7f602c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c15cd60 0x7f602c160930 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f602c0b5490 tx=0x7f602802bf60 comp rx=0 tx=0).stop 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 -- 172.21.15.50:0/2905581878 shutdown_connections 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 --2- 172.21.15.50:0/2905581878 >> v2:172.21.15.117:3300/0 conn(0x7f602c0cddb0 0x7f602c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c0b8430 0x7f602c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 --2- 172.21.15.50:0/2905581878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c15cd60 0x7f602c160930 secure :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f602c0b5490 tx=0x7f602802bf60 comp rx=0 tx=0).stop 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 -- 172.21.15.50:0/2905581878 >> 172.21.15.50:0/2905581878 conn(0x7f602c0d2ac0 msgr2=0x7f602c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 -- 172.21.15.50:0/2905581878 shutdown_connections 2023-08-10T10:47:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.649+0000 7f603368e640 1 -- 172.21.15.50:0/2905581878 wait complete. 2023-08-10T10:47:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.651+0000 7f603368e640 1 Processor -- start 2023-08-10T10:47:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.651+0000 7f603368e640 1 -- start start 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cddb0 0x7f602c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c1f1cf0 0x7f602c14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c149850 con 0x7f602c0b8430 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c149a60 con 0x7f602c0cddb0 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603368e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c149d40 con 0x7f602c1f1cf0 2023-08-10T10:47:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603142a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603142a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33016/0 (socket says 172.21.15.50:33016) 2023-08-10T10:47:17.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.652+0000 7f603142a640 1 -- 172.21.15.50:0/1768289074 learned_addr learned my addr 172.21.15.50:0/1768289074 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 -- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c1f1cf0 msgr2=0x7f602c14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f6031c2b640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c1f1cf0 0x7f602c14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f6030c29640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cddb0 0x7f602c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c1f1cf0 0x7f602c14a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 -- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cddb0 msgr2=0x7f602c149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cddb0 0x7f602c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 -- 172.21.15.50:0/1768289074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028009b30 con 0x7f602c0b8430 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603142a640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6028036040 tx=0x7f6028004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028009510 con 0x7f602c0b8430 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602803e450 con 0x7f602c0b8430 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602803e820 con 0x7f602c0b8430 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.653+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c14a020 con 0x7f602c0b8430 2023-08-10T10:47:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.654+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c14a5e0 con 0x7f602c0b8430 2023-08-10T10:47:17.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.655+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c04e270 con 0x7f602c0b8430 2023-08-10T10:47:17.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.656+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f602803e980 con 0x7f602c0b8430 2023-08-10T10:47:17.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.657+0000 7f6021ffb640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 0x7f601006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:17.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.657+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f60280abff0 con 0x7f602c0b8430 2023-08-10T10:47:17.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.658+0000 7f6030c29640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 0x7f601006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.658+0000 7f6030c29640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 0x7f601006d110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f601c006fd0 tx=0x7f601c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.662+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60280773a0 con 0x7f602c0b8430 2023-08-10T10:47:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.926+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f602c149e80 con 0x7f602c0b8430 2023-08-10T10:47:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.959+0000 7f6021ffb640 1 -- 172.21.15.50:0/1768289074 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v479) v1 ==== 140+0+0 (secure 0 0 0) 0x7f602c149e80 con 0x7f602c0b8430 2023-08-10T10:47:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 msgr2=0x7f601006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 0x7f601006d110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f601c006fd0 tx=0x7f601c008040 comp rx=0 tx=0).stop 2023-08-10T10:47:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 msgr2=0x7f602c15f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6028036040 tx=0x7f6028004a40 comp rx=0 tx=0).stop 2023-08-10T10:47:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 shutdown_connections 2023-08-10T10:47:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c1f1cf0 0x7f602c14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601006ac50 0x7f601006d110 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cddb0 0x7f602c149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 --2- 172.21.15.50:0/1768289074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0b8430 0x7f602c15f670 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 >> 172.21.15.50:0/1768289074 conn(0x7f602c0d2ac0 msgr2=0x7f602c0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 shutdown_connections 2023-08-10T10:47:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:17.962+0000 7f603368e640 1 -- 172.21.15.50:0/1768289074 wait complete. 2023-08-10T10:47:17.984 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-10T10:47:17.985 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-08-10T10:47:17.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-08-10T10:47:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.212+0000 7f0e138a7640 1 Processor -- start 2023-08-10T10:47:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.213+0000 7f0e138a7640 1 -- start start 2023-08-10T10:47:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.214+0000 7f0e138a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e0c0b3010 0x7f0e0c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.214+0000 7f0e138a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0e0c0c9b30 0x7f0e0c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.214+0000 7f0e138a7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c0719f0 con 0x7f0e0c15ccb0 2023-08-10T10:47:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.214+0000 7f0e138a7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c8db0 con 0x7f0e0c0b3010 2023-08-10T10:47:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.214+0000 7f0e138a7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c9050 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e11643640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e0c15ccb0 0x7f0e0c0b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40426/0 (socket says 172.21.15.50:40426) 2023-08-10T10:47:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e11643640 1 -- 172.21.15.50:0/1042753206 learned_addr learned my addr 172.21.15.50:0/1042753206 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e10e42640 1 --2- 172.21.15.50:0/1042753206 >> v2:172.21.15.50:3300/0 conn(0x7f0e0c0b3010 0x7f0e0c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e03fff640 1 -- 172.21.15.50:0/1042753206 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105615393 0 0) 0x7f0e0c0719f0 con 0x7f0e0c15ccb0 2023-08-10T10:47:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e03fff640 1 -- 172.21.15.50:0/1042753206 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df8003520 con 0x7f0e0c15ccb0 2023-08-10T10:47:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e11e44640 1 --2- 172.21.15.50:0/1042753206 >> v2:172.21.15.117:3300/0 conn(0x7f0e0c0c9b30 0x7f0e0c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e10e42640 1 -- 172.21.15.50:0/1042753206 >> v2:172.21.15.117:3300/0 conn(0x7f0e0c0c9b30 msgr2=0x7f0e0c069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e10e42640 1 --2- 172.21.15.50:0/1042753206 >> v2:172.21.15.117:3300/0 conn(0x7f0e0c0c9b30 0x7f0e0c069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e10e42640 1 -- 172.21.15.50:0/1042753206 >> v1:172.21.15.50:6789/0 conn(0x7f0e0c15ccb0 legacy=0x7f0e0c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.215+0000 7f0e10e42640 1 -- 172.21.15.50:0/1042753206 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0c9330 con 0x7f0e0c0b3010 2023-08-10T10:47:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.217+0000 7f0e10e42640 1 --2- 172.21.15.50:0/1042753206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c0696a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0b0ce0 tx=0x7f0dfc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d2c2879cae7a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.217+0000 7f0e03fff640 1 -- 172.21.15.50:0/1042753206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc031830 con 0x7f0e0c0b3010 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.217+0000 7f0e03fff640 1 -- 172.21.15.50:0/1042753206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc031990 con 0x7f0e0c0b3010 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.217+0000 7f0e03fff640 1 -- 172.21.15.50:0/1042753206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc031d00 con 0x7f0e0c0b3010 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 -- 172.21.15.50:0/1042753206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0b3010 msgr2=0x7f0e0c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 --2- 172.21.15.50:0/1042753206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c0696a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0b0ce0 tx=0x7f0dfc02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 -- 172.21.15.50:0/1042753206 shutdown_connections 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 --2- 172.21.15.50:0/1042753206 >> v2:172.21.15.117:3300/0 conn(0x7f0e0c0c9b30 0x7f0e0c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 --2- 172.21.15.50:0/1042753206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c0696a0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 -- 172.21.15.50:0/1042753206 >> 172.21.15.50:0/1042753206 conn(0x7f0e0c06b590 msgr2=0x7f0e0c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 -- 172.21.15.50:0/1042753206 shutdown_connections 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.218+0000 7f0e138a7640 1 -- 172.21.15.50:0/1042753206 wait complete. 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.220+0000 7f0e138a7640 1 Processor -- start 2023-08-10T10:47:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.220+0000 7f0e138a7640 1 -- start start 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 0x7f0e0c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c15fbb0 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c15f030 con 0x7f0e0c0b3010 2023-08-10T10:47:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e138a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c15f310 con 0x7f0e0c15ccb0 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e10e42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e10e42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33028/0 (socket says 172.21.15.50:33028) 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e10e42640 1 -- 172.21.15.50:0/3507872954 learned_addr learned my addr 172.21.15.50:0/3507872954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.221+0000 7f0e11643640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e11e44640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 0x7f0e0c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 -- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 msgr2=0x7f0e0c0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 0x7f0e0c0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 -- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e0c0b3010 msgr2=0x7f0e0c1470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c1470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 -- 172.21.15.50:0/3507872954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009400 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e11e44640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 0x7f0e0c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e10e42640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc000c00 tx=0x7f0dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0317b0 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc032e10 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc003850 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.222+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c15f5f0 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.223+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c15e270 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.224+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c04e270 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.225+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dfc0039b0 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.226+0000 7f0e01ffb640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 0x7f0df006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.227+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0dfc0aaff0 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.227+0000 7f0e11643640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 0x7f0df006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.227+0000 7f0e11643640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 0x7f0df006d140 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.231+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0dfc076320 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.490+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f0e0c0b0c70 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.968+0000 7f0e01ffb640 1 -- 172.21.15.50:0/3507872954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v480) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0dfc079940 con 0x7f0e0c0c9b30 2023-08-10T10:47:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 msgr2=0x7f0df006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 0x7f0df006d140 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).stop 2023-08-10T10:47:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 msgr2=0x7f0e0c0c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc000c00 tx=0x7f0dfc0046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 shutdown_connections 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e0c15ccb0 0x7f0e0c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e0c0c9b30 0x7f0e0c0c7df0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0df006ac80 0x7f0df006d140 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 --2- 172.21.15.50:0/3507872954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e0c0b3010 0x7f0e0c1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.972+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 >> 172.21.15.50:0/3507872954 conn(0x7f0e0c06b590 msgr2=0x7f0e0c159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.973+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 shutdown_connections 2023-08-10T10:47:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:18.973+0000 7f0e138a7640 1 -- 172.21.15.50:0/3507872954 wait complete. 2023-08-10T10:47:18.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.224+0000 7fed61f5d640 1 Processor -- start 2023-08-10T10:47:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.224+0000 7fed61f5d640 1 -- start start 2023-08-10T10:47:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed61f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed5c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed61f5d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0719f0 con 0x7fed5c15ccb0 2023-08-10T10:47:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed61f5d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0c8db0 con 0x7fed5c0c9b30 2023-08-10T10:47:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed61f5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c9050 con 0x7fed5c0b3010 2023-08-10T10:47:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed5b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed5c15ccb0 0x7fed5c0b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40434/0 (socket says 172.21.15.50:40434) 2023-08-10T10:47:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.226+0000 7fed5b7fe640 1 -- 172.21.15.50:0/1960160089 learned_addr learned my addr 172.21.15.50:0/1960160089 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed53fff640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed5c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702692991 0 0) 0x7fed5c0719f0 con 0x7fed5c15ccb0 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed48003520 con 0x7fed5c15ccb0 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678568314 0 0) 0x7fed48003520 con 0x7fed5c15ccb0 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 msgr2=0x7fed5c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed5c0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 >> v1:172.21.15.117:6789/0 conn(0x7fed5c0c9b30 legacy=0x7fed5c06ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0c9330 con 0x7fed5c15ccb0 2023-08-10T10:47:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fed4c001670 con 0x7fed5c15ccb0 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 >> v1:172.21.15.50:6789/0 conn(0x7fed5c15ccb0 legacy=0x7fed5c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.227+0000 7fed5affd640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5affd640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed48004d00 0x7fed48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c9050 con 0x7fed48003f20 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4800ba60 con 0x7fed48004d00 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4800bc20 con 0x7fed5c0b3010 2023-08-10T10:47:19.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5b7fe640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 -- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 msgr2=0x7fed480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 -- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed48004d00 msgr2=0x7fed48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed48004d00 0x7fed48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed53fff640 1 -- 172.21.15.50:0/1960160089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48003520 con 0x7fed48003f20 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.228+0000 7fed5b7fe640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c0b3010 0x7fed480039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed53fff640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed480047c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fed44009a90 tx=0x7fed480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a829cb5fff2cb74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4402c690 con 0x7fed48003f20 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4402c7f0 con 0x7fed48003f20 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed5affd640 1 -- 172.21.15.50:0/1960160089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4402cb80 con 0x7fed48003f20 2023-08-10T10:47:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed61f5d640 1 -- 172.21.15.50:0/1960160089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 msgr2=0x7fed480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed61f5d640 1 --2- 172.21.15.50:0/1960160089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed480047c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fed44009a90 tx=0x7fed480057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.230+0000 7fed5bfff640 1 -- 172.21.15.50:0/1960160089 reap_dead start 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.231+0000 7fed61f5d640 1 -- 172.21.15.50:0/1960160089 shutdown_connections 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.231+0000 7fed61f5d640 1 -- 172.21.15.50:0/1960160089 >> 172.21.15.50:0/1960160089 conn(0x7fed5c06b590 msgr2=0x7fed5c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.231+0000 7fed61f5d640 1 -- 172.21.15.50:0/1960160089 shutdown_connections 2023-08-10T10:47:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.231+0000 7fed61f5d640 1 -- 172.21.15.50:0/1960160089 wait complete. 2023-08-10T10:47:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.232+0000 7fed61f5d640 1 Processor -- start 2023-08-10T10:47:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.233+0000 7fed61f5d640 1 -- start start 2023-08-10T10:47:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c151fb0 0x7fed5c15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 0x7fed5c0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c15e840 con 0x7fed48003f20 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c158740 con 0x7fed5c15f210 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed61f5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c158a20 con 0x7fed5c151fb0 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33052/0 (socket says 172.21.15.50:33052) 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 -- 172.21.15.50:0/3947688186 learned_addr learned my addr 172.21.15.50:0/3947688186 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed53fff640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c151fb0 0x7fed5c15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 -- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c151fb0 msgr2=0x7fed5c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c151fb0 0x7fed5c15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 -- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 msgr2=0x7fed5c0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5bfff640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 0x7fed5c0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 0x7fed5c0c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.234+0000 7fed5b7fe640 1 -- 172.21.15.50:0/3947688186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c158d00 con 0x7fed48003f20 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed5bfff640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 0x7fed5c0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed5b7fe640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00d8b0 tx=0x7fed4c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0074e0 con 0x7fed48003f20 2023-08-10T10:47:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c007640 con 0x7fed48003f20 2023-08-10T10:47:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0049e0 con 0x7fed48003f20 2023-08-10T10:47:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c15e4d0 con 0x7fed48003f20 2023-08-10T10:47:19.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.235+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c15dc80 con 0x7fed48003f20 2023-08-10T10:47:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.236+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0c4dc0 con 0x7fed48003f20 2023-08-10T10:47:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.237+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed4c004b40 con 0x7fed48003f20 2023-08-10T10:47:19.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.238+0000 7fed58ff9640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 0x7fed3c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.238+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fed4c088e70 con 0x7fed48003f20 2023-08-10T10:47:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.239+0000 7fed53fff640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 0x7fed3c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.239+0000 7fed53fff640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 0x7fed3c06d110 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fed44036000 tx=0x7fed44030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.243+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed4c057ce0 con 0x7fed48003f20 2023-08-10T10:47:19.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.434+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed5c15e2d0 con 0x7fed48003f20 2023-08-10T10:47:19.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.436+0000 7fed58ff9640 1 -- 172.21.15.50:0/3947688186 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+14766 (secure 0 0 0) 0x7fed4c019020 con 0x7fed48003f20 2023-08-10T10:47:19.438 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:19.439 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":150,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:16.927218+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/935015286":"2023-08-11T10:47:13.475355+0000","172.21.15.50:6836/935015286":"2023-08-11T10:47:13.475355+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:19.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 msgr2=0x7fed3c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 0x7fed3c06d110 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fed44036000 tx=0x7fed44030000 comp rx=0 tx=0).stop 2023-08-10T10:47:19.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 msgr2=0x7fed5c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00d8b0 tx=0x7fed4c00dd70 comp rx=0 tx=0).stop 2023-08-10T10:47:19.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 shutdown_connections 2023-08-10T10:47:19.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fed3c06ac50 0x7fed3c06d110 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c15f210 0x7fed5c0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c151fb0 0x7fed5c15ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 --2- 172.21.15.50:0/3947688186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed48003f20 0x7fed5c0c6170 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 >> 172.21.15.50:0/3947688186 conn(0x7fed5c06b590 msgr2=0x7fed5c0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:19.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 shutdown_connections 2023-08-10T10:47:19.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.439+0000 7fed61f5d640 1 -- 172.21.15.50:0/3947688186 wait complete. 2023-08-10T10:47:19.459 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:19.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.696+0000 7fd6ef59e640 1 Processor -- start 2023-08-10T10:47:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.696+0000 7fd6ef59e640 1 -- start start 2023-08-10T10:47:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6ef59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6f00b1e00 0x7fd6f006a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6ef59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f006a5c0 con 0x7fd6f00cd660 2023-08-10T10:47:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6ef59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f006a820 con 0x7fd6f015fde0 2023-08-10T10:47:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6ef59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f006b0c0 con 0x7fd6f00b1e00 2023-08-10T10:47:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6edd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6f00cd660 0x7fd6f00d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40448/0 (socket says 172.21.15.50:40448) 2023-08-10T10:47:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.698+0000 7fd6edd9b640 1 -- 172.21.15.50:0/759010702 learned_addr learned my addr 172.21.15.50:0/759010702 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6eed9d640 1 --2- 172.21.15.50:0/759010702 >> v2:172.21.15.117:3300/0 conn(0x7fd6f00b1e00 0x7fd6f006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523646316 0 0) 0x7fd6f006a5c0 con 0x7fd6f00cd660 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d8003520 con 0x7fd6f00cd660 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 915845878 0 0) 0x7fd6d8003520 con 0x7fd6f00cd660 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 >> v2:172.21.15.117:3300/0 conn(0x7fd6f00b1e00 msgr2=0x7fd6f006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 --2- 172.21.15.50:0/759010702 >> v2:172.21.15.117:3300/0 conn(0x7fd6f00b1e00 0x7fd6f006a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 >> v1:172.21.15.117:6789/0 conn(0x7fd6f015fde0 legacy=0x7fd6f00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f006ab00 con 0x7fd6f00cd660 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd6e4001690 con 0x7fd6f00cd660 2023-08-10T10:47:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 >> v1:172.21.15.50:6789/0 conn(0x7fd6f00cd660 legacy=0x7fd6f00d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80039e0 0x7fd6d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80047c0 0x7fd6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f006b0c0 con 0x7fd6d8005280 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d800c1c0 con 0x7fd6d80039e0 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.699+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d800c380 con 0x7fd6d80047c0 2023-08-10T10:47:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6ee59c640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80039e0 0x7fd6d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6edd9b640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80047c0 0x7fd6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 -- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80047c0 msgr2=0x7fd6d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80047c0 0x7fd6d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 -- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80039e0 msgr2=0x7fd6d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80039e0 0x7fd6d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.700+0000 7fd6eed9d640 1 -- 172.21.15.50:0/759010702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8003520 con 0x7fd6d8005280 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.701+0000 7fd6eed9d640 1 -- 172.21.15.50:0/759010702 reap_dead start 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.701+0000 7fd6eed9d640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6d800b980 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009ac0 tx=0x7fd6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3084b2a5f1c783 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8004020 con 0x7fd6d8005280 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8004180 con 0x7fd6d8005280 2023-08-10T10:47:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ed59a640 1 -- 172.21.15.50:0/759010702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e802c710 con 0x7fd6d8005280 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ef59e640 1 -- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 msgr2=0x7fd6d800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6d800b980 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009ac0 tx=0x7fd6d80057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ef59e640 1 -- 172.21.15.50:0/759010702 shutdown_connections 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/759010702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6d800b980 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.702+0000 7fd6ef59e640 1 -- 172.21.15.50:0/759010702 >> 172.21.15.50:0/759010702 conn(0x7fd6f00d2900 msgr2=0x7fd6f00d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.703+0000 7fd6ef59e640 1 -- 172.21.15.50:0/759010702 shutdown_connections 2023-08-10T10:47:19.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.703+0000 7fd6ef59e640 1 -- 172.21.15.50:0/759010702 wait complete. 2023-08-10T10:47:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.704+0000 7fd6ef59e640 1 Processor -- start 2023-08-10T10:47:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.705+0000 7fd6ef59e640 1 -- start start 2023-08-10T10:47:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f01529a0 0x7fd6f00a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f01523e0 0x7fd6f00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01f6560 con 0x7fd6d8005280 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01f59e0 con 0x7fd6f01523e0 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ef59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01f5cc0 con 0x7fd6f01529a0 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33068/0 (socket says 172.21.15.50:33068) 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 -- 172.21.15.50:0/2029022312 learned_addr learned my addr 172.21.15.50:0/2029022312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6edd9b640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f01529a0 0x7fd6f00a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 -- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f01529a0 msgr2=0x7fd6f00a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f01529a0 0x7fd6f00a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 -- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f01523e0 msgr2=0x7fd6f00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f01523e0 0x7fd6f00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.706+0000 7fd6ee59c640 1 -- 172.21.15.50:0/2029022312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f01f5fa0 con 0x7fd6d8005280 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6ee59c640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000e7f0 tx=0x7fd6e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0003b80 con 0x7fd6d8005280 2023-08-10T10:47:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0003ce0 con 0x7fd6d8005280 2023-08-10T10:47:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00052d0 con 0x7fd6d8005280 2023-08-10T10:47:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01f6280 con 0x7fd6d8005280 2023-08-10T10:47:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.707+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0152020 con 0x7fd6d8005280 2023-08-10T10:47:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.708+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0066e30 con 0x7fd6d8005280 2023-08-10T10:47:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.709+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6e0005430 con 0x7fd6d8005280 2023-08-10T10:47:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.711+0000 7fd6deffd640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 0x7fd6d006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.711+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd6e00892a0 con 0x7fd6d8005280 2023-08-10T10:47:19.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.711+0000 7fd6edd9b640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 0x7fd6d006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.712+0000 7fd6edd9b640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 0x7fd6d006d110 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40010e0 tx=0x7fd6e4000fb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:19.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.715+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd6e00545d0 con 0x7fd6d8005280 2023-08-10T10:47:19.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.906+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6f00b7340 con 0x7fd6d8005280 2023-08-10T10:47:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.907+0000 7fd6deffd640 1 -- 172.21.15.50:0/2029022312 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6e0057bf0 con 0x7fd6d8005280 2023-08-10T10:47:19.908 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 msgr2=0x7fd6d006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 0x7fd6d006d110 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40010e0 tx=0x7fd6e4000fb0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 msgr2=0x7fd6f00a92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000e7f0 tx=0x7fd6e000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 shutdown_connections 2023-08-10T10:47:19.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd6d006ac50 0x7fd6d006d110 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f01523e0 0x7fd6f00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f01529a0 0x7fd6f00a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 --2- 172.21.15.50:0/2029022312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8005280 0x7fd6f00a92e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.909+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 >> 172.21.15.50:0/2029022312 conn(0x7fd6f00d2900 msgr2=0x7fd6f00d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:19.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.910+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 shutdown_connections 2023-08-10T10:47:19.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:19.910+0000 7fd6ef59e640 1 -- 172.21.15.50:0/2029022312 wait complete. 2023-08-10T10:47:19.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:47:20.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.158+0000 7fde0b008640 1 Processor -- start 2023-08-10T10:47:20.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.158+0000 7fde0b008640 1 -- start start 2023-08-10T10:47:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.159+0000 7fde0b008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde0415fde0 0x7fde0406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.159+0000 7fde0b008640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde040cd660 0x7fde040d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.159+0000 7fde0b008640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0406a5c0 con 0x7fde040b1e00 2023-08-10T10:47:20.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0b008640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0406b0c0 con 0x7fde040cd660 2023-08-10T10:47:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0b008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0406a820 con 0x7fde0415fde0 2023-08-10T10:47:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0a807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde040cd660 0x7fde040d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0a807640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde040cd660 0x7fde040d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33072/0 (socket says 172.21.15.50:33072) 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0a807640 1 -- 172.21.15.50:0/82970773 learned_addr learned my addr 172.21.15.50:0/82970773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.160+0000 7fde0a006640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde0415fde0 0x7fde0406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.161+0000 7fde0a807640 1 -- 172.21.15.50:0/82970773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde0415fde0 msgr2=0x7fde0406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.161+0000 7fde0a807640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde0415fde0 0x7fde0406a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.161+0000 7fde0a807640 1 -- 172.21.15.50:0/82970773 >> v1:172.21.15.117:6789/0 conn(0x7fde040b1e00 legacy=0x7fde040ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.161+0000 7fde0a807640 1 -- 172.21.15.50:0/82970773 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0406ab00 con 0x7fde040cd660 2023-08-10T10:47:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.162+0000 7fde0a807640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde040d0b20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009e50 tx=0x7fddfc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631a640226cf9c7a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde09004640 1 -- 172.21.15.50:0/82970773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc02c9e0 con 0x7fde040cd660 2023-08-10T10:47:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde09004640 1 -- 172.21.15.50:0/82970773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc02cb40 con 0x7fde040cd660 2023-08-10T10:47:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde09004640 1 -- 172.21.15.50:0/82970773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0343f0 con 0x7fde040cd660 2023-08-10T10:47:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde0b008640 1 -- 172.21.15.50:0/82970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 msgr2=0x7fde040d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde0b008640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde040d0b20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009e50 tx=0x7fddfc02be40 comp rx=0 tx=0).stop 2023-08-10T10:47:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde0b008640 1 -- 172.21.15.50:0/82970773 shutdown_connections 2023-08-10T10:47:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde0b008640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde040d0b20 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.163+0000 7fde0b008640 1 --2- 172.21.15.50:0/82970773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde0415fde0 0x7fde0406a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.164+0000 7fde0b008640 1 -- 172.21.15.50:0/82970773 >> 172.21.15.50:0/82970773 conn(0x7fde040d2900 msgr2=0x7fde040d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.164+0000 7fde0b008640 1 -- 172.21.15.50:0/82970773 shutdown_connections 2023-08-10T10:47:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.164+0000 7fde0b008640 1 -- 172.21.15.50:0/82970773 wait complete. 2023-08-10T10:47:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.165+0000 7fde0b008640 1 Processor -- start 2023-08-10T10:47:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.166+0000 7fde0b008640 1 -- start start 2023-08-10T10:47:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde040b1e00 0x7fde0414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde0415fde0 0x7fde0414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04150f40 con 0x7fde040cd660 2023-08-10T10:47:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041f62a0 con 0x7fde0415fde0 2023-08-10T10:47:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0b008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde041506a0 con 0x7fde040b1e00 2023-08-10T10:47:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde09805640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde09805640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33086/0 (socket says 172.21.15.50:33086) 2023-08-10T10:47:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde09805640 1 -- 172.21.15.50:0/1809398386 learned_addr learned my addr 172.21.15.50:0/1809398386 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:20.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0a006640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde040b1e00 0x7fde0414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.167+0000 7fde0a807640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde0415fde0 0x7fde0414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 -- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde040b1e00 msgr2=0x7fde0414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde040b1e00 0x7fde0414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 -- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde0415fde0 msgr2=0x7fde0414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde0415fde0 0x7fde0414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 -- 172.21.15.50:0/1809398386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009b30 con 0x7fde040cd660 2023-08-10T10:47:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde09805640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c4d0 tx=0x7fddf400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40052d0 con 0x7fde040cd660 2023-08-10T10:47:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4005430 con 0x7fde040cd660 2023-08-10T10:47:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4012850 con 0x7fde040cd660 2023-08-10T10:47:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde04150980 con 0x7fde040cd660 2023-08-10T10:47:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.168+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040a9480 con 0x7fde040cd660 2023-08-10T10:47:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.169+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde040a92e0 con 0x7fde040cd660 2023-08-10T10:47:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.170+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddf40129b0 con 0x7fde040cd660 2023-08-10T10:47:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.171+0000 7fddfaffd640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 0x7fdde806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.171+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fddf4088cf0 con 0x7fde040cd660 2023-08-10T10:47:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.172+0000 7fde0a006640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 0x7fdde806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.172+0000 7fde0a006640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 0x7fdde806d110 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fde00009a30 tx=0x7fde00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.175+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde040a92e0 con 0x7fde040cd660 2023-08-10T10:47:20.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.364+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde040a92e0 con 0x7fde040cd660 2023-08-10T10:47:20.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.365+0000 7fddfaffd640 1 -- 172.21.15.50:0/1809398386 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v150) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde040a92e0 con 0x7fde040cd660 2023-08-10T10:47:20.367 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:47:20.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.367+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 msgr2=0x7fdde806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.367+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 0x7fdde806d110 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fde00009a30 tx=0x7fde00008040 comp rx=0 tx=0).stop 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 msgr2=0x7fde041f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c4d0 tx=0x7fddf400c990 comp rx=0 tx=0).stop 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 shutdown_connections 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdde806ac50 0x7fdde806d110 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde0415fde0 0x7fde0414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde040cd660 0x7fde041f5d60 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 --2- 172.21.15.50:0/1809398386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde040b1e00 0x7fde0414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 >> 172.21.15.50:0/1809398386 conn(0x7fde040d2900 msgr2=0x7fde0415f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 shutdown_connections 2023-08-10T10:47:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.368+0000 7fde0b008640 1 -- 172.21.15.50:0/1809398386 wait complete. 2023-08-10T10:47:20.388 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:47:20.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.610+0000 7f8de0b40640 1 Processor -- start 2023-08-10T10:47:20.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.610+0000 7f8de0b40640 1 -- start start 2023-08-10T10:47:20.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8de0b40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cf310 0x7f8ddc0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8de0b40640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8de0b40640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc0ce100 con 0x7f8ddc15ce90 2023-08-10T10:47:20.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8de0b40640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cfc30 con 0x7f8ddc0cd920 2023-08-10T10:47:20.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8de0b40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cde20 con 0x7f8ddc0cf310 2023-08-10T10:47:20.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8ddbfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8ddbfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:47676/0 (socket says 172.21.15.50:47676) 2023-08-10T10:47:20.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.612+0000 7f8ddbfff640 1 -- 172.21.15.50:0/1918358901 learned_addr learned my addr 172.21.15.50:0/1918358901 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.613+0000 7f8ddb7fe640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cf310 0x7f8ddc0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.613+0000 7f8ddbfff640 1 -- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cf310 msgr2=0x7f8ddc0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.613+0000 7f8ddbfff640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cf310 0x7f8ddc0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.613+0000 7f8ddbfff640 1 -- 172.21.15.50:0/1918358901 >> v1:172.21.15.117:6789/0 conn(0x7f8ddc15ce90 legacy=0x7f8ddc0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.613+0000 7f8ddbfff640 1 -- 172.21.15.50:0/1918358901 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0d1950 con 0x7f8ddc0cd920 2023-08-10T10:47:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.615+0000 7f8ddbfff640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009e50 tx=0x7f8dd402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6e1ee6efa68c42 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.615+0000 7f8dda7fc640 1 -- 172.21.15.50:0/1918358901 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402cb00 con 0x7f8ddc0cd920 2023-08-10T10:47:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.615+0000 7f8dda7fc640 1 -- 172.21.15.50:0/1918358901 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd402cc60 con 0x7f8ddc0cd920 2023-08-10T10:47:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.615+0000 7f8dda7fc640 1 -- 172.21.15.50:0/1918358901 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40343f0 con 0x7f8ddc0cd920 2023-08-10T10:47:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 -- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 msgr2=0x7f8ddc0b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009e50 tx=0x7f8dd402bf60 comp rx=0 tx=0).stop 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 -- 172.21.15.50:0/1918358901 shutdown_connections 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0b4a90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 --2- 172.21.15.50:0/1918358901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc0cf310 0x7f8ddc0cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 -- 172.21.15.50:0/1918358901 >> 172.21.15.50:0/1918358901 conn(0x7f8ddc06fcc0 msgr2=0x7f8ddc0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:20.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 -- 172.21.15.50:0/1918358901 shutdown_connections 2023-08-10T10:47:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.616+0000 7f8de0b40640 1 -- 172.21.15.50:0/1918358901 wait complete. 2023-08-10T10:47:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.618+0000 7f8de0b40640 1 Processor -- start 2023-08-10T10:47:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.618+0000 7f8de0b40640 1 -- start start 2023-08-10T10:47:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc15ce90 0x7f8ddc15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cb380 con 0x7f8ddc0cf310 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cae60 con 0x7f8ddc0cd920 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8de0b40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1f4090 con 0x7f8ddc15ce90 2023-08-10T10:47:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8ddaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8ddaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33100/0 (socket says 172.21.15.50:33100) 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.619+0000 7f8ddaffd640 1 -- 172.21.15.50:0/127359678 learned_addr learned my addr 172.21.15.50:0/127359678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddb7fe640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddbfff640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc15ce90 0x7f8ddc15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 -- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc15ce90 msgr2=0x7f8ddc15e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc15ce90 0x7f8ddc15e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 -- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 msgr2=0x7f8ddc0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 -- 172.21.15.50:0/127359678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4009b30 con 0x7f8ddc0cf310 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8ddaffd640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c3f0 tx=0x7f8dc400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.620+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40052d0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.621+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4005450 con 0x7f8ddc0cf310 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.621+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4007260 con 0x7f8ddc0cf310 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.621+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc14d6d0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.621+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc1f3a40 con 0x7f8ddc0cf310 2023-08-10T10:47:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.622+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc1f38a0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.623+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dc40073c0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.624+0000 7f8dd3fff640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 0x7f8dbc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.624+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8dc4088500 con 0x7f8ddc0cf310 2023-08-10T10:47:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.624+0000 7f8ddb7fe640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 0x7f8dbc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.625+0000 7f8ddb7fe640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 0x7f8dbc06d140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009ad0 tx=0x7f8dcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.628+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ddc1f38a0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.808+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8ddc1f38a0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.816+0000 7f8dd3fff640 1 -- 172.21.15.50:0/127359678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ddc1f38a0 con 0x7f8ddc0cf310 2023-08-10T10:47:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 msgr2=0x7f8dbc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 0x7f8dbc06d140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009ad0 tx=0x7f8dcc008040 comp rx=0 tx=0).stop 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 msgr2=0x7f8ddc0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c3f0 tx=0x7f8dc400c8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 shutdown_connections 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ddc15ce90 0x7f8ddc15e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ddc0cf310 0x7f8ddc0ca920 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8dbc06ac80 0x7f8dbc06d140 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 --2- 172.21.15.50:0/127359678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ddc0cd920 0x7f8ddc0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 >> 172.21.15.50:0/127359678 conn(0x7f8ddc06fcc0 msgr2=0x7f8ddc0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.819+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 shutdown_connections 2023-08-10T10:47:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:20.820+0000 7f8de0b40640 1 -- 172.21.15.50:0/127359678 wait complete. 2023-08-10T10:47:20.839 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:47:20.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:47:20.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:47:21.070 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:47:21.070 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:21.071 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:21.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:47:21.136 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:21.136 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:21.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:47:21.196 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:21.197 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:21.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:47:21.262 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:21.262 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:21.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:47:21.325 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:47:21.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:21.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.563+0000 7fc97a2b4640 1 Processor -- start 2023-08-10T10:47:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.563+0000 7fc97a2b4640 1 -- start start 2023-08-10T10:47:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.564+0000 7fc97a2b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9740b8430 0x7fc9740cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.564+0000 7fc97a2b4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9740cddb0 0x7fc9740d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc97a2b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc974161180 con 0x7fc97415cd60 2023-08-10T10:47:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc97a2b4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740ce240 con 0x7fc9740cddb0 2023-08-10T10:47:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc97a2b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b5bd0 con 0x7fc9740b8430 2023-08-10T10:47:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc973fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc97415cd60 0x7fc974160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40454/0 (socket says 172.21.15.50:40454) 2023-08-10T10:47:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc973fff640 1 -- 172.21.15.50:0/630668440 learned_addr learned my addr 172.21.15.50:0/630668440 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc9737fe640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9740b8430 0x7fc9740cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.565+0000 7fc978851640 1 --2- 172.21.15.50:0/630668440 >> v2:172.21.15.117:3300/0 conn(0x7fc9740cddb0 0x7fc9740d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc972ffd640 1 -- 172.21.15.50:0/630668440 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797197268 0 0) 0x7fc974161180 con 0x7fc97415cd60 2023-08-10T10:47:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc972ffd640 1 -- 172.21.15.50:0/630668440 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c003520 con 0x7fc97415cd60 2023-08-10T10:47:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc978851640 1 -- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9740b8430 msgr2=0x7fc9740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc978851640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9740b8430 0x7fc9740cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc978851640 1 -- 172.21.15.50:0/630668440 >> v1:172.21.15.50:6789/0 conn(0x7fc97415cd60 legacy=0x7fc974160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.566+0000 7fc978851640 1 -- 172.21.15.50:0/630668440 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974161460 con 0x7fc9740cddb0 2023-08-10T10:47:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.568+0000 7fc978851640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740d1400 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097a0 tx=0x7fc96c02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=111a7f1500b0ce44 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.572+0000 7fc972ffd640 1 -- 172.21.15.50:0/630668440 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c030800 con 0x7fc9740cddb0 2023-08-10T10:47:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.572+0000 7fc972ffd640 1 -- 172.21.15.50:0/630668440 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c030960 con 0x7fc9740cddb0 2023-08-10T10:47:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.572+0000 7fc972ffd640 1 -- 172.21.15.50:0/630668440 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c030cf0 con 0x7fc9740cddb0 2023-08-10T10:47:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 -- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 msgr2=0x7fc9740d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740d1400 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097a0 tx=0x7fc96c02b940 comp rx=0 tx=0).stop 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 -- 172.21.15.50:0/630668440 shutdown_connections 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740d1400 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/630668440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9740b8430 0x7fc9740cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 -- 172.21.15.50:0/630668440 >> 172.21.15.50:0/630668440 conn(0x7fc9740d2ac0 msgr2=0x7fc9740d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 -- 172.21.15.50:0/630668440 shutdown_connections 2023-08-10T10:47:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.573+0000 7fc97a2b4640 1 -- 172.21.15.50:0/630668440 wait complete. 2023-08-10T10:47:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.575+0000 7fc97a2b4640 1 Processor -- start 2023-08-10T10:47:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.575+0000 7fc97a2b4640 1 -- start start 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 0x7fc9740cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741f3d10 con 0x7fc9740b8430 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c9380 con 0x7fc9740cddb0 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.576+0000 7fc97a2b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741f3fb0 con 0x7fc97415cd60 2023-08-10T10:47:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33102/0 (socket says 172.21.15.50:33102) 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 -- 172.21.15.50:0/56720139 learned_addr learned my addr 172.21.15.50:0/56720139 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc978851640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 0x7fc9740cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 -- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 msgr2=0x7fc9740cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc9737fe640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 0x7fc9740cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 -- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 msgr2=0x7fc9740c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc973fff640 1 -- 172.21.15.50:0/56720139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009400 con 0x7fc9740b8430 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.577+0000 7fc978851640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 0x7fc9740cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc973fff640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fc96400cbc0 tx=0x7fc96400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400ad40 con 0x7fc9740b8430 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964012400 con 0x7fc9740b8430 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400aea0 con 0x7fc9740b8430 2023-08-10T10:47:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9741f4290 con 0x7fc9740b8430 2023-08-10T10:47:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.578+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740aa370 con 0x7fc9740b8430 2023-08-10T10:47:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.579+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9741f47b0 con 0x7fc9740b8430 2023-08-10T10:47:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.580+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc964007070 con 0x7fc9740b8430 2023-08-10T10:47:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.582+0000 7fc970ff9640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 0x7fc96006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.582+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc964089250 con 0x7fc9740b8430 2023-08-10T10:47:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.582+0000 7fc9737fe640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 0x7fc96006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.583+0000 7fc9737fe640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 0x7fc96006d110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc9740b2c40 tx=0x7fc968008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:21.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.587+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc964054640 con 0x7fc9740b8430 2023-08-10T10:47:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.824+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc97404e270 con 0x7fc9740b8430 2023-08-10T10:47:21.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.825+0000 7fc970ff9640 1 -- 172.21.15.50:0/56720139 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fc964017de0 con 0x7fc9740b8430 2023-08-10T10:47:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:21.827 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/4201562179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":4201562179},{"type":"v1","addr":"172.21.15.117:6834","nonce":4201562179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2490056607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2490056607},{"type":"v1","addr":"172.21.15.50:6835","nonce":2490056607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2424560169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2424560169},{"type":"v1","addr":"172.21.15.117:6835","nonce":2424560169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8415,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/3457270120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":3457270120},{"type":"v1","addr":"172.21.15.50:6837","nonce":3457270120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[]} 2023-08-10T10:47:21.828 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 69 2023-08-10T10:47:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 msgr2=0x7fc96006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 0x7fc96006d110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc9740b2c40 tx=0x7fc968008040 comp rx=0 tx=0).stop 2023-08-10T10:47:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 msgr2=0x7fc97415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fc96400cbc0 tx=0x7fc96400a430 comp rx=0 tx=0).stop 2023-08-10T10:47:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 shutdown_connections 2023-08-10T10:47:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc97415cd60 0x7fc9740cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc96006ac50 0x7fc96006d110 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9740cddb0 0x7fc9740c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 --2- 172.21.15.50:0/56720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9740b8430 0x7fc97415a5b0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 >> 172.21.15.50:0/56720139 conn(0x7fc9740d2ac0 msgr2=0x7fc9740b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 shutdown_connections 2023-08-10T10:47:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:21.828+0000 7fc97a2b4640 1 -- 172.21.15.50:0/56720139 wait complete. 2023-08-10T10:47:21.847 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:47:21.848 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:47:21.848 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:47:21.849 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:47:21.849 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:47:21.849 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:47:21.849 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:47:21.849 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:47:21.850 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:47:21.850 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:47:21.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:47:21.850 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:47:21.851 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:47:21.851 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:47:21.851 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:47:21.851 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:47:21.867 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:47:21.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:47:21.868 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:47:21.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:47:21.881 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:47:21.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:47:21.882 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:47:21.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:47:21.916 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:47:21.917 DEBUG:teuthology.parallel:result is None 2023-08-10T10:47:21.924 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:47:21.924 DEBUG:teuthology.parallel:result is None 2023-08-10T10:47:21.934 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:47:21.934 DEBUG:teuthology.parallel:result is None 2023-08-10T10:47:21.940 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:47:21.941 DEBUG:teuthology.parallel:result is None 2023-08-10T10:47:21.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:47:22.088 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:47:22.097 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:47:22.099 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:47:22.099 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:47:22.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.142+0000 7f3a0d0d3640 1 Processor -- start 2023-08-10T10:47:22.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.143+0000 7f3a0d0d3640 1 -- start start 2023-08-10T10:47:22.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0d0d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a0815a820 0x7f3a0806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0d0d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a08069db0 0x7f3a080cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0d0d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0815bcb0 con 0x7f3a0815ac00 2023-08-10T10:47:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0d0d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c5540 con 0x7f3a08069db0 2023-08-10T10:47:22.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0d0d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0815b0a0 con 0x7f3a0815a820 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.144+0000 7f3a0759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a08069db0 0x7f3a080cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a08069db0 0x7f3a080cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33128/0 (socket says 172.21.15.50:33128) 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 -- 172.21.15.50:0/2208195382 learned_addr learned my addr 172.21.15.50:0/2208195382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a06d9d640 1 --2- 172.21.15.50:0/2208195382 >> v2:172.21.15.117:3300/0 conn(0x7f3a0815a820 0x7f3a0806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 -- 172.21.15.50:0/2208195382 >> v2:172.21.15.117:3300/0 conn(0x7f3a0815a820 msgr2=0x7f3a0806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:22.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 --2- 172.21.15.50:0/2208195382 >> v2:172.21.15.117:3300/0 conn(0x7f3a0815a820 0x7f3a0806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 -- 172.21.15.50:0/2208195382 >> v1:172.21.15.117:6789/0 conn(0x7f3a0815ac00 legacy=0x7f3a080696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:22.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.145+0000 7f3a0759e640 1 -- 172.21.15.50:0/2208195382 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0815b380 con 0x7f3a08069db0 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.146+0000 7f3a0759e640 1 --2- 172.21.15.50:0/2208195382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a08069db0 0x7f3a080cc370 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3a080cee20 tx=0x7f3a0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb9875713e7b06 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.146+0000 7f3a0659c640 1 -- 172.21.15.50:0/2208195382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0002ca80 con 0x7f3a08069db0 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0659c640 1 -- 172.21.15.50:0/2208195382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0002cbe0 con 0x7f3a08069db0 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0659c640 1 -- 172.21.15.50:0/2208195382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000343f0 con 0x7f3a08069db0 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/2208195382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a08069db0 msgr2=0x7f3a080cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/2208195382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a08069db0 0x7f3a080cc370 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3a080cee20 tx=0x7f3a0002bee0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/2208195382 shutdown_connections 2023-08-10T10:47:22.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/2208195382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a08069db0 0x7f3a080cc370 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/2208195382 >> v2:172.21.15.117:3300/0 conn(0x7f3a0815a820 0x7f3a0806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/2208195382 >> 172.21.15.50:0/2208195382 conn(0x7f3a080b08e0 msgr2=0x7f3a080ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:22.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/2208195382 shutdown_connections 2023-08-10T10:47:22.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.147+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/2208195382 wait complete. 2023-08-10T10:47:22.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.149+0000 7f3a0d0d3640 1 Processor -- start 2023-08-10T10:47:22.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.149+0000 7f3a0d0d3640 1 -- start start 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 0x7f3a08157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a0815ac00 0x7f3a0815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08158100 con 0x7f3a0815a820 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c3110 con 0x7f3a08069db0 2023-08-10T10:47:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.150+0000 7f3a0d0d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c33f0 con 0x7f3a0815ac00 2023-08-10T10:47:22.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33130/0 (socket says 172.21.15.50:33130) 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 -- 172.21.15.50:0/1758528208 learned_addr learned my addr 172.21.15.50:0/1758528208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f3a06d9d640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 0x7f3a08157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f3a0759e640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a0815ac00 0x7f3a0815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 -- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a0815ac00 msgr2=0x7f3a0815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a0815ac00 0x7f3a0815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 -- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 msgr2=0x7f3a08157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 0x7f3a08157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f39fffff640 1 -- 172.21.15.50:0/1758528208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009b30 con 0x7f3a0815a820 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.151+0000 7f3a06d9d640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 0x7f3a08157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f39fffff640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c3c0 tx=0x7f39f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00052d0 con 0x7f3a0815a820 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0005450 con 0x7f3a0815a820 2023-08-10T10:47:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080c36d0 con 0x7f3a0815a820 2023-08-10T10:47:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0007260 con 0x7f3a0815a820 2023-08-10T10:47:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.152+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080c3c90 con 0x7f3a0815a820 2023-08-10T10:47:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.153+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0804e270 con 0x7f3a0815a820 2023-08-10T10:47:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.154+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39f00073c0 con 0x7f3a0815a820 2023-08-10T10:47:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.155+0000 7f39ff7fe640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 0x7f39e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.155+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f39f00885f0 con 0x7f3a0815a820 2023-08-10T10:47:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.155+0000 7f3a06d9d640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 0x7f39e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.156+0000 7f3a06d9d640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 0x7f39e806d110 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006fd0 tx=0x7f39f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:22.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.159+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39f0053920 con 0x7f3a0815a820 2023-08-10T10:47:22.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:22.372+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3a0806be50 con 0x7f3a0815a820 2023-08-10T10:47:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.014+0000 7f39ff7fe640 1 -- 172.21.15.50:0/1758528208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39f0056f40 con 0x7f3a0815a820 2023-08-10T10:47:23.016 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:47:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 msgr2=0x7f39e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 0x7f39e806d110 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006fd0 tx=0x7f39f8008040 comp rx=0 tx=0).stop 2023-08-10T10:47:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 msgr2=0x7f3a0815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c3c0 tx=0x7f39f000c880 comp rx=0 tx=0).stop 2023-08-10T10:47:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 shutdown_connections 2023-08-10T10:47:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a0815ac00 0x7f3a0815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0815a820 0x7f3a0815bfc0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39e806ac50 0x7f39e806d110 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.018+0000 7f3a0d0d3640 1 --2- 172.21.15.50:0/1758528208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a08069db0 0x7f3a08157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.019+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 >> 172.21.15.50:0/1758528208 conn(0x7f3a080b08e0 msgr2=0x7f3a080696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.019+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 shutdown_connections 2023-08-10T10:47:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.019+0000 7f3a0d0d3640 1 -- 172.21.15.50:0/1758528208 wait complete. 2023-08-10T10:47:23.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:47:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.267+0000 7fb1eabab640 1 Processor -- start 2023-08-10T10:47:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.267+0000 7fb1eabab640 1 -- start start 2023-08-10T10:47:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.269+0000 7fb1eabab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.269+0000 7fb1eabab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1e40b19d0 0x7fb1e40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.269+0000 7fb1eabab640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40b1f10 con 0x7fb1e415f2b0 2023-08-10T10:47:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.269+0000 7fb1eabab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40b21f0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.269+0000 7fb1eabab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e415e5c0 con 0x7fb1e415a940 2023-08-10T10:47:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.270+0000 7fb1e9ba9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.270+0000 7fb1e9ba9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:38700/0 (socket says 172.21.15.50:38700) 2023-08-10T10:47:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.270+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/709764189 learned_addr learned my addr 172.21.15.50:0/709764189 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.270+0000 7fb1e93a8640 1 --1- 172.21.15.50:0/709764189 >> v1:172.21.15.117:6789/0 conn(0x7fb1e415f2b0 0x7fb1e40b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:50440/0 (socket says 172.21.15.50:50440) 2023-08-10T10:47:23.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.270+0000 7fb1ea3aa640 1 --2- 172.21.15.50:0/709764189 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40b19d0 0x7fb1e40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.271+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/709764189 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40b19d0 msgr2=0x7fb1e40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.271+0000 7fb1e9ba9640 1 --2- 172.21.15.50:0/709764189 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40b19d0 0x7fb1e40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.271+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/709764189 >> v1:172.21.15.117:6789/0 conn(0x7fb1e415f2b0 legacy=0x7fb1e40b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.271+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/709764189 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e415e7d0 con 0x7fb1e415a940 2023-08-10T10:47:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.272+0000 7fb1e9ba9640 1 --2- 172.21.15.50:0/709764189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009870 tx=0x7fb1e002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f814916240447 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.273+0000 7fb1e8ba7640 1 -- 172.21.15.50:0/709764189 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0031640 con 0x7fb1e415a940 2023-08-10T10:47:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.273+0000 7fb1e8ba7640 1 -- 172.21.15.50:0/709764189 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00317a0 con 0x7fb1e415a940 2023-08-10T10:47:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.273+0000 7fb1e8ba7640 1 -- 172.21.15.50:0/709764189 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0031b30 con 0x7fb1e415a940 2023-08-10T10:47:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 -- 172.21.15.50:0/709764189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 msgr2=0x7fb1e40aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 --2- 172.21.15.50:0/709764189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009870 tx=0x7fb1e002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 -- 172.21.15.50:0/709764189 shutdown_connections 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 --2- 172.21.15.50:0/709764189 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40b19d0 0x7fb1e40b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 --2- 172.21.15.50:0/709764189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415a940 0x7fb1e40aff10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 -- 172.21.15.50:0/709764189 >> 172.21.15.50:0/709764189 conn(0x7fb1e406ab80 msgr2=0x7fb1e406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 -- 172.21.15.50:0/709764189 shutdown_connections 2023-08-10T10:47:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.274+0000 7fb1eabab640 1 -- 172.21.15.50:0/709764189 wait complete. 2023-08-10T10:47:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.276+0000 7fb1eabab640 1 Processor -- start 2023-08-10T10:47:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.277+0000 7fb1eabab640 1 -- start start 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 0x7fb1e40c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415f2b0 0x7fb1e40c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41f79d0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40cc270 con 0x7fb1e415a940 2023-08-10T10:47:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1eabab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41f7200 con 0x7fb1e415f2b0 2023-08-10T10:47:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.278+0000 7fb1e9ba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33146/0 (socket says 172.21.15.50:33146) 2023-08-10T10:47:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/2578335054 learned_addr learned my addr 172.21.15.50:0/2578335054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1ea3aa640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415f2b0 0x7fb1e40c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e93a8640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 0x7fb1e40c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415f2b0 msgr2=0x7fb1e40c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415f2b0 0x7fb1e40c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 msgr2=0x7fb1e40c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 0x7fb1e40c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 -- 172.21.15.50:0/2578335054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00094d0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e93a8640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 0x7fb1e40c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.279+0000 7fb1e9ba9640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0000c00 tx=0x7fb1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.280+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003a930 con 0x7fb1e40b19d0 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.280+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e003aa90 con 0x7fb1e40b19d0 2023-08-10T10:47:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.280+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e406fc60 con 0x7fb1e40b19d0 2023-08-10T10:47:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.280+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003ae40 con 0x7fb1e40b19d0 2023-08-10T10:47:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.280+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e41f76f0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.281+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4066e30 con 0x7fb1e40b19d0 2023-08-10T10:47:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.282+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1e002f050 con 0x7fb1e40b19d0 2023-08-10T10:47:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.283+0000 7fb1da7fc640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 0x7fb1c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.283+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1e00aaff0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.284+0000 7fb1e93a8640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 0x7fb1c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.284+0000 7fb1e93a8640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 0x7fb1c806d110 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40ce130 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.289+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb1e0076350 con 0x7fb1e40b19d0 2023-08-10T10:47:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.547+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb1e40b0dc0 con 0x7fb1e40b19d0 2023-08-10T10:47:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.548+0000 7fb1da7fc640 1 -- 172.21.15.50:0/2578335054 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb1e0035090 con 0x7fb1e40b19d0 2023-08-10T10:47:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:23.550 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:47:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:47:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:47:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:47:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:47:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:47:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:47:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:47:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:47:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:47:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:47:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:47:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:47:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:47:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:47:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:47:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:47:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:47:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:47:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:47:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:47:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:47:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:47:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:47:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:47:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:47:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:47:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:47:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:47:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:47:23.583 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:47:23.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:47:23.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:47:23.583 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:47:23.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:23.584 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:47:23.584 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:47:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.550+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 msgr2=0x7fb1c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.550+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 0x7fb1c806d110 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40ce130 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2023-08-10T10:47:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.550+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 msgr2=0x7fb1e40c2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.550+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0000c00 tx=0x7fb1e00046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.550+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 shutdown_connections 2023-08-10T10:47:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e415f2b0 0x7fb1e40c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb1c806ac50 0x7fb1c806d110 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e415a940 0x7fb1e40c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 --2- 172.21.15.50:0/2578335054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1e40b19d0 0x7fb1e40c2450 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 >> 172.21.15.50:0/2578335054 conn(0x7fb1e406ab80 msgr2=0x7fb1e40ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 shutdown_connections 2023-08-10T10:47:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.551+0000 7fb1eabab640 1 -- 172.21.15.50:0/2578335054 wait complete. 2023-08-10T10:47:23.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.807+0000 7fbd6cae0640 1 Processor -- start 2023-08-10T10:47:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.807+0000 7fbd6cae0640 1 -- start start 2023-08-10T10:47:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd6815a940 0x7fbd680aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd680b12c0 0x7fbd680b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd680b21f0 con 0x7fbd6815a940 2023-08-10T10:47:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815e5c0 con 0x7fbd680b12c0 2023-08-10T10:47:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd6cae0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680b3a60 con 0x7fbd6815f2b0 2023-08-10T10:47:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd6815a940 0x7fbd680aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd6815a940 0x7fbd680aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33148/0 (socket says 172.21.15.50:33148) 2023-08-10T10:47:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.809+0000 7fbd677fe640 1 -- 172.21.15.50:0/3713049768 learned_addr learned my addr 172.21.15.50:0/3713049768 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.810+0000 7fbd677fe640 1 -- 172.21.15.50:0/3713049768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 msgr2=0x7fbd680b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.810+0000 7fbd677fe640 1 --2- 172.21.15.50:0/3713049768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.810+0000 7fbd677fe640 1 -- 172.21.15.50:0/3713049768 >> v2:172.21.15.117:3300/0 conn(0x7fbd680b12c0 msgr2=0x7fbd680b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.810+0000 7fbd677fe640 1 --2- 172.21.15.50:0/3713049768 >> v2:172.21.15.117:3300/0 conn(0x7fbd680b12c0 0x7fbd680b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.810+0000 7fbd677fe640 1 -- 172.21.15.50:0/3713049768 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680b1c90 con 0x7fbd6815a940 2023-08-10T10:47:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.811+0000 7fbd677fe640 1 --2- 172.21.15.50:0/3713049768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd680aff10 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fbd680b3ba0 tx=0x7fbd5802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef50adb476395b4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.811+0000 7fbd667fc640 1 -- 172.21.15.50:0/3713049768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580317c0 con 0x7fbd6815a940 2023-08-10T10:47:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.811+0000 7fbd667fc640 1 -- 172.21.15.50:0/3713049768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd58031920 con 0x7fbd6815a940 2023-08-10T10:47:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.811+0000 7fbd667fc640 1 -- 172.21.15.50:0/3713049768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58031cb0 con 0x7fbd6815a940 2023-08-10T10:47:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 -- 172.21.15.50:0/3713049768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 msgr2=0x7fbd680aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/3713049768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd680aff10 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fbd680b3ba0 tx=0x7fbd5802b860 comp rx=0 tx=0).stop 2023-08-10T10:47:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 -- 172.21.15.50:0/3713049768 shutdown_connections 2023-08-10T10:47:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/3713049768 >> v2:172.21.15.117:3300/0 conn(0x7fbd680b12c0 0x7fbd680b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/3713049768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/3713049768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd680aff10 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 -- 172.21.15.50:0/3713049768 >> 172.21.15.50:0/3713049768 conn(0x7fbd6806ab80 msgr2=0x7fbd6806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 -- 172.21.15.50:0/3713049768 shutdown_connections 2023-08-10T10:47:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.812+0000 7fbd6cae0640 1 -- 172.21.15.50:0/3713049768 wait complete. 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.814+0000 7fbd6cae0640 1 Processor -- start 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.814+0000 7fbd6cae0640 1 -- start start 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 0x7fbd680c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6815ca60 con 0x7fbd6815a940 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6815cd40 con 0x7fbd680b12c0 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd6cae0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6815d020 con 0x7fbd6815f2b0 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33150/0 (socket says 172.21.15.50:33150) 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.815+0000 7fbd66ffd640 1 -- 172.21.15.50:0/4218033332 learned_addr learned my addr 172.21.15.50:0/4218033332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd677fe640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 0x7fbd680c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 -- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 msgr2=0x7fbd680c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 -- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 msgr2=0x7fbd680c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 0x7fbd680c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 -- 172.21.15.50:0/4218033332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580094d0 con 0x7fbd6815a940 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd677fe640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 0x7fbd680c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd66ffd640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b410 tx=0x7fbd5c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c011830 con 0x7fbd6815a940 2023-08-10T10:47:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0119b0 con 0x7fbd6815a940 2023-08-10T10:47:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c011d60 con 0x7fbd6815a940 2023-08-10T10:47:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6815d300 con 0x7fbd6815a940 2023-08-10T10:47:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.816+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd68149350 con 0x7fbd6815a940 2023-08-10T10:47:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.818+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68146500 con 0x7fbd6815a940 2023-08-10T10:47:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.819+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd5c01a400 con 0x7fbd6815a940 2023-08-10T10:47:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.819+0000 7fbd4ffff640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 0x7fbd5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.820+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbd5c089310 con 0x7fbd6815a940 2023-08-10T10:47:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.820+0000 7fbd677fe640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 0x7fbd5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.821+0000 7fbd677fe640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 0x7fbd5406d110 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbd58036000 tx=0x7fbd5803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:23.824+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd68146500 con 0x7fbd6815a940 2023-08-10T10:47:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.017+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd68146500 con 0x7fbd6815a940 2023-08-10T10:47:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.019+0000 7fbd4ffff640 1 -- 172.21.15.50:0/4218033332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+14639 (secure 0 0 0) 0x7fbd68146500 con 0x7fbd6815a940 2023-08-10T10:47:24.021 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:24.021 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":154,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:23.024640+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.021+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 msgr2=0x7fbd5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.021+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 0x7fbd5406d110 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbd58036000 tx=0x7fbd5803d040 comp rx=0 tx=0).stop 2023-08-10T10:47:24.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.021+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 msgr2=0x7fbd68148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.021+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b410 tx=0x7fbd5c00b8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 shutdown_connections 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6815f2b0 0x7fbd680c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd6815a940 0x7fbd68148800 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbd5406ac50 0x7fbd5406d110 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 --2- 172.21.15.50:0/4218033332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680b12c0 0x7fbd680c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 >> 172.21.15.50:0/4218033332 conn(0x7fbd6806ab80 msgr2=0x7fbd680cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 shutdown_connections 2023-08-10T10:47:24.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.022+0000 7fbd6cae0640 1 -- 172.21.15.50:0/4218033332 wait complete. 2023-08-10T10:47:24.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:24.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.267+0000 7f926b025640 1 Processor -- start 2023-08-10T10:47:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.267+0000 7f926b025640 1 -- start start 2023-08-10T10:47:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926b025640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9264159790 0x7f92640b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926b025640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926406b290 0x7f92640cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926b025640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9264159b70 con 0x7f92640b3490 2023-08-10T10:47:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926b025640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92640cc380 con 0x7f9264159790 2023-08-10T10:47:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926b025640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92640cc590 con 0x7f926406b290 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926a023640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9264159790 0x7f92640b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926a023640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9264159790 0x7f92640b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33158/0 (socket says 172.21.15.50:33158) 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f926a023640 1 -- 172.21.15.50:0/3705311481 learned_addr learned my addr 172.21.15.50:0/3705311481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.269+0000 7f9269822640 1 --1- 172.21.15.50:0/3705311481 >> v1:172.21.15.50:6789/0 conn(0x7f92640b3490 0x7f926406ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40464/0 (socket says 172.21.15.50:40464) 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.270+0000 7f926a023640 1 -- 172.21.15.50:0/3705311481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926406b290 msgr2=0x7f92640cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.270+0000 7f926a023640 1 --2- 172.21.15.50:0/3705311481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926406b290 0x7f92640cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.270+0000 7f926a023640 1 -- 172.21.15.50:0/3705311481 >> v1:172.21.15.50:6789/0 conn(0x7f92640b3490 legacy=0x7f926406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.270+0000 7f926a023640 1 -- 172.21.15.50:0/3705311481 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640cc870 con 0x7f9264159790 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.271+0000 7f926a023640 1 --2- 172.21.15.50:0/3705311481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92640b24a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f9260009870 tx=0x7f926002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6d95b08149017e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.271+0000 7f9269021640 1 -- 172.21.15.50:0/3705311481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260030840 con 0x7f9264159790 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.271+0000 7f9269021640 1 -- 172.21.15.50:0/3705311481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92600309a0 con 0x7f9264159790 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.271+0000 7f9269021640 1 -- 172.21.15.50:0/3705311481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260030d30 con 0x7f9264159790 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 -- 172.21.15.50:0/3705311481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 msgr2=0x7f92640b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 --2- 172.21.15.50:0/3705311481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92640b24a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f9260009870 tx=0x7f926002b980 comp rx=0 tx=0).stop 2023-08-10T10:47:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 -- 172.21.15.50:0/3705311481 shutdown_connections 2023-08-10T10:47:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 --2- 172.21.15.50:0/3705311481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926406b290 0x7f92640cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 --2- 172.21.15.50:0/3705311481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92640b24a0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 -- 172.21.15.50:0/3705311481 >> 172.21.15.50:0/3705311481 conn(0x7f9264069cd0 msgr2=0x7f92640caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 -- 172.21.15.50:0/3705311481 shutdown_connections 2023-08-10T10:47:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.272+0000 7f926b025640 1 -- 172.21.15.50:0/3705311481 wait complete. 2023-08-10T10:47:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.274+0000 7f926b025640 1 Processor -- start 2023-08-10T10:47:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.274+0000 7f926b025640 1 -- start start 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 0x7f92640c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 0x7f92640c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264152cf0 con 0x7f9264159790 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264070f90 con 0x7f926406b290 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926b025640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9264071270 con 0x7f92640b3490 2023-08-10T10:47:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926a824640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926a824640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33164/0 (socket says 172.21.15.50:33164) 2023-08-10T10:47:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.275+0000 7f926a824640 1 -- 172.21.15.50:0/3046052808 learned_addr learned my addr 172.21.15.50:0/3046052808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f9269822640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 0x7f92640c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a023640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 0x7f92640c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 -- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 msgr2=0x7f92640c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 0x7f92640c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 -- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 msgr2=0x7f92640c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 0x7f92640c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 -- 172.21.15.50:0/3046052808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600094d0 con 0x7f9264159790 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a023640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 0x7f92640c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f9269822640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 0x7f92640c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926a824640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b9e0 tx=0x7f925c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00cb20 con 0x7f9264159790 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00cca0 con 0x7f9264159790 2023-08-10T10:47:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c014680 con 0x7f9264159790 2023-08-10T10:47:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.276+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640ae280 con 0x7f9264159790 2023-08-10T10:47:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.277+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92640c7bb0 con 0x7f9264159790 2023-08-10T10:47:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.278+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9264066e30 con 0x7f9264159790 2023-08-10T10:47:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.279+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f925c01d3b0 con 0x7f9264159790 2023-08-10T10:47:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.279+0000 7f925affd640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 0x7f924806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.280+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f925c089090 con 0x7f9264159790 2023-08-10T10:47:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.280+0000 7f926a023640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 0x7f924806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.280+0000 7f926a023640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 0x7f924806d110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9260036000 tx=0x7f926003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.284+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f925c054480 con 0x7f9264159790 2023-08-10T10:47:24.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.469+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92640ca2d0 con 0x7f9264159790 2023-08-10T10:47:24.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.470+0000 7f925affd640 1 -- 172.21.15.50:0/3046052808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7f925c0190a0 con 0x7f9264159790 2023-08-10T10:47:24.472 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:47:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 msgr2=0x7f924806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 0x7f924806d110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9260036000 tx=0x7f926003b040 comp rx=0 tx=0).stop 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 msgr2=0x7f92641527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b9e0 tx=0x7f925c00bea0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 shutdown_connections 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9264159790 0x7f92641527b0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92640b3490 0x7f92640c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f924806ac50 0x7f924806d110 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 --2- 172.21.15.50:0/3046052808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926406b290 0x7f92640c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 >> 172.21.15.50:0/3046052808 conn(0x7f9264069cd0 msgr2=0x7f9264158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 shutdown_connections 2023-08-10T10:47:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.473+0000 7f926b025640 1 -- 172.21.15.50:0/3046052808 wait complete. 2023-08-10T10:47:24.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:47:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.708+0000 7f7742cad640 1 Processor -- start 2023-08-10T10:47:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.708+0000 7f7742cad640 1 -- start start 2023-08-10T10:47:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.709+0000 7f7742cad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c15cb90 0x7f773c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.709+0000 7f7742cad640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 0x7f773c160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.709+0000 7f7742cad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c160a40 con 0x7f773c0b4640 2023-08-10T10:47:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.709+0000 7f7742cad640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0b4bb0 con 0x7f773c15cb90 2023-08-10T10:47:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.709+0000 7f7742cad640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0b4e90 con 0x7f773c15cf70 2023-08-10T10:47:24.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c15cb90 0x7f773c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f773c15cb90 0x7f773c0b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33176/0 (socket says 172.21.15.50:33176) 2023-08-10T10:47:24.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 -- 172.21.15.50:0/813948761 learned_addr learned my addr 172.21.15.50:0/813948761 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f773bfff640 1 --2- 172.21.15.50:0/813948761 >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 0x7f773c160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 -- 172.21.15.50:0/813948761 >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 msgr2=0x7f773c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 --2- 172.21.15.50:0/813948761 >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 0x7f773c160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 -- 172.21.15.50:0/813948761 >> v1:172.21.15.117:6789/0 conn(0x7f773c0b4640 legacy=0x7f773c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f7740a49640 1 -- 172.21.15.50:0/813948761 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0b5170 con 0x7f773c15cb90 2023-08-10T10:47:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.710+0000 7f773bfff640 1 --2- 172.21.15.50:0/813948761 >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 0x7f773c160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.712+0000 7f7740a49640 1 --2- 172.21.15.50:0/813948761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c0b5dd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f773c0d2b70 tx=0x7f772c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d127a1c3be6244 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.712+0000 7f773b7fe640 1 -- 172.21.15.50:0/813948761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c031870 con 0x7f773c15cb90 2023-08-10T10:47:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.712+0000 7f773b7fe640 1 -- 172.21.15.50:0/813948761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0319d0 con 0x7f773c15cb90 2023-08-10T10:47:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.712+0000 7f773b7fe640 1 -- 172.21.15.50:0/813948761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c031d60 con 0x7f773c15cb90 2023-08-10T10:47:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 -- 172.21.15.50:0/813948761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 msgr2=0x7f773c0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 --2- 172.21.15.50:0/813948761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c0b5dd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f773c0d2b70 tx=0x7f772c02b910 comp rx=0 tx=0).stop 2023-08-10T10:47:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 -- 172.21.15.50:0/813948761 shutdown_connections 2023-08-10T10:47:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 --2- 172.21.15.50:0/813948761 >> v2:172.21.15.117:3300/0 conn(0x7f773c15cf70 0x7f773c160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 --2- 172.21.15.50:0/813948761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c0b5dd0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 -- 172.21.15.50:0/813948761 >> 172.21.15.50:0/813948761 conn(0x7f773c0cf640 msgr2=0x7f773c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:24.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 -- 172.21.15.50:0/813948761 shutdown_connections 2023-08-10T10:47:24.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.713+0000 7f7742cad640 1 -- 172.21.15.50:0/813948761 wait complete. 2023-08-10T10:47:24.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.715+0000 7f7742cad640 1 Processor -- start 2023-08-10T10:47:24.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.715+0000 7f7742cad640 1 -- start start 2023-08-10T10:47:24.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f773c0b4640 0x7f773c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f773c15cf70 0x7f773c1e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15f810 con 0x7f773c15cb90 2023-08-10T10:47:24.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15e770 con 0x7f773c15cf70 2023-08-10T10:47:24.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f7742cad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15ea50 con 0x7f773c0b4640 2023-08-10T10:47:24.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.716+0000 7f773bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33178/0 (socket says 172.21.15.50:33178) 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 -- 172.21.15.50:0/632310364 learned_addr learned my addr 172.21.15.50:0/632310364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f7740a49640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f773c0b4640 0x7f773c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f774124a640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f773c15cf70 0x7f773c1e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 -- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f773c0b4640 msgr2=0x7f773c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f773c0b4640 0x7f773c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 -- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f773c15cf70 msgr2=0x7f773c1e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f773c15cf70 0x7f773c1e7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 -- 172.21.15.50:0/632310364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0094d0 con 0x7f773c15cb90 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.717+0000 7f773bfff640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f772400ce00 tx=0x7f772400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.718+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400f890 con 0x7f773c15cb90 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.718+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400f9f0 con 0x7f773c15cb90 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.718+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400fdc0 con 0x7f773c15cb90 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.718+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c15ed30 con 0x7f773c15cb90 2023-08-10T10:47:24.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.718+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c15f2f0 con 0x7f773c15cb90 2023-08-10T10:47:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.719+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c14ce40 con 0x7f773c15cb90 2023-08-10T10:47:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.720+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f772400b040 con 0x7f773c15cb90 2023-08-10T10:47:24.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.721+0000 7f77397fa640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 0x7f771c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.721+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7724089b90 con 0x7f773c15cb90 2023-08-10T10:47:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.722+0000 7f7740a49640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 0x7f771c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.722+0000 7f7740a49640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 0x7f771c06d110 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f772c036000 tx=0x7f772c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:24.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.725+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7724054f80 con 0x7f773c15cb90 2023-08-10T10:47:24.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.915+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f773c0612b0 con 0x7f773c15cb90 2023-08-10T10:47:24.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.916+0000 7f77397fa640 1 -- 172.21.15.50:0/632310364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f772401d020 con 0x7f773c15cb90 2023-08-10T10:47:24.918 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:47:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 msgr2=0x7f771c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 0x7f771c06d110 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f772c036000 tx=0x7f772c03c040 comp rx=0 tx=0).stop 2023-08-10T10:47:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 msgr2=0x7f773c1f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f772400ce00 tx=0x7f772400a650 comp rx=0 tx=0).stop 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 shutdown_connections 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f771c06ac50 0x7f771c06d110 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f773c15cf70 0x7f773c1e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f773c15cb90 0x7f773c1f23a0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.918+0000 7f7742cad640 1 --2- 172.21.15.50:0/632310364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f773c0b4640 0x7f773c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:24.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.919+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 >> 172.21.15.50:0/632310364 conn(0x7f773c0cf640 msgr2=0x7f773c0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.919+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 shutdown_connections 2023-08-10T10:47:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:24.919+0000 7f7742cad640 1 -- 172.21.15.50:0/632310364 wait complete. 2023-08-10T10:47:24.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:47:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.166+0000 7fdc6f59e640 1 Processor -- start 2023-08-10T10:47:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.166+0000 7fdc6f59e640 1 -- start start 2023-08-10T10:47:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.167+0000 7fdc6f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 0x7fdc70160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6f59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700ce410 con 0x7fdc700b5e50 2023-08-10T10:47:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6f59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc70160e70 con 0x7fdc7006ec60 2023-08-10T10:47:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700ce7d0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc700b5e50 0x7fdc7006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46010/0 (socket says 172.21.15.50:46010) 2023-08-10T10:47:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6dd9b640 1 -- 172.21.15.50:0/4163757721 learned_addr learned my addr 172.21.15.50:0/4163757721 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.168+0000 7fdc6e59c640 1 --2- 172.21.15.50:0/4163757721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 0x7fdc70160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040097727 0 0) 0x7fdc700ce410 con 0x7fdc700b5e50 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc58003520 con 0x7fdc700b5e50 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6e59c640 1 -- 172.21.15.50:0/4163757721 >> v1:172.21.15.117:6789/0 conn(0x7fdc7006ec60 legacy=0x7fdc700cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6e59c640 1 -- 172.21.15.50:0/4163757721 >> v1:172.21.15.50:6789/0 conn(0x7fdc700b5e50 legacy=0x7fdc7006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914037318 0 0) 0x7fdc70160e70 con 0x7fdc7006ec60 2023-08-10T10:47:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.169+0000 7fdc6e59c640 1 -- 172.21.15.50:0/4163757721 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70161150 con 0x7fdc7015c9c0 2023-08-10T10:47:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.170+0000 7fdc6e59c640 1 --2- 172.21.15.50:0/4163757721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 0x7fdc70160640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097d0 tx=0x7fdc6002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf223db6e57de0db server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.171+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640019f0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.171+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6002e050 con 0x7fdc7015c9c0 2023-08-10T10:47:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.171+0000 7fdc6d59a640 1 -- 172.21.15.50:0/4163757721 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60030730 con 0x7fdc7015c9c0 2023-08-10T10:47:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 -- 172.21.15.50:0/4163757721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 msgr2=0x7fdc70160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/4163757721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 0x7fdc70160640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097d0 tx=0x7fdc6002b730 comp rx=0 tx=0).stop 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 -- 172.21.15.50:0/4163757721 shutdown_connections 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/4163757721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7015c9c0 0x7fdc70160640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 -- 172.21.15.50:0/4163757721 >> 172.21.15.50:0/4163757721 conn(0x7fdc700d0630 msgr2=0x7fdc700d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 -- 172.21.15.50:0/4163757721 shutdown_connections 2023-08-10T10:47:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.172+0000 7fdc6f59e640 1 -- 172.21.15.50:0/4163757721 wait complete. 2023-08-10T10:47:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.174+0000 7fdc6f59e640 1 Processor -- start 2023-08-10T10:47:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.174+0000 7fdc6f59e640 1 -- start start 2023-08-10T10:47:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7006ec60 0x7fdc7006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 0x7fdc7015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7006bfb0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700c92d0 con 0x7fdc700b5e50 2023-08-10T10:47:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.175+0000 7fdc6f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700c8a30 con 0x7fdc7006ec60 2023-08-10T10:47:25.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49320/0 (socket says 172.21.15.50:49320) 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 -- 172.21.15.50:0/62330745 learned_addr learned my addr 172.21.15.50:0/62330745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6e59c640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7006ec60 0x7fdc7006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6dd9b640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 0x7fdc7015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 -- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7006ec60 msgr2=0x7fdc7006b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7006ec60 0x7fdc7006b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 -- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 msgr2=0x7fdc7015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 0x7fdc7015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6ed9d640 1 -- 172.21.15.50:0/62330745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60009400 con 0x7fdc7015c9c0 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.176+0000 7fdc6dd9b640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 0x7fdc7015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc6ed9d640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c3e0 tx=0x7fdc6800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680035f0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68003750 con 0x7fdc7015c9c0 2023-08-10T10:47:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68003b40 con 0x7fdc7015c9c0 2023-08-10T10:47:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7006b9f0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.177+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc700c8f60 con 0x7fdc7015c9c0 2023-08-10T10:47:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.178+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc700c9440 con 0x7fdc7015c9c0 2023-08-10T10:47:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.179+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc68003ca0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.180+0000 7fdc5effd640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 0x7fdc5006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.180+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc680886c0 con 0x7fdc7015c9c0 2023-08-10T10:47:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.180+0000 7fdc6e59c640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 0x7fdc5006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.181+0000 7fdc6e59c640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 0x7fdc5006d110 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdc60034000 tx=0x7fdc60008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.184+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc68053b60 con 0x7fdc7015c9c0 2023-08-10T10:47:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.377+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc70066e30 con 0x7fdc7015c9c0 2023-08-10T10:47:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.378+0000 7fdc5effd640 1 -- 172.21.15.50:0/62330745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdc68057180 con 0x7fdc7015c9c0 2023-08-10T10:47:25.380 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:25.380 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:47:25.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:25.380 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:47:25.380 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:47:25.381 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:47:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 msgr2=0x7fdc5006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 0x7fdc5006d110 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdc60034000 tx=0x7fdc60008030 comp rx=0 tx=0).stop 2023-08-10T10:47:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 msgr2=0x7fdc7015fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c3e0 tx=0x7fdc6800c8a0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 shutdown_connections 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7015c9c0 0x7fdc7015fb20 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc5006ac50 0x7fdc5006d110 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc700b5e50 0x7fdc7015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 --2- 172.21.15.50:0/62330745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc7006ec60 0x7fdc7006b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 >> 172.21.15.50:0/62330745 conn(0x7fdc700d0630 msgr2=0x7fdc700cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 shutdown_connections 2023-08-10T10:47:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.381+0000 7fdc6f59e640 1 -- 172.21.15.50:0/62330745 wait complete. 2023-08-10T10:47:25.403 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:47:25.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:47:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.636+0000 7f7ba6f66640 1 Processor -- start 2023-08-10T10:47:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.636+0000 7f7ba6f66640 1 -- start start 2023-08-10T10:47:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba6f66640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ba015a820 0x7f7ba00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba6f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00ca740 0x7f7ba00cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba6f66640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00b1d60 con 0x7f7ba00718f0 2023-08-10T10:47:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba6f66640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00b4060 con 0x7f7ba015a820 2023-08-10T10:47:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba6f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c5450 con 0x7f7ba00ca740 2023-08-10T10:47:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.638+0000 7f7ba5763640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ba00718f0 0x7f7ba0070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46026/0 (socket says 172.21.15.50:46026) 2023-08-10T10:47:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.639+0000 7f7ba5763640 1 -- 172.21.15.50:0/1871030883 learned_addr learned my addr 172.21.15.50:0/1871030883 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.639+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/1871030883 >> v2:172.21.15.117:3300/0 conn(0x7f7ba015a820 0x7f7ba00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.639+0000 7f7ba6765640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00ca740 0x7f7ba00cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.639+0000 7f7ba4f62640 1 -- 172.21.15.50:0/1871030883 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144224463 0 0) 0x7f7ba00b1d60 con 0x7f7ba00718f0 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.639+0000 7f7ba4f62640 1 -- 172.21.15.50:0/1871030883 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c003520 con 0x7f7ba00718f0 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.640+0000 7f7ba5f64640 1 -- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00ca740 msgr2=0x7f7ba00cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.640+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00ca740 0x7f7ba00cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.640+0000 7f7ba5f64640 1 -- 172.21.15.50:0/1871030883 >> v1:172.21.15.50:6789/0 conn(0x7f7ba00718f0 legacy=0x7f7ba0070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.640+0000 7f7ba5f64640 1 -- 172.21.15.50:0/1871030883 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00b4480 con 0x7f7ba015a820 2023-08-10T10:47:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.641+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba015a820 0x7f7ba00cae20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097a0 tx=0x7f7b9c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f4c2e4a47eff83 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba4f62640 1 -- 172.21.15.50:0/1871030883 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c02d040 con 0x7f7ba015a820 2023-08-10T10:47:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba4f62640 1 -- 172.21.15.50:0/1871030883 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c031810 con 0x7f7ba015a820 2023-08-10T10:47:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba4f62640 1 -- 172.21.15.50:0/1871030883 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c031b80 con 0x7f7ba015a820 2023-08-10T10:47:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba6f66640 1 -- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba015a820 msgr2=0x7f7ba00cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba015a820 0x7f7ba00cae20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097a0 tx=0x7f7b9c02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.642+0000 7f7ba6f66640 1 -- 172.21.15.50:0/1871030883 shutdown_connections 2023-08-10T10:47:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.643+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00ca740 0x7f7ba00cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.643+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/1871030883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba015a820 0x7f7ba00cae20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.643+0000 7f7ba6f66640 1 -- 172.21.15.50:0/1871030883 >> 172.21.15.50:0/1871030883 conn(0x7f7ba00b0050 msgr2=0x7f7ba00b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.643+0000 7f7ba6f66640 1 -- 172.21.15.50:0/1871030883 shutdown_connections 2023-08-10T10:47:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.643+0000 7f7ba6f66640 1 -- 172.21.15.50:0/1871030883 wait complete. 2023-08-10T10:47:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.644+0000 7f7ba6f66640 1 Processor -- start 2023-08-10T10:47:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.645+0000 7f7ba6f66640 1 -- start start 2023-08-10T10:47:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00718f0 0x7f7ba015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 0x7f7ba01f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba015ac00 con 0x7f7ba015a820 2023-08-10T10:47:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c4010 con 0x7f7ba00ca740 2023-08-10T10:47:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c42f0 con 0x7f7ba00718f0 2023-08-10T10:47:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49336/0 (socket says 172.21.15.50:49336) 2023-08-10T10:47:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 -- 172.21.15.50:0/2485844334 learned_addr learned my addr 172.21.15.50:0/2485844334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:25.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00718f0 0x7f7ba015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba5763640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 0x7f7ba01f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 -- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00718f0 msgr2=0x7f7ba015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00718f0 0x7f7ba015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 -- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 msgr2=0x7f7ba01f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 0x7f7ba01f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba6765640 1 -- 172.21.15.50:0/2485844334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c009400 con 0x7f7ba015a820 2023-08-10T10:47:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.646+0000 7f7ba5763640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 0x7f7ba01f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7ba6765640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800efc0 tx=0x7f7b9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98014480 con 0x7f7ba015a820 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800f040 con 0x7f7ba015a820 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98014820 con 0x7f7ba015a820 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba015aea0 con 0x7f7ba015a820 2023-08-10T10:47:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.647+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba015d990 con 0x7f7ba015a820 2023-08-10T10:47:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.648+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba0066e30 con 0x7f7ba015a820 2023-08-10T10:47:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.649+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b98014980 con 0x7f7ba015a820 2023-08-10T10:47:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.650+0000 7f7b967fc640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 0x7f7b8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.650+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b98089d40 con 0x7f7ba015a820 2023-08-10T10:47:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.651+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 0x7f7b8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.651+0000 7f7ba5f64640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 0x7f7b8406d110 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c036000 tx=0x7f7b9c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.655+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7b98055140 con 0x7f7ba015a820 2023-08-10T10:47:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:25.846+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7ba00b0d80 con 0x7f7ba015a820 2023-08-10T10:47:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.037+0000 7f7b967fc640 1 -- 172.21.15.50:0/2485844334 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7b980180b0 con 0x7f7ba015a820 2023-08-10T10:47:26.040 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:47:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 msgr2=0x7f7b8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 0x7f7b8406d110 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c036000 tx=0x7f7b9c03c040 comp rx=0 tx=0).stop 2023-08-10T10:47:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 msgr2=0x7f7ba00c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800efc0 tx=0x7f7b9800c490 comp rx=0 tx=0).stop 2023-08-10T10:47:26.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 shutdown_connections 2023-08-10T10:47:26.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba015a820 0x7f7ba00c7780 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7b8406ac50 0x7f7b8406d110 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba00ca740 0x7f7ba01f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 --2- 172.21.15.50:0/2485844334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ba00718f0 0x7f7ba015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 >> 172.21.15.50:0/2485844334 conn(0x7f7ba00b0050 msgr2=0x7f7ba015e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 shutdown_connections 2023-08-10T10:47:26.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.046+0000 7f7ba6f66640 1 -- 172.21.15.50:0/2485844334 wait complete. 2023-08-10T10:47:26.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:47:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.303+0000 7fb9e9d49640 1 Processor -- start 2023-08-10T10:47:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.303+0000 7fb9e9d49640 1 -- start start 2023-08-10T10:47:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9d49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9e40c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9d49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b1370 con 0x7fb9e40aff00 2023-08-10T10:47:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9d49640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b1650 con 0x7fb9e415aa50 2023-08-10T10:47:26.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9d49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415ae30 con 0x7fb9e40b4130 2023-08-10T10:47:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9548640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9e40aff00 0x7fb9e40cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46036/0 (socket says 172.21.15.50:46036) 2023-08-10T10:47:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e9548640 1 -- 172.21.15.50:0/207805044 learned_addr learned my addr 172.21.15.50:0/207805044 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e3fff640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9e40c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204344339 0 0) 0x7fb9e40b1370 con 0x7fb9e40aff00 2023-08-10T10:47:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d4003520 con 0x7fb9e40aff00 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 32200102 0 0) 0x7fb9d4003520 con 0x7fb9e40aff00 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 msgr2=0x7fb9e40c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9e40c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 >> v1:172.21.15.117:6789/0 conn(0x7fb9e415aa50 legacy=0x7fb9e40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40b1930 con 0x7fb9e40aff00 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb9dc0019f0 con 0x7fb9e40aff00 2023-08-10T10:47:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 >> v1:172.21.15.50:6789/0 conn(0x7fb9e40aff00 legacy=0x7fb9e40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4003a10 0x7fb9d4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.306+0000 7fb9e37fe640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e37fe640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d4004d00 0x7fb9d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415ae30 con 0x7fb9d4004d00 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400ba80 con 0x7fb9d4003a10 2023-08-10T10:47:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400bc40 con 0x7fb9e40b4130 2023-08-10T10:47:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d4004d00 0x7fb9d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e8d47640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4003a10 0x7fb9d4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e3fff640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 -- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 msgr2=0x7fb9d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40b4130 0x7fb9d40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 -- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4003a10 msgr2=0x7fb9d4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4003a10 0x7fb9d4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e9548640 1 -- 172.21.15.50:0/207805044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4003520 con 0x7fb9d4004d00 2023-08-10T10:47:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.307+0000 7fb9e8d47640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4003a10 0x7fb9d4003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.308+0000 7fb9e9548640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d4004d00 0x7fb9d4005180 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a7d0 tx=0x7fb9d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deff8de6bb7faf01 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc034630 con 0x7fb9d4004d00 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc02f070 con 0x7fb9d4004d00 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e37fe640 1 -- 172.21.15.50:0/207805044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0349f0 con 0x7fb9d4004d00 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e9d49640 1 -- 172.21.15.50:0/207805044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d4004d00 msgr2=0x7fb9d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/207805044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d4004d00 0x7fb9d4005180 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a7d0 tx=0x7fb9d40057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.309+0000 7fb9e9548640 1 -- 172.21.15.50:0/207805044 reap_dead start 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.310+0000 7fb9e9d49640 1 -- 172.21.15.50:0/207805044 shutdown_connections 2023-08-10T10:47:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.310+0000 7fb9e9d49640 1 -- 172.21.15.50:0/207805044 >> 172.21.15.50:0/207805044 conn(0x7fb9e4069cd0 msgr2=0x7fb9e40caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.310+0000 7fb9e9d49640 1 -- 172.21.15.50:0/207805044 shutdown_connections 2023-08-10T10:47:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.310+0000 7fb9e9d49640 1 -- 172.21.15.50:0/207805044 wait complete. 2023-08-10T10:47:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.312+0000 7fb9e9d49640 1 Processor -- start 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.312+0000 7fb9e9d49640 1 -- start start 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4004d00 0x7fb9e414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40cca60 0x7fb9e40ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41e6030 con 0x7fb9e41e5670 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40cd800 con 0x7fb9d4004d00 2023-08-10T10:47:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9d49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40cdae0 con 0x7fb9e40cca60 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49362/0 (socket says 172.21.15.50:49362) 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e3fff640 1 -- 172.21.15.50:0/3765511541 learned_addr learned my addr 172.21.15.50:0/3765511541 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e8d47640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4004d00 0x7fb9e414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e9548640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40cca60 0x7fb9e40ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.313+0000 7fb9e3fff640 1 -- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40cca60 msgr2=0x7fb9e40ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e3fff640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40cca60 0x7fb9e40ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e3fff640 1 -- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4004d00 msgr2=0x7fb9e414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e3fff640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4004d00 0x7fb9e414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e3fff640 1 -- 172.21.15.50:0/3765511541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40cddc0 con 0x7fb9e41e5670 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e3fff640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0010860 tx=0x7fb9d0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0009610 con 0x7fb9e41e5670 2023-08-10T10:47:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d000eb60 con 0x7fb9e41e5670 2023-08-10T10:47:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d001c400 con 0x7fb9e41e5670 2023-08-10T10:47:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e40ce0a0 con 0x7fb9e41e5670 2023-08-10T10:47:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.314+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e414bef0 con 0x7fb9e41e5670 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.316+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40c2aa0 con 0x7fb9e41e5670 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.317+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9d001c560 con 0x7fb9e41e5670 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.318+0000 7fb9e17fa640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 0x7fb9c806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.318+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb9d0089760 con 0x7fb9e41e5670 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.318+0000 7fb9e8d47640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 0x7fb9c806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.319+0000 7fb9e8d47640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 0x7fb9c806d140 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8007fd0 tx=0x7fb9d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.323+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb9d0054b30 con 0x7fb9e41e5670 2023-08-10T10:47:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:26.517+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb9e40c5530 con 0x7fb9e41e5670 2023-08-10T10:47:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.056+0000 7fb9e17fa640 1 -- 172.21.15.50:0/3765511541 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb9e40c5530 con 0x7fb9e41e5670 2023-08-10T10:47:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:47:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.061+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 msgr2=0x7fb9c806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.061+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 0x7fb9c806d140 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8007fd0 tx=0x7fb9d8009040 comp rx=0 tx=0).stop 2023-08-10T10:47:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.061+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 msgr2=0x7fb9e41e5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.061+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0010860 tx=0x7fb9d0010d20 comp rx=0 tx=0).stop 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 shutdown_connections 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9e40cca60 0x7fb9e40ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9e41e5670 0x7fb9e41e5af0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9c806ac80 0x7fb9c806d140 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 --2- 172.21.15.50:0/3765511541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9d4004d00 0x7fb9e414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 >> 172.21.15.50:0/3765511541 conn(0x7fb9e4069cd0 msgr2=0x7fb9e4159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 shutdown_connections 2023-08-10T10:47:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.077+0000 7fb9e9d49640 1 -- 172.21.15.50:0/3765511541 wait complete. 2023-08-10T10:47:27.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:47:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.314+0000 7fbcb0006640 1 Processor -- start 2023-08-10T10:47:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.314+0000 7fbcb0006640 1 -- start start 2023-08-10T10:47:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcb0006640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbca815cf70 0x7fbca8160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcb0006640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8160a40 con 0x7fbca815cb90 2023-08-10T10:47:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcb0006640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80b4bb0 con 0x7fbca80b4640 2023-08-10T10:47:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcb0006640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca80b4e90 con 0x7fbca815cf70 2023-08-10T10:47:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcadda2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbca815cb90 0x7fbca80b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46050/0 (socket says 172.21.15.50:46050) 2023-08-10T10:47:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcadda2640 1 -- 172.21.15.50:0/3966834235 learned_addr learned my addr 172.21.15.50:0/3966834235 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/3966834235 >> v2:172.21.15.117:3300/0 conn(0x7fbca815cf70 0x7fbca8160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.316+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524263866 0 0) 0x7fbca8160a40 con 0x7fbca815cb90 2023-08-10T10:47:27.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc94003520 con 0x7fbca815cb90 2023-08-10T10:47:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703474356 0 0) 0x7fbc94003520 con 0x7fbca815cb90 2023-08-10T10:47:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 >> v2:172.21.15.117:3300/0 conn(0x7fbca815cf70 msgr2=0x7fbca8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 --2- 172.21.15.50:0/3966834235 >> v2:172.21.15.117:3300/0 conn(0x7fbca815cf70 0x7fbca8160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 >> v1:172.21.15.117:6789/0 conn(0x7fbca80b4640 legacy=0x7fbca806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80b5170 con 0x7fbca815cb90 2023-08-10T10:47:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fbca4001670 con 0x7fbca815cb90 2023-08-10T10:47:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 >> v1:172.21.15.50:6789/0 conn(0x7fbca815cb90 legacy=0x7fbca80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94003970 0x7fbc94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 0x7fbc94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94005180 0x7fbc9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80b4e90 con 0x7fbc940047c0 2023-08-10T10:47:27.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9400c020 con 0x7fbc94005180 2023-08-10T10:47:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.317+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9400c1e0 con 0x7fbc94003970 2023-08-10T10:47:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 0x7fbc94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcae5a3640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94005180 0x7fbc9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcadda2640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94003970 0x7fbc94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 -- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94003970 msgr2=0x7fbc94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc94003970 0x7fbc94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 -- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94005180 msgr2=0x7fbc9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94005180 0x7fbc9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcad5a1640 1 -- 172.21.15.50:0/3966834235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94003520 con 0x7fbc940047c0 2023-08-10T10:47:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcae5a3640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94005180 0x7fbc9400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.318+0000 7fbcae5a3640 1 -- 172.21.15.50:0/3966834235 reap_dead start 2023-08-10T10:47:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.319+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 0x7fbc94004c40 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009ac0 tx=0x7fbc940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cfcba363484f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802c6b0 con 0x7fbc940047c0 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9802c810 con 0x7fbc940047c0 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcacda0640 1 -- 172.21.15.50:0/3966834235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802cba0 con 0x7fbc940047c0 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcb0006640 1 -- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 msgr2=0x7fbc94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcb0006640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 0x7fbc94004c40 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009ac0 tx=0x7fbc940057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcb0006640 1 -- 172.21.15.50:0/3966834235 shutdown_connections 2023-08-10T10:47:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcb0006640 1 --2- 172.21.15.50:0/3966834235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc940047c0 0x7fbc94004c40 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.320+0000 7fbcb0006640 1 -- 172.21.15.50:0/3966834235 >> 172.21.15.50:0/3966834235 conn(0x7fbca80cf640 msgr2=0x7fbca80cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.321+0000 7fbcb0006640 1 -- 172.21.15.50:0/3966834235 shutdown_connections 2023-08-10T10:47:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.321+0000 7fbcb0006640 1 -- 172.21.15.50:0/3966834235 wait complete. 2023-08-10T10:47:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.322+0000 7fbcb0006640 1 Processor -- start 2023-08-10T10:47:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.323+0000 7fbcb0006640 1 -- start start 2023-08-10T10:47:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940047c0 0x7fbca80c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbca8157ad0 0x7fbca8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81554e0 con 0x7fbca81544d0 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8158490 con 0x7fbc940047c0 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.324+0000 7fbcb0006640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca814f940 con 0x7fbca8157ad0 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49382/0 (socket says 172.21.15.50:49382) 2023-08-10T10:47:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 -- 172.21.15.50:0/839296256 learned_addr learned my addr 172.21.15.50:0/839296256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcad5a1640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbca8157ad0 0x7fbca8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcadda2640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940047c0 0x7fbca80c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 -- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbca8157ad0 msgr2=0x7fbca8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbca8157ad0 0x7fbca8157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 -- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940047c0 msgr2=0x7fbca80c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940047c0 0x7fbca80c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.325+0000 7fbcae5a3640 1 -- 172.21.15.50:0/839296256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8155200 con 0x7fbca81544d0 2023-08-10T10:47:27.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbcae5a3640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fbca80713d0 tx=0x7fbca000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0003b80 con 0x7fbca81544d0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0003ce0 con 0x7fbca81544d0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0005310 con 0x7fbca81544d0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca814fbe0 con 0x7fbca81544d0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.326+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca80c9400 con 0x7fbca81544d0 2023-08-10T10:47:27.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.327+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca814f7a0 con 0x7fbca81544d0 2023-08-10T10:47:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.329+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbca0005470 con 0x7fbca81544d0 2023-08-10T10:47:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.329+0000 7fbc9e7fc640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 0x7fbc8c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.330+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fbca0088fe0 con 0x7fbca81544d0 2023-08-10T10:47:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.330+0000 7fbcadda2640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 0x7fbc8c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.331+0000 7fbcadda2640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 0x7fbc8c06d140 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbca4001c90 tx=0x7fbca4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:27.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.335+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbca814f7a0 con 0x7fbca81544d0 2023-08-10T10:47:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:27.564+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbca8150100 con 0x7fbca81544d0 2023-08-10T10:47:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.060+0000 7fbc9e7fc640 1 -- 172.21.15.50:0/839296256 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbca8150100 con 0x7fbca81544d0 2023-08-10T10:47:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 19 and data pool 20 2023-08-10T10:47:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.073+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 msgr2=0x7fbc8c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.073+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 0x7fbc8c06d140 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbca4001c90 tx=0x7fbca4009040 comp rx=0 tx=0).stop 2023-08-10T10:47:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.073+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 msgr2=0x7fbca8154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.073+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fbca80713d0 tx=0x7fbca000e960 comp rx=0 tx=0).stop 2023-08-10T10:47:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 shutdown_connections 2023-08-10T10:47:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca81544d0 0x7fbca8154930 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbca8157ad0 0x7fbca8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc8c06ac80 0x7fbc8c06d140 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 --2- 172.21.15.50:0/839296256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940047c0 0x7fbca80c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 >> 172.21.15.50:0/839296256 conn(0x7fbca80cf640 msgr2=0x7fbca8160100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:28.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.083+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 shutdown_connections 2023-08-10T10:47:28.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.084+0000 7fbcb0006640 1 -- 172.21.15.50:0/839296256 wait complete. 2023-08-10T10:47:28.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:28.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.309+0000 7f9f6d924640 1 Processor -- start 2023-08-10T10:47:28.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.309+0000 7f9f6d924640 1 -- start start 2023-08-10T10:47:28.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.310+0000 7f9f6d924640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f68072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f6d924640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f68072c70 0x7f9f680ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f6d924640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f680cd920 con 0x7f9f680ca6f0 2023-08-10T10:47:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f6d924640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f68073100 con 0x7f9f68072c70 2023-08-10T10:47:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f6d924640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6806c060 con 0x7f9f6806bc00 2023-08-10T10:47:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f68072c70 0x7f9f680ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f68072c70 0x7f9f680ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49396/0 (socket says 172.21.15.50:49396) 2023-08-10T10:47:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 -- 172.21.15.50:0/4082079610 learned_addr learned my addr 172.21.15.50:0/4082079610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 -- 172.21.15.50:0/4082079610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 msgr2=0x7f9f68072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 --2- 172.21.15.50:0/4082079610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f68072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 -- 172.21.15.50:0/4082079610 >> v1:172.21.15.117:6789/0 conn(0x7f9f680ca6f0 legacy=0x7f9f680696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.311+0000 7f9f677fe640 1 -- 172.21.15.50:0/4082079610 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6806a160 con 0x7f9f68072c70 2023-08-10T10:47:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.313+0000 7f9f677fe640 1 --2- 172.21.15.50:0/4082079610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f68072c70 0x7f9f680ce370 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009e50 tx=0x7f9f6002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418761973813c476 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.313+0000 7f9f667fc640 1 -- 172.21.15.50:0/4082079610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6002c960 con 0x7f9f68072c70 2023-08-10T10:47:28.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.313+0000 7f9f667fc640 1 -- 172.21.15.50:0/4082079610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6002cac0 con 0x7f9f68072c70 2023-08-10T10:47:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.313+0000 7f9f667fc640 1 -- 172.21.15.50:0/4082079610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6002ce50 con 0x7f9f68072c70 2023-08-10T10:47:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 -- 172.21.15.50:0/4082079610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f68072c70 msgr2=0x7f9f680ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 --2- 172.21.15.50:0/4082079610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f68072c70 0x7f9f680ce370 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009e50 tx=0x7f9f6002bdc0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 -- 172.21.15.50:0/4082079610 shutdown_connections 2023-08-10T10:47:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 --2- 172.21.15.50:0/4082079610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f68072c70 0x7f9f680ce370 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 --2- 172.21.15.50:0/4082079610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f68072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 -- 172.21.15.50:0/4082079610 >> 172.21.15.50:0/4082079610 conn(0x7f9f680cc2c0 msgr2=0x7f9f680cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 -- 172.21.15.50:0/4082079610 shutdown_connections 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.314+0000 7f9f6d924640 1 -- 172.21.15.50:0/4082079610 wait complete. 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.316+0000 7f9f6d924640 1 Processor -- start 2023-08-10T10:47:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.316+0000 7f9f6d924640 1 -- start start 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f680b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 0x7f9f680b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6814f660 con 0x7f9f680ca6f0 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6815dc60 con 0x7f9f68072c70 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f6d924640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6815df40 con 0x7f9f6806bc00 2023-08-10T10:47:28.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49404/0 (socket says 172.21.15.50:49404) 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f677fe640 1 -- 172.21.15.50:0/3985312034 learned_addr learned my addr 172.21.15.50:0/3985312034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f66ffd640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f680b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f5ffff640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 0x7f9f680b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f677fe640 1 -- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 msgr2=0x7f9f680b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.317+0000 7f9f677fe640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f680b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f677fe640 1 -- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 msgr2=0x7f9f680b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f677fe640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 0x7f9f680b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f677fe640 1 -- 172.21.15.50:0/3985312034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009b30 con 0x7f9f680ca6f0 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f5ffff640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 0x7f9f680b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f677fe640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9f60036040 tx=0x7f9f60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6003e450 con 0x7f9f680ca6f0 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6003e5d0 con 0x7f9f680ca6f0 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6003e980 con 0x7f9f680ca6f0 2023-08-10T10:47:28.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.318+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6815e220 con 0x7f9f680ca6f0 2023-08-10T10:47:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.319+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6815e7e0 con 0x7f9f680ca6f0 2023-08-10T10:47:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.320+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6815e9d0 con 0x7f9f680ca6f0 2023-08-10T10:47:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.321+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f6003eae0 con 0x7f9f680ca6f0 2023-08-10T10:47:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.321+0000 7f9f64ff9640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 0x7f9f4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.322+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f600ac320 con 0x7f9f680ca6f0 2023-08-10T10:47:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.322+0000 7f9f66ffd640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 0x7f9f4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.322+0000 7f9f66ffd640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 0x7f9f4806d110 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006fd0 tx=0x7f9f58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.326+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9f60077460 con 0x7f9f680ca6f0 2023-08-10T10:47:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.521+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f6804e270 con 0x7f9f680ca6f0 2023-08-10T10:47:28.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.523+0000 7f9f64ff9640 1 -- 172.21.15.50:0/3985312034 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18312 (secure 0 0 0) 0x7f9f6007aa80 con 0x7f9f680ca6f0 2023-08-10T10:47:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:28.525 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":157,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:27.565392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:28.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 msgr2=0x7f9f4806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 0x7f9f4806d110 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006fd0 tx=0x7f9f58008040 comp rx=0 tx=0).stop 2023-08-10T10:47:28.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 msgr2=0x7f9f680b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9f60036040 tx=0x7f9f60004a40 comp rx=0 tx=0).stop 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 shutdown_connections 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f680ca6f0 0x7f9f680b2bd0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f4806ac50 0x7f9f4806d110 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f68072c70 0x7f9f680b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 --2- 172.21.15.50:0/3985312034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f6806bc00 0x7f9f680b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.526+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 >> 172.21.15.50:0/3985312034 conn(0x7f9f680cc2c0 msgr2=0x7f9f680696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:28.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.527+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 shutdown_connections 2023-08-10T10:47:28.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.527+0000 7f9f6d924640 1 -- 172.21.15.50:0/3985312034 wait complete. 2023-08-10T10:47:28.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.773+0000 7fe96b59e640 1 Processor -- start 2023-08-10T10:47:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.773+0000 7fe96b59e640 1 -- start start 2023-08-10T10:47:28.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe96b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe96c0b0620 0x7fe96c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe96b59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 0x7fe96c166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe96b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c1604d0 con 0x7fe96c1600f0 2023-08-10T10:47:28.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe96b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0cca30 con 0x7fe96c0b0620 2023-08-10T10:47:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe96b59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0cc100 con 0x7fe96c1646f0 2023-08-10T10:47:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.775+0000 7fe963fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe96c0b0620 0x7fe96c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe96c0b0620 0x7fe96c0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49412/0 (socket says 172.21.15.50:49412) 2023-08-10T10:47:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 -- 172.21.15.50:0/517913756 learned_addr learned my addr 172.21.15.50:0/517913756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe96ad9d640 1 --2- 172.21.15.50:0/517913756 >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 0x7fe96c166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 -- 172.21.15.50:0/517913756 >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 msgr2=0x7fe96c166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 --2- 172.21.15.50:0/517913756 >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 0x7fe96c166ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 -- 172.21.15.50:0/517913756 >> v1:172.21.15.117:6789/0 conn(0x7fe96c1600f0 legacy=0x7fe96c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe963fff640 1 -- 172.21.15.50:0/517913756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0cc3e0 con 0x7fe96c0b0620 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.776+0000 7fe96ad9d640 1 --2- 172.21.15.50:0/517913756 >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 0x7fe96c166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.777+0000 7fe963fff640 1 --2- 172.21.15.50:0/517913756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0ac890 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0c8c10 tx=0x7fe95402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586e13afe3e6222e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.777+0000 7fe969d9b640 1 -- 172.21.15.50:0/517913756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540317e0 con 0x7fe96c0b0620 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe969d9b640 1 -- 172.21.15.50:0/517913756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954031940 con 0x7fe96c0b0620 2023-08-10T10:47:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe969d9b640 1 -- 172.21.15.50:0/517913756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954031cd0 con 0x7fe96c0b0620 2023-08-10T10:47:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 -- 172.21.15.50:0/517913756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 msgr2=0x7fe96c0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 --2- 172.21.15.50:0/517913756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0ac890 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0c8c10 tx=0x7fe95402b880 comp rx=0 tx=0).stop 2023-08-10T10:47:28.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 -- 172.21.15.50:0/517913756 shutdown_connections 2023-08-10T10:47:28.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 --2- 172.21.15.50:0/517913756 >> v2:172.21.15.117:3300/0 conn(0x7fe96c1646f0 0x7fe96c166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 --2- 172.21.15.50:0/517913756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0ac890 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 -- 172.21.15.50:0/517913756 >> 172.21.15.50:0/517913756 conn(0x7fe96c06ab80 msgr2=0x7fe96c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 -- 172.21.15.50:0/517913756 shutdown_connections 2023-08-10T10:47:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.778+0000 7fe96b59e640 1 -- 172.21.15.50:0/517913756 wait complete. 2023-08-10T10:47:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.780+0000 7fe96b59e640 1 Processor -- start 2023-08-10T10:47:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.780+0000 7fe96b59e640 1 -- start start 2023-08-10T10:47:28.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe96c1600f0 0x7fe96c14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe96c1646f0 0x7fe96c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0c4d10 con 0x7fe96c0b0620 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0c4340 con 0x7fe96c1600f0 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.781+0000 7fe96b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0c3730 con 0x7fe96c1646f0 2023-08-10T10:47:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49424/0 (socket says 172.21.15.50:49424) 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 -- 172.21.15.50:0/4209946668 learned_addr learned my addr 172.21.15.50:0/4209946668 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 -- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe96c1646f0 msgr2=0x7fe96c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe96c1646f0 0x7fe96c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 -- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe96c1600f0 msgr2=0x7fe96c14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe96c1600f0 0x7fe96c14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 -- 172.21.15.50:0/4209946668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540094d0 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.782+0000 7fe96a59c640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c430 tx=0x7fe95c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.783+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011790 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.783+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0118f0 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.783+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c011ca0 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.783+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c0c3a10 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.783+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c0c3fd0 con 0x7fe96c0b0620 2023-08-10T10:47:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.784+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0ad990 con 0x7fe96c0b0620 2023-08-10T10:47:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.785+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe95c01c460 con 0x7fe96c0b0620 2023-08-10T10:47:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.786+0000 7fe962ffd640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 0x7fe94c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.786+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe95c089470 con 0x7fe96c0b0620 2023-08-10T10:47:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.786+0000 7fe963fff640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 0x7fe94c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.787+0000 7fe963fff640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 0x7fe94c06d110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe954036000 tx=0x7fe954030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:28.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.790+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe95c057fa0 con 0x7fe96c0b0620 2023-08-10T10:47:28.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.981+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe96c066e30 con 0x7fe96c0b0620 2023-08-10T10:47:28.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.983+0000 7fe962ffd640 1 -- 172.21.15.50:0/4209946668 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18312 (secure 0 0 0) 0x7fe95c057b30 con 0x7fe96c0b0620 2023-08-10T10:47:28.985 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:28.985 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":157,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:27.565392+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:28.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 msgr2=0x7fe94c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 0x7fe94c06d110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe954036000 tx=0x7fe954030000 comp rx=0 tx=0).stop 2023-08-10T10:47:28.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 msgr2=0x7fe96c0c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:28.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00c430 tx=0x7fe95c00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 shutdown_connections 2023-08-10T10:47:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe96c1646f0 0x7fe96c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe94c06ac50 0x7fe94c06d110 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe96c1600f0 0x7fe96c14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 --2- 172.21.15.50:0/4209946668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0b0620 0x7fe96c0c47d0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 >> 172.21.15.50:0/4209946668 conn(0x7fe96c06ab80 msgr2=0x7fe96c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.986+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 shutdown_connections 2023-08-10T10:47:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:28.987+0000 7fe96b59e640 1 -- 172.21.15.50:0/4209946668 wait complete. 2023-08-10T10:47:29.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:47:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.232+0000 7f94de4ec640 1 Processor -- start 2023-08-10T10:47:29.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.232+0000 7f94de4ec640 1 -- start start 2023-08-10T10:47:29.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94de4ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94d81599e0 0x7f94d80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94de4ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 0x7f94d80b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94de4ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80ccff0 con 0x7f94d80c8b50 2023-08-10T10:47:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94de4ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80cdca0 con 0x7f94d81599e0 2023-08-10T10:47:29.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94de4ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80cdf80 con 0x7f94d8069db0 2023-08-10T10:47:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94dd4ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94d81599e0 0x7f94d80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94dcce9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94d80c8b50 0x7f94d80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46062/0 (socket says 172.21.15.50:46062) 2023-08-10T10:47:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.234+0000 7f94dcce9640 1 -- 172.21.15.50:0/3817619502 learned_addr learned my addr 172.21.15.50:0/3817619502 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94ddceb640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 0x7f94d80b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94dd4ea640 1 -- 172.21.15.50:0/3817619502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 msgr2=0x7f94d80b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94dd4ea640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 0x7f94d80b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94dd4ea640 1 -- 172.21.15.50:0/3817619502 >> v1:172.21.15.50:6789/0 conn(0x7f94d80c8b50 legacy=0x7f94d80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94dd4ea640 1 -- 172.21.15.50:0/3817619502 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80b2910 con 0x7f94d81599e0 2023-08-10T10:47:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.235+0000 7f94ddceb640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 0x7f94d80b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.236+0000 7f94dd4ea640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d81599e0 0x7f94d80ccab0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9e5d8ffbe16a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94cffff640 1 -- 172.21.15.50:0/3817619502 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d402d040 con 0x7f94d81599e0 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94cffff640 1 -- 172.21.15.50:0/3817619502 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4031810 con 0x7f94d81599e0 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94cffff640 1 -- 172.21.15.50:0/3817619502 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4031ba0 con 0x7f94d81599e0 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 -- 172.21.15.50:0/3817619502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d81599e0 msgr2=0x7f94d80ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d81599e0 0x7f94d80ccab0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402b8b0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 -- 172.21.15.50:0/3817619502 shutdown_connections 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d8069db0 0x7f94d80b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3817619502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d81599e0 0x7f94d80ccab0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 -- 172.21.15.50:0/3817619502 >> 172.21.15.50:0/3817619502 conn(0x7f94d80caf80 msgr2=0x7f94d80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 -- 172.21.15.50:0/3817619502 shutdown_connections 2023-08-10T10:47:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.237+0000 7f94de4ec640 1 -- 172.21.15.50:0/3817619502 wait complete. 2023-08-10T10:47:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.239+0000 7f94de4ec640 1 Processor -- start 2023-08-10T10:47:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.239+0000 7f94de4ec640 1 -- start start 2023-08-10T10:47:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d8069db0 0x7f94d8151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 0x7f94d8157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d806ffd0 con 0x7f94d80c8b50 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8152360 con 0x7f94d8069db0 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94de4ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d806ed00 con 0x7f94d81599e0 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.240+0000 7f94dcce9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49454/0 (socket says 172.21.15.50:49454) 2023-08-10T10:47:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 -- 172.21.15.50:0/3253639059 learned_addr learned my addr 172.21.15.50:0/3253639059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 -- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 msgr2=0x7f94d8157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94ddceb640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 0x7f94d8157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dd4ea640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d8069db0 0x7f94d8151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 0x7f94d8157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 -- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d8069db0 msgr2=0x7f94d8151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:29.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d8069db0 0x7f94d8151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 -- 172.21.15.50:0/3253639059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009400 con 0x7f94d80c8b50 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94ddceb640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 0x7f94d8157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.241+0000 7f94dcce9640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c3c0 tx=0x7f94c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.242+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8005ce0 con 0x7f94d80c8b50 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.242+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8005e40 con 0x7f94d80c8b50 2023-08-10T10:47:29.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.242+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80072d0 con 0x7f94d80c8b50 2023-08-10T10:47:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.242+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d806efe0 con 0x7f94d80c8b50 2023-08-10T10:47:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.242+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d806f5a0 con 0x7f94d80c8b50 2023-08-10T10:47:29.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.243+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80701a0 con 0x7f94d80c8b50 2023-08-10T10:47:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.244+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94c80074f0 con 0x7f94d80c8b50 2023-08-10T10:47:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.245+0000 7f94cdffb640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 0x7f94bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.245+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94c8088a10 con 0x7f94d80c8b50 2023-08-10T10:47:29.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.245+0000 7f94dd4ea640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 0x7f94bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:29.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.246+0000 7f94dd4ea640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 0x7f94bc06d110 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f94d4036000 tx=0x7f94d403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:29.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.249+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f94d80701a0 con 0x7f94d80c8b50 2023-08-10T10:47:29.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:29.480+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f94d80701a0 con 0x7f94d80c8b50 2023-08-10T10:47:30.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.120+0000 7f94cdffb640 1 -- 172.21.15.50:0/3253639059 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f94d80701a0 con 0x7f94d80c8b50 2023-08-10T10:47:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.123+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 msgr2=0x7f94bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.123+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 0x7f94bc06d110 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f94d4036000 tx=0x7f94d403c040 comp rx=0 tx=0).stop 2023-08-10T10:47:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.123+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 msgr2=0x7f94d815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.123+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c3c0 tx=0x7f94c800c880 comp rx=0 tx=0).stop 2023-08-10T10:47:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 shutdown_connections 2023-08-10T10:47:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94d81599e0 0x7f94d8157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80c8b50 0x7f94d815b150 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94bc06ac50 0x7f94bc06d110 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 --2- 172.21.15.50:0/3253639059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d8069db0 0x7f94d8151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 >> 172.21.15.50:0/3253639059 conn(0x7f94d80caf80 msgr2=0x7f94d806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 shutdown_connections 2023-08-10T10:47:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.124+0000 7f94de4ec640 1 -- 172.21.15.50:0/3253639059 wait complete. 2023-08-10T10:47:30.146 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:47:30.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:47:30.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.384+0000 7f2cd6cde640 1 Processor -- start 2023-08-10T10:47:30.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.384+0000 7f2cd6cde640 1 -- start start 2023-08-10T10:47:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.385+0000 7f2cd6cde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cd00ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd6cde640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2cd00b2f00 0x7f2cd00cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd6cde640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd006b650 con 0x7f2cd00696a0 2023-08-10T10:47:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd6cde640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd006b190 con 0x7f2cd00b2f00 2023-08-10T10:47:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd6cde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00affe0 con 0x7f2cd006a500 2023-08-10T10:47:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd527b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2cd00696a0 0x7f2cd0160d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46070/0 (socket says 172.21.15.50:46070) 2023-08-10T10:47:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd527b640 1 -- 172.21.15.50:0/404950329 learned_addr learned my addr 172.21.15.50:0/404950329 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:30.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/404950329 >> v2:172.21.15.117:3300/0 conn(0x7f2cd00b2f00 0x7f2cd00cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.386+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cd00ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851303636 0 0) 0x7f2cd006b650 con 0x7f2cd00696a0 2023-08-10T10:47:30.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb8003520 con 0x7f2cd00696a0 2023-08-10T10:47:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3426576319 0 0) 0x7f2cb8003520 con 0x7f2cd00696a0 2023-08-10T10:47:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 msgr2=0x7f2cd00ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cd00ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 >> v2:172.21.15.117:3300/0 conn(0x7f2cd00b2f00 msgr2=0x7f2cd00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 --2- 172.21.15.50:0/404950329 >> v2:172.21.15.117:3300/0 conn(0x7f2cd00b2f00 0x7f2cd00cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd006b370 con 0x7f2cd00696a0 2023-08-10T10:47:30.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f2cc80019f0 con 0x7f2cd00696a0 2023-08-10T10:47:30.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 >> v1:172.21.15.50:6789/0 conn(0x7f2cd00696a0 legacy=0x7f2cd0160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb8003970 0x7f2cb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb80047c0 0x7f2cb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd006b190 con 0x7f2cb80047c0 2023-08-10T10:47:30.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00affe0 con 0x7f2cb8003970 2023-08-10T10:47:30.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.387+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb800ba00 con 0x7f2cd006a500 2023-08-10T10:47:30.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb80047c0 0x7f2cb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb8003970 0x7f2cb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cd527b640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 -- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 msgr2=0x7f2cb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cb8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 -- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb8003970 msgr2=0x7f2cb8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb8003970 0x7f2cb8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cc7fff640 1 -- 172.21.15.50:0/404950329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8003520 con 0x7f2cb80047c0 2023-08-10T10:47:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.388+0000 7f2cd527b640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd006a500 0x7f2cb8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.389+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb80047c0 0x7f2cb8004c40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009ac0 tx=0x7f2cb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6656d36d834bd75f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002c710 con 0x7f2cb80047c0 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc002c870 con 0x7f2cb80047c0 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cc77fe640 1 -- 172.21.15.50:0/404950329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002cc00 con 0x7f2cb80047c0 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 -- 172.21.15.50:0/404950329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb80047c0 msgr2=0x7f2cb8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/404950329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb80047c0 0x7f2cb8004c40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009ac0 tx=0x7f2cb80057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd527b640 1 -- 172.21.15.50:0/404950329 reap_dead start 2023-08-10T10:47:30.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 -- 172.21.15.50:0/404950329 shutdown_connections 2023-08-10T10:47:30.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 -- 172.21.15.50:0/404950329 >> 172.21.15.50:0/404950329 conn(0x7f2cd00b23e0 msgr2=0x7f2cd00b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:30.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 -- 172.21.15.50:0/404950329 shutdown_connections 2023-08-10T10:47:30.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.390+0000 7f2cd6cde640 1 -- 172.21.15.50:0/404950329 wait complete. 2023-08-10T10:47:30.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.392+0000 7f2cd6cde640 1 Processor -- start 2023-08-10T10:47:30.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.393+0000 7f2cd6cde640 1 -- start start 2023-08-10T10:47:30.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.393+0000 7f2cd6cde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 0x7f2cd0151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.393+0000 7f2cd6cde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd6cde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 0x7f2cd015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd6cde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd015f620 con 0x7f2cd00c4e30 2023-08-10T10:47:30.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd6cde640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00c5b50 con 0x7f2cb80047c0 2023-08-10T10:47:30.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd6cde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00c69b0 con 0x7f2cd015ec60 2023-08-10T10:47:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49480/0 (socket says 172.21.15.50:49480) 2023-08-10T10:47:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 -- 172.21.15.50:0/2756075747 learned_addr learned my addr 172.21.15.50:0/2756075747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:30.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 0x7f2cd0151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd527b640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 0x7f2cd015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 -- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 msgr2=0x7f2cd015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 0x7f2cd015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 -- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 msgr2=0x7f2cd0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 0x7f2cd0151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cc7fff640 1 -- 172.21.15.50:0/2756075747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd01523e0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 0x7f2cd0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:30.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.394+0000 7f2cd527b640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 0x7f2cd015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cc7fff640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f2cc002c2b0 tx=0x7f2cc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0003810 con 0x7f2cd00c4e30 2023-08-10T10:47:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc002de90 con 0x7f2cd00c4e30 2023-08-10T10:47:30.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0003bb0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd00c5da0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.395+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd00c6360 con 0x7f2cd00c4e30 2023-08-10T10:47:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.396+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd00612b0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.397+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cc0003d10 con 0x7f2cd00c4e30 2023-08-10T10:47:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.398+0000 7f2cc57fa640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 0x7f2cbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.398+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cc00ab5a0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.398+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 0x7f2cbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.399+0000 7f2cd4a7a640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 0x7f2cbc06d110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc006ce0 tx=0x7f2ccc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.403+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2cc00766d0 con 0x7f2cd00c4e30 2023-08-10T10:47:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:30.640+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2cd00ccd10 con 0x7f2cd00c4e30 2023-08-10T10:47:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.132+0000 7f2cc57fa640 1 -- 172.21.15.50:0/2756075747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2cc0079cf0 con 0x7f2cd00c4e30 2023-08-10T10:47:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 msgr2=0x7f2cbc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 0x7f2cbc06d110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc006ce0 tx=0x7f2ccc008040 comp rx=0 tx=0).stop 2023-08-10T10:47:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 msgr2=0x7f2cd00c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f2cc002c2b0 tx=0x7f2cc0004730 comp rx=0 tx=0).stop 2023-08-10T10:47:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 shutdown_connections 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd015ec60 0x7f2cd015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cd00c4e30 0x7f2cd00c52b0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cbc06ac50 0x7f2cbc06d110 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 --2- 172.21.15.50:0/2756075747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cb80047c0 0x7f2cd0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 >> 172.21.15.50:0/2756075747 conn(0x7f2cd00b23e0 msgr2=0x7f2cd0152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.135+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 shutdown_connections 2023-08-10T10:47:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.136+0000 7f2cd6cde640 1 -- 172.21.15.50:0/2756075747 wait complete. 2023-08-10T10:47:31.157 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:47:31.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.383+0000 7fe3ba96d640 1 Processor -- start 2023-08-10T10:47:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.384+0000 7fe3ba96d640 1 -- start start 2023-08-10T10:47:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.385+0000 7fe3ba96d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3b40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.385+0000 7fe3ba96d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b415d010 con 0x7fe3b4153c30 2023-08-10T10:47:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.385+0000 7fe3ba96d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b415d290 con 0x7fe3b40cfd40 2023-08-10T10:47:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.385+0000 7fe3ba96d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b415d570 con 0x7fe3b4153850 2023-08-10T10:47:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.386+0000 7fe3b916a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3b4153c30 0x7fe3b40cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46072/0 (socket says 172.21.15.50:46072) 2023-08-10T10:47:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.386+0000 7fe3b916a640 1 -- 172.21.15.50:0/2715792697 learned_addr learned my addr 172.21.15.50:0/2715792697 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.386+0000 7fe3b996b640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3b40b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.386+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012348674 0 0) 0x7fe3b415d010 con 0x7fe3b4153c30 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a0003520 con 0x7fe3b4153c30 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023467336 0 0) 0x7fe3a0003520 con 0x7fe3b4153c30 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 msgr2=0x7fe3b40b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3b40b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 >> v1:172.21.15.117:6789/0 conn(0x7fe3b40cfd40 legacy=0x7fe3b40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b415d850 con 0x7fe3b4153c30 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe3a4001670 con 0x7fe3b4153c30 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 >> v1:172.21.15.50:6789/0 conn(0x7fe3b4153c30 legacy=0x7fe3b40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a0003a10 0x7fe3a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004d00 0x7fe3a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b415d570 con 0x7fe3a0004d00 2023-08-10T10:47:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a000ba90 con 0x7fe3a0003a10 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a000bc50 con 0x7fe3b4153850 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.387+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004d00 0x7fe3a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3b996b640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a0003a10 0x7fe3a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3b916a640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3ba16c640 1 -- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 msgr2=0x7fe3a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b4153850 0x7fe3a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3ba16c640 1 -- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a0003a10 msgr2=0x7fe3a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a0003a10 0x7fe3a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.388+0000 7fe3ba16c640 1 -- 172.21.15.50:0/2715792697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0003520 con 0x7fe3a0004d00 2023-08-10T10:47:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.389+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004d00 0x7fe3a0005180 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007fd0 tx=0x7fe3a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff4439b1b37419a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.389+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0052d0 con 0x7fe3a0004d00 2023-08-10T10:47:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.389+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac02e050 con 0x7fe3a0004d00 2023-08-10T10:47:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.389+0000 7fe3b8969640 1 -- 172.21.15.50:0/2715792697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003640 con 0x7fe3a0004d00 2023-08-10T10:47:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 -- 172.21.15.50:0/2715792697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004d00 msgr2=0x7fe3a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/2715792697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004d00 0x7fe3a0005180 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac007fd0 tx=0x7fe3a00057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba16c640 1 -- 172.21.15.50:0/2715792697 reap_dead start 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 -- 172.21.15.50:0/2715792697 shutdown_connections 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 -- 172.21.15.50:0/2715792697 >> 172.21.15.50:0/2715792697 conn(0x7fe3b4069880 msgr2=0x7fe3b4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 -- 172.21.15.50:0/2715792697 shutdown_connections 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.390+0000 7fe3ba96d640 1 -- 172.21.15.50:0/2715792697 wait complete. 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.392+0000 7fe3ba96d640 1 Processor -- start 2023-08-10T10:47:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.392+0000 7fe3ba96d640 1 -- start start 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 0x7fe3b414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 0x7fe3b40d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40b8280 con 0x7fe3b40b78c0 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41e7060 con 0x7fe3b40d2d30 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3ba96d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40d36f0 con 0x7fe3a0004d00 2023-08-10T10:47:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3b916a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3b916a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49486/0 (socket says 172.21.15.50:49486) 2023-08-10T10:47:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.393+0000 7fe3b916a640 1 -- 172.21.15.50:0/1212871460 learned_addr learned my addr 172.21.15.50:0/1212871460 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 0x7fe3b40d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b996b640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 0x7fe3b414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 -- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 msgr2=0x7fe3b414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 0x7fe3b414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 -- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 msgr2=0x7fe3b40d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 0x7fe3b40d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 -- 172.21.15.50:0/1212871460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b41e64c0 con 0x7fe3b40b78c0 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3ba16c640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 0x7fe3b40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b996b640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 0x7fe3b414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3b916a640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400e7d0 tx=0x7fe3a400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400eee0 con 0x7fe3b40b78c0 2023-08-10T10:47:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400c870 con 0x7fe3b40b78c0 2023-08-10T10:47:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400cc20 con 0x7fe3b40b78c0 2023-08-10T10:47:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.394+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b40d20d0 con 0x7fe3b40b78c0 2023-08-10T10:47:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.395+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b41e6a10 con 0x7fe3b40b78c0 2023-08-10T10:47:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.396+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4066e30 con 0x7fe3b40b78c0 2023-08-10T10:47:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.397+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3a401d460 con 0x7fe3b40b78c0 2023-08-10T10:47:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.398+0000 7fe3aa7fc640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 0x7fe39806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.398+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3a4089520 con 0x7fe3b40b78c0 2023-08-10T10:47:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.398+0000 7fe3b996b640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 0x7fe39806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.399+0000 7fe3b996b640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 0x7fe39806d110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0007440 tx=0x7fe3b000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.402+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe3a4054530 con 0x7fe3b40b78c0 2023-08-10T10:47:31.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.639+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3b41e71a0 con 0x7fe3b40b78c0 2023-08-10T10:47:31.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.640+0000 7fe3aa7fc640 1 -- 172.21.15.50:0/1212871460 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fe3a4057b50 con 0x7fe3b40b78c0 2023-08-10T10:47:31.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:31.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:47:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:47:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 msgr2=0x7fe39806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 0x7fe39806d110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0007440 tx=0x7fe3b000b040 comp rx=0 tx=0).stop 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 msgr2=0x7fe3b40b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400e7d0 tx=0x7fe3a400ec90 comp rx=0 tx=0).stop 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 shutdown_connections 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe39806ac50 0x7fe39806d110 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b40d2d30 0x7fe3b40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b40b78c0 0x7fe3b40b7d40 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 --2- 172.21.15.50:0/1212871460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a0004d00 0x7fe3b414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 >> 172.21.15.50:0/1212871460 conn(0x7fe3b4069880 msgr2=0x7fe3b4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 shutdown_connections 2023-08-10T10:47:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.643+0000 7fe3ba96d640 1 -- 172.21.15.50:0/1212871460 wait complete. 2023-08-10T10:47:31.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.892+0000 7f3837964640 1 Processor -- start 2023-08-10T10:47:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.892+0000 7f3837964640 1 -- start start 2023-08-10T10:47:31.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3837964640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38300696a0 0x7f3830069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3837964640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38300b1ae0 0x7f38300b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3837964640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383015e1f0 con 0x7f3830159970 2023-08-10T10:47:31.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3837964640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300b10d0 con 0x7f38300696a0 2023-08-10T10:47:31.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3837964640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383015d5e0 con 0x7f38300b1ae0 2023-08-10T10:47:31.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3834eff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38300696a0 0x7f3830069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3834eff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38300696a0 0x7f3830069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49492/0 (socket says 172.21.15.50:49492) 2023-08-10T10:47:31.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.894+0000 7f3834eff640 1 -- 172.21.15.50:0/1478263000 learned_addr learned my addr 172.21.15.50:0/1478263000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.895+0000 7f3834eff640 1 -- 172.21.15.50:0/1478263000 >> v2:172.21.15.117:3300/0 conn(0x7f38300b1ae0 msgr2=0x7f38300b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.895+0000 7f3834eff640 1 --2- 172.21.15.50:0/1478263000 >> v2:172.21.15.117:3300/0 conn(0x7f38300b1ae0 0x7f38300b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.895+0000 7f3834eff640 1 -- 172.21.15.50:0/1478263000 >> v1:172.21.15.117:6789/0 conn(0x7f3830159970 legacy=0x7f38300b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.895+0000 7f3834eff640 1 -- 172.21.15.50:0/1478263000 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383006a040 con 0x7f38300696a0 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.896+0000 7f3834eff640 1 --2- 172.21.15.50:0/1478263000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300696a0 0x7f3830069b00 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f38300caf40 tx=0x7f382002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5001f7e5a26d7181 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.896+0000 7f3827fff640 1 -- 172.21.15.50:0/1478263000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820031640 con 0x7f38300696a0 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3827fff640 1 -- 172.21.15.50:0/1478263000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200317a0 con 0x7f38300696a0 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3827fff640 1 -- 172.21.15.50:0/1478263000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820031b30 con 0x7f38300696a0 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 -- 172.21.15.50:0/1478263000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300696a0 msgr2=0x7f3830069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 --2- 172.21.15.50:0/1478263000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300696a0 0x7f3830069b00 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f38300caf40 tx=0x7f382002b8f0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 -- 172.21.15.50:0/1478263000 shutdown_connections 2023-08-10T10:47:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 --2- 172.21.15.50:0/1478263000 >> v2:172.21.15.117:3300/0 conn(0x7f38300b1ae0 0x7f38300b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 --2- 172.21.15.50:0/1478263000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300696a0 0x7f3830069b00 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 -- 172.21.15.50:0/1478263000 >> 172.21.15.50:0/1478263000 conn(0x7f383006b590 msgr2=0x7f38300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.897+0000 7f3837964640 1 -- 172.21.15.50:0/1478263000 shutdown_connections 2023-08-10T10:47:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.898+0000 7f3837964640 1 -- 172.21.15.50:0/1478263000 wait complete. 2023-08-10T10:47:31.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.900+0000 7f3837964640 1 Processor -- start 2023-08-10T10:47:31.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.900+0000 7f3837964640 1 -- start start 2023-08-10T10:47:31.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300696a0 0x7f38300c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3830159970 0x7f38300c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c5080 con 0x7f38300b1ae0 2023-08-10T10:47:31.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830158b00 con 0x7f38300696a0 2023-08-10T10:47:31.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.901+0000 7f3837964640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3830158820 con 0x7f3830159970 2023-08-10T10:47:31.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49498/0 (socket says 172.21.15.50:49498) 2023-08-10T10:47:31.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 -- 172.21.15.50:0/2393927044 learned_addr learned my addr 172.21.15.50:0/2393927044 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:31.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3835f01640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3830159970 0x7f38300c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3835700640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300696a0 0x7f38300c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 -- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3830159970 msgr2=0x7f38300c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3830159970 0x7f38300c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 -- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300696a0 msgr2=0x7f38300c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300696a0 0x7f38300c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.902+0000 7f3834eff640 1 -- 172.21.15.50:0/2393927044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094d0 con 0x7f38300b1ae0 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3834eff640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f38200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382003ac40 con 0x7f38300b1ae0 2023-08-10T10:47:31.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382003ada0 con 0x7f38300b1ae0 2023-08-10T10:47:31.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820044630 con 0x7f38300b1ae0 2023-08-10T10:47:31.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38301f5f00 con 0x7f38300b1ae0 2023-08-10T10:47:31.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.903+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38301f64c0 con 0x7f38300b1ae0 2023-08-10T10:47:31.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.904+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383004e270 con 0x7f38300b1ae0 2023-08-10T10:47:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.905+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f382002f050 con 0x7f38300b1ae0 2023-08-10T10:47:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.906+0000 7f3825ffb640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 0x7f381406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.907+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38200ab510 con 0x7f38300b1ae0 2023-08-10T10:47:31.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.907+0000 7f3835700640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 0x7f381406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:31.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.908+0000 7f3835700640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 0x7f381406d110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:31.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:31.912+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38200765b0 con 0x7f38300b1ae0 2023-08-10T10:47:32.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.106+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38300b3160 con 0x7f38300b1ae0 2023-08-10T10:47:32.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.108+0000 7f3825ffb640 1 -- 172.21.15.50:0/2393927044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+18299 (secure 0 0 0) 0x7f3820079bd0 con 0x7f38300b1ae0 2023-08-10T10:47:32.109 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:32.110 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":158,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:47:29.052607+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 msgr2=0x7f381406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 0x7f381406d110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).stop 2023-08-10T10:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 msgr2=0x7f3830157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f38200046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 shutdown_connections 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3830159970 0x7f38300c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38300b1ae0 0x7f3830157f20 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f381406ac50 0x7f381406d110 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 --2- 172.21.15.50:0/2393927044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300696a0 0x7f38300c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.111+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 >> 172.21.15.50:0/2393927044 conn(0x7f383006b590 msgr2=0x7f38300cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.112+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 shutdown_connections 2023-08-10T10:47:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.112+0000 7f3837964640 1 -- 172.21.15.50:0/2393927044 wait complete. 2023-08-10T10:47:32.134 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:47:32.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:47:32.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.356+0000 7f1db7d96640 1 Processor -- start 2023-08-10T10:47:32.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.356+0000 7f1db7d96640 1 -- start start 2023-08-10T10:47:32.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 0x7f1db00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1db00b0c60 0x7f1db00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db0071c70 con 0x7f1db00b0c60 2023-08-10T10:47:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00713d0 con 0x7f1db015aa40 2023-08-10T10:47:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db7d96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00716b0 con 0x7f1db0070e80 2023-08-10T10:47:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db5331640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1db00b0c60 0x7f1db00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db5331640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1db00b0c60 0x7f1db00b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49508/0 (socket says 172.21.15.50:49508) 2023-08-10T10:47:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.358+0000 7f1db5331640 1 -- 172.21.15.50:0/522141301 learned_addr learned my addr 172.21.15.50:0/522141301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5b32640 1 --2- 172.21.15.50:0/522141301 >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 0x7f1db00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5331640 1 -- 172.21.15.50:0/522141301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 msgr2=0x7f1db00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db6333640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5331640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db00696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5331640 1 -- 172.21.15.50:0/522141301 >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 msgr2=0x7f1db00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5331640 1 --2- 172.21.15.50:0/522141301 >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 0x7f1db00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5331640 1 -- 172.21.15.50:0/522141301 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0071990 con 0x7f1db00b0c60 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db5b32640 1 --2- 172.21.15.50:0/522141301 >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 0x7f1db00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.359+0000 7f1db6333640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.360+0000 7f1db5331640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db00b3d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f1db00c8dc0 tx=0x7f1da002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02a18ea96ee88e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.360+0000 7f1db4b30640 1 -- 172.21.15.50:0/522141301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00317f0 con 0x7f1db00b0c60 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db4b30640 1 -- 172.21.15.50:0/522141301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0031950 con 0x7f1db00b0c60 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db4b30640 1 -- 172.21.15.50:0/522141301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0031ce0 con 0x7f1db00b0c60 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 -- 172.21.15.50:0/522141301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 msgr2=0x7f1db00b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db00b3d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f1db00c8dc0 tx=0x7f1da002b890 comp rx=0 tx=0).stop 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 -- 172.21.15.50:0/522141301 shutdown_connections 2023-08-10T10:47:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 --2- 172.21.15.50:0/522141301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db00b3d60 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 --2- 172.21.15.50:0/522141301 >> v2:172.21.15.117:3300/0 conn(0x7f1db015aa40 0x7f1db00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.361+0000 7f1db7d96640 1 -- 172.21.15.50:0/522141301 >> 172.21.15.50:0/522141301 conn(0x7f1db006b590 msgr2=0x7f1db00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.362+0000 7f1db7d96640 1 -- 172.21.15.50:0/522141301 shutdown_connections 2023-08-10T10:47:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.362+0000 7f1db7d96640 1 -- 172.21.15.50:0/522141301 wait complete. 2023-08-10T10:47:32.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.363+0000 7f1db7d96640 1 Processor -- start 2023-08-10T10:47:32.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.363+0000 7f1db7d96640 1 -- start start 2023-08-10T10:47:32.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 0x7f1db01594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01f4840 con 0x7f1db00b0c60 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db015df80 con 0x7f1db015aa40 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.364+0000 7f1db7d96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0151a50 con 0x7f1db0070e80 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49518/0 (socket says 172.21.15.50:49518) 2023-08-10T10:47:32.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 -- 172.21.15.50:0/3043812407 learned_addr learned my addr 172.21.15.50:0/3043812407 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:32.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5b32640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db6333640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 0x7f1db01594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 -- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 msgr2=0x7f1db015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 -- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 msgr2=0x7f1db01594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 0x7f1db01594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db5331640 1 -- 172.21.15.50:0/3043812407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00094d0 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.365+0000 7f1db6333640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 0x7f1db01594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1db5331640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1da002b8d0 tx=0x7f1da00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0032990 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0032b10 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00453f0 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db01f3c30 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.366+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db01f41f0 con 0x7f1db00b0c60 2023-08-10T10:47:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.367+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db004e270 con 0x7f1db00b0c60 2023-08-10T10:47:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.368+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1da004e450 con 0x7f1db00b0c60 2023-08-10T10:47:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.369+0000 7f1da67fc640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 0x7f1d9406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.369+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1da00ab900 con 0x7f1db00b0c60 2023-08-10T10:47:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.370+0000 7f1db5b32640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 0x7f1d9406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.370+0000 7f1db5b32640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 0x7f1d9406d140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00aac0 tx=0x7f1dac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.374+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1da0076a40 con 0x7f1db00b0c60 2023-08-10T10:47:32.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.559+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1db00c9400 con 0x7f1d9406ac80 2023-08-10T10:47:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.584+0000 7f1da67fc640 1 -- 172.21.15.50:0/3043812407 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302798 (secure 0 0 0) 0x7f1dac00c040 con 0x7f1d9406ac80 2023-08-10T10:47:32.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:47:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 msgr2=0x7f1d9406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 0x7f1d9406d140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00aac0 tx=0x7f1dac008040 comp rx=0 tx=0).stop 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 msgr2=0x7f1db0151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1da002b8d0 tx=0x7f1da00046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 shutdown_connections 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d9406ac80 0x7f1d9406d140 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015aa40 0x7f1db01594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db00b0c60 0x7f1db0151510 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 --2- 172.21.15.50:0/3043812407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db0070e80 0x7f1db015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.589+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 >> 172.21.15.50:0/3043812407 conn(0x7f1db006b590 msgr2=0x7f1db00cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.590+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 shutdown_connections 2023-08-10T10:47:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.590+0000 7f1db7d96640 1 -- 172.21.15.50:0/3043812407 wait complete. 2023-08-10T10:47:32.607 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2023-08-10T10:47:32.509911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8440,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554059,"statfs":{"total":1600000000,"available":1591356796,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001888"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076389+0000","last_change":"2023-08-10T10:47:28.076001+0000","last_active":"2023-08-10T10:47:28.076389+0000","last_peered":"2023-08-10T10:47:28.076389+0000","last_clean":"2023-08-10T10:47:28.076389+0000","last_became_active":"2023-08-10T10:47:28.075296+0000","last_became_peered":"2023-08-10T10:47:28.075296+0000","last_unstale":"2023-08-10T10:47:28.076389+0000","last_undegraded":"2023-08-10T10:47:28.076389+0000","last_fullsized":"2023-08-10T10:47:28.076389+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:23.380177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.063854+0000","last_change":"2023-08-10T10:47:28.063662+0000","last_active":"2023-08-10T10:47:28.063854+0000","last_peered":"2023-08-10T10:47:28.063854+0000","last_clean":"2023-08-10T10:47:28.063854+0000","last_became_active":"2023-08-10T10:47:28.063009+0000","last_became_peered":"2023-08-10T10:47:28.063009+0000","last_unstale":"2023-08-10T10:47:28.063854+0000","last_undegraded":"2023-08-10T10:47:28.063854+0000","last_fullsized":"2023-08-10T10:47:28.063854+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:05.447507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.090078+0000","last_change":"2023-08-10T10:47:28.090010+0000","last_active":"2023-08-10T10:47:28.090078+0000","last_peered":"2023-08-10T10:47:28.090078+0000","last_clean":"2023-08-10T10:47:28.090078+0000","last_became_active":"2023-08-10T10:47:28.088415+0000","last_became_peered":"2023-08-10T10:47:28.088415+0000","last_unstale":"2023-08-10T10:47:28.090078+0000","last_undegraded":"2023-08-10T10:47:28.090078+0000","last_fullsized":"2023-08-10T10:47:28.090078+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:42:09.203210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083692+0000","last_change":"2023-08-10T10:47:28.083528+0000","last_active":"2023-08-10T10:47:28.083692+0000","last_peered":"2023-08-10T10:47:28.083692+0000","last_clean":"2023-08-10T10:47:28.083692+0000","last_became_active":"2023-08-10T10:47:28.081641+0000","last_became_peered":"2023-08-10T10:47:28.081641+0000","last_unstale":"2023-08-10T10:47:28.083692+0000","last_undegraded":"2023-08-10T10:47:28.083692+0000","last_fullsized":"2023-08-10T10:47:28.083692+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:05:46.612424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077639+0000","last_change":"2023-08-10T10:47:28.076827+0000","last_active":"2023-08-10T10:47:28.077639+0000","last_peered":"2023-08-10T10:47:28.077639+0000","last_clean":"2023-08-10T10:47:28.077639+0000","last_became_active":"2023-08-10T10:47:28.072614+0000","last_became_peered":"2023-08-10T10:47:28.072614+0000","last_unstale":"2023-08-10T10:47:28.077639+0000","last_undegraded":"2023-08-10T10:47:28.077639+0000","last_fullsized":"2023-08-10T10:47:28.077639+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:56.622415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080104+0000","last_change":"2023-08-10T10:47:28.079976+0000","last_active":"2023-08-10T10:47:28.080104+0000","last_peered":"2023-08-10T10:47:28.080104+0000","last_clean":"2023-08-10T10:47:28.080104+0000","last_became_active":"2023-08-10T10:47:28.079424+0000","last_became_peered":"2023-08-10T10:47:28.079424+0000","last_unstale":"2023-08-10T10:47:28.080104+0000","last_undegraded":"2023-08-10T10:47:28.080104+0000","last_fullsized":"2023-08-10T10:47:28.080104+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:37:34.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077525+0000","last_change":"2023-08-10T10:47:28.075910+0000","last_active":"2023-08-10T10:47:28.077525+0000","last_peered":"2023-08-10T10:47:28.077525+0000","last_clean":"2023-08-10T10:47:28.077525+0000","last_became_active":"2023-08-10T10:47:28.074957+0000","last_became_peered":"2023-08-10T10:47:28.074957+0000","last_unstale":"2023-08-10T10:47:28.077525+0000","last_undegraded":"2023-08-10T10:47:28.077525+0000","last_fullsized":"2023-08-10T10:47:28.077525+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:07:19.484873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076341+0000","last_change":"2023-08-10T10:47:28.076176+0000","last_active":"2023-08-10T10:47:28.076341+0000","last_peered":"2023-08-10T10:47:28.076341+0000","last_clean":"2023-08-10T10:47:28.076341+0000","last_became_active":"2023-08-10T10:47:28.075830+0000","last_became_peered":"2023-08-10T10:47:28.075830+0000","last_unstale":"2023-08-10T10:47:28.076341+0000","last_undegraded":"2023-08-10T10:47:28.076341+0000","last_fullsized":"2023-08-10T10:47:28.076341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:53.965073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077320+0000","last_change":"2023-08-10T10:47:28.069483+0000","last_active":"2023-08-10T10:47:28.077320+0000","last_peered":"2023-08-10T10:47:28.077320+0000","last_clean":"2023-08-10T10:47:28.077320+0000","last_became_active":"2023-08-10T10:47:28.068612+0000","last_became_peered":"2023-08-10T10:47:28.068612+0000","last_unstale":"2023-08-10T10:47:28.077320+0000","last_undegraded":"2023-08-10T10:47:28.077320+0000","last_fullsized":"2023-08-10T10:47:28.077320+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:21.523566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078596+0000","last_change":"2023-08-10T10:47:28.078385+0000","last_active":"2023-08-10T10:47:28.078596+0000","last_peered":"2023-08-10T10:47:28.078596+0000","last_clean":"2023-08-10T10:47:28.078596+0000","last_became_active":"2023-08-10T10:47:28.077972+0000","last_became_peered":"2023-08-10T10:47:28.077972+0000","last_unstale":"2023-08-10T10:47:28.078596+0000","last_undegraded":"2023-08-10T10:47:28.078596+0000","last_fullsized":"2023-08-10T10:47:28.078596+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:29.105516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077224+0000","last_change":"2023-08-10T10:47:28.076682+0000","last_active":"2023-08-10T10:47:28.077224+0000","last_peered":"2023-08-10T10:47:28.077224+0000","last_clean":"2023-08-10T10:47:28.077224+0000","last_became_active":"2023-08-10T10:47:28.076328+0000","last_became_peered":"2023-08-10T10:47:28.076328+0000","last_unstale":"2023-08-10T10:47:28.077224+0000","last_undegraded":"2023-08-10T10:47:28.077224+0000","last_fullsized":"2023-08-10T10:47:28.077224+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:17:52.334738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081711+0000","last_change":"2023-08-10T10:47:28.081600+0000","last_active":"2023-08-10T10:47:28.081711+0000","last_peered":"2023-08-10T10:47:28.081711+0000","last_clean":"2023-08-10T10:47:28.081711+0000","last_became_active":"2023-08-10T10:47:28.080024+0000","last_became_peered":"2023-08-10T10:47:28.080024+0000","last_unstale":"2023-08-10T10:47:28.081711+0000","last_undegraded":"2023-08-10T10:47:28.081711+0000","last_fullsized":"2023-08-10T10:47:28.081711+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:23.672829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088143+0000","last_change":"2023-08-10T10:47:28.088038+0000","last_active":"2023-08-10T10:47:28.088143+0000","last_peered":"2023-08-10T10:47:28.088143+0000","last_clean":"2023-08-10T10:47:28.088143+0000","last_became_active":"2023-08-10T10:47:28.086968+0000","last_became_peered":"2023-08-10T10:47:28.086968+0000","last_unstale":"2023-08-10T10:47:28.088143+0000","last_undegraded":"2023-08-10T10:47:28.088143+0000","last_fullsized":"2023-08-10T10:47:28.088143+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:51.860796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078743+0000","last_change":"2023-08-10T10:47:28.078664+0000","last_active":"2023-08-10T10:47:28.078743+0000","last_peered":"2023-08-10T10:47:28.078743+0000","last_clean":"2023-08-10T10:47:28.078743+0000","last_became_active":"2023-08-10T10:47:28.078216+0000","last_became_peered":"2023-08-10T10:47:28.078216+0000","last_unstale":"2023-08-10T10:47:28.078743+0000","last_undegraded":"2023-08-10T10:47:28.078743+0000","last_fullsized":"2023-08-10T10:47:28.078743+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:57:39.723321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076367+0000","last_change":"2023-08-10T10:47:28.075493+0000","last_active":"2023-08-10T10:47:28.076367+0000","last_peered":"2023-08-10T10:47:28.076367+0000","last_clean":"2023-08-10T10:47:28.076367+0000","last_became_active":"2023-08-10T10:47:28.075073+0000","last_became_peered":"2023-08-10T10:47:28.075073+0000","last_unstale":"2023-08-10T10:47:28.076367+0000","last_undegraded":"2023-08-10T10:47:28.076367+0000","last_fullsized":"2023-08-10T10:47:28.076367+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:49.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080233+0000","last_change":"2023-08-10T10:47:28.080129+0000","last_active":"2023-08-10T10:47:28.080233+0000","last_peered":"2023-08-10T10:47:28.080233+0000","last_clean":"2023-08-10T10:47:28.080233+0000","last_became_active":"2023-08-10T10:47:28.079732+0000","last_became_peered":"2023-08-10T10:47:28.079732+0000","last_unstale":"2023-08-10T10:47:28.080233+0000","last_undegraded":"2023-08-10T10:47:28.080233+0000","last_fullsized":"2023-08-10T10:47:28.080233+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:49.374507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077403+0000","last_change":"2023-08-10T10:47:28.071762+0000","last_active":"2023-08-10T10:47:28.077403+0000","last_peered":"2023-08-10T10:47:28.077403+0000","last_clean":"2023-08-10T10:47:28.077403+0000","last_became_active":"2023-08-10T10:47:28.071358+0000","last_became_peered":"2023-08-10T10:47:28.071358+0000","last_unstale":"2023-08-10T10:47:28.077403+0000","last_undegraded":"2023-08-10T10:47:28.077403+0000","last_fullsized":"2023-08-10T10:47:28.077403+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:48.817084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065132+0000","last_change":"2023-08-10T10:47:28.064951+0000","last_active":"2023-08-10T10:47:28.065132+0000","last_peered":"2023-08-10T10:47:28.065132+0000","last_clean":"2023-08-10T10:47:28.065132+0000","last_became_active":"2023-08-10T10:47:28.064237+0000","last_became_peered":"2023-08-10T10:47:28.064237+0000","last_unstale":"2023-08-10T10:47:28.065132+0000","last_undegraded":"2023-08-10T10:47:28.065132+0000","last_fullsized":"2023-08-10T10:47:28.065132+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:30.600523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077137+0000","last_change":"2023-08-10T10:47:28.075405+0000","last_active":"2023-08-10T10:47:28.077137+0000","last_peered":"2023-08-10T10:47:28.077137+0000","last_clean":"2023-08-10T10:47:28.077137+0000","last_became_active":"2023-08-10T10:47:28.073098+0000","last_became_peered":"2023-08-10T10:47:28.073098+0000","last_unstale":"2023-08-10T10:47:28.077137+0000","last_undegraded":"2023-08-10T10:47:28.077137+0000","last_fullsized":"2023-08-10T10:47:28.077137+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:49.413358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069720+0000","last_change":"2023-08-10T10:47:28.068069+0000","last_active":"2023-08-10T10:47:28.069720+0000","last_peered":"2023-08-10T10:47:28.069720+0000","last_clean":"2023-08-10T10:47:28.069720+0000","last_became_active":"2023-08-10T10:47:28.067829+0000","last_became_peered":"2023-08-10T10:47:28.067829+0000","last_unstale":"2023-08-10T10:47:28.069720+0000","last_undegraded":"2023-08-10T10:47:28.069720+0000","last_fullsized":"2023-08-10T10:47:28.069720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:42.686067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.074823+0000","last_change":"2023-08-10T10:47:28.074710+0000","last_active":"2023-08-10T10:47:28.074823+0000","last_peered":"2023-08-10T10:47:28.074823+0000","last_clean":"2023-08-10T10:47:28.074823+0000","last_became_active":"2023-08-10T10:47:28.071404+0000","last_became_peered":"2023-08-10T10:47:28.071404+0000","last_unstale":"2023-08-10T10:47:28.074823+0000","last_undegraded":"2023-08-10T10:47:28.074823+0000","last_fullsized":"2023-08-10T10:47:28.074823+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:56.712282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081374+0000","last_change":"2023-08-10T10:47:28.080640+0000","last_active":"2023-08-10T10:47:28.081374+0000","last_peered":"2023-08-10T10:47:28.081374+0000","last_clean":"2023-08-10T10:47:28.081374+0000","last_became_active":"2023-08-10T10:47:28.079680+0000","last_became_peered":"2023-08-10T10:47:28.079680+0000","last_unstale":"2023-08-10T10:47:28.081374+0000","last_undegraded":"2023-08-10T10:47:28.081374+0000","last_fullsized":"2023-08-10T10:47:28.081374+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:04:52.812777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.073774+0000","last_change":"2023-08-10T10:47:28.073531+0000","last_active":"2023-08-10T10:47:28.073774+0000","last_peered":"2023-08-10T10:47:28.073774+0000","last_clean":"2023-08-10T10:47:28.073774+0000","last_became_active":"2023-08-10T10:47:28.072671+0000","last_became_peered":"2023-08-10T10:47:28.072671+0000","last_unstale":"2023-08-10T10:47:28.073774+0000","last_undegraded":"2023-08-10T10:47:28.073774+0000","last_fullsized":"2023-08-10T10:47:28.073774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:03.978061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077380+0000","last_change":"2023-08-10T10:47:28.069778+0000","last_active":"2023-08-10T10:47:28.077380+0000","last_peered":"2023-08-10T10:47:28.077380+0000","last_clean":"2023-08-10T10:47:28.077380+0000","last_became_active":"2023-08-10T10:47:28.069090+0000","last_became_peered":"2023-08-10T10:47:28.069090+0000","last_unstale":"2023-08-10T10:47:28.077380+0000","last_undegraded":"2023-08-10T10:47:28.077380+0000","last_fullsized":"2023-08-10T10:47:28.077380+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:43:43.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078719+0000","last_change":"2023-08-10T10:47:28.078649+0000","last_active":"2023-08-10T10:47:28.078719+0000","last_peered":"2023-08-10T10:47:28.078719+0000","last_clean":"2023-08-10T10:47:28.078719+0000","last_became_active":"2023-08-10T10:47:28.078251+0000","last_became_peered":"2023-08-10T10:47:28.078251+0000","last_unstale":"2023-08-10T10:47:28.078719+0000","last_undegraded":"2023-08-10T10:47:28.078719+0000","last_fullsized":"2023-08-10T10:47:28.078719+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:46.777805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077218+0000","last_change":"2023-08-10T10:47:28.077135+0000","last_active":"2023-08-10T10:47:28.077218+0000","last_peered":"2023-08-10T10:47:28.077218+0000","last_clean":"2023-08-10T10:47:28.077218+0000","last_became_active":"2023-08-10T10:47:28.076860+0000","last_became_peered":"2023-08-10T10:47:28.076860+0000","last_unstale":"2023-08-10T10:47:28.077218+0000","last_undegraded":"2023-08-10T10:47:28.077218+0000","last_fullsized":"2023-08-10T10:47:28.077218+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:39.257543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088243+0000","last_change":"2023-08-10T10:47:28.088141+0000","last_active":"2023-08-10T10:47:28.088243+0000","last_peered":"2023-08-10T10:47:28.088243+0000","last_clean":"2023-08-10T10:47:28.088243+0000","last_became_active":"2023-08-10T10:47:28.085201+0000","last_became_peered":"2023-08-10T10:47:28.085201+0000","last_unstale":"2023-08-10T10:47:28.088243+0000","last_undegraded":"2023-08-10T10:47:28.088243+0000","last_fullsized":"2023-08-10T10:47:28.088243+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:24.945585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080284+0000","last_change":"2023-08-10T10:47:28.080015+0000","last_active":"2023-08-10T10:47:28.080284+0000","last_peered":"2023-08-10T10:47:28.080284+0000","last_clean":"2023-08-10T10:47:28.080284+0000","last_became_active":"2023-08-10T10:47:28.079430+0000","last_became_peered":"2023-08-10T10:47:28.079430+0000","last_unstale":"2023-08-10T10:47:28.080284+0000","last_undegraded":"2023-08-10T10:47:28.080284+0000","last_fullsized":"2023-08-10T10:47:28.080284+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:21:02.694403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085306+0000","last_change":"2023-08-10T10:47:28.085235+0000","last_active":"2023-08-10T10:47:28.085306+0000","last_peered":"2023-08-10T10:47:28.085306+0000","last_clean":"2023-08-10T10:47:28.085306+0000","last_became_active":"2023-08-10T10:47:28.084993+0000","last_became_peered":"2023-08-10T10:47:28.084993+0000","last_unstale":"2023-08-10T10:47:28.085306+0000","last_undegraded":"2023-08-10T10:47:28.085306+0000","last_fullsized":"2023-08-10T10:47:28.085306+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:58.363531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078562+0000","last_change":"2023-08-10T10:47:28.078486+0000","last_active":"2023-08-10T10:47:28.078562+0000","last_peered":"2023-08-10T10:47:28.078562+0000","last_clean":"2023-08-10T10:47:28.078562+0000","last_became_active":"2023-08-10T10:47:28.077909+0000","last_became_peered":"2023-08-10T10:47:28.077909+0000","last_unstale":"2023-08-10T10:47:28.078562+0000","last_undegraded":"2023-08-10T10:47:28.078562+0000","last_fullsized":"2023-08-10T10:47:28.078562+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:32.095239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070933+0000","last_change":"2023-08-10T10:47:28.070799+0000","last_active":"2023-08-10T10:47:28.070933+0000","last_peered":"2023-08-10T10:47:28.070933+0000","last_clean":"2023-08-10T10:47:28.070933+0000","last_became_active":"2023-08-10T10:47:28.069229+0000","last_became_peered":"2023-08-10T10:47:28.069229+0000","last_unstale":"2023-08-10T10:47:28.070933+0000","last_undegraded":"2023-08-10T10:47:28.070933+0000","last_fullsized":"2023-08-10T10:47:28.070933+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:37.449649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.082120+0000","last_change":"2023-08-10T10:47:28.082042+0000","last_active":"2023-08-10T10:47:28.082120+0000","last_peered":"2023-08-10T10:47:28.082120+0000","last_clean":"2023-08-10T10:47:28.082120+0000","last_became_active":"2023-08-10T10:47:28.081794+0000","last_became_peered":"2023-08-10T10:47:28.081794+0000","last_unstale":"2023-08-10T10:47:28.082120+0000","last_undegraded":"2023-08-10T10:47:28.082120+0000","last_fullsized":"2023-08-10T10:47:28.082120+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:36.990476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081193+0000","last_change":"2023-08-10T10:47:28.076975+0000","last_active":"2023-08-10T10:47:28.081193+0000","last_peered":"2023-08-10T10:47:28.081193+0000","last_clean":"2023-08-10T10:47:28.081193+0000","last_became_active":"2023-08-10T10:47:28.076147+0000","last_became_peered":"2023-08-10T10:47:28.076147+0000","last_unstale":"2023-08-10T10:47:28.081193+0000","last_undegraded":"2023-08-10T10:47:28.081193+0000","last_fullsized":"2023-08-10T10:47:28.081193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:00.685104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.091024+0000","last_change":"2023-08-10T10:47:27.076917+0000","last_active":"2023-08-10T10:47:28.091024+0000","last_peered":"2023-08-10T10:47:28.091024+0000","last_clean":"2023-08-10T10:47:28.091024+0000","last_became_active":"2023-08-10T10:47:27.076060+0000","last_became_peered":"2023-08-10T10:47:27.076060+0000","last_unstale":"2023-08-10T10:47:28.091024+0000","last_undegraded":"2023-08-10T10:47:28.091024+0000","last_fullsized":"2023-08-10T10:47:28.091024+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:18.815690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085680+0000","last_change":"2023-08-10T10:47:28.085594+0000","last_active":"2023-08-10T10:47:28.085680+0000","last_peered":"2023-08-10T10:47:28.085680+0000","last_clean":"2023-08-10T10:47:28.085680+0000","last_became_active":"2023-08-10T10:47:28.085280+0000","last_became_peered":"2023-08-10T10:47:28.085280+0000","last_unstale":"2023-08-10T10:47:28.085680+0000","last_undegraded":"2023-08-10T10:47:28.085680+0000","last_fullsized":"2023-08-10T10:47:28.085680+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:40.643021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085785+0000","last_change":"2023-08-10T10:47:27.074613+0000","last_active":"2023-08-10T10:47:28.085785+0000","last_peered":"2023-08-10T10:47:28.085785+0000","last_clean":"2023-08-10T10:47:28.085785+0000","last_became_active":"2023-08-10T10:47:27.074342+0000","last_became_peered":"2023-08-10T10:47:27.074342+0000","last_unstale":"2023-08-10T10:47:28.085785+0000","last_undegraded":"2023-08-10T10:47:28.085785+0000","last_fullsized":"2023-08-10T10:47:28.085785+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:47:13.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.073999+0000","last_change":"2023-08-10T10:47:28.073873+0000","last_active":"2023-08-10T10:47:28.073999+0000","last_peered":"2023-08-10T10:47:28.073999+0000","last_clean":"2023-08-10T10:47:28.073999+0000","last_became_active":"2023-08-10T10:47:28.073147+0000","last_became_peered":"2023-08-10T10:47:28.073147+0000","last_unstale":"2023-08-10T10:47:28.073999+0000","last_undegraded":"2023-08-10T10:47:28.073999+0000","last_fullsized":"2023-08-10T10:47:28.073999+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:12.489692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088486+0000","last_change":"2023-08-10T10:47:27.072152+0000","last_active":"2023-08-10T10:47:28.088486+0000","last_peered":"2023-08-10T10:47:28.088486+0000","last_clean":"2023-08-10T10:47:28.088486+0000","last_became_active":"2023-08-10T10:47:27.071627+0000","last_became_peered":"2023-08-10T10:47:27.071627+0000","last_unstale":"2023-08-10T10:47:28.088486+0000","last_undegraded":"2023-08-10T10:47:28.088486+0000","last_fullsized":"2023-08-10T10:47:28.088486+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:32.189036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081997+0000","last_change":"2023-08-10T10:47:28.081872+0000","last_active":"2023-08-10T10:47:28.081997+0000","last_peered":"2023-08-10T10:47:28.081997+0000","last_clean":"2023-08-10T10:47:28.081997+0000","last_became_active":"2023-08-10T10:47:28.080390+0000","last_became_peered":"2023-08-10T10:47:28.080390+0000","last_unstale":"2023-08-10T10:47:28.081997+0000","last_undegraded":"2023-08-10T10:47:28.081997+0000","last_fullsized":"2023-08-10T10:47:28.081997+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:26.720518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085003+0000","last_change":"2023-08-10T10:47:27.070371+0000","last_active":"2023-08-10T10:47:28.085003+0000","last_peered":"2023-08-10T10:47:28.085003+0000","last_clean":"2023-08-10T10:47:28.085003+0000","last_became_active":"2023-08-10T10:47:27.070112+0000","last_became_peered":"2023-08-10T10:47:27.070112+0000","last_unstale":"2023-08-10T10:47:28.085003+0000","last_undegraded":"2023-08-10T10:47:28.085003+0000","last_fullsized":"2023-08-10T10:47:28.085003+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:47:45.454250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.071195+0000","last_change":"2023-08-10T10:47:28.071097+0000","last_active":"2023-08-10T10:47:28.071195+0000","last_peered":"2023-08-10T10:47:28.071195+0000","last_clean":"2023-08-10T10:47:28.071195+0000","last_became_active":"2023-08-10T10:47:28.070168+0000","last_became_peered":"2023-08-10T10:47:28.070168+0000","last_unstale":"2023-08-10T10:47:28.071195+0000","last_undegraded":"2023-08-10T10:47:28.071195+0000","last_fullsized":"2023-08-10T10:47:28.071195+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:12:13.640329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083878+0000","last_change":"2023-08-10T10:47:27.071617+0000","last_active":"2023-08-10T10:47:28.083878+0000","last_peered":"2023-08-10T10:47:28.083878+0000","last_clean":"2023-08-10T10:47:28.083878+0000","last_became_active":"2023-08-10T10:47:27.071255+0000","last_became_peered":"2023-08-10T10:47:27.071255+0000","last_unstale":"2023-08-10T10:47:28.083878+0000","last_undegraded":"2023-08-10T10:47:28.083878+0000","last_fullsized":"2023-08-10T10:47:28.083878+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:36.194768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083034+0000","last_change":"2023-08-10T10:47:28.082843+0000","last_active":"2023-08-10T10:47:28.083034+0000","last_peered":"2023-08-10T10:47:28.083034+0000","last_clean":"2023-08-10T10:47:28.083034+0000","last_became_active":"2023-08-10T10:47:28.076520+0000","last_became_peered":"2023-08-10T10:47:28.076520+0000","last_unstale":"2023-08-10T10:47:28.083034+0000","last_undegraded":"2023-08-10T10:47:28.083034+0000","last_fullsized":"2023-08-10T10:47:28.083034+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:58.940557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.086089+0000","last_change":"2023-08-10T10:47:27.059334+0000","last_active":"2023-08-10T10:47:28.086089+0000","last_peered":"2023-08-10T10:47:28.086089+0000","last_clean":"2023-08-10T10:47:28.086089+0000","last_became_active":"2023-08-10T10:47:27.058767+0000","last_became_peered":"2023-08-10T10:47:27.058767+0000","last_unstale":"2023-08-10T10:47:28.086089+0000","last_undegraded":"2023-08-10T10:47:28.086089+0000","last_fullsized":"2023-08-10T10:47:28.086089+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:16:24.450707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069788+0000","last_change":"2023-08-10T10:47:28.069071+0000","last_active":"2023-08-10T10:47:28.069788+0000","last_peered":"2023-08-10T10:47:28.069788+0000","last_clean":"2023-08-10T10:47:28.069788+0000","last_became_active":"2023-08-10T10:47:28.068687+0000","last_became_peered":"2023-08-10T10:47:28.068687+0000","last_unstale":"2023-08-10T10:47:28.069788+0000","last_undegraded":"2023-08-10T10:47:28.069788+0000","last_fullsized":"2023-08-10T10:47:28.069788+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:53.483768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.063088+0000","last_change":"2023-08-10T10:47:27.067095+0000","last_active":"2023-08-10T10:47:28.063088+0000","last_peered":"2023-08-10T10:47:28.063088+0000","last_clean":"2023-08-10T10:47:28.063088+0000","last_became_active":"2023-08-10T10:47:27.066815+0000","last_became_peered":"2023-08-10T10:47:27.066815+0000","last_unstale":"2023-08-10T10:47:28.063088+0000","last_undegraded":"2023-08-10T10:47:28.063088+0000","last_fullsized":"2023-08-10T10:47:28.063088+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:33.935660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080032+0000","last_change":"2023-08-10T10:47:28.079961+0000","last_active":"2023-08-10T10:47:28.080032+0000","last_peered":"2023-08-10T10:47:28.080032+0000","last_clean":"2023-08-10T10:47:28.080032+0000","last_became_active":"2023-08-10T10:47:28.079573+0000","last_became_peered":"2023-08-10T10:47:28.079573+0000","last_unstale":"2023-08-10T10:47:28.080032+0000","last_undegraded":"2023-08-10T10:47:28.080032+0000","last_fullsized":"2023-08-10T10:47:28.080032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:56.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070852+0000","last_change":"2023-08-10T10:47:27.075228+0000","last_active":"2023-08-10T10:47:28.070852+0000","last_peered":"2023-08-10T10:47:28.070852+0000","last_clean":"2023-08-10T10:47:28.070852+0000","last_became_active":"2023-08-10T10:47:27.074160+0000","last_became_peered":"2023-08-10T10:47:27.074160+0000","last_unstale":"2023-08-10T10:47:28.070852+0000","last_undegraded":"2023-08-10T10:47:28.070852+0000","last_fullsized":"2023-08-10T10:47:28.070852+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:00.860963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078132+0000","last_change":"2023-08-10T10:47:28.078059+0000","last_active":"2023-08-10T10:47:28.078132+0000","last_peered":"2023-08-10T10:47:28.078132+0000","last_clean":"2023-08-10T10:47:28.078132+0000","last_became_active":"2023-08-10T10:47:28.077707+0000","last_became_peered":"2023-08-10T10:47:28.077707+0000","last_unstale":"2023-08-10T10:47:28.078132+0000","last_undegraded":"2023-08-10T10:47:28.078132+0000","last_fullsized":"2023-08-10T10:47:28.078132+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:44.357145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089685+0000","last_change":"2023-08-10T10:47:27.073727+0000","last_active":"2023-08-10T10:47:28.089685+0000","last_peered":"2023-08-10T10:47:28.089685+0000","last_clean":"2023-08-10T10:47:28.089685+0000","last_became_active":"2023-08-10T10:47:27.073333+0000","last_became_peered":"2023-08-10T10:47:27.073333+0000","last_unstale":"2023-08-10T10:47:28.089685+0000","last_undegraded":"2023-08-10T10:47:28.089685+0000","last_fullsized":"2023-08-10T10:47:28.089685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:45.805621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075050+0000","last_change":"2023-08-10T10:47:28.074881+0000","last_active":"2023-08-10T10:47:28.075050+0000","last_peered":"2023-08-10T10:47:28.075050+0000","last_clean":"2023-08-10T10:47:28.075050+0000","last_became_active":"2023-08-10T10:47:28.074571+0000","last_became_peered":"2023-08-10T10:47:28.074571+0000","last_unstale":"2023-08-10T10:47:28.075050+0000","last_undegraded":"2023-08-10T10:47:28.075050+0000","last_fullsized":"2023-08-10T10:47:28.075050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:29:53.190724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084271+0000","last_change":"2023-08-10T10:47:27.075780+0000","last_active":"2023-08-10T10:47:28.084271+0000","last_peered":"2023-08-10T10:47:28.084271+0000","last_clean":"2023-08-10T10:47:28.084271+0000","last_became_active":"2023-08-10T10:47:27.074752+0000","last_became_peered":"2023-08-10T10:47:27.074752+0000","last_unstale":"2023-08-10T10:47:28.084271+0000","last_undegraded":"2023-08-10T10:47:28.084271+0000","last_fullsized":"2023-08-10T10:47:28.084271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:41.255143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080539+0000","last_change":"2023-08-10T10:47:28.080207+0000","last_active":"2023-08-10T10:47:28.080539+0000","last_peered":"2023-08-10T10:47:28.080539+0000","last_clean":"2023-08-10T10:47:28.080539+0000","last_became_active":"2023-08-10T10:47:28.079649+0000","last_became_peered":"2023-08-10T10:47:28.079649+0000","last_unstale":"2023-08-10T10:47:28.080539+0000","last_undegraded":"2023-08-10T10:47:28.080539+0000","last_fullsized":"2023-08-10T10:47:28.080539+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:26:09.975027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083964+0000","last_change":"2023-08-10T10:47:27.068663+0000","last_active":"2023-08-10T10:47:28.083964+0000","last_peered":"2023-08-10T10:47:28.083964+0000","last_clean":"2023-08-10T10:47:28.083964+0000","last_became_active":"2023-08-10T10:47:27.068300+0000","last_became_peered":"2023-08-10T10:47:27.068300+0000","last_unstale":"2023-08-10T10:47:28.083964+0000","last_undegraded":"2023-08-10T10:47:28.083964+0000","last_fullsized":"2023-08-10T10:47:28.083964+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:44.244085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088374+0000","last_change":"2023-08-10T10:47:28.088281+0000","last_active":"2023-08-10T10:47:28.088374+0000","last_peered":"2023-08-10T10:47:28.088374+0000","last_clean":"2023-08-10T10:47:28.088374+0000","last_became_active":"2023-08-10T10:47:28.088043+0000","last_became_peered":"2023-08-10T10:47:28.088043+0000","last_unstale":"2023-08-10T10:47:28.088374+0000","last_undegraded":"2023-08-10T10:47:28.088374+0000","last_fullsized":"2023-08-10T10:47:28.088374+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:29.071801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.057271+0000","last_change":"2023-08-10T10:47:27.073020+0000","last_active":"2023-08-10T10:47:28.057271+0000","last_peered":"2023-08-10T10:47:28.057271+0000","last_clean":"2023-08-10T10:47:28.057271+0000","last_became_active":"2023-08-10T10:47:27.072779+0000","last_became_peered":"2023-08-10T10:47:27.072779+0000","last_unstale":"2023-08-10T10:47:28.057271+0000","last_undegraded":"2023-08-10T10:47:28.057271+0000","last_fullsized":"2023-08-10T10:47:28.057271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:45.579850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080730+0000","last_change":"2023-08-10T10:47:28.080616+0000","last_active":"2023-08-10T10:47:28.080730+0000","last_peered":"2023-08-10T10:47:28.080730+0000","last_clean":"2023-08-10T10:47:28.080730+0000","last_became_active":"2023-08-10T10:47:28.080184+0000","last_became_peered":"2023-08-10T10:47:28.080184+0000","last_unstale":"2023-08-10T10:47:28.080730+0000","last_undegraded":"2023-08-10T10:47:28.080730+0000","last_fullsized":"2023-08-10T10:47:28.080730+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:55.586647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084089+0000","last_change":"2023-08-10T10:47:27.077138+0000","last_active":"2023-08-10T10:47:28.084089+0000","last_peered":"2023-08-10T10:47:28.084089+0000","last_clean":"2023-08-10T10:47:28.084089+0000","last_became_active":"2023-08-10T10:47:27.076760+0000","last_became_peered":"2023-08-10T10:47:27.076760+0000","last_unstale":"2023-08-10T10:47:28.084089+0000","last_undegraded":"2023-08-10T10:47:28.084089+0000","last_fullsized":"2023-08-10T10:47:28.084089+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:48.657925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076408+0000","last_change":"2023-08-10T10:47:28.076238+0000","last_active":"2023-08-10T10:47:28.076408+0000","last_peered":"2023-08-10T10:47:28.076408+0000","last_clean":"2023-08-10T10:47:28.076408+0000","last_became_active":"2023-08-10T10:47:28.075714+0000","last_became_peered":"2023-08-10T10:47:28.075714+0000","last_unstale":"2023-08-10T10:47:28.076408+0000","last_undegraded":"2023-08-10T10:47:28.076408+0000","last_fullsized":"2023-08-10T10:47:28.076408+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:45.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.072596+0000","last_change":"2023-08-10T10:47:27.074443+0000","last_active":"2023-08-10T10:47:28.072596+0000","last_peered":"2023-08-10T10:47:28.072596+0000","last_clean":"2023-08-10T10:47:28.072596+0000","last_became_active":"2023-08-10T10:47:27.074188+0000","last_became_peered":"2023-08-10T10:47:27.074188+0000","last_unstale":"2023-08-10T10:47:28.072596+0000","last_undegraded":"2023-08-10T10:47:28.072596+0000","last_fullsized":"2023-08-10T10:47:28.072596+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:44.054257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078594+0000","last_change":"2023-08-10T10:47:28.078390+0000","last_active":"2023-08-10T10:47:28.078594+0000","last_peered":"2023-08-10T10:47:28.078594+0000","last_clean":"2023-08-10T10:47:28.078594+0000","last_became_active":"2023-08-10T10:47:28.073200+0000","last_became_peered":"2023-08-10T10:47:28.073200+0000","last_unstale":"2023-08-10T10:47:28.078594+0000","last_undegraded":"2023-08-10T10:47:28.078594+0000","last_fullsized":"2023-08-10T10:47:28.078594+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:03.510978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065075+0000","last_change":"2023-08-10T10:47:27.075203+0000","last_active":"2023-08-10T10:47:28.065075+0000","last_peered":"2023-08-10T10:47:28.065075+0000","last_clean":"2023-08-10T10:47:28.065075+0000","last_became_active":"2023-08-10T10:47:27.074887+0000","last_became_peered":"2023-08-10T10:47:27.074887+0000","last_unstale":"2023-08-10T10:47:28.065075+0000","last_undegraded":"2023-08-10T10:47:28.065075+0000","last_fullsized":"2023-08-10T10:47:28.065075+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:20:13.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083352+0000","last_change":"2023-08-10T10:47:28.081939+0000","last_active":"2023-08-10T10:47:28.083352+0000","last_peered":"2023-08-10T10:47:28.083352+0000","last_clean":"2023-08-10T10:47:28.083352+0000","last_became_active":"2023-08-10T10:47:28.074164+0000","last_became_peered":"2023-08-10T10:47:28.074164+0000","last_unstale":"2023-08-10T10:47:28.083352+0000","last_undegraded":"2023-08-10T10:47:28.083352+0000","last_fullsized":"2023-08-10T10:47:28.083352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:54.332978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067711+0000","last_change":"2023-08-10T10:47:27.077218+0000","last_active":"2023-08-10T10:47:28.067711+0000","last_peered":"2023-08-10T10:47:28.067711+0000","last_clean":"2023-08-10T10:47:28.067711+0000","last_became_active":"2023-08-10T10:47:27.075453+0000","last_became_peered":"2023-08-10T10:47:27.075453+0000","last_unstale":"2023-08-10T10:47:28.067711+0000","last_undegraded":"2023-08-10T10:47:28.067711+0000","last_fullsized":"2023-08-10T10:47:28.067711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:52.602921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069755+0000","last_change":"2023-08-10T10:47:28.068921+0000","last_active":"2023-08-10T10:47:28.069755+0000","last_peered":"2023-08-10T10:47:28.069755+0000","last_clean":"2023-08-10T10:47:28.069755+0000","last_became_active":"2023-08-10T10:47:28.068351+0000","last_became_peered":"2023-08-10T10:47:28.068351+0000","last_unstale":"2023-08-10T10:47:28.069755+0000","last_undegraded":"2023-08-10T10:47:28.069755+0000","last_fullsized":"2023-08-10T10:47:28.069755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:42.870014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.086507+0000","last_change":"2023-08-10T10:47:27.076896+0000","last_active":"2023-08-10T10:47:28.086507+0000","last_peered":"2023-08-10T10:47:28.086507+0000","last_clean":"2023-08-10T10:47:28.086507+0000","last_became_active":"2023-08-10T10:47:27.076250+0000","last_became_peered":"2023-08-10T10:47:27.076250+0000","last_unstale":"2023-08-10T10:47:28.086507+0000","last_undegraded":"2023-08-10T10:47:28.086507+0000","last_fullsized":"2023-08-10T10:47:28.086507+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:12:02.451609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.091286+0000","last_change":"2023-08-10T10:47:28.091199+0000","last_active":"2023-08-10T10:47:28.091286+0000","last_peered":"2023-08-10T10:47:28.091286+0000","last_clean":"2023-08-10T10:47:28.091286+0000","last_became_active":"2023-08-10T10:47:28.090391+0000","last_became_peered":"2023-08-10T10:47:28.090391+0000","last_unstale":"2023-08-10T10:47:28.091286+0000","last_undegraded":"2023-08-10T10:47:28.091286+0000","last_fullsized":"2023-08-10T10:47:28.091286+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:57.192610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061800+0000","last_change":"2023-08-10T10:47:27.075622+0000","last_active":"2023-08-10T10:47:28.061800+0000","last_peered":"2023-08-10T10:47:28.061800+0000","last_clean":"2023-08-10T10:47:28.061800+0000","last_became_active":"2023-08-10T10:47:27.075341+0000","last_became_peered":"2023-08-10T10:47:27.075341+0000","last_unstale":"2023-08-10T10:47:28.061800+0000","last_undegraded":"2023-08-10T10:47:28.061800+0000","last_fullsized":"2023-08-10T10:47:28.061800+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:19.366993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088369+0000","last_change":"2023-08-10T10:47:28.088313+0000","last_active":"2023-08-10T10:47:28.088369+0000","last_peered":"2023-08-10T10:47:28.088369+0000","last_clean":"2023-08-10T10:47:28.088369+0000","last_became_active":"2023-08-10T10:47:28.085576+0000","last_became_peered":"2023-08-10T10:47:28.085576+0000","last_unstale":"2023-08-10T10:47:28.088369+0000","last_undegraded":"2023-08-10T10:47:28.088369+0000","last_fullsized":"2023-08-10T10:47:28.088369+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:43:57.950172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.058802+0000","last_change":"2023-08-10T10:47:27.074519+0000","last_active":"2023-08-10T10:47:28.058802+0000","last_peered":"2023-08-10T10:47:28.058802+0000","last_clean":"2023-08-10T10:47:28.058802+0000","last_became_active":"2023-08-10T10:47:27.074255+0000","last_became_peered":"2023-08-10T10:47:27.074255+0000","last_unstale":"2023-08-10T10:47:28.058802+0000","last_undegraded":"2023-08-10T10:47:28.058802+0000","last_fullsized":"2023-08-10T10:47:28.058802+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:10.946071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075944+0000","last_change":"2023-08-10T10:47:28.075774+0000","last_active":"2023-08-10T10:47:28.075944+0000","last_peered":"2023-08-10T10:47:28.075944+0000","last_clean":"2023-08-10T10:47:28.075944+0000","last_became_active":"2023-08-10T10:47:28.075251+0000","last_became_peered":"2023-08-10T10:47:28.075251+0000","last_unstale":"2023-08-10T10:47:28.075944+0000","last_undegraded":"2023-08-10T10:47:28.075944+0000","last_fullsized":"2023-08-10T10:47:28.075944+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:08.394663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067704+0000","last_change":"2023-08-10T10:47:27.068052+0000","last_active":"2023-08-10T10:47:28.067704+0000","last_peered":"2023-08-10T10:47:28.067704+0000","last_clean":"2023-08-10T10:47:28.067704+0000","last_became_active":"2023-08-10T10:47:27.067781+0000","last_became_peered":"2023-08-10T10:47:27.067781+0000","last_unstale":"2023-08-10T10:47:28.067704+0000","last_undegraded":"2023-08-10T10:47:28.067704+0000","last_fullsized":"2023-08-10T10:47:28.067704+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:14.432820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077422+0000","last_change":"2023-08-10T10:47:28.073369+0000","last_active":"2023-08-10T10:47:28.077422+0000","last_peered":"2023-08-10T10:47:28.077422+0000","last_clean":"2023-08-10T10:47:28.077422+0000","last_became_active":"2023-08-10T10:47:28.073037+0000","last_became_peered":"2023-08-10T10:47:28.073037+0000","last_unstale":"2023-08-10T10:47:28.077422+0000","last_undegraded":"2023-08-10T10:47:28.077422+0000","last_fullsized":"2023-08-10T10:47:28.077422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:31.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061568+0000","last_change":"2023-08-10T10:47:27.080303+0000","last_active":"2023-08-10T10:47:28.061568+0000","last_peered":"2023-08-10T10:47:28.061568+0000","last_clean":"2023-08-10T10:47:28.061568+0000","last_became_active":"2023-08-10T10:47:27.078982+0000","last_became_peered":"2023-08-10T10:47:27.078982+0000","last_unstale":"2023-08-10T10:47:28.061568+0000","last_undegraded":"2023-08-10T10:47:28.061568+0000","last_fullsized":"2023-08-10T10:47:28.061568+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:28.053962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078138+0000","last_change":"2023-08-10T10:47:28.077573+0000","last_active":"2023-08-10T10:47:28.078138+0000","last_peered":"2023-08-10T10:47:28.078138+0000","last_clean":"2023-08-10T10:47:28.078138+0000","last_became_active":"2023-08-10T10:47:28.077230+0000","last_became_peered":"2023-08-10T10:47:28.077230+0000","last_unstale":"2023-08-10T10:47:28.078138+0000","last_undegraded":"2023-08-10T10:47:28.078138+0000","last_fullsized":"2023-08-10T10:47:28.078138+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:47:47.745717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069014+0000","last_change":"2023-08-10T10:47:27.066259+0000","last_active":"2023-08-10T10:47:28.069014+0000","last_peered":"2023-08-10T10:47:28.069014+0000","last_clean":"2023-08-10T10:47:28.069014+0000","last_became_active":"2023-08-10T10:47:27.065700+0000","last_became_peered":"2023-08-10T10:47:27.065700+0000","last_unstale":"2023-08-10T10:47:28.069014+0000","last_undegraded":"2023-08-10T10:47:28.069014+0000","last_fullsized":"2023-08-10T10:47:28.069014+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:48.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079266+0000","last_change":"2023-08-10T10:47:28.078741+0000","last_active":"2023-08-10T10:47:28.079266+0000","last_peered":"2023-08-10T10:47:28.079266+0000","last_clean":"2023-08-10T10:47:28.079266+0000","last_became_active":"2023-08-10T10:47:28.078399+0000","last_became_peered":"2023-08-10T10:47:28.078399+0000","last_unstale":"2023-08-10T10:47:28.079266+0000","last_undegraded":"2023-08-10T10:47:28.079266+0000","last_fullsized":"2023-08-10T10:47:28.079266+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:09.799993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.066153+0000","last_change":"2023-08-10T10:47:27.066465+0000","last_active":"2023-08-10T10:47:28.066153+0000","last_peered":"2023-08-10T10:47:28.066153+0000","last_clean":"2023-08-10T10:47:28.066153+0000","last_became_active":"2023-08-10T10:47:27.066212+0000","last_became_peered":"2023-08-10T10:47:27.066212+0000","last_unstale":"2023-08-10T10:47:28.066153+0000","last_undegraded":"2023-08-10T10:47:28.066153+0000","last_fullsized":"2023-08-10T10:47:28.066153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:33.515282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081045+0000","last_change":"2023-08-10T10:47:28.080957+0000","last_active":"2023-08-10T10:47:28.081045+0000","last_peered":"2023-08-10T10:47:28.081045+0000","last_clean":"2023-08-10T10:47:28.081045+0000","last_became_active":"2023-08-10T10:47:28.075313+0000","last_became_peered":"2023-08-10T10:47:28.075313+0000","last_unstale":"2023-08-10T10:47:28.081045+0000","last_undegraded":"2023-08-10T10:47:28.081045+0000","last_fullsized":"2023-08-10T10:47:28.081045+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:12.778645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.059027+0000","last_change":"2023-08-10T10:47:27.075441+0000","last_active":"2023-08-10T10:47:28.059027+0000","last_peered":"2023-08-10T10:47:28.059027+0000","last_clean":"2023-08-10T10:47:28.059027+0000","last_became_active":"2023-08-10T10:47:27.075117+0000","last_became_peered":"2023-08-10T10:47:27.075117+0000","last_unstale":"2023-08-10T10:47:28.059027+0000","last_undegraded":"2023-08-10T10:47:28.059027+0000","last_fullsized":"2023-08-10T10:47:28.059027+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:37.859083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089803+0000","last_change":"2023-08-10T10:47:28.089623+0000","last_active":"2023-08-10T10:47:28.089803+0000","last_peered":"2023-08-10T10:47:28.089803+0000","last_clean":"2023-08-10T10:47:28.089803+0000","last_became_active":"2023-08-10T10:47:28.088078+0000","last_became_peered":"2023-08-10T10:47:28.088078+0000","last_unstale":"2023-08-10T10:47:28.089803+0000","last_undegraded":"2023-08-10T10:47:28.089803+0000","last_fullsized":"2023-08-10T10:47:28.089803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:48.484286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.062896+0000","last_change":"2023-08-10T10:47:27.075231+0000","last_active":"2023-08-10T10:47:28.062896+0000","last_peered":"2023-08-10T10:47:28.062896+0000","last_clean":"2023-08-10T10:47:28.062896+0000","last_became_active":"2023-08-10T10:47:27.074870+0000","last_became_peered":"2023-08-10T10:47:27.074870+0000","last_unstale":"2023-08-10T10:47:28.062896+0000","last_undegraded":"2023-08-10T10:47:28.062896+0000","last_fullsized":"2023-08-10T10:47:28.062896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:24.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":409,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065557+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:47:28.065557+0000","last_peered":"2023-08-10T10:47:28.065557+0000","last_clean":"2023-08-10T10:47:28.065557+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:47:28.065557+0000","last_undegraded":"2023-08-10T10:47:28.065557+0000","last_fullsized":"2023-08-10T10:47:28.065557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:16.446593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":269,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061973+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:47:28.061973+0000","last_peered":"2023-08-10T10:47:28.061973+0000","last_clean":"2023-08-10T10:47:28.061973+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:47:28.061973+0000","last_undegraded":"2023-08-10T10:47:28.061973+0000","last_fullsized":"2023-08-10T10:47:28.061973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:45.026309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.082156+0000","last_change":"2023-08-10T10:47:28.081177+0000","last_active":"2023-08-10T10:47:28.082156+0000","last_peered":"2023-08-10T10:47:28.082156+0000","last_clean":"2023-08-10T10:47:28.082156+0000","last_became_active":"2023-08-10T10:47:28.075683+0000","last_became_peered":"2023-08-10T10:47:28.075683+0000","last_unstale":"2023-08-10T10:47:28.082156+0000","last_undegraded":"2023-08-10T10:47:28.082156+0000","last_fullsized":"2023-08-10T10:47:28.082156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:00.508594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067788+0000","last_change":"2023-08-10T10:47:27.077904+0000","last_active":"2023-08-10T10:47:28.067788+0000","last_peered":"2023-08-10T10:47:28.067788+0000","last_clean":"2023-08-10T10:47:28.067788+0000","last_became_active":"2023-08-10T10:47:27.077664+0000","last_became_peered":"2023-08-10T10:47:27.077664+0000","last_unstale":"2023-08-10T10:47:28.067788+0000","last_undegraded":"2023-08-10T10:47:28.067788+0000","last_fullsized":"2023-08-10T10:47:28.067788+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:18:21.966433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":255,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065427+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:47:28.065427+0000","last_peered":"2023-08-10T10:47:28.065427+0000","last_clean":"2023-08-10T10:47:28.065427+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:47:28.065427+0000","last_undegraded":"2023-08-10T10:47:28.065427+0000","last_fullsized":"2023-08-10T10:47:28.065427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:40.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.071361+0000","last_change":"2023-08-10T10:47:28.071229+0000","last_active":"2023-08-10T10:47:28.071361+0000","last_peered":"2023-08-10T10:47:28.071361+0000","last_clean":"2023-08-10T10:47:28.071361+0000","last_became_active":"2023-08-10T10:47:28.070819+0000","last_became_peered":"2023-08-10T10:47:28.070819+0000","last_unstale":"2023-08-10T10:47:28.071361+0000","last_undegraded":"2023-08-10T10:47:28.071361+0000","last_fullsized":"2023-08-10T10:47:28.071361+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:45.389671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089576+0000","last_change":"2023-08-10T10:47:27.079285+0000","last_active":"2023-08-10T10:47:28.089576+0000","last_peered":"2023-08-10T10:47:28.089576+0000","last_clean":"2023-08-10T10:47:28.089576+0000","last_became_active":"2023-08-10T10:47:27.079050+0000","last_became_peered":"2023-08-10T10:47:27.079050+0000","last_unstale":"2023-08-10T10:47:28.089576+0000","last_undegraded":"2023-08-10T10:47:28.089576+0000","last_fullsized":"2023-08-10T10:47:28.089576+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:47.233136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067058+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:47:28.067058+0000","last_peered":"2023-08-10T10:47:28.067058+0000","last_clean":"2023-08-10T10:47:28.067058+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:47:28.067058+0000","last_undegraded":"2023-08-10T10:47:28.067058+0000","last_fullsized":"2023-08-10T10:47:28.067058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:36.793702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075915+0000","last_change":"2023-08-10T10:47:28.075795+0000","last_active":"2023-08-10T10:47:28.075915+0000","last_peered":"2023-08-10T10:47:28.075915+0000","last_clean":"2023-08-10T10:47:28.075915+0000","last_became_active":"2023-08-10T10:47:28.075393+0000","last_became_peered":"2023-08-10T10:47:28.075393+0000","last_unstale":"2023-08-10T10:47:28.075915+0000","last_undegraded":"2023-08-10T10:47:28.075915+0000","last_fullsized":"2023-08-10T10:47:28.075915+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:57.958945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085296+0000","last_change":"2023-08-10T10:47:27.075928+0000","last_active":"2023-08-10T10:47:28.085296+0000","last_peered":"2023-08-10T10:47:28.085296+0000","last_clean":"2023-08-10T10:47:28.085296+0000","last_became_active":"2023-08-10T10:47:27.075662+0000","last_became_peered":"2023-08-10T10:47:27.075662+0000","last_unstale":"2023-08-10T10:47:28.085296+0000","last_undegraded":"2023-08-10T10:47:28.085296+0000","last_fullsized":"2023-08-10T10:47:28.085296+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:45:03.764252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":269,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.057910+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:47:28.057910+0000","last_peered":"2023-08-10T10:47:28.057910+0000","last_clean":"2023-08-10T10:47:28.057910+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:47:28.057910+0000","last_undegraded":"2023-08-10T10:47:28.057910+0000","last_fullsized":"2023-08-10T10:47:28.057910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:10.557596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079841+0000","last_change":"2023-08-10T10:47:28.079767+0000","last_active":"2023-08-10T10:47:28.079841+0000","last_peered":"2023-08-10T10:47:28.079841+0000","last_clean":"2023-08-10T10:47:28.079841+0000","last_became_active":"2023-08-10T10:47:28.079473+0000","last_became_peered":"2023-08-10T10:47:28.079473+0000","last_unstale":"2023-08-10T10:47:28.079841+0000","last_undegraded":"2023-08-10T10:47:28.079841+0000","last_fullsized":"2023-08-10T10:47:28.079841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:17.267295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089618+0000","last_change":"2023-08-10T10:47:27.079441+0000","last_active":"2023-08-10T10:47:28.089618+0000","last_peered":"2023-08-10T10:47:28.089618+0000","last_clean":"2023-08-10T10:47:28.089618+0000","last_became_active":"2023-08-10T10:47:27.079192+0000","last_became_peered":"2023-08-10T10:47:27.079192+0000","last_unstale":"2023-08-10T10:47:28.089618+0000","last_undegraded":"2023-08-10T10:47:28.089618+0000","last_fullsized":"2023-08-10T10:47:28.089618+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:54.986116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":275,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067821+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:47:28.067821+0000","last_peered":"2023-08-10T10:47:28.067821+0000","last_clean":"2023-08-10T10:47:28.067821+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:47:28.067821+0000","last_undegraded":"2023-08-10T10:47:28.067821+0000","last_fullsized":"2023-08-10T10:47:28.067821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:56:20.377064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081055+0000","last_change":"2023-08-10T10:47:28.080990+0000","last_active":"2023-08-10T10:47:28.081055+0000","last_peered":"2023-08-10T10:47:28.081055+0000","last_clean":"2023-08-10T10:47:28.081055+0000","last_became_active":"2023-08-10T10:47:28.080678+0000","last_became_peered":"2023-08-10T10:47:28.080678+0000","last_unstale":"2023-08-10T10:47:28.081055+0000","last_undegraded":"2023-08-10T10:47:28.081055+0000","last_fullsized":"2023-08-10T10:47:28.081055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:16.949737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089183+0000","last_change":"2023-08-10T10:47:27.063750+0000","last_active":"2023-08-10T10:47:28.089183+0000","last_peered":"2023-08-10T10:47:28.089183+0000","last_clean":"2023-08-10T10:47:28.089183+0000","last_became_active":"2023-08-10T10:47:27.063037+0000","last_became_peered":"2023-08-10T10:47:27.063037+0000","last_unstale":"2023-08-10T10:47:28.089183+0000","last_undegraded":"2023-08-10T10:47:28.089183+0000","last_fullsized":"2023-08-10T10:47:28.089183+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:16.905392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":255,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065309+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:47:28.065309+0000","last_peered":"2023-08-10T10:47:28.065309+0000","last_clean":"2023-08-10T10:47:28.065309+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:47:28.065309+0000","last_undegraded":"2023-08-10T10:47:28.065309+0000","last_fullsized":"2023-08-10T10:47:28.065309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:49.793451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084545+0000","last_change":"2023-08-10T10:47:28.084464+0000","last_active":"2023-08-10T10:47:28.084545+0000","last_peered":"2023-08-10T10:47:28.084545+0000","last_clean":"2023-08-10T10:47:28.084545+0000","last_became_active":"2023-08-10T10:47:28.084197+0000","last_became_peered":"2023-08-10T10:47:28.084197+0000","last_unstale":"2023-08-10T10:47:28.084545+0000","last_undegraded":"2023-08-10T10:47:28.084545+0000","last_fullsized":"2023-08-10T10:47:28.084545+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:04.320222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061174+0000","last_change":"2023-08-10T10:47:27.078743+0000","last_active":"2023-08-10T10:47:28.061174+0000","last_peered":"2023-08-10T10:47:28.061174+0000","last_clean":"2023-08-10T10:47:28.061174+0000","last_became_active":"2023-08-10T10:47:27.077241+0000","last_became_peered":"2023-08-10T10:47:27.077241+0000","last_unstale":"2023-08-10T10:47:28.061174+0000","last_undegraded":"2023-08-10T10:47:28.061174+0000","last_fullsized":"2023-08-10T10:47:28.061174+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:07.376825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":275,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.066380+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:47:28.066380+0000","last_peered":"2023-08-10T10:47:28.066380+0000","last_clean":"2023-08-10T10:47:28.066380+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:47:28.066380+0000","last_undegraded":"2023-08-10T10:47:28.066380+0000","last_fullsized":"2023-08-10T10:47:28.066380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:05.439387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079285+0000","last_change":"2023-08-10T10:47:28.079103+0000","last_active":"2023-08-10T10:47:28.079285+0000","last_peered":"2023-08-10T10:47:28.079285+0000","last_clean":"2023-08-10T10:47:28.079285+0000","last_became_active":"2023-08-10T10:47:28.078832+0000","last_became_peered":"2023-08-10T10:47:28.078832+0000","last_unstale":"2023-08-10T10:47:28.079285+0000","last_undegraded":"2023-08-10T10:47:28.079285+0000","last_fullsized":"2023-08-10T10:47:28.079285+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:38.170330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070621+0000","last_change":"2023-08-10T10:47:27.077037+0000","last_active":"2023-08-10T10:47:28.070621+0000","last_peered":"2023-08-10T10:47:28.070621+0000","last_clean":"2023-08-10T10:47:28.070621+0000","last_became_active":"2023-08-10T10:47:27.076524+0000","last_became_peered":"2023-08-10T10:47:27.076524+0000","last_unstale":"2023-08-10T10:47:28.070621+0000","last_undegraded":"2023-08-10T10:47:28.070621+0000","last_fullsized":"2023-08-10T10:47:28.070621+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:39.208080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067992+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:47:28.067992+0000","last_peered":"2023-08-10T10:47:28.067992+0000","last_clean":"2023-08-10T10:47:28.067992+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:47:28.067992+0000","last_undegraded":"2023-08-10T10:47:28.067992+0000","last_fullsized":"2023-08-10T10:47:28.067992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:41:27.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193819,"statfs":{"total":200000000,"available":198471569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.206,"15min":1.145},"min":{"1min":0.83299999999999996,"5min":0.52300000000000002,"15min":0.39600000000000002},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1830000000000001,"15min":1.109},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.44800000000000001},"max":{"1min":1.581,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.232,"15min":1.163},"min":{"1min":0.80900000000000005,"5min":0.66800000000000004,"15min":0.66500000000000004},"max":{"1min":1.778,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.405},{"interface":"front","average":{"1min":1.139,"5min":1.2190000000000001,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.458,"5min":8.0830000000000002,"15min":8.0830000000000002},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.21,"15min":1.224},"min":{"1min":0.69299999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.948,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":1.258},{"interface":"front","average":{"1min":1.335,"5min":1.327,"15min":1.2629999999999999},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.497},"max":{"1min":1.8660000000000001,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.2030000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.284,"15min":1.23},"min":{"1min":1.056,"5min":0.433,"15min":0.433},"max":{"1min":2.081,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":0.97099999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.266,"5min":6.069,"15min":6.069},"last":1.5780000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.329,"15min":1.26},"min":{"1min":0.89800000000000002,"5min":0.56499999999999995,"15min":0.49099999999999999},"max":{"1min":2.2080000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":1.081},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.292},"min":{"1min":0.83099999999999996,"5min":0.54400000000000004,"15min":0.52600000000000002},"max":{"1min":1.72,"5min":7.4950000000000001,"15min":7.4950000000000001},"last":1.133}]},{"osd":5,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.522,"15min":1.4650000000000001},"min":{"1min":0.872,"5min":0.67600000000000005,"15min":0.59699999999999998},"max":{"1min":2.0670000000000002,"5min":6.0090000000000003,"15min":6.0090000000000003},"last":1.468},{"interface":"front","average":{"1min":1.512,"5min":1.5129999999999999,"15min":1.5029999999999999},"min":{"1min":0.97299999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.056,"5min":7.5529999999999999,"15min":7.5529999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.633,"15min":1.593},"min":{"1min":1.042,"5min":0.61299999999999999,"15min":0.58599999999999997},"max":{"1min":2.2829999999999999,"5min":8.859,"15min":8.859},"last":1.631},{"interface":"front","average":{"1min":1.508,"5min":1.532,"15min":1.51},"min":{"1min":0.93100000000000005,"5min":0.62,"15min":0.62},"max":{"1min":2.3050000000000002,"5min":7.1139999999999999,"15min":7.1139999999999999},"last":1.3149999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.754,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.468,"5min":1.75,"15min":1.7509999999999999},"last":0.879},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.111,"15min":1.0169999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.5820000000000001,"5min":1.659,"15min":1.659},"last":1.405}]},{"osd":1,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1080000000000001,"15min":1.071},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"max":{"1min":1.4199999999999999,"5min":2.302,"15min":2.302},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.24,"15min":1.1830000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.194,"15min":1.141},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.476,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.268,"15min":1.232},"min":{"1min":0.80900000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5800000000000001,"5min":1.968,"15min":1.968},"last":1.01}]},{"osd":3,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.343,"15min":1.2310000000000001},"min":{"1min":0.99399999999999999,"5min":0.80700000000000005,"15min":0.69399999999999995},"max":{"1min":1.6279999999999999,"5min":3.177,"15min":3.177},"last":1.329},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.306,"15min":1.262},"min":{"1min":0.749,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.718,"5min":2.395,"15min":2.395},"last":1.5249999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.71699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6479999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.163},{"interface":"front","average":{"1min":1.446,"5min":1.484,"15min":1.4239999999999999},"min":{"1min":1.0720000000000001,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":1.9670000000000001,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.444,"15min":1.411},"min":{"1min":0.76700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.8200000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.306},{"interface":"front","average":{"1min":1.466,"5min":1.5680000000000001,"15min":1.4990000000000001},"min":{"1min":1.0660000000000001,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":1.867,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.216}]},{"osd":7,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.4079999999999999,"15min":1.3680000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7869999999999999,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.254},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.546,"15min":1.4910000000000001},"min":{"1min":0.86299999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8500000000000001,"5min":2.5819999999999999,"15min":2.698},"last":1.367}]}]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194399,"statfs":{"total":200000000,"available":199064588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.093},"min":{"1min":0.65600000000000003,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.581,"15min":2.5070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.776,"5min":1.8069999999999999,"15min":32.941000000000003},"last":1.833}]},{"osd":1,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1910000000000001,"15min":1.212},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5449999999999999,"5min":1.762,"15min":2.2450000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.181,"15min":1.206},"min":{"1min":0.629,"5min":0.62,"15min":0.62},"max":{"1min":1.6419999999999999,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.27}]},{"osd":2,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2270000000000001,"15min":1.3069999999999999},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5980000000000001,"5min":1.857,"15min":4.1980000000000004},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.79800000000000004,"5min":0.69899999999999995,"15min":0.67700000000000005},"max":{"1min":1.4670000000000001,"5min":1.653,"15min":1.73},"last":1.556}]},{"osd":3,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.3,"15min":1.26},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.3200000000000001,"15min":1.359},"min":{"1min":0.95699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8120000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.518}]},{"osd":4,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.2529999999999999,"15min":1.292},"min":{"1min":0.88200000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.8969999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.488},{"interface":"front","average":{"1min":1.351,"5min":1.375,"15min":1.3600000000000001},"min":{"1min":0.85899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.893,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.6000000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.405,"15min":1.3340000000000001},"min":{"1min":1.046,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.04,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.4119999999999999,"15min":1.395},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":1.6910000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.5029999999999999,"15min":1.4890000000000001},"min":{"1min":0.96099999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.738},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.516,"15min":1.494},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.956,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.6539999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":914,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194398,"statfs":{"total":200000000,"available":199063591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.165,"15min":1.1359999999999999},"min":{"1min":0.749,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":1.46,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.157},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2130000000000001,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.907,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.133}]},{"osd":1,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.2769999999999999},"min":{"1min":0.78400000000000003,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.5760000000000001,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.159,"15min":1.139},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.252,"15min":1.165},"min":{"1min":0.77400000000000002,"5min":0.75,"15min":0.621},"max":{"1min":1.6990000000000001,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3720000000000001,"15min":1.304},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.70499999999999996},"max":{"1min":1.7989999999999999,"5min":4.226,"15min":4.226},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2989999999999999,"15min":1.2529999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7250000000000001,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.323},{"interface":"front","average":{"1min":1.24,"5min":1.373,"15min":1.29},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.67000000000000004},"max":{"1min":1.633,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.448}]},{"osd":5,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.363,"15min":1.3560000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.651,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3160000000000001,"15min":1.2929999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42399999999999999},"max":{"1min":1.7390000000000001,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.204}]},{"osd":6,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.367,"15min":1.3280000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.577,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.371},{"interface":"front","average":{"1min":1.411,"5min":1.5309999999999999,"15min":1.476},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.992,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.93100000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4870000000000001,"15min":1.4319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.57999999999999996},"max":{"1min":2.1099999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.573,"15min":1.514},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.901,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.526}]}]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.92600000000000005,"15min":0.85599999999999998},"min":{"1min":0.59199999999999997,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.3140000000000001,"5min":1.629,"15min":2.1019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.55500000000000005,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.5529999999999999,"5min":1.9590000000000001,"15min":2.4470000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94499999999999995,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.4430000000000001,"5min":1.5549999999999999,"15min":1.6599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.0840000000000001,"15min":0.96699999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.34100000000000003},"max":{"1min":1.6519999999999999,"5min":1.752,"15min":1.897},"last":0.497}]},{"osd":2,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":0.96399999999999997},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.496,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1830000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.46899999999999997},"max":{"1min":1.5880000000000001,"5min":1.958,"15min":2.0430000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.421,"15min":1.278},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.70599999999999996},"max":{"1min":1.6319999999999999,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2729999999999999,"15min":1.2150000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.71399999999999997},"max":{"1min":2.0390000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4059999999999999,"15min":1.3420000000000001},"min":{"1min":0.91100000000000003,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.125},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.46,"5min":1.444,"15min":1.3779999999999999},"min":{"1min":0.81399999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.98,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.385,"15min":1.296},"min":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.911,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4630000000000001,"15min":1.413},"min":{"1min":0.93799999999999994,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.1539999999999999},"last":0.749}]},{"osd":7,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5189999999999999,"15min":1.446},"min":{"1min":0.86099999999999999,"5min":0.81699999999999995,"15min":0.754},"max":{"1min":2.198,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.54,"5min":1.4359999999999999,"15min":1.3620000000000001},"min":{"1min":1.04,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0459999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.81399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.42199999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0169999999999999,"5min":1.464,"15min":1.5209999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95199999999999996,"15min":0.90700000000000003},"min":{"1min":0.49099999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.607,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.095,"15min":1.0509999999999999},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8009999999999999,"15min":1.9630000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.1850000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.548,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.1870000000000001,"15min":1.2190000000000001},"min":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.575,"5min":1.863,"15min":3.6920000000000002},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3720000000000001,"15min":1.399},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7470000000000001,"5min":2.415,"15min":2.6000000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3100000000000001},"min":{"1min":0.92900000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.9339999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.298,"15min":1.2689999999999999},"min":{"1min":0.84899999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.764,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.458,"15min":1.462},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9870000000000001,"5min":3.294,"15min":3.294},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.446,"15min":1.391},"min":{"1min":0.88900000000000001,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":1.798,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.399,"15min":1.3540000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.833,"5min":2.444,"15min":2.444},"last":1.04}]},{"osd":7,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.5189999999999999,"15min":1.4279999999999999},"min":{"1min":0.996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0430000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.115},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4219999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0950000000000002,"5min":2.556,"15min":2.556},"last":1.135}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":914,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199063521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.89000000000000001,"15min":0.83899999999999997},"min":{"1min":0.441,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.343,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97999999999999998,"15min":0.94399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2649999999999999,"5min":2.012,"15min":2.246},"last":1.4019999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.03,"15min":0.91500000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5660000000000001,"5min":1.792,"15min":2.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":1.171,"5min":1.2210000000000001,"15min":1.097},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.7130000000000001,"5min":1.7589999999999999,"15min":2.423},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.194,"15min":1.0820000000000001},"min":{"1min":0.63100000000000001,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.5960000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.099,"15min":1.0449999999999999},"min":{"1min":0.61199999999999999,"5min":0.48899999999999999,"15min":0.42399999999999999},"max":{"1min":1.728,"5min":1.8,"15min":2.8940000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.26,"15min":1.1899999999999999},"min":{"1min":0.93000000000000005,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":1.597,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.054},{"interface":"front","average":{"1min":1.365,"5min":1.468,"15min":1.3999999999999999},"min":{"1min":0.83299999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.78,"5min":2.343,"15min":2.343},"last":1.45}]},{"osd":5,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.423,"15min":1.375},"min":{"1min":1.0900000000000001,"5min":0.93100000000000005,"15min":0.67900000000000005},"max":{"1min":1.6160000000000001,"5min":1.98,"15min":2.9969999999999999},"last":1.288},{"interface":"front","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.94599999999999995,"15min":0.71699999999999997},"max":{"1min":1.788,"5min":2.387,"15min":2.73},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4410000000000001,"15min":1.375},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.78400000000000003},"max":{"1min":2.0299999999999998,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.413,"15min":1.294},"min":{"1min":1.0289999999999999,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":1.958,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.5009999999999999,"15min":1.444},"min":{"1min":0.81100000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.833,"5min":2.4129999999999998,"15min":2.742},"last":1.349},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4970000000000001,"15min":1.4159999999999999},"min":{"1min":0.878,"5min":0.82699999999999996,"15min":0.625},"max":{"1min":1.883,"5min":2.1640000000000001,"15min":2.605},"last":1.599}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.0089999999999999,"15min":0.97499999999999998},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2290000000000001,"5min":8.6899999999999995,"15min":8.6899999999999995},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.165,"15min":1.069},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.4339999999999999,"5min":11.173,"15min":11.173},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":1.02},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.39000000000000001},"max":{"1min":1.387,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.028},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47399999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.012,"15min":0.97299999999999998},"min":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3120000000000001,"5min":4.8570000000000002,"15min":5.9980000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.2729999999999999,"15min":1.1579999999999999},"min":{"1min":0.65400000000000003,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.7509999999999999,"5min":10.739000000000001,"15min":10.739000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3660000000000001,"15min":1.306},"min":{"1min":0.95199999999999996,"5min":0.88800000000000001,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":4.6980000000000004,"15min":6.5209999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4239999999999999},"min":{"1min":1.0820000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.885,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3959999999999999,"15min":1.373},"min":{"1min":0.91000000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.831,"5min":1.948,"15min":1.986},"last":1.359},{"interface":"front","average":{"1min":1.216,"5min":1.3999999999999999,"15min":1.3799999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":7.532,"15min":16.058},"last":1.397}]},{"osd":6,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.46,"15min":1.4530000000000001},"min":{"1min":0.96099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.004,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.452,"15min":1.4330000000000001},"min":{"1min":0.86499999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.998,"5min":2.3359999999999999,"15min":3.2240000000000002},"last":1.431}]},{"osd":7,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.5,"15min":1.518},"min":{"1min":1.024,"5min":0.76500000000000001,"15min":0.752},"max":{"1min":1.825,"5min":2.4460000000000002,"15min":3.3330000000000002},"last":1.508},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.468,"15min":1.4379999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7809999999999999,"5min":4.9939999999999998,"15min":6.5670000000000002},"last":1.175}]}]}],"pool_statfs":[]}} 2023-08-10T10:47:32.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:47:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.883+0000 7fc39916b640 1 Processor -- start 2023-08-10T10:47:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.883+0000 7fc39916b640 1 -- start start 2023-08-10T10:47:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39916b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3940b3f30 0x7fc3940ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39916b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc394071c70 con 0x7fc3940b0c60 2023-08-10T10:47:32.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39916b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940713d0 con 0x7fc39415aa40 2023-08-10T10:47:32.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39916b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940716b0 con 0x7fc3940b3f30 2023-08-10T10:47:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3940b0c60 0x7fc3940c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46074/0 (socket says 172.21.15.50:46074) 2023-08-10T10:47:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.885+0000 7fc39259c640 1 -- 172.21.15.50:0/1340442594 learned_addr learned my addr 172.21.15.50:0/1340442594 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc39359e640 1 --2- 172.21.15.50:0/1340442594 >> v2:172.21.15.117:3300/0 conn(0x7fc3940b3f30 0x7fc3940ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705580597 0 0) 0x7fc394071c70 con 0x7fc3940b0c60 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc37c003520 con 0x7fc3940b0c60 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903041110 0 0) 0x7fc37c003520 con 0x7fc3940b0c60 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 >> v2:172.21.15.117:3300/0 conn(0x7fc3940b3f30 msgr2=0x7fc3940ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 --2- 172.21.15.50:0/1340442594 >> v2:172.21.15.117:3300/0 conn(0x7fc3940b3f30 0x7fc3940ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 >> v1:172.21.15.117:6789/0 conn(0x7fc39415aa40 legacy=0x7fc3940b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394071990 con 0x7fc3940b0c60 2023-08-10T10:47:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fc388001670 con 0x7fc3940b0c60 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 >> v1:172.21.15.50:6789/0 conn(0x7fc3940b0c60 legacy=0x7fc3940c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc37c003970 0x7fc37c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0047c0 0x7fc37c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 0x7fc37c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940716b0 con 0x7fc37c0052a0 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c00c170 con 0x7fc37c0047c0 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.886+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c00c330 con 0x7fc37c003970 2023-08-10T10:47:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 0x7fc37c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc392d9d640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc37c003970 0x7fc37c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 -- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc37c003970 msgr2=0x7fc37c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39259c640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0047c0 0x7fc37c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc37c003970 0x7fc37c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 -- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0047c0 msgr2=0x7fc37c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0047c0 0x7fc37c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39359e640 1 -- 172.21.15.50:0/1340442594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c003520 con 0x7fc37c0052a0 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.887+0000 7fc39259c640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0047c0 0x7fc37c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.888+0000 7fc39359e640 1 -- 172.21.15.50:0/1340442594 reap_dead start 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.888+0000 7fc39359e640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 0x7fc37c00b980 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007330 tx=0x7fc37c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f38d9797de3f32 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c02ccd0 con 0x7fc37c0052a0 2023-08-10T10:47:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02ce30 con 0x7fc37c0052a0 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc391d9b640 1 -- 172.21.15.50:0/1340442594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003bd0 con 0x7fc37c0052a0 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 -- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 msgr2=0x7fc37c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 0x7fc37c00b980 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007330 tx=0x7fc37c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 -- 172.21.15.50:0/1340442594 shutdown_connections 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 --2- 172.21.15.50:0/1340442594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0052a0 0x7fc37c00b980 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 -- 172.21.15.50:0/1340442594 >> 172.21.15.50:0/1340442594 conn(0x7fc39406b590 msgr2=0x7fc3940ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:32.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.889+0000 7fc39916b640 1 -- 172.21.15.50:0/1340442594 shutdown_connections 2023-08-10T10:47:32.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.890+0000 7fc39916b640 1 -- 172.21.15.50:0/1340442594 wait complete. 2023-08-10T10:47:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.891+0000 7fc39916b640 1 Processor -- start 2023-08-10T10:47:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.892+0000 7fc39916b640 1 -- start start 2023-08-10T10:47:32.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0052a0 0x7fc394151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3940c7fc0 0x7fc3940c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941521b0 con 0x7fc39415ae20 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415b7e0 con 0x7fc37c0052a0 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39916b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941573a0 con 0x7fc3940c7fc0 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49534/0 (socket says 172.21.15.50:49534) 2023-08-10T10:47:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39359e640 1 -- 172.21.15.50:0/1314486490 learned_addr learned my addr 172.21.15.50:0/1314486490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc392d9d640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0052a0 0x7fc394151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39259c640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3940c7fc0 0x7fc3940c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.893+0000 7fc39359e640 1 -- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3940c7fc0 msgr2=0x7fc3940c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39359e640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3940c7fc0 0x7fc3940c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39359e640 1 -- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0052a0 msgr2=0x7fc394151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39359e640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0052a0 0x7fc394151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39359e640 1 -- 172.21.15.50:0/1314486490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940c6aa0 con 0x7fc39415ae20 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39359e640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007450 tx=0x7fc38c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004550 con 0x7fc39415ae20 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0046d0 con 0x7fc39415ae20 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c034680 con 0x7fc39415ae20 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.894+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940c6d80 con 0x7fc39415ae20 2023-08-10T10:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.895+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394157640 con 0x7fc39415ae20 2023-08-10T10:47:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.896+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940c72a0 con 0x7fc39415ae20 2023-08-10T10:47:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.897+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc38c03b070 con 0x7fc39415ae20 2023-08-10T10:47:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.898+0000 7fc37b7fe640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 0x7fc38006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.898+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc38c0aac80 con 0x7fc39415ae20 2023-08-10T10:47:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.898+0000 7fc392d9d640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 0x7fc38006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.899+0000 7fc392d9d640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 0x7fc38006d110 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:32.902+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc3940c72a0 con 0x7fc39415ae20 2023-08-10T10:47:33.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.090+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3940663d0 con 0x7fc38006ac50 2023-08-10T10:47:33.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.103+0000 7fc37b7fe640 1 -- 172.21.15.50:0/1314486490 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302798 (secure 0 0 0) 0x7fc3940663d0 con 0x7fc38006ac50 2023-08-10T10:47:33.109 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:33.111 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:47:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.109+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 msgr2=0x7fc38006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.109+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 0x7fc38006d110 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384009040 comp rx=0 tx=0).stop 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.109+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 msgr2=0x7fc39415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.109+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007450 tx=0x7fc38c004ab0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 shutdown_connections 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc39415ae20 0x7fc39415b2a0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3940c7fc0 0x7fc3940c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc38006ac50 0x7fc38006d110 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 --2- 172.21.15.50:0/1314486490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc37c0052a0 0x7fc394151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 >> 172.21.15.50:0/1314486490 conn(0x7fc39406b590 msgr2=0x7fc3940c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 shutdown_connections 2023-08-10T10:47:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.110+0000 7fc39916b640 1 -- 172.21.15.50:0/1314486490 wait complete. 2023-08-10T10:47:33.130 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2023-08-10T10:47:32.509911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8440,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554059,"statfs":{"total":1600000000,"available":1591356796,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001888"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076389+0000","last_change":"2023-08-10T10:47:28.076001+0000","last_active":"2023-08-10T10:47:28.076389+0000","last_peered":"2023-08-10T10:47:28.076389+0000","last_clean":"2023-08-10T10:47:28.076389+0000","last_became_active":"2023-08-10T10:47:28.075296+0000","last_became_peered":"2023-08-10T10:47:28.075296+0000","last_unstale":"2023-08-10T10:47:28.076389+0000","last_undegraded":"2023-08-10T10:47:28.076389+0000","last_fullsized":"2023-08-10T10:47:28.076389+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:23.380177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.063854+0000","last_change":"2023-08-10T10:47:28.063662+0000","last_active":"2023-08-10T10:47:28.063854+0000","last_peered":"2023-08-10T10:47:28.063854+0000","last_clean":"2023-08-10T10:47:28.063854+0000","last_became_active":"2023-08-10T10:47:28.063009+0000","last_became_peered":"2023-08-10T10:47:28.063009+0000","last_unstale":"2023-08-10T10:47:28.063854+0000","last_undegraded":"2023-08-10T10:47:28.063854+0000","last_fullsized":"2023-08-10T10:47:28.063854+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:05.447507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.090078+0000","last_change":"2023-08-10T10:47:28.090010+0000","last_active":"2023-08-10T10:47:28.090078+0000","last_peered":"2023-08-10T10:47:28.090078+0000","last_clean":"2023-08-10T10:47:28.090078+0000","last_became_active":"2023-08-10T10:47:28.088415+0000","last_became_peered":"2023-08-10T10:47:28.088415+0000","last_unstale":"2023-08-10T10:47:28.090078+0000","last_undegraded":"2023-08-10T10:47:28.090078+0000","last_fullsized":"2023-08-10T10:47:28.090078+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:42:09.203210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083692+0000","last_change":"2023-08-10T10:47:28.083528+0000","last_active":"2023-08-10T10:47:28.083692+0000","last_peered":"2023-08-10T10:47:28.083692+0000","last_clean":"2023-08-10T10:47:28.083692+0000","last_became_active":"2023-08-10T10:47:28.081641+0000","last_became_peered":"2023-08-10T10:47:28.081641+0000","last_unstale":"2023-08-10T10:47:28.083692+0000","last_undegraded":"2023-08-10T10:47:28.083692+0000","last_fullsized":"2023-08-10T10:47:28.083692+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:05:46.612424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077639+0000","last_change":"2023-08-10T10:47:28.076827+0000","last_active":"2023-08-10T10:47:28.077639+0000","last_peered":"2023-08-10T10:47:28.077639+0000","last_clean":"2023-08-10T10:47:28.077639+0000","last_became_active":"2023-08-10T10:47:28.072614+0000","last_became_peered":"2023-08-10T10:47:28.072614+0000","last_unstale":"2023-08-10T10:47:28.077639+0000","last_undegraded":"2023-08-10T10:47:28.077639+0000","last_fullsized":"2023-08-10T10:47:28.077639+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:56.622415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080104+0000","last_change":"2023-08-10T10:47:28.079976+0000","last_active":"2023-08-10T10:47:28.080104+0000","last_peered":"2023-08-10T10:47:28.080104+0000","last_clean":"2023-08-10T10:47:28.080104+0000","last_became_active":"2023-08-10T10:47:28.079424+0000","last_became_peered":"2023-08-10T10:47:28.079424+0000","last_unstale":"2023-08-10T10:47:28.080104+0000","last_undegraded":"2023-08-10T10:47:28.080104+0000","last_fullsized":"2023-08-10T10:47:28.080104+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:37:34.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077525+0000","last_change":"2023-08-10T10:47:28.075910+0000","last_active":"2023-08-10T10:47:28.077525+0000","last_peered":"2023-08-10T10:47:28.077525+0000","last_clean":"2023-08-10T10:47:28.077525+0000","last_became_active":"2023-08-10T10:47:28.074957+0000","last_became_peered":"2023-08-10T10:47:28.074957+0000","last_unstale":"2023-08-10T10:47:28.077525+0000","last_undegraded":"2023-08-10T10:47:28.077525+0000","last_fullsized":"2023-08-10T10:47:28.077525+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:07:19.484873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076341+0000","last_change":"2023-08-10T10:47:28.076176+0000","last_active":"2023-08-10T10:47:28.076341+0000","last_peered":"2023-08-10T10:47:28.076341+0000","last_clean":"2023-08-10T10:47:28.076341+0000","last_became_active":"2023-08-10T10:47:28.075830+0000","last_became_peered":"2023-08-10T10:47:28.075830+0000","last_unstale":"2023-08-10T10:47:28.076341+0000","last_undegraded":"2023-08-10T10:47:28.076341+0000","last_fullsized":"2023-08-10T10:47:28.076341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:53.965073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077320+0000","last_change":"2023-08-10T10:47:28.069483+0000","last_active":"2023-08-10T10:47:28.077320+0000","last_peered":"2023-08-10T10:47:28.077320+0000","last_clean":"2023-08-10T10:47:28.077320+0000","last_became_active":"2023-08-10T10:47:28.068612+0000","last_became_peered":"2023-08-10T10:47:28.068612+0000","last_unstale":"2023-08-10T10:47:28.077320+0000","last_undegraded":"2023-08-10T10:47:28.077320+0000","last_fullsized":"2023-08-10T10:47:28.077320+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:21.523566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078596+0000","last_change":"2023-08-10T10:47:28.078385+0000","last_active":"2023-08-10T10:47:28.078596+0000","last_peered":"2023-08-10T10:47:28.078596+0000","last_clean":"2023-08-10T10:47:28.078596+0000","last_became_active":"2023-08-10T10:47:28.077972+0000","last_became_peered":"2023-08-10T10:47:28.077972+0000","last_unstale":"2023-08-10T10:47:28.078596+0000","last_undegraded":"2023-08-10T10:47:28.078596+0000","last_fullsized":"2023-08-10T10:47:28.078596+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:29.105516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077224+0000","last_change":"2023-08-10T10:47:28.076682+0000","last_active":"2023-08-10T10:47:28.077224+0000","last_peered":"2023-08-10T10:47:28.077224+0000","last_clean":"2023-08-10T10:47:28.077224+0000","last_became_active":"2023-08-10T10:47:28.076328+0000","last_became_peered":"2023-08-10T10:47:28.076328+0000","last_unstale":"2023-08-10T10:47:28.077224+0000","last_undegraded":"2023-08-10T10:47:28.077224+0000","last_fullsized":"2023-08-10T10:47:28.077224+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:17:52.334738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081711+0000","last_change":"2023-08-10T10:47:28.081600+0000","last_active":"2023-08-10T10:47:28.081711+0000","last_peered":"2023-08-10T10:47:28.081711+0000","last_clean":"2023-08-10T10:47:28.081711+0000","last_became_active":"2023-08-10T10:47:28.080024+0000","last_became_peered":"2023-08-10T10:47:28.080024+0000","last_unstale":"2023-08-10T10:47:28.081711+0000","last_undegraded":"2023-08-10T10:47:28.081711+0000","last_fullsized":"2023-08-10T10:47:28.081711+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:23.672829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088143+0000","last_change":"2023-08-10T10:47:28.088038+0000","last_active":"2023-08-10T10:47:28.088143+0000","last_peered":"2023-08-10T10:47:28.088143+0000","last_clean":"2023-08-10T10:47:28.088143+0000","last_became_active":"2023-08-10T10:47:28.086968+0000","last_became_peered":"2023-08-10T10:47:28.086968+0000","last_unstale":"2023-08-10T10:47:28.088143+0000","last_undegraded":"2023-08-10T10:47:28.088143+0000","last_fullsized":"2023-08-10T10:47:28.088143+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:51.860796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078743+0000","last_change":"2023-08-10T10:47:28.078664+0000","last_active":"2023-08-10T10:47:28.078743+0000","last_peered":"2023-08-10T10:47:28.078743+0000","last_clean":"2023-08-10T10:47:28.078743+0000","last_became_active":"2023-08-10T10:47:28.078216+0000","last_became_peered":"2023-08-10T10:47:28.078216+0000","last_unstale":"2023-08-10T10:47:28.078743+0000","last_undegraded":"2023-08-10T10:47:28.078743+0000","last_fullsized":"2023-08-10T10:47:28.078743+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:57:39.723321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076367+0000","last_change":"2023-08-10T10:47:28.075493+0000","last_active":"2023-08-10T10:47:28.076367+0000","last_peered":"2023-08-10T10:47:28.076367+0000","last_clean":"2023-08-10T10:47:28.076367+0000","last_became_active":"2023-08-10T10:47:28.075073+0000","last_became_peered":"2023-08-10T10:47:28.075073+0000","last_unstale":"2023-08-10T10:47:28.076367+0000","last_undegraded":"2023-08-10T10:47:28.076367+0000","last_fullsized":"2023-08-10T10:47:28.076367+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:49.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080233+0000","last_change":"2023-08-10T10:47:28.080129+0000","last_active":"2023-08-10T10:47:28.080233+0000","last_peered":"2023-08-10T10:47:28.080233+0000","last_clean":"2023-08-10T10:47:28.080233+0000","last_became_active":"2023-08-10T10:47:28.079732+0000","last_became_peered":"2023-08-10T10:47:28.079732+0000","last_unstale":"2023-08-10T10:47:28.080233+0000","last_undegraded":"2023-08-10T10:47:28.080233+0000","last_fullsized":"2023-08-10T10:47:28.080233+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:49.374507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077403+0000","last_change":"2023-08-10T10:47:28.071762+0000","last_active":"2023-08-10T10:47:28.077403+0000","last_peered":"2023-08-10T10:47:28.077403+0000","last_clean":"2023-08-10T10:47:28.077403+0000","last_became_active":"2023-08-10T10:47:28.071358+0000","last_became_peered":"2023-08-10T10:47:28.071358+0000","last_unstale":"2023-08-10T10:47:28.077403+0000","last_undegraded":"2023-08-10T10:47:28.077403+0000","last_fullsized":"2023-08-10T10:47:28.077403+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:48.817084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065132+0000","last_change":"2023-08-10T10:47:28.064951+0000","last_active":"2023-08-10T10:47:28.065132+0000","last_peered":"2023-08-10T10:47:28.065132+0000","last_clean":"2023-08-10T10:47:28.065132+0000","last_became_active":"2023-08-10T10:47:28.064237+0000","last_became_peered":"2023-08-10T10:47:28.064237+0000","last_unstale":"2023-08-10T10:47:28.065132+0000","last_undegraded":"2023-08-10T10:47:28.065132+0000","last_fullsized":"2023-08-10T10:47:28.065132+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:30.600523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077137+0000","last_change":"2023-08-10T10:47:28.075405+0000","last_active":"2023-08-10T10:47:28.077137+0000","last_peered":"2023-08-10T10:47:28.077137+0000","last_clean":"2023-08-10T10:47:28.077137+0000","last_became_active":"2023-08-10T10:47:28.073098+0000","last_became_peered":"2023-08-10T10:47:28.073098+0000","last_unstale":"2023-08-10T10:47:28.077137+0000","last_undegraded":"2023-08-10T10:47:28.077137+0000","last_fullsized":"2023-08-10T10:47:28.077137+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:49.413358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069720+0000","last_change":"2023-08-10T10:47:28.068069+0000","last_active":"2023-08-10T10:47:28.069720+0000","last_peered":"2023-08-10T10:47:28.069720+0000","last_clean":"2023-08-10T10:47:28.069720+0000","last_became_active":"2023-08-10T10:47:28.067829+0000","last_became_peered":"2023-08-10T10:47:28.067829+0000","last_unstale":"2023-08-10T10:47:28.069720+0000","last_undegraded":"2023-08-10T10:47:28.069720+0000","last_fullsized":"2023-08-10T10:47:28.069720+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:42.686067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.074823+0000","last_change":"2023-08-10T10:47:28.074710+0000","last_active":"2023-08-10T10:47:28.074823+0000","last_peered":"2023-08-10T10:47:28.074823+0000","last_clean":"2023-08-10T10:47:28.074823+0000","last_became_active":"2023-08-10T10:47:28.071404+0000","last_became_peered":"2023-08-10T10:47:28.071404+0000","last_unstale":"2023-08-10T10:47:28.074823+0000","last_undegraded":"2023-08-10T10:47:28.074823+0000","last_fullsized":"2023-08-10T10:47:28.074823+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:56.712282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081374+0000","last_change":"2023-08-10T10:47:28.080640+0000","last_active":"2023-08-10T10:47:28.081374+0000","last_peered":"2023-08-10T10:47:28.081374+0000","last_clean":"2023-08-10T10:47:28.081374+0000","last_became_active":"2023-08-10T10:47:28.079680+0000","last_became_peered":"2023-08-10T10:47:28.079680+0000","last_unstale":"2023-08-10T10:47:28.081374+0000","last_undegraded":"2023-08-10T10:47:28.081374+0000","last_fullsized":"2023-08-10T10:47:28.081374+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:04:52.812777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.073774+0000","last_change":"2023-08-10T10:47:28.073531+0000","last_active":"2023-08-10T10:47:28.073774+0000","last_peered":"2023-08-10T10:47:28.073774+0000","last_clean":"2023-08-10T10:47:28.073774+0000","last_became_active":"2023-08-10T10:47:28.072671+0000","last_became_peered":"2023-08-10T10:47:28.072671+0000","last_unstale":"2023-08-10T10:47:28.073774+0000","last_undegraded":"2023-08-10T10:47:28.073774+0000","last_fullsized":"2023-08-10T10:47:28.073774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:03.978061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077380+0000","last_change":"2023-08-10T10:47:28.069778+0000","last_active":"2023-08-10T10:47:28.077380+0000","last_peered":"2023-08-10T10:47:28.077380+0000","last_clean":"2023-08-10T10:47:28.077380+0000","last_became_active":"2023-08-10T10:47:28.069090+0000","last_became_peered":"2023-08-10T10:47:28.069090+0000","last_unstale":"2023-08-10T10:47:28.077380+0000","last_undegraded":"2023-08-10T10:47:28.077380+0000","last_fullsized":"2023-08-10T10:47:28.077380+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:43:43.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078719+0000","last_change":"2023-08-10T10:47:28.078649+0000","last_active":"2023-08-10T10:47:28.078719+0000","last_peered":"2023-08-10T10:47:28.078719+0000","last_clean":"2023-08-10T10:47:28.078719+0000","last_became_active":"2023-08-10T10:47:28.078251+0000","last_became_peered":"2023-08-10T10:47:28.078251+0000","last_unstale":"2023-08-10T10:47:28.078719+0000","last_undegraded":"2023-08-10T10:47:28.078719+0000","last_fullsized":"2023-08-10T10:47:28.078719+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:46.777805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077218+0000","last_change":"2023-08-10T10:47:28.077135+0000","last_active":"2023-08-10T10:47:28.077218+0000","last_peered":"2023-08-10T10:47:28.077218+0000","last_clean":"2023-08-10T10:47:28.077218+0000","last_became_active":"2023-08-10T10:47:28.076860+0000","last_became_peered":"2023-08-10T10:47:28.076860+0000","last_unstale":"2023-08-10T10:47:28.077218+0000","last_undegraded":"2023-08-10T10:47:28.077218+0000","last_fullsized":"2023-08-10T10:47:28.077218+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:39.257543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088243+0000","last_change":"2023-08-10T10:47:28.088141+0000","last_active":"2023-08-10T10:47:28.088243+0000","last_peered":"2023-08-10T10:47:28.088243+0000","last_clean":"2023-08-10T10:47:28.088243+0000","last_became_active":"2023-08-10T10:47:28.085201+0000","last_became_peered":"2023-08-10T10:47:28.085201+0000","last_unstale":"2023-08-10T10:47:28.088243+0000","last_undegraded":"2023-08-10T10:47:28.088243+0000","last_fullsized":"2023-08-10T10:47:28.088243+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:24.945585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080284+0000","last_change":"2023-08-10T10:47:28.080015+0000","last_active":"2023-08-10T10:47:28.080284+0000","last_peered":"2023-08-10T10:47:28.080284+0000","last_clean":"2023-08-10T10:47:28.080284+0000","last_became_active":"2023-08-10T10:47:28.079430+0000","last_became_peered":"2023-08-10T10:47:28.079430+0000","last_unstale":"2023-08-10T10:47:28.080284+0000","last_undegraded":"2023-08-10T10:47:28.080284+0000","last_fullsized":"2023-08-10T10:47:28.080284+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:21:02.694403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085306+0000","last_change":"2023-08-10T10:47:28.085235+0000","last_active":"2023-08-10T10:47:28.085306+0000","last_peered":"2023-08-10T10:47:28.085306+0000","last_clean":"2023-08-10T10:47:28.085306+0000","last_became_active":"2023-08-10T10:47:28.084993+0000","last_became_peered":"2023-08-10T10:47:28.084993+0000","last_unstale":"2023-08-10T10:47:28.085306+0000","last_undegraded":"2023-08-10T10:47:28.085306+0000","last_fullsized":"2023-08-10T10:47:28.085306+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:58.363531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078562+0000","last_change":"2023-08-10T10:47:28.078486+0000","last_active":"2023-08-10T10:47:28.078562+0000","last_peered":"2023-08-10T10:47:28.078562+0000","last_clean":"2023-08-10T10:47:28.078562+0000","last_became_active":"2023-08-10T10:47:28.077909+0000","last_became_peered":"2023-08-10T10:47:28.077909+0000","last_unstale":"2023-08-10T10:47:28.078562+0000","last_undegraded":"2023-08-10T10:47:28.078562+0000","last_fullsized":"2023-08-10T10:47:28.078562+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:32.095239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070933+0000","last_change":"2023-08-10T10:47:28.070799+0000","last_active":"2023-08-10T10:47:28.070933+0000","last_peered":"2023-08-10T10:47:28.070933+0000","last_clean":"2023-08-10T10:47:28.070933+0000","last_became_active":"2023-08-10T10:47:28.069229+0000","last_became_peered":"2023-08-10T10:47:28.069229+0000","last_unstale":"2023-08-10T10:47:28.070933+0000","last_undegraded":"2023-08-10T10:47:28.070933+0000","last_fullsized":"2023-08-10T10:47:28.070933+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:37.449649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.082120+0000","last_change":"2023-08-10T10:47:28.082042+0000","last_active":"2023-08-10T10:47:28.082120+0000","last_peered":"2023-08-10T10:47:28.082120+0000","last_clean":"2023-08-10T10:47:28.082120+0000","last_became_active":"2023-08-10T10:47:28.081794+0000","last_became_peered":"2023-08-10T10:47:28.081794+0000","last_unstale":"2023-08-10T10:47:28.082120+0000","last_undegraded":"2023-08-10T10:47:28.082120+0000","last_fullsized":"2023-08-10T10:47:28.082120+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:36.990476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081193+0000","last_change":"2023-08-10T10:47:28.076975+0000","last_active":"2023-08-10T10:47:28.081193+0000","last_peered":"2023-08-10T10:47:28.081193+0000","last_clean":"2023-08-10T10:47:28.081193+0000","last_became_active":"2023-08-10T10:47:28.076147+0000","last_became_peered":"2023-08-10T10:47:28.076147+0000","last_unstale":"2023-08-10T10:47:28.081193+0000","last_undegraded":"2023-08-10T10:47:28.081193+0000","last_fullsized":"2023-08-10T10:47:28.081193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:00.685104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.091024+0000","last_change":"2023-08-10T10:47:27.076917+0000","last_active":"2023-08-10T10:47:28.091024+0000","last_peered":"2023-08-10T10:47:28.091024+0000","last_clean":"2023-08-10T10:47:28.091024+0000","last_became_active":"2023-08-10T10:47:27.076060+0000","last_became_peered":"2023-08-10T10:47:27.076060+0000","last_unstale":"2023-08-10T10:47:28.091024+0000","last_undegraded":"2023-08-10T10:47:28.091024+0000","last_fullsized":"2023-08-10T10:47:28.091024+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:07:18.815690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085680+0000","last_change":"2023-08-10T10:47:28.085594+0000","last_active":"2023-08-10T10:47:28.085680+0000","last_peered":"2023-08-10T10:47:28.085680+0000","last_clean":"2023-08-10T10:47:28.085680+0000","last_became_active":"2023-08-10T10:47:28.085280+0000","last_became_peered":"2023-08-10T10:47:28.085280+0000","last_unstale":"2023-08-10T10:47:28.085680+0000","last_undegraded":"2023-08-10T10:47:28.085680+0000","last_fullsized":"2023-08-10T10:47:28.085680+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:40.643021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085785+0000","last_change":"2023-08-10T10:47:27.074613+0000","last_active":"2023-08-10T10:47:28.085785+0000","last_peered":"2023-08-10T10:47:28.085785+0000","last_clean":"2023-08-10T10:47:28.085785+0000","last_became_active":"2023-08-10T10:47:27.074342+0000","last_became_peered":"2023-08-10T10:47:27.074342+0000","last_unstale":"2023-08-10T10:47:28.085785+0000","last_undegraded":"2023-08-10T10:47:28.085785+0000","last_fullsized":"2023-08-10T10:47:28.085785+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:47:13.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.073999+0000","last_change":"2023-08-10T10:47:28.073873+0000","last_active":"2023-08-10T10:47:28.073999+0000","last_peered":"2023-08-10T10:47:28.073999+0000","last_clean":"2023-08-10T10:47:28.073999+0000","last_became_active":"2023-08-10T10:47:28.073147+0000","last_became_peered":"2023-08-10T10:47:28.073147+0000","last_unstale":"2023-08-10T10:47:28.073999+0000","last_undegraded":"2023-08-10T10:47:28.073999+0000","last_fullsized":"2023-08-10T10:47:28.073999+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:12.489692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088486+0000","last_change":"2023-08-10T10:47:27.072152+0000","last_active":"2023-08-10T10:47:28.088486+0000","last_peered":"2023-08-10T10:47:28.088486+0000","last_clean":"2023-08-10T10:47:28.088486+0000","last_became_active":"2023-08-10T10:47:27.071627+0000","last_became_peered":"2023-08-10T10:47:27.071627+0000","last_unstale":"2023-08-10T10:47:28.088486+0000","last_undegraded":"2023-08-10T10:47:28.088486+0000","last_fullsized":"2023-08-10T10:47:28.088486+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:32.189036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081997+0000","last_change":"2023-08-10T10:47:28.081872+0000","last_active":"2023-08-10T10:47:28.081997+0000","last_peered":"2023-08-10T10:47:28.081997+0000","last_clean":"2023-08-10T10:47:28.081997+0000","last_became_active":"2023-08-10T10:47:28.080390+0000","last_became_peered":"2023-08-10T10:47:28.080390+0000","last_unstale":"2023-08-10T10:47:28.081997+0000","last_undegraded":"2023-08-10T10:47:28.081997+0000","last_fullsized":"2023-08-10T10:47:28.081997+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:26.720518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085003+0000","last_change":"2023-08-10T10:47:27.070371+0000","last_active":"2023-08-10T10:47:28.085003+0000","last_peered":"2023-08-10T10:47:28.085003+0000","last_clean":"2023-08-10T10:47:28.085003+0000","last_became_active":"2023-08-10T10:47:27.070112+0000","last_became_peered":"2023-08-10T10:47:27.070112+0000","last_unstale":"2023-08-10T10:47:28.085003+0000","last_undegraded":"2023-08-10T10:47:28.085003+0000","last_fullsized":"2023-08-10T10:47:28.085003+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:47:45.454250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.071195+0000","last_change":"2023-08-10T10:47:28.071097+0000","last_active":"2023-08-10T10:47:28.071195+0000","last_peered":"2023-08-10T10:47:28.071195+0000","last_clean":"2023-08-10T10:47:28.071195+0000","last_became_active":"2023-08-10T10:47:28.070168+0000","last_became_peered":"2023-08-10T10:47:28.070168+0000","last_unstale":"2023-08-10T10:47:28.071195+0000","last_undegraded":"2023-08-10T10:47:28.071195+0000","last_fullsized":"2023-08-10T10:47:28.071195+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:12:13.640329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083878+0000","last_change":"2023-08-10T10:47:27.071617+0000","last_active":"2023-08-10T10:47:28.083878+0000","last_peered":"2023-08-10T10:47:28.083878+0000","last_clean":"2023-08-10T10:47:28.083878+0000","last_became_active":"2023-08-10T10:47:27.071255+0000","last_became_peered":"2023-08-10T10:47:27.071255+0000","last_unstale":"2023-08-10T10:47:28.083878+0000","last_undegraded":"2023-08-10T10:47:28.083878+0000","last_fullsized":"2023-08-10T10:47:28.083878+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:36.194768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083034+0000","last_change":"2023-08-10T10:47:28.082843+0000","last_active":"2023-08-10T10:47:28.083034+0000","last_peered":"2023-08-10T10:47:28.083034+0000","last_clean":"2023-08-10T10:47:28.083034+0000","last_became_active":"2023-08-10T10:47:28.076520+0000","last_became_peered":"2023-08-10T10:47:28.076520+0000","last_unstale":"2023-08-10T10:47:28.083034+0000","last_undegraded":"2023-08-10T10:47:28.083034+0000","last_fullsized":"2023-08-10T10:47:28.083034+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:58.940557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.086089+0000","last_change":"2023-08-10T10:47:27.059334+0000","last_active":"2023-08-10T10:47:28.086089+0000","last_peered":"2023-08-10T10:47:28.086089+0000","last_clean":"2023-08-10T10:47:28.086089+0000","last_became_active":"2023-08-10T10:47:27.058767+0000","last_became_peered":"2023-08-10T10:47:27.058767+0000","last_unstale":"2023-08-10T10:47:28.086089+0000","last_undegraded":"2023-08-10T10:47:28.086089+0000","last_fullsized":"2023-08-10T10:47:28.086089+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:16:24.450707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069788+0000","last_change":"2023-08-10T10:47:28.069071+0000","last_active":"2023-08-10T10:47:28.069788+0000","last_peered":"2023-08-10T10:47:28.069788+0000","last_clean":"2023-08-10T10:47:28.069788+0000","last_became_active":"2023-08-10T10:47:28.068687+0000","last_became_peered":"2023-08-10T10:47:28.068687+0000","last_unstale":"2023-08-10T10:47:28.069788+0000","last_undegraded":"2023-08-10T10:47:28.069788+0000","last_fullsized":"2023-08-10T10:47:28.069788+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:53.483768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.063088+0000","last_change":"2023-08-10T10:47:27.067095+0000","last_active":"2023-08-10T10:47:28.063088+0000","last_peered":"2023-08-10T10:47:28.063088+0000","last_clean":"2023-08-10T10:47:28.063088+0000","last_became_active":"2023-08-10T10:47:27.066815+0000","last_became_peered":"2023-08-10T10:47:27.066815+0000","last_unstale":"2023-08-10T10:47:28.063088+0000","last_undegraded":"2023-08-10T10:47:28.063088+0000","last_fullsized":"2023-08-10T10:47:28.063088+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:33.935660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080032+0000","last_change":"2023-08-10T10:47:28.079961+0000","last_active":"2023-08-10T10:47:28.080032+0000","last_peered":"2023-08-10T10:47:28.080032+0000","last_clean":"2023-08-10T10:47:28.080032+0000","last_became_active":"2023-08-10T10:47:28.079573+0000","last_became_peered":"2023-08-10T10:47:28.079573+0000","last_unstale":"2023-08-10T10:47:28.080032+0000","last_undegraded":"2023-08-10T10:47:28.080032+0000","last_fullsized":"2023-08-10T10:47:28.080032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:56.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070852+0000","last_change":"2023-08-10T10:47:27.075228+0000","last_active":"2023-08-10T10:47:28.070852+0000","last_peered":"2023-08-10T10:47:28.070852+0000","last_clean":"2023-08-10T10:47:28.070852+0000","last_became_active":"2023-08-10T10:47:27.074160+0000","last_became_peered":"2023-08-10T10:47:27.074160+0000","last_unstale":"2023-08-10T10:47:28.070852+0000","last_undegraded":"2023-08-10T10:47:28.070852+0000","last_fullsized":"2023-08-10T10:47:28.070852+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:00.860963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078132+0000","last_change":"2023-08-10T10:47:28.078059+0000","last_active":"2023-08-10T10:47:28.078132+0000","last_peered":"2023-08-10T10:47:28.078132+0000","last_clean":"2023-08-10T10:47:28.078132+0000","last_became_active":"2023-08-10T10:47:28.077707+0000","last_became_peered":"2023-08-10T10:47:28.077707+0000","last_unstale":"2023-08-10T10:47:28.078132+0000","last_undegraded":"2023-08-10T10:47:28.078132+0000","last_fullsized":"2023-08-10T10:47:28.078132+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:44.357145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089685+0000","last_change":"2023-08-10T10:47:27.073727+0000","last_active":"2023-08-10T10:47:28.089685+0000","last_peered":"2023-08-10T10:47:28.089685+0000","last_clean":"2023-08-10T10:47:28.089685+0000","last_became_active":"2023-08-10T10:47:27.073333+0000","last_became_peered":"2023-08-10T10:47:27.073333+0000","last_unstale":"2023-08-10T10:47:28.089685+0000","last_undegraded":"2023-08-10T10:47:28.089685+0000","last_fullsized":"2023-08-10T10:47:28.089685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:45.805621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075050+0000","last_change":"2023-08-10T10:47:28.074881+0000","last_active":"2023-08-10T10:47:28.075050+0000","last_peered":"2023-08-10T10:47:28.075050+0000","last_clean":"2023-08-10T10:47:28.075050+0000","last_became_active":"2023-08-10T10:47:28.074571+0000","last_became_peered":"2023-08-10T10:47:28.074571+0000","last_unstale":"2023-08-10T10:47:28.075050+0000","last_undegraded":"2023-08-10T10:47:28.075050+0000","last_fullsized":"2023-08-10T10:47:28.075050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:29:53.190724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084271+0000","last_change":"2023-08-10T10:47:27.075780+0000","last_active":"2023-08-10T10:47:28.084271+0000","last_peered":"2023-08-10T10:47:28.084271+0000","last_clean":"2023-08-10T10:47:28.084271+0000","last_became_active":"2023-08-10T10:47:27.074752+0000","last_became_peered":"2023-08-10T10:47:27.074752+0000","last_unstale":"2023-08-10T10:47:28.084271+0000","last_undegraded":"2023-08-10T10:47:28.084271+0000","last_fullsized":"2023-08-10T10:47:28.084271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:41.255143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080539+0000","last_change":"2023-08-10T10:47:28.080207+0000","last_active":"2023-08-10T10:47:28.080539+0000","last_peered":"2023-08-10T10:47:28.080539+0000","last_clean":"2023-08-10T10:47:28.080539+0000","last_became_active":"2023-08-10T10:47:28.079649+0000","last_became_peered":"2023-08-10T10:47:28.079649+0000","last_unstale":"2023-08-10T10:47:28.080539+0000","last_undegraded":"2023-08-10T10:47:28.080539+0000","last_fullsized":"2023-08-10T10:47:28.080539+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:26:09.975027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083964+0000","last_change":"2023-08-10T10:47:27.068663+0000","last_active":"2023-08-10T10:47:28.083964+0000","last_peered":"2023-08-10T10:47:28.083964+0000","last_clean":"2023-08-10T10:47:28.083964+0000","last_became_active":"2023-08-10T10:47:27.068300+0000","last_became_peered":"2023-08-10T10:47:27.068300+0000","last_unstale":"2023-08-10T10:47:28.083964+0000","last_undegraded":"2023-08-10T10:47:28.083964+0000","last_fullsized":"2023-08-10T10:47:28.083964+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:44.244085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088374+0000","last_change":"2023-08-10T10:47:28.088281+0000","last_active":"2023-08-10T10:47:28.088374+0000","last_peered":"2023-08-10T10:47:28.088374+0000","last_clean":"2023-08-10T10:47:28.088374+0000","last_became_active":"2023-08-10T10:47:28.088043+0000","last_became_peered":"2023-08-10T10:47:28.088043+0000","last_unstale":"2023-08-10T10:47:28.088374+0000","last_undegraded":"2023-08-10T10:47:28.088374+0000","last_fullsized":"2023-08-10T10:47:28.088374+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:29.071801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.057271+0000","last_change":"2023-08-10T10:47:27.073020+0000","last_active":"2023-08-10T10:47:28.057271+0000","last_peered":"2023-08-10T10:47:28.057271+0000","last_clean":"2023-08-10T10:47:28.057271+0000","last_became_active":"2023-08-10T10:47:27.072779+0000","last_became_peered":"2023-08-10T10:47:27.072779+0000","last_unstale":"2023-08-10T10:47:28.057271+0000","last_undegraded":"2023-08-10T10:47:28.057271+0000","last_fullsized":"2023-08-10T10:47:28.057271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:45.579850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.080730+0000","last_change":"2023-08-10T10:47:28.080616+0000","last_active":"2023-08-10T10:47:28.080730+0000","last_peered":"2023-08-10T10:47:28.080730+0000","last_clean":"2023-08-10T10:47:28.080730+0000","last_became_active":"2023-08-10T10:47:28.080184+0000","last_became_peered":"2023-08-10T10:47:28.080184+0000","last_unstale":"2023-08-10T10:47:28.080730+0000","last_undegraded":"2023-08-10T10:47:28.080730+0000","last_fullsized":"2023-08-10T10:47:28.080730+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:55.586647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084089+0000","last_change":"2023-08-10T10:47:27.077138+0000","last_active":"2023-08-10T10:47:28.084089+0000","last_peered":"2023-08-10T10:47:28.084089+0000","last_clean":"2023-08-10T10:47:28.084089+0000","last_became_active":"2023-08-10T10:47:27.076760+0000","last_became_peered":"2023-08-10T10:47:27.076760+0000","last_unstale":"2023-08-10T10:47:28.084089+0000","last_undegraded":"2023-08-10T10:47:28.084089+0000","last_fullsized":"2023-08-10T10:47:28.084089+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:20:48.657925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.076408+0000","last_change":"2023-08-10T10:47:28.076238+0000","last_active":"2023-08-10T10:47:28.076408+0000","last_peered":"2023-08-10T10:47:28.076408+0000","last_clean":"2023-08-10T10:47:28.076408+0000","last_became_active":"2023-08-10T10:47:28.075714+0000","last_became_peered":"2023-08-10T10:47:28.075714+0000","last_unstale":"2023-08-10T10:47:28.076408+0000","last_undegraded":"2023-08-10T10:47:28.076408+0000","last_fullsized":"2023-08-10T10:47:28.076408+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:45.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.072596+0000","last_change":"2023-08-10T10:47:27.074443+0000","last_active":"2023-08-10T10:47:28.072596+0000","last_peered":"2023-08-10T10:47:28.072596+0000","last_clean":"2023-08-10T10:47:28.072596+0000","last_became_active":"2023-08-10T10:47:27.074188+0000","last_became_peered":"2023-08-10T10:47:27.074188+0000","last_unstale":"2023-08-10T10:47:28.072596+0000","last_undegraded":"2023-08-10T10:47:28.072596+0000","last_fullsized":"2023-08-10T10:47:28.072596+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:01:44.054257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078594+0000","last_change":"2023-08-10T10:47:28.078390+0000","last_active":"2023-08-10T10:47:28.078594+0000","last_peered":"2023-08-10T10:47:28.078594+0000","last_clean":"2023-08-10T10:47:28.078594+0000","last_became_active":"2023-08-10T10:47:28.073200+0000","last_became_peered":"2023-08-10T10:47:28.073200+0000","last_unstale":"2023-08-10T10:47:28.078594+0000","last_undegraded":"2023-08-10T10:47:28.078594+0000","last_fullsized":"2023-08-10T10:47:28.078594+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:47:03.510978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065075+0000","last_change":"2023-08-10T10:47:27.075203+0000","last_active":"2023-08-10T10:47:28.065075+0000","last_peered":"2023-08-10T10:47:28.065075+0000","last_clean":"2023-08-10T10:47:28.065075+0000","last_became_active":"2023-08-10T10:47:27.074887+0000","last_became_peered":"2023-08-10T10:47:27.074887+0000","last_unstale":"2023-08-10T10:47:28.065075+0000","last_undegraded":"2023-08-10T10:47:28.065075+0000","last_fullsized":"2023-08-10T10:47:28.065075+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:20:13.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.083352+0000","last_change":"2023-08-10T10:47:28.081939+0000","last_active":"2023-08-10T10:47:28.083352+0000","last_peered":"2023-08-10T10:47:28.083352+0000","last_clean":"2023-08-10T10:47:28.083352+0000","last_became_active":"2023-08-10T10:47:28.074164+0000","last_became_peered":"2023-08-10T10:47:28.074164+0000","last_unstale":"2023-08-10T10:47:28.083352+0000","last_undegraded":"2023-08-10T10:47:28.083352+0000","last_fullsized":"2023-08-10T10:47:28.083352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:54.332978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067711+0000","last_change":"2023-08-10T10:47:27.077218+0000","last_active":"2023-08-10T10:47:28.067711+0000","last_peered":"2023-08-10T10:47:28.067711+0000","last_clean":"2023-08-10T10:47:28.067711+0000","last_became_active":"2023-08-10T10:47:27.075453+0000","last_became_peered":"2023-08-10T10:47:27.075453+0000","last_unstale":"2023-08-10T10:47:28.067711+0000","last_undegraded":"2023-08-10T10:47:28.067711+0000","last_fullsized":"2023-08-10T10:47:28.067711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:52.602921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069755+0000","last_change":"2023-08-10T10:47:28.068921+0000","last_active":"2023-08-10T10:47:28.069755+0000","last_peered":"2023-08-10T10:47:28.069755+0000","last_clean":"2023-08-10T10:47:28.069755+0000","last_became_active":"2023-08-10T10:47:28.068351+0000","last_became_peered":"2023-08-10T10:47:28.068351+0000","last_unstale":"2023-08-10T10:47:28.069755+0000","last_undegraded":"2023-08-10T10:47:28.069755+0000","last_fullsized":"2023-08-10T10:47:28.069755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:42.870014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.086507+0000","last_change":"2023-08-10T10:47:27.076896+0000","last_active":"2023-08-10T10:47:28.086507+0000","last_peered":"2023-08-10T10:47:28.086507+0000","last_clean":"2023-08-10T10:47:28.086507+0000","last_became_active":"2023-08-10T10:47:27.076250+0000","last_became_peered":"2023-08-10T10:47:27.076250+0000","last_unstale":"2023-08-10T10:47:28.086507+0000","last_undegraded":"2023-08-10T10:47:28.086507+0000","last_fullsized":"2023-08-10T10:47:28.086507+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:12:02.451609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.091286+0000","last_change":"2023-08-10T10:47:28.091199+0000","last_active":"2023-08-10T10:47:28.091286+0000","last_peered":"2023-08-10T10:47:28.091286+0000","last_clean":"2023-08-10T10:47:28.091286+0000","last_became_active":"2023-08-10T10:47:28.090391+0000","last_became_peered":"2023-08-10T10:47:28.090391+0000","last_unstale":"2023-08-10T10:47:28.091286+0000","last_undegraded":"2023-08-10T10:47:28.091286+0000","last_fullsized":"2023-08-10T10:47:28.091286+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:57.192610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061800+0000","last_change":"2023-08-10T10:47:27.075622+0000","last_active":"2023-08-10T10:47:28.061800+0000","last_peered":"2023-08-10T10:47:28.061800+0000","last_clean":"2023-08-10T10:47:28.061800+0000","last_became_active":"2023-08-10T10:47:27.075341+0000","last_became_peered":"2023-08-10T10:47:27.075341+0000","last_unstale":"2023-08-10T10:47:28.061800+0000","last_undegraded":"2023-08-10T10:47:28.061800+0000","last_fullsized":"2023-08-10T10:47:28.061800+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:19.366993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.088369+0000","last_change":"2023-08-10T10:47:28.088313+0000","last_active":"2023-08-10T10:47:28.088369+0000","last_peered":"2023-08-10T10:47:28.088369+0000","last_clean":"2023-08-10T10:47:28.088369+0000","last_became_active":"2023-08-10T10:47:28.085576+0000","last_became_peered":"2023-08-10T10:47:28.085576+0000","last_unstale":"2023-08-10T10:47:28.088369+0000","last_undegraded":"2023-08-10T10:47:28.088369+0000","last_fullsized":"2023-08-10T10:47:28.088369+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:43:57.950172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.058802+0000","last_change":"2023-08-10T10:47:27.074519+0000","last_active":"2023-08-10T10:47:28.058802+0000","last_peered":"2023-08-10T10:47:28.058802+0000","last_clean":"2023-08-10T10:47:28.058802+0000","last_became_active":"2023-08-10T10:47:27.074255+0000","last_became_peered":"2023-08-10T10:47:27.074255+0000","last_unstale":"2023-08-10T10:47:28.058802+0000","last_undegraded":"2023-08-10T10:47:28.058802+0000","last_fullsized":"2023-08-10T10:47:28.058802+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:56:10.946071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075944+0000","last_change":"2023-08-10T10:47:28.075774+0000","last_active":"2023-08-10T10:47:28.075944+0000","last_peered":"2023-08-10T10:47:28.075944+0000","last_clean":"2023-08-10T10:47:28.075944+0000","last_became_active":"2023-08-10T10:47:28.075251+0000","last_became_peered":"2023-08-10T10:47:28.075251+0000","last_unstale":"2023-08-10T10:47:28.075944+0000","last_undegraded":"2023-08-10T10:47:28.075944+0000","last_fullsized":"2023-08-10T10:47:28.075944+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:08.394663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067704+0000","last_change":"2023-08-10T10:47:27.068052+0000","last_active":"2023-08-10T10:47:28.067704+0000","last_peered":"2023-08-10T10:47:28.067704+0000","last_clean":"2023-08-10T10:47:28.067704+0000","last_became_active":"2023-08-10T10:47:27.067781+0000","last_became_peered":"2023-08-10T10:47:27.067781+0000","last_unstale":"2023-08-10T10:47:28.067704+0000","last_undegraded":"2023-08-10T10:47:28.067704+0000","last_fullsized":"2023-08-10T10:47:28.067704+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:14.432820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.077422+0000","last_change":"2023-08-10T10:47:28.073369+0000","last_active":"2023-08-10T10:47:28.077422+0000","last_peered":"2023-08-10T10:47:28.077422+0000","last_clean":"2023-08-10T10:47:28.077422+0000","last_became_active":"2023-08-10T10:47:28.073037+0000","last_became_peered":"2023-08-10T10:47:28.073037+0000","last_unstale":"2023-08-10T10:47:28.077422+0000","last_undegraded":"2023-08-10T10:47:28.077422+0000","last_fullsized":"2023-08-10T10:47:28.077422+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:31.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061568+0000","last_change":"2023-08-10T10:47:27.080303+0000","last_active":"2023-08-10T10:47:28.061568+0000","last_peered":"2023-08-10T10:47:28.061568+0000","last_clean":"2023-08-10T10:47:28.061568+0000","last_became_active":"2023-08-10T10:47:27.078982+0000","last_became_peered":"2023-08-10T10:47:27.078982+0000","last_unstale":"2023-08-10T10:47:28.061568+0000","last_undegraded":"2023-08-10T10:47:28.061568+0000","last_fullsized":"2023-08-10T10:47:28.061568+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:28.053962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.078138+0000","last_change":"2023-08-10T10:47:28.077573+0000","last_active":"2023-08-10T10:47:28.078138+0000","last_peered":"2023-08-10T10:47:28.078138+0000","last_clean":"2023-08-10T10:47:28.078138+0000","last_became_active":"2023-08-10T10:47:28.077230+0000","last_became_peered":"2023-08-10T10:47:28.077230+0000","last_unstale":"2023-08-10T10:47:28.078138+0000","last_undegraded":"2023-08-10T10:47:28.078138+0000","last_fullsized":"2023-08-10T10:47:28.078138+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:47:47.745717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.069014+0000","last_change":"2023-08-10T10:47:27.066259+0000","last_active":"2023-08-10T10:47:28.069014+0000","last_peered":"2023-08-10T10:47:28.069014+0000","last_clean":"2023-08-10T10:47:28.069014+0000","last_became_active":"2023-08-10T10:47:27.065700+0000","last_became_peered":"2023-08-10T10:47:27.065700+0000","last_unstale":"2023-08-10T10:47:28.069014+0000","last_undegraded":"2023-08-10T10:47:28.069014+0000","last_fullsized":"2023-08-10T10:47:28.069014+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:48.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079266+0000","last_change":"2023-08-10T10:47:28.078741+0000","last_active":"2023-08-10T10:47:28.079266+0000","last_peered":"2023-08-10T10:47:28.079266+0000","last_clean":"2023-08-10T10:47:28.079266+0000","last_became_active":"2023-08-10T10:47:28.078399+0000","last_became_peered":"2023-08-10T10:47:28.078399+0000","last_unstale":"2023-08-10T10:47:28.079266+0000","last_undegraded":"2023-08-10T10:47:28.079266+0000","last_fullsized":"2023-08-10T10:47:28.079266+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:09.799993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.066153+0000","last_change":"2023-08-10T10:47:27.066465+0000","last_active":"2023-08-10T10:47:28.066153+0000","last_peered":"2023-08-10T10:47:28.066153+0000","last_clean":"2023-08-10T10:47:28.066153+0000","last_became_active":"2023-08-10T10:47:27.066212+0000","last_became_peered":"2023-08-10T10:47:27.066212+0000","last_unstale":"2023-08-10T10:47:28.066153+0000","last_undegraded":"2023-08-10T10:47:28.066153+0000","last_fullsized":"2023-08-10T10:47:28.066153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:33.515282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081045+0000","last_change":"2023-08-10T10:47:28.080957+0000","last_active":"2023-08-10T10:47:28.081045+0000","last_peered":"2023-08-10T10:47:28.081045+0000","last_clean":"2023-08-10T10:47:28.081045+0000","last_became_active":"2023-08-10T10:47:28.075313+0000","last_became_peered":"2023-08-10T10:47:28.075313+0000","last_unstale":"2023-08-10T10:47:28.081045+0000","last_undegraded":"2023-08-10T10:47:28.081045+0000","last_fullsized":"2023-08-10T10:47:28.081045+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:12.778645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.059027+0000","last_change":"2023-08-10T10:47:27.075441+0000","last_active":"2023-08-10T10:47:28.059027+0000","last_peered":"2023-08-10T10:47:28.059027+0000","last_clean":"2023-08-10T10:47:28.059027+0000","last_became_active":"2023-08-10T10:47:27.075117+0000","last_became_peered":"2023-08-10T10:47:27.075117+0000","last_unstale":"2023-08-10T10:47:28.059027+0000","last_undegraded":"2023-08-10T10:47:28.059027+0000","last_fullsized":"2023-08-10T10:47:28.059027+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:37.859083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089803+0000","last_change":"2023-08-10T10:47:28.089623+0000","last_active":"2023-08-10T10:47:28.089803+0000","last_peered":"2023-08-10T10:47:28.089803+0000","last_clean":"2023-08-10T10:47:28.089803+0000","last_became_active":"2023-08-10T10:47:28.088078+0000","last_became_peered":"2023-08-10T10:47:28.088078+0000","last_unstale":"2023-08-10T10:47:28.089803+0000","last_undegraded":"2023-08-10T10:47:28.089803+0000","last_fullsized":"2023-08-10T10:47:28.089803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:48.484286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.062896+0000","last_change":"2023-08-10T10:47:27.075231+0000","last_active":"2023-08-10T10:47:28.062896+0000","last_peered":"2023-08-10T10:47:28.062896+0000","last_clean":"2023-08-10T10:47:28.062896+0000","last_became_active":"2023-08-10T10:47:27.074870+0000","last_became_peered":"2023-08-10T10:47:27.074870+0000","last_unstale":"2023-08-10T10:47:28.062896+0000","last_undegraded":"2023-08-10T10:47:28.062896+0000","last_fullsized":"2023-08-10T10:47:28.062896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:24.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":409,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065557+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:47:28.065557+0000","last_peered":"2023-08-10T10:47:28.065557+0000","last_clean":"2023-08-10T10:47:28.065557+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:47:28.065557+0000","last_undegraded":"2023-08-10T10:47:28.065557+0000","last_fullsized":"2023-08-10T10:47:28.065557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:16.446593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":269,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061973+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:47:28.061973+0000","last_peered":"2023-08-10T10:47:28.061973+0000","last_clean":"2023-08-10T10:47:28.061973+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:47:28.061973+0000","last_undegraded":"2023-08-10T10:47:28.061973+0000","last_fullsized":"2023-08-10T10:47:28.061973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:26:45.026309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.082156+0000","last_change":"2023-08-10T10:47:28.081177+0000","last_active":"2023-08-10T10:47:28.082156+0000","last_peered":"2023-08-10T10:47:28.082156+0000","last_clean":"2023-08-10T10:47:28.082156+0000","last_became_active":"2023-08-10T10:47:28.075683+0000","last_became_peered":"2023-08-10T10:47:28.075683+0000","last_unstale":"2023-08-10T10:47:28.082156+0000","last_undegraded":"2023-08-10T10:47:28.082156+0000","last_fullsized":"2023-08-10T10:47:28.082156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:20:00.508594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067788+0000","last_change":"2023-08-10T10:47:27.077904+0000","last_active":"2023-08-10T10:47:28.067788+0000","last_peered":"2023-08-10T10:47:28.067788+0000","last_clean":"2023-08-10T10:47:28.067788+0000","last_became_active":"2023-08-10T10:47:27.077664+0000","last_became_peered":"2023-08-10T10:47:27.077664+0000","last_unstale":"2023-08-10T10:47:28.067788+0000","last_undegraded":"2023-08-10T10:47:28.067788+0000","last_fullsized":"2023-08-10T10:47:28.067788+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:18:21.966433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":255,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065427+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:47:28.065427+0000","last_peered":"2023-08-10T10:47:28.065427+0000","last_clean":"2023-08-10T10:47:28.065427+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:47:28.065427+0000","last_undegraded":"2023-08-10T10:47:28.065427+0000","last_fullsized":"2023-08-10T10:47:28.065427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:40.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.071361+0000","last_change":"2023-08-10T10:47:28.071229+0000","last_active":"2023-08-10T10:47:28.071361+0000","last_peered":"2023-08-10T10:47:28.071361+0000","last_clean":"2023-08-10T10:47:28.071361+0000","last_became_active":"2023-08-10T10:47:28.070819+0000","last_became_peered":"2023-08-10T10:47:28.070819+0000","last_unstale":"2023-08-10T10:47:28.071361+0000","last_undegraded":"2023-08-10T10:47:28.071361+0000","last_fullsized":"2023-08-10T10:47:28.071361+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:45.389671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089576+0000","last_change":"2023-08-10T10:47:27.079285+0000","last_active":"2023-08-10T10:47:28.089576+0000","last_peered":"2023-08-10T10:47:28.089576+0000","last_clean":"2023-08-10T10:47:28.089576+0000","last_became_active":"2023-08-10T10:47:27.079050+0000","last_became_peered":"2023-08-10T10:47:27.079050+0000","last_unstale":"2023-08-10T10:47:28.089576+0000","last_undegraded":"2023-08-10T10:47:28.089576+0000","last_fullsized":"2023-08-10T10:47:28.089576+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:47.233136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067058+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:47:28.067058+0000","last_peered":"2023-08-10T10:47:28.067058+0000","last_clean":"2023-08-10T10:47:28.067058+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:47:28.067058+0000","last_undegraded":"2023-08-10T10:47:28.067058+0000","last_fullsized":"2023-08-10T10:47:28.067058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:36.793702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.075915+0000","last_change":"2023-08-10T10:47:28.075795+0000","last_active":"2023-08-10T10:47:28.075915+0000","last_peered":"2023-08-10T10:47:28.075915+0000","last_clean":"2023-08-10T10:47:28.075915+0000","last_became_active":"2023-08-10T10:47:28.075393+0000","last_became_peered":"2023-08-10T10:47:28.075393+0000","last_unstale":"2023-08-10T10:47:28.075915+0000","last_undegraded":"2023-08-10T10:47:28.075915+0000","last_fullsized":"2023-08-10T10:47:28.075915+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:35:57.958945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.085296+0000","last_change":"2023-08-10T10:47:27.075928+0000","last_active":"2023-08-10T10:47:28.085296+0000","last_peered":"2023-08-10T10:47:28.085296+0000","last_clean":"2023-08-10T10:47:28.085296+0000","last_became_active":"2023-08-10T10:47:27.075662+0000","last_became_peered":"2023-08-10T10:47:27.075662+0000","last_unstale":"2023-08-10T10:47:28.085296+0000","last_undegraded":"2023-08-10T10:47:28.085296+0000","last_fullsized":"2023-08-10T10:47:28.085296+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:45:03.764252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":269,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.057910+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:47:28.057910+0000","last_peered":"2023-08-10T10:47:28.057910+0000","last_clean":"2023-08-10T10:47:28.057910+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:47:28.057910+0000","last_undegraded":"2023-08-10T10:47:28.057910+0000","last_fullsized":"2023-08-10T10:47:28.057910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:10.557596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079841+0000","last_change":"2023-08-10T10:47:28.079767+0000","last_active":"2023-08-10T10:47:28.079841+0000","last_peered":"2023-08-10T10:47:28.079841+0000","last_clean":"2023-08-10T10:47:28.079841+0000","last_became_active":"2023-08-10T10:47:28.079473+0000","last_became_peered":"2023-08-10T10:47:28.079473+0000","last_unstale":"2023-08-10T10:47:28.079841+0000","last_undegraded":"2023-08-10T10:47:28.079841+0000","last_fullsized":"2023-08-10T10:47:28.079841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:17.267295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089618+0000","last_change":"2023-08-10T10:47:27.079441+0000","last_active":"2023-08-10T10:47:28.089618+0000","last_peered":"2023-08-10T10:47:28.089618+0000","last_clean":"2023-08-10T10:47:28.089618+0000","last_became_active":"2023-08-10T10:47:27.079192+0000","last_became_peered":"2023-08-10T10:47:27.079192+0000","last_unstale":"2023-08-10T10:47:28.089618+0000","last_undegraded":"2023-08-10T10:47:28.089618+0000","last_fullsized":"2023-08-10T10:47:28.089618+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:54.986116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":275,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067821+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:47:28.067821+0000","last_peered":"2023-08-10T10:47:28.067821+0000","last_clean":"2023-08-10T10:47:28.067821+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:47:28.067821+0000","last_undegraded":"2023-08-10T10:47:28.067821+0000","last_fullsized":"2023-08-10T10:47:28.067821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:56:20.377064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.081055+0000","last_change":"2023-08-10T10:47:28.080990+0000","last_active":"2023-08-10T10:47:28.081055+0000","last_peered":"2023-08-10T10:47:28.081055+0000","last_clean":"2023-08-10T10:47:28.081055+0000","last_became_active":"2023-08-10T10:47:28.080678+0000","last_became_peered":"2023-08-10T10:47:28.080678+0000","last_unstale":"2023-08-10T10:47:28.081055+0000","last_undegraded":"2023-08-10T10:47:28.081055+0000","last_fullsized":"2023-08-10T10:47:28.081055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:16.949737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.089183+0000","last_change":"2023-08-10T10:47:27.063750+0000","last_active":"2023-08-10T10:47:28.089183+0000","last_peered":"2023-08-10T10:47:28.089183+0000","last_clean":"2023-08-10T10:47:28.089183+0000","last_became_active":"2023-08-10T10:47:27.063037+0000","last_became_peered":"2023-08-10T10:47:27.063037+0000","last_unstale":"2023-08-10T10:47:28.089183+0000","last_undegraded":"2023-08-10T10:47:28.089183+0000","last_fullsized":"2023-08-10T10:47:28.089183+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:16.905392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":255,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.065309+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:47:28.065309+0000","last_peered":"2023-08-10T10:47:28.065309+0000","last_clean":"2023-08-10T10:47:28.065309+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:47:28.065309+0000","last_undegraded":"2023-08-10T10:47:28.065309+0000","last_fullsized":"2023-08-10T10:47:28.065309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:49.793451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.084545+0000","last_change":"2023-08-10T10:47:28.084464+0000","last_active":"2023-08-10T10:47:28.084545+0000","last_peered":"2023-08-10T10:47:28.084545+0000","last_clean":"2023-08-10T10:47:28.084545+0000","last_became_active":"2023-08-10T10:47:28.084197+0000","last_became_peered":"2023-08-10T10:47:28.084197+0000","last_unstale":"2023-08-10T10:47:28.084545+0000","last_undegraded":"2023-08-10T10:47:28.084545+0000","last_fullsized":"2023-08-10T10:47:28.084545+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:04.320222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.061174+0000","last_change":"2023-08-10T10:47:27.078743+0000","last_active":"2023-08-10T10:47:28.061174+0000","last_peered":"2023-08-10T10:47:28.061174+0000","last_clean":"2023-08-10T10:47:28.061174+0000","last_became_active":"2023-08-10T10:47:27.077241+0000","last_became_peered":"2023-08-10T10:47:27.077241+0000","last_unstale":"2023-08-10T10:47:28.061174+0000","last_undegraded":"2023-08-10T10:47:28.061174+0000","last_fullsized":"2023-08-10T10:47:28.061174+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:07.376825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":275,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.066380+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:47:28.066380+0000","last_peered":"2023-08-10T10:47:28.066380+0000","last_clean":"2023-08-10T10:47:28.066380+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:47:28.066380+0000","last_undegraded":"2023-08-10T10:47:28.066380+0000","last_fullsized":"2023-08-10T10:47:28.066380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:45:05.439387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.079285+0000","last_change":"2023-08-10T10:47:28.079103+0000","last_active":"2023-08-10T10:47:28.079285+0000","last_peered":"2023-08-10T10:47:28.079285+0000","last_clean":"2023-08-10T10:47:28.079285+0000","last_became_active":"2023-08-10T10:47:28.078832+0000","last_became_peered":"2023-08-10T10:47:28.078832+0000","last_unstale":"2023-08-10T10:47:28.079285+0000","last_undegraded":"2023-08-10T10:47:28.079285+0000","last_fullsized":"2023-08-10T10:47:28.079285+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:27.034844+0000","last_clean_scrub_stamp":"2023-08-10T10:47:27.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:38.170330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.070621+0000","last_change":"2023-08-10T10:47:27.077037+0000","last_active":"2023-08-10T10:47:28.070621+0000","last_peered":"2023-08-10T10:47:28.070621+0000","last_clean":"2023-08-10T10:47:28.070621+0000","last_became_active":"2023-08-10T10:47:27.076524+0000","last_became_peered":"2023-08-10T10:47:27.076524+0000","last_unstale":"2023-08-10T10:47:28.070621+0000","last_undegraded":"2023-08-10T10:47:28.070621+0000","last_fullsized":"2023-08-10T10:47:28.070621+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:47:26.017006+0000","last_clean_scrub_stamp":"2023-08-10T10:47:26.017006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:35:39.208080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-10T10:47:28.067992+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:47:28.067992+0000","last_peered":"2023-08-10T10:47:28.067992+0000","last_clean":"2023-08-10T10:47:28.067992+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:47:28.067992+0000","last_undegraded":"2023-08-10T10:47:28.067992+0000","last_fullsized":"2023-08-10T10:47:28.067992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:41:27.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193819,"statfs":{"total":200000000,"available":198471569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.206,"15min":1.145},"min":{"1min":0.83299999999999996,"5min":0.52300000000000002,"15min":0.39600000000000002},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1830000000000001,"15min":1.109},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.44800000000000001},"max":{"1min":1.581,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.232,"15min":1.163},"min":{"1min":0.80900000000000005,"5min":0.66800000000000004,"15min":0.66500000000000004},"max":{"1min":1.778,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.405},{"interface":"front","average":{"1min":1.139,"5min":1.2190000000000001,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.458,"5min":8.0830000000000002,"15min":8.0830000000000002},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.21,"15min":1.224},"min":{"1min":0.69299999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.948,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":1.258},{"interface":"front","average":{"1min":1.335,"5min":1.327,"15min":1.2629999999999999},"min":{"1min":0.996,"5min":0.58599999999999997,"15min":0.497},"max":{"1min":1.8660000000000001,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.2030000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.284,"15min":1.23},"min":{"1min":1.056,"5min":0.433,"15min":0.433},"max":{"1min":2.081,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4450000000000001,"15min":1.3959999999999999},"min":{"1min":0.97099999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.266,"5min":6.069,"15min":6.069},"last":1.5780000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.329,"15min":1.26},"min":{"1min":0.89800000000000002,"5min":0.56499999999999995,"15min":0.49099999999999999},"max":{"1min":2.2080000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":1.081},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.292},"min":{"1min":0.83099999999999996,"5min":0.54400000000000004,"15min":0.52600000000000002},"max":{"1min":1.72,"5min":7.4950000000000001,"15min":7.4950000000000001},"last":1.133}]},{"osd":5,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.522,"15min":1.4650000000000001},"min":{"1min":0.872,"5min":0.67600000000000005,"15min":0.59699999999999998},"max":{"1min":2.0670000000000002,"5min":6.0090000000000003,"15min":6.0090000000000003},"last":1.468},{"interface":"front","average":{"1min":1.512,"5min":1.5129999999999999,"15min":1.5029999999999999},"min":{"1min":0.97299999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.056,"5min":7.5529999999999999,"15min":7.5529999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.633,"15min":1.593},"min":{"1min":1.042,"5min":0.61299999999999999,"15min":0.58599999999999997},"max":{"1min":2.2829999999999999,"5min":8.859,"15min":8.859},"last":1.631},{"interface":"front","average":{"1min":1.508,"5min":1.532,"15min":1.51},"min":{"1min":0.93100000000000005,"5min":0.62,"15min":0.62},"max":{"1min":2.3050000000000002,"5min":7.1139999999999999,"15min":7.1139999999999999},"last":1.3149999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.754,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.468,"5min":1.75,"15min":1.7509999999999999},"last":0.879},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.111,"15min":1.0169999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.5820000000000001,"5min":1.659,"15min":1.659},"last":1.405}]},{"osd":1,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1080000000000001,"15min":1.071},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"max":{"1min":1.4199999999999999,"5min":2.302,"15min":2.302},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.24,"15min":1.1830000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.194,"15min":1.141},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.476,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.268,"15min":1.232},"min":{"1min":0.80900000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5800000000000001,"5min":1.968,"15min":1.968},"last":1.01}]},{"osd":3,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.343,"15min":1.2310000000000001},"min":{"1min":0.99399999999999999,"5min":0.80700000000000005,"15min":0.69399999999999995},"max":{"1min":1.6279999999999999,"5min":3.177,"15min":3.177},"last":1.329},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.306,"15min":1.262},"min":{"1min":0.749,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.718,"5min":2.395,"15min":2.395},"last":1.5249999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2629999999999999,"15min":1.22},"min":{"1min":0.71699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6479999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.163},{"interface":"front","average":{"1min":1.446,"5min":1.484,"15min":1.4239999999999999},"min":{"1min":1.0720000000000001,"5min":0.67200000000000004,"15min":0.622},"max":{"1min":1.9670000000000001,"5min":2.6890000000000001,"15min":2.7589999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.444,"15min":1.411},"min":{"1min":0.76700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.8200000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.306},{"interface":"front","average":{"1min":1.466,"5min":1.5680000000000001,"15min":1.4990000000000001},"min":{"1min":1.0660000000000001,"5min":0.78200000000000003,"15min":0.69399999999999995},"max":{"1min":1.867,"5min":2.8519999999999999,"15min":2.8700000000000001},"last":1.216}]},{"osd":7,"last update":"Thu Aug 10 10:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.4079999999999999,"15min":1.3680000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7869999999999999,"5min":2.6259999999999999,"15min":3.1019999999999999},"last":1.254},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.546,"15min":1.4910000000000001},"min":{"1min":0.86299999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8500000000000001,"5min":2.5819999999999999,"15min":2.698},"last":1.367}]}]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194399,"statfs":{"total":200000000,"available":199064588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.093},"min":{"1min":0.65600000000000003,"5min":0.621,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.581,"15min":2.5070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.776,"5min":1.8069999999999999,"15min":32.941000000000003},"last":1.833}]},{"osd":1,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1910000000000001,"15min":1.212},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5449999999999999,"5min":1.762,"15min":2.2450000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.181,"15min":1.206},"min":{"1min":0.629,"5min":0.62,"15min":0.62},"max":{"1min":1.6419999999999999,"5min":2.2160000000000002,"15min":4.3360000000000003},"last":1.27}]},{"osd":2,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2270000000000001,"15min":1.3069999999999999},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5980000000000001,"5min":1.857,"15min":4.1980000000000004},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.79800000000000004,"5min":0.69899999999999995,"15min":0.67700000000000005},"max":{"1min":1.4670000000000001,"5min":1.653,"15min":1.73},"last":1.556}]},{"osd":3,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.3,"15min":1.26},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.3200000000000001,"15min":1.359},"min":{"1min":0.95699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8120000000000001,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.518}]},{"osd":4,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.2529999999999999,"15min":1.292},"min":{"1min":0.88200000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.8969999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.488},{"interface":"front","average":{"1min":1.351,"5min":1.375,"15min":1.3600000000000001},"min":{"1min":0.85899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.893,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.6000000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.405,"15min":1.3340000000000001},"min":{"1min":1.046,"5min":0.56599999999999995,"15min":0.54200000000000004},"max":{"1min":2.04,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.4119999999999999,"15min":1.395},"min":{"1min":0.78400000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":1.6910000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.5029999999999999,"15min":1.4890000000000001},"min":{"1min":0.96099999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.738},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.516,"15min":1.494},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.956,"5min":2.1320000000000001,"15min":2.1989999999999998},"last":1.6539999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":914,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194398,"statfs":{"total":200000000,"available":199063591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.165,"15min":1.1359999999999999},"min":{"1min":0.749,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":1.46,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":1.157},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2130000000000001,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.73499999999999999,"15min":0.55600000000000005},"max":{"1min":1.907,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":1.133}]},{"osd":1,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.2769999999999999},"min":{"1min":0.78400000000000003,"5min":0.66800000000000004,"15min":0.61899999999999999},"max":{"1min":1.5760000000000001,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.159,"15min":1.139},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.252,"15min":1.165},"min":{"1min":0.77400000000000002,"5min":0.75,"15min":0.621},"max":{"1min":1.6990000000000001,"5min":4.4969999999999999,"15min":4.4969999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3720000000000001,"15min":1.304},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.70499999999999996},"max":{"1min":1.7989999999999999,"5min":4.226,"15min":4.226},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2989999999999999,"15min":1.2529999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7250000000000001,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.323},{"interface":"front","average":{"1min":1.24,"5min":1.373,"15min":1.29},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.67000000000000004},"max":{"1min":1.633,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.448}]},{"osd":5,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.363,"15min":1.3560000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.651,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3160000000000001,"15min":1.2929999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42399999999999999},"max":{"1min":1.7390000000000001,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.204}]},{"osd":6,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.367,"15min":1.3280000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.577,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":1.371},{"interface":"front","average":{"1min":1.411,"5min":1.5309999999999999,"15min":1.476},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.992,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.93100000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4870000000000001,"15min":1.4319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.57999999999999996},"max":{"1min":2.1099999999999999,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.573,"15min":1.514},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.901,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.526}]}]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.92600000000000005,"15min":0.85599999999999998},"min":{"1min":0.59199999999999997,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.3140000000000001,"5min":1.629,"15min":2.1019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.55500000000000005,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.5529999999999999,"5min":1.9590000000000001,"15min":2.4470000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94499999999999995,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.4430000000000001,"5min":1.5549999999999999,"15min":1.6599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.0840000000000001,"15min":0.96699999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.34100000000000003},"max":{"1min":1.6519999999999999,"5min":1.752,"15min":1.897},"last":0.497}]},{"osd":2,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":0.96399999999999997},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.496,"5min":2.0590000000000002,"15min":2.0710000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1830000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.46899999999999997},"max":{"1min":1.5880000000000001,"5min":1.958,"15min":2.0430000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.421,"15min":1.278},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.70599999999999996},"max":{"1min":1.6319999999999999,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2729999999999999,"15min":1.2150000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.71399999999999997},"max":{"1min":2.0390000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4059999999999999,"15min":1.3420000000000001},"min":{"1min":0.91100000000000003,"5min":0.83999999999999997,"15min":0.77900000000000003},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.125},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.46,"5min":1.444,"15min":1.3779999999999999},"min":{"1min":0.81399999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.98,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.385,"15min":1.296},"min":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.911,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4630000000000001,"15min":1.413},"min":{"1min":0.93799999999999994,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.1539999999999999},"last":0.749}]},{"osd":7,"last update":"Thu Aug 10 10:47:24 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.5189999999999999,"15min":1.446},"min":{"1min":0.86099999999999999,"5min":0.81699999999999995,"15min":0.754},"max":{"1min":2.198,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.54,"5min":1.4359999999999999,"15min":1.3620000000000001},"min":{"1min":1.04,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0459999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.81399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":907,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.42199999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0169999999999999,"5min":1.464,"15min":1.5209999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95199999999999996,"15min":0.90700000000000003},"min":{"1min":0.49099999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.607,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.095,"15min":1.0509999999999999},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8009999999999999,"15min":1.9630000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.1850000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.548,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.50900000000000001},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.1870000000000001,"15min":1.2190000000000001},"min":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.575,"5min":1.863,"15min":3.6920000000000002},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3720000000000001,"15min":1.399},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7470000000000001,"5min":2.415,"15min":2.6000000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.351,"15min":1.3100000000000001},"min":{"1min":0.92900000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.9339999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.298,"15min":1.2689999999999999},"min":{"1min":0.84899999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.764,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.458,"15min":1.462},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9870000000000001,"5min":3.294,"15min":3.294},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.446,"15min":1.391},"min":{"1min":0.88900000000000001,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":1.798,"5min":2.3940000000000001,"15min":2.6509999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.399,"15min":1.3540000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.833,"5min":2.444,"15min":2.444},"last":1.04}]},{"osd":7,"last update":"Thu Aug 10 10:47:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.5189999999999999,"15min":1.4279999999999999},"min":{"1min":0.996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0430000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.115},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4219999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0950000000000002,"5min":2.556,"15min":2.556},"last":1.135}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":914,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199063521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.89000000000000001,"15min":0.83899999999999997},"min":{"1min":0.441,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.343,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97999999999999998,"15min":0.94399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2649999999999999,"5min":2.012,"15min":2.246},"last":1.4019999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.03,"15min":0.91500000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5660000000000001,"5min":1.792,"15min":2.0209999999999999},"last":0.751},{"interface":"front","average":{"1min":1.171,"5min":1.2210000000000001,"15min":1.097},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.7130000000000001,"5min":1.7589999999999999,"15min":2.423},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.194,"15min":1.0820000000000001},"min":{"1min":0.63100000000000001,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.5960000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.099,"15min":1.0449999999999999},"min":{"1min":0.61199999999999999,"5min":0.48899999999999999,"15min":0.42399999999999999},"max":{"1min":1.728,"5min":1.8,"15min":2.8940000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.26,"15min":1.1899999999999999},"min":{"1min":0.93000000000000005,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":1.597,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.054},{"interface":"front","average":{"1min":1.365,"5min":1.468,"15min":1.3999999999999999},"min":{"1min":0.83299999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.78,"5min":2.343,"15min":2.343},"last":1.45}]},{"osd":5,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.423,"15min":1.375},"min":{"1min":1.0900000000000001,"5min":0.93100000000000005,"15min":0.67900000000000005},"max":{"1min":1.6160000000000001,"5min":1.98,"15min":2.9969999999999999},"last":1.288},{"interface":"front","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.94599999999999995,"15min":0.71699999999999997},"max":{"1min":1.788,"5min":2.387,"15min":2.73},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4410000000000001,"15min":1.375},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.78400000000000003},"max":{"1min":2.0299999999999998,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.413,"15min":1.294},"min":{"1min":1.0289999999999999,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":1.958,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Aug 10 10:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.5009999999999999,"15min":1.444},"min":{"1min":0.81100000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.833,"5min":2.4129999999999998,"15min":2.742},"last":1.349},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4970000000000001,"15min":1.4159999999999999},"min":{"1min":0.878,"5min":0.82699999999999996,"15min":0.625},"max":{"1min":1.883,"5min":2.1640000000000001,"15min":2.605},"last":1.599}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.0089999999999999,"15min":0.97499999999999998},"min":{"1min":0.46200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2290000000000001,"5min":8.6899999999999995,"15min":8.6899999999999995},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.165,"15min":1.069},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.4339999999999999,"5min":11.173,"15min":11.173},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":1.02},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.39000000000000001},"max":{"1min":1.387,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.028},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47399999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.012,"15min":0.97299999999999998},"min":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3120000000000001,"5min":4.8570000000000002,"15min":5.9980000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.2729999999999999,"15min":1.1579999999999999},"min":{"1min":0.65400000000000003,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.7509999999999999,"5min":10.739000000000001,"15min":10.739000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3660000000000001,"15min":1.306},"min":{"1min":0.95199999999999996,"5min":0.88800000000000001,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":4.6980000000000004,"15min":6.5209999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4810000000000001,"15min":1.4239999999999999},"min":{"1min":1.0820000000000001,"5min":0.751,"15min":0.751},"max":{"1min":1.885,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3959999999999999,"15min":1.373},"min":{"1min":0.91000000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.831,"5min":1.948,"15min":1.986},"last":1.359},{"interface":"front","average":{"1min":1.216,"5min":1.3999999999999999,"15min":1.3799999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":7.532,"15min":16.058},"last":1.397}]},{"osd":6,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.46,"15min":1.4530000000000001},"min":{"1min":0.96099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.004,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.452,"15min":1.4330000000000001},"min":{"1min":0.86499999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.998,"5min":2.3359999999999999,"15min":3.2240000000000002},"last":1.431}]},{"osd":7,"last update":"Thu Aug 10 10:47:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.5,"15min":1.518},"min":{"1min":1.024,"5min":0.76500000000000001,"15min":0.752},"max":{"1min":1.825,"5min":2.4460000000000002,"15min":3.3330000000000002},"last":1.508},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.468,"15min":1.4379999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7809999999999999,"5min":4.9939999999999998,"15min":6.5670000000000002},"last":1.175}]}]}],"pool_statfs":[]}} 2023-08-10T10:47:33.137 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:47:33.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:47:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.410+0000 7f0ff4942640 1 Processor -- start 2023-08-10T10:47:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.410+0000 7f0ff4942640 1 -- start start 2023-08-10T10:47:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.412+0000 7f0ff4942640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ff015cbb0 0x7f0ff01612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.412+0000 7f0ff4942640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff0161800 con 0x7f0ff00c9420 2023-08-10T10:47:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.412+0000 7f0ff4942640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff0160870 con 0x7f0ff00c98b0 2023-08-10T10:47:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.412+0000 7f0ff4942640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00ca370 con 0x7f0ff015cbb0 2023-08-10T10:47:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ff015cbb0 0x7f0ff01612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ff015cbb0 0x7f0ff01612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49540/0 (socket says 172.21.15.50:49540) 2023-08-10T10:47:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 -- 172.21.15.50:0/124807635 learned_addr learned my addr 172.21.15.50:0/124807635 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0feed9d640 1 --1- 172.21.15.50:0/124807635 >> v1:172.21.15.50:6789/0 conn(0x7f0ff00c9420 0x7f0ff006f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46076/0 (socket says 172.21.15.50:46076) 2023-08-10T10:47:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 -- 172.21.15.50:0/124807635 >> v1:172.21.15.117:6789/0 conn(0x7f0ff00c98b0 legacy=0x7f0ff00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 -- 172.21.15.50:0/124807635 >> v1:172.21.15.50:6789/0 conn(0x7f0ff00c9420 legacy=0x7f0ff006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fee59c640 1 -- 172.21.15.50:0/124807635 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff00ca650 con 0x7f0ff015cbb0 2023-08-10T10:47:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.413+0000 7f0fed59a640 1 -- 172.21.15.50:0/124807635 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718204157 0 0) 0x7f0fe8001490 con 0x7f0ff00c9420 2023-08-10T10:47:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.414+0000 7f0fee59c640 1 --2- 172.21.15.50:0/124807635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01612c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6967136436b97b44 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.415+0000 7f0fed59a640 1 -- 172.21.15.50:0/124807635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0031870 con 0x7f0ff015cbb0 2023-08-10T10:47:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.415+0000 7f0fed59a640 1 -- 172.21.15.50:0/124807635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe00319d0 con 0x7f0ff015cbb0 2023-08-10T10:47:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.415+0000 7f0fed59a640 1 -- 172.21.15.50:0/124807635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0031d60 con 0x7f0ff015cbb0 2023-08-10T10:47:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.415+0000 7f0ff4942640 1 -- 172.21.15.50:0/124807635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff015cbb0 msgr2=0x7f0ff01612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.415+0000 7f0ff4942640 1 --2- 172.21.15.50:0/124807635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01612c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe002b910 comp rx=0 tx=0).stop 2023-08-10T10:47:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.416+0000 7f0ff4942640 1 -- 172.21.15.50:0/124807635 shutdown_connections 2023-08-10T10:47:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.416+0000 7f0ff4942640 1 --2- 172.21.15.50:0/124807635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01612c0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.416+0000 7f0ff4942640 1 -- 172.21.15.50:0/124807635 >> 172.21.15.50:0/124807635 conn(0x7f0ff00b01b0 msgr2=0x7f0ff00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.416+0000 7f0ff4942640 1 -- 172.21.15.50:0/124807635 shutdown_connections 2023-08-10T10:47:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.416+0000 7f0ff4942640 1 -- 172.21.15.50:0/124807635 wait complete. 2023-08-10T10:47:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.418+0000 7f0ff4942640 1 Processor -- start 2023-08-10T10:47:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.418+0000 7f0ff4942640 1 -- start start 2023-08-10T10:47:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c98b0 0x7f0ff015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00b1e20 con 0x7f0ff00c9420 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff015f680 con 0x7f0ff015cbb0 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0ff4942640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00c6830 con 0x7f0ff00c98b0 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0fee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.419+0000 7f0fee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49548/0 (socket says 172.21.15.50:49548) 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 -- 172.21.15.50:0/1600658003 learned_addr learned my addr 172.21.15.50:0/1600658003 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fedd9b640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c98b0 0x7f0ff015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0feed9d640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 -- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c98b0 msgr2=0x7f0ff015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c98b0 0x7f0ff015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 -- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff015cbb0 msgr2=0x7f0ff01f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 -- 172.21.15.50:0/1600658003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00094d0 con 0x7f0ff00c9420 2023-08-10T10:47:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.420+0000 7f0fee59c640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.421+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe003ad30 con 0x7f0ff00c9420 2023-08-10T10:47:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.421+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe003ae90 con 0x7f0ff00c9420 2023-08-10T10:47:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.421+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff00c6b10 con 0x7f0ff00c9420 2023-08-10T10:47:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.421+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0044630 con 0x7f0ff00c9420 2023-08-10T10:47:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.421+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff00c70d0 con 0x7f0ff00c9420 2023-08-10T10:47:33.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.422+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff00612b0 con 0x7f0ff00c9420 2023-08-10T10:47:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.423+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fe004d450 con 0x7f0ff00c9420 2023-08-10T10:47:33.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.424+0000 7f0fdeffd640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 0x7f0fd006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.424+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fe002d040 con 0x7f0ff00c9420 2023-08-10T10:47:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.425+0000 7f0fedd9b640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 0x7f0fd006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.425+0000 7f0fedd9b640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 0x7f0fd006d110 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.428+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0fe0076c70 con 0x7f0ff00c9420 2023-08-10T10:47:33.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.686+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0ff00c89d0 con 0x7f0ff00c9420 2023-08-10T10:47:33.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.692+0000 7f0fdeffd640 1 -- 172.21.15.50:0/1600658003 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0fe007a290 con 0x7f0ff00c9420 2023-08-10T10:47:33.693 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:47:33.693 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:47:33.693 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:47:33.694 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:47:33.694 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:47:33.694 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:47:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 msgr2=0x7f0fd006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 0x7f0fd006d110 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4008040 comp rx=0 tx=0).stop 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 msgr2=0x7f0ff00c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe00046c0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 shutdown_connections 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0fd006ac50 0x7f0fd006d110 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff015cbb0 0x7f0ff01f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c98b0 0x7f0ff015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 --2- 172.21.15.50:0/1600658003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00c9420 0x7f0ff00c61a0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 >> 172.21.15.50:0/1600658003 conn(0x7f0ff00b01b0 msgr2=0x7f0ff015ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 shutdown_connections 2023-08-10T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.695+0000 7f0ff4942640 1 -- 172.21.15.50:0/1600658003 wait complete. 2023-08-10T10:47:33.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.928+0000 7f9ea0ec5640 1 Processor -- start 2023-08-10T10:47:33.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.928+0000 7f9ea0ec5640 1 -- start start 2023-08-10T10:47:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9ea0ec5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e9c0b8430 0x7f9e9c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9ea0ec5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c161180 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9ea0ec5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c161460 con 0x7f9e9c15cd60 2023-08-10T10:47:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9ea0ec5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ce240 con 0x7f9e9c0b8430 2023-08-10T10:47:33.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9e9ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e9c0cddb0 0x7f9e9c0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46092/0 (socket says 172.21.15.50:46092) 2023-08-10T10:47:33.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9e9ad9d640 1 -- 172.21.15.50:0/2777685076 learned_addr learned my addr 172.21.15.50:0/2777685076 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:33.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.930+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e9c0b8430 0x7f9e9c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074663926 0 0) 0x7f9e9c161180 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e88003520 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766560863 0 0) 0x7f9e9c161460 con 0x7f9e9c15cd60 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c161180 con 0x7f9e9c15cd60 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421773564 0 0) 0x7f9e88003520 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e9c0b8430 msgr2=0x7f9e9c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e9c0b8430 0x7f9e9c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 >> v1:172.21.15.117:6789/0 conn(0x7f9e9c15cd60 legacy=0x7f9e9c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c161740 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9e94001670 con 0x7f9e9c0cddb0 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 >> v1:172.21.15.50:6789/0 conn(0x7f9e9c0cddb0 legacy=0x7f9e9c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e88003b30 0x7f9e88003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880047c0 0x7f9e88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e88005180 0x7f9e8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ce240 con 0x7f9e880047c0 2023-08-10T10:47:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8800bf20 con 0x7f9e88005180 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.931+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8800c0e0 con 0x7f9e88003b30 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880047c0 0x7f9e88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e9ad9d640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e88005180 0x7f9e8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e9a59c640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e88003b30 0x7f9e88003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 -- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e88003b30 msgr2=0x7f9e88003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e88003b30 0x7f9e88003f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 -- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e88005180 msgr2=0x7f9e8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e88005180 0x7f9e8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.932+0000 7f9e91d9b640 1 -- 172.21.15.50:0/2777685076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88003520 con 0x7f9e880047c0 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.933+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880047c0 0x7f9e88004c40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0d2a20 tx=0x7f9e880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbe45296a67a014 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8402c580 con 0x7f9e880047c0 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8402c6e0 con 0x7f9e880047c0 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9e99d9b640 1 -- 172.21.15.50:0/2777685076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8402ca50 con 0x7f9e880047c0 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/2777685076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880047c0 msgr2=0x7f9e88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/2777685076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e880047c0 0x7f9e88004c40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0d2a20 tx=0x7f9e880057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9e9ad9d640 1 -- 172.21.15.50:0/2777685076 reap_dead start 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/2777685076 shutdown_connections 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/2777685076 >> 172.21.15.50:0/2777685076 conn(0x7f9e9c0d2ac0 msgr2=0x7f9e9c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/2777685076 shutdown_connections 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.934+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/2777685076 wait complete. 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.936+0000 7f9ea0ec5640 1 Processor -- start 2023-08-10T10:47:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.936+0000 7f9ea0ec5640 1 -- start start 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e880047c0 0x7f9e9c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 0x7f9e9c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1f27c0 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ca000 con 0x7f9e9c1578f0 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.937+0000 7f9ea0ec5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ca2e0 con 0x7f9e880047c0 2023-08-10T10:47:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49578/0 (socket says 172.21.15.50:49578) 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 -- 172.21.15.50:0/1589248483 learned_addr learned my addr 172.21.15.50:0/1589248483 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e9a59c640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e880047c0 0x7f9e9c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e9ad9d640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 0x7f9e9c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 -- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e880047c0 msgr2=0x7f9e9c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e880047c0 0x7f9e9c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 -- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 msgr2=0x7f9e9c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 0x7f9e9c157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e91d9b640 1 -- 172.21.15.50:0/1589248483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0ca5c0 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.938+0000 7f9e9ad9d640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 0x7f9e9c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9e91d9b640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9e84037040 tx=0x7f9e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8402dea0 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84003850 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84003c00 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c0ca8a0 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.939+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c158510 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.940+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c066390 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.941+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e84040450 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.943+0000 7f9e937fe640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 0x7f9e7c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:33.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.943+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e840ab700 con 0x7f9e9c0c9b00 2023-08-10T10:47:33.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.943+0000 7f9e9a59c640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 0x7f9e7c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:33.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.944+0000 7f9e9a59c640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 0x7f9e7c06d140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c007fd0 tx=0x7f9e8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:33.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:33.947+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9e84076830 con 0x7f9e9c0c9b00 2023-08-10T10:47:34.020 INFO:tasks.ceph.mds.b.smithi117.stderr:2023-08-10T10:47:34.019+0000 7f4f7469c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:47:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.194+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e9c04e270 con 0x7f9e9c0c9b00 2023-08-10T10:47:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.195+0000 7f9e937fe640 1 -- 172.21.15.50:0/1589248483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f9e84079e50 con 0x7f9e9c0c9b00 2023-08-10T10:47:34.196 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:34.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:47:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:47:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.197+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 msgr2=0x7f9e7c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.197+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 0x7f9e7c06d140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c007fd0 tx=0x7f9e8c009040 comp rx=0 tx=0).stop 2023-08-10T10:47:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.197+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 msgr2=0x7f9e9c1f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.197+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9e84037040 tx=0x7f9e84004730 comp rx=0 tx=0).stop 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 shutdown_connections 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9e7c06ac80 0x7f9e7c06d140 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e9c1578f0 0x7f9e9c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e9c0c9b00 0x7f9e9c1f2280 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 --2- 172.21.15.50:0/1589248483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e880047c0 0x7f9e9c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 >> 172.21.15.50:0/1589248483 conn(0x7f9e9c0d2ac0 msgr2=0x7f9e9c0b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 shutdown_connections 2023-08-10T10:47:34.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.198+0000 7f9ea0ec5640 1 -- 172.21.15.50:0/1589248483 wait complete. 2023-08-10T10:47:34.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:47:27.565751+0000', 'modified': '2023-08-10T10:47:31.117672+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8502': {'gid': 8502, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6834/3094444013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6832', 'nonce': 3094444013}, {'type': 'v1', 'addr': '172.21.15.117:6834', 'nonce': 3094444013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:47:34.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:47:34.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:47:34.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.859+0000 7fba1359e640 1 Processor -- start 2023-08-10T10:47:34.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.859+0000 7fba1359e640 1 -- start start 2023-08-10T10:47:34.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba1359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba1359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba14160370 con 0x7fba140cd960 2023-08-10T10:47:34.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba1359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140d0d90 con 0x7fba140d28b0 2023-08-10T10:47:34.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba1359e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140d0b90 con 0x7fba1415ff90 2023-08-10T10:47:34.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba11d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba140cd960 0x7fba140d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46104/0 (socket says 172.21.15.50:46104) 2023-08-10T10:47:34.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.860+0000 7fba11d9b640 1 -- 172.21.15.50:0/839199869 learned_addr learned my addr 172.21.15.50:0/839199869 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:34.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1259c640 1 --2- 172.21.15.50:0/839199869 >> v2:172.21.15.117:3300/0 conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436408485 0 0) 0x7fba08001110 con 0x7fba140cd960 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc003520 con 0x7fba140cd960 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497873872 0 0) 0x7fb9fc003520 con 0x7fba140cd960 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 >> v2:172.21.15.117:3300/0 conn(0x7fba1415ff90 msgr2=0x7fba14160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 --2- 172.21.15.50:0/839199869 >> v2:172.21.15.117:3300/0 conn(0x7fba1415ff90 0x7fba14160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 >> v1:172.21.15.117:6789/0 conn(0x7fba140d28b0 legacy=0x7fba140d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140d1070 con 0x7fba140cd960 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.861+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fba08001800 con 0x7fba140cd960 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 >> v1:172.21.15.50:6789/0 conn(0x7fba140cd960 legacy=0x7fba140d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140d0b90 con 0x7fb9fc005180 2023-08-10T10:47:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c0b0 con 0x7fb9fc0039e0 2023-08-10T10:47:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c270 con 0x7fb9fc0047c0 2023-08-10T10:47:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba12d9d640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba1259c640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba12d9d640 1 -- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc0047c0 msgr2=0x7fb9fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.862+0000 7fba11d9b640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba12d9d640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba12d9d640 1 -- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0039e0 msgr2=0x7fb9fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba12d9d640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba12d9d640 1 -- 172.21.15.50:0/839199869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc003520 con 0x7fb9fc005180 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba1259c640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0039e0 0x7fb9fc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.863+0000 7fba11d9b640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.864+0000 7fba12d9d640 1 -- 172.21.15.50:0/839199869 reap_dead start 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.864+0000 7fba12d9d640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 0x7fb9fc00b980 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001750 tx=0x7fb9fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45934999fb3e627b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.864+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0052d0 con 0x7fb9fc005180 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.864+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c02e050 con 0x7fb9fc005180 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.864+0000 7fba1159a640 1 -- 172.21.15.50:0/839199869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c003830 con 0x7fb9fc005180 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 -- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 msgr2=0x7fb9fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 0x7fb9fc00b980 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001750 tx=0x7fb9fc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 -- 172.21.15.50:0/839199869 shutdown_connections 2023-08-10T10:47:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 --2- 172.21.15.50:0/839199869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 -- 172.21.15.50:0/839199869 >> 172.21.15.50:0/839199869 conn(0x7fba14069ac0 msgr2=0x7fba14069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 -- 172.21.15.50:0/839199869 shutdown_connections 2023-08-10T10:47:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.865+0000 7fba1359e640 1 -- 172.21.15.50:0/839199869 wait complete. 2023-08-10T10:47:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.867+0000 7fba1359e640 1 Processor -- start 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.867+0000 7fba1359e640 1 -- start start 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 0x7fba140b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1415c370 0x7fba140b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140ca760 con 0x7fba140cb490 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140b5080 con 0x7fba1415c370 2023-08-10T10:47:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba1359e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140ca9b0 con 0x7fb9fc005180 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba12d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba12d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49588/0 (socket says 172.21.15.50:49588) 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.868+0000 7fba12d9d640 1 -- 172.21.15.50:0/1243190083 learned_addr learned my addr 172.21.15.50:0/1243190083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba1259c640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 0x7fba140b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 -- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 msgr2=0x7fba140b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 0x7fba140b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 -- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1415c370 msgr2=0x7fba140b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba11d9b640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1415c370 0x7fba140b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1415c370 0x7fba140b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 -- 172.21.15.50:0/1243190083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140cac90 con 0x7fba140cb490 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba1259c640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 0x7fba140b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba12d9d640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001870 tx=0x7fba0c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba02ffd640 1 -- 172.21.15.50:0/1243190083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0054e0 con 0x7fba140cb490 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.869+0000 7fba02ffd640 1 -- 172.21.15.50:0/1243190083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c007a30 con 0x7fba140cb490 2023-08-10T10:47:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.870+0000 7fba02ffd640 1 -- 172.21.15.50:0/1243190083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c007230 con 0x7fba140cb490 2023-08-10T10:47:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.870+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba140ca760 con 0x7fba140cb490 2023-08-10T10:47:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.870+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba140b28d0 con 0x7fba140cb490 2023-08-10T10:47:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.872+0000 7fba02ffd640 1 -- 172.21.15.50:0/1243190083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba0c03a070 con 0x7fba140cb490 2023-08-10T10:47:34.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.874+0000 7fba02ffd640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 0x7fb9f406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.874+0000 7fba02ffd640 1 -- 172.21.15.50:0/1243190083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba0c037070 con 0x7fba140cb490 2023-08-10T10:47:34.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.874+0000 7fba1259c640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 0x7fb9f406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.874+0000 7fba1b57a740 1 Processor -- start 2023-08-10T10:47:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 -- start start 2023-08-10T10:47:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1259c640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 0x7fb9f406d110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba04007380 tx=0x7fba0400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d39610 0x5572d3d66900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d3d210 0x5572d3d66e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3ca99d0 con 0x5572d3d69690 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3ca70c0 con 0x5572d3d39610 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.875+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572d3ca29b0 con 0x5572d3d3d210 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49598/0 (socket says 172.21.15.50:49598) 2023-08-10T10:47:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 -- 172.21.15.50:0/2713086024 learned_addr learned my addr 172.21.15.50:0/2713086024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 -- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d3d210 msgr2=0x5572d3d66e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d3d210 0x5572d3d66e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 -- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d39610 msgr2=0x5572d3d66900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d39610 0x5572d3d66900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.876+0000 7fba1259c640 1 -- 172.21.15.50:0/2713086024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572d3c6fc10 con 0x5572d3d69690 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fba1259c640 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fba04017830 tx=0x7fba04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2cdc6857c494b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fb9f3fff640 1 -- 172.21.15.50:0/2713086024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e040 con 0x5572d3d69690 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fb9f3fff640 1 -- 172.21.15.50:0/2713086024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0401b070 con 0x5572d3d69690 2023-08-10T10:47:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fb9f3fff640 1 -- 172.21.15.50:0/2713086024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04017e70 con 0x5572d3d69690 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fba1b57a740 1 -- 172.21.15.50:0/2713086024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 msgr2=0x5572d3d69a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.877+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fba04017830 tx=0x7fba04014000 comp rx=0 tx=0).stop 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 -- 172.21.15.50:0/2713086024 shutdown_connections 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d3d210 0x5572d3d66e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d39610 0x5572d3d66900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2713086024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d69a70 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 -- 172.21.15.50:0/2713086024 >> 172.21.15.50:0/2713086024 conn(0x5572d3d3b920 msgr2=0x5572d3d844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 -- 172.21.15.50:0/2713086024 shutdown_connections 2023-08-10T10:47:34.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 -- 172.21.15.50:0/2713086024 wait complete. 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.878+0000 7fba1b57a740 1 -- start start 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.879+0000 7fba1b57a740 1 Processor -- start 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d60050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d6c790 0x5572d3d6cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3c43940 con 0x5572d3d3d210 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3c435e0 con 0x5572d3d6c790 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572d3a09f20 con 0x5572d3d69690 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1b57a740 10 client.0 _ll_register_callbacks cb 0x5572d3c9c250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49600/0 (socket says 172.21.15.50:49600) 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 -- 172.21.15.50:0/2759388430 learned_addr learned my addr 172.21.15.50:0/2759388430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba11d9b640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d60050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba12d9d640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d6c790 0x5572d3d6cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 -- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 msgr2=0x5572d3d60050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d60050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 -- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d6c790 msgr2=0x5572d3d6cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d6c790 0x5572d3d6cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.880+0000 7fba1259c640 1 -- 172.21.15.50:0/2759388430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba040174e0 con 0x5572d3d3d210 2023-08-10T10:47:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fba1259c640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fba04017f60 tx=0x7fba04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dae8aaf6587327 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fb9f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e040 con 0x5572d3d3d210 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572d3cccbf0 con 0x5572d3d3d210 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba04004020 con 0x5572d3d3d210 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba040041e0 con 0x5572d3d3d210 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.881+0000 7fba1b57a740 10 client.8637 fetch_fsmap learned FSMap version 76 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x5572d3ca1030 con 0x5572d3d3d210 2023-08-10T10:47:34.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572d3cccbf0 con 0x5572d3d3d210 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba04004340 con 0x5572d3d3d210 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 10 client.8637 fetch_fsmap finished waiting for FSMap version 76 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 10 client.8637 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 20 client.8637 populate_metadata read hostname 'smithi050' 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d6a130 0x5572d3d97cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 4 client.8637 mds_command: new command op to 8502 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:47:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.882+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 --> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572d3c957c0 con 0x5572d3d6a130 2023-08-10T10:47:34.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.883+0000 7fba11d9b640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d6a130 0x5572d3d97cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.884+0000 7fba11d9b640 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d6a130 0x5572d3d97cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba7c62078e66fc server_cookie=8fe4620b763298f7 in_seq=0 out_seq=0 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.884+0000 7fb9f17fa640 10 client.8637 ms_handle_connect on v2:172.21.15.117:6832/3094444013 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fb9f17fa640 1 -- 172.21.15.50:0/2759388430 <== mds.0 v2:172.21.15.117:6832/3094444013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5572d3c957c0 con 0x5572d3d6a130 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fb9f17fa640 10 client.8637 handle_command_reply: tid=0 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 client.8637 shutdown 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 msgr2=0x5572d3d53b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fba04017f60 tx=0x7fba04004ab0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 shutdown_connections 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d6a130 0x5572d3d97cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d6c790 0x5572d3d6cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d60050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fb9f17fa640 0 client.8637 ms_handle_reset on v2:172.21.15.117:6832/3094444013 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 --2- 172.21.15.50:0/2759388430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d3d210 0x5572d3d53b00 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 >> 172.21.15.50:0/2759388430 conn(0x5572d3d39610 msgr2=0x5572d3d3da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 shutdown_connections 2023-08-10T10:47:34.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.886+0000 7fba1b57a740 1 -- 172.21.15.50:0/2759388430 wait complete. 2023-08-10T10:47:34.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.887+0000 7fba1b57a740 20 client.8637 trim_cache size 0 max 16384 2023-08-10T10:47:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.903+0000 7fba1b57a740 1 Processor -- start 2023-08-10T10:47:34.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.903+0000 7fba1b57a740 1 -- start start 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3d66340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d66880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d977d0 con 0x5572d3d6c790 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d403a0 con 0x5572d3d3d210 2023-08-10T10:47:34.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.904+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d6b000 con 0x5572d3d69690 2023-08-10T10:47:34.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55448/0 (socket says 172.21.15.50:55448) 2023-08-10T10:47:34.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 -- 172.21.15.50:0/810282224 learned_addr learned my addr 172.21.15.50:0/810282224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:34.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba1259c640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3d66340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba11d9b640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 -- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 msgr2=0x5572d3d66880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d66880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 -- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 msgr2=0x5572d3d66340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3d66340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 -- 172.21.15.50:0/810282224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572d3cd68a0 con 0x5572d3d6c790 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba1259c640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3d66340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.905+0000 7fba12d9d640 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02be60 tx=0x7fba0c07f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6670c91f53b207e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba00ff9640 1 -- 172.21.15.50:0/810282224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c077590 con 0x5572d3d6c790 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba00ff9640 1 -- 172.21.15.50:0/810282224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c001370 con 0x5572d3d6c790 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba00ff9640 1 -- 172.21.15.50:0/810282224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0aa0c0 con 0x5572d3d6c790 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 -- 172.21.15.50:0/810282224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 msgr2=0x5572d3d879b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02be60 tx=0x7fba0c07f050 comp rx=0 tx=0).stop 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 -- 172.21.15.50:0/810282224 shutdown_connections 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d6c790 0x5572d3d879b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d69690 0x5572d3d66880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 --2- 172.21.15.50:0/810282224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3d66340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 -- 172.21.15.50:0/810282224 >> 172.21.15.50:0/810282224 conn(0x5572d3d39610 msgr2=0x5572d3d64160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 -- 172.21.15.50:0/810282224 shutdown_connections 2023-08-10T10:47:34.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.906+0000 7fba1b57a740 1 -- 172.21.15.50:0/810282224 wait complete. 2023-08-10T10:47:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.907+0000 7fba1b57a740 1 -- start start 2023-08-10T10:47:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.907+0000 7fba1b57a740 1 Processor -- start 2023-08-10T10:47:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3dec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d6c790 0x5572d3d87ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d39280 con 0x5572d3d69690 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d87280 con 0x5572d3d3d210 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572d3d65580 con 0x5572d3d6c790 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.908+0000 7fba1b57a740 10 client.0 _ll_register_callbacks cb 0x7fba04017e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55458/0 (socket says 172.21.15.50:55458) 2023-08-10T10:47:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 -- 172.21.15.50:0/239570911 learned_addr learned my addr 172.21.15.50:0/239570911 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba1259c640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3dec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba12d9d640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d6c790 0x5572d3d87ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 -- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d6c790 msgr2=0x5572d3d87ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d6c790 0x5572d3d87ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 -- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 msgr2=0x5572d3dec150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3dec150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 -- 172.21.15.50:0/239570911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba140b28d0 con 0x5572d3d69690 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fba11d9b640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fba141f5bf0 tx=0x7fba08017600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5af4873b6f8bad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.909+0000 7fb9f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08015ae0 con 0x5572d3d69690 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba0800c040 con 0x5572d3d69690 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba0401b070 con 0x5572d3d69690 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba08015c40 con 0x5572d3d69690 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 10 client.8643 fetch_fsmap learned FSMap version 76 2023-08-10T10:47:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x5572d3c42610 con 0x5572d3d69690 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0401b070 con 0x5572d3d69690 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba08012040 con 0x5572d3d69690 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 10 client.8643 fetch_fsmap finished waiting for FSMap version 76 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 10 client.8643 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 20 client.8643 populate_metadata read hostname 'smithi050' 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.910+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d92f80 0x5572d3d93360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.911+0000 7fba1b57a740 4 client.8643 mds_command: new command op to 8502 tid=0[{"prefix": "status"}] 2023-08-10T10:47:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.911+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 --> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5572d3c9b990 con 0x5572d3d92f80 2023-08-10T10:47:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.911+0000 7fba1259c640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d92f80 0x5572d3d93360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.912+0000 7fba1259c640 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d92f80 0x5572d3d93360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be0a41302e791ed server_cookie=cfebf70f59a5bebf in_seq=0 out_seq=0 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.912+0000 7fb9f17fa640 10 client.8643 ms_handle_connect on v2:172.21.15.117:6832/3094444013 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fb9f17fa640 1 -- 172.21.15.50:0/239570911 <== mds.0 v2:172.21.15.117:6832/3094444013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5572d3c9b990 con 0x5572d3d92f80 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fb9f17fa640 10 client.8643 handle_command_reply: tid=0 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 client.8643 shutdown 2023-08-10T10:47:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 msgr2=0x5572d3d879b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fba141f5bf0 tx=0x7fba08017600 comp rx=0 tx=0).stop 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 shutdown_connections 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572d3d6c790 0x5572d3d87ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572d3d69690 0x5572d3d879b0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:6832/3094444013,v1:172.21.15.117:6834/3094444013] conn(0x5572d3d92f80 0x5572d3d93360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 --2- 172.21.15.50:0/239570911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572d3d3d210 0x5572d3dec150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 >> 172.21.15.50:0/239570911 conn(0x5572d3d39610 msgr2=0x5572d3d3f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.913+0000 7fb9f17fa640 0 client.8643 ms_handle_reset on v2:172.21.15.117:6832/3094444013 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 shutdown_connections 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1b57a740 1 -- 172.21.15.50:0/239570911 wait complete. 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1b57a740 20 client.8643 trim_cache size 0 max 16384 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:47:34.920 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8502, 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.8588467949999998, 2023-08-10T10:47:34.921 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 76, 2023-08-10T10:47:34.922 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 158, 2023-08-10T10:47:34.922 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 158, 2023-08-10T10:47:34.922 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.810020608 2023-08-10T10:47:34.922 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 msgr2=0x7fb9f406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 0x7fb9f406d110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba04007380 tx=0x7fba0400b040 comp rx=0 tx=0).stop 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 msgr2=0x7fba140cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001870 tx=0x7fba0c001120 comp rx=0 tx=0).stop 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 shutdown_connections 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba140cb490 0x7fba140cb910 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb9f406ac50 0x7fb9f406d110 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1415c370 0x7fba140b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 --2- 172.21.15.50:0/1243190083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc005180 0x7fba140b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.914+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 >> 172.21.15.50:0/1243190083 conn(0x7fba14069ac0 msgr2=0x7fba140d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.915+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 shutdown_connections 2023-08-10T10:47:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:34.915+0000 7fba1359e640 1 -- 172.21.15.50:0/1243190083 wait complete. 2023-08-10T10:47:34.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:47:35.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.162+0000 7fc7626bf640 1 Processor -- start 2023-08-10T10:47:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.162+0000 7fc7626bf640 1 -- start start 2023-08-10T10:47:35.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7626bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c15e3a0 0x7fc75c071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7626bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75c0cf810 0x7fc75c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7626bf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0cfd40 con 0x7fc75c0cd220 2023-08-10T10:47:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7626bf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0d0020 con 0x7fc75c0cf810 2023-08-10T10:47:35.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7626bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0d0300 con 0x7fc75c15e3a0 2023-08-10T10:47:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.163+0000 7fc7537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75c0cf810 0x7fc75c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75c0cf810 0x7fc75c0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55460/0 (socket says 172.21.15.50:55460) 2023-08-10T10:47:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 -- 172.21.15.50:0/1118571012 learned_addr learned my addr 172.21.15.50:0/1118571012 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc75bfff640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c15e3a0 0x7fc75c071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 -- 172.21.15.50:0/1118571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c15e3a0 msgr2=0x7fc75c071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c15e3a0 0x7fc75c071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 -- 172.21.15.50:0/1118571012 >> v1:172.21.15.50:6789/0 conn(0x7fc75c0cd220 legacy=0x7fc75c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:35.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.164+0000 7fc7537fe640 1 -- 172.21.15.50:0/1118571012 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0d05e0 con 0x7fc75c0cf810 2023-08-10T10:47:35.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.165+0000 7fc7537fe640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c0cf810 0x7fc75c0b36a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc744009870 tx=0x7fc74402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73125e0fa9ad552 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:35.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc75b7fe640 1 -- 172.21.15.50:0/1118571012 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744031640 con 0x7fc75c0cf810 2023-08-10T10:47:35.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc75b7fe640 1 -- 172.21.15.50:0/1118571012 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440317a0 con 0x7fc75c0cf810 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc75b7fe640 1 -- 172.21.15.50:0/1118571012 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744031b30 con 0x7fc75c0cf810 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 -- 172.21.15.50:0/1118571012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c0cf810 msgr2=0x7fc75c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c0cf810 0x7fc75c0b36a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc744009870 tx=0x7fc74402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 -- 172.21.15.50:0/1118571012 shutdown_connections 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c0cf810 0x7fc75c0b36a0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 --2- 172.21.15.50:0/1118571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c15e3a0 0x7fc75c071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 -- 172.21.15.50:0/1118571012 >> 172.21.15.50:0/1118571012 conn(0x7fc75c0b2380 msgr2=0x7fc75c0b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:35.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 -- 172.21.15.50:0/1118571012 shutdown_connections 2023-08-10T10:47:35.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.166+0000 7fc7626bf640 1 -- 172.21.15.50:0/1118571012 wait complete. 2023-08-10T10:47:35.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.168+0000 7fc7626bf640 1 Processor -- start 2023-08-10T10:47:35.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.168+0000 7fc7626bf640 1 -- start start 2023-08-10T10:47:35.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc75c0cd220 0x7fc75c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c0cf810 0x7fc75c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1f39c0 con 0x7fc75c15e3a0 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0ad080 con 0x7fc75c0cd220 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.169+0000 7fc7626bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1f36e0 con 0x7fc75c0cf810 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55464/0 (socket says 172.21.15.50:55464) 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 -- 172.21.15.50:0/878479159 learned_addr learned my addr 172.21.15.50:0/878479159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc75bfff640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc75c0cd220 0x7fc75c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc7537fe640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c0cf810 0x7fc75c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 -- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c0cf810 msgr2=0x7fc75c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c0cf810 0x7fc75c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 -- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc75c0cd220 msgr2=0x7fc75c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:35.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc75c0cd220 0x7fc75c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.170+0000 7fc760c5c640 1 -- 172.21.15.50:0/878479159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440094d0 con 0x7fc75c15e3a0 2023-08-10T10:47:35.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc760c5c640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc75400b970 tx=0x7fc75400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75400cb40 con 0x7fc75c15e3a0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400cca0 con 0x7fc75c15e3a0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754014680 con 0x7fc75c15e3a0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0aca30 con 0x7fc75c15e3a0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.171+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c0ad510 con 0x7fc75c15e3a0 2023-08-10T10:47:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.172+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0ac890 con 0x7fc75c15e3a0 2023-08-10T10:47:35.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.173+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc75401d3b0 con 0x7fc75c15e3a0 2023-08-10T10:47:35.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.174+0000 7fc7597fa640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:35.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.174+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7540893b0 con 0x7fc75c15e3a0 2023-08-10T10:47:35.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.175+0000 7fc75bfff640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.175+0000 7fc75bfff640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0c9cc0 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:35.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.179+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc75c0ac890 con 0x7fc75c15e3a0 2023-08-10T10:47:35.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.411+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc75c0ac890 con 0x7fc75c15e3a0 2023-08-10T10:47:35.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.412+0000 7fc7597fa640 1 -- 172.21.15.50:0/878479159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc75c0ac890 con 0x7fc75c15e3a0 2023-08-10T10:47:35.412 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:47:35.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 msgr2=0x7fc74006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:35.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0c9cc0 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2023-08-10T10:47:35.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 msgr2=0x7fc75c0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:35.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc75400b970 tx=0x7fc75400be30 comp rx=0 tx=0).stop 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 shutdown_connections 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75c15e3a0 0x7fc75c0c93e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc75c0cf810 0x7fc75c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.414+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.415+0000 7fc7626bf640 1 --2- 172.21.15.50:0/878479159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc75c0cd220 0x7fc75c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:35.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.415+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 >> 172.21.15.50:0/878479159 conn(0x7fc75c0b2380 msgr2=0x7fc75c15b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:35.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.415+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 shutdown_connections 2023-08-10T10:47:35.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:35.415+0000 7fc7626bf640 1 -- 172.21.15.50:0/878479159 wait complete. 2023-08-10T10:47:35.436 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:47:35.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:47:35.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:47:35.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:47:35.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:47:35.438 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:47:35.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:47:35.439 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:47:35.439 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:47:35.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.440 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:47:35.495 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:47:35.496 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:47:35.496 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:47:35.496 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.496 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40670sec preferred_lft 40670sec 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:47:35.498 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:47:35.499 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.500 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:47:35.501 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:47:35.501 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:47:35.501 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:35.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.502 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:47:35.599 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:47:35.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.604 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:47:35.664 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:47:35.664 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:47:35.665 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:47:35.665 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:47:35.665 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:47:35.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.666 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:47:35.666 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:47:35.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:47:35.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:47:35.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:47:35.668 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:47:35.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.865 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:47:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:47:35.922 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:47:35.922 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:47:35.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:35.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:47:36.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:47:36.026 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:47:36.088 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:47:36.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:47:36.090 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:47:36.146 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:47:36.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:36.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:36.301 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:36.302 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:47:36.338 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:36.338 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:47:36.338 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:47:36.338 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:47:36.339 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:47:36.340 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:47:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:47:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:47:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:47:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:47:36.345 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:47:36.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:36.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:47:36.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:36.444 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:47:36.526 INFO:teuthology.orchestra.run.smithi050.stdout:client6152 2023-08-10T10:47:36.527 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:47:36.527 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:36.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:47:36.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.804+0000 7fb3982ad640 1 Processor -- start 2023-08-10T10:47:36.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.804+0000 7fb3982ad640 1 -- start start 2023-08-10T10:47:36.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.805+0000 7fb3982ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900afbb0 0x7fb3900b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.805+0000 7fb3982ad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3900aff90 0x7fb3900b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.805+0000 7fb3982ad640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3900ceda0 0x7fb3900cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb3982ad640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900d0590 con 0x7fb3900aff90 2023-08-10T10:47:36.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb3982ad640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39006d5e0 con 0x7fb3900ceda0 2023-08-10T10:47:36.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb3982ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900cfa10 con 0x7fb3900afbb0 2023-08-10T10:47:36.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3900aff90 0x7fb3900b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3900aff90 0x7fb3900b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55480/0 (socket says 172.21.15.50:55480) 2023-08-10T10:47:36.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 -- 172.21.15.50:0/3498784717 learned_addr learned my addr 172.21.15.50:0/3498784717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:36.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb39684a640 1 --2- 172.21.15.50:0/3498784717 >> v2:172.21.15.117:3300/0 conn(0x7fb3900ceda0 0x7fb3900cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 -- 172.21.15.50:0/3498784717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900afbb0 msgr2=0x7fb3900b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:36.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 --2- 172.21.15.50:0/3498784717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900afbb0 0x7fb3900b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 -- 172.21.15.50:0/3498784717 >> v2:172.21.15.117:3300/0 conn(0x7fb3900ceda0 msgr2=0x7fb3900cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:36.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 --2- 172.21.15.50:0/3498784717 >> v2:172.21.15.117:3300/0 conn(0x7fb3900ceda0 0x7fb3900cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.806+0000 7fb395848640 1 -- 172.21.15.50:0/3498784717 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900cfcf0 con 0x7fb3900aff90 2023-08-10T10:47:36.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.807+0000 7fb395848640 1 --2- 172.21.15.50:0/3498784717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900aff90 0x7fb3900b28f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb390161c30 tx=0x7fb38002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874a72513406d4bb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:36.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.808+0000 7fb395047640 1 -- 172.21.15.50:0/3498784717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380031880 con 0x7fb3900aff90 2023-08-10T10:47:36.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.808+0000 7fb395047640 1 -- 172.21.15.50:0/3498784717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3800319e0 con 0x7fb3900aff90 2023-08-10T10:47:36.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.808+0000 7fb395047640 1 -- 172.21.15.50:0/3498784717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380031d70 con 0x7fb3900aff90 2023-08-10T10:47:36.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.808+0000 7fb3982ad640 1 -- 172.21.15.50:0/3498784717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900aff90 msgr2=0x7fb3900b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:36.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.808+0000 7fb3982ad640 1 --2- 172.21.15.50:0/3498784717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900aff90 0x7fb3900b28f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb390161c30 tx=0x7fb38002b920 comp rx=0 tx=0).stop 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 -- 172.21.15.50:0/3498784717 shutdown_connections 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 --2- 172.21.15.50:0/3498784717 >> v2:172.21.15.117:3300/0 conn(0x7fb3900ceda0 0x7fb3900cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 --2- 172.21.15.50:0/3498784717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900aff90 0x7fb3900b28f0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 --2- 172.21.15.50:0/3498784717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900afbb0 0x7fb3900b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 -- 172.21.15.50:0/3498784717 >> 172.21.15.50:0/3498784717 conn(0x7fb3900d0930 msgr2=0x7fb3900d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:36.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 -- 172.21.15.50:0/3498784717 shutdown_connections 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.809+0000 7fb3982ad640 1 -- 172.21.15.50:0/3498784717 wait complete. 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.810+0000 7fb3982ad640 1 Processor -- start 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.811+0000 7fb3982ad640 1 -- start start 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3900afbb0 0x7fb390158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 0x7fb3901f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39015de10 con 0x7fb3900ceda0 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901f36e0 con 0x7fb3900afbb0 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb3982ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901600a0 con 0x7fb3900aff90 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55496/0 (socket says 172.21.15.50:55496) 2023-08-10T10:47:36.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 -- 172.21.15.50:0/146425337 learned_addr learned my addr 172.21.15.50:0/146425337 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb395848640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 0x7fb3901f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb396049640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3900afbb0 0x7fb390158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 -- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 msgr2=0x7fb3901f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 0x7fb3901f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 -- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3900afbb0 msgr2=0x7fb390158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3900afbb0 0x7fb390158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:36.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.812+0000 7fb39684a640 1 -- 172.21.15.50:0/146425337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800094d0 con 0x7fb3900ceda0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb395848640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 0x7fb3901f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb39684a640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c550 tx=0x7fb38800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388004220 con 0x7fb3900ceda0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388004380 con 0x7fb3900ceda0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388003830 con 0x7fb3900ceda0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb390160380 con 0x7fb3900ceda0 2023-08-10T10:47:36.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.813+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39015da30 con 0x7fb3900ceda0 2023-08-10T10:47:36.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.815+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39015df50 con 0x7fb3900ceda0 2023-08-10T10:47:36.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.816+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb388003990 con 0x7fb3900ceda0 2023-08-10T10:47:36.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.816+0000 7fb386ffd640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 0x7fb37406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:36.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.817+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3880891e0 con 0x7fb3900ceda0 2023-08-10T10:47:36.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.817+0000 7fb396049640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 0x7fb37406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:36.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.817+0000 7fb396049640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 0x7fb37406d140 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009f20 tx=0x7fb38c0094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:36.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:36.821+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb39015df50 con 0x7fb3900ceda0 2023-08-10T10:47:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.051+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb39015df50 con 0x7fb3900ceda0 2023-08-10T10:47:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.052+0000 7fb386ffd640 1 -- 172.21.15.50:0/146425337 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb38801e060 con 0x7fb3900ceda0 2023-08-10T10:47:37.053 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:47:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.054+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 msgr2=0x7fb37406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.054+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 0x7fb37406d140 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009f20 tx=0x7fb38c0094f0 comp rx=0 tx=0).stop 2023-08-10T10:47:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.054+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 msgr2=0x7fb39015e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.054+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c550 tx=0x7fb38800ca10 comp rx=0 tx=0).stop 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 shutdown_connections 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3900ceda0 0x7fb39015e230 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3900aff90 0x7fb3901f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb37406ac80 0x7fb37406d140 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 --2- 172.21.15.50:0/146425337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3900afbb0 0x7fb390158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 >> 172.21.15.50:0/146425337 conn(0x7fb3900d0930 msgr2=0x7fb3900adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 shutdown_connections 2023-08-10T10:47:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:37.055+0000 7fb3982ad640 1 -- 172.21.15.50:0/146425337 wait complete. 2023-08-10T10:47:37.074 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:47:37.074 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:47:37.074 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:47:37.075 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:47:37.075 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:47:37.075 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:47:37.075 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:47:37.076 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:47:37.076 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:47:37.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.077 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:47:37.137 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:47:37.138 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:47:37.138 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:47:37.138 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.138 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:47:37.138 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:47:37.139 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:47:37.140 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:37.140 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:47:37.140 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:37.140 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:47:37.140 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 40840sec preferred_lft 40840sec 2023-08-10T10:47:37.141 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:47:37.141 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.141 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:47:37.141 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:47:37.142 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:47:37.142 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.142 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:47:37.142 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.142 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:47:37.143 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:47:37.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.145 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:47:37.238 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:47:37.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.243 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:47:37.297 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:47:37.298 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:47:37.298 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:47:37.298 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:47:37.298 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:47:37.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.299 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:47:37.299 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:47:37.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:47:37.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:47:37.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:47:37.301 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:47:37.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.483 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:47:37.533 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:47:37.534 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:47:37.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:47:37.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:47:37.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:47:37.616 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:47:37.668 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:47:37.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:47:37.670 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:47:37.725 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:47:37.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:37.871 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:37.871 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:47:37.902 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:47:37.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:47:37.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:47:37.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:47:37.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:47:37.904 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:47:37.904 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:47:37.905 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:47:37.905 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:47:37.905 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:47:37.908 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:47:37.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:47:37.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:47:37.989 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:47:38.039 INFO:teuthology.orchestra.run.smithi117.stdout:client8658 2023-08-10T10:47:38.040 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:47:38.040 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:47:38.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:47:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.332+0000 7fdea887d640 1 Processor -- start 2023-08-10T10:47:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.332+0000 7fdea887d640 1 -- start start 2023-08-10T10:47:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.333+0000 7fdea887d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea40d2830 0x7fdea40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.333+0000 7fdea887d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea40d0e10 con 0x7fdea40b1bd0 2023-08-10T10:47:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fdea887d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea40d2580 con 0x7fdea415cc20 2023-08-10T10:47:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fdea887d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40d31e0 con 0x7fdea40d2830 2023-08-10T10:47:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fde9a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdea40b1bd0 0x7fdea40d1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2023-08-10T10:47:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fde9a59c640 1 -- 172.21.15.50:0/438214686 learned_addr learned my addr 172.21.15.50:0/438214686 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:47:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fdea359e640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea40d2830 0x7fdea40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904582608 0 0) 0x7fdea40d0e10 con 0x7fdea40b1bd0 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.334+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90003520 con 0x7fdea40b1bd0 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128424128 0 0) 0x7fde90003520 con 0x7fdea40b1bd0 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea40d2830 msgr2=0x7fdea40d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea40d2830 0x7fdea40d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 >> v1:172.21.15.117:6789/0 conn(0x7fdea415cc20 legacy=0x7fdea40b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40d10b0 con 0x7fdea40b1bd0 2023-08-10T10:47:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fde8c001690 con 0x7fdea40b1bd0 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 >> v1:172.21.15.50:6789/0 conn(0x7fdea40b1bd0 legacy=0x7fdea40d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde90003a10 0x7fde90003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fde90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900052a0 0x7fde9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40d31e0 con 0x7fde900047c0 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9000c150 con 0x7fde90003a10 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9000c310 con 0x7fde900052a0 2023-08-10T10:47:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea359e640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea40d2830 0x7fdea40d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fde90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fdea2d9d640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde90003a10 0x7fde90003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 -- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900052a0 msgr2=0x7fde9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde900052a0 0x7fde9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 -- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde90003a10 msgr2=0x7fde90003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde90003a10 0x7fde90003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.335+0000 7fde9a59c640 1 -- 172.21.15.50:0/438214686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90003520 con 0x7fde900047c0 2023-08-10T10:47:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.336+0000 7fdea2d9d640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde90003a10 0x7fde90003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:38.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fde9a59c640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fde90004c40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fdea40b1aa0 tx=0x7fde900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f391677f5001f555 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:38.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c005ad0 con 0x7fde900047c0 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c005c30 con 0x7fde900047c0 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea259c640 1 -- 172.21.15.50:0/438214686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c02c890 con 0x7fde900047c0 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea887d640 1 -- 172.21.15.50:0/438214686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 msgr2=0x7fde90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea887d640 1 --2- 172.21.15.50:0/438214686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fde90004c40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fdea40b1aa0 tx=0x7fde900057f0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea359e640 1 -- 172.21.15.50:0/438214686 reap_dead start 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea887d640 1 -- 172.21.15.50:0/438214686 shutdown_connections 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.337+0000 7fdea887d640 1 -- 172.21.15.50:0/438214686 >> 172.21.15.50:0/438214686 conn(0x7fdea4069ac0 msgr2=0x7fdea4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.338+0000 7fdea887d640 1 -- 172.21.15.50:0/438214686 shutdown_connections 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.338+0000 7fdea887d640 1 -- 172.21.15.50:0/438214686 wait complete. 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.339+0000 7fdea887d640 1 Processor -- start 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.340+0000 7fdea887d640 1 -- start start 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.340+0000 7fdea887d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.340+0000 7fdea887d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 0x7fdea40a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea887d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea4158950 0x7fdea4158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea887d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40a99c0 con 0x7fde900047c0 2023-08-10T10:47:38.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea887d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40ca420 con 0x7fdea40a9200 2023-08-10T10:47:38.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea887d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40ca700 con 0x7fdea4158950 2023-08-10T10:47:38.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55512/0 (socket says 172.21.15.50:55512) 2023-08-10T10:47:38.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 -- 172.21.15.50:0/2539949449 learned_addr learned my addr 172.21.15.50:0/2539949449 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:38.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fde9a59c640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 0x7fdea40a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea359e640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea4158950 0x7fdea4158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 -- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea4158950 msgr2=0x7fdea4158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea4158950 0x7fdea4158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 -- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 msgr2=0x7fdea40a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 0x7fdea40a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fdea2d9d640 1 -- 172.21.15.50:0/2539949449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40ca9e0 con 0x7fde900047c0 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.341+0000 7fde9a59c640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 0x7fdea40a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fdea2d9d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fde9400d7a0 tx=0x7fde9400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94017070 con 0x7fde900047c0 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94005070 con 0x7fde900047c0 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94005420 con 0x7fde900047c0 2023-08-10T10:47:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea40cacc0 con 0x7fde900047c0 2023-08-10T10:47:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.342+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea40a9660 con 0x7fde900047c0 2023-08-10T10:47:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.343+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea4066e30 con 0x7fde900047c0 2023-08-10T10:47:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.344+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde94007030 con 0x7fde900047c0 2023-08-10T10:47:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.345+0000 7fde9bfff640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 0x7fde8406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.345+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde94088e60 con 0x7fde900047c0 2023-08-10T10:47:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.346+0000 7fde9a59c640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 0x7fde8406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.346+0000 7fde9a59c640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 0x7fde8406d110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fde8c034000 tx=0x7fde8c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.350+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fde94053e70 con 0x7fde900047c0 2023-08-10T10:47:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.580+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdea40b2490 con 0x7fde900047c0 2023-08-10T10:47:38.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.581+0000 7fde9bfff640 1 -- 172.21.15.50:0/2539949449 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fde94057490 con 0x7fde900047c0 2023-08-10T10:47:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:47:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:47:38.582 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:47:38.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.583+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 msgr2=0x7fde8406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.583+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 0x7fde8406d110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fde8c034000 tx=0x7fde8c009030 comp rx=0 tx=0).stop 2023-08-10T10:47:38.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.583+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 msgr2=0x7fdea415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.583+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fde9400d7a0 tx=0x7fde9400dc60 comp rx=0 tx=0).stop 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 shutdown_connections 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdea4158950 0x7fdea4158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde8406ac50 0x7fde8406d110 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdea40a9200 0x7fdea40a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 --2- 172.21.15.50:0/2539949449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde900047c0 0x7fdea415b370 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 >> 172.21.15.50:0/2539949449 conn(0x7fdea4069ac0 msgr2=0x7fdea415f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 shutdown_connections 2023-08-10T10:47:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:38.584+0000 7fdea887d640 1 -- 172.21.15.50:0/2539949449 wait complete. 2023-08-10T10:47:38.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-08-10T10:47:38.846 INFO:teuthology.orchestra.run.smithi117.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":8502,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.775566789000001,"mdsmap_epoch":76,"osdmap_epoch":158,"osdmap_epoch_barrier":158,"uptime":16.726742022} 2023-08-10T10:47:38.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 8502, "mdsmap_epoch": 76, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "rank_uptime": 10.775566789, "state": "up:active", "uptime": 16.726742022, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:47:38.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-10T10:47:39.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.091+0000 7fa2650e7640 1 Processor -- start 2023-08-10T10:47:39.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.091+0000 7fa2650e7640 1 -- start start 2023-08-10T10:47:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.092+0000 7fa2650e7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26015a820 0x7fa26006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.092+0000 7fa2650e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 0x7fa2600cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.092+0000 7fa2650e7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015bcb0 con 0x7fa26015ac00 2023-08-10T10:47:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.092+0000 7fa2650e7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600c5540 con 0x7fa26015a820 2023-08-10T10:47:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.092+0000 7fa2650e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26015b0a0 con 0x7fa260069db0 2023-08-10T10:47:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26015a820 0x7fa26006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26015a820 0x7fa26006c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55514/0 (socket says 172.21.15.50:55514) 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 -- 172.21.15.50:0/2068676782 learned_addr learned my addr 172.21.15.50:0/2068676782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25f59e640 1 --2- 172.21.15.50:0/2068676782 >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 0x7fa2600cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 -- 172.21.15.50:0/2068676782 >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 msgr2=0x7fa2600cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 --2- 172.21.15.50:0/2068676782 >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 0x7fa2600cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 -- 172.21.15.50:0/2068676782 >> v1:172.21.15.50:6789/0 conn(0x7fa26015ac00 legacy=0x7fa2600696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25ed9d640 1 -- 172.21.15.50:0/2068676782 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26015b380 con 0x7fa26015a820 2023-08-10T10:47:39.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25f59e640 1 --2- 172.21.15.50:0/2068676782 >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 0x7fa2600cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:39.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.093+0000 7fa25dd9b640 1 -- 172.21.15.50:0/2068676782 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870306355 0 0) 0x7fa26015bcb0 con 0x7fa26015ac00 2023-08-10T10:47:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.095+0000 7fa25ed9d640 1 --2- 172.21.15.50:0/2068676782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa26006c180 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa26006ac10 tx=0x7fa25002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1590345b0845d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.095+0000 7fa25dd9b640 1 -- 172.21.15.50:0/2068676782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250031870 con 0x7fa26015a820 2023-08-10T10:47:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.095+0000 7fa25dd9b640 1 -- 172.21.15.50:0/2068676782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2500319d0 con 0x7fa26015a820 2023-08-10T10:47:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.095+0000 7fa25dd9b640 1 -- 172.21.15.50:0/2068676782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250031d60 con 0x7fa26015a820 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 -- 172.21.15.50:0/2068676782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 msgr2=0x7fa26006c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 --2- 172.21.15.50:0/2068676782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa26006c180 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa26006ac10 tx=0x7fa25002b910 comp rx=0 tx=0).stop 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 -- 172.21.15.50:0/2068676782 shutdown_connections 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 --2- 172.21.15.50:0/2068676782 >> v2:172.21.15.117:3300/0 conn(0x7fa260069db0 0x7fa2600cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 --2- 172.21.15.50:0/2068676782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa26006c180 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 -- 172.21.15.50:0/2068676782 >> 172.21.15.50:0/2068676782 conn(0x7fa2600b08e0 msgr2=0x7fa2600ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 -- 172.21.15.50:0/2068676782 shutdown_connections 2023-08-10T10:47:39.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.096+0000 7fa2650e7640 1 -- 172.21.15.50:0/2068676782 wait complete. 2023-08-10T10:47:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.097+0000 7fa2650e7640 1 Processor -- start 2023-08-10T10:47:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.098+0000 7fa2650e7640 1 -- start start 2023-08-10T10:47:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260069db0 0x7fa2601554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015ac00 0x7fa260148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260155a00 con 0x7fa26015a820 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601576f0 con 0x7fa260069db0 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa2650e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600b3160 con 0x7fa26015ac00 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55528/0 (socket says 172.21.15.50:55528) 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25e59c640 1 -- 172.21.15.50:0/1106953893 learned_addr learned my addr 172.21.15.50:0/1106953893 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:47:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25ed9d640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260069db0 0x7fa2601554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25f59e640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015ac00 0x7fa260148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25e59c640 1 -- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015ac00 msgr2=0x7fa260148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.099+0000 7fa25e59c640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015ac00 0x7fa260148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa25e59c640 1 -- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260069db0 msgr2=0x7fa2601554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa25e59c640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260069db0 0x7fa2601554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa25e59c640 1 -- 172.21.15.50:0/1106953893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500094d0 con 0x7fa26015a820 2023-08-10T10:47:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa25e59c640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c410 tx=0x7fa24800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480035f0 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248003770 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248003b20 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260157130 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.100+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260156e20 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.102+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600b1290 con 0x7fa26015a820 2023-08-10T10:47:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.103+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa248003c80 con 0x7fa26015a820 2023-08-10T10:47:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.103+0000 7fa2577fe640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 0x7fa24006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.104+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa248088b70 con 0x7fa26015a820 2023-08-10T10:47:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.104+0000 7fa25ed9d640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 0x7fa24006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:39.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.105+0000 7fa25ed9d640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 0x7fa24006d110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa250036000 tx=0x7fa250008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:39.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.108+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa2600b1290 con 0x7fa26015a820 2023-08-10T10:47:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.297+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fa2600b1290 con 0x7fa26015a820 2023-08-10T10:47:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.615+0000 7fa2577fe640 1 -- 172.21.15.50:0/1106953893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v159) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa2600b1290 con 0x7fa26015a820 2023-08-10T10:47:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-10T10:47:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.619+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 msgr2=0x7fa24006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.619+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 0x7fa24006d110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa250036000 tx=0x7fa250008030 comp rx=0 tx=0).stop 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.619+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 msgr2=0x7fa2600cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.619+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c410 tx=0x7fa24800c8d0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 shutdown_connections 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015ac00 0x7fa260148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26015a820 0x7fa2600cc550 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa24006ac50 0x7fa24006d110 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 --2- 172.21.15.50:0/1106953893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260069db0 0x7fa2601554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:39.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 >> 172.21.15.50:0/1106953893 conn(0x7fa2600b08e0 msgr2=0x7fa26006ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:39.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 shutdown_connections 2023-08-10T10:47:39.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:47:39.620+0000 7fa2650e7640 1 -- 172.21.15.50:0/1106953893 wait complete. 2023-08-10T10:47:39.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:47:39.893 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:47:39.893 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:47:39.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-10T10:47:40.134 INFO:teuthology.orchestra.run.smithi050.stdout:{"mon_tick_interval":"5"} 2023-08-10T10:47:40.135 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-10T10:47:40.135 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-08-10T10:47:40.136 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:47:40.136 DEBUG:teuthology.orchestra.run.smithi050:> import time 2023-08-10T10:47:40.137 DEBUG:teuthology.orchestra.run.smithi050:> import datetime 2023-08-10T10:47:40.137 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-08-10T10:47:40.137 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:47:40.137 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.138 DEBUG:teuthology.orchestra.run.smithi050:> # Write some buffered data through before going full, all should be well 2023-08-10T10:47:40.138 DEBUG:teuthology.orchestra.run.smithi050:> print("writing some data through which we expect to succeed") 2023-08-10T10:47:40.138 DEBUG:teuthology.orchestra.run.smithi050:> bytes = 0 2023-08-10T10:47:40.139 DEBUG:teuthology.orchestra.run.smithi050:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-10T10:47:40.139 DEBUG:teuthology.orchestra.run.smithi050:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-10T10:47:40.139 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-08-10T10:47:40.139 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:47:40.140 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-10T10:47:40.140 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.141 DEBUG:teuthology.orchestra.run.smithi050:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-10T10:47:40.141 DEBUG:teuthology.orchestra.run.smithi050:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-10T10:47:40.142 DEBUG:teuthology.orchestra.run.smithi050:> # buffered IO, the error should always only appear from fsync and not 2023-08-10T10:47:40.142 DEBUG:teuthology.orchestra.run.smithi050:> # from write 2023-08-10T10:47:40.143 DEBUG:teuthology.orchestra.run.smithi050:> full = False 2023-08-10T10:47:40.144 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.144 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(32 * 0.9)): 2023-08-10T10:47:40.145 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:47:40.255 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-08-10T10:47:40.256 DEBUG:teuthology.orchestra.run.smithi050:> print("done writing {0} bytes".format(bytes)) 2023-08-10T10:47:40.256 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.257 DEBUG:teuthology.orchestra.run.smithi050:> # OK, now we should sneak in under the full condition 2023-08-10T10:47:40.258 DEBUG:teuthology.orchestra.run.smithi050:> # due to the time it takes the OSDs to report to the 2023-08-10T10:47:40.259 DEBUG:teuthology.orchestra.run.smithi050:> # mons, and get a successful fsync on our full-making data 2023-08-10T10:47:40.259 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:47:40.260 DEBUG:teuthology.orchestra.run.smithi050:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-08-10T10:47:40.260 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.261 DEBUG:teuthology.orchestra.run.smithi050:> # buffered write, add more dirty data to the buffer 2023-08-10T10:47:40.262 DEBUG:teuthology.orchestra.run.smithi050:> print("starting buffered write") 2023-08-10T10:47:40.262 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:47:40.263 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(32 * 0.2)): 2023-08-10T10:47:40.263 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:47:40.263 DEBUG:teuthology.orchestra.run.smithi050:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-10T10:47:40.263 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(15.0) 2023-08-10T10:47:40.264 DEBUG:teuthology.orchestra.run.smithi050:> except OSError: 2023-08-10T10:47:40.264 DEBUG:teuthology.orchestra.run.smithi050:> pass; 2023-08-10T10:47:40.264 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.265 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-08-10T10:47:40.265 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.265 DEBUG:teuthology.orchestra.run.smithi050:> # Wait long enough for a background flush that should fail 2023-08-10T10:47:40.266 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(30) 2023-08-10T10:47:40.266 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.266 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2023-08-10T10:47:40.266 DEBUG:teuthology.orchestra.run.smithi050:> # ...and check that the failed background flush is reflected in fclose 2023-08-10T10:47:40.267 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:47:40.267 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:47:40.267 DEBUG:teuthology.orchestra.run.smithi050:> except OSError: 2023-08-10T10:47:40.267 DEBUG:teuthology.orchestra.run.smithi050:> print("close() returned an error as expected") 2023-08-10T10:47:40.268 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:47:40.268 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("close() failed to raise error") 2023-08-10T10:47:40.268 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:47:40.269 DEBUG:teuthology.orchestra.run.smithi050:> # The kernel cephfs client does not raise errors on fclose 2023-08-10T10:47:40.269 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:47:40.269 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:47:40.270 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-10T10:47:40.270 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:47:44.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:47:44.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:14.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:14.895 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:45.033 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:48:45.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:15.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:15.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:42.431 INFO:teuthology.orchestra.run.smithi050.stdout:writing some data through which we expect to succeed 2023-08-10T10:49:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-10T10:49:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-08-10T10:49:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-08-10T10:49:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-08-10T10:49:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-08-10T10:49:42.433 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-08-10T10:49:42.433 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-08-10T10:49:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-08-10T10:49:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-08-10T10:49:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-08-10T10:49:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-08-10T10:49:42.435 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-08-10T10:49:42.435 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-08-10T10:49:42.435 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-08-10T10:49:42.435 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-08-10T10:49:42.436 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-08-10T10:49:42.436 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-08-10T10:49:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-08-10T10:49:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-08-10T10:49:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-08-10T10:49:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-08-10T10:49:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-08-10T10:49:42.438 INFO:teuthology.orchestra.run.smithi050.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:done writing 29884416 bytes 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:successfully fsync'ed prior to getting full state reported 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:starting buffered write 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.439 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.440 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:49:42.440 INFO:teuthology.orchestra.run.smithi050.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-08-10T10:49:42.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:49:42.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:49:42.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:49:42.883 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:49:42.884 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:49:42.884 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:42.950 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:49:42.951 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:43.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.245+0000 7f94d11a4640 1 Processor -- start 2023-08-10T10:49:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.245+0000 7f94d11a4640 1 -- start start 2023-08-10T10:49:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.246+0000 7f94d11a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94cc0b0c60 0x7f94cc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.246+0000 7f94d11a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b3f30 0x7f94cc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.246+0000 7f94d11a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc071c70 con 0x7f94cc15aa40 2023-08-10T10:49:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94d11a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc0713d0 con 0x7f94cc0b0c60 2023-08-10T10:49:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94d11a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0716b0 con 0x7f94cc0b3f30 2023-08-10T10:49:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94c259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94cc0b0c60 0x7f94cc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94cad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94cc15aa40 0x7f94cc0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53086/0 (socket says 172.21.15.50:53086) 2023-08-10T10:49:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94cad9d640 1 -- 172.21.15.50:0/91802604 learned_addr learned my addr 172.21.15.50:0/91802604 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94cb59e640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b3f30 0x7f94cc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94c259c640 1 -- 172.21.15.50:0/91802604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b3f30 msgr2=0x7f94cc0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94c259c640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b3f30 0x7f94cc0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94c259c640 1 -- 172.21.15.50:0/91802604 >> v1:172.21.15.50:6789/0 conn(0x7f94cc15aa40 legacy=0x7f94cc0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.247+0000 7f94c259c640 1 -- 172.21.15.50:0/91802604 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc071990 con 0x7f94cc0b0c60 2023-08-10T10:49:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.248+0000 7f94c259c640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b0c60 0x7f94cc0c9920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097a0 tx=0x7f94b402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192941a9e287549a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.249+0000 7f94ca59c640 1 -- 172.21.15.50:0/91802604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031780 con 0x7f94cc0b0c60 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.249+0000 7f94ca59c640 1 -- 172.21.15.50:0/91802604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40318e0 con 0x7f94cc0b0c60 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.249+0000 7f94ca59c640 1 -- 172.21.15.50:0/91802604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031c70 con 0x7f94cc0b0c60 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.249+0000 7f94d11a4640 1 -- 172.21.15.50:0/91802604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b0c60 msgr2=0x7f94cc0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.249+0000 7f94d11a4640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b0c60 0x7f94cc0c9920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097a0 tx=0x7f94b402b820 comp rx=0 tx=0).stop 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 -- 172.21.15.50:0/91802604 shutdown_connections 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b0c60 0x7f94cc0c9920 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 --2- 172.21.15.50:0/91802604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b3f30 0x7f94cc0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 -- 172.21.15.50:0/91802604 >> 172.21.15.50:0/91802604 conn(0x7f94cc06b590 msgr2=0x7f94cc0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 -- 172.21.15.50:0/91802604 shutdown_connections 2023-08-10T10:49:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.250+0000 7f94d11a4640 1 -- 172.21.15.50:0/91802604 wait complete. 2023-08-10T10:49:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.251+0000 7f94d11a4640 1 Processor -- start 2023-08-10T10:49:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.252+0000 7f94d11a4640 1 -- start start 2023-08-10T10:49:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b0c60 0x7f94cc159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94cc15aa40 0x7f94cc0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0c59c0 con 0x7f94cc0b3f30 2023-08-10T10:49:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc152c30 con 0x7f94cc15aa40 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94d11a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc153490 con 0x7f94cc0b0c60 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34854/0 (socket says 172.21.15.50:34854) 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94c259c640 1 -- 172.21.15.50:0/3570304105 learned_addr learned my addr 172.21.15.50:0/3570304105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94cad9d640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b0c60 0x7f94cc159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94c259c640 1 -- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b0c60 msgr2=0x7f94cc159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94c259c640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b0c60 0x7f94cc159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.253+0000 7f94cb59e640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94cc15aa40 0x7f94cc0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c259c640 1 -- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94cc15aa40 msgr2=0x7f94cc0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c259c640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94cc15aa40 0x7f94cc0c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c259c640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009400 con 0x7f94cc0b3f30 2023-08-10T10:49:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c259c640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098c0 tx=0x7f94b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4032820 con 0x7f94cc0b3f30 2023-08-10T10:49:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4032980 con 0x7f94cc0b3f30 2023-08-10T10:49:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4032d30 con 0x7f94cc0b3f30 2023-08-10T10:49:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc152670 con 0x7f94cc0b3f30 2023-08-10T10:49:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.254+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc14f150 con 0x7f94cc0b3f30 2023-08-10T10:49:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.256+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc0c5b30 con 0x7f94cc0b3f30 2023-08-10T10:49:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.256+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94b404e440 con 0x7f94cc0b3f30 2023-08-10T10:49:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.258+0000 7f94c3fff640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 0x7f94ac06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.258+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94b40ab5b0 con 0x7f94cc0b3f30 2023-08-10T10:49:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.258+0000 7f94cad9d640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 0x7f94ac06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.258+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f94ac072dd0 con 0x7f94cc0b3f30 2023-08-10T10:49:43.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.259+0000 7f94cad9d640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 0x7f94ac06d140 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005880 tx=0x7f94bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.263+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f94cc0c5b30 con 0x7f94cc0b3f30 2023-08-10T10:49:43.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.455+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94cc0c5770 con 0x7f94cc0b3f30 2023-08-10T10:49:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.458+0000 7f94c3fff640 1 -- 172.21.15.50:0/3570304105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18325 (secure 0 0 0) 0x7f94b4076650 con 0x7f94cc0b3f30 2023-08-10T10:49:43.459 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:43.460 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:06.615766+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 msgr2=0x7f94ac06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 0x7f94ac06d140 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005880 tx=0x7f94bc009040 comp rx=0 tx=0).stop 2023-08-10T10:49:43.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 msgr2=0x7f94cc0c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098c0 tx=0x7f94b40046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 shutdown_connections 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f94ac06ac80 0x7f94ac06d140 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94cc15aa40 0x7f94cc0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94cc0b3f30 0x7f94cc0c6c70 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 --2- 172.21.15.50:0/3570304105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94cc0b0c60 0x7f94cc159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.461+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 >> 172.21.15.50:0/3570304105 conn(0x7f94cc06b590 msgr2=0x7f94cc0ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.462+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 shutdown_connections 2023-08-10T10:49:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.462+0000 7f94d11a4640 1 -- 172.21.15.50:0/3570304105 wait complete. 2023-08-10T10:49:43.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:47:25.902442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:47:26.575181+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:49:43.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:49:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.708+0000 7f4a5b59e640 1 Processor -- start 2023-08-10T10:49:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.709+0000 7f4a5b59e640 1 -- start start 2023-08-10T10:49:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.710+0000 7f4a5b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a5c15fde0 0x7f4a5c06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.710+0000 7f4a5b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 0x7f4a5c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.710+0000 7f4a5b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c06a5c0 con 0x7f4a5c0cd490 2023-08-10T10:49:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.710+0000 7f4a5b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06b0c0 con 0x7f4a5c15fde0 2023-08-10T10:49:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.710+0000 7f4a5b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0cd920 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a5c15fde0 0x7f4a5c06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a5c15fde0 0x7f4a5c06a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34856/0 (socket says 172.21.15.50:34856) 2023-08-10T10:49:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2674260991 learned_addr learned my addr 172.21.15.50:0/2674260991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 0x7f4a5c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2674260991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 msgr2=0x7f4a5c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 0x7f4a5c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2674260991 >> v1:172.21.15.117:6789/0 conn(0x7f4a5c0cd490 legacy=0x7f4a5c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2674260991 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c06a820 con 0x7f4a5c15fde0 2023-08-10T10:49:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.711+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 0x7f4a5c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.713+0000 7f4a5a59c640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c15fde0 0x7f4a5c06a080 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23a77e8b0460ad6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.713+0000 7f4a5959a640 1 -- 172.21.15.50:0/2674260991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c031740 con 0x7f4a5c15fde0 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.713+0000 7f4a5959a640 1 -- 172.21.15.50:0/2674260991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0318a0 con 0x7f4a5c15fde0 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.713+0000 7f4a5959a640 1 -- 172.21.15.50:0/2674260991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c031c30 con 0x7f4a5c15fde0 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2674260991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c15fde0 msgr2=0x7f4a5c06a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c15fde0 0x7f4a5c06a080 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c02b7e0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2674260991 shutdown_connections 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0b1e00 0x7f4a5c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2674260991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c15fde0 0x7f4a5c06a080 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2674260991 >> 172.21.15.50:0/2674260991 conn(0x7f4a5c0d2900 msgr2=0x7f4a5c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2674260991 shutdown_connections 2023-08-10T10:49:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.714+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2674260991 wait complete. 2023-08-10T10:49:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.716+0000 7f4a5b59e640 1 Processor -- start 2023-08-10T10:49:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.716+0000 7f4a5b59e640 1 -- start start 2023-08-10T10:49:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 0x7f4a5c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c15fde0 0x7f4a5c15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1558a0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1571c0 con 0x7f4a5c0cd490 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c159d90 con 0x7f4a5c15fde0 2023-08-10T10:49:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34872/0 (socket says 172.21.15.50:34872) 2023-08-10T10:49:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.717+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2634861960 learned_addr learned my addr 172.21.15.50:0/2634861960 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5ad9d640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c15fde0 0x7f4a5c15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 0x7f4a5c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c15fde0 msgr2=0x7f4a5c15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c15fde0 0x7f4a5c15ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 msgr2=0x7f4a5c15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 0x7f4a5c15a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0094d0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 0x7f4a5c15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:43.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.718+0000 7f4a5a59c640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.719+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c033d60 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.719+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c03c400 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.719+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c03c7b0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.719+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c15a650 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.719+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c1566e0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.720+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c066e30 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.721+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a4c03a040 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.722+0000 7f4a4affd640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 0x7f4a3c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:43.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.722+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a4c0aafd0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.722+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f4a3c072da0 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.722+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 0x7f4a3c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.723+0000 7f4a59d9b640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 0x7f4a3c06d110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006fd0 tx=0x7f4a50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.727+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4a4c02f060 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.916+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a5c15a650 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.916+0000 7f4a4affd640 1 -- 172.21.15.50:0/2634861960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a5c15a650 con 0x7f4a5c0b1e00 2023-08-10T10:49:43.917 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:49:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 msgr2=0x7f4a3c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 0x7f4a3c06d110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006fd0 tx=0x7f4a50008040 comp rx=0 tx=0).stop 2023-08-10T10:49:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 msgr2=0x7f4a5c155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 shutdown_connections 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c15fde0 0x7f4a5c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a3c06ac50 0x7f4a3c06d110 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0cd490 0x7f4a5c15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 --2- 172.21.15.50:0/2634861960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0b1e00 0x7f4a5c155360 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 >> 172.21.15.50:0/2634861960 conn(0x7f4a5c0d2900 msgr2=0x7f4a5c0d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.919+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 shutdown_connections 2023-08-10T10:49:43.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:43.920+0000 7f4a5b59e640 1 -- 172.21.15.50:0/2634861960 wait complete. 2023-08-10T10:49:43.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:49:44.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.169+0000 7fc9ec656640 1 Processor -- start 2023-08-10T10:49:44.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.170+0000 7fc9ec656640 1 -- start start 2023-08-10T10:49:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.171+0000 7fc9ec656640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9e415ae40 0x7fc9e40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.171+0000 7fc9ec656640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e406cb30 0x7fc9e40ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.171+0000 7fc9ec656640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e40adcb0 con 0x7fc9e40cd2a0 2023-08-10T10:49:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.171+0000 7fc9ec656640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e406c320 con 0x7fc9e406cb30 2023-08-10T10:49:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.171+0000 7fc9ec656640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e406b770 con 0x7fc9e415ae40 2023-08-10T10:49:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e406cb30 0x7fc9e40ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e406cb30 0x7fc9e40ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34876/0 (socket says 172.21.15.50:34876) 2023-08-10T10:49:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 -- 172.21.15.50:0/3347654796 learned_addr learned my addr 172.21.15.50:0/3347654796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 -- 172.21.15.50:0/3347654796 >> v2:172.21.15.117:3300/0 conn(0x7fc9e415ae40 msgr2=0x7fc9e40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 --2- 172.21.15.50:0/3347654796 >> v2:172.21.15.117:3300/0 conn(0x7fc9e415ae40 0x7fc9e40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 -- 172.21.15.50:0/3347654796 >> v1:172.21.15.117:6789/0 conn(0x7fc9e40cd2a0 legacy=0x7fc9e40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.172+0000 7fc9e9bf1640 1 -- 172.21.15.50:0/3347654796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e406b9f0 con 0x7fc9e406cb30 2023-08-10T10:49:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.173+0000 7fc9e9bf1640 1 --2- 172.21.15.50:0/3347654796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e40ad770 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406e6f0 tx=0x7fc9d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10eb7c4d64aef09 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.174+0000 7fc9e93f0640 1 -- 172.21.15.50:0/3347654796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4031870 con 0x7fc9e406cb30 2023-08-10T10:49:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.174+0000 7fc9e93f0640 1 -- 172.21.15.50:0/3347654796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40319d0 con 0x7fc9e406cb30 2023-08-10T10:49:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.174+0000 7fc9e93f0640 1 -- 172.21.15.50:0/3347654796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4031d60 con 0x7fc9e406cb30 2023-08-10T10:49:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.174+0000 7fc9ec656640 1 -- 172.21.15.50:0/3347654796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 msgr2=0x7fc9e40ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.174+0000 7fc9ec656640 1 --2- 172.21.15.50:0/3347654796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e40ad770 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406e6f0 tx=0x7fc9d402b910 comp rx=0 tx=0).stop 2023-08-10T10:49:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 -- 172.21.15.50:0/3347654796 shutdown_connections 2023-08-10T10:49:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 --2- 172.21.15.50:0/3347654796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e40ad770 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 --2- 172.21.15.50:0/3347654796 >> v2:172.21.15.117:3300/0 conn(0x7fc9e415ae40 0x7fc9e40b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 -- 172.21.15.50:0/3347654796 >> 172.21.15.50:0/3347654796 conn(0x7fc9e40b01b0 msgr2=0x7fc9e40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 -- 172.21.15.50:0/3347654796 shutdown_connections 2023-08-10T10:49:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.175+0000 7fc9ec656640 1 -- 172.21.15.50:0/3347654796 wait complete. 2023-08-10T10:49:44.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.177+0000 7fc9ec656640 1 Processor -- start 2023-08-10T10:49:44.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.177+0000 7fc9ec656640 1 -- start start 2023-08-10T10:49:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40cd2a0 0x7fc9e415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 0x7fc9e414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e40c5930 con 0x7fc9e406cb30 2023-08-10T10:49:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e415b760 con 0x7fc9e415ae40 2023-08-10T10:49:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ec656640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e414e570 con 0x7fc9e40cd2a0 2023-08-10T10:49:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34884/0 (socket says 172.21.15.50:34884) 2023-08-10T10:49:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 -- 172.21.15.50:0/1518071098 learned_addr learned my addr 172.21.15.50:0/1518071098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9e9bf1640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40cd2a0 0x7fc9e415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 -- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40cd2a0 msgr2=0x7fc9e415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40cd2a0 0x7fc9e415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9ea3f2640 1 -- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 msgr2=0x7fc9e414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.179+0000 7fc9eabf3640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 0x7fc9e414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9ea3f2640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 0x7fc9e414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9ea3f2640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40094d0 con 0x7fc9e406cb30 2023-08-10T10:49:44.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9eabf3640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 0x7fc9e414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:44.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9ea3f2640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b410 tx=0x7fc9e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0011830 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e00119b0 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0011d60 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.180+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e415b9c0 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.181+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e415bf80 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.182+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e40612b0 con 0x7fc9e406cb30 2023-08-10T10:49:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.183+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9e001a400 con 0x7fc9e406cb30 2023-08-10T10:49:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.184+0000 7fc9daffd640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 0x7fc9c806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.184+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9e0089670 con 0x7fc9e406cb30 2023-08-10T10:49:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.184+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fc9c8072dd0 con 0x7fc9e406cb30 2023-08-10T10:49:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.184+0000 7fc9e9bf1640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 0x7fc9c806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.185+0000 7fc9e9bf1640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 0x7fc9c806d140 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4036000 tx=0x7fc9d403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.188+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9e0054710 con 0x7fc9e406cb30 2023-08-10T10:49:44.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.383+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9e406ee10 con 0x7fc9e406cb30 2023-08-10T10:49:44.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.384+0000 7fc9daffd640 1 -- 172.21.15.50:0/1518071098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9e0015070 con 0x7fc9e406cb30 2023-08-10T10:49:44.385 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:49:44.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 msgr2=0x7fc9c806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 0x7fc9c806d140 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4036000 tx=0x7fc9d403c040 comp rx=0 tx=0).stop 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 msgr2=0x7fc9e415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b410 tx=0x7fc9e000b8d0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 shutdown_connections 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9c806ac80 0x7fc9c806d140 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415ae40 0x7fc9e414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40cd2a0 0x7fc9e415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 --2- 172.21.15.50:0/1518071098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e406cb30 0x7fc9e415d210 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 >> 172.21.15.50:0/1518071098 conn(0x7fc9e40b01b0 msgr2=0x7fc9e40cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 shutdown_connections 2023-08-10T10:49:44.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.387+0000 7fc9ec656640 1 -- 172.21.15.50:0/1518071098 wait complete. 2023-08-10T10:49:44.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:49:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.640+0000 7fc9e9f02640 1 Processor -- start 2023-08-10T10:49:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.640+0000 7fc9e9f02640 1 -- start start 2023-08-10T10:49:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9f02640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 0x7fc9e4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9f02640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e415e4d0 0x7fc9e415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9f02640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e406a040 con 0x7fc9e41583c0 2023-08-10T10:49:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9f02640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e415aee0 con 0x7fc9e415e4d0 2023-08-10T10:49:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9f02640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e40b2100 con 0x7fc9e40696a0 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9701640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e415e4d0 0x7fc9e415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9701640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9e415e4d0 0x7fc9e415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34900/0 (socket says 172.21.15.50:34900) 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e8f00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9e41583c0 0x7fc9e40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53090/0 (socket says 172.21.15.50:53090) 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.641+0000 7fc9e9701640 1 -- 172.21.15.50:0/56723312 learned_addr learned my addr 172.21.15.50:0/56723312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9dbfff640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 0x7fc9e4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9e9701640 1 -- 172.21.15.50:0/56723312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 msgr2=0x7fc9e4069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9db7fe640 1 -- 172.21.15.50:0/56723312 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944806170 0 0) 0x7fc9e406a040 con 0x7fc9e41583c0 2023-08-10T10:49:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9e9701640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 0x7fc9e4069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9e9701640 1 -- 172.21.15.50:0/56723312 >> v1:172.21.15.50:6789/0 conn(0x7fc9e41583c0 legacy=0x7fc9e40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9e9701640 1 -- 172.21.15.50:0/56723312 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e415b1a0 con 0x7fc9e415e4d0 2023-08-10T10:49:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.642+0000 7fc9dbfff640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 0x7fc9e4069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.643+0000 7fc9e9701640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e415e4d0 0x7fc9e415e940 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7cfc2c6f2d027f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.643+0000 7fc9db7fe640 1 -- 172.21.15.50:0/56723312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc030840 con 0x7fc9e415e4d0 2023-08-10T10:49:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9db7fe640 1 -- 172.21.15.50:0/56723312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0309a0 con 0x7fc9e415e4d0 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9db7fe640 1 -- 172.21.15.50:0/56723312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc030d30 con 0x7fc9e415e4d0 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 -- 172.21.15.50:0/56723312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e415e4d0 msgr2=0x7fc9e415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e415e4d0 0x7fc9e415e940 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc02b980 comp rx=0 tx=0).stop 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 -- 172.21.15.50:0/56723312 shutdown_connections 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e415e4d0 0x7fc9e415e940 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/56723312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e40696a0 0x7fc9e4069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 -- 172.21.15.50:0/56723312 >> 172.21.15.50:0/56723312 conn(0x7fc9e40caf80 msgr2=0x7fc9e40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.644+0000 7fc9e9f02640 1 -- 172.21.15.50:0/56723312 shutdown_connections 2023-08-10T10:49:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.645+0000 7fc9e9f02640 1 -- 172.21.15.50:0/56723312 wait complete. 2023-08-10T10:49:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.646+0000 7fc9e9f02640 1 Processor -- start 2023-08-10T10:49:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.646+0000 7fc9e9f02640 1 -- start start 2023-08-10T10:49:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e41583c0 0x7fc9e415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415e4d0 0x7fc9e41f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4154d60 con 0x7fc9e40696a0 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e41558e0 con 0x7fc9e415e4d0 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.647+0000 7fc9e9f02640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4154fb0 con 0x7fc9e41583c0 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34908/0 (socket says 172.21.15.50:34908) 2023-08-10T10:49:44.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 -- 172.21.15.50:0/4093313136 learned_addr learned my addr 172.21.15.50:0/4093313136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 -- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e41583c0 msgr2=0x7fc9e415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e41583c0 0x7fc9e415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 -- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415e4d0 msgr2=0x7fc9e41f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415e4d0 0x7fc9e41f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0094d0 con 0x7fc9e40696a0 2023-08-10T10:49:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.648+0000 7fc9e8f00640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c890 tx=0x7fc9e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.649+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000a640 con 0x7fc9e40696a0 2023-08-10T10:49:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.649+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e000a7c0 con 0x7fc9e40696a0 2023-08-10T10:49:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.649+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000ab70 con 0x7fc9e40696a0 2023-08-10T10:49:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.649+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e4155290 con 0x7fc9e40696a0 2023-08-10T10:49:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.649+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e415cdd0 con 0x7fc9e40696a0 2023-08-10T10:49:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.650+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e40b11f0 con 0x7fc9e40696a0 2023-08-10T10:49:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.651+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9e000acd0 con 0x7fc9e40696a0 2023-08-10T10:49:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.652+0000 7fc9d97fa640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 0x7fc9d006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.652+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9e0088a70 con 0x7fc9e40696a0 2023-08-10T10:49:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.652+0000 7fc9dbfff640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 0x7fc9d006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.653+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fc9d0072dd0 con 0x7fc9e40696a0 2023-08-10T10:49:44.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.653+0000 7fc9dbfff640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 0x7fc9d006d140 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006fd0 tx=0x7fc9d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.656+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9e0018060 con 0x7fc9e40696a0 2023-08-10T10:49:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.843+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9e4066e30 con 0x7fc9e40696a0 2023-08-10T10:49:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.844+0000 7fc9d97fa640 1 -- 172.21.15.50:0/4093313136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9e0018070 con 0x7fc9e40696a0 2023-08-10T10:49:44.845 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:49:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 msgr2=0x7fc9d006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 0x7fc9d006d140 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006fd0 tx=0x7fc9d4008040 comp rx=0 tx=0).stop 2023-08-10T10:49:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 msgr2=0x7fc9e41efc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c890 tx=0x7fc9e000cd50 comp rx=0 tx=0).stop 2023-08-10T10:49:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 shutdown_connections 2023-08-10T10:49:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc9d006ac80 0x7fc9d006d140 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e415e4d0 0x7fc9e41f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e41583c0 0x7fc9e415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 --2- 172.21.15.50:0/4093313136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9e40696a0 0x7fc9e41efc00 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 >> 172.21.15.50:0/4093313136 conn(0x7fc9e40caf80 msgr2=0x7fc9e4157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 shutdown_connections 2023-08-10T10:49:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:44.847+0000 7fc9e9f02640 1 -- 172.21.15.50:0/4093313136 wait complete. 2023-08-10T10:49:44.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:49:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.089+0000 7ff2abfff640 1 Processor -- start 2023-08-10T10:49:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.089+0000 7ff2abfff640 1 -- start start 2023-08-10T10:49:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.090+0000 7ff2abfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff2ac15ff90 0x7ff2ac160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.090+0000 7ff2abfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.090+0000 7ff2abfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac160370 con 0x7ff2ac0cd960 2023-08-10T10:49:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.090+0000 7ff2abfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ac0d0b90 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.090+0000 7ff2abfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ac1614d0 con 0x7ff2ac15ff90 2023-08-10T10:49:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2aa7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2ac0cd960 0x7ff2ac0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35964/0 (socket says 172.21.15.50:35964) 2023-08-10T10:49:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40436/0 (socket says 172.21.15.50:40436) 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2aa7fc640 1 -- 172.21.15.50:0/2806564761 learned_addr learned my addr 172.21.15.50:0/2806564761 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2aaffd640 1 --2- 172.21.15.50:0/2806564761 >> v2:172.21.15.117:3300/0 conn(0x7ff2ac15ff90 0x7ff2ac160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 -- 172.21.15.50:0/2806564761 >> v2:172.21.15.117:3300/0 conn(0x7ff2ac15ff90 msgr2=0x7ff2ac160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 --2- 172.21.15.50:0/2806564761 >> v2:172.21.15.117:3300/0 conn(0x7ff2ac15ff90 0x7ff2ac160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 -- 172.21.15.50:0/2806564761 >> v1:172.21.15.50:6789/0 conn(0x7ff2ac0cd960 legacy=0x7ff2ac0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.091+0000 7ff2ab7fe640 1 -- 172.21.15.50:0/2806564761 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac0d3200 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2ab7fe640 1 --2- 172.21.15.50:0/2806564761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac071330 tx=0x7ff2a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86409057d8b366b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2a9ffb640 1 -- 172.21.15.50:0/2806564761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4031830 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2a9ffb640 1 -- 172.21.15.50:0/2806564761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4031990 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2a9ffb640 1 -- 172.21.15.50:0/2806564761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4031d20 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2abfff640 1 -- 172.21.15.50:0/2806564761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0d28b0 msgr2=0x7ff2ac0d2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.093+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2806564761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac071330 tx=0x7ff2a402b8d0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 -- 172.21.15.50:0/2806564761 shutdown_connections 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2806564761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0d28b0 0x7ff2ac0d2cc0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2806564761 >> v2:172.21.15.117:3300/0 conn(0x7ff2ac15ff90 0x7ff2ac160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 -- 172.21.15.50:0/2806564761 >> 172.21.15.50:0/2806564761 conn(0x7ff2ac069ac0 msgr2=0x7ff2ac069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 -- 172.21.15.50:0/2806564761 shutdown_connections 2023-08-10T10:49:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.094+0000 7ff2abfff640 1 -- 172.21.15.50:0/2806564761 wait complete. 2023-08-10T10:49:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.095+0000 7ff2abfff640 1 Processor -- start 2023-08-10T10:49:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.096+0000 7ff2abfff640 1 -- start start 2023-08-10T10:49:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 0x7ff2ac1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2ac15ff90 0x7ff2ac0c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac1f3470 con 0x7ff2ac0cd960 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac1f2eb0 con 0x7ff2ac15ff90 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2abfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac1f3190 con 0x7ff2ac0d28b0 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40446/0 (socket says 172.21.15.50:40446) 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 -- 172.21.15.50:0/2116175017 learned_addr learned my addr 172.21.15.50:0/2116175017 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aa7fc640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 0x7ff2ac1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 -- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 msgr2=0x7ff2ac1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 0x7ff2ac1f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2ab7fe640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2ac15ff90 0x7ff2ac0c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 -- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2ac15ff90 msgr2=0x7ff2ac0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2ac15ff90 0x7ff2ac0c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aaffd640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009400 con 0x7ff2ac0cd960 2023-08-10T10:49:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.097+0000 7ff2aa7fc640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 0x7ff2ac1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2aaffd640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007e40 tx=0x7ff29c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c014620 con 0x7ff2ac0cd960 2023-08-10T10:49:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00ee90 con 0x7ff2ac0cd960 2023-08-10T10:49:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0149c0 con 0x7ff2ac0cd960 2023-08-10T10:49:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac0b23e0 con 0x7ff2ac0cd960 2023-08-10T10:49:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.098+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac15c520 con 0x7ff2ac0cd960 2023-08-10T10:49:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.099+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ac0b2240 con 0x7ff2ac0cd960 2023-08-10T10:49:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.100+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff29c014b20 con 0x7ff2ac0cd960 2023-08-10T10:49:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.101+0000 7ff2937fe640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 0x7ff29806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.101+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff29c089e60 con 0x7ff2ac0cd960 2023-08-10T10:49:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.102+0000 7ff2aa7fc640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 0x7ff29806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.102+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7ff298072da0 con 0x7ff2ac0cd960 2023-08-10T10:49:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.102+0000 7ff2aa7fc640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 0x7ff29806d110 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.106+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff2ac0b2240 con 0x7ff2ac0cd960 2023-08-10T10:49:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.302+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2ac0b2240 con 0x7ff2ac0cd960 2023-08-10T10:49:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.303+0000 7ff2937fe640 1 -- 172.21.15.50:0/2116175017 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2ac0b2240 con 0x7ff2ac0cd960 2023-08-10T10:49:45.304 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:49:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.306+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 msgr2=0x7ff29806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.306+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 0x7ff29806d110 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).stop 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.306+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 msgr2=0x7ff2ac15bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007e40 tx=0x7ff29c00e4b0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 shutdown_connections 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff29806ac50 0x7ff29806d110 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2ac15ff90 0x7ff2ac0c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2ac0d28b0 0x7ff2ac1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 --2- 172.21.15.50:0/2116175017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ac0cd960 0x7ff2ac15bfe0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 >> 172.21.15.50:0/2116175017 conn(0x7ff2ac069ac0 msgr2=0x7ff2ac0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 shutdown_connections 2023-08-10T10:49:45.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.307+0000 7ff2abfff640 1 -- 172.21.15.50:0/2116175017 wait complete. 2023-08-10T10:49:45.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:49:45.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:45.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:49:45.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.544+0000 7f557b59e640 1 Processor -- start 2023-08-10T10:49:45.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.544+0000 7f557b59e640 1 -- start start 2023-08-10T10:49:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f557c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0d1f70 con 0x7f557c1607c0 2023-08-10T10:49:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c160510 con 0x7f557c160130 2023-08-10T10:49:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c160ca0 con 0x7f557c0cfb00 2023-08-10T10:49:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f557c1607c0 0x7f557c0d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35966/0 (socket says 172.21.15.50:35966) 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.546+0000 7f557ad9d640 1 -- 172.21.15.50:0/1792793063 learned_addr learned my addr 172.21.15.50:0/1792793063 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5573fff640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f557c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895896654 0 0) 0x7f557c0d1f70 con 0x7f557c1607c0 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5568003520 con 0x7f557c1607c0 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305273791 0 0) 0x7f5568003520 con 0x7f557c1607c0 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 msgr2=0x7f557c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f557c0cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 >> v1:172.21.15.117:6789/0 conn(0x7f557c160130 legacy=0x7f557c0cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c160f80 con 0x7f557c1607c0 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f55740019f0 con 0x7f557c1607c0 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 >> v1:172.21.15.50:6789/0 conn(0x7f557c1607c0 legacy=0x7f557c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568003a10 0x7f5568003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f55680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568004d00 0x7f5568005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c160ca0 con 0x7f5568004d00 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556800ba90 con 0x7f5568003a10 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.547+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556800bc50 con 0x7f557c0cfb00 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568004d00 0x7f5568005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557a59c640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568003a10 0x7f5568003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f5573fff640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f55680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 -- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 msgr2=0x7f55680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c0cfb00 0x7f55680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 -- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568003a10 msgr2=0x7f5568003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568003a10 0x7f5568003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.548+0000 7f557ad9d640 1 -- 172.21.15.50:0/1792793063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568003520 con 0x7f5568004d00 2023-08-10T10:49:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.549+0000 7f557ad9d640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568004d00 0x7f5568005180 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f557c160bd0 tx=0x7f55680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9be099e6ff232f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740072d0 con 0x7f5568004d00 2023-08-10T10:49:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557402f070 con 0x7f5568004d00 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f5579d9b640 1 -- 172.21.15.50:0/1792793063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740076b0 con 0x7f5568004d00 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 -- 172.21.15.50:0/1792793063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568004d00 msgr2=0x7f5568005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 --2- 172.21.15.50:0/1792793063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568004d00 0x7f5568005180 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f557c160bd0 tx=0x7f55680057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557ad9d640 1 -- 172.21.15.50:0/1792793063 reap_dead start 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 -- 172.21.15.50:0/1792793063 shutdown_connections 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 -- 172.21.15.50:0/1792793063 >> 172.21.15.50:0/1792793063 conn(0x7f557c0696a0 msgr2=0x7f557c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 -- 172.21.15.50:0/1792793063 shutdown_connections 2023-08-10T10:49:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.550+0000 7f557b59e640 1 -- 172.21.15.50:0/1792793063 wait complete. 2023-08-10T10:49:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.552+0000 7f557b59e640 1 Processor -- start 2023-08-10T10:49:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.552+0000 7f557b59e640 1 -- start start 2023-08-10T10:49:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.553+0000 7f557b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568004d00 0x7f557c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.553+0000 7f557b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.553+0000 7f557b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c14de70 0x7f557c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.553+0000 7f557b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0aaf50 con 0x7f557c14e8d0 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.553+0000 7f557b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cb0f0 con 0x7f5568004d00 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f557b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cb3d0 con 0x7f557c14de70 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40466/0 (socket says 172.21.15.50:40466) 2023-08-10T10:49:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 -- 172.21.15.50:0/774547061 learned_addr learned my addr 172.21.15.50:0/774547061 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 -- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c14de70 msgr2=0x7f557c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c14de70 0x7f557c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 -- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568004d00 msgr2=0x7f557c0caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568004d00 0x7f557c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.554+0000 7f5573fff640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0cb6b0 con 0x7f557c14e8d0 2023-08-10T10:49:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f5573fff640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f5564011600 tx=0x7f5564011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564015870 con 0x7f557c14e8d0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55640159d0 con 0x7f557c14e8d0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564015d40 con 0x7f557c14e8d0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0a9340 con 0x7f557c14e8d0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.555+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c14e2f0 con 0x7f557c14e8d0 2023-08-10T10:49:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.556+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c066e30 con 0x7f557c14e8d0 2023-08-10T10:49:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.557+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f556400f490 con 0x7f557c14e8d0 2023-08-10T10:49:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.558+0000 7f5572ffd640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 0x7f555c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.558+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55640899c0 con 0x7f557c14e8d0 2023-08-10T10:49:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.558+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f555c072dd0 con 0x7f557c14e8d0 2023-08-10T10:49:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.558+0000 7f557a59c640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 0x7f555c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.559+0000 7f557a59c640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 0x7f555c06d140 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.562+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f55640549d0 con 0x7f557c14e8d0 2023-08-10T10:49:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.765+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f557c0b5260 con 0x7f557c14e8d0 2023-08-10T10:49:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.766+0000 7f5572ffd640 1 -- 172.21.15.50:0/774547061 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v160) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5564022070 con 0x7f557c14e8d0 2023-08-10T10:49:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:49:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.768+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 msgr2=0x7f555c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.768+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 0x7f555c06d140 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).stop 2023-08-10T10:49:45.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.768+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 msgr2=0x7f557c0ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.768+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f5564011600 tx=0x7f5564011ac0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 shutdown_connections 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f557c14de70 0x7f557c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c14e8d0 0x7f557c0ab450 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f555c06ac80 0x7f555c06d140 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 --2- 172.21.15.50:0/774547061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5568004d00 0x7f557c0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 >> 172.21.15.50:0/774547061 conn(0x7f557c0696a0 msgr2=0x7f557c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 shutdown_connections 2023-08-10T10:49:45.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:45.769+0000 7f557b59e640 1 -- 172.21.15.50:0/774547061 wait complete. 2023-08-10T10:49:45.787 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:49:45.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:45.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:49:45.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:49:45.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:45.919 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:49:45.979 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:49:45.980 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:46.042 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:49:46.042 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:46.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:46.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.327+0000 7f005759e640 1 Processor -- start 2023-08-10T10:49:46.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.327+0000 7f005759e640 1 -- start start 2023-08-10T10:49:46.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0058153850 0x7f00580b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 0x7f00580cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580cffe0 con 0x7f0058153850 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005815d010 con 0x7f00580cf630 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005815d290 con 0x7f0058153c30 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0058153850 0x7f00580b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0058153850 0x7f00580b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40468/0 (socket says 172.21.15.50:40468) 2023-08-10T10:49:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.328+0000 7f005659c640 1 -- 172.21.15.50:0/3842725377 learned_addr learned my addr 172.21.15.50:0/3842725377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f0055d9b640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f0056d9d640 1 --2- 172.21.15.50:0/3842725377 >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 0x7f00580cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f005659c640 1 -- 172.21.15.50:0/3842725377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 msgr2=0x7f00580b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f005659c640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f005659c640 1 -- 172.21.15.50:0/3842725377 >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 msgr2=0x7f00580cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f005659c640 1 --2- 172.21.15.50:0/3842725377 >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 0x7f00580cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f005659c640 1 -- 172.21.15.50:0/3842725377 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005815d570 con 0x7f0058153850 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.329+0000 7f0056d9d640 1 --2- 172.21.15.50:0/3842725377 >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 0x7f00580cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.330+0000 7f005659c640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0058153850 0x7f00580b1690 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f005808bb50 tx=0x7f004802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa312f427d6a837e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.330+0000 7f005559a640 1 -- 172.21.15.50:0/3842725377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004802ca80 con 0x7f0058153850 2023-08-10T10:49:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.330+0000 7f005559a640 1 -- 172.21.15.50:0/3842725377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004802cbe0 con 0x7f0058153850 2023-08-10T10:49:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.330+0000 7f005559a640 1 -- 172.21.15.50:0/3842725377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480343f0 con 0x7f0058153850 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 -- 172.21.15.50:0/3842725377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0058153850 msgr2=0x7f00580b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0058153850 0x7f00580b1690 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f005808bb50 tx=0x7f004802bee0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 -- 172.21.15.50:0/3842725377 shutdown_connections 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 --2- 172.21.15.50:0/3842725377 >> v2:172.21.15.117:3300/0 conn(0x7f00580cf630 0x7f00580cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 --2- 172.21.15.50:0/3842725377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0058153850 0x7f00580b1690 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 -- 172.21.15.50:0/3842725377 >> 172.21.15.50:0/3842725377 conn(0x7f0058069880 msgr2=0x7f0058069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 -- 172.21.15.50:0/3842725377 shutdown_connections 2023-08-10T10:49:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.331+0000 7f005759e640 1 -- 172.21.15.50:0/3842725377 wait complete. 2023-08-10T10:49:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.333+0000 7f005759e640 1 Processor -- start 2023-08-10T10:49:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.333+0000 7f005759e640 1 -- start start 2023-08-10T10:49:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 0x7f00580d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580d1160 con 0x7f00580cf630 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581512b0 con 0x7f0058153850 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580d1350 con 0x7f0058153c30 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40474/0 (socket says 172.21.15.50:40474) 2023-08-10T10:49:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.334+0000 7f005659c640 1 -- 172.21.15.50:0/1085403465 learned_addr learned my addr 172.21.15.50:0/1085403465 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f0055d9b640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 0x7f00580d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 -- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 msgr2=0x7f00580b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 -- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 msgr2=0x7f00580d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 0x7f00580d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009b30 con 0x7f00580cf630 2023-08-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f0055d9b640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 0x7f00580d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005659c640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f0048000f80 tx=0x7f0048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004803e450 con 0x7f00580cf630 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004803e5f0 con 0x7f00580cf630 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004803e9a0 con 0x7f00580cf630 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.335+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580d1630 con 0x7f00580cf630 2023-08-10T10:49:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.336+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00580d1bf0 con 0x7f00580cf630 2023-08-10T10:49:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.337+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0058066e30 con 0x7f00580cf630 2023-08-10T10:49:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.338+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f004802cd50 con 0x7f00580cf630 2023-08-10T10:49:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.339+0000 7f0046ffd640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 0x7f003806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.339+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00480ac1d0 con 0x7f00580cf630 2023-08-10T10:49:46.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.339+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f0038072da0 con 0x7f00580cf630 2023-08-10T10:49:46.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.339+0000 7f0055d9b640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 0x7f003806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.340+0000 7f0055d9b640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 0x7f003806d110 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f00580b19d0 tx=0x7f004c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.344+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00480771e0 con 0x7f00580cf630 2023-08-10T10:49:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.536+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00580cea00 con 0x7f00580cf630 2023-08-10T10:49:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.538+0000 7f0046ffd640 1 -- 172.21.15.50:0/1085403465 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18325 (secure 0 0 0) 0x7f004807a800 con 0x7f00580cf630 2023-08-10T10:49:46.539 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:46.539 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:06.615766+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 msgr2=0x7f003806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 0x7f003806d110 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f00580b19d0 tx=0x7f004c008040 comp rx=0 tx=0).stop 2023-08-10T10:49:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 msgr2=0x7f0058150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f0048000f80 tx=0x7f0048004a40 comp rx=0 tx=0).stop 2023-08-10T10:49:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 shutdown_connections 2023-08-10T10:49:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0058153c30 0x7f00580b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f003806ac50 0x7f003806d110 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0058153850 0x7f00580d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 --2- 172.21.15.50:0/1085403465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00580cf630 0x7f0058150d70 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.541+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 >> 172.21.15.50:0/1085403465 conn(0x7f0058069880 msgr2=0x7f005815ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.542+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 shutdown_connections 2023-08-10T10:49:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.542+0000 7f005759e640 1 -- 172.21.15.50:0/1085403465 wait complete. 2023-08-10T10:49:46.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:47:25.902442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:47:26.575181+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:49:46.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:49:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.800+0000 7fcadaa71640 1 Processor -- start 2023-08-10T10:49:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.800+0000 7fcadaa71640 1 -- start start 2023-08-10T10:49:46.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcadaa71640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcad40cd1c0 0x7fcad40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcadaa71640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad406a7c0 con 0x7fcad4160300 2023-08-10T10:49:46.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcadaa71640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad406aa90 con 0x7fcad40b62f0 2023-08-10T10:49:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcadaa71640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40cdbb0 con 0x7fcad40cd1c0 2023-08-10T10:49:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcad9a6f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcad4160300 0x7fcad406a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35972/0 (socket says 172.21.15.50:35972) 2023-08-10T10:49:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.802+0000 7fcad9a6f640 1 -- 172.21.15.50:0/1728987486 learned_addr learned my addr 172.21.15.50:0/1728987486 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad926e640 1 --2- 172.21.15.50:0/1728987486 >> v2:172.21.15.50:3300/0 conn(0x7fcad40cd1c0 0x7fcad40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad8a6d640 1 -- 172.21.15.50:0/1728987486 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717087645 0 0) 0x7fcad406a7c0 con 0x7fcad4160300 2023-08-10T10:49:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad8a6d640 1 -- 172.21.15.50:0/1728987486 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac0003520 con 0x7fcad4160300 2023-08-10T10:49:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad926e640 1 -- 172.21.15.50:0/1728987486 >> v1:172.21.15.117:6789/0 conn(0x7fcad40b62f0 legacy=0x7fcad40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad926e640 1 -- 172.21.15.50:0/1728987486 >> v1:172.21.15.50:6789/0 conn(0x7fcad4160300 legacy=0x7fcad406a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.803+0000 7fcad926e640 1 -- 172.21.15.50:0/1728987486 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad406ad70 con 0x7fcad40cd1c0 2023-08-10T10:49:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.804+0000 7fcad926e640 1 --2- 172.21.15.50:0/1728987486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40cd1c0 0x7fcad40cd670 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3010072b184dc807 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcad8a6d640 1 -- 172.21.15.50:0/1728987486 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4030610 con 0x7fcad40cd1c0 2023-08-10T10:49:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcad8a6d640 1 -- 172.21.15.50:0/1728987486 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4030770 con 0x7fcad40cd1c0 2023-08-10T10:49:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcad8a6d640 1 -- 172.21.15.50:0/1728987486 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4030ae0 con 0x7fcad40cd1c0 2023-08-10T10:49:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcadaa71640 1 -- 172.21.15.50:0/1728987486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40cd1c0 msgr2=0x7fcad40cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcadaa71640 1 --2- 172.21.15.50:0/1728987486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40cd1c0 0x7fcad40cd670 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b960 comp rx=0 tx=0).stop 2023-08-10T10:49:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcadaa71640 1 -- 172.21.15.50:0/1728987486 shutdown_connections 2023-08-10T10:49:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcadaa71640 1 --2- 172.21.15.50:0/1728987486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40cd1c0 0x7fcad40cd670 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.805+0000 7fcadaa71640 1 -- 172.21.15.50:0/1728987486 >> 172.21.15.50:0/1728987486 conn(0x7fcad40d2960 msgr2=0x7fcad40d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.806+0000 7fcadaa71640 1 -- 172.21.15.50:0/1728987486 shutdown_connections 2023-08-10T10:49:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.806+0000 7fcadaa71640 1 -- 172.21.15.50:0/1728987486 wait complete. 2023-08-10T10:49:46.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.807+0000 7fcadaa71640 1 Processor -- start 2023-08-10T10:49:46.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.807+0000 7fcadaa71640 1 -- start start 2023-08-10T10:49:46.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad40cd1c0 0x7fcad41f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 0x7fcad40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad41f5a30 con 0x7fcad40b62f0 2023-08-10T10:49:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad41f2880 con 0x7fcad40cd1c0 2023-08-10T10:49:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.808+0000 7fcadaa71640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad41f2b60 con 0x7fcad4160300 2023-08-10T10:49:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40498/0 (socket says 172.21.15.50:40498) 2023-08-10T10:49:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 -- 172.21.15.50:0/3102948627 learned_addr learned my addr 172.21.15.50:0/3102948627 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad926e640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad40cd1c0 0x7fcad41f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcada270640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 0x7fcad40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 -- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 msgr2=0x7fcad40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 0x7fcad40cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 -- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad40cd1c0 msgr2=0x7fcad41f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad40cd1c0 0x7fcad41f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcad9a6f640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009400 con 0x7fcad40b62f0 2023-08-10T10:49:46.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.809+0000 7fcada270640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 0x7fcad40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:46.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcad9a6f640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c500 tx=0x7fcad000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0005ce0 con 0x7fcad40b62f0 2023-08-10T10:49:46.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0005e40 con 0x7fcad40b62f0 2023-08-10T10:49:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0007330 con 0x7fcad40b62f0 2023-08-10T10:49:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad41f2e40 con 0x7fcad40b62f0 2023-08-10T10:49:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.810+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad41f6390 con 0x7fcad40b62f0 2023-08-10T10:49:46.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.812+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad4066e30 con 0x7fcad40b62f0 2023-08-10T10:49:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.812+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcad0007550 con 0x7fcad40b62f0 2023-08-10T10:49:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.813+0000 7fcaca7fc640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 0x7fcab806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.813+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcad0088b40 con 0x7fcad40b62f0 2023-08-10T10:49:46.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.814+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fcab8072da0 con 0x7fcad40b62f0 2023-08-10T10:49:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.814+0000 7fcad926e640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 0x7fcab806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.814+0000 7fcad926e640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 0x7fcab806d110 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcac4036000 tx=0x7fcac4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:46.818+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcad0017060 con 0x7fcad40b62f0 2023-08-10T10:49:47.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.008+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcad415f870 con 0x7fcad40b62f0 2023-08-10T10:49:47.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.009+0000 7fcaca7fc640 1 -- 172.21.15.50:0/3102948627 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcad0053d40 con 0x7fcad40b62f0 2023-08-10T10:49:47.010 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:49:47.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 msgr2=0x7fcab806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 0x7fcab806d110 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcac4036000 tx=0x7fcac4008030 comp rx=0 tx=0).stop 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 msgr2=0x7fcad41f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c500 tx=0x7fcad000c9c0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 shutdown_connections 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad4160300 0x7fcad40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcab806ac50 0x7fcab806d110 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad40cd1c0 0x7fcad41f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 --2- 172.21.15.50:0/3102948627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad40b62f0 0x7fcad41f5e50 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 >> 172.21.15.50:0/3102948627 conn(0x7fcad40d2960 msgr2=0x7fcad4069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 shutdown_connections 2023-08-10T10:49:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.012+0000 7fcadaa71640 1 -- 172.21.15.50:0/3102948627 wait complete. 2023-08-10T10:49:47.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:49:47.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.274+0000 7ff6d32b4640 1 Processor -- start 2023-08-10T10:49:47.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.274+0000 7ff6d32b4640 1 -- start start 2023-08-10T10:49:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.275+0000 7ff6d32b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 0x7ff6cc160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.275+0000 7ff6d32b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc160a40 con 0x7ff6cc15cb90 2023-08-10T10:49:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.275+0000 7ff6d32b4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0b4bb0 con 0x7ff6cc0b4640 2023-08-10T10:49:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6d32b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0b4e90 con 0x7ff6cc15cf70 2023-08-10T10:49:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6d1050640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6cc15cb90 0x7ff6cc0b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35984/0 (socket says 172.21.15.50:35984) 2023-08-10T10:49:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6d1050640 1 -- 172.21.15.50:0/1922607494 learned_addr learned my addr 172.21.15.50:0/1922607494 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6d084f640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 0x7ff6cc160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874064117 0 0) 0x7ff6cc160a40 con 0x7ff6cc15cb90 2023-08-10T10:49:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.276+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b8003520 con 0x7ff6cc15cb90 2023-08-10T10:49:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 337624986 0 0) 0x7ff6b8003520 con 0x7ff6cc15cb90 2023-08-10T10:49:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 msgr2=0x7ff6cc160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 0x7ff6cc160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 >> v1:172.21.15.117:6789/0 conn(0x7ff6cc0b4640 legacy=0x7ff6cc06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0b5170 con 0x7ff6cc15cb90 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff6c8001670 con 0x7ff6cc15cb90 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 >> v1:172.21.15.50:6789/0 conn(0x7ff6cc15cb90 legacy=0x7ff6cc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6b80039a0 0x7ff6b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 0x7ff6b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0b4e90 con 0x7ff6b80047c0 2023-08-10T10:49:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b800ba60 con 0x7ff6b80039a0 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b800bc20 con 0x7ff6cc15cf70 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.277+0000 7ff6d084f640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.278+0000 7ff6d084f640 1 -- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 msgr2=0x7ff6b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.278+0000 7ff6d084f640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6cc15cf70 0x7ff6b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.278+0000 7ff6d084f640 1 -- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6b80039a0 msgr2=0x7ff6b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.278+0000 7ff6d084f640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6b80039a0 0x7ff6b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.278+0000 7ff6d084f640 1 -- 172.21.15.50:0/1922607494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0b5170 con 0x7ff6b80047c0 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.279+0000 7ff6d084f640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009a90 tx=0x7ff6b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1c21e1057b604e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.279+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc02c6b0 con 0x7ff6b80047c0 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.279+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc02c810 con 0x7ff6b80047c0 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.279+0000 7ff6c3fff640 1 -- 172.21.15.50:0/1922607494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc02cba0 con 0x7ff6b80047c0 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 -- 172.21.15.50:0/1922607494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b80047c0 msgr2=0x7ff6b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/1922607494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009a90 tx=0x7ff6b80057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d1851640 1 -- 172.21.15.50:0/1922607494 reap_dead start 2023-08-10T10:49:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 -- 172.21.15.50:0/1922607494 shutdown_connections 2023-08-10T10:49:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 -- 172.21.15.50:0/1922607494 >> 172.21.15.50:0/1922607494 conn(0x7ff6cc0cf640 msgr2=0x7ff6cc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 -- 172.21.15.50:0/1922607494 shutdown_connections 2023-08-10T10:49:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.280+0000 7ff6d32b4640 1 -- 172.21.15.50:0/1922607494 wait complete. 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.282+0000 7ff6d32b4640 1 Processor -- start 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.282+0000 7ff6d32b4640 1 -- start start 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6b80047c0 0x7ff6cc0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0c8f30 0x7ff6cc0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc151550 con 0x7ff6cc1510d0 2023-08-10T10:49:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c7800 con 0x7ff6cc0c8f30 2023-08-10T10:49:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d32b4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c8930 con 0x7ff6b80047c0 2023-08-10T10:49:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d084f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d084f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40506/0 (socket says 172.21.15.50:40506) 2023-08-10T10:49:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d084f640 1 -- 172.21.15.50:0/3536469348 learned_addr learned my addr 172.21.15.50:0/3536469348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d1050640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6b80047c0 0x7ff6cc0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.283+0000 7ff6d1851640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0c8f30 0x7ff6cc0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 -- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6b80047c0 msgr2=0x7ff6cc0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6b80047c0 0x7ff6cc0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 -- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0c8f30 msgr2=0x7ff6cc0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0c8f30 0x7ff6cc0cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0c67e0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d084f640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc02c250 tx=0x7ff6bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc003810 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc003970 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc003ce0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.284+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc0c6ac0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.285+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc0c93b0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.286+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc0c6640 con 0x7ff6cc1510d0 2023-08-10T10:49:47.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.287+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6bc040450 con 0x7ff6cc1510d0 2023-08-10T10:49:47.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.288+0000 7ff6c1ffb640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 0x7ff6b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.288+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6bc0ab3e0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.288+0000 7ff6d1050640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 0x7ff6b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.288+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7ff6b0072da0 con 0x7ff6cc1510d0 2023-08-10T10:49:47.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.289+0000 7ff6d1050640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 0x7ff6b006d110 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8001eb0 tx=0x7ff6c8001740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.292+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff6cc0c6640 con 0x7ff6cc1510d0 2023-08-10T10:49:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.484+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6cc0c6640 con 0x7ff6cc1510d0 2023-08-10T10:49:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.486+0000 7ff6c1ffb640 1 -- 172.21.15.50:0/3536469348 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6cc0c6640 con 0x7ff6cc1510d0 2023-08-10T10:49:47.487 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:49:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.488+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 msgr2=0x7ff6b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.488+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 0x7ff6b006d110 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8001eb0 tx=0x7ff6c8001740 comp rx=0 tx=0).stop 2023-08-10T10:49:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.488+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 msgr2=0x7ff6cc0c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.488+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc02c250 tx=0x7ff6bc004730 comp rx=0 tx=0).stop 2023-08-10T10:49:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 shutdown_connections 2023-08-10T10:49:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6b006ac50 0x7ff6b006d110 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6cc0c8f30 0x7ff6cc0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6cc1510d0 0x7ff6cc0c72c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 --2- 172.21.15.50:0/3536469348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6b80047c0 0x7ff6cc0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 >> 172.21.15.50:0/3536469348 conn(0x7ff6cc0cf640 msgr2=0x7ff6cc157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 shutdown_connections 2023-08-10T10:49:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.489+0000 7ff6d32b4640 1 -- 172.21.15.50:0/3536469348 wait complete. 2023-08-10T10:49:47.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:49:47.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.730+0000 7f3bb9b53640 1 Processor -- start 2023-08-10T10:49:47.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.730+0000 7f3bb9b53640 1 -- start start 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb9b53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb40696a0 0x7f3bb4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb9b53640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3bb415e4d0 0x7f3bb415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb9b53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb406a040 con 0x7f3bb41583c0 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb9b53640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb415aee0 con 0x7f3bb415e4d0 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb9b53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b2100 con 0x7f3bb40696a0 2023-08-10T10:49:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb8b51640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bb41583c0 0x7f3bb40b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35996/0 (socket says 172.21.15.50:35996) 2023-08-10T10:49:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.732+0000 7f3bb8b51640 1 -- 172.21.15.50:0/700593381 learned_addr learned my addr 172.21.15.50:0/700593381 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb9352640 1 --2- 172.21.15.50:0/700593381 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415e4d0 0x7f3bb415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440268088 0 0) 0x7f3bb406a040 con 0x7f3bb41583c0 2023-08-10T10:49:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb40696a0 0x7f3bb4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba4003520 con 0x7f3bb41583c0 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2039370843 0 0) 0x7f3ba4003520 con 0x7f3bb41583c0 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb40696a0 msgr2=0x7f3bb4069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bb40696a0 0x7f3bb4069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415e4d0 msgr2=0x7f3bb415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/700593381 >> v2:172.21.15.117:3300/0 conn(0x7f3bb415e4d0 0x7f3bb415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb415b1a0 con 0x7f3bb41583c0 2023-08-10T10:49:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3ba8001670 con 0x7f3bb41583c0 2023-08-10T10:49:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.733+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 >> v1:172.21.15.50:6789/0 conn(0x7f3bb41583c0 legacy=0x7f3bb40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40039e0 0x7f3ba4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40047c0 0x7f3ba4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba4005180 0x7f3ba400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb415aee0 con 0x7f3ba40039e0 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b2100 con 0x7f3ba4005180 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba400bf70 con 0x7f3ba40047c0 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40039e0 0x7f3ba4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40047c0 0x7f3ba4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 -- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40047c0 msgr2=0x7f3ba4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40047c0 0x7f3ba4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 -- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba4005180 msgr2=0x7f3ba400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba4005180 0x7f3ba400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb8b51640 1 -- 172.21.15.50:0/700593381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4003520 con 0x7f3ba40039e0 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.734+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40047c0 0x7f3ba4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.735+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40039e0 0x7f3ba4003e00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001eb0 tx=0x7f3ba40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2595c62a81b3b1a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8005ad0 con 0x7f3ba40039e0 2023-08-10T10:49:47.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8005c30 con 0x7f3ba40039e0 2023-08-10T10:49:47.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb37fe640 1 -- 172.21.15.50:0/700593381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba802c8b0 con 0x7f3ba40039e0 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb9b53640 1 -- 172.21.15.50:0/700593381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40039e0 msgr2=0x7f3ba4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/700593381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40039e0 0x7f3ba4003e00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001eb0 tx=0x7f3ba40057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb9352640 1 -- 172.21.15.50:0/700593381 reap_dead start 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb9b53640 1 -- 172.21.15.50:0/700593381 shutdown_connections 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.736+0000 7f3bb9b53640 1 -- 172.21.15.50:0/700593381 >> 172.21.15.50:0/700593381 conn(0x7f3bb40caf80 msgr2=0x7f3bb40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.737+0000 7f3bb9b53640 1 -- 172.21.15.50:0/700593381 shutdown_connections 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.737+0000 7f3bb9b53640 1 -- 172.21.15.50:0/700593381 wait complete. 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.738+0000 7f3bb9b53640 1 Processor -- start 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.738+0000 7f3bb9b53640 1 -- start start 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40039e0 0x7f3bb41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb4153760 0x7f3bb4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40ca880 con 0x7f3bb41543a0 2023-08-10T10:49:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40ca530 con 0x7f3bb4153760 2023-08-10T10:49:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.739+0000 7f3bb9b53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40caca0 con 0x7f3ba40039e0 2023-08-10T10:49:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40528/0 (socket says 172.21.15.50:40528) 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1717424630 learned_addr learned my addr 172.21.15.50:0/1717424630 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40039e0 msgr2=0x7f3bb41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40039e0 0x7f3bb41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb4153760 msgr2=0x7f3bb4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb4153760 0x7f3bb4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4158ce0 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.740+0000 7f3bb3fff640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0012aa0 tx=0x7f3ba0012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.741+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000da50 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.741+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000dbb0 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.741+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb415a670 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.741+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0018420 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.741+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb4154120 con 0x7f3bb41543a0 2023-08-10T10:49:47.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.742+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4066e30 con 0x7f3bb41543a0 2023-08-10T10:49:47.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.743+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ba0018580 con 0x7f3bb41543a0 2023-08-10T10:49:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.744+0000 7f3bb17fa640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 0x7f3b9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.744+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ba008d950 con 0x7f3bb41543a0 2023-08-10T10:49:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.744+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f3b98072da0 con 0x7f3bb41543a0 2023-08-10T10:49:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.744+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 0x7f3b9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.745+0000 7f3bb8b51640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 0x7f3b9806d110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8034000 tx=0x7f3ba802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.749+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3ba00588d0 con 0x7f3bb41543a0 2023-08-10T10:49:47.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.942+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bb40af060 con 0x7f3bb41543a0 2023-08-10T10:49:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.942+0000 7f3bb17fa640 1 -- 172.21.15.50:0/1717424630 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ba000b770 con 0x7f3bb41543a0 2023-08-10T10:49:47.943 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:49:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 msgr2=0x7f3b9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 0x7f3b9806d110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8034000 tx=0x7f3ba802e000 comp rx=0 tx=0).stop 2023-08-10T10:49:47.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 msgr2=0x7f3bb40ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0012aa0 tx=0x7f3ba0012f60 comp rx=0 tx=0).stop 2023-08-10T10:49:47.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 shutdown_connections 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b9806ac50 0x7f3b9806d110 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bb4153760 0x7f3bb4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bb41543a0 0x7f3bb40ccef0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 --2- 172.21.15.50:0/1717424630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba40039e0 0x7f3bb41587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.945+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 >> 172.21.15.50:0/1717424630 conn(0x7f3bb40caf80 msgr2=0x7f3bb41578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.946+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 shutdown_connections 2023-08-10T10:49:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:47.946+0000 7f3bb9b53640 1 -- 172.21.15.50:0/1717424630 wait complete. 2023-08-10T10:49:47.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:49:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.201+0000 7f3ff0afd640 1 Processor -- start 2023-08-10T10:49:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.201+0000 7f3ff0afd640 1 -- start start 2023-08-10T10:49:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec1599e0 0x7f3fec0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 0x7f3fec0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0ccff0 con 0x7f3fec1599e0 2023-08-10T10:49:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0cdca0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3ff0afd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0cdf80 con 0x7f3fec0c9000 2023-08-10T10:49:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3feb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec1599e0 0x7f3fec0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3feb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec1599e0 0x7f3fec0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40544/0 (socket says 172.21.15.50:40544) 2023-08-10T10:49:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.203+0000 7f3feb7fe640 1 -- 172.21.15.50:0/936932786 learned_addr learned my addr 172.21.15.50:0/936932786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feaffd640 1 --2- 172.21.15.50:0/936932786 >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 0x7f3fec0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3febfff640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feb7fe640 1 -- 172.21.15.50:0/936932786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 msgr2=0x7f3fec069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feb7fe640 1 -- 172.21.15.50:0/936932786 >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 msgr2=0x7f3fec0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/936932786 >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 0x7f3fec0696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feb7fe640 1 -- 172.21.15.50:0/936932786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0b2910 con 0x7f3fec1599e0 2023-08-10T10:49:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.204+0000 7f3feaffd640 1 --2- 172.21.15.50:0/936932786 >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 0x7f3fec0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.205+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec1599e0 0x7f3fec0ccab0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0adf70 tx=0x7f3fdc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec06f66bca40519 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.205+0000 7f3fea7fc640 1 -- 172.21.15.50:0/936932786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031860 con 0x7f3fec1599e0 2023-08-10T10:49:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.205+0000 7f3fea7fc640 1 -- 172.21.15.50:0/936932786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0319c0 con 0x7f3fec1599e0 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.205+0000 7f3fea7fc640 1 -- 172.21.15.50:0/936932786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031d50 con 0x7f3fec1599e0 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 -- 172.21.15.50:0/936932786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec1599e0 msgr2=0x7f3fec0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec1599e0 0x7f3fec0ccab0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0adf70 tx=0x7f3fdc02b900 comp rx=0 tx=0).stop 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 -- 172.21.15.50:0/936932786 shutdown_connections 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/936932786 >> v2:172.21.15.117:3300/0 conn(0x7f3fec0c8b50 0x7f3fec0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/936932786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec1599e0 0x7f3fec0ccab0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 -- 172.21.15.50:0/936932786 >> 172.21.15.50:0/936932786 conn(0x7f3fec0caf80 msgr2=0x7f3fec0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 -- 172.21.15.50:0/936932786 shutdown_connections 2023-08-10T10:49:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.206+0000 7f3ff0afd640 1 -- 172.21.15.50:0/936932786 wait complete. 2023-08-10T10:49:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.208+0000 7f3ff0afd640 1 Processor -- start 2023-08-10T10:49:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.208+0000 7f3ff0afd640 1 -- start start 2023-08-10T10:49:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 0x7f3fec06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec1f2500 con 0x7f3fec0c8b50 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15fd10 con 0x7f3fec1599e0 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.209+0000 7f3ff0afd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15fff0 con 0x7f3fec0c9000 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40552/0 (socket says 172.21.15.50:40552) 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 -- 172.21.15.50:0/133456679 learned_addr learned my addr 172.21.15.50:0/133456679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3febfff640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 0x7f3fec06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feaffd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 -- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 msgr2=0x7f3fec15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec15f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 -- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 msgr2=0x7f3fec06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 0x7f3fec06ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3feb7fe640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094d0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.210+0000 7f3febfff640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 0x7f3fec06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc02b940 tx=0x7f3fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc03ad30 con 0x7f3fec0c8b50 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0443f0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0447a0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec1602d0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.211+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec15a560 con 0x7f3fec0c8b50 2023-08-10T10:49:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.212+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec0cd8d0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.213+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fdc04d450 con 0x7f3fec0c8b50 2023-08-10T10:49:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.214+0000 7f3fd3fff640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 0x7f3fd806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.214+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fdc0abac0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.214+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f3fd8072da0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.214+0000 7f3feaffd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 0x7f3fd806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.215+0000 7f3feaffd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 0x7f3fd806d110 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006fd0 tx=0x7f3fe0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.218+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3fdc035020 con 0x7f3fec0c8b50 2023-08-10T10:49:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.411+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fec066e30 con 0x7f3fec0c8b50 2023-08-10T10:49:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.412+0000 7f3fd3fff640 1 -- 172.21.15.50:0/133456679 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fdc076ad0 con 0x7f3fec0c8b50 2023-08-10T10:49:48.413 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:49:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.414+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 msgr2=0x7f3fd806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.414+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 0x7f3fd806d110 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006fd0 tx=0x7f3fe0008040 comp rx=0 tx=0).stop 2023-08-10T10:49:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.414+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 msgr2=0x7f3fec1f1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.414+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc02b940 tx=0x7f3fdc0046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 shutdown_connections 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3fd806ac50 0x7f3fd806d110 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fec1599e0 0x7f3fec06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fec0c9000 0x7f3fec15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 --2- 172.21.15.50:0/133456679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0c8b50 0x7f3fec1f1fc0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 >> 172.21.15.50:0/133456679 conn(0x7f3fec0caf80 msgr2=0x7f3fec0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 shutdown_connections 2023-08-10T10:49:48.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.415+0000 7f3ff0afd640 1 -- 172.21.15.50:0/133456679 wait complete. 2023-08-10T10:49:48.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:49:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.668+0000 7f6042ed9640 1 Processor -- start 2023-08-10T10:49:48.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.668+0000 7f6042ed9640 1 -- start start 2023-08-10T10:49:48.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6042ed9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15a820 0x7f603c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6042ed9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f603c069db0 0x7f603c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6042ed9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c15bcb0 con 0x7f603c15ac00 2023-08-10T10:49:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6042ed9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0c5540 con 0x7f603c069db0 2023-08-10T10:49:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6042ed9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c15b0a0 con 0x7f603c15a820 2023-08-10T10:49:48.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6041476640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f603c069db0 0x7f603c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6041476640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f603c069db0 0x7f603c0cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40568/0 (socket says 172.21.15.50:40568) 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6041476640 1 -- 172.21.15.50:0/957074213 learned_addr learned my addr 172.21.15.50:0/957074213 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.670+0000 7f6040c75640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15a820 0x7f603c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.671+0000 7f6041476640 1 -- 172.21.15.50:0/957074213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15a820 msgr2=0x7f603c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.671+0000 7f6041476640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15a820 0x7f603c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.671+0000 7f6041476640 1 -- 172.21.15.50:0/957074213 >> v1:172.21.15.117:6789/0 conn(0x7f603c15ac00 legacy=0x7f603c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.671+0000 7f6041476640 1 -- 172.21.15.50:0/957074213 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c15b380 con 0x7f603c069db0 2023-08-10T10:49:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.672+0000 7f6041476640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c0cc370 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6034009e50 tx=0x7f603402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611eda7bdcba0610 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f603b7fe640 1 -- 172.21.15.50:0/957074213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603402cb00 con 0x7f603c069db0 2023-08-10T10:49:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f603b7fe640 1 -- 172.21.15.50:0/957074213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603402cc60 con 0x7f603c069db0 2023-08-10T10:49:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f603b7fe640 1 -- 172.21.15.50:0/957074213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340343f0 con 0x7f603c069db0 2023-08-10T10:49:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 -- 172.21.15.50:0/957074213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 msgr2=0x7f603c0cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c0cc370 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6034009e50 tx=0x7f603402bf60 comp rx=0 tx=0).stop 2023-08-10T10:49:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 -- 172.21.15.50:0/957074213 shutdown_connections 2023-08-10T10:49:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c0cc370 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 --2- 172.21.15.50:0/957074213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15a820 0x7f603c06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.673+0000 7f6042ed9640 1 -- 172.21.15.50:0/957074213 >> 172.21.15.50:0/957074213 conn(0x7f603c0b08e0 msgr2=0x7f603c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.674+0000 7f6042ed9640 1 -- 172.21.15.50:0/957074213 shutdown_connections 2023-08-10T10:49:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.674+0000 7f6042ed9640 1 -- 172.21.15.50:0/957074213 wait complete. 2023-08-10T10:49:48.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.676+0000 7f6042ed9640 1 Processor -- start 2023-08-10T10:49:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.676+0000 7f6042ed9640 1 -- start start 2023-08-10T10:49:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603c15a820 0x7f603c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 0x7f603c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c4b50 con 0x7f603c069db0 2023-08-10T10:49:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c3f40 con 0x7f603c15a820 2023-08-10T10:49:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.677+0000 7f6042ed9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c4220 con 0x7f603c15ac00 2023-08-10T10:49:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40578/0 (socket says 172.21.15.50:40578) 2023-08-10T10:49:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 -- 172.21.15.50:0/3365562613 learned_addr learned my addr 172.21.15.50:0/3365562613 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:48.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f603bfff640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603c15a820 0x7f603c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6041476640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 0x7f603c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 -- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 msgr2=0x7f603c1498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 0x7f603c1498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 -- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603c15a820 msgr2=0x7f603c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603c15a820 0x7f603c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6040c75640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009b30 con 0x7f603c069db0 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.678+0000 7f6041476640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 0x7f603c1498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f6040c75640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f603000d800 tx=0x7f603000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000b6c0 con 0x7f603c069db0 2023-08-10T10:49:48.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000b820 con 0x7f603c069db0 2023-08-10T10:49:48.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000bbb0 con 0x7f603c069db0 2023-08-10T10:49:48.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0c4500 con 0x7f603c069db0 2023-08-10T10:49:48.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.679+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c0c3b60 con 0x7f603c069db0 2023-08-10T10:49:48.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.680+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c04e270 con 0x7f603c069db0 2023-08-10T10:49:48.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.681+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f603000bd10 con 0x7f603c069db0 2023-08-10T10:49:48.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.682+0000 7f60397fa640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 0x7f602806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:48.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.682+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6030089aa0 con 0x7f603c069db0 2023-08-10T10:49:48.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.682+0000 7f603bfff640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 0x7f602806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:48.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.682+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f6028072dd0 con 0x7f603c069db0 2023-08-10T10:49:48.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.683+0000 7f603bfff640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 0x7f602806d140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f603c156380 tx=0x7f602c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:48.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.686+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6030054ab0 con 0x7f603c069db0 2023-08-10T10:49:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.895+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f603c15b660 con 0x7f603c069db0 2023-08-10T10:49:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.896+0000 7f60397fa640 1 -- 172.21.15.50:0/3365562613 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v160) v1 ==== 80+0+0 (secure 0 0 0) 0x7f60300580d0 con 0x7f603c069db0 2023-08-10T10:49:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:49:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 msgr2=0x7f602806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 0x7f602806d140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f603c156380 tx=0x7f602c009040 comp rx=0 tx=0).stop 2023-08-10T10:49:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 msgr2=0x7f603c14d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f603000d800 tx=0x7f603000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 shutdown_connections 2023-08-10T10:49:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f603c15ac00 0x7f603c1498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f602806ac80 0x7f602806d140 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603c15a820 0x7f603c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.898+0000 7f6042ed9640 1 --2- 172.21.15.50:0/3365562613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f603c069db0 0x7f603c14d240 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.899+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 >> 172.21.15.50:0/3365562613 conn(0x7f603c0b08e0 msgr2=0x7f603c06b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.899+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 shutdown_connections 2023-08-10T10:49:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:48.899+0000 7f6042ed9640 1 -- 172.21.15.50:0/3365562613 wait complete. 2023-08-10T10:49:48.919 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:49:48.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:48.920 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:49:49.044 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:49:49.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:49.045 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:49:49.094 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:49:49.094 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:49.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:49:49.159 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:49:49.159 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:49.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:49:49.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:49:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.463+0000 7f3aac2a6640 1 Processor -- start 2023-08-10T10:49:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.463+0000 7f3aac2a6640 1 -- start start 2023-08-10T10:49:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aac2a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3aa40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aac2a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa4071c70 con 0x7f3aa415aa40 2023-08-10T10:49:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aac2a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40713d0 con 0x7f3aa40b3f30 2023-08-10T10:49:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aac2a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40716b0 con 0x7f3aa40b0c60 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aaa042640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3aa415aa40 0x7f3aa40b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36006/0 (socket says 172.21.15.50:36006) 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.465+0000 7f3aaa042640 1 -- 172.21.15.50:0/4163823793 learned_addr learned my addr 172.21.15.50:0/4163823793 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9841640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3aa40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419801161 0 0) 0x7f3aa4071c70 con 0x7f3aa415aa40 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a90003520 con 0x7f3aa415aa40 2023-08-10T10:49:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238741732 0 0) 0x7f3a90003520 con 0x7f3aa415aa40 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 msgr2=0x7f3aa40c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3aa40c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 >> v1:172.21.15.117:6789/0 conn(0x7f3aa40b3f30 legacy=0x7f3aa40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa4071990 con 0x7f3aa415aa40 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f3aa0001670 con 0x7f3aa415aa40 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 >> v1:172.21.15.50:6789/0 conn(0x7f3aa415aa40 legacy=0x7f3aa40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900039a0 0x7f3a90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a900047c0 0x7f3a90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3a900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40716b0 con 0x7f3a900047c0 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9000bab0 con 0x7f3a900039a0 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.466+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9000bc70 con 0x7f3aa40b0c60 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a900047c0 0x7f3a90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aaa042640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900039a0 0x7f3a90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aaa843640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3a900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 -- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 msgr2=0x7f3a900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3a900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 -- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900039a0 msgr2=0x7f3a90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900039a0 0x7f3a90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aa9841640 1 -- 172.21.15.50:0/4163823793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90003520 con 0x7f3a900047c0 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aaa843640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40b0c60 0x7f3a900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.467+0000 7f3aaa042640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900039a0 0x7f3a90003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.468+0000 7f3aa9841640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a900047c0 0x7f3a90004c40 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009ac0 tx=0x7f3a900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5e0079a36d0c97 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9402c6b0 con 0x7f3a900047c0 2023-08-10T10:49:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9402c810 con 0x7f3a900047c0 2023-08-10T10:49:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aa9040640 1 -- 172.21.15.50:0/4163823793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9402cba0 con 0x7f3a900047c0 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aac2a6640 1 -- 172.21.15.50:0/4163823793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a900047c0 msgr2=0x7f3a90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/4163823793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a900047c0 0x7f3a90004c40 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009ac0 tx=0x7f3a900057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aaa843640 1 -- 172.21.15.50:0/4163823793 reap_dead start 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aac2a6640 1 -- 172.21.15.50:0/4163823793 shutdown_connections 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aac2a6640 1 -- 172.21.15.50:0/4163823793 >> 172.21.15.50:0/4163823793 conn(0x7f3aa406b590 msgr2=0x7f3aa40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.469+0000 7f3aac2a6640 1 -- 172.21.15.50:0/4163823793 shutdown_connections 2023-08-10T10:49:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.470+0000 7f3aac2a6640 1 -- 172.21.15.50:0/4163823793 wait complete. 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.471+0000 7f3aac2a6640 1 Processor -- start 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.471+0000 7f3aac2a6640 1 -- start start 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 0x7f3aa40c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 0x7f3aa4146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4152540 con 0x7f3aa415b5c0 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40c5f00 con 0x7f3a900047c0 2023-08-10T10:49:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.472+0000 7f3aac2a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40c61e0 con 0x7f3aa40c5790 2023-08-10T10:49:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40608/0 (socket says 172.21.15.50:40608) 2023-08-10T10:49:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 -- 172.21.15.50:0/1737185741 learned_addr learned my addr 172.21.15.50:0/1737185741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa042640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 0x7f3aa40c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aa9841640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 0x7f3aa4146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 -- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 msgr2=0x7f3aa4146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 0x7f3aa4146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 -- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 msgr2=0x7f3aa40c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 0x7f3aa40c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa843640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40c64c0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aaa042640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 0x7f3aa40c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.473+0000 7f3aa9841640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 0x7f3aa4146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3aaa843640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4070400 tx=0x7f3a9c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c003970 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c003af0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c005030 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa4152800 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.474+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa4146f90 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.475+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa404e270 con 0x7f3aa415b5c0 2023-08-10T10:49:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.476+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a9c005190 con 0x7f3aa415b5c0 2023-08-10T10:49:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.477+0000 7f3a9affd640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 0x7f3a8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.477+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a9c08cbe0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.478+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f3a88072da0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.478+0000 7f3aaa042640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 0x7f3a8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.478+0000 7f3aaa042640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 0x7f3a8806d110 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00017a0 tx=0x7f3aa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.482+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a9c057bf0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.713+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aa415a240 con 0x7f3aa415b5c0 2023-08-10T10:49:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.714+0000 7f3a9affd640 1 -- 172.21.15.50:0/1737185741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f3a9c00c4d0 con 0x7f3aa415b5c0 2023-08-10T10:49:49.715 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:49.715 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:49:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:49:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 msgr2=0x7f3a8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 0x7f3a8806d110 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00017a0 tx=0x7f3aa0009040 comp rx=0 tx=0).stop 2023-08-10T10:49:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 msgr2=0x7f3aa415ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4070400 tx=0x7f3a9c0020c0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 shutdown_connections 2023-08-10T10:49:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3aa415b5c0 0x7f3aa415ba40 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3aa40c5790 0x7f3aa4146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3a8806ac50 0x7f3a8806d110 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 --2- 172.21.15.50:0/1737185741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900047c0 0x7f3aa40c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 >> 172.21.15.50:0/1737185741 conn(0x7f3aa406b590 msgr2=0x7f3aa40b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:49.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 shutdown_connections 2023-08-10T10:49:49.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.717+0000 7f3aac2a6640 1 -- 172.21.15.50:0/1737185741 wait complete. 2023-08-10T10:49:49.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.964+0000 7ffb0a80d640 1 Processor -- start 2023-08-10T10:49:49.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.964+0000 7ffb0a80d640 1 -- start start 2023-08-10T10:49:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.965+0000 7ffb0a80d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb040b0c60 0x7ffb040c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.965+0000 7ffb0a80d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffb040c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.965+0000 7ffb0a80d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb04071c70 con 0x7ffb0415aa40 2023-08-10T10:49:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb0a80d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb040713d0 con 0x7ffb040b0c60 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb0a80d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040716b0 con 0x7ffb040b3f30 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb03fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffb0415aa40 0x7ffb040b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36010/0 (socket says 172.21.15.50:36010) 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb03fff640 1 -- 172.21.15.50:0/2109590106 learned_addr learned my addr 172.21.15.50:0/2109590106 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb08daa640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffb040c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb037fe640 1 --2- 172.21.15.50:0/2109590106 >> v2:172.21.15.117:3300/0 conn(0x7ffb040b0c60 0x7ffb040c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592883485 0 0) 0x7ffb04071c70 con 0x7ffb0415aa40 2023-08-10T10:49:49.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.966+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaec003520 con 0x7ffb0415aa40 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991699184 0 0) 0x7ffaec003520 con 0x7ffb0415aa40 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 msgr2=0x7ffb040c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffb040c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 >> v2:172.21.15.117:3300/0 conn(0x7ffb040b0c60 msgr2=0x7ffb040c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 --2- 172.21.15.50:0/2109590106 >> v2:172.21.15.117:3300/0 conn(0x7ffb040b0c60 0x7ffb040c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04071990 con 0x7ffb0415aa40 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ffaf4001670 con 0x7ffb0415aa40 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 >> v1:172.21.15.50:6789/0 conn(0x7ffb0415aa40 legacy=0x7ffb040b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec003970 0x7ffaec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffaec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffaec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040713d0 con 0x7ffaec004d00 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040716b0 con 0x7ffaec003970 2023-08-10T10:49:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec00b9b0 con 0x7ffb040b3f30 2023-08-10T10:49:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb08daa640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffaec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.967+0000 7ffb037fe640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffaec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb03fff640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec003970 0x7ffaec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb08daa640 1 -- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 msgr2=0x7ffaec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb08daa640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040b3f30 0x7ffaec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb08daa640 1 -- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec003970 msgr2=0x7ffaec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb08daa640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec003970 0x7ffaec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.968+0000 7ffb08daa640 1 -- 172.21.15.50:0/2109590106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec003520 con 0x7ffaec004d00 2023-08-10T10:49:49.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.969+0000 7ffb08daa640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffaec005180 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009fc0 tx=0x7ffaec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea24f3f71789acb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.969+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc02cc20 con 0x7ffaec004d00 2023-08-10T10:49:49.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.969+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00f040 con 0x7ffaec004d00 2023-08-10T10:49:49.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.969+0000 7ffb02ffd640 1 -- 172.21.15.50:0/2109590106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc034440 con 0x7ffaec004d00 2023-08-10T10:49:49.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 -- 172.21.15.50:0/2109590106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 msgr2=0x7ffaec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/2109590106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffaec005180 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009fc0 tx=0x7ffaec0057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb08daa640 1 -- 172.21.15.50:0/2109590106 reap_dead start 2023-08-10T10:49:49.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 -- 172.21.15.50:0/2109590106 shutdown_connections 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 -- 172.21.15.50:0/2109590106 >> 172.21.15.50:0/2109590106 conn(0x7ffb0406b590 msgr2=0x7ffb040ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 -- 172.21.15.50:0/2109590106 shutdown_connections 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.970+0000 7ffb0a80d640 1 -- 172.21.15.50:0/2109590106 wait complete. 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.972+0000 7ffb0a80d640 1 Processor -- start 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.972+0000 7ffb0a80d640 1 -- start start 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040c5790 0x7ffb041f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb041f1fe0 0x7ffb04159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c5bf0 con 0x7ffaec004d00 2023-08-10T10:49:49.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c5ec0 con 0x7ffb041f1fe0 2023-08-10T10:49:49.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb0a80d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c61a0 con 0x7ffb040c5790 2023-08-10T10:49:49.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.973+0000 7ffb03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40622/0 (socket says 172.21.15.50:40622) 2023-08-10T10:49:49.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 -- 172.21.15.50:0/927553503 learned_addr learned my addr 172.21.15.50:0/927553503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb037fe640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040c5790 0x7ffb041f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 -- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040c5790 msgr2=0x7ffb041f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040c5790 0x7ffb041f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 -- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb041f1fe0 msgr2=0x7ffb04159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb041f1fe0 0x7ffb04159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040c6480 con 0x7ffaec004d00 2023-08-10T10:49:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.974+0000 7ffb03fff640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400e870 tx=0x7ffaf400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.975+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400c8d0 con 0x7ffaec004d00 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.975+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf400ca50 con 0x7ffaec004d00 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.975+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400ce00 con 0x7ffaec004d00 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.975+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb040c6760 con 0x7ffaec004d00 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.975+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb04159830 con 0x7ffaec004d00 2023-08-10T10:49:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.976+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb041f24e0 con 0x7ffaec004d00 2023-08-10T10:49:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.977+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffaf401d460 con 0x7ffaec004d00 2023-08-10T10:49:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.978+0000 7ffb00ff9640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 0x7ffaf006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.978+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffaf4089500 con 0x7ffaec004d00 2023-08-10T10:49:49.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.978+0000 7ffb037fe640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 0x7ffaf006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.978+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7ffaf0072da0 con 0x7ffaec004d00 2023-08-10T10:49:49.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.979+0000 7ffb037fe640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 0x7ffaf006d110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb04159e40 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:49.982+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb041f24e0 con 0x7ffaec004d00 2023-08-10T10:49:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.178+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb041f24e0 con 0x7ffaec004d00 2023-08-10T10:49:50.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.180+0000 7ffb00ff9640 1 -- 172.21.15.50:0/927553503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18325 (secure 0 0 0) 0x7ffb041f24e0 con 0x7ffaec004d00 2023-08-10T10:49:50.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:50.181 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:06.615766+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:50.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 msgr2=0x7ffaf006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 0x7ffaf006d110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb04159e40 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 msgr2=0x7ffb0415db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400e870 tx=0x7ffaf400ed30 comp rx=0 tx=0).stop 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 shutdown_connections 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffaf006ac50 0x7ffaf006d110 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb041f1fe0 0x7ffb04159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb040c5790 0x7ffb041f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 --2- 172.21.15.50:0/927553503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaec004d00 0x7ffb0415db20 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 >> 172.21.15.50:0/927553503 conn(0x7ffb0406b590 msgr2=0x7ffb04156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 shutdown_connections 2023-08-10T10:49:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.183+0000 7ffb0a80d640 1 -- 172.21.15.50:0/927553503 wait complete. 2023-08-10T10:49:50.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:47:25.902442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:47:26.575181+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:49:50.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:49:50.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.436+0000 7fdc4e471640 1 Processor -- start 2023-08-10T10:49:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.436+0000 7fdc4e471640 1 -- start start 2023-08-10T10:49:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.437+0000 7fdc4e471640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc4815aad0 0x7fdc4806a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc4e471640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc480ae6f0 con 0x7fdc4806a580 2023-08-10T10:49:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc4e471640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc48069bb0 con 0x7fdc48072e40 2023-08-10T10:49:50.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc4e471640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480ae940 con 0x7fdc4815aad0 2023-08-10T10:49:50.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc477fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc4806a580 0x7fdc48072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36022/0 (socket says 172.21.15.50:36022) 2023-08-10T10:49:50.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc477fe640 1 -- 172.21.15.50:0/499599726 learned_addr learned my addr 172.21.15.50:0/499599726 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:50.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.438+0000 7fdc47fff640 1 --2- 172.21.15.50:0/499599726 >> v2:172.21.15.117:3300/0 conn(0x7fdc4815aad0 0x7fdc4806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606073291 0 0) 0x7fdc480ae6f0 con 0x7fdc4806a580 2023-08-10T10:49:50.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc34003520 con 0x7fdc4806a580 2023-08-10T10:49:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636516260 0 0) 0x7fdc34003520 con 0x7fdc4806a580 2023-08-10T10:49:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 >> v2:172.21.15.117:3300/0 conn(0x7fdc4815aad0 msgr2=0x7fdc4806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 --2- 172.21.15.50:0/499599726 >> v2:172.21.15.117:3300/0 conn(0x7fdc4815aad0 0x7fdc4806a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 >> v1:172.21.15.117:6789/0 conn(0x7fdc48072e40 legacy=0x7fdc4806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48069840 con 0x7fdc4806a580 2023-08-10T10:49:50.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fdc380019f0 con 0x7fdc4806a580 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 >> v1:172.21.15.50:6789/0 conn(0x7fdc4806a580 legacy=0x7fdc48072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc34003970 0x7fdc34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480ae940 con 0x7fdc34005180 2023-08-10T10:49:50.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3400c120 con 0x7fdc34003970 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.439+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3400c2e0 con 0x7fdc340047c0 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc47fff640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc34003970 0x7fdc34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc477fe640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 -- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc340047c0 msgr2=0x7fdc34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc340047c0 0x7fdc34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 -- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc34003970 msgr2=0x7fdc34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:50.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc34003970 0x7fdc34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.440+0000 7fdc4ca0e640 1 -- 172.21.15.50:0/499599726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc34003520 con 0x7fdc34005180 2023-08-10T10:49:50.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.441+0000 7fdc4ca0e640 1 -- 172.21.15.50:0/499599726 reap_dead start 2023-08-10T10:49:50.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.441+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc3400b980 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001750 tx=0x7fdc340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c106e6e1d427782b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400052d0 con 0x7fdc34005180 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4002e050 con 0x7fdc34005180 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc46ffd640 1 -- 172.21.15.50:0/499599726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003830 con 0x7fdc34005180 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 -- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 msgr2=0x7fdc3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc3400b980 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001750 tx=0x7fdc340057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 -- 172.21.15.50:0/499599726 shutdown_connections 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 --2- 172.21.15.50:0/499599726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc3400b980 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 -- 172.21.15.50:0/499599726 >> 172.21.15.50:0/499599726 conn(0x7fdc480b12a0 msgr2=0x7fdc480b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.442+0000 7fdc4e471640 1 -- 172.21.15.50:0/499599726 shutdown_connections 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.443+0000 7fdc4e471640 1 -- 172.21.15.50:0/499599726 wait complete. 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.444+0000 7fdc4e471640 1 Processor -- start 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.445+0000 7fdc4e471640 1 -- start start 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.445+0000 7fdc4e471640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4e471640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc4815c430 0x7fdc4815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4e471640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 0x7fdc480b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4e471640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480c94f0 con 0x7fdc34005180 2023-08-10T10:49:50.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4e471640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481f5dc0 con 0x7fdc4815c430 2023-08-10T10:49:50.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4e471640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481f60a0 con 0x7fdc480b3400 2023-08-10T10:49:50.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40640/0 (socket says 172.21.15.50:40640) 2023-08-10T10:49:50.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 -- 172.21.15.50:0/809015290 learned_addr learned my addr 172.21.15.50:0/809015290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:50.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 0x7fdc480b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 -- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 msgr2=0x7fdc480b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 0x7fdc480b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 -- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc4815c430 msgr2=0x7fdc4815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc4815c430 0x7fdc4815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc47fff640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480b2920 con 0x7fdc34005180 2023-08-10T10:49:50.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.446+0000 7fdc4ca0e640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 0x7fdc480b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc47fff640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fdc30011540 tx=0x7fdc30011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30015930 con 0x7fdc34005180 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30015a90 con 0x7fdc34005180 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc480b2c00 con 0x7fdc34005180 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30015e60 con 0x7fdc34005180 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.447+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480ae1c0 con 0x7fdc34005180 2023-08-10T10:49:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.449+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc480ae3e0 con 0x7fdc34005180 2023-08-10T10:49:50.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.449+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc3000f460 con 0x7fdc34005180 2023-08-10T10:49:50.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.450+0000 7fdc44ff9640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 0x7fdc2806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.450+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc30089d40 con 0x7fdc34005180 2023-08-10T10:49:50.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.451+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fdc28072dd0 con 0x7fdc34005180 2023-08-10T10:49:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.451+0000 7fdc477fe640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 0x7fdc2806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.451+0000 7fdc477fe640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 0x7fdc2806d140 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc380012e0 tx=0x7fdc380014d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.455+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc30054d50 con 0x7fdc34005180 2023-08-10T10:49:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.646+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc480612b0 con 0x7fdc34005180 2023-08-10T10:49:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.647+0000 7fdc44ff9640 1 -- 172.21.15.50:0/809015290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc30022020 con 0x7fdc34005180 2023-08-10T10:49:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:49:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.649+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 msgr2=0x7fdc2806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.649+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 0x7fdc2806d140 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc380012e0 tx=0x7fdc380014d0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 msgr2=0x7fdc480adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fdc30011540 tx=0x7fdc30011a00 comp rx=0 tx=0).stop 2023-08-10T10:49:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 shutdown_connections 2023-08-10T10:49:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc480b3400 0x7fdc480b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdc2806ac80 0x7fdc2806d140 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc4815c430 0x7fdc4815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 --2- 172.21.15.50:0/809015290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc34005180 0x7fdc480adc80 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 >> 172.21.15.50:0/809015290 conn(0x7fdc480b12a0 msgr2=0x7fdc480af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 shutdown_connections 2023-08-10T10:49:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.650+0000 7fdc4e471640 1 -- 172.21.15.50:0/809015290 wait complete. 2023-08-10T10:49:50.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:49:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.896+0000 7f0df759e640 1 Processor -- start 2023-08-10T10:49:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.897+0000 7f0df759e640 1 -- start start 2023-08-10T10:49:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.898+0000 7f0df759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0df8161070 0x7f0df80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 0x7f0df80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df8164bf0 con 0x7f0df80c94e0 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df8164e40 con 0x7f0df8161070 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df8165120 con 0x7f0df80b0610 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0df8161070 0x7f0df80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0df8161070 0x7f0df80cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40644/0 (socket says 172.21.15.50:40644) 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df659c640 1 -- 172.21.15.50:0/1323277853 learned_addr learned my addr 172.21.15.50:0/1323277853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df659c640 1 -- 172.21.15.50:0/1323277853 >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 msgr2=0x7f0df80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.899+0000 7f0df6d9d640 1 --2- 172.21.15.50:0/1323277853 >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 0x7f0df80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.900+0000 7f0df659c640 1 --2- 172.21.15.50:0/1323277853 >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 0x7f0df80cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.900+0000 7f0df659c640 1 -- 172.21.15.50:0/1323277853 >> v1:172.21.15.117:6789/0 conn(0x7f0df80c94e0 legacy=0x7f0df80aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.900+0000 7f0df659c640 1 -- 172.21.15.50:0/1323277853 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8165400 con 0x7f0df8161070 2023-08-10T10:49:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.900+0000 7f0df6d9d640 1 --2- 172.21.15.50:0/1323277853 >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 0x7f0df80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.901+0000 7f0df659c640 1 --2- 172.21.15.50:0/1323277853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df8161070 0x7f0df80cdc60 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c1f80 tx=0x7f0de802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2fa6bcb220670 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.901+0000 7f0df5d9b640 1 -- 172.21.15.50:0/1323277853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8031870 con 0x7f0df8161070 2023-08-10T10:49:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.901+0000 7f0df5d9b640 1 -- 172.21.15.50:0/1323277853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de80319d0 con 0x7f0df8161070 2023-08-10T10:49:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.901+0000 7f0df5d9b640 1 -- 172.21.15.50:0/1323277853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8031d60 con 0x7f0df8161070 2023-08-10T10:49:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 -- 172.21.15.50:0/1323277853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df8161070 msgr2=0x7f0df80cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 --2- 172.21.15.50:0/1323277853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df8161070 0x7f0df80cdc60 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c1f80 tx=0x7f0de802b910 comp rx=0 tx=0).stop 2023-08-10T10:49:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 -- 172.21.15.50:0/1323277853 shutdown_connections 2023-08-10T10:49:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 --2- 172.21.15.50:0/1323277853 >> v2:172.21.15.117:3300/0 conn(0x7f0df80b0610 0x7f0df80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 --2- 172.21.15.50:0/1323277853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df8161070 0x7f0df80cdc60 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 -- 172.21.15.50:0/1323277853 >> 172.21.15.50:0/1323277853 conn(0x7f0df8069cd0 msgr2=0x7f0df80caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 -- 172.21.15.50:0/1323277853 shutdown_connections 2023-08-10T10:49:50.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.902+0000 7f0df759e640 1 -- 172.21.15.50:0/1323277853 wait complete. 2023-08-10T10:49:50.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.904+0000 7f0df759e640 1 Processor -- start 2023-08-10T10:49:50.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.904+0000 7f0df759e640 1 -- start start 2023-08-10T10:49:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df80b0610 0x7f0df81f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df80c4150 0x7f0df80c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80c4b20 con 0x7f0df80c94e0 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df815d1b0 con 0x7f0df80c4150 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0df759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df81f6450 con 0x7f0df80b0610 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0deffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0deffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40658/0 (socket says 172.21.15.50:40658) 2023-08-10T10:49:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.905+0000 7f0deffff640 1 -- 172.21.15.50:0/2600767954 learned_addr learned my addr 172.21.15.50:0/2600767954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 -- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df80b0610 msgr2=0x7f0df81f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df80b0610 0x7f0df81f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 -- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df80c4150 msgr2=0x7f0df80c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df80c4150 0x7f0df80c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80094d0 con 0x7f0df80c94e0 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deffff640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b3f0 tx=0x7f0de000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0011830 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0011990 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0011d40 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.906+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df815d400 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.907+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df815d9c0 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.908+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df8066e30 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.909+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0de001a400 con 0x7f0df80c94e0 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.909+0000 7f0deeffd640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 0x7f0dd806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.910+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0de00893a0 con 0x7f0df80c94e0 2023-08-10T10:49:50.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.910+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f0dd8072da0 con 0x7f0df80c94e0 2023-08-10T10:49:50.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.910+0000 7f0df659c640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 0x7f0dd806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.911+0000 7f0df659c640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 0x7f0dd806d110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0de8036000 tx=0x7f0de8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:50.914+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0de00543b0 con 0x7f0df80c94e0 2023-08-10T10:49:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.109+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0df8164670 con 0x7f0df80c94e0 2023-08-10T10:49:51.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.110+0000 7f0deeffd640 1 -- 172.21.15.50:0/2600767954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0de0015020 con 0x7f0df80c94e0 2023-08-10T10:49:51.112 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:49:51.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 msgr2=0x7f0dd806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 0x7f0dd806d110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0de8036000 tx=0x7f0de8030000 comp rx=0 tx=0).stop 2023-08-10T10:49:51.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 msgr2=0x7f0df81620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b3f0 tx=0x7f0de000b8b0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 shutdown_connections 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0dd806ac50 0x7f0dd806d110 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df80c4150 0x7f0df80c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df80c94e0 0x7f0df81620a0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 --2- 172.21.15.50:0/2600767954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df80b0610 0x7f0df81f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.113+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 >> 172.21.15.50:0/2600767954 conn(0x7f0df8069cd0 msgr2=0x7f0df80afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.114+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 shutdown_connections 2023-08-10T10:49:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.114+0000 7f0df759e640 1 -- 172.21.15.50:0/2600767954 wait complete. 2023-08-10T10:49:51.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:49:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.358+0000 7f72bd3b2640 1 Processor -- start 2023-08-10T10:49:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.358+0000 7f72bd3b2640 1 -- start start 2023-08-10T10:49:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72bd3b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72b81583c0 0x7f72b80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72bd3b2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72b80b1ba0 0x7f72b80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72bd3b2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b806a030 con 0x7f72b8069be0 2023-08-10T10:49:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72bd3b2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b815aee0 con 0x7f72b81583c0 2023-08-10T10:49:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72bd3b2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b80b2100 con 0x7f72b80b1ba0 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.360+0000 7f72b7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72b81583c0 0x7f72b80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72b81583c0 0x7f72b80b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40664/0 (socket says 172.21.15.50:40664) 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 -- 172.21.15.50:0/2782836769 learned_addr learned my addr 172.21.15.50:0/2782836769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 -- 172.21.15.50:0/2782836769 >> v2:172.21.15.117:3300/0 conn(0x7f72b80b1ba0 msgr2=0x7f72b80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 --2- 172.21.15.50:0/2782836769 >> v2:172.21.15.117:3300/0 conn(0x7f72b80b1ba0 0x7f72b80696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 -- 172.21.15.50:0/2782836769 >> v1:172.21.15.117:6789/0 conn(0x7f72b8069be0 legacy=0x7f72b806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.361+0000 7f72b7fff640 1 -- 172.21.15.50:0/2782836769 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b815b1a0 con 0x7f72b81583c0 2023-08-10T10:49:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.363+0000 7f72b7fff640 1 --2- 172.21.15.50:0/2782836769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b80b1660 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f72b80ade00 tx=0x7f72a802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423b98d1a46eab98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.363+0000 7f72b6ffd640 1 -- 172.21.15.50:0/2782836769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8031800 con 0x7f72b81583c0 2023-08-10T10:49:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.363+0000 7f72b6ffd640 1 -- 172.21.15.50:0/2782836769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8031960 con 0x7f72b81583c0 2023-08-10T10:49:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.363+0000 7f72b6ffd640 1 -- 172.21.15.50:0/2782836769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8031cf0 con 0x7f72b81583c0 2023-08-10T10:49:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 -- 172.21.15.50:0/2782836769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 msgr2=0x7f72b80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/2782836769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b80b1660 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f72b80ade00 tx=0x7f72a802b8a0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 -- 172.21.15.50:0/2782836769 shutdown_connections 2023-08-10T10:49:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/2782836769 >> v2:172.21.15.117:3300/0 conn(0x7f72b80b1ba0 0x7f72b80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/2782836769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b80b1660 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 -- 172.21.15.50:0/2782836769 >> 172.21.15.50:0/2782836769 conn(0x7f72b80caf80 msgr2=0x7f72b80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 -- 172.21.15.50:0/2782836769 shutdown_connections 2023-08-10T10:49:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.364+0000 7f72bd3b2640 1 -- 172.21.15.50:0/2782836769 wait complete. 2023-08-10T10:49:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.366+0000 7f72bd3b2640 1 Processor -- start 2023-08-10T10:49:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.366+0000 7f72bd3b2640 1 -- start start 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8069be0 0x7f72b815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 0x7f72b8070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b806e800 con 0x7f72b81583c0 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815e680 con 0x7f72b8069be0 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bd3b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b806ea50 con 0x7f72b80b1ba0 2023-08-10T10:49:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bcbb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bcbb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40670/0 (socket says 172.21.15.50:40670) 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.367+0000 7f72bcbb1640 1 -- 172.21.15.50:0/310894885 learned_addr learned my addr 172.21.15.50:0/310894885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b77fe640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 0x7f72b8070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b7fff640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8069be0 0x7f72b815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 -- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 msgr2=0x7f72b8070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 0x7f72b8070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 -- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8069be0 msgr2=0x7f72b815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8069be0 0x7f72b815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80094d0 con 0x7f72b81583c0 2023-08-10T10:49:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b77fe640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 0x7f72b8070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bcbb1640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c7b0 tx=0x7f72b000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0003d80 con 0x7f72b81583c0 2023-08-10T10:49:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0005070 con 0x7f72b81583c0 2023-08-10T10:49:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005420 con 0x7f72b81583c0 2023-08-10T10:49:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.368+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b806ed30 con 0x7f72b81583c0 2023-08-10T10:49:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.369+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b806f2f0 con 0x7f72b81583c0 2023-08-10T10:49:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.370+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b8066e30 con 0x7f72b81583c0 2023-08-10T10:49:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.371+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72b0005580 con 0x7f72b81583c0 2023-08-10T10:49:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.371+0000 7f72b4ff9640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 0x7f72a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.372+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72b0088a30 con 0x7f72b81583c0 2023-08-10T10:49:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.372+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f72a4072da0 con 0x7f72b81583c0 2023-08-10T10:49:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.372+0000 7f72b7fff640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 0x7f72a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.373+0000 7f72b7fff640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 0x7f72a406d110 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f72a8036000 tx=0x7f72a803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.376+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f72b0053ad0 con 0x7f72b81583c0 2023-08-10T10:49:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.567+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72b815e8b0 con 0x7f72b81583c0 2023-08-10T10:49:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.568+0000 7f72b4ff9640 1 -- 172.21.15.50:0/310894885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72b00570f0 con 0x7f72b81583c0 2023-08-10T10:49:51.570 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:49:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.570+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 msgr2=0x7f72a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.570+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 0x7f72a406d110 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f72a8036000 tx=0x7f72a803c040 comp rx=0 tx=0).stop 2023-08-10T10:49:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.570+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 msgr2=0x7f72b8070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.570+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c7b0 tx=0x7f72b000cc70 comp rx=0 tx=0).stop 2023-08-10T10:49:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 shutdown_connections 2023-08-10T10:49:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b81583c0 0x7f72b8070540 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b80b1ba0 0x7f72b8070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f72a406ac50 0x7f72a406d110 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 --2- 172.21.15.50:0/310894885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8069be0 0x7f72b815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 >> 172.21.15.50:0/310894885 conn(0x7f72b80caf80 msgr2=0x7f72b80c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 shutdown_connections 2023-08-10T10:49:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.571+0000 7f72bd3b2640 1 -- 172.21.15.50:0/310894885 wait complete. 2023-08-10T10:49:51.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:49:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.811+0000 7fc4e31e1640 1 Processor -- start 2023-08-10T10:49:51.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.811+0000 7fc4e31e1640 1 -- start start 2023-08-10T10:49:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.812+0000 7fc4e31e1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4dc0718a0 0x7fc4dc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.812+0000 7fc4e31e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 0x7fc4dc0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.812+0000 7fc4e31e1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc0cca70 con 0x7fc4dc070d00 2023-08-10T10:49:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.812+0000 7fc4e31e1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cf8a0 con 0x7fc4dc0718a0 2023-08-10T10:49:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.812+0000 7fc4e31e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cfb80 con 0x7fc4dc0af9b0 2023-08-10T10:49:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4e0f7d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc4dc070d00 0x7fc4dc0710e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36024/0 (socket says 172.21.15.50:36024) 2023-08-10T10:49:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4e0f7d640 1 -- 172.21.15.50:0/979715499 learned_addr learned my addr 172.21.15.50:0/979715499 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/979715499 >> v2:172.21.15.50:3300/0 conn(0x7fc4dc0718a0 0x7fc4dc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d37fe640 1 -- 172.21.15.50:0/979715499 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492763719 0 0) 0x7fc4dc0cca70 con 0x7fc4dc070d00 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d37fe640 1 -- 172.21.15.50:0/979715499 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c4003520 con 0x7fc4dc070d00 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4e177e640 1 --2- 172.21.15.50:0/979715499 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 0x7fc4dc0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d3fff640 1 -- 172.21.15.50:0/979715499 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 msgr2=0x7fc4dc0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/979715499 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 0x7fc4dc0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d3fff640 1 -- 172.21.15.50:0/979715499 >> v1:172.21.15.50:6789/0 conn(0x7fc4dc070d00 legacy=0x7fc4dc0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4d3fff640 1 -- 172.21.15.50:0/979715499 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0b3280 con 0x7fc4dc0718a0 2023-08-10T10:49:51.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.813+0000 7fc4e177e640 1 --2- 172.21.15.50:0/979715499 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 0x7fc4dc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:51.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.814+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/979715499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc0ccf00 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0b2370 tx=0x7fc4cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd66a4b84612398 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4d37fe640 1 -- 172.21.15.50:0/979715499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02e070 con 0x7fc4dc0718a0 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4d37fe640 1 -- 172.21.15.50:0/979715499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0315a0 con 0x7fc4dc0718a0 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4d37fe640 1 -- 172.21.15.50:0/979715499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc031910 con 0x7fc4dc0718a0 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 -- 172.21.15.50:0/979715499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 msgr2=0x7fc4dc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/979715499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc0ccf00 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0b2370 tx=0x7fc4cc02b840 comp rx=0 tx=0).stop 2023-08-10T10:49:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 -- 172.21.15.50:0/979715499 shutdown_connections 2023-08-10T10:49:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/979715499 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0af9b0 0x7fc4dc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/979715499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc0ccf00 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.815+0000 7fc4e31e1640 1 -- 172.21.15.50:0/979715499 >> 172.21.15.50:0/979715499 conn(0x7fc4dc0b23e0 msgr2=0x7fc4dc0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.816+0000 7fc4e31e1640 1 -- 172.21.15.50:0/979715499 shutdown_connections 2023-08-10T10:49:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.816+0000 7fc4e31e1640 1 -- 172.21.15.50:0/979715499 wait complete. 2023-08-10T10:49:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.817+0000 7fc4e31e1640 1 Processor -- start 2023-08-10T10:49:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.818+0000 7fc4e31e1640 1 -- start start 2023-08-10T10:49:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.818+0000 7fc4e31e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 0x7fc4dc0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.818+0000 7fc4e31e1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e31e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 0x7fc4dc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e31e1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0c8450 con 0x7fc4dc0718a0 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e31e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0c7af0 con 0x7fc4dc070d00 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e31e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0ca7d0 con 0x7fc4dc0af9b0 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40700/0 (socket says 172.21.15.50:40700) 2023-08-10T10:49:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 -- 172.21.15.50:0/1557590361 learned_addr learned my addr 172.21.15.50:0/1557590361 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e0f7d640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 0x7fc4dc0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e177e640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 0x7fc4dc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 -- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 msgr2=0x7fc4dc156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 0x7fc4dc156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 -- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 msgr2=0x7fc4dc0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 0x7fc4dc0c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4d3fff640 1 -- 172.21.15.50:0/1557590361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009400 con 0x7fc4dc0718a0 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e0f7d640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 0x7fc4dc0c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.819+0000 7fc4e177e640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 0x7fc4dc156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4d3fff640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc032630 con 0x7fc4dc0718a0 2023-08-10T10:49:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc032790 con 0x7fc4dc0718a0 2023-08-10T10:49:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc032b00 con 0x7fc4dc0718a0 2023-08-10T10:49:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc0c7d90 con 0x7fc4dc0718a0 2023-08-10T10:49:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.820+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc0ca4a0 con 0x7fc4dc0718a0 2023-08-10T10:49:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.821+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc0c8590 con 0x7fc4dc0718a0 2023-08-10T10:49:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.822+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4cc032c60 con 0x7fc4dc0718a0 2023-08-10T10:49:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.823+0000 7fc4d17fa640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 0x7fc4c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.823+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4cc0aaf80 con 0x7fc4dc0718a0 2023-08-10T10:49:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.824+0000 7fc4e0f7d640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 0x7fc4c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.824+0000 7fc4e0f7d640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 0x7fc4c806d110 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005c00 tx=0x7fc4d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:51.828+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc4dc0c8590 con 0x7fc4dc0718a0 2023-08-10T10:49:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.022+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4dc0c8590 con 0x7fc4dc0718a0 2023-08-10T10:49:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.023+0000 7fc4d17fa640 1 -- 172.21.15.50:0/1557590361 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4dc0c8590 con 0x7fc4dc0718a0 2023-08-10T10:49:52.025 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:49:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 msgr2=0x7fc4c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 0x7fc4c806d110 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005c00 tx=0x7fc4d8009040 comp rx=0 tx=0).stop 2023-08-10T10:49:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 msgr2=0x7fc4dc1f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc0046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 shutdown_connections 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0af9b0 0x7fc4dc156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4dc0718a0 0x7fc4dc1f0660 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc4c806ac50 0x7fc4c806d110 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 --2- 172.21.15.50:0/1557590361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc070d00 0x7fc4dc0c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.026+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 >> 172.21.15.50:0/1557590361 conn(0x7fc4dc0b23e0 msgr2=0x7fc4dc0cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.027+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 shutdown_connections 2023-08-10T10:49:52.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.027+0000 7fc4e31e1640 1 -- 172.21.15.50:0/1557590361 wait complete. 2023-08-10T10:49:52.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:49:52.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.284+0000 7f124480c640 1 Processor -- start 2023-08-10T10:49:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.284+0000 7f124480c640 1 -- start start 2023-08-10T10:49:52.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f124480c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12400cd9a0 0x7f12400cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f124480c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400cc5a0 con 0x7f12400c9d00 2023-08-10T10:49:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f124480c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124015d720 con 0x7f1240159830 2023-08-10T10:49:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f124480c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400b4170 con 0x7f12400cd9a0 2023-08-10T10:49:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f123f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12400cd9a0 0x7f12400cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f123f59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12400cd9a0 0x7f12400cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40712/0 (socket says 172.21.15.50:40712) 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f123e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f12400c9d00 0x7f12400cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36036/0 (socket says 172.21.15.50:36036) 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.286+0000 7f123f59e640 1 -- 172.21.15.50:0/747752024 learned_addr learned my addr 172.21.15.50:0/747752024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.287+0000 7f123f59e640 1 -- 172.21.15.50:0/747752024 >> v1:172.21.15.117:6789/0 conn(0x7f1240159830 legacy=0x7f124015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.287+0000 7f123f59e640 1 -- 172.21.15.50:0/747752024 >> v1:172.21.15.50:6789/0 conn(0x7f12400c9d00 legacy=0x7f12400cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.287+0000 7f123f59e640 1 -- 172.21.15.50:0/747752024 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240159c10 con 0x7f12400cd9a0 2023-08-10T10:49:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.287+0000 7f123dd9b640 1 -- 172.21.15.50:0/747752024 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691792146 0 0) 0x7f12400cc5a0 con 0x7f12400c9d00 2023-08-10T10:49:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.288+0000 7f123f59e640 1 --2- 172.21.15.50:0/747752024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f12400cc060 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f123800d150 tx=0x7f123802e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeff4267b4f17ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.288+0000 7f123dd9b640 1 -- 172.21.15.50:0/747752024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800b0d0 con 0x7f12400cd9a0 2023-08-10T10:49:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.288+0000 7f123dd9b640 1 -- 172.21.15.50:0/747752024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800b230 con 0x7f12400cd9a0 2023-08-10T10:49:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.288+0000 7f123dd9b640 1 -- 172.21.15.50:0/747752024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238009600 con 0x7f12400cd9a0 2023-08-10T10:49:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 -- 172.21.15.50:0/747752024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 msgr2=0x7f12400cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 --2- 172.21.15.50:0/747752024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f12400cc060 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f123800d150 tx=0x7f123802e200 comp rx=0 tx=0).stop 2023-08-10T10:49:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 -- 172.21.15.50:0/747752024 shutdown_connections 2023-08-10T10:49:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 --2- 172.21.15.50:0/747752024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f12400cc060 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 -- 172.21.15.50:0/747752024 >> 172.21.15.50:0/747752024 conn(0x7f124006ab80 msgr2=0x7f124006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 -- 172.21.15.50:0/747752024 shutdown_connections 2023-08-10T10:49:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.289+0000 7f124480c640 1 -- 172.21.15.50:0/747752024 wait complete. 2023-08-10T10:49:52.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.291+0000 7f124480c640 1 Processor -- start 2023-08-10T10:49:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.291+0000 7f124480c640 1 -- start start 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 0x7f12400c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 0x7f124015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c1c30 con 0x7f12400cd9a0 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c7ef0 con 0x7f12400c9d00 2023-08-10T10:49:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.292+0000 7f124480c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c7650 con 0x7f1240159830 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40720/0 (socket says 172.21.15.50:40720) 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 -- 172.21.15.50:0/1085118284 learned_addr learned my addr 172.21.15.50:0/1085118284 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 -- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 msgr2=0x7f124015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123f59e640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 0x7f124015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 0x7f124015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123ed9d640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 0x7f12400c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 -- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 msgr2=0x7f12400c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 0x7f12400c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 -- 172.21.15.50:0/1085118284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123800bd40 con 0x7f12400cd9a0 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123f59e640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 0x7f124015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123ed9d640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 0x7f12400c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.293+0000 7f123e59c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f123400c3f0 tx=0x7f123400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.294+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340074e0 con 0x7f12400cd9a0 2023-08-10T10:49:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.294+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234007640 con 0x7f12400cd9a0 2023-08-10T10:49:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.294+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234004a00 con 0x7f12400cd9a0 2023-08-10T10:49:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.294+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12400c7930 con 0x7f12400cd9a0 2023-08-10T10:49:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.294+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12400c34b0 con 0x7f12400cd9a0 2023-08-10T10:49:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.295+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400c3310 con 0x7f12400cd9a0 2023-08-10T10:49:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.296+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1234004b60 con 0x7f12400cd9a0 2023-08-10T10:49:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.297+0000 7f12277fe640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 0x7f122c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.297+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12340893b0 con 0x7f12400cd9a0 2023-08-10T10:49:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.297+0000 7f123ed9d640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 0x7f122c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.298+0000 7f123ed9d640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 0x7f122c06d110 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f12401f5350 tx=0x7f1230009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.301+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f12400c3310 con 0x7f12400cd9a0 2023-08-10T10:49:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.533+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12400c3310 con 0x7f12400cd9a0 2023-08-10T10:49:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.534+0000 7f12277fe640 1 -- 172.21.15.50:0/1085118284 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f12400c3310 con 0x7f12400cd9a0 2023-08-10T10:49:52.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:52.536 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:49:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:49:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 msgr2=0x7f122c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 0x7f122c06d110 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f12401f5350 tx=0x7f1230009040 comp rx=0 tx=0).stop 2023-08-10T10:49:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 msgr2=0x7f124014fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f123400c3f0 tx=0x7f123400c8b0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 shutdown_connections 2023-08-10T10:49:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240159830 0x7f124015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12400cd9a0 0x7f124014fae0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f122c06ac50 0x7f122c06d110 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 --2- 172.21.15.50:0/1085118284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c9d00 0x7f12400c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 >> 172.21.15.50:0/1085118284 conn(0x7f124006ab80 msgr2=0x7f12400ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 shutdown_connections 2023-08-10T10:49:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.537+0000 7f124480c640 1 -- 172.21.15.50:0/1085118284 wait complete. 2023-08-10T10:49:52.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.769+0000 7f4284f31640 1 Processor -- start 2023-08-10T10:49:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.770+0000 7f4284f31640 1 -- start start 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c1af0 0x7f42800696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4280069be0 0x7f42800b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42800b2d70 0x7f42800b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42801617f0 con 0x7f4280069be0 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428006f6f0 con 0x7f42800b2d70 2023-08-10T10:49:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.771+0000 7f4284f31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428006a020 con 0x7f42800c1af0 2023-08-10T10:49:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4280069be0 0x7f42800b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4280069be0 0x7f42800b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40728/0 (socket says 172.21.15.50:40728) 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 -- 172.21.15.50:0/1372738229 learned_addr learned my addr 172.21.15.50:0/1372738229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f427e59c640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c1af0 0x7f42800696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f427ed9d640 1 --2- 172.21.15.50:0/1372738229 >> v2:172.21.15.117:3300/0 conn(0x7f42800b2d70 0x7f42800b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 -- 172.21.15.50:0/1372738229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c1af0 msgr2=0x7f42800696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c1af0 0x7f42800696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 -- 172.21.15.50:0/1372738229 >> v2:172.21.15.117:3300/0 conn(0x7f42800b2d70 msgr2=0x7f42800b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 --2- 172.21.15.50:0/1372738229 >> v2:172.21.15.117:3300/0 conn(0x7f42800b2d70 0x7f42800b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.772+0000 7f4277fff640 1 -- 172.21.15.50:0/1372738229 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800b31e0 con 0x7f4280069be0 2023-08-10T10:49:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.773+0000 7f4277fff640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42800b2830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f42800b4760 tx=0x7f426802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213aa6539e117405 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f427dd9b640 1 -- 172.21.15.50:0/1372738229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268030850 con 0x7f4280069be0 2023-08-10T10:49:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f427dd9b640 1 -- 172.21.15.50:0/1372738229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42680309b0 con 0x7f4280069be0 2023-08-10T10:49:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f427dd9b640 1 -- 172.21.15.50:0/1372738229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268030d40 con 0x7f4280069be0 2023-08-10T10:49:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 -- 172.21.15.50:0/1372738229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 msgr2=0x7f42800b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42800b2830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f42800b4760 tx=0x7f426802b990 comp rx=0 tx=0).stop 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 -- 172.21.15.50:0/1372738229 shutdown_connections 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 --2- 172.21.15.50:0/1372738229 >> v2:172.21.15.117:3300/0 conn(0x7f42800b2d70 0x7f42800b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42800b2830 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 --2- 172.21.15.50:0/1372738229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c1af0 0x7f42800696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.774+0000 7f4284f31640 1 -- 172.21.15.50:0/1372738229 >> 172.21.15.50:0/1372738229 conn(0x7f428006b590 msgr2=0x7f42800ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.775+0000 7f4284f31640 1 -- 172.21.15.50:0/1372738229 shutdown_connections 2023-08-10T10:49:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.775+0000 7f4284f31640 1 -- 172.21.15.50:0/1372738229 wait complete. 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.776+0000 7f4284f31640 1 Processor -- start 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.777+0000 7f4284f31640 1 -- start start 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.777+0000 7f4284f31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f4284f31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800b2d70 0x7f428015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f4284f31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42800c1af0 0x7f428015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f4284f31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801fb3a0 con 0x7f4280069be0 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f4284f31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801f7060 con 0x7f42800c1af0 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f4284f31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42801f7340 con 0x7f42800b2d70 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40732/0 (socket says 172.21.15.50:40732) 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 -- 172.21.15.50:0/2699238958 learned_addr learned my addr 172.21.15.50:0/2699238958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 -- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800b2d70 msgr2=0x7f428015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800b2d70 0x7f428015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 -- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42800c1af0 msgr2=0x7f428015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42800c1af0 0x7f428015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.778+0000 7f427e59c640 1 -- 172.21.15.50:0/2699238958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680094d0 con 0x7f4280069be0 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f427e59c640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f427000d5f0 tx=0x7f427000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700125f0 con 0x7f4280069be0 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270012750 con 0x7f4280069be0 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270012b00 con 0x7f4280069be0 2023-08-10T10:49:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42801f7620 con 0x7f4280069be0 2023-08-10T10:49:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.779+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800b0e80 con 0x7f4280069be0 2023-08-10T10:49:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.780+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42800b1040 con 0x7f4280069be0 2023-08-10T10:49:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.781+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4270012c60 con 0x7f4280069be0 2023-08-10T10:49:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.782+0000 7f4276ffd640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 0x7f426006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.782+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4270089a30 con 0x7f4280069be0 2023-08-10T10:49:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.782+0000 7f4277fff640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 0x7f426006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.783+0000 7f4277fff640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 0x7f426006d140 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.786+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4270054a40 con 0x7f4280069be0 2023-08-10T10:49:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.977+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428004e270 con 0x7f4280069be0 2023-08-10T10:49:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.980+0000 7f4276ffd640 1 -- 172.21.15.50:0/2699238958 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f4270058060 con 0x7f4280069be0 2023-08-10T10:49:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:52.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":161,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:51.632847+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 msgr2=0x7f426006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 0x7f426006d140 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803b040 comp rx=0 tx=0).stop 2023-08-10T10:49:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 msgr2=0x7f42801f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f427000d5f0 tx=0x7f427000dab0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 shutdown_connections 2023-08-10T10:49:52.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f426006ac80 0x7f426006d140 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42800c1af0 0x7f428015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800b2d70 0x7f428015f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 --2- 172.21.15.50:0/2699238958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4280069be0 0x7f42801f6630 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 >> 172.21.15.50:0/2699238958 conn(0x7f428006b590 msgr2=0x7f42800cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 shutdown_connections 2023-08-10T10:49:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:52.982+0000 7f4284f31640 1 -- 172.21.15.50:0/2699238958 wait complete. 2023-08-10T10:49:53.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:49:53.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:49:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.228+0000 7f00a4c56640 1 Processor -- start 2023-08-10T10:49:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.228+0000 7f00a4c56640 1 -- start start 2023-08-10T10:49:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f00a4c56640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00a015aa40 0x7f00a00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f00a4c56640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00a00ca930 0x7f00a00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f00a4c56640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a0071c70 con 0x7f00a00b0c60 2023-08-10T10:49:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f00a4c56640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00713d0 con 0x7f00a00ca930 2023-08-10T10:49:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f00a4c56640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00716b0 con 0x7f00a015aa40 2023-08-10T10:49:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f009ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00a00ca930 0x7f00a00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f009dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00a00b0c60 0x7f00a00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36044/0 (socket says 172.21.15.50:36044) 2023-08-10T10:49:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f009dd9b640 1 -- 172.21.15.50:0/3341311203 learned_addr learned my addr 172.21.15.50:0/3341311203 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:53.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.230+0000 7f009e59c640 1 --2- 172.21.15.50:0/3341311203 >> v2:172.21.15.117:3300/0 conn(0x7f00a015aa40 0x7f00a00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.231+0000 7f009ed9d640 1 -- 172.21.15.50:0/3341311203 >> v2:172.21.15.117:3300/0 conn(0x7f00a015aa40 msgr2=0x7f00a00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:53.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.231+0000 7f009ed9d640 1 --2- 172.21.15.50:0/3341311203 >> v2:172.21.15.117:3300/0 conn(0x7f00a015aa40 0x7f00a00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.231+0000 7f009ed9d640 1 -- 172.21.15.50:0/3341311203 >> v1:172.21.15.50:6789/0 conn(0x7f00a00b0c60 legacy=0x7f00a00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.231+0000 7f009ed9d640 1 -- 172.21.15.50:0/3341311203 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0071990 con 0x7f00a00ca930 2023-08-10T10:49:53.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.231+0000 7f009d59a640 1 -- 172.21.15.50:0/3341311203 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344062621 0 0) 0x7f00a0071c70 con 0x7f00a00b0c60 2023-08-10T10:49:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.232+0000 7f009ed9d640 1 --2- 172.21.15.50:0/3341311203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a00ca930 0x7f00a00b3d60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f00a00c8dc0 tx=0x7f009802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e51b05bb0dd865a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.232+0000 7f009d59a640 1 -- 172.21.15.50:0/3341311203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009802cbf0 con 0x7f00a00ca930 2023-08-10T10:49:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.232+0000 7f009d59a640 1 -- 172.21.15.50:0/3341311203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009802cd50 con 0x7f00a00ca930 2023-08-10T10:49:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.232+0000 7f009d59a640 1 -- 172.21.15.50:0/3341311203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098034660 con 0x7f00a00ca930 2023-08-10T10:49:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 -- 172.21.15.50:0/3341311203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a00ca930 msgr2=0x7f00a00b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 --2- 172.21.15.50:0/3341311203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a00ca930 0x7f00a00b3d60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f00a00c8dc0 tx=0x7f009802be40 comp rx=0 tx=0).stop 2023-08-10T10:49:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 -- 172.21.15.50:0/3341311203 shutdown_connections 2023-08-10T10:49:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 --2- 172.21.15.50:0/3341311203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a00ca930 0x7f00a00b3d60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 --2- 172.21.15.50:0/3341311203 >> v2:172.21.15.117:3300/0 conn(0x7f00a015aa40 0x7f00a00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 -- 172.21.15.50:0/3341311203 >> 172.21.15.50:0/3341311203 conn(0x7f00a006b590 msgr2=0x7f00a00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 -- 172.21.15.50:0/3341311203 shutdown_connections 2023-08-10T10:49:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.233+0000 7f00a4c56640 1 -- 172.21.15.50:0/3341311203 wait complete. 2023-08-10T10:49:53.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.235+0000 7f00a4c56640 1 Processor -- start 2023-08-10T10:49:53.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.235+0000 7f00a4c56640 1 -- start start 2023-08-10T10:49:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 0x7f00a0069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00a00ca930 0x7f00a00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c8790 con 0x7f00a015aa40 2023-08-10T10:49:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c84b0 con 0x7f00a00ca930 2023-08-10T10:49:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f00a4c56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c6a00 con 0x7f00a00b0c60 2023-08-10T10:49:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.236+0000 7f009ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40760/0 (socket says 172.21.15.50:40760) 2023-08-10T10:49:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 -- 172.21.15.50:0/1637690886 learned_addr learned my addr 172.21.15.50:0/1637690886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009dd9b640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00a00ca930 0x7f00a00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009e59c640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 0x7f00a0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 -- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 msgr2=0x7f00a0069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 0x7f00a0069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 -- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00a00ca930 msgr2=0x7f00a00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00a00ca930 0x7f00a00c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 -- 172.21.15.50:0/1637690886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098009a70 con 0x7f00a015aa40 2023-08-10T10:49:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009e59c640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 0x7f00a0069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.237+0000 7f009ed9d640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e80 tx=0x7f0098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.238+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098040650 con 0x7f00a015aa40 2023-08-10T10:49:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.238+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980407d0 con 0x7f00a015aa40 2023-08-10T10:49:53.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.238+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00c6ce0 con 0x7f00a015aa40 2023-08-10T10:49:53.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.238+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098040b80 con 0x7f00a015aa40 2023-08-10T10:49:53.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.238+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00afb40 con 0x7f00a015aa40 2023-08-10T10:49:53.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.239+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a00afcd0 con 0x7f00a015aa40 2023-08-10T10:49:53.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.240+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0098040ce0 con 0x7f00a015aa40 2023-08-10T10:49:53.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.241+0000 7f008effd640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 0x7f008006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.241+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00980ac370 con 0x7f00a015aa40 2023-08-10T10:49:53.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.241+0000 7f009e59c640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 0x7f008006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.242+0000 7f009e59c640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 0x7f008006d110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0090006fd0 tx=0x7f0090008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.245+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00a00afcd0 con 0x7f00a015aa40 2023-08-10T10:49:53.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.472+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00a00c6860 con 0x7f00a015aa40 2023-08-10T10:49:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.473+0000 7f008effd640 1 -- 172.21.15.50:0/1637690886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f00a00c6860 con 0x7f00a015aa40 2023-08-10T10:49:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:53.475 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:49:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:49:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 msgr2=0x7f008006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 0x7f008006d110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0090006fd0 tx=0x7f0090008040 comp rx=0 tx=0).stop 2023-08-10T10:49:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 msgr2=0x7f00a01523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e80 tx=0x7f0098004a40 comp rx=0 tx=0).stop 2023-08-10T10:49:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 shutdown_connections 2023-08-10T10:49:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00a015aa40 0x7f00a01523c0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f008006ac50 0x7f008006d110 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00a00ca930 0x7f00a00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 --2- 172.21.15.50:0/1637690886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00a00b0c60 0x7f00a0069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 >> 172.21.15.50:0/1637690886 conn(0x7f00a006b590 msgr2=0x7f00a014e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 shutdown_connections 2023-08-10T10:49:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.476+0000 7f00a4c56640 1 -- 172.21.15.50:0/1637690886 wait complete. 2023-08-10T10:49:53.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:49:53.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.725+0000 7f532bfff640 1 Processor -- start 2023-08-10T10:49:53.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.725+0000 7f532bfff640 1 -- start start 2023-08-10T10:49:53.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 0x7f532c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f532c0cbc20 0x7f532c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c0ce200 con 0x7f532c06e550 2023-08-10T10:49:53.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532bfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c15bb30 con 0x7f532c0cbc20 2023-08-10T10:49:53.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15aeb0 con 0x7f532c071450 2023-08-10T10:49:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.726+0000 7f532b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f532c0cbc20 0x7f532c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f532c0cbc20 0x7f532c0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40770/0 (socket says 172.21.15.50:40770) 2023-08-10T10:49:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 -- 172.21.15.50:0/2897572545 learned_addr learned my addr 172.21.15.50:0/2897572545 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532a7fc640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 0x7f532c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 -- 172.21.15.50:0/2897572545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 msgr2=0x7f532c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 0x7f532c0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 -- 172.21.15.50:0/2897572545 >> v1:172.21.15.117:6789/0 conn(0x7f532c06e550 legacy=0x7f532c06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532b7fe640 1 -- 172.21.15.50:0/2897572545 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c15b190 con 0x7f532c0cbc20 2023-08-10T10:49:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.727+0000 7f532a7fc640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 0x7f532c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:53.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.728+0000 7f532b7fe640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c0cbc20 0x7f532c0cc0b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5324009870 tx=0x7f532402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a577a5b00e61abcb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f5329ffb640 1 -- 172.21.15.50:0/2897572545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324031640 con 0x7f532c0cbc20 2023-08-10T10:49:53.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f5329ffb640 1 -- 172.21.15.50:0/2897572545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53240317a0 con 0x7f532c0cbc20 2023-08-10T10:49:53.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f5329ffb640 1 -- 172.21.15.50:0/2897572545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324031b30 con 0x7f532c0cbc20 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 -- 172.21.15.50:0/2897572545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c0cbc20 msgr2=0x7f532c0cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c0cbc20 0x7f532c0cc0b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5324009870 tx=0x7f532402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 -- 172.21.15.50:0/2897572545 shutdown_connections 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c0cbc20 0x7f532c0cc0b0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 --2- 172.21.15.50:0/2897572545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c071450 0x7f532c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 -- 172.21.15.50:0/2897572545 >> 172.21.15.50:0/2897572545 conn(0x7f532c0d0630 msgr2=0x7f532c0d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 -- 172.21.15.50:0/2897572545 shutdown_connections 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.729+0000 7f532bfff640 1 -- 172.21.15.50:0/2897572545 wait complete. 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.731+0000 7f532bfff640 1 Processor -- start 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.731+0000 7f532bfff640 1 -- start start 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f532c06e550 0x7f532c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 0x7f532c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c069710 con 0x7f532c071450 2023-08-10T10:49:53.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0b4a20 con 0x7f532c06e550 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0b4ca0 con 0x7f532c0cbc20 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.732+0000 7f532a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40784/0 (socket says 172.21.15.50:40784) 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 -- 172.21.15.50:0/1305222384 learned_addr learned my addr 172.21.15.50:0/1305222384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532b7fe640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 0x7f532c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 -- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 msgr2=0x7f532c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 0x7f532c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 -- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f532c06e550 msgr2=0x7f532c0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f532c06e550 0x7f532c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 -- 172.21.15.50:0/1305222384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240094d0 con 0x7f532c071450 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532b7fe640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 0x7f532c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.733+0000 7f532a7fc640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f531c00ce00 tx=0x7f531c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.734+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00f890 con 0x7f532c071450 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.734+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00f9f0 con 0x7f532c071450 2023-08-10T10:49:53.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.734+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00fdc0 con 0x7f532c071450 2023-08-10T10:49:53.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.734+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c14fcd0 con 0x7f532c071450 2023-08-10T10:49:53.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.734+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c150290 con 0x7f532c071450 2023-08-10T10:49:53.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.735+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c066e30 con 0x7f532c071450 2023-08-10T10:49:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.736+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f531c00b040 con 0x7f532c071450 2023-08-10T10:49:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.737+0000 7f5323fff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 0x7f530c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.737+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f531c089f90 con 0x7f532c071450 2023-08-10T10:49:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.737+0000 7f532affd640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 0x7f530c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.738+0000 7f532affd640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 0x7f530c06d140 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5314006fd0 tx=0x7f5314006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.741+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f531c054fa0 con 0x7f532c071450 2023-08-10T10:49:53.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.969+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f532c15f150 con 0x7f532c071450 2023-08-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.971+0000 7f5323fff640 1 -- 172.21.15.50:0/1305222384 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f531c01d020 con 0x7f532c071450 2023-08-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:53.973 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:47:27.565751+0000","modified":"2023-08-10T10:47:31.117672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8502":{"gid":8502,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6834/3094444013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3094444013},{"type":"v1","addr":"172.21.15.117:6834","nonce":3094444013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-10T10:49:53.973 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2023-08-10T10:49:53.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 msgr2=0x7f530c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 0x7f530c06d140 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5314006fd0 tx=0x7f5314006bc0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 msgr2=0x7f532c1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f531c00ce00 tx=0x7f531c00a650 comp rx=0 tx=0).stop 2023-08-10T10:49:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 shutdown_connections 2023-08-10T10:49:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f532c0cbc20 0x7f532c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f532c071450 0x7f532c1507b0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f530c06ac80 0x7f530c06d140 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 --2- 172.21.15.50:0/1305222384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f532c06e550 0x7f532c0b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 >> 172.21.15.50:0/1305222384 conn(0x7f532c0d0630 msgr2=0x7f532c159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 shutdown_connections 2023-08-10T10:49:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:53.973+0000 7f532bfff640 1 -- 172.21.15.50:0/1305222384 wait complete. 2023-08-10T10:49:53.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:54.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.231+0000 7f38d3fff640 1 Processor -- start 2023-08-10T10:49:54.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.231+0000 7f38d3fff640 1 -- start start 2023-08-10T10:49:54.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38d40ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d3fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40cca30 con 0x7f38d4159000 2023-08-10T10:49:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d3fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40ca180 con 0x7f38d40c9cf0 2023-08-10T10:49:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cc100 con 0x7f38d40c8e90 2023-08-10T10:49:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f38d4159000 0x7f38d40aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36050/0 (socket says 172.21.15.50:36050) 2023-08-10T10:49:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.233+0000 7f38d2ffd640 1 -- 172.21.15.50:0/1943276973 learned_addr learned my addr 172.21.15.50:0/1943276973 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38cbfff640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38d40ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282219823 0 0) 0x7f38d40cca30 con 0x7f38d4159000 2023-08-10T10:49:54.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c0003440 con 0x7f38d4159000 2023-08-10T10:49:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2923122733 0 0) 0x7f38c0003440 con 0x7f38d4159000 2023-08-10T10:49:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 msgr2=0x7f38d40ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38d40ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 >> v1:172.21.15.117:6789/0 conn(0x7f38d40c9cf0 legacy=0x7f38d40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40cc3e0 con 0x7f38d4159000 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f38c4001670 con 0x7f38d4159000 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 >> v1:172.21.15.50:6789/0 conn(0x7f38d4159000 legacy=0x7f38d40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c0003b00 0x7f38c0003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.234+0000 7f38d27fc640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38c000a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d27fc640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c000b070 0x7f38c000d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cc100 con 0x7f38c0003b00 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000dce0 con 0x7f38c000b070 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000dea0 con 0x7f38d40c8e90 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c0003b00 0x7f38c0003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38cbfff640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38c000a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 -- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 msgr2=0x7f38c000a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38d40c8e90 0x7f38c000a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 -- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c000b070 msgr2=0x7f38c000d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d37fe640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c000b070 0x7f38c000d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c000b070 0x7f38c000d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d2ffd640 1 -- 172.21.15.50:0/1943276973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0003440 con 0x7f38c0003b00 2023-08-10T10:49:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.235+0000 7f38d37fe640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c000b070 0x7f38c000d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:54.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.236+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c0003b00 0x7f38c0003f20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c240 tx=0x7f38c00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267e21582b865638 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4005ad0 con 0x7f38c0003b00 2023-08-10T10:49:54.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4005c30 con 0x7f38c0003b00 2023-08-10T10:49:54.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d27fc640 1 -- 172.21.15.50:0/1943276973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c402c8b0 con 0x7f38c0003b00 2023-08-10T10:49:54.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d3fff640 1 -- 172.21.15.50:0/1943276973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c0003b00 msgr2=0x7f38c0003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1943276973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c0003b00 0x7f38c0003f20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c240 tx=0x7f38c00036f0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d37fe640 1 -- 172.21.15.50:0/1943276973 reap_dead start 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d3fff640 1 -- 172.21.15.50:0/1943276973 shutdown_connections 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.237+0000 7f38d3fff640 1 -- 172.21.15.50:0/1943276973 >> 172.21.15.50:0/1943276973 conn(0x7f38d406ab80 msgr2=0x7f38d406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.238+0000 7f38d3fff640 1 -- 172.21.15.50:0/1943276973 shutdown_connections 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.238+0000 7f38d3fff640 1 -- 172.21.15.50:0/1943276973 wait complete. 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.239+0000 7f38d3fff640 1 Processor -- start 2023-08-10T10:49:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.240+0000 7f38d3fff640 1 -- start start 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.240+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c0003b00 0x7f38d41ee210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.240+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.240+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d40c3010 0x7f38d40b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.240+0000 7f38d3fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41f17e0 con 0x7f38d406e700 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38d3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41ee7f0 con 0x7f38d40c3010 2023-08-10T10:49:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38d3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41eead0 con 0x7f38c0003b00 2023-08-10T10:49:54.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40804/0 (socket says 172.21.15.50:40804) 2023-08-10T10:49:54.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38cbfff640 1 -- 172.21.15.50:0/1164469937 learned_addr learned my addr 172.21.15.50:0/1164469937 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:54.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c0003b00 0x7f38d41ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38d37fe640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d40c3010 0x7f38d40b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38cbfff640 1 -- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c0003b00 msgr2=0x7f38d41ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.241+0000 7f38cbfff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c0003b00 0x7f38d41ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cbfff640 1 -- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d40c3010 msgr2=0x7f38d40b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cbfff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d40c3010 0x7f38d40b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cbfff640 1 -- 172.21.15.50:0/1164469937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d41eedb0 con 0x7f38d406e700 2023-08-10T10:49:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cbfff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f38bc010860 tx=0x7f38bc010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc009610 con 0x7f38d406e700 2023-08-10T10:49:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00eb60 con 0x7f38d406e700 2023-08-10T10:49:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc01c400 con 0x7f38d406e700 2023-08-10T10:49:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41ef090 con 0x7f38d406e700 2023-08-10T10:49:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.242+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40713f0 con 0x7f38d406e700 2023-08-10T10:49:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.243+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d41f1950 con 0x7f38d406e700 2023-08-10T10:49:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.244+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38bc01c560 con 0x7f38d406e700 2023-08-10T10:49:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.245+0000 7f38cb7fe640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 0x7f38b406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.245+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38bc089940 con 0x7f38d406e700 2023-08-10T10:49:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.246+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 0x7f38b406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.246+0000 7f38d2ffd640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 0x7f38b406d140 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f38c4034000 tx=0x7f38c4009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.249+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38bc054a90 con 0x7f38d406e700 2023-08-10T10:49:54.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.441+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38d4066e30 con 0x7f38d406e700 2023-08-10T10:49:54.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.444+0000 7f38cb7fe640 1 -- 172.21.15.50:0/1164469937 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f38bc0580b0 con 0x7f38d406e700 2023-08-10T10:49:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:49:54.446 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":161,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:51.632847+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:47:25.902442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-10T10:47:26.575181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:54.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 msgr2=0x7f38b406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 0x7f38b406d140 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f38c4034000 tx=0x7f38c4009030 comp rx=0 tx=0).stop 2023-08-10T10:49:54.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 msgr2=0x7f38d4154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f38bc010860 tx=0x7f38bc010d20 comp rx=0 tx=0).stop 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 shutdown_connections 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.446+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f38b406ac80 0x7f38b406d140 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d40c3010 0x7f38d40b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38d406e700 0x7f38d4154520 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 --2- 172.21.15.50:0/1164469937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c0003b00 0x7f38d41ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 >> 172.21.15.50:0/1164469937 conn(0x7f38d406ab80 msgr2=0x7f38d40c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 shutdown_connections 2023-08-10T10:49:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.447+0000 7f38d3fff640 1 -- 172.21.15.50:0/1164469937 wait complete. 2023-08-10T10:49:54.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:49:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.698+0000 7f7047dfd640 1 Processor -- start 2023-08-10T10:49:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.698+0000 7f7047dfd640 1 -- start start 2023-08-10T10:49:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.699+0000 7f7047dfd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f704006ea80 0x7f704006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.699+0000 7f7047dfd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70400ce130 0x7f7040165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.699+0000 7f7047dfd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70400cc6d0 con 0x7f70400c8c40 2023-08-10T10:49:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.699+0000 7f7047dfd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704006f3a0 con 0x7f70400ce130 2023-08-10T10:49:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.699+0000 7f7047dfd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400ca0d0 con 0x7f704006ea80 2023-08-10T10:49:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70400ce130 0x7f7040165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f7045398640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f70400c8c40 0x7f7040164c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36058/0 (socket says 172.21.15.50:36058) 2023-08-10T10:49:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70400ce130 0x7f7040165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40818/0 (socket says 172.21.15.50:40818) 2023-08-10T10:49:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f7045398640 1 -- 172.21.15.50:0/1558063679 learned_addr learned my addr 172.21.15.50:0/1558063679 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f7045b99640 1 --2- 172.21.15.50:0/1558063679 >> v2:172.21.15.117:3300/0 conn(0x7f704006ea80 0x7f704006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 -- 172.21.15.50:0/1558063679 >> v2:172.21.15.117:3300/0 conn(0x7f704006ea80 msgr2=0x7f704006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 --2- 172.21.15.50:0/1558063679 >> v2:172.21.15.117:3300/0 conn(0x7f704006ea80 0x7f704006ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 -- 172.21.15.50:0/1558063679 >> v1:172.21.15.50:6789/0 conn(0x7f70400c8c40 legacy=0x7f7040164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f704639a640 1 -- 172.21.15.50:0/1558063679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400ca3b0 con 0x7f70400ce130 2023-08-10T10:49:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.700+0000 7f7044b97640 1 -- 172.21.15.50:0/1558063679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087471550 0 0) 0x7f70400cc6d0 con 0x7f70400c8c40 2023-08-10T10:49:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f704639a640 1 --2- 172.21.15.50:0/1558063679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70400ce130 0x7f7040165340 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f70400b11f0 tx=0x7f703802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15b608b06d4d2e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f7044b97640 1 -- 172.21.15.50:0/1558063679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703802cd10 con 0x7f70400ce130 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f7044b97640 1 -- 172.21.15.50:0/1558063679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703802ce70 con 0x7f70400ce130 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f7044b97640 1 -- 172.21.15.50:0/1558063679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038034640 con 0x7f70400ce130 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f7047dfd640 1 -- 172.21.15.50:0/1558063679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70400ce130 msgr2=0x7f7040165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.702+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1558063679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70400ce130 0x7f7040165340 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f70400b11f0 tx=0x7f703802bf60 comp rx=0 tx=0).stop 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 -- 172.21.15.50:0/1558063679 shutdown_connections 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1558063679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70400ce130 0x7f7040165340 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1558063679 >> v2:172.21.15.117:3300/0 conn(0x7f704006ea80 0x7f704006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 -- 172.21.15.50:0/1558063679 >> 172.21.15.50:0/1558063679 conn(0x7f70400b08e0 msgr2=0x7f70400ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 -- 172.21.15.50:0/1558063679 shutdown_connections 2023-08-10T10:49:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.703+0000 7f7047dfd640 1 -- 172.21.15.50:0/1558063679 wait complete. 2023-08-10T10:49:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.704+0000 7f7047dfd640 1 Processor -- start 2023-08-10T10:49:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.705+0000 7f7047dfd640 1 -- start start 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.705+0000 7f7047dfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.705+0000 7f7047dfd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 0x7f70400c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.705+0000 7f7047dfd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70400ce130 0x7f70400c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7047dfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401f6350 con 0x7f704006ea80 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7047dfd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400c5e40 con 0x7f70400c8c40 2023-08-10T10:49:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7047dfd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040162800 con 0x7f70400ce130 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40826/0 (socket says 172.21.15.50:40826) 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 -- 172.21.15.50:0/1320961440 learned_addr learned my addr 172.21.15.50:0/1320961440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045398640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 0x7f70400c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 -- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70400ce130 msgr2=0x7f70400c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70400ce130 0x7f70400c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 -- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 msgr2=0x7f70400c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 0x7f70400c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045b99640 1 -- 172.21.15.50:0/1320961440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009a70 con 0x7f704006ea80 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.706+0000 7f7045398640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 0x7f70400c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f7045b99640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d800 tx=0x7f703c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00b6c0 con 0x7f704006ea80 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00b820 con 0x7f704006ea80 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040162520 con 0x7f704006ea80 2023-08-10T10:49:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00bbb0 con 0x7f704006ea80 2023-08-10T10:49:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.707+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70400c5ad0 con 0x7f704006ea80 2023-08-10T10:49:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.708+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704004e270 con 0x7f704006ea80 2023-08-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.709+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f703c00bd10 con 0x7f704006ea80 2023-08-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.710+0000 7f70367fc640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 0x7f702406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.710+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f703c089a70 con 0x7f704006ea80 2023-08-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.710+0000 7f7045398640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 0x7f702406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.711+0000 7f7045398640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 0x7f702406d110 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f70400c1f30 tx=0x7f7030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.714+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f703c054b10 con 0x7f704006ea80 2023-08-10T10:49:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.945+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f70400addf0 con 0x7f704006ea80 2023-08-10T10:49:54.948 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:49:54.947+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:49:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.958+0000 7f70367fc640 1 -- 172.21.15.50:0/1320961440 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f703c058130 con 0x7f704006ea80 2023-08-10T10:49:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:49:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 msgr2=0x7f702406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 0x7f702406d110 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f70400c1f30 tx=0x7f7030009040 comp rx=0 tx=0).stop 2023-08-10T10:49:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 msgr2=0x7f70401f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d800 tx=0x7f703c00dcc0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 shutdown_connections 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70400ce130 0x7f70400c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f702406ac50 0x7f702406d110 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70400c8c40 0x7f70400c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 --2- 172.21.15.50:0/1320961440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f704006ea80 0x7f70401f5e10 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 >> 172.21.15.50:0/1320961440 conn(0x7f70400b08e0 msgr2=0x7f704006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:54.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 shutdown_connections 2023-08-10T10:49:54.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:54.961+0000 7f7047dfd640 1 -- 172.21.15.50:0/1320961440 wait complete. 2023-08-10T10:49:54.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:49:55.086 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:49:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.213+0000 7fb97bfff640 1 Processor -- start 2023-08-10T10:49:55.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.213+0000 7fb97bfff640 1 -- start start 2023-08-10T10:49:55.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb97c0cf3b0 0x7fb97c0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97bfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c160b60 con 0x7fb97c15ce70 2023-08-10T10:49:55.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0b8200 con 0x7fb97c0b1a30 2023-08-10T10:49:55.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c161700 con 0x7fb97c0cf3b0 2023-08-10T10:49:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb97c15ce70 0x7fb97c0cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51812/0 (socket says 172.21.15.50:51812) 2023-08-10T10:49:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.215+0000 7fb97a7fc640 1 -- 172.21.15.50:0/2118417892 learned_addr learned my addr 172.21.15.50:0/2118417892 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb97affd640 1 --2- 172.21.15.50:0/2118417892 >> v2:172.21.15.117:3300/0 conn(0x7fb97c0cf3b0 0x7fb97c0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344640615 0 0) 0x7fb97c160b60 con 0x7fb97c15ce70 2023-08-10T10:49:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb964003520 con 0x7fb97c15ce70 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 379122566 0 0) 0x7fb964003520 con 0x7fb97c15ce70 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 >> v2:172.21.15.117:3300/0 conn(0x7fb97c0cf3b0 msgr2=0x7fb97c0d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 --2- 172.21.15.50:0/2118417892 >> v2:172.21.15.117:3300/0 conn(0x7fb97c0cf3b0 0x7fb97c0d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 >> v1:172.21.15.117:6789/0 conn(0x7fb97c0b1a30 legacy=0x7fb97c160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0b8750 con 0x7fb97c15ce70 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb970001670 con 0x7fb97c15ce70 2023-08-10T10:49:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 >> v1:172.21.15.50:6789/0 conn(0x7fb97c15ce70 legacy=0x7fb97c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 0x7fb964003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9640047c0 0x7fb964004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964005180 0x7fb96400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c161700 con 0x7fb964003970 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c020 con 0x7fb9640047c0 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.216+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c1e0 con 0x7fb964005180 2023-08-10T10:49:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 0x7fb964003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 -- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964005180 msgr2=0x7fb96400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964005180 0x7fb96400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 -- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9640047c0 msgr2=0x7fb964004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97a7fc640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9640047c0 0x7fb964004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9640047c0 0x7fb964004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97affd640 1 -- 172.21.15.50:0/2118417892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964003520 con 0x7fb964003970 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.217+0000 7fb97b7fe640 1 -- 172.21.15.50:0/2118417892 reap_dead start 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.218+0000 7fb97affd640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 0x7fb964003d90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009ac0 tx=0x7fb9640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fcbcc7a7ab5b84 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c02c6d0 con 0x7fb964003970 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c02c830 con 0x7fb964003970 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb979ffb640 1 -- 172.21.15.50:0/2118417892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c02cbc0 con 0x7fb964003970 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 -- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 msgr2=0x7fb964003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 0x7fb964003d90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009ac0 tx=0x7fb9640057f0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 -- 172.21.15.50:0/2118417892 shutdown_connections 2023-08-10T10:49:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 --2- 172.21.15.50:0/2118417892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb964003970 0x7fb964003d90 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 -- 172.21.15.50:0/2118417892 >> 172.21.15.50:0/2118417892 conn(0x7fb97c0696a0 msgr2=0x7fb97c069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 -- 172.21.15.50:0/2118417892 shutdown_connections 2023-08-10T10:49:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.219+0000 7fb97bfff640 1 -- 172.21.15.50:0/2118417892 wait complete. 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.221+0000 7fb97bfff640 1 Processor -- start 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.221+0000 7fb97bfff640 1 -- start start 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.222+0000 7fb97bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 0x7fb97c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.222+0000 7fb97bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 0x7fb97c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.222+0000 7fb97bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c15fc00 con 0x7fb97c0c6a00 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0cb990 con 0x7fb964003970 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c9390 con 0x7fb97c0c6580 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42596/0 (socket says 172.21.15.50:42596) 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 -- 172.21.15.50:0/632973326 learned_addr learned my addr 172.21.15.50:0/632973326 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97a7fc640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 0x7fb97c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97affd640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 0x7fb97c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 -- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 msgr2=0x7fb97c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 0x7fb97c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 -- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 msgr2=0x7fb97c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 0x7fb97c1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97b7fe640 1 -- 172.21.15.50:0/632973326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c15ddc0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97affd640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 0x7fb97c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.223+0000 7fb97a7fc640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 0x7fb97c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb97b7fe640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0d02f0 tx=0x7fb97400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974005d40 con 0x7fb97c0c6a00 2023-08-10T10:49:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400ced0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974005ea0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c15e0a0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.224+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c0cb320 con 0x7fb97c0c6a00 2023-08-10T10:49:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.225+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c0612b0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.226+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb97400a850 con 0x7fb97c0c6a00 2023-08-10T10:49:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.227+0000 7fb963fff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 0x7fb96806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.227+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb974088490 con 0x7fb97c0c6a00 2023-08-10T10:49:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.227+0000 7fb97affd640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 0x7fb96806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.228+0000 7fb97affd640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 0x7fb96806d140 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb96c036000 tx=0x7fb96c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.231+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb9740534d0 con 0x7fb97c0c6a00 2023-08-10T10:49:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:55.462+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb97c0b5200 con 0x7fb97c0c6a00 2023-08-10T10:49:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.105+0000 7fb963fff640 1 -- 172.21.15.50:0/632973326 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb974056af0 con 0x7fb97c0c6a00 2023-08-10T10:49:56.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.109+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 msgr2=0x7fb96806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.109+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 0x7fb96806d140 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb96c036000 tx=0x7fb96c030000 comp rx=0 tx=0).stop 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.109+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 msgr2=0x7fb97c15d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.109+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0d02f0 tx=0x7fb97400cb90 comp rx=0 tx=0).stop 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 shutdown_connections 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb97c0c6a00 0x7fb97c15d790 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb97c0c6580 0x7fb97c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb96806ac80 0x7fb96806d140 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 --2- 172.21.15.50:0/632973326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964003970 0x7fb97c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 >> 172.21.15.50:0/632973326 conn(0x7fb97c0696a0 msgr2=0x7fb97c0d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:56.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 shutdown_connections 2023-08-10T10:49:56.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.110+0000 7fb97bfff640 1 -- 172.21.15.50:0/632973326 wait complete. 2023-08-10T10:49:56.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:49:56.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.355+0000 7f8639d9b640 1 Processor -- start 2023-08-10T10:49:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.355+0000 7f8639d9b640 1 -- start start 2023-08-10T10:49:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8639d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f863415aaf0 0x7f86340cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8639d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 0x7f86340cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8639d9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8634071380 con 0x7f86340cd6c0 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8639d9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86340cdaf0 con 0x7f863415aaf0 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8639d9b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86340cc260 con 0x7f86340cfdb0 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f8638d99640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f863415aaf0 0x7f86340cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:56.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f863959a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86340cd6c0 0x7f863406b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51828/0 (socket says 172.21.15.50:51828) 2023-08-10T10:49:56.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.357+0000 7f863959a640 1 -- 172.21.15.50:0/3661972119 learned_addr learned my addr 172.21.15.50:0/3661972119 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f8638d99640 1 -- 172.21.15.50:0/3661972119 >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 msgr2=0x7f86340cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f862bfff640 1 --2- 172.21.15.50:0/3661972119 >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 0x7f86340cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f8638d99640 1 --2- 172.21.15.50:0/3661972119 >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 0x7f86340cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f8638d99640 1 -- 172.21.15.50:0/3661972119 >> v1:172.21.15.50:6789/0 conn(0x7f86340cd6c0 legacy=0x7f863406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f8638d99640 1 -- 172.21.15.50:0/3661972119 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340cc540 con 0x7f863415aaf0 2023-08-10T10:49:56.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.358+0000 7f862bfff640 1 --2- 172.21.15.50:0/3661972119 >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 0x7f86340cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:56.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.359+0000 7f8638d99640 1 --2- 172.21.15.50:0/3661972119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f863415aaf0 0x7f86340cf870 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f86340cad70 tx=0x7f863002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d031628f73b95206 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:56.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.359+0000 7f862b7fe640 1 -- 172.21.15.50:0/3661972119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630031830 con 0x7f863415aaf0 2023-08-10T10:49:56.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.359+0000 7f862b7fe640 1 -- 172.21.15.50:0/3661972119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630031990 con 0x7f863415aaf0 2023-08-10T10:49:56.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.359+0000 7f862b7fe640 1 -- 172.21.15.50:0/3661972119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630031d20 con 0x7f863415aaf0 2023-08-10T10:49:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 -- 172.21.15.50:0/3661972119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f863415aaf0 msgr2=0x7f86340cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 --2- 172.21.15.50:0/3661972119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f863415aaf0 0x7f86340cf870 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f86340cad70 tx=0x7f863002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 -- 172.21.15.50:0/3661972119 shutdown_connections 2023-08-10T10:49:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 --2- 172.21.15.50:0/3661972119 >> v2:172.21.15.117:3300/0 conn(0x7f86340cfdb0 0x7f86340cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 --2- 172.21.15.50:0/3661972119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f863415aaf0 0x7f86340cf870 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 -- 172.21.15.50:0/3661972119 >> 172.21.15.50:0/3661972119 conn(0x7f863406d3c0 msgr2=0x7f86340b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 -- 172.21.15.50:0/3661972119 shutdown_connections 2023-08-10T10:49:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.360+0000 7f8639d9b640 1 -- 172.21.15.50:0/3661972119 wait complete. 2023-08-10T10:49:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.362+0000 7f8639d9b640 1 Processor -- start 2023-08-10T10:49:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.362+0000 7f8639d9b640 1 -- start start 2023-08-10T10:49:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86340cfdb0 0x7f86341f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f863415aaf0 0x7f8634158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86341f3200 con 0x7f86340cd6c0 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340c7ed0 con 0x7f86340cfdb0 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8639d9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86340c81b0 con 0x7f863415aaf0 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8638d99640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8638d99640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42616/0 (socket says 172.21.15.50:42616) 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.363+0000 7f8638d99640 1 -- 172.21.15.50:0/1672803202 learned_addr learned my addr 172.21.15.50:0/1672803202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 -- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f863415aaf0 msgr2=0x7f8634158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f863415aaf0 0x7f8634158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 -- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86340cfdb0 msgr2=0x7f86341f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86340cfdb0 0x7f86341f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 -- 172.21.15.50:0/1672803202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630009400 con 0x7f86340cd6c0 2023-08-10T10:49:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8638d99640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8630000c00 tx=0x7f86300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863003aa60 con 0x7f86340cd6c0 2023-08-10T10:49:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863003abe0 con 0x7f86340cd6c0 2023-08-10T10:49:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300443f0 con 0x7f86340cd6c0 2023-08-10T10:49:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.364+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86340c8490 con 0x7f86340cd6c0 2023-08-10T10:49:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.365+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340c8a50 con 0x7f86340cd6c0 2023-08-10T10:49:56.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.366+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8634066e30 con 0x7f86340cd6c0 2023-08-10T10:49:56.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.367+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f863004d450 con 0x7f86340cd6c0 2023-08-10T10:49:56.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.368+0000 7f86297fa640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 0x7f862006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:56.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.369+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f86300ab730 con 0x7f86340cd6c0 2023-08-10T10:49:56.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.369+0000 7f862bfff640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 0x7f862006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:56.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.369+0000 7f862bfff640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 0x7f862006d110 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8624006fd0 tx=0x7f8624008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.373+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8630076890 con 0x7f86340cd6c0 2023-08-10T10:49:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:56.567+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86340c9150 con 0x7f86340cd6c0 2023-08-10T10:49:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.129+0000 7f86297fa640 1 -- 172.21.15.50:0/1672803202 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8630079eb0 con 0x7f86340cd6c0 2023-08-10T10:49:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:49:57.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 msgr2=0x7f862006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 0x7f862006d110 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8624006fd0 tx=0x7f8624008040 comp rx=0 tx=0).stop 2023-08-10T10:49:57.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 msgr2=0x7f86340c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8630000c00 tx=0x7f86300046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 shutdown_connections 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f863415aaf0 0x7f8634158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f862006ac50 0x7f862006d110 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86340cfdb0 0x7f86341f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 --2- 172.21.15.50:0/1672803202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86340cd6c0 0x7f86340c7840 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.133+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 >> 172.21.15.50:0/1672803202 conn(0x7f863406d3c0 msgr2=0x7f8634156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.134+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 shutdown_connections 2023-08-10T10:49:57.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.134+0000 7f8639d9b640 1 -- 172.21.15.50:0/1672803202 wait complete. 2023-08-10T10:49:57.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:49:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.392+0000 7f2ce88d7640 1 Processor -- start 2023-08-10T10:49:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.393+0000 7f2ce88d7640 1 -- start start 2023-08-10T10:49:57.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce88d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ce40cdd70 0x7f2ce40b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce88d7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40d24b0 con 0x7f2ce40cd910 2023-08-10T10:49:57.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce88d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40d18a0 con 0x7f2ce40cf000 2023-08-10T10:49:57.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce88d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40d1b80 con 0x7f2ce40cdd70 2023-08-10T10:49:57.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ce40cdd70 0x7f2ce40b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ce40cd910 0x7f2ce40b5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51836/0 (socket says 172.21.15.50:51836) 2023-08-10T10:49:57.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.395+0000 7f2ce2ffd640 1 -- 172.21.15.50:0/2860173728 learned_addr learned my addr 172.21.15.50:0/2860173728 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:57.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.396+0000 7f2ce3fff640 1 -- 172.21.15.50:0/2860173728 >> v1:172.21.15.117:6789/0 conn(0x7f2ce40cf000 legacy=0x7f2ce40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.396+0000 7f2ce3fff640 1 -- 172.21.15.50:0/2860173728 >> v1:172.21.15.50:6789/0 conn(0x7f2ce40cd910 legacy=0x7f2ce40b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.396+0000 7f2ce3fff640 1 -- 172.21.15.50:0/2860173728 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40d1e60 con 0x7f2ce40cdd70 2023-08-10T10:49:57.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.397+0000 7f2ce3fff640 1 --2- 172.21.15.50:0/2860173728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cdd70 0x7f2ce40b6360 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009d90 tx=0x7f2cdc02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e7124eb52eec4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:57.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.397+0000 7f2ce27fc640 1 -- 172.21.15.50:0/2860173728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc02ccf0 con 0x7f2ce40cdd70 2023-08-10T10:49:57.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.397+0000 7f2ce27fc640 1 -- 172.21.15.50:0/2860173728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc02ce50 con 0x7f2ce40cdd70 2023-08-10T10:49:57.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.397+0000 7f2ce27fc640 1 -- 172.21.15.50:0/2860173728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc034660 con 0x7f2ce40cdd70 2023-08-10T10:49:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 -- 172.21.15.50:0/2860173728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cdd70 msgr2=0x7f2ce40b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/2860173728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cdd70 0x7f2ce40b6360 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009d90 tx=0x7f2cdc02bf40 comp rx=0 tx=0).stop 2023-08-10T10:49:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 -- 172.21.15.50:0/2860173728 shutdown_connections 2023-08-10T10:49:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/2860173728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cdd70 0x7f2ce40b6360 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 -- 172.21.15.50:0/2860173728 >> 172.21.15.50:0/2860173728 conn(0x7f2ce406fcc0 msgr2=0x7f2ce40700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 -- 172.21.15.50:0/2860173728 shutdown_connections 2023-08-10T10:49:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.398+0000 7f2ce88d7640 1 -- 172.21.15.50:0/2860173728 wait complete. 2023-08-10T10:49:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.400+0000 7f2ce88d7640 1 Processor -- start 2023-08-10T10:49:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.400+0000 7f2ce88d7640 1 -- start start 2023-08-10T10:49:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 0x7f2ce4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40cdd70 0x7f2ce40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c7c50 con 0x7f2ce40cf000 2023-08-10T10:49:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c6d80 con 0x7f2ce40cd910 2023-08-10T10:49:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce88d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c91b0 con 0x7f2ce40cdd70 2023-08-10T10:49:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42636/0 (socket says 172.21.15.50:42636) 2023-08-10T10:49:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce3fff640 1 -- 172.21.15.50:0/4225283150 learned_addr learned my addr 172.21.15.50:0/4225283150 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.401+0000 7f2ce37fe640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 0x7f2ce4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce2ffd640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40cdd70 0x7f2ce40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 -- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40cdd70 msgr2=0x7f2ce40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40cdd70 0x7f2ce40b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 -- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 msgr2=0x7f2ce4154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 0x7f2ce4154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 -- 172.21.15.50:0/4225283150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc009a70 con 0x7f2ce40cf000 2023-08-10T10:49:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce37fe640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 0x7f2ce4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ce3fff640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc037040 tx=0x7f2cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.402+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc03d600 con 0x7f2ce40cf000 2023-08-10T10:49:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.403+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc03d760 con 0x7f2ce40cf000 2023-08-10T10:49:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.403+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc03daf0 con 0x7f2ce40cf000 2023-08-10T10:49:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.403+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40c6fd0 con 0x7f2ce40cf000 2023-08-10T10:49:57.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.403+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40c7590 con 0x7f2ce40cf000 2023-08-10T10:49:57.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.404+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce40612b0 con 0x7f2ce40cf000 2023-08-10T10:49:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.405+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cdc03b040 con 0x7f2ce40cf000 2023-08-10T10:49:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.406+0000 7f2ccbfff640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 0x7f2cd006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.406+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f2cdc0abb20 con 0x7f2ce40cf000 2023-08-10T10:49:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.406+0000 7f2ce37fe640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 0x7f2cd006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.407+0000 7f2ce37fe640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 0x7f2cd006d110 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ce41e92e0 tx=0x7f2cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.411+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2cdc076c90 con 0x7f2ce40cf000 2023-08-10T10:49:57.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:57.606+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ce40c5cc0 con 0x7f2ce40cf000 2023-08-10T10:49:58.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.137+0000 7f2ccbfff640 1 -- 172.21.15.50:0/4225283150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2cdc0390d0 con 0x7f2ce40cf000 2023-08-10T10:49:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:49:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 msgr2=0x7f2cd006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 0x7f2cd006d110 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ce41e92e0 tx=0x7f2cd4009040 comp rx=0 tx=0).stop 2023-08-10T10:49:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 msgr2=0x7f2ce40b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc037040 tx=0x7f2cdc004a40 comp rx=0 tx=0).stop 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 shutdown_connections 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce40cf000 0x7f2ce40b4920 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40cdd70 0x7f2ce40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2cd006ac50 0x7f2cd006d110 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 --2- 172.21.15.50:0/4225283150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce40cd910 0x7f2ce4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.142+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 >> 172.21.15.50:0/4225283150 conn(0x7f2ce406fcc0 msgr2=0x7f2ce40b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.143+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 shutdown_connections 2023-08-10T10:49:58.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.143+0000 7f2ce88d7640 1 -- 172.21.15.50:0/4225283150 wait complete. 2023-08-10T10:49:58.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:49:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.392+0000 7f815ec71640 1 Processor -- start 2023-08-10T10:49:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.392+0000 7f815ec71640 1 -- start start 2023-08-10T10:49:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.393+0000 7f815ec71640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81580ca5d0 0x7f815815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815ec71640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580b3bf0 con 0x7f8158158390 2023-08-10T10:49:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815ec71640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815815e720 con 0x7f815815f0f0 2023-08-10T10:49:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815ec71640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81580b3e30 con 0x7f81580ca5d0 2023-08-10T10:49:58.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815dc6f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8158158390 0x7f81580b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51850/0 (socket says 172.21.15.50:51850) 2023-08-10T10:49:58.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815d46e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81580ca5d0 0x7f815815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815dc6f640 1 -- 172.21.15.50:0/2296100727 learned_addr learned my addr 172.21.15.50:0/2296100727 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.394+0000 7f815cc6d640 1 -- 172.21.15.50:0/2296100727 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573565059 0 0) 0x7f8154001110 con 0x7f8158158390 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.395+0000 7f815cc6d640 1 -- 172.21.15.50:0/2296100727 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8144003520 con 0x7f8158158390 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.395+0000 7f815d46e640 1 -- 172.21.15.50:0/2296100727 >> v1:172.21.15.117:6789/0 conn(0x7f815815f0f0 legacy=0x7f81580affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.395+0000 7f815d46e640 1 -- 172.21.15.50:0/2296100727 >> v1:172.21.15.50:6789/0 conn(0x7f8158158390 legacy=0x7f81580b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.395+0000 7f815d46e640 1 -- 172.21.15.50:0/2296100727 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580b4110 con 0x7f81580ca5d0 2023-08-10T10:49:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.396+0000 7f815d46e640 1 --2- 172.21.15.50:0/2296100727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81580ca5d0 0x7f815815ebb0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f81480097a0 tx=0x7f814802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bd70f52392be0b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.396+0000 7f815cc6d640 1 -- 172.21.15.50:0/2296100727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148030610 con 0x7f81580ca5d0 2023-08-10T10:49:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.396+0000 7f815cc6d640 1 -- 172.21.15.50:0/2296100727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148030770 con 0x7f81580ca5d0 2023-08-10T10:49:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.396+0000 7f815cc6d640 1 -- 172.21.15.50:0/2296100727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148030ae0 con 0x7f81580ca5d0 2023-08-10T10:49:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 -- 172.21.15.50:0/2296100727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81580ca5d0 msgr2=0x7f815815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 --2- 172.21.15.50:0/2296100727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81580ca5d0 0x7f815815ebb0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f81480097a0 tx=0x7f814802b960 comp rx=0 tx=0).stop 2023-08-10T10:49:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 -- 172.21.15.50:0/2296100727 shutdown_connections 2023-08-10T10:49:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 --2- 172.21.15.50:0/2296100727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81580ca5d0 0x7f815815ebb0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 -- 172.21.15.50:0/2296100727 >> 172.21.15.50:0/2296100727 conn(0x7f81580cafb0 msgr2=0x7f81580cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 -- 172.21.15.50:0/2296100727 shutdown_connections 2023-08-10T10:49:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.397+0000 7f815ec71640 1 -- 172.21.15.50:0/2296100727 wait complete. 2023-08-10T10:49:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.399+0000 7f815ec71640 1 Processor -- start 2023-08-10T10:49:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.399+0000 7f815ec71640 1 -- start start 2023-08-10T10:49:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81580ca5d0 0x7f815806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 0x7f8158070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81580c5020 con 0x7f8158158390 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815806ecb0 con 0x7f81580ca5d0 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815ec71640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580c8000 con 0x7f8158070180 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815d46e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.400+0000 7f815d46e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42652/0 (socket says 172.21.15.50:42652) 2023-08-10T10:49:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 -- 172.21.15.50:0/227363522 learned_addr learned my addr 172.21.15.50:0/227363522 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815dc6f640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81580ca5d0 0x7f815806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815e470640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 0x7f8158070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 -- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 msgr2=0x7f8158070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 0x7f8158070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 -- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81580ca5d0 msgr2=0x7f815806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81580ca5d0 0x7f815806e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 -- 172.21.15.50:0/227363522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148009400 con 0x7f8158158390 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815e470640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 0x7f8158070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.401+0000 7f815d46e640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f814802b9a0 tx=0x7f81480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.402+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814803e070 con 0x7f8158158390 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.402+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148030e20 con 0x7f8158158390 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.402+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148003830 con 0x7f8158158390 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.402+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8158155310 con 0x7f8158158390 2023-08-10T10:49:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.402+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81580c4d40 con 0x7f8158158390 2023-08-10T10:49:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.403+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81580612b0 con 0x7f8158158390 2023-08-10T10:49:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.404+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8148003990 con 0x7f8158158390 2023-08-10T10:49:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.405+0000 7f814e7fc640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 0x7f813c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.405+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f81480aabb0 con 0x7f8158158390 2023-08-10T10:49:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.405+0000 7f815dc6f640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 0x7f813c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.406+0000 7f815dc6f640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 0x7f813c06d110 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8154007fd0 tx=0x7f8154009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.410+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8148076000 con 0x7f8158158390 2023-08-10T10:49:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.608+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f81580c5190 con 0x7f8158158390 2023-08-10T10:49:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.614+0000 7f814e7fc640 1 -- 172.21.15.50:0/227363522 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8148079620 con 0x7f8158158390 2023-08-10T10:49:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 msgr2=0x7f813c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 0x7f813c06d110 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8154007fd0 tx=0x7f8154009040 comp rx=0 tx=0).stop 2023-08-10T10:49:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 msgr2=0x7f8158154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f814802b9a0 tx=0x7f81480046c0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 shutdown_connections 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8158070180 0x7f8158070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158158390 0x7f8158154dd0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f813c06ac50 0x7f813c06d110 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 --2- 172.21.15.50:0/227363522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81580ca5d0 0x7f815806e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 >> 172.21.15.50:0/227363522 conn(0x7f81580cafb0 msgr2=0x7f81580cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 shutdown_connections 2023-08-10T10:49:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.617+0000 7f815ec71640 1 -- 172.21.15.50:0/227363522 wait complete. 2023-08-10T10:49:58.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-08-10T10:49:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.853+0000 7fb580fd4640 1 Processor -- start 2023-08-10T10:49:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.853+0000 7fb580fd4640 1 -- start start 2023-08-10T10:49:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb580fd4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb57c0cfc30 0x7fb57c070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb580fd4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c0cb940 con 0x7fb57c15cea0 2023-08-10T10:49:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb580fd4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c15d4b0 con 0x7fb57c06e550 2023-08-10T10:49:58.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb580fd4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c15d790 con 0x7fb57c0cfc30 2023-08-10T10:49:58.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb57bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb57c0cfc30 0x7fb57c070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb572ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb57c15cea0 0x7fb57c0ce410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51852/0 (socket says 172.21.15.50:51852) 2023-08-10T10:49:58.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.855+0000 7fb572ffd640 1 -- 172.21.15.50:0/1771382221 learned_addr learned my addr 172.21.15.50:0/1771382221 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:49:58.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.856+0000 7fb57bfff640 1 -- 172.21.15.50:0/1771382221 >> v1:172.21.15.117:6789/0 conn(0x7fb57c06e550 legacy=0x7fb57c06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.856+0000 7fb57bfff640 1 -- 172.21.15.50:0/1771382221 >> v1:172.21.15.50:6789/0 conn(0x7fb57c15cea0 legacy=0x7fb57c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.856+0000 7fb57bfff640 1 -- 172.21.15.50:0/1771382221 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c15da70 con 0x7fb57c0cfc30 2023-08-10T10:49:58.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.856+0000 7fb57affd640 1 -- 172.21.15.50:0/1771382221 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155103644 0 0) 0x7fb57c0cb940 con 0x7fb57c15cea0 2023-08-10T10:49:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.857+0000 7fb57bfff640 1 --2- 172.21.15.50:0/1771382221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c070ef0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb574009d90 tx=0x7fb57402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b6bc5855362e8e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.857+0000 7fb57affd640 1 -- 172.21.15.50:0/1771382221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57402cd00 con 0x7fb57c0cfc30 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.857+0000 7fb57affd640 1 -- 172.21.15.50:0/1771382221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57402ce60 con 0x7fb57c0cfc30 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.857+0000 7fb57affd640 1 -- 172.21.15.50:0/1771382221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574034660 con 0x7fb57c0cfc30 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 -- 172.21.15.50:0/1771382221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 msgr2=0x7fb57c070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 --2- 172.21.15.50:0/1771382221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c070ef0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb574009d90 tx=0x7fb57402bf50 comp rx=0 tx=0).stop 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 -- 172.21.15.50:0/1771382221 shutdown_connections 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 --2- 172.21.15.50:0/1771382221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c070ef0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 -- 172.21.15.50:0/1771382221 >> 172.21.15.50:0/1771382221 conn(0x7fb57c0d0630 msgr2=0x7fb57c0d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 -- 172.21.15.50:0/1771382221 shutdown_connections 2023-08-10T10:49:58.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.858+0000 7fb580fd4640 1 -- 172.21.15.50:0/1771382221 wait complete. 2023-08-10T10:49:58.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.860+0000 7fb580fd4640 1 Processor -- start 2023-08-10T10:49:58.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.860+0000 7fb580fd4640 1 -- start start 2023-08-10T10:49:58.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb57c06e550 0x7fb57c0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb57c15cea0 0x7fb57c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0c9cd0 con 0x7fb57c0cfc30 2023-08-10T10:49:58.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0c90c0 con 0x7fb57c06e550 2023-08-10T10:49:58.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb580fd4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0c93a0 con 0x7fb57c15cea0 2023-08-10T10:49:58.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb572ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb572ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42682/0 (socket says 172.21.15.50:42682) 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.861+0000 7fb572ffd640 1 -- 172.21.15.50:0/61870413 learned_addr learned my addr 172.21.15.50:0/61870413 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb57b7fe640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb57c06e550 0x7fb57c0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb57bfff640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb57c15cea0 0x7fb57c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 -- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb57c15cea0 msgr2=0x7fb57c15f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb57c15cea0 0x7fb57c15f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 -- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb57c06e550 msgr2=0x7fb57c0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb57c06e550 0x7fb57c0c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 -- 172.21.15.50:0/61870413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009a70 con 0x7fb57c0cfc30 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.862+0000 7fb572ffd640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c4a0 tx=0x7fb56400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.863+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640074e0 con 0x7fb57c0cfc30 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.863+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564007640 con 0x7fb57c0cfc30 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.863+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564004a00 con 0x7fb57c0cfc30 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.863+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c0c9680 con 0x7fb57c0cfc30 2023-08-10T10:49:58.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.863+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c0c8c90 con 0x7fb57c0cfc30 2023-08-10T10:49:58.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.864+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c066e30 con 0x7fb57c0cfc30 2023-08-10T10:49:58.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.865+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb564004b60 con 0x7fb57c0cfc30 2023-08-10T10:49:58.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.866+0000 7fb578ff9640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 0x7fb55c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.866+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb5640883e0 con 0x7fb57c0cfc30 2023-08-10T10:49:58.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.866+0000 7fb57b7fe640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 0x7fb55c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.867+0000 7fb57b7fe640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 0x7fb55c06d110 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0b2160 tx=0x7fb56c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:58.870+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb564053710 con 0x7fb57c0cfc30 2023-08-10T10:49:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:49:59.141+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fb57c06f2a0 con 0x7fb57c0cfc30 2023-08-10T10:50:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.152+0000 7fb578ff9640 1 -- 172.21.15.50:0/61870413 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v579) v1 ==== 132+0+0 (secure 0 0 0) 0x7fb564056d30 con 0x7fb57c0cfc30 2023-08-10T10:50:00.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.155+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 msgr2=0x7fb55c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.155+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 0x7fb55c06d110 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0b2160 tx=0x7fb56c009040 comp rx=0 tx=0).stop 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.155+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 msgr2=0x7fb57c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.155+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c4a0 tx=0x7fb56400c960 comp rx=0 tx=0).stop 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 shutdown_connections 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb57c15cea0 0x7fb57c15f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb57c0cfc30 0x7fb57c15f1a0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb55c06ac50 0x7fb55c06d110 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 --2- 172.21.15.50:0/61870413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb57c06e550 0x7fb57c0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 >> 172.21.15.50:0/61870413 conn(0x7fb57c0d0630 msgr2=0x7fb57c15aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 shutdown_connections 2023-08-10T10:50:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.156+0000 7fb580fd4640 1 -- 172.21.15.50:0/61870413 wait complete. 2023-08-10T10:50:00.179 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-10T10:50:00.179 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-08-10T10:50:00.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-08-10T10:50:00.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.406+0000 7f241b6ba640 1 Processor -- start 2023-08-10T10:50:00.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.406+0000 7f241b6ba640 1 -- start start 2023-08-10T10:50:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.407+0000 7f241b6ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241415ccb0 0x7f24140b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.407+0000 7f241b6ba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2414069db0 0x7f24140b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.407+0000 7f241b6ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140719f0 con 0x7f24140c9b30 2023-08-10T10:50:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.407+0000 7f241b6ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24140c8db0 con 0x7f241415ccb0 2023-08-10T10:50:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.407+0000 7f241b6ba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24140c9050 con 0x7f2414069db0 2023-08-10T10:50:00.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.408+0000 7f2419456640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241415ccb0 0x7f24140b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.408+0000 7f2419456640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241415ccb0 0x7f24140b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42694/0 (socket says 172.21.15.50:42694) 2023-08-10T10:50:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.408+0000 7f2419456640 1 -- 172.21.15.50:0/3117258265 learned_addr learned my addr 172.21.15.50:0/3117258265 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.408+0000 7f2419c57640 1 --2- 172.21.15.50:0/3117258265 >> v2:172.21.15.117:3300/0 conn(0x7f2414069db0 0x7f24140b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.409+0000 7f2419456640 1 -- 172.21.15.50:0/3117258265 >> v2:172.21.15.117:3300/0 conn(0x7f2414069db0 msgr2=0x7f24140b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:00.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.409+0000 7f2419456640 1 --2- 172.21.15.50:0/3117258265 >> v2:172.21.15.117:3300/0 conn(0x7f2414069db0 0x7f24140b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.409+0000 7f2419456640 1 -- 172.21.15.50:0/3117258265 >> v1:172.21.15.117:6789/0 conn(0x7f24140c9b30 legacy=0x7f24140696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:00.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.409+0000 7f2419456640 1 -- 172.21.15.50:0/3117258265 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140c9330 con 0x7f241415ccb0 2023-08-10T10:50:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.410+0000 7f2419456640 1 --2- 172.21.15.50:0/3117258265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f24140b2900 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f24140cb000 tx=0x7f241002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c435fab270c6c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.410+0000 7f240bfff640 1 -- 172.21.15.50:0/3117258265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031870 con 0x7f241415ccb0 2023-08-10T10:50:00.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.410+0000 7f240bfff640 1 -- 172.21.15.50:0/3117258265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100319d0 con 0x7f241415ccb0 2023-08-10T10:50:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.410+0000 7f240bfff640 1 -- 172.21.15.50:0/3117258265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031d60 con 0x7f241415ccb0 2023-08-10T10:50:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 -- 172.21.15.50:0/3117258265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 msgr2=0x7f24140b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 --2- 172.21.15.50:0/3117258265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f24140b2900 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f24140cb000 tx=0x7f241002b910 comp rx=0 tx=0).stop 2023-08-10T10:50:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 -- 172.21.15.50:0/3117258265 shutdown_connections 2023-08-10T10:50:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 --2- 172.21.15.50:0/3117258265 >> v2:172.21.15.117:3300/0 conn(0x7f2414069db0 0x7f24140b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 --2- 172.21.15.50:0/3117258265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f24140b2900 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 -- 172.21.15.50:0/3117258265 >> 172.21.15.50:0/3117258265 conn(0x7f241406b590 msgr2=0x7f24140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 -- 172.21.15.50:0/3117258265 shutdown_connections 2023-08-10T10:50:00.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.411+0000 7f241b6ba640 1 -- 172.21.15.50:0/3117258265 wait complete. 2023-08-10T10:50:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.413+0000 7f241b6ba640 1 Processor -- start 2023-08-10T10:50:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.413+0000 7f241b6ba640 1 -- start start 2023-08-10T10:50:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2414069db0 0x7f24141592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 0x7f241415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24141f31b0 con 0x7f241415ccb0 2023-08-10T10:50:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24140ae390 con 0x7f24140c9b30 2023-08-10T10:50:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f241b6ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24141f5870 con 0x7f2414069db0 2023-08-10T10:50:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.414+0000 7f2419c57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42696/0 (socket says 172.21.15.50:42696) 2023-08-10T10:50:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 -- 172.21.15.50:0/813459786 learned_addr learned my addr 172.21.15.50:0/813459786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419456640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2414069db0 0x7f24141592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2418c55640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 0x7f241415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 -- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2414069db0 msgr2=0x7f24141592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2414069db0 0x7f24141592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 -- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 msgr2=0x7f241415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 0x7f241415f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 -- 172.21.15.50:0/813459786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100094d0 con 0x7f241415ccb0 2023-08-10T10:50:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2418c55640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 0x7f241415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.415+0000 7f2419c57640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f240c007e30 tx=0x7f240c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.416+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c014620 con 0x7f241415ccb0 2023-08-10T10:50:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.416+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c014780 con 0x7f241415ccb0 2023-08-10T10:50:00.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.416+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c014b30 con 0x7f241415ccb0 2023-08-10T10:50:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.416+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24140c72f0 con 0x7f241415ccb0 2023-08-10T10:50:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.416+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24141f5da0 con 0x7f241415ccb0 2023-08-10T10:50:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.417+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241404e270 con 0x7f241415ccb0 2023-08-10T10:50:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.418+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f240c014c90 con 0x7f241415ccb0 2023-08-10T10:50:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.419+0000 7f2409ffb640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 0x7f23f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.419+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f240c089bc0 con 0x7f241415ccb0 2023-08-10T10:50:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.419+0000 7f2419456640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 0x7f23f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.420+0000 7f2419456640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 0x7f23f806d110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2410036000 tx=0x7f241003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.424+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f240c054ef0 con 0x7f241415ccb0 2023-08-10T10:50:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:00.685+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f24140cd6d0 con 0x7f241415ccb0 2023-08-10T10:50:01.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.161+0000 7f2409ffb640 1 -- 172.21.15.50:0/813459786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v580) v1 ==== 134+0+0 (secure 0 0 0) 0x7f240c058510 con 0x7f241415ccb0 2023-08-10T10:50:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.164+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 msgr2=0x7f23f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.164+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 0x7f23f806d110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2410036000 tx=0x7f241003c040 comp rx=0 tx=0).stop 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.164+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 msgr2=0x7f241415f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.164+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f240c007e30 tx=0x7f240c00e4b0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 shutdown_connections 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241415ccb0 0x7f241415f830 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f23f806ac50 0x7f23f806d110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24140c9b30 0x7f241415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 --2- 172.21.15.50:0/813459786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2414069db0 0x7f24141592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 >> 172.21.15.50:0/813459786 conn(0x7f241406b590 msgr2=0x7f24140cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:01.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 shutdown_connections 2023-08-10T10:50:01.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.165+0000 7f241b6ba640 1 -- 172.21.15.50:0/813459786 wait complete. 2023-08-10T10:50:01.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.411+0000 7fc54a5f5640 1 Processor -- start 2023-08-10T10:50:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.411+0000 7fc54a5f5640 1 -- start start 2023-08-10T10:50:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc54a5f5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc544159830 0x7fc5440cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc54a5f5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5440c9d00 0x7fc54415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc54a5f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440cc5a0 con 0x7fc54415e0f0 2023-08-10T10:50:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc54a5f5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440b4170 con 0x7fc5440c9d00 2023-08-10T10:50:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc54a5f5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54415d720 con 0x7fc544159830 2023-08-10T10:50:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc548df2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5440c9d00 0x7fc54415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc548df2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5440c9d00 0x7fc54415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42700/0 (socket says 172.21.15.50:42700) 2023-08-10T10:50:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.413+0000 7fc548df2640 1 -- 172.21.15.50:0/2918895546 learned_addr learned my addr 172.21.15.50:0/2918895546 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.414+0000 7fc548df2640 1 -- 172.21.15.50:0/2918895546 >> v2:172.21.15.117:3300/0 conn(0x7fc544159830 msgr2=0x7fc5440cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.414+0000 7fc548df2640 1 --2- 172.21.15.50:0/2918895546 >> v2:172.21.15.117:3300/0 conn(0x7fc544159830 0x7fc5440cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.414+0000 7fc548df2640 1 -- 172.21.15.50:0/2918895546 >> v1:172.21.15.117:6789/0 conn(0x7fc54415e0f0 legacy=0x7fc5440cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.414+0000 7fc548df2640 1 -- 172.21.15.50:0/2918895546 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544159c10 con 0x7fc5440c9d00 2023-08-10T10:50:01.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.415+0000 7fc548df2640 1 --2- 172.21.15.50:0/2918895546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54415dbb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc5440cf590 tx=0x7fc53402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39729e0a422b163 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.415+0000 7fc53bfff640 1 -- 172.21.15.50:0/2918895546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534031870 con 0x7fc5440c9d00 2023-08-10T10:50:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.415+0000 7fc53bfff640 1 -- 172.21.15.50:0/2918895546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5340319d0 con 0x7fc5440c9d00 2023-08-10T10:50:01.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.415+0000 7fc53bfff640 1 -- 172.21.15.50:0/2918895546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534031d60 con 0x7fc5440c9d00 2023-08-10T10:50:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 -- 172.21.15.50:0/2918895546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 msgr2=0x7fc54415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/2918895546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54415dbb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc5440cf590 tx=0x7fc53402b910 comp rx=0 tx=0).stop 2023-08-10T10:50:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 -- 172.21.15.50:0/2918895546 shutdown_connections 2023-08-10T10:50:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/2918895546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54415dbb0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/2918895546 >> v2:172.21.15.117:3300/0 conn(0x7fc544159830 0x7fc5440cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 -- 172.21.15.50:0/2918895546 >> 172.21.15.50:0/2918895546 conn(0x7fc54406ab80 msgr2=0x7fc54406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 -- 172.21.15.50:0/2918895546 shutdown_connections 2023-08-10T10:50:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.416+0000 7fc54a5f5640 1 -- 172.21.15.50:0/2918895546 wait complete. 2023-08-10T10:50:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.418+0000 7fc54a5f5640 1 Processor -- start 2023-08-10T10:50:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.418+0000 7fc54a5f5640 1 -- start start 2023-08-10T10:50:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc544159830 0x7fc5441515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 0x7fc544151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54415cb00 con 0x7fc5440c9d00 2023-08-10T10:50:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54414d460 con 0x7fc544159830 2023-08-10T10:50:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc54a5f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54415c670 con 0x7fc54414d6b0 2023-08-10T10:50:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc5495f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc5495f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42710/0 (socket says 172.21.15.50:42710) 2023-08-10T10:50:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.419+0000 7fc5495f3640 1 -- 172.21.15.50:0/3053106640 learned_addr learned my addr 172.21.15.50:0/3053106640 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc549df4640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 0x7fc544151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 -- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 msgr2=0x7fc544151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 0x7fc544151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 -- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc544159830 msgr2=0x7fc5441515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc544159830 0x7fc5441515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 -- 172.21.15.50:0/3053106640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340094d0 con 0x7fc5440c9d00 2023-08-10T10:50:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc549df4640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 0x7fc544151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc5495f3640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc54000b4d0 tx=0x7fc54000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.420+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540010610 con 0x7fc5440c9d00 2023-08-10T10:50:01.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.421+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540010770 con 0x7fc5440c9d00 2023-08-10T10:50:01.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.421+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540010b20 con 0x7fc5440c9d00 2023-08-10T10:50:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.421+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54415ba60 con 0x7fc5440c9d00 2023-08-10T10:50:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.421+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54415c020 con 0x7fc5440c9d00 2023-08-10T10:50:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.422+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc544066e30 con 0x7fc5440c9d00 2023-08-10T10:50:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.423+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc540010c80 con 0x7fc5440c9d00 2023-08-10T10:50:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.424+0000 7fc539ffb640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 0x7fc52806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.424+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc540088d90 con 0x7fc5440c9d00 2023-08-10T10:50:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.424+0000 7fc548df2640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 0x7fc52806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.425+0000 7fc548df2640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 0x7fc52806d110 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc534036000 tx=0x7fc534030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.428+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc540057be0 con 0x7fc5440c9d00 2023-08-10T10:50:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.612+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54414f0b0 con 0x7fc5440c9d00 2023-08-10T10:50:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.614+0000 7fc539ffb640 1 -- 172.21.15.50:0/3053106640 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+14770 (secure 0 0 0) 0x7fc54001e090 con 0x7fc5440c9d00 2023-08-10T10:50:01.616 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:01.616 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":164,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:49:58.122922+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6834/3094444013":"2023-08-11T10:49:54.948152+0000","172.21.15.117:6832/3094444013":"2023-08-11T10:49:54.948152+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 msgr2=0x7fc52806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 0x7fc52806d110 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc534036000 tx=0x7fc534030000 comp rx=0 tx=0).stop 2023-08-10T10:50:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 msgr2=0x7fc54414e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc54000b4d0 tx=0x7fc54000b990 comp rx=0 tx=0).stop 2023-08-10T10:50:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 shutdown_connections 2023-08-10T10:50:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54414d6b0 0x7fc544151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc52806ac50 0x7fc52806d110 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc544159830 0x7fc5441515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 --2- 172.21.15.50:0/3053106640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5440c9d00 0x7fc54414e4f0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.616+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 >> 172.21.15.50:0/3053106640 conn(0x7fc54406ab80 msgr2=0x7fc54414f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.617+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 shutdown_connections 2023-08-10T10:50:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.617+0000 7fc54a5f5640 1 -- 172.21.15.50:0/3053106640 wait complete. 2023-08-10T10:50:01.637 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:50:01.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:01.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.865+0000 7f214a7ea640 1 Processor -- start 2023-08-10T10:50:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.865+0000 7f214a7ea640 1 -- start start 2023-08-10T10:50:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.866+0000 7f214a7ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.866+0000 7f214a7ea640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21440ada90 0x7f21440c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.866+0000 7f214a7ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21440ca360 0x7f21440cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f214a7ea640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21440ca7f0 con 0x7f21440ada90 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f214a7ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21440adf10 con 0x7f21440ca360 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f214a7ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214406ebb0 con 0x7f2144159c10 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21440ada90 0x7f21440c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21440ada90 0x7f21440c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42714/0 (socket says 172.21.15.50:42714) 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 -- 172.21.15.50:0/413846240 learned_addr learned my addr 172.21.15.50:0/413846240 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f2143fff640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 -- 172.21.15.50:0/413846240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 msgr2=0x7f21440b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 -- 172.21.15.50:0/413846240 >> v2:172.21.15.117:3300/0 conn(0x7f21440ca360 msgr2=0x7f21440cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 --2- 172.21.15.50:0/413846240 >> v2:172.21.15.117:3300/0 conn(0x7f21440ca360 0x7f21440cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f213b7fe640 1 -- 172.21.15.50:0/413846240 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214406ee90 con 0x7f21440ada90 2023-08-10T10:50:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.867+0000 7f2143fff640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.868+0000 7f213b7fe640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ada90 0x7f21440c9e20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f21440ce5c0 tx=0x7f212c02b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5fce7118583055 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.869+0000 7f21437fe640 1 -- 172.21.15.50:0/413846240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0317f0 con 0x7f21440ada90 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.869+0000 7f21437fe640 1 -- 172.21.15.50:0/413846240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c031950 con 0x7f21440ada90 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.869+0000 7f21437fe640 1 -- 172.21.15.50:0/413846240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c031ce0 con 0x7f21440ada90 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.869+0000 7f214a7ea640 1 -- 172.21.15.50:0/413846240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ada90 msgr2=0x7f21440c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.869+0000 7f214a7ea640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ada90 0x7f21440c9e20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f21440ce5c0 tx=0x7f212c02b890 comp rx=0 tx=0).stop 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 -- 172.21.15.50:0/413846240 shutdown_connections 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 --2- 172.21.15.50:0/413846240 >> v2:172.21.15.117:3300/0 conn(0x7f21440ca360 0x7f21440cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ada90 0x7f21440c9e20 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 --2- 172.21.15.50:0/413846240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 -- 172.21.15.50:0/413846240 >> 172.21.15.50:0/413846240 conn(0x7f21440b01b0 msgr2=0x7f21440b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 -- 172.21.15.50:0/413846240 shutdown_connections 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.870+0000 7f214a7ea640 1 -- 172.21.15.50:0/413846240 wait complete. 2023-08-10T10:50:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.871+0000 7f214a7ea640 1 Processor -- start 2023-08-10T10:50:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.872+0000 7f214a7ea640 1 -- start start 2023-08-10T10:50:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.872+0000 7f214a7ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21440ada90 0x7f214415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.872+0000 7f214a7ea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.872+0000 7f214a7ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f214a7ea640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214415c860 con 0x7f21440ca360 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f214a7ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214415be90 con 0x7f21440ada90 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f214a7ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214415b000 con 0x7f2144159c10 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42724/0 (socket says 172.21.15.50:42724) 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 -- 172.21.15.50:0/2154339292 learned_addr learned my addr 172.21.15.50:0/2154339292 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f2148d87640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 -- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 msgr2=0x7f21440c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 -- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21440ada90 msgr2=0x7f214415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f2143fff640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21440ada90 0x7f214415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21440ada90 0x7f214415c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.873+0000 7f213b7fe640 1 -- 172.21.15.50:0/2154339292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0094d0 con 0x7f21440ca360 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f213b7fe640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0329d0 con 0x7f21440ca360 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c032b50 con 0x7f21440ca360 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0453f0 con 0x7f21440ca360 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21441f3510 con 0x7f21440ca360 2023-08-10T10:50:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.874+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214415b560 con 0x7f21440ca360 2023-08-10T10:50:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.875+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21440c8b80 con 0x7f21440ca360 2023-08-10T10:50:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.877+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f212c045550 con 0x7f21440ca360 2023-08-10T10:50:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.877+0000 7f21417fa640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 0x7f212406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.878+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f212c0abba0 con 0x7f21440ca360 2023-08-10T10:50:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.878+0000 7f2143fff640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 0x7f212406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.879+0000 7f2143fff640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 0x7f212406d110 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f21440af240 tx=0x7f2134008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:01.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:01.881+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f212c077070 con 0x7f21440ca360 2023-08-10T10:50:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.072+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21440612b0 con 0x7f21440ca360 2023-08-10T10:50:02.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.073+0000 7f21417fa640 1 -- 172.21.15.50:0/2154339292 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f212c07a690 con 0x7f21440ca360 2023-08-10T10:50:02.075 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:50:02.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.075+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 msgr2=0x7f212406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.075+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 0x7f212406d110 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f21440af240 tx=0x7f2134008040 comp rx=0 tx=0).stop 2023-08-10T10:50:02.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.075+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 msgr2=0x7f21441f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.075+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 shutdown_connections 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2144159c10 0x7f21440c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21440ca360 0x7f21441f2fd0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f212406ac50 0x7f212406d110 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 --2- 172.21.15.50:0/2154339292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21440ada90 0x7f214415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 >> 172.21.15.50:0/2154339292 conn(0x7f21440b01b0 msgr2=0x7f21440b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:02.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 shutdown_connections 2023-08-10T10:50:02.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.076+0000 7f214a7ea640 1 -- 172.21.15.50:0/2154339292 wait complete. 2023-08-10T10:50:02.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:50:02.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.330+0000 7f868eeb8640 1 Processor -- start 2023-08-10T10:50:02.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.330+0000 7f868eeb8640 1 -- start start 2023-08-10T10:50:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.331+0000 7f868eeb8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868815cf70 0x7f8688160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.331+0000 7f868eeb8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86880b4640 0x7f8688161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.331+0000 7f868eeb8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8688160a40 con 0x7f868815cb90 2023-08-10T10:50:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.331+0000 7f868eeb8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86880b4bb0 con 0x7f86880b4640 2023-08-10T10:50:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.331+0000 7f868eeb8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b4e90 con 0x7f868815cf70 2023-08-10T10:50:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f868cc54640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f868815cb90 0x7f86880b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51858/0 (socket says 172.21.15.50:51858) 2023-08-10T10:50:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f868cc54640 1 -- 172.21.15.50:0/531831762 learned_addr learned my addr 172.21.15.50:0/531831762 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:02.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f868d455640 1 --2- 172.21.15.50:0/531831762 >> v2:172.21.15.50:3300/0 conn(0x7f86880b4640 0x7f8688161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f867ffff640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868815cf70 0x7f8688160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196274920 0 0) 0x7f8688160a40 con 0x7f868815cb90 2023-08-10T10:50:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.332+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8670003520 con 0x7f868815cb90 2023-08-10T10:50:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.333+0000 7f868d455640 1 -- 172.21.15.50:0/531831762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868815cf70 msgr2=0x7f8688160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.333+0000 7f868d455640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868815cf70 0x7f8688160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.333+0000 7f868d455640 1 -- 172.21.15.50:0/531831762 >> v1:172.21.15.50:6789/0 conn(0x7f868815cb90 legacy=0x7f86880b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.333+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101085266 0 0) 0x7f8670003520 con 0x7f868815cb90 2023-08-10T10:50:02.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.333+0000 7f868d455640 1 -- 172.21.15.50:0/531831762 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880b5170 con 0x7f86880b4640 2023-08-10T10:50:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.334+0000 7f868d455640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86880b4640 0x7f8688161410 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816411ad9bfb34eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684001670 con 0x7f86880b4640 2023-08-10T10:50:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868002c8a0 con 0x7f86880b4640 2023-08-10T10:50:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f867f7fe640 1 -- 172.21.15.50:0/531831762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868002cc10 con 0x7f86880b4640 2023-08-10T10:50:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f868eeb8640 1 -- 172.21.15.50:0/531831762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86880b4640 msgr2=0x7f8688161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f868eeb8640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86880b4640 0x7f8688161410 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868002bd70 comp rx=0 tx=0).stop 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.335+0000 7f868eeb8640 1 -- 172.21.15.50:0/531831762 shutdown_connections 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.336+0000 7f868eeb8640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86880b4640 0x7f8688161410 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.336+0000 7f868eeb8640 1 --2- 172.21.15.50:0/531831762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868815cf70 0x7f8688160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.336+0000 7f868eeb8640 1 -- 172.21.15.50:0/531831762 >> 172.21.15.50:0/531831762 conn(0x7f86880cf640 msgr2=0x7f86880cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.336+0000 7f868eeb8640 1 -- 172.21.15.50:0/531831762 shutdown_connections 2023-08-10T10:50:02.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.336+0000 7f868eeb8640 1 -- 172.21.15.50:0/531831762 wait complete. 2023-08-10T10:50:02.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.337+0000 7f868eeb8640 1 Processor -- start 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.338+0000 7f868eeb8640 1 -- start start 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 0x7f86880c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868815cf70 0x7f86880b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c7fb0 con 0x7f868815cb90 2023-08-10T10:50:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c8290 con 0x7f868815cf70 2023-08-10T10:50:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868eeb8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c8570 con 0x7f86880b4640 2023-08-10T10:50:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f867ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f867ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42742/0 (socket says 172.21.15.50:42742) 2023-08-10T10:50:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f867ffff640 1 -- 172.21.15.50:0/266195432 learned_addr learned my addr 172.21.15.50:0/266195432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:02.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.339+0000 7f868cc54640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 0x7f86880c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 -- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 msgr2=0x7f86880c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 0x7f86880c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 -- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868815cf70 msgr2=0x7f86880b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f868d455640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868815cf70 0x7f86880b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868815cf70 0x7f86880b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 -- 172.21.15.50:0/266195432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009a70 con 0x7f868815cb90 2023-08-10T10:50:02.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f868cc54640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 0x7f86880c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:02.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867ffff640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f867800e870 tx=0x7f867800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780094f0 con 0x7f868815cb90 2023-08-10T10:50:02.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800c940 con 0x7f868815cb90 2023-08-10T10:50:02.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800ccf0 con 0x7f868815cb90 2023-08-10T10:50:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.340+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880c8850 con 0x7f868815cb90 2023-08-10T10:50:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.341+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880c7c30 con 0x7f868815cb90 2023-08-10T10:50:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.342+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880612b0 con 0x7f868815cb90 2023-08-10T10:50:02.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.343+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8678013470 con 0x7f868815cb90 2023-08-10T10:50:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.343+0000 7f867d7fa640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 0x7f867406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.344+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8678089260 con 0x7f868815cb90 2023-08-10T10:50:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.344+0000 7f868cc54640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 0x7f867406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.344+0000 7f868cc54640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 0x7f867406d140 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8684001380 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.348+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8678054660 con 0x7f868815cb90 2023-08-10T10:50:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.540+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86880d0a10 con 0x7f868815cb90 2023-08-10T10:50:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.541+0000 7f867d7fa640 1 -- 172.21.15.50:0/266195432 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8678057c80 con 0x7f868815cb90 2023-08-10T10:50:02.544 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:50:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.544+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 msgr2=0x7f867406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.544+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 0x7f867406d140 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8684001380 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.544+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 msgr2=0x7f86880b7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.544+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f867800e870 tx=0x7f867800ed30 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 shutdown_connections 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f867406ac80 0x7f867406d140 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868815cf70 0x7f86880b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f868815cb90 0x7f86880b7640 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 --2- 172.21.15.50:0/266195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880b4640 0x7f86880c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 >> 172.21.15.50:0/266195432 conn(0x7f86880cf640 msgr2=0x7f868815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 shutdown_connections 2023-08-10T10:50:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.545+0000 7f868eeb8640 1 -- 172.21.15.50:0/266195432 wait complete. 2023-08-10T10:50:02.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:50:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.802+0000 7f7db68e0640 1 Processor -- start 2023-08-10T10:50:02.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.803+0000 7f7db68e0640 1 -- start start 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 0x7f7db00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7db0069be0 0x7f7db006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db006a050 con 0x7f7db0069be0 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db015aee0 con 0x7f7db00b1ba0 2023-08-10T10:50:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.804+0000 7f7db68e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00b2100 con 0x7f7db01583c0 2023-08-10T10:50:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7db0069be0 0x7f7db006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7db0069be0 0x7f7db006ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42756/0 (socket says 172.21.15.50:42756) 2023-08-10T10:50:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 -- 172.21.15.50:0/684079432 learned_addr learned my addr 172.21.15.50:0/684079432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db58de640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db50dd640 1 --2- 172.21.15.50:0/684079432 >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 0x7f7db00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 -- 172.21.15.50:0/684079432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 msgr2=0x7f7db00b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db00b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 -- 172.21.15.50:0/684079432 >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 msgr2=0x7f7db00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 --2- 172.21.15.50:0/684079432 >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 0x7f7db00696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db60df640 1 -- 172.21.15.50:0/684079432 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db015b1a0 con 0x7f7db0069be0 2023-08-10T10:50:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.805+0000 7f7db50dd640 1 --2- 172.21.15.50:0/684079432 >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 0x7f7db00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.806+0000 7f7db60df640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db0069be0 0x7f7db006ab80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f7db00b0f90 tx=0x7f7da802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974dbf598566831d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db48dc640 1 -- 172.21.15.50:0/684079432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da802ca80 con 0x7f7db0069be0 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db48dc640 1 -- 172.21.15.50:0/684079432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da802cbe0 con 0x7f7db0069be0 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db48dc640 1 -- 172.21.15.50:0/684079432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80343f0 con 0x7f7db0069be0 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 -- 172.21.15.50:0/684079432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db0069be0 msgr2=0x7f7db006ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db0069be0 0x7f7db006ab80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f7db00b0f90 tx=0x7f7da802bee0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 -- 172.21.15.50:0/684079432 shutdown_connections 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db0069be0 0x7f7db006ab80 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 --2- 172.21.15.50:0/684079432 >> v2:172.21.15.117:3300/0 conn(0x7f7db00b1ba0 0x7f7db00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 --2- 172.21.15.50:0/684079432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db00b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.807+0000 7f7db68e0640 1 -- 172.21.15.50:0/684079432 >> 172.21.15.50:0/684079432 conn(0x7f7db00caf80 msgr2=0x7f7db00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.808+0000 7f7db68e0640 1 -- 172.21.15.50:0/684079432 shutdown_connections 2023-08-10T10:50:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.808+0000 7f7db68e0640 1 -- 172.21.15.50:0/684079432 wait complete. 2023-08-10T10:50:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.809+0000 7f7db68e0640 1 Processor -- start 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.810+0000 7f7db68e0640 1 -- start start 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.810+0000 7f7db68e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db0069be0 0x7f7db00c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db68e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db68e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db01f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db68e0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01f5970 con 0x7f7db00b1ba0 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db68e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01e7050 con 0x7f7db0069be0 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db68e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01e46d0 con 0x7f7db01583c0 2023-08-10T10:50:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db50dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db50dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42762/0 (socket says 172.21.15.50:42762) 2023-08-10T10:50:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db50dd640 1 -- 172.21.15.50:0/1340799961 learned_addr learned my addr 172.21.15.50:0/1340799961 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db60df640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db01f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.811+0000 7f7db58de640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db0069be0 0x7f7db00c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 -- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 msgr2=0x7f7db01f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db01f3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 -- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db0069be0 msgr2=0x7f7db00c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db0069be0 0x7f7db00c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 -- 172.21.15.50:0/1340799961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009b30 con 0x7f7db00b1ba0 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db60df640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db01f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db50dd640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c7c0 tx=0x7f7da000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0007a30 con 0x7f7db00b1ba0 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da0007b90 con 0x7f7db00b1ba0 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000ce70 con 0x7f7db00b1ba0 2023-08-10T10:50:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.812+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db01e49b0 con 0x7f7db00b1ba0 2023-08-10T10:50:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.813+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db01e4f70 con 0x7f7db00b1ba0 2023-08-10T10:50:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.814+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db01e5190 con 0x7f7db00b1ba0 2023-08-10T10:50:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.815+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7da00113f0 con 0x7f7db00b1ba0 2023-08-10T10:50:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.816+0000 7f7da67fc640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 0x7f7d9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.816+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7da00893b0 con 0x7f7db00b1ba0 2023-08-10T10:50:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.816+0000 7f7db58de640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 0x7f7d9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.816+0000 7f7db58de640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 0x7f7d9406d110 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:02.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:02.820+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7da00546e0 con 0x7f7db00b1ba0 2023-08-10T10:50:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.013+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7db0066e30 con 0x7f7db00b1ba0 2023-08-10T10:50:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.021+0000 7f7da67fc640 1 -- 172.21.15.50:0/1340799961 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7da0057d00 con 0x7f7db00b1ba0 2023-08-10T10:50:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 msgr2=0x7f7d9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 0x7f7d9406d110 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).stop 2023-08-10T10:50:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 msgr2=0x7f7db01e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c7c0 tx=0x7f7da000cc80 comp rx=0 tx=0).stop 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 shutdown_connections 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db01583c0 0x7f7db01f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7db00b1ba0 0x7f7db01e6260 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7d9406ac50 0x7f7d9406d110 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 --2- 172.21.15.50:0/1340799961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db0069be0 0x7f7db00c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.024+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 >> 172.21.15.50:0/1340799961 conn(0x7f7db00caf80 msgr2=0x7f7db00cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.025+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 shutdown_connections 2023-08-10T10:50:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.025+0000 7f7db68e0640 1 -- 172.21.15.50:0/1340799961 wait complete. 2023-08-10T10:50:03.046 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:50:03.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:50:03.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:50:03.300 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:50:03.301 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:50:03.301 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:03.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:50:03.364 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:50:03.365 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:03.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:50:03.424 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:50:03.425 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:03.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:50:03.486 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:50:03.487 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:03.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:50:03.546 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:50:03.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.785+0000 7fbfd5fd2640 1 Processor -- start 2023-08-10T10:50:03.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.785+0000 7fbfd5fd2640 1 -- start start 2023-08-10T10:50:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 0x7fbfd00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbfd00c3610 0x7fbfd00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd00ce4f0 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd0161450 con 0x7fbfd00c3610 2023-08-10T10:50:03.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd5fd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00d1490 con 0x7fbfd00d0b70 2023-08-10T10:50:03.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfc7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfc7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42776/0 (socket says 172.21.15.50:42776) 2023-08-10T10:50:03.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfc7fff640 1 -- 172.21.15.50:0/1691606295 learned_addr learned my addr 172.21.15.50:0/1691606295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:03.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.787+0000 7fbfd57d1640 1 --2- 172.21.15.50:0/1691606295 >> v2:172.21.15.117:3300/0 conn(0x7fbfd00c3610 0x7fbfd00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfd4fd0640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 0x7fbfd00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfc7fff640 1 -- 172.21.15.50:0/1691606295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 msgr2=0x7fbfd00d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfc7fff640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 0x7fbfd00d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfc7fff640 1 -- 172.21.15.50:0/1691606295 >> v2:172.21.15.117:3300/0 conn(0x7fbfd00c3610 msgr2=0x7fbfd00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfc7fff640 1 --2- 172.21.15.50:0/1691606295 >> v2:172.21.15.117:3300/0 conn(0x7fbfd00c3610 0x7fbfd00cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfc7fff640 1 -- 172.21.15.50:0/1691606295 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00afea0 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.788+0000 7fbfd4fd0640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 0x7fbfd00d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:03.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.789+0000 7fbfc7fff640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fbfd006ca90 tx=0x7fbfc002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec5b995732183b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.789+0000 7fbfc77fe640 1 -- 172.21.15.50:0/1691606295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00317f0 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.789+0000 7fbfc77fe640 1 -- 172.21.15.50:0/1691606295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0031950 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.789+0000 7fbfc77fe640 1 -- 172.21.15.50:0/1691606295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0031ce0 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/1691606295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00c3bd0 msgr2=0x7fbfd00ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fbfd006ca90 tx=0x7fbfc002b890 comp rx=0 tx=0).stop 2023-08-10T10:50:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/1691606295 shutdown_connections 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/1691606295 >> v2:172.21.15.117:3300/0 conn(0x7fbfd00c3610 0x7fbfd00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd00ccf90 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/1691606295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00d0b70 0x7fbfd00d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/1691606295 >> 172.21.15.50:0/1691606295 conn(0x7fbfd006d180 msgr2=0x7fbfd006d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/1691606295 shutdown_connections 2023-08-10T10:50:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.790+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/1691606295 wait complete. 2023-08-10T10:50:03.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.792+0000 7fbfd5fd2640 1 Processor -- start 2023-08-10T10:50:03.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.792+0000 7fbfd5fd2640 1 -- start start 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00c3610 0x7fbfd00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd01e9dc0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c6f50 con 0x7fbfd00c3bd0 2023-08-10T10:50:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.793+0000 7fbfd5fd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c7230 con 0x7fbfd00c3610 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42790/0 (socket says 172.21.15.50:42790) 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 -- 172.21.15.50:0/582793080 learned_addr learned my addr 172.21.15.50:0/582793080 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd4fd0640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00c3610 0x7fbfd00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfc7fff640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 -- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00c3610 msgr2=0x7fbfd00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00c3610 0x7fbfd00c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 -- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfd00c3bd0 msgr2=0x7fbfd015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd015cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 -- 172.21.15.50:0/582793080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00094d0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.794+0000 7fbfd57d1640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800d5d0 tx=0x7fbfc800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.795+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8014620 con 0x7fbfd00d0b70 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.795+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc80147a0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.795+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8014b50 con 0x7fbfd00d0b70 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.795+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd01e9a50 con 0x7fbfd00d0b70 2023-08-10T10:50:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.795+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd00c6bb0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.796+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd01e9be0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.797+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbfc8014cb0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.798+0000 7fbfc57fa640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 0x7fbfbc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.798+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbfc80896a0 con 0x7fbfd00d0b70 2023-08-10T10:50:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.799+0000 7fbfd4fd0640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 0x7fbfbc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.800+0000 7fbfd4fd0640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 0x7fbfbc06d140 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0075b0 tx=0x7fbfcc007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:03.803+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbfc8054940 con 0x7fbfd00d0b70 2023-08-10T10:50:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.035+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfd0066e30 con 0x7fbfd00d0b70 2023-08-10T10:50:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.036+0000 7fbfc57fa640 1 -- 172.21.15.50:0/582793080 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fbfc8018090 con 0x7fbfd00d0b70 2023-08-10T10:50:04.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4132972066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4132972066},{"type":"v1","addr":"172.21.15.50:6835","nonce":4132972066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6206,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2287720717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2287720717},{"type":"v1","addr":"172.21.15.117:6834","nonce":2287720717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":6592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/1560296400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":1560296400},{"type":"v1","addr":"172.21.15.50:6837","nonce":1560296400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/979300995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":979300995},{"type":"v1","addr":"172.21.15.117:6835","nonce":979300995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-08-10T10:50:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 78 2023-08-10T10:50:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 msgr2=0x7fbfbc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 0x7fbfbc06d140 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0075b0 tx=0x7fbfcc007540 comp rx=0 tx=0).stop 2023-08-10T10:50:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 msgr2=0x7fbfd00c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800d5d0 tx=0x7fbfc800da90 comp rx=0 tx=0).stop 2023-08-10T10:50:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 shutdown_connections 2023-08-10T10:50:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfd00d0b70 0x7fbfd00c6670 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbfbc06ac80 0x7fbfbc06d140 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfd00c3bd0 0x7fbfd015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 --2- 172.21.15.50:0/582793080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfd00c3610 0x7fbfd00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 >> 172.21.15.50:0/582793080 conn(0x7fbfd006d180 msgr2=0x7fbfd00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 shutdown_connections 2023-08-10T10:50:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.039+0000 7fbfd5fd2640 1 -- 172.21.15.50:0/582793080 wait complete. 2023-08-10T10:50:04.060 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:50:04.060 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:50:04.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:50:04.061 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:50:04.061 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:50:04.061 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:50:04.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:50:04.062 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:50:04.062 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:50:04.062 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:50:04.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:50:04.063 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:50:04.063 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:50:04.063 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:50:04.063 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:50:04.064 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:50:04.081 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:50:04.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:50:04.084 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:50:04.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:50:04.088 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:50:04.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:50:04.091 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:50:04.091 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:50:04.132 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:50:04.133 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:04.139 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:50:04.140 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:04.141 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:50:04.141 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:04.147 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:50:04.147 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:04.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:50:04.301 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:50:04.303 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:50:04.304 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:50:04.306 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:50:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.347+0000 7f54a9c83640 1 Processor -- start 2023-08-10T10:50:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.347+0000 7f54a9c83640 1 -- start start 2023-08-10T10:50:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.348+0000 7f54a9c83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.348+0000 7f54a9c83640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54a415ac00 0x7f54a40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.348+0000 7f54a9c83640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a415bcb0 con 0x7f54a40b40e0 2023-08-10T10:50:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.348+0000 7f54a9c83640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40c5540 con 0x7f54a415ac00 2023-08-10T10:50:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.348+0000 7f54a9c83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a415b0a0 con 0x7f54a415a820 2023-08-10T10:50:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f54a3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54a40b40e0 0x7f54a415e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51886/0 (socket says 172.21.15.50:51886) 2023-08-10T10:50:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f54a3fff640 1 -- 172.21.15.50:0/3685772360 learned_addr learned my addr 172.21.15.50:0/3685772360 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f549affd640 1 --2- 172.21.15.50:0/3685772360 >> v2:172.21.15.117:3300/0 conn(0x7f54a415ac00 0x7f54a40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f549affd640 1 -- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 msgr2=0x7f54a406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f549affd640 1 --2- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f549affd640 1 -- 172.21.15.50:0/3685772360 >> v1:172.21.15.50:6789/0 conn(0x7f54a40b40e0 legacy=0x7f54a415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f549affd640 1 -- 172.21.15.50:0/3685772360 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a415b380 con 0x7f54a415ac00 2023-08-10T10:50:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.349+0000 7f54a2ffd640 1 -- 172.21.15.50:0/3685772360 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850652268 0 0) 0x7f54a415bcb0 con 0x7f54a40b40e0 2023-08-10T10:50:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f549affd640 1 --2- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a415ac00 0x7f54a40696a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f548c0097a0 tx=0x7f548c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a267eac69f3024a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f54a2ffd640 1 -- 172.21.15.50:0/3685772360 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031830 con 0x7f54a415ac00 2023-08-10T10:50:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f54a2ffd640 1 -- 172.21.15.50:0/3685772360 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c031990 con 0x7f54a415ac00 2023-08-10T10:50:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f54a2ffd640 1 -- 172.21.15.50:0/3685772360 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031d20 con 0x7f54a415ac00 2023-08-10T10:50:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f54a9c83640 1 -- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a415ac00 msgr2=0x7f54a40696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.351+0000 7f54a9c83640 1 --2- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a415ac00 0x7f54a40696a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f548c0097a0 tx=0x7f548c02b8d0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 -- 172.21.15.50:0/3685772360 shutdown_connections 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 --2- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a415ac00 0x7f54a40696a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 --2- 172.21.15.50:0/3685772360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 -- 172.21.15.50:0/3685772360 >> 172.21.15.50:0/3685772360 conn(0x7f54a40b08e0 msgr2=0x7f54a40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 -- 172.21.15.50:0/3685772360 shutdown_connections 2023-08-10T10:50:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.352+0000 7f54a9c83640 1 -- 172.21.15.50:0/3685772360 wait complete. 2023-08-10T10:50:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.353+0000 7f54a9c83640 1 Processor -- start 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.354+0000 7f54a9c83640 1 -- start start 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a40b40e0 0x7f54a40c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a41f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a406ba20 con 0x7f54a415ac00 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c5c00 con 0x7f54a40b40e0 2023-08-10T10:50:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a9c83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c31f0 con 0x7f54a415a820 2023-08-10T10:50:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42830/0 (socket says 172.21.15.50:42830) 2023-08-10T10:50:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a3fff640 1 -- 172.21.15.50:0/2799651786 learned_addr learned my addr 172.21.15.50:0/2799651786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f54a37fe640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a40b40e0 0x7f54a40c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.355+0000 7f549affd640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a41f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 -- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 msgr2=0x7f54a41f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a41f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 -- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a40b40e0 msgr2=0x7f54a40c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a40b40e0 0x7f54a40c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 -- 172.21.15.50:0/2799651786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009400 con 0x7f54a415ac00 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a3fff640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c810 tx=0x7f549c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00a640 con 0x7f54a415ac00 2023-08-10T10:50:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00a7c0 con 0x7f54a415ac00 2023-08-10T10:50:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00ab70 con 0x7f54a415ac00 2023-08-10T10:50:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a41f1750 con 0x7f54a415ac00 2023-08-10T10:50:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.356+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a40c6110 con 0x7f54a415ac00 2023-08-10T10:50:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.358+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a404e270 con 0x7f54a415ac00 2023-08-10T10:50:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.359+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f549c00acd0 con 0x7f54a415ac00 2023-08-10T10:50:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.359+0000 7f54a0ff9640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 0x7f548406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.360+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f549c088610 con 0x7f54a415ac00 2023-08-10T10:50:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.360+0000 7f54a37fe640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 0x7f548406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.360+0000 7f54a37fe640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 0x7f548406d110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f54a40c4860 tx=0x7f5494009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.364+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f549c053a80 con 0x7f54a415ac00 2023-08-10T10:50:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:04.571+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54a40c8a20 con 0x7f54a415ac00 2023-08-10T10:50:05.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.196+0000 7f54a0ff9640 1 -- 172.21.15.50:0/2799651786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v166) v1 ==== 97+0+0 (secure 0 0 0) 0x7f549c0570a0 con 0x7f54a415ac00 2023-08-10T10:50:05.199 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:50:05.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.200+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 msgr2=0x7f548406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.200+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 0x7f548406d110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f54a40c4860 tx=0x7f5494009190 comp rx=0 tx=0).stop 2023-08-10T10:50:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.200+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 msgr2=0x7f54a40ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.200+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c810 tx=0x7f549c00ccd0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 shutdown_connections 2023-08-10T10:50:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54a415ac00 0x7f54a40ae0e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54a415a820 0x7f54a41f1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f548406ac50 0x7f548406d110 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 --2- 172.21.15.50:0/2799651786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54a40b40e0 0x7f54a40c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 >> 172.21.15.50:0/2799651786 conn(0x7f54a40b08e0 msgr2=0x7f54a40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 shutdown_connections 2023-08-10T10:50:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.201+0000 7f54a9c83640 1 -- 172.21.15.50:0/2799651786 wait complete. 2023-08-10T10:50:05.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:50:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.456+0000 7f8dd566a640 1 Processor -- start 2023-08-10T10:50:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.457+0000 7f8dd566a640 1 -- start start 2023-08-10T10:50:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.458+0000 7f8dd566a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8dd0153850 0x7f8dd00b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.458+0000 7f8dd566a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 0x7f8dd00b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dd566a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd015d010 con 0x7f8dd00cf630 2023-08-10T10:50:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dd566a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd015d290 con 0x7f8dd0153850 2023-08-10T10:50:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dd566a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd015d570 con 0x7f8dd0153c30 2023-08-10T10:50:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8dd0153850 0x7f8dd00b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8dd0153850 0x7f8dd00b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45428/0 (socket says 172.21.15.50:45428) 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 -- 172.21.15.50:0/1003526342 learned_addr learned my addr 172.21.15.50:0/1003526342 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dc7fff640 1 --2- 172.21.15.50:0/1003526342 >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 0x7f8dd00b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 -- 172.21.15.50:0/1003526342 >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 msgr2=0x7f8dd00b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 --2- 172.21.15.50:0/1003526342 >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 0x7f8dd00b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 -- 172.21.15.50:0/1003526342 >> v1:172.21.15.117:6789/0 conn(0x7f8dd00cf630 legacy=0x7f8dd00ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dcffff640 1 -- 172.21.15.50:0/1003526342 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd015d850 con 0x7f8dd0153850 2023-08-10T10:50:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.459+0000 7f8dc7fff640 1 --2- 172.21.15.50:0/1003526342 >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 0x7f8dd00b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dcffff640 1 --2- 172.21.15.50:0/1003526342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd0153850 0x7f8dd00b1690 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8dd008b960 tx=0x7f8dc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46990973b81424e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dcf7fe640 1 -- 172.21.15.50:0/1003526342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0031870 con 0x7f8dd0153850 2023-08-10T10:50:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dcf7fe640 1 -- 172.21.15.50:0/1003526342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc00319d0 con 0x7f8dd0153850 2023-08-10T10:50:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dcf7fe640 1 -- 172.21.15.50:0/1003526342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0031d60 con 0x7f8dd0153850 2023-08-10T10:50:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dd566a640 1 -- 172.21.15.50:0/1003526342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd0153850 msgr2=0x7f8dd00b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.461+0000 7f8dd566a640 1 --2- 172.21.15.50:0/1003526342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd0153850 0x7f8dd00b1690 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8dd008b960 tx=0x7f8dc002b910 comp rx=0 tx=0).stop 2023-08-10T10:50:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 -- 172.21.15.50:0/1003526342 shutdown_connections 2023-08-10T10:50:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 --2- 172.21.15.50:0/1003526342 >> v2:172.21.15.117:3300/0 conn(0x7f8dd0153c30 0x7f8dd00b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 --2- 172.21.15.50:0/1003526342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd0153850 0x7f8dd00b1690 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 -- 172.21.15.50:0/1003526342 >> 172.21.15.50:0/1003526342 conn(0x7f8dd0069880 msgr2=0x7f8dd0069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 -- 172.21.15.50:0/1003526342 shutdown_connections 2023-08-10T10:50:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.462+0000 7f8dd566a640 1 -- 172.21.15.50:0/1003526342 wait complete. 2023-08-10T10:50:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.464+0000 7f8dd566a640 1 Processor -- start 2023-08-10T10:50:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.464+0000 7f8dd566a640 1 -- start start 2023-08-10T10:50:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd0153850 0x7f8dd014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd0153c30 0x7f8dd0156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd01540a0 con 0x7f8dd00cf630 2023-08-10T10:50:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00c7320 con 0x7f8dd0153850 2023-08-10T10:50:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd566a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00c7ff0 con 0x7f8dd0153c30 2023-08-10T10:50:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dcffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dcffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45430/0 (socket says 172.21.15.50:45430) 2023-08-10T10:50:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dcffff640 1 -- 172.21.15.50:0/3626833272 learned_addr learned my addr 172.21.15.50:0/3626833272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.465+0000 7f8dd4e69640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd0153c30 0x7f8dd0156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 -- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd0153c30 msgr2=0x7f8dd0156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd0153c30 0x7f8dd0156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 -- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd0153850 msgr2=0x7f8dd014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd0153850 0x7f8dd014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 -- 172.21.15.50:0/3626833272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00094d0 con 0x7f8dd00cf630 2023-08-10T10:50:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcffff640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0000c00 tx=0x7f8dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0031840 con 0x7f8dd00cf630 2023-08-10T10:50:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc00443f0 con 0x7f8dd00cf630 2023-08-10T10:50:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00447c0 con 0x7f8dd00cf630 2023-08-10T10:50:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.466+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00c82d0 con 0x7f8dd00cf630 2023-08-10T10:50:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.467+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd00c8890 con 0x7f8dd00cf630 2023-08-10T10:50:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.468+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd0066e30 con 0x7f8dd00cf630 2023-08-10T10:50:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.469+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dc004d450 con 0x7f8dd00cf630 2023-08-10T10:50:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.470+0000 7f8dcd7fa640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 0x7f8db006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.470+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8dc002d040 con 0x7f8dd00cf630 2023-08-10T10:50:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.470+0000 7f8dc7fff640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 0x7f8db006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.471+0000 7f8dc7fff640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 0x7f8db006d110 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8db8006fd0 tx=0x7f8db8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:05.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.474+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8dc0076d50 con 0x7f8dd00cf630 2023-08-10T10:50:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.739+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8dd00b50f0 con 0x7f8dd00cf630 2023-08-10T10:50:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.740+0000 7f8dcd7fa640 1 -- 172.21.15.50:0/3626833272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8dc007a370 con 0x7f8dd00cf630 2023-08-10T10:50:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:05.742 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:50:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:50:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:50:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:50:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:50:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:50:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:50:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:50:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:50:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:50:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:50:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:50:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:50:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:50:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:50:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:50:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:50:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:50:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:50:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:50:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:50:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:50:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:50:05.773 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:50:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 msgr2=0x7f8db006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 0x7f8db006d110 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8db8006fd0 tx=0x7f8db8008040 comp rx=0 tx=0).stop 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 msgr2=0x7f8dd00c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0000c00 tx=0x7f8dc00046c0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 shutdown_connections 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd0153c30 0x7f8dd0156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8db006ac50 0x7f8db006d110 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd0153850 0x7f8dd014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 --2- 172.21.15.50:0/3626833272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dd00cf630 0x7f8dd00c6de0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 >> 172.21.15.50:0/3626833272 conn(0x7f8dd0069880 msgr2=0x7f8dd015f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 shutdown_connections 2023-08-10T10:50:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:05.743+0000 7f8dd566a640 1 -- 172.21.15.50:0/3626833272 wait complete. 2023-08-10T10:50:05.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:06.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.005+0000 7f4ac3fff640 1 Processor -- start 2023-08-10T10:50:06.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.006+0000 7f4ac3fff640 1 -- start start 2023-08-10T10:50:06.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4ac3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac4153c30 0x7f4ac40b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4ac3fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac415d010 con 0x7f4ac40cf630 2023-08-10T10:50:06.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4ac3fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac415d290 con 0x7f4ac4153c30 2023-08-10T10:50:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4ac3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac415d570 con 0x7f4ac4153850 2023-08-10T10:50:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4aba7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac4153c30 0x7f4ac40b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4aba7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac4153c30 0x7f4ac40b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45442/0 (socket says 172.21.15.50:45442) 2023-08-10T10:50:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.007+0000 7f4aba7fc640 1 -- 172.21.15.50:0/1997324966 learned_addr learned my addr 172.21.15.50:0/1997324966 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.008+0000 7f4ac2ffd640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.008+0000 7f4aba7fc640 1 -- 172.21.15.50:0/1997324966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 msgr2=0x7f4ac40b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:06.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.008+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.008+0000 7f4aba7fc640 1 -- 172.21.15.50:0/1997324966 >> v1:172.21.15.117:6789/0 conn(0x7f4ac40cf630 legacy=0x7f4ac40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:06.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.008+0000 7f4aba7fc640 1 -- 172.21.15.50:0/1997324966 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac415d850 con 0x7f4ac4153c30 2023-08-10T10:50:06.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.009+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac4153c30 0x7f4ac40b1bd0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009870 tx=0x7f4aac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8886a7b45ec02f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.009+0000 7f4ac27fc640 1 -- 172.21.15.50:0/1997324966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac031640 con 0x7f4ac4153c30 2023-08-10T10:50:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.009+0000 7f4ac27fc640 1 -- 172.21.15.50:0/1997324966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac0317a0 con 0x7f4ac4153c30 2023-08-10T10:50:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.009+0000 7f4ac27fc640 1 -- 172.21.15.50:0/1997324966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac031b30 con 0x7f4ac4153c30 2023-08-10T10:50:06.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 -- 172.21.15.50:0/1997324966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac4153c30 msgr2=0x7f4ac40b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac4153c30 0x7f4ac40b1bd0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009870 tx=0x7f4aac02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 -- 172.21.15.50:0/1997324966 shutdown_connections 2023-08-10T10:50:06.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac4153c30 0x7f4ac40b1bd0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/1997324966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 -- 172.21.15.50:0/1997324966 >> 172.21.15.50:0/1997324966 conn(0x7f4ac4069880 msgr2=0x7f4ac4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 -- 172.21.15.50:0/1997324966 shutdown_connections 2023-08-10T10:50:06.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.010+0000 7f4ac3fff640 1 -- 172.21.15.50:0/1997324966 wait complete. 2023-08-10T10:50:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.012+0000 7f4ac3fff640 1 Processor -- start 2023-08-10T10:50:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.012+0000 7f4ac3fff640 1 -- start start 2023-08-10T10:50:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40d2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac4153c30 0x7f4ac40c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40d12c0 con 0x7f4ac40cf630 2023-08-10T10:50:06.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40d15a0 con 0x7f4ac4153c30 2023-08-10T10:50:06.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40d1880 con 0x7f4ac4153850 2023-08-10T10:50:06.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45458/0 (socket says 172.21.15.50:45458) 2023-08-10T10:50:06.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.013+0000 7f4ac2ffd640 1 -- 172.21.15.50:0/372323269 learned_addr learned my addr 172.21.15.50:0/372323269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 -- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 msgr2=0x7f4ac40d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac37fe640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac4153c30 0x7f4ac40c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 -- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac4153c30 msgr2=0x7f4ac40c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac4153c30 0x7f4ac40c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 -- 172.21.15.50:0/372323269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0094d0 con 0x7f4ac40cf630 2023-08-10T10:50:06.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:06.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4ac2ffd640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400ce10 tx=0x7f4ab400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.014+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4003b90 con 0x7f4ac40cf630 2023-08-10T10:50:06.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.015+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4003cf0 con 0x7f4ac40cf630 2023-08-10T10:50:06.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.015+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4003ea0 con 0x7f4ac40cf630 2023-08-10T10:50:06.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.015+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40d1b60 con 0x7f4ac40cf630 2023-08-10T10:50:06.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.015+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac40b62e0 con 0x7f4ac40cf630 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.016+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac40d2080 con 0x7f4ac40cf630 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.017+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ab4004240 con 0x7f4ac40cf630 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.018+0000 7f4abbfff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 0x7f4aa406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.018+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4ab4012070 con 0x7f4ac40cf630 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.018+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 0x7f4aa406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.019+0000 7f4aba7fc640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 0x7f4aa406d140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4aac036000 tx=0x7f4aac03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.022+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4ab4054fb0 con 0x7f4ac40cf630 2023-08-10T10:50:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.217+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ac4066e30 con 0x7f4ac40cf630 2023-08-10T10:50:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.219+0000 7f4abbfff640 1 -- 172.21.15.50:0/372323269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f4ab40585d0 con 0x7f4ac40cf630 2023-08-10T10:50:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:06.221 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":168,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:50:05.207802+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 msgr2=0x7f4aa406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 0x7f4aa406d140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4aac036000 tx=0x7f4aac03c040 comp rx=0 tx=0).stop 2023-08-10T10:50:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 msgr2=0x7f4ac40d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400ce10 tx=0x7f4ab400a660 comp rx=0 tx=0).stop 2023-08-10T10:50:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 shutdown_connections 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4aa406ac80 0x7f4aa406d140 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac4153c30 0x7f4ac40c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac4153850 0x7f4ac40d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 --2- 172.21.15.50:0/372323269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac40cf630 0x7f4ac40d2360 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 >> 172.21.15.50:0/372323269 conn(0x7f4ac4069880 msgr2=0x7f4ac415ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 shutdown_connections 2023-08-10T10:50:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.222+0000 7f4ac3fff640 1 -- 172.21.15.50:0/372323269 wait complete. 2023-08-10T10:50:06.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:50:06.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.473+0000 7fb238a1a640 1 Processor -- start 2023-08-10T10:50:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.474+0000 7fb238a1a640 1 -- start start 2023-08-10T10:50:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb238a1a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb234159c10 0x7fb2340b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb238a1a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2340ca530 0x7fb23406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb238a1a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340adf40 con 0x7fb2340ada90 2023-08-10T10:50:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb238a1a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23406ebb0 con 0x7fb234159c10 2023-08-10T10:50:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb238a1a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23406ee90 con 0x7fb2340ca530 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb23259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb234159c10 0x7fb2340b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb23259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb234159c10 0x7fb2340b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45462/0 (socket says 172.21.15.50:45462) 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb23259c640 1 -- 172.21.15.50:0/1897925161 learned_addr learned my addr 172.21.15.50:0/1897925161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.476+0000 7fb232d9d640 1 --2- 172.21.15.50:0/1897925161 >> v2:172.21.15.117:3300/0 conn(0x7fb2340ca530 0x7fb23406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.477+0000 7fb23259c640 1 -- 172.21.15.50:0/1897925161 >> v2:172.21.15.117:3300/0 conn(0x7fb2340ca530 msgr2=0x7fb23406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.477+0000 7fb23259c640 1 --2- 172.21.15.50:0/1897925161 >> v2:172.21.15.117:3300/0 conn(0x7fb2340ca530 0x7fb23406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.477+0000 7fb23259c640 1 -- 172.21.15.50:0/1897925161 >> v1:172.21.15.50:6789/0 conn(0x7fb2340ada90 legacy=0x7fb2340c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.477+0000 7fb23259c640 1 -- 172.21.15.50:0/1897925161 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23406f170 con 0x7fb234159c10 2023-08-10T10:50:06.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.477+0000 7fb231d9b640 1 -- 172.21.15.50:0/1897925161 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495328274 0 0) 0x7fb2340adf40 con 0x7fb2340ada90 2023-08-10T10:50:06.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.478+0000 7fb23259c640 1 --2- 172.21.15.50:0/1897925161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b0cd0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb23406e840 tx=0x7fb22402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea82c74735cab235 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.478+0000 7fb231d9b640 1 -- 172.21.15.50:0/1897925161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22402ca80 con 0x7fb234159c10 2023-08-10T10:50:06.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.478+0000 7fb231d9b640 1 -- 172.21.15.50:0/1897925161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22402cbe0 con 0x7fb234159c10 2023-08-10T10:50:06.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.478+0000 7fb231d9b640 1 -- 172.21.15.50:0/1897925161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240343f0 con 0x7fb234159c10 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 -- 172.21.15.50:0/1897925161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 msgr2=0x7fb2340b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 --2- 172.21.15.50:0/1897925161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b0cd0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb23406e840 tx=0x7fb22402bee0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 -- 172.21.15.50:0/1897925161 shutdown_connections 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 --2- 172.21.15.50:0/1897925161 >> v2:172.21.15.117:3300/0 conn(0x7fb2340ca530 0x7fb23406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 --2- 172.21.15.50:0/1897925161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b0cd0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 -- 172.21.15.50:0/1897925161 >> 172.21.15.50:0/1897925161 conn(0x7fb2340b01b0 msgr2=0x7fb2340b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 -- 172.21.15.50:0/1897925161 shutdown_connections 2023-08-10T10:50:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.479+0000 7fb238a1a640 1 -- 172.21.15.50:0/1897925161 wait complete. 2023-08-10T10:50:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.481+0000 7fb238a1a640 1 Processor -- start 2023-08-10T10:50:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.481+0000 7fb238a1a640 1 -- start start 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 0x7fb23414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 0x7fb2341516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234150c00 con 0x7fb234159c10 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340b1960 con 0x7fb2340ca530 2023-08-10T10:50:06.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb238a1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340b3be0 con 0x7fb2340ada90 2023-08-10T10:50:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb232d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb232d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45470/0 (socket says 172.21.15.50:45470) 2023-08-10T10:50:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.482+0000 7fb232d9d640 1 -- 172.21.15.50:0/2675406808 learned_addr learned my addr 172.21.15.50:0/2675406808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb23259c640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 0x7fb23414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb229d9b640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 0x7fb2341516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 -- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 msgr2=0x7fb23414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 0x7fb23414dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 -- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 msgr2=0x7fb2341516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 0x7fb2341516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 -- 172.21.15.50:0/2675406808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009b30 con 0x7fb234159c10 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb23259c640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 0x7fb23414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb229d9b640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 0x7fb2341516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb232d9d640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d5d0 tx=0x7fb22c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0125f0 con 0x7fb234159c10 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.483+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c012750 con 0x7fb234159c10 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.484+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2340b1310 con 0x7fb234159c10 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.484+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c012b00 con 0x7fb234159c10 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.484+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2340b3ec0 con 0x7fb234159c10 2023-08-10T10:50:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.485+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2340caa30 con 0x7fb234159c10 2023-08-10T10:50:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.486+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb22c012c60 con 0x7fb234159c10 2023-08-10T10:50:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.487+0000 7fb22b7fe640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 0x7fb21406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.487+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb22c089790 con 0x7fb234159c10 2023-08-10T10:50:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.487+0000 7fb23259c640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 0x7fb21406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.488+0000 7fb23259c640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 0x7fb21406d110 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb224035000 tx=0x7fb224030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.491+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb22c054af0 con 0x7fb234159c10 2023-08-10T10:50:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.687+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2340612b0 con 0x7fb234159c10 2023-08-10T10:50:06.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.688+0000 7fb22b7fe640 1 -- 172.21.15.50:0/2675406808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb22c058110 con 0x7fb234159c10 2023-08-10T10:50:06.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:50:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 msgr2=0x7fb21406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 0x7fb21406d110 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb224035000 tx=0x7fb224030000 comp rx=0 tx=0).stop 2023-08-10T10:50:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 msgr2=0x7fb2340b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00d5d0 tx=0x7fb22c00da90 comp rx=0 tx=0).stop 2023-08-10T10:50:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 shutdown_connections 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234159c10 0x7fb2340b1df0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb21406ac50 0x7fb21406d110 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2340ca530 0x7fb2341516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 --2- 172.21.15.50:0/2675406808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2340ada90 0x7fb23414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 >> 172.21.15.50:0/2675406808 conn(0x7fb2340b01b0 msgr2=0x7fb2340cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 shutdown_connections 2023-08-10T10:50:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.691+0000 7fb238a1a640 1 -- 172.21.15.50:0/2675406808 wait complete. 2023-08-10T10:50:06.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:50:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.936+0000 7f5680342640 1 Processor -- start 2023-08-10T10:50:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.936+0000 7f5680342640 1 -- start start 2023-08-10T10:50:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f5680342640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56780b0cd0 0x7f567806ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f5680342640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56780cdcb0 0x7f567806f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f5680342640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5678161640 con 0x7f5678161260 2023-08-10T10:50:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f5680342640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780c1bb0 con 0x7f56780cdcb0 2023-08-10T10:50:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f5680342640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780adb30 con 0x7f56780b0cd0 2023-08-10T10:50:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f567e8df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56780cdcb0 0x7f567806f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f567e8df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56780cdcb0 0x7f567806f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45478/0 (socket says 172.21.15.50:45478) 2023-08-10T10:50:06.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f567e8df640 1 -- 172.21.15.50:0/4273400429 learned_addr learned my addr 172.21.15.50:0/4273400429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.938+0000 7f567e0de640 1 --1- 172.21.15.50:0/4273400429 >> v1:172.21.15.50:6789/0 conn(0x7f5678161260 0x7f56780ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36806/0 (socket says 172.21.15.50:36806) 2023-08-10T10:50:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.939+0000 7f567d8dd640 1 --2- 172.21.15.50:0/4273400429 >> v2:172.21.15.117:3300/0 conn(0x7f56780b0cd0 0x7f567806ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.939+0000 7f567e8df640 1 -- 172.21.15.50:0/4273400429 >> v2:172.21.15.117:3300/0 conn(0x7f56780b0cd0 msgr2=0x7f567806ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.939+0000 7f567e8df640 1 --2- 172.21.15.50:0/4273400429 >> v2:172.21.15.117:3300/0 conn(0x7f56780b0cd0 0x7f567806ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.939+0000 7f567e8df640 1 -- 172.21.15.50:0/4273400429 >> v1:172.21.15.50:6789/0 conn(0x7f5678161260 legacy=0x7f56780ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.939+0000 7f567e8df640 1 -- 172.21.15.50:0/4273400429 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780ade10 con 0x7f56780cdcb0 2023-08-10T10:50:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.940+0000 7f567e8df640 1 --2- 172.21.15.50:0/4273400429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56780cdcb0 0x7f567806f1d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5678073e80 tx=0x7f567002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d1f5287525f4cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.940+0000 7f567d0dc640 1 -- 172.21.15.50:0/4273400429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031870 con 0x7f56780cdcb0 2023-08-10T10:50:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.940+0000 7f567d0dc640 1 -- 172.21.15.50:0/4273400429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56700319d0 con 0x7f56780cdcb0 2023-08-10T10:50:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.940+0000 7f567d0dc640 1 -- 172.21.15.50:0/4273400429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031d60 con 0x7f56780cdcb0 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 -- 172.21.15.50:0/4273400429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56780cdcb0 msgr2=0x7f567806f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 --2- 172.21.15.50:0/4273400429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56780cdcb0 0x7f567806f1d0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5678073e80 tx=0x7f567002b910 comp rx=0 tx=0).stop 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 -- 172.21.15.50:0/4273400429 shutdown_connections 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 --2- 172.21.15.50:0/4273400429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56780cdcb0 0x7f567806f1d0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 --2- 172.21.15.50:0/4273400429 >> v2:172.21.15.117:3300/0 conn(0x7f56780b0cd0 0x7f567806ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 -- 172.21.15.50:0/4273400429 >> 172.21.15.50:0/4273400429 conn(0x7f56780b01b0 msgr2=0x7f56780b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 -- 172.21.15.50:0/4273400429 shutdown_connections 2023-08-10T10:50:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.941+0000 7f5680342640 1 -- 172.21.15.50:0/4273400429 wait complete. 2023-08-10T10:50:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.943+0000 7f5680342640 1 Processor -- start 2023-08-10T10:50:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.943+0000 7f5680342640 1 -- start start 2023-08-10T10:50:06.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56780b0cd0 0x7f56780c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 0x7f567815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780c45e0 con 0x7f5678161260 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567815d180 con 0x7f56780cdcb0 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f5680342640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780c2af0 con 0x7f56780b0cd0 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f567e8df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f567e8df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45488/0 (socket says 172.21.15.50:45488) 2023-08-10T10:50:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.944+0000 7f567e8df640 1 -- 172.21.15.50:0/1623760165 learned_addr learned my addr 172.21.15.50:0/1623760165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e0de640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56780b0cd0 0x7f56780c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567d8dd640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 0x7f567815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 -- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56780b0cd0 msgr2=0x7f56780c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56780b0cd0 0x7f56780c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 -- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 msgr2=0x7f567815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 0x7f567815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 -- 172.21.15.50:0/1623760165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700094d0 con 0x7f5678161260 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567d8dd640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 0x7f567815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.945+0000 7f567e8df640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f56700090b0 tx=0x7f56700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.946+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567003ac60 con 0x7f5678161260 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.946+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567003adc0 con 0x7f5678161260 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.946+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780c2dd0 con 0x7f5678161260 2023-08-10T10:50:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.946+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670044630 con 0x7f5678161260 2023-08-10T10:50:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.946+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56780c2730 con 0x7f5678161260 2023-08-10T10:50:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.947+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56780c4f40 con 0x7f5678161260 2023-08-10T10:50:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.948+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f567004d450 con 0x7f5678161260 2023-08-10T10:50:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.949+0000 7f566effd640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 0x7f565c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.949+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f567002d040 con 0x7f5678161260 2023-08-10T10:50:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.950+0000 7f567e0de640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 0x7f565c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.950+0000 7f567e0de640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 0x7f565c06d110 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f56740012e0 tx=0x7f5674005b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:06.954+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5670076b50 con 0x7f5678161260 2023-08-10T10:50:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.145+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56780c4060 con 0x7f5678161260 2023-08-10T10:50:07.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.146+0000 7f566effd640 1 -- 172.21.15.50:0/1623760165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56780c4060 con 0x7f5678161260 2023-08-10T10:50:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:50:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.148+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 msgr2=0x7f565c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 0x7f565c06d110 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f56740012e0 tx=0x7f5674005b70 comp rx=0 tx=0).stop 2023-08-10T10:50:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 msgr2=0x7f56780c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f56700090b0 tx=0x7f56700046c0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 shutdown_connections 2023-08-10T10:50:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5678161260 0x7f56780c21f0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f565c06ac50 0x7f565c06d110 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56780cdcb0 0x7f567815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 --2- 172.21.15.50:0/1623760165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56780b0cd0 0x7f56780c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 >> 172.21.15.50:0/1623760165 conn(0x7f56780b01b0 msgr2=0x7f56780af920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 shutdown_connections 2023-08-10T10:50:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.149+0000 7f5680342640 1 -- 172.21.15.50:0/1623760165 wait complete. 2023-08-10T10:50:07.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:50:07.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.394+0000 7f0e3ce3f640 1 Processor -- start 2023-08-10T10:50:07.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.394+0000 7f0e3ce3f640 1 -- start start 2023-08-10T10:50:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3ce3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 0x7f0e380b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3ce3f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0e380b0f00 0x7f0e380696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3ce3f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3815e1f0 con 0x7f0e38069be0 2023-08-10T10:50:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3ce3f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3806a070 con 0x7f0e380b0f00 2023-08-10T10:50:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3ce3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3815d5e0 con 0x7f0e38159970 2023-08-10T10:50:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e36d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e38069be0 0x7f0e380c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36816/0 (socket says 172.21.15.50:36816) 2023-08-10T10:50:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e36d9d640 1 -- 172.21.15.50:0/28059562 learned_addr learned my addr 172.21.15.50:0/28059562 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e3659c640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 0x7f0e380b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.396+0000 7f0e35d9b640 1 --2- 172.21.15.50:0/28059562 >> v2:172.21.15.117:3300/0 conn(0x7f0e380b0f00 0x7f0e380696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980699352 0 0) 0x7f0e3815e1f0 con 0x7f0e38069be0 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e20003520 con 0x7f0e38069be0 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1818039643 0 0) 0x7f0e20003520 con 0x7f0e38069be0 2023-08-10T10:50:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 msgr2=0x7f0e380b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 0x7f0e380b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 >> v2:172.21.15.117:3300/0 conn(0x7f0e380b0f00 msgr2=0x7f0e380696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 --2- 172.21.15.50:0/28059562 >> v2:172.21.15.117:3300/0 conn(0x7f0e380b0f00 0x7f0e380696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3815d8c0 con 0x7f0e38069be0 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0e300019f0 con 0x7f0e38069be0 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 >> v1:172.21.15.50:6789/0 conn(0x7f0e38069be0 legacy=0x7f0e380c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e20003970 0x7f0e20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e200047c0 0x7f0e20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 0x7f0e20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3806a070 con 0x7f0e20003970 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3815d5e0 con 0x7f0e200047c0 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2000b980 con 0x7f0e38159970 2023-08-10T10:50:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.397+0000 7f0e3659c640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e20003970 0x7f0e20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e3659c640 1 -- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 msgr2=0x7f0e20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e3659c640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e38159970 0x7f0e20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e3659c640 1 -- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e200047c0 msgr2=0x7f0e20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e35d9b640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e200047c0 0x7f0e20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e3659c640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e200047c0 0x7f0e20004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.398+0000 7f0e3659c640 1 -- 172.21.15.50:0/28059562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20003520 con 0x7f0e20003970 2023-08-10T10:50:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.399+0000 7f0e3659c640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e20003970 0x7f0e20003d90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009ac0 tx=0x7f0e200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6765f94e120eacda server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.399+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2802c710 con 0x7f0e20003970 2023-08-10T10:50:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.399+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2802c870 con 0x7f0e20003970 2023-08-10T10:50:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.399+0000 7f0e3559a640 1 -- 172.21.15.50:0/28059562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2802cc00 con 0x7f0e20003970 2023-08-10T10:50:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/28059562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e20003970 msgr2=0x7f0e20003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/28059562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e20003970 0x7f0e20003d90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009ac0 tx=0x7f0e200057f0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e36d9d640 1 -- 172.21.15.50:0/28059562 reap_dead start 2023-08-10T10:50:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/28059562 shutdown_connections 2023-08-10T10:50:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/28059562 >> 172.21.15.50:0/28059562 conn(0x7f0e3806b590 msgr2=0x7f0e380ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/28059562 shutdown_connections 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.400+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/28059562 wait complete. 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.402+0000 7f0e3ce3f640 1 Processor -- start 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.402+0000 7f0e3ce3f640 1 -- start start 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e20003970 0x7f0e3815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e38157f80 0x7f0e380ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380afc60 con 0x7f0e38158400 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380af1c0 con 0x7f0e38157f80 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.403+0000 7f0e3ce3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380acf50 con 0x7f0e20003970 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45508/0 (socket says 172.21.15.50:45508) 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 -- 172.21.15.50:0/1877868947 learned_addr learned my addr 172.21.15.50:0/1877868947 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e3659c640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e20003970 0x7f0e3815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e35d9b640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e38157f80 0x7f0e380ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 -- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e20003970 msgr2=0x7f0e3815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e20003970 0x7f0e3815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 -- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e38157f80 msgr2=0x7f0e380ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e38157f80 0x7f0e380ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.404+0000 7f0e36d9d640 1 -- 172.21.15.50:0/1877868947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380acc70 con 0x7f0e38158400 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e36d9d640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f0e380ce4e0 tx=0x7f0e3000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000ce50 con 0x7f0e38158400 2023-08-10T10:50:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000a610 con 0x7f0e38158400 2023-08-10T10:50:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e380af460 con 0x7f0e38158400 2023-08-10T10:50:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000a9c0 con 0x7f0e38158400 2023-08-10T10:50:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.405+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e380aee70 con 0x7f0e38158400 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.406+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380af980 con 0x7f0e38158400 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.407+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e3000ab20 con 0x7f0e38158400 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.408+0000 7f0e26ffd640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 0x7f0e1806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.408+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0e30088d40 con 0x7f0e38158400 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.408+0000 7f0e3659c640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 0x7f0e1806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.409+0000 7f0e3659c640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 0x7f0e1806d110 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0e28036000 tx=0x7f0e28030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.413+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0e380af980 con 0x7f0e38158400 2023-08-10T10:50:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.605+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e380af980 con 0x7f0e38158400 2023-08-10T10:50:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.606+0000 7f0e26ffd640 1 -- 172.21.15.50:0/1877868947 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v168) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0e380af980 con 0x7f0e38158400 2023-08-10T10:50:07.608 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:07.608 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:50:07.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:50:07.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:50:07.610 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.608+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 msgr2=0x7f0e1806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.608+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 0x7f0e1806d110 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0e28036000 tx=0x7f0e28030000 comp rx=0 tx=0).stop 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.608+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 msgr2=0x7f0e380ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.608+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f0e380ce4e0 tx=0x7f0e3000cc00 comp rx=0 tx=0).stop 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 shutdown_connections 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e38158400 0x7f0e380ae930 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e1806ac50 0x7f0e1806d110 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e38157f80 0x7f0e380ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 --2- 172.21.15.50:0/1877868947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e20003970 0x7f0e3815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 >> 172.21.15.50:0/1877868947 conn(0x7f0e3806b590 msgr2=0x7f0e380b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 shutdown_connections 2023-08-10T10:50:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.609+0000 7f0e3ce3f640 1 -- 172.21.15.50:0/1877868947 wait complete. 2023-08-10T10:50:07.629 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:50:07.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:50:07.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.866+0000 7f24b0cd3640 1 Processor -- start 2023-08-10T10:50:07.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.867+0000 7f24b0cd3640 1 -- start start 2023-08-10T10:50:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.868+0000 7f24b0cd3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24ac159990 0x7f24ac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.868+0000 7f24b0cd3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24ac0ce180 0x7f24ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.868+0000 7f24b0cd3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac06db40 con 0x7f24ac06d760 2023-08-10T10:50:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.868+0000 7f24b0cd3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac06c180 con 0x7f24ac159990 2023-08-10T10:50:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.868+0000 7f24b0cd3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac06c460 con 0x7f24ac0ce180 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24ac159990 0x7f24ac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24ac159990 0x7f24ac0cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45510/0 (socket says 172.21.15.50:45510) 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24ac06d760 0x7f24ac0ca020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36818/0 (socket says 172.21.15.50:36818) 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 -- 172.21.15.50:0/1041326416 learned_addr learned my addr 172.21.15.50:0/1041326416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24a9d9b640 1 --2- 172.21.15.50:0/1041326416 >> v2:172.21.15.117:3300/0 conn(0x7f24ac0ce180 0x7f24ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 -- 172.21.15.50:0/1041326416 >> v2:172.21.15.117:3300/0 conn(0x7f24ac0ce180 msgr2=0x7f24ac06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 --2- 172.21.15.50:0/1041326416 >> v2:172.21.15.117:3300/0 conn(0x7f24ac0ce180 0x7f24ac06d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 -- 172.21.15.50:0/1041326416 >> v1:172.21.15.50:6789/0 conn(0x7f24ac06d760 legacy=0x7f24ac0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24aa59c640 1 -- 172.21.15.50:0/1041326416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac06c740 con 0x7f24ac159990 2023-08-10T10:50:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.869+0000 7f24a959a640 1 -- 172.21.15.50:0/1041326416 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781720340 0 0) 0x7f24ac06db40 con 0x7f24ac06d760 2023-08-10T10:50:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.871+0000 7f24aa59c640 1 --2- 172.21.15.50:0/1041326416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac159990 0x7f24ac0cdc40 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f24ac06b280 tx=0x7f249c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2ab2957dba7e42 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.871+0000 7f24a959a640 1 -- 172.21.15.50:0/1041326416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c030860 con 0x7f24ac159990 2023-08-10T10:50:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.871+0000 7f24a959a640 1 -- 172.21.15.50:0/1041326416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0309c0 con 0x7f24ac159990 2023-08-10T10:50:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.871+0000 7f24a959a640 1 -- 172.21.15.50:0/1041326416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c030d50 con 0x7f24ac159990 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 -- 172.21.15.50:0/1041326416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac159990 msgr2=0x7f24ac0cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/1041326416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac159990 0x7f24ac0cdc40 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f24ac06b280 tx=0x7f249c02b9a0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 -- 172.21.15.50:0/1041326416 shutdown_connections 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/1041326416 >> v2:172.21.15.117:3300/0 conn(0x7f24ac0ce180 0x7f24ac06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/1041326416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac159990 0x7f24ac0cdc40 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 -- 172.21.15.50:0/1041326416 >> 172.21.15.50:0/1041326416 conn(0x7f24ac0cf780 msgr2=0x7f24ac0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 -- 172.21.15.50:0/1041326416 shutdown_connections 2023-08-10T10:50:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.872+0000 7f24b0cd3640 1 -- 172.21.15.50:0/1041326416 wait complete. 2023-08-10T10:50:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.874+0000 7f24b0cd3640 1 Processor -- start 2023-08-10T10:50:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.874+0000 7f24b0cd3640 1 -- start start 2023-08-10T10:50:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24ac0ce180 0x7f24ac1ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 0x7f24ac0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1ef170 con 0x7f24ac06d760 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac154540 con 0x7f24ac159990 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24b0cd3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1eebb0 con 0x7f24ac0ce180 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45514/0 (socket says 172.21.15.50:45514) 2023-08-10T10:50:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 -- 172.21.15.50:0/940370140 learned_addr learned my addr 172.21.15.50:0/940370140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aad9d640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 0x7f24ac0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 -- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24ac0ce180 msgr2=0x7f24ac1ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24ac0ce180 0x7f24ac1ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 -- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 msgr2=0x7f24ac0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 0x7f24ac0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 -- 172.21.15.50:0/940370140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0094d0 con 0x7f24ac06d760 2023-08-10T10:50:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aad9d640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 0x7f24ac0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.876+0000 7f24aa59c640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.877+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c03e070 con 0x7f24ac06d760 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.877+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c004030 con 0x7f24ac06d760 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.877+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0043c0 con 0x7f24ac06d760 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.877+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac1eee90 con 0x7f24ac06d760 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.877+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac0c96a0 con 0x7f24ac06d760 2023-08-10T10:50:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.878+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac154030 con 0x7f24ac06d760 2023-08-10T10:50:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.879+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f249c042070 con 0x7f24ac06d760 2023-08-10T10:50:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.880+0000 7f249affd640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 0x7f248c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.880+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f249c0ab190 con 0x7f24ac06d760 2023-08-10T10:50:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.880+0000 7f24a9d9b640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 0x7f248c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.881+0000 7f24a9d9b640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 0x7f248c06d110 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0b5510 tx=0x7f24a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:07.885+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f24ac154030 con 0x7f24ac06d760 2023-08-10T10:50:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.077+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f24ac154030 con 0x7f24ac06d760 2023-08-10T10:50:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.222+0000 7f249affd640 1 -- 172.21.15.50:0/940370140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v169) v1 ==== 138+0+0 (secure 0 0 0) 0x7f24ac154030 con 0x7f24ac06d760 2023-08-10T10:50:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:50:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.228+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 msgr2=0x7f248c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.228+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 0x7f248c06d110 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0b5510 tx=0x7f24a0008040 comp rx=0 tx=0).stop 2023-08-10T10:50:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.228+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 msgr2=0x7f24ac0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.228+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 shutdown_connections 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f248c06ac50 0x7f248c06d110 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24ac159990 0x7f24ac0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24ac0ce180 0x7f24ac1ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 --2- 172.21.15.50:0/940370140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac06d760 0x7f24ac0c9160 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 >> 172.21.15.50:0/940370140 conn(0x7f24ac0cf780 msgr2=0x7f24ac0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 shutdown_connections 2023-08-10T10:50:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.229+0000 7f24b0cd3640 1 -- 172.21.15.50:0/940370140 wait complete. 2023-08-10T10:50:08.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:50:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.481+0000 7f7cbe60d640 1 Processor -- start 2023-08-10T10:50:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.481+0000 7f7cbe60d640 1 -- start start 2023-08-10T10:50:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cbe60d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb815cbb0 0x7f7cb81612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cbe60d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c98b0 0x7f7cb80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cbe60d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb8161800 con 0x7f7cb80c8d10 2023-08-10T10:50:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cbe60d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb8160870 con 0x7f7cb815cbb0 2023-08-10T10:50:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cbe60d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ca370 con 0x7f7cb80c98b0 2023-08-10T10:50:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.483+0000 7f7cb7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb815cbb0 0x7f7cb81612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb815cbb0 0x7f7cb81612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45528/0 (socket says 172.21.15.50:45528) 2023-08-10T10:50:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 -- 172.21.15.50:0/932882336 learned_addr learned my addr 172.21.15.50:0/932882336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7caf7fe640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c98b0 0x7f7cb80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 -- 172.21.15.50:0/932882336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c98b0 msgr2=0x7f7cb80c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c98b0 0x7f7cb80c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 -- 172.21.15.50:0/932882336 >> v1:172.21.15.117:6789/0 conn(0x7f7cb80c8d10 legacy=0x7f7cb806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 -- 172.21.15.50:0/932882336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80ca650 con 0x7f7cb815cbb0 2023-08-10T10:50:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.484+0000 7f7cb7fff640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb81612c0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009870 tx=0x7f7ca802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f68e43ce1493c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.486+0000 7f7cb77fe640 1 -- 172.21.15.50:0/932882336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca80317c0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.486+0000 7f7cb77fe640 1 -- 172.21.15.50:0/932882336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8031920 con 0x7f7cb815cbb0 2023-08-10T10:50:08.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.486+0000 7f7cb77fe640 1 -- 172.21.15.50:0/932882336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8031cb0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.486+0000 7f7cbe60d640 1 -- 172.21.15.50:0/932882336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 msgr2=0x7f7cb81612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.486+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb81612c0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009870 tx=0x7f7ca802b860 comp rx=0 tx=0).stop 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 -- 172.21.15.50:0/932882336 shutdown_connections 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c98b0 0x7f7cb80c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/932882336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb81612c0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 -- 172.21.15.50:0/932882336 >> 172.21.15.50:0/932882336 conn(0x7f7cb80b01b0 msgr2=0x7f7cb80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:08.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 -- 172.21.15.50:0/932882336 shutdown_connections 2023-08-10T10:50:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.487+0000 7f7cbe60d640 1 -- 172.21.15.50:0/932882336 wait complete. 2023-08-10T10:50:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.489+0000 7f7cbe60d640 1 Processor -- start 2023-08-10T10:50:08.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.490+0000 7f7cbe60d640 1 -- start start 2023-08-10T10:50:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c8d10 0x7f7cb8159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb80c98b0 0x7f7cb80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c3550 con 0x7f7cb815cbb0 2023-08-10T10:50:08.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c3830 con 0x7f7cb80c98b0 2023-08-10T10:50:08.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbe60d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c3b10 con 0x7f7cb80c8d10 2023-08-10T10:50:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45530/0 (socket says 172.21.15.50:45530) 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 -- 172.21.15.50:0/2808328625 learned_addr learned my addr 172.21.15.50:0/2808328625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7caf7fe640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb80c98b0 0x7f7cb80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cb7fff640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c8d10 0x7f7cb8159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 -- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c8d10 msgr2=0x7f7cb8159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c8d10 0x7f7cb8159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 -- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb80c98b0 msgr2=0x7f7cb80c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb80c98b0 0x7f7cb80c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 -- 172.21.15.50:0/2808328625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80094d0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cbcbaa640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000b410 tx=0x7f7cb000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.491+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0004020 con 0x7f7cb815cbb0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.492+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80c3df0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.492+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0004180 con 0x7f7cb815cbb0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.492+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0011630 con 0x7f7cb815cbb0 2023-08-10T10:50:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.492+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb80c30f0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.493+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80612b0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.494+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cb0011790 con 0x7f7cb815cbb0 2023-08-10T10:50:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.496+0000 7f7cb57fa640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 0x7f7c9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.496+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7cb0089820 con 0x7f7cb815cbb0 2023-08-10T10:50:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.497+0000 7f7cb7fff640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 0x7f7c9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.497+0000 7f7cb7fff640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 0x7f7c9806d110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8036000 tx=0x7f7ca803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.502+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7cb0054aa0 con 0x7f7cb815cbb0 2023-08-10T10:50:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:08.694+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7cb8070730 con 0x7f7cb815cbb0 2023-08-10T10:50:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.240+0000 7f7cb57fa640 1 -- 172.21.15.50:0/2808328625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v170) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7cb00580c0 con 0x7f7cb815cbb0 2023-08-10T10:50:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:50:09.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.251+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 msgr2=0x7f7c9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.251+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 0x7f7c9806d110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8036000 tx=0x7f7ca803d040 comp rx=0 tx=0).stop 2023-08-10T10:50:09.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.251+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 msgr2=0x7f7cb80c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.251+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000b410 tx=0x7f7cb000b8d0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.252+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 shutdown_connections 2023-08-10T10:50:09.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.252+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb815cbb0 0x7f7cb80c7960 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.252+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7c9806ac50 0x7f7c9806d110 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.252+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb80c98b0 0x7f7cb80c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.253+0000 7f7cbe60d640 1 --2- 172.21.15.50:0/2808328625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cb80c8d10 0x7f7cb8159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.253+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 >> 172.21.15.50:0/2808328625 conn(0x7f7cb80b01b0 msgr2=0x7f7cb806f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.253+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 shutdown_connections 2023-08-10T10:50:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.254+0000 7f7cbe60d640 1 -- 172.21.15.50:0/2808328625 wait complete. 2023-08-10T10:50:09.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:50:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.491+0000 7f9fef0bf640 1 Processor -- start 2023-08-10T10:50:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.491+0000 7f9fef0bf640 1 -- start start 2023-08-10T10:50:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.492+0000 7f9fef0bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fe80cd9b0 0x7f9fe80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.492+0000 7f9fef0bf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe806c320 con 0x7f9fe815ae40 2023-08-10T10:50:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.492+0000 7f9fef0bf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe806b770 con 0x7f9fe806cb30 2023-08-10T10:50:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.492+0000 7f9fef0bf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe806b9f0 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fece5b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9fe815ae40 0x7f9fe80cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36820/0 (socket says 172.21.15.50:36820) 2023-08-10T10:50:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fece5b640 1 -- 172.21.15.50:0/3600810508 learned_addr learned my addr 172.21.15.50:0/3600810508 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fe7fff640 1 --2- 172.21.15.50:0/3600810508 >> v2:172.21.15.50:3300/0 conn(0x7f9fe80cd9b0 0x7f9fe80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fe77fe640 1 -- 172.21.15.50:0/3600810508 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801522988 0 0) 0x7f9fe806c320 con 0x7f9fe815ae40 2023-08-10T10:50:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fe77fe640 1 -- 172.21.15.50:0/3600810508 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd0003520 con 0x7f9fe815ae40 2023-08-10T10:50:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fe7fff640 1 -- 172.21.15.50:0/3600810508 >> v1:172.21.15.117:6789/0 conn(0x7f9fe806cb30 legacy=0x7f9fe80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.493+0000 7f9fe7fff640 1 -- 172.21.15.50:0/3600810508 >> v1:172.21.15.50:6789/0 conn(0x7f9fe815ae40 legacy=0x7f9fe80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.494+0000 7f9fe7fff640 1 -- 172.21.15.50:0/3600810508 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe806bcd0 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.495+0000 7f9fe7fff640 1 --2- 172.21.15.50:0/3600810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe80b1510 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097a0 tx=0x7f9fdc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ee4d9f0a9e87df server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.495+0000 7f9fe77fe640 1 -- 172.21.15.50:0/3600810508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030610 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.495+0000 7f9fe77fe640 1 -- 172.21.15.50:0/3600810508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc030770 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.495+0000 7f9fe77fe640 1 -- 172.21.15.50:0/3600810508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc030b00 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 -- 172.21.15.50:0/3600810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80cd9b0 msgr2=0x7f9fe80b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/3600810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe80b1510 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097a0 tx=0x7f9fdc02b960 comp rx=0 tx=0).stop 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 -- 172.21.15.50:0/3600810508 shutdown_connections 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/3600810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe80b1510 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 -- 172.21.15.50:0/3600810508 >> 172.21.15.50:0/3600810508 conn(0x7f9fe80b01b0 msgr2=0x7f9fe80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 -- 172.21.15.50:0/3600810508 shutdown_connections 2023-08-10T10:50:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.496+0000 7f9fef0bf640 1 -- 172.21.15.50:0/3600810508 wait complete. 2023-08-10T10:50:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.497+0000 7f9fef0bf640 1 Processor -- start 2023-08-10T10:50:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.498+0000 7f9fef0bf640 1 -- start start 2023-08-10T10:50:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe806cb30 0x7f9fe80c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8143da0 con 0x7f9fe815ae40 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815d850 con 0x7f9fe80cd9b0 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fef0bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815db30 con 0x7f9fe806cb30 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45542/0 (socket says 172.21.15.50:45542) 2023-08-10T10:50:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 -- 172.21.15.50:0/2133175845 learned_addr learned my addr 172.21.15.50:0/2133175845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fe7fff640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fece5b640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe806cb30 0x7f9fe80c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 -- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe806cb30 msgr2=0x7f9fe80c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe806cb30 0x7f9fe80c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 -- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe80cd9b0 msgr2=0x7f9fe815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.499+0000 7f9fed65c640 1 -- 172.21.15.50:0/2133175845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc009400 con 0x7f9fe815ae40 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fed65c640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c3a0 tx=0x7f9fe000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00052d0 con 0x7f9fe815ae40 2023-08-10T10:50:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0005430 con 0x7f9fe815ae40 2023-08-10T10:50:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0003830 con 0x7f9fe815ae40 2023-08-10T10:50:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe815de10 con 0x7f9fe815ae40 2023-08-10T10:50:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.500+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80c4f30 con 0x7f9fe815ae40 2023-08-10T10:50:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.501+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8143f10 con 0x7f9fe815ae40 2023-08-10T10:50:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.502+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fe0003990 con 0x7f9fe815ae40 2023-08-10T10:50:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.504+0000 7f9fe57fa640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 0x7f9fd406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.504+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9fe0088ab0 con 0x7f9fe815ae40 2023-08-10T10:50:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.504+0000 7f9fece5b640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 0x7f9fd406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.505+0000 7f9fece5b640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 0x7f9fd406d110 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8001560 tx=0x7f9fd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:09.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.509+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fe8143f10 con 0x7f9fe815ae40 2023-08-10T10:50:09.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:09.738+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9fe8143f10 con 0x7f9fe815ae40 2023-08-10T10:50:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.303+0000 7f9fe57fa640 1 -- 172.21.15.50:0/2133175845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9fe8143f10 con 0x7f9fe815ae40 2023-08-10T10:50:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 21 and data pool 22 2023-08-10T10:50:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.312+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 msgr2=0x7f9fd406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.312+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 0x7f9fd406d110 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8001560 tx=0x7f9fd8009040 comp rx=0 tx=0).stop 2023-08-10T10:50:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.312+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 msgr2=0x7f9fe80cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.312+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c3a0 tx=0x7f9fe000c860 comp rx=0 tx=0).stop 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 shutdown_connections 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe815ae40 0x7f9fe80cc420 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9fd406ac50 0x7f9fd406d110 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe80cd9b0 0x7f9fe815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 --2- 172.21.15.50:0/2133175845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe806cb30 0x7f9fe80c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.313+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 >> 172.21.15.50:0/2133175845 conn(0x7f9fe80b01b0 msgr2=0x7f9fe815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.314+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 shutdown_connections 2023-08-10T10:50:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.314+0000 7f9fef0bf640 1 -- 172.21.15.50:0/2133175845 wait complete. 2023-08-10T10:50:10.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.528+0000 7f4572cec640 1 Processor -- start 2023-08-10T10:50:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.529+0000 7f4572cec640 1 -- start start 2023-08-10T10:50:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.530+0000 7f4572cec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f456c15cd60 0x7f456c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.530+0000 7f4572cec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.530+0000 7f4572cec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c161180 con 0x7f456c0b8430 2023-08-10T10:50:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.530+0000 7f4572cec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0b5bd0 con 0x7f456c15cd60 2023-08-10T10:50:10.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.530+0000 7f4572cec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c161460 con 0x7f456c0cdf80 2023-08-10T10:50:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f456c15cd60 0x7f456c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f456c15cd60 0x7f456c160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45552/0 (socket says 172.21.15.50:45552) 2023-08-10T10:50:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 -- 172.21.15.50:0/2384172503 learned_addr learned my addr 172.21.15.50:0/2384172503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4571289640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 -- 172.21.15.50:0/2384172503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 msgr2=0x7f456c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:10.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c0d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 -- 172.21.15.50:0/2384172503 >> v1:172.21.15.117:6789/0 conn(0x7f456c0b8430 legacy=0x7f456c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:10.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.531+0000 7f4570a88640 1 -- 172.21.15.50:0/2384172503 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c161740 con 0x7f456c15cd60 2023-08-10T10:50:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.532+0000 7f4570a88640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c160930 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f4560009870 tx=0x7f456002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d622e3a7c0b1544 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f456b7fe640 1 -- 172.21.15.50:0/2384172503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560030840 con 0x7f456c15cd60 2023-08-10T10:50:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f456b7fe640 1 -- 172.21.15.50:0/2384172503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45600309a0 con 0x7f456c15cd60 2023-08-10T10:50:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f456b7fe640 1 -- 172.21.15.50:0/2384172503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560030d30 con 0x7f456c15cd60 2023-08-10T10:50:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 -- 172.21.15.50:0/2384172503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 msgr2=0x7f456c160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c160930 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f4560009870 tx=0x7f456002b980 comp rx=0 tx=0).stop 2023-08-10T10:50:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 -- 172.21.15.50:0/2384172503 shutdown_connections 2023-08-10T10:50:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 --2- 172.21.15.50:0/2384172503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c160930 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 -- 172.21.15.50:0/2384172503 >> 172.21.15.50:0/2384172503 conn(0x7f456c0d2ac0 msgr2=0x7f456c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 -- 172.21.15.50:0/2384172503 shutdown_connections 2023-08-10T10:50:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.533+0000 7f4572cec640 1 -- 172.21.15.50:0/2384172503 wait complete. 2023-08-10T10:50:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.535+0000 7f4572cec640 1 Processor -- start 2023-08-10T10:50:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.535+0000 7f4572cec640 1 -- start start 2023-08-10T10:50:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 0x7f456c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c14bf60 con 0x7f456c15cd60 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c148740 con 0x7f456c0b8430 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.536+0000 7f4572cec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c148a20 con 0x7f456c0cdf80 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45568/0 (socket says 172.21.15.50:45568) 2023-08-10T10:50:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 -- 172.21.15.50:0/1689303378 learned_addr learned my addr 172.21.15.50:0/1689303378 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4570a88640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 0x7f456c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f456bfff640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 -- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 msgr2=0x7f456c1497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c1497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 -- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 msgr2=0x7f456c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 0x7f456c148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4571289640 1 -- 172.21.15.50:0/1689303378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600094d0 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.537+0000 7f4570a88640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 0x7f456c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f4571289640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f456400cd20 tx=0x7f456400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564003b90 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564003cf0 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564004240 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c148d00 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.538+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1492c0 con 0x7f456c15cd60 2023-08-10T10:50:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.539+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c04e270 con 0x7f456c15cd60 2023-08-10T10:50:10.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.540+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45640043a0 con 0x7f456c15cd60 2023-08-10T10:50:10.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.541+0000 7f45697fa640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 0x7f455006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.541+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4564012070 con 0x7f456c15cd60 2023-08-10T10:50:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.542+0000 7f4570a88640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 0x7f455006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.542+0000 7f4570a88640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 0x7f455006d110 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4560036000 tx=0x7f456003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.545+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4564054f10 con 0x7f456c15cd60 2023-08-10T10:50:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.739+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f456c0d3940 con 0x7f456c15cd60 2023-08-10T10:50:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.742+0000 7f45697fa640 1 -- 172.21.15.50:0/1689303378 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f4564058530 con 0x7f456c15cd60 2023-08-10T10:50:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:10.743 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":171,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:50:09.740062+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:10.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.744+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 msgr2=0x7f455006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.744+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 0x7f455006d110 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4560036000 tx=0x7f456003b040 comp rx=0 tx=0).stop 2023-08-10T10:50:10.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.744+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 msgr2=0x7f456c14b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.744+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f456400cd20 tx=0x7f456400a660 comp rx=0 tx=0).stop 2023-08-10T10:50:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 shutdown_connections 2023-08-10T10:50:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c15cd60 0x7f456c14b570 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cdf80 0x7f456c1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f455006ac50 0x7f455006d110 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 --2- 172.21.15.50:0/1689303378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0b8430 0x7f456c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 >> 172.21.15.50:0/1689303378 conn(0x7f456c0d2ac0 msgr2=0x7f456c15be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 shutdown_connections 2023-08-10T10:50:10.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.745+0000 7f4572cec640 1 -- 172.21.15.50:0/1689303378 wait complete. 2023-08-10T10:50:10.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.979+0000 7ff4cf59e640 1 Processor -- start 2023-08-10T10:50:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.980+0000 7ff4cf59e640 1 -- start start 2023-08-10T10:50:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.981+0000 7ff4cf59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d01600f0 0x7ff4d00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.981+0000 7ff4cf59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d01604d0 con 0x7ff4d00b0390 2023-08-10T10:50:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.981+0000 7ff4cf59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00cca30 con 0x7ff4d00aff10 2023-08-10T10:50:10.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.981+0000 7ff4cf59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d00cc100 con 0x7ff4d01600f0 2023-08-10T10:50:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d01600f0 0x7ff4d00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4d01600f0 0x7ff4d00ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45576/0 (socket says 172.21.15.50:45576) 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 -- 172.21.15.50:0/2504783778 learned_addr learned my addr 172.21.15.50:0/2504783778 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 -- 172.21.15.50:0/2504783778 >> v1:172.21.15.117:6789/0 conn(0x7ff4d00aff10 legacy=0x7ff4d00ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 -- 172.21.15.50:0/2504783778 >> v1:172.21.15.50:6789/0 conn(0x7ff4d00b0390 legacy=0x7ff4d00cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.982+0000 7ff4ce59c640 1 -- 172.21.15.50:0/2504783778 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00cc3e0 con 0x7ff4d01600f0 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.983+0000 7ff4ce59c640 1 --2- 172.21.15.50:0/2504783778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d01600f0 0x7ff4d00ac890 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009870 tx=0x7ff4c002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5752c57598f994a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cd59a640 1 -- 172.21.15.50:0/2504783778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0030850 con 0x7ff4d01600f0 2023-08-10T10:50:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cd59a640 1 -- 172.21.15.50:0/2504783778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00309b0 con 0x7ff4d01600f0 2023-08-10T10:50:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cd59a640 1 -- 172.21.15.50:0/2504783778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0030d40 con 0x7ff4d01600f0 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cf59e640 1 -- 172.21.15.50:0/2504783778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d01600f0 msgr2=0x7ff4d00ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/2504783778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d01600f0 0x7ff4d00ac890 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009870 tx=0x7ff4c002b990 comp rx=0 tx=0).stop 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cf59e640 1 -- 172.21.15.50:0/2504783778 shutdown_connections 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/2504783778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d01600f0 0x7ff4d00ac890 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.984+0000 7ff4cf59e640 1 -- 172.21.15.50:0/2504783778 >> 172.21.15.50:0/2504783778 conn(0x7ff4d006ab80 msgr2=0x7ff4d006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.985+0000 7ff4cf59e640 1 -- 172.21.15.50:0/2504783778 shutdown_connections 2023-08-10T10:50:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.985+0000 7ff4cf59e640 1 -- 172.21.15.50:0/2504783778 wait complete. 2023-08-10T10:50:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.986+0000 7ff4cf59e640 1 Processor -- start 2023-08-10T10:50:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.986+0000 7ff4cf59e640 1 -- start start 2023-08-10T10:50:10.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.987+0000 7ff4cf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.987+0000 7ff4cf59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d00b0390 0x7ff4d00b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4cf59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d01600f0 0x7ff4d00c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4cf59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00c5bf0 con 0x7ff4d00aff10 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4cf59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00b4150 con 0x7ff4d00b0390 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4cf59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ca540 con 0x7ff4d01600f0 2023-08-10T10:50:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45582/0 (socket says 172.21.15.50:45582) 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 -- 172.21.15.50:0/56066657 learned_addr learned my addr 172.21.15.50:0/56066657 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4cdd9b640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d00b0390 0x7ff4d00b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ced9d640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d01600f0 0x7ff4d00c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 -- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d01600f0 msgr2=0x7ff4d00c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d01600f0 0x7ff4d00c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 -- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d00b0390 msgr2=0x7ff4d00b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d00b0390 0x7ff4d00b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.988+0000 7ff4ce59c640 1 -- 172.21.15.50:0/56066657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00094d0 con 0x7ff4d00aff10 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4ce59c640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0000c00 tx=0x7ff4c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0030820 con 0x7ff4d00aff10 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0043400 con 0x7ff4d00aff10 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00437d0 con 0x7ff4d00aff10 2023-08-10T10:50:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d00ca820 con 0x7ff4d00aff10 2023-08-10T10:50:10.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.989+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d00cade0 con 0x7ff4d00aff10 2023-08-10T10:50:10.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.990+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d00cc6a0 con 0x7ff4d00aff10 2023-08-10T10:50:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.991+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4c002e070 con 0x7ff4d00aff10 2023-08-10T10:50:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.993+0000 7ff4beffd640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 0x7ff4b006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.993+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4c003e070 con 0x7ff4d00aff10 2023-08-10T10:50:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.993+0000 7ff4cdd9b640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 0x7ff4b006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.994+0000 7ff4cdd9b640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 0x7ff4b006d140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff4d01513e0 tx=0x7ff4c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:10.997+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff4d00cc6a0 con 0x7ff4d00aff10 2023-08-10T10:50:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.190+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d00cc6a0 con 0x7ff4d00aff10 2023-08-10T10:50:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.193+0000 7ff4beffd640 1 -- 172.21.15.50:0/56066657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18304 (secure 0 0 0) 0x7ff4d00cc6a0 con 0x7ff4d00aff10 2023-08-10T10:50:11.194 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:11.194 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":171,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:50:09.740062+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.195+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 msgr2=0x7ff4b006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.195+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 0x7ff4b006d140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff4d01513e0 tx=0x7ff4c4009040 comp rx=0 tx=0).stop 2023-08-10T10:50:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.195+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 msgr2=0x7ff4d00c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.195+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0000c00 tx=0x7ff4c0004730 comp rx=0 tx=0).stop 2023-08-10T10:50:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 shutdown_connections 2023-08-10T10:50:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d01600f0 0x7ff4d00c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff4b006ac80 0x7ff4b006d140 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d00b0390 0x7ff4d00b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 --2- 172.21.15.50:0/56066657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d00aff10 0x7ff4d00c9e80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 >> 172.21.15.50:0/56066657 conn(0x7ff4d006ab80 msgr2=0x7ff4d015e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 shutdown_connections 2023-08-10T10:50:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.196+0000 7ff4cf59e640 1 -- 172.21.15.50:0/56066657 wait complete. 2023-08-10T10:50:11.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:50:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.445+0000 7f6b085cb640 1 Processor -- start 2023-08-10T10:50:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.445+0000 7f6b085cb640 1 -- start start 2023-08-10T10:50:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.446+0000 7f6b085cb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b000cf920 0x7f6b000cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.446+0000 7f6b085cb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 0x7f6b000cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.446+0000 7f6b085cb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b000cfdd0 con 0x7f6b0015ee00 2023-08-10T10:50:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.446+0000 7f6b085cb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b00165020 con 0x7f6b000cf920 2023-08-10T10:50:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.446+0000 7f6b085cb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b00165300 con 0x7f6b00165b00 2023-08-10T10:50:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b06367640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6b0015ee00 0x7f6b000cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36838/0 (socket says 172.21.15.50:36838) 2023-08-10T10:50:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b06367640 1 -- 172.21.15.50:0/3089153556 learned_addr learned my addr 172.21.15.50:0/3089153556 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05b66640 1 --2- 172.21.15.50:0/3089153556 >> v2:172.21.15.50:3300/0 conn(0x7f6b000cf920 0x7f6b000cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05365640 1 -- 172.21.15.50:0/3089153556 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849009683 0 0) 0x7f6b000cfdd0 con 0x7f6b0015ee00 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b06b68640 1 --2- 172.21.15.50:0/3089153556 >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 0x7f6b000cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05365640 1 -- 172.21.15.50:0/3089153556 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec003520 con 0x7f6b0015ee00 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05b66640 1 -- 172.21.15.50:0/3089153556 >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 msgr2=0x7f6b000cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05b66640 1 --2- 172.21.15.50:0/3089153556 >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 0x7f6b000cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05b66640 1 -- 172.21.15.50:0/3089153556 >> v1:172.21.15.50:6789/0 conn(0x7f6b0015ee00 legacy=0x7f6b000cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.447+0000 7f6b05b66640 1 -- 172.21.15.50:0/3089153556 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b001655e0 con 0x7f6b000cf920 2023-08-10T10:50:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.448+0000 7f6b06b68640 1 --2- 172.21.15.50:0/3089153556 >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 0x7f6b000cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.449+0000 7f6b05b66640 1 --2- 172.21.15.50:0/3089153556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b000cf920 0x7f6b000cd140 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b000718a0 tx=0x7f6af002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc0be81bb378ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.449+0000 7f6b05365640 1 -- 172.21.15.50:0/3089153556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af002e070 con 0x7f6b000cf920 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.449+0000 7f6b05365640 1 -- 172.21.15.50:0/3089153556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af00315a0 con 0x7f6b000cf920 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.449+0000 7f6b05365640 1 -- 172.21.15.50:0/3089153556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0031930 con 0x7f6b000cf920 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 -- 172.21.15.50:0/3089153556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b000cf920 msgr2=0x7f6b000cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3089153556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b000cf920 0x7f6b000cd140 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b000718a0 tx=0x7f6af002b840 comp rx=0 tx=0).stop 2023-08-10T10:50:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 -- 172.21.15.50:0/3089153556 shutdown_connections 2023-08-10T10:50:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3089153556 >> v2:172.21.15.117:3300/0 conn(0x7f6b00165b00 0x7f6b000cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3089153556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b000cf920 0x7f6b000cd140 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 -- 172.21.15.50:0/3089153556 >> 172.21.15.50:0/3089153556 conn(0x7f6b0006fcc0 msgr2=0x7f6b000700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 -- 172.21.15.50:0/3089153556 shutdown_connections 2023-08-10T10:50:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.450+0000 7f6b085cb640 1 -- 172.21.15.50:0/3089153556 wait complete. 2023-08-10T10:50:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.451+0000 7f6b085cb640 1 Processor -- start 2023-08-10T10:50:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.452+0000 7f6b085cb640 1 -- start start 2023-08-10T10:50:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 0x7f6b0015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 0x7f6b000cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000cb620 con 0x7f6b00165b00 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0006b900 con 0x7f6b000cf920 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b085cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0006bbe0 con 0x7f6b0015ee00 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45606/0 (socket says 172.21.15.50:45606) 2023-08-10T10:50:11.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 -- 172.21.15.50:0/3082196089 learned_addr learned my addr 172.21.15.50:0/3082196089 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b05b66640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 0x7f6b000cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 -- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 msgr2=0x7f6b000cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06367640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 0x7f6b0015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 0x7f6b000cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 -- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 msgr2=0x7f6b0015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.453+0000 7f6b06b68640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 0x7f6b0015d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b06b68640 1 -- 172.21.15.50:0/3082196089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af0009400 con 0x7f6b00165b00 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b05b66640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 0x7f6b000cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b06367640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 0x7f6b0015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b06b68640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c7c0 tx=0x7f6af800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8004230 con 0x7f6b00165b00 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8004390 con 0x7f6b00165b00 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8007860 con 0x7f6b00165b00 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0006bec0 con 0x7f6b00165b00 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.454+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0015d890 con 0x7f6b00165b00 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.455+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b000cbab0 con 0x7f6b00165b00 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.456+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6af80079c0 con 0x7f6b00165b00 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.457+0000 7f6af6ffd640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 0x7f6ae406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.457+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6af8089840 con 0x7f6b00165b00 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.458+0000 7f6b06367640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 0x7f6ae406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.458+0000 7f6b06367640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 0x7f6ae406d110 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0012e0 tx=0x7f6afc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.461+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b000cbab0 con 0x7f6b00165b00 2023-08-10T10:50:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:11.695+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6b000cbab0 con 0x7f6b00165b00 2023-08-10T10:50:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.652+0000 7f6af6ffd640 1 -- 172.21.15.50:0/3082196089 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6b000cbab0 con 0x7f6b00165b00 2023-08-10T10:50:12.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.656+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 msgr2=0x7f6ae406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.656+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 0x7f6ae406d110 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0012e0 tx=0x7f6afc009040 comp rx=0 tx=0).stop 2023-08-10T10:50:12.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.656+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 msgr2=0x7f6b001f99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c7c0 tx=0x7f6af800cc80 comp rx=0 tx=0).stop 2023-08-10T10:50:12.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 shutdown_connections 2023-08-10T10:50:12.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00165b00 0x7f6b001f99c0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b0015ee00 0x7f6b000cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6ae406ac50 0x7f6ae406d110 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 --2- 172.21.15.50:0/3082196089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b000cf920 0x7f6b0015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 >> 172.21.15.50:0/3082196089 conn(0x7f6b0006fcc0 msgr2=0x7f6b0015f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 shutdown_connections 2023-08-10T10:50:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.657+0000 7f6b085cb640 1 -- 172.21.15.50:0/3082196089 wait complete. 2023-08-10T10:50:12.683 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:50:12.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:50:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.924+0000 7f4a33357640 1 Processor -- start 2023-08-10T10:50:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.925+0000 7f4a33357640 1 -- start start 2023-08-10T10:50:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.926+0000 7f4a33357640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a2c15ae40 0x7f4a2c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.926+0000 7f4a33357640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c06c320 con 0x7f4a2c0cd9b0 2023-08-10T10:50:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.926+0000 7f4a33357640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c06b770 con 0x7f4a2c06cb30 2023-08-10T10:50:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.926+0000 7f4a33357640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c06b9f0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a2c15ae40 0x7f4a2c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a2c15ae40 0x7f4a2c0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45618/0 (socket says 172.21.15.50:45618) 2023-08-10T10:50:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 -- 172.21.15.50:0/1951731024 learned_addr learned my addr 172.21.15.50:0/1951731024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 -- 172.21.15.50:0/1951731024 >> v1:172.21.15.117:6789/0 conn(0x7f4a2c06cb30 legacy=0x7f4a2c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 -- 172.21.15.50:0/1951731024 >> v1:172.21.15.50:6789/0 conn(0x7f4a2c0cd9b0 legacy=0x7f4a2c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.927+0000 7f4a310f3640 1 -- 172.21.15.50:0/1951731024 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c06bcd0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.928+0000 7f4a310f3640 1 --2- 172.21.15.50:0/1951731024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0b1510 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed95f2c068b64ca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a23fff640 1 -- 172.21.15.50:0/1951731024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28030860 con 0x7f4a2c15ae40 2023-08-10T10:50:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a23fff640 1 -- 172.21.15.50:0/1951731024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280309c0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a23fff640 1 -- 172.21.15.50:0/1951731024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28030d50 con 0x7f4a2c15ae40 2023-08-10T10:50:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a33357640 1 -- 172.21.15.50:0/1951731024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 msgr2=0x7f4a2c0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a33357640 1 --2- 172.21.15.50:0/1951731024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0b1510 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2802b9a0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a33357640 1 -- 172.21.15.50:0/1951731024 shutdown_connections 2023-08-10T10:50:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.929+0000 7f4a33357640 1 --2- 172.21.15.50:0/1951731024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0b1510 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.930+0000 7f4a33357640 1 -- 172.21.15.50:0/1951731024 >> 172.21.15.50:0/1951731024 conn(0x7f4a2c0b01b0 msgr2=0x7f4a2c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.930+0000 7f4a33357640 1 -- 172.21.15.50:0/1951731024 shutdown_connections 2023-08-10T10:50:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.930+0000 7f4a33357640 1 -- 172.21.15.50:0/1951731024 wait complete. 2023-08-10T10:50:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.931+0000 7f4a33357640 1 Processor -- start 2023-08-10T10:50:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.932+0000 7f4a33357640 1 -- start start 2023-08-10T10:50:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2c06cb30 0x7f4a2c1edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2c0cd9b0 0x7f4a2c0af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c6810 con 0x7f4a2c15ae40 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15bcf0 con 0x7f4a2c06cb30 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a33357640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15b3c0 con 0x7f4a2c0cd9b0 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45634/0 (socket says 172.21.15.50:45634) 2023-08-10T10:50:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 -- 172.21.15.50:0/1490203760 learned_addr learned my addr 172.21.15.50:0/1490203760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a310f3640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2c06cb30 0x7f4a2c1edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a308f2640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2c0cd9b0 0x7f4a2c0af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 -- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2c0cd9b0 msgr2=0x7f4a2c0af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2c0cd9b0 0x7f4a2c0af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 -- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2c06cb30 msgr2=0x7f4a2c1edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2c06cb30 0x7f4a2c1edb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.933+0000 7f4a318f4640 1 -- 172.21.15.50:0/1490203760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280094d0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a318f4640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c730 tx=0x7f4a2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24003b70 con 0x7f4a2c15ae40 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24003cd0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400aa90 con 0x7f4a2c15ae40 2023-08-10T10:50:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c15b6a0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.934+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c1ee090 con 0x7f4a2c15ae40 2023-08-10T10:50:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.935+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c15be80 con 0x7f4a2c15ae40 2023-08-10T10:50:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.936+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a2400abf0 con 0x7f4a2c15ae40 2023-08-10T10:50:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.937+0000 7f4a21ffb640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 0x7f4a1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.937+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a24089350 con 0x7f4a2c15ae40 2023-08-10T10:50:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.938+0000 7f4a310f3640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 0x7f4a1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.939+0000 7f4a310f3640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 0x7f4a1006d110 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a28036000 tx=0x7f4a2803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:12.942+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4a24054360 con 0x7f4a2c15ae40 2023-08-10T10:50:13.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.170+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a2c0612b0 con 0x7f4a2c15ae40 2023-08-10T10:50:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.655+0000 7f4a21ffb640 1 -- 172.21.15.50:0/1490203760 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a24057980 con 0x7f4a2c15ae40 2023-08-10T10:50:13.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 msgr2=0x7f4a1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 0x7f4a1006d110 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a28036000 tx=0x7f4a2803b040 comp rx=0 tx=0).stop 2023-08-10T10:50:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 msgr2=0x7f4a2c0af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c730 tx=0x7f4a2400cbf0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 shutdown_connections 2023-08-10T10:50:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2c15ae40 0x7f4a2c0af690 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2c0cd9b0 0x7f4a2c0af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a1006ac50 0x7f4a1006d110 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 --2- 172.21.15.50:0/1490203760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2c06cb30 0x7f4a2c1edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.660+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 >> 172.21.15.50:0/1490203760 conn(0x7f4a2c0b01b0 msgr2=0x7f4a2c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.661+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 shutdown_connections 2023-08-10T10:50:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.661+0000 7f4a33357640 1 -- 172.21.15.50:0/1490203760 wait complete. 2023-08-10T10:50:13.682 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:50:13.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.920+0000 7fdb53d42640 1 Processor -- start 2023-08-10T10:50:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.920+0000 7fdb53d42640 1 -- start start 2023-08-10T10:50:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.921+0000 7fdb53d42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 0x7fdb4c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.921+0000 7fdb53d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 0x7fdb4c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.921+0000 7fdb53d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0adfc0 con 0x7fdb4c1612b0 2023-08-10T10:50:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb53d42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c0ce790 con 0x7fdb4c0cae50 2023-08-10T10:50:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb53d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0cd0f0 con 0x7fdb4c0cc100 2023-08-10T10:50:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb51ade640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 0x7fdb4c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb522df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 0x7fdb4c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb51ade640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 0x7fdb4c0ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:42396/0 (socket says 172.21.15.50:42396) 2023-08-10T10:50:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.922+0000 7fdb51ade640 1 -- 172.21.15.50:0/1519273382 learned_addr learned my addr 172.21.15.50:0/1519273382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.923+0000 7fdb522df640 1 -- 172.21.15.50:0/1519273382 >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 msgr2=0x7fdb4c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.923+0000 7fdb522df640 1 --2- 172.21.15.50:0/1519273382 >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 0x7fdb4c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.923+0000 7fdb522df640 1 -- 172.21.15.50:0/1519273382 >> v1:172.21.15.117:6789/0 conn(0x7fdb4c1612b0 legacy=0x7fdb4c0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.923+0000 7fdb522df640 1 -- 172.21.15.50:0/1519273382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c161790 con 0x7fdb4c0cc100 2023-08-10T10:50:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.925+0000 7fdb522df640 1 --2- 172.21.15.50:0/1519273382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 0x7fdb4c0ac890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009d90 tx=0x7fdb4402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab6fa589b03bc09 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.925+0000 7fdb50adc640 1 -- 172.21.15.50:0/1519273382 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4402cc60 con 0x7fdb4c0cc100 2023-08-10T10:50:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.925+0000 7fdb50adc640 1 -- 172.21.15.50:0/1519273382 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4402cdc0 con 0x7fdb4c0cc100 2023-08-10T10:50:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.925+0000 7fdb50adc640 1 -- 172.21.15.50:0/1519273382 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44034660 con 0x7fdb4c0cc100 2023-08-10T10:50:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 -- 172.21.15.50:0/1519273382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 msgr2=0x7fdb4c0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1519273382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 0x7fdb4c0ac890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009d90 tx=0x7fdb4402beb0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 -- 172.21.15.50:0/1519273382 shutdown_connections 2023-08-10T10:50:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1519273382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c0cc100 0x7fdb4c0ac890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1519273382 >> v2:172.21.15.117:3300/0 conn(0x7fdb4c0cae50 0x7fdb4c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 -- 172.21.15.50:0/1519273382 >> 172.21.15.50:0/1519273382 conn(0x7fdb4c0cefe0 msgr2=0x7fdb4c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 -- 172.21.15.50:0/1519273382 shutdown_connections 2023-08-10T10:50:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.926+0000 7fdb53d42640 1 -- 172.21.15.50:0/1519273382 wait complete. 2023-08-10T10:50:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.928+0000 7fdb53d42640 1 Processor -- start 2023-08-10T10:50:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.928+0000 7fdb53d42640 1 -- start start 2023-08-10T10:50:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 0x7fdb4c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c1612b0 0x7fdb4c15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c15dc40 con 0x7fdb4c0cc100 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c15d750 con 0x7fdb4c0cae50 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb53d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c15d960 con 0x7fdb4c1612b0 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb512dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb512dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45642/0 (socket says 172.21.15.50:45642) 2023-08-10T10:50:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.929+0000 7fdb512dd640 1 -- 172.21.15.50:0/1152015002 learned_addr learned my addr 172.21.15.50:0/1152015002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb51ade640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 0x7fdb4c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb522df640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c1612b0 0x7fdb4c15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 -- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c1612b0 msgr2=0x7fdb4c15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c1612b0 0x7fdb4c15fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 -- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 msgr2=0x7fdb4c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 0x7fdb4c1f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 -- 172.21.15.50:0/1152015002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009a70 con 0x7fdb4c0cc100 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb51ade640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 0x7fdb4c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb512dd640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c400 tx=0x7fdb3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0052d0 con 0x7fdb4c0cc100 2023-08-10T10:50:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c005430 con 0x7fdb4c0cc100 2023-08-10T10:50:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003830 con 0x7fdb4c0cc100 2023-08-10T10:50:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.930+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c15f300 con 0x7fdb4c0cc100 2023-08-10T10:50:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.931+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c15f8c0 con 0x7fdb4c0cc100 2023-08-10T10:50:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.932+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c04e270 con 0x7fdb4c0cc100 2023-08-10T10:50:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.933+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb3c003990 con 0x7fdb4c0cc100 2023-08-10T10:50:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.935+0000 7fdb427fc640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 0x7fdb3006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.935+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb3c088ae0 con 0x7fdb4c0cc100 2023-08-10T10:50:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.935+0000 7fdb51ade640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 0x7fdb3006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.936+0000 7fdb51ade640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 0x7fdb3006d110 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009a20 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:13.939+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdb3c053af0 con 0x7fdb4c0cc100 2023-08-10T10:50:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.175+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb4c0c8bd0 con 0x7fdb4c0cc100 2023-08-10T10:50:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.177+0000 7fdb427fc640 1 -- 172.21.15.50:0/1152015002 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fdb3c057110 con 0x7fdb4c0cc100 2023-08-10T10:50:14.178 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:14.178 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:50:14.178 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:50:14.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.179+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 msgr2=0x7fdb3006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.179+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 0x7fdb3006d110 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009a20 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.179+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 msgr2=0x7fdb4c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.179+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c400 tx=0x7fdb3c00c8c0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 shutdown_connections 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb4c1612b0 0x7fdb4c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c0cc100 0x7fdb4c15d210 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdb3006ac50 0x7fdb3006d110 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 --2- 172.21.15.50:0/1152015002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb4c0cae50 0x7fdb4c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 >> 172.21.15.50:0/1152015002 conn(0x7fdb4c0cefe0 msgr2=0x7fdb4c06f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 shutdown_connections 2023-08-10T10:50:14.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.180+0000 7fdb53d42640 1 -- 172.21.15.50:0/1152015002 wait complete. 2023-08-10T10:50:14.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:14.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.421+0000 7f1098206640 1 Processor -- start 2023-08-10T10:50:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.421+0000 7f1098206640 1 -- start start 2023-08-10T10:50:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.422+0000 7f1098206640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f109015ccb0 0x7f10900b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1098206640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 0x7f10900b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1098206640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900719f0 con 0x7f10900c9b30 2023-08-10T10:50:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1098206640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900c8db0 con 0x7f109015ccb0 2023-08-10T10:50:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1098206640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c9050 con 0x7f1090069db0 2023-08-10T10:50:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f10957a1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10900c9b30 0x7f10900696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36860/0 (socket says 172.21.15.50:36860) 2023-08-10T10:50:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f10957a1640 1 -- 172.21.15.50:0/2108499986 learned_addr learned my addr 172.21.15.50:0/2108499986 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f10967a3640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 0x7f10900b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2108499986 >> v2:172.21.15.117:3300/0 conn(0x7f109015ccb0 0x7f10900b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.423+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645169625 0 0) 0x7f10900719f0 con 0x7f10900c9b30 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c003520 con 0x7f10900c9b30 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051303328 0 0) 0x7f107c003520 con 0x7f10900c9b30 2023-08-10T10:50:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 msgr2=0x7f10900b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 0x7f10900b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 >> v2:172.21.15.117:3300/0 conn(0x7f109015ccb0 msgr2=0x7f10900b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 --2- 172.21.15.50:0/2108499986 >> v2:172.21.15.117:3300/0 conn(0x7f109015ccb0 0x7f10900b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900c9330 con 0x7f10900c9b30 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f1080001690 con 0x7f10900c9b30 2023-08-10T10:50:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 >> v1:172.21.15.50:6789/0 conn(0x7f10900c9b30 legacy=0x7f10900696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c003970 0x7f107c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c0047c0 0x7f107c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 0x7f107c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c8db0 con 0x7f107c003970 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c9050 con 0x7f107c0047c0 2023-08-10T10:50:14.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c00b980 con 0x7f1090069db0 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.424+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c003970 0x7f107c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.425+0000 7f1095fa2640 1 -- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 msgr2=0x7f107c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.425+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090069db0 0x7f107c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.425+0000 7f1095fa2640 1 -- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c0047c0 msgr2=0x7f107c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.425+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c0047c0 0x7f107c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.425+0000 7f1095fa2640 1 -- 172.21.15.50:0/2108499986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c003520 con 0x7f107c003970 2023-08-10T10:50:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.426+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c003970 0x7f107c003d90 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f108c009ac0 tx=0x7f107c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6132cc2f1758152 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.426+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c02c710 con 0x7f107c003970 2023-08-10T10:50:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.426+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c02c870 con 0x7f107c003970 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.426+0000 7f1094fa0640 1 -- 172.21.15.50:0/2108499986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c02cc00 con 0x7f107c003970 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 -- 172.21.15.50:0/2108499986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c003970 msgr2=0x7f107c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 --2- 172.21.15.50:0/2108499986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c003970 0x7f107c003d90 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f108c009ac0 tx=0x7f107c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f10967a3640 1 -- 172.21.15.50:0/2108499986 reap_dead start 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 -- 172.21.15.50:0/2108499986 shutdown_connections 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 -- 172.21.15.50:0/2108499986 >> 172.21.15.50:0/2108499986 conn(0x7f109006b590 msgr2=0x7f10900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 -- 172.21.15.50:0/2108499986 shutdown_connections 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.427+0000 7f1098206640 1 -- 172.21.15.50:0/2108499986 wait complete. 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.429+0000 7f1098206640 1 Processor -- start 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.429+0000 7f1098206640 1 -- start start 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c003970 0x7f10901f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090154f00 0x7f10900c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090157370 con 0x7f10900c7c80 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c8650 con 0x7f107c003970 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1098206640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1090156cf0 con 0x7f1090154f00 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f10967a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f10967a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45664/0 (socket says 172.21.15.50:45664) 2023-08-10T10:50:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f10967a3640 1 -- 172.21.15.50:0/2153790997 learned_addr learned my addr 172.21.15.50:0/2153790997 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c003970 0x7f10901f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f10957a1640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090154f00 0x7f10900c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.430+0000 7f10967a3640 1 -- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090154f00 msgr2=0x7f10900c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10967a3640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090154f00 0x7f10900c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10967a3640 1 -- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c003970 msgr2=0x7f10901f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10967a3640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c003970 0x7f10901f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10967a3640 1 -- 172.21.15.50:0/2153790997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900c6b80 con 0x7f10900c7c80 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10967a3640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f10900cb020 tx=0x7f108800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088010040 con 0x7f10900c7c80 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800bae0 con 0x7f10900c7c80 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800be70 con 0x7f10900c7c80 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900c6e60 con 0x7f10900c7c80 2023-08-10T10:50:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.431+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10901f2180 con 0x7f10900c7c80 2023-08-10T10:50:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.432+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10900c7050 con 0x7f10900c7c80 2023-08-10T10:50:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.433+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f108801d400 con 0x7f10900c7c80 2023-08-10T10:50:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.434+0000 7f10867fc640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 0x7f107406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.434+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1088089bc0 con 0x7f10900c7c80 2023-08-10T10:50:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.435+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 0x7f107406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.435+0000 7f1095fa2640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 0x7f107406d110 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f108c036000 tx=0x7f108c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.438+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10880586f0 con 0x7f10900c7c80 2023-08-10T10:50:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.630+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f109004e270 con 0x7f10900c7c80 2023-08-10T10:50:14.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.631+0000 7f10867fc640 1 -- 172.21.15.50:0/2153790997 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f1088058280 con 0x7f10900c7c80 2023-08-10T10:50:14.632 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:14.632 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":172,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:50:11.263005+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:14.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 msgr2=0x7f107406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 0x7f107406d110 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f108c036000 tx=0x7f108c030000 comp rx=0 tx=0).stop 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 msgr2=0x7f10900c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f10900cb020 tx=0x7f108800b480 comp rx=0 tx=0).stop 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 shutdown_connections 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10900c7c80 0x7f10900c8110 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1090154f00 0x7f10900c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f107406ac50 0x7f107406d110 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 --2- 172.21.15.50:0/2153790997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107c003970 0x7f10901f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 >> 172.21.15.50:0/2153790997 conn(0x7f109006b590 msgr2=0x7f109015ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 shutdown_connections 2023-08-10T10:50:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.634+0000 7f1098206640 1 -- 172.21.15.50:0/2153790997 wait complete. 2023-08-10T10:50:14.653 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:50:14.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:50:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.859+0000 7fb307b76640 1 Processor -- start 2023-08-10T10:50:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.859+0000 7fb307b76640 1 -- start start 2023-08-10T10:50:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb307b76640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3000afc20 0x7fb30015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb307b76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000cb580 0x7fb3000cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb307b76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000b0000 con 0x7fb3000cb9c0 2023-08-10T10:50:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb307b76640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cbe60 con 0x7fb3000afc20 2023-08-10T10:50:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb307b76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000cc140 con 0x7fb3000cb580 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb305912640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3000afc20 0x7fb30015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb305912640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3000afc20 0x7fb30015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45676/0 (socket says 172.21.15.50:45676) 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.861+0000 7fb305912640 1 -- 172.21.15.50:0/587134142 learned_addr learned my addr 172.21.15.50:0/587134142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.862+0000 7fb305912640 1 -- 172.21.15.50:0/587134142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000cb580 msgr2=0x7fb3000cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.862+0000 7fb305912640 1 --2- 172.21.15.50:0/587134142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000cb580 0x7fb3000cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.862+0000 7fb305912640 1 -- 172.21.15.50:0/587134142 >> v1:172.21.15.50:6789/0 conn(0x7fb3000cb9c0 legacy=0x7fb30015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.862+0000 7fb305912640 1 -- 172.21.15.50:0/587134142 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000cc420 con 0x7fb3000afc20 2023-08-10T10:50:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.862+0000 7fb304910640 1 -- 172.21.15.50:0/587134142 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484097438 0 0) 0x7fb3000b0000 con 0x7fb3000cb9c0 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb305912640 1 --2- 172.21.15.50:0/587134142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000afc20 0x7fb30015f370 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009850 tx=0x7fb2fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240b02470d59a5cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb304910640 1 -- 172.21.15.50:0/587134142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc004230 con 0x7fb3000afc20 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb304910640 1 -- 172.21.15.50:0/587134142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc004390 con 0x7fb3000afc20 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb304910640 1 -- 172.21.15.50:0/587134142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc003810 con 0x7fb3000afc20 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb307b76640 1 -- 172.21.15.50:0/587134142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000afc20 msgr2=0x7fb30015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.863+0000 7fb307b76640 1 --2- 172.21.15.50:0/587134142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000afc20 0x7fb30015f370 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009850 tx=0x7fb2fc02b960 comp rx=0 tx=0).stop 2023-08-10T10:50:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 -- 172.21.15.50:0/587134142 shutdown_connections 2023-08-10T10:50:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 --2- 172.21.15.50:0/587134142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000cb580 0x7fb3000cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 --2- 172.21.15.50:0/587134142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000afc20 0x7fb30015f370 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 -- 172.21.15.50:0/587134142 >> 172.21.15.50:0/587134142 conn(0x7fb3000d0930 msgr2=0x7fb3000d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 -- 172.21.15.50:0/587134142 shutdown_connections 2023-08-10T10:50:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.864+0000 7fb307b76640 1 -- 172.21.15.50:0/587134142 wait complete. 2023-08-10T10:50:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.865+0000 7fb307b76640 1 Processor -- start 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 -- start start 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000afc20 0x7fb3001f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3000cb580 0x7fb30014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c55f0 con 0x7fb3000cb9c0 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001f3100 con 0x7fb3000cb580 2023-08-10T10:50:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.866+0000 7fb307b76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c4970 con 0x7fb3000afc20 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45692/0 (socket says 172.21.15.50:45692) 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 -- 172.21.15.50:0/1583052986 learned_addr learned my addr 172.21.15.50:0/1583052986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb305912640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000afc20 0x7fb3001f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb305111640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3000cb580 0x7fb30014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 -- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000afc20 msgr2=0x7fb3001f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000afc20 0x7fb3001f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 -- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3000cb580 msgr2=0x7fb30014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3000cb580 0x7fb30014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.867+0000 7fb306113640 1 -- 172.21.15.50:0/1583052986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009460 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb306113640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c780 tx=0x7fb2f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8003da0 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800ce30 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8005270 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000c4c50 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.868+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c5210 con 0x7fb3000cb9c0 2023-08-10T10:50:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.869+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30004e270 con 0x7fb3000cb9c0 2023-08-10T10:50:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.870+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2f80053d0 con 0x7fb3000cb9c0 2023-08-10T10:50:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.871+0000 7fb2f67fc640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 0x7fb2e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.871+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2f8088d80 con 0x7fb3000cb9c0 2023-08-10T10:50:14.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.871+0000 7fb305912640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 0x7fb2e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.872+0000 7fb305912640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 0x7fb2e406d110 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc035000 tx=0x7fb2fc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:14.875+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb2f8053d90 con 0x7fb3000cb9c0 2023-08-10T10:50:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.065+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3000cc700 con 0x7fb2e406ac50 2023-08-10T10:50:15.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.076+0000 7fb2f67fc640 1 -- 172.21.15.50:0/1583052986 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302945 (secure 0 0 0) 0x7fb2fc03e040 con 0x7fb2e406ac50 2023-08-10T10:50:15.080 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:15.081 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 msgr2=0x7fb2e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 0x7fb2e406d110 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc035000 tx=0x7fb2fc008030 comp rx=0 tx=0).stop 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 msgr2=0x7fb3000c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c780 tx=0x7fb2f800cc40 comp rx=0 tx=0).stop 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 shutdown_connections 2023-08-10T10:50:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3000cb9c0 0x7fb3000c5ea0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb2e406ac50 0x7fb2e406d110 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3000cb580 0x7fb30014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 --2- 172.21.15.50:0/1583052986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3000afc20 0x7fb3001f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 >> 172.21.15.50:0/1583052986 conn(0x7fb3000d0930 msgr2=0x7fb3000c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.081+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 shutdown_connections 2023-08-10T10:50:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.082+0000 7fb307b76640 1 -- 172.21.15.50:0/1583052986 wait complete. 2023-08-10T10:50:15.101 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":527,"stamp":"2023-08-10T10:50:14.572199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553296,"statfs":{"total":1600000000,"available":1590575746,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002254"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271379+0000","last_change":"2023-08-10T10:50:10.291593+0000","last_active":"2023-08-10T10:50:11.271379+0000","last_peered":"2023-08-10T10:50:11.271379+0000","last_clean":"2023-08-10T10:50:11.271379+0000","last_became_active":"2023-08-10T10:50:10.290710+0000","last_became_peered":"2023-08-10T10:50:10.290710+0000","last_unstale":"2023-08-10T10:50:11.271379+0000","last_undegraded":"2023-08-10T10:50:11.271379+0000","last_fullsized":"2023-08-10T10:50:11.271379+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:33:27.052191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360545+0000","last_change":"2023-08-10T10:50:10.293331+0000","last_active":"2023-08-10T10:50:11.360545+0000","last_peered":"2023-08-10T10:50:11.360545+0000","last_clean":"2023-08-10T10:50:11.360545+0000","last_became_active":"2023-08-10T10:50:10.291933+0000","last_became_peered":"2023-08-10T10:50:10.291933+0000","last_unstale":"2023-08-10T10:50:11.360545+0000","last_undegraded":"2023-08-10T10:50:11.360545+0000","last_fullsized":"2023-08-10T10:50:11.360545+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:53.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361431+0000","last_change":"2023-08-10T10:50:10.293787+0000","last_active":"2023-08-10T10:50:11.361431+0000","last_peered":"2023-08-10T10:50:11.361431+0000","last_clean":"2023-08-10T10:50:11.361431+0000","last_became_active":"2023-08-10T10:50:10.293475+0000","last_became_peered":"2023-08-10T10:50:10.293475+0000","last_unstale":"2023-08-10T10:50:11.361431+0000","last_undegraded":"2023-08-10T10:50:11.361431+0000","last_fullsized":"2023-08-10T10:50:11.361431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:45.444769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362174+0000","last_change":"2023-08-10T10:50:10.302858+0000","last_active":"2023-08-10T10:50:11.362174+0000","last_peered":"2023-08-10T10:50:11.362174+0000","last_clean":"2023-08-10T10:50:11.362174+0000","last_became_active":"2023-08-10T10:50:10.298593+0000","last_became_peered":"2023-08-10T10:50:10.298593+0000","last_unstale":"2023-08-10T10:50:11.362174+0000","last_undegraded":"2023-08-10T10:50:11.362174+0000","last_fullsized":"2023-08-10T10:50:11.362174+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:20:46.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268845+0000","last_change":"2023-08-10T10:50:10.278610+0000","last_active":"2023-08-10T10:50:11.268845+0000","last_peered":"2023-08-10T10:50:11.268845+0000","last_clean":"2023-08-10T10:50:11.268845+0000","last_became_active":"2023-08-10T10:50:10.276731+0000","last_became_peered":"2023-08-10T10:50:10.276731+0000","last_unstale":"2023-08-10T10:50:11.268845+0000","last_undegraded":"2023-08-10T10:50:11.268845+0000","last_fullsized":"2023-08-10T10:50:11.268845+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:06.417467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268529+0000","last_change":"2023-08-10T10:50:10.273669+0000","last_active":"2023-08-10T10:50:11.268529+0000","last_peered":"2023-08-10T10:50:11.268529+0000","last_clean":"2023-08-10T10:50:11.268529+0000","last_became_active":"2023-08-10T10:50:10.272997+0000","last_became_peered":"2023-08-10T10:50:10.272997+0000","last_unstale":"2023-08-10T10:50:11.268529+0000","last_undegraded":"2023-08-10T10:50:11.268529+0000","last_fullsized":"2023-08-10T10:50:11.268529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:33.469727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271006+0000","last_change":"2023-08-10T10:50:10.297943+0000","last_active":"2023-08-10T10:50:11.271006+0000","last_peered":"2023-08-10T10:50:11.271006+0000","last_clean":"2023-08-10T10:50:11.271006+0000","last_became_active":"2023-08-10T10:50:10.297529+0000","last_became_peered":"2023-08-10T10:50:10.297529+0000","last_unstale":"2023-08-10T10:50:11.271006+0000","last_undegraded":"2023-08-10T10:50:11.271006+0000","last_fullsized":"2023-08-10T10:50:11.271006+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:00.471693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272521+0000","last_change":"2023-08-10T10:50:10.293431+0000","last_active":"2023-08-10T10:50:11.272521+0000","last_peered":"2023-08-10T10:50:11.272521+0000","last_clean":"2023-08-10T10:50:11.272521+0000","last_became_active":"2023-08-10T10:50:10.293094+0000","last_became_peered":"2023-08-10T10:50:10.293094+0000","last_unstale":"2023-08-10T10:50:11.272521+0000","last_undegraded":"2023-08-10T10:50:11.272521+0000","last_fullsized":"2023-08-10T10:50:11.272521+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:47:47.990803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268611+0000","last_change":"2023-08-10T10:50:10.298305+0000","last_active":"2023-08-10T10:50:11.268611+0000","last_peered":"2023-08-10T10:50:11.268611+0000","last_clean":"2023-08-10T10:50:11.268611+0000","last_became_active":"2023-08-10T10:50:10.298043+0000","last_became_peered":"2023-08-10T10:50:10.298043+0000","last_unstale":"2023-08-10T10:50:11.268611+0000","last_undegraded":"2023-08-10T10:50:11.268611+0000","last_fullsized":"2023-08-10T10:50:11.268611+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:01.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268923+0000","last_change":"2023-08-10T10:50:10.277380+0000","last_active":"2023-08-10T10:50:11.268923+0000","last_peered":"2023-08-10T10:50:11.268923+0000","last_clean":"2023-08-10T10:50:11.268923+0000","last_became_active":"2023-08-10T10:50:10.274614+0000","last_became_peered":"2023-08-10T10:50:10.274614+0000","last_unstale":"2023-08-10T10:50:11.268923+0000","last_undegraded":"2023-08-10T10:50:11.268923+0000","last_fullsized":"2023-08-10T10:50:11.268923+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:47.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362173+0000","last_change":"2023-08-10T10:50:10.295189+0000","last_active":"2023-08-10T10:50:11.362173+0000","last_peered":"2023-08-10T10:50:11.362173+0000","last_clean":"2023-08-10T10:50:11.362173+0000","last_became_active":"2023-08-10T10:50:10.294815+0000","last_became_peered":"2023-08-10T10:50:10.294815+0000","last_unstale":"2023-08-10T10:50:11.362173+0000","last_undegraded":"2023-08-10T10:50:11.362173+0000","last_fullsized":"2023-08-10T10:50:11.362173+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:08.891493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362119+0000","last_change":"2023-08-10T10:50:10.302807+0000","last_active":"2023-08-10T10:50:11.362119+0000","last_peered":"2023-08-10T10:50:11.362119+0000","last_clean":"2023-08-10T10:50:11.362119+0000","last_became_active":"2023-08-10T10:50:10.300269+0000","last_became_peered":"2023-08-10T10:50:10.300269+0000","last_unstale":"2023-08-10T10:50:11.362119+0000","last_undegraded":"2023-08-10T10:50:11.362119+0000","last_fullsized":"2023-08-10T10:50:11.362119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:33.469727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268336+0000","last_change":"2023-08-10T10:50:10.275221+0000","last_active":"2023-08-10T10:50:11.268336+0000","last_peered":"2023-08-10T10:50:11.268336+0000","last_clean":"2023-08-10T10:50:11.268336+0000","last_became_active":"2023-08-10T10:50:10.274484+0000","last_became_peered":"2023-08-10T10:50:10.274484+0000","last_unstale":"2023-08-10T10:50:11.268336+0000","last_undegraded":"2023-08-10T10:50:11.268336+0000","last_fullsized":"2023-08-10T10:50:11.268336+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:50:09.853488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362620+0000","last_change":"2023-08-10T10:50:10.302241+0000","last_active":"2023-08-10T10:50:11.362620+0000","last_peered":"2023-08-10T10:50:11.362620+0000","last_clean":"2023-08-10T10:50:11.362620+0000","last_became_active":"2023-08-10T10:50:10.295989+0000","last_became_peered":"2023-08-10T10:50:10.295989+0000","last_unstale":"2023-08-10T10:50:11.362620+0000","last_undegraded":"2023-08-10T10:50:11.362620+0000","last_fullsized":"2023-08-10T10:50:11.362620+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:32.145208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361614+0000","last_change":"2023-08-10T10:50:10.289588+0000","last_active":"2023-08-10T10:50:11.361614+0000","last_peered":"2023-08-10T10:50:11.361614+0000","last_clean":"2023-08-10T10:50:11.361614+0000","last_became_active":"2023-08-10T10:50:10.288669+0000","last_became_peered":"2023-08-10T10:50:10.288669+0000","last_unstale":"2023-08-10T10:50:11.361614+0000","last_undegraded":"2023-08-10T10:50:11.361614+0000","last_fullsized":"2023-08-10T10:50:11.361614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:45.397167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268860+0000","last_change":"2023-08-10T10:50:10.294797+0000","last_active":"2023-08-10T10:50:11.268860+0000","last_peered":"2023-08-10T10:50:11.268860+0000","last_clean":"2023-08-10T10:50:11.268860+0000","last_became_active":"2023-08-10T10:50:10.293889+0000","last_became_peered":"2023-08-10T10:50:10.293889+0000","last_unstale":"2023-08-10T10:50:11.268860+0000","last_undegraded":"2023-08-10T10:50:11.268860+0000","last_fullsized":"2023-08-10T10:50:11.268860+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:21.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363687+0000","last_change":"2023-08-10T10:50:10.290257+0000","last_active":"2023-08-10T10:50:11.363687+0000","last_peered":"2023-08-10T10:50:11.363687+0000","last_clean":"2023-08-10T10:50:11.363687+0000","last_became_active":"2023-08-10T10:50:10.289251+0000","last_became_peered":"2023-08-10T10:50:10.289251+0000","last_unstale":"2023-08-10T10:50:11.363687+0000","last_undegraded":"2023-08-10T10:50:11.363687+0000","last_fullsized":"2023-08-10T10:50:11.363687+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:12:12.534474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363195+0000","last_change":"2023-08-10T10:50:10.298806+0000","last_active":"2023-08-10T10:50:11.363195+0000","last_peered":"2023-08-10T10:50:11.363195+0000","last_clean":"2023-08-10T10:50:11.363195+0000","last_became_active":"2023-08-10T10:50:10.298554+0000","last_became_peered":"2023-08-10T10:50:10.298554+0000","last_unstale":"2023-08-10T10:50:11.363195+0000","last_undegraded":"2023-08-10T10:50:11.363195+0000","last_fullsized":"2023-08-10T10:50:11.363195+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:38.216056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362770+0000","last_change":"2023-08-10T10:50:10.305524+0000","last_active":"2023-08-10T10:50:11.362770+0000","last_peered":"2023-08-10T10:50:11.362770+0000","last_clean":"2023-08-10T10:50:11.362770+0000","last_became_active":"2023-08-10T10:50:10.305224+0000","last_became_peered":"2023-08-10T10:50:10.305224+0000","last_unstale":"2023-08-10T10:50:11.362770+0000","last_undegraded":"2023-08-10T10:50:11.362770+0000","last_fullsized":"2023-08-10T10:50:11.362770+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:12.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364448+0000","last_change":"2023-08-10T10:50:10.289017+0000","last_active":"2023-08-10T10:50:11.364448+0000","last_peered":"2023-08-10T10:50:11.364448+0000","last_clean":"2023-08-10T10:50:11.364448+0000","last_became_active":"2023-08-10T10:50:10.287979+0000","last_became_peered":"2023-08-10T10:50:10.287979+0000","last_unstale":"2023-08-10T10:50:11.364448+0000","last_undegraded":"2023-08-10T10:50:11.364448+0000","last_fullsized":"2023-08-10T10:50:11.364448+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:31:18.098882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269062+0000","last_change":"2023-08-10T10:50:10.294260+0000","last_active":"2023-08-10T10:50:11.269062+0000","last_peered":"2023-08-10T10:50:11.269062+0000","last_clean":"2023-08-10T10:50:11.269062+0000","last_became_active":"2023-08-10T10:50:10.292820+0000","last_became_peered":"2023-08-10T10:50:10.292820+0000","last_unstale":"2023-08-10T10:50:11.269062+0000","last_undegraded":"2023-08-10T10:50:11.269062+0000","last_fullsized":"2023-08-10T10:50:11.269062+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:45:40.427391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271327+0000","last_change":"2023-08-10T10:50:10.297783+0000","last_active":"2023-08-10T10:50:11.271327+0000","last_peered":"2023-08-10T10:50:11.271327+0000","last_clean":"2023-08-10T10:50:11.271327+0000","last_became_active":"2023-08-10T10:50:10.297103+0000","last_became_peered":"2023-08-10T10:50:10.297103+0000","last_unstale":"2023-08-10T10:50:11.271327+0000","last_undegraded":"2023-08-10T10:50:11.271327+0000","last_fullsized":"2023-08-10T10:50:11.271327+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:41.726201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272889+0000","last_change":"2023-08-10T10:50:10.299965+0000","last_active":"2023-08-10T10:50:11.272889+0000","last_peered":"2023-08-10T10:50:11.272889+0000","last_clean":"2023-08-10T10:50:11.272889+0000","last_became_active":"2023-08-10T10:50:10.299553+0000","last_became_peered":"2023-08-10T10:50:10.299553+0000","last_unstale":"2023-08-10T10:50:11.272889+0000","last_undegraded":"2023-08-10T10:50:11.272889+0000","last_fullsized":"2023-08-10T10:50:11.272889+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:49.701410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362023+0000","last_change":"2023-08-10T10:50:10.290053+0000","last_active":"2023-08-10T10:50:11.362023+0000","last_peered":"2023-08-10T10:50:11.362023+0000","last_clean":"2023-08-10T10:50:11.362023+0000","last_became_active":"2023-08-10T10:50:10.289541+0000","last_became_peered":"2023-08-10T10:50:10.289541+0000","last_unstale":"2023-08-10T10:50:11.362023+0000","last_undegraded":"2023-08-10T10:50:11.362023+0000","last_fullsized":"2023-08-10T10:50:11.362023+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:13.333619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272454+0000","last_change":"2023-08-10T10:50:10.275743+0000","last_active":"2023-08-10T10:50:11.272454+0000","last_peered":"2023-08-10T10:50:11.272454+0000","last_clean":"2023-08-10T10:50:11.272454+0000","last_became_active":"2023-08-10T10:50:10.274401+0000","last_became_peered":"2023-08-10T10:50:10.274401+0000","last_unstale":"2023-08-10T10:50:11.272454+0000","last_undegraded":"2023-08-10T10:50:11.272454+0000","last_fullsized":"2023-08-10T10:50:11.272454+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:53.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271713+0000","last_change":"2023-08-10T10:50:10.291278+0000","last_active":"2023-08-10T10:50:11.271713+0000","last_peered":"2023-08-10T10:50:11.271713+0000","last_clean":"2023-08-10T10:50:11.271713+0000","last_became_active":"2023-08-10T10:50:10.290051+0000","last_became_peered":"2023-08-10T10:50:10.290051+0000","last_unstale":"2023-08-10T10:50:11.271713+0000","last_undegraded":"2023-08-10T10:50:11.271713+0000","last_fullsized":"2023-08-10T10:50:11.271713+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:10:25.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268595+0000","last_change":"2023-08-10T10:50:10.289979+0000","last_active":"2023-08-10T10:50:11.268595+0000","last_peered":"2023-08-10T10:50:11.268595+0000","last_clean":"2023-08-10T10:50:11.268595+0000","last_became_active":"2023-08-10T10:50:10.288829+0000","last_became_peered":"2023-08-10T10:50:10.288829+0000","last_unstale":"2023-08-10T10:50:11.268595+0000","last_undegraded":"2023-08-10T10:50:11.268595+0000","last_fullsized":"2023-08-10T10:50:11.268595+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:20:46.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363539+0000","last_change":"2023-08-10T10:50:10.294581+0000","last_active":"2023-08-10T10:50:11.363539+0000","last_peered":"2023-08-10T10:50:11.363539+0000","last_clean":"2023-08-10T10:50:11.363539+0000","last_became_active":"2023-08-10T10:50:10.292458+0000","last_became_peered":"2023-08-10T10:50:10.292458+0000","last_unstale":"2023-08-10T10:50:11.363539+0000","last_undegraded":"2023-08-10T10:50:11.363539+0000","last_fullsized":"2023-08-10T10:50:11.363539+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:44.680492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274448+0000","last_change":"2023-08-10T10:50:10.304525+0000","last_active":"2023-08-10T10:50:11.274448+0000","last_peered":"2023-08-10T10:50:11.274448+0000","last_clean":"2023-08-10T10:50:11.274448+0000","last_became_active":"2023-08-10T10:50:10.301244+0000","last_became_peered":"2023-08-10T10:50:10.301244+0000","last_unstale":"2023-08-10T10:50:11.274448+0000","last_undegraded":"2023-08-10T10:50:11.274448+0000","last_fullsized":"2023-08-10T10:50:11.274448+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:19:47.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362461+0000","last_change":"2023-08-10T10:50:10.297263+0000","last_active":"2023-08-10T10:50:11.362461+0000","last_peered":"2023-08-10T10:50:11.362461+0000","last_clean":"2023-08-10T10:50:11.362461+0000","last_became_active":"2023-08-10T10:50:10.297004+0000","last_became_peered":"2023-08-10T10:50:10.297004+0000","last_unstale":"2023-08-10T10:50:11.362461+0000","last_undegraded":"2023-08-10T10:50:11.362461+0000","last_fullsized":"2023-08-10T10:50:11.362461+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:06.732272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269237+0000","last_change":"2023-08-10T10:50:10.294596+0000","last_active":"2023-08-10T10:50:11.269237+0000","last_peered":"2023-08-10T10:50:11.269237+0000","last_clean":"2023-08-10T10:50:11.269237+0000","last_became_active":"2023-08-10T10:50:10.293528+0000","last_became_peered":"2023-08-10T10:50:10.293528+0000","last_unstale":"2023-08-10T10:50:11.269237+0000","last_undegraded":"2023-08-10T10:50:11.269237+0000","last_fullsized":"2023-08-10T10:50:11.269237+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:42:44.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273763+0000","last_change":"2023-08-10T10:50:10.294209+0000","last_active":"2023-08-10T10:50:11.273763+0000","last_peered":"2023-08-10T10:50:11.273763+0000","last_clean":"2023-08-10T10:50:11.273763+0000","last_became_active":"2023-08-10T10:50:10.293667+0000","last_became_peered":"2023-08-10T10:50:10.293667+0000","last_unstale":"2023-08-10T10:50:11.273763+0000","last_undegraded":"2023-08-10T10:50:11.273763+0000","last_fullsized":"2023-08-10T10:50:11.273763+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:38.880985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361161+0000","last_change":"2023-08-10T10:50:10.293778+0000","last_active":"2023-08-10T10:50:11.361161+0000","last_peered":"2023-08-10T10:50:11.361161+0000","last_clean":"2023-08-10T10:50:11.361161+0000","last_became_active":"2023-08-10T10:50:10.293447+0000","last_became_peered":"2023-08-10T10:50:10.293447+0000","last_unstale":"2023-08-10T10:50:11.361161+0000","last_undegraded":"2023-08-10T10:50:11.361161+0000","last_fullsized":"2023-08-10T10:50:11.361161+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:32.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268636+0000","last_change":"2023-08-10T10:50:09.243332+0000","last_active":"2023-08-10T10:50:11.268636+0000","last_peered":"2023-08-10T10:50:11.268636+0000","last_clean":"2023-08-10T10:50:11.268636+0000","last_became_active":"2023-08-10T10:50:09.242922+0000","last_became_peered":"2023-08-10T10:50:09.242922+0000","last_unstale":"2023-08-10T10:50:11.268636+0000","last_undegraded":"2023-08-10T10:50:11.268636+0000","last_fullsized":"2023-08-10T10:50:11.268636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:31.129377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361752+0000","last_change":"2023-08-10T10:50:10.291578+0000","last_active":"2023-08-10T10:50:11.361752+0000","last_peered":"2023-08-10T10:50:11.361752+0000","last_clean":"2023-08-10T10:50:11.361752+0000","last_became_active":"2023-08-10T10:50:10.291200+0000","last_became_peered":"2023-08-10T10:50:10.291200+0000","last_unstale":"2023-08-10T10:50:11.361752+0000","last_undegraded":"2023-08-10T10:50:11.361752+0000","last_fullsized":"2023-08-10T10:50:11.361752+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:31:31.562172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361796+0000","last_change":"2023-08-10T10:50:09.254835+0000","last_active":"2023-08-10T10:50:11.361796+0000","last_peered":"2023-08-10T10:50:11.361796+0000","last_clean":"2023-08-10T10:50:11.361796+0000","last_became_active":"2023-08-10T10:50:09.253560+0000","last_became_peered":"2023-08-10T10:50:09.253560+0000","last_unstale":"2023-08-10T10:50:11.361796+0000","last_undegraded":"2023-08-10T10:50:11.361796+0000","last_fullsized":"2023-08-10T10:50:11.361796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:12.287107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274778+0000","last_change":"2023-08-10T10:50:10.305059+0000","last_active":"2023-08-10T10:50:11.274778+0000","last_peered":"2023-08-10T10:50:11.274778+0000","last_clean":"2023-08-10T10:50:11.274778+0000","last_became_active":"2023-08-10T10:50:10.304122+0000","last_became_peered":"2023-08-10T10:50:10.304122+0000","last_unstale":"2023-08-10T10:50:11.274778+0000","last_undegraded":"2023-08-10T10:50:11.274778+0000","last_fullsized":"2023-08-10T10:50:11.274778+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:36.963127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363134+0000","last_change":"2023-08-10T10:50:09.253782+0000","last_active":"2023-08-10T10:50:11.363134+0000","last_peered":"2023-08-10T10:50:11.363134+0000","last_clean":"2023-08-10T10:50:11.363134+0000","last_became_active":"2023-08-10T10:50:09.253461+0000","last_became_peered":"2023-08-10T10:50:09.253461+0000","last_unstale":"2023-08-10T10:50:11.363134+0000","last_undegraded":"2023-08-10T10:50:11.363134+0000","last_fullsized":"2023-08-10T10:50:11.363134+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:27:16.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363083+0000","last_change":"2023-08-10T10:50:10.300508+0000","last_active":"2023-08-10T10:50:11.363083+0000","last_peered":"2023-08-10T10:50:11.363083+0000","last_clean":"2023-08-10T10:50:11.363083+0000","last_became_active":"2023-08-10T10:50:10.300170+0000","last_became_peered":"2023-08-10T10:50:10.300170+0000","last_unstale":"2023-08-10T10:50:11.363083+0000","last_undegraded":"2023-08-10T10:50:11.363083+0000","last_fullsized":"2023-08-10T10:50:11.363083+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:37:04.910356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361261+0000","last_change":"2023-08-10T10:50:09.251627+0000","last_active":"2023-08-10T10:50:11.361261+0000","last_peered":"2023-08-10T10:50:11.361261+0000","last_clean":"2023-08-10T10:50:11.361261+0000","last_became_active":"2023-08-10T10:50:09.250795+0000","last_became_peered":"2023-08-10T10:50:09.250795+0000","last_unstale":"2023-08-10T10:50:11.361261+0000","last_undegraded":"2023-08-10T10:50:11.361261+0000","last_fullsized":"2023-08-10T10:50:11.361261+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:40.594831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363347+0000","last_change":"2023-08-10T10:50:10.289241+0000","last_active":"2023-08-10T10:50:11.363347+0000","last_peered":"2023-08-10T10:50:11.363347+0000","last_clean":"2023-08-10T10:50:11.363347+0000","last_became_active":"2023-08-10T10:50:10.288642+0000","last_became_peered":"2023-08-10T10:50:10.288642+0000","last_unstale":"2023-08-10T10:50:11.363347+0000","last_undegraded":"2023-08-10T10:50:11.363347+0000","last_fullsized":"2023-08-10T10:50:11.363347+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:32:46.214716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274013+0000","last_change":"2023-08-10T10:50:09.252421+0000","last_active":"2023-08-10T10:50:11.274013+0000","last_peered":"2023-08-10T10:50:11.274013+0000","last_clean":"2023-08-10T10:50:11.274013+0000","last_became_active":"2023-08-10T10:50:09.251762+0000","last_became_peered":"2023-08-10T10:50:09.251762+0000","last_unstale":"2023-08-10T10:50:11.274013+0000","last_undegraded":"2023-08-10T10:50:11.274013+0000","last_fullsized":"2023-08-10T10:50:11.274013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:59:42.404075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363018+0000","last_change":"2023-08-10T10:50:10.300111+0000","last_active":"2023-08-10T10:50:11.363018+0000","last_peered":"2023-08-10T10:50:11.363018+0000","last_clean":"2023-08-10T10:50:11.363018+0000","last_became_active":"2023-08-10T10:50:10.290463+0000","last_became_peered":"2023-08-10T10:50:10.290463+0000","last_unstale":"2023-08-10T10:50:11.363018+0000","last_undegraded":"2023-08-10T10:50:11.363018+0000","last_fullsized":"2023-08-10T10:50:11.363018+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:06.417467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268881+0000","last_change":"2023-08-10T10:50:09.255772+0000","last_active":"2023-08-10T10:50:11.268881+0000","last_peered":"2023-08-10T10:50:11.268881+0000","last_clean":"2023-08-10T10:50:11.268881+0000","last_became_active":"2023-08-10T10:50:09.255205+0000","last_became_peered":"2023-08-10T10:50:09.255205+0000","last_unstale":"2023-08-10T10:50:11.268881+0000","last_undegraded":"2023-08-10T10:50:11.268881+0000","last_fullsized":"2023-08-10T10:50:11.268881+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:12:11.518643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360684+0000","last_change":"2023-08-10T10:50:10.292373+0000","last_active":"2023-08-10T10:50:11.360684+0000","last_peered":"2023-08-10T10:50:11.360684+0000","last_clean":"2023-08-10T10:50:11.360684+0000","last_became_active":"2023-08-10T10:50:10.291877+0000","last_became_peered":"2023-08-10T10:50:10.291877+0000","last_unstale":"2023-08-10T10:50:11.360684+0000","last_undegraded":"2023-08-10T10:50:11.360684+0000","last_fullsized":"2023-08-10T10:50:11.360684+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.600152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.270346+0000","last_change":"2023-08-10T10:50:09.247282+0000","last_active":"2023-08-10T10:50:11.270346+0000","last_peered":"2023-08-10T10:50:11.270346+0000","last_clean":"2023-08-10T10:50:11.270346+0000","last_became_active":"2023-08-10T10:50:09.246903+0000","last_became_peered":"2023-08-10T10:50:09.246903+0000","last_unstale":"2023-08-10T10:50:11.270346+0000","last_undegraded":"2023-08-10T10:50:11.270346+0000","last_fullsized":"2023-08-10T10:50:11.270346+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:06.370504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272142+0000","last_change":"2023-08-10T10:50:10.293955+0000","last_active":"2023-08-10T10:50:11.272142+0000","last_peered":"2023-08-10T10:50:11.272142+0000","last_clean":"2023-08-10T10:50:11.272142+0000","last_became_active":"2023-08-10T10:50:10.293554+0000","last_became_peered":"2023-08-10T10:50:10.293554+0000","last_unstale":"2023-08-10T10:50:11.272142+0000","last_undegraded":"2023-08-10T10:50:11.272142+0000","last_fullsized":"2023-08-10T10:50:11.272142+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:00.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268708+0000","last_change":"2023-08-10T10:50:09.258264+0000","last_active":"2023-08-10T10:50:11.268708+0000","last_peered":"2023-08-10T10:50:11.268708+0000","last_clean":"2023-08-10T10:50:11.268708+0000","last_became_active":"2023-08-10T10:50:09.257293+0000","last_became_peered":"2023-08-10T10:50:09.257293+0000","last_unstale":"2023-08-10T10:50:11.268708+0000","last_undegraded":"2023-08-10T10:50:11.268708+0000","last_fullsized":"2023-08-10T10:50:11.268708+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:38.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364367+0000","last_change":"2023-08-10T10:50:10.292327+0000","last_active":"2023-08-10T10:50:11.364367+0000","last_peered":"2023-08-10T10:50:11.364367+0000","last_clean":"2023-08-10T10:50:11.364367+0000","last_became_active":"2023-08-10T10:50:10.291839+0000","last_became_peered":"2023-08-10T10:50:10.291839+0000","last_unstale":"2023-08-10T10:50:11.364367+0000","last_undegraded":"2023-08-10T10:50:11.364367+0000","last_fullsized":"2023-08-10T10:50:11.364367+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:57.381727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362274+0000","last_change":"2023-08-10T10:50:09.253166+0000","last_active":"2023-08-10T10:50:11.362274+0000","last_peered":"2023-08-10T10:50:11.362274+0000","last_clean":"2023-08-10T10:50:11.362274+0000","last_became_active":"2023-08-10T10:50:09.252693+0000","last_became_peered":"2023-08-10T10:50:09.252693+0000","last_unstale":"2023-08-10T10:50:11.362274+0000","last_undegraded":"2023-08-10T10:50:11.362274+0000","last_fullsized":"2023-08-10T10:50:11.362274+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:24.683362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363723+0000","last_change":"2023-08-10T10:50:10.303543+0000","last_active":"2023-08-10T10:50:11.363723+0000","last_peered":"2023-08-10T10:50:11.363723+0000","last_clean":"2023-08-10T10:50:11.363723+0000","last_became_active":"2023-08-10T10:50:10.302873+0000","last_became_peered":"2023-08-10T10:50:10.302873+0000","last_unstale":"2023-08-10T10:50:11.363723+0000","last_undegraded":"2023-08-10T10:50:11.363723+0000","last_fullsized":"2023-08-10T10:50:11.363723+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:56.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363522+0000","last_change":"2023-08-10T10:50:09.241018+0000","last_active":"2023-08-10T10:50:11.363522+0000","last_peered":"2023-08-10T10:50:11.363522+0000","last_clean":"2023-08-10T10:50:11.363522+0000","last_became_active":"2023-08-10T10:50:09.240543+0000","last_became_peered":"2023-08-10T10:50:09.240543+0000","last_unstale":"2023-08-10T10:50:11.363522+0000","last_undegraded":"2023-08-10T10:50:11.363522+0000","last_fullsized":"2023-08-10T10:50:11.363522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:49.801933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272815+0000","last_change":"2023-08-10T10:50:10.276162+0000","last_active":"2023-08-10T10:50:11.272815+0000","last_peered":"2023-08-10T10:50:11.272815+0000","last_clean":"2023-08-10T10:50:11.272815+0000","last_became_active":"2023-08-10T10:50:10.275080+0000","last_became_peered":"2023-08-10T10:50:10.275080+0000","last_unstale":"2023-08-10T10:50:11.272815+0000","last_undegraded":"2023-08-10T10:50:11.272815+0000","last_fullsized":"2023-08-10T10:50:11.272815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.600152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361406+0000","last_change":"2023-08-10T10:50:09.253785+0000","last_active":"2023-08-10T10:50:11.361406+0000","last_peered":"2023-08-10T10:50:11.361406+0000","last_clean":"2023-08-10T10:50:11.361406+0000","last_became_active":"2023-08-10T10:50:09.251268+0000","last_became_peered":"2023-08-10T10:50:09.251268+0000","last_unstale":"2023-08-10T10:50:11.361406+0000","last_undegraded":"2023-08-10T10:50:11.361406+0000","last_fullsized":"2023-08-10T10:50:11.361406+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:28.944025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.270228+0000","last_change":"2023-08-10T10:50:10.292886+0000","last_active":"2023-08-10T10:50:11.270228+0000","last_peered":"2023-08-10T10:50:11.270228+0000","last_clean":"2023-08-10T10:50:11.270228+0000","last_became_active":"2023-08-10T10:50:10.292439+0000","last_became_peered":"2023-08-10T10:50:10.292439+0000","last_unstale":"2023-08-10T10:50:11.270228+0000","last_undegraded":"2023-08-10T10:50:11.270228+0000","last_fullsized":"2023-08-10T10:50:11.270228+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:34.552734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362864+0000","last_change":"2023-08-10T10:50:09.255778+0000","last_active":"2023-08-10T10:50:11.362864+0000","last_peered":"2023-08-10T10:50:11.362864+0000","last_clean":"2023-08-10T10:50:11.362864+0000","last_became_active":"2023-08-10T10:50:09.253402+0000","last_became_peered":"2023-08-10T10:50:09.253402+0000","last_unstale":"2023-08-10T10:50:11.362864+0000","last_undegraded":"2023-08-10T10:50:11.362864+0000","last_fullsized":"2023-08-10T10:50:11.362864+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:17.441228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364075+0000","last_change":"2023-08-10T10:50:10.303824+0000","last_active":"2023-08-10T10:50:11.364075+0000","last_peered":"2023-08-10T10:50:11.364075+0000","last_clean":"2023-08-10T10:50:11.364075+0000","last_became_active":"2023-08-10T10:50:10.303268+0000","last_became_peered":"2023-08-10T10:50:10.303268+0000","last_unstale":"2023-08-10T10:50:11.364075+0000","last_undegraded":"2023-08-10T10:50:11.364075+0000","last_fullsized":"2023-08-10T10:50:11.364075+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:13.172641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362487+0000","last_change":"2023-08-10T10:50:09.252472+0000","last_active":"2023-08-10T10:50:11.362487+0000","last_peered":"2023-08-10T10:50:11.362487+0000","last_clean":"2023-08-10T10:50:11.362487+0000","last_became_active":"2023-08-10T10:50:09.252227+0000","last_became_peered":"2023-08-10T10:50:09.252227+0000","last_unstale":"2023-08-10T10:50:11.362487+0000","last_undegraded":"2023-08-10T10:50:11.362487+0000","last_fullsized":"2023-08-10T10:50:11.362487+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:44.657800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362014+0000","last_change":"2023-08-10T10:50:10.294982+0000","last_active":"2023-08-10T10:50:11.362014+0000","last_peered":"2023-08-10T10:50:11.362014+0000","last_clean":"2023-08-10T10:50:11.362014+0000","last_became_active":"2023-08-10T10:50:10.294680+0000","last_became_peered":"2023-08-10T10:50:10.294680+0000","last_unstale":"2023-08-10T10:50:11.362014+0000","last_undegraded":"2023-08-10T10:50:11.362014+0000","last_fullsized":"2023-08-10T10:50:11.362014+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:43.664286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275703+0000","last_change":"2023-08-10T10:50:09.246445+0000","last_active":"2023-08-10T10:50:11.275703+0000","last_peered":"2023-08-10T10:50:11.275703+0000","last_clean":"2023-08-10T10:50:11.275703+0000","last_became_active":"2023-08-10T10:50:09.245945+0000","last_became_peered":"2023-08-10T10:50:09.245945+0000","last_unstale":"2023-08-10T10:50:11.275703+0000","last_undegraded":"2023-08-10T10:50:11.275703+0000","last_fullsized":"2023-08-10T10:50:11.275703+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:14:28.441136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363680+0000","last_change":"2023-08-10T10:50:10.299443+0000","last_active":"2023-08-10T10:50:11.363680+0000","last_peered":"2023-08-10T10:50:11.363680+0000","last_clean":"2023-08-10T10:50:11.363680+0000","last_became_active":"2023-08-10T10:50:10.299030+0000","last_became_peered":"2023-08-10T10:50:10.299030+0000","last_unstale":"2023-08-10T10:50:11.363680+0000","last_undegraded":"2023-08-10T10:50:11.363680+0000","last_fullsized":"2023-08-10T10:50:11.363680+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:41.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363605+0000","last_change":"2023-08-10T10:50:09.251042+0000","last_active":"2023-08-10T10:50:11.363605+0000","last_peered":"2023-08-10T10:50:11.363605+0000","last_clean":"2023-08-10T10:50:11.363605+0000","last_became_active":"2023-08-10T10:50:09.250586+0000","last_became_peered":"2023-08-10T10:50:09.250586+0000","last_unstale":"2023-08-10T10:50:11.363605+0000","last_undegraded":"2023-08-10T10:50:11.363605+0000","last_fullsized":"2023-08-10T10:50:11.363605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:18.760375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361061+0000","last_change":"2023-08-10T10:50:10.292175+0000","last_active":"2023-08-10T10:50:11.361061+0000","last_peered":"2023-08-10T10:50:11.361061+0000","last_clean":"2023-08-10T10:50:11.361061+0000","last_became_active":"2023-08-10T10:50:10.291449+0000","last_became_peered":"2023-08-10T10:50:10.291449+0000","last_unstale":"2023-08-10T10:50:11.361061+0000","last_undegraded":"2023-08-10T10:50:11.361061+0000","last_fullsized":"2023-08-10T10:50:11.361061+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:16.574616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273960+0000","last_change":"2023-08-10T10:50:09.249231+0000","last_active":"2023-08-10T10:50:11.273960+0000","last_peered":"2023-08-10T10:50:11.273960+0000","last_clean":"2023-08-10T10:50:11.273960+0000","last_became_active":"2023-08-10T10:50:09.248911+0000","last_became_peered":"2023-08-10T10:50:09.248911+0000","last_unstale":"2023-08-10T10:50:11.273960+0000","last_undegraded":"2023-08-10T10:50:11.273960+0000","last_fullsized":"2023-08-10T10:50:11.273960+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:45.524129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268644+0000","last_change":"2023-08-10T10:50:10.278109+0000","last_active":"2023-08-10T10:50:11.268644+0000","last_peered":"2023-08-10T10:50:11.268644+0000","last_clean":"2023-08-10T10:50:11.268644+0000","last_became_active":"2023-08-10T10:50:10.275857+0000","last_became_peered":"2023-08-10T10:50:10.275857+0000","last_unstale":"2023-08-10T10:50:11.268644+0000","last_undegraded":"2023-08-10T10:50:11.268644+0000","last_fullsized":"2023-08-10T10:50:11.268644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:01.835574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363824+0000","last_change":"2023-08-10T10:50:09.255058+0000","last_active":"2023-08-10T10:50:11.363824+0000","last_peered":"2023-08-10T10:50:11.363824+0000","last_clean":"2023-08-10T10:50:11.363824+0000","last_became_active":"2023-08-10T10:50:09.252000+0000","last_became_peered":"2023-08-10T10:50:09.252000+0000","last_unstale":"2023-08-10T10:50:11.363824+0000","last_undegraded":"2023-08-10T10:50:11.363824+0000","last_fullsized":"2023-08-10T10:50:11.363824+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:46.481844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363359+0000","last_change":"2023-08-10T10:50:10.301007+0000","last_active":"2023-08-10T10:50:11.363359+0000","last_peered":"2023-08-10T10:50:11.363359+0000","last_clean":"2023-08-10T10:50:11.363359+0000","last_became_active":"2023-08-10T10:50:10.291034+0000","last_became_peered":"2023-08-10T10:50:10.291034+0000","last_unstale":"2023-08-10T10:50:11.363359+0000","last_undegraded":"2023-08-10T10:50:11.363359+0000","last_fullsized":"2023-08-10T10:50:11.363359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:21.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273887+0000","last_change":"2023-08-10T10:50:09.255072+0000","last_active":"2023-08-10T10:50:11.273887+0000","last_peered":"2023-08-10T10:50:11.273887+0000","last_clean":"2023-08-10T10:50:11.273887+0000","last_became_active":"2023-08-10T10:50:09.253747+0000","last_became_peered":"2023-08-10T10:50:09.253747+0000","last_unstale":"2023-08-10T10:50:11.273887+0000","last_undegraded":"2023-08-10T10:50:11.273887+0000","last_fullsized":"2023-08-10T10:50:11.273887+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:17.556776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273288+0000","last_change":"2023-08-10T10:50:10.298450+0000","last_active":"2023-08-10T10:50:11.273288+0000","last_peered":"2023-08-10T10:50:11.273288+0000","last_clean":"2023-08-10T10:50:11.273288+0000","last_became_active":"2023-08-10T10:50:10.296349+0000","last_became_peered":"2023-08-10T10:50:10.296349+0000","last_unstale":"2023-08-10T10:50:11.273288+0000","last_undegraded":"2023-08-10T10:50:11.273288+0000","last_fullsized":"2023-08-10T10:50:11.273288+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:04.652874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360880+0000","last_change":"2023-08-10T10:50:09.253176+0000","last_active":"2023-08-10T10:50:11.360880+0000","last_peered":"2023-08-10T10:50:11.360880+0000","last_clean":"2023-08-10T10:50:11.360880+0000","last_became_active":"2023-08-10T10:50:09.252148+0000","last_became_peered":"2023-08-10T10:50:09.252148+0000","last_unstale":"2023-08-10T10:50:11.360880+0000","last_undegraded":"2023-08-10T10:50:11.360880+0000","last_fullsized":"2023-08-10T10:50:11.360880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:17.556776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268815+0000","last_change":"2023-08-10T10:50:10.291791+0000","last_active":"2023-08-10T10:50:11.268815+0000","last_peered":"2023-08-10T10:50:11.268815+0000","last_clean":"2023-08-10T10:50:11.268815+0000","last_became_active":"2023-08-10T10:50:10.291479+0000","last_became_peered":"2023-08-10T10:50:10.291479+0000","last_unstale":"2023-08-10T10:50:11.268815+0000","last_undegraded":"2023-08-10T10:50:11.268815+0000","last_fullsized":"2023-08-10T10:50:11.268815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:18.457059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269052+0000","last_change":"2023-08-10T10:50:09.257785+0000","last_active":"2023-08-10T10:50:11.269052+0000","last_peered":"2023-08-10T10:50:11.269052+0000","last_clean":"2023-08-10T10:50:11.269052+0000","last_became_active":"2023-08-10T10:50:09.256849+0000","last_became_peered":"2023-08-10T10:50:09.256849+0000","last_unstale":"2023-08-10T10:50:11.269052+0000","last_undegraded":"2023-08-10T10:50:11.269052+0000","last_fullsized":"2023-08-10T10:50:11.269052+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:17.734575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275371+0000","last_change":"2023-08-10T10:50:10.304372+0000","last_active":"2023-08-10T10:50:11.275371+0000","last_peered":"2023-08-10T10:50:11.275371+0000","last_clean":"2023-08-10T10:50:11.275371+0000","last_became_active":"2023-08-10T10:50:10.300764+0000","last_became_peered":"2023-08-10T10:50:10.300764+0000","last_unstale":"2023-08-10T10:50:11.275371+0000","last_undegraded":"2023-08-10T10:50:11.275371+0000","last_fullsized":"2023-08-10T10:50:11.275371+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:27.741404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271921+0000","last_change":"2023-08-10T10:50:09.250875+0000","last_active":"2023-08-10T10:50:11.271921+0000","last_peered":"2023-08-10T10:50:11.271921+0000","last_clean":"2023-08-10T10:50:11.271921+0000","last_became_active":"2023-08-10T10:50:09.250521+0000","last_became_peered":"2023-08-10T10:50:09.250521+0000","last_unstale":"2023-08-10T10:50:11.271921+0000","last_undegraded":"2023-08-10T10:50:11.271921+0000","last_fullsized":"2023-08-10T10:50:11.271921+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:56.259862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362212+0000","last_change":"2023-08-10T10:50:10.296255+0000","last_active":"2023-08-10T10:50:11.362212+0000","last_peered":"2023-08-10T10:50:11.362212+0000","last_clean":"2023-08-10T10:50:11.362212+0000","last_became_active":"2023-08-10T10:50:10.295941+0000","last_became_peered":"2023-08-10T10:50:10.295941+0000","last_unstale":"2023-08-10T10:50:11.362212+0000","last_undegraded":"2023-08-10T10:50:11.362212+0000","last_fullsized":"2023-08-10T10:50:11.362212+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:01.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362841+0000","last_change":"2023-08-10T10:50:09.247692+0000","last_active":"2023-08-10T10:50:11.362841+0000","last_peered":"2023-08-10T10:50:11.362841+0000","last_clean":"2023-08-10T10:50:11.362841+0000","last_became_active":"2023-08-10T10:50:09.247267+0000","last_became_peered":"2023-08-10T10:50:09.247267+0000","last_unstale":"2023-08-10T10:50:11.362841+0000","last_undegraded":"2023-08-10T10:50:11.362841+0000","last_fullsized":"2023-08-10T10:50:11.362841+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:54.484876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360847+0000","last_change":"2023-08-10T10:50:10.294262+0000","last_active":"2023-08-10T10:50:11.360847+0000","last_peered":"2023-08-10T10:50:11.360847+0000","last_clean":"2023-08-10T10:50:11.360847+0000","last_became_active":"2023-08-10T10:50:10.293880+0000","last_became_peered":"2023-08-10T10:50:10.293880+0000","last_unstale":"2023-08-10T10:50:11.360847+0000","last_undegraded":"2023-08-10T10:50:11.360847+0000","last_fullsized":"2023-08-10T10:50:11.360847+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:17.691325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274191+0000","last_change":"2023-08-10T10:50:09.249720+0000","last_active":"2023-08-10T10:50:11.274191+0000","last_peered":"2023-08-10T10:50:11.274191+0000","last_clean":"2023-08-10T10:50:11.274191+0000","last_became_active":"2023-08-10T10:50:09.249125+0000","last_became_peered":"2023-08-10T10:50:09.249125+0000","last_unstale":"2023-08-10T10:50:11.274191+0000","last_undegraded":"2023-08-10T10:50:11.274191+0000","last_fullsized":"2023-08-10T10:50:11.274191+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:15.558786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273332+0000","last_change":"2023-08-10T10:50:10.296335+0000","last_active":"2023-08-10T10:50:11.273332+0000","last_peered":"2023-08-10T10:50:11.273332+0000","last_clean":"2023-08-10T10:50:11.273332+0000","last_became_active":"2023-08-10T10:50:10.293098+0000","last_became_peered":"2023-08-10T10:50:10.293098+0000","last_unstale":"2023-08-10T10:50:11.273332+0000","last_undegraded":"2023-08-10T10:50:11.273332+0000","last_fullsized":"2023-08-10T10:50:11.273332+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:13.261189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362139+0000","last_change":"2023-08-10T10:50:09.252336+0000","last_active":"2023-08-10T10:50:11.362139+0000","last_peered":"2023-08-10T10:50:11.362139+0000","last_clean":"2023-08-10T10:50:11.362139+0000","last_became_active":"2023-08-10T10:50:09.251965+0000","last_became_peered":"2023-08-10T10:50:09.251965+0000","last_unstale":"2023-08-10T10:50:11.362139+0000","last_undegraded":"2023-08-10T10:50:11.362139+0000","last_fullsized":"2023-08-10T10:50:11.362139+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:51.757612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272860+0000","last_change":"2023-08-10T10:50:10.297724+0000","last_active":"2023-08-10T10:50:11.272860+0000","last_peered":"2023-08-10T10:50:11.272860+0000","last_clean":"2023-08-10T10:50:11.272860+0000","last_became_active":"2023-08-10T10:50:10.295745+0000","last_became_peered":"2023-08-10T10:50:10.295745+0000","last_unstale":"2023-08-10T10:50:11.272860+0000","last_undegraded":"2023-08-10T10:50:11.272860+0000","last_fullsized":"2023-08-10T10:50:11.272860+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:28.557320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363176+0000","last_change":"2023-08-10T10:50:09.255195+0000","last_active":"2023-08-10T10:50:11.363176+0000","last_peered":"2023-08-10T10:50:11.363176+0000","last_clean":"2023-08-10T10:50:11.363176+0000","last_became_active":"2023-08-10T10:50:09.254943+0000","last_became_peered":"2023-08-10T10:50:09.254943+0000","last_unstale":"2023-08-10T10:50:11.363176+0000","last_undegraded":"2023-08-10T10:50:11.363176+0000","last_fullsized":"2023-08-10T10:50:11.363176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:32.761281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":435,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364311+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:50:11.364311+0000","last_peered":"2023-08-10T10:50:11.364311+0000","last_clean":"2023-08-10T10:50:11.364311+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:50:11.364311+0000","last_undegraded":"2023-08-10T10:50:11.364311+0000","last_fullsized":"2023-08-10T10:50:11.364311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:36.023512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272213+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:50:11.272213+0000","last_peered":"2023-08-10T10:50:11.272213+0000","last_clean":"2023-08-10T10:50:11.272213+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:50:11.272213+0000","last_undegraded":"2023-08-10T10:50:11.272213+0000","last_fullsized":"2023-08-10T10:50:11.272213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:47.559509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275080+0000","last_change":"2023-08-10T10:50:10.305247+0000","last_active":"2023-08-10T10:50:11.275080+0000","last_peered":"2023-08-10T10:50:11.275080+0000","last_clean":"2023-08-10T10:50:11.275080+0000","last_became_active":"2023-08-10T10:50:10.304708+0000","last_became_peered":"2023-08-10T10:50:10.304708+0000","last_unstale":"2023-08-10T10:50:11.275080+0000","last_undegraded":"2023-08-10T10:50:11.275080+0000","last_fullsized":"2023-08-10T10:50:11.275080+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:15.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364287+0000","last_change":"2023-08-10T10:50:09.251628+0000","last_active":"2023-08-10T10:50:11.364287+0000","last_peered":"2023-08-10T10:50:11.364287+0000","last_clean":"2023-08-10T10:50:11.364287+0000","last_became_active":"2023-08-10T10:50:09.243944+0000","last_became_peered":"2023-08-10T10:50:09.243944+0000","last_unstale":"2023-08-10T10:50:11.364287+0000","last_undegraded":"2023-08-10T10:50:11.364287+0000","last_fullsized":"2023-08-10T10:50:11.364287+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:51.992457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363891+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:50:11.363891+0000","last_peered":"2023-08-10T10:50:11.363891+0000","last_clean":"2023-08-10T10:50:11.363891+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:50:11.363891+0000","last_undegraded":"2023-08-10T10:50:11.363891+0000","last_fullsized":"2023-08-10T10:50:11.363891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:08.822455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364279+0000","last_change":"2023-08-10T10:50:10.295513+0000","last_active":"2023-08-10T10:50:11.364279+0000","last_peered":"2023-08-10T10:50:11.364279+0000","last_clean":"2023-08-10T10:50:11.364279+0000","last_became_active":"2023-08-10T10:50:10.294302+0000","last_became_peered":"2023-08-10T10:50:10.294302+0000","last_unstale":"2023-08-10T10:50:11.364279+0000","last_undegraded":"2023-08-10T10:50:11.364279+0000","last_fullsized":"2023-08-10T10:50:11.364279+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:44.467278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271540+0000","last_change":"2023-08-10T10:50:09.245570+0000","last_active":"2023-08-10T10:50:11.271540+0000","last_peered":"2023-08-10T10:50:11.271540+0000","last_clean":"2023-08-10T10:50:11.271540+0000","last_became_active":"2023-08-10T10:50:09.245166+0000","last_became_peered":"2023-08-10T10:50:09.245166+0000","last_unstale":"2023-08-10T10:50:11.271540+0000","last_undegraded":"2023-08-10T10:50:11.271540+0000","last_fullsized":"2023-08-10T10:50:11.271540+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:25.022137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364488+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:50:11.364488+0000","last_peered":"2023-08-10T10:50:11.364488+0000","last_clean":"2023-08-10T10:50:11.364488+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:50:11.364488+0000","last_undegraded":"2023-08-10T10:50:11.364488+0000","last_fullsized":"2023-08-10T10:50:11.364488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:15:02.149985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362747+0000","last_change":"2023-08-10T10:50:10.290143+0000","last_active":"2023-08-10T10:50:11.362747+0000","last_peered":"2023-08-10T10:50:11.362747+0000","last_clean":"2023-08-10T10:50:11.362747+0000","last_became_active":"2023-08-10T10:50:10.289705+0000","last_became_peered":"2023-08-10T10:50:10.289705+0000","last_unstale":"2023-08-10T10:50:11.362747+0000","last_undegraded":"2023-08-10T10:50:11.362747+0000","last_fullsized":"2023-08-10T10:50:11.362747+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:44.392081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363811+0000","last_change":"2023-08-10T10:50:09.246345+0000","last_active":"2023-08-10T10:50:11.363811+0000","last_peered":"2023-08-10T10:50:11.363811+0000","last_clean":"2023-08-10T10:50:11.363811+0000","last_became_active":"2023-08-10T10:50:09.245851+0000","last_became_peered":"2023-08-10T10:50:09.245851+0000","last_unstale":"2023-08-10T10:50:11.363811+0000","last_undegraded":"2023-08-10T10:50:11.363811+0000","last_fullsized":"2023-08-10T10:50:11.363811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:49.120227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272338+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:50:11.272338+0000","last_peered":"2023-08-10T10:50:11.272338+0000","last_clean":"2023-08-10T10:50:11.272338+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:50:11.272338+0000","last_undegraded":"2023-08-10T10:50:11.272338+0000","last_fullsized":"2023-08-10T10:50:11.272338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:46.634810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273233+0000","last_change":"2023-08-10T10:50:10.297806+0000","last_active":"2023-08-10T10:50:11.273233+0000","last_peered":"2023-08-10T10:50:11.273233+0000","last_clean":"2023-08-10T10:50:11.273233+0000","last_became_active":"2023-08-10T10:50:10.297345+0000","last_became_peered":"2023-08-10T10:50:10.297345+0000","last_unstale":"2023-08-10T10:50:11.273233+0000","last_undegraded":"2023-08-10T10:50:11.273233+0000","last_fullsized":"2023-08-10T10:50:11.273233+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:14:37.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268983+0000","last_change":"2023-08-10T10:50:09.254556+0000","last_active":"2023-08-10T10:50:11.268983+0000","last_peered":"2023-08-10T10:50:11.268983+0000","last_clean":"2023-08-10T10:50:11.268983+0000","last_became_active":"2023-08-10T10:50:09.252239+0000","last_became_peered":"2023-08-10T10:50:09.252239+0000","last_unstale":"2023-08-10T10:50:11.268983+0000","last_undegraded":"2023-08-10T10:50:11.268983+0000","last_fullsized":"2023-08-10T10:50:11.268983+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:15.101820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362241+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:50:11.362241+0000","last_peered":"2023-08-10T10:50:11.362241+0000","last_clean":"2023-08-10T10:50:11.362241+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:50:11.362241+0000","last_undegraded":"2023-08-10T10:50:11.362241+0000","last_fullsized":"2023-08-10T10:50:11.362241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:24:36.868270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360707+0000","last_change":"2023-08-10T10:50:10.293538+0000","last_active":"2023-08-10T10:50:11.360707+0000","last_peered":"2023-08-10T10:50:11.360707+0000","last_clean":"2023-08-10T10:50:11.360707+0000","last_became_active":"2023-08-10T10:50:10.292315+0000","last_became_peered":"2023-08-10T10:50:10.292315+0000","last_unstale":"2023-08-10T10:50:11.360707+0000","last_undegraded":"2023-08-10T10:50:11.360707+0000","last_fullsized":"2023-08-10T10:50:11.360707+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:04.652874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362416+0000","last_change":"2023-08-10T10:50:09.250500+0000","last_active":"2023-08-10T10:50:11.362416+0000","last_peered":"2023-08-10T10:50:11.362416+0000","last_clean":"2023-08-10T10:50:11.362416+0000","last_became_active":"2023-08-10T10:50:09.250227+0000","last_became_peered":"2023-08-10T10:50:09.250227+0000","last_unstale":"2023-08-10T10:50:11.362416+0000","last_undegraded":"2023-08-10T10:50:11.362416+0000","last_fullsized":"2023-08-10T10:50:11.362416+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:00.819744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362980+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:50:11.362980+0000","last_peered":"2023-08-10T10:50:11.362980+0000","last_clean":"2023-08-10T10:50:11.362980+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:50:11.362980+0000","last_undegraded":"2023-08-10T10:50:11.362980+0000","last_fullsized":"2023-08-10T10:50:11.362980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:43.862735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269405+0000","last_change":"2023-08-10T10:50:10.294421+0000","last_active":"2023-08-10T10:50:11.269405+0000","last_peered":"2023-08-10T10:50:11.269405+0000","last_clean":"2023-08-10T10:50:11.269405+0000","last_became_active":"2023-08-10T10:50:10.293156+0000","last_became_peered":"2023-08-10T10:50:10.293156+0000","last_unstale":"2023-08-10T10:50:11.269405+0000","last_undegraded":"2023-08-10T10:50:11.269405+0000","last_fullsized":"2023-08-10T10:50:11.269405+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:28:02.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362533+0000","last_change":"2023-08-10T10:50:09.256943+0000","last_active":"2023-08-10T10:50:11.362533+0000","last_peered":"2023-08-10T10:50:11.362533+0000","last_clean":"2023-08-10T10:50:11.362533+0000","last_became_active":"2023-08-10T10:50:09.256736+0000","last_became_peered":"2023-08-10T10:50:09.256736+0000","last_unstale":"2023-08-10T10:50:11.362533+0000","last_undegraded":"2023-08-10T10:50:11.362533+0000","last_fullsized":"2023-08-10T10:50:11.362533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:38.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361679+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:50:11.361679+0000","last_peered":"2023-08-10T10:50:11.361679+0000","last_clean":"2023-08-10T10:50:11.361679+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:50:11.361679+0000","last_undegraded":"2023-08-10T10:50:11.361679+0000","last_fullsized":"2023-08-10T10:50:11.361679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:16.117948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361887+0000","last_change":"2023-08-10T10:50:10.296496+0000","last_active":"2023-08-10T10:50:11.361887+0000","last_peered":"2023-08-10T10:50:11.361887+0000","last_clean":"2023-08-10T10:50:11.361887+0000","last_became_active":"2023-08-10T10:50:10.296217+0000","last_became_peered":"2023-08-10T10:50:10.296217+0000","last_unstale":"2023-08-10T10:50:11.361887+0000","last_undegraded":"2023-08-10T10:50:11.361887+0000","last_fullsized":"2023-08-10T10:50:11.361887+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:38.891565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"171'8","reported_seq":21,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273530+0000","last_change":"2023-08-10T10:50:09.255285+0000","last_active":"2023-08-10T10:50:11.273530+0000","last_peered":"2023-08-10T10:50:11.273530+0000","last_clean":"2023-08-10T10:50:11.273530+0000","last_became_active":"2023-08-10T10:50:09.254467+0000","last_became_peered":"2023-08-10T10:50:09.254467+0000","last_unstale":"2023-08-10T10:50:11.273530+0000","last_undegraded":"2023-08-10T10:50:11.273530+0000","last_fullsized":"2023-08-10T10:50:11.273530+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:16.675494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":272,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363981+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:50:11.363981+0000","last_peered":"2023-08-10T10:50:11.363981+0000","last_clean":"2023-08-10T10:50:11.363981+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:50:11.363981+0000","last_undegraded":"2023-08-10T10:50:11.363981+0000","last_fullsized":"2023-08-10T10:50:11.363981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:21.001319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198379506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.234,"15min":1.151},"min":{"1min":0.83299999999999996,"5min":0.52300000000000002,"15min":0.39600000000000002},"max":{"1min":1.532,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.745},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.1279999999999999},"min":{"1min":0.80000000000000004,"5min":0.52200000000000002,"15min":0.44800000000000001},"max":{"1min":1.496,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2350000000000001,"15min":1.1739999999999999},"min":{"1min":0.88600000000000001,"5min":0.68100000000000005,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.25,"15min":1.181},"min":{"1min":0.84699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.9299999999999999,"5min":8.0830000000000002,"15min":8.0830000000000002},"last":1.3879999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.208,"15min":1.214},"min":{"1min":0.81899999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.45,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.373,"15min":1.28},"min":{"1min":1.1140000000000001,"5min":0.58599999999999997,"15min":0.497},"max":{"1min":1.8839999999999999,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.022}]},{"osd":3,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2689999999999999,"15min":1.232},"min":{"1min":0.97099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.6359999999999999,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4750000000000001,"15min":1.403},"min":{"1min":1.298,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7769999999999999,"5min":6.069,"15min":6.069},"last":1.359}]},{"osd":4,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.3129999999999999,"15min":1.262},"min":{"1min":0.85099999999999998,"5min":0.56499999999999995,"15min":0.49099999999999999},"max":{"1min":1.7070000000000001,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.302,"15min":1.284},"min":{"1min":0.70099999999999996,"5min":0.54400000000000004,"15min":0.52600000000000002},"max":{"1min":1.5389999999999999,"5min":7.4950000000000001,"15min":7.4950000000000001},"last":1.421}]},{"osd":5,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.5,"15min":1.4590000000000001},"min":{"1min":0.78300000000000003,"5min":0.67600000000000005,"15min":0.59699999999999998},"max":{"1min":1.9430000000000001,"5min":6.0090000000000003,"15min":6.0090000000000003},"last":1.446},{"interface":"front","average":{"1min":1.468,"5min":1.5129999999999999,"15min":1.498},"min":{"1min":0.98799999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8700000000000001,"5min":7.5529999999999999,"15min":7.5529999999999999},"last":1.532}]},{"osd":6,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.657,"15min":1.587},"min":{"1min":1.2689999999999999,"5min":0.61299999999999999,"15min":0.58599999999999997},"max":{"1min":2.0459999999999998,"5min":8.859,"15min":8.859},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.546,"15min":1.5109999999999999},"min":{"1min":1.1339999999999999,"5min":0.62,"15min":0.62},"max":{"1min":2.2650000000000001,"5min":7.1139999999999999,"15min":7.1139999999999999},"last":0.92400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.173,"15min":1.1060000000000001},"min":{"1min":0.72199999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8080000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.097,"15min":1.052},"min":{"1min":0.874,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.675,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.377}]},{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.119,"15min":1.0940000000000001},"min":{"1min":0.91300000000000003,"5min":0.59899999999999998,"15min":0.58499999999999996},"max":{"1min":1.764,"5min":1.764,"15min":2.302},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.2569999999999999,"15min":1.2130000000000001},"min":{"1min":1.0669999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6839999999999999,"5min":2.052,"15min":2.052},"last":1.3440000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.232,"15min":1.1759999999999999},"min":{"1min":0.99199999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.643,"5min":1.744,"15min":2.1669999999999998},"last":1.46},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.242,"15min":1.246},"min":{"1min":0.81999999999999995,"5min":0.752,"15min":0.58699999999999997},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.968},"last":1.032}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":1.198,"5min":0.80700000000000005,"15min":0.69399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":3.177},"last":1.177},{"interface":"front","average":{"1min":1.343,"5min":1.2869999999999999,"15min":1.2769999999999999},"min":{"1min":1.044,"5min":0.749,"15min":0.71599999999999997},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":2.395},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.246,"15min":1.236},"min":{"1min":0.80300000000000005,"5min":0.60699999999999998,"15min":0.49399999999999999},"max":{"1min":1.823,"5min":1.8320000000000001,"15min":2.7250000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.486,"15min":1.4510000000000001},"min":{"1min":1.228,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.8420000000000001,"5min":2.0009999999999999,"15min":2.7589999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.95599999999999996,"5min":0.69999999999999996,"15min":0.59399999999999997},"max":{"1min":1.7929999999999999,"5min":1.9419999999999999,"15min":2.4510000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.591,"5min":1.5309999999999999,"15min":1.5189999999999999},"min":{"1min":1.2330000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.899,"5min":2.1139999999999999,"15min":2.8700000000000001},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.341,"15min":1.369},"min":{"1min":0.91700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8100000000000001,"5min":2.0600000000000001,"15min":3.1019999999999999},"last":1.2},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.51},"min":{"1min":1.0620000000000001,"5min":0.86299999999999999,"15min":0.65400000000000003},"max":{"1min":1.7490000000000001,"5min":2.125,"15min":2.698},"last":1.141}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1004,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194307,"statfs":{"total":200000000,"available":198970915,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.1319999999999999,"15min":1.1180000000000001},"min":{"1min":0.88100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.645,"5min":1.645,"15min":2.5070000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.208,"15min":1.2509999999999999},"min":{"1min":0.78500000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.764,"5min":1.857,"15min":32.941000000000003},"last":1.044}]},{"osd":1,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.266,"15min":1.228},"min":{"1min":0.94099999999999995,"5min":0.64800000000000002,"15min":0.51400000000000001},"max":{"1min":1.891,"5min":1.891,"15min":2.2450000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.304,"5min":1.212,"15min":1.2050000000000001},"min":{"1min":0.998,"5min":0.62,"15min":0.62},"max":{"1min":1.6679999999999999,"5min":1.6899999999999999,"15min":4.3360000000000003},"last":1.2789999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.252,"15min":1.294},"min":{"1min":0.96299999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6899999999999999,"5min":1.8700000000000001,"15min":4.1980000000000004},"last":1.484},{"interface":"front","average":{"1min":1.222,"5min":1.1799999999999999,"15min":1.1779999999999999},"min":{"1min":0.88900000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.522,"5min":1.734,"15min":1.734},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3240000000000001,"15min":1.2789999999999999},"min":{"1min":0.99399999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6699999999999999,"5min":2.016,"15min":2.016},"last":1.214},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.347,"15min":1.353},"min":{"1min":1.042,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.5880000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.2689999999999999,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.68000000000000005,"15min":0.58599999999999997},"max":{"1min":1.361,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4099999999999999,"15min":1.3740000000000001},"min":{"1min":0.98299999999999998,"5min":0.755,"15min":0.58099999999999996},"max":{"1min":1.724,"5min":1.893,"15min":2.0299999999999998},"last":1.345}]},{"osd":6,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4339999999999999,"15min":1.371},"min":{"1min":1.1779999999999999,"5min":0.67700000000000005,"15min":0.54200000000000004},"max":{"1min":1.7270000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.75},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4410000000000001,"15min":1.4099999999999999},"min":{"1min":1.028,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.694,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":1.6699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5369999999999999,"15min":1.5},"min":{"1min":1.0640000000000001,"5min":0.88500000000000001,"15min":0.63100000000000001},"max":{"1min":1.7989999999999999,"5min":2.403,"15min":2.403},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.5469999999999999,"15min":1.514},"min":{"1min":1.2030000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.835,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.647}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1007,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198968332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.88200000000000001,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":1.583,"5min":2.2559999999999998,"15min":4.4009999999999998},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.175,"15min":1.198},"min":{"1min":0.97399999999999998,"5min":0.68600000000000005,"15min":0.55600000000000005},"max":{"1min":1.716,"5min":1.907,"15min":3.7629999999999999},"last":0.93799999999999994}]},{"osd":1,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2569999999999999,"15min":1.27},"min":{"1min":0.94799999999999995,"5min":0.69499999999999995,"15min":0.61899999999999999},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":3.9820000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.1950000000000001,"15min":1.1579999999999999},"min":{"1min":0.98899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5640000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3109999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.2430000000000001,"15min":1.1919999999999999},"min":{"1min":0.89900000000000002,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.7150000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3260000000000001,"15min":1.3109999999999999},"min":{"1min":0.96499999999999997,"5min":0.73899999999999999,"15min":0.70499999999999996},"max":{"1min":1.5740000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.24,"15min":1.2569999999999999},"min":{"1min":0.94899999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6819999999999999,"5min":1.893,"15min":3.8130000000000002},"last":1.375},{"interface":"front","average":{"1min":1.429,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":1.1240000000000001,"5min":0.82199999999999995,"15min":0.67000000000000004},"max":{"1min":1.792,"5min":2.5600000000000001,"15min":4.6859999999999999},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.296,"15min":1.349},"min":{"1min":0.99299999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6890000000000001,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.2689999999999999,"15min":1.2949999999999999},"min":{"1min":0.93799999999999994,"5min":0.50600000000000001,"15min":0.42399999999999999},"max":{"1min":1.7529999999999999,"5min":1.911,"15min":2.9340000000000002},"last":1.1850000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.327,"15min":1.3360000000000001},"min":{"1min":0.92500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.847,"5min":2.6190000000000002,"15min":4.5590000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4590000000000001,"15min":1.4830000000000001},"min":{"1min":0.98699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.819,"5min":2.121,"15min":5.1529999999999996},"last":1.3919999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.4670000000000001,"15min":1.4490000000000001},"min":{"1min":1.2649999999999999,"5min":0.67900000000000005,"15min":0.57999999999999996},"max":{"1min":1.8120000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5649999999999999,"15min":1.538},"min":{"1min":1.383,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.899,"5min":2.6659999999999999,"15min":4.6280000000000001},"last":1.5800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969280,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.2949999999999999,"5min":1.6060000000000001,"15min":2.1019999999999999},"last":1.125},{"interface":"front","average":{"1min":1.212,"5min":1.129,"15min":1.0549999999999999},"min":{"1min":0.98899999999999999,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.5669999999999999,"5min":1.9590000000000001,"15min":2.4470000000000001},"last":1.839}]},{"osd":1,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":0.96099999999999997,"15min":0.89300000000000002},"min":{"1min":0.79000000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.093,"15min":1.0089999999999999},"min":{"1min":0.82399999999999995,"5min":0.49399999999999999,"15min":0.34100000000000003},"max":{"1min":1.5489999999999999,"5min":1.6839999999999999,"15min":1.897},"last":1.514}]},{"osd":2,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.091,"15min":1.006},"min":{"1min":0.92800000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.581,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.633},{"interface":"front","average":{"1min":1.395,"5min":1.23,"15min":1.147},"min":{"1min":0.99299999999999999,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.694,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.869}]},{"osd":4,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.446,"15min":1.3160000000000001},"min":{"1min":1.1180000000000001,"5min":0.80400000000000005,"15min":0.70599999999999996},"max":{"1min":1.8120000000000001,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":1.76},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":1.002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7230000000000001,"5min":2.0390000000000001,"15min":2.5179999999999998},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4570000000000001,"15min":1.3819999999999999},"min":{"1min":1.2509999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.3029999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.4139999999999999,"15min":1.3959999999999999},"min":{"1min":1.226,"5min":0.621,"15min":0.621},"max":{"1min":1.8260000000000001,"5min":2.1890000000000001,"15min":4.2069999999999999},"last":1.171}]},{"osd":6,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.395,"15min":1.329},"min":{"1min":1.149,"5min":0.83399999999999996,"15min":0.79900000000000004},"max":{"1min":1.9650000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.591},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.5149999999999999,"15min":1.452},"min":{"1min":1.377,"5min":0.749,"15min":0.749},"max":{"1min":2.2250000000000001,"5min":2.964,"15min":2.964},"last":1.8009999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.5329999999999999,"15min":1.4730000000000001},"min":{"1min":1.3640000000000001,"5min":0.85299999999999998,"15min":0.754},"max":{"1min":2.1640000000000001,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.905},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.4670000000000001,"15min":1.3979999999999999},"min":{"1min":1.319,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.855,"5min":2.0459999999999998,"15min":2.3879999999999999},"last":1.726}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.66600000000000004,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.96999999999999997,"15min":0.93700000000000006},"min":{"1min":0.79600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.575,"5min":1.825,"15min":1.825},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.1020000000000001,"15min":1.075},"min":{"1min":0.78400000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.9630000000000001},"last":1.054},{"interface":"front","average":{"1min":1.393,"5min":1.2250000000000001,"15min":1.169},"min":{"1min":1.079,"5min":0.503,"15min":0.503},"max":{"1min":1.9179999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3140000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.76500000000000001,"5min":0.54200000000000004,"15min":0.50900000000000001},"max":{"1min":1.3859999999999999,"5min":1.877,"15min":1.877},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.1499999999999999,"15min":1.2130000000000001},"min":{"1min":0.94399999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.839,"5min":1.839,"15min":3.6920000000000002},"last":1.0029999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.371,"15min":1.4039999999999999},"min":{"1min":1.0600000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.6000000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.359,"15min":1.3260000000000001},"min":{"1min":1.0089999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8999999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.4510000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.2789999999999999,"15min":1.2829999999999999},"min":{"1min":1.099,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6799999999999999,"5min":1.819,"15min":2.2280000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.423,"15min":1.4670000000000001},"min":{"1min":1.2070000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.968,"5min":1.9870000000000001,"15min":3.294},"last":1.353}]},{"osd":6,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.4399999999999999,"15min":1.415},"min":{"1min":1.1259999999999999,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.206},{"interface":"front","average":{"1min":1.47,"5min":1.3660000000000001,"15min":1.371},"min":{"1min":1.0920000000000001,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.883,"5min":1.8879999999999999,"15min":2.444},"last":1.284}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.492,"15min":1.4530000000000001},"min":{"1min":1.2909999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.421,"15min":1.4379999999999999},"min":{"1min":1.363,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8100000000000001,"5min":2.0950000000000002,"15min":2.556},"last":1.427}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.90100000000000002,"15min":0.86699999999999999},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97699999999999998,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.706,"5min":1.706,"15min":2.246},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.024,"15min":0.94399999999999995},"min":{"1min":0.73499999999999999,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.671,"5min":1.792,"15min":2.0209999999999999},"last":1.129},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.1519999999999999},"min":{"1min":0.85599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.627,"5min":1.7370000000000001,"15min":2.423},"last":1.72}]},{"osd":3,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.212,"15min":1.1200000000000001},"min":{"1min":0.85399999999999998,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.7150000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.123,"15min":1.0660000000000001},"min":{"1min":0.91800000000000004,"5min":0.48899999999999999,"15min":0.42399999999999999},"max":{"1min":1.569,"5min":1.8,"15min":2.8940000000000001},"last":1.298}]},{"osd":4,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.2729999999999999,"15min":1.2130000000000001},"min":{"1min":0.97699999999999998,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":1.7809999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.367},{"interface":"front","average":{"1min":1.577,"5min":1.484,"15min":1.4299999999999999},"min":{"1min":1.208,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.845,"5min":2.2989999999999999,"15min":2.343},"last":1.5469999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.4399999999999999,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.67900000000000005},"max":{"1min":1.8779999999999999,"5min":1.98,"15min":2.9969999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4430000000000001,"15min":1.3640000000000001},"min":{"1min":1.1759999999999999,"5min":0.89600000000000002,"15min":0.71699999999999997},"max":{"1min":1.9470000000000001,"5min":2.387,"15min":2.73},"last":1.5049999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.429,"15min":1.395},"min":{"1min":1.0800000000000001,"5min":0.82899999999999996,"15min":0.78400000000000003},"max":{"1min":1.982,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.444},{"interface":"front","average":{"1min":1.446,"5min":1.417,"15min":1.327},"min":{"1min":1.1459999999999999,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":2.02,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.5289999999999999,"15min":1.47},"min":{"1min":1.1100000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.1800000000000002,"5min":2.4129999999999998,"15min":2.742},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.494,"15min":1.4450000000000001},"min":{"1min":1.218,"5min":0.82699999999999996,"15min":0.625},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.605},"last":1.593}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193728,"statfs":{"total":200000000,"available":198378277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0389999999999999,"15min":0.98799999999999999},"min":{"1min":0.72699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.506,"5min":8.6899999999999995,"15min":8.6899999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.177,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.86199999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.544,"5min":11.173,"15min":11.173},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.028,"15min":1.032},"min":{"1min":0.83899999999999997,"5min":0.435,"15min":0.39000000000000001},"max":{"1min":1.6499999999999999,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.79800000000000004,"5min":0.47699999999999998,"15min":0.47399999999999998},"max":{"1min":1.5880000000000001,"5min":1.875,"15min":1.875},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.0740000000000001,"15min":1.0049999999999999},"min":{"1min":0.82599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6020000000000001,"5min":4.8570000000000002,"15min":5.9980000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.345,"5min":1.3149999999999999,"15min":1.1910000000000001},"min":{"1min":1.0029999999999999,"5min":0.503,"15min":0.46700000000000003},"max":{"1min":1.7130000000000001,"5min":10.739000000000001,"15min":10.739000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3939999999999999,"15min":1.329},"min":{"1min":1.036,"5min":0.88100000000000001,"15min":0.73199999999999998},"max":{"1min":1.8220000000000001,"5min":4.6980000000000004,"15min":6.5209999999999999},"last":1.198},{"interface":"front","average":{"1min":1.655,"5min":1.5249999999999999,"15min":1.456},"min":{"1min":1.25,"5min":0.751,"15min":0.751},"max":{"1min":2.258,"5min":2.2690000000000001,"15min":3.1739999999999999},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.401,"15min":1.383},"min":{"1min":1.218,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.071},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.413,"15min":1.4039999999999999},"min":{"1min":1.1599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.794,"5min":7.532,"15min":16.058},"last":1.254}]},{"osd":6,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.526,"15min":1.4850000000000001},"min":{"1min":1.353,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.375,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.47,"15min":1.448},"min":{"1min":1.1739999999999999,"5min":0.754,"15min":0.754},"max":{"1min":2.3010000000000002,"5min":2.3359999999999999,"15min":3.2240000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.532,"15min":1.5269999999999999},"min":{"1min":1.2110000000000001,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.1549999999999998,"5min":2.4460000000000002,"15min":3.3330000000000002},"last":1.101},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5129999999999999,"15min":1.4630000000000001},"min":{"1min":1.278,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9139999999999999,"5min":4.9939999999999998,"15min":6.5670000000000002},"last":1.337}]}]}],"pool_statfs":[]}} 2023-08-10T10:50:15.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:50:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.378+0000 7f2164ff3640 1 Processor -- start 2023-08-10T10:50:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.379+0000 7f2164ff3640 1 -- start start 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f2164ff3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21600b0c60 0x7f21600c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f2164ff3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f21600c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f2164ff3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2160071c70 con 0x7f216015aa40 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f2164ff3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21600713d0 con 0x7f21600b0c60 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f2164ff3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21600716b0 con 0x7f21600b3f30 2023-08-10T10:50:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f215e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f216015aa40 0x7f21600b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41120/0 (socket says 172.21.15.50:41120) 2023-08-10T10:50:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.380+0000 7f215e59c640 1 -- 172.21.15.50:0/316031453 learned_addr learned my addr 172.21.15.50:0/316031453 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215ed9d640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f21600c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f2157fff640 1 --2- 172.21.15.50:0/316031453 >> v2:172.21.15.117:3300/0 conn(0x7f21600b0c60 0x7f21600c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832235647 0 0) 0x7f2160071c70 con 0x7f216015aa40 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003520 con 0x7f216015aa40 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328191891 0 0) 0x7f214c003520 con 0x7f216015aa40 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 msgr2=0x7f21600c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f21600c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 >> v2:172.21.15.117:3300/0 conn(0x7f21600b0c60 msgr2=0x7f21600c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 --2- 172.21.15.50:0/316031453 >> v2:172.21.15.117:3300/0 conn(0x7f21600b0c60 0x7f21600c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160071990 con 0x7f216015aa40 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.381+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f2150001670 con 0x7f216015aa40 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 >> v1:172.21.15.50:6789/0 conn(0x7f216015aa40 legacy=0x7f21600b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f214c0047c0 0x7f214c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f214c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600713d0 con 0x7f214c0047c0 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600716b0 con 0x7f214c003970 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c00b9b0 con 0x7f21600b3f30 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f214c0047c0 0x7f214c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215e59c640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215ed9d640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f214c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 -- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 msgr2=0x7f214c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f214c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 -- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f214c003970 msgr2=0x7f214c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f2157fff640 1 -- 172.21.15.50:0/316031453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c003520 con 0x7f214c0047c0 2023-08-10T10:50:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215e59c640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.382+0000 7f215ed9d640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21600b3f30 0x7f214c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f2157fff640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f214c0047c0 0x7f214c004c40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f2148009ac0 tx=0x7f214c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7774e7c55e0722 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214802c6d0 con 0x7f214c0047c0 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214802c830 con 0x7f214c0047c0 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f215dd9b640 1 -- 172.21.15.50:0/316031453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214802cbc0 con 0x7f214c0047c0 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f2164ff3640 1 -- 172.21.15.50:0/316031453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f214c0047c0 msgr2=0x7f214c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f2164ff3640 1 --2- 172.21.15.50:0/316031453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f214c0047c0 0x7f214c004c40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f2148009ac0 tx=0x7f214c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.384+0000 7f215ed9d640 1 -- 172.21.15.50:0/316031453 reap_dead start 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.385+0000 7f2164ff3640 1 -- 172.21.15.50:0/316031453 shutdown_connections 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.385+0000 7f2164ff3640 1 -- 172.21.15.50:0/316031453 >> 172.21.15.50:0/316031453 conn(0x7f216006b590 msgr2=0x7f21600ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.385+0000 7f2164ff3640 1 -- 172.21.15.50:0/316031453 shutdown_connections 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.385+0000 7f2164ff3640 1 -- 172.21.15.50:0/316031453 wait complete. 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.387+0000 7f2164ff3640 1 Processor -- start 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.387+0000 7f2164ff3640 1 -- start start 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f214c0047c0 0x7f216015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2160151700 0x7f21600c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160152540 con 0x7f21600c8150 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160152820 con 0x7f2160151700 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f2164ff3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160152b00 con 0x7f214c0047c0 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f215ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f215ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54214/0 (socket says 172.21.15.50:54214) 2023-08-10T10:50:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.388+0000 7f215ed9d640 1 -- 172.21.15.50:0/3473332669 learned_addr learned my addr 172.21.15.50:0/3473332669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f2157fff640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2160151700 0x7f21600c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215e59c640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f214c0047c0 0x7f216015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 -- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f214c0047c0 msgr2=0x7f216015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f214c0047c0 0x7f216015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 -- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2160151700 msgr2=0x7f21600c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2160151700 0x7f21600c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 -- 172.21.15.50:0/3473332669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160152de0 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f215ed9d640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f21600c9090 tx=0x7f215800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158017400 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158011040 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158017780 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.389+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21601530c0 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.390+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2160151b60 con 0x7f21600c8150 2023-08-10T10:50:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.391+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21601532b0 con 0x7f21600c8150 2023-08-10T10:50:15.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.392+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21580203b0 con 0x7f21600c8150 2023-08-10T10:50:15.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.393+0000 7f2156ffd640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 0x7f214006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.393+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2158089730 con 0x7f21600c8150 2023-08-10T10:50:15.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.393+0000 7f215e59c640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 0x7f214006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.394+0000 7f215e59c640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 0x7f214006d140 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2150000f60 tx=0x7f2150009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.397+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f21580546b0 con 0x7f21600c8150 2023-08-10T10:50:15.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:50:15.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:50:15.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.586+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21600663d0 con 0x7f214006ac80 2023-08-10T10:50:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.600+0000 7f2156ffd640 1 -- 172.21.15.50:0/3473332669 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302945 (secure 0 0 0) 0x7f21600663d0 con 0x7f214006ac80 2023-08-10T10:50:15.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:15.606 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:50:15.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.605+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 msgr2=0x7f214006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.605+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 0x7f214006d140 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2150000f60 tx=0x7f2150009040 comp rx=0 tx=0).stop 2023-08-10T10:50:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.605+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 msgr2=0x7f21600cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.605+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f21600c9090 tx=0x7f215800f4a0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 shutdown_connections 2023-08-10T10:50:15.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600c8150 0x7f21600cad10 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f214006ac80 0x7f214006d140 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2160151700 0x7f21600c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 --2- 172.21.15.50:0/3473332669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f214c0047c0 0x7f216015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 >> 172.21.15.50:0/3473332669 conn(0x7f216006b590 msgr2=0x7f21600cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 shutdown_connections 2023-08-10T10:50:15.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.606+0000 7f2164ff3640 1 -- 172.21.15.50:0/3473332669 wait complete. 2023-08-10T10:50:15.628 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":527,"stamp":"2023-08-10T10:50:14.572199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553296,"statfs":{"total":1600000000,"available":1590575746,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002254"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271379+0000","last_change":"2023-08-10T10:50:10.291593+0000","last_active":"2023-08-10T10:50:11.271379+0000","last_peered":"2023-08-10T10:50:11.271379+0000","last_clean":"2023-08-10T10:50:11.271379+0000","last_became_active":"2023-08-10T10:50:10.290710+0000","last_became_peered":"2023-08-10T10:50:10.290710+0000","last_unstale":"2023-08-10T10:50:11.271379+0000","last_undegraded":"2023-08-10T10:50:11.271379+0000","last_fullsized":"2023-08-10T10:50:11.271379+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:33:27.052191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360545+0000","last_change":"2023-08-10T10:50:10.293331+0000","last_active":"2023-08-10T10:50:11.360545+0000","last_peered":"2023-08-10T10:50:11.360545+0000","last_clean":"2023-08-10T10:50:11.360545+0000","last_became_active":"2023-08-10T10:50:10.291933+0000","last_became_peered":"2023-08-10T10:50:10.291933+0000","last_unstale":"2023-08-10T10:50:11.360545+0000","last_undegraded":"2023-08-10T10:50:11.360545+0000","last_fullsized":"2023-08-10T10:50:11.360545+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:53.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361431+0000","last_change":"2023-08-10T10:50:10.293787+0000","last_active":"2023-08-10T10:50:11.361431+0000","last_peered":"2023-08-10T10:50:11.361431+0000","last_clean":"2023-08-10T10:50:11.361431+0000","last_became_active":"2023-08-10T10:50:10.293475+0000","last_became_peered":"2023-08-10T10:50:10.293475+0000","last_unstale":"2023-08-10T10:50:11.361431+0000","last_undegraded":"2023-08-10T10:50:11.361431+0000","last_fullsized":"2023-08-10T10:50:11.361431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:45.444769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362174+0000","last_change":"2023-08-10T10:50:10.302858+0000","last_active":"2023-08-10T10:50:11.362174+0000","last_peered":"2023-08-10T10:50:11.362174+0000","last_clean":"2023-08-10T10:50:11.362174+0000","last_became_active":"2023-08-10T10:50:10.298593+0000","last_became_peered":"2023-08-10T10:50:10.298593+0000","last_unstale":"2023-08-10T10:50:11.362174+0000","last_undegraded":"2023-08-10T10:50:11.362174+0000","last_fullsized":"2023-08-10T10:50:11.362174+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:20:46.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268845+0000","last_change":"2023-08-10T10:50:10.278610+0000","last_active":"2023-08-10T10:50:11.268845+0000","last_peered":"2023-08-10T10:50:11.268845+0000","last_clean":"2023-08-10T10:50:11.268845+0000","last_became_active":"2023-08-10T10:50:10.276731+0000","last_became_peered":"2023-08-10T10:50:10.276731+0000","last_unstale":"2023-08-10T10:50:11.268845+0000","last_undegraded":"2023-08-10T10:50:11.268845+0000","last_fullsized":"2023-08-10T10:50:11.268845+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:06.417467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268529+0000","last_change":"2023-08-10T10:50:10.273669+0000","last_active":"2023-08-10T10:50:11.268529+0000","last_peered":"2023-08-10T10:50:11.268529+0000","last_clean":"2023-08-10T10:50:11.268529+0000","last_became_active":"2023-08-10T10:50:10.272997+0000","last_became_peered":"2023-08-10T10:50:10.272997+0000","last_unstale":"2023-08-10T10:50:11.268529+0000","last_undegraded":"2023-08-10T10:50:11.268529+0000","last_fullsized":"2023-08-10T10:50:11.268529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:33.469727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271006+0000","last_change":"2023-08-10T10:50:10.297943+0000","last_active":"2023-08-10T10:50:11.271006+0000","last_peered":"2023-08-10T10:50:11.271006+0000","last_clean":"2023-08-10T10:50:11.271006+0000","last_became_active":"2023-08-10T10:50:10.297529+0000","last_became_peered":"2023-08-10T10:50:10.297529+0000","last_unstale":"2023-08-10T10:50:11.271006+0000","last_undegraded":"2023-08-10T10:50:11.271006+0000","last_fullsized":"2023-08-10T10:50:11.271006+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:41:00.471693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272521+0000","last_change":"2023-08-10T10:50:10.293431+0000","last_active":"2023-08-10T10:50:11.272521+0000","last_peered":"2023-08-10T10:50:11.272521+0000","last_clean":"2023-08-10T10:50:11.272521+0000","last_became_active":"2023-08-10T10:50:10.293094+0000","last_became_peered":"2023-08-10T10:50:10.293094+0000","last_unstale":"2023-08-10T10:50:11.272521+0000","last_undegraded":"2023-08-10T10:50:11.272521+0000","last_fullsized":"2023-08-10T10:50:11.272521+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:47:47.990803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268611+0000","last_change":"2023-08-10T10:50:10.298305+0000","last_active":"2023-08-10T10:50:11.268611+0000","last_peered":"2023-08-10T10:50:11.268611+0000","last_clean":"2023-08-10T10:50:11.268611+0000","last_became_active":"2023-08-10T10:50:10.298043+0000","last_became_peered":"2023-08-10T10:50:10.298043+0000","last_unstale":"2023-08-10T10:50:11.268611+0000","last_undegraded":"2023-08-10T10:50:11.268611+0000","last_fullsized":"2023-08-10T10:50:11.268611+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:01.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268923+0000","last_change":"2023-08-10T10:50:10.277380+0000","last_active":"2023-08-10T10:50:11.268923+0000","last_peered":"2023-08-10T10:50:11.268923+0000","last_clean":"2023-08-10T10:50:11.268923+0000","last_became_active":"2023-08-10T10:50:10.274614+0000","last_became_peered":"2023-08-10T10:50:10.274614+0000","last_unstale":"2023-08-10T10:50:11.268923+0000","last_undegraded":"2023-08-10T10:50:11.268923+0000","last_fullsized":"2023-08-10T10:50:11.268923+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:47.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362173+0000","last_change":"2023-08-10T10:50:10.295189+0000","last_active":"2023-08-10T10:50:11.362173+0000","last_peered":"2023-08-10T10:50:11.362173+0000","last_clean":"2023-08-10T10:50:11.362173+0000","last_became_active":"2023-08-10T10:50:10.294815+0000","last_became_peered":"2023-08-10T10:50:10.294815+0000","last_unstale":"2023-08-10T10:50:11.362173+0000","last_undegraded":"2023-08-10T10:50:11.362173+0000","last_fullsized":"2023-08-10T10:50:11.362173+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:01:08.891493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362119+0000","last_change":"2023-08-10T10:50:10.302807+0000","last_active":"2023-08-10T10:50:11.362119+0000","last_peered":"2023-08-10T10:50:11.362119+0000","last_clean":"2023-08-10T10:50:11.362119+0000","last_became_active":"2023-08-10T10:50:10.300269+0000","last_became_peered":"2023-08-10T10:50:10.300269+0000","last_unstale":"2023-08-10T10:50:11.362119+0000","last_undegraded":"2023-08-10T10:50:11.362119+0000","last_fullsized":"2023-08-10T10:50:11.362119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:33.469727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268336+0000","last_change":"2023-08-10T10:50:10.275221+0000","last_active":"2023-08-10T10:50:11.268336+0000","last_peered":"2023-08-10T10:50:11.268336+0000","last_clean":"2023-08-10T10:50:11.268336+0000","last_became_active":"2023-08-10T10:50:10.274484+0000","last_became_peered":"2023-08-10T10:50:10.274484+0000","last_unstale":"2023-08-10T10:50:11.268336+0000","last_undegraded":"2023-08-10T10:50:11.268336+0000","last_fullsized":"2023-08-10T10:50:11.268336+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:50:09.853488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362620+0000","last_change":"2023-08-10T10:50:10.302241+0000","last_active":"2023-08-10T10:50:11.362620+0000","last_peered":"2023-08-10T10:50:11.362620+0000","last_clean":"2023-08-10T10:50:11.362620+0000","last_became_active":"2023-08-10T10:50:10.295989+0000","last_became_peered":"2023-08-10T10:50:10.295989+0000","last_unstale":"2023-08-10T10:50:11.362620+0000","last_undegraded":"2023-08-10T10:50:11.362620+0000","last_fullsized":"2023-08-10T10:50:11.362620+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:32.145208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361614+0000","last_change":"2023-08-10T10:50:10.289588+0000","last_active":"2023-08-10T10:50:11.361614+0000","last_peered":"2023-08-10T10:50:11.361614+0000","last_clean":"2023-08-10T10:50:11.361614+0000","last_became_active":"2023-08-10T10:50:10.288669+0000","last_became_peered":"2023-08-10T10:50:10.288669+0000","last_unstale":"2023-08-10T10:50:11.361614+0000","last_undegraded":"2023-08-10T10:50:11.361614+0000","last_fullsized":"2023-08-10T10:50:11.361614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:45.397167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268860+0000","last_change":"2023-08-10T10:50:10.294797+0000","last_active":"2023-08-10T10:50:11.268860+0000","last_peered":"2023-08-10T10:50:11.268860+0000","last_clean":"2023-08-10T10:50:11.268860+0000","last_became_active":"2023-08-10T10:50:10.293889+0000","last_became_peered":"2023-08-10T10:50:10.293889+0000","last_unstale":"2023-08-10T10:50:11.268860+0000","last_undegraded":"2023-08-10T10:50:11.268860+0000","last_fullsized":"2023-08-10T10:50:11.268860+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:21.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363687+0000","last_change":"2023-08-10T10:50:10.290257+0000","last_active":"2023-08-10T10:50:11.363687+0000","last_peered":"2023-08-10T10:50:11.363687+0000","last_clean":"2023-08-10T10:50:11.363687+0000","last_became_active":"2023-08-10T10:50:10.289251+0000","last_became_peered":"2023-08-10T10:50:10.289251+0000","last_unstale":"2023-08-10T10:50:11.363687+0000","last_undegraded":"2023-08-10T10:50:11.363687+0000","last_fullsized":"2023-08-10T10:50:11.363687+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:12:12.534474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363195+0000","last_change":"2023-08-10T10:50:10.298806+0000","last_active":"2023-08-10T10:50:11.363195+0000","last_peered":"2023-08-10T10:50:11.363195+0000","last_clean":"2023-08-10T10:50:11.363195+0000","last_became_active":"2023-08-10T10:50:10.298554+0000","last_became_peered":"2023-08-10T10:50:10.298554+0000","last_unstale":"2023-08-10T10:50:11.363195+0000","last_undegraded":"2023-08-10T10:50:11.363195+0000","last_fullsized":"2023-08-10T10:50:11.363195+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:38.216056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362770+0000","last_change":"2023-08-10T10:50:10.305524+0000","last_active":"2023-08-10T10:50:11.362770+0000","last_peered":"2023-08-10T10:50:11.362770+0000","last_clean":"2023-08-10T10:50:11.362770+0000","last_became_active":"2023-08-10T10:50:10.305224+0000","last_became_peered":"2023-08-10T10:50:10.305224+0000","last_unstale":"2023-08-10T10:50:11.362770+0000","last_undegraded":"2023-08-10T10:50:11.362770+0000","last_fullsized":"2023-08-10T10:50:11.362770+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:54:12.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364448+0000","last_change":"2023-08-10T10:50:10.289017+0000","last_active":"2023-08-10T10:50:11.364448+0000","last_peered":"2023-08-10T10:50:11.364448+0000","last_clean":"2023-08-10T10:50:11.364448+0000","last_became_active":"2023-08-10T10:50:10.287979+0000","last_became_peered":"2023-08-10T10:50:10.287979+0000","last_unstale":"2023-08-10T10:50:11.364448+0000","last_undegraded":"2023-08-10T10:50:11.364448+0000","last_fullsized":"2023-08-10T10:50:11.364448+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:31:18.098882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269062+0000","last_change":"2023-08-10T10:50:10.294260+0000","last_active":"2023-08-10T10:50:11.269062+0000","last_peered":"2023-08-10T10:50:11.269062+0000","last_clean":"2023-08-10T10:50:11.269062+0000","last_became_active":"2023-08-10T10:50:10.292820+0000","last_became_peered":"2023-08-10T10:50:10.292820+0000","last_unstale":"2023-08-10T10:50:11.269062+0000","last_undegraded":"2023-08-10T10:50:11.269062+0000","last_fullsized":"2023-08-10T10:50:11.269062+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:45:40.427391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271327+0000","last_change":"2023-08-10T10:50:10.297783+0000","last_active":"2023-08-10T10:50:11.271327+0000","last_peered":"2023-08-10T10:50:11.271327+0000","last_clean":"2023-08-10T10:50:11.271327+0000","last_became_active":"2023-08-10T10:50:10.297103+0000","last_became_peered":"2023-08-10T10:50:10.297103+0000","last_unstale":"2023-08-10T10:50:11.271327+0000","last_undegraded":"2023-08-10T10:50:11.271327+0000","last_fullsized":"2023-08-10T10:50:11.271327+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:41.726201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272889+0000","last_change":"2023-08-10T10:50:10.299965+0000","last_active":"2023-08-10T10:50:11.272889+0000","last_peered":"2023-08-10T10:50:11.272889+0000","last_clean":"2023-08-10T10:50:11.272889+0000","last_became_active":"2023-08-10T10:50:10.299553+0000","last_became_peered":"2023-08-10T10:50:10.299553+0000","last_unstale":"2023-08-10T10:50:11.272889+0000","last_undegraded":"2023-08-10T10:50:11.272889+0000","last_fullsized":"2023-08-10T10:50:11.272889+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:49.701410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362023+0000","last_change":"2023-08-10T10:50:10.290053+0000","last_active":"2023-08-10T10:50:11.362023+0000","last_peered":"2023-08-10T10:50:11.362023+0000","last_clean":"2023-08-10T10:50:11.362023+0000","last_became_active":"2023-08-10T10:50:10.289541+0000","last_became_peered":"2023-08-10T10:50:10.289541+0000","last_unstale":"2023-08-10T10:50:11.362023+0000","last_undegraded":"2023-08-10T10:50:11.362023+0000","last_fullsized":"2023-08-10T10:50:11.362023+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:13.333619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272454+0000","last_change":"2023-08-10T10:50:10.275743+0000","last_active":"2023-08-10T10:50:11.272454+0000","last_peered":"2023-08-10T10:50:11.272454+0000","last_clean":"2023-08-10T10:50:11.272454+0000","last_became_active":"2023-08-10T10:50:10.274401+0000","last_became_peered":"2023-08-10T10:50:10.274401+0000","last_unstale":"2023-08-10T10:50:11.272454+0000","last_undegraded":"2023-08-10T10:50:11.272454+0000","last_fullsized":"2023-08-10T10:50:11.272454+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:53.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271713+0000","last_change":"2023-08-10T10:50:10.291278+0000","last_active":"2023-08-10T10:50:11.271713+0000","last_peered":"2023-08-10T10:50:11.271713+0000","last_clean":"2023-08-10T10:50:11.271713+0000","last_became_active":"2023-08-10T10:50:10.290051+0000","last_became_peered":"2023-08-10T10:50:10.290051+0000","last_unstale":"2023-08-10T10:50:11.271713+0000","last_undegraded":"2023-08-10T10:50:11.271713+0000","last_fullsized":"2023-08-10T10:50:11.271713+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:10:25.895844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268595+0000","last_change":"2023-08-10T10:50:10.289979+0000","last_active":"2023-08-10T10:50:11.268595+0000","last_peered":"2023-08-10T10:50:11.268595+0000","last_clean":"2023-08-10T10:50:11.268595+0000","last_became_active":"2023-08-10T10:50:10.288829+0000","last_became_peered":"2023-08-10T10:50:10.288829+0000","last_unstale":"2023-08-10T10:50:11.268595+0000","last_undegraded":"2023-08-10T10:50:11.268595+0000","last_fullsized":"2023-08-10T10:50:11.268595+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:20:46.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363539+0000","last_change":"2023-08-10T10:50:10.294581+0000","last_active":"2023-08-10T10:50:11.363539+0000","last_peered":"2023-08-10T10:50:11.363539+0000","last_clean":"2023-08-10T10:50:11.363539+0000","last_became_active":"2023-08-10T10:50:10.292458+0000","last_became_peered":"2023-08-10T10:50:10.292458+0000","last_unstale":"2023-08-10T10:50:11.363539+0000","last_undegraded":"2023-08-10T10:50:11.363539+0000","last_fullsized":"2023-08-10T10:50:11.363539+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:44.680492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274448+0000","last_change":"2023-08-10T10:50:10.304525+0000","last_active":"2023-08-10T10:50:11.274448+0000","last_peered":"2023-08-10T10:50:11.274448+0000","last_clean":"2023-08-10T10:50:11.274448+0000","last_became_active":"2023-08-10T10:50:10.301244+0000","last_became_peered":"2023-08-10T10:50:10.301244+0000","last_unstale":"2023-08-10T10:50:11.274448+0000","last_undegraded":"2023-08-10T10:50:11.274448+0000","last_fullsized":"2023-08-10T10:50:11.274448+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:19:47.849154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362461+0000","last_change":"2023-08-10T10:50:10.297263+0000","last_active":"2023-08-10T10:50:11.362461+0000","last_peered":"2023-08-10T10:50:11.362461+0000","last_clean":"2023-08-10T10:50:11.362461+0000","last_became_active":"2023-08-10T10:50:10.297004+0000","last_became_peered":"2023-08-10T10:50:10.297004+0000","last_unstale":"2023-08-10T10:50:11.362461+0000","last_undegraded":"2023-08-10T10:50:11.362461+0000","last_fullsized":"2023-08-10T10:50:11.362461+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:06.732272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269237+0000","last_change":"2023-08-10T10:50:10.294596+0000","last_active":"2023-08-10T10:50:11.269237+0000","last_peered":"2023-08-10T10:50:11.269237+0000","last_clean":"2023-08-10T10:50:11.269237+0000","last_became_active":"2023-08-10T10:50:10.293528+0000","last_became_peered":"2023-08-10T10:50:10.293528+0000","last_unstale":"2023-08-10T10:50:11.269237+0000","last_undegraded":"2023-08-10T10:50:11.269237+0000","last_fullsized":"2023-08-10T10:50:11.269237+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:42:44.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273763+0000","last_change":"2023-08-10T10:50:10.294209+0000","last_active":"2023-08-10T10:50:11.273763+0000","last_peered":"2023-08-10T10:50:11.273763+0000","last_clean":"2023-08-10T10:50:11.273763+0000","last_became_active":"2023-08-10T10:50:10.293667+0000","last_became_peered":"2023-08-10T10:50:10.293667+0000","last_unstale":"2023-08-10T10:50:11.273763+0000","last_undegraded":"2023-08-10T10:50:11.273763+0000","last_fullsized":"2023-08-10T10:50:11.273763+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:32:38.880985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361161+0000","last_change":"2023-08-10T10:50:10.293778+0000","last_active":"2023-08-10T10:50:11.361161+0000","last_peered":"2023-08-10T10:50:11.361161+0000","last_clean":"2023-08-10T10:50:11.361161+0000","last_became_active":"2023-08-10T10:50:10.293447+0000","last_became_peered":"2023-08-10T10:50:10.293447+0000","last_unstale":"2023-08-10T10:50:11.361161+0000","last_undegraded":"2023-08-10T10:50:11.361161+0000","last_fullsized":"2023-08-10T10:50:11.361161+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:32.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268636+0000","last_change":"2023-08-10T10:50:09.243332+0000","last_active":"2023-08-10T10:50:11.268636+0000","last_peered":"2023-08-10T10:50:11.268636+0000","last_clean":"2023-08-10T10:50:11.268636+0000","last_became_active":"2023-08-10T10:50:09.242922+0000","last_became_peered":"2023-08-10T10:50:09.242922+0000","last_unstale":"2023-08-10T10:50:11.268636+0000","last_undegraded":"2023-08-10T10:50:11.268636+0000","last_fullsized":"2023-08-10T10:50:11.268636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:31.129377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361752+0000","last_change":"2023-08-10T10:50:10.291578+0000","last_active":"2023-08-10T10:50:11.361752+0000","last_peered":"2023-08-10T10:50:11.361752+0000","last_clean":"2023-08-10T10:50:11.361752+0000","last_became_active":"2023-08-10T10:50:10.291200+0000","last_became_peered":"2023-08-10T10:50:10.291200+0000","last_unstale":"2023-08-10T10:50:11.361752+0000","last_undegraded":"2023-08-10T10:50:11.361752+0000","last_fullsized":"2023-08-10T10:50:11.361752+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:31:31.562172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361796+0000","last_change":"2023-08-10T10:50:09.254835+0000","last_active":"2023-08-10T10:50:11.361796+0000","last_peered":"2023-08-10T10:50:11.361796+0000","last_clean":"2023-08-10T10:50:11.361796+0000","last_became_active":"2023-08-10T10:50:09.253560+0000","last_became_peered":"2023-08-10T10:50:09.253560+0000","last_unstale":"2023-08-10T10:50:11.361796+0000","last_undegraded":"2023-08-10T10:50:11.361796+0000","last_fullsized":"2023-08-10T10:50:11.361796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:12.287107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274778+0000","last_change":"2023-08-10T10:50:10.305059+0000","last_active":"2023-08-10T10:50:11.274778+0000","last_peered":"2023-08-10T10:50:11.274778+0000","last_clean":"2023-08-10T10:50:11.274778+0000","last_became_active":"2023-08-10T10:50:10.304122+0000","last_became_peered":"2023-08-10T10:50:10.304122+0000","last_unstale":"2023-08-10T10:50:11.274778+0000","last_undegraded":"2023-08-10T10:50:11.274778+0000","last_fullsized":"2023-08-10T10:50:11.274778+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:19:36.963127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363134+0000","last_change":"2023-08-10T10:50:09.253782+0000","last_active":"2023-08-10T10:50:11.363134+0000","last_peered":"2023-08-10T10:50:11.363134+0000","last_clean":"2023-08-10T10:50:11.363134+0000","last_became_active":"2023-08-10T10:50:09.253461+0000","last_became_peered":"2023-08-10T10:50:09.253461+0000","last_unstale":"2023-08-10T10:50:11.363134+0000","last_undegraded":"2023-08-10T10:50:11.363134+0000","last_fullsized":"2023-08-10T10:50:11.363134+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:27:16.549970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363083+0000","last_change":"2023-08-10T10:50:10.300508+0000","last_active":"2023-08-10T10:50:11.363083+0000","last_peered":"2023-08-10T10:50:11.363083+0000","last_clean":"2023-08-10T10:50:11.363083+0000","last_became_active":"2023-08-10T10:50:10.300170+0000","last_became_peered":"2023-08-10T10:50:10.300170+0000","last_unstale":"2023-08-10T10:50:11.363083+0000","last_undegraded":"2023-08-10T10:50:11.363083+0000","last_fullsized":"2023-08-10T10:50:11.363083+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:37:04.910356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361261+0000","last_change":"2023-08-10T10:50:09.251627+0000","last_active":"2023-08-10T10:50:11.361261+0000","last_peered":"2023-08-10T10:50:11.361261+0000","last_clean":"2023-08-10T10:50:11.361261+0000","last_became_active":"2023-08-10T10:50:09.250795+0000","last_became_peered":"2023-08-10T10:50:09.250795+0000","last_unstale":"2023-08-10T10:50:11.361261+0000","last_undegraded":"2023-08-10T10:50:11.361261+0000","last_fullsized":"2023-08-10T10:50:11.361261+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:40.594831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363347+0000","last_change":"2023-08-10T10:50:10.289241+0000","last_active":"2023-08-10T10:50:11.363347+0000","last_peered":"2023-08-10T10:50:11.363347+0000","last_clean":"2023-08-10T10:50:11.363347+0000","last_became_active":"2023-08-10T10:50:10.288642+0000","last_became_peered":"2023-08-10T10:50:10.288642+0000","last_unstale":"2023-08-10T10:50:11.363347+0000","last_undegraded":"2023-08-10T10:50:11.363347+0000","last_fullsized":"2023-08-10T10:50:11.363347+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:32:46.214716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274013+0000","last_change":"2023-08-10T10:50:09.252421+0000","last_active":"2023-08-10T10:50:11.274013+0000","last_peered":"2023-08-10T10:50:11.274013+0000","last_clean":"2023-08-10T10:50:11.274013+0000","last_became_active":"2023-08-10T10:50:09.251762+0000","last_became_peered":"2023-08-10T10:50:09.251762+0000","last_unstale":"2023-08-10T10:50:11.274013+0000","last_undegraded":"2023-08-10T10:50:11.274013+0000","last_fullsized":"2023-08-10T10:50:11.274013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:59:42.404075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363018+0000","last_change":"2023-08-10T10:50:10.300111+0000","last_active":"2023-08-10T10:50:11.363018+0000","last_peered":"2023-08-10T10:50:11.363018+0000","last_clean":"2023-08-10T10:50:11.363018+0000","last_became_active":"2023-08-10T10:50:10.290463+0000","last_became_peered":"2023-08-10T10:50:10.290463+0000","last_unstale":"2023-08-10T10:50:11.363018+0000","last_undegraded":"2023-08-10T10:50:11.363018+0000","last_fullsized":"2023-08-10T10:50:11.363018+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:06.417467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268881+0000","last_change":"2023-08-10T10:50:09.255772+0000","last_active":"2023-08-10T10:50:11.268881+0000","last_peered":"2023-08-10T10:50:11.268881+0000","last_clean":"2023-08-10T10:50:11.268881+0000","last_became_active":"2023-08-10T10:50:09.255205+0000","last_became_peered":"2023-08-10T10:50:09.255205+0000","last_unstale":"2023-08-10T10:50:11.268881+0000","last_undegraded":"2023-08-10T10:50:11.268881+0000","last_fullsized":"2023-08-10T10:50:11.268881+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:12:11.518643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360684+0000","last_change":"2023-08-10T10:50:10.292373+0000","last_active":"2023-08-10T10:50:11.360684+0000","last_peered":"2023-08-10T10:50:11.360684+0000","last_clean":"2023-08-10T10:50:11.360684+0000","last_became_active":"2023-08-10T10:50:10.291877+0000","last_became_peered":"2023-08-10T10:50:10.291877+0000","last_unstale":"2023-08-10T10:50:11.360684+0000","last_undegraded":"2023-08-10T10:50:11.360684+0000","last_fullsized":"2023-08-10T10:50:11.360684+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.600152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.270346+0000","last_change":"2023-08-10T10:50:09.247282+0000","last_active":"2023-08-10T10:50:11.270346+0000","last_peered":"2023-08-10T10:50:11.270346+0000","last_clean":"2023-08-10T10:50:11.270346+0000","last_became_active":"2023-08-10T10:50:09.246903+0000","last_became_peered":"2023-08-10T10:50:09.246903+0000","last_unstale":"2023-08-10T10:50:11.270346+0000","last_undegraded":"2023-08-10T10:50:11.270346+0000","last_fullsized":"2023-08-10T10:50:11.270346+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:06.370504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272142+0000","last_change":"2023-08-10T10:50:10.293955+0000","last_active":"2023-08-10T10:50:11.272142+0000","last_peered":"2023-08-10T10:50:11.272142+0000","last_clean":"2023-08-10T10:50:11.272142+0000","last_became_active":"2023-08-10T10:50:10.293554+0000","last_became_peered":"2023-08-10T10:50:10.293554+0000","last_unstale":"2023-08-10T10:50:11.272142+0000","last_undegraded":"2023-08-10T10:50:11.272142+0000","last_fullsized":"2023-08-10T10:50:11.272142+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:00.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268708+0000","last_change":"2023-08-10T10:50:09.258264+0000","last_active":"2023-08-10T10:50:11.268708+0000","last_peered":"2023-08-10T10:50:11.268708+0000","last_clean":"2023-08-10T10:50:11.268708+0000","last_became_active":"2023-08-10T10:50:09.257293+0000","last_became_peered":"2023-08-10T10:50:09.257293+0000","last_unstale":"2023-08-10T10:50:11.268708+0000","last_undegraded":"2023-08-10T10:50:11.268708+0000","last_fullsized":"2023-08-10T10:50:11.268708+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:38.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364367+0000","last_change":"2023-08-10T10:50:10.292327+0000","last_active":"2023-08-10T10:50:11.364367+0000","last_peered":"2023-08-10T10:50:11.364367+0000","last_clean":"2023-08-10T10:50:11.364367+0000","last_became_active":"2023-08-10T10:50:10.291839+0000","last_became_peered":"2023-08-10T10:50:10.291839+0000","last_unstale":"2023-08-10T10:50:11.364367+0000","last_undegraded":"2023-08-10T10:50:11.364367+0000","last_fullsized":"2023-08-10T10:50:11.364367+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:57.381727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362274+0000","last_change":"2023-08-10T10:50:09.253166+0000","last_active":"2023-08-10T10:50:11.362274+0000","last_peered":"2023-08-10T10:50:11.362274+0000","last_clean":"2023-08-10T10:50:11.362274+0000","last_became_active":"2023-08-10T10:50:09.252693+0000","last_became_peered":"2023-08-10T10:50:09.252693+0000","last_unstale":"2023-08-10T10:50:11.362274+0000","last_undegraded":"2023-08-10T10:50:11.362274+0000","last_fullsized":"2023-08-10T10:50:11.362274+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:24.683362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363723+0000","last_change":"2023-08-10T10:50:10.303543+0000","last_active":"2023-08-10T10:50:11.363723+0000","last_peered":"2023-08-10T10:50:11.363723+0000","last_clean":"2023-08-10T10:50:11.363723+0000","last_became_active":"2023-08-10T10:50:10.302873+0000","last_became_peered":"2023-08-10T10:50:10.302873+0000","last_unstale":"2023-08-10T10:50:11.363723+0000","last_undegraded":"2023-08-10T10:50:11.363723+0000","last_fullsized":"2023-08-10T10:50:11.363723+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:56.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363522+0000","last_change":"2023-08-10T10:50:09.241018+0000","last_active":"2023-08-10T10:50:11.363522+0000","last_peered":"2023-08-10T10:50:11.363522+0000","last_clean":"2023-08-10T10:50:11.363522+0000","last_became_active":"2023-08-10T10:50:09.240543+0000","last_became_peered":"2023-08-10T10:50:09.240543+0000","last_unstale":"2023-08-10T10:50:11.363522+0000","last_undegraded":"2023-08-10T10:50:11.363522+0000","last_fullsized":"2023-08-10T10:50:11.363522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:49.801933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272815+0000","last_change":"2023-08-10T10:50:10.276162+0000","last_active":"2023-08-10T10:50:11.272815+0000","last_peered":"2023-08-10T10:50:11.272815+0000","last_clean":"2023-08-10T10:50:11.272815+0000","last_became_active":"2023-08-10T10:50:10.275080+0000","last_became_peered":"2023-08-10T10:50:10.275080+0000","last_unstale":"2023-08-10T10:50:11.272815+0000","last_undegraded":"2023-08-10T10:50:11.272815+0000","last_fullsized":"2023-08-10T10:50:11.272815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:49.600152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361406+0000","last_change":"2023-08-10T10:50:09.253785+0000","last_active":"2023-08-10T10:50:11.361406+0000","last_peered":"2023-08-10T10:50:11.361406+0000","last_clean":"2023-08-10T10:50:11.361406+0000","last_became_active":"2023-08-10T10:50:09.251268+0000","last_became_peered":"2023-08-10T10:50:09.251268+0000","last_unstale":"2023-08-10T10:50:11.361406+0000","last_undegraded":"2023-08-10T10:50:11.361406+0000","last_fullsized":"2023-08-10T10:50:11.361406+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:28.944025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.270228+0000","last_change":"2023-08-10T10:50:10.292886+0000","last_active":"2023-08-10T10:50:11.270228+0000","last_peered":"2023-08-10T10:50:11.270228+0000","last_clean":"2023-08-10T10:50:11.270228+0000","last_became_active":"2023-08-10T10:50:10.292439+0000","last_became_peered":"2023-08-10T10:50:10.292439+0000","last_unstale":"2023-08-10T10:50:11.270228+0000","last_undegraded":"2023-08-10T10:50:11.270228+0000","last_fullsized":"2023-08-10T10:50:11.270228+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:34.552734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362864+0000","last_change":"2023-08-10T10:50:09.255778+0000","last_active":"2023-08-10T10:50:11.362864+0000","last_peered":"2023-08-10T10:50:11.362864+0000","last_clean":"2023-08-10T10:50:11.362864+0000","last_became_active":"2023-08-10T10:50:09.253402+0000","last_became_peered":"2023-08-10T10:50:09.253402+0000","last_unstale":"2023-08-10T10:50:11.362864+0000","last_undegraded":"2023-08-10T10:50:11.362864+0000","last_fullsized":"2023-08-10T10:50:11.362864+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:17.441228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364075+0000","last_change":"2023-08-10T10:50:10.303824+0000","last_active":"2023-08-10T10:50:11.364075+0000","last_peered":"2023-08-10T10:50:11.364075+0000","last_clean":"2023-08-10T10:50:11.364075+0000","last_became_active":"2023-08-10T10:50:10.303268+0000","last_became_peered":"2023-08-10T10:50:10.303268+0000","last_unstale":"2023-08-10T10:50:11.364075+0000","last_undegraded":"2023-08-10T10:50:11.364075+0000","last_fullsized":"2023-08-10T10:50:11.364075+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:13.172641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362487+0000","last_change":"2023-08-10T10:50:09.252472+0000","last_active":"2023-08-10T10:50:11.362487+0000","last_peered":"2023-08-10T10:50:11.362487+0000","last_clean":"2023-08-10T10:50:11.362487+0000","last_became_active":"2023-08-10T10:50:09.252227+0000","last_became_peered":"2023-08-10T10:50:09.252227+0000","last_unstale":"2023-08-10T10:50:11.362487+0000","last_undegraded":"2023-08-10T10:50:11.362487+0000","last_fullsized":"2023-08-10T10:50:11.362487+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:44.657800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362014+0000","last_change":"2023-08-10T10:50:10.294982+0000","last_active":"2023-08-10T10:50:11.362014+0000","last_peered":"2023-08-10T10:50:11.362014+0000","last_clean":"2023-08-10T10:50:11.362014+0000","last_became_active":"2023-08-10T10:50:10.294680+0000","last_became_peered":"2023-08-10T10:50:10.294680+0000","last_unstale":"2023-08-10T10:50:11.362014+0000","last_undegraded":"2023-08-10T10:50:11.362014+0000","last_fullsized":"2023-08-10T10:50:11.362014+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:27:43.664286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275703+0000","last_change":"2023-08-10T10:50:09.246445+0000","last_active":"2023-08-10T10:50:11.275703+0000","last_peered":"2023-08-10T10:50:11.275703+0000","last_clean":"2023-08-10T10:50:11.275703+0000","last_became_active":"2023-08-10T10:50:09.245945+0000","last_became_peered":"2023-08-10T10:50:09.245945+0000","last_unstale":"2023-08-10T10:50:11.275703+0000","last_undegraded":"2023-08-10T10:50:11.275703+0000","last_fullsized":"2023-08-10T10:50:11.275703+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:14:28.441136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363680+0000","last_change":"2023-08-10T10:50:10.299443+0000","last_active":"2023-08-10T10:50:11.363680+0000","last_peered":"2023-08-10T10:50:11.363680+0000","last_clean":"2023-08-10T10:50:11.363680+0000","last_became_active":"2023-08-10T10:50:10.299030+0000","last_became_peered":"2023-08-10T10:50:10.299030+0000","last_unstale":"2023-08-10T10:50:11.363680+0000","last_undegraded":"2023-08-10T10:50:11.363680+0000","last_fullsized":"2023-08-10T10:50:11.363680+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:41.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363605+0000","last_change":"2023-08-10T10:50:09.251042+0000","last_active":"2023-08-10T10:50:11.363605+0000","last_peered":"2023-08-10T10:50:11.363605+0000","last_clean":"2023-08-10T10:50:11.363605+0000","last_became_active":"2023-08-10T10:50:09.250586+0000","last_became_peered":"2023-08-10T10:50:09.250586+0000","last_unstale":"2023-08-10T10:50:11.363605+0000","last_undegraded":"2023-08-10T10:50:11.363605+0000","last_fullsized":"2023-08-10T10:50:11.363605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:18.760375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361061+0000","last_change":"2023-08-10T10:50:10.292175+0000","last_active":"2023-08-10T10:50:11.361061+0000","last_peered":"2023-08-10T10:50:11.361061+0000","last_clean":"2023-08-10T10:50:11.361061+0000","last_became_active":"2023-08-10T10:50:10.291449+0000","last_became_peered":"2023-08-10T10:50:10.291449+0000","last_unstale":"2023-08-10T10:50:11.361061+0000","last_undegraded":"2023-08-10T10:50:11.361061+0000","last_fullsized":"2023-08-10T10:50:11.361061+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:16.574616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273960+0000","last_change":"2023-08-10T10:50:09.249231+0000","last_active":"2023-08-10T10:50:11.273960+0000","last_peered":"2023-08-10T10:50:11.273960+0000","last_clean":"2023-08-10T10:50:11.273960+0000","last_became_active":"2023-08-10T10:50:09.248911+0000","last_became_peered":"2023-08-10T10:50:09.248911+0000","last_unstale":"2023-08-10T10:50:11.273960+0000","last_undegraded":"2023-08-10T10:50:11.273960+0000","last_fullsized":"2023-08-10T10:50:11.273960+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:45.524129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268644+0000","last_change":"2023-08-10T10:50:10.278109+0000","last_active":"2023-08-10T10:50:11.268644+0000","last_peered":"2023-08-10T10:50:11.268644+0000","last_clean":"2023-08-10T10:50:11.268644+0000","last_became_active":"2023-08-10T10:50:10.275857+0000","last_became_peered":"2023-08-10T10:50:10.275857+0000","last_unstale":"2023-08-10T10:50:11.268644+0000","last_undegraded":"2023-08-10T10:50:11.268644+0000","last_fullsized":"2023-08-10T10:50:11.268644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:01.835574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363824+0000","last_change":"2023-08-10T10:50:09.255058+0000","last_active":"2023-08-10T10:50:11.363824+0000","last_peered":"2023-08-10T10:50:11.363824+0000","last_clean":"2023-08-10T10:50:11.363824+0000","last_became_active":"2023-08-10T10:50:09.252000+0000","last_became_peered":"2023-08-10T10:50:09.252000+0000","last_unstale":"2023-08-10T10:50:11.363824+0000","last_undegraded":"2023-08-10T10:50:11.363824+0000","last_fullsized":"2023-08-10T10:50:11.363824+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:46.481844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363359+0000","last_change":"2023-08-10T10:50:10.301007+0000","last_active":"2023-08-10T10:50:11.363359+0000","last_peered":"2023-08-10T10:50:11.363359+0000","last_clean":"2023-08-10T10:50:11.363359+0000","last_became_active":"2023-08-10T10:50:10.291034+0000","last_became_peered":"2023-08-10T10:50:10.291034+0000","last_unstale":"2023-08-10T10:50:11.363359+0000","last_undegraded":"2023-08-10T10:50:11.363359+0000","last_fullsized":"2023-08-10T10:50:11.363359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:21.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273887+0000","last_change":"2023-08-10T10:50:09.255072+0000","last_active":"2023-08-10T10:50:11.273887+0000","last_peered":"2023-08-10T10:50:11.273887+0000","last_clean":"2023-08-10T10:50:11.273887+0000","last_became_active":"2023-08-10T10:50:09.253747+0000","last_became_peered":"2023-08-10T10:50:09.253747+0000","last_unstale":"2023-08-10T10:50:11.273887+0000","last_undegraded":"2023-08-10T10:50:11.273887+0000","last_fullsized":"2023-08-10T10:50:11.273887+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:17.556776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273288+0000","last_change":"2023-08-10T10:50:10.298450+0000","last_active":"2023-08-10T10:50:11.273288+0000","last_peered":"2023-08-10T10:50:11.273288+0000","last_clean":"2023-08-10T10:50:11.273288+0000","last_became_active":"2023-08-10T10:50:10.296349+0000","last_became_peered":"2023-08-10T10:50:10.296349+0000","last_unstale":"2023-08-10T10:50:11.273288+0000","last_undegraded":"2023-08-10T10:50:11.273288+0000","last_fullsized":"2023-08-10T10:50:11.273288+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:04.652874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360880+0000","last_change":"2023-08-10T10:50:09.253176+0000","last_active":"2023-08-10T10:50:11.360880+0000","last_peered":"2023-08-10T10:50:11.360880+0000","last_clean":"2023-08-10T10:50:11.360880+0000","last_became_active":"2023-08-10T10:50:09.252148+0000","last_became_peered":"2023-08-10T10:50:09.252148+0000","last_unstale":"2023-08-10T10:50:11.360880+0000","last_undegraded":"2023-08-10T10:50:11.360880+0000","last_fullsized":"2023-08-10T10:50:11.360880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:17.556776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268815+0000","last_change":"2023-08-10T10:50:10.291791+0000","last_active":"2023-08-10T10:50:11.268815+0000","last_peered":"2023-08-10T10:50:11.268815+0000","last_clean":"2023-08-10T10:50:11.268815+0000","last_became_active":"2023-08-10T10:50:10.291479+0000","last_became_peered":"2023-08-10T10:50:10.291479+0000","last_unstale":"2023-08-10T10:50:11.268815+0000","last_undegraded":"2023-08-10T10:50:11.268815+0000","last_fullsized":"2023-08-10T10:50:11.268815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:18.457059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269052+0000","last_change":"2023-08-10T10:50:09.257785+0000","last_active":"2023-08-10T10:50:11.269052+0000","last_peered":"2023-08-10T10:50:11.269052+0000","last_clean":"2023-08-10T10:50:11.269052+0000","last_became_active":"2023-08-10T10:50:09.256849+0000","last_became_peered":"2023-08-10T10:50:09.256849+0000","last_unstale":"2023-08-10T10:50:11.269052+0000","last_undegraded":"2023-08-10T10:50:11.269052+0000","last_fullsized":"2023-08-10T10:50:11.269052+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:17.734575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275371+0000","last_change":"2023-08-10T10:50:10.304372+0000","last_active":"2023-08-10T10:50:11.275371+0000","last_peered":"2023-08-10T10:50:11.275371+0000","last_clean":"2023-08-10T10:50:11.275371+0000","last_became_active":"2023-08-10T10:50:10.300764+0000","last_became_peered":"2023-08-10T10:50:10.300764+0000","last_unstale":"2023-08-10T10:50:11.275371+0000","last_undegraded":"2023-08-10T10:50:11.275371+0000","last_fullsized":"2023-08-10T10:50:11.275371+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:27.741404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271921+0000","last_change":"2023-08-10T10:50:09.250875+0000","last_active":"2023-08-10T10:50:11.271921+0000","last_peered":"2023-08-10T10:50:11.271921+0000","last_clean":"2023-08-10T10:50:11.271921+0000","last_became_active":"2023-08-10T10:50:09.250521+0000","last_became_peered":"2023-08-10T10:50:09.250521+0000","last_unstale":"2023-08-10T10:50:11.271921+0000","last_undegraded":"2023-08-10T10:50:11.271921+0000","last_fullsized":"2023-08-10T10:50:11.271921+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:56.259862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362212+0000","last_change":"2023-08-10T10:50:10.296255+0000","last_active":"2023-08-10T10:50:11.362212+0000","last_peered":"2023-08-10T10:50:11.362212+0000","last_clean":"2023-08-10T10:50:11.362212+0000","last_became_active":"2023-08-10T10:50:10.295941+0000","last_became_peered":"2023-08-10T10:50:10.295941+0000","last_unstale":"2023-08-10T10:50:11.362212+0000","last_undegraded":"2023-08-10T10:50:11.362212+0000","last_fullsized":"2023-08-10T10:50:11.362212+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:01.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362841+0000","last_change":"2023-08-10T10:50:09.247692+0000","last_active":"2023-08-10T10:50:11.362841+0000","last_peered":"2023-08-10T10:50:11.362841+0000","last_clean":"2023-08-10T10:50:11.362841+0000","last_became_active":"2023-08-10T10:50:09.247267+0000","last_became_peered":"2023-08-10T10:50:09.247267+0000","last_unstale":"2023-08-10T10:50:11.362841+0000","last_undegraded":"2023-08-10T10:50:11.362841+0000","last_fullsized":"2023-08-10T10:50:11.362841+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:54.484876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360847+0000","last_change":"2023-08-10T10:50:10.294262+0000","last_active":"2023-08-10T10:50:11.360847+0000","last_peered":"2023-08-10T10:50:11.360847+0000","last_clean":"2023-08-10T10:50:11.360847+0000","last_became_active":"2023-08-10T10:50:10.293880+0000","last_became_peered":"2023-08-10T10:50:10.293880+0000","last_unstale":"2023-08-10T10:50:11.360847+0000","last_undegraded":"2023-08-10T10:50:11.360847+0000","last_fullsized":"2023-08-10T10:50:11.360847+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:17.691325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.274191+0000","last_change":"2023-08-10T10:50:09.249720+0000","last_active":"2023-08-10T10:50:11.274191+0000","last_peered":"2023-08-10T10:50:11.274191+0000","last_clean":"2023-08-10T10:50:11.274191+0000","last_became_active":"2023-08-10T10:50:09.249125+0000","last_became_peered":"2023-08-10T10:50:09.249125+0000","last_unstale":"2023-08-10T10:50:11.274191+0000","last_undegraded":"2023-08-10T10:50:11.274191+0000","last_fullsized":"2023-08-10T10:50:11.274191+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:15.558786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273332+0000","last_change":"2023-08-10T10:50:10.296335+0000","last_active":"2023-08-10T10:50:11.273332+0000","last_peered":"2023-08-10T10:50:11.273332+0000","last_clean":"2023-08-10T10:50:11.273332+0000","last_became_active":"2023-08-10T10:50:10.293098+0000","last_became_peered":"2023-08-10T10:50:10.293098+0000","last_unstale":"2023-08-10T10:50:11.273332+0000","last_undegraded":"2023-08-10T10:50:11.273332+0000","last_fullsized":"2023-08-10T10:50:11.273332+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:13.261189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362139+0000","last_change":"2023-08-10T10:50:09.252336+0000","last_active":"2023-08-10T10:50:11.362139+0000","last_peered":"2023-08-10T10:50:11.362139+0000","last_clean":"2023-08-10T10:50:11.362139+0000","last_became_active":"2023-08-10T10:50:09.251965+0000","last_became_peered":"2023-08-10T10:50:09.251965+0000","last_unstale":"2023-08-10T10:50:11.362139+0000","last_undegraded":"2023-08-10T10:50:11.362139+0000","last_fullsized":"2023-08-10T10:50:11.362139+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:51.757612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272860+0000","last_change":"2023-08-10T10:50:10.297724+0000","last_active":"2023-08-10T10:50:11.272860+0000","last_peered":"2023-08-10T10:50:11.272860+0000","last_clean":"2023-08-10T10:50:11.272860+0000","last_became_active":"2023-08-10T10:50:10.295745+0000","last_became_peered":"2023-08-10T10:50:10.295745+0000","last_unstale":"2023-08-10T10:50:11.272860+0000","last_undegraded":"2023-08-10T10:50:11.272860+0000","last_fullsized":"2023-08-10T10:50:11.272860+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:14:28.557320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363176+0000","last_change":"2023-08-10T10:50:09.255195+0000","last_active":"2023-08-10T10:50:11.363176+0000","last_peered":"2023-08-10T10:50:11.363176+0000","last_clean":"2023-08-10T10:50:11.363176+0000","last_became_active":"2023-08-10T10:50:09.254943+0000","last_became_peered":"2023-08-10T10:50:09.254943+0000","last_unstale":"2023-08-10T10:50:11.363176+0000","last_undegraded":"2023-08-10T10:50:11.363176+0000","last_fullsized":"2023-08-10T10:50:11.363176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:32.761281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":435,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364311+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:50:11.364311+0000","last_peered":"2023-08-10T10:50:11.364311+0000","last_clean":"2023-08-10T10:50:11.364311+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:50:11.364311+0000","last_undegraded":"2023-08-10T10:50:11.364311+0000","last_fullsized":"2023-08-10T10:50:11.364311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:36.023512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272213+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:50:11.272213+0000","last_peered":"2023-08-10T10:50:11.272213+0000","last_clean":"2023-08-10T10:50:11.272213+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:50:11.272213+0000","last_undegraded":"2023-08-10T10:50:11.272213+0000","last_fullsized":"2023-08-10T10:50:11.272213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:47.559509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.275080+0000","last_change":"2023-08-10T10:50:10.305247+0000","last_active":"2023-08-10T10:50:11.275080+0000","last_peered":"2023-08-10T10:50:11.275080+0000","last_clean":"2023-08-10T10:50:11.275080+0000","last_became_active":"2023-08-10T10:50:10.304708+0000","last_became_peered":"2023-08-10T10:50:10.304708+0000","last_unstale":"2023-08-10T10:50:11.275080+0000","last_undegraded":"2023-08-10T10:50:11.275080+0000","last_fullsized":"2023-08-10T10:50:11.275080+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:15.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364287+0000","last_change":"2023-08-10T10:50:09.251628+0000","last_active":"2023-08-10T10:50:11.364287+0000","last_peered":"2023-08-10T10:50:11.364287+0000","last_clean":"2023-08-10T10:50:11.364287+0000","last_became_active":"2023-08-10T10:50:09.243944+0000","last_became_peered":"2023-08-10T10:50:09.243944+0000","last_unstale":"2023-08-10T10:50:11.364287+0000","last_undegraded":"2023-08-10T10:50:11.364287+0000","last_fullsized":"2023-08-10T10:50:11.364287+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:51.992457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363891+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:50:11.363891+0000","last_peered":"2023-08-10T10:50:11.363891+0000","last_clean":"2023-08-10T10:50:11.363891+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:50:11.363891+0000","last_undegraded":"2023-08-10T10:50:11.363891+0000","last_fullsized":"2023-08-10T10:50:11.363891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:08.822455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364279+0000","last_change":"2023-08-10T10:50:10.295513+0000","last_active":"2023-08-10T10:50:11.364279+0000","last_peered":"2023-08-10T10:50:11.364279+0000","last_clean":"2023-08-10T10:50:11.364279+0000","last_became_active":"2023-08-10T10:50:10.294302+0000","last_became_peered":"2023-08-10T10:50:10.294302+0000","last_unstale":"2023-08-10T10:50:11.364279+0000","last_undegraded":"2023-08-10T10:50:11.364279+0000","last_fullsized":"2023-08-10T10:50:11.364279+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:44.467278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.271540+0000","last_change":"2023-08-10T10:50:09.245570+0000","last_active":"2023-08-10T10:50:11.271540+0000","last_peered":"2023-08-10T10:50:11.271540+0000","last_clean":"2023-08-10T10:50:11.271540+0000","last_became_active":"2023-08-10T10:50:09.245166+0000","last_became_peered":"2023-08-10T10:50:09.245166+0000","last_unstale":"2023-08-10T10:50:11.271540+0000","last_undegraded":"2023-08-10T10:50:11.271540+0000","last_fullsized":"2023-08-10T10:50:11.271540+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:25.022137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.364488+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:50:11.364488+0000","last_peered":"2023-08-10T10:50:11.364488+0000","last_clean":"2023-08-10T10:50:11.364488+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:50:11.364488+0000","last_undegraded":"2023-08-10T10:50:11.364488+0000","last_fullsized":"2023-08-10T10:50:11.364488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:15:02.149985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362747+0000","last_change":"2023-08-10T10:50:10.290143+0000","last_active":"2023-08-10T10:50:11.362747+0000","last_peered":"2023-08-10T10:50:11.362747+0000","last_clean":"2023-08-10T10:50:11.362747+0000","last_became_active":"2023-08-10T10:50:10.289705+0000","last_became_peered":"2023-08-10T10:50:10.289705+0000","last_unstale":"2023-08-10T10:50:11.362747+0000","last_undegraded":"2023-08-10T10:50:11.362747+0000","last_fullsized":"2023-08-10T10:50:11.362747+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:13:44.392081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363811+0000","last_change":"2023-08-10T10:50:09.246345+0000","last_active":"2023-08-10T10:50:11.363811+0000","last_peered":"2023-08-10T10:50:11.363811+0000","last_clean":"2023-08-10T10:50:11.363811+0000","last_became_active":"2023-08-10T10:50:09.245851+0000","last_became_peered":"2023-08-10T10:50:09.245851+0000","last_unstale":"2023-08-10T10:50:11.363811+0000","last_undegraded":"2023-08-10T10:50:11.363811+0000","last_fullsized":"2023-08-10T10:50:11.363811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:25:49.120227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.272338+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:50:11.272338+0000","last_peered":"2023-08-10T10:50:11.272338+0000","last_clean":"2023-08-10T10:50:11.272338+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:50:11.272338+0000","last_undegraded":"2023-08-10T10:50:11.272338+0000","last_fullsized":"2023-08-10T10:50:11.272338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:46.634810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273233+0000","last_change":"2023-08-10T10:50:10.297806+0000","last_active":"2023-08-10T10:50:11.273233+0000","last_peered":"2023-08-10T10:50:11.273233+0000","last_clean":"2023-08-10T10:50:11.273233+0000","last_became_active":"2023-08-10T10:50:10.297345+0000","last_became_peered":"2023-08-10T10:50:10.297345+0000","last_unstale":"2023-08-10T10:50:11.273233+0000","last_undegraded":"2023-08-10T10:50:11.273233+0000","last_fullsized":"2023-08-10T10:50:11.273233+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:14:37.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.268983+0000","last_change":"2023-08-10T10:50:09.254556+0000","last_active":"2023-08-10T10:50:11.268983+0000","last_peered":"2023-08-10T10:50:11.268983+0000","last_clean":"2023-08-10T10:50:11.268983+0000","last_became_active":"2023-08-10T10:50:09.252239+0000","last_became_peered":"2023-08-10T10:50:09.252239+0000","last_unstale":"2023-08-10T10:50:11.268983+0000","last_undegraded":"2023-08-10T10:50:11.268983+0000","last_fullsized":"2023-08-10T10:50:11.268983+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:35:15.101820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362241+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:50:11.362241+0000","last_peered":"2023-08-10T10:50:11.362241+0000","last_clean":"2023-08-10T10:50:11.362241+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:50:11.362241+0000","last_undegraded":"2023-08-10T10:50:11.362241+0000","last_fullsized":"2023-08-10T10:50:11.362241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:24:36.868270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.360707+0000","last_change":"2023-08-10T10:50:10.293538+0000","last_active":"2023-08-10T10:50:11.360707+0000","last_peered":"2023-08-10T10:50:11.360707+0000","last_clean":"2023-08-10T10:50:11.360707+0000","last_became_active":"2023-08-10T10:50:10.292315+0000","last_became_peered":"2023-08-10T10:50:10.292315+0000","last_unstale":"2023-08-10T10:50:11.360707+0000","last_undegraded":"2023-08-10T10:50:11.360707+0000","last_fullsized":"2023-08-10T10:50:11.360707+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:04.652874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362416+0000","last_change":"2023-08-10T10:50:09.250500+0000","last_active":"2023-08-10T10:50:11.362416+0000","last_peered":"2023-08-10T10:50:11.362416+0000","last_clean":"2023-08-10T10:50:11.362416+0000","last_became_active":"2023-08-10T10:50:09.250227+0000","last_became_peered":"2023-08-10T10:50:09.250227+0000","last_unstale":"2023-08-10T10:50:11.362416+0000","last_undegraded":"2023-08-10T10:50:11.362416+0000","last_fullsized":"2023-08-10T10:50:11.362416+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:00.819744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362980+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:50:11.362980+0000","last_peered":"2023-08-10T10:50:11.362980+0000","last_clean":"2023-08-10T10:50:11.362980+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:50:11.362980+0000","last_undegraded":"2023-08-10T10:50:11.362980+0000","last_fullsized":"2023-08-10T10:50:11.362980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:55:43.862735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.269405+0000","last_change":"2023-08-10T10:50:10.294421+0000","last_active":"2023-08-10T10:50:11.269405+0000","last_peered":"2023-08-10T10:50:11.269405+0000","last_clean":"2023-08-10T10:50:11.269405+0000","last_became_active":"2023-08-10T10:50:10.293156+0000","last_became_peered":"2023-08-10T10:50:10.293156+0000","last_unstale":"2023-08-10T10:50:11.269405+0000","last_undegraded":"2023-08-10T10:50:11.269405+0000","last_fullsized":"2023-08-10T10:50:11.269405+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:28:02.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.362533+0000","last_change":"2023-08-10T10:50:09.256943+0000","last_active":"2023-08-10T10:50:11.362533+0000","last_peered":"2023-08-10T10:50:11.362533+0000","last_clean":"2023-08-10T10:50:11.362533+0000","last_became_active":"2023-08-10T10:50:09.256736+0000","last_became_peered":"2023-08-10T10:50:09.256736+0000","last_unstale":"2023-08-10T10:50:11.362533+0000","last_undegraded":"2023-08-10T10:50:11.362533+0000","last_fullsized":"2023-08-10T10:50:11.362533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:38.967557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361679+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:50:11.361679+0000","last_peered":"2023-08-10T10:50:11.361679+0000","last_clean":"2023-08-10T10:50:11.361679+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:50:11.361679+0000","last_undegraded":"2023-08-10T10:50:11.361679+0000","last_fullsized":"2023-08-10T10:50:11.361679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:16.117948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.361887+0000","last_change":"2023-08-10T10:50:10.296496+0000","last_active":"2023-08-10T10:50:11.361887+0000","last_peered":"2023-08-10T10:50:11.361887+0000","last_clean":"2023-08-10T10:50:11.361887+0000","last_became_active":"2023-08-10T10:50:10.296217+0000","last_became_peered":"2023-08-10T10:50:10.296217+0000","last_unstale":"2023-08-10T10:50:11.361887+0000","last_undegraded":"2023-08-10T10:50:11.361887+0000","last_fullsized":"2023-08-10T10:50:11.361887+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:09.218541+0000","last_clean_scrub_stamp":"2023-08-10T10:50:09.218541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:38.891565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"171'8","reported_seq":21,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.273530+0000","last_change":"2023-08-10T10:50:09.255285+0000","last_active":"2023-08-10T10:50:11.273530+0000","last_peered":"2023-08-10T10:50:11.273530+0000","last_clean":"2023-08-10T10:50:11.273530+0000","last_became_active":"2023-08-10T10:50:09.254467+0000","last_became_peered":"2023-08-10T10:50:09.254467+0000","last_unstale":"2023-08-10T10:50:11.273530+0000","last_undegraded":"2023-08-10T10:50:11.273530+0000","last_fullsized":"2023-08-10T10:50:11.273530+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:50:08.202710+0000","last_clean_scrub_stamp":"2023-08-10T10:50:08.202710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:00:16.675494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":272,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-10T10:50:11.363981+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:50:11.363981+0000","last_peered":"2023-08-10T10:50:11.363981+0000","last_clean":"2023-08-10T10:50:11.363981+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:50:11.363981+0000","last_undegraded":"2023-08-10T10:50:11.363981+0000","last_fullsized":"2023-08-10T10:50:11.363981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:21.001319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198379506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.234,"15min":1.151},"min":{"1min":0.83299999999999996,"5min":0.52300000000000002,"15min":0.39600000000000002},"max":{"1min":1.532,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.745},{"interface":"front","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.1279999999999999},"min":{"1min":0.80000000000000004,"5min":0.52200000000000002,"15min":0.44800000000000001},"max":{"1min":1.496,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2350000000000001,"15min":1.1739999999999999},"min":{"1min":0.88600000000000001,"5min":0.68100000000000005,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.25,"15min":1.181},"min":{"1min":0.84699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.9299999999999999,"5min":8.0830000000000002,"15min":8.0830000000000002},"last":1.3879999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.208,"15min":1.214},"min":{"1min":0.81899999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.45,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.373,"15min":1.28},"min":{"1min":1.1140000000000001,"5min":0.58599999999999997,"15min":0.497},"max":{"1min":1.8839999999999999,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.022}]},{"osd":3,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2689999999999999,"15min":1.232},"min":{"1min":0.97099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.6359999999999999,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.4750000000000001,"15min":1.403},"min":{"1min":1.298,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7769999999999999,"5min":6.069,"15min":6.069},"last":1.359}]},{"osd":4,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.3129999999999999,"15min":1.262},"min":{"1min":0.85099999999999998,"5min":0.56499999999999995,"15min":0.49099999999999999},"max":{"1min":1.7070000000000001,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.302,"15min":1.284},"min":{"1min":0.70099999999999996,"5min":0.54400000000000004,"15min":0.52600000000000002},"max":{"1min":1.5389999999999999,"5min":7.4950000000000001,"15min":7.4950000000000001},"last":1.421}]},{"osd":5,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.5,"15min":1.4590000000000001},"min":{"1min":0.78300000000000003,"5min":0.67600000000000005,"15min":0.59699999999999998},"max":{"1min":1.9430000000000001,"5min":6.0090000000000003,"15min":6.0090000000000003},"last":1.446},{"interface":"front","average":{"1min":1.468,"5min":1.5129999999999999,"15min":1.498},"min":{"1min":0.98799999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8700000000000001,"5min":7.5529999999999999,"15min":7.5529999999999999},"last":1.532}]},{"osd":6,"last update":"Thu Aug 10 10:49:28 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.657,"15min":1.587},"min":{"1min":1.2689999999999999,"5min":0.61299999999999999,"15min":0.58599999999999997},"max":{"1min":2.0459999999999998,"5min":8.859,"15min":8.859},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.546,"15min":1.5109999999999999},"min":{"1min":1.1339999999999999,"5min":0.62,"15min":0.62},"max":{"1min":2.2650000000000001,"5min":7.1139999999999999,"15min":7.1139999999999999},"last":0.92400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.173,"15min":1.1060000000000001},"min":{"1min":0.72199999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8080000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.097,"15min":1.052},"min":{"1min":0.874,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.675,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.377}]},{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.119,"15min":1.0940000000000001},"min":{"1min":0.91300000000000003,"5min":0.59899999999999998,"15min":0.58499999999999996},"max":{"1min":1.764,"5min":1.764,"15min":2.302},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.2569999999999999,"15min":1.2130000000000001},"min":{"1min":1.0669999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6839999999999999,"5min":2.052,"15min":2.052},"last":1.3440000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.232,"15min":1.1759999999999999},"min":{"1min":0.99199999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.643,"5min":1.744,"15min":2.1669999999999998},"last":1.46},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.242,"15min":1.246},"min":{"1min":0.81999999999999995,"5min":0.752,"15min":0.58699999999999997},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.968},"last":1.032}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3049999999999999,"15min":1.2689999999999999},"min":{"1min":1.198,"5min":0.80700000000000005,"15min":0.69399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":3.177},"last":1.177},{"interface":"front","average":{"1min":1.343,"5min":1.2869999999999999,"15min":1.2769999999999999},"min":{"1min":1.044,"5min":0.749,"15min":0.71599999999999997},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":2.395},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.246,"15min":1.236},"min":{"1min":0.80300000000000005,"5min":0.60699999999999998,"15min":0.49399999999999999},"max":{"1min":1.823,"5min":1.8320000000000001,"15min":2.7250000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.486,"15min":1.4510000000000001},"min":{"1min":1.228,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.8420000000000001,"5min":2.0009999999999999,"15min":2.7589999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.95599999999999996,"5min":0.69999999999999996,"15min":0.59399999999999997},"max":{"1min":1.7929999999999999,"5min":1.9419999999999999,"15min":2.4510000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.591,"5min":1.5309999999999999,"15min":1.5189999999999999},"min":{"1min":1.2330000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.899,"5min":2.1139999999999999,"15min":2.8700000000000001},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.341,"15min":1.369},"min":{"1min":0.91700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8100000000000001,"5min":2.0600000000000001,"15min":3.1019999999999999},"last":1.2},{"interface":"front","average":{"1min":1.504,"5min":1.522,"15min":1.51},"min":{"1min":1.0620000000000001,"5min":0.86299999999999999,"15min":0.65400000000000003},"max":{"1min":1.7490000000000001,"5min":2.125,"15min":2.698},"last":1.141}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1004,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194307,"statfs":{"total":200000000,"available":198970915,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.1319999999999999,"15min":1.1180000000000001},"min":{"1min":0.88100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.645,"5min":1.645,"15min":2.5070000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.208,"15min":1.2509999999999999},"min":{"1min":0.78500000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.764,"5min":1.857,"15min":32.941000000000003},"last":1.044}]},{"osd":1,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.266,"15min":1.228},"min":{"1min":0.94099999999999995,"5min":0.64800000000000002,"15min":0.51400000000000001},"max":{"1min":1.891,"5min":1.891,"15min":2.2450000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.304,"5min":1.212,"15min":1.2050000000000001},"min":{"1min":0.998,"5min":0.62,"15min":0.62},"max":{"1min":1.6679999999999999,"5min":1.6899999999999999,"15min":4.3360000000000003},"last":1.2789999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.252,"15min":1.294},"min":{"1min":0.96299999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6899999999999999,"5min":1.8700000000000001,"15min":4.1980000000000004},"last":1.484},{"interface":"front","average":{"1min":1.222,"5min":1.1799999999999999,"15min":1.1779999999999999},"min":{"1min":0.88900000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.522,"5min":1.734,"15min":1.734},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.3240000000000001,"15min":1.2789999999999999},"min":{"1min":0.99399999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.6699999999999999,"5min":2.016,"15min":2.016},"last":1.214},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.347,"15min":1.353},"min":{"1min":1.042,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.9630000000000001,"15min":4.0620000000000003},"last":1.5880000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.2689999999999999,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.68000000000000005,"15min":0.58599999999999997},"max":{"1min":1.361,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4099999999999999,"15min":1.3740000000000001},"min":{"1min":0.98299999999999998,"5min":0.755,"15min":0.58099999999999996},"max":{"1min":1.724,"5min":1.893,"15min":2.0299999999999998},"last":1.345}]},{"osd":6,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4339999999999999,"15min":1.371},"min":{"1min":1.1779999999999999,"5min":0.67700000000000005,"15min":0.54200000000000004},"max":{"1min":1.7270000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.75},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4410000000000001,"15min":1.4099999999999999},"min":{"1min":1.028,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.694,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":1.6699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:33 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5369999999999999,"15min":1.5},"min":{"1min":1.0640000000000001,"5min":0.88500000000000001,"15min":0.63100000000000001},"max":{"1min":1.7989999999999999,"5min":2.403,"15min":2.403},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.5469999999999999,"15min":1.514},"min":{"1min":1.2030000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.835,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.647}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1007,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198968332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.88200000000000001,"5min":0.67000000000000004,"15min":0.54200000000000004},"max":{"1min":1.583,"5min":2.2559999999999998,"15min":4.4009999999999998},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.175,"15min":1.198},"min":{"1min":0.97399999999999998,"5min":0.68600000000000005,"15min":0.55600000000000005},"max":{"1min":1.716,"5min":1.907,"15min":3.7629999999999999},"last":0.93799999999999994}]},{"osd":1,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2569999999999999,"15min":1.27},"min":{"1min":0.94799999999999995,"5min":0.69499999999999995,"15min":0.61899999999999999},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":3.9820000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.1950000000000001,"15min":1.1579999999999999},"min":{"1min":0.98899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5640000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3109999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.2430000000000001,"15min":1.1919999999999999},"min":{"1min":0.89900000000000002,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.7150000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3260000000000001,"15min":1.3109999999999999},"min":{"1min":0.96499999999999997,"5min":0.73899999999999999,"15min":0.70499999999999996},"max":{"1min":1.5740000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.24,"15min":1.2569999999999999},"min":{"1min":0.94899999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6819999999999999,"5min":1.893,"15min":3.8130000000000002},"last":1.375},{"interface":"front","average":{"1min":1.429,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":1.1240000000000001,"5min":0.82199999999999995,"15min":0.67000000000000004},"max":{"1min":1.792,"5min":2.5600000000000001,"15min":4.6859999999999999},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.296,"15min":1.349},"min":{"1min":0.99299999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6890000000000001,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.2689999999999999,"15min":1.2949999999999999},"min":{"1min":0.93799999999999994,"5min":0.50600000000000001,"15min":0.42399999999999999},"max":{"1min":1.7529999999999999,"5min":1.911,"15min":2.9340000000000002},"last":1.1850000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.327,"15min":1.3360000000000001},"min":{"1min":0.92500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.847,"5min":2.6190000000000002,"15min":4.5590000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4590000000000001,"15min":1.4830000000000001},"min":{"1min":0.98699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.819,"5min":2.121,"15min":5.1529999999999996},"last":1.3919999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.4670000000000001,"15min":1.4490000000000001},"min":{"1min":1.2649999999999999,"5min":0.67900000000000005,"15min":0.57999999999999996},"max":{"1min":1.8120000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5649999999999999,"15min":1.538},"min":{"1min":1.383,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.899,"5min":2.6659999999999999,"15min":4.6280000000000001},"last":1.5800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969280,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.374,"15min":0.28999999999999998},"max":{"1min":1.2949999999999999,"5min":1.6060000000000001,"15min":2.1019999999999999},"last":1.125},{"interface":"front","average":{"1min":1.212,"5min":1.129,"15min":1.0549999999999999},"min":{"1min":0.98899999999999999,"5min":0.44900000000000001,"15min":0.433},"max":{"1min":1.5669999999999999,"5min":1.9590000000000001,"15min":2.4470000000000001},"last":1.839}]},{"osd":1,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":0.96099999999999997,"15min":0.89300000000000002},"min":{"1min":0.79000000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.093,"15min":1.0089999999999999},"min":{"1min":0.82399999999999995,"5min":0.49399999999999999,"15min":0.34100000000000003},"max":{"1min":1.5489999999999999,"5min":1.6839999999999999,"15min":1.897},"last":1.514}]},{"osd":2,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.091,"15min":1.006},"min":{"1min":0.92800000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.581,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.633},{"interface":"front","average":{"1min":1.395,"5min":1.23,"15min":1.147},"min":{"1min":0.99299999999999999,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.694,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.869}]},{"osd":4,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.446,"15min":1.3160000000000001},"min":{"1min":1.1180000000000001,"5min":0.80400000000000005,"15min":0.70599999999999996},"max":{"1min":1.8120000000000001,"5min":9.8149999999999995,"15min":9.8149999999999995},"last":1.76},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":1.002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7230000000000001,"5min":2.0390000000000001,"15min":2.5179999999999998},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4570000000000001,"15min":1.3819999999999999},"min":{"1min":1.2509999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.3029999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.4139999999999999,"15min":1.3959999999999999},"min":{"1min":1.226,"5min":0.621,"15min":0.621},"max":{"1min":1.8260000000000001,"5min":2.1890000000000001,"15min":4.2069999999999999},"last":1.171}]},{"osd":6,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.395,"15min":1.329},"min":{"1min":1.149,"5min":0.83399999999999996,"15min":0.79900000000000004},"max":{"1min":1.9650000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.591},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.5149999999999999,"15min":1.452},"min":{"1min":1.377,"5min":0.749,"15min":0.749},"max":{"1min":2.2250000000000001,"5min":2.964,"15min":2.964},"last":1.8009999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.5329999999999999,"15min":1.4730000000000001},"min":{"1min":1.3640000000000001,"5min":0.85299999999999998,"15min":0.754},"max":{"1min":2.1640000000000001,"5min":2.2749999999999999,"15min":2.4950000000000001},"last":1.905},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.4670000000000001,"15min":1.3979999999999999},"min":{"1min":1.319,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.855,"5min":2.0459999999999998,"15min":2.3879999999999999},"last":1.726}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.66600000000000004,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.96999999999999997,"15min":0.93700000000000006},"min":{"1min":0.79600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.575,"5min":1.825,"15min":1.825},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.1020000000000001,"15min":1.075},"min":{"1min":0.78400000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.9630000000000001},"last":1.054},{"interface":"front","average":{"1min":1.393,"5min":1.2250000000000001,"15min":1.169},"min":{"1min":1.079,"5min":0.503,"15min":0.503},"max":{"1min":1.9179999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3140000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.76500000000000001,"5min":0.54200000000000004,"15min":0.50900000000000001},"max":{"1min":1.3859999999999999,"5min":1.877,"15min":1.877},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.1499999999999999,"15min":1.2130000000000001},"min":{"1min":0.94399999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.839,"5min":1.839,"15min":3.6920000000000002},"last":1.0029999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.371,"15min":1.4039999999999999},"min":{"1min":1.0600000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.6000000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.359,"15min":1.3260000000000001},"min":{"1min":1.0089999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8999999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.4510000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.2789999999999999,"15min":1.2829999999999999},"min":{"1min":1.099,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6799999999999999,"5min":1.819,"15min":2.2280000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.423,"15min":1.4670000000000001},"min":{"1min":1.2070000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.968,"5min":1.9870000000000001,"15min":3.294},"last":1.353}]},{"osd":6,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.4399999999999999,"15min":1.415},"min":{"1min":1.1259999999999999,"5min":0.88300000000000001,"15min":0.81599999999999995},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.206},{"interface":"front","average":{"1min":1.47,"5min":1.3660000000000001,"15min":1.371},"min":{"1min":1.0920000000000001,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.883,"5min":1.8879999999999999,"15min":2.444},"last":1.284}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.492,"15min":1.4530000000000001},"min":{"1min":1.2909999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.421,"15min":1.4379999999999999},"min":{"1min":1.363,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.8100000000000001,"5min":2.0950000000000002,"15min":2.556},"last":1.427}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.90100000000000002,"15min":0.86699999999999999},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.33100000000000002},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97699999999999998,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.706,"5min":1.706,"15min":2.246},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.024,"15min":0.94399999999999995},"min":{"1min":0.73499999999999999,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.671,"5min":1.792,"15min":2.0209999999999999},"last":1.129},{"interface":"front","average":{"1min":1.387,"5min":1.252,"15min":1.1519999999999999},"min":{"1min":0.85599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.627,"5min":1.7370000000000001,"15min":2.423},"last":1.72}]},{"osd":3,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.212,"15min":1.1200000000000001},"min":{"1min":0.85399999999999998,"5min":0.56000000000000005,"15min":0.45400000000000001},"max":{"1min":1.7150000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.123,"15min":1.0660000000000001},"min":{"1min":0.91800000000000004,"5min":0.48899999999999999,"15min":0.42399999999999999},"max":{"1min":1.569,"5min":1.8,"15min":2.8940000000000001},"last":1.298}]},{"osd":4,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.2729999999999999,"15min":1.2130000000000001},"min":{"1min":0.97699999999999998,"5min":0.74199999999999999,"15min":0.65500000000000003},"max":{"1min":1.7809999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.367},{"interface":"front","average":{"1min":1.577,"5min":1.484,"15min":1.4299999999999999},"min":{"1min":1.208,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.845,"5min":2.2989999999999999,"15min":2.343},"last":1.5469999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.4399999999999999,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.67900000000000005},"max":{"1min":1.8779999999999999,"5min":1.98,"15min":2.9969999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4430000000000001,"15min":1.3640000000000001},"min":{"1min":1.1759999999999999,"5min":0.89600000000000002,"15min":0.71699999999999997},"max":{"1min":1.9470000000000001,"5min":2.387,"15min":2.73},"last":1.5049999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.429,"15min":1.395},"min":{"1min":1.0800000000000001,"5min":0.82899999999999996,"15min":0.78400000000000003},"max":{"1min":1.982,"5min":2.0670000000000002,"15min":2.4670000000000001},"last":1.444},{"interface":"front","average":{"1min":1.446,"5min":1.417,"15min":1.327},"min":{"1min":1.1459999999999999,"5min":0.77600000000000002,"15min":0.77300000000000002},"max":{"1min":2.02,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.5289999999999999,"15min":1.47},"min":{"1min":1.1100000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.1800000000000002,"5min":2.4129999999999998,"15min":2.742},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.494,"15min":1.4450000000000001},"min":{"1min":1.218,"5min":0.82699999999999996,"15min":0.625},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.605},"last":1.593}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193728,"statfs":{"total":200000000,"available":198378277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0389999999999999,"15min":0.98799999999999999},"min":{"1min":0.72699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.506,"5min":8.6899999999999995,"15min":8.6899999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.177,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.86199999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.544,"5min":11.173,"15min":11.173},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.028,"15min":1.032},"min":{"1min":0.83899999999999997,"5min":0.435,"15min":0.39000000000000001},"max":{"1min":1.6499999999999999,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.79800000000000004,"5min":0.47699999999999998,"15min":0.47399999999999998},"max":{"1min":1.5880000000000001,"5min":1.875,"15min":1.875},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.0740000000000001,"15min":1.0049999999999999},"min":{"1min":0.82599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6020000000000001,"5min":4.8570000000000002,"15min":5.9980000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.345,"5min":1.3149999999999999,"15min":1.1910000000000001},"min":{"1min":1.0029999999999999,"5min":0.503,"15min":0.46700000000000003},"max":{"1min":1.7130000000000001,"5min":10.739000000000001,"15min":10.739000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3939999999999999,"15min":1.329},"min":{"1min":1.036,"5min":0.88100000000000001,"15min":0.73199999999999998},"max":{"1min":1.8220000000000001,"5min":4.6980000000000004,"15min":6.5209999999999999},"last":1.198},{"interface":"front","average":{"1min":1.655,"5min":1.5249999999999999,"15min":1.456},"min":{"1min":1.25,"5min":0.751,"15min":0.751},"max":{"1min":2.258,"5min":2.2690000000000001,"15min":3.1739999999999999},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.401,"15min":1.383},"min":{"1min":1.218,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.071},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.413,"15min":1.4039999999999999},"min":{"1min":1.1599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.794,"5min":7.532,"15min":16.058},"last":1.254}]},{"osd":6,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.526,"15min":1.4850000000000001},"min":{"1min":1.353,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.375,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.47,"15min":1.448},"min":{"1min":1.1739999999999999,"5min":0.754,"15min":0.754},"max":{"1min":2.3010000000000002,"5min":2.3359999999999999,"15min":3.2240000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":1.532,"15min":1.5269999999999999},"min":{"1min":1.2110000000000001,"5min":0.81799999999999995,"15min":0.752},"max":{"1min":2.1549999999999998,"5min":2.4460000000000002,"15min":3.3330000000000002},"last":1.101},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5129999999999999,"15min":1.4630000000000001},"min":{"1min":1.278,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9139999999999999,"5min":4.9939999999999998,"15min":6.5670000000000002},"last":1.337}]}]}],"pool_statfs":[]}} 2023-08-10T10:50:15.639 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:50:15.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:50:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.908+0000 7f48ac96d640 1 Processor -- start 2023-08-10T10:50:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.908+0000 7f48ac96d640 1 -- start start 2023-08-10T10:50:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48ac96d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a815aa50 0x7f48a80c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48ac96d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48a80b4130 0x7f48a80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48ac96d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80b1370 con 0x7f48a80aff00 2023-08-10T10:50:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48ac96d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a815ae30 con 0x7f48a815aa50 2023-08-10T10:50:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48ac96d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80b1650 con 0x7f48a80b4130 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48a77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a815aa50 0x7f48a80c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48a77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a815aa50 0x7f48a80c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54216/0 (socket says 172.21.15.50:54216) 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.910+0000 7f48a77fe640 1 -- 172.21.15.50:0/2600246783 learned_addr learned my addr 172.21.15.50:0/2600246783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.911+0000 7f489effd640 1 --2- 172.21.15.50:0/2600246783 >> v2:172.21.15.117:3300/0 conn(0x7f48a80b4130 0x7f48a80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.911+0000 7f48a77fe640 1 -- 172.21.15.50:0/2600246783 >> v2:172.21.15.117:3300/0 conn(0x7f48a80b4130 msgr2=0x7f48a80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.911+0000 7f48a77fe640 1 --2- 172.21.15.50:0/2600246783 >> v2:172.21.15.117:3300/0 conn(0x7f48a80b4130 0x7f48a80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.911+0000 7f48a77fe640 1 -- 172.21.15.50:0/2600246783 >> v1:172.21.15.117:6789/0 conn(0x7f48a80aff00 legacy=0x7f48a80cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.911+0000 7f48a77fe640 1 -- 172.21.15.50:0/2600246783 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80b1930 con 0x7f48a815aa50 2023-08-10T10:50:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.912+0000 7f48a77fe640 1 --2- 172.21.15.50:0/2600246783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a815aa50 0x7f48a80c5550 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f48a806bc00 tx=0x7f489802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468ae584779a74c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.912+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2600246783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980317e0 con 0x7f48a815aa50 2023-08-10T10:50:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.912+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2600246783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898031940 con 0x7f48a815aa50 2023-08-10T10:50:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.912+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2600246783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898031cd0 con 0x7f48a815aa50 2023-08-10T10:50:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 -- 172.21.15.50:0/2600246783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a815aa50 msgr2=0x7f48a80c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 --2- 172.21.15.50:0/2600246783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a815aa50 0x7f48a80c5550 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f48a806bc00 tx=0x7f489802b880 comp rx=0 tx=0).stop 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 -- 172.21.15.50:0/2600246783 shutdown_connections 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 --2- 172.21.15.50:0/2600246783 >> v2:172.21.15.117:3300/0 conn(0x7f48a80b4130 0x7f48a80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 --2- 172.21.15.50:0/2600246783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a815aa50 0x7f48a80c5550 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 -- 172.21.15.50:0/2600246783 >> 172.21.15.50:0/2600246783 conn(0x7f48a8069cd0 msgr2=0x7f48a80caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 -- 172.21.15.50:0/2600246783 shutdown_connections 2023-08-10T10:50:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.913+0000 7f48ac96d640 1 -- 172.21.15.50:0/2600246783 wait complete. 2023-08-10T10:50:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.915+0000 7f48ac96d640 1 Processor -- start 2023-08-10T10:50:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.916+0000 7f48ac96d640 1 -- start start 2023-08-10T10:50:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.916+0000 7f48ac96d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a80aff00 0x7f48a815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48ac96d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48ac96d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a815aa50 0x7f48a81f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48ac96d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a815c4f0 con 0x7f48a80b4130 2023-08-10T10:50:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48ac96d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a815b8e0 con 0x7f48a815aa50 2023-08-10T10:50:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48ac96d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a815bbc0 con 0x7f48a80aff00 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f489effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f489effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54220/0 (socket says 172.21.15.50:54220) 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f489effd640 1 -- 172.21.15.50:0/4270266260 learned_addr learned my addr 172.21.15.50:0/4270266260 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48a77fe640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a80aff00 0x7f48a815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.917+0000 7f48a7fff640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a815aa50 0x7f48a81f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 -- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a80aff00 msgr2=0x7f48a815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a80aff00 0x7f48a815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 -- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a815aa50 msgr2=0x7f48a81f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a815aa50 0x7f48a81f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 -- 172.21.15.50:0/4270266260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980094d0 con 0x7f48a80b4130 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f489effd640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f489000d5f0 tx=0x7f489000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900125f0 con 0x7f48a80b4130 2023-08-10T10:50:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890012750 con 0x7f48a80b4130 2023-08-10T10:50:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890012b00 con 0x7f48a80b4130 2023-08-10T10:50:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a815bea0 con 0x7f48a80b4130 2023-08-10T10:50:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.918+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a81f1df0 con 0x7f48a80b4130 2023-08-10T10:50:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.920+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a815c6a0 con 0x7f48a80b4130 2023-08-10T10:50:15.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.921+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4890012c60 con 0x7f48a80b4130 2023-08-10T10:50:15.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.922+0000 7f48a4ff9640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 0x7f488806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.922+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48900898e0 con 0x7f48a80b4130 2023-08-10T10:50:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.922+0000 7f48a77fe640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 0x7f488806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.923+0000 7f48a77fe640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 0x7f488806d140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4898036000 tx=0x7f489803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:15.926+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48a815c6a0 con 0x7f48a80b4130 2023-08-10T10:50:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.186+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f48a81f1f80 con 0x7f48a80b4130 2023-08-10T10:50:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.192+0000 7f48a4ff9640 1 -- 172.21.15.50:0/4270266260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4890054a00 con 0x7f48a80b4130 2023-08-10T10:50:16.193 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:50:16.193 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:50:16.193 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:50:16.193 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:50:16.193 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:50:16.194 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:50:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 msgr2=0x7f488806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 0x7f488806d140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4898036000 tx=0x7f489803d040 comp rx=0 tx=0).stop 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 msgr2=0x7f48a815c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f489000d5f0 tx=0x7f489000dab0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 shutdown_connections 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f488806ac80 0x7f488806d140 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a815aa50 0x7f48a81f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a80b4130 0x7f48a815c980 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 --2- 172.21.15.50:0/4270266260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a80aff00 0x7f48a815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 >> 172.21.15.50:0/4270266260 conn(0x7f48a8069cd0 msgr2=0x7f48a80ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 shutdown_connections 2023-08-10T10:50:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.195+0000 7f48ac96d640 1 -- 172.21.15.50:0/4270266260 wait complete. 2023-08-10T10:50:16.199 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:50:16.199+0000 7f73540cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:50:16.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.446+0000 7f0202b62640 1 Processor -- start 2023-08-10T10:50:16.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.446+0000 7f0202b62640 1 -- start start 2023-08-10T10:50:16.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0202b62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01fc15a940 0x7f01fc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0202b62640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 0x7f01fc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0202b62640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01fc0b1f10 con 0x7f01fc15f2b0 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0202b62640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc0b21f0 con 0x7f01fc15a940 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0202b62640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc15e5c0 con 0x7f01fc0b19d0 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0201b60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01fc15a940 0x7f01fc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0201b60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01fc15a940 0x7f01fc0aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54224/0 (socket says 172.21.15.50:54224) 2023-08-10T10:50:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.448+0000 7f0201b60640 1 -- 172.21.15.50:0/3294296881 learned_addr learned my addr 172.21.15.50:0/3294296881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0202361640 1 --2- 172.21.15.50:0/3294296881 >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 0x7f01fc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0201b60640 1 -- 172.21.15.50:0/3294296881 >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 msgr2=0x7f01fc0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0201b60640 1 --2- 172.21.15.50:0/3294296881 >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 0x7f01fc0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0201b60640 1 -- 172.21.15.50:0/3294296881 >> v1:172.21.15.50:6789/0 conn(0x7f01fc15f2b0 legacy=0x7f01fc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0201b60640 1 -- 172.21.15.50:0/3294296881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc15e7d0 con 0x7f01fc15a940 2023-08-10T10:50:16.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.449+0000 7f0202361640 1 --2- 172.21.15.50:0/3294296881 >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 0x7f01fc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:16.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.450+0000 7f0201b60640 1 --2- 172.21.15.50:0/3294296881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15a940 0x7f01fc0aff10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f01fc15e4f0 tx=0x7f01f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68b48038a206a8a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.450+0000 7f0200b5e640 1 -- 172.21.15.50:0/3294296881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8031870 con 0x7f01fc15a940 2023-08-10T10:50:16.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.450+0000 7f0200b5e640 1 -- 172.21.15.50:0/3294296881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80319d0 con 0x7f01fc15a940 2023-08-10T10:50:16.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.450+0000 7f0200b5e640 1 -- 172.21.15.50:0/3294296881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8031d60 con 0x7f01fc15a940 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 -- 172.21.15.50:0/3294296881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15a940 msgr2=0x7f01fc0aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 --2- 172.21.15.50:0/3294296881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15a940 0x7f01fc0aff10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f01fc15e4f0 tx=0x7f01f802b910 comp rx=0 tx=0).stop 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 -- 172.21.15.50:0/3294296881 shutdown_connections 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 --2- 172.21.15.50:0/3294296881 >> v2:172.21.15.117:3300/0 conn(0x7f01fc0b19d0 0x7f01fc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 --2- 172.21.15.50:0/3294296881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15a940 0x7f01fc0aff10 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 -- 172.21.15.50:0/3294296881 >> 172.21.15.50:0/3294296881 conn(0x7f01fc06ab80 msgr2=0x7f01fc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 -- 172.21.15.50:0/3294296881 shutdown_connections 2023-08-10T10:50:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.451+0000 7f0202b62640 1 -- 172.21.15.50:0/3294296881 wait complete. 2023-08-10T10:50:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.453+0000 7f0202b62640 1 Processor -- start 2023-08-10T10:50:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.453+0000 7f0202b62640 1 -- start start 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01fc0b19d0 0x7f01fc1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01fc15a940 0x7f01fc1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc15c620 con 0x7f01fc15f2b0 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc06fba0 con 0x7f01fc15a940 2023-08-10T10:50:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202b62640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc06fe80 con 0x7f01fc0b19d0 2023-08-10T10:50:16.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54236/0 (socket says 172.21.15.50:54236) 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.454+0000 7f0202361640 1 -- 172.21.15.50:0/1327241138 learned_addr learned my addr 172.21.15.50:0/1327241138 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0201b60640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01fc0b19d0 0x7f01fc1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f020135f640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01fc15a940 0x7f01fc1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 -- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01fc0b19d0 msgr2=0x7f01fc1f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01fc0b19d0 0x7f01fc1f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 -- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01fc15a940 msgr2=0x7f01fc1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01fc15a940 0x7f01fc1f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 -- 172.21.15.50:0/1327241138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80094d0 con 0x7f01fc15f2b0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202361640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f01f400cd50 tx=0x7f01f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400f680 con 0x7f01fc15f2b0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400f800 con 0x7f01fc15f2b0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400fbb0 con 0x7f01fc15f2b0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.455+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01fc15c890 con 0x7f01fc15f2b0 2023-08-10T10:50:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.456+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01fc0c24b0 con 0x7f01fc15f2b0 2023-08-10T10:50:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.457+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc066e30 con 0x7f01fc15f2b0 2023-08-10T10:50:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.458+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01f400b040 con 0x7f01fc15f2b0 2023-08-10T10:50:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.459+0000 7f01f27fc640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 0x7f01e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.459+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01f4089e50 con 0x7f01fc15f2b0 2023-08-10T10:50:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.459+0000 7f0201b60640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 0x7f01e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.460+0000 7f0201b60640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 0x7f01e006d110 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f01f8036000 tx=0x7f01f803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.464+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f01f4054f90 con 0x7f01fc15f2b0 2023-08-10T10:50:16.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.696+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01fc0c2290 con 0x7f01fc15f2b0 2023-08-10T10:50:16.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.697+0000 7f01f27fc640 1 -- 172.21.15.50:0/1327241138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f01f401d090 con 0x7f01fc15f2b0 2023-08-10T10:50:16.698 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:16.698 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:50:16.698 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:50:16.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.699+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 msgr2=0x7f01e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.699+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 0x7f01e006d110 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f01f8036000 tx=0x7f01f803c040 comp rx=0 tx=0).stop 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.699+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 msgr2=0x7f01fc1f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.699+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f01f400cd50 tx=0x7f01f400a650 comp rx=0 tx=0).stop 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 shutdown_connections 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01fc15f2b0 0x7f01fc1f6640 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f01e006ac50 0x7f01e006d110 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01fc15a940 0x7f01fc1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 --2- 172.21.15.50:0/1327241138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01fc0b19d0 0x7f01fc1f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 >> 172.21.15.50:0/1327241138 conn(0x7f01fc06ab80 msgr2=0x7f01fc0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 shutdown_connections 2023-08-10T10:50:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:16.700+0000 7f0202b62640 1 -- 172.21.15.50:0/1327241138 wait complete. 2023-08-10T10:50:17.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:50:09.740882+0000', 'modified': '2023-08-10T10:50:13.648806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8952}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8952': {'gid': 8952, 'name': 'c', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6837/2288662428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 2288662428}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 2288662428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:50:17.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:50:17.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.360+0000 7f90d8a7c640 1 Processor -- start 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.360+0000 7f90d8a7c640 1 -- start start 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d8a7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415ce00 0x7f90d40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d8a7c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40d1220 con 0x7f90d40b5af0 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d8a7c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40b8a30 con 0x7f90d40cd730 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d8a7c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40d2930 con 0x7f90d415ce00 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90d40b5af0 0x7f90d40d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41140/0 (socket says 172.21.15.50:41140) 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4179565513 learned_addr learned my addr 172.21.15.50:0/4179565513 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.362+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415ce00 0x7f90d40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504004591 0 0) 0x7f90d40d1220 con 0x7f90d40b5af0 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90bc003520 con 0x7f90d40b5af0 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764731084 0 0) 0x7f90bc003520 con 0x7f90d40b5af0 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415ce00 msgr2=0x7f90d40d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415ce00 0x7f90d40d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 >> v1:172.21.15.117:6789/0 conn(0x7f90d40cd730 legacy=0x7f90d40cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40b1e70 con 0x7f90d40b5af0 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f90cc001670 con 0x7f90d40b5af0 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 >> v1:172.21.15.50:6789/0 conn(0x7f90d40b5af0 legacy=0x7f90d40d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90bc0039a0 0x7f90bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90bc004390 0x7f90bc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00bf70 con 0x7f90bc005060 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00c0b0 con 0x7f90bc004390 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00c270 con 0x7f90bc0039a0 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.363+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90bc004390 0x7f90bc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d259c640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90bc0039a0 0x7f90bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90bc0039a0 msgr2=0x7f90bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90bc0039a0 0x7f90bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90bc004390 msgr2=0x7f90bc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90bc004390 0x7f90bc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4179565513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc003520 con 0x7f90bc005060 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d259c640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90bc0039a0 0x7f90bc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.364+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90bc004390 0x7f90bc004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.365+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90bc00b980 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00c240 tx=0x7f90bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f489ae3c23f8de50 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc005ad0 con 0x7f90bc005060 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc005c30 con 0x7f90bc005060 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d159a640 1 -- 172.21.15.50:0/4179565513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc02caf0 con 0x7f90bc005060 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d8a7c640 1 -- 172.21.15.50:0/4179565513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 msgr2=0x7f90bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/4179565513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90bc00b980 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00c240 tx=0x7f90bc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4179565513 reap_dead start 2023-08-10T10:50:17.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d8a7c640 1 -- 172.21.15.50:0/4179565513 shutdown_connections 2023-08-10T10:50:17.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.366+0000 7f90d8a7c640 1 -- 172.21.15.50:0/4179565513 >> 172.21.15.50:0/4179565513 conn(0x7f90d40d2c60 msgr2=0x7f90d40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.367+0000 7f90d8a7c640 1 -- 172.21.15.50:0/4179565513 shutdown_connections 2023-08-10T10:50:17.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.367+0000 7f90d8a7c640 1 -- 172.21.15.50:0/4179565513 wait complete. 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.368+0000 7f90d8a7c640 1 Processor -- start 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.369+0000 7f90d8a7c640 1 -- start start 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415f920 0x7f90d415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d41f1d30 0x7f90d41f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415a660 con 0x7f90bc005060 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415e880 con 0x7f90d41f1d30 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d8a7c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415eb60 con 0x7f90d415f920 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54248/0 (socket says 172.21.15.50:54248) 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d259c640 1 -- 172.21.15.50:0/2045858886 learned_addr learned my addr 172.21.15.50:0/2045858886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415f920 0x7f90d415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.370+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d41f1d30 0x7f90d41f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 -- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415f920 msgr2=0x7f90d415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415f920 0x7f90d415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 -- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d41f1d30 msgr2=0x7f90d41f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d41f1d30 0x7f90d41f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 -- 172.21.15.50:0/2045858886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d415ee40 con 0x7f90bc005060 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d259c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f90c400db10 tx=0x7f90c40020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90c2ffd640 1 -- 172.21.15.50:0/2045858886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4003da0 con 0x7f90bc005060 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90c2ffd640 1 -- 172.21.15.50:0/2045858886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4006b50 con 0x7f90bc005060 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90c2ffd640 1 -- 172.21.15.50:0/2045858886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400b740 con 0x7f90bc005060 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d415f120 con 0x7f90bc005060 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.371+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40cf470 con 0x7f90bc005060 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.375+0000 7f90c2ffd640 1 -- 172.21.15.50:0/2045858886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90c400b8a0 con 0x7f90bc005060 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.376+0000 7f90c2ffd640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 0x7f90b406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.376+0000 7f90c2ffd640 1 -- 172.21.15.50:0/2045858886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90c4088b10 con 0x7f90bc005060 2023-08-10T10:50:17.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.376+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 0x7f90b406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.376+0000 7f90db5f0740 1 Processor -- start 2023-08-10T10:50:17.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.377+0000 7f90db5f0740 1 -- start start 2023-08-10T10:50:17.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.377+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 0x7f90b406d140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cbe00 tx=0x7f90c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.377+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.377+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e691440 0x55656e6be730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.377+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90db5f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e6019d0 con 0x55656e695040 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e5ff0c0 con 0x55656e691440 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656e5fa9b0 con 0x55656e6c14c0 2023-08-10T10:50:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54264/0 (socket says 172.21.15.50:54264) 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 -- 172.21.15.50:0/3348938420 learned_addr learned my addr 172.21.15.50:0/3348938420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e691440 0x55656e6be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d259c640 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 -- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 msgr2=0x55656e6c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 -- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e691440 msgr2=0x55656e6be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e691440 0x55656e6be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.378+0000 7f90d2d9d640 1 -- 172.21.15.50:0/3348938420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656e5c7c10 con 0x55656e695040 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.379+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f90cc001930 tx=0x7f90cc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0820b1e1175a98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.379+0000 7f90b3fff640 1 -- 172.21.15.50:0/3348938420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc03c040 con 0x55656e695040 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.379+0000 7f90b3fff640 1 -- 172.21.15.50:0/3348938420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc02c8b0 con 0x55656e695040 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.379+0000 7f90b3fff640 1 -- 172.21.15.50:0/3348938420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc001670 con 0x55656e695040 2023-08-10T10:50:17.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 -- 172.21.15.50:0/3348938420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 msgr2=0x55656e6bec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f90cc001930 tx=0x7f90cc007000 comp rx=0 tx=0).stop 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 -- 172.21.15.50:0/3348938420 shutdown_connections 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e6bec70 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e691440 0x55656e6be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3348938420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 -- 172.21.15.50:0/3348938420 >> 172.21.15.50:0/3348938420 conn(0x55656e693750 msgr2=0x55656e6dc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 -- 172.21.15.50:0/3348938420 shutdown_connections 2023-08-10T10:50:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.380+0000 7f90db5f0740 1 -- 172.21.15.50:0/3348938420 wait complete. 2023-08-10T10:50:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.381+0000 7f90db5f0740 1 -- start start 2023-08-10T10:50:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.381+0000 7f90db5f0740 1 Processor -- start 2023-08-10T10:50:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 0x55656e6d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 0x55656e6c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e59b940 con 0x55656e6bc570 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e59b5e0 con 0x55656e6c14c0 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656e361f20 con 0x55656e695040 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90db5f0740 10 client.0 _ll_register_callbacks cb 0x55656e5f4250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.382+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54276/0 (socket says 172.21.15.50:54276) 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4271727891 learned_addr learned my addr 172.21.15.50:0/4271727891 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d259c640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 0x55656e6d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 0x55656e6c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 msgr2=0x55656e6d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 0x55656e6d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 msgr2=0x55656e6c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 0x55656e6c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 -- 172.21.15.50:0/4271727891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc003520 con 0x55656e6bc570 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d259c640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 0x55656e6d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 0x55656e6c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f90cc02c520 tx=0x7f90cc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb423fdf0802f26 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.383+0000 7f90b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc046070 con 0x55656e6bc570 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55656e624bf0 con 0x55656e6bc570 2023-08-10T10:50:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90cc000e40 con 0x55656e6bc570 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90cc005aa0 con 0x55656e6bc570 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 10 client.9102 fetch_fsmap learned FSMap version 85 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55656e5f9030 con 0x55656e6bc570 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55656e624bf0 con 0x55656e6bc570 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90cc03f030 con 0x55656e6bc570 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 10 client.9102 fetch_fsmap finished waiting for FSMap version 85 2023-08-10T10:50:17.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 10 client.9102 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 20 client.9102 populate_metadata read hostname 'smithi050' 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e6adaf0 0x55656e6f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 4 client.9102 mds_command: new command op to 8952 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.384+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 --> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55656e5ed7c0 con 0x55656e6adaf0 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.385+0000 7f90d259c640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e6adaf0 0x55656e6f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.385+0000 7f90d259c640 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e6adaf0 0x55656e6f94a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371552d4d58dac5f server_cookie=4e768a57d7105c85 in_seq=0 out_seq=0 2023-08-10T10:50:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.385+0000 7f90b17fa640 10 client.9102 ms_handle_connect on v2:172.21.15.50:6836/2288662428 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90b17fa640 1 -- 172.21.15.50:0/4271727891 <== mds.0 v2:172.21.15.50:6836/2288662428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55656e5ed7c0 con 0x55656e6adaf0 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90b17fa640 10 client.9102 handle_command_reply: tid=0 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 client.9102 shutdown 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 msgr2=0x55656e6c1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f90cc02c520 tx=0x7f90cc02e070 comp rx=0 tx=0).stop 2023-08-10T10:50:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 shutdown_connections 2023-08-10T10:50:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e6adaf0 0x55656e6f94a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6bc570 0x55656e6c1df0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6c14c0 0x55656e6c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90b17fa640 0 client.9102 ms_handle_reset on v2:172.21.15.50:6836/2288662428 2023-08-10T10:50:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 --2- 172.21.15.50:0/4271727891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e695040 0x55656e6d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.386+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 >> 172.21.15.50:0/4271727891 conn(0x55656e691440 msgr2=0x55656e6957f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.387+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 shutdown_connections 2023-08-10T10:50:17.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.387+0000 7f90db5f0740 1 -- 172.21.15.50:0/4271727891 wait complete. 2023-08-10T10:50:17.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.387+0000 7f90db5f0740 20 client.9102 trim_cache size 0 max 16384 2023-08-10T10:50:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.404+0000 7f90db5f0740 1 Processor -- start 2023-08-10T10:50:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.404+0000 7f90db5f0740 1 -- start start 2023-08-10T10:50:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e695040 0x55656e695940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6bc570 0x55656e6bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e695f00 con 0x55656e6c14c0 2023-08-10T10:50:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e6db060 con 0x55656e695040 2023-08-10T10:50:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656e698020 con 0x55656e6bc570 2023-08-10T10:50:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54282/0 (socket says 172.21.15.50:54282) 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.405+0000 7f90d2d9d640 1 -- 172.21.15.50:0/2355588214 learned_addr learned my addr 172.21.15.50:0/2355588214 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 -- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6bc570 msgr2=0x55656e6bbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6bc570 0x55656e6bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 -- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e695040 msgr2=0x55656e695940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e695040 0x55656e695940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 -- 172.21.15.50:0/2355588214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656e62e8a0 con 0x55656e6c14c0 2023-08-10T10:50:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90d2d9d640 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f90cc02c5c0 tx=0x7f90cc046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48b4ab0177f00f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90c0ff9640 1 -- 172.21.15.50:0/2355588214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc000e40 con 0x55656e6c14c0 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90c0ff9640 1 -- 172.21.15.50:0/2355588214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc007180 con 0x55656e6c14c0 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.406+0000 7f90c0ff9640 1 -- 172.21.15.50:0/2355588214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0074f0 con 0x55656e6c14c0 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 -- 172.21.15.50:0/2355588214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 msgr2=0x55656e6bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f90cc02c5c0 tx=0x7f90cc046000 comp rx=0 tx=0).stop 2023-08-10T10:50:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 -- 172.21.15.50:0/2355588214 shutdown_connections 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e6c14c0 0x55656e6bec00 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6bc570 0x55656e6bbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 --2- 172.21.15.50:0/2355588214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e695040 0x55656e695940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 -- 172.21.15.50:0/2355588214 >> 172.21.15.50:0/2355588214 conn(0x55656e691440 msgr2=0x55656e6d60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 -- 172.21.15.50:0/2355588214 shutdown_connections 2023-08-10T10:50:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.407+0000 7f90db5f0740 1 -- 172.21.15.50:0/2355588214 wait complete. 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.408+0000 7f90db5f0740 1 -- start start 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.408+0000 7f90db5f0740 1 Processor -- start 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6bc570 0x55656e6ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e6d4600 con 0x55656e695040 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656e7479a0 con 0x55656e6bc570 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656e6d4c40 con 0x55656e6c14c0 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90db5f0740 10 client.0 _ll_register_callbacks cb 0x7f90c8009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54298/0 (socket says 172.21.15.50:54298) 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.409+0000 7f90d259c640 1 -- 172.21.15.50:0/3908030202 learned_addr learned my addr 172.21.15.50:0/3908030202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 -- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 msgr2=0x55656e6f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 -- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6bc570 msgr2=0x55656e6ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6bc570 0x55656e6ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 -- 172.21.15.50:0/3908030202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55656e5f9030 con 0x55656e695040 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90d259c640 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f90c4057820 tx=0x7f90c4087090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164690748c51b7ad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:50:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c405f8a0 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90c401dc00 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90cc02c8b0 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.410+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c401ddc0 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 10 client.9108 fetch_fsmap learned FSMap version 85 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55656e59a610 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc02c8b0 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90c400bb50 con 0x55656e695040 2023-08-10T10:50:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 10 client.9108 fetch_fsmap finished waiting for FSMap version 85 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 10 client.9108 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 20 client.9108 populate_metadata read hostname 'smithi050' 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e746430 0x55656e6f5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 4 client.9108 mds_command: new command op to 8952 tid=0[{"prefix": "status"}] 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 --> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55656e5f3990 con 0x55656e746430 2023-08-10T10:50:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.411+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e746430 0x55656e6f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90d1d9b640 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e746430 0x55656e6f5710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238cebd8636c5c33 server_cookie=90f3d7b6ade4325 in_seq=0 out_seq=0 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90b17fa640 10 client.9108 ms_handle_connect on v2:172.21.15.50:6836/2288662428 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90b17fa640 1 -- 172.21.15.50:0/3908030202 <== mds.0 v2:172.21.15.50:6836/2288662428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55656e5f3990 con 0x55656e746430 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90b17fa640 10 client.9108 handle_command_reply: tid=0 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 client.9108 shutdown 2023-08-10T10:50:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 msgr2=0x55656e747460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f90c4057820 tx=0x7f90c4087090 comp rx=0 tx=0).stop 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 shutdown_connections 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:6836/2288662428,v1:172.21.15.50:6837/2288662428] conn(0x55656e746430 0x55656e6f5710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55656e6c14c0 0x55656e6f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55656e6bc570 0x55656e6ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 --2- 172.21.15.50:0/3908030202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55656e695040 0x55656e747460 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90b17fa640 0 client.9108 ms_handle_reset on v2:172.21.15.50:6836/2288662428 2023-08-10T10:50:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.412+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 >> 172.21.15.50:0/3908030202 conn(0x55656e691440 msgr2=0x55656e6c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 shutdown_connections 2023-08-10T10:50:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90db5f0740 1 -- 172.21.15.50:0/3908030202 wait complete. 2023-08-10T10:50:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90db5f0740 20 client.9108 trim_cache size 0 max 16384 2023-08-10T10:50:17.424 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8952, 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:50:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.1113465890000001, 2023-08-10T10:50:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 85, 2023-08-10T10:50:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 172, 2023-08-10T10:50:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 172, 2023-08-10T10:50:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.100639357 2023-08-10T10:50:17.426 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:50:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 msgr2=0x7f90b406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 0x7f90b406d140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cbe00 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2023-08-10T10:50:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 msgr2=0x7f90d415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f90c400db10 tx=0x7f90c40020c0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 shutdown_connections 2023-08-10T10:50:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f90b406ac80 0x7f90b406d140 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d41f1d30 0x7f90d41f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90d415f920 0x7f90d415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 --2- 172.21.15.50:0/2045858886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90bc005060 0x7f90d415a120 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.413+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 >> 172.21.15.50:0/2045858886 conn(0x7f90d40d2c60 msgr2=0x7f90d40b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.414+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 shutdown_connections 2023-08-10T10:50:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.414+0000 7f90d8a7c640 1 -- 172.21.15.50:0/2045858886 wait complete. 2023-08-10T10:50:17.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:50:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.656+0000 7fb4c7c8e640 1 Processor -- start 2023-08-10T10:50:17.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.656+0000 7fb4c7c8e640 1 -- start start 2023-08-10T10:50:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c7c8e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 0x7fb4c00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c7c8e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4c00ca930 0x7fb4c00b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c7c8e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c0071c70 con 0x7fb4c00b0c60 2023-08-10T10:50:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c7c8e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00713d0 con 0x7fb4c00ca930 2023-08-10T10:50:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c7c8e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00716b0 con 0x7fb4c015aa40 2023-08-10T10:50:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c622b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4c00ca930 0x7fb4c00b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c622b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4c00ca930 0x7fb4c00b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54304/0 (socket says 172.21.15.50:54304) 2023-08-10T10:50:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.658+0000 7fb4c622b640 1 -- 172.21.15.50:0/2877064655 learned_addr learned my addr 172.21.15.50:0/2877064655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c5a2a640 1 --2- 172.21.15.50:0/2877064655 >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 0x7fb4c00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c622b640 1 -- 172.21.15.50:0/2877064655 >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 msgr2=0x7fb4c00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c622b640 1 --2- 172.21.15.50:0/2877064655 >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 0x7fb4c00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c622b640 1 -- 172.21.15.50:0/2877064655 >> v1:172.21.15.50:6789/0 conn(0x7fb4c00b0c60 legacy=0x7fb4c00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c622b640 1 -- 172.21.15.50:0/2877064655 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0071990 con 0x7fb4c00ca930 2023-08-10T10:50:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.659+0000 7fb4c5a2a640 1 --2- 172.21.15.50:0/2877064655 >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 0x7fb4c00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.660+0000 7fb4c622b640 1 --2- 172.21.15.50:0/2877064655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00ca930 0x7fb4c00b3d60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00c8dc0 tx=0x7fb4b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cc5fc45819098a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.660+0000 7fb4c4a28640 1 -- 172.21.15.50:0/2877064655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802ca80 con 0x7fb4c00ca930 2023-08-10T10:50:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c4a28640 1 -- 172.21.15.50:0/2877064655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b802cbe0 con 0x7fb4c00ca930 2023-08-10T10:50:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c4a28640 1 -- 172.21.15.50:0/2877064655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80343f0 con 0x7fb4c00ca930 2023-08-10T10:50:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2877064655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00ca930 msgr2=0x7fb4c00b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2877064655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00ca930 0x7fb4c00b3d60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00c8dc0 tx=0x7fb4b802bee0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2877064655 shutdown_connections 2023-08-10T10:50:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2877064655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00ca930 0x7fb4c00b3d60 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2877064655 >> v2:172.21.15.117:3300/0 conn(0x7fb4c015aa40 0x7fb4c00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.661+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2877064655 >> 172.21.15.50:0/2877064655 conn(0x7fb4c006b590 msgr2=0x7fb4c00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.662+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2877064655 shutdown_connections 2023-08-10T10:50:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.662+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2877064655 wait complete. 2023-08-10T10:50:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.663+0000 7fb4c7c8e640 1 Processor -- start 2023-08-10T10:50:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 -- start start 2023-08-10T10:50:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c00b0c60 0x7fb4c015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00ca930 0x7fb4c014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c01578c0 con 0x7fb4c015aa40 2023-08-10T10:50:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0156c40 con 0x7fb4c00ca930 2023-08-10T10:50:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.664+0000 7fb4c7c8e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0156f20 con 0x7fb4c00b0c60 2023-08-10T10:50:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54316/0 (socket says 172.21.15.50:54316) 2023-08-10T10:50:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 -- 172.21.15.50:0/2851815046 learned_addr learned my addr 172.21.15.50:0/2851815046 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c5a2a640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c00b0c60 0x7fb4c015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c5229640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00ca930 0x7fb4c014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 -- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c00b0c60 msgr2=0x7fb4c015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c00b0c60 0x7fb4c015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 -- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00ca930 msgr2=0x7fb4c014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00ca930 0x7fb4c014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.665+0000 7fb4c622b640 1 -- 172.21.15.50:0/2851815046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009b30 con 0x7fb4c015aa40 2023-08-10T10:50:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4c622b640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8036040 tx=0x7fb4b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8009510 con 0x7fb4c015aa40 2023-08-10T10:50:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b803e450 con 0x7fb4c015aa40 2023-08-10T10:50:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b803e800 con 0x7fb4c015aa40 2023-08-10T10:50:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c0157200 con 0x7fb4c015aa40 2023-08-10T10:50:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.666+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c015d5e0 con 0x7fb4c015aa40 2023-08-10T10:50:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.668+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0157a00 con 0x7fb4c015aa40 2023-08-10T10:50:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.668+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4b802cd50 con 0x7fb4c015aa40 2023-08-10T10:50:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.669+0000 7fb4b67fc640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 0x7fb4a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.669+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4b80ac090 con 0x7fb4c015aa40 2023-08-10T10:50:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.670+0000 7fb4c5a2a640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 0x7fb4a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.670+0000 7fb4c5a2a640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 0x7fb4a406d110 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b840 tx=0x7fb4bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.674+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4c0157a00 con 0x7fb4c015aa40 2023-08-10T10:50:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.906+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4c0157a00 con 0x7fb4c015aa40 2023-08-10T10:50:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.907+0000 7fb4b67fc640 1 -- 172.21.15.50:0/2851815046 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4b8043060 con 0x7fb4c015aa40 2023-08-10T10:50:17.907 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:50:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 msgr2=0x7fb4a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 0x7fb4a406d110 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b840 tx=0x7fb4bc008040 comp rx=0 tx=0).stop 2023-08-10T10:50:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 msgr2=0x7fb4c014dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8036040 tx=0x7fb4b8004a40 comp rx=0 tx=0).stop 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 shutdown_connections 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c015aa40 0x7fb4c014dc60 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb4a406ac50 0x7fb4a406d110 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00ca930 0x7fb4c014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 --2- 172.21.15.50:0/2851815046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c00b0c60 0x7fb4c015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 >> 172.21.15.50:0/2851815046 conn(0x7fb4c006b590 msgr2=0x7fb4c00c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 shutdown_connections 2023-08-10T10:50:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:17.909+0000 7fb4c7c8e640 1 -- 172.21.15.50:0/2851815046 wait complete. 2023-08-10T10:50:17.929 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:50:17.930 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:50:17.930 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:50:17.930 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:50:17.931 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:50:17.931 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:50:17.931 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:50:17.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:50:17.932 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:50:17.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:17.932 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:50:17.991 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:50:17.991 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:50:17.991 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:50:17.991 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:50:17.992 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:50:17.993 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40508sec preferred_lft 40508sec 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:50:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.996 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:50:17.996 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:50:17.996 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:50:17.996 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:17.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:17.997 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:50:18.095 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:50:18.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.100 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:50:18.158 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:50:18.158 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:50:18.159 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:50:18.159 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:50:18.159 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:50:18.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.160 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:50:18.160 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:50:18.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:50:18.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:50:18.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:50:18.161 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:50:18.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.364 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:50:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:50:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:50:18.423 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:50:18.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:50:18.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:18.531 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:50:18.592 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:50:18.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:18.593 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:50:18.652 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:50:18.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:18.805 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:18.805 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:50:18.836 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:18.836 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:50:18.836 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:50:18.836 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:50:18.836 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:50:18.838 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:50:18.838 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:50:18.839 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:50:18.839 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:50:18.839 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:50:18.842 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:50:18.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:50:18.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:18.934 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:50:19.003 INFO:teuthology.orchestra.run.smithi050.stdout:client9120 2023-08-10T10:50:19.004 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:50:19.004 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:19.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:50:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.289+0000 7f5b5bfff640 1 Processor -- start 2023-08-10T10:50:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.289+0000 7f5b5bfff640 1 -- start start 2023-08-10T10:50:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b5c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b5c0cc420 0x7f5b5c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5bfff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c06a040 con 0x7f5b5c159830 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c15def0 con 0x7f5b5c0cc420 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0ce350 con 0x7f5b5c0696a0 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b5c159830 0x7f5b5c0cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41164/0 (socket says 172.21.15.50:41164) 2023-08-10T10:50:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.291+0000 7f5b5affd640 1 -- 172.21.15.50:0/749902980 learned_addr learned my addr 172.21.15.50:0/749902980 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:50:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/749902980 >> v2:172.21.15.117:3300/0 conn(0x7f5b5c0cc420 0x7f5b5c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b5a7fc640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b5c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680014274 0 0) 0x7f5b5c06a040 con 0x7f5b5c159830 2023-08-10T10:50:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b44003520 con 0x7f5b5c159830 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208763070 0 0) 0x7f5b44003520 con 0x7f5b5c159830 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 msgr2=0x7f5b5c069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b5c069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 >> v2:172.21.15.117:3300/0 conn(0x7f5b5c0cc420 msgr2=0x7f5b5c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 --2- 172.21.15.50:0/749902980 >> v2:172.21.15.117:3300/0 conn(0x7f5b5c0cc420 0x7f5b5c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c15e380 con 0x7f5b5c159830 2023-08-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5b4c001670 con 0x7f5b5c159830 2023-08-10T10:50:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 >> v1:172.21.15.50:6789/0 conn(0x7f5b5c159830 legacy=0x7f5b5c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44003970 0x7f5b44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b44004d00 0x7f5b44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c15def0 con 0x7f5b44004d00 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0ce350 con 0x7f5b44003970 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.292+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4400b980 con 0x7f5b5c0696a0 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b44004d00 0x7f5b44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5a7fc640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 -- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 msgr2=0x7f5b440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c0696a0 0x7f5b440047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 -- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44003970 msgr2=0x7f5b44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44003970 0x7f5b44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.293+0000 7f5b5b7fe640 1 -- 172.21.15.50:0/749902980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44003520 con 0x7f5b44004d00 2023-08-10T10:50:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.294+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b44004d00 0x7f5b44005180 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007390 tx=0x7f5b440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372f9c3ad0b615f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.294+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5402ccf0 con 0x7f5b44004d00 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.294+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5402ce50 con 0x7f5b44004d00 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b59ffb640 1 -- 172.21.15.50:0/749902980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54034660 con 0x7f5b44004d00 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 -- 172.21.15.50:0/749902980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b44004d00 msgr2=0x7f5b44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/749902980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b44004d00 0x7f5b44005180 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007390 tx=0x7f5b440057f0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5b7fe640 1 -- 172.21.15.50:0/749902980 reap_dead start 2023-08-10T10:50:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 -- 172.21.15.50:0/749902980 shutdown_connections 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 -- 172.21.15.50:0/749902980 >> 172.21.15.50:0/749902980 conn(0x7f5b5c0cafa0 msgr2=0x7f5b5c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 -- 172.21.15.50:0/749902980 shutdown_connections 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.295+0000 7f5b5bfff640 1 -- 172.21.15.50:0/749902980 wait complete. 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.297+0000 7f5b5bfff640 1 Processor -- start 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.297+0000 7f5b5bfff640 1 -- start start 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44004d00 0x7f5b5c151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c14f6b0 0x7f5b5c157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c157e80 con 0x7f5b5c06e840 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c150f30 con 0x7f5b44004d00 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.298+0000 7f5b5bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c152220 con 0x7f5b5c14f6b0 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54346/0 (socket says 172.21.15.50:54346) 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 -- 172.21.15.50:0/1123159432 learned_addr learned my addr 172.21.15.50:0/1123159432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5affd640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44004d00 0x7f5b5c151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5b7fe640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c14f6b0 0x7f5b5c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 -- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c14f6b0 msgr2=0x7f5b5c157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c14f6b0 0x7f5b5c157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 -- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44004d00 msgr2=0x7f5b5c151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44004d00 0x7f5b5c151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 -- 172.21.15.50:0/1123159432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c151180 con 0x7f5b5c06e840 2023-08-10T10:50:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.299+0000 7f5b5a7fc640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f5b50010890 tx=0x7f5b50010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.300+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50009610 con 0x7f5b5c06e840 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.300+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5000eb00 con 0x7f5b5c06e840 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.300+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000ee90 con 0x7f5b5c06e840 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.300+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c151460 con 0x7f5b5c06e840 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.300+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c070370 con 0x7f5b5c06e840 2023-08-10T10:50:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.301+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c066e30 con 0x7f5b5c06e840 2023-08-10T10:50:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.302+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b5001c400 con 0x7f5b5c06e840 2023-08-10T10:50:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.304+0000 7f5b437fe640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 0x7f5b4806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.304+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b50089a80 con 0x7f5b5c06e840 2023-08-10T10:50:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.304+0000 7f5b5affd640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 0x7f5b4806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.305+0000 7f5b5affd640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 0x7f5b4806d110 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000f60 tx=0x7f5b4c001690 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.309+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5b50054b20 con 0x7f5b5c06e840 2023-08-10T10:50:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.536+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b5c0cbda0 con 0x7f5b5c06e840 2023-08-10T10:50:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.537+0000 7f5b437fe640 1 -- 172.21.15.50:0/1123159432 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b50058140 con 0x7f5b5c06e840 2023-08-10T10:50:19.538 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:50:19.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 msgr2=0x7f5b4806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 0x7f5b4806d110 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000f60 tx=0x7f5b4c001690 comp rx=0 tx=0).stop 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 msgr2=0x7f5b5c14c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f5b50010890 tx=0x7f5b50010d50 comp rx=0 tx=0).stop 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 shutdown_connections 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5c14f6b0 0x7f5b5c157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b5c06e840 0x7f5b5c14c8f0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5b4806ac50 0x7f5b4806d110 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 --2- 172.21.15.50:0/1123159432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b44004d00 0x7f5b5c151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 >> 172.21.15.50:0/1123159432 conn(0x7f5b5c0cafa0 msgr2=0x7f5b5c0af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 shutdown_connections 2023-08-10T10:50:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:19.540+0000 7f5b5bfff640 1 -- 172.21.15.50:0/1123159432 wait complete. 2023-08-10T10:50:19.560 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:50:19.561 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:50:19.561 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:50:19.561 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:50:19.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:50:19.562 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:50:19.562 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:50:19.562 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:50:19.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:50:19.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:19.563 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:50:19.625 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:50:19.625 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:50:19.625 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:50:19.626 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.626 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:50:19.626 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.626 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:19.626 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:19.627 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:50:19.627 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:19.627 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:19.627 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:50:19.628 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:19.628 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:19.628 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:50:19.628 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:19.628 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:50:19.629 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 40678sec preferred_lft 40678sec 2023-08-10T10:50:19.629 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:50:19.629 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.629 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:50:19.630 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:19.630 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:50:19.630 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.630 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.631 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:50:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:50:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:50:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:19.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:19.633 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:50:19.731 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:50:19.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:19.736 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:50:19.789 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:50:19.789 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:50:19.789 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:50:19.789 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:50:19.789 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:50:19.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:19.791 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:50:19.791 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:50:19.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:50:19.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:50:19.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:50:19.792 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:50:19.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:19.974 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:50:20.024 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:50:20.024 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:50:20.025 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:50:20.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:20.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:50:20.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:20.122 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:50:20.172 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:50:20.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:20.173 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:50:20.223 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:50:20.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:20.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:20.356 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:20.356 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:50:20.388 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:50:20.389 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:50:20.389 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:50:20.389 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:50:20.389 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:50:20.392 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:50:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:50:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:50:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:50:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:50:20.396 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:50:20.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:20.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:50:20.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:20.473 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:50:20.528 INFO:teuthology.orchestra.run.smithi117.stdout:client6311 2023-08-10T10:50:20.529 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:50:20.529 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:50:20.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:20.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.805+0000 7f0f7a81a640 1 Processor -- start 2023-08-10T10:50:20.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.805+0000 7f0f7a81a640 1 -- start start 2023-08-10T10:50:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f741600f0 0x7f0f740ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f740aff10 0x7f0f740b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f740b08d0 con 0x7f0f741600f0 2023-08-10T10:50:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f741604d0 con 0x7f0f740aff10 2023-08-10T10:50:20.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f7a81a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740cca30 con 0x7f0f740ccec0 2023-08-10T10:50:20.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.807+0000 7f0f79818640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f741600f0 0x7f0f740ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f741600f0 0x7f0f740ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54352/0 (socket says 172.21.15.50:54352) 2023-08-10T10:50:20.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 -- 172.21.15.50:0/1849645553 learned_addr learned my addr 172.21.15.50:0/1849645553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:20.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79017640 1 --2- 172.21.15.50:0/1849645553 >> v2:172.21.15.117:3300/0 conn(0x7f0f740aff10 0x7f0f740b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f7a019640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 -- 172.21.15.50:0/1849645553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 msgr2=0x7f0f740cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:20.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 -- 172.21.15.50:0/1849645553 >> v2:172.21.15.117:3300/0 conn(0x7f0f740aff10 msgr2=0x7f0f740b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:20.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 --2- 172.21.15.50:0/1849645553 >> v2:172.21.15.117:3300/0 conn(0x7f0f740aff10 0x7f0f740b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.808+0000 7f0f79818640 1 -- 172.21.15.50:0/1849645553 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740cc100 con 0x7f0f741600f0 2023-08-10T10:50:20.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.810+0000 7f0f79818640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f741600f0 0x7f0f740ac890 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0f740b1080 tx=0x7f0f7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac53e27cbd5f0de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:20.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f78816640 1 -- 172.21.15.50:0/1849645553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700317e0 con 0x7f0f741600f0 2023-08-10T10:50:20.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f78816640 1 -- 172.21.15.50:0/1849645553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70031940 con 0x7f0f741600f0 2023-08-10T10:50:20.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f78816640 1 -- 172.21.15.50:0/1849645553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70031cd0 con 0x7f0f741600f0 2023-08-10T10:50:20.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1849645553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f741600f0 msgr2=0x7f0f740ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f741600f0 0x7f0f740ac890 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0f740b1080 tx=0x7f0f7002b880 comp rx=0 tx=0).stop 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1849645553 shutdown_connections 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1849645553 >> v2:172.21.15.117:3300/0 conn(0x7f0f740aff10 0x7f0f740b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1849645553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f741600f0 0x7f0f740ac890 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.811+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1849645553 >> 172.21.15.50:0/1849645553 conn(0x7f0f7406ab80 msgr2=0x7f0f7406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:20.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.812+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1849645553 shutdown_connections 2023-08-10T10:50:20.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.812+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1849645553 wait complete. 2023-08-10T10:50:20.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.813+0000 7f0f7a81a640 1 Processor -- start 2023-08-10T10:50:20.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.814+0000 7f0f7a81a640 1 -- start start 2023-08-10T10:50:20.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.814+0000 7f0f7a81a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.814+0000 7f0f7a81a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f7a81a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 0x7f0f741542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f7a81a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740b24b0 con 0x7f0f740aff10 2023-08-10T10:50:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f7a81a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740c5560 con 0x7f0f741600f0 2023-08-10T10:50:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f7a81a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740b1060 con 0x7f0f740ccec0 2023-08-10T10:50:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f79818640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f79818640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54354/0 (socket says 172.21.15.50:54354) 2023-08-10T10:50:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f79818640 1 -- 172.21.15.50:0/1046991649 learned_addr learned my addr 172.21.15.50:0/1046991649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f7a019640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 0x7f0f741542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.815+0000 7f0f79017640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 -- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 msgr2=0x7f0f740b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 -- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 msgr2=0x7f0f741542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 0x7f0f741542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 -- 172.21.15.50:0/1046991649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700094d0 con 0x7f0f740aff10 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f7a019640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 0x7f0f741542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f79818640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f0f70000c00 tx=0x7f0f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70032880 con 0x7f0f740aff10 2023-08-10T10:50:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f700329e0 con 0x7f0f740aff10 2023-08-10T10:50:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70032d50 con 0x7f0f740aff10 2023-08-10T10:50:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.816+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740b13a0 con 0x7f0f740aff10 2023-08-10T10:50:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.817+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7415e760 con 0x7f0f740aff10 2023-08-10T10:50:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.818+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f74066e30 con 0x7f0f740aff10 2023-08-10T10:50:20.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.819+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f700453f0 con 0x7f0f740aff10 2023-08-10T10:50:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.820+0000 7f0f6a7fc640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 0x7f0f5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.820+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f700ab560 con 0x7f0f740aff10 2023-08-10T10:50:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.820+0000 7f0f79017640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 0x7f0f5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.821+0000 7f0f79017640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 0x7f0f5806d110 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f740b42c0 tx=0x7f0f64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:20.824+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f70076600 con 0x7f0f740aff10 2023-08-10T10:50:21.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.055+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f740ae250 con 0x7f0f740aff10 2023-08-10T10:50:21.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.056+0000 7f0f6a7fc640 1 -- 172.21.15.50:0/1046991649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f0f70079c20 con 0x7f0f740aff10 2023-08-10T10:50:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:50:21.057 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:50:21.057 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:50:21.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 msgr2=0x7f0f5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 0x7f0f5806d110 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f740b42c0 tx=0x7f0f64008040 comp rx=0 tx=0).stop 2023-08-10T10:50:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 msgr2=0x7f0f7415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f0f70000c00 tx=0x7f0f700046c0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 shutdown_connections 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f5806ac50 0x7f0f5806d110 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f741600f0 0x7f0f741542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f740ccec0 0x7f0f740b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 --2- 172.21.15.50:0/1046991649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f740aff10 0x7f0f7415e220 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.058+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 >> 172.21.15.50:0/1046991649 conn(0x7f0f7406ab80 msgr2=0x7f0f740af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:21.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.059+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 shutdown_connections 2023-08-10T10:50:21.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.059+0000 7f0f7a81a640 1 -- 172.21.15.50:0/1046991649 wait complete. 2023-08-10T10:50:21.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:50:21.324 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":8952,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.006552382000001,"mdsmap_epoch":85,"osdmap_epoch":172,"osdmap_epoch_barrier":172,"uptime":16.9958472} 2023-08-10T10:50:21.324 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 8952, "mdsmap_epoch": 85, "osdmap_epoch": 172, "osdmap_epoch_barrier": 172, "rank_uptime": 11.006552382, "state": "up:active", "uptime": 16.9958472, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:50:21.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-10T10:50:21.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.562+0000 7ff7c8871640 1 Processor -- start 2023-08-10T10:50:21.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.563+0000 7ff7c8871640 1 -- start start 2023-08-10T10:50:21.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c8871640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c40ca160 0x7ff7c40cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c8871640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7c406f550 0x7ff7c406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c8871640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c40cae00 con 0x7ff7c40ac890 2023-08-10T10:50:21.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c8871640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40c9150 con 0x7ff7c40ca160 2023-08-10T10:50:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c8871640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40ca5c0 con 0x7ff7c406f550 2023-08-10T10:50:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c40ca160 0x7ff7c40cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c40ca160 0x7ff7c40cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54366/0 (socket says 172.21.15.50:54366) 2023-08-10T10:50:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 -- 172.21.15.50:0/3258905794 learned_addr learned my addr 172.21.15.50:0/3258905794 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 -- 172.21.15.50:0/3258905794 >> v2:172.21.15.117:3300/0 conn(0x7ff7c406f550 msgr2=0x7ff7c406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 --2- 172.21.15.50:0/3258905794 >> v2:172.21.15.117:3300/0 conn(0x7ff7c406f550 0x7ff7c406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.564+0000 7ff7c1d9b640 1 -- 172.21.15.50:0/3258905794 >> v1:172.21.15.117:6789/0 conn(0x7ff7c40ac890 legacy=0x7ff7c40acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.565+0000 7ff7c1d9b640 1 -- 172.21.15.50:0/3258905794 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40cdba0 con 0x7ff7c40ca160 2023-08-10T10:50:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.566+0000 7ff7c1d9b640 1 --2- 172.21.15.50:0/3258905794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c40ca160 0x7ff7c40cd660 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cc6c0 tx=0x7ff7b802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c847c1939ccfcd10 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.566+0000 7ff7c159a640 1 -- 172.21.15.50:0/3258905794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8031750 con 0x7ff7c40ca160 2023-08-10T10:50:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.566+0000 7ff7c159a640 1 -- 172.21.15.50:0/3258905794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b80318b0 con 0x7ff7c40ca160 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.566+0000 7ff7c159a640 1 -- 172.21.15.50:0/3258905794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8031c40 con 0x7ff7c40ca160 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 -- 172.21.15.50:0/3258905794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c40ca160 msgr2=0x7ff7c40cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 --2- 172.21.15.50:0/3258905794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c40ca160 0x7ff7c40cd660 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cc6c0 tx=0x7ff7b802b7f0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 -- 172.21.15.50:0/3258905794 shutdown_connections 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 --2- 172.21.15.50:0/3258905794 >> v2:172.21.15.117:3300/0 conn(0x7ff7c406f550 0x7ff7c406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 --2- 172.21.15.50:0/3258905794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c40ca160 0x7ff7c40cd660 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 -- 172.21.15.50:0/3258905794 >> 172.21.15.50:0/3258905794 conn(0x7ff7c40b08e0 msgr2=0x7ff7c40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 -- 172.21.15.50:0/3258905794 shutdown_connections 2023-08-10T10:50:21.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.567+0000 7ff7c8871640 1 -- 172.21.15.50:0/3258905794 wait complete. 2023-08-10T10:50:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.568+0000 7ff7c8871640 1 Processor -- start 2023-08-10T10:50:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.569+0000 7ff7c8871640 1 -- start start 2023-08-10T10:50:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c40ac890 0x7ff7c40c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40ca160 0x7ff7c40c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b2180 con 0x7ff7c406f550 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4155e90 con 0x7ff7c40ca160 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c8871640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b1220 con 0x7ff7c40ac890 2023-08-10T10:50:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54372/0 (socket says 172.21.15.50:54372) 2023-08-10T10:50:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 -- 172.21.15.50:0/2457904027 learned_addr learned my addr 172.21.15.50:0/2457904027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:50:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c2d9d640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40ca160 0x7ff7c40c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 -- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c40ac890 msgr2=0x7ff7c40c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c40ac890 0x7ff7c40c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 -- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40ca160 msgr2=0x7ff7c40c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.570+0000 7ff7c259c640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40ca160 0x7ff7c40c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7c259c640 1 -- 172.21.15.50:0/2457904027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80094d0 con 0x7ff7c406f550 2023-08-10T10:50:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7c259c640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ba50 tx=0x7ff7b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400cc10 con 0x7ff7c406f550 2023-08-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400cd70 con 0x7ff7c406f550 2023-08-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40b1500 con 0x7ff7c406f550 2023-08-10T10:50:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4014680 con 0x7ff7c406f550 2023-08-10T10:50:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.571+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40b1ac0 con 0x7ff7c406f550 2023-08-10T10:50:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.573+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c4066390 con 0x7ff7c406f550 2023-08-10T10:50:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.574+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7b401d3b0 con 0x7ff7c406f550 2023-08-10T10:50:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.575+0000 7ff7b2ffd640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 0x7ff7a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.575+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7b40895a0 con 0x7ff7c406f550 2023-08-10T10:50:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.575+0000 7ff7c1d9b640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 0x7ff7a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.576+0000 7ff7c1d9b640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 0x7ff7a406d110 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8035000 tx=0x7ff7b8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.579+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7b40545b0 con 0x7ff7c406f550 2023-08-10T10:50:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:21.772+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ff7c40cab20 con 0x7ff7c406f550 2023-08-10T10:50:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.714+0000 7ff7b2ffd640 1 -- 172.21.15.50:0/2457904027 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v173) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff7b4057bd0 con 0x7ff7c406f550 2023-08-10T10:50:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-10T10:50:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 msgr2=0x7ff7a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 0x7ff7a406d110 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8035000 tx=0x7ff7b8030000 comp rx=0 tx=0).stop 2023-08-10T10:50:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 msgr2=0x7ff7c4155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ba50 tx=0x7ff7b400bf10 comp rx=0 tx=0).stop 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 shutdown_connections 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff7a406ac50 0x7ff7a406d110 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40ca160 0x7ff7c40c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c40ac890 0x7ff7c40c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 --2- 172.21.15.50:0/2457904027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c406f550 0x7ff7c4155950 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 >> 172.21.15.50:0/2457904027 conn(0x7ff7c40b08e0 msgr2=0x7ff7c41604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.718+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 shutdown_connections 2023-08-10T10:50:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:50:22.719+0000 7ff7c8871640 1 -- 172.21.15.50:0/2457904027 wait complete. 2023-08-10T10:50:22.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:50:22.991 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:50:22.992 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:50:22.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-10T10:50:23.235 INFO:teuthology.orchestra.run.smithi050.stdout:{"mon_tick_interval":"5"} 2023-08-10T10:50:23.236 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-10T10:50:23.237 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-08-10T10:50:23.237 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:50:23.237 DEBUG:teuthology.orchestra.run.smithi050:> import time 2023-08-10T10:50:23.238 DEBUG:teuthology.orchestra.run.smithi050:> import datetime 2023-08-10T10:50:23.238 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-08-10T10:50:23.239 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-08-10T10:50:23.239 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.239 DEBUG:teuthology.orchestra.run.smithi050:> # Write some buffered data through before going full, all should be well 2023-08-10T10:50:23.240 DEBUG:teuthology.orchestra.run.smithi050:> print("writing some data through which we expect to succeed") 2023-08-10T10:50:23.240 DEBUG:teuthology.orchestra.run.smithi050:> bytes = 0 2023-08-10T10:50:23.240 DEBUG:teuthology.orchestra.run.smithi050:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-10T10:50:23.240 DEBUG:teuthology.orchestra.run.smithi050:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-10T10:50:23.241 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-08-10T10:50:23.241 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:50:23.241 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-10T10:50:23.242 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.242 DEBUG:teuthology.orchestra.run.smithi050:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-10T10:50:23.242 DEBUG:teuthology.orchestra.run.smithi050:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-10T10:50:23.243 DEBUG:teuthology.orchestra.run.smithi050:> # buffered IO, the error should always only appear from fsync and not 2023-08-10T10:50:23.243 DEBUG:teuthology.orchestra.run.smithi050:> # from write 2023-08-10T10:50:23.243 DEBUG:teuthology.orchestra.run.smithi050:> full = False 2023-08-10T10:50:23.244 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.244 DEBUG:teuthology.orchestra.run.smithi050:> for n in range(0, int(32 * 1.1)): 2023-08-10T10:50:23.244 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:50:23.245 DEBUG:teuthology.orchestra.run.smithi050:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-10T10:50:23.245 DEBUG:teuthology.orchestra.run.smithi050:> print("wrote bytes via buffered write, moving on to fsync") 2023-08-10T10:50:23.245 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-08-10T10:50:23.246 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2023-08-10T10:50:23.246 DEBUG:teuthology.orchestra.run.smithi050:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-08-10T10:50:23.246 DEBUG:teuthology.orchestra.run.smithi050:> raise 2023-08-10T10:50:23.247 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:50:23.247 DEBUG:teuthology.orchestra.run.smithi050:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:50:23.247 DEBUG:teuthology.orchestra.run.smithi050:> full = True 2023-08-10T10:50:23.248 DEBUG:teuthology.orchestra.run.smithi050:> break 2023-08-10T10:50:23.248 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.248 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-08-10T10:50:23.248 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f) 2023-08-10T10:50:23.249 DEBUG:teuthology.orchestra.run.smithi050:> print("fsync'"'"'ed successfully") 2023-08-10T10:50:23.249 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-08-10T10:50:23.249 DEBUG:teuthology.orchestra.run.smithi050:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:50:23.249 DEBUG:teuthology.orchestra.run.smithi050:> full = True 2023-08-10T10:50:23.250 DEBUG:teuthology.orchestra.run.smithi050:> break 2023-08-10T10:50:23.250 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-08-10T10:50:23.250 DEBUG:teuthology.orchestra.run.smithi050:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-10T10:50:23.251 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.251 DEBUG:teuthology.orchestra.run.smithi050:> if n > 32 * 0.9: 2023-08-10T10:50:23.251 DEBUG:teuthology.orchestra.run.smithi050:> # Be cautious in the last region where we expect to hit 2023-08-10T10:50:23.251 DEBUG:teuthology.orchestra.run.smithi050:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-08-10T10:50:23.252 DEBUG:teuthology.orchestra.run.smithi050:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-10T10:50:23.252 DEBUG:teuthology.orchestra.run.smithi050:> time.sleep(15.0) 2023-08-10T10:50:23.252 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.253 DEBUG:teuthology.orchestra.run.smithi050:> if not full: 2023-08-10T10:50:23.253 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-08-10T10:50:23.254 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.254 DEBUG:teuthology.orchestra.run.smithi050:> # close() should not raise an error because we already caught it in 2023-08-10T10:50:23.255 DEBUG:teuthology.orchestra.run.smithi050:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-08-10T10:50:23.256 DEBUG:teuthology.orchestra.run.smithi050:> # since then because all IOs got cancelled on the full flag. 2023-08-10T10:50:23.257 DEBUG:teuthology.orchestra.run.smithi050:> print("calling close") 2023-08-10T10:50:23.257 DEBUG:teuthology.orchestra.run.smithi050:> os.close(f) 2023-08-10T10:50:23.258 DEBUG:teuthology.orchestra.run.smithi050:> print("close() did not raise error") 2023-08-10T10:50:23.258 DEBUG:teuthology.orchestra.run.smithi050:> 2023-08-10T10:50:23.258 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-10T10:50:23.259 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-08-10T10:50:45.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:50:45.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:51:15.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:51:15.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:51:24.889 INFO:teuthology.orchestra.run.smithi050.stdout:writing some data through which we expect to succeed 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 1.00 MB 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 2.00 MB 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 3.00 MB 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 4.00 MB 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.891 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 5.00 MB 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 6.00 MB 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.892 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 7.00 MB 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 8.00 MB 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 9.00 MB 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 10.00 MB 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 11.00 MB 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 12.00 MB 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 13.00 MB 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 14.00 MB 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.895 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 15.00 MB 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 16.00 MB 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 17.00 MB 2023-08-10T10:51:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 18.00 MB 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 19.00 MB 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 20.00 MB 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 21.00 MB 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 22.00 MB 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 23.00 MB 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 24.00 MB 2023-08-10T10:51:24.899 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 25.00 MB 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 26.00 MB 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.900 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 27.00 MB 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 28.00 MB 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.901 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 29.00 MB 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 30.00 MB 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 31.00 MB 2023-08-10T10:51:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 32.00 MB 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:fsync'ed successfully 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:Not full yet after 33.00 MB 2023-08-10T10:51:24.903 INFO:teuthology.orchestra.run.smithi050.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-10T10:51:24.904 INFO:teuthology.orchestra.run.smithi050.stdout:Reached fullness after 33.00 MB 2023-08-10T10:51:24.904 INFO:teuthology.orchestra.run.smithi050.stdout:calling close 2023-08-10T10:51:24.904 INFO:teuthology.orchestra.run.smithi050.stdout:close() did not raise error 2023-08-10T10:51:25.098 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:51:25.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:51:25.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:51:25.358 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:51:25.359 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:51:25.359 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:25.423 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:51:25.423 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:25.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:25.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.711+0000 7f3b926c5640 1 Processor -- start 2023-08-10T10:51:25.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.711+0000 7f3b926c5640 1 -- start start 2023-08-10T10:51:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b8c15aa40 0x7f3b8c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c070e80 0x7f3b8c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c071c70 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c0713d0 con 0x7f3b8c15aa40 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b926c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0716b0 con 0x7f3b8c070e80 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b837fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b837fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34468/0 (socket says 172.21.15.50:34468) 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b837fe640 1 -- 172.21.15.50:0/2235383174 learned_addr learned my addr 172.21.15.50:0/2235383174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.713+0000 7f3b837fe640 1 -- 172.21.15.50:0/2235383174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c070e80 msgr2=0x7f3b8c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:25.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.714+0000 7f3b837fe640 1 --2- 172.21.15.50:0/2235383174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c070e80 0x7f3b8c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.714+0000 7f3b837fe640 1 -- 172.21.15.50:0/2235383174 >> v2:172.21.15.117:3300/0 conn(0x7f3b8c15aa40 msgr2=0x7f3b8c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:25.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.714+0000 7f3b837fe640 1 --2- 172.21.15.50:0/2235383174 >> v2:172.21.15.117:3300/0 conn(0x7f3b8c15aa40 0x7f3b8c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.714+0000 7f3b837fe640 1 -- 172.21.15.50:0/2235383174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c071990 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.715+0000 7f3b837fe640 1 --2- 172.21.15.50:0/2235383174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0c8dc0 tx=0x7f3b7402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f677e16297005cec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.715+0000 7f3b8b7fe640 1 -- 172.21.15.50:0/2235383174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740317e0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.715+0000 7f3b8b7fe640 1 -- 172.21.15.50:0/2235383174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74031940 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.715+0000 7f3b8b7fe640 1 -- 172.21.15.50:0/2235383174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74031cd0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 -- 172.21.15.50:0/2235383174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 msgr2=0x7f3b8c0b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 --2- 172.21.15.50:0/2235383174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0c8dc0 tx=0x7f3b7402b880 comp rx=0 tx=0).stop 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 -- 172.21.15.50:0/2235383174 shutdown_connections 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 --2- 172.21.15.50:0/2235383174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c070e80 0x7f3b8c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 --2- 172.21.15.50:0/2235383174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c0b3d60 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 --2- 172.21.15.50:0/2235383174 >> v2:172.21.15.117:3300/0 conn(0x7f3b8c15aa40 0x7f3b8c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 -- 172.21.15.50:0/2235383174 >> 172.21.15.50:0/2235383174 conn(0x7f3b8c06b590 msgr2=0x7f3b8c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 -- 172.21.15.50:0/2235383174 shutdown_connections 2023-08-10T10:51:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.716+0000 7f3b926c5640 1 -- 172.21.15.50:0/2235383174 wait complete. 2023-08-10T10:51:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.719+0000 7f3b926c5640 1 Processor -- start 2023-08-10T10:51:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.719+0000 7f3b926c5640 1 -- start start 2023-08-10T10:51:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 0x7f3b8c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 0x7f3b8c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c1f4980 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c15b2f0 con 0x7f3b8c070e80 2023-08-10T10:51:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b926c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c15b5d0 con 0x7f3b8c15aa40 2023-08-10T10:51:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.720+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34470/0 (socket says 172.21.15.50:34470) 2023-08-10T10:51:25.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 -- 172.21.15.50:0/3953842771 learned_addr learned my addr 172.21.15.50:0/3953842771 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:25.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b8bfff640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 0x7f3b8c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:25.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 -- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 msgr2=0x7f3b8c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b90c62640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 0x7f3b8c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 0x7f3b8c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 -- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 msgr2=0x7f3b8c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 0x7f3b8c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740094d0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b8bfff640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 0x7f3b8c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b90c62640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 0x7f3b8c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.721+0000 7f3b837fe640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000c00 tx=0x7f3b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.722+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74032880 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.722+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b740329e0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.722+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74032d90 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.722+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c15b8b0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.722+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c15be70 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.723+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c04e270 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.725+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b740453f0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.726+0000 7f3b897fa640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 0x7f3b6c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.726+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3b740ab9c0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.726+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f3b6c072f20 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.726+0000 7f3b8bfff640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 0x7f3b6c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.727+0000 7f3b8bfff640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 0x7f3b6c06d110 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00a850 tx=0x7f3b7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.733+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b740769e0 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.929+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b8c0cd250 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.932+0000 7f3b897fa640 1 -- 172.21.15.50:0/3953842771 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+18570 (secure 0 0 0) 0x7f3b7407a000 con 0x7f3b8c0b0c60 2023-08-10T10:51:25.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:25.934 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":176,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:10.864239+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.23","mappings":[{"from":4,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":2}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:25.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 msgr2=0x7f3b6c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:25.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 0x7f3b6c06d110 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00a850 tx=0x7f3b7c008040 comp rx=0 tx=0).stop 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 msgr2=0x7f3b8c15ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000c00 tx=0x7f3b740046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 shutdown_connections 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b8c15aa40 0x7f3b8c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b0c60 0x7f3b8c15ca80 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3b6c06ac50 0x7f3b6c06d110 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 --2- 172.21.15.50:0/3953842771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c070e80 0x7f3b8c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 >> 172.21.15.50:0/3953842771 conn(0x7f3b8c06b590 msgr2=0x7f3b8c0cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 shutdown_connections 2023-08-10T10:51:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:25.935+0000 7f3b926c5640 1 -- 172.21.15.50:0/3953842771 wait complete. 2023-08-10T10:51:25.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:50:08.132427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:50:08.751454+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:51:25.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.186+0000 7f7509e06640 1 Processor -- start 2023-08-10T10:51:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.186+0000 7f7509e06640 1 -- start start 2023-08-10T10:51:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.187+0000 7f7509e06640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75040cd9b0 0x7f75040b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7509e06640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750406c320 con 0x7f750406cb30 2023-08-10T10:51:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7509e06640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750406b770 con 0x7f750415ae40 2023-08-10T10:51:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7509e06640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750406b9f0 con 0x7f75040cd9b0 2023-08-10T10:51:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7502ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75040cd9b0 0x7f75040b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7503fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f750406cb30 0x7f75040c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40194/0 (socket says 172.21.15.50:40194) 2023-08-10T10:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.188+0000 7f7503fff640 1 -- 172.21.15.50:0/4054406397 learned_addr learned my addr 172.21.15.50:0/4054406397 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.189+0000 7f7502ffd640 1 -- 172.21.15.50:0/4054406397 >> v1:172.21.15.117:6789/0 conn(0x7f750415ae40 legacy=0x7f75040cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.189+0000 7f7502ffd640 1 -- 172.21.15.50:0/4054406397 >> v1:172.21.15.50:6789/0 conn(0x7f750406cb30 legacy=0x7f75040c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.189+0000 7f7502ffd640 1 -- 172.21.15.50:0/4054406397 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750406bcd0 con 0x7f75040cd9b0 2023-08-10T10:51:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.189+0000 7f75027fc640 1 -- 172.21.15.50:0/4054406397 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441918177 0 0) 0x7f750406c320 con 0x7f750406cb30 2023-08-10T10:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.190+0000 7f7502ffd640 1 --2- 172.21.15.50:0/4054406397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f75040b1510 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f74f80097a0 tx=0x7f74f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0257f8ebb202046 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.190+0000 7f75027fc640 1 -- 172.21.15.50:0/4054406397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8030610 con 0x7f75040cd9b0 2023-08-10T10:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.190+0000 7f75027fc640 1 -- 172.21.15.50:0/4054406397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8030770 con 0x7f75040cd9b0 2023-08-10T10:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.190+0000 7f75027fc640 1 -- 172.21.15.50:0/4054406397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8030b00 con 0x7f75040cd9b0 2023-08-10T10:51:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 -- 172.21.15.50:0/4054406397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 msgr2=0x7f75040b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 --2- 172.21.15.50:0/4054406397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f75040b1510 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f74f80097a0 tx=0x7f74f802b960 comp rx=0 tx=0).stop 2023-08-10T10:51:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 -- 172.21.15.50:0/4054406397 shutdown_connections 2023-08-10T10:51:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 --2- 172.21.15.50:0/4054406397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f75040b1510 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 -- 172.21.15.50:0/4054406397 >> 172.21.15.50:0/4054406397 conn(0x7f75040b01b0 msgr2=0x7f75040b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 -- 172.21.15.50:0/4054406397 shutdown_connections 2023-08-10T10:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.191+0000 7f7509e06640 1 -- 172.21.15.50:0/4054406397 wait complete. 2023-08-10T10:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.193+0000 7f7509e06640 1 Processor -- start 2023-08-10T10:51:26.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.193+0000 7f7509e06640 1 -- start start 2023-08-10T10:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f750406cb30 0x7f7504146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750415ae40 0x7f7504147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c7820 con 0x7f75040cd9b0 2023-08-10T10:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c6c10 con 0x7f750415ae40 2023-08-10T10:51:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7509e06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c6ef0 con 0x7f750406cb30 2023-08-10T10:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7502ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7502ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34492/0 (socket says 172.21.15.50:34492) 2023-08-10T10:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.194+0000 7f7502ffd640 1 -- 172.21.15.50:0/3490845362 learned_addr learned my addr 172.21.15.50:0/3490845362 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f75037fe640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f750406cb30 0x7f7504146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 -- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f750406cb30 msgr2=0x7f7504146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f750406cb30 0x7f7504146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 -- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750415ae40 msgr2=0x7f7504147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750415ae40 0x7f7504147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8009400 con 0x7f75040cd9b0 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f7502ffd640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f74f80098c0 tx=0x7f74f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.195+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f803e040 con 0x7f75040cd9b0 2023-08-10T10:51:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.196+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8039cb0 con 0x7f75040cd9b0 2023-08-10T10:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.196+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8044630 con 0x7f75040cd9b0 2023-08-10T10:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.196+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75040c71d0 con 0x7f75040cd9b0 2023-08-10T10:51:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.196+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750415b760 con 0x7f75040cd9b0 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.197+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75040ad6f0 con 0x7f75040cd9b0 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.198+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74f8043390 con 0x7f75040cd9b0 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.199+0000 7f74ebfff640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 0x7f74f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.199+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f74f80ab8e0 con 0x7f75040cd9b0 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.199+0000 7f75037fe640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 0x7f74f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.199+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f74f0072f20 con 0x7f75040cd9b0 2023-08-10T10:51:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.200+0000 7f75037fe640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 0x7f74f006d110 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000f60 tx=0x7f74f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.204+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f74f8076870 con 0x7f75040cd9b0 2023-08-10T10:51:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.396+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75040612b0 con 0x7f75040cd9b0 2023-08-10T10:51:26.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.397+0000 7f74ebfff640 1 -- 172.21.15.50:0/3490845362 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74f8049070 con 0x7f75040cd9b0 2023-08-10T10:51:26.398 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:51:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.399+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 msgr2=0x7f74f006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.399+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 0x7f74f006d110 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000f60 tx=0x7f74f4009040 comp rx=0 tx=0).stop 2023-08-10T10:51:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 msgr2=0x7f750415b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f74f80098c0 tx=0x7f74f8004730 comp rx=0 tx=0).stop 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 shutdown_connections 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f74f006ac50 0x7f74f006d110 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750415ae40 0x7f7504147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75040cd9b0 0x7f750415b220 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 --2- 172.21.15.50:0/3490845362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f750406cb30 0x7f7504146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 >> 172.21.15.50:0/3490845362 conn(0x7f75040b01b0 msgr2=0x7f7504159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 shutdown_connections 2023-08-10T10:51:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.400+0000 7f7509e06640 1 -- 172.21.15.50:0/3490845362 wait complete. 2023-08-10T10:51:26.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:51:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.646+0000 7f4a28739640 1 Processor -- start 2023-08-10T10:51:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.646+0000 7f4a28739640 1 -- start start 2023-08-10T10:51:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.648+0000 7f4a28739640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a2015cbb0 0x7f4a201612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.648+0000 7f4a28739640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a20161800 con 0x7f4a200c98b0 2023-08-10T10:51:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.648+0000 7f4a28739640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a20160870 con 0x7f4a200c9420 2023-08-10T10:51:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.648+0000 7f4a28739640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200ca370 con 0x7f4a2015cbb0 2023-08-10T10:51:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.648+0000 7f4a264d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a2015cbb0 0x7f4a201612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a264d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a2015cbb0 0x7f4a201612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:45550/0 (socket says 172.21.15.50:45550) 2023-08-10T10:51:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a264d5640 1 -- 172.21.15.50:0/664741094 learned_addr learned my addr 172.21.15.50:0/664741094 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a25cd4640 1 --1- 172.21.15.50:0/664741094 >> v1:172.21.15.50:6789/0 conn(0x7f4a200c98b0 0x7f4a200c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40196/0 (socket says 172.21.15.50:40196) 2023-08-10T10:51:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a254d3640 1 -- 172.21.15.50:0/664741094 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769961526 0 0) 0x7f4a10001110 con 0x7f4a200c98b0 2023-08-10T10:51:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a254d3640 1 -- 172.21.15.50:0/664741094 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a0c003520 con 0x7f4a200c98b0 2023-08-10T10:51:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a264d5640 1 -- 172.21.15.50:0/664741094 >> v1:172.21.15.117:6789/0 conn(0x7f4a200c9420 legacy=0x7f4a2006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a264d5640 1 -- 172.21.15.50:0/664741094 >> v1:172.21.15.50:6789/0 conn(0x7f4a200c98b0 legacy=0x7f4a200c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.649+0000 7f4a264d5640 1 -- 172.21.15.50:0/664741094 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200ca650 con 0x7f4a2015cbb0 2023-08-10T10:51:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.651+0000 7f4a264d5640 1 --2- 172.21.15.50:0/664741094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015cbb0 0x7f4a201612c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009870 tx=0x7f4a1c02b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a82b153ea97bfd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.651+0000 7f4a254d3640 1 -- 172.21.15.50:0/664741094 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c030850 con 0x7f4a2015cbb0 2023-08-10T10:51:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.651+0000 7f4a254d3640 1 -- 172.21.15.50:0/664741094 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0309b0 con 0x7f4a2015cbb0 2023-08-10T10:51:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.651+0000 7f4a254d3640 1 -- 172.21.15.50:0/664741094 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c030d40 con 0x7f4a2015cbb0 2023-08-10T10:51:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 -- 172.21.15.50:0/664741094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015cbb0 msgr2=0x7f4a201612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 --2- 172.21.15.50:0/664741094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015cbb0 0x7f4a201612c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009870 tx=0x7f4a1c02b990 comp rx=0 tx=0).stop 2023-08-10T10:51:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 -- 172.21.15.50:0/664741094 shutdown_connections 2023-08-10T10:51:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 --2- 172.21.15.50:0/664741094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015cbb0 0x7f4a201612c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 -- 172.21.15.50:0/664741094 >> 172.21.15.50:0/664741094 conn(0x7f4a200b01b0 msgr2=0x7f4a200b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:26.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 -- 172.21.15.50:0/664741094 shutdown_connections 2023-08-10T10:51:26.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.652+0000 7f4a28739640 1 -- 172.21.15.50:0/664741094 wait complete. 2023-08-10T10:51:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.654+0000 7f4a28739640 1 Processor -- start 2023-08-10T10:51:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.654+0000 7f4a28739640 1 -- start start 2023-08-10T10:51:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a200c9420 0x7f4a20159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 0x7f4a200c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2006bbc0 con 0x7f4a200c98b0 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2006b100 con 0x7f4a200c9420 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a28739640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ae960 con 0x7f4a2015cbb0 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.655+0000 7f4a25cd4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34494/0 (socket says 172.21.15.50:34494) 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 -- 172.21.15.50:0/3113460375 learned_addr learned my addr 172.21.15.50:0/3113460375 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a264d5640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a200c9420 0x7f4a20159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a26cd6640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 0x7f4a200c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 -- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 msgr2=0x7f4a200c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 0x7f4a200c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 -- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a200c9420 msgr2=0x7f4a20159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a200c9420 0x7f4a20159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0094d0 con 0x7f4a200c98b0 2023-08-10T10:51:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a26cd6640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 0x7f4a200c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.656+0000 7f4a25cd4640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c420 tx=0x7f4a1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.657+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100074e0 con 0x7f4a200c98b0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.657+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10007640 con 0x7f4a200c98b0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.657+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10004a20 con 0x7f4a200c98b0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.657+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a200aec40 con 0x7f4a200c98b0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.657+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2006b3c0 con 0x7f4a200c98b0 2023-08-10T10:51:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.658+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200612b0 con 0x7f4a200c98b0 2023-08-10T10:51:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.659+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a10004b80 con 0x7f4a200c98b0 2023-08-10T10:51:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.660+0000 7f4a16ffd640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 0x7f4a0406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.660+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4a10088e50 con 0x7f4a200c98b0 2023-08-10T10:51:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.660+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f4a04072f50 con 0x7f4a200c98b0 2023-08-10T10:51:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.660+0000 7f4a264d5640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 0x7f4a0406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.661+0000 7f4a264d5640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 0x7f4a0406d140 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c036000 tx=0x7f4a1c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.664+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4a10053e70 con 0x7f4a200c98b0 2023-08-10T10:51:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.858+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a20161800 con 0x7f4a200c98b0 2023-08-10T10:51:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.859+0000 7f4a16ffd640 1 -- 172.21.15.50:0/3113460375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a20161800 con 0x7f4a200c98b0 2023-08-10T10:51:26.861 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:51:26.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 msgr2=0x7f4a0406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 0x7f4a0406d140 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c036000 tx=0x7f4a1c008030 comp rx=0 tx=0).stop 2023-08-10T10:51:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 msgr2=0x7f4a20158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c420 tx=0x7f4a1000c8e0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 shutdown_connections 2023-08-10T10:51:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015cbb0 0x7f4a200c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a200c98b0 0x7f4a20158f00 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4a0406ac80 0x7f4a0406d140 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 --2- 172.21.15.50:0/3113460375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a200c9420 0x7f4a20159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 >> 172.21.15.50:0/3113460375 conn(0x7f4a200b01b0 msgr2=0x7f4a200af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 shutdown_connections 2023-08-10T10:51:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:26.862+0000 7f4a28739640 1 -- 172.21.15.50:0/3113460375 wait complete. 2023-08-10T10:51:26.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:51:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.112+0000 7fc3c3d55640 1 Processor -- start 2023-08-10T10:51:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.113+0000 7fc3c3d55640 1 -- start start 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 0x7fc3bc06f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc0c8d10 0x7fc3bc0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc159750 con 0x7fc3bc06ec90 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0ade50 con 0x7fc3bc0ada70 2023-08-10T10:51:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.114+0000 7fc3c3d55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0ca220 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34508/0 (socket says 172.21.15.50:34508) 2023-08-10T10:51:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 -- 172.21.15.50:0/421230889 learned_addr learned my addr 172.21.15.50:0/421230889 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c1af1640 1 --2- 172.21.15.50:0/421230889 >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 0x7fc3bc06f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 -- 172.21.15.50:0/421230889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc0c8d10 msgr2=0x7fc3bc0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 --2- 172.21.15.50:0/421230889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc0c8d10 0x7fc3bc0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 -- 172.21.15.50:0/421230889 >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 msgr2=0x7fc3bc06f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 --2- 172.21.15.50:0/421230889 >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 0x7fc3bc06f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c12f0640 1 -- 172.21.15.50:0/421230889 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0ca500 con 0x7fc3bc06ec90 2023-08-10T10:51:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.115+0000 7fc3c1af1640 1 --2- 172.21.15.50:0/421230889 >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 0x7fc3bc06f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.116+0000 7fc3c12f0640 1 --2- 172.21.15.50:0/421230889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc073e80 tx=0x7fc3ac02dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6046eaca1ea6e764 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.117+0000 7fc3c0aef640 1 -- 172.21.15.50:0/421230889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac02ec50 con 0x7fc3bc06ec90 2023-08-10T10:51:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.117+0000 7fc3c0aef640 1 -- 172.21.15.50:0/421230889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac032070 con 0x7fc3bc06ec90 2023-08-10T10:51:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.117+0000 7fc3c0aef640 1 -- 172.21.15.50:0/421230889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac038400 con 0x7fc3bc06ec90 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.117+0000 7fc3c3d55640 1 -- 172.21.15.50:0/421230889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06ec90 msgr2=0x7fc3bc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/421230889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc073e80 tx=0x7fc3ac02dea0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 -- 172.21.15.50:0/421230889 shutdown_connections 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/421230889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc0c8d10 0x7fc3bc0c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/421230889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc06ec90 0x7fc3bc06f9d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/421230889 >> v2:172.21.15.117:3300/0 conn(0x7fc3bc0ada70 0x7fc3bc06f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 -- 172.21.15.50:0/421230889 >> 172.21.15.50:0/421230889 conn(0x7fc3bc0b01b0 msgr2=0x7fc3bc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 -- 172.21.15.50:0/421230889 shutdown_connections 2023-08-10T10:51:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.118+0000 7fc3c3d55640 1 -- 172.21.15.50:0/421230889 wait complete. 2023-08-10T10:51:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.120+0000 7fc3c3d55640 1 Processor -- start 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.120+0000 7fc3c3d55640 1 -- start start 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06ec90 0x7fc3bc0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3bc0ada70 0x7fc3bc156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c6e20 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c3120 con 0x7fc3bc0ada70 2023-08-10T10:51:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c3d55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c3400 con 0x7fc3bc06ec90 2023-08-10T10:51:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c22f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c22f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34520/0 (socket says 172.21.15.50:34520) 2023-08-10T10:51:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.121+0000 7fc3c22f2640 1 -- 172.21.15.50:0/1768063384 learned_addr learned my addr 172.21.15.50:0/1768063384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 -- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06ec90 msgr2=0x7fc3bc0aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06ec90 0x7fc3bc0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 -- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3bc0ada70 msgr2=0x7fc3bc156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3bc0ada70 0x7fc3bc156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac00b760 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c22f2640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400b970 tx=0x7fc3b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400cb40 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400ccc0 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4014680 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.122+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0c36e0 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.123+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc0acfb0 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.124+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc0612b0 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.124+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3b401d3b0 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.125+0000 7fc3b27fc640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 0x7fc3a006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.126+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc3b4089580 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.126+0000 7fc3c1af1640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 0x7fc3a006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.126+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fc3a0072f20 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.126+0000 7fc3c1af1640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 0x7fc3a006d110 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006fd0 tx=0x7fc3b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.130+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc3b4054510 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.321+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3bc0c6f60 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.322+0000 7fc3b27fc640 1 -- 172.21.15.50:0/1768063384 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v176) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b4019070 con 0x7fc3bc0c8d10 2023-08-10T10:51:27.324 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:51:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 msgr2=0x7fc3a006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 0x7fc3a006d110 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006fd0 tx=0x7fc3b8008040 comp rx=0 tx=0).stop 2023-08-10T10:51:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 msgr2=0x7fc3bc156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400b970 tx=0x7fc3b400be30 comp rx=0 tx=0).stop 2023-08-10T10:51:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 shutdown_connections 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3bc0c8d10 0x7fc3bc156fb0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc3a006ac50 0x7fc3a006d110 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3bc0ada70 0x7fc3bc156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 --2- 172.21.15.50:0/1768063384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06ec90 0x7fc3bc0aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 >> 172.21.15.50:0/1768063384 conn(0x7fc3bc0b01b0 msgr2=0x7fc3bc158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 shutdown_connections 2023-08-10T10:51:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.325+0000 7fc3c3d55640 1 -- 172.21.15.50:0/1768063384 wait complete. 2023-08-10T10:51:27.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:51:27.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.569+0000 7f6251a7e640 1 Processor -- start 2023-08-10T10:51:27.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.569+0000 7f6251a7e640 1 -- start start 2023-08-10T10:51:27.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6251a7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f624c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6251a7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f624c15e4d0 0x7f624c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6251a7e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c06a040 con 0x7f624c1583c0 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6251a7e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c15aee0 con 0x7f624c15e4d0 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6251a7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0b2100 con 0x7f624c0696a0 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6250a7c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f624c1583c0 0x7f624c0b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40200/0 (socket says 172.21.15.50:40200) 2023-08-10T10:51:27.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.571+0000 7f6250a7c640 1 -- 172.21.15.50:0/3007788829 learned_addr learned my addr 172.21.15.50:0/3007788829 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114259355 0 0) 0x7f624c06a040 con 0x7f624c1583c0 2023-08-10T10:51:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f623c003520 con 0x7f624c1583c0 2023-08-10T10:51:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f625127d640 1 --2- 172.21.15.50:0/3007788829 >> v2:172.21.15.117:3300/0 conn(0x7f624c15e4d0 0x7f624c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624bfff640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f624c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300232811 0 0) 0x7f623c003520 con 0x7f624c1583c0 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 msgr2=0x7f624c069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f624c069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 >> v2:172.21.15.117:3300/0 conn(0x7f624c15e4d0 msgr2=0x7f624c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 --2- 172.21.15.50:0/3007788829 >> v2:172.21.15.117:3300/0 conn(0x7f624c15e4d0 0x7f624c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c15b1a0 con 0x7f624c1583c0 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6240001670 con 0x7f624c1583c0 2023-08-10T10:51:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 >> v1:172.21.15.50:6789/0 conn(0x7f624c1583c0 legacy=0x7f624c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f623c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004010 0x7f623c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623c004d00 0x7f623c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15aee0 con 0x7f623c004d00 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0b2100 con 0x7f623c004010 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c00bb10 con 0x7f624c0696a0 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.572+0000 7f625127d640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623c004d00 0x7f623c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f6250a7c640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f623c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f624bfff640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004010 0x7f623c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f625127d640 1 -- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 msgr2=0x7f623c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f625127d640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0696a0 0x7f623c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f625127d640 1 -- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004010 msgr2=0x7f623c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f625127d640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004010 0x7f623c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f625127d640 1 -- 172.21.15.50:0/3007788829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c003520 con 0x7f623c004d00 2023-08-10T10:51:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.573+0000 7f624bfff640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004010 0x7f623c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.574+0000 7f625127d640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623c004d00 0x7f623c005180 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f6244007330 tx=0x7f623c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ef08a41c86c27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.574+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624402ccd0 con 0x7f623c004d00 2023-08-10T10:51:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.574+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624402ce30 con 0x7f623c004d00 2023-08-10T10:51:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.574+0000 7f624b7fe640 1 -- 172.21.15.50:0/3007788829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244034660 con 0x7f623c004d00 2023-08-10T10:51:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 -- 172.21.15.50:0/3007788829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623c004d00 msgr2=0x7f623c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 --2- 172.21.15.50:0/3007788829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f623c004d00 0x7f623c005180 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f6244007330 tx=0x7f623c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f625127d640 1 -- 172.21.15.50:0/3007788829 reap_dead start 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 -- 172.21.15.50:0/3007788829 shutdown_connections 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 -- 172.21.15.50:0/3007788829 >> 172.21.15.50:0/3007788829 conn(0x7f624c0caf80 msgr2=0x7f624c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 -- 172.21.15.50:0/3007788829 shutdown_connections 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.575+0000 7f6251a7e640 1 -- 172.21.15.50:0/3007788829 wait complete. 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.577+0000 7f6251a7e640 1 Processor -- start 2023-08-10T10:51:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.577+0000 7f6251a7e640 1 -- start start 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623c004d00 0x7f624c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0ce9b0 0x7f624c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0cee30 con 0x7f624c159ca0 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15cf60 con 0x7f624c0ce9b0 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f6251a7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15d240 con 0x7f623c004d00 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f624bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f624bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34534/0 (socket says 172.21.15.50:34534) 2023-08-10T10:51:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.578+0000 7f624bfff640 1 -- 172.21.15.50:0/448277363 learned_addr learned my addr 172.21.15.50:0/448277363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 -- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623c004d00 msgr2=0x7f624c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623c004d00 0x7f624c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 -- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0ce9b0 msgr2=0x7f624c15c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0ce9b0 0x7f624c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c15d520 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f624bfff640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f623800e7e0 tx=0x7f623800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800c6d0 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800c830 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800cbe0 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.579+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c15d800 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.580+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c15c7b0 con 0x7f624c159ca0 2023-08-10T10:51:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.581+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c066e30 con 0x7f624c159ca0 2023-08-10T10:51:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.582+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f623800cd40 con 0x7f624c159ca0 2023-08-10T10:51:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.583+0000 7f62497fa640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 0x7f623006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.583+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f6238089320 con 0x7f624c159ca0 2023-08-10T10:51:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.583+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f6230072f10 con 0x7f624c159ca0 2023-08-10T10:51:27.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.583+0000 7f6250a7c640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 0x7f623006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:27.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.584+0000 7f6250a7c640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 0x7f623006d100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6240000f60 tx=0x7f6240000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:27.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.587+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f62380542b0 con 0x7f624c159ca0 2023-08-10T10:51:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.801+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f624c0c8420 con 0x7f624c159ca0 2023-08-10T10:51:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.802+0000 7f62497fa640 1 -- 172.21.15.50:0/448277363 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v176) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62380210a0 con 0x7f624c159ca0 2023-08-10T10:51:27.804 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:51:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 msgr2=0x7f623006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 0x7f623006d100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6240000f60 tx=0x7f6240000ed0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 msgr2=0x7f624c0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f623800e7e0 tx=0x7f623800eca0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 shutdown_connections 2023-08-10T10:51:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f623006ac40 0x7f623006d100 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0ce9b0 0x7f624c15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624c159ca0 0x7f624c0ce470 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 --2- 172.21.15.50:0/448277363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f623c004d00 0x7f624c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 >> 172.21.15.50:0/448277363 conn(0x7f624c0caf80 msgr2=0x7f624c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 shutdown_connections 2023-08-10T10:51:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:27.804+0000 7f6251a7e640 1 -- 172.21.15.50:0/448277363 wait complete. 2023-08-10T10:51:27.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:51:28.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.050+0000 7f404ca05640 1 Processor -- start 2023-08-10T10:51:28.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.051+0000 7f404ca05640 1 -- start start 2023-08-10T10:51:28.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.052+0000 7f404ca05640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f404815ff90 0x7f4048160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.052+0000 7f404ca05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480cd960 0x7f40480d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.052+0000 7f404ca05640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4048160370 con 0x7f40480d2370 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.052+0000 7f404ca05640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480d0b90 con 0x7f404815ff90 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.052+0000 7f404ca05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40481614d0 con 0x7f40480cd960 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f404815ff90 0x7f4048160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f404815ff90 0x7f4048160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34544/0 (socket says 172.21.15.50:34544) 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 -- 172.21.15.50:0/2963176367 learned_addr learned my addr 172.21.15.50:0/2963176367 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 -- 172.21.15.50:0/2963176367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480cd960 msgr2=0x7f40480d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 --2- 172.21.15.50:0/2963176367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480cd960 0x7f40480d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 -- 172.21.15.50:0/2963176367 >> v1:172.21.15.117:6789/0 conn(0x7f40480d2370 legacy=0x7f40480d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:28.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.053+0000 7f4046d9d640 1 -- 172.21.15.50:0/2963176367 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480d0d90 con 0x7f404815ff90 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.054+0000 7f4046d9d640 1 --2- 172.21.15.50:0/2963176367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f4048160f90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f4038009870 tx=0x7f403802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d47145b16048b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.054+0000 7f4045d9b640 1 -- 172.21.15.50:0/2963176367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038031640 con 0x7f404815ff90 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.054+0000 7f4045d9b640 1 -- 172.21.15.50:0/2963176367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40380317a0 con 0x7f404815ff90 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.054+0000 7f4045d9b640 1 -- 172.21.15.50:0/2963176367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038031b30 con 0x7f404815ff90 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 -- 172.21.15.50:0/2963176367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 msgr2=0x7f4048160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 --2- 172.21.15.50:0/2963176367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f4048160f90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f4038009870 tx=0x7f403802b8f0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 -- 172.21.15.50:0/2963176367 shutdown_connections 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 --2- 172.21.15.50:0/2963176367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480cd960 0x7f40480d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 --2- 172.21.15.50:0/2963176367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f4048160f90 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 -- 172.21.15.50:0/2963176367 >> 172.21.15.50:0/2963176367 conn(0x7f4048069ac0 msgr2=0x7f4048069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 -- 172.21.15.50:0/2963176367 shutdown_connections 2023-08-10T10:51:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.055+0000 7f404ca05640 1 -- 172.21.15.50:0/2963176367 wait complete. 2023-08-10T10:51:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.057+0000 7f404ca05640 1 Processor -- start 2023-08-10T10:51:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.057+0000 7f404ca05640 1 -- start start 2023-08-10T10:51:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.058+0000 7f404ca05640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40480cd960 0x7f40480cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.058+0000 7f404ca05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480d2370 0x7f404815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.058+0000 7f404ca05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404ca05640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480b11b0 con 0x7f404815ff90 2023-08-10T10:51:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404ca05640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40481f20e0 con 0x7f40480cd960 2023-08-10T10:51:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404ca05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40481f2f30 con 0x7f40480d2370 2023-08-10T10:51:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34548/0 (socket says 172.21.15.50:34548) 2023-08-10T10:51:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 -- 172.21.15.50:0/372938863 learned_addr learned my addr 172.21.15.50:0/372938863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f4046d9d640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40480cd960 0x7f40480cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404659c640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480d2370 0x7f404815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 -- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480d2370 msgr2=0x7f404815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480d2370 0x7f404815b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 -- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40480cd960 msgr2=0x7f40480cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40480cd960 0x7f40480cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.059+0000 7f404759e640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40380094d0 con 0x7f404815ff90 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f404759e640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f404000c7b0 tx=0x7f404000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040003d80 con 0x7f404815ff90 2023-08-10T10:51:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000ce60 con 0x7f404815ff90 2023-08-10T10:51:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400052b0 con 0x7f404815ff90 2023-08-10T10:51:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40481f2320 con 0x7f404815ff90 2023-08-10T10:51:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.060+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40481f28e0 con 0x7f404815ff90 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.061+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4048066e30 con 0x7f404815ff90 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.062+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4040005410 con 0x7f404815ff90 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.063+0000 7f403f7fe640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 0x7f402806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.063+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f4040088a50 con 0x7f404815ff90 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.063+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f4028072fd0 con 0x7f404815ff90 2023-08-10T10:51:28.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.064+0000 7f4046d9d640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 0x7f402806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.064+0000 7f4046d9d640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 0x7f402806d140 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4038036000 tx=0x7f403803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.067+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4040017060 con 0x7f404815ff90 2023-08-10T10:51:28.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.267+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40480d05c0 con 0x7f404815ff90 2023-08-10T10:51:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.268+0000 7f403f7fe640 1 -- 172.21.15.50:0/372938863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v176) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4040017030 con 0x7f404815ff90 2023-08-10T10:51:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:51:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 msgr2=0x7f402806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 0x7f402806d140 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4038036000 tx=0x7f403803c040 comp rx=0 tx=0).stop 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 msgr2=0x7f40480b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f404000c7b0 tx=0x7f404000cc70 comp rx=0 tx=0).stop 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 shutdown_connections 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f404815ff90 0x7f40480b2090 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40480d2370 0x7f404815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f402806ac80 0x7f402806d140 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 --2- 172.21.15.50:0/372938863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40480cd960 0x7f40480cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 >> 172.21.15.50:0/372938863 conn(0x7f4048069ac0 msgr2=0x7f404806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 shutdown_connections 2023-08-10T10:51:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.271+0000 7f404ca05640 1 -- 172.21.15.50:0/372938863 wait complete. 2023-08-10T10:51:28.291 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:51:28.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:28.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:51:28.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:51:28.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:28.428 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:51:28.485 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:51:28.486 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:28.543 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:51:28.544 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:28.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.832+0000 7f2f2e06a640 1 Processor -- start 2023-08-10T10:51:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.832+0000 7f2f2e06a640 1 -- start start 2023-08-10T10:51:28.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f28153850 0x7f2f280b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f28153c30 0x7f2f280b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f280cf630 0x7f2f280cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280cffe0 con 0x7f2f280cf630 2023-08-10T10:51:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2815d010 con 0x7f2f28153850 2023-08-10T10:51:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2e06a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815d290 con 0x7f2f28153c30 2023-08-10T10:51:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.833+0000 7f2f2d869640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f280cf630 0x7f2f280cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f280cf630 0x7f2f280cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34556/0 (socket says 172.21.15.50:34556) 2023-08-10T10:51:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 -- 172.21.15.50:0/3804788037 learned_addr learned my addr 172.21.15.50:0/3804788037 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d068640 1 --2- 172.21.15.50:0/3804788037 >> v2:172.21.15.117:3300/0 conn(0x7f2f28153850 0x7f2f280b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2c867640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f28153c30 0x7f2f280b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 -- 172.21.15.50:0/3804788037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f28153c30 msgr2=0x7f2f280b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f28153c30 0x7f2f280b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 -- 172.21.15.50:0/3804788037 >> v2:172.21.15.117:3300/0 conn(0x7f2f28153850 msgr2=0x7f2f280b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 --2- 172.21.15.50:0/3804788037 >> v2:172.21.15.117:3300/0 conn(0x7f2f28153850 0x7f2f280b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.834+0000 7f2f2d869640 1 -- 172.21.15.50:0/3804788037 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2815d570 con 0x7f2f280cf630 2023-08-10T10:51:28.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.835+0000 7f2f2d869640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f280cf630 0x7f2f280cfaa0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f2f28070d30 tx=0x7f2f2002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276c0efe30e8fb28 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f1ffff640 1 -- 172.21.15.50:0/3804788037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2002ca80 con 0x7f2f280cf630 2023-08-10T10:51:28.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f1ffff640 1 -- 172.21.15.50:0/3804788037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2002cbe0 con 0x7f2f280cf630 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f1ffff640 1 -- 172.21.15.50:0/3804788037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f200343f0 con 0x7f2f280cf630 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 -- 172.21.15.50:0/3804788037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f280cf630 msgr2=0x7f2f280cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f280cf630 0x7f2f280cfaa0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f2f28070d30 tx=0x7f2f2002bee0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 -- 172.21.15.50:0/3804788037 shutdown_connections 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f280cf630 0x7f2f280cfaa0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/3804788037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f28153c30 0x7f2f280b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/3804788037 >> v2:172.21.15.117:3300/0 conn(0x7f2f28153850 0x7f2f280b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.836+0000 7f2f2e06a640 1 -- 172.21.15.50:0/3804788037 >> 172.21.15.50:0/3804788037 conn(0x7f2f28069880 msgr2=0x7f2f28069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:28.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.837+0000 7f2f2e06a640 1 -- 172.21.15.50:0/3804788037 shutdown_connections 2023-08-10T10:51:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.837+0000 7f2f2e06a640 1 -- 172.21.15.50:0/3804788037 wait complete. 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.838+0000 7f2f2e06a640 1 Processor -- start 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.838+0000 7f2f2e06a640 1 -- start start 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.839+0000 7f2f2e06a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f280cf630 0x7f2f280c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.839+0000 7f2f2e06a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.839+0000 7f2f2e06a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f28153c30 0x7f2f280c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2e06a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280d1790 con 0x7f2f28153850 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2e06a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280c5930 con 0x7f2f28153c30 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2e06a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280d0b80 con 0x7f2f280cf630 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34570/0 (socket says 172.21.15.50:34570) 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 -- 172.21.15.50:0/2153321572 learned_addr learned my addr 172.21.15.50:0/2153321572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2d869640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f28153c30 0x7f2f280c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2d068640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f280cf630 0x7f2f280c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 -- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f280cf630 msgr2=0x7f2f280c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f280cf630 0x7f2f280c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 -- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f28153c30 msgr2=0x7f2f280c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f28153c30 0x7f2f280c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.840+0000 7f2f2c867640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009b30 con 0x7f2f28153850 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f2c867640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800d620 tx=0x7f2f1800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800b620 con 0x7f2f28153850 2023-08-10T10:51:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800b780 con 0x7f2f28153850 2023-08-10T10:51:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800bb10 con 0x7f2f28153850 2023-08-10T10:51:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280d0e60 con 0x7f2f28153850 2023-08-10T10:51:28.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.841+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f280d1420 con 0x7f2f28153850 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.842+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f28066e30 con 0x7f2f28153850 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.843+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f1800bc70 con 0x7f2f28153850 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.846+0000 7f2f1dffb640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 0x7f2f0c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.846+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2f18089a00 con 0x7f2f28153850 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.846+0000 7f2f2d068640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 0x7f2f0c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.846+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f2f0c072f20 con 0x7f2f28153850 2023-08-10T10:51:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.846+0000 7f2f2d068640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 0x7f2f0c06d110 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:28.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:28.849+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2f18054a20 con 0x7f2f28153850 2023-08-10T10:51:29.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.041+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f280b55c0 con 0x7f2f28153850 2023-08-10T10:51:29.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.043+0000 7f2f1dffb640 1 -- 172.21.15.50:0/2153321572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+18570 (secure 0 0 0) 0x7f2f18058040 con 0x7f2f28153850 2023-08-10T10:51:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:29.045 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":176,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:10.864239+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.23","mappings":[{"from":4,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":2}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.045+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 msgr2=0x7f2f0c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.045+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 0x7f2f0c06d110 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24008040 comp rx=0 tx=0).stop 2023-08-10T10:51:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.045+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 msgr2=0x7f2f280c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.045+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800d620 tx=0x7f2f1800dae0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 shutdown_connections 2023-08-10T10:51:29.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f0c06ac50 0x7f2f0c06d110 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f28153c30 0x7f2f280c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f28153850 0x7f2f280c53f0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 --2- 172.21.15.50:0/2153321572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f280cf630 0x7f2f280c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 >> 172.21.15.50:0/2153321572 conn(0x7f2f28069880 msgr2=0x7f2f280b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 shutdown_connections 2023-08-10T10:51:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.046+0000 7f2f2e06a640 1 -- 172.21.15.50:0/2153321572 wait complete. 2023-08-10T10:51:29.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:50:08.132427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:50:08.751454+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:51:29.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.284+0000 7ffae0f17640 1 Processor -- start 2023-08-10T10:51:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 -- start start 2023-08-10T10:51:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffadc15fde0 0x7ffadc06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 0x7ffadc0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 0x7ffadc1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc06b0c0 con 0x7ffadc15fde0 2023-08-10T10:51:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0cd920 con 0x7ffadc0cd490 2023-08-10T10:51:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffae0f17640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc06a5c0 con 0x7ffadc0b1e00 2023-08-10T10:51:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.285+0000 7ffadb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffadc15fde0 0x7ffadc06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffadc15fde0 0x7ffadc06a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34572/0 (socket says 172.21.15.50:34572) 2023-08-10T10:51:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 -- 172.21.15.50:0/2248618525 learned_addr learned my addr 172.21.15.50:0/2248618525 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadaffd640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 0x7ffadc0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 -- 172.21.15.50:0/2248618525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 msgr2=0x7ffadc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadbfff640 1 --2- 172.21.15.50:0/2248618525 >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 0x7ffadc1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 0x7ffadc0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 -- 172.21.15.50:0/2248618525 >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 msgr2=0x7ffadc1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/2248618525 >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 0x7ffadc1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadb7fe640 1 -- 172.21.15.50:0/2248618525 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc06a820 con 0x7ffadc15fde0 2023-08-10T10:51:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadaffd640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 0x7ffadc0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.286+0000 7ffadbfff640 1 --2- 172.21.15.50:0/2248618525 >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 0x7ffadc1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.288+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc15fde0 0x7ffadc06a080 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0d36d0 tx=0x7ffacc02b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d5bbd92eeafe9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffada7fc640 1 -- 172.21.15.50:0/2248618525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc031760 con 0x7ffadc15fde0 2023-08-10T10:51:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffada7fc640 1 -- 172.21.15.50:0/2248618525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0318c0 con 0x7ffadc15fde0 2023-08-10T10:51:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffada7fc640 1 -- 172.21.15.50:0/2248618525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc031c50 con 0x7ffadc15fde0 2023-08-10T10:51:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffae0f17640 1 -- 172.21.15.50:0/2248618525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc15fde0 msgr2=0x7ffadc06a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffae0f17640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc15fde0 0x7ffadc06a080 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0d36d0 tx=0x7ffacc02b800 comp rx=0 tx=0).stop 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.289+0000 7ffae0f17640 1 -- 172.21.15.50:0/2248618525 shutdown_connections 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 --2- 172.21.15.50:0/2248618525 >> v2:172.21.15.117:3300/0 conn(0x7ffadc0cd490 0x7ffadc1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0b1e00 0x7ffadc0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 --2- 172.21.15.50:0/2248618525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc15fde0 0x7ffadc06a080 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 -- 172.21.15.50:0/2248618525 >> 172.21.15.50:0/2248618525 conn(0x7ffadc0d2900 msgr2=0x7ffadc0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 -- 172.21.15.50:0/2248618525 shutdown_connections 2023-08-10T10:51:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.290+0000 7ffae0f17640 1 -- 172.21.15.50:0/2248618525 wait complete. 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.291+0000 7ffae0f17640 1 Processor -- start 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 -- start start 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0cd490 0x7ffadc0acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffadc15fde0 0x7ffadc0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0abb70 con 0x7ffadc0b1e00 2023-08-10T10:51:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0abe50 con 0x7ffadc15fde0 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffae0f17640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0ac130 con 0x7ffadc0cd490 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34578/0 (socket says 172.21.15.50:34578) 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 -- 172.21.15.50:0/3361101257 learned_addr learned my addr 172.21.15.50:0/3361101257 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadbfff640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffadc15fde0 0x7ffadc0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadaffd640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0cd490 0x7ffadc0acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 -- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0cd490 msgr2=0x7ffadc0acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0cd490 0x7ffadc0acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 -- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffadc15fde0 msgr2=0x7ffadc0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffadc15fde0 0x7ffadc0adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.292+0000 7ffadb7fe640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0094d0 con 0x7ffadc0b1e00 2023-08-10T10:51:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffadb7fe640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ffacc000c00 tx=0x7ffacc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc03b880 con 0x7ffadc0b1e00 2023-08-10T10:51:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc03b9e0 con 0x7ffadc0b1e00 2023-08-10T10:51:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc03bd90 con 0x7ffadc0b1e00 2023-08-10T10:51:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0ac410 con 0x7ffadc0b1e00 2023-08-10T10:51:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.294+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc15dd70 con 0x7ffadc0b1e00 2023-08-10T10:51:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.295+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc0ac930 con 0x7ffadc0b1e00 2023-08-10T10:51:29.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.296+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffacc04e450 con 0x7ffadc0b1e00 2023-08-10T10:51:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.297+0000 7ffac3fff640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 0x7ffac806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.297+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ffacc02f050 con 0x7ffadc0b1e00 2023-08-10T10:51:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.298+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7ffac8072f20 con 0x7ffadc0b1e00 2023-08-10T10:51:29.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.298+0000 7ffadaffd640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 0x7ffac806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.298+0000 7ffadaffd640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 0x7ffac806d110 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b2980 tx=0x7ffad0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.301+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffacc076610 con 0x7ffadc0b1e00 2023-08-10T10:51:29.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.492+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffadc066e30 con 0x7ffadc0b1e00 2023-08-10T10:51:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.492+0000 7ffac3fff640 1 -- 172.21.15.50:0/3361101257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffacc079c30 con 0x7ffadc0b1e00 2023-08-10T10:51:29.493 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:51:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 msgr2=0x7ffac806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 0x7ffac806d110 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b2980 tx=0x7ffad0008040 comp rx=0 tx=0).stop 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 msgr2=0x7ffadc15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ffacc000c00 tx=0x7ffacc0046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 shutdown_connections 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffac806ac50 0x7ffac806d110 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffadc15fde0 0x7ffadc0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffadc0cd490 0x7ffadc0acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 --2- 172.21.15.50:0/3361101257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffadc0b1e00 0x7ffadc15d830 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 >> 172.21.15.50:0/3361101257 conn(0x7ffadc0d2900 msgr2=0x7ffadc0b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 shutdown_connections 2023-08-10T10:51:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.495+0000 7ffae0f17640 1 -- 172.21.15.50:0/3361101257 wait complete. 2023-08-10T10:51:29.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:51:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.734+0000 7f07ec406640 1 Processor -- start 2023-08-10T10:51:29.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.734+0000 7f07ec406640 1 -- start start 2023-08-10T10:51:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07e415cbb0 0x7f07e41612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07e40c98b0 0x7f07e40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e40c8d10 0x7f07e40c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e4161800 con 0x7f07e40c98b0 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e4160870 con 0x7f07e415cbb0 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07ec406640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c9660 con 0x7f07e40c8d10 2023-08-10T10:51:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07e99a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07e40c98b0 0x7f07e40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07e99a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07e40c98b0 0x7f07e40c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34588/0 (socket says 172.21.15.50:34588) 2023-08-10T10:51:29.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.736+0000 7f07e99a1640 1 -- 172.21.15.50:0/2314252367 learned_addr learned my addr 172.21.15.50:0/2314252367 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07ea1a2640 1 --2- 172.21.15.50:0/2314252367 >> v2:172.21.15.117:3300/0 conn(0x7f07e415cbb0 0x7f07e41612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07e99a1640 1 -- 172.21.15.50:0/2314252367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e40c8d10 msgr2=0x7f07e40c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:29.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07ea9a3640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e40c8d10 0x7f07e40c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07e99a1640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e40c8d10 0x7f07e40c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07e99a1640 1 -- 172.21.15.50:0/2314252367 >> v2:172.21.15.117:3300/0 conn(0x7f07e415cbb0 msgr2=0x7f07e41612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07e99a1640 1 --2- 172.21.15.50:0/2314252367 >> v2:172.21.15.117:3300/0 conn(0x7f07e415cbb0 0x7f07e41612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.737+0000 7f07e99a1640 1 -- 172.21.15.50:0/2314252367 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40ca370 con 0x7f07e40c98b0 2023-08-10T10:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.738+0000 7f07e99a1640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40c9d40 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f07e406e6f0 tx=0x7f07d402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f825969ef70d144 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.738+0000 7f07e91a0640 1 -- 172.21.15.50:0/2314252367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40317f0 con 0x7f07e40c98b0 2023-08-10T10:51:29.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.738+0000 7f07e91a0640 1 -- 172.21.15.50:0/2314252367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4031950 con 0x7f07e40c98b0 2023-08-10T10:51:29.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.738+0000 7f07e91a0640 1 -- 172.21.15.50:0/2314252367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4031ce0 con 0x7f07e40c98b0 2023-08-10T10:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 -- 172.21.15.50:0/2314252367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 msgr2=0x7f07e40c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40c9d40 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f07e406e6f0 tx=0x7f07d402b890 comp rx=0 tx=0).stop 2023-08-10T10:51:29.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 -- 172.21.15.50:0/2314252367 shutdown_connections 2023-08-10T10:51:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e40c8d10 0x7f07e40c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 --2- 172.21.15.50:0/2314252367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40c9d40 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 --2- 172.21.15.50:0/2314252367 >> v2:172.21.15.117:3300/0 conn(0x7f07e415cbb0 0x7f07e41612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 -- 172.21.15.50:0/2314252367 >> 172.21.15.50:0/2314252367 conn(0x7f07e40b01b0 msgr2=0x7f07e40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 -- 172.21.15.50:0/2314252367 shutdown_connections 2023-08-10T10:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.739+0000 7f07ec406640 1 -- 172.21.15.50:0/2314252367 wait complete. 2023-08-10T10:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.741+0000 7f07ec406640 1 Processor -- start 2023-08-10T10:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.741+0000 7f07ec406640 1 -- start start 2023-08-10T10:51:29.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 0x7f07e4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e415cbb0 0x7f07e40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c4b60 con 0x7f07e40c98b0 2023-08-10T10:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415e930 con 0x7f07e40c8d10 2023-08-10T10:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07ec406640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415e000 con 0x7f07e415cbb0 2023-08-10T10:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.742+0000 7f07e99a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34592/0 (socket says 172.21.15.50:34592) 2023-08-10T10:51:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 -- 172.21.15.50:0/817598497 learned_addr learned my addr 172.21.15.50:0/817598497 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07ea9a3640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e415cbb0 0x7f07e40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07ea1a2640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 0x7f07e4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 -- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e415cbb0 msgr2=0x7f07e40ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e415cbb0 0x7f07e40ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 -- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 msgr2=0x7f07e4159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 0x7f07e4159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40094d0 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07ea1a2640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 0x7f07e4159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.743+0000 7f07e99a1640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f07d4000c00 tx=0x7f07d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.744+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4032890 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.744+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4032a30 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.744+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4032de0 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.744+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e415e2e0 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.744+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e415a020 con 0x7f07e40c98b0 2023-08-10T10:51:29.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.745+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e4066390 con 0x7f07e40c98b0 2023-08-10T10:51:29.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.746+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07d40453f0 con 0x7f07e40c98b0 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.747+0000 7f07daffd640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 0x7f07c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.747+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f07d40ab9b0 con 0x7f07e40c98b0 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.747+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f07c8072f20 con 0x7f07e40c98b0 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.747+0000 7f07ea1a2640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 0x7f07c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.748+0000 7f07ea1a2640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 0x7f07c806d110 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009f50 tx=0x7f07e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:29.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.751+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f07d4076a60 con 0x7f07e40c98b0 2023-08-10T10:51:29.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.942+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07e40612b0 con 0x7f07e40c98b0 2023-08-10T10:51:29.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.942+0000 7f07daffd640 1 -- 172.21.15.50:0/817598497 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07d407a080 con 0x7f07e40c98b0 2023-08-10T10:51:29.944 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:51:29.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 msgr2=0x7f07c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 0x7f07c806d110 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009f50 tx=0x7f07e000b040 comp rx=0 tx=0).stop 2023-08-10T10:51:29.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 msgr2=0x7f07e40ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:29.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f07d4000c00 tx=0x7f07d40046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 shutdown_connections 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07e415cbb0 0x7f07e40ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40c98b0 0x7f07e40ae0f0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f07c806ac50 0x7f07c806d110 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 --2- 172.21.15.50:0/817598497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07e40c8d10 0x7f07e4159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.945+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 >> 172.21.15.50:0/817598497 conn(0x7f07e40b01b0 msgr2=0x7f07e40ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.946+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 shutdown_connections 2023-08-10T10:51:29.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:29.946+0000 7f07ec406640 1 -- 172.21.15.50:0/817598497 wait complete. 2023-08-10T10:51:29.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:51:30.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.189+0000 7f519a149640 1 Processor -- start 2023-08-10T10:51:30.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.190+0000 7f519a149640 1 -- start start 2023-08-10T10:51:30.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.191+0000 7f519a149640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51941583c0 0x7f51940b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.191+0000 7f519a149640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 0x7f519415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.191+0000 7f519a149640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519415aee0 con 0x7f51940b1ba0 2023-08-10T10:51:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.191+0000 7f519a149640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940b2100 con 0x7f51941583c0 2023-08-10T10:51:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.191+0000 7f519a149640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519415b1a0 con 0x7f5194069db0 2023-08-10T10:51:30.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51941583c0 0x7f51940b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51941583c0 0x7f51940b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34594/0 (socket says 172.21.15.50:34594) 2023-08-10T10:51:30.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 -- 172.21.15.50:0/1876534227 learned_addr learned my addr 172.21.15.50:0/1876534227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:30.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 -- 172.21.15.50:0/1876534227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 msgr2=0x7f519415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:30.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199948640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 0x7f519415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 0x7f519415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f518bfff640 1 -- 172.21.15.50:0/1876534227 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856452660 0 0) 0x7f519415aee0 con 0x7f51940b1ba0 2023-08-10T10:51:30.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 -- 172.21.15.50:0/1876534227 >> v1:172.21.15.50:6789/0 conn(0x7f51940b1ba0 legacy=0x7f51940696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199147640 1 -- 172.21.15.50:0/1876534227 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519415b480 con 0x7f51941583c0 2023-08-10T10:51:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.192+0000 7f5199948640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 0x7f519415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.193+0000 7f5199147640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51941583c0 0x7f51940b1660 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f519002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb74666bc012b349 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.194+0000 7f518bfff640 1 -- 172.21.15.50:0/1876534227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190030840 con 0x7f51941583c0 2023-08-10T10:51:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.194+0000 7f518bfff640 1 -- 172.21.15.50:0/1876534227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900309a0 con 0x7f51941583c0 2023-08-10T10:51:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.194+0000 7f518bfff640 1 -- 172.21.15.50:0/1876534227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190030d30 con 0x7f51941583c0 2023-08-10T10:51:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.194+0000 7f519a149640 1 -- 172.21.15.50:0/1876534227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51941583c0 msgr2=0x7f51940b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.194+0000 7f519a149640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51941583c0 0x7f51940b1660 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f519002b980 comp rx=0 tx=0).stop 2023-08-10T10:51:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 -- 172.21.15.50:0/1876534227 shutdown_connections 2023-08-10T10:51:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5194069db0 0x7f519415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 --2- 172.21.15.50:0/1876534227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51941583c0 0x7f51940b1660 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 -- 172.21.15.50:0/1876534227 >> 172.21.15.50:0/1876534227 conn(0x7f51940caf80 msgr2=0x7f51940cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 -- 172.21.15.50:0/1876534227 shutdown_connections 2023-08-10T10:51:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.195+0000 7f519a149640 1 -- 172.21.15.50:0/1876534227 wait complete. 2023-08-10T10:51:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.196+0000 7f519a149640 1 Processor -- start 2023-08-10T10:51:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.197+0000 7f519a149640 1 -- start start 2023-08-10T10:51:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 0x7f51940c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51940c2570 0x7f51940ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519406ec10 con 0x7f5194069db0 2023-08-10T10:51:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194156b10 con 0x7f51940b1ba0 2023-08-10T10:51:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f519a149640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c2af0 con 0x7f51940c2570 2023-08-10T10:51:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34596/0 (socket says 172.21.15.50:34596) 2023-08-10T10:51:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 -- 172.21.15.50:0/4108362490 learned_addr learned my addr 172.21.15.50:0/4108362490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199948640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51940c2570 0x7f51940ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5198946640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 0x7f51940c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 -- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51940c2570 msgr2=0x7f51940ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51940c2570 0x7f51940ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 -- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 msgr2=0x7f51940c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 0x7f51940c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.198+0000 7f5199147640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094d0 con 0x7f5194069db0 2023-08-10T10:51:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f5198946640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 0x7f51940c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f5199147640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f519002bf10 tx=0x7f5190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190043400 con 0x7f5194069db0 2023-08-10T10:51:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190043560 con 0x7f5194069db0 2023-08-10T10:51:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190043910 con 0x7f5194069db0 2023-08-10T10:51:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.199+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51940c2dd0 con 0x7f5194069db0 2023-08-10T10:51:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.200+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519406e8a0 con 0x7f5194069db0 2023-08-10T10:51:30.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.201+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519406ea30 con 0x7f5194069db0 2023-08-10T10:51:30.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.202+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5190043a70 con 0x7f5194069db0 2023-08-10T10:51:30.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.203+0000 7f5189ffb640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 0x7f517806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.203+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f519003e070 con 0x7f5194069db0 2023-08-10T10:51:30.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.203+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f5178072f20 con 0x7f5194069db0 2023-08-10T10:51:30.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.203+0000 7f5198946640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 0x7f517806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.204+0000 7f5198946640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 0x7f517806d110 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51941f36e0 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.207+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51900779b0 con 0x7f5194069db0 2023-08-10T10:51:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.404+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5194066e30 con 0x7f5194069db0 2023-08-10T10:51:30.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.405+0000 7f5189ffb640 1 -- 172.21.15.50:0/4108362490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v176) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5190034070 con 0x7f5194069db0 2023-08-10T10:51:30.406 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.407+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 msgr2=0x7f517806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.407+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 0x7f517806d110 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51941f36e0 tx=0x7f5184009040 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.407+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 msgr2=0x7f51941565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.407+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f519002bf10 tx=0x7f5190004730 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 shutdown_connections 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51940c2570 0x7f51940ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f517806ac50 0x7f517806d110 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51940b1ba0 0x7f51940c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 --2- 172.21.15.50:0/4108362490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5194069db0 0x7f51941565d0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 >> 172.21.15.50:0/4108362490 conn(0x7f51940caf80 msgr2=0x7f51940af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 shutdown_connections 2023-08-10T10:51:30.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.408+0000 7f519a149640 1 -- 172.21.15.50:0/4108362490 wait complete. 2023-08-10T10:51:30.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:51:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.651+0000 7eff4c9ab640 1 Processor -- start 2023-08-10T10:51:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.651+0000 7eff4c9ab640 1 -- start start 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.652+0000 7eff4c9ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff481583c0 0x7eff480b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff4c9ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 0x7eff4815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff4c9ab640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4815aee0 con 0x7eff480b1ba0 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff4c9ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480b2100 con 0x7eff481583c0 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff4c9ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4815b1a0 con 0x7eff48069db0 2023-08-10T10:51:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff46ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7eff480b1ba0 0x7eff480696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40218/0 (socket says 172.21.15.50:40218) 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff46ffd640 1 -- 172.21.15.50:0/678591570 learned_addr learned my addr 172.21.15.50:0/678591570 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff477fe640 1 --2- 172.21.15.50:0/678591570 >> v2:172.21.15.117:3300/0 conn(0x7eff481583c0 0x7eff480b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff47fff640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 0x7eff4815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188878876 0 0) 0x7eff4815aee0 con 0x7eff480b1ba0 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.653+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff30003520 con 0x7eff480b1ba0 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2884080131 0 0) 0x7eff30003520 con 0x7eff480b1ba0 2023-08-10T10:51:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 msgr2=0x7eff4815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 0x7eff4815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 >> v2:172.21.15.117:3300/0 conn(0x7eff481583c0 msgr2=0x7eff480b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 --2- 172.21.15.50:0/678591570 >> v2:172.21.15.117:3300/0 conn(0x7eff481583c0 0x7eff480b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4815b480 con 0x7eff480b1ba0 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7eff3c001670 con 0x7eff480b1ba0 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 >> v1:172.21.15.50:6789/0 conn(0x7eff480b1ba0 legacy=0x7eff480696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff300039e0 0x7eff30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 0x7eff30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b2100 con 0x7eff300047c0 2023-08-10T10:51:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4815b1a0 con 0x7eff300039e0 2023-08-10T10:51:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3000b9b0 con 0x7eff48069db0 2023-08-10T10:51:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.654+0000 7eff46ffd640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff477fe640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff300039e0 0x7eff30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff46ffd640 1 -- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 msgr2=0x7eff30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff46ffd640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48069db0 0x7eff30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff46ffd640 1 -- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff300039e0 msgr2=0x7eff30003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff46ffd640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff300039e0 0x7eff30003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.655+0000 7eff46ffd640 1 -- 172.21.15.50:0/678591570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30003520 con 0x7eff300047c0 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.656+0000 7eff46ffd640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff30004c40 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001eb0 tx=0x7eff300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415a0c9bf87c8114 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.656+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c005ad0 con 0x7eff300047c0 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.656+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c005c30 con 0x7eff300047c0 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.656+0000 7eff467fc640 1 -- 172.21.15.50:0/678591570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c02c860 con 0x7eff300047c0 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 -- 172.21.15.50:0/678591570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 msgr2=0x7eff30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/678591570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff30004c40 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001eb0 tx=0x7eff300057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff47fff640 1 -- 172.21.15.50:0/678591570 reap_dead start 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 -- 172.21.15.50:0/678591570 shutdown_connections 2023-08-10T10:51:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 -- 172.21.15.50:0/678591570 >> 172.21.15.50:0/678591570 conn(0x7eff480caf80 msgr2=0x7eff480cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 -- 172.21.15.50:0/678591570 shutdown_connections 2023-08-10T10:51:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.657+0000 7eff4c9ab640 1 -- 172.21.15.50:0/678591570 wait complete. 2023-08-10T10:51:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.659+0000 7eff4c9ab640 1 Processor -- start 2023-08-10T10:51:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.659+0000 7eff4c9ab640 1 -- start start 2023-08-10T10:51:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48153370 0x7eff481f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff48155480 0x7eff48155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48155e40 con 0x7eff300047c0 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4815c120 con 0x7eff48155480 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff4c9ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c6df0 con 0x7eff48153370 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34614/0 (socket says 172.21.15.50:34614) 2023-08-10T10:51:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.660+0000 7eff477fe640 1 -- 172.21.15.50:0/666168626 learned_addr learned my addr 172.21.15.50:0/666168626 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff46ffd640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48153370 0x7eff481f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 -- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48153370 msgr2=0x7eff481f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48153370 0x7eff481f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 -- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff48155480 msgr2=0x7eff48155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff48155480 0x7eff48155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480c7bd0 con 0x7eff300047c0 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff477fe640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7eff38010860 tx=0x7eff38010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38009610 con 0x7eff300047c0 2023-08-10T10:51:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800eae0 con 0x7eff300047c0 2023-08-10T10:51:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff481f4190 con 0x7eff300047c0 2023-08-10T10:51:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800ee70 con 0x7eff300047c0 2023-08-10T10:51:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.661+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff480c6b10 con 0x7eff300047c0 2023-08-10T10:51:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.663+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48066e30 con 0x7eff300047c0 2023-08-10T10:51:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.663+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff3801c400 con 0x7eff300047c0 2023-08-10T10:51:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.664+0000 7eff2ffff640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 0x7eff3406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.664+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7eff38089ac0 con 0x7eff300047c0 2023-08-10T10:51:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.665+0000 7eff46ffd640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 0x7eff3406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.665+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7eff34072f20 con 0x7eff300047c0 2023-08-10T10:51:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.665+0000 7eff46ffd640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 0x7eff3406d110 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7eff3c034000 tx=0x7eff3c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.669+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7eff38054ae0 con 0x7eff300047c0 2023-08-10T10:51:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.860+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff480b39c0 con 0x7eff300047c0 2023-08-10T10:51:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.861+0000 7eff2ffff640 1 -- 172.21.15.50:0/666168626 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v176) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff38058100 con 0x7eff300047c0 2023-08-10T10:51:30.862 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:51:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 msgr2=0x7eff3406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 0x7eff3406d110 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7eff3c034000 tx=0x7eff3c007000 comp rx=0 tx=0).stop 2023-08-10T10:51:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 msgr2=0x7eff480c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7eff38010860 tx=0x7eff38010d20 comp rx=0 tx=0).stop 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 shutdown_connections 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7eff3406ac50 0x7eff3406d110 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff48155480 0x7eff48155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff48153370 0x7eff481f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.863+0000 7eff4c9ab640 1 --2- 172.21.15.50:0/666168626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff300047c0 0x7eff480c75f0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:30.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.864+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 >> 172.21.15.50:0/666168626 conn(0x7eff480caf80 msgr2=0x7eff480c7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.864+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 shutdown_connections 2023-08-10T10:51:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:30.864+0000 7eff4c9ab640 1 -- 172.21.15.50:0/666168626 wait complete. 2023-08-10T10:51:30.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:51:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.104+0000 7fe447fff640 1 Processor -- start 2023-08-10T10:51:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.105+0000 7fe447fff640 1 -- start start 2023-08-10T10:51:31.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.106+0000 7fe447fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4480b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.106+0000 7fe447fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe44815ad00 0x7fe4480cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe447fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480b2280 con 0x7fe448069a80 2023-08-10T10:51:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe447fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480ce240 con 0x7fe44815ad00 2023-08-10T10:51:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe447fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b19e0 con 0x7fe4480696a0 2023-08-10T10:51:31.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe4477fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe448069a80 0x7fe4480ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40224/0 (socket says 172.21.15.50:40224) 2023-08-10T10:51:31.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe4477fe640 1 -- 172.21.15.50:0/1062115529 learned_addr learned my addr 172.21.15.50:0/1062115529 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe446ffd640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4480b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.107+0000 7fe4467fc640 1 --2- 172.21.15.50:0/1062115529 >> v2:172.21.15.117:3300/0 conn(0x7fe44815ad00 0x7fe4480cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304154744 0 0) 0x7fe4480b2280 con 0x7fe448069a80 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe430003520 con 0x7fe448069a80 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573137401 0 0) 0x7fe430003520 con 0x7fe448069a80 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 msgr2=0x7fe4480b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4480b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 >> v2:172.21.15.117:3300/0 conn(0x7fe44815ad00 msgr2=0x7fe4480cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 --2- 172.21.15.50:0/1062115529 >> v2:172.21.15.117:3300/0 conn(0x7fe44815ad00 0x7fe4480cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480b1cc0 con 0x7fe448069a80 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe4400019f0 con 0x7fe448069a80 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 >> v1:172.21.15.50:6789/0 conn(0x7fe448069a80 legacy=0x7fe4480ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4300039e0 0x7fe430003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe430004d00 0x7fe430005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ce240 con 0x7fe430004d00 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b19e0 con 0x7fe4300039e0 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43000b9d0 con 0x7fe4480696a0 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.108+0000 7fe4477fe640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe430004d00 0x7fe430005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4467fc640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe446ffd640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4300039e0 0x7fe430003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4477fe640 1 -- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 msgr2=0x7fe4300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4477fe640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4480696a0 0x7fe4300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4477fe640 1 -- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4300039e0 msgr2=0x7fe430003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4477fe640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4300039e0 0x7fe430003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.109+0000 7fe4477fe640 1 -- 172.21.15.50:0/1062115529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430003520 con 0x7fe430004d00 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.110+0000 7fe4477fe640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe430004d00 0x7fe430005180 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fe44000a860 tx=0x7fe4300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29bc1915517754 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.110+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440034630 con 0x7fe430004d00 2023-08-10T10:51:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.110+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44002f070 con 0x7fe430004d00 2023-08-10T10:51:31.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.110+0000 7fe445ffb640 1 -- 172.21.15.50:0/1062115529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400349f0 con 0x7fe430004d00 2023-08-10T10:51:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 -- 172.21.15.50:0/1062115529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe430004d00 msgr2=0x7fe430005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 --2- 172.21.15.50:0/1062115529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe430004d00 0x7fe430005180 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fe44000a860 tx=0x7fe4300057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe4477fe640 1 -- 172.21.15.50:0/1062115529 reap_dead start 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 -- 172.21.15.50:0/1062115529 shutdown_connections 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 -- 172.21.15.50:0/1062115529 >> 172.21.15.50:0/1062115529 conn(0x7fe4480cafa0 msgr2=0x7fe4480cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 -- 172.21.15.50:0/1062115529 shutdown_connections 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.111+0000 7fe447fff640 1 -- 172.21.15.50:0/1062115529 wait complete. 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.113+0000 7fe447fff640 1 Processor -- start 2023-08-10T10:51:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.113+0000 7fe447fff640 1 -- start start 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe448154ec0 0x7fe4480c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe448158680 0x7fe448158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe448159040 con 0x7fe44815c500 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c8440 con 0x7fe448158680 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe447fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4481552a0 con 0x7fe448154ec0 2023-08-10T10:51:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe4467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe4467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34628/0 (socket says 172.21.15.50:34628) 2023-08-10T10:51:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.114+0000 7fe4467fc640 1 -- 172.21.15.50:0/1450676689 learned_addr learned my addr 172.21.15.50:0/1450676689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe446ffd640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe448154ec0 0x7fe4480c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4477fe640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe448158680 0x7fe448158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 -- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe448154ec0 msgr2=0x7fe4480c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe448154ec0 0x7fe4480c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 -- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe448158680 msgr2=0x7fe448158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe448158680 0x7fe448158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44815b460 con 0x7fe44815c500 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe4467fc640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011610 tx=0x7fe43c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c004220 con 0x7fe44815c500 2023-08-10T10:51:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c004380 con 0x7fe44815c500 2023-08-10T10:51:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.115+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00f930 con 0x7fe44815c500 2023-08-10T10:51:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.116+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44815b740 con 0x7fe44815c500 2023-08-10T10:51:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.116+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44815bd00 con 0x7fe44815c500 2023-08-10T10:51:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.117+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe448066e30 con 0x7fe44815c500 2023-08-10T10:51:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.118+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe43c00fa90 con 0x7fe44815c500 2023-08-10T10:51:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.119+0000 7fe42f7fe640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 0x7fe43406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.119+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fe43c0897e0 con 0x7fe44815c500 2023-08-10T10:51:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.119+0000 7fe446ffd640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 0x7fe43406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.119+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fe434072f50 con 0x7fe44815c500 2023-08-10T10:51:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.120+0000 7fe446ffd640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 0x7fe43406d140 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe438009a10 tx=0x7fe438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.123+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe43c054770 con 0x7fe44815c500 2023-08-10T10:51:31.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.333+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4480cb790 con 0x7fe44815c500 2023-08-10T10:51:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.334+0000 7fe42f7fe640 1 -- 172.21.15.50:0/1450676689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v176) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe43c022080 con 0x7fe44815c500 2023-08-10T10:51:31.335 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:51:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 msgr2=0x7fe43406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 0x7fe43406d140 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe438009a10 tx=0x7fe438008040 comp rx=0 tx=0).stop 2023-08-10T10:51:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 msgr2=0x7fe44815c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011610 tx=0x7fe43c011ad0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 shutdown_connections 2023-08-10T10:51:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe43406ac80 0x7fe43406d140 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe448158680 0x7fe448158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44815c500 0x7fe44815c960 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 --2- 172.21.15.50:0/1450676689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe448154ec0 0x7fe4480c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 >> 172.21.15.50:0/1450676689 conn(0x7fe4480cafa0 msgr2=0x7fe4480ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 shutdown_connections 2023-08-10T10:51:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.337+0000 7fe447fff640 1 -- 172.21.15.50:0/1450676689 wait complete. 2023-08-10T10:51:31.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:51:31.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:31.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:51:31.500 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:51:31.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:31.501 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:51:31.554 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:51:31.554 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:31.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:51:31.620 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:51:31.620 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:31.681 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:51:31.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:31.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.913+0000 7f22500d3640 1 Processor -- start 2023-08-10T10:51:31.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.913+0000 7f22500d3640 1 -- start start 2023-08-10T10:51:31.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.915+0000 7f22500d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 0x7f22480b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.915+0000 7f22500d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.915+0000 7f22500d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2248071c70 con 0x7f22480b0c60 2023-08-10T10:51:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.915+0000 7f22500d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480713d0 con 0x7f22480ca930 2023-08-10T10:51:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.915+0000 7f22500d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22480716b0 con 0x7f224815aa40 2023-08-10T10:51:31.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.916+0000 7f224e670640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.916+0000 7f224e670640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:45720/0 (socket says 172.21.15.50:45720) 2023-08-10T10:51:31.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.916+0000 7f224e670640 1 -- 172.21.15.50:0/2146502482 learned_addr learned my addr 172.21.15.50:0/2146502482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:31.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.916+0000 7f224de6f640 1 --2- 172.21.15.50:0/2146502482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 0x7f22480b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.917+0000 7f224de6f640 1 -- 172.21.15.50:0/2146502482 >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 msgr2=0x7f22480b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:31.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.917+0000 7f224de6f640 1 --2- 172.21.15.50:0/2146502482 >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.917+0000 7f224de6f640 1 -- 172.21.15.50:0/2146502482 >> v1:172.21.15.117:6789/0 conn(0x7f22480b0c60 legacy=0x7f22480696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.917+0000 7f224de6f640 1 -- 172.21.15.50:0/2146502482 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248071990 con 0x7f224815aa40 2023-08-10T10:51:31.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.917+0000 7f224e670640 1 --2- 172.21.15.50:0/2146502482 >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:31.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.919+0000 7f224de6f640 1 --2- 172.21.15.50:0/2146502482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 0x7f22480b3820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22440097a0 tx=0x7f224402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b4bf119208f899 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.919+0000 7f224ce6d640 1 -- 172.21.15.50:0/2146502482 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244031780 con 0x7f224815aa40 2023-08-10T10:51:31.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.919+0000 7f224ce6d640 1 -- 172.21.15.50:0/2146502482 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440318e0 con 0x7f224815aa40 2023-08-10T10:51:31.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.919+0000 7f224ce6d640 1 -- 172.21.15.50:0/2146502482 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244031c70 con 0x7f224815aa40 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 -- 172.21.15.50:0/2146502482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 msgr2=0x7f22480b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 --2- 172.21.15.50:0/2146502482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 0x7f22480b3820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22440097a0 tx=0x7f224402b820 comp rx=0 tx=0).stop 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 -- 172.21.15.50:0/2146502482 shutdown_connections 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 --2- 172.21.15.50:0/2146502482 >> v2:172.21.15.117:3300/0 conn(0x7f22480ca930 0x7f22480b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 --2- 172.21.15.50:0/2146502482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224815aa40 0x7f22480b3820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 -- 172.21.15.50:0/2146502482 >> 172.21.15.50:0/2146502482 conn(0x7f224806b590 msgr2=0x7f22480ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:31.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 -- 172.21.15.50:0/2146502482 shutdown_connections 2023-08-10T10:51:31.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.920+0000 7f22500d3640 1 -- 172.21.15.50:0/2146502482 wait complete. 2023-08-10T10:51:31.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.922+0000 7f22500d3640 1 Processor -- start 2023-08-10T10:51:31.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.922+0000 7f22500d3640 1 -- start start 2023-08-10T10:51:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22480b0c60 0x7f224815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 0x7f224814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224815c870 con 0x7f22480ca930 2023-08-10T10:51:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224815bbf0 con 0x7f224815aa40 2023-08-10T10:51:31.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.923+0000 7f22500d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224815bed0 con 0x7f22480b0c60 2023-08-10T10:51:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34632/0 (socket says 172.21.15.50:34632) 2023-08-10T10:51:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 -- 172.21.15.50:0/227272746 learned_addr learned my addr 172.21.15.50:0/227272746 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224de6f640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22480b0c60 0x7f224815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224e670640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 0x7f224814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 -- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22480b0c60 msgr2=0x7f224815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22480b0c60 0x7f224815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 -- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 msgr2=0x7f224814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 0x7f224814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224d66e640 1 -- 172.21.15.50:0/227272746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240009b30 con 0x7f22480ca930 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.924+0000 7f224e670640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 0x7f224814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f224d66e640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f223800c450 tx=0x7f223800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380052d0 con 0x7f22480ca930 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238005430 con 0x7f22480ca930 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238012870 con 0x7f22480ca930 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244009400 con 0x7f22480ca930 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.925+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224815c490 con 0x7f22480ca930 2023-08-10T10:51:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.927+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224815c9b0 con 0x7f22480ca930 2023-08-10T10:51:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.928+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22380129d0 con 0x7f22480ca930 2023-08-10T10:51:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.929+0000 7f223e7fc640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 0x7f222c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.930+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2238089130 con 0x7f22480ca930 2023-08-10T10:51:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.930+0000 7f224de6f640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 0x7f222c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.930+0000 7f224de6f640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 0x7f222c06d110 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2244036000 tx=0x7f224403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:31.934+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f224815c9b0 con 0x7f22480ca930 2023-08-10T10:51:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.164+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224815c9b0 con 0x7f22480ca930 2023-08-10T10:51:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.165+0000 7f223e7fc640 1 -- 172.21.15.50:0/227272746 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f223805b280 con 0x7f22480ca930 2023-08-10T10:51:32.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:32.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:51:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 msgr2=0x7f222c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 0x7f222c06d110 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2244036000 tx=0x7f224403d040 comp rx=0 tx=0).stop 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 msgr2=0x7f22480c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f223800c450 tx=0x7f223800c910 comp rx=0 tx=0).stop 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 shutdown_connections 2023-08-10T10:51:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f222c06ac50 0x7f222c06d110 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224815aa40 0x7f224814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480ca930 0x7f22480c68c0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 --2- 172.21.15.50:0/227272746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22480b0c60 0x7f224815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.168+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 >> 172.21.15.50:0/227272746 conn(0x7f224806b590 msgr2=0x7f22480c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.169+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 shutdown_connections 2023-08-10T10:51:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.169+0000 7f22500d3640 1 -- 172.21.15.50:0/227272746 wait complete. 2023-08-10T10:51:32.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.410+0000 7fdd04f96640 1 Processor -- start 2023-08-10T10:51:32.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.410+0000 7fdd04f96640 1 -- start start 2023-08-10T10:51:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdd04f96640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd00069b00 0x7fdd000b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdd04f96640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0015e1f0 con 0x7fdd00159970 2023-08-10T10:51:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdd04f96640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000b10d0 con 0x7fdd000696a0 2023-08-10T10:51:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdd04f96640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0015d5e0 con 0x7fdd00069b00 2023-08-10T10:51:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdcfe59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd00159970 0x7fdd000b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40226/0 (socket says 172.21.15.50:40226) 2023-08-10T10:51:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdcfe59c640 1 -- 172.21.15.50:0/1825023303 learned_addr learned my addr 172.21.15.50:0/1825023303 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:32.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdcfed9d640 1 --2- 172.21.15.50:0/1825023303 >> v2:172.21.15.117:3300/0 conn(0x7fdd00069b00 0x7fdd000b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579320381 0 0) 0x7fdd0015e1f0 con 0x7fdd00159970 2023-08-10T10:51:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.412+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcec005730 con 0x7fdd00159970 2023-08-10T10:51:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795766958 0 0) 0x7fdcec005730 con 0x7fdd00159970 2023-08-10T10:51:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 >> v2:172.21.15.117:3300/0 conn(0x7fdd00069b00 msgr2=0x7fdd000b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 --2- 172.21.15.50:0/1825023303 >> v2:172.21.15.117:3300/0 conn(0x7fdd00069b00 0x7fdd000b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 >> v1:172.21.15.117:6789/0 conn(0x7fdd000696a0 legacy=0x7fdd000b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0015d8c0 con 0x7fdd00159970 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fdcf0001690 con 0x7fdd00159970 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 >> v1:172.21.15.50:6789/0 conn(0x7fdd00159970 legacy=0x7fdd000b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdcec005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcec0069d0 0x7fdcec006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcec007390 0x7fdcec00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0015d5e0 con 0x7fdcec005b80 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00e2e0 con 0x7fdcec007390 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00e4a0 con 0x7fdcec0069d0 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.413+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdcec005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfe59c640 1 -- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcec0069d0 msgr2=0x7fdcec006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcec0069d0 0x7fdcec006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfe59c640 1 -- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcec007390 msgr2=0x7fdcec00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcec007390 0x7fdcec00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfe59c640 1 -- 172.21.15.50:0/1825023303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec005730 con 0x7fdcec005b80 2023-08-10T10:51:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.414+0000 7fdcfed9d640 1 -- 172.21.15.50:0/1825023303 reap_dead start 2023-08-10T10:51:32.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.415+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdcec005fa0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c210 tx=0x7fdcec007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7b25fc360af765 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.415+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0005ad0 con 0x7fdcec005b80 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.415+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf0005c30 con 0x7fdcec005b80 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.415+0000 7fdcfdd9b640 1 -- 172.21.15.50:0/1825023303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf002c870 con 0x7fdcec005b80 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 -- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 msgr2=0x7fdcec005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdcec005fa0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c210 tx=0x7fdcec007a00 comp rx=0 tx=0).stop 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 -- 172.21.15.50:0/1825023303 shutdown_connections 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 --2- 172.21.15.50:0/1825023303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdcec005fa0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 -- 172.21.15.50:0/1825023303 >> 172.21.15.50:0/1825023303 conn(0x7fdd0006b590 msgr2=0x7fdd000ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 -- 172.21.15.50:0/1825023303 shutdown_connections 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.416+0000 7fdd04f96640 1 -- 172.21.15.50:0/1825023303 wait complete. 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.418+0000 7fdd04f96640 1 Processor -- start 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.418+0000 7fdd04f96640 1 -- start start 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000c8330 0x7fdd000c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000c1a60 0x7fdd0006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0015b660 con 0x7fdcec005b80 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000c7ea0 con 0x7fdd000c8330 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdd04f96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000c6ff0 con 0x7fdd000c1a60 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34648/0 (socket says 172.21.15.50:34648) 2023-08-10T10:51:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 -- 172.21.15.50:0/3361027106 learned_addr learned my addr 172.21.15.50:0/3361027106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 -- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000c1a60 msgr2=0x7fdd0006fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000c1a60 0x7fdd0006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 -- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000c8330 msgr2=0x7fdd000c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000c8330 0x7fdd000c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.419+0000 7fdcfe59c640 1 -- 172.21.15.50:0/3361027106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000c7290 con 0x7fdcec005b80 2023-08-10T10:51:32.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdcfe59c640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c210 tx=0x7fdd0015e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf003c070 con 0x7fdcec005b80 2023-08-10T10:51:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf002ca80 con 0x7fdcec005b80 2023-08-10T10:51:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf002ce30 con 0x7fdcec005b80 2023-08-10T10:51:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000c7570 con 0x7fdcec005b80 2023-08-10T10:51:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.420+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000c7b30 con 0x7fdcec005b80 2023-08-10T10:51:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.421+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd000c7cf0 con 0x7fdcec005b80 2023-08-10T10:51:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.422+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdcf0032070 con 0x7fdcec005b80 2023-08-10T10:51:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.423+0000 7fdcf6ffd640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 0x7fdce006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.423+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fdcf00aa3f0 con 0x7fdcec005b80 2023-08-10T10:51:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.424+0000 7fdcf7fff640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 0x7fdce006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.424+0000 7fdcf7fff640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 0x7fdce006d110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdd0015c780 tx=0x7fdce80079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.428+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdcf0075380 con 0x7fdcec005b80 2023-08-10T10:51:32.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.623+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0004e270 con 0x7fdcec005b80 2023-08-10T10:51:32.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.626+0000 7fdcf6ffd640 1 -- 172.21.15.50:0/3361027106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fdcf0045090 con 0x7fdcec005b80 2023-08-10T10:51:32.628 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:32.628 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":177,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:31.675092+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.23","mappings":[{"from":4,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":2}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 msgr2=0x7fdce006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 0x7fdce006d110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdd0015c780 tx=0x7fdce80079d0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 msgr2=0x7fdd000c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c210 tx=0x7fdd0015e160 comp rx=0 tx=0).stop 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 shutdown_connections 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000c1a60 0x7fdd0006fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdce006ac50 0x7fdce006d110 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000c8330 0x7fdd000c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 --2- 172.21.15.50:0/3361027106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcec005b80 0x7fdd000c6ab0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.629+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 >> 172.21.15.50:0/3361027106 conn(0x7fdd0006b590 msgr2=0x7fdd000b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.630+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 shutdown_connections 2023-08-10T10:51:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.630+0000 7fdd04f96640 1 -- 172.21.15.50:0/3361027106 wait complete. 2023-08-10T10:51:32.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:50:08.132427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:50:08.751454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:51:32.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.870+0000 7f0d7fb07640 1 Processor -- start 2023-08-10T10:51:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.870+0000 7f0d7fb07640 1 -- start start 2023-08-10T10:51:32.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7fb07640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d780afcb0 0x7f0d780ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7fb07640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d780cea00 0x7f0d780cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7fb07640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d78070ea0 con 0x7f0d7815a540 2023-08-10T10:51:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7fb07640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780cddc0 con 0x7f0d780cea00 2023-08-10T10:51:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7fb07640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d78071180 con 0x7f0d780afcb0 2023-08-10T10:51:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7d0a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d780cea00 0x7f0d780cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7d0a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d780cea00 0x7f0d780cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34662/0 (socket says 172.21.15.50:34662) 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7d0a2640 1 -- 172.21.15.50:0/762356346 learned_addr learned my addr 172.21.15.50:0/762356346 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.872+0000 7f0d7e0a4640 1 --1- 172.21.15.50:0/762356346 >> v1:172.21.15.50:6789/0 conn(0x7f0d7815a540 0x7f0d7815a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40242/0 (socket says 172.21.15.50:40242) 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.873+0000 7f0d7d0a2640 1 -- 172.21.15.50:0/762356346 >> v2:172.21.15.117:3300/0 conn(0x7f0d780afcb0 msgr2=0x7f0d780ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.873+0000 7f0d7d0a2640 1 --2- 172.21.15.50:0/762356346 >> v2:172.21.15.117:3300/0 conn(0x7f0d780afcb0 0x7f0d780ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.873+0000 7f0d7d0a2640 1 -- 172.21.15.50:0/762356346 >> v1:172.21.15.50:6789/0 conn(0x7f0d7815a540 legacy=0x7f0d7815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.873+0000 7f0d7d0a2640 1 -- 172.21.15.50:0/762356346 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78071460 con 0x7f0d780cea00 2023-08-10T10:51:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.874+0000 7f0d7d0a2640 1 --2- 172.21.15.50:0/762356346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d780cea00 0x7f0d780cee60 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f0d780740e0 tx=0x7f0d6802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5159464032c57c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.874+0000 7f0d7c8a1640 1 -- 172.21.15.50:0/762356346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68030870 con 0x7f0d780cea00 2023-08-10T10:51:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.874+0000 7f0d7c8a1640 1 -- 172.21.15.50:0/762356346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680309d0 con 0x7f0d780cea00 2023-08-10T10:51:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.874+0000 7f0d7c8a1640 1 -- 172.21.15.50:0/762356346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68030d60 con 0x7f0d780cea00 2023-08-10T10:51:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 -- 172.21.15.50:0/762356346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d780cea00 msgr2=0x7f0d780cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/762356346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d780cea00 0x7f0d780cee60 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f0d780740e0 tx=0x7f0d6802b9b0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 -- 172.21.15.50:0/762356346 shutdown_connections 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/762356346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d780cea00 0x7f0d780cee60 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/762356346 >> v2:172.21.15.117:3300/0 conn(0x7f0d780afcb0 0x7f0d780ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 -- 172.21.15.50:0/762356346 >> 172.21.15.50:0/762356346 conn(0x7f0d780b23e0 msgr2=0x7f0d780b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 -- 172.21.15.50:0/762356346 shutdown_connections 2023-08-10T10:51:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.875+0000 7f0d7fb07640 1 -- 172.21.15.50:0/762356346 wait complete. 2023-08-10T10:51:32.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.877+0000 7f0d7fb07640 1 Processor -- start 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.877+0000 7f0d7fb07640 1 -- start start 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d780afcb0 0x7f0d781f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d780cea00 0x7f0d780696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78069be0 con 0x7f0d7815a540 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7806aa20 con 0x7f0d780afcb0 2023-08-10T10:51:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7fb07640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78069e10 con 0x7f0d780cea00 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7e0a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7e0a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34678/0 (socket says 172.21.15.50:34678) 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7e0a4640 1 -- 172.21.15.50:0/1864625095 learned_addr learned my addr 172.21.15.50:0/1864625095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7d8a3640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d780afcb0 0x7f0d781f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.878+0000 7f0d7d0a2640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d780cea00 0x7f0d780696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 -- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d780cea00 msgr2=0x7f0d780696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d780cea00 0x7f0d780696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 -- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d780afcb0 msgr2=0x7f0d781f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d780afcb0 0x7f0d781f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 -- 172.21.15.50:0/1864625095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680094d0 con 0x7f0d7815a540 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7e0a4640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c730 tx=0x7f0d7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000ce40 con 0x7f0d7815a540 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000a640 con 0x7f0d7815a540 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000a9f0 con 0x7f0d7815a540 2023-08-10T10:51:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.879+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7806a0f0 con 0x7f0d7815a540 2023-08-10T10:51:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.880+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7806a6b0 con 0x7f0d7815a540 2023-08-10T10:51:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.881+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7806ab90 con 0x7f0d7815a540 2023-08-10T10:51:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.882+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d7000ab50 con 0x7f0d7815a540 2023-08-10T10:51:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.882+0000 7f0d6e7fc640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 0x7f0d5c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.883+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f0d70088be0 con 0x7f0d7815a540 2023-08-10T10:51:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.883+0000 7f0d7d8a3640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 0x7f0d5c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.883+0000 7f0d7d8a3640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 0x7f0d5c06d110 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009890 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:32.886+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0d70053cb0 con 0x7f0d7815a540 2023-08-10T10:51:33.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.083+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d780612b0 con 0x7f0d7815a540 2023-08-10T10:51:33.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.084+0000 7f0d6e7fc640 1 -- 172.21.15.50:0/1864625095 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d700170a0 con 0x7f0d7815a540 2023-08-10T10:51:33.085 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:51:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 msgr2=0x7f0d5c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 0x7f0d5c06d110 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009890 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2023-08-10T10:51:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 msgr2=0x7f0d780add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c730 tx=0x7f0d7000cbf0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 shutdown_connections 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.087+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7815a540 0x7f0d780add40 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d780cea00 0x7f0d780696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0d5c06ac50 0x7f0d5c06d110 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 --2- 172.21.15.50:0/1864625095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d780afcb0 0x7f0d781f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 >> 172.21.15.50:0/1864625095 conn(0x7f0d780b23e0 msgr2=0x7f0d780b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 shutdown_connections 2023-08-10T10:51:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.088+0000 7f0d7fb07640 1 -- 172.21.15.50:0/1864625095 wait complete. 2023-08-10T10:51:33.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:51:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.339+0000 7f537bfff640 1 Processor -- start 2023-08-10T10:51:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.339+0000 7f537bfff640 1 -- start start 2023-08-10T10:51:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.340+0000 7f537bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f537c15fde0 0x7f537c06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.340+0000 7f537bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f537c0cd660 0x7f537c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.340+0000 7f537bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c06a5c0 con 0x7f537c0b1e00 2023-08-10T10:51:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.340+0000 7f537bfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c06b0c0 con 0x7f537c0cd660 2023-08-10T10:51:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.340+0000 7f537bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c06a820 con 0x7f537c15fde0 2023-08-10T10:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f537c0cd660 0x7f537c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f537c0cd660 0x7f537c0d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34692/0 (socket says 172.21.15.50:34692) 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 -- 172.21.15.50:0/1032152455 learned_addr learned my addr 172.21.15.50:0/1032152455 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537affd640 1 --2- 172.21.15.50:0/1032152455 >> v2:172.21.15.117:3300/0 conn(0x7f537c15fde0 0x7f537c06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 -- 172.21.15.50:0/1032152455 >> v2:172.21.15.117:3300/0 conn(0x7f537c15fde0 msgr2=0x7f537c06a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 --2- 172.21.15.50:0/1032152455 >> v2:172.21.15.117:3300/0 conn(0x7f537c15fde0 0x7f537c06a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.341+0000 7f537b7fe640 1 -- 172.21.15.50:0/1032152455 >> v1:172.21.15.117:6789/0 conn(0x7f537c0b1e00 legacy=0x7f537c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.342+0000 7f537b7fe640 1 -- 172.21.15.50:0/1032152455 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c06ab00 con 0x7f537c0cd660 2023-08-10T10:51:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.343+0000 7f537b7fe640 1 --2- 172.21.15.50:0/1032152455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c0cd660 0x7f537c0d0b20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f537c073bd0 tx=0x7f537402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228706b5139d2b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.343+0000 7f537a7fc640 1 -- 172.21.15.50:0/1032152455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53740317e0 con 0x7f537c0cd660 2023-08-10T10:51:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.343+0000 7f537a7fc640 1 -- 172.21.15.50:0/1032152455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374031940 con 0x7f537c0cd660 2023-08-10T10:51:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.343+0000 7f537a7fc640 1 -- 172.21.15.50:0/1032152455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374031cd0 con 0x7f537c0cd660 2023-08-10T10:51:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 -- 172.21.15.50:0/1032152455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c0cd660 msgr2=0x7f537c0d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 --2- 172.21.15.50:0/1032152455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c0cd660 0x7f537c0d0b20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f537c073bd0 tx=0x7f537402b880 comp rx=0 tx=0).stop 2023-08-10T10:51:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 -- 172.21.15.50:0/1032152455 shutdown_connections 2023-08-10T10:51:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 --2- 172.21.15.50:0/1032152455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c0cd660 0x7f537c0d0b20 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 --2- 172.21.15.50:0/1032152455 >> v2:172.21.15.117:3300/0 conn(0x7f537c15fde0 0x7f537c06a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 -- 172.21.15.50:0/1032152455 >> 172.21.15.50:0/1032152455 conn(0x7f537c0d2900 msgr2=0x7f537c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 -- 172.21.15.50:0/1032152455 shutdown_connections 2023-08-10T10:51:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.344+0000 7f537bfff640 1 -- 172.21.15.50:0/1032152455 wait complete. 2023-08-10T10:51:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.346+0000 7f537bfff640 1 Processor -- start 2023-08-10T10:51:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.346+0000 7f537bfff640 1 -- start start 2023-08-10T10:51:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0b1e00 0x7f537c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0cd660 0x7f537c0a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1f1fc0 con 0x7f537c15fde0 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0a92e0 con 0x7f537c0cd660 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.347+0000 7f537bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c14de20 con 0x7f537c0b1e00 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0b1e00 0x7f537c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34706/0 (socket says 172.21.15.50:34706) 2023-08-10T10:51:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 -- 172.21.15.50:0/3728450436 learned_addr learned my addr 172.21.15.50:0/3728450436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f53727fc640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0cd660 0x7f537c0a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 -- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0b1e00 msgr2=0x7f537c14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0b1e00 0x7f537c14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 -- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0cd660 msgr2=0x7f537c0a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0cd660 0x7f537c0a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.348+0000 7f537b7fe640 1 -- 172.21.15.50:0/3728450436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740094d0 con 0x7f537c15fde0 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f537b7fe640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f53740090b0 tx=0x7f53740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374032880 con 0x7f537c15fde0 2023-08-10T10:51:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740329e0 con 0x7f537c15fde0 2023-08-10T10:51:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374032d90 con 0x7f537c15fde0 2023-08-10T10:51:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c150c10 con 0x7f537c15fde0 2023-08-10T10:51:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.349+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0a94f0 con 0x7f537c15fde0 2023-08-10T10:51:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.350+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c066e30 con 0x7f537c15fde0 2023-08-10T10:51:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.351+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f537404e450 con 0x7f537c15fde0 2023-08-10T10:51:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.352+0000 7f5373fff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 0x7f535c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.352+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f53740ab5d0 con 0x7f537c15fde0 2023-08-10T10:51:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.352+0000 7f537affd640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 0x7f535c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.353+0000 7f537affd640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 0x7f535c06d110 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f536c009fd0 tx=0x7f536c009800 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.357+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53740767c0 con 0x7f537c15fde0 2023-08-10T10:51:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.554+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f537c0ab360 con 0x7f537c15fde0 2023-08-10T10:51:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.555+0000 7f5373fff640 1 -- 172.21.15.50:0/3728450436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v177) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5374079de0 con 0x7f537c15fde0 2023-08-10T10:51:33.555 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 msgr2=0x7f535c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 0x7f535c06d110 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f536c009fd0 tx=0x7f536c009800 comp rx=0 tx=0).stop 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 msgr2=0x7f537c150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f53740090b0 tx=0x7f53740046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 shutdown_connections 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537c15fde0 0x7f537c150150 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f535c06ac50 0x7f535c06d110 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f537c0cd660 0x7f537c0a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 --2- 172.21.15.50:0/3728450436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f537c0b1e00 0x7f537c14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 >> 172.21.15.50:0/3728450436 conn(0x7f537c0d2900 msgr2=0x7f537c065340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.557+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 shutdown_connections 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.558+0000 7f537bfff640 1 -- 172.21.15.50:0/3728450436 wait complete. 2023-08-10T10:51:33.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.804+0000 7f8eb4cd2640 1 Processor -- start 2023-08-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.805+0000 7f8eb4cd2640 1 -- start start 2023-08-10T10:51:33.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.806+0000 7f8eb4cd2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8eb0159c10 0x7f8eb00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.806+0000 7f8eb4cd2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb00adf40 con 0x7f8eb00ada90 2023-08-10T10:51:33.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.806+0000 7f8eb4cd2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb006ebb0 con 0x7f8eb00ca530 2023-08-10T10:51:33.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.806+0000 7f8eb4cd2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006ee90 con 0x7f8eb0159c10 2023-08-10T10:51:33.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eae59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8eb0159c10 0x7f8eb00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8ea7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8eb00ada90 0x7f8eb00c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40250/0 (socket says 172.21.15.50:40250) 2023-08-10T10:51:33.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eae59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8eb0159c10 0x7f8eb00b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34710/0 (socket says 172.21.15.50:34710) 2023-08-10T10:51:33.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8ea7fff640 1 -- 172.21.15.50:0/3262412814 learned_addr learned my addr 172.21.15.50:0/3262412814 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:33.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eae59c640 1 -- 172.21.15.50:0/3262412814 >> v1:172.21.15.117:6789/0 conn(0x7f8eb00ca530 legacy=0x7f8eb006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eae59c640 1 -- 172.21.15.50:0/3262412814 >> v1:172.21.15.50:6789/0 conn(0x7f8eb00ada90 legacy=0x7f8eb00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eae59c640 1 -- 172.21.15.50:0/3262412814 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb006f170 con 0x7f8eb0159c10 2023-08-10T10:51:33.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.807+0000 7f8eadd9b640 1 -- 172.21.15.50:0/3262412814 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009423159 0 0) 0x7f8eb00adf40 con 0x7f8eb00ada90 2023-08-10T10:51:33.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.808+0000 7f8eae59c640 1 --2- 172.21.15.50:0/3262412814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0159c10 0x7f8eb00b0cd0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46992562c66784fc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eadd9b640 1 -- 172.21.15.50:0/3262412814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea002e070 con 0x7f8eb0159c10 2023-08-10T10:51:33.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eadd9b640 1 -- 172.21.15.50:0/3262412814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00315a0 con 0x7f8eb0159c10 2023-08-10T10:51:33.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eadd9b640 1 -- 172.21.15.50:0/3262412814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0031930 con 0x7f8eb0159c10 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/3262412814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0159c10 msgr2=0x7f8eb00b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/3262412814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0159c10 0x7f8eb00b0cd0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002b840 comp rx=0 tx=0).stop 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/3262412814 shutdown_connections 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/3262412814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0159c10 0x7f8eb00b0cd0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.809+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/3262412814 >> 172.21.15.50:0/3262412814 conn(0x7f8eb00b01b0 msgr2=0x7f8eb00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.810+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/3262412814 shutdown_connections 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.810+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/3262412814 wait complete. 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.811+0000 7f8eb4cd2640 1 Processor -- start 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.812+0000 7f8eb4cd2640 1 -- start start 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.812+0000 7f8eb4cd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb00ada90 0x7f8eb00c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eb4cd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eb4cd2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 0x7f8eb0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eb4cd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0158680 con 0x7f8eb00ca530 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eb4cd2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00cc270 con 0x7f8eb0159c10 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eb4cd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00c6f70 con 0x7f8eb00ada90 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34726/0 (socket says 172.21.15.50:34726) 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 -- 172.21.15.50:0/785957237 learned_addr learned my addr 172.21.15.50:0/785957237 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eae59c640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb00ada90 0x7f8eb00c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 -- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb00ada90 msgr2=0x7f8eb00c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eaed9d640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 0x7f8eb0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb00ada90 0x7f8eb00c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 -- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 msgr2=0x7f8eb0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 0x7f8eb0157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8ea7fff640 1 -- 172.21.15.50:0/785957237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009400 con 0x7f8eb00ca530 2023-08-10T10:51:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.813+0000 7f8eaed9d640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 0x7f8eb0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8ea7fff640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c4d0 tx=0x7f8e9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980074e0 con 0x7f8eb00ca530 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98007660 con 0x7f8eb00ca530 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb01580a0 con 0x7f8eb00ca530 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004a20 con 0x7f8eb00ca530 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.814+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb00cc4c0 con 0x7f8eb00ca530 2023-08-10T10:51:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.815+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb00612b0 con 0x7f8eb00ca530 2023-08-10T10:51:33.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.816+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e98004b80 con 0x7f8eb00ca530 2023-08-10T10:51:33.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.818+0000 7f8ea6ffd640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 0x7f8e9006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.818+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f8e98088b30 con 0x7f8eb00ca530 2023-08-10T10:51:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.818+0000 7f8eae59c640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 0x7f8e9006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.819+0000 7f8eae59c640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 0x7f8e9006d110 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0036000 tx=0x7f8ea003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:33.821+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8e98053ac0 con 0x7f8eb00ca530 2023-08-10T10:51:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.032+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8eb006c0e0 con 0x7f8eb00ca530 2023-08-10T10:51:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.033+0000 7f8ea6ffd640 1 -- 172.21.15.50:0/785957237 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e98018020 con 0x7f8eb00ca530 2023-08-10T10:51:34.034 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:51:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 msgr2=0x7f8e9006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 0x7f8e9006d110 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0036000 tx=0x7f8ea003d040 comp rx=0 tx=0).stop 2023-08-10T10:51:34.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 msgr2=0x7f8eb00cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c4d0 tx=0x7f8e9800c990 comp rx=0 tx=0).stop 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 shutdown_connections 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8e9006ac50 0x7f8e9006d110 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb0159c10 0x7f8eb0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb00ca530 0x7f8eb00cda70 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 --2- 172.21.15.50:0/785957237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb00ada90 0x7f8eb00c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 >> 172.21.15.50:0/785957237 conn(0x7f8eb00b01b0 msgr2=0x7f8eb015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.036+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 shutdown_connections 2023-08-10T10:51:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.037+0000 7f8eb4cd2640 1 -- 172.21.15.50:0/785957237 wait complete. 2023-08-10T10:51:34.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:51:34.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.283+0000 7f1b08d07640 1 Processor -- start 2023-08-10T10:51:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.283+0000 7f1b08d07640 1 -- start start 2023-08-10T10:51:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.284+0000 7f1b08d07640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b040cd9b0 0x7f1b040b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.284+0000 7f1b08d07640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0406c320 con 0x7f1b0406cb30 2023-08-10T10:51:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.284+0000 7f1b08d07640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0406b770 con 0x7f1b0415ae40 2023-08-10T10:51:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.284+0000 7f1b08d07640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0406b9f0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b040cd9b0 0x7f1b040b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b040cd9b0 0x7f1b040b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34740/0 (socket says 172.21.15.50:34740) 2023-08-10T10:51:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 -- 172.21.15.50:0/3514266686 learned_addr learned my addr 172.21.15.50:0/3514266686 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 -- 172.21.15.50:0/3514266686 >> v1:172.21.15.117:6789/0 conn(0x7f1b0415ae40 legacy=0x7f1b040cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 -- 172.21.15.50:0/3514266686 >> v1:172.21.15.50:6789/0 conn(0x7f1b0406cb30 legacy=0x7f1b040c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b01d9b640 1 -- 172.21.15.50:0/3514266686 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0406bcd0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.285+0000 7f1b0159a640 1 -- 172.21.15.50:0/3514266686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387988831 0 0) 0x7f1b0406c320 con 0x7f1b0406cb30 2023-08-10T10:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.286+0000 7f1b01d9b640 1 --2- 172.21.15.50:0/3514266686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b040b1510 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009870 tx=0x7f1af802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb2c7653dbcf8b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.286+0000 7f1b0159a640 1 -- 172.21.15.50:0/3514266686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802f840 con 0x7f1b040cd9b0 2023-08-10T10:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b0159a640 1 -- 172.21.15.50:0/3514266686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af802f9a0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b0159a640 1 -- 172.21.15.50:0/3514266686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802fd30 con 0x7f1b040cd9b0 2023-08-10T10:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 -- 172.21.15.50:0/3514266686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 msgr2=0x7f1b040b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 --2- 172.21.15.50:0/3514266686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b040b1510 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009870 tx=0x7f1af802ba20 comp rx=0 tx=0).stop 2023-08-10T10:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 -- 172.21.15.50:0/3514266686 shutdown_connections 2023-08-10T10:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 --2- 172.21.15.50:0/3514266686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b040b1510 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 -- 172.21.15.50:0/3514266686 >> 172.21.15.50:0/3514266686 conn(0x7f1b040b01b0 msgr2=0x7f1b040b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 -- 172.21.15.50:0/3514266686 shutdown_connections 2023-08-10T10:51:34.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.287+0000 7f1b08d07640 1 -- 172.21.15.50:0/3514266686 wait complete. 2023-08-10T10:51:34.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.289+0000 7f1b08d07640 1 Processor -- start 2023-08-10T10:51:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.289+0000 7f1b08d07640 1 -- start start 2023-08-10T10:51:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 0x7f1b040c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0415ae40 0x7f1b04157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04158210 con 0x7f1b040cd9b0 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0415c110 con 0x7f1b0406cb30 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b08d07640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b041f2c90 con 0x7f1b0415ae40 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b01d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b01d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34752/0 (socket says 172.21.15.50:34752) 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.290+0000 7f1b01d9b640 1 -- 172.21.15.50:0/2764854499 learned_addr learned my addr 172.21.15.50:0/2764854499 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 -- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0415ae40 msgr2=0x7f1b04157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0415ae40 0x7f1b04157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 -- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 msgr2=0x7f1b040c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b0259c640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 0x7f1b040c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 0x7f1b040c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 -- 172.21.15.50:0/2764854499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80094d0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b0259c640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 0x7f1b040c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:34.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.291+0000 7f1b01d9b640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f1af8000c00 tx=0x7f1af8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.292+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8041400 con 0x7f1b040cd9b0 2023-08-10T10:51:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.292+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8041560 con 0x7f1b040cd9b0 2023-08-10T10:51:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.292+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8041910 con 0x7f1b040cd9b0 2023-08-10T10:51:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.292+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b041f2f70 con 0x7f1b040cd9b0 2023-08-10T10:51:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.292+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b041f3530 con 0x7f1b040cd9b0 2023-08-10T10:51:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.293+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0415c2a0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.294+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1af8041a70 con 0x7f1b040cd9b0 2023-08-10T10:51:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.295+0000 7f1af2ffd640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 0x7f1ae406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.295+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f1af803c070 con 0x7f1b040cd9b0 2023-08-10T10:51:34.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.295+0000 7f1b0259c640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 0x7f1ae406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.296+0000 7f1b0259c640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 0x7f1ae406d110 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1af40012e0 tx=0x7f1af4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.300+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1af80774c0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.492+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b040612b0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.493+0000 7f1af2ffd640 1 -- 172.21.15.50:0/2764854499 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1af807aae0 con 0x7f1b040cd9b0 2023-08-10T10:51:34.493 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:51:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.495+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 msgr2=0x7f1ae406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.495+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 0x7f1ae406d110 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1af40012e0 tx=0x7f1af4009040 comp rx=0 tx=0).stop 2023-08-10T10:51:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.495+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 msgr2=0x7f1b0406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.495+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f1af8000c00 tx=0x7f1af8004730 comp rx=0 tx=0).stop 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 shutdown_connections 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0415ae40 0x7f1b04157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b040cd9b0 0x7f1b0406ee20 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1ae406ac50 0x7f1ae406d110 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 --2- 172.21.15.50:0/2764854499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0406cb30 0x7f1b040c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 >> 172.21.15.50:0/2764854499 conn(0x7f1b040b01b0 msgr2=0x7f1b0415b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 shutdown_connections 2023-08-10T10:51:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.496+0000 7f1b08d07640 1 -- 172.21.15.50:0/2764854499 wait complete. 2023-08-10T10:51:34.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.742+0000 7f502759e640 1 Processor -- start 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.742+0000 7f502759e640 1 -- start start 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.743+0000 7f502759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5028159830 0x7f50280cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f502759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50280cd290 0x7f50280cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f502759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280cc5a0 con 0x7f50280c9d00 2023-08-10T10:51:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f502759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b4170 con 0x7f50280cd290 2023-08-10T10:51:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f502759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502815d720 con 0x7f5028159830 2023-08-10T10:51:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f5026d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50280cd290 0x7f50280cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f5026d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50280cd290 0x7f50280cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34766/0 (socket says 172.21.15.50:34766) 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f5026d9d640 1 -- 172.21.15.50:0/3832555928 learned_addr learned my addr 172.21.15.50:0/3832555928 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.744+0000 7f502659c640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5028159830 0x7f50280cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.745+0000 7f5026d9d640 1 -- 172.21.15.50:0/3832555928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5028159830 msgr2=0x7f50280cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.745+0000 7f5026d9d640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5028159830 0x7f50280cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.745+0000 7f5026d9d640 1 -- 172.21.15.50:0/3832555928 >> v1:172.21.15.117:6789/0 conn(0x7f50280c9d00 legacy=0x7f502815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.745+0000 7f5026d9d640 1 -- 172.21.15.50:0/3832555928 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280cdc20 con 0x7f50280cd290 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.746+0000 7f5026d9d640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280cd6e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f5020009e50 tx=0x7f502002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016b1ef839db25b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.746+0000 7f5025d9b640 1 -- 172.21.15.50:0/3832555928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502002ed10 con 0x7f50280cd290 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.746+0000 7f5025d9b640 1 -- 172.21.15.50:0/3832555928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502002ee70 con 0x7f50280cd290 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.746+0000 7f5025d9b640 1 -- 172.21.15.50:0/3832555928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200365f0 con 0x7f50280cd290 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 -- 172.21.15.50:0/3832555928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 msgr2=0x7f50280cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280cd6e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f5020009e50 tx=0x7f502002e170 comp rx=0 tx=0).stop 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 -- 172.21.15.50:0/3832555928 shutdown_connections 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280cd6e0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 --2- 172.21.15.50:0/3832555928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5028159830 0x7f50280cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 -- 172.21.15.50:0/3832555928 >> 172.21.15.50:0/3832555928 conn(0x7f502806ab80 msgr2=0x7f502806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 -- 172.21.15.50:0/3832555928 shutdown_connections 2023-08-10T10:51:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.747+0000 7f502759e640 1 -- 172.21.15.50:0/3832555928 wait complete. 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.749+0000 7f502759e640 1 Processor -- start 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.749+0000 7f502759e640 1 -- start start 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50280c9d00 0x7f502806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 0x7f50280af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028070710 con 0x7f50280cd290 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280709f0 con 0x7f5028159830 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f502759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5028070cd0 con 0x7f50280c9d00 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.750+0000 7f501ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34770/0 (socket says 172.21.15.50:34770) 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 -- 172.21.15.50:0/3832191624 learned_addr learned my addr 172.21.15.50:0/3832191624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f502659c640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50280c9d00 0x7f502806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f5026d9d640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 0x7f50280af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 -- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50280c9d00 msgr2=0x7f502806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50280c9d00 0x7f502806fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 -- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 msgr2=0x7f50280af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 0x7f50280af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 -- 172.21.15.50:0/3832191624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009b30 con 0x7f50280cd290 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f5026d9d640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 0x7f50280af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.751+0000 7f501ffff640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f501000c400 tx=0x7f501000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.752+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100052d0 con 0x7f50280cd290 2023-08-10T10:51:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.752+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5010005430 con 0x7f50280cd290 2023-08-10T10:51:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.752+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010003830 con 0x7f50280cd290 2023-08-10T10:51:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.752+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028070fb0 con 0x7f50280cd290 2023-08-10T10:51:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.752+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028070390 con 0x7f50280cd290 2023-08-10T10:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.753+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280714d0 con 0x7f50280cd290 2023-08-10T10:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.754+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5010003990 con 0x7f50280cd290 2023-08-10T10:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.755+0000 7f501effd640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 0x7f500806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.756+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f5010088ad0 con 0x7f50280cd290 2023-08-10T10:51:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.756+0000 7f502659c640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 0x7f500806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.757+0000 7f502659c640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 0x7f500806d110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5018009970 tx=0x7f5018008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.760+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50280714d0 con 0x7f50280cd290 2023-08-10T10:51:34.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.992+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50280714d0 con 0x7f50280cd290 2023-08-10T10:51:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.993+0000 7f501effd640 1 -- 172.21.15.50:0/3832191624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f50280714d0 con 0x7f50280cd290 2023-08-10T10:51:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:34.994 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:51:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:51:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.995+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 msgr2=0x7f500806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.995+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 0x7f500806d110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5018009970 tx=0x7f5018008040 comp rx=0 tx=0).stop 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.995+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 msgr2=0x7f50280aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.995+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f501000c400 tx=0x7f501000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 shutdown_connections 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f500806ac50 0x7f500806d110 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5028159830 0x7f50280af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50280cd290 0x7f50280aef40 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 --2- 172.21.15.50:0/3832191624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50280c9d00 0x7f502806fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 >> 172.21.15.50:0/3832191624 conn(0x7f502806ab80 msgr2=0x7f50280b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 shutdown_connections 2023-08-10T10:51:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:34.996+0000 7f502759e640 1 -- 172.21.15.50:0/3832191624 wait complete. 2023-08-10T10:51:35.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.241+0000 7fb77d1f4640 1 Processor -- start 2023-08-10T10:51:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.241+0000 7fb77d1f4640 1 -- start start 2023-08-10T10:51:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb778159830 0x7fb7780cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb77815e0f0 0x7fb7780cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780b4170 con 0x7fb77815e0f0 2023-08-10T10:51:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780cc5a0 con 0x7fb778159830 2023-08-10T10:51:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.243+0000 7fb77d1f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815d720 con 0x7fb7780c9d00 2023-08-10T10:51:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb77815e0f0 0x7fb7780cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb77815e0f0 0x7fb7780cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42680/0 (socket says 172.21.15.50:42680) 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 -- 172.21.15.50:0/3053514801 learned_addr learned my addr 172.21.15.50:0/3053514801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb76ffff640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb777fff640 1 --2- 172.21.15.50:0/3053514801 >> v2:172.21.15.117:3300/0 conn(0x7fb778159830 0x7fb7780cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 -- 172.21.15.50:0/3053514801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 msgr2=0x7fb77815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 -- 172.21.15.50:0/3053514801 >> v2:172.21.15.117:3300/0 conn(0x7fb778159830 msgr2=0x7fb7780cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/3053514801 >> v2:172.21.15.117:3300/0 conn(0x7fb778159830 0x7fb7780cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.244+0000 7fb77c9f3640 1 -- 172.21.15.50:0/3053514801 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778159c10 con 0x7fb77815e0f0 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.246+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77815e0f0 0x7fb7780cd290 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fb7780cf590 tx=0x7fb77002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4ce30b466944fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.246+0000 7fb7777fe640 1 -- 172.21.15.50:0/3053514801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77002ca70 con 0x7fb77815e0f0 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.246+0000 7fb7777fe640 1 -- 172.21.15.50:0/3053514801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77002cbd0 con 0x7fb77815e0f0 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.246+0000 7fb7777fe640 1 -- 172.21.15.50:0/3053514801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700343f0 con 0x7fb77815e0f0 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 -- 172.21.15.50:0/3053514801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77815e0f0 msgr2=0x7fb7780cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77815e0f0 0x7fb7780cd290 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fb7780cf590 tx=0x7fb77002bed0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 -- 172.21.15.50:0/3053514801 shutdown_connections 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77815e0f0 0x7fb7780cd290 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/3053514801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/3053514801 >> v2:172.21.15.117:3300/0 conn(0x7fb778159830 0x7fb7780cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 -- 172.21.15.50:0/3053514801 >> 172.21.15.50:0/3053514801 conn(0x7fb77806ab80 msgr2=0x7fb77806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 -- 172.21.15.50:0/3053514801 shutdown_connections 2023-08-10T10:51:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.247+0000 7fb77d1f4640 1 -- 172.21.15.50:0/3053514801 wait complete. 2023-08-10T10:51:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.249+0000 7fb77d1f4640 1 Processor -- start 2023-08-10T10:51:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.249+0000 7fb77d1f4640 1 -- start start 2023-08-10T10:51:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb778159830 0x7fb7780c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815b330 con 0x7fb7780c5aa0 2023-08-10T10:51:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778150440 con 0x7fb778159830 2023-08-10T10:51:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.250+0000 7fb77d1f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815b580 con 0x7fb7780c9d00 2023-08-10T10:51:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42682/0 (socket says 172.21.15.50:42682) 2023-08-10T10:51:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 -- 172.21.15.50:0/2851080773 learned_addr learned my addr 172.21.15.50:0/2851080773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb777fff640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb76ffff640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb778159830 0x7fb7780c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 -- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 msgr2=0x7fb77814ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77814ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 -- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb778159830 msgr2=0x7fb7780c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb778159830 0x7fb7780c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.251+0000 7fb77c9f3640 1 -- 172.21.15.50:0/2851080773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009b30 con 0x7fb7780c5aa0 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb77c9f3640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb770036040 tx=0x7fb770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770009510 con 0x7fb7780c5aa0 2023-08-10T10:51:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77003e450 con 0x7fb7780c5aa0 2023-08-10T10:51:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77003e800 con 0x7fb7780c5aa0 2023-08-10T10:51:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77815b860 con 0x7fb7780c5aa0 2023-08-10T10:51:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.252+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77815be20 con 0x7fb7780c5aa0 2023-08-10T10:51:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.253+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77815b6c0 con 0x7fb7780c5aa0 2023-08-10T10:51:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.254+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb77003e960 con 0x7fb7780c5aa0 2023-08-10T10:51:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.255+0000 7fb7757fa640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 0x7fb75806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.255+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fb7700ac2d0 con 0x7fb7780c5aa0 2023-08-10T10:51:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.255+0000 7fb777fff640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 0x7fb75806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.256+0000 7fb777fff640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 0x7fb75806d110 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb768006fd0 tx=0x7fb768008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.259+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb77815b6c0 con 0x7fb7780c5aa0 2023-08-10T10:51:35.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.450+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb77815b6c0 con 0x7fb7780c5aa0 2023-08-10T10:51:35.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.453+0000 7fb7757fa640 1 -- 172.21.15.50:0/2851080773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fb77815b6c0 con 0x7fb7780c5aa0 2023-08-10T10:51:35.455 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:35.455 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":177,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:31.675092+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.23","mappings":[{"from":4,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":2}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 msgr2=0x7fb75806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 0x7fb75806d110 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb768006fd0 tx=0x7fb768008040 comp rx=0 tx=0).stop 2023-08-10T10:51:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 msgr2=0x7fb778151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb770036040 tx=0x7fb770004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 shutdown_connections 2023-08-10T10:51:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7780c5aa0 0x7fb778151060 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb75806ac50 0x7fb75806d110 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb778159830 0x7fb7780c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 --2- 172.21.15.50:0/2851080773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7780c9d00 0x7fb77814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 >> 172.21.15.50:0/2851080773 conn(0x7fb77806ab80 msgr2=0x7fb7780af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 shutdown_connections 2023-08-10T10:51:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.456+0000 7fb77d1f4640 1 -- 172.21.15.50:0/2851080773 wait complete. 2023-08-10T10:51:35.475 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:51:35.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.703+0000 7f9b7c7e1640 1 Processor -- start 2023-08-10T10:51:35.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.704+0000 7f9b7c7e1640 1 -- start start 2023-08-10T10:51:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.705+0000 7f9b7c7e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b7415cd60 0x7f9b74160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.705+0000 7f9b7c7e1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b74161180 con 0x7f9b740b8430 2023-08-10T10:51:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.705+0000 7f9b7c7e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b74161460 con 0x7f9b740cdf80 2023-08-10T10:51:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.705+0000 7f9b7c7e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740b5bd0 con 0x7f9b7415cd60 2023-08-10T10:51:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.706+0000 7f9b79d7c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b740b8430 0x7f9b740cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57720/0 (socket says 172.21.15.50:57720) 2023-08-10T10:51:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.706+0000 7f9b79d7c640 1 -- 172.21.15.50:0/3020519651 learned_addr learned my addr 172.21.15.50:0/3020519651 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.706+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3020519651 >> v2:172.21.15.117:3300/0 conn(0x7f9b7415cd60 0x7f9b74160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.706+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258100527 0 0) 0x7f9b74161180 con 0x7f9b740b8430 2023-08-10T10:51:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b60003520 con 0x7f9b740b8430 2023-08-10T10:51:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737345163 0 0) 0x7f9b60003520 con 0x7f9b740b8430 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 >> v2:172.21.15.117:3300/0 conn(0x7f9b7415cd60 msgr2=0x7f9b74160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 --2- 172.21.15.50:0/3020519651 >> v2:172.21.15.117:3300/0 conn(0x7f9b7415cd60 0x7f9b74160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 >> v1:172.21.15.117:6789/0 conn(0x7f9b740cdf80 legacy=0x7f9b740d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74161740 con 0x7f9b740b8430 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9b64001670 con 0x7f9b740b8430 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 >> v1:172.21.15.50:6789/0 conn(0x7f9b740b8430 legacy=0x7f9b740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 0x7f9b60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b600047c0 0x7f9b60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b60005180 0x7f9b6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b5bd0 con 0x7f9b60003970 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6000c030 con 0x7f9b60005180 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6000c1f0 con 0x7f9b600047c0 2023-08-10T10:51:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.707+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 0x7f9b60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b79d7c640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b600047c0 0x7f9b60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7a57d640 1 -- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b600047c0 msgr2=0x7f9b60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7ad7e640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b60005180 0x7f9b6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b600047c0 0x7f9b60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7a57d640 1 -- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b60005180 msgr2=0x7f9b6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b60005180 0x7f9b6000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7a57d640 1 -- 172.21.15.50:0/3020519651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60003520 con 0x7f9b60003970 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b79d7c640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b600047c0 0x7f9b60004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7ad7e640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b60005180 0x7f9b6000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.708+0000 7f9b7ad7e640 1 -- 172.21.15.50:0/3020519651 reap_dead start 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.709+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 0x7f9b60003d90 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009ac0 tx=0x7f9b600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f849da3f902ec93 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.709+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7002c6b0 con 0x7f9b60003970 2023-08-10T10:51:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.709+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7002c810 con 0x7f9b60003970 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.709+0000 7f9b7957b640 1 -- 172.21.15.50:0/3020519651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7002cba0 con 0x7f9b60003970 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 msgr2=0x7f9b60003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 0x7f9b60003d90 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009ac0 tx=0x7f9b600057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3020519651 shutdown_connections 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3020519651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b60003970 0x7f9b60003d90 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3020519651 >> 172.21.15.50:0/3020519651 conn(0x7f9b740d2ac0 msgr2=0x7f9b740d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3020519651 shutdown_connections 2023-08-10T10:51:35.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.710+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3020519651 wait complete. 2023-08-10T10:51:35.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.713+0000 7f9b7c7e1640 1 Processor -- start 2023-08-10T10:51:35.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.713+0000 7f9b7c7e1640 1 -- start start 2023-08-10T10:51:35.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b60003970 0x7f9b741524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7415e580 0x7f9b740cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415e0f0 con 0x7f9b7415ea00 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415d4e0 con 0x7f9b7415e580 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.714+0000 7f9b7c7e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415d7c0 con 0x7f9b60003970 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42700/0 (socket says 172.21.15.50:42700) 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 -- 172.21.15.50:0/3771420423 learned_addr learned my addr 172.21.15.50:0/3771420423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b79d7c640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7415e580 0x7f9b740cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b60003970 0x7f9b741524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 -- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b60003970 msgr2=0x7f9b741524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b60003970 0x7f9b741524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 -- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7415e580 msgr2=0x7f9b740cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7415e580 0x7f9b740cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.715+0000 7f9b7ad7e640 1 -- 172.21.15.50:0/3771420423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7415daa0 con 0x7f9b7415ea00 2023-08-10T10:51:35.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b7ad7e640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9b740b5a10 tx=0x7f9b6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c003b70 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c003cd0 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0052b0 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7415dd80 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.716+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b74157190 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.718+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7404e270 con 0x7f9b7415ea00 2023-08-10T10:51:35.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.719+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b6c005410 con 0x7f9b7415ea00 2023-08-10T10:51:35.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.720+0000 7f9b6affd640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 0x7f9b5806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.720+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f9b6c088da0 con 0x7f9b7415ea00 2023-08-10T10:51:35.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.720+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 0x7f9b5806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.721+0000 7f9b7a57d640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 0x7f9b5806d110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9b70036000 tx=0x7f9b70030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.724+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9b6c053e70 con 0x7f9b7415ea00 2023-08-10T10:51:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.955+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b740d3940 con 0x7f9b7415ea00 2023-08-10T10:51:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.956+0000 7f9b6affd640 1 -- 172.21.15.50:0/3771420423 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f9b6c018020 con 0x7f9b7415ea00 2023-08-10T10:51:35.957 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:35.958 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:51:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:51:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.959+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 msgr2=0x7f9b5806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.959+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 0x7f9b5806d110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9b70036000 tx=0x7f9b70030000 comp rx=0 tx=0).stop 2023-08-10T10:51:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.959+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 msgr2=0x7f9b740cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.959+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9b740b5a10 tx=0x7f9b6c00dc00 comp rx=0 tx=0).stop 2023-08-10T10:51:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 shutdown_connections 2023-08-10T10:51:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b7415ea00 0x7f9b740cc210 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9b5806ac50 0x7f9b5806d110 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7415e580 0x7f9b740cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 --2- 172.21.15.50:0/3771420423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b60003970 0x7f9b741524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 >> 172.21.15.50:0/3771420423 conn(0x7f9b740d2ac0 msgr2=0x7f9b740cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 shutdown_connections 2023-08-10T10:51:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:35.960+0000 7f9b7c7e1640 1 -- 172.21.15.50:0/3771420423 wait complete. 2023-08-10T10:51:35.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.217+0000 7f6d3ffff640 1 Processor -- start 2023-08-10T10:51:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.218+0000 7f6d3ffff640 1 -- start start 2023-08-10T10:51:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.219+0000 7f6d3ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d400b1da0 0x7f6d400cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.219+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40153c30 0x7f6d400cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.219+0000 7f6d3ffff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4015d010 con 0x7f6d40153850 2023-08-10T10:51:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.219+0000 7f6d3ffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4015d290 con 0x7f6d400b1da0 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.219+0000 7f6d3ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4015d570 con 0x7f6d40153c30 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d400b1da0 0x7f6d400cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d400b1da0 0x7f6d400cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42716/0 (socket says 172.21.15.50:42716) 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 -- 172.21.15.50:0/3716400766 learned_addr learned my addr 172.21.15.50:0/3716400766 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40153c30 0x7f6d400cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 -- 172.21.15.50:0/3716400766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40153c30 msgr2=0x7f6d400cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40153c30 0x7f6d400cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 -- 172.21.15.50:0/3716400766 >> v1:172.21.15.117:6789/0 conn(0x7f6d40153850 legacy=0x7f6d400b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.220+0000 7f6d37fff640 1 -- 172.21.15.50:0/3716400766 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4015d850 con 0x7f6d400b1da0 2023-08-10T10:51:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.221+0000 7f6d37fff640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d400b1da0 0x7f6d400cf630 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009870 tx=0x7f6d2802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b99a8c39bdfcf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.222+0000 7f6d3e7fc640 1 -- 172.21.15.50:0/3716400766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28031640 con 0x7f6d400b1da0 2023-08-10T10:51:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.222+0000 7f6d3e7fc640 1 -- 172.21.15.50:0/3716400766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280317a0 con 0x7f6d400b1da0 2023-08-10T10:51:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.222+0000 7f6d3e7fc640 1 -- 172.21.15.50:0/3716400766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28031b30 con 0x7f6d400b1da0 2023-08-10T10:51:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.222+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3716400766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d400b1da0 msgr2=0x7f6d400cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.222+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d400b1da0 0x7f6d400cf630 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009870 tx=0x7f6d2802b8f0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3716400766 shutdown_connections 2023-08-10T10:51:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40153c30 0x7f6d400cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3716400766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d400b1da0 0x7f6d400cf630 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3716400766 >> 172.21.15.50:0/3716400766 conn(0x7f6d40069880 msgr2=0x7f6d40069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3716400766 shutdown_connections 2023-08-10T10:51:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.223+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3716400766 wait complete. 2023-08-10T10:51:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.224+0000 7f6d3ffff640 1 Processor -- start 2023-08-10T10:51:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.225+0000 7f6d3ffff640 1 -- start start 2023-08-10T10:51:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 0x7f6d40152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400cc140 0x7f6d400c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400d3310 con 0x7f6d40153c30 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400b0ad0 con 0x7f6d40153850 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400cc8b0 con 0x7f6d400cc140 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42722/0 (socket says 172.21.15.50:42722) 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 -- 172.21.15.50:0/4149974184 learned_addr learned my addr 172.21.15.50:0/4149974184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3effd640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 0x7f6d40152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 -- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400cc140 msgr2=0x7f6d400c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400cc140 0x7f6d400c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 -- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 msgr2=0x7f6d40152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 0x7f6d40152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d37fff640 1 -- 172.21.15.50:0/4149974184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280094d0 con 0x7f6d40153c30 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.226+0000 7f6d3effd640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 0x7f6d40152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d37fff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009870 tx=0x7f6d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2803ac60 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2803adc0 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d400d2330 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28044630 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.227+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d400d25d0 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.229+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d400ce120 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.229+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d2802f050 con 0x7f6d40153c30 2023-08-10T10:51:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.230+0000 7f6d3cff9640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 0x7f6d2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.230+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f6d280ab4d0 con 0x7f6d40153c30 2023-08-10T10:51:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.231+0000 7f6d3effd640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 0x7f6d2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.231+0000 7f6d3effd640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 0x7f6d2006d110 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6d30003eb0 tx=0x7f6d30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.234+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6d28076460 con 0x7f6d40153c30 2023-08-10T10:51:36.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.469+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d40066e30 con 0x7f6d40153c30 2023-08-10T10:51:36.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.470+0000 7f6d3cff9640 1 -- 172.21.15.50:0/4149974184 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f6d28031e60 con 0x7f6d40153c30 2023-08-10T10:51:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:36.471 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:50:09.740882+0000","modified":"2023-08-10T10:50:13.648806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8952":{"gid":8952,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6837/2288662428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2288662428},{"type":"v1","addr":"172.21.15.50:6837","nonce":2288662428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-10T10:51:36.471 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2023-08-10T10:51:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.472+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 msgr2=0x7f6d2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.472+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 0x7f6d2006d110 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6d30003eb0 tx=0x7f6d30009040 comp rx=0 tx=0).stop 2023-08-10T10:51:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.472+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 msgr2=0x7f6d400d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.472+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009870 tx=0x7f6d280046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 shutdown_connections 2023-08-10T10:51:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400cc140 0x7f6d400c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d40153c30 0x7f6d400d2dd0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6d2006ac50 0x7f6d2006d110 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/4149974184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d40153850 0x7f6d40152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 >> 172.21.15.50:0/4149974184 conn(0x7f6d40069880 msgr2=0x7f6d400cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 shutdown_connections 2023-08-10T10:51:36.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.473+0000 7f6d3ffff640 1 -- 172.21.15.50:0/4149974184 wait complete. 2023-08-10T10:51:36.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.725+0000 7f2d36e2c640 1 Processor -- start 2023-08-10T10:51:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.725+0000 7f2d36e2c640 1 -- start start 2023-08-10T10:51:36.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d3015cd60 0x7f2d30160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d300b8430 0x7f2d300cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d300cddb0 0x7f2d300696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300ce240 con 0x7f2d300cddb0 2023-08-10T10:51:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300b5bd0 con 0x7f2d300b8430 2023-08-10T10:51:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d36e2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30161180 con 0x7f2d3015cd60 2023-08-10T10:51:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d353c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d300cddb0 0x7f2d300696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d353c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d300cddb0 0x7f2d300696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42732/0 (socket says 172.21.15.50:42732) 2023-08-10T10:51:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.726+0000 7f2d353c9640 1 -- 172.21.15.50:0/4024930413 learned_addr learned my addr 172.21.15.50:0/4024930413 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d2ffff640 1 --2- 172.21.15.50:0/4024930413 >> v2:172.21.15.117:3300/0 conn(0x7f2d300b8430 0x7f2d300cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d34bc8640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d3015cd60 0x7f2d30160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d353c9640 1 -- 172.21.15.50:0/4024930413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d3015cd60 msgr2=0x7f2d30160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d353c9640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d3015cd60 0x7f2d30160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d353c9640 1 -- 172.21.15.50:0/4024930413 >> v2:172.21.15.117:3300/0 conn(0x7f2d300b8430 msgr2=0x7f2d300cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d353c9640 1 --2- 172.21.15.50:0/4024930413 >> v2:172.21.15.117:3300/0 conn(0x7f2d300b8430 0x7f2d300cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.727+0000 7f2d353c9640 1 -- 172.21.15.50:0/4024930413 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30161460 con 0x7f2d300cddb0 2023-08-10T10:51:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.728+0000 7f2d353c9640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d300cddb0 0x7f2d300696a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f2d3006b2c0 tx=0x7f2d2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f683e972c3ee69 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d2f7fe640 1 -- 172.21.15.50:0/4024930413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28030860 con 0x7f2d300cddb0 2023-08-10T10:51:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d2f7fe640 1 -- 172.21.15.50:0/4024930413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280309c0 con 0x7f2d300cddb0 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d2f7fe640 1 -- 172.21.15.50:0/4024930413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28030d50 con 0x7f2d300cddb0 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 -- 172.21.15.50:0/4024930413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d300cddb0 msgr2=0x7f2d300696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d300cddb0 0x7f2d300696a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f2d3006b2c0 tx=0x7f2d2802b9a0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 -- 172.21.15.50:0/4024930413 shutdown_connections 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d300cddb0 0x7f2d300696a0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/4024930413 >> v2:172.21.15.117:3300/0 conn(0x7f2d300b8430 0x7f2d300cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/4024930413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d3015cd60 0x7f2d30160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 -- 172.21.15.50:0/4024930413 >> 172.21.15.50:0/4024930413 conn(0x7f2d300d2ac0 msgr2=0x7f2d300d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 -- 172.21.15.50:0/4024930413 shutdown_connections 2023-08-10T10:51:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.729+0000 7f2d36e2c640 1 -- 172.21.15.50:0/4024930413 wait complete. 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.731+0000 7f2d36e2c640 1 Processor -- start 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.731+0000 7f2d36e2c640 1 -- start start 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 0x7f2d3014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d300cddb0 0x7f2d301484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014e800 con 0x7f2d3015cd60 2023-08-10T10:51:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30149040 con 0x7f2d300cddb0 2023-08-10T10:51:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d36e2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30149320 con 0x7f2d300b8430 2023-08-10T10:51:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.732+0000 7f2d353c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42740/0 (socket says 172.21.15.50:42740) 2023-08-10T10:51:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 -- 172.21.15.50:0/3135732619 learned_addr learned my addr 172.21.15.50:0/3135732619 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d34bc8640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 0x7f2d3014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 -- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 msgr2=0x7f2d3014a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 0x7f2d3014a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 -- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d300cddb0 msgr2=0x7f2d301484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d300cddb0 0x7f2d301484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 -- 172.21.15.50:0/3135732619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280094d0 con 0x7f2d3015cd60 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d34bc8640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 0x7f2d3014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.733+0000 7f2d353c9640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f2d280090b0 tx=0x7f2d28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.734+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28039c90 con 0x7f2d3015cd60 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.734+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28039df0 con 0x7f2d3015cd60 2023-08-10T10:51:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.734+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d30149600 con 0x7f2d3015cd60 2023-08-10T10:51:36.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.734+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28043640 con 0x7f2d3015cd60 2023-08-10T10:51:36.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.734+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d30149bc0 con 0x7f2d3015cd60 2023-08-10T10:51:36.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.735+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3004e270 con 0x7f2d3015cd60 2023-08-10T10:51:36.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.736+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d280437a0 con 0x7f2d3015cd60 2023-08-10T10:51:36.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.737+0000 7f2d2d7fa640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 0x7f2d1c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.737+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2d2803e070 con 0x7f2d3015cd60 2023-08-10T10:51:36.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.737+0000 7f2d34bc8640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 0x7f2d1c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.738+0000 7f2d34bc8640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 0x7f2d1c06d110 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009f70 tx=0x7f2d2000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.742+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2d28077830 con 0x7f2d3015cd60 2023-08-10T10:51:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.933+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d300d3940 con 0x7f2d3015cd60 2023-08-10T10:51:36.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.935+0000 7f2d2d7fa640 1 -- 172.21.15.50:0/3135732619 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f2d2807ae50 con 0x7f2d3015cd60 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":177,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:31.675092+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:50:08.132427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-10T10:50:08.751454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.23","mappings":[{"from":4,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":2}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 msgr2=0x7f2d1c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 0x7f2d1c06d110 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009f70 tx=0x7f2d2000b040 comp rx=0 tx=0).stop 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 msgr2=0x7f2d30148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f2d280090b0 tx=0x7f2d28004730 comp rx=0 tx=0).stop 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 shutdown_connections 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d3015cd60 0x7f2d30148a10 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d1c06ac50 0x7f2d1c06d110 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d300cddb0 0x7f2d301484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 --2- 172.21.15.50:0/3135732619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d300b8430 0x7f2d3014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 >> 172.21.15.50:0/3135732619 conn(0x7f2d300d2ac0 msgr2=0x7f2d300b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 shutdown_connections 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:36.938+0000 7f2d36e2c640 1 -- 172.21.15.50:0/3135732619 wait complete. 2023-08-10T10:51:36.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:51:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.193+0000 7ff0894d3640 1 Processor -- start 2023-08-10T10:51:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.193+0000 7ff0894d3640 1 -- start start 2023-08-10T10:51:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.194+0000 7ff0894d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0840d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.194+0000 7ff0894d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0840d1220 con 0x7ff08415ce00 2023-08-10T10:51:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.194+0000 7ff0894d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0840b8a30 con 0x7ff0840b5af0 2023-08-10T10:51:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.194+0000 7ff0894d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840d2930 con 0x7ff0840cd730 2023-08-10T10:51:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.195+0000 7ff0827fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff08415ce00 0x7ff0840cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57724/0 (socket says 172.21.15.50:57724) 2023-08-10T10:51:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.195+0000 7ff0827fc640 1 -- 172.21.15.50:0/2095340949 learned_addr learned my addr 172.21.15.50:0/2095340949 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.195+0000 7ff082ffd640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0840d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.195+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630768155 0 0) 0x7ff0840d1220 con 0x7ff08415ce00 2023-08-10T10:51:37.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.195+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff070003520 con 0x7ff08415ce00 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509123956 0 0) 0x7ff070003520 con 0x7ff08415ce00 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 msgr2=0x7ff0840d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0840d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 >> v1:172.21.15.117:6789/0 conn(0x7ff0840b5af0 legacy=0x7ff0840d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0840b1e70 con 0x7ff08415ce00 2023-08-10T10:51:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff074001670 con 0x7ff08415ce00 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 >> v1:172.21.15.50:6789/0 conn(0x7ff08415ce00 legacy=0x7ff0840cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0700039a0 0x7ff070003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff070004d00 0x7ff070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000ba30 con 0x7ff0700039a0 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000bb70 con 0x7ff070004d00 2023-08-10T10:51:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000bd30 con 0x7ff0840cd730 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.196+0000 7ff082ffd640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0700039a0 0x7ff070003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff0827fc640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff082ffd640 1 -- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 msgr2=0x7ff0700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff082ffd640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff0837fe640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff070004d00 0x7ff070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff082ffd640 1 -- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff070004d00 msgr2=0x7ff070005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff082ffd640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff070004d00 0x7ff070005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff082ffd640 1 -- 172.21.15.50:0/2095340949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070003520 con 0x7ff0700039a0 2023-08-10T10:51:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.197+0000 7ff0827fc640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0840cd730 0x7ff0700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.198+0000 7ff082ffd640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0700039a0 0x7ff070003dc0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009a90 tx=0x7ff0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120e7d78a2654281 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.198+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c02c680 con 0x7ff0700039a0 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.198+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c02c7e0 con 0x7ff0700039a0 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.198+0000 7ff081ffb640 1 -- 172.21.15.50:0/2095340949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c02cb70 con 0x7ff0700039a0 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 -- 172.21.15.50:0/2095340949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0700039a0 msgr2=0x7ff070003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 --2- 172.21.15.50:0/2095340949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0700039a0 0x7ff070003dc0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009a90 tx=0x7ff0700057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0837fe640 1 -- 172.21.15.50:0/2095340949 reap_dead start 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 -- 172.21.15.50:0/2095340949 shutdown_connections 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 -- 172.21.15.50:0/2095340949 >> 172.21.15.50:0/2095340949 conn(0x7ff0840d2c60 msgr2=0x7ff0840d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 -- 172.21.15.50:0/2095340949 shutdown_connections 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.199+0000 7ff0894d3640 1 -- 172.21.15.50:0/2095340949 wait complete. 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.201+0000 7ff0894d3640 1 Processor -- start 2023-08-10T10:51:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.201+0000 7ff0894d3640 1 -- start start 2023-08-10T10:51:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0700039a0 0x7ff084149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 0x7ff0841f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840d1f70 con 0x7ff0840d15b0 2023-08-10T10:51:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084149a70 con 0x7ff0841f5910 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0894d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff084148ae0 con 0x7ff0700039a0 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.202+0000 7ff0827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42752/0 (socket says 172.21.15.50:42752) 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 -- 172.21.15.50:0/1482006199 learned_addr learned my addr 172.21.15.50:0/1482006199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff082ffd640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0700039a0 0x7ff084149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0837fe640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 0x7ff0841f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 -- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0700039a0 msgr2=0x7ff084149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0700039a0 0x7ff084149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 -- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 msgr2=0x7ff0841f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 0x7ff0841f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 -- 172.21.15.50:0/1482006199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0841f2e70 con 0x7ff0840d15b0 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0837fe640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 0x7ff0841f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.203+0000 7ff0827fc640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7ff07400d8b0 tx=0x7ff07400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.204+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740074e0 con 0x7ff0840d15b0 2023-08-10T10:51:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.204+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074007640 con 0x7ff0840d15b0 2023-08-10T10:51:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.204+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740049e0 con 0x7ff0840d15b0 2023-08-10T10:51:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.204+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0841f3150 con 0x7ff0840d15b0 2023-08-10T10:51:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.204+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff084149010 con 0x7ff0840d15b0 2023-08-10T10:51:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.205+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08404e270 con 0x7ff0840d15b0 2023-08-10T10:51:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.206+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff074004b40 con 0x7ff0840d15b0 2023-08-10T10:51:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.207+0000 7ff07b7fe640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 0x7ff06406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.207+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff074088f70 con 0x7ff0840d15b0 2023-08-10T10:51:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.207+0000 7ff082ffd640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 0x7ff06406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.208+0000 7ff082ffd640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 0x7ff06406d140 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff06c036000 tx=0x7ff06c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.211+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff074057ae0 con 0x7ff0840d15b0 2023-08-10T10:51:37.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.445+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff0840d0e80 con 0x7ff0840d15b0 2023-08-10T10:51:37.447 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:51:37.446+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:51:37.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.458+0000 7ff07b7fe640 1 -- 172.21.15.50:0/1482006199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff074019090 con 0x7ff0840d15b0 2023-08-10T10:51:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:51:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 msgr2=0x7ff06406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 0x7ff06406d140 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff06c036000 tx=0x7ff06c030000 comp rx=0 tx=0).stop 2023-08-10T10:51:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 msgr2=0x7ff0840d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7ff07400d8b0 tx=0x7ff07400dd70 comp rx=0 tx=0).stop 2023-08-10T10:51:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 shutdown_connections 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff06406ac80 0x7ff06406d140 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0841f5910 0x7ff0841f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0840d15b0 0x7ff0840d1a30 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 --2- 172.21.15.50:0/1482006199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0700039a0 0x7ff084149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.461+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 >> 172.21.15.50:0/1482006199 conn(0x7ff0840d2c60 msgr2=0x7ff0840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.462+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 shutdown_connections 2023-08-10T10:51:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.462+0000 7ff0894d3640 1 -- 172.21.15.50:0/1482006199 wait complete. 2023-08-10T10:51:37.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:51:37.540 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:51:37.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.688+0000 7fbc793a4640 1 Processor -- start 2023-08-10T10:51:37.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.688+0000 7fbc793a4640 1 -- start start 2023-08-10T10:51:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.689+0000 7fbc793a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 0x7fbc740d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.689+0000 7fbc793a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc740b5af0 0x7fbc740d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.689+0000 7fbc793a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc740d1220 con 0x7fbc740cd730 2023-08-10T10:51:37.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.689+0000 7fbc793a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740d2930 con 0x7fbc740b5af0 2023-08-10T10:51:37.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.689+0000 7fbc793a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740b8a30 con 0x7fbc7415ce00 2023-08-10T10:51:37.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.690+0000 7fbc72ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc740cd730 0x7fbc740cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57742/0 (socket says 172.21.15.50:57742) 2023-08-10T10:51:37.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.690+0000 7fbc72ffd640 1 -- 172.21.15.50:0/113777859 learned_addr learned my addr 172.21.15.50:0/113777859 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.690+0000 7fbc727fc640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 0x7fbc740d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.690+0000 7fbc737fe640 1 --2- 172.21.15.50:0/113777859 >> v2:172.21.15.117:3300/0 conn(0x7fbc740b5af0 0x7fbc740d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.690+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410803978 0 0) 0x7fbc740d1220 con 0x7fbc740cd730 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc60003520 con 0x7fbc740cd730 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639055032 0 0) 0x7fbc60003520 con 0x7fbc740cd730 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 msgr2=0x7fbc740d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 0x7fbc740d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 >> v2:172.21.15.117:3300/0 conn(0x7fbc740b5af0 msgr2=0x7fbc740d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 --2- 172.21.15.50:0/113777859 >> v2:172.21.15.117:3300/0 conn(0x7fbc740b5af0 0x7fbc740d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740b1e70 con 0x7fbc740cd730 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fbc64001670 con 0x7fbc740cd730 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 >> v1:172.21.15.50:6789/0 conn(0x7fbc740cd730 legacy=0x7fbc740cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc60003970 0x7fbc60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 0x7fbc600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60004d00 0x7fbc60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740b8a30 con 0x7fbc60003970 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6000b980 con 0x7fbc60004d00 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6000bac0 con 0x7fbc7415ce00 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.691+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc60003970 0x7fbc60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.692+0000 7fbc72ffd640 1 -- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 msgr2=0x7fbc600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.692+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc7415ce00 0x7fbc600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.692+0000 7fbc72ffd640 1 -- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60004d00 msgr2=0x7fbc60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.692+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60004d00 0x7fbc60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.692+0000 7fbc72ffd640 1 -- 172.21.15.50:0/113777859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60003520 con 0x7fbc60003970 2023-08-10T10:51:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.693+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc60003970 0x7fbc60003d90 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c240 tx=0x7fbc600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f21592ef06d9d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.693+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6402cb00 con 0x7fbc60003970 2023-08-10T10:51:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.693+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6402cc60 con 0x7fbc60003970 2023-08-10T10:51:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.693+0000 7fbc71ffb640 1 -- 172.21.15.50:0/113777859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64005af0 con 0x7fbc60003970 2023-08-10T10:51:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 -- 172.21.15.50:0/113777859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc60003970 msgr2=0x7fbc60003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 --2- 172.21.15.50:0/113777859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc60003970 0x7fbc60003d90 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c240 tx=0x7fbc600057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc737fe640 1 -- 172.21.15.50:0/113777859 reap_dead start 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 -- 172.21.15.50:0/113777859 shutdown_connections 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 -- 172.21.15.50:0/113777859 >> 172.21.15.50:0/113777859 conn(0x7fbc740d2c60 msgr2=0x7fbc740d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 -- 172.21.15.50:0/113777859 shutdown_connections 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.694+0000 7fbc793a4640 1 -- 172.21.15.50:0/113777859 wait complete. 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.696+0000 7fbc793a4640 1 Processor -- start 2023-08-10T10:51:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.696+0000 7fbc793a4640 1 -- start start 2023-08-10T10:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60003970 0x7fbc7415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc74158980 0x7fbc74158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740cc980 con 0x7fbc74150ab0 2023-08-10T10:51:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c9f40 con 0x7fbc60003970 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc793a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c9c60 con 0x7fbc74158980 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc727fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc727fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42782/0 (socket says 172.21.15.50:42782) 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.697+0000 7fbc727fc640 1 -- 172.21.15.50:0/4263800601 learned_addr learned my addr 172.21.15.50:0/4263800601 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 -- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc74158980 msgr2=0x7fbc74158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc74158980 0x7fbc74158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 -- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60003970 msgr2=0x7fbc7415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60003970 0x7fbc7415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 -- 172.21.15.50:0/4263800601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7415f600 con 0x7fbc74150ab0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc727fc640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e7f0 tx=0x7fbc5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00c8e0 con 0x7fbc74150ab0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00ca40 con 0x7fbc74150ab0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.698+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00cdd0 con 0x7fbc74150ab0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.699+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7415f8e0 con 0x7fbc74150ab0 2023-08-10T10:51:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.699+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc741512c0 con 0x7fbc74150ab0 2023-08-10T10:51:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.700+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7415f460 con 0x7fbc74150ab0 2023-08-10T10:51:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.701+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc5c013470 con 0x7fbc74150ab0 2023-08-10T10:51:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.702+0000 7fbc6b7fe640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 0x7fbc5406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.703+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fbc5c089550 con 0x7fbc74150ab0 2023-08-10T10:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.703+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 0x7fbc5406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.703+0000 7fbc72ffd640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 0x7fbc5406d140 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbc64034000 tx=0x7fbc6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.707+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbc7415f460 con 0x7fbc74150ab0 2023-08-10T10:51:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:37.934+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc7415f460 con 0x7fbc74150ab0 2023-08-10T10:51:38.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.458+0000 7fbc6b7fe640 1 -- 172.21.15.50:0/4263800601 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc7415f460 con 0x7fbc74150ab0 2023-08-10T10:51:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 msgr2=0x7fbc5406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 0x7fbc5406d140 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbc64034000 tx=0x7fbc6402e000 comp rx=0 tx=0).stop 2023-08-10T10:51:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 msgr2=0x7fbc74158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e7f0 tx=0x7fbc5c00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 shutdown_connections 2023-08-10T10:51:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc74158980 0x7fbc74158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc74150ab0 0x7fbc74158440 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbc5406ac80 0x7fbc5406d140 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 --2- 172.21.15.50:0/4263800601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc60003970 0x7fbc7415fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.462+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 >> 172.21.15.50:0/4263800601 conn(0x7fbc740d2c60 msgr2=0x7fbc740d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:38.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.463+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 shutdown_connections 2023-08-10T10:51:38.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.463+0000 7fbc793a4640 1 -- 172.21.15.50:0/4263800601 wait complete. 2023-08-10T10:51:38.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:51:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.721+0000 7ff6e41e8640 1 Processor -- start 2023-08-10T10:51:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.721+0000 7ff6e41e8640 1 -- start start 2023-08-10T10:51:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e41e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6dc0ac890 0x7ff6dc0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e41e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff6dc0acc70 0x7ff6dc0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e41e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0cae00 con 0x7ff6dc06f550 2023-08-10T10:51:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e41e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c9150 con 0x7ff6dc0ac890 2023-08-10T10:51:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e41e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0cdba0 con 0x7ff6dc0acc70 2023-08-10T10:51:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e1f84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6dc0ac890 0x7ff6dc0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e1f84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6dc0ac890 0x7ff6dc0ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42788/0 (socket says 172.21.15.50:42788) 2023-08-10T10:51:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e2785640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6dc06f550 0x7ff6dc0c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57746/0 (socket says 172.21.15.50:57746) 2023-08-10T10:51:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.723+0000 7ff6e1f84640 1 -- 172.21.15.50:0/3851363991 learned_addr learned my addr 172.21.15.50:0/3851363991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.724+0000 7ff6e1783640 1 --2- 172.21.15.50:0/3851363991 >> v2:172.21.15.117:3300/0 conn(0x7ff6dc0acc70 0x7ff6dc0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.724+0000 7ff6e1f84640 1 -- 172.21.15.50:0/3851363991 >> v2:172.21.15.117:3300/0 conn(0x7ff6dc0acc70 msgr2=0x7ff6dc0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.724+0000 7ff6e1f84640 1 --2- 172.21.15.50:0/3851363991 >> v2:172.21.15.117:3300/0 conn(0x7ff6dc0acc70 0x7ff6dc0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.724+0000 7ff6e1f84640 1 -- 172.21.15.50:0/3851363991 >> v1:172.21.15.50:6789/0 conn(0x7ff6dc06f550 legacy=0x7ff6dc0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.724+0000 7ff6e1f84640 1 -- 172.21.15.50:0/3851363991 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0ca840 con 0x7ff6dc0ac890 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.725+0000 7ff6e1f84640 1 --2- 172.21.15.50:0/3851363991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc0ac890 0x7ff6dc0ca160 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc06efe0 tx=0x7ff6d802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324833dc7b698a1d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.725+0000 7ff6e0f82640 1 -- 172.21.15.50:0/3851363991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80317f0 con 0x7ff6dc0ac890 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.725+0000 7ff6e0f82640 1 -- 172.21.15.50:0/3851363991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8031950 con 0x7ff6dc0ac890 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.725+0000 7ff6e0f82640 1 -- 172.21.15.50:0/3851363991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8031ce0 con 0x7ff6dc0ac890 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 -- 172.21.15.50:0/3851363991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc0ac890 msgr2=0x7ff6dc0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/3851363991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc0ac890 0x7ff6dc0ca160 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc06efe0 tx=0x7ff6d802b890 comp rx=0 tx=0).stop 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 -- 172.21.15.50:0/3851363991 shutdown_connections 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/3851363991 >> v2:172.21.15.117:3300/0 conn(0x7ff6dc0acc70 0x7ff6dc0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/3851363991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc0ac890 0x7ff6dc0ca160 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 -- 172.21.15.50:0/3851363991 >> 172.21.15.50:0/3851363991 conn(0x7ff6dc0b08e0 msgr2=0x7ff6dc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 -- 172.21.15.50:0/3851363991 shutdown_connections 2023-08-10T10:51:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.726+0000 7ff6e41e8640 1 -- 172.21.15.50:0/3851363991 wait complete. 2023-08-10T10:51:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.728+0000 7ff6e41e8640 1 Processor -- start 2023-08-10T10:51:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.728+0000 7ff6e41e8640 1 -- start start 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6dc0ac890 0x7ff6dc146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6dc0acc70 0x7ff6dc146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc06c290 con 0x7ff6dc06f550 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc06b710 con 0x7ff6dc0acc70 2023-08-10T10:51:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e41e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc06b9f0 con 0x7ff6dc0ac890 2023-08-10T10:51:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e1f84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e1f84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42802/0 (socket says 172.21.15.50:42802) 2023-08-10T10:51:38.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.729+0000 7ff6e1f84640 1 -- 172.21.15.50:0/92530957 learned_addr learned my addr 172.21.15.50:0/92530957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 -- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6dc0ac890 msgr2=0x7ff6dc146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6dc0ac890 0x7ff6dc146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 -- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6dc0acc70 msgr2=0x7ff6dc146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6dc0acc70 0x7ff6dc146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 -- 172.21.15.50:0/92530957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80094d0 con 0x7ff6dc06f550 2023-08-10T10:51:38.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6e1f84640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802b8d0 tx=0x7ff6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.730+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8032990 con 0x7ff6dc06f550 2023-08-10T10:51:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.731+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8032af0 con 0x7ff6dc06f550 2023-08-10T10:51:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.731+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8032ea0 con 0x7ff6dc06f550 2023-08-10T10:51:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.731+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc06bcd0 con 0x7ff6dc06f550 2023-08-10T10:51:38.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.731+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc0c28d0 con 0x7ff6dc06f550 2023-08-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.732+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc0c2ac0 con 0x7ff6dc06f550 2023-08-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.733+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6d804e450 con 0x7ff6dc06f550 2023-08-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.734+0000 7ff6d27fc640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 0x7ff6c006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.734+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff6d80abc10 con 0x7ff6dc06f550 2023-08-10T10:51:38.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.734+0000 7ff6e1783640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 0x7ff6c006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:38.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.734+0000 7ff6e1783640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 0x7ff6c006d110 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc149ec0 tx=0x7ff6cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.738+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff6d8076b50 con 0x7ff6dc06f550 2023-08-10T10:51:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:38.928+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6dc04e270 con 0x7ff6dc06f550 2023-08-10T10:51:39.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.469+0000 7ff6d27fc640 1 -- 172.21.15.50:0/92530957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v179) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff6d807a170 con 0x7ff6dc06f550 2023-08-10T10:51:39.471 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:51:39.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 msgr2=0x7ff6c006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 0x7ff6c006d110 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc149ec0 tx=0x7ff6cc008040 comp rx=0 tx=0).stop 2023-08-10T10:51:39.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 msgr2=0x7ff6dc0c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802b8d0 tx=0x7ff6d80046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 shutdown_connections 2023-08-10T10:51:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff6c006ac50 0x7ff6c006d110 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6dc0acc70 0x7ff6dc146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6dc0ac890 0x7ff6dc146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 --2- 172.21.15.50:0/92530957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc06f550 0x7ff6dc0c2390 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 >> 172.21.15.50:0/92530957 conn(0x7ff6dc0b08e0 msgr2=0x7ff6dc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 shutdown_connections 2023-08-10T10:51:39.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.475+0000 7ff6e41e8640 1 -- 172.21.15.50:0/92530957 wait complete. 2023-08-10T10:51:39.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:51:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.719+0000 7f54f0dd2640 1 Processor -- start 2023-08-10T10:51:39.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.720+0000 7f54f0dd2640 1 -- start start 2023-08-10T10:51:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.721+0000 7f54f0dd2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54ec06a8c0 0x7f54ec0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.721+0000 7f54f0dd2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec071bf0 con 0x7f54ec071220 2023-08-10T10:51:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.721+0000 7f54f0dd2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec1618c0 con 0x7f54ec06ad50 2023-08-10T10:51:39.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.721+0000 7f54f0dd2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec0cb700 con 0x7f54ec06a8c0 2023-08-10T10:51:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54ec06a8c0 0x7f54ec0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54ec071220 0x7f54ec1611b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57758/0 (socket says 172.21.15.50:57758) 2023-08-10T10:51:39.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eb7fe640 1 -- 172.21.15.50:0/415207447 learned_addr learned my addr 172.21.15.50:0/415207447 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:39.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eaffd640 1 -- 172.21.15.50:0/415207447 >> v1:172.21.15.117:6789/0 conn(0x7f54ec06ad50 legacy=0x7f54ec072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eaffd640 1 -- 172.21.15.50:0/415207447 >> v1:172.21.15.50:6789/0 conn(0x7f54ec071220 legacy=0x7f54ec1611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.722+0000 7f54eaffd640 1 -- 172.21.15.50:0/415207447 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0cb9e0 con 0x7f54ec06a8c0 2023-08-10T10:51:39.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54eaffd640 1 --2- 172.21.15.50:0/415207447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec0cd4a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f54e00097a0 tx=0x7f54e002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281896002bde086d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:39.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54ea7fc640 1 -- 172.21.15.50:0/415207447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0030710 con 0x7f54ec06a8c0 2023-08-10T10:51:39.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54ea7fc640 1 -- 172.21.15.50:0/415207447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e002e050 con 0x7f54ec06a8c0 2023-08-10T10:51:39.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54ea7fc640 1 -- 172.21.15.50:0/415207447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0030a90 con 0x7f54ec06a8c0 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54f0dd2640 1 -- 172.21.15.50:0/415207447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 msgr2=0x7f54ec0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.724+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/415207447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec0cd4a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f54e00097a0 tx=0x7f54e002b790 comp rx=0 tx=0).stop 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.725+0000 7f54f0dd2640 1 -- 172.21.15.50:0/415207447 shutdown_connections 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.725+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/415207447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec0cd4a0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.725+0000 7f54f0dd2640 1 -- 172.21.15.50:0/415207447 >> 172.21.15.50:0/415207447 conn(0x7f54ec0cf5a0 msgr2=0x7f54ec0cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:39.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.725+0000 7f54f0dd2640 1 -- 172.21.15.50:0/415207447 shutdown_connections 2023-08-10T10:51:39.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.725+0000 7f54f0dd2640 1 -- 172.21.15.50:0/415207447 wait complete. 2023-08-10T10:51:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.726+0000 7f54f0dd2640 1 Processor -- start 2023-08-10T10:51:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.727+0000 7f54f0dd2640 1 -- start start 2023-08-10T10:51:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ec06ad50 0x7f54ec0add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ec071220 0x7f54ec1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0ae250 con 0x7f54ec06a8c0 2023-08-10T10:51:39.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0acc70 con 0x7f54ec071220 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54f0dd2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0acf50 con 0x7f54ec06ad50 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42820/0 (socket says 172.21.15.50:42820) 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 -- 172.21.15.50:0/551906613 learned_addr learned my addr 172.21.15.50:0/551906613 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eaffd640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ec06ad50 0x7f54ec0add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 -- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ec06ad50 msgr2=0x7f54ec0add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ec06ad50 0x7f54ec0add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 -- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ec071220 msgr2=0x7f54ec1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54ebfff640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ec071220 0x7f54ec1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ec071220 0x7f54ec1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.728+0000 7f54eb7fe640 1 -- 172.21.15.50:0/551906613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009400 con 0x7f54ec06a8c0 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54eb7fe640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c5f0 tx=0x7f54dc00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0074e0 con 0x7f54ec06a8c0 2023-08-10T10:51:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc007640 con 0x7f54ec06a8c0 2023-08-10T10:51:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec0ad230 con 0x7f54ec06a8c0 2023-08-10T10:51:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc004a00 con 0x7f54ec06a8c0 2023-08-10T10:51:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.729+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec0ad7f0 con 0x7f54ec06a8c0 2023-08-10T10:51:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.730+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec0ad9e0 con 0x7f54ec06a8c0 2023-08-10T10:51:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.731+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54dc004b60 con 0x7f54ec06a8c0 2023-08-10T10:51:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.732+0000 7f54d3fff640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 0x7f54d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.732+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5826+0+0 (secure 0 0 0) 0x7f54dc0888a0 con 0x7f54ec06a8c0 2023-08-10T10:51:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.733+0000 7f54eaffd640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 0x7f54d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.734+0000 7f54eaffd640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 0x7f54d806d110 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f54e0034000 tx=0x7f54e002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.737+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54dc053990 con 0x7f54ec06a8c0 2023-08-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:39.931+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54ec0612b0 con 0x7f54ec06a8c0 2023-08-10T10:51:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.477+0000 7f54d3fff640 1 -- 172.21.15.50:0/551906613 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v180) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54dc018020 con 0x7f54ec06a8c0 2023-08-10T10:51:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:51:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.483+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 msgr2=0x7f54d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.483+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 0x7f54d806d110 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f54e0034000 tx=0x7f54e002f000 comp rx=0 tx=0).stop 2023-08-10T10:51:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.483+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 msgr2=0x7f54ec15f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.483+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c5f0 tx=0x7f54dc00cab0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 shutdown_connections 2023-08-10T10:51:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54d806ac50 0x7f54d806d110 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ec071220 0x7f54ec1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ec06ad50 0x7f54ec0add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 --2- 172.21.15.50:0/551906613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ec06a8c0 0x7f54ec15f410 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 >> 172.21.15.50:0/551906613 conn(0x7f54ec0cf5a0 msgr2=0x7f54ec15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.484+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 shutdown_connections 2023-08-10T10:51:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.485+0000 7f54f0dd2640 1 -- 172.21.15.50:0/551906613 wait complete. 2023-08-10T10:51:40.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:51:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.724+0000 7f9632d0c640 1 Processor -- start 2023-08-10T10:51:40.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.724+0000 7f9632d0c640 1 -- start start 2023-08-10T10:51:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.725+0000 7f9632d0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0cd730 0x7f962c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9632d0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f962c15ce00 0x7f962c0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9632d0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f962c0b5af0 0x7f962c0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9632d0c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0d2930 con 0x7f962c15ce00 2023-08-10T10:51:40.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9632d0c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0d1220 con 0x7f962c0b5af0 2023-08-10T10:51:40.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9632d0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0b8a30 con 0x7f962c0cd730 2023-08-10T10:51:40.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9623fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f962c15ce00 0x7f962c0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9623fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f962c15ce00 0x7f962c0cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42832/0 (socket says 172.21.15.50:42832) 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9623fff640 1 -- 172.21.15.50:0/1219144479 learned_addr learned my addr 172.21.15.50:0/1219144479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f9630aa8640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0cd730 0x7f962c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.726+0000 7f96312a9640 1 --2- 172.21.15.50:0/1219144479 >> v2:172.21.15.117:3300/0 conn(0x7f962c0b5af0 0x7f962c0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.727+0000 7f9623fff640 1 -- 172.21.15.50:0/1219144479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0cd730 msgr2=0x7f962c0d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.727+0000 7f9623fff640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0cd730 0x7f962c0d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.727+0000 7f9623fff640 1 -- 172.21.15.50:0/1219144479 >> v2:172.21.15.117:3300/0 conn(0x7f962c0b5af0 msgr2=0x7f962c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.727+0000 7f9623fff640 1 --2- 172.21.15.50:0/1219144479 >> v2:172.21.15.117:3300/0 conn(0x7f962c0b5af0 0x7f962c0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.727+0000 7f9623fff640 1 -- 172.21.15.50:0/1219144479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0b1e70 con 0x7f962c15ce00 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.728+0000 7f9623fff640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15ce00 0x7f962c0cdb10 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f962c0b5530 tx=0x7f961c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ce6f6410ae0f94 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.728+0000 7f96237fe640 1 -- 172.21.15.50:0/1219144479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c031870 con 0x7f962c15ce00 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.728+0000 7f96237fe640 1 -- 172.21.15.50:0/1219144479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c0319d0 con 0x7f962c15ce00 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.728+0000 7f96237fe640 1 -- 172.21.15.50:0/1219144479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c031d60 con 0x7f962c15ce00 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 -- 172.21.15.50:0/1219144479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15ce00 msgr2=0x7f962c0cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15ce00 0x7f962c0cdb10 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f962c0b5530 tx=0x7f961c02b910 comp rx=0 tx=0).stop 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 -- 172.21.15.50:0/1219144479 shutdown_connections 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 --2- 172.21.15.50:0/1219144479 >> v2:172.21.15.117:3300/0 conn(0x7f962c0b5af0 0x7f962c0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15ce00 0x7f962c0cdb10 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 --2- 172.21.15.50:0/1219144479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0cd730 0x7f962c0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 -- 172.21.15.50:0/1219144479 >> 172.21.15.50:0/1219144479 conn(0x7f962c0d2c60 msgr2=0x7f962c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 -- 172.21.15.50:0/1219144479 shutdown_connections 2023-08-10T10:51:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.729+0000 7f9632d0c640 1 -- 172.21.15.50:0/1219144479 wait complete. 2023-08-10T10:51:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.731+0000 7f9632d0c640 1 Processor -- start 2023-08-10T10:51:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.731+0000 7f9632d0c640 1 -- start start 2023-08-10T10:51:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b5af0 0x7f962c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 0x7f962c0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c156610 con 0x7f962c15f940 2023-08-10T10:51:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c15d380 con 0x7f962c0cd730 2023-08-10T10:51:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f9632d0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c15d660 con 0x7f962c0b5af0 2023-08-10T10:51:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.732+0000 7f96312a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42848/0 (socket says 172.21.15.50:42848) 2023-08-10T10:51:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 -- 172.21.15.50:0/694622894 learned_addr learned my addr 172.21.15.50:0/694622894 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f9630aa8640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b5af0 0x7f962c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f9623fff640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 0x7f962c0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 -- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b5af0 msgr2=0x7f962c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b5af0 0x7f962c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 -- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 msgr2=0x7f962c0c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 0x7f962c0c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 -- 172.21.15.50:0/694622894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0094d0 con 0x7f962c15f940 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f9623fff640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 0x7f962c0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.733+0000 7f96312a9640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f962400d580 tx=0x7f962400da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:40.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.734+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624014620 con 0x7f962c15f940 2023-08-10T10:51:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.734+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240147a0 con 0x7f962c15f940 2023-08-10T10:51:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.734+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624014b50 con 0x7f962c15f940 2023-08-10T10:51:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.734+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c15dd10 con 0x7f962c15f940 2023-08-10T10:51:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.734+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c0c7470 con 0x7f962c15f940 2023-08-10T10:51:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.735+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c15db70 con 0x7f962c15f940 2023-08-10T10:51:40.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.736+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9624014cb0 con 0x7f962c15f940 2023-08-10T10:51:40.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.737+0000 7f96217fa640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 0x7f961806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:40.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.737+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9624089590 con 0x7f962c15f940 2023-08-10T10:51:40.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.737+0000 7f9630aa8640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 0x7f961806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:40.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.738+0000 7f9630aa8640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 0x7f961806d110 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f962c0c9540 tx=0x7f96280039b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.741+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f962c15db70 con 0x7f962c15f940 2023-08-10T10:51:40.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.934+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f962c15db70 con 0x7f962c15f940 2023-08-10T10:51:40.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.944+0000 7f96217fa640 1 -- 172.21.15.50:0/694622894 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f962c15db70 con 0x7f962c15f940 2023-08-10T10:51:40.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.946+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 msgr2=0x7f961806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 0x7f961806d110 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f962c0c9540 tx=0x7f96280039b0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 msgr2=0x7f962c15fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:40.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f962400d580 tx=0x7f962400da40 comp rx=0 tx=0).stop 2023-08-10T10:51:40.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 shutdown_connections 2023-08-10T10:51:40.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f962c15f940 0x7f962c15fdf0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f961806ac50 0x7f961806d110 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c0cd730 0x7f962c0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 --2- 172.21.15.50:0/694622894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b5af0 0x7f962c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 >> 172.21.15.50:0/694622894 conn(0x7f962c0d2c60 msgr2=0x7f962c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 shutdown_connections 2023-08-10T10:51:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:40.947+0000 7f9632d0c640 1 -- 172.21.15.50:0/694622894 wait complete. 2023-08-10T10:51:40.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-08-10T10:51:41.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.194+0000 7f6030b88640 1 Processor -- start 2023-08-10T10:51:41.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.194+0000 7f6030b88640 1 -- start start 2023-08-10T10:51:41.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.195+0000 7f6030b88640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f602c1605d0 0x7f602c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f6030b88640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f602c0cac80 0x7f602c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f6030b88640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c0cb610 con 0x7f602c15c950 2023-08-10T10:51:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f6030b88640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0ce6b0 con 0x7f602c0cac80 2023-08-10T10:51:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f6030b88640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c160b40 con 0x7f602c1605d0 2023-08-10T10:51:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f602c15c950 0x7f602c0cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57762/0 (socket says 172.21.15.50:57762) 2023-08-10T10:51:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602b7fe640 1 -- 172.21.15.50:0/2808150877 learned_addr learned my addr 172.21.15.50:0/2808150877 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602bfff640 1 --2- 172.21.15.50:0/2808150877 >> v2:172.21.15.50:3300/0 conn(0x7f602c0cac80 0x7f602c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602affd640 1 --2- 172.21.15.50:0/2808150877 >> v2:172.21.15.117:3300/0 conn(0x7f602c1605d0 0x7f602c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602bfff640 1 -- 172.21.15.50:0/2808150877 >> v2:172.21.15.117:3300/0 conn(0x7f602c1605d0 msgr2=0x7f602c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602bfff640 1 --2- 172.21.15.50:0/2808150877 >> v2:172.21.15.117:3300/0 conn(0x7f602c1605d0 0x7f602c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602bfff640 1 -- 172.21.15.50:0/2808150877 >> v1:172.21.15.50:6789/0 conn(0x7f602c15c950 legacy=0x7f602c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.196+0000 7f602bfff640 1 -- 172.21.15.50:0/2808150877 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c160e20 con 0x7f602c0cac80 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.198+0000 7f602bfff640 1 --2- 172.21.15.50:0/2808150877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0cac80 0x7f602c0cb0d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f602c066320 tx=0x7f602402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa93218698cba3c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.198+0000 7f602a7fc640 1 -- 172.21.15.50:0/2808150877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024031830 con 0x7f602c0cac80 2023-08-10T10:51:41.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.198+0000 7f602a7fc640 1 -- 172.21.15.50:0/2808150877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024031990 con 0x7f602c0cac80 2023-08-10T10:51:41.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.198+0000 7f602a7fc640 1 -- 172.21.15.50:0/2808150877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024031d20 con 0x7f602c0cac80 2023-08-10T10:51:41.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 -- 172.21.15.50:0/2808150877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0cac80 msgr2=0x7f602c0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 --2- 172.21.15.50:0/2808150877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0cac80 0x7f602c0cb0d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f602c066320 tx=0x7f602402b8d0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 -- 172.21.15.50:0/2808150877 shutdown_connections 2023-08-10T10:51:41.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 --2- 172.21.15.50:0/2808150877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c0cac80 0x7f602c0cb0d0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 --2- 172.21.15.50:0/2808150877 >> v2:172.21.15.117:3300/0 conn(0x7f602c1605d0 0x7f602c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 -- 172.21.15.50:0/2808150877 >> 172.21.15.50:0/2808150877 conn(0x7f602c0d0630 msgr2=0x7f602c0d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:41.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 -- 172.21.15.50:0/2808150877 shutdown_connections 2023-08-10T10:51:41.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.199+0000 7f6030b88640 1 -- 172.21.15.50:0/2808150877 wait complete. 2023-08-10T10:51:41.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.201+0000 7f6030b88640 1 Processor -- start 2023-08-10T10:51:41.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.201+0000 7f6030b88640 1 -- start start 2023-08-10T10:51:41.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cac80 0x7f602c15df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c15c950 0x7f602c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c15ee10 con 0x7f602c1605d0 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0af740 con 0x7f602c0cac80 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f6030b88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0c6fa0 con 0x7f602c15c950 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f602bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f602bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42860/0 (socket says 172.21.15.50:42860) 2023-08-10T10:51:41.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f602bfff640 1 -- 172.21.15.50:0/3600555875 learned_addr learned my addr 172.21.15.50:0/3600555875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f602affd640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c15c950 0x7f602c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.202+0000 7f602b7fe640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cac80 0x7f602c15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 -- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c15c950 msgr2=0x7f602c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c15c950 0x7f602c0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 -- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cac80 msgr2=0x7f602c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cac80 0x7f602c15df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 -- 172.21.15.50:0/3600555875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009400 con 0x7f602c1605d0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f602bfff640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f602403b660 tx=0x7f60240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240317d0 con 0x7f602c1605d0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602403ba50 con 0x7f602c1605d0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602403be00 con 0x7f602c1605d0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c15f020 con 0x7f602c1605d0 2023-08-10T10:51:41.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.203+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c15f5e0 con 0x7f602c1605d0 2023-08-10T10:51:41.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.205+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c066e30 con 0x7f602c1605d0 2023-08-10T10:51:41.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.206+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60240433f0 con 0x7f602c1605d0 2023-08-10T10:51:41.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.207+0000 7f6013fff640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 0x7f601806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.207+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f60240aae60 con 0x7f602c1605d0 2023-08-10T10:51:41.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.207+0000 7f602b7fe640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 0x7f601806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.208+0000 7f602b7fe640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 0x7f601806d110 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f601c005c00 tx=0x7f601c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.211+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60240763c0 con 0x7f602c1605d0 2023-08-10T10:51:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.477+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f602c15d340 con 0x7f602c1605d0 2023-08-10T10:51:41.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.495+0000 7f6013fff640 1 -- 172.21.15.50:0/3600555875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v648) v1 ==== 131+0+0 (secure 0 0 0) 0x7f60240350c0 con 0x7f602c1605d0 2023-08-10T10:51:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.498+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 msgr2=0x7f601806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.498+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 0x7f601806d110 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f601c005c00 tx=0x7f601c009040 comp rx=0 tx=0).stop 2023-08-10T10:51:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.498+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 msgr2=0x7f602c0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.498+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f602403b660 tx=0x7f60240046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.498+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 shutdown_connections 2023-08-10T10:51:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f602c1605d0 0x7f602c0c6a60 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f602c15c950 0x7f602c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f601806ac50 0x7f601806d110 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 --2- 172.21.15.50:0/3600555875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f602c0cac80 0x7f602c15df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 >> 172.21.15.50:0/3600555875 conn(0x7f602c0d0630 msgr2=0x7f602c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:41.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 shutdown_connections 2023-08-10T10:51:41.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.499+0000 7f6030b88640 1 -- 172.21.15.50:0/3600555875 wait complete. 2023-08-10T10:51:41.517 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-10T10:51:41.518 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-08-10T10:51:41.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-08-10T10:51:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.741+0000 7f405ab15640 1 Processor -- start 2023-08-10T10:51:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.742+0000 7f405ab15640 1 -- start start 2023-08-10T10:51:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.743+0000 7f405ab15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f405415ceb0 0x7f4054070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.743+0000 7f405ab15640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40540b29e0 0x7f40540cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.743+0000 7f405ab15640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40540cf0e0 con 0x7f40540b3c60 2023-08-10T10:51:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.743+0000 7f405ab15640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4054071b40 con 0x7f405415ceb0 2023-08-10T10:51:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.743+0000 7f405ab15640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4054071580 con 0x7f40540b29e0 2023-08-10T10:51:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f405415ceb0 0x7f4054070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f405415ceb0 0x7f4054070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42872/0 (socket says 172.21.15.50:42872) 2023-08-10T10:51:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 -- 172.21.15.50:0/2312698980 learned_addr learned my addr 172.21.15.50:0/2312698980 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40590b2640 1 --2- 172.21.15.50:0/2312698980 >> v2:172.21.15.117:3300/0 conn(0x7f40540b29e0 0x7f40540cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 -- 172.21.15.50:0/2312698980 >> v2:172.21.15.117:3300/0 conn(0x7f40540b29e0 msgr2=0x7f40540cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 --2- 172.21.15.50:0/2312698980 >> v2:172.21.15.117:3300/0 conn(0x7f40540b29e0 0x7f40540cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 -- 172.21.15.50:0/2312698980 >> v1:172.21.15.117:6789/0 conn(0x7f40540b3c60 legacy=0x7f40540b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.744+0000 7f40588b1640 1 -- 172.21.15.50:0/2312698980 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054071860 con 0x7f405415ceb0 2023-08-10T10:51:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.746+0000 7f40588b1640 1 --2- 172.21.15.50:0/2312698980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405415ceb0 0x7f4054070b50 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f40540cb5a0 tx=0x7f404802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644e4c098f8c8661 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.746+0000 7f40537fe640 1 -- 172.21.15.50:0/2312698980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048031870 con 0x7f405415ceb0 2023-08-10T10:51:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.746+0000 7f40537fe640 1 -- 172.21.15.50:0/2312698980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40480319d0 con 0x7f405415ceb0 2023-08-10T10:51:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.746+0000 7f40537fe640 1 -- 172.21.15.50:0/2312698980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048031d60 con 0x7f405415ceb0 2023-08-10T10:51:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 -- 172.21.15.50:0/2312698980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405415ceb0 msgr2=0x7f4054070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 --2- 172.21.15.50:0/2312698980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405415ceb0 0x7f4054070b50 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f40540cb5a0 tx=0x7f404802b910 comp rx=0 tx=0).stop 2023-08-10T10:51:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 -- 172.21.15.50:0/2312698980 shutdown_connections 2023-08-10T10:51:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 --2- 172.21.15.50:0/2312698980 >> v2:172.21.15.117:3300/0 conn(0x7f40540b29e0 0x7f40540cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 --2- 172.21.15.50:0/2312698980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f405415ceb0 0x7f4054070b50 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 -- 172.21.15.50:0/2312698980 >> 172.21.15.50:0/2312698980 conn(0x7f40540cd2d0 msgr2=0x7f40540cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 -- 172.21.15.50:0/2312698980 shutdown_connections 2023-08-10T10:51:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.747+0000 7f405ab15640 1 -- 172.21.15.50:0/2312698980 wait complete. 2023-08-10T10:51:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.749+0000 7f405ab15640 1 Processor -- start 2023-08-10T10:51:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.749+0000 7f405ab15640 1 -- start start 2023-08-10T10:51:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40540b29e0 0x7f4054151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f405415ceb0 0x7f405415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ae010 con 0x7f40540b3c60 2023-08-10T10:51:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ad420 con 0x7f40540b29e0 2023-08-10T10:51:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f405ab15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054152110 con 0x7f405415ceb0 2023-08-10T10:51:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.750+0000 7f4053fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42876/0 (socket says 172.21.15.50:42876) 2023-08-10T10:51:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 -- 172.21.15.50:0/3889459973 learned_addr learned my addr 172.21.15.50:0/3889459973 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f40588b1640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40540b29e0 0x7f4054151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f40590b2640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f405415ceb0 0x7f405415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 -- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f405415ceb0 msgr2=0x7f405415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f405415ceb0 0x7f405415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 -- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40540b29e0 msgr2=0x7f4054151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40540b29e0 0x7f4054151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 -- 172.21.15.50:0/3889459973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480094d0 con 0x7f40540b3c60 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.751+0000 7f4053fff640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f404000c400 tx=0x7f404000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.752+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011790 con 0x7f40540b3c60 2023-08-10T10:51:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.752+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011930 con 0x7f40540b3c60 2023-08-10T10:51:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.752+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011ce0 con 0x7f40540b3c60 2023-08-10T10:51:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.752+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40540ad6e0 con 0x7f40540b3c60 2023-08-10T10:51:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.752+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40540adca0 con 0x7f40540b3c60 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.753+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40540ae1c0 con 0x7f40540b3c60 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.754+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f404001c460 con 0x7f40540b3c60 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.755+0000 7f40517fa640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 0x7f403806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.755+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4040089190 con 0x7f40540b3c60 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.755+0000 7f40588b1640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 0x7f403806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.756+0000 7f40588b1640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 0x7f403806d140 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4048036000 tx=0x7f404803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:41.759+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40540ae1c0 con 0x7f40540b3c60 2023-08-10T10:51:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.024+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f405404e270 con 0x7f40540b3c60 2023-08-10T10:51:42.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.502+0000 7f40517fa640 1 -- 172.21.15.50:0/3889459973 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v649) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4040057f50 con 0x7f40540b3c60 2023-08-10T10:51:42.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 msgr2=0x7f403806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 0x7f403806d140 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4048036000 tx=0x7f404803c040 comp rx=0 tx=0).stop 2023-08-10T10:51:42.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 msgr2=0x7f40540696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f404000c400 tx=0x7f404000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 shutdown_connections 2023-08-10T10:51:42.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f405415ceb0 0x7f405415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40540b3c60 0x7f40540696a0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f403806ac80 0x7f403806d140 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 --2- 172.21.15.50:0/3889459973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40540b29e0 0x7f4054151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.506+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 >> 172.21.15.50:0/3889459973 conn(0x7f40540cd2d0 msgr2=0x7f40540cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:42.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.507+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 shutdown_connections 2023-08-10T10:51:42.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.507+0000 7f405ab15640 1 -- 172.21.15.50:0/3889459973 wait complete. 2023-08-10T10:51:42.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.765+0000 7f3205f24640 1 Processor -- start 2023-08-10T10:51:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.765+0000 7f3205f24640 1 -- start start 2023-08-10T10:51:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.767+0000 7f3205f24640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.767+0000 7f3205f24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.767+0000 7f3205f24640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320006f6f0 con 0x7f3200069be0 2023-08-10T10:51:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.767+0000 7f3205f24640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32001617f0 con 0x7f32000c1af0 2023-08-10T10:51:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.767+0000 7f3205f24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320006a050 con 0x7f32000b2f40 2023-08-10T10:51:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.768+0000 7f31ff7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.768+0000 7f31fffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.768+0000 7f31fffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:53608/0 (socket says 172.21.15.50:53608) 2023-08-10T10:51:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.768+0000 7f31fffff640 1 -- 172.21.15.50:0/1114309638 learned_addr learned my addr 172.21.15.50:0/1114309638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.768+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/1114309638 >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:52382/0 (socket says 172.21.15.50:52382) 2023-08-10T10:51:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31fffff640 1 -- 172.21.15.50:0/1114309638 >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 msgr2=0x7f32000696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31fffff640 1 --2- 172.21.15.50:0/1114309638 >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31fffff640 1 -- 172.21.15.50:0/1114309638 >> v1:172.21.15.117:6789/0 conn(0x7f3200069be0 legacy=0x7f32000b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31fffff640 1 -- 172.21.15.50:0/1114309638 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320006edc0 con 0x7f32000b2f40 2023-08-10T10:51:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31feffd640 1 -- 172.21.15.50:0/1114309638 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514476142 0 0) 0x7f320006f6f0 con 0x7f3200069be0 2023-08-10T10:51:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.769+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/1114309638 >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.771+0000 7f31fffff640 1 --2- 172.21.15.50:0/1114309638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009e50 tx=0x7f31f802bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee93b3720b88fbcf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.772+0000 7f31feffd640 1 -- 172.21.15.50:0/1114309638 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f802cb80 con 0x7f32000b2f40 2023-08-10T10:51:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.772+0000 7f31feffd640 1 -- 172.21.15.50:0/1114309638 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f802cce0 con 0x7f32000b2f40 2023-08-10T10:51:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.772+0000 7f31feffd640 1 -- 172.21.15.50:0/1114309638 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8034610 con 0x7f32000b2f40 2023-08-10T10:51:42.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.772+0000 7f3205f24640 1 -- 172.21.15.50:0/1114309638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 msgr2=0x7f320006fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.772+0000 7f3205f24640 1 --2- 172.21.15.50:0/1114309638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009e50 tx=0x7f31f802bfe0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 -- 172.21.15.50:0/1114309638 shutdown_connections 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 --2- 172.21.15.50:0/1114309638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32000b2f40 0x7f320006fb80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 --2- 172.21.15.50:0/1114309638 >> v2:172.21.15.117:3300/0 conn(0x7f32000c1af0 0x7f32000696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 -- 172.21.15.50:0/1114309638 >> 172.21.15.50:0/1114309638 conn(0x7f320006b590 msgr2=0x7f32000ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 -- 172.21.15.50:0/1114309638 shutdown_connections 2023-08-10T10:51:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.773+0000 7f3205f24640 1 -- 172.21.15.50:0/1114309638 wait complete. 2023-08-10T10:51:42.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.775+0000 7f3205f24640 1 Processor -- start 2023-08-10T10:51:42.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.775+0000 7f3205f24640 1 -- start start 2023-08-10T10:51:42.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 0x7f3200156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 0x7f3200156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c5010 con 0x7f32000c1af0 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c4a50 con 0x7f32000b2f40 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f3205f24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c4d30 con 0x7f3200069be0 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f31fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f31fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42888/0 (socket says 172.21.15.50:42888) 2023-08-10T10:51:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.776+0000 7f31fffff640 1 -- 172.21.15.50:0/2626698186 learned_addr learned my addr 172.21.15.50:0/2626698186 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31f7fff640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 0x7f3200156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 0x7f3200156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 -- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 msgr2=0x7f3200156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 0x7f3200156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 -- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 msgr2=0x7f3200156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 0x7f3200156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 -- 172.21.15.50:0/2626698186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009400 con 0x7f32000c1af0 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31f7fff640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 0x7f3200156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 0x7f3200156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.777+0000 7f31fffff640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009f70 tx=0x7f31f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.778+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8009510 con 0x7f32000c1af0 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.778+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f802ce50 con 0x7f32000c1af0 2023-08-10T10:51:42.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.778+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8040690 con 0x7f32000c1af0 2023-08-10T10:51:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.778+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f8009b30 con 0x7f32000c1af0 2023-08-10T10:51:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.778+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32000c2570 con 0x7f32000c1af0 2023-08-10T10:51:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.779+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320004e270 con 0x7f32000c1af0 2023-08-10T10:51:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.780+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31f80407f0 con 0x7f32000c1af0 2023-08-10T10:51:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.781+0000 7f31fcff9640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 0x7f31e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.781+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f31f80abbb0 con 0x7f32000c1af0 2023-08-10T10:51:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.781+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 0x7f31e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.782+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 0x7f31e006d110 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009c50 tx=0x7f31f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.786+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f31f8076ff0 con 0x7f32000c1af0 2023-08-10T10:51:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.979+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32000c2730 con 0x7f32000c1af0 2023-08-10T10:51:42.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.981+0000 7f31fcff9640 1 -- 172.21.15.50:0/2626698186 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+14768 (secure 0 0 0) 0x7f31f807a610 con 0x7f32000c1af0 2023-08-10T10:51:42.982 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:42.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":180,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:40.464364+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6837/2288662428":"2023-08-11T10:51:37.446677+0000","172.21.15.50:6836/2288662428":"2023-08-11T10:51:37.446677+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:42.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 msgr2=0x7f31e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 0x7f31e006d110 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009c50 tx=0x7f31f0008040 comp rx=0 tx=0).stop 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 msgr2=0x7f32000c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009f70 tx=0x7f31f8004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 shutdown_connections 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000c1af0 0x7f32000c4000 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31e006ac50 0x7f31e006d110 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000b2f40 0x7f3200156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 --2- 172.21.15.50:0/2626698186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200069be0 0x7f3200156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 >> 172.21.15.50:0/2626698186 conn(0x7f320006b590 msgr2=0x7f3200159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 shutdown_connections 2023-08-10T10:51:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:42.984+0000 7f3205f24640 1 -- 172.21.15.50:0/2626698186 wait complete. 2023-08-10T10:51:43.003 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:51:43.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.236+0000 7f73bffff640 1 Processor -- start 2023-08-10T10:51:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.236+0000 7f73bffff640 1 -- start start 2023-08-10T10:51:43.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73c015aa50 0x7f73c00c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73bffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73c00aff00 0x7f73c00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73bffff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00b0890 con 0x7f73c00b4130 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73bffff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c015ae30 con 0x7f73c015aa50 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73bffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c00b1370 con 0x7f73c00aff00 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73beffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73c015aa50 0x7f73c00c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73beffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73c015aa50 0x7f73c00c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42898/0 (socket says 172.21.15.50:42898) 2023-08-10T10:51:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.238+0000 7f73beffd640 1 -- 172.21.15.50:0/4128325405 learned_addr learned my addr 172.21.15.50:0/4128325405 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.239+0000 7f73beffd640 1 -- 172.21.15.50:0/4128325405 >> v2:172.21.15.117:3300/0 conn(0x7f73c00aff00 msgr2=0x7f73c00b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.239+0000 7f73beffd640 1 --2- 172.21.15.50:0/4128325405 >> v2:172.21.15.117:3300/0 conn(0x7f73c00aff00 0x7f73c00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.239+0000 7f73beffd640 1 -- 172.21.15.50:0/4128325405 >> v1:172.21.15.50:6789/0 conn(0x7f73c00b4130 legacy=0x7f73c00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.239+0000 7f73beffd640 1 -- 172.21.15.50:0/4128325405 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00b1650 con 0x7f73c015aa50 2023-08-10T10:51:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.240+0000 7f73beffd640 1 --2- 172.21.15.50:0/4128325405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c5550 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f73c00cb6a0 tx=0x7f73b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a50535875df2032 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.240+0000 7f73bdffb640 1 -- 172.21.15.50:0/4128325405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0031870 con 0x7f73c015aa50 2023-08-10T10:51:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.240+0000 7f73bdffb640 1 -- 172.21.15.50:0/4128325405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00319d0 con 0x7f73c015aa50 2023-08-10T10:51:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.240+0000 7f73bdffb640 1 -- 172.21.15.50:0/4128325405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0031d60 con 0x7f73c015aa50 2023-08-10T10:51:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 -- 172.21.15.50:0/4128325405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 msgr2=0x7f73c00c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 --2- 172.21.15.50:0/4128325405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c5550 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f73c00cb6a0 tx=0x7f73b002b910 comp rx=0 tx=0).stop 2023-08-10T10:51:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 -- 172.21.15.50:0/4128325405 shutdown_connections 2023-08-10T10:51:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 --2- 172.21.15.50:0/4128325405 >> v2:172.21.15.117:3300/0 conn(0x7f73c00aff00 0x7f73c00b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 --2- 172.21.15.50:0/4128325405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c5550 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 -- 172.21.15.50:0/4128325405 >> 172.21.15.50:0/4128325405 conn(0x7f73c0069cd0 msgr2=0x7f73c00caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 -- 172.21.15.50:0/4128325405 shutdown_connections 2023-08-10T10:51:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.241+0000 7f73bffff640 1 -- 172.21.15.50:0/4128325405 wait complete. 2023-08-10T10:51:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.243+0000 7f73bffff640 1 Processor -- start 2023-08-10T10:51:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.243+0000 7f73bffff640 1 -- start start 2023-08-10T10:51:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 0x7f73c0158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 0x7f73c0070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00c3300 con 0x7f73c015aa50 2023-08-10T10:51:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00c35e0 con 0x7f73c00aff00 2023-08-10T10:51:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00c38c0 con 0x7f73c00b4130 2023-08-10T10:51:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.244+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42900/0 (socket says 172.21.15.50:42900) 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 -- 172.21.15.50:0/938205983 learned_addr learned my addr 172.21.15.50:0/938205983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73beffd640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 0x7f73c0158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 -- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 msgr2=0x7f73c0070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73be7fc640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 0x7f73c0070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 0x7f73c0070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 -- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 msgr2=0x7f73c0158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 0x7f73c0158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 -- 172.21.15.50:0/938205983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00094d0 con 0x7f73c015aa50 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73be7fc640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 0x7f73c0070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73beffd640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 0x7f73c0158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.245+0000 7f73bf7fe640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f73b800b970 tx=0x7f73b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.246+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800cb40 con 0x7f73c015aa50 2023-08-10T10:51:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.246+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800ccc0 con 0x7f73c015aa50 2023-08-10T10:51:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.246+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8014680 con 0x7f73c015aa50 2023-08-10T10:51:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.246+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c00c3ba0 con 0x7f73c015aa50 2023-08-10T10:51:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.246+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c0158750 con 0x7f73c015aa50 2023-08-10T10:51:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.247+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c00c40c0 con 0x7f73c015aa50 2023-08-10T10:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.248+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73b801d3b0 con 0x7f73c015aa50 2023-08-10T10:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.249+0000 7f73a77fe640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 0x7f73ac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.249+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f73b80890f0 con 0x7f73c015aa50 2023-08-10T10:51:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.250+0000 7f73beffd640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 0x7f73ac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.250+0000 7f73beffd640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 0x7f73ac06d110 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f73b0036000 tx=0x7f73b003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.253+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f73c00c40c0 con 0x7f73c015aa50 2023-08-10T10:51:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.443+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73c00c40c0 con 0x7f73c015aa50 2023-08-10T10:51:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.444+0000 7f73a77fe640 1 -- 172.21.15.50:0/938205983 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73c00c40c0 con 0x7f73c015aa50 2023-08-10T10:51:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 msgr2=0x7f73ac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 0x7f73ac06d110 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f73b0036000 tx=0x7f73b003c040 comp rx=0 tx=0).stop 2023-08-10T10:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 msgr2=0x7f73c00c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f73b800b970 tx=0x7f73b800be30 comp rx=0 tx=0).stop 2023-08-10T10:51:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 shutdown_connections 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73c015aa50 0x7f73c00c43a0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c00b4130 0x7f73c0070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73ac06ac50 0x7f73ac06d110 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 --2- 172.21.15.50:0/938205983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c00aff00 0x7f73c0158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 >> 172.21.15.50:0/938205983 conn(0x7f73c0069cd0 msgr2=0x7f73c00af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 shutdown_connections 2023-08-10T10:51:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.447+0000 7f73bffff640 1 -- 172.21.15.50:0/938205983 wait complete. 2023-08-10T10:51:43.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:51:43.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.700+0000 7fc88097f640 1 Processor -- start 2023-08-10T10:51:43.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.700+0000 7fc88097f640 1 -- start start 2023-08-10T10:51:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.702+0000 7fc88097f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc87c15cbb0 0x7fc87c1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.702+0000 7fc88097f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 0x7fc87c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.702+0000 7fc88097f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c161800 con 0x7fc87c0c8d10 2023-08-10T10:51:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.702+0000 7fc88097f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c160870 con 0x7fc87c15cbb0 2023-08-10T10:51:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.702+0000 7fc88097f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ca370 con 0x7fc87c0c98b0 2023-08-10T10:51:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.703+0000 7fc87a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc87c15cbb0 0x7fc87c1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.703+0000 7fc87ad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc87c0c8d10 0x7fc87c06f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:40704/0 (socket says 172.21.15.50:40704) 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.703+0000 7fc87ad9d640 1 -- 172.21.15.50:0/1601562307 learned_addr learned my addr 172.21.15.50:0/1601562307 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.703+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1601562307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 0x7fc87c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc87959a640 1 -- 172.21.15.50:0/1601562307 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795041802 0 0) 0x7fc874001490 con 0x7fc87c0c8d10 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc87959a640 1 -- 172.21.15.50:0/1601562307 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc864003520 con 0x7fc87c0c8d10 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc879d9b640 1 -- 172.21.15.50:0/1601562307 >> v2:172.21.15.117:3300/0 conn(0x7fc87c15cbb0 msgr2=0x7fc87c1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1601562307 >> v2:172.21.15.117:3300/0 conn(0x7fc87c15cbb0 0x7fc87c1612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc879d9b640 1 -- 172.21.15.50:0/1601562307 >> v1:172.21.15.117:6789/0 conn(0x7fc87c0c8d10 legacy=0x7fc87c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.704+0000 7fc879d9b640 1 -- 172.21.15.50:0/1601562307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0ca650 con 0x7fc87c0c98b0 2023-08-10T10:51:43.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.705+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1601562307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 0x7fc87c0c9d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097a0 tx=0x7fc87002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24cc4c37ae0f1796 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.706+0000 7fc87959a640 1 -- 172.21.15.50:0/1601562307 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870031780 con 0x7fc87c0c98b0 2023-08-10T10:51:43.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.706+0000 7fc87959a640 1 -- 172.21.15.50:0/1601562307 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700318e0 con 0x7fc87c0c98b0 2023-08-10T10:51:43.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.706+0000 7fc87959a640 1 -- 172.21.15.50:0/1601562307 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870031c70 con 0x7fc87c0c98b0 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 -- 172.21.15.50:0/1601562307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 msgr2=0x7fc87c0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 --2- 172.21.15.50:0/1601562307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 0x7fc87c0c9d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097a0 tx=0x7fc87002b820 comp rx=0 tx=0).stop 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 -- 172.21.15.50:0/1601562307 shutdown_connections 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 --2- 172.21.15.50:0/1601562307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c0c98b0 0x7fc87c0c9d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 --2- 172.21.15.50:0/1601562307 >> v2:172.21.15.117:3300/0 conn(0x7fc87c15cbb0 0x7fc87c1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 -- 172.21.15.50:0/1601562307 >> 172.21.15.50:0/1601562307 conn(0x7fc87c0b01b0 msgr2=0x7fc87c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 -- 172.21.15.50:0/1601562307 shutdown_connections 2023-08-10T10:51:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.707+0000 7fc88097f640 1 -- 172.21.15.50:0/1601562307 wait complete. 2023-08-10T10:51:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.709+0000 7fc88097f640 1 Processor -- start 2023-08-10T10:51:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.709+0000 7fc88097f640 1 -- start start 2023-08-10T10:51:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc87c0c98b0 0x7fc87c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c15cbb0 0x7fc87c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0c4510 con 0x7fc87c0c8d10 2023-08-10T10:51:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0c8000 con 0x7fc87c0c98b0 2023-08-10T10:51:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc88097f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0c73f0 con 0x7fc87c15cbb0 2023-08-10T10:51:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc87a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc87a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42912/0 (socket says 172.21.15.50:42912) 2023-08-10T10:51:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc87a59c640 1 -- 172.21.15.50:0/1469946499 learned_addr learned my addr 172.21.15.50:0/1469946499 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc87ad9d640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c15cbb0 0x7fc87c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.710+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc87c0c98b0 0x7fc87c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 -- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c15cbb0 msgr2=0x7fc87c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c15cbb0 0x7fc87c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 -- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc87c0c98b0 msgr2=0x7fc87c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc87c0c98b0 0x7fc87c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 -- 172.21.15.50:0/1469946499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009400 con 0x7fc87c0c8d10 2023-08-10T10:51:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc87a59c640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00e9e0 tx=0x7fc86c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c009670 con 0x7fc87c0c8d10 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00c9d0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00cd80 con 0x7fc87c0c8d10 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.711+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c0c76d0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.712+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c0c7c90 con 0x7fc87c0c8d10 2023-08-10T10:51:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.713+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0612b0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.714+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc86c013470 con 0x7fc87c0c8d10 2023-08-10T10:51:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.715+0000 7fc86affd640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 0x7fc85c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.715+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc86c0897b0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.715+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 0x7fc85c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.716+0000 7fc879d9b640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 0x7fc85c06d140 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc870036000 tx=0x7fc87003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.719+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc86c054ae0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.910+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc87c15b1a0 con 0x7fc87c0c8d10 2023-08-10T10:51:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.911+0000 7fc86affd640 1 -- 172.21.15.50:0/1469946499 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc86c058100 con 0x7fc87c0c8d10 2023-08-10T10:51:43.911 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:51:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 msgr2=0x7fc85c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 0x7fc85c06d140 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc870036000 tx=0x7fc87003d040 comp rx=0 tx=0).stop 2023-08-10T10:51:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 msgr2=0x7fc87c0c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00e9e0 tx=0x7fc86c00eea0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 shutdown_connections 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc87c15cbb0 0x7fc87c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc85c06ac80 0x7fc85c06d140 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.913+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc87c0c98b0 0x7fc87c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.914+0000 7fc88097f640 1 --2- 172.21.15.50:0/1469946499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c0c8d10 0x7fc87c0c2460 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.914+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 >> 172.21.15.50:0/1469946499 conn(0x7fc87c0b01b0 msgr2=0x7fc87c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.914+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 shutdown_connections 2023-08-10T10:51:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:43.914+0000 7fc88097f640 1 -- 172.21.15.50:0/1469946499 wait complete. 2023-08-10T10:51:43.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-10T10:51:44.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.151+0000 7f48a7fff640 1 Processor -- start 2023-08-10T10:51:44.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.151+0000 7f48a7fff640 1 -- start start 2023-08-10T10:51:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.152+0000 7f48a7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a81583c0 0x7f48a80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.152+0000 7f48a7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48a8069db0 0x7f48a815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a7fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a815aee0 con 0x7f48a80b1ba0 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a7fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80b2100 con 0x7f48a81583c0 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a7fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a815b1a0 con 0x7f48a8069db0 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a81583c0 0x7f48a80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48a81583c0 0x7f48a80b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42926/0 (socket says 172.21.15.50:42926) 2023-08-10T10:51:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2776374176 learned_addr learned my addr 172.21.15.50:0/2776374176 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a67fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f48a80b1ba0 0x7f48a80696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57772/0 (socket says 172.21.15.50:57772) 2023-08-10T10:51:44.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a77fe640 1 --2- 172.21.15.50:0/2776374176 >> v2:172.21.15.117:3300/0 conn(0x7f48a8069db0 0x7f48a815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:44.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2776374176 >> v2:172.21.15.117:3300/0 conn(0x7f48a8069db0 msgr2=0x7f48a815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 --2- 172.21.15.50:0/2776374176 >> v2:172.21.15.117:3300/0 conn(0x7f48a8069db0 0x7f48a815e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2776374176 >> v1:172.21.15.50:6789/0 conn(0x7f48a80b1ba0 legacy=0x7f48a80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a6ffd640 1 -- 172.21.15.50:0/2776374176 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a815b480 con 0x7f48a81583c0 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.153+0000 7f48a5ffb640 1 -- 172.21.15.50:0/2776374176 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233661653 0 0) 0x7f48a815aee0 con 0x7f48a80b1ba0 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a6ffd640 1 --2- 172.21.15.50:0/2776374176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a81583c0 0x7f48a80b1660 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f48a806cdf0 tx=0x7f489802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90809bf19525932 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:44.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a5ffb640 1 -- 172.21.15.50:0/2776374176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898030880 con 0x7f48a81583c0 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a5ffb640 1 -- 172.21.15.50:0/2776374176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48980309e0 con 0x7f48a81583c0 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a5ffb640 1 -- 172.21.15.50:0/2776374176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898030d70 con 0x7f48a81583c0 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 -- 172.21.15.50:0/2776374176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a81583c0 msgr2=0x7f48a80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 --2- 172.21.15.50:0/2776374176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a81583c0 0x7f48a80b1660 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f48a806cdf0 tx=0x7f489802b9c0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 -- 172.21.15.50:0/2776374176 shutdown_connections 2023-08-10T10:51:44.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 --2- 172.21.15.50:0/2776374176 >> v2:172.21.15.117:3300/0 conn(0x7f48a8069db0 0x7f48a815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 --2- 172.21.15.50:0/2776374176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a81583c0 0x7f48a80b1660 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.155+0000 7f48a7fff640 1 -- 172.21.15.50:0/2776374176 >> 172.21.15.50:0/2776374176 conn(0x7f48a80caf80 msgr2=0x7f48a80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.156+0000 7f48a7fff640 1 -- 172.21.15.50:0/2776374176 shutdown_connections 2023-08-10T10:51:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.156+0000 7f48a7fff640 1 -- 172.21.15.50:0/2776374176 wait complete. 2023-08-10T10:51:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.157+0000 7f48a7fff640 1 Processor -- start 2023-08-10T10:51:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.157+0000 7f48a7fff640 1 -- start start 2023-08-10T10:51:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a80b1ba0 0x7f48a806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a81583c0 0x7f48a81587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a806fed0 con 0x7f48a8069db0 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a806f2c0 con 0x7f48a80b1ba0 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.158+0000 7f48a7fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a806f5a0 con 0x7f48a81583c0 2023-08-10T10:51:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42940/0 (socket says 172.21.15.50:42940) 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 -- 172.21.15.50:0/1028196593 learned_addr learned my addr 172.21.15.50:0/1028196593 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 -- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a81583c0 msgr2=0x7f48a81587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a81583c0 0x7f48a81587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 -- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a80b1ba0 msgr2=0x7f48a806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a80b1ba0 0x7f48a806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 -- 172.21.15.50:0/1028196593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980094d0 con 0x7f48a8069db0 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.159+0000 7f48a6ffd640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f4898000c00 tx=0x7f4898004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.160+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898030850 con 0x7f48a8069db0 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.160+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898043400 con 0x7f48a8069db0 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.160+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980437d0 con 0x7f48a8069db0 2023-08-10T10:51:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.160+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a806f880 con 0x7f48a8069db0 2023-08-10T10:51:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.160+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8070360 con 0x7f48a8069db0 2023-08-10T10:51:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.161+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a8066e30 con 0x7f48a8069db0 2023-08-10T10:51:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.162+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4898043930 con 0x7f48a8069db0 2023-08-10T10:51:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.163+0000 7f488f7fe640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 0x7f489406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.163+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f489803e070 con 0x7f48a8069db0 2023-08-10T10:51:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.163+0000 7f48a67fc640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 0x7f489406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.164+0000 7f48a67fc640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 0x7f489406d110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f489c0011e0 tx=0x7f489c007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.167+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48980779d0 con 0x7f48a8069db0 2023-08-10T10:51:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.353+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f48a8073380 con 0x7f48a8069db0 2023-08-10T10:51:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.360+0000 7f488f7fe640 1 -- 172.21.15.50:0/1028196593 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f48980340c0 con 0x7f48a8069db0 2023-08-10T10:51:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.362+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 msgr2=0x7f489406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.362+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 0x7f489406d110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f489c0011e0 tx=0x7f489c007920 comp rx=0 tx=0).stop 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.362+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 msgr2=0x7f48a8156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.362+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f4898000c00 tx=0x7f4898004730 comp rx=0 tx=0).stop 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 shutdown_connections 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48a81583c0 0x7f48a81587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f489406ac50 0x7f489406d110 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a80b1ba0 0x7f48a806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 --2- 172.21.15.50:0/1028196593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48a8069db0 0x7f48a8156a20 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 >> 172.21.15.50:0/1028196593 conn(0x7f48a80caf80 msgr2=0x7f48a80ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 shutdown_connections 2023-08-10T10:51:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:44.363+0000 7f48a7fff640 1 -- 172.21.15.50:0/1028196593 wait complete. 2023-08-10T10:51:44.380 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:51:44.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:51:44.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:51:44.623 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:51:44.624 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:51:44.624 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:44.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:51:44.687 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:51:44.687 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:44.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:51:44.745 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:51:44.745 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:44.811 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:51:44.811 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:51:44.812 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:51:44.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:51:44.871 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-10T10:51:44.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.106+0000 7fc765098640 1 Processor -- start 2023-08-10T10:51:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.106+0000 7fc765098640 1 -- start start 2023-08-10T10:51:45.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc765098640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7600ac890 0x7fc760167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc765098640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7601604d0 con 0x7fc7601600f0 2023-08-10T10:51:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc765098640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600cca30 con 0x7fc7600b0620 2023-08-10T10:51:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc765098640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7600acd00 con 0x7fc7600ac890 2023-08-10T10:51:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc75ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7601600f0 0x7fc7600aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56614/0 (socket says 172.21.15.50:56614) 2023-08-10T10:51:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc75ffff640 1 -- 172.21.15.50:0/2967289756 learned_addr learned my addr 172.21.15.50:0/2967289756 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.108+0000 7fc764897640 1 --2- 172.21.15.50:0/2967289756 >> v2:172.21.15.50:3300/0 conn(0x7fc7600ac890 0x7fc760167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.109+0000 7fc75effd640 1 -- 172.21.15.50:0/2967289756 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652746975 0 0) 0x7fc7601604d0 con 0x7fc7601600f0 2023-08-10T10:51:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.109+0000 7fc75effd640 1 -- 172.21.15.50:0/2967289756 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc74c003520 con 0x7fc7601600f0 2023-08-10T10:51:45.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.109+0000 7fc764897640 1 -- 172.21.15.50:0/2967289756 >> v1:172.21.15.117:6789/0 conn(0x7fc7600b0620 legacy=0x7fc7601646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:45.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.109+0000 7fc764897640 1 -- 172.21.15.50:0/2967289756 >> v1:172.21.15.50:6789/0 conn(0x7fc7601600f0 legacy=0x7fc7600aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.109+0000 7fc764897640 1 -- 172.21.15.50:0/2967289756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600cc100 con 0x7fc7600ac890 2023-08-10T10:51:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.110+0000 7fc764897640 1 --2- 172.21.15.50:0/2967289756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600ac890 0x7fc760167e20 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc758009dc0 tx=0x7fc75802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c00952a4481f74a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.110+0000 7fc75effd640 1 -- 172.21.15.50:0/2967289756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75802cbb0 con 0x7fc7600ac890 2023-08-10T10:51:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.110+0000 7fc75effd640 1 -- 172.21.15.50:0/2967289756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75802cd10 con 0x7fc7600ac890 2023-08-10T10:51:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.110+0000 7fc75effd640 1 -- 172.21.15.50:0/2967289756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758034660 con 0x7fc7600ac890 2023-08-10T10:51:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 -- 172.21.15.50:0/2967289756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600ac890 msgr2=0x7fc760167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 --2- 172.21.15.50:0/2967289756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600ac890 0x7fc760167e20 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc758009dc0 tx=0x7fc75802be00 comp rx=0 tx=0).stop 2023-08-10T10:51:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 -- 172.21.15.50:0/2967289756 shutdown_connections 2023-08-10T10:51:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 --2- 172.21.15.50:0/2967289756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600ac890 0x7fc760167e20 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 -- 172.21.15.50:0/2967289756 >> 172.21.15.50:0/2967289756 conn(0x7fc76006ab80 msgr2=0x7fc76006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 -- 172.21.15.50:0/2967289756 shutdown_connections 2023-08-10T10:51:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.111+0000 7fc765098640 1 -- 172.21.15.50:0/2967289756 wait complete. 2023-08-10T10:51:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.113+0000 7fc765098640 1 Processor -- start 2023-08-10T10:51:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.113+0000 7fc765098640 1 -- start start 2023-08-10T10:51:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 0x7fc760148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7601600f0 0x7fc7600c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76006f0e0 con 0x7fc7600b0620 2023-08-10T10:51:45.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76006f3c0 con 0x7fc7600ac890 2023-08-10T10:51:45.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc765098640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76006f6a0 con 0x7fc7601600f0 2023-08-10T10:51:45.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42348/0 (socket says 172.21.15.50:42348) 2023-08-10T10:51:45.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.114+0000 7fc75f7fe640 1 -- 172.21.15.50:0/2375074491 learned_addr learned my addr 172.21.15.50:0/2375074491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75ffff640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 0x7fc760148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 -- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7601600f0 msgr2=0x7fc7600c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7601600f0 0x7fc7600c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 -- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 msgr2=0x7fc760148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 0x7fc760148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 -- 172.21.15.50:0/2375074491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009a70 con 0x7fc7600b0620 2023-08-10T10:51:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75ffff640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 0x7fc760148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75f7fe640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.115+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011790 con 0x7fc7600b0620 2023-08-10T10:51:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.116+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480118f0 con 0x7fc7600b0620 2023-08-10T10:51:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.116+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76006f980 con 0x7fc7600b0620 2023-08-10T10:51:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.116+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011ce0 con 0x7fc7600b0620 2023-08-10T10:51:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.116+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc760148eb0 con 0x7fc7600b0620 2023-08-10T10:51:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.117+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc760149070 con 0x7fc7600b0620 2023-08-10T10:51:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.118+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc74801c460 con 0x7fc7600b0620 2023-08-10T10:51:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.119+0000 7fc75cff9640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.119+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc748089220 con 0x7fc7600b0620 2023-08-10T10:51:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.119+0000 7fc75ffff640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.120+0000 7fc75ffff640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7500011e0 tx=0x7fc750009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.124+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc748054550 con 0x7fc7600b0620 2023-08-10T10:51:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.353+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc760066e30 con 0x7fc7600b0620 2023-08-10T10:51:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.354+0000 7fc75cff9640 1 -- 172.21.15.50:0/2375074491 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc748057b70 con 0x7fc7600b0620 2023-08-10T10:51:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:45.356 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2719437063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2719437063},{"type":"v1","addr":"172.21.15.117:6835","nonce":2719437063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/407572465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":407572465},{"type":"v1","addr":"172.21.15.117:6834","nonce":407572465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2862399022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2862399022},{"type":"v1","addr":"172.21.15.50:6835","nonce":2862399022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/3148866653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":3148866653},{"type":"v1","addr":"172.21.15.50:6837","nonce":3148866653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-08-10T10:51:45.356 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 87 2023-08-10T10:51:45.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.357+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 msgr2=0x7fc74006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.357+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7500011e0 tx=0x7fc750009040 comp rx=0 tx=0).stop 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.357+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 msgr2=0x7fc76006e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.357+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 shutdown_connections 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7601600f0 0x7fc7600c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7600b0620 0x7fc76006e700 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc74006ac50 0x7fc74006d110 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 --2- 172.21.15.50:0/2375074491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7600ac890 0x7fc760148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 >> 172.21.15.50:0/2375074491 conn(0x7fc76006ab80 msgr2=0x7fc7600aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:45.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 shutdown_connections 2023-08-10T10:51:45.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.358+0000 7fc765098640 1 -- 172.21.15.50:0/2375074491 wait complete. 2023-08-10T10:51:45.378 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:51:45.378 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-10T10:51:45.379 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:51:45.379 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:51:45.379 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:51:45.380 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-10T10:51:45.380 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:51:45.380 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:51:45.381 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:51:45.381 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-10T10:51:45.381 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:51:45.381 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:51:45.381 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:51:45.382 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-10T10:51:45.382 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:51:45.382 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:51:45.396 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:51:45.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:51:45.399 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:51:45.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:51:45.407 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:51:45.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:51:45.409 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:51:45.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:51:45.445 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:51:45.446 DEBUG:teuthology.parallel:result is None 2023-08-10T10:51:45.451 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:51:45.452 DEBUG:teuthology.parallel:result is None 2023-08-10T10:51:45.456 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:51:45.456 DEBUG:teuthology.parallel:result is None 2023-08-10T10:51:45.462 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:51:45.463 DEBUG:teuthology.parallel:result is None 2023-08-10T10:51:45.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-10T10:51:45.616 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-08-10T10:51:45.616 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:51:45.623 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-10T10:51:45.630 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-10T10:51:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.665+0000 7fe5510d3640 1 Processor -- start 2023-08-10T10:51:45.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.666+0000 7fe5510d3640 1 -- start start 2023-08-10T10:51:45.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe5510d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe54c15a820 0x7fe54c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe5510d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe54c069db0 0x7fe54c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe5510d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54c15bcb0 con 0x7fe54c15ac00 2023-08-10T10:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe5510d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0c5540 con 0x7fe54c15a820 2023-08-10T10:51:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe5510d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c15b0a0 con 0x7fe54c069db0 2023-08-10T10:51:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe54259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe54c15ac00 0x7fe54c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56642/0 (socket says 172.21.15.50:56642) 2023-08-10T10:51:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe54259c640 1 -- 172.21.15.50:0/3435086376 learned_addr learned my addr 172.21.15.50:0/3435086376 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.667+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/3435086376 >> v2:172.21.15.50:3300/0 conn(0x7fe54c15a820 0x7fe54c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54b59e640 1 --2- 172.21.15.50:0/3435086376 >> v2:172.21.15.117:3300/0 conn(0x7fe54c069db0 0x7fe54c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54a59c640 1 -- 172.21.15.50:0/3435086376 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300109330 0 0) 0x7fe54c15bcb0 con 0x7fe54c15ac00 2023-08-10T10:51:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54a59c640 1 -- 172.21.15.50:0/3435086376 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe538003520 con 0x7fe54c15ac00 2023-08-10T10:51:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54ad9d640 1 -- 172.21.15.50:0/3435086376 >> v2:172.21.15.117:3300/0 conn(0x7fe54c069db0 msgr2=0x7fe54c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/3435086376 >> v2:172.21.15.117:3300/0 conn(0x7fe54c069db0 0x7fe54c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54ad9d640 1 -- 172.21.15.50:0/3435086376 >> v1:172.21.15.50:6789/0 conn(0x7fe54c15ac00 legacy=0x7fe54c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.668+0000 7fe54ad9d640 1 -- 172.21.15.50:0/3435086376 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c15b380 con 0x7fe54c15a820 2023-08-10T10:51:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.669+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/3435086376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c06c180 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe54c06ac10 tx=0x7fe53c02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed99355614b112a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.669+0000 7fe54a59c640 1 -- 172.21.15.50:0/3435086376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c02cbe0 con 0x7fe54c15a820 2023-08-10T10:51:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.669+0000 7fe54a59c640 1 -- 172.21.15.50:0/3435086376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c02cd40 con 0x7fe54c15a820 2023-08-10T10:51:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.669+0000 7fe54a59c640 1 -- 172.21.15.50:0/3435086376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c034660 con 0x7fe54c15a820 2023-08-10T10:51:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 -- 172.21.15.50:0/3435086376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 msgr2=0x7fe54c06c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 --2- 172.21.15.50:0/3435086376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c06c180 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe54c06ac10 tx=0x7fe53c02be30 comp rx=0 tx=0).stop 2023-08-10T10:51:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 -- 172.21.15.50:0/3435086376 shutdown_connections 2023-08-10T10:51:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 --2- 172.21.15.50:0/3435086376 >> v2:172.21.15.117:3300/0 conn(0x7fe54c069db0 0x7fe54c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 --2- 172.21.15.50:0/3435086376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c06c180 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 -- 172.21.15.50:0/3435086376 >> 172.21.15.50:0/3435086376 conn(0x7fe54c0b08e0 msgr2=0x7fe54c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 -- 172.21.15.50:0/3435086376 shutdown_connections 2023-08-10T10:51:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.670+0000 7fe5510d3640 1 -- 172.21.15.50:0/3435086376 wait complete. 2023-08-10T10:51:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.672+0000 7fe5510d3640 1 Processor -- start 2023-08-10T10:51:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.672+0000 7fe5510d3640 1 -- start start 2023-08-10T10:51:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54c069db0 0x7fe54c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 0x7fe54c1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c1590e0 con 0x7fe54c15a820 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c1f2f20 con 0x7fe54c069db0 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe5510d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c1f3200 con 0x7fe54c15ac00 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe54259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe54259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42376/0 (socket says 172.21.15.50:42376) 2023-08-10T10:51:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe54259c640 1 -- 172.21.15.50:0/1226576575 learned_addr learned my addr 172.21.15.50:0/1226576575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.673+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54c069db0 0x7fe54c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 -- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 msgr2=0x7fe54c1f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54b59e640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 0x7fe54c1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 0x7fe54c1f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 -- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54c069db0 msgr2=0x7fe54c158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54c069db0 0x7fe54c158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 -- 172.21.15.50:0/1226576575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009a70 con 0x7fe54c15a820 2023-08-10T10:51:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54b59e640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 0x7fe54c1f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe54259c640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c410 tx=0x7fe53400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534005ce0 con 0x7fe54c15a820 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534005e40 con 0x7fe54c15a820 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c1f34e0 con 0x7fe54c15a820 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340072f0 con 0x7fe54c15a820 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.674+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c0c2990 con 0x7fe54c15a820 2023-08-10T10:51:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.676+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c04e270 con 0x7fe54c15a820 2023-08-10T10:51:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.676+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe534007510 con 0x7fe54c15a820 2023-08-10T10:51:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.678+0000 7fe543fff640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 0x7fe52c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.678+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe534088930 con 0x7fe54c15a820 2023-08-10T10:51:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.678+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 0x7fe52c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.679+0000 7fe54ad9d640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 0x7fe52c06d110 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe53c036000 tx=0x7fe53c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.682+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe534053d20 con 0x7fe54c15a820 2023-08-10T10:51:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:45.896+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe54c06c490 con 0x7fe54c15a820 2023-08-10T10:51:45.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:51:46.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:51:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.544+0000 7fe543fff640 1 -- 172.21.15.50:0/1226576575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v182) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe534057340 con 0x7fe54c15a820 2023-08-10T10:51:46.545 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-08-10T10:51:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.547+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 msgr2=0x7fe52c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.547+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 0x7fe52c06d110 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe53c036000 tx=0x7fe53c030000 comp rx=0 tx=0).stop 2023-08-10T10:51:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.547+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 msgr2=0x7fe54c1f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.547+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c410 tx=0x7fe53400c8d0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 shutdown_connections 2023-08-10T10:51:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54c15ac00 0x7fe54c1f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe54c15a820 0x7fe54c1f2530 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe52c06ac50 0x7fe52c06d110 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 --2- 172.21.15.50:0/1226576575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54c069db0 0x7fe54c158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 >> 172.21.15.50:0/1226576575 conn(0x7fe54c0b08e0 msgr2=0x7fe54c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 shutdown_connections 2023-08-10T10:51:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.548+0000 7fe5510d3640 1 -- 172.21.15.50:0/1226576575 wait complete. 2023-08-10T10:51:46.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-10T10:51:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.791+0000 7f9bd82d3640 1 Processor -- start 2023-08-10T10:51:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.791+0000 7f9bd82d3640 1 -- start start 2023-08-10T10:51:46.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.793+0000 7f9bd82d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bd015ccb0 0x7f9bd00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.793+0000 7f9bd82d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00719f0 con 0x7f9bd0069db0 2023-08-10T10:51:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.793+0000 7f9bd82d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00c8db0 con 0x7f9bd00c9b30 2023-08-10T10:51:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.793+0000 7f9bd82d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00c9050 con 0x7f9bd015ccb0 2023-08-10T10:51:46.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.794+0000 7f9bd6870640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9bd0069db0 0x7f9bd006ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56644/0 (socket says 172.21.15.50:56644) 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.794+0000 7f9bd6870640 1 -- 172.21.15.50:0/1258305844 learned_addr learned my addr 172.21.15.50:0/1258305844 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.794+0000 7f9bd606f640 1 --2- 172.21.15.50:0/1258305844 >> v2:172.21.15.117:3300/0 conn(0x7f9bd015ccb0 0x7f9bd00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.794+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695210539 0 0) 0x7f9bd00719f0 con 0x7f9bd0069db0 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc003520 con 0x7f9bd0069db0 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126626674 0 0) 0x7f9bbc003520 con 0x7f9bd0069db0 2023-08-10T10:51:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 >> v2:172.21.15.117:3300/0 conn(0x7f9bd015ccb0 msgr2=0x7f9bd00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 --2- 172.21.15.50:0/1258305844 >> v2:172.21.15.117:3300/0 conn(0x7f9bd015ccb0 0x7f9bd00b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 >> v1:172.21.15.117:6789/0 conn(0x7f9bd00c9b30 legacy=0x7f9bd00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00c9330 con 0x7f9bd0069db0 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9bc80019f0 con 0x7f9bd0069db0 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 >> v1:172.21.15.50:6789/0 conn(0x7f9bd0069db0 legacy=0x7f9bd006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc003970 0x7f9bbc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 0x7f9bbc004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc005040 0x7f9bbc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c9050 con 0x7f9bbc004370 2023-08-10T10:51:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc00bfa0 con 0x7f9bbc003970 2023-08-10T10:51:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc00c160 con 0x7f9bbc005040 2023-08-10T10:51:46.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.795+0000 7f9bd586e640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 0x7f9bbc004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd606f640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc003970 0x7f9bbc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd6870640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc005040 0x7f9bbc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd586e640 1 -- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc005040 msgr2=0x7f9bbc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd586e640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc005040 0x7f9bbc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd586e640 1 -- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc003970 msgr2=0x7f9bbc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd586e640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc003970 0x7f9bbc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd586e640 1 -- 172.21.15.50:0/1258305844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc003520 con 0x7f9bbc004370 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd6870640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc005040 0x7f9bbc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.796+0000 7f9bd6870640 1 -- 172.21.15.50:0/1258305844 reap_dead start 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.797+0000 7f9bd586e640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 0x7f9bbc004840 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0001830 tx=0x7f9bbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43a5fa1b7d2f503 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.797+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0032600 con 0x7f9bbc004370 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.797+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc002e050 con 0x7f9bbc004370 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.797+0000 7f9bd506d640 1 -- 172.21.15.50:0/1258305844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00329c0 con 0x7f9bbc004370 2023-08-10T10:51:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 -- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 msgr2=0x7f9bbc004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 0x7f9bbc004840 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0001830 tx=0x7f9bbc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 -- 172.21.15.50:0/1258305844 shutdown_connections 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/1258305844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bbc004370 0x7f9bbc004840 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 -- 172.21.15.50:0/1258305844 >> 172.21.15.50:0/1258305844 conn(0x7f9bd006b590 msgr2=0x7f9bd00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 -- 172.21.15.50:0/1258305844 shutdown_connections 2023-08-10T10:51:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.798+0000 7f9bd82d3640 1 -- 172.21.15.50:0/1258305844 wait complete. 2023-08-10T10:51:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.800+0000 7f9bd82d3640 1 Processor -- start 2023-08-10T10:51:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.800+0000 7f9bd82d3640 1 -- start start 2023-08-10T10:51:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc004370 0x7f9bd015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd00c81b0 0x7f9bd0070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c7d90 con 0x7f9bd01505a0 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c7110 con 0x7f9bd00c81b0 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.801+0000 7f9bd82d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c73f0 con 0x7f9bbc004370 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42404/0 (socket says 172.21.15.50:42404) 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 -- 172.21.15.50:0/2740622869 learned_addr learned my addr 172.21.15.50:0/2740622869 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd606f640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc004370 0x7f9bd015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 -- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc004370 msgr2=0x7f9bd015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc004370 0x7f9bd015e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 -- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd00c81b0 msgr2=0x7f9bd0070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd6870640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd00c81b0 0x7f9bd0070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd00c81b0 0x7f9bd0070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 -- 172.21.15.50:0/2740622869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00c76d0 con 0x7f9bd01505a0 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.802+0000 7f9bd586e640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f9bc002bcc0 tx=0x7f9bc0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.803+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc003c820 con 0x7f9bd01505a0 2023-08-10T10:51:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.803+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc003c980 con 0x7f9bd01505a0 2023-08-10T10:51:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.803+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc003cd10 con 0x7f9bd01505a0 2023-08-10T10:51:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.803+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd00c79b0 con 0x7f9bd01505a0 2023-08-10T10:51:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.803+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd01603b0 con 0x7f9bd01505a0 2023-08-10T10:51:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.804+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd00c7ed0 con 0x7f9bd01505a0 2023-08-10T10:51:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.805+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9bc00503f0 con 0x7f9bd01505a0 2023-08-10T10:51:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.806+0000 7f9bc6ffd640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 0x7f9bb406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.806+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9bc00ab440 con 0x7f9bd01505a0 2023-08-10T10:51:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.806+0000 7f9bd606f640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 0x7f9bb406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.807+0000 7f9bd606f640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 0x7f9bb406d140 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00cade0 tx=0x7f9bcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:46.811+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9bd00c7ed0 con 0x7f9bd01505a0 2023-08-10T10:51:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.071+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9bd00c7ed0 con 0x7f9bd01505a0 2023-08-10T10:51:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.072+0000 7f9bc6ffd640 1 -- 172.21.15.50:0/2740622869 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9bd00c7ed0 con 0x7f9bd01505a0 2023-08-10T10:51:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:51:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-08-10T10:51:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkUmVsLhAAzfa0rRKXs8bj3Jrbjj/KuQ==", 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRk/lO+FxAAvuV12HXAF476TJnfgay5UQ==", 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-08-10T10:51:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRklwXdBRAAeS1PGLs2uza/Wyk1rLQlBA==", 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkjL5kKBAAmxv2eouBdjkLRcPEwQAl3w==", 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:51:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkYq+DHBAApcR2ctFNgc7VyPHFRxjbKg==", 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9vdRkkEEULRAA1AtwOEZnbhamwIcQ5dCrTg==", 2023-08-10T10:51:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-08-10T10:51:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkYthfARAAJcvT9+d/oeEbfy11M31MNA==", 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+vdRkqp1UEBAAwhCIZaAGHAO58H0noKPSGg==", 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkOuVpFhAAE4pdcb1vevfLVfRL+kgFPA==", 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkbpSFJhAAnJoYpXJ0MOsmIGgJalNHgQ==", 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-08-10T10:51:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQACvtRkqzpZNxAAtFCFxzHhcCWP5rbwjXNY8Q==", 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADvtRk8OEoDRAAXMu+CqhW3PvpW8U9kUS8yA==", 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg==", 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-08-10T10:51:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkfxGdExAAwtHlwPru6p9bwnFwa+X4hg==", 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:51:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRkUo0DCBAAS8tzdTRa+cvXN1BQ9gbCVA==", 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD7vdRk1JDCHhAAXAvcjMARaMY1VVc3ZX7WVg==", 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-08-10T10:51:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD4vdRkLhtKGhAAmxD1NzIEnsvLWcCyC2IxZQ==", 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-08-10T10:51:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRklvsfIRAAj+do2tZ6LYs8Hxl8hDxfHA==", 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD5vdRkbop1ExAAGOhFRAnPWagJMpws4lQb4Q==", 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:51:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:51:47.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 msgr2=0x7f9bb406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 0x7f9bb406d140 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00cade0 tx=0x7f9bcc008040 comp rx=0 tx=0).stop 2023-08-10T10:51:47.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 msgr2=0x7f9bd015fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f9bc002bcc0 tx=0x7f9bc0001230 comp rx=0 tx=0).stop 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 shutdown_connections 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9bb406ac80 0x7f9bb406d140 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd00c81b0 0x7f9bd0070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd01505a0 0x7f9bd015fe70 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 --2- 172.21.15.50:0/2740622869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc004370 0x7f9bd015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 >> 172.21.15.50:0/2740622869 conn(0x7f9bd006b590 msgr2=0x7f9bd00cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.075+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 shutdown_connections 2023-08-10T10:51:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.076+0000 7f9bd82d3640 1 -- 172.21.15.50:0/2740622869 wait complete. 2023-08-10T10:51:47.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.336+0000 7fef429bd640 1 Processor -- start 2023-08-10T10:51:47.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.336+0000 7fef429bd640 1 -- start start 2023-08-10T10:51:47.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.337+0000 7fef429bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef3c15f2b0 0x7fef3c165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef429bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0b1f10 con 0x7fef3c0b0620 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef429bd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c15e7d0 con 0x7fef3c15a940 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef429bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0b21f0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef421bc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef3c15f2b0 0x7fef3c165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef411ba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef3c0b0620 0x7fef3c0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56646/0 (socket says 172.21.15.50:56646) 2023-08-10T10:51:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef411ba640 1 -- 172.21.15.50:0/1991324944 learned_addr learned my addr 172.21.15.50:0/1991324944 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef421bc640 1 -- 172.21.15.50:0/1991324944 >> v1:172.21.15.117:6789/0 conn(0x7fef3c15a940 legacy=0x7fef3c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.338+0000 7fef421bc640 1 -- 172.21.15.50:0/1991324944 >> v1:172.21.15.50:6789/0 conn(0x7fef3c0b0620 legacy=0x7fef3c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.339+0000 7fef421bc640 1 -- 172.21.15.50:0/1991324944 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c15eab0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.339+0000 7fef409b9640 1 -- 172.21.15.50:0/1991324944 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365496380 0 0) 0x7fef3c0b1f10 con 0x7fef3c0b0620 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef421bc640 1 --2- 172.21.15.50:0/1991324944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c165950 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef3402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839f66851d8c0400 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef409b9640 1 -- 172.21.15.50:0/1991324944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3402cc60 con 0x7fef3c15f2b0 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef409b9640 1 -- 172.21.15.50:0/1991324944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3402cdc0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef409b9640 1 -- 172.21.15.50:0/1991324944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34034660 con 0x7fef3c15f2b0 2023-08-10T10:51:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef429bd640 1 -- 172.21.15.50:0/1991324944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 msgr2=0x7fef3c165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.340+0000 7fef429bd640 1 --2- 172.21.15.50:0/1991324944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c165950 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef3402beb0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.341+0000 7fef429bd640 1 -- 172.21.15.50:0/1991324944 shutdown_connections 2023-08-10T10:51:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.341+0000 7fef429bd640 1 --2- 172.21.15.50:0/1991324944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c165950 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.341+0000 7fef429bd640 1 -- 172.21.15.50:0/1991324944 >> 172.21.15.50:0/1991324944 conn(0x7fef3c06ab80 msgr2=0x7fef3c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.341+0000 7fef429bd640 1 -- 172.21.15.50:0/1991324944 shutdown_connections 2023-08-10T10:51:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.341+0000 7fef429bd640 1 -- 172.21.15.50:0/1991324944 wait complete. 2023-08-10T10:51:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.343+0000 7fef429bd640 1 Processor -- start 2023-08-10T10:51:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.343+0000 7fef429bd640 1 -- start start 2023-08-10T10:51:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 0x7fef3c071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef3c15a940 0x7fef3c1f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c06f1c0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c06fd40 con 0x7fef3c0b0620 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef429bd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c06f410 con 0x7fef3c15a940 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42428/0 (socket says 172.21.15.50:42428) 2023-08-10T10:51:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 -- 172.21.15.50:0/799925993 learned_addr learned my addr 172.21.15.50:0/799925993 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef419bb640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 0x7fef3c071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 -- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef3c15a940 msgr2=0x7fef3c1f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef3c15a940 0x7fef3c1f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.344+0000 7fef421bc640 1 -- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 msgr2=0x7fef3c071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef421bc640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 0x7fef3c071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef421bc640 1 -- 172.21.15.50:0/799925993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34009a70 con 0x7fef3c15f2b0 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef419bb640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 0x7fef3c071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef421bc640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34040450 con 0x7fef3c15f2b0 2023-08-10T10:51:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef340405d0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34040980 con 0x7fef3c15f2b0 2023-08-10T10:51:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c06f6f0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.345+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0716a0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.347+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c06feb0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.347+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef34040ae0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.348+0000 7fef327fc640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 0x7fef2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.348+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef340abd90 con 0x7fef3c15f2b0 2023-08-10T10:51:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.349+0000 7fef419bb640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 0x7fef2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.349+0000 7fef419bb640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 0x7fef2006d110 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fef3c070160 tx=0x7fef38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.353+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fef340771b0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.553+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef3c066e30 con 0x7fef3c15f2b0 2023-08-10T10:51:47.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.555+0000 7fef327fc640 1 -- 172.21.15.50:0/799925993 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+14639 (secure 0 0 0) 0x7fef3407a7d0 con 0x7fef3c15f2b0 2023-08-10T10:51:47.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:47.556 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":184,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:46.557341+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.557+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 msgr2=0x7fef2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.557+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 0x7fef2006d110 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fef3c070160 tx=0x7fef38009040 comp rx=0 tx=0).stop 2023-08-10T10:51:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.557+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 msgr2=0x7fef3c1f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef34004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 shutdown_connections 2023-08-10T10:51:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3c15f2b0 0x7fef3c1f5ba0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef3c15a940 0x7fef3c1f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fef2006ac50 0x7fef2006d110 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 --2- 172.21.15.50:0/799925993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef3c0b0620 0x7fef3c071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 >> 172.21.15.50:0/799925993 conn(0x7fef3c06ab80 msgr2=0x7fef3c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 shutdown_connections 2023-08-10T10:51:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.558+0000 7fef429bd640 1 -- 172.21.15.50:0/799925993 wait complete. 2023-08-10T10:51:47.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:51:47.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:47.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.805+0000 7f0b032a6640 1 Processor -- start 2023-08-10T10:51:47.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.805+0000 7f0b032a6640 1 -- start start 2023-08-10T10:51:47.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.807+0000 7f0b032a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0afc0cd9b0 0x7f0afc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.807+0000 7f0b032a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc06c320 con 0x7f0afc06cb30 2023-08-10T10:51:47.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.807+0000 7f0b032a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc06b770 con 0x7f0afc15ae40 2023-08-10T10:51:47.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.807+0000 7f0b032a6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc06b9f0 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0afc0cd9b0 0x7f0afc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0afc0cd9b0 0x7f0afc0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42434/0 (socket says 172.21.15.50:42434) 2023-08-10T10:51:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 -- 172.21.15.50:0/1126992783 learned_addr learned my addr 172.21.15.50:0/1126992783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 -- 172.21.15.50:0/1126992783 >> v1:172.21.15.117:6789/0 conn(0x7f0afc15ae40 legacy=0x7f0afc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 -- 172.21.15.50:0/1126992783 >> v1:172.21.15.50:6789/0 conn(0x7f0afc06cb30 legacy=0x7f0afc0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.808+0000 7f0b00841640 1 -- 172.21.15.50:0/1126992783 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc06bcd0 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.809+0000 7f0b00841640 1 --2- 172.21.15.50:0/1126992783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc0cd9b0 0x7f0afc0b1510 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009870 tx=0x7f0aec02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9cb4ac73c340b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.810+0000 7f0af3fff640 1 -- 172.21.15.50:0/1126992783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec030850 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.810+0000 7f0af3fff640 1 -- 172.21.15.50:0/1126992783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec0309b0 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.810+0000 7f0af3fff640 1 -- 172.21.15.50:0/1126992783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec030d40 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.810+0000 7f0b032a6640 1 -- 172.21.15.50:0/1126992783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc0cd9b0 msgr2=0x7f0afc0b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.810+0000 7f0b032a6640 1 --2- 172.21.15.50:0/1126992783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc0cd9b0 0x7f0afc0b1510 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009870 tx=0x7f0aec02b990 comp rx=0 tx=0).stop 2023-08-10T10:51:47.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.811+0000 7f0b032a6640 1 -- 172.21.15.50:0/1126992783 shutdown_connections 2023-08-10T10:51:47.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.811+0000 7f0b032a6640 1 --2- 172.21.15.50:0/1126992783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc0cd9b0 0x7f0afc0b1510 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.811+0000 7f0b032a6640 1 -- 172.21.15.50:0/1126992783 >> 172.21.15.50:0/1126992783 conn(0x7f0afc0b01b0 msgr2=0x7f0afc0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:47.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.811+0000 7f0b032a6640 1 -- 172.21.15.50:0/1126992783 shutdown_connections 2023-08-10T10:51:47.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.811+0000 7f0b032a6640 1 -- 172.21.15.50:0/1126992783 wait complete. 2023-08-10T10:51:47.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.812+0000 7f0b032a6640 1 Processor -- start 2023-08-10T10:51:47.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.813+0000 7f0b032a6640 1 -- start start 2023-08-10T10:51:47.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0afc0cd9b0 0x7f0afc1f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0afc15ae40 0x7f0afc1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1f2870 con 0x7f0afc06cb30 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1f62e0 con 0x7f0afc15ae40 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b032a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1f65c0 con 0x7f0afc0cd9b0 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42448/0 (socket says 172.21.15.50:42448) 2023-08-10T10:51:47.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 -- 172.21.15.50:0/3384675468 learned_addr learned my addr 172.21.15.50:0/3384675468 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:47.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 -- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0afc0cd9b0 msgr2=0x7f0afc1f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0afc0cd9b0 0x7f0afc1f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 -- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0afc15ae40 msgr2=0x7f0afc1f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0afc15ae40 0x7f0afc1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.814+0000 7f0b01042640 1 -- 172.21.15.50:0/3384675468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0094d0 con 0x7f0afc06cb30 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0b01042640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0af800b3f0 tx=0x7f0af800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011830 con 0x7f0afc06cb30 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8011990 con 0x7f0afc06cb30 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011d40 con 0x7f0afc06cb30 2023-08-10T10:51:47.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc1f68a0 con 0x7f0afc06cb30 2023-08-10T10:51:47.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.815+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc0c3e00 con 0x7f0afc06cb30 2023-08-10T10:51:47.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.816+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc0612b0 con 0x7f0afc06cb30 2023-08-10T10:51:47.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.817+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0af801a400 con 0x7f0afc06cb30 2023-08-10T10:51:47.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.818+0000 7f0af1ffb640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 0x7f0ae006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:47.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.818+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0af8089060 con 0x7f0afc06cb30 2023-08-10T10:51:47.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.819+0000 7f0b00841640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 0x7f0ae006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:47.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.819+0000 7f0b00841640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 0x7f0ae006d140 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0aec036000 tx=0x7f0aec03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:47.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:47.822+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0af80bb330 con 0x7f0afc06cb30 2023-08-10T10:51:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.022+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0afc0c53b0 con 0x7f0afc06cb30 2023-08-10T10:51:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.023+0000 7f0af1ffb640 1 -- 172.21.15.50:0/3384675468 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0af80150a0 con 0x7f0afc06cb30 2023-08-10T10:51:48.024 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 msgr2=0x7f0ae006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 0x7f0ae006d140 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0aec036000 tx=0x7f0aec03b040 comp rx=0 tx=0).stop 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 msgr2=0x7f0afc0c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0af800b3f0 tx=0x7f0af800b8b0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 shutdown_connections 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0ae006ac80 0x7f0ae006d140 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0afc15ae40 0x7f0afc1f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0afc0cd9b0 0x7f0afc1f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 --2- 172.21.15.50:0/3384675468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0afc06cb30 0x7f0afc0c38c0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 >> 172.21.15.50:0/3384675468 conn(0x7f0afc0b01b0 msgr2=0x7f0afc0af840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 shutdown_connections 2023-08-10T10:51:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.026+0000 7f0b032a6640 1 -- 172.21.15.50:0/3384675468 wait complete. 2023-08-10T10:51:48.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:51:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.275+0000 7fb866e8a640 1 Processor -- start 2023-08-10T10:51:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.276+0000 7fb866e8a640 1 -- start start 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.277+0000 7fb866e8a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8600cd660 0x7fb86006a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.277+0000 7fb866e8a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86006a5c0 con 0x7fb86015fde0 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.277+0000 7fb866e8a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86006a820 con 0x7fb8600b1e00 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.277+0000 7fb866e8a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86006b0c0 con 0x7fb8600cd660 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb865e88640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb86015fde0 0x7fb8600ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56670/0 (socket says 172.21.15.50:56670) 2023-08-10T10:51:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb865e88640 1 -- 172.21.15.50:0/4279725253 learned_addr learned my addr 172.21.15.50:0/4279725253 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854904606 0 0) 0x7fb86006a5c0 con 0x7fb86015fde0 2023-08-10T10:51:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84c003520 con 0x7fb86015fde0 2023-08-10T10:51:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb865687640 1 --2- 172.21.15.50:0/4279725253 >> v2:172.21.15.117:3300/0 conn(0x7fb8600cd660 0x7fb86006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 973848310 0 0) 0x7fb84c003520 con 0x7fb86015fde0 2023-08-10T10:51:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 >> v2:172.21.15.117:3300/0 conn(0x7fb8600cd660 msgr2=0x7fb86006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 --2- 172.21.15.50:0/4279725253 >> v2:172.21.15.117:3300/0 conn(0x7fb8600cd660 0x7fb86006a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.278+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 >> v1:172.21.15.117:6789/0 conn(0x7fb8600b1e00 legacy=0x7fb8600d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86006ab00 con 0x7fb86015fde0 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb85c001690 con 0x7fb86015fde0 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 >> v1:172.21.15.50:6789/0 conn(0x7fb86015fde0 legacy=0x7fb8600ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 0x7fb84c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0047c0 0x7fb84c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb84c005330 0x7fb84c00b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86006b0c0 con 0x7fb84c0039e0 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c00c280 con 0x7fb84c005330 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c00c440 con 0x7fb84c0047c0 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 0x7fb84c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 -- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0047c0 msgr2=0x7fb84c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0047c0 0x7fb84c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 -- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb84c005330 msgr2=0x7fb84c00b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb84c005330 0x7fb84c00b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb865e88640 1 -- 172.21.15.50:0/4279725253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c003520 con 0x7fb84c0039e0 2023-08-10T10:51:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.279+0000 7fb866689640 1 -- 172.21.15.50:0/4279725253 reap_dead start 2023-08-10T10:51:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.280+0000 7fb865e88640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 0x7fb84c003e00 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb86006a750 tx=0x7fb84c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b19267d93f8ac68 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.281+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c005ad0 con 0x7fb84c0039e0 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.281+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c005c30 con 0x7fb84c0039e0 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.281+0000 7fb864e86640 1 -- 172.21.15.50:0/4279725253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c02c890 con 0x7fb84c0039e0 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.281+0000 7fb866e8a640 1 -- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 msgr2=0x7fb84c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.281+0000 7fb866e8a640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 0x7fb84c003e00 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb86006a750 tx=0x7fb84c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.282+0000 7fb866e8a640 1 -- 172.21.15.50:0/4279725253 shutdown_connections 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.282+0000 7fb866e8a640 1 --2- 172.21.15.50:0/4279725253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb84c0039e0 0x7fb84c003e00 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.282+0000 7fb866e8a640 1 -- 172.21.15.50:0/4279725253 >> 172.21.15.50:0/4279725253 conn(0x7fb8600d2900 msgr2=0x7fb8600d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.282+0000 7fb866e8a640 1 -- 172.21.15.50:0/4279725253 shutdown_connections 2023-08-10T10:51:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.282+0000 7fb866e8a640 1 -- 172.21.15.50:0/4279725253 wait complete. 2023-08-10T10:51:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.283+0000 7fb866e8a640 1 Processor -- start 2023-08-10T10:51:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.284+0000 7fb866e8a640 1 -- start start 2023-08-10T10:51:48.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0039e0 0x7fb860153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 0x7fb8600ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601f1f40 con 0x7fb8600d1a70 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600d2430 con 0x7fb8600ad4b0 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866e8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601f2d60 con 0x7fb84c0039e0 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42458/0 (socket says 172.21.15.50:42458) 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 -- 172.21.15.50:0/2002310373 learned_addr learned my addr 172.21.15.50:0/2002310373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866689640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 0x7fb8600ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 -- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0039e0 msgr2=0x7fb860153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865e88640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0039e0 0x7fb860153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0039e0 0x7fb860153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 -- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 msgr2=0x7fb8600ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 0x7fb8600ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb865687640 1 -- 172.21.15.50:0/2002310373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8601f2150 con 0x7fb8600d1a70 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.285+0000 7fb866689640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 0x7fb8600ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb865687640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fb85000d800 tx=0x7fb85000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000b6c0 con 0x7fb8600d1a70 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000b820 con 0x7fb8600d1a70 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000bbd0 con 0x7fb8600d1a70 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8601f2430 con 0x7fb8600d1a70 2023-08-10T10:51:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.286+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8601f29f0 con 0x7fb8600d1a70 2023-08-10T10:51:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.287+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860066e30 con 0x7fb8600d1a70 2023-08-10T10:51:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.288+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb85000bd30 con 0x7fb8600d1a70 2023-08-10T10:51:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.289+0000 7fb8567fc640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 0x7fb84406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.289+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb8500896c0 con 0x7fb8600d1a70 2023-08-10T10:51:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.289+0000 7fb865e88640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 0x7fb84406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.290+0000 7fb865e88640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 0x7fb84406d110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb85c034000 tx=0x7fb85c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.294+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb850054a20 con 0x7fb8600d1a70 2023-08-10T10:51:48.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.485+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8600af380 con 0x7fb8600d1a70 2023-08-10T10:51:48.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.486+0000 7fb8567fc640 1 -- 172.21.15.50:0/2002310373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v184) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb850058040 con 0x7fb8600d1a70 2023-08-10T10:51:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:51:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 msgr2=0x7fb84406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 0x7fb84406d110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb85c034000 tx=0x7fb85c009030 comp rx=0 tx=0).stop 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 msgr2=0x7fb8600d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fb85000d800 tx=0x7fb85000dcc0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 shutdown_connections 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb84406ac50 0x7fb84406d110 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8600ad4b0 0x7fb8600ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8600d1a70 0x7fb8600d1ef0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 --2- 172.21.15.50:0/2002310373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb84c0039e0 0x7fb860153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 >> 172.21.15.50:0/2002310373 conn(0x7fb8600d2900 msgr2=0x7fb8600b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 shutdown_connections 2023-08-10T10:51:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.489+0000 7fb866e8a640 1 -- 172.21.15.50:0/2002310373 wait complete. 2023-08-10T10:51:48.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:51:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.728+0000 7f77a569f640 1 Processor -- start 2023-08-10T10:51:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.728+0000 7f77a569f640 1 -- start start 2023-08-10T10:51:48.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.730+0000 7f77a569f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77a00b0620 0x7f77a00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.730+0000 7f77a569f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a01604d0 con 0x7f77a01646f0 2023-08-10T10:51:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.730+0000 7f77a569f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00cca30 con 0x7f77a01600f0 2023-08-10T10:51:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.730+0000 7f77a569f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00cc100 con 0x7f77a00b0620 2023-08-10T10:51:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.730+0000 7f77a4e9e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77a01646f0 0x7f77a0166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56684/0 (socket says 172.21.15.50:56684) 2023-08-10T10:51:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f77a4e9e640 1 -- 172.21.15.50:0/3184933771 learned_addr learned my addr 172.21.15.50:0/3184933771 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779f7fe640 1 --2- 172.21.15.50:0/3184933771 >> v2:172.21.15.117:3300/0 conn(0x7f77a00b0620 0x7f77a00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761280209 0 0) 0x7f77a01604d0 con 0x7f77a01646f0 2023-08-10T10:51:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7788003520 con 0x7f77a01646f0 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370359920 0 0) 0x7f7788003520 con 0x7f77a01646f0 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 >> v2:172.21.15.117:3300/0 conn(0x7f77a00b0620 msgr2=0x7f77a00ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 --2- 172.21.15.50:0/3184933771 >> v2:172.21.15.117:3300/0 conn(0x7f77a00b0620 0x7f77a00ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.731+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 >> v1:172.21.15.117:6789/0 conn(0x7f77a01600f0 legacy=0x7f77a00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00cc3e0 con 0x7f77a01646f0 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f77980019f0 con 0x7f77a01646f0 2023-08-10T10:51:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 >> v1:172.21.15.50:6789/0 conn(0x7f77a01646f0 legacy=0x7f77a0166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77880039e0 0x7f7788003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 0x7f7788004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880051f0 0x7f778800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cc100 con 0x7f77880047c0 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778800c150 con 0x7f77880039e0 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778800c310 con 0x7f77880051f0 2023-08-10T10:51:48.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779f7fe640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 0x7f7788004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779ffff640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77880039e0 0x7f7788003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f77a4e9e640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880051f0 0x7f778800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.732+0000 7f779f7fe640 1 -- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880051f0 msgr2=0x7f778800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f779f7fe640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880051f0 0x7f778800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f779f7fe640 1 -- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77880039e0 msgr2=0x7f7788003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f779f7fe640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77880039e0 0x7f7788003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f779f7fe640 1 -- 172.21.15.50:0/3184933771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788003520 con 0x7f77880047c0 2023-08-10T10:51:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f77a4e9e640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880051f0 0x7f778800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f779ffff640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77880039e0 0x7f7788003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.733+0000 7f77a4e9e640 1 -- 172.21.15.50:0/3184933771 reap_dead start 2023-08-10T10:51:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.734+0000 7f779f7fe640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 0x7f7788004c40 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f77880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d48c374b340435 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.734+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779402c6b0 con 0x7f77880047c0 2023-08-10T10:51:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.734+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779402c810 con 0x7f77880047c0 2023-08-10T10:51:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.734+0000 7f779effd640 1 -- 172.21.15.50:0/3184933771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779402cba0 con 0x7f77880047c0 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 -- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 msgr2=0x7f7788004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 0x7f7788004c40 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f77880057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 -- 172.21.15.50:0/3184933771 shutdown_connections 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 --2- 172.21.15.50:0/3184933771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77880047c0 0x7f7788004c40 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 -- 172.21.15.50:0/3184933771 >> 172.21.15.50:0/3184933771 conn(0x7f77a006ab80 msgr2=0x7f77a006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 -- 172.21.15.50:0/3184933771 shutdown_connections 2023-08-10T10:51:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.735+0000 7f77a569f640 1 -- 172.21.15.50:0/3184933771 wait complete. 2023-08-10T10:51:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.738+0000 7f77a569f640 1 Processor -- start 2023-08-10T10:51:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.738+0000 7f77a569f640 1 -- start start 2023-08-10T10:51:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880047c0 0x7f77a0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77a0150b20 0x7f77a0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00b1ad0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a006eb80 con 0x7f77a0150b20 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a569f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a01514e0 con 0x7f77880047c0 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.739+0000 7f77a4e9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42462/0 (socket says 172.21.15.50:42462) 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 -- 172.21.15.50:0/1873072482 learned_addr learned my addr 172.21.15.50:0/1873072482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f779f7fe640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77a0150b20 0x7f77a0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f779ffff640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880047c0 0x7f77a0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 -- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880047c0 msgr2=0x7f77a0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880047c0 0x7f77a0070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 -- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77a0150b20 msgr2=0x7f77a0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77a0150b20 0x7f77a0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 -- 172.21.15.50:0/1873072482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00711a0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f77a4e9e640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f77a00c8a70 tx=0x7f779800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.740+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798004b60 con 0x7f77a00b1fc0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.741+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798004cc0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.741+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980072b0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.741+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a00b3370 con 0x7f77a00b1fc0 2023-08-10T10:51:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.741+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a00b3090 con 0x7f77a00b1fc0 2023-08-10T10:51:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.742+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0066e30 con 0x7f77a00b1fc0 2023-08-10T10:51:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.743+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7798007410 con 0x7f77a00b1fc0 2023-08-10T10:51:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.744+0000 7f779cff9640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 0x7f778c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.744+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f77980896e0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.744+0000 7f779ffff640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 0x7f778c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.745+0000 7f779ffff640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 0x7f778c06d140 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7790007fd0 tx=0x7f7790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.748+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7798054a40 con 0x7f77a00b1fc0 2023-08-10T10:51:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.943+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f77a01561d0 con 0x7f77a00b1fc0 2023-08-10T10:51:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.943+0000 7f779cff9640 1 -- 172.21.15.50:0/1873072482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v184) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7798058060 con 0x7f77a00b1fc0 2023-08-10T10:51:48.945 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:48.945 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-08-10T10:51:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-08-10T10:51:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-08-10T10:51:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:51:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:51:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-08-10T10:51:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-08-10T10:51:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:51:48.948 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-08-10T10:51:48.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 msgr2=0x7f778c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 0x7f778c06d140 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7790007fd0 tx=0x7f7790009040 comp rx=0 tx=0).stop 2023-08-10T10:51:48.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 msgr2=0x7f77a00b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:48.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f77a00c8a70 tx=0x7f779800b4a0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 shutdown_connections 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a00b1fc0 0x7f77a00b2440 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f778c06ac80 0x7f778c06d140 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77a0150b20 0x7f77a0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 --2- 172.21.15.50:0/1873072482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77880047c0 0x7f77a0070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 >> 172.21.15.50:0/1873072482 conn(0x7f77a006ab80 msgr2=0x7f77a00adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:48.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 shutdown_connections 2023-08-10T10:51:48.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:48.946+0000 7f77a569f640 1 -- 172.21.15.50:0/1873072482 wait complete. 2023-08-10T10:51:48.966 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:51:48.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:51:49.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.196+0000 7fc96cbc2640 1 Processor -- start 2023-08-10T10:51:49.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.196+0000 7fc96cbc2640 1 -- start start 2023-08-10T10:51:49.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.198+0000 7fc96cbc2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 0x7fc96806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.198+0000 7fc96cbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 0x7fc9680696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.198+0000 7fc96cbc2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96815bcb0 con 0x7fc9680b40e0 2023-08-10T10:51:49.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.198+0000 7fc96cbc2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680c5540 con 0x7fc96815a820 2023-08-10T10:51:49.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.198+0000 7fc96cbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96815b0a0 con 0x7fc96815ac00 2023-08-10T10:51:49.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc966d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9680b40e0 0x7fc96815e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56690/0 (socket says 172.21.15.50:56690) 2023-08-10T10:51:49.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc966d9d640 1 -- 172.21.15.50:0/2028374712 learned_addr learned my addr 172.21.15.50:0/2028374712 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:49.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc96659c640 1 --2- 172.21.15.50:0/2028374712 >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 0x7fc96806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc965d9b640 1 --2- 172.21.15.50:0/2028374712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 0x7fc9680696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533542038 0 0) 0x7fc96815bcb0 con 0x7fc9680b40e0 2023-08-10T10:51:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.199+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc950003520 con 0x7fc9680b40e0 2023-08-10T10:51:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320708779 0 0) 0x7fc950003520 con 0x7fc9680b40e0 2023-08-10T10:51:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc965d9b640 1 -- 172.21.15.50:0/2028374712 >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 msgr2=0x7fc96806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc965d9b640 1 --2- 172.21.15.50:0/2028374712 >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 0x7fc96806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc965d9b640 1 -- 172.21.15.50:0/2028374712 >> v1:172.21.15.50:6789/0 conn(0x7fc9680b40e0 legacy=0x7fc96815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc965d9b640 1 -- 172.21.15.50:0/2028374712 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96815b380 con 0x7fc96815ac00 2023-08-10T10:51:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.200+0000 7fc96659c640 1 --2- 172.21.15.50:0/2028374712 >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 0x7fc96806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.201+0000 7fc965d9b640 1 --2- 172.21.15.50:0/2028374712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 0x7fc9680696a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0097a0 tx=0x7fc95c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d2deef2d09b937 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.202+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600019f0 con 0x7fc96815ac00 2023-08-10T10:51:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.202+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c02e050 con 0x7fc96815ac00 2023-08-10T10:51:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.202+0000 7fc96559a640 1 -- 172.21.15.50:0/2028374712 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c030730 con 0x7fc96815ac00 2023-08-10T10:51:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2028374712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 msgr2=0x7fc9680696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2028374712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 0x7fc9680696a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0097a0 tx=0x7fc95c02b790 comp rx=0 tx=0).stop 2023-08-10T10:51:49.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2028374712 shutdown_connections 2023-08-10T10:51:49.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2028374712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815ac00 0x7fc9680696a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2028374712 >> v2:172.21.15.117:3300/0 conn(0x7fc96815a820 0x7fc96806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2028374712 >> 172.21.15.50:0/2028374712 conn(0x7fc9680b08e0 msgr2=0x7fc9680ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:49.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2028374712 shutdown_connections 2023-08-10T10:51:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.203+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2028374712 wait complete. 2023-08-10T10:51:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.205+0000 7fc96cbc2640 1 Processor -- start 2023-08-10T10:51:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.205+0000 7fc96cbc2640 1 -- start start 2023-08-10T10:51:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9680b40e0 0x7fc9680c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 0x7fc9680c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680af720 con 0x7fc96815ac00 2023-08-10T10:51:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680aeb10 con 0x7fc9680b40e0 2023-08-10T10:51:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc96cbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680aedf0 con 0x7fc96815a820 2023-08-10T10:51:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.206+0000 7fc966d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42478/0 (socket says 172.21.15.50:42478) 2023-08-10T10:51:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 -- 172.21.15.50:0/2752659762 learned_addr learned my addr 172.21.15.50:0/2752659762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc96659c640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9680b40e0 0x7fc9680c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc965d9b640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 0x7fc9680c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 -- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 msgr2=0x7fc9680c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 0x7fc9680c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 -- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9680b40e0 msgr2=0x7fc9680c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9680b40e0 0x7fc9680c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 -- 172.21.15.50:0/2752659762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009400 con 0x7fc96815ac00 2023-08-10T10:51:49.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc965d9b640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 0x7fc9680c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:49.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.207+0000 7fc966d9d640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc960001830 tx=0x7fc96000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.208+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960012400 con 0x7fc96815ac00 2023-08-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.208+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960012560 con 0x7fc96815ac00 2023-08-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.208+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c009400 con 0x7fc96815ac00 2023-08-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.208+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960012910 con 0x7fc96815ac00 2023-08-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.208+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680af3b0 con 0x7fc96815ac00 2023-08-10T10:51:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.209+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9680b18b0 con 0x7fc96815ac00 2023-08-10T10:51:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.210+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc960012a70 con 0x7fc96815ac00 2023-08-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.211+0000 7fc956ffd640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 0x7fc94806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.211+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc9600899b0 con 0x7fc96815ac00 2023-08-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.211+0000 7fc96659c640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 0x7fc94806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.212+0000 7fc96659c640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 0x7fc94806d110 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc9680c24d0 tx=0x7fc958008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.217+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9680b18b0 con 0x7fc96815ac00 2023-08-10T10:51:49.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.406+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc9680b18b0 con 0x7fc96815ac00 2023-08-10T10:51:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.569+0000 7fc956ffd640 1 -- 172.21.15.50:0/2752659762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v185) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc9680b18b0 con 0x7fc96815ac00 2023-08-10T10:51:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-08-10T10:51:49.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 msgr2=0x7fc94806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 0x7fc94806d110 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc9680c24d0 tx=0x7fc958008040 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 msgr2=0x7fc9680c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc960001830 tx=0x7fc96000a430 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 shutdown_connections 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96815ac00 0x7fc9680c3190 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815a820 0x7fc9680c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc94806ac50 0x7fc94806d110 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 --2- 172.21.15.50:0/2752659762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9680b40e0 0x7fc9680c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.579+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 >> 172.21.15.50:0/2752659762 conn(0x7fc9680b08e0 msgr2=0x7fc96815d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.580+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 shutdown_connections 2023-08-10T10:51:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.580+0000 7fc96cbc2640 1 -- 172.21.15.50:0/2752659762 wait complete. 2023-08-10T10:51:49.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:51:49.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.826+0000 7f5d55fb2640 1 Processor -- start 2023-08-10T10:51:49.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.826+0000 7f5d55fb2640 1 -- start start 2023-08-10T10:51:49.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d55fb2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d500b1b00 0x7f5d500cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d55fb2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5015d050 con 0x7f5d5015cc70 2023-08-10T10:51:49.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d55fb2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d50069a80 con 0x7f5d500d1d90 2023-08-10T10:51:49.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d55fb2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5006b230 con 0x7f5d500b1b00 2023-08-10T10:51:49.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d54fb0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d5015cc70 0x7f5d5006ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56694/0 (socket says 172.21.15.50:56694) 2023-08-10T10:51:49.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.828+0000 7f5d54fb0640 1 -- 172.21.15.50:0/2660145562 learned_addr learned my addr 172.21.15.50:0/2660145562 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:49.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d47fff640 1 --2- 172.21.15.50:0/2660145562 >> v2:172.21.15.117:3300/0 conn(0x7f5d500b1b00 0x7f5d500cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913385757 0 0) 0x7f5d5015d050 con 0x7f5d5015cc70 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d38003520 con 0x7f5d5015cc70 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484736644 0 0) 0x7f5d38003520 con 0x7f5d5015cc70 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 >> v2:172.21.15.117:3300/0 conn(0x7f5d500b1b00 msgr2=0x7f5d500cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 --2- 172.21.15.50:0/2660145562 >> v2:172.21.15.117:3300/0 conn(0x7f5d500b1b00 0x7f5d500cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 >> v1:172.21.15.117:6789/0 conn(0x7f5d500d1d90 legacy=0x7f5d500b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50069d60 con 0x7f5d5015cc70 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f5d4c001670 con 0x7f5d5015cc70 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 >> v1:172.21.15.50:6789/0 conn(0x7f5d5015cc70 legacy=0x7f5d5006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380039e0 0x7f5d38003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 0x7f5d38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d38005180 0x7f5d3800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5006b230 con 0x7f5d380047c0 2023-08-10T10:51:49.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3800c0b0 con 0x7f5d380039e0 2023-08-10T10:51:49.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.829+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3800c270 con 0x7f5d38005180 2023-08-10T10:51:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 0x7f5d38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d54fb0640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380039e0 0x7f5d38003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d557b1640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d38005180 0x7f5d3800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 -- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d38005180 msgr2=0x7f5d3800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d38005180 0x7f5d3800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 -- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380039e0 msgr2=0x7f5d38003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380039e0 0x7f5d38003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d47fff640 1 -- 172.21.15.50:0/2660145562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38003520 con 0x7f5d380047c0 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.830+0000 7f5d557b1640 1 -- 172.21.15.50:0/2660145562 reap_dead start 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.832+0000 7f5d47fff640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 0x7f5d38004c40 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009a90 tx=0x7f5d380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a6763d78a13a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.832+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4002c680 con 0x7f5d380047c0 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.832+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4002c7e0 con 0x7f5d380047c0 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.832+0000 7f5d477fe640 1 -- 172.21.15.50:0/2660145562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4002cb70 con 0x7f5d380047c0 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 -- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 msgr2=0x7f5d38004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 0x7f5d38004c40 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009a90 tx=0x7f5d380057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 -- 172.21.15.50:0/2660145562 shutdown_connections 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/2660145562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d380047c0 0x7f5d38004c40 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 -- 172.21.15.50:0/2660145562 >> 172.21.15.50:0/2660145562 conn(0x7f5d500d28e0 msgr2=0x7f5d500d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 -- 172.21.15.50:0/2660145562 shutdown_connections 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.833+0000 7f5d55fb2640 1 -- 172.21.15.50:0/2660145562 wait complete. 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.835+0000 7f5d55fb2640 1 Processor -- start 2023-08-10T10:51:49.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.835+0000 7f5d55fb2640 1 -- start start 2023-08-10T10:51:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380047c0 0x7f5d5015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d500d08d0 0x7f5d500d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500d1290 con 0x7f5d500cc000 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5015b5c0 con 0x7f5d380047c0 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d55fb2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5015d050 con 0x7f5d500d08d0 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42496/0 (socket says 172.21.15.50:42496) 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d47fff640 1 -- 172.21.15.50:0/796743461 learned_addr learned my addr 172.21.15.50:0/796743461 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:49.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d54fb0640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380047c0 0x7f5d5015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.836+0000 7f5d557b1640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d500d08d0 0x7f5d500d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 -- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d500d08d0 msgr2=0x7f5d500d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d500d08d0 0x7f5d500d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 -- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380047c0 msgr2=0x7f5d5015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380047c0 0x7f5d5015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 -- 172.21.15.50:0/796743461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5015d330 con 0x7f5d500cc000 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d47fff640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f5d40037040 tx=0x7f5d40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40003810 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40003970 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40003d20 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.837+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5015d610 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.838+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5015dbd0 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.839+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50066e30 con 0x7f5d500cc000 2023-08-10T10:51:49.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.840+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d40034440 con 0x7f5d500cc000 2023-08-10T10:51:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.841+0000 7f5d457fa640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 0x7f5d3c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.841+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5d400ab2a0 con 0x7f5d500cc000 2023-08-10T10:51:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.841+0000 7f5d54fb0640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 0x7f5d3c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:49.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.842+0000 7f5d54fb0640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 0x7f5d3c06d140 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0059d0 tx=0x7f5d4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:49.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:49.846+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5d400766f0 con 0x7f5d500cc000 2023-08-10T10:51:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.041+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5d500d2450 con 0x7f5d500cc000 2023-08-10T10:51:50.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.586+0000 7f5d457fa640 1 -- 172.21.15.50:0/796743461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v186) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5d40079d10 con 0x7f5d500cc000 2023-08-10T10:51:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-08-10T10:51:50.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.596+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 msgr2=0x7f5d3c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.596+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 0x7f5d3c06d140 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0059d0 tx=0x7f5d4c009040 comp rx=0 tx=0).stop 2023-08-10T10:51:50.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.596+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 msgr2=0x7f5d500cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.596+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f5d40037040 tx=0x7f5d40004730 comp rx=0 tx=0).stop 2023-08-10T10:51:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.597+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 shutdown_connections 2023-08-10T10:51:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.597+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d500d08d0 0x7f5d500d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.598+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d500cc000 0x7f5d500cc480 secure :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f5d40037040 tx=0x7f5d40004730 comp rx=0 tx=0).stop 2023-08-10T10:51:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.598+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f5d3c06ac80 0x7f5d3c06d140 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.598+0000 7f5d55fb2640 1 --2- 172.21.15.50:0/796743461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380047c0 0x7f5d5015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.598+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 >> 172.21.15.50:0/796743461 conn(0x7f5d500d28e0 msgr2=0x7f5d500b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:50.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.602+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 shutdown_connections 2023-08-10T10:51:50.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.604+0000 7f5d55fb2640 1 -- 172.21.15.50:0/796743461 wait complete. 2023-08-10T10:51:50.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:51:50.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.833+0000 7fe715438640 1 Processor -- start 2023-08-10T10:51:50.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.833+0000 7fe715438640 1 -- start start 2023-08-10T10:51:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe715438640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7100cd9b0 0x7fe7100b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe715438640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe7100ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe715438640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100adcb0 con 0x7fe71015ae40 2023-08-10T10:51:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe715438640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71006c320 con 0x7fe7100cd9b0 2023-08-10T10:51:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe715438640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006b770 con 0x7fe71006cb30 2023-08-10T10:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe70effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe71015ae40 0x7fe7100cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56704/0 (socket says 172.21.15.50:56704) 2023-08-10T10:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.835+0000 7fe70effd640 1 -- 172.21.15.50:0/420980211 learned_addr learned my addr 172.21.15.50:0/420980211 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe7100ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70e7fc640 1 --2- 172.21.15.50:0/420980211 >> v2:172.21.15.117:3300/0 conn(0x7fe7100cd9b0 0x7fe7100b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943010537 0 0) 0x7fe7100adcb0 con 0x7fe71015ae40 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f8003520 con 0x7fe71015ae40 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164548719 0 0) 0x7fe6f8003520 con 0x7fe71015ae40 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 msgr2=0x7fe7100ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe7100ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 >> v2:172.21.15.117:3300/0 conn(0x7fe7100cd9b0 msgr2=0x7fe7100b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 --2- 172.21.15.50:0/420980211 >> v2:172.21.15.117:3300/0 conn(0x7fe7100cd9b0 0x7fe7100b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71006b9f0 con 0x7fe71015ae40 2023-08-10T10:51:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.836+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fe700001670 con 0x7fe71015ae40 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 >> v1:172.21.15.50:6789/0 conn(0x7fe71015ae40 legacy=0x7fe7100cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe6f8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f8003ef0 0x7fe6f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f8004d00 0x7fe6f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006c320 con 0x7fe6f8004d00 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006b770 con 0x7fe6f8003ef0 2023-08-10T10:51:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f800b980 con 0x7fe71006cb30 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f8004d00 0x7fe6f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70effd640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe6f8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70e7fc640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f8003ef0 0x7fe6f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 -- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 msgr2=0x7fe6f8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe71006cb30 0x7fe6f8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 -- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f8003ef0 msgr2=0x7fe6f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f8003ef0 0x7fe6f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70f7fe640 1 -- 172.21.15.50:0/420980211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8003520 con 0x7fe6f8004d00 2023-08-10T10:51:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.837+0000 7fe70e7fc640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f8003ef0 0x7fe6f80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f8004d00 0x7fe6f8005180 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fe7100b0d80 tx=0x7fe6f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4161e8b48062eb57 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70802cb90 con 0x7fe6f8004d00 2023-08-10T10:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800f040 con 0x7fe6f8004d00 2023-08-10T10:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe70dffb640 1 -- 172.21.15.50:0/420980211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708034440 con 0x7fe6f8004d00 2023-08-10T10:51:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe715438640 1 -- 172.21.15.50:0/420980211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f8004d00 msgr2=0x7fe6f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe715438640 1 --2- 172.21.15.50:0/420980211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f8004d00 0x7fe6f8005180 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fe7100b0d80 tx=0x7fe6f80057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.839+0000 7fe70f7fe640 1 -- 172.21.15.50:0/420980211 reap_dead start 2023-08-10T10:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.840+0000 7fe715438640 1 -- 172.21.15.50:0/420980211 shutdown_connections 2023-08-10T10:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.840+0000 7fe715438640 1 -- 172.21.15.50:0/420980211 >> 172.21.15.50:0/420980211 conn(0x7fe7100b01b0 msgr2=0x7fe7100b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.840+0000 7fe715438640 1 -- 172.21.15.50:0/420980211 shutdown_connections 2023-08-10T10:51:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.840+0000 7fe715438640 1 -- 172.21.15.50:0/420980211 wait complete. 2023-08-10T10:51:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.842+0000 7fe715438640 1 Processor -- start 2023-08-10T10:51:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.842+0000 7fe715438640 1 -- start start 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f8004d00 0x7fe7101e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7101e4830 0x7fe71006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710070a50 con 0x7fe71006f8f0 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006ef20 con 0x7fe7101e4830 2023-08-10T10:51:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe715438640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101e5370 con 0x7fe6f8004d00 2023-08-10T10:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42522/0 (socket says 172.21.15.50:42522) 2023-08-10T10:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe70f7fe640 1 -- 172.21.15.50:0/841627963 learned_addr learned my addr 172.21.15.50:0/841627963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.843+0000 7fe70effd640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f8004d00 0x7fe7101e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70e7fc640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7101e4830 0x7fe71006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 -- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f8004d00 msgr2=0x7fe7101e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f8004d00 0x7fe7101e42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 -- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7101e4830 msgr2=0x7fe71006f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7101e4830 0x7fe71006f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 -- 172.21.15.50:0/841627963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7101e4db0 con 0x7fe71006f8f0 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe70f7fe640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fe708037040 tx=0x7fe708009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708034d50 con 0x7fe71006f8f0 2023-08-10T10:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70802ce10 con 0x7fe71006f8f0 2023-08-10T10:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70803e660 con 0x7fe71006f8f0 2023-08-10T10:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.844+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7101e5090 con 0x7fe71006f8f0 2023-08-10T10:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.845+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71014dc60 con 0x7fe71006f8f0 2023-08-10T10:51:50.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.846+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7100c1f80 con 0x7fe71006f8f0 2023-08-10T10:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.847+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe70803e7c0 con 0x7fe71006f8f0 2023-08-10T10:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.848+0000 7fe6f77fe640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 0x7fe6fc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.848+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe7080ab370 con 0x7fe71006f8f0 2023-08-10T10:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.848+0000 7fe70effd640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 0x7fe6fc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.849+0000 7fe70effd640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 0x7fe6fc06d110 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe700001050 tx=0x7fe700009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:50.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:50.852+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe708076470 con 0x7fe71006f8f0 2023-08-10T10:51:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.083+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7100612b0 con 0x7fe71006f8f0 2023-08-10T10:51:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.626+0000 7fe6f77fe640 1 -- 172.21.15.50:0/841627963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v90) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe708079a90 con 0x7fe71006f8f0 2023-08-10T10:51:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 23 and data pool 24 2023-08-10T10:51:51.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.631+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 msgr2=0x7fe6fc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.631+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 0x7fe6fc06d110 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe700001050 tx=0x7fe700009040 comp rx=0 tx=0).stop 2023-08-10T10:51:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.631+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 msgr2=0x7fe710154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.631+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fe708037040 tx=0x7fe708009750 comp rx=0 tx=0).stop 2023-08-10T10:51:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.632+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 shutdown_connections 2023-08-10T10:51:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.632+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe71006f8f0 0x7fe710154fe0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.633+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe6fc06ac50 0x7fe6fc06d110 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.633+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7101e4830 0x7fe71006f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.633+0000 7fe715438640 1 --2- 172.21.15.50:0/841627963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f8004d00 0x7fe7101e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.633+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 >> 172.21.15.50:0/841627963 conn(0x7fe7100b01b0 msgr2=0x7fe71014fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.637+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 shutdown_connections 2023-08-10T10:51:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.637+0000 7fe715438640 1 -- 172.21.15.50:0/841627963 wait complete. 2023-08-10T10:51:51.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:51.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.848+0000 7facb541a640 1 Processor -- start 2023-08-10T10:51:51.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.848+0000 7facb541a640 1 -- start start 2023-08-10T10:51:51.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facb541a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7facb0165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facb541a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00b1f10 con 0x7facb015a940 2023-08-10T10:51:51.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facb541a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb015e7d0 con 0x7facb00b0620 2023-08-10T10:51:51.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facb541a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00b21f0 con 0x7facb015f2b0 2023-08-10T10:51:51.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facaffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7facb015a940 0x7facb00aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56712/0 (socket says 172.21.15.50:56712) 2023-08-10T10:51:51.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.850+0000 7facaffff640 1 -- 172.21.15.50:0/3092887727 learned_addr learned my addr 172.21.15.50:0/3092887727 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:51.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140901136 0 0) 0x7facb00b1f10 con 0x7facb015a940 2023-08-10T10:51:51.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facb4c19640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7facb0165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9c003520 con 0x7facb015a940 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909457245 0 0) 0x7fac9c003520 con 0x7facb015a940 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 msgr2=0x7facb0165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7facb0165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 >> v1:172.21.15.117:6789/0 conn(0x7facb00b0620 legacy=0x7facb00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb015eab0 con 0x7facb015a940 2023-08-10T10:51:51.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7faca0001670 con 0x7facb015a940 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 >> v1:172.21.15.50:6789/0 conn(0x7facb015a940 legacy=0x7facb00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.851+0000 7facaf7fe640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c003a10 0x7fac9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaf7fe640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7fac9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaf7fe640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c004d00 0x7fac9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00bb10 con 0x7fac9c004d00 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00bc50 con 0x7fac9c003a10 2023-08-10T10:51:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00be10 con 0x7facb015f2b0 2023-08-10T10:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c004d00 0x7fac9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7faca7fff640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7fac9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facaffff640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c003a10 0x7fac9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 -- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 msgr2=0x7fac9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb015f2b0 0x7fac9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 -- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c003a10 msgr2=0x7fac9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c003a10 0x7fac9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.852+0000 7facb4c19640 1 -- 172.21.15.50:0/3092887727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c003520 con 0x7fac9c004d00 2023-08-10T10:51:51.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.853+0000 7facb4c19640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c004d00 0x7fac9c005180 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7faca8009f90 tx=0x7fac9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e852d9a28d54d0ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:51.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca802cbd0 con 0x7fac9c004d00 2023-08-10T10:51:51.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800f040 con 0x7fac9c004d00 2023-08-10T10:51:51.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facaf7fe640 1 -- 172.21.15.50:0/3092887727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8034440 con 0x7fac9c004d00 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb541a640 1 -- 172.21.15.50:0/3092887727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c004d00 msgr2=0x7fac9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb541a640 1 --2- 172.21.15.50:0/3092887727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac9c004d00 0x7fac9c005180 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7faca8009f90 tx=0x7fac9c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb4c19640 1 -- 172.21.15.50:0/3092887727 reap_dead start 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb541a640 1 -- 172.21.15.50:0/3092887727 shutdown_connections 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb541a640 1 -- 172.21.15.50:0/3092887727 >> 172.21.15.50:0/3092887727 conn(0x7facb006ab80 msgr2=0x7facb006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.854+0000 7facb541a640 1 -- 172.21.15.50:0/3092887727 shutdown_connections 2023-08-10T10:51:51.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.855+0000 7facb541a640 1 -- 172.21.15.50:0/3092887727 wait complete. 2023-08-10T10:51:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.856+0000 7facb541a640 1 Processor -- start 2023-08-10T10:51:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.856+0000 7facb541a640 1 -- start start 2023-08-10T10:51:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 0x7facb0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb00c5e20 0x7facb006f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0070110 con 0x7facb006fc90 2023-08-10T10:51:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0070a70 con 0x7fac9c004d00 2023-08-10T10:51:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.857+0000 7facb541a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00cdf30 con 0x7facb00c5e20 2023-08-10T10:51:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42548/0 (socket says 172.21.15.50:42548) 2023-08-10T10:51:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 -- 172.21.15.50:0/2590043526 learned_addr learned my addr 172.21.15.50:0/2590043526 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7faca7fff640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb00c5e20 0x7facb006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facaffff640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 0x7facb0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 -- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb00c5e20 msgr2=0x7facb006f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb00c5e20 0x7facb006f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 -- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 msgr2=0x7facb0156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 0x7facb0156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facb4c19640 1 -- 172.21.15.50:0/2590043526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00704b0 con 0x7facb006fc90 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.858+0000 7facaffff640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 0x7facb0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facb4c19640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7faca8037040 tx=0x7faca8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8034d50 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8003990 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8003d20 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0070790 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.859+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb00c5a90 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.860+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb00cda20 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.862+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faca8004030 con 0x7facb006fc90 2023-08-10T10:51:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.862+0000 7facad7fa640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 0x7fac9006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.863+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faca80aac70 con 0x7facb006fc90 2023-08-10T10:51:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.863+0000 7facaffff640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 0x7fac9006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.863+0000 7facaffff640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 0x7fac9006d110 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faca0000f60 tx=0x7faca0000ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:51.867+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7facb00cda20 con 0x7facb006fc90 2023-08-10T10:51:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.061+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facb00cda20 con 0x7facb006fc90 2023-08-10T10:51:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.065+0000 7facad7fa640 1 -- 172.21.15.50:0/2590043526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+18296 (secure 0 0 0) 0x7facb00cda20 con 0x7facb006fc90 2023-08-10T10:51:52.067 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:52.067 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":187,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:51.084747+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 msgr2=0x7fac9006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 0x7fac9006d110 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faca0000f60 tx=0x7faca0000ef0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 msgr2=0x7facb00acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7faca8037040 tx=0x7faca8009750 comp rx=0 tx=0).stop 2023-08-10T10:51:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 shutdown_connections 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb006fc90 0x7facb00acb40 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb00c5e20 0x7facb006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fac9006ac50 0x7fac9006d110 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 --2- 172.21.15.50:0/2590043526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac9c004d00 0x7facb0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 >> 172.21.15.50:0/2590043526 conn(0x7facb006ab80 msgr2=0x7facb00c8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 shutdown_connections 2023-08-10T10:51:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.068+0000 7facb541a640 1 -- 172.21.15.50:0/2590043526 wait complete. 2023-08-10T10:51:52.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:52.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.309+0000 7f954c731640 1 Processor -- start 2023-08-10T10:51:52.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.310+0000 7f954c731640 1 -- start start 2023-08-10T10:51:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.311+0000 7f954c731640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 0x7f95440c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.311+0000 7f954c731640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95440b3f30 0x7f95440c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.311+0000 7f954c731640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9544071c70 con 0x7f954415aa40 2023-08-10T10:51:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.311+0000 7f954c731640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440713d0 con 0x7f95440b3f30 2023-08-10T10:51:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.311+0000 7f954c731640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440716b0 con 0x7f95440b0c60 2023-08-10T10:51:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95440b3f30 0x7f95440c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95440b3f30 0x7f95440c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42554/0 (socket says 172.21.15.50:42554) 2023-08-10T10:51:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 -- 172.21.15.50:0/928247120 learned_addr learned my addr 172.21.15.50:0/928247120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f9549ccc640 1 --2- 172.21.15.50:0/928247120 >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 0x7f95440c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 -- 172.21.15.50:0/928247120 >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 msgr2=0x7f95440c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 --2- 172.21.15.50:0/928247120 >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 0x7f95440c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 -- 172.21.15.50:0/928247120 >> v1:172.21.15.117:6789/0 conn(0x7f954415aa40 legacy=0x7f95440b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f954acce640 1 -- 172.21.15.50:0/928247120 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544071990 con 0x7f95440b3f30 2023-08-10T10:51:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.312+0000 7f9549ccc640 1 --2- 172.21.15.50:0/928247120 >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 0x7f95440c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.314+0000 7f954acce640 1 --2- 172.21.15.50:0/928247120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b3f30 0x7f95440c9e60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f954415e6e0 tx=0x7f953c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b64a94ccdbd703 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.314+0000 7f95494cb640 1 -- 172.21.15.50:0/928247120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0317e0 con 0x7f95440b3f30 2023-08-10T10:51:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.314+0000 7f95494cb640 1 -- 172.21.15.50:0/928247120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c031940 con 0x7f95440b3f30 2023-08-10T10:51:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.314+0000 7f95494cb640 1 -- 172.21.15.50:0/928247120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c031cd0 con 0x7f95440b3f30 2023-08-10T10:51:52.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 -- 172.21.15.50:0/928247120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b3f30 msgr2=0x7f95440c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 --2- 172.21.15.50:0/928247120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b3f30 0x7f95440c9e60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f954415e6e0 tx=0x7f953c02b880 comp rx=0 tx=0).stop 2023-08-10T10:51:52.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 -- 172.21.15.50:0/928247120 shutdown_connections 2023-08-10T10:51:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 --2- 172.21.15.50:0/928247120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b3f30 0x7f95440c9e60 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 --2- 172.21.15.50:0/928247120 >> v2:172.21.15.117:3300/0 conn(0x7f95440b0c60 0x7f95440c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 -- 172.21.15.50:0/928247120 >> 172.21.15.50:0/928247120 conn(0x7f954406b590 msgr2=0x7f95440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 -- 172.21.15.50:0/928247120 shutdown_connections 2023-08-10T10:51:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.315+0000 7f954c731640 1 -- 172.21.15.50:0/928247120 wait complete. 2023-08-10T10:51:52.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.317+0000 7f954c731640 1 Processor -- start 2023-08-10T10:51:52.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.318+0000 7f954c731640 1 -- start start 2023-08-10T10:51:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95440b3f30 0x7f9544151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 0x7f95440cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544155910 con 0x7f95440b0c60 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954415cbd0 con 0x7f95440b3f30 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954c731640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954415b8d0 con 0x7f954415aa40 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954a4cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954a4cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42558/0 (socket says 172.21.15.50:42558) 2023-08-10T10:51:52.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.319+0000 7f954a4cd640 1 -- 172.21.15.50:0/3496443657 learned_addr learned my addr 172.21.15.50:0/3496443657 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954acce640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 0x7f95440cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 -- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 msgr2=0x7f95440cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 0x7f95440cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f9549ccc640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95440b3f30 0x7f9544151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 -- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95440b3f30 msgr2=0x7f9544151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95440b3f30 0x7f9544151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 -- 172.21.15.50:0/3496443657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0094d0 con 0x7f95440b0c60 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954acce640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 0x7f95440cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f954a4cd640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f954000ba80 tx=0x7f954000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000cc00 con 0x7f95440b0c60 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954000cd60 con 0x7f95440b0c60 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.320+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540003bb0 con 0x7f95440b0c60 2023-08-10T10:51:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.321+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954415bbb0 con 0x7f95440b0c60 2023-08-10T10:51:52.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.321+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954415c170 con 0x7f95440b0c60 2023-08-10T10:51:52.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.322+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954404e270 con 0x7f95440b0c60 2023-08-10T10:51:52.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.323+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9540014440 con 0x7f95440b0c60 2023-08-10T10:51:52.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.324+0000 7f953affd640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 0x7f952806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.324+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9540089300 con 0x7f95440b0c60 2023-08-10T10:51:52.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.325+0000 7f9549ccc640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 0x7f952806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.325+0000 7f9549ccc640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 0x7f952806d110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f95441f1a70 tx=0x7f9534008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.329+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f95400543a0 con 0x7f95440b0c60 2023-08-10T10:51:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.530+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95440c8b80 con 0x7f95440b0c60 2023-08-10T10:51:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.533+0000 7f953affd640 1 -- 172.21.15.50:0/3496443657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+18296 (secure 0 0 0) 0x7f95400579c0 con 0x7f95440b0c60 2023-08-10T10:51:52.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:52.536 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":187,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:51.084747+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 msgr2=0x7f952806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 0x7f952806d110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f95441f1a70 tx=0x7f9534008040 comp rx=0 tx=0).stop 2023-08-10T10:51:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 msgr2=0x7f954415c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f954000ba80 tx=0x7f954000bf40 comp rx=0 tx=0).stop 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 shutdown_connections 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f954415aa40 0x7f95440cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f952806ac50 0x7f952806d110 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95440b3f30 0x7f9544151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 --2- 172.21.15.50:0/3496443657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95440b0c60 0x7f954415c690 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 >> 172.21.15.50:0/3496443657 conn(0x7f954406b590 msgr2=0x7f95440b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.536+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 shutdown_connections 2023-08-10T10:51:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.537+0000 7f954c731640 1 -- 172.21.15.50:0/3496443657 wait complete. 2023-08-10T10:51:52.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:51:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.789+0000 7f0eba96d640 1 Processor -- start 2023-08-10T10:51:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.789+0000 7f0eba96d640 1 -- start start 2023-08-10T10:51:52.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba96d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eb40d2fc0 0x7f0eb4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba96d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb4160370 con 0x7f0eb415ff90 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba96d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb40d0d90 con 0x7f0eb40cd960 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba96d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40d0b90 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba16c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eb40d2fc0 0x7f0eb4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba16c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eb40d2fc0 0x7f0eb4160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42570/0 (socket says 172.21.15.50:42570) 2023-08-10T10:51:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.791+0000 7f0eba16c640 1 -- 172.21.15.50:0/1554618310 learned_addr learned my addr 172.21.15.50:0/1554618310 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.792+0000 7f0eba16c640 1 -- 172.21.15.50:0/1554618310 >> v1:172.21.15.117:6789/0 conn(0x7f0eb40cd960 legacy=0x7f0eb40d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.792+0000 7f0eba16c640 1 -- 172.21.15.50:0/1554618310 >> v1:172.21.15.50:6789/0 conn(0x7f0eb415ff90 legacy=0x7f0eb40d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.792+0000 7f0eba16c640 1 -- 172.21.15.50:0/1554618310 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40d1070 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.793+0000 7f0eba16c640 1 --2- 172.21.15.50:0/1554618310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb4160f90 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009e50 tx=0x7f0eac02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e6d7fe2945296e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.793+0000 7f0eb8969640 1 -- 172.21.15.50:0/1554618310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac02cb10 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.793+0000 7f0eb8969640 1 -- 172.21.15.50:0/1554618310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac02cc70 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.793+0000 7f0eb8969640 1 -- 172.21.15.50:0/1554618310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0343f0 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 -- 172.21.15.50:0/1554618310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb40d2fc0 msgr2=0x7f0eb4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 --2- 172.21.15.50:0/1554618310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb4160f90 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009e50 tx=0x7f0eac02bf70 comp rx=0 tx=0).stop 2023-08-10T10:51:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 -- 172.21.15.50:0/1554618310 shutdown_connections 2023-08-10T10:51:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 --2- 172.21.15.50:0/1554618310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb4160f90 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 -- 172.21.15.50:0/1554618310 >> 172.21.15.50:0/1554618310 conn(0x7f0eb4069ac0 msgr2=0x7f0eb4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 -- 172.21.15.50:0/1554618310 shutdown_connections 2023-08-10T10:51:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.794+0000 7f0eba96d640 1 -- 172.21.15.50:0/1554618310 wait complete. 2023-08-10T10:51:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.796+0000 7f0eba96d640 1 Processor -- start 2023-08-10T10:51:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.796+0000 7f0eba96d640 1 -- start start 2023-08-10T10:51:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb40cd960 0x7f0eb41e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb40b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40b50c0 con 0x7f0eb415ff90 2023-08-10T10:51:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40b2360 con 0x7f0eb40d2fc0 2023-08-10T10:51:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.797+0000 7f0eba96d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40b2640 con 0x7f0eb40cd960 2023-08-10T10:51:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42578/0 (socket says 172.21.15.50:42578) 2023-08-10T10:51:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 -- 172.21.15.50:0/3263540843 learned_addr learned my addr 172.21.15.50:0/3263540843 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eb916a640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb40b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eb996b640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb40cd960 0x7f0eb41e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 -- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb40cd960 msgr2=0x7f0eb41e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb40cd960 0x7f0eb41e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 -- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb40d2fc0 msgr2=0x7f0eb40b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb40b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.798+0000 7f0eba16c640 1 -- 172.21.15.50:0/3263540843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac009b30 con 0x7f0eb415ff90 2023-08-10T10:51:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eba16c640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0eac036040 tx=0x7f0eac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac03e450 con 0x7f0eb415ff90 2023-08-10T10:51:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac03e5d0 con 0x7f0eb415ff90 2023-08-10T10:51:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac03e980 con 0x7f0eb415ff90 2023-08-10T10:51:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb40b2920 con 0x7f0eb415ff90 2023-08-10T10:51:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.799+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb40b2ee0 con 0x7f0eb415ff90 2023-08-10T10:51:52.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.800+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4066e30 con 0x7f0eb415ff90 2023-08-10T10:51:52.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.801+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0eac03eae0 con 0x7f0eb415ff90 2023-08-10T10:51:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.802+0000 7f0eaa7fc640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 0x7f0e9806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.802+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0eac0ac390 con 0x7f0eb415ff90 2023-08-10T10:51:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.802+0000 7f0eb996b640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 0x7f0e9806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.803+0000 7f0eb996b640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 0x7f0e9806d110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000f60 tx=0x7f0eb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:52.807+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0eac0774e0 con 0x7f0eb415ff90 2023-08-10T10:51:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.039+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0eb40b30d0 con 0x7f0eb415ff90 2023-08-10T10:51:53.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.631+0000 7f0eaa7fc640 1 -- 172.21.15.50:0/3263540843 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0eac07ab00 con 0x7f0eb415ff90 2023-08-10T10:51:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 msgr2=0x7f0e9806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 0x7f0e9806d110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000f60 tx=0x7f0eb0009040 comp rx=0 tx=0).stop 2023-08-10T10:51:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 msgr2=0x7f0eb40caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0eac036040 tx=0x7f0eac004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 shutdown_connections 2023-08-10T10:51:53.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eb415ff90 0x7f0eb40caa40 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0e9806ac50 0x7f0e9806d110 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb40d2fc0 0x7f0eb40b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 --2- 172.21.15.50:0/3263540843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb40cd960 0x7f0eb41e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 >> 172.21.15.50:0/3263540843 conn(0x7f0eb4069ac0 msgr2=0x7f0eb40c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 shutdown_connections 2023-08-10T10:51:53.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.635+0000 7f0eba96d640 1 -- 172.21.15.50:0/3263540843 wait complete. 2023-08-10T10:51:53.659 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-10T10:51:53.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:51:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.895+0000 7faade796640 1 Processor -- start 2023-08-10T10:51:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.895+0000 7faade796640 1 -- start start 2023-08-10T10:51:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.896+0000 7faade796640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faad8159c10 0x7faad80b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.896+0000 7faade796640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad80ca530 0x7faad806a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.896+0000 7faade796640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80adf40 con 0x7faad80ada90 2023-08-10T10:51:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.896+0000 7faade796640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad806ebb0 con 0x7faad80ca530 2023-08-10T10:51:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.896+0000 7faade796640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad806ee90 con 0x7faad8159c10 2023-08-10T10:51:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad80ca530 0x7faad806a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad80ca530 0x7faad806a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42582/0 (socket says 172.21.15.50:42582) 2023-08-10T10:51:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 -- 172.21.15.50:0/2057003955 learned_addr learned my addr 172.21.15.50:0/2057003955 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faad77fe640 1 --1- 172.21.15.50:0/2057003955 >> v1:172.21.15.50:6789/0 conn(0x7faad80ada90 0x7faad80c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56736/0 (socket says 172.21.15.50:56736) 2023-08-10T10:51:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faad7fff640 1 --2- 172.21.15.50:0/2057003955 >> v2:172.21.15.117:3300/0 conn(0x7faad8159c10 0x7faad80b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 -- 172.21.15.50:0/2057003955 >> v2:172.21.15.117:3300/0 conn(0x7faad8159c10 msgr2=0x7faad80b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 --2- 172.21.15.50:0/2057003955 >> v2:172.21.15.117:3300/0 conn(0x7faad8159c10 0x7faad80b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 -- 172.21.15.50:0/2057003955 >> v1:172.21.15.50:6789/0 conn(0x7faad80ada90 legacy=0x7faad80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faad6ffd640 1 -- 172.21.15.50:0/2057003955 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941780774 0 0) 0x7faad80adf40 con 0x7faad80ada90 2023-08-10T10:51:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.897+0000 7faadcd33640 1 -- 172.21.15.50:0/2057003955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad806f170 con 0x7faad80ca530 2023-08-10T10:51:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.898+0000 7faadcd33640 1 --2- 172.21.15.50:0/2057003955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ca530 0x7faad806a6e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7faad80734e0 tx=0x7faad002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa7f329d7fea084 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.899+0000 7faad6ffd640 1 -- 172.21.15.50:0/2057003955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0031890 con 0x7faad80ca530 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.899+0000 7faad6ffd640 1 -- 172.21.15.50:0/2057003955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad00319f0 con 0x7faad80ca530 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.899+0000 7faad6ffd640 1 -- 172.21.15.50:0/2057003955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0031d80 con 0x7faad80ca530 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.899+0000 7faade796640 1 -- 172.21.15.50:0/2057003955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ca530 msgr2=0x7faad806a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.899+0000 7faade796640 1 --2- 172.21.15.50:0/2057003955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ca530 0x7faad806a6e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7faad80734e0 tx=0x7faad002b930 comp rx=0 tx=0).stop 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 -- 172.21.15.50:0/2057003955 shutdown_connections 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 --2- 172.21.15.50:0/2057003955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ca530 0x7faad806a6e0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 --2- 172.21.15.50:0/2057003955 >> v2:172.21.15.117:3300/0 conn(0x7faad8159c10 0x7faad80b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 -- 172.21.15.50:0/2057003955 >> 172.21.15.50:0/2057003955 conn(0x7faad80b01b0 msgr2=0x7faad80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 -- 172.21.15.50:0/2057003955 shutdown_connections 2023-08-10T10:51:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.900+0000 7faade796640 1 -- 172.21.15.50:0/2057003955 wait complete. 2023-08-10T10:51:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.901+0000 7faade796640 1 Processor -- start 2023-08-10T10:51:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.902+0000 7faade796640 1 -- start start 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.902+0000 7faade796640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.902+0000 7faade796640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad80ca530 0x7faad80ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faade796640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad8159c10 0x7faad80aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faade796640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8156250 con 0x7faad80ada90 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faade796640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8156530 con 0x7faad8159c10 2023-08-10T10:51:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faade796640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad8156810 con 0x7faad80ca530 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42588/0 (socket says 172.21.15.50:42588) 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 -- 172.21.15.50:0/3951698053 learned_addr learned my addr 172.21.15.50:0/3951698053 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 -- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad80ca530 msgr2=0x7faad80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad80ca530 0x7faad80ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 -- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad8159c10 msgr2=0x7faad80aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad8159c10 0x7faad80aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.903+0000 7faad7fff640 1 -- 172.21.15.50:0/3951698053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00094d0 con 0x7faad80ada90 2023-08-10T10:51:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faad7fff640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7faac8007e40 tx=0x7faac800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8014620 con 0x7faad80ada90 2023-08-10T10:51:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800ee90 con 0x7faad80ada90 2023-08-10T10:51:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80149c0 con 0x7faad80ada90 2023-08-10T10:51:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad80b1310 con 0x7faad80ada90 2023-08-10T10:51:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.904+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad80b3bf0 con 0x7faad80ada90 2023-08-10T10:51:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.905+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80612b0 con 0x7faad80ada90 2023-08-10T10:51:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.906+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faac8014b20 con 0x7faad80ada90 2023-08-10T10:51:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.907+0000 7faad4ff9640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 0x7faac406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.908+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faac8089e90 con 0x7faad80ada90 2023-08-10T10:51:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.908+0000 7faad77fe640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 0x7faac406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.908+0000 7faad77fe640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 0x7faac406d140 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faacc007fd0 tx=0x7faacc007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:53.912+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faac8054ea0 con 0x7faad80ada90 2023-08-10T10:51:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.140+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faad8069840 con 0x7faad80ada90 2023-08-10T10:51:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.635+0000 7faad4ff9640 1 -- 172.21.15.50:0/3951698053 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7faac80584c0 con 0x7faad80ada90 2023-08-10T10:51:54.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.639+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 msgr2=0x7faac406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.639+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 0x7faac406d140 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faacc007fd0 tx=0x7faacc007920 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.639+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 msgr2=0x7faad80b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.639+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7faac8007e40 tx=0x7faac800e4b0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 shutdown_connections 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7faac406ac80 0x7faac406d140 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad8159c10 0x7faad80aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad80ca530 0x7faad80ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 --2- 172.21.15.50:0/3951698053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad80ada90 0x7faad80b36b0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 >> 172.21.15.50:0/3951698053 conn(0x7faad80b01b0 msgr2=0x7faad80cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 shutdown_connections 2023-08-10T10:51:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.640+0000 7faade796640 1 -- 172.21.15.50:0/3951698053 wait complete. 2023-08-10T10:51:54.663 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:51:54.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:54.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.901+0000 7fc74f11f640 1 Processor -- start 2023-08-10T10:51:54.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.901+0000 7fc74f11f640 1 -- start start 2023-08-10T10:51:54.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.902+0000 7fc74f11f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7480cae50 0x7fc7480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:54.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74f11f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480adfc0 con 0x7fc7480cc100 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74f11f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480ce790 con 0x7fc7481612b0 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74f11f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480cd0f0 con 0x7fc7480cae50 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7480cae50 0x7fc7480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7480cae50 0x7fc7480ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51678/0 (socket says 172.21.15.50:51678) 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74d6bc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7480cc100 0x7fc7480ac890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48364/0 (socket says 172.21.15.50:48364) 2023-08-10T10:51:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 -- 172.21.15.50:0/2669013314 learned_addr learned my addr 172.21.15.50:0/2669013314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 -- 172.21.15.50:0/2669013314 >> v1:172.21.15.117:6789/0 conn(0x7fc7481612b0 legacy=0x7fc7480cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 -- 172.21.15.50:0/2669013314 >> v1:172.21.15.50:6789/0 conn(0x7fc7480cc100 legacy=0x7fc7480ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.903+0000 7fc74cebb640 1 -- 172.21.15.50:0/2669013314 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748161790 con 0x7fc7480cae50 2023-08-10T10:51:54.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.905+0000 7fc74cebb640 1 --2- 172.21.15.50:0/2669013314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc7480ccbb0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc74402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6350676b5a2b540b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:54.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.905+0000 7fc73f7fe640 1 -- 172.21.15.50:0/2669013314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74402cb10 con 0x7fc7480cae50 2023-08-10T10:51:54.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.905+0000 7fc73f7fe640 1 -- 172.21.15.50:0/2669013314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74402cc70 con 0x7fc7480cae50 2023-08-10T10:51:54.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.905+0000 7fc73f7fe640 1 -- 172.21.15.50:0/2669013314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440343f0 con 0x7fc7480cae50 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 -- 172.21.15.50:0/2669013314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 msgr2=0x7fc7480ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 --2- 172.21.15.50:0/2669013314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc7480ccbb0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc74402bf70 comp rx=0 tx=0).stop 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 -- 172.21.15.50:0/2669013314 shutdown_connections 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 --2- 172.21.15.50:0/2669013314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc7480ccbb0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 -- 172.21.15.50:0/2669013314 >> 172.21.15.50:0/2669013314 conn(0x7fc7480cefe0 msgr2=0x7fc7480cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 -- 172.21.15.50:0/2669013314 shutdown_connections 2023-08-10T10:51:54.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.906+0000 7fc74f11f640 1 -- 172.21.15.50:0/2669013314 wait complete. 2023-08-10T10:51:54.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.908+0000 7fc74f11f640 1 Processor -- start 2023-08-10T10:51:54.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.908+0000 7fc74f11f640 1 -- start start 2023-08-10T10:51:54.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7480cc100 0x7fc74814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7481612b0 0x7fc74815f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74815e650 con 0x7fc7480cae50 2023-08-10T10:51:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74814f8c0 con 0x7fc7480cc100 2023-08-10T10:51:54.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74f11f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74815d750 con 0x7fc7481612b0 2023-08-10T10:51:54.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74cebb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:54.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74cebb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51690/0 (socket says 172.21.15.50:51690) 2023-08-10T10:51:54.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.909+0000 7fc74cebb640 1 -- 172.21.15.50:0/3867591047 learned_addr learned my addr 172.21.15.50:0/3867591047 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:54.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74d6bc640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7481612b0 0x7fc74815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:54.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 -- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7481612b0 msgr2=0x7fc74815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7481612b0 0x7fc74815f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 -- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7480cc100 msgr2=0x7fc74814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:54.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7480cc100 0x7fc74814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 -- 172.21.15.50:0/3867591047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009b30 con 0x7fc7480cae50 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74cebb640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74403e450 con 0x7fc7480cae50 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74403e5f0 con 0x7fc7480cae50 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74403e9a0 con 0x7fc7480cae50 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.910+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74815d9d0 con 0x7fc7480cae50 2023-08-10T10:51:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.911+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74815df90 con 0x7fc7480cae50 2023-08-10T10:51:54.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.912+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74804e270 con 0x7fc7480cae50 2023-08-10T10:51:54.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.913+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc74403eb00 con 0x7fc7480cae50 2023-08-10T10:51:54.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.914+0000 7fc73d7fa640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 0x7fc73406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.914+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7440ac610 con 0x7fc7480cae50 2023-08-10T10:51:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.914+0000 7fc73ffff640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 0x7fc73406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.915+0000 7fc73ffff640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 0x7fc73406d110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc74815a4a0 tx=0x7fc7380079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:54.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:54.918+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc744077650 con 0x7fc7480cae50 2023-08-10T10:51:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.148+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc74806d9c0 con 0x7fc7480cae50 2023-08-10T10:51:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.149+0000 7fc73d7fa640 1 -- 172.21.15.50:0/3867591047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7fc74403edb0 con 0x7fc7480cae50 2023-08-10T10:51:55.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:55.151 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:51:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:51:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 msgr2=0x7fc73406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 0x7fc73406d110 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc74815a4a0 tx=0x7fc7380079d0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 msgr2=0x7fc74815d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc744004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 shutdown_connections 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7481612b0 0x7fc74815f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc73406ac50 0x7fc73406d110 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7480cc100 0x7fc74814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 --2- 172.21.15.50:0/3867591047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7480cae50 0x7fc74815d210 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.151+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 >> 172.21.15.50:0/3867591047 conn(0x7fc7480cefe0 msgr2=0x7fc74815c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:55.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.152+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 shutdown_connections 2023-08-10T10:51:55.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.152+0000 7fc74f11f640 1 -- 172.21.15.50:0/3867591047 wait complete. 2023-08-10T10:51:55.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:55.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.393+0000 7fc03d7eb640 1 Processor -- start 2023-08-10T10:51:55.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.394+0000 7fc03d7eb640 1 -- start start 2023-08-10T10:51:55.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc03d7eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038153850 0x7fc0380b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc03d7eb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0380cfd40 0x7fc0380b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc03d7eb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03815d010 con 0x7fc038153c30 2023-08-10T10:51:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc03d7eb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03815d290 con 0x7fc0380cfd40 2023-08-10T10:51:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc03d7eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03815d570 con 0x7fc038153850 2023-08-10T10:51:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc0377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc038153c30 0x7fc0380cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48376/0 (socket says 172.21.15.50:48376) 2023-08-10T10:51:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.395+0000 7fc0377fe640 1 -- 172.21.15.50:0/844752422 learned_addr learned my addr 172.21.15.50:0/844752422 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc03cfea640 1 --2- 172.21.15.50:0/844752422 >> v2:172.21.15.50:3300/0 conn(0x7fc0380cfd40 0x7fc0380b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc037fff640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038153850 0x7fc0380b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410078271 0 0) 0x7fc03815d010 con 0x7fc038153c30 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc020003520 con 0x7fc038153c30 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc03cfea640 1 -- 172.21.15.50:0/844752422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038153850 msgr2=0x7fc0380b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc03cfea640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038153850 0x7fc0380b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc03cfea640 1 -- 172.21.15.50:0/844752422 >> v1:172.21.15.50:6789/0 conn(0x7fc038153c30 legacy=0x7fc0380cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870793792 0 0) 0x7fc020003520 con 0x7fc038153c30 2023-08-10T10:51:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.396+0000 7fc03cfea640 1 -- 172.21.15.50:0/844752422 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03815d850 con 0x7fc0380cfd40 2023-08-10T10:51:55.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.397+0000 7fc03cfea640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0380cfd40 0x7fc0380b1bd0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc030006fd0 tx=0x7fc03002b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341c34547eef16ad server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c001670 con 0x7fc0380cfd40 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03002e050 con 0x7fc0380cfd40 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc036ffd640 1 -- 172.21.15.50:0/844752422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030030710 con 0x7fc0380cfd40 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 -- 172.21.15.50:0/844752422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0380cfd40 msgr2=0x7fc0380b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0380cfd40 0x7fc0380b1bd0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc030006fd0 tx=0x7fc03002b770 comp rx=0 tx=0).stop 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 -- 172.21.15.50:0/844752422 shutdown_connections 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0380cfd40 0x7fc0380b1bd0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/844752422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc038153850 0x7fc0380b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.398+0000 7fc03d7eb640 1 -- 172.21.15.50:0/844752422 >> 172.21.15.50:0/844752422 conn(0x7fc038069880 msgr2=0x7fc038069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.399+0000 7fc03d7eb640 1 -- 172.21.15.50:0/844752422 shutdown_connections 2023-08-10T10:51:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.399+0000 7fc03d7eb640 1 -- 172.21.15.50:0/844752422 wait complete. 2023-08-10T10:51:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.400+0000 7fc03d7eb640 1 Processor -- start 2023-08-10T10:51:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.401+0000 7fc03d7eb640 1 -- start start 2023-08-10T10:51:55.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0380cfd40 0x7fc0381efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc038153850 0x7fc0381550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381540a0 con 0x7fc038153c30 2023-08-10T10:51:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381f0140 con 0x7fc038153850 2023-08-10T10:51:55.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03d7eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381542f0 con 0x7fc0380cfd40 2023-08-10T10:51:55.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51718/0 (socket says 172.21.15.50:51718) 2023-08-10T10:51:55.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 -- 172.21.15.50:0/905959286 learned_addr learned my addr 172.21.15.50:0/905959286 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:55.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc037fff640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0380cfd40 0x7fc0381efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc0377fe640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc038153850 0x7fc0381550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 -- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0380cfd40 msgr2=0x7fc0381efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0380cfd40 0x7fc0381efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 -- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc038153850 msgr2=0x7fc0381550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc038153850 0x7fc0381550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.402+0000 7fc03cfea640 1 -- 172.21.15.50:0/905959286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009400 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc03cfea640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc03002b7b0 tx=0x7fc030004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030003ca0 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030003e20 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030005c20 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0381545d0 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.403+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc038154b90 con 0x7fc038153c30 2023-08-10T10:51:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.404+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc038066e30 con 0x7fc038153c30 2023-08-10T10:51:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.406+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc030039070 con 0x7fc038153c30 2023-08-10T10:51:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.407+0000 7fc034ff9640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 0x7fc02406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.407+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0300aac50 con 0x7fc038153c30 2023-08-10T10:51:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.407+0000 7fc037fff640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 0x7fc02406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.408+0000 7fc037fff640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 0x7fc02406d110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc03806a370 tx=0x7fc02800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.411+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc030075c60 con 0x7fc038153c30 2023-08-10T10:51:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.605+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0381614a0 con 0x7fc038153c30 2023-08-10T10:51:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.607+0000 7fc034ff9640 1 -- 172.21.15.50:0/905959286 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+18283 (secure 0 0 0) 0x7fc030040090 con 0x7fc038153c30 2023-08-10T10:51:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:55.610 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":188,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:51:52.585342+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.610+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 msgr2=0x7fc02406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.610+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 0x7fc02406d110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc03806a370 tx=0x7fc02800b040 comp rx=0 tx=0).stop 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.610+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 msgr2=0x7fc0380b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.610+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc03002b7b0 tx=0x7fc030004710 comp rx=0 tx=0).stop 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 shutdown_connections 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc038153c30 0x7fc0380b3170 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc02406ac50 0x7fc02406d110 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc038153850 0x7fc0381550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 --2- 172.21.15.50:0/905959286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0380cfd40 0x7fc0381efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 >> 172.21.15.50:0/905959286 conn(0x7fc038069880 msgr2=0x7fc0380cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 shutdown_connections 2023-08-10T10:51:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.611+0000 7fc03d7eb640 1 -- 172.21.15.50:0/905959286 wait complete. 2023-08-10T10:51:55.634 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:51:55.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:51:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.846+0000 7f227e95f640 1 Processor -- start 2023-08-10T10:51:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.847+0000 7f227e95f640 1 -- start start 2023-08-10T10:51:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f227e95f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22780b8430 0x7f22780cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f227e95f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780cddb0 0x7f22780d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f227e95f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2278161180 con 0x7f227815cd60 2023-08-10T10:51:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f227e95f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780ce240 con 0x7f22780b8430 2023-08-10T10:51:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f227e95f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780b5bd0 con 0x7f22780cddb0 2023-08-10T10:51:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f2277fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f227815cd60 0x7f2278160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48384/0 (socket says 172.21.15.50:48384) 2023-08-10T10:51:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f2277fff640 1 -- 172.21.15.50:0/1113676637 learned_addr learned my addr 172.21.15.50:0/1113676637 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.848+0000 7f226f7fe640 1 --2- 172.21.15.50:0/1113676637 >> v2:172.21.15.50:3300/0 conn(0x7f22780b8430 0x7f22780cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f227cefc640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780cddb0 0x7f22780d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f22777fe640 1 -- 172.21.15.50:0/1113676637 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189329315 0 0) 0x7f2278161180 con 0x7f227815cd60 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f226f7fe640 1 -- 172.21.15.50:0/1113676637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780cddb0 msgr2=0x7f22780d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f226f7fe640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780cddb0 0x7f22780d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f226f7fe640 1 -- 172.21.15.50:0/1113676637 >> v1:172.21.15.50:6789/0 conn(0x7f227815cd60 legacy=0x7f2278160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.849+0000 7f226f7fe640 1 -- 172.21.15.50:0/1113676637 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278161460 con 0x7f22780b8430 2023-08-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.850+0000 7f226f7fe640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22780b8430 0x7f22780cd870 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f22600097a0 tx=0x7f226002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0e85cc28ae2a60 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f22777fe640 1 -- 172.21.15.50:0/1113676637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260030610 con 0x7f22780b8430 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f22777fe640 1 -- 172.21.15.50:0/1113676637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260030770 con 0x7f22780b8430 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f22777fe640 1 -- 172.21.15.50:0/1113676637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260030b00 con 0x7f22780b8430 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 -- 172.21.15.50:0/1113676637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22780b8430 msgr2=0x7f22780cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22780b8430 0x7f22780cd870 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f22600097a0 tx=0x7f226002b960 comp rx=0 tx=0).stop 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 -- 172.21.15.50:0/1113676637 shutdown_connections 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22780b8430 0x7f22780cd870 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 --2- 172.21.15.50:0/1113676637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780cddb0 0x7f22780d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 -- 172.21.15.50:0/1113676637 >> 172.21.15.50:0/1113676637 conn(0x7f22780d2ac0 msgr2=0x7f22780d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.851+0000 7f227e95f640 1 -- 172.21.15.50:0/1113676637 shutdown_connections 2023-08-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.852+0000 7f227e95f640 1 -- 172.21.15.50:0/1113676637 wait complete. 2023-08-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.853+0000 7f227e95f640 1 Processor -- start 2023-08-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.853+0000 7f227e95f640 1 -- start start 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 0x7f22780c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 0x7f22781561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2278156c30 con 0x7f227815cd60 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2278156e70 con 0x7f22780cddb0 2023-08-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.854+0000 7f227e95f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2278157150 con 0x7f22780b8430 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51742/0 (socket says 172.21.15.50:51742) 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 -- 172.21.15.50:0/3982830755 learned_addr learned my addr 172.21.15.50:0/3982830755 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f2277fff640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 0x7f22780c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 -- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 msgr2=0x7f22780c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f226f7fe640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 0x7f22781561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 0x7f22780c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 -- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 msgr2=0x7f22781561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 0x7f22781561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f227cefc640 1 -- 172.21.15.50:0/3982830755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260009400 con 0x7f227815cd60 2023-08-10T10:51:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f2277fff640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 0x7f22780c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.855+0000 7f226f7fe640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 0x7f22781561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f227cefc640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f2270007e60 tx=0x7f227000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270014420 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22700145a0 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270014950 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2278157430 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.856+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22781579f0 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.857+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227804e270 con 0x7f227815cd60 2023-08-10T10:51:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.858+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2270014ab0 con 0x7f227815cd60 2023-08-10T10:51:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.859+0000 7f22757fa640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 0x7f225806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.859+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2270089e80 con 0x7f227815cd60 2023-08-10T10:51:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.860+0000 7f2277fff640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 0x7f225806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.860+0000 7f2277fff640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 0x7f225806d110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2268000f60 tx=0x7f2268009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:55.864+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2270058920 con 0x7f227815cd60 2023-08-10T10:51:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.052+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22780d0c00 con 0x7f225806ac50 2023-08-10T10:51:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.077+0000 7f22757fa640 1 -- 172.21.15.50:0/3982830755 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303107 (secure 0 0 0) 0x7f22680013d0 con 0x7f225806ac50 2023-08-10T10:51:56.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:51:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 msgr2=0x7f225806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 0x7f225806d110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2268000f60 tx=0x7f2268009040 comp rx=0 tx=0).stop 2023-08-10T10:51:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 msgr2=0x7f22781566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f2270007e60 tx=0x7f227000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 shutdown_connections 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f227815cd60 0x7f22781566f0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f225806ac50 0x7f225806d110 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22780cddb0 0x7f22781561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 --2- 172.21.15.50:0/3982830755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22780b8430 0x7f22780c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 >> 172.21.15.50:0/3982830755 conn(0x7f22780d2ac0 msgr2=0x7f227815bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 shutdown_connections 2023-08-10T10:51:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.085+0000 7f227e95f640 1 -- 172.21.15.50:0/3982830755 wait complete. 2023-08-10T10:51:56.108 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-08-10T10:51:54.609905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9964,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552535,"statfs":{"total":1600000000,"available":1589795878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046480"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596188+0000","last_change":"2023-08-10T10:51:51.611864+0000","last_active":"2023-08-10T10:51:52.596188+0000","last_peered":"2023-08-10T10:51:52.596188+0000","last_clean":"2023-08-10T10:51:52.596188+0000","last_became_active":"2023-08-10T10:51:51.608610+0000","last_became_peered":"2023-08-10T10:51:51.608610+0000","last_unstale":"2023-08-10T10:51:52.596188+0000","last_undegraded":"2023-08-10T10:51:52.596188+0000","last_fullsized":"2023-08-10T10:51:52.596188+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:25.009982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839172+0000","last_change":"2023-08-10T10:51:51.611969+0000","last_active":"2023-08-10T10:51:52.839172+0000","last_peered":"2023-08-10T10:51:52.839172+0000","last_clean":"2023-08-10T10:51:52.839172+0000","last_became_active":"2023-08-10T10:51:51.611041+0000","last_became_peered":"2023-08-10T10:51:51.611041+0000","last_unstale":"2023-08-10T10:51:52.839172+0000","last_undegraded":"2023-08-10T10:51:52.839172+0000","last_fullsized":"2023-08-10T10:51:52.839172+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:47.001036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594714+0000","last_change":"2023-08-10T10:51:51.614135+0000","last_active":"2023-08-10T10:51:52.594714+0000","last_peered":"2023-08-10T10:51:52.594714+0000","last_clean":"2023-08-10T10:51:52.594714+0000","last_became_active":"2023-08-10T10:51:51.613750+0000","last_became_peered":"2023-08-10T10:51:51.613750+0000","last_unstale":"2023-08-10T10:51:52.594714+0000","last_undegraded":"2023-08-10T10:51:52.594714+0000","last_fullsized":"2023-08-10T10:51:52.594714+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:51.571069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594751+0000","last_change":"2023-08-10T10:51:51.605339+0000","last_active":"2023-08-10T10:51:52.594751+0000","last_peered":"2023-08-10T10:51:52.594751+0000","last_clean":"2023-08-10T10:51:52.594751+0000","last_became_active":"2023-08-10T10:51:51.597888+0000","last_became_peered":"2023-08-10T10:51:51.597888+0000","last_unstale":"2023-08-10T10:51:52.594751+0000","last_undegraded":"2023-08-10T10:51:52.594751+0000","last_fullsized":"2023-08-10T10:51:52.594751+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:09:57.736853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618905+0000","last_change":"2023-08-10T10:51:51.618692+0000","last_active":"2023-08-10T10:51:51.618905+0000","last_peered":"2023-08-10T10:51:51.618905+0000","last_clean":"2023-08-10T10:51:51.618905+0000","last_became_active":"2023-08-10T10:51:51.618300+0000","last_became_peered":"2023-08-10T10:51:51.618300+0000","last_unstale":"2023-08-10T10:51:51.618905+0000","last_undegraded":"2023-08-10T10:51:51.618905+0000","last_fullsized":"2023-08-10T10:51:51.618905+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:02.790553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839553+0000","last_change":"2023-08-10T10:51:51.613707+0000","last_active":"2023-08-10T10:51:52.839553+0000","last_peered":"2023-08-10T10:51:52.839553+0000","last_clean":"2023-08-10T10:51:52.839553+0000","last_became_active":"2023-08-10T10:51:51.613458+0000","last_became_peered":"2023-08-10T10:51:51.613458+0000","last_unstale":"2023-08-10T10:51:52.839553+0000","last_undegraded":"2023-08-10T10:51:52.839553+0000","last_fullsized":"2023-08-10T10:51:52.839553+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:15:45.423769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.621821+0000","last_change":"2023-08-10T10:51:51.617797+0000","last_active":"2023-08-10T10:51:51.621821+0000","last_peered":"2023-08-10T10:51:51.621821+0000","last_clean":"2023-08-10T10:51:51.621821+0000","last_became_active":"2023-08-10T10:51:51.617370+0000","last_became_peered":"2023-08-10T10:51:51.617370+0000","last_unstale":"2023-08-10T10:51:51.621821+0000","last_undegraded":"2023-08-10T10:51:51.621821+0000","last_fullsized":"2023-08-10T10:51:51.621821+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:44:50.014836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.613151+0000","last_change":"2023-08-10T10:51:51.612884+0000","last_active":"2023-08-10T10:51:51.613151+0000","last_peered":"2023-08-10T10:51:51.613151+0000","last_clean":"2023-08-10T10:51:51.613151+0000","last_became_active":"2023-08-10T10:51:51.607808+0000","last_became_peered":"2023-08-10T10:51:51.607808+0000","last_unstale":"2023-08-10T10:51:51.613151+0000","last_undegraded":"2023-08-10T10:51:51.613151+0000","last_fullsized":"2023-08-10T10:51:51.613151+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:37.054776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625841+0000","last_change":"2023-08-10T10:51:51.625651+0000","last_active":"2023-08-10T10:51:51.625841+0000","last_peered":"2023-08-10T10:51:51.625841+0000","last_clean":"2023-08-10T10:51:51.625841+0000","last_became_active":"2023-08-10T10:51:51.619644+0000","last_became_peered":"2023-08-10T10:51:51.619644+0000","last_unstale":"2023-08-10T10:51:51.625841+0000","last_undegraded":"2023-08-10T10:51:51.625841+0000","last_fullsized":"2023-08-10T10:51:51.625841+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:29.806550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625777+0000","last_change":"2023-08-10T10:51:51.625604+0000","last_active":"2023-08-10T10:51:51.625777+0000","last_peered":"2023-08-10T10:51:51.625777+0000","last_clean":"2023-08-10T10:51:51.625777+0000","last_became_active":"2023-08-10T10:51:51.625061+0000","last_became_peered":"2023-08-10T10:51:51.625061+0000","last_unstale":"2023-08-10T10:51:51.625777+0000","last_undegraded":"2023-08-10T10:51:51.625777+0000","last_fullsized":"2023-08-10T10:51:51.625777+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:56.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595876+0000","last_change":"2023-08-10T10:51:51.613495+0000","last_active":"2023-08-10T10:51:52.595876+0000","last_peered":"2023-08-10T10:51:52.595876+0000","last_clean":"2023-08-10T10:51:52.595876+0000","last_became_active":"2023-08-10T10:51:51.612202+0000","last_became_peered":"2023-08-10T10:51:51.612202+0000","last_unstale":"2023-08-10T10:51:52.595876+0000","last_undegraded":"2023-08-10T10:51:52.595876+0000","last_fullsized":"2023-08-10T10:51:52.595876+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:04.299073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840065+0000","last_change":"2023-08-10T10:51:51.615711+0000","last_active":"2023-08-10T10:51:52.840065+0000","last_peered":"2023-08-10T10:51:52.840065+0000","last_clean":"2023-08-10T10:51:52.840065+0000","last_became_active":"2023-08-10T10:51:51.615449+0000","last_became_peered":"2023-08-10T10:51:51.615449+0000","last_unstale":"2023-08-10T10:51:52.840065+0000","last_undegraded":"2023-08-10T10:51:52.840065+0000","last_fullsized":"2023-08-10T10:51:52.840065+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:26.980247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591461+0000","last_change":"2023-08-10T10:51:51.614553+0000","last_active":"2023-08-10T10:51:52.591461+0000","last_peered":"2023-08-10T10:51:52.591461+0000","last_clean":"2023-08-10T10:51:52.591461+0000","last_became_active":"2023-08-10T10:51:51.613585+0000","last_became_peered":"2023-08-10T10:51:51.613585+0000","last_unstale":"2023-08-10T10:51:52.591461+0000","last_undegraded":"2023-08-10T10:51:52.591461+0000","last_fullsized":"2023-08-10T10:51:52.591461+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:35.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625464+0000","last_change":"2023-08-10T10:51:51.625377+0000","last_active":"2023-08-10T10:51:51.625464+0000","last_peered":"2023-08-10T10:51:51.625464+0000","last_clean":"2023-08-10T10:51:51.625464+0000","last_became_active":"2023-08-10T10:51:51.624984+0000","last_became_peered":"2023-08-10T10:51:51.624984+0000","last_unstale":"2023-08-10T10:51:51.625464+0000","last_undegraded":"2023-08-10T10:51:51.625464+0000","last_fullsized":"2023-08-10T10:51:51.625464+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:29.602916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596158+0000","last_change":"2023-08-10T10:51:51.609109+0000","last_active":"2023-08-10T10:51:52.596158+0000","last_peered":"2023-08-10T10:51:52.596158+0000","last_clean":"2023-08-10T10:51:52.596158+0000","last_became_active":"2023-08-10T10:51:51.608567+0000","last_became_peered":"2023-08-10T10:51:51.608567+0000","last_unstale":"2023-08-10T10:51:52.596158+0000","last_undegraded":"2023-08-10T10:51:52.596158+0000","last_fullsized":"2023-08-10T10:51:52.596158+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:12.923694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596473+0000","last_change":"2023-08-10T10:51:51.615881+0000","last_active":"2023-08-10T10:51:52.596473+0000","last_peered":"2023-08-10T10:51:52.596473+0000","last_clean":"2023-08-10T10:51:52.596473+0000","last_became_active":"2023-08-10T10:51:51.612901+0000","last_became_peered":"2023-08-10T10:51:51.612901+0000","last_unstale":"2023-08-10T10:51:52.596473+0000","last_undegraded":"2023-08-10T10:51:52.596473+0000","last_fullsized":"2023-08-10T10:51:52.596473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:07.343362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.614873+0000","last_change":"2023-08-10T10:51:51.614746+0000","last_active":"2023-08-10T10:51:51.614873+0000","last_peered":"2023-08-10T10:51:51.614873+0000","last_clean":"2023-08-10T10:51:51.614873+0000","last_became_active":"2023-08-10T10:51:51.614353+0000","last_became_peered":"2023-08-10T10:51:51.614353+0000","last_unstale":"2023-08-10T10:51:51.614873+0000","last_undegraded":"2023-08-10T10:51:51.614873+0000","last_fullsized":"2023-08-10T10:51:51.614873+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:38.421756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.623586+0000","last_change":"2023-08-10T10:51:51.623526+0000","last_active":"2023-08-10T10:51:51.623586+0000","last_peered":"2023-08-10T10:51:51.623586+0000","last_clean":"2023-08-10T10:51:51.623586+0000","last_became_active":"2023-08-10T10:51:51.623335+0000","last_became_peered":"2023-08-10T10:51:51.623335+0000","last_unstale":"2023-08-10T10:51:51.623586+0000","last_undegraded":"2023-08-10T10:51:51.623586+0000","last_fullsized":"2023-08-10T10:51:51.623586+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:04.877612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594386+0000","last_change":"2023-08-10T10:51:51.605552+0000","last_active":"2023-08-10T10:51:52.594386+0000","last_peered":"2023-08-10T10:51:52.594386+0000","last_clean":"2023-08-10T10:51:52.594386+0000","last_became_active":"2023-08-10T10:51:51.605161+0000","last_became_peered":"2023-08-10T10:51:51.605161+0000","last_unstale":"2023-08-10T10:51:52.594386+0000","last_undegraded":"2023-08-10T10:51:52.594386+0000","last_fullsized":"2023-08-10T10:51:52.594386+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:03.899379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995291+0000","last_change":"2023-08-10T10:51:51.616439+0000","last_active":"2023-08-10T10:51:52.995291+0000","last_peered":"2023-08-10T10:51:52.995291+0000","last_clean":"2023-08-10T10:51:52.995291+0000","last_became_active":"2023-08-10T10:51:51.616170+0000","last_became_peered":"2023-08-10T10:51:51.616170+0000","last_unstale":"2023-08-10T10:51:52.995291+0000","last_undegraded":"2023-08-10T10:51:52.995291+0000","last_fullsized":"2023-08-10T10:51:52.995291+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:48:51.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591341+0000","last_change":"2023-08-10T10:51:51.610909+0000","last_active":"2023-08-10T10:51:52.591341+0000","last_peered":"2023-08-10T10:51:52.591341+0000","last_clean":"2023-08-10T10:51:52.591341+0000","last_became_active":"2023-08-10T10:51:51.610361+0000","last_became_peered":"2023-08-10T10:51:51.610361+0000","last_unstale":"2023-08-10T10:51:52.591341+0000","last_undegraded":"2023-08-10T10:51:52.591341+0000","last_fullsized":"2023-08-10T10:51:52.591341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:59:25.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839526+0000","last_change":"2023-08-10T10:51:51.619332+0000","last_active":"2023-08-10T10:51:52.839526+0000","last_peered":"2023-08-10T10:51:52.839526+0000","last_clean":"2023-08-10T10:51:52.839526+0000","last_became_active":"2023-08-10T10:51:51.618192+0000","last_became_peered":"2023-08-10T10:51:51.618192+0000","last_unstale":"2023-08-10T10:51:52.839526+0000","last_undegraded":"2023-08-10T10:51:52.839526+0000","last_fullsized":"2023-08-10T10:51:52.839526+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:27.694468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.616904+0000","last_change":"2023-08-10T10:51:51.616782+0000","last_active":"2023-08-10T10:51:51.616904+0000","last_peered":"2023-08-10T10:51:51.616904+0000","last_clean":"2023-08-10T10:51:51.616904+0000","last_became_active":"2023-08-10T10:51:51.615424+0000","last_became_peered":"2023-08-10T10:51:51.615424+0000","last_unstale":"2023-08-10T10:51:51.616904+0000","last_undegraded":"2023-08-10T10:51:51.616904+0000","last_fullsized":"2023-08-10T10:51:51.616904+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:23.796511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595115+0000","last_change":"2023-08-10T10:51:51.606377+0000","last_active":"2023-08-10T10:51:52.595115+0000","last_peered":"2023-08-10T10:51:52.595115+0000","last_clean":"2023-08-10T10:51:52.595115+0000","last_became_active":"2023-08-10T10:51:51.606006+0000","last_became_peered":"2023-08-10T10:51:51.606006+0000","last_unstale":"2023-08-10T10:51:52.595115+0000","last_undegraded":"2023-08-10T10:51:52.595115+0000","last_fullsized":"2023-08-10T10:51:52.595115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:10.229201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591267+0000","last_change":"2023-08-10T10:51:51.603277+0000","last_active":"2023-08-10T10:51:52.591267+0000","last_peered":"2023-08-10T10:51:52.591267+0000","last_clean":"2023-08-10T10:51:52.591267+0000","last_became_active":"2023-08-10T10:51:51.601525+0000","last_became_peered":"2023-08-10T10:51:51.601525+0000","last_unstale":"2023-08-10T10:51:52.591267+0000","last_undegraded":"2023-08-10T10:51:52.591267+0000","last_fullsized":"2023-08-10T10:51:52.591267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:16.968729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995015+0000","last_change":"2023-08-10T10:51:51.619697+0000","last_active":"2023-08-10T10:51:52.995015+0000","last_peered":"2023-08-10T10:51:52.995015+0000","last_clean":"2023-08-10T10:51:52.995015+0000","last_became_active":"2023-08-10T10:51:51.619121+0000","last_became_peered":"2023-08-10T10:51:51.619121+0000","last_unstale":"2023-08-10T10:51:52.995015+0000","last_undegraded":"2023-08-10T10:51:52.995015+0000","last_fullsized":"2023-08-10T10:51:52.995015+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:25:10.590830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839885+0000","last_change":"2023-08-10T10:51:51.619483+0000","last_active":"2023-08-10T10:51:52.839885+0000","last_peered":"2023-08-10T10:51:52.839885+0000","last_clean":"2023-08-10T10:51:52.839885+0000","last_became_active":"2023-08-10T10:51:51.618725+0000","last_became_peered":"2023-08-10T10:51:51.618725+0000","last_unstale":"2023-08-10T10:51:52.839885+0000","last_undegraded":"2023-08-10T10:51:52.839885+0000","last_fullsized":"2023-08-10T10:51:52.839885+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:11:30.959097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591190+0000","last_change":"2023-08-10T10:51:51.599129+0000","last_active":"2023-08-10T10:51:52.591190+0000","last_peered":"2023-08-10T10:51:52.591190+0000","last_clean":"2023-08-10T10:51:52.591190+0000","last_became_active":"2023-08-10T10:51:51.598364+0000","last_became_peered":"2023-08-10T10:51:51.598364+0000","last_unstale":"2023-08-10T10:51:52.591190+0000","last_undegraded":"2023-08-10T10:51:52.591190+0000","last_fullsized":"2023-08-10T10:51:52.591190+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:15:42.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839399+0000","last_change":"2023-08-10T10:51:51.627143+0000","last_active":"2023-08-10T10:51:52.839399+0000","last_peered":"2023-08-10T10:51:52.839399+0000","last_clean":"2023-08-10T10:51:52.839399+0000","last_became_active":"2023-08-10T10:51:51.626919+0000","last_became_peered":"2023-08-10T10:51:51.626919+0000","last_unstale":"2023-08-10T10:51:52.839399+0000","last_undegraded":"2023-08-10T10:51:52.839399+0000","last_fullsized":"2023-08-10T10:51:52.839399+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:10.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.615198+0000","last_change":"2023-08-10T10:51:51.614653+0000","last_active":"2023-08-10T10:51:51.615198+0000","last_peered":"2023-08-10T10:51:51.615198+0000","last_clean":"2023-08-10T10:51:51.615198+0000","last_became_active":"2023-08-10T10:51:51.614391+0000","last_became_peered":"2023-08-10T10:51:51.614391+0000","last_unstale":"2023-08-10T10:51:51.615198+0000","last_undegraded":"2023-08-10T10:51:51.615198+0000","last_fullsized":"2023-08-10T10:51:51.615198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:14:17.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596214+0000","last_change":"2023-08-10T10:51:51.604927+0000","last_active":"2023-08-10T10:51:52.596214+0000","last_peered":"2023-08-10T10:51:52.596214+0000","last_clean":"2023-08-10T10:51:52.596214+0000","last_became_active":"2023-08-10T10:51:51.604233+0000","last_became_peered":"2023-08-10T10:51:51.604233+0000","last_unstale":"2023-08-10T10:51:52.596214+0000","last_undegraded":"2023-08-10T10:51:52.596214+0000","last_fullsized":"2023-08-10T10:51:52.596214+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:03.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.615177+0000","last_change":"2023-08-10T10:51:51.614550+0000","last_active":"2023-08-10T10:51:51.615177+0000","last_peered":"2023-08-10T10:51:51.615177+0000","last_clean":"2023-08-10T10:51:51.615177+0000","last_became_active":"2023-08-10T10:51:51.614273+0000","last_became_peered":"2023-08-10T10:51:51.614273+0000","last_unstale":"2023-08-10T10:51:51.615177+0000","last_undegraded":"2023-08-10T10:51:51.615177+0000","last_fullsized":"2023-08-10T10:51:51.615177+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:54.818759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839066+0000","last_change":"2023-08-10T10:51:51.615300+0000","last_active":"2023-08-10T10:51:52.839066+0000","last_peered":"2023-08-10T10:51:52.839066+0000","last_clean":"2023-08-10T10:51:52.839066+0000","last_became_active":"2023-08-10T10:51:51.615008+0000","last_became_peered":"2023-08-10T10:51:51.615008+0000","last_unstale":"2023-08-10T10:51:52.839066+0000","last_undegraded":"2023-08-10T10:51:52.839066+0000","last_fullsized":"2023-08-10T10:51:52.839066+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:59.108140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"187'4","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595223+0000","last_change":"2023-08-10T10:51:50.604506+0000","last_active":"2023-08-10T10:51:52.595223+0000","last_peered":"2023-08-10T10:51:52.595223+0000","last_clean":"2023-08-10T10:51:52.595223+0000","last_became_active":"2023-08-10T10:51:50.604160+0000","last_became_peered":"2023-08-10T10:51:50.604160+0000","last_unstale":"2023-08-10T10:51:52.595223+0000","last_undegraded":"2023-08-10T10:51:52.595223+0000","last_fullsized":"2023-08-10T10:51:52.595223+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:33.717376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591367+0000","last_change":"2023-08-10T10:51:51.613481+0000","last_active":"2023-08-10T10:51:52.591367+0000","last_peered":"2023-08-10T10:51:52.591367+0000","last_clean":"2023-08-10T10:51:52.591367+0000","last_became_active":"2023-08-10T10:51:51.613089+0000","last_became_peered":"2023-08-10T10:51:51.613089+0000","last_unstale":"2023-08-10T10:51:52.591367+0000","last_undegraded":"2023-08-10T10:51:52.591367+0000","last_fullsized":"2023-08-10T10:51:52.591367+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:28.683224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637944+0000","last_change":"2023-08-10T10:51:50.610055+0000","last_active":"2023-08-10T10:51:51.637944+0000","last_peered":"2023-08-10T10:51:51.637944+0000","last_clean":"2023-08-10T10:51:51.637944+0000","last_became_active":"2023-08-10T10:51:50.609660+0000","last_became_peered":"2023-08-10T10:51:50.609660+0000","last_unstale":"2023-08-10T10:51:51.637944+0000","last_undegraded":"2023-08-10T10:51:51.637944+0000","last_fullsized":"2023-08-10T10:51:51.637944+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:57:36.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618039+0000","last_change":"2023-08-10T10:51:51.617952+0000","last_active":"2023-08-10T10:51:51.618039+0000","last_peered":"2023-08-10T10:51:51.618039+0000","last_clean":"2023-08-10T10:51:51.618039+0000","last_became_active":"2023-08-10T10:51:51.617703+0000","last_became_peered":"2023-08-10T10:51:51.617703+0000","last_unstale":"2023-08-10T10:51:51.618039+0000","last_undegraded":"2023-08-10T10:51:51.618039+0000","last_fullsized":"2023-08-10T10:51:51.618039+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:17.664245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596512+0000","last_change":"2023-08-10T10:51:50.605538+0000","last_active":"2023-08-10T10:51:52.596512+0000","last_peered":"2023-08-10T10:51:52.596512+0000","last_clean":"2023-08-10T10:51:52.596512+0000","last_became_active":"2023-08-10T10:51:50.605175+0000","last_became_peered":"2023-08-10T10:51:50.605175+0000","last_unstale":"2023-08-10T10:51:52.596512+0000","last_undegraded":"2023-08-10T10:51:52.596512+0000","last_fullsized":"2023-08-10T10:51:52.596512+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:10.482055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839744+0000","last_change":"2023-08-10T10:51:51.616517+0000","last_active":"2023-08-10T10:51:52.839744+0000","last_peered":"2023-08-10T10:51:52.839744+0000","last_clean":"2023-08-10T10:51:52.839744+0000","last_became_active":"2023-08-10T10:51:51.615954+0000","last_became_peered":"2023-08-10T10:51:51.615954+0000","last_unstale":"2023-08-10T10:51:52.839744+0000","last_undegraded":"2023-08-10T10:51:52.839744+0000","last_fullsized":"2023-08-10T10:51:52.839744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:45.782516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995375+0000","last_change":"2023-08-10T10:51:50.605949+0000","last_active":"2023-08-10T10:51:52.995375+0000","last_peered":"2023-08-10T10:51:52.995375+0000","last_clean":"2023-08-10T10:51:52.995375+0000","last_became_active":"2023-08-10T10:51:50.605677+0000","last_became_peered":"2023-08-10T10:51:50.605677+0000","last_unstale":"2023-08-10T10:51:52.995375+0000","last_undegraded":"2023-08-10T10:51:52.995375+0000","last_fullsized":"2023-08-10T10:51:52.995375+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:16:04.814789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625459+0000","last_change":"2023-08-10T10:51:51.625357+0000","last_active":"2023-08-10T10:51:51.625459+0000","last_peered":"2023-08-10T10:51:51.625459+0000","last_clean":"2023-08-10T10:51:51.625459+0000","last_became_active":"2023-08-10T10:51:51.611951+0000","last_became_peered":"2023-08-10T10:51:51.611951+0000","last_unstale":"2023-08-10T10:51:51.625459+0000","last_undegraded":"2023-08-10T10:51:51.625459+0000","last_fullsized":"2023-08-10T10:51:51.625459+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:55.347104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637370+0000","last_change":"2023-08-10T10:51:50.605520+0000","last_active":"2023-08-10T10:51:51.637370+0000","last_peered":"2023-08-10T10:51:51.637370+0000","last_clean":"2023-08-10T10:51:51.637370+0000","last_became_active":"2023-08-10T10:51:50.604522+0000","last_became_peered":"2023-08-10T10:51:50.604522+0000","last_unstale":"2023-08-10T10:51:51.637370+0000","last_undegraded":"2023-08-10T10:51:51.637370+0000","last_fullsized":"2023-08-10T10:51:51.637370+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:22.868516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995288+0000","last_change":"2023-08-10T10:51:51.624720+0000","last_active":"2023-08-10T10:51:52.995288+0000","last_peered":"2023-08-10T10:51:52.995288+0000","last_clean":"2023-08-10T10:51:52.995288+0000","last_became_active":"2023-08-10T10:51:51.622428+0000","last_became_peered":"2023-08-10T10:51:51.622428+0000","last_unstale":"2023-08-10T10:51:52.995288+0000","last_undegraded":"2023-08-10T10:51:52.995288+0000","last_fullsized":"2023-08-10T10:51:52.995288+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:26:38.765449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.636423+0000","last_change":"2023-08-10T10:51:50.611907+0000","last_active":"2023-08-10T10:51:51.636423+0000","last_peered":"2023-08-10T10:51:51.636423+0000","last_clean":"2023-08-10T10:51:51.636423+0000","last_became_active":"2023-08-10T10:51:50.611603+0000","last_became_peered":"2023-08-10T10:51:50.611603+0000","last_unstale":"2023-08-10T10:51:51.636423+0000","last_undegraded":"2023-08-10T10:51:51.636423+0000","last_fullsized":"2023-08-10T10:51:51.636423+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:44.362181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995491+0000","last_change":"2023-08-10T10:51:51.616960+0000","last_active":"2023-08-10T10:51:52.995491+0000","last_peered":"2023-08-10T10:51:52.995491+0000","last_clean":"2023-08-10T10:51:52.995491+0000","last_became_active":"2023-08-10T10:51:51.616652+0000","last_became_peered":"2023-08-10T10:51:51.616652+0000","last_unstale":"2023-08-10T10:51:52.995491+0000","last_undegraded":"2023-08-10T10:51:52.995491+0000","last_fullsized":"2023-08-10T10:51:52.995491+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:36.996141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994759+0000","last_change":"2023-08-10T10:51:50.609005+0000","last_active":"2023-08-10T10:51:52.994759+0000","last_peered":"2023-08-10T10:51:52.994759+0000","last_clean":"2023-08-10T10:51:52.994759+0000","last_became_active":"2023-08-10T10:51:50.608759+0000","last_became_peered":"2023-08-10T10:51:50.608759+0000","last_unstale":"2023-08-10T10:51:52.994759+0000","last_undegraded":"2023-08-10T10:51:52.994759+0000","last_fullsized":"2023-08-10T10:51:52.994759+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:35.176011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596762+0000","last_change":"2023-08-10T10:51:51.609009+0000","last_active":"2023-08-10T10:51:52.596762+0000","last_peered":"2023-08-10T10:51:52.596762+0000","last_clean":"2023-08-10T10:51:52.596762+0000","last_became_active":"2023-08-10T10:51:51.606871+0000","last_became_peered":"2023-08-10T10:51:51.606871+0000","last_unstale":"2023-08-10T10:51:52.596762+0000","last_undegraded":"2023-08-10T10:51:52.596762+0000","last_fullsized":"2023-08-10T10:51:52.596762+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:35.038814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598323+0000","last_change":"2023-08-10T10:51:50.604447+0000","last_active":"2023-08-10T10:51:51.598323+0000","last_peered":"2023-08-10T10:51:51.598323+0000","last_clean":"2023-08-10T10:51:51.598323+0000","last_became_active":"2023-08-10T10:51:50.604206+0000","last_became_peered":"2023-08-10T10:51:50.604206+0000","last_unstale":"2023-08-10T10:51:51.598323+0000","last_undegraded":"2023-08-10T10:51:51.598323+0000","last_fullsized":"2023-08-10T10:51:51.598323+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:05.871559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.626082+0000","last_change":"2023-08-10T10:51:51.625981+0000","last_active":"2023-08-10T10:51:51.626082+0000","last_peered":"2023-08-10T10:51:51.626082+0000","last_clean":"2023-08-10T10:51:51.626082+0000","last_became_active":"2023-08-10T10:51:51.620155+0000","last_became_peered":"2023-08-10T10:51:51.620155+0000","last_unstale":"2023-08-10T10:51:51.626082+0000","last_undegraded":"2023-08-10T10:51:51.626082+0000","last_fullsized":"2023-08-10T10:51:51.626082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:10.599787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591064+0000","last_change":"2023-08-10T10:51:50.604878+0000","last_active":"2023-08-10T10:51:52.591064+0000","last_peered":"2023-08-10T10:51:52.591064+0000","last_clean":"2023-08-10T10:51:52.591064+0000","last_became_active":"2023-08-10T10:51:50.604429+0000","last_became_peered":"2023-08-10T10:51:50.604429+0000","last_unstale":"2023-08-10T10:51:52.591064+0000","last_undegraded":"2023-08-10T10:51:52.591064+0000","last_fullsized":"2023-08-10T10:51:52.591064+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:47.102878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.608474+0000","last_change":"2023-08-10T10:51:51.608374+0000","last_active":"2023-08-10T10:51:51.608474+0000","last_peered":"2023-08-10T10:51:51.608474+0000","last_clean":"2023-08-10T10:51:51.608474+0000","last_became_active":"2023-08-10T10:51:51.608072+0000","last_became_peered":"2023-08-10T10:51:51.608072+0000","last_unstale":"2023-08-10T10:51:51.608474+0000","last_undegraded":"2023-08-10T10:51:51.608474+0000","last_fullsized":"2023-08-10T10:51:51.608474+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:32.345032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637657+0000","last_change":"2023-08-10T10:51:50.611176+0000","last_active":"2023-08-10T10:51:51.637657+0000","last_peered":"2023-08-10T10:51:51.637657+0000","last_clean":"2023-08-10T10:51:51.637657+0000","last_became_active":"2023-08-10T10:51:50.609741+0000","last_became_peered":"2023-08-10T10:51:50.609741+0000","last_unstale":"2023-08-10T10:51:51.637657+0000","last_undegraded":"2023-08-10T10:51:51.637657+0000","last_fullsized":"2023-08-10T10:51:51.637657+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:11.908062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596040+0000","last_change":"2023-08-10T10:51:51.600450+0000","last_active":"2023-08-10T10:51:52.596040+0000","last_peered":"2023-08-10T10:51:52.596040+0000","last_clean":"2023-08-10T10:51:52.596040+0000","last_became_active":"2023-08-10T10:51:51.599820+0000","last_became_peered":"2023-08-10T10:51:51.599820+0000","last_unstale":"2023-08-10T10:51:52.596040+0000","last_undegraded":"2023-08-10T10:51:52.596040+0000","last_fullsized":"2023-08-10T10:51:52.596040+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:06.887190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.635608+0000","last_change":"2023-08-10T10:51:50.607177+0000","last_active":"2023-08-10T10:51:51.635608+0000","last_peered":"2023-08-10T10:51:51.635608+0000","last_clean":"2023-08-10T10:51:51.635608+0000","last_became_active":"2023-08-10T10:51:50.606806+0000","last_became_peered":"2023-08-10T10:51:50.606806+0000","last_unstale":"2023-08-10T10:51:51.635608+0000","last_undegraded":"2023-08-10T10:51:51.635608+0000","last_fullsized":"2023-08-10T10:51:51.635608+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:05.240953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596798+0000","last_change":"2023-08-10T10:51:51.613008+0000","last_active":"2023-08-10T10:51:52.596798+0000","last_peered":"2023-08-10T10:51:52.596798+0000","last_clean":"2023-08-10T10:51:52.596798+0000","last_became_active":"2023-08-10T10:51:51.611453+0000","last_became_peered":"2023-08-10T10:51:51.611453+0000","last_unstale":"2023-08-10T10:51:52.596798+0000","last_undegraded":"2023-08-10T10:51:52.596798+0000","last_fullsized":"2023-08-10T10:51:52.596798+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:03.116172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598145+0000","last_change":"2023-08-10T10:51:50.605874+0000","last_active":"2023-08-10T10:51:51.598145+0000","last_peered":"2023-08-10T10:51:51.598145+0000","last_clean":"2023-08-10T10:51:51.598145+0000","last_became_active":"2023-08-10T10:51:50.605011+0000","last_became_peered":"2023-08-10T10:51:50.605011+0000","last_unstale":"2023-08-10T10:51:51.598145+0000","last_undegraded":"2023-08-10T10:51:51.598145+0000","last_fullsized":"2023-08-10T10:51:51.598145+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:03.283442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591670+0000","last_change":"2023-08-10T10:51:51.602733+0000","last_active":"2023-08-10T10:51:52.591670+0000","last_peered":"2023-08-10T10:51:52.591670+0000","last_clean":"2023-08-10T10:51:52.591670+0000","last_became_active":"2023-08-10T10:51:51.600634+0000","last_became_peered":"2023-08-10T10:51:51.600634+0000","last_unstale":"2023-08-10T10:51:52.591670+0000","last_undegraded":"2023-08-10T10:51:52.591670+0000","last_fullsized":"2023-08-10T10:51:52.591670+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:34:05.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.636297+0000","last_change":"2023-08-10T10:51:50.603688+0000","last_active":"2023-08-10T10:51:51.636297+0000","last_peered":"2023-08-10T10:51:51.636297+0000","last_clean":"2023-08-10T10:51:51.636297+0000","last_became_active":"2023-08-10T10:51:50.603290+0000","last_became_peered":"2023-08-10T10:51:50.603290+0000","last_unstale":"2023-08-10T10:51:51.636297+0000","last_undegraded":"2023-08-10T10:51:51.636297+0000","last_fullsized":"2023-08-10T10:51:51.636297+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:07.296160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.626723+0000","last_change":"2023-08-10T10:51:51.626623+0000","last_active":"2023-08-10T10:51:51.626723+0000","last_peered":"2023-08-10T10:51:51.626723+0000","last_clean":"2023-08-10T10:51:51.626723+0000","last_became_active":"2023-08-10T10:51:51.626165+0000","last_became_peered":"2023-08-10T10:51:51.626165+0000","last_unstale":"2023-08-10T10:51:51.626723+0000","last_undegraded":"2023-08-10T10:51:51.626723+0000","last_fullsized":"2023-08-10T10:51:51.626723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:22.046472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595042+0000","last_change":"2023-08-10T10:51:50.612157+0000","last_active":"2023-08-10T10:51:52.595042+0000","last_peered":"2023-08-10T10:51:52.595042+0000","last_clean":"2023-08-10T10:51:52.595042+0000","last_became_active":"2023-08-10T10:51:50.611916+0000","last_became_peered":"2023-08-10T10:51:50.611916+0000","last_unstale":"2023-08-10T10:51:52.595042+0000","last_undegraded":"2023-08-10T10:51:52.595042+0000","last_fullsized":"2023-08-10T10:51:52.595042+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:04:34.412790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.622963+0000","last_change":"2023-08-10T10:51:51.622820+0000","last_active":"2023-08-10T10:51:51.622963+0000","last_peered":"2023-08-10T10:51:51.622963+0000","last_clean":"2023-08-10T10:51:51.622963+0000","last_became_active":"2023-08-10T10:51:51.622495+0000","last_became_peered":"2023-08-10T10:51:51.622495+0000","last_unstale":"2023-08-10T10:51:51.622963+0000","last_undegraded":"2023-08-10T10:51:51.622963+0000","last_fullsized":"2023-08-10T10:51:51.622963+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:41.526669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995843+0000","last_change":"2023-08-10T10:51:50.607600+0000","last_active":"2023-08-10T10:51:52.995843+0000","last_peered":"2023-08-10T10:51:52.995843+0000","last_clean":"2023-08-10T10:51:52.995843+0000","last_became_active":"2023-08-10T10:51:50.607126+0000","last_became_peered":"2023-08-10T10:51:50.607126+0000","last_unstale":"2023-08-10T10:51:52.995843+0000","last_undegraded":"2023-08-10T10:51:52.995843+0000","last_fullsized":"2023-08-10T10:51:52.995843+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:56:02.725530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840241+0000","last_change":"2023-08-10T10:51:51.619575+0000","last_active":"2023-08-10T10:51:52.840241+0000","last_peered":"2023-08-10T10:51:52.840241+0000","last_clean":"2023-08-10T10:51:52.840241+0000","last_became_active":"2023-08-10T10:51:51.619059+0000","last_became_peered":"2023-08-10T10:51:51.619059+0000","last_unstale":"2023-08-10T10:51:52.840241+0000","last_undegraded":"2023-08-10T10:51:52.840241+0000","last_fullsized":"2023-08-10T10:51:52.840241+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:55:54.525654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840255+0000","last_change":"2023-08-10T10:51:50.602972+0000","last_active":"2023-08-10T10:51:52.840255+0000","last_peered":"2023-08-10T10:51:52.840255+0000","last_clean":"2023-08-10T10:51:52.840255+0000","last_became_active":"2023-08-10T10:51:50.602552+0000","last_became_peered":"2023-08-10T10:51:50.602552+0000","last_unstale":"2023-08-10T10:51:52.840255+0000","last_undegraded":"2023-08-10T10:51:52.840255+0000","last_fullsized":"2023-08-10T10:51:52.840255+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:51:23.766706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596548+0000","last_change":"2023-08-10T10:51:51.609285+0000","last_active":"2023-08-10T10:51:52.596548+0000","last_peered":"2023-08-10T10:51:52.596548+0000","last_clean":"2023-08-10T10:51:52.596548+0000","last_became_active":"2023-08-10T10:51:51.606521+0000","last_became_peered":"2023-08-10T10:51:51.606521+0000","last_unstale":"2023-08-10T10:51:52.596548+0000","last_undegraded":"2023-08-10T10:51:52.596548+0000","last_fullsized":"2023-08-10T10:51:52.596548+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:22.712224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637022+0000","last_change":"2023-08-10T10:51:50.610828+0000","last_active":"2023-08-10T10:51:51.637022+0000","last_peered":"2023-08-10T10:51:51.637022+0000","last_clean":"2023-08-10T10:51:51.637022+0000","last_became_active":"2023-08-10T10:51:50.608799+0000","last_became_peered":"2023-08-10T10:51:50.608799+0000","last_unstale":"2023-08-10T10:51:51.637022+0000","last_undegraded":"2023-08-10T10:51:51.637022+0000","last_fullsized":"2023-08-10T10:51:51.637022+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:30:04.667491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.623247+0000","last_change":"2023-08-10T10:51:51.615983+0000","last_active":"2023-08-10T10:51:51.623247+0000","last_peered":"2023-08-10T10:51:51.623247+0000","last_clean":"2023-08-10T10:51:51.623247+0000","last_became_active":"2023-08-10T10:51:51.613644+0000","last_became_peered":"2023-08-10T10:51:51.613644+0000","last_unstale":"2023-08-10T10:51:51.623247+0000","last_undegraded":"2023-08-10T10:51:51.623247+0000","last_fullsized":"2023-08-10T10:51:51.623247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:57:28.758825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591682+0000","last_change":"2023-08-10T10:51:50.602189+0000","last_active":"2023-08-10T10:51:52.591682+0000","last_peered":"2023-08-10T10:51:52.591682+0000","last_clean":"2023-08-10T10:51:52.591682+0000","last_became_active":"2023-08-10T10:51:50.601864+0000","last_became_peered":"2023-08-10T10:51:50.601864+0000","last_unstale":"2023-08-10T10:51:52.591682+0000","last_undegraded":"2023-08-10T10:51:52.591682+0000","last_fullsized":"2023-08-10T10:51:52.591682+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:05.099459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994617+0000","last_change":"2023-08-10T10:51:51.623975+0000","last_active":"2023-08-10T10:51:52.994617+0000","last_peered":"2023-08-10T10:51:52.994617+0000","last_clean":"2023-08-10T10:51:52.994617+0000","last_became_active":"2023-08-10T10:51:51.623595+0000","last_became_peered":"2023-08-10T10:51:51.623595+0000","last_unstale":"2023-08-10T10:51:52.994617+0000","last_undegraded":"2023-08-10T10:51:52.994617+0000","last_fullsized":"2023-08-10T10:51:52.994617+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:26.631626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591211+0000","last_change":"2023-08-10T10:51:50.589828+0000","last_active":"2023-08-10T10:51:52.591211+0000","last_peered":"2023-08-10T10:51:52.591211+0000","last_clean":"2023-08-10T10:51:52.591211+0000","last_became_active":"2023-08-10T10:51:50.589288+0000","last_became_peered":"2023-08-10T10:51:50.589288+0000","last_unstale":"2023-08-10T10:51:52.591211+0000","last_undegraded":"2023-08-10T10:51:52.591211+0000","last_fullsized":"2023-08-10T10:51:52.591211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:17:47.811114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.621857+0000","last_change":"2023-08-10T10:51:51.621725+0000","last_active":"2023-08-10T10:51:51.621857+0000","last_peered":"2023-08-10T10:51:51.621857+0000","last_clean":"2023-08-10T10:51:51.621857+0000","last_became_active":"2023-08-10T10:51:51.621466+0000","last_became_peered":"2023-08-10T10:51:51.621466+0000","last_unstale":"2023-08-10T10:51:51.621857+0000","last_undegraded":"2023-08-10T10:51:51.621857+0000","last_fullsized":"2023-08-10T10:51:51.621857+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:03.899379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.996048+0000","last_change":"2023-08-10T10:51:50.610964+0000","last_active":"2023-08-10T10:51:52.996048+0000","last_peered":"2023-08-10T10:51:52.996048+0000","last_clean":"2023-08-10T10:51:52.996048+0000","last_became_active":"2023-08-10T10:51:50.610627+0000","last_became_peered":"2023-08-10T10:51:50.610627+0000","last_unstale":"2023-08-10T10:51:52.996048+0000","last_undegraded":"2023-08-10T10:51:52.996048+0000","last_fullsized":"2023-08-10T10:51:52.996048+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:32:05.420051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595157+0000","last_change":"2023-08-10T10:51:51.612427+0000","last_active":"2023-08-10T10:51:52.595157+0000","last_peered":"2023-08-10T10:51:52.595157+0000","last_clean":"2023-08-10T10:51:52.595157+0000","last_became_active":"2023-08-10T10:51:51.611991+0000","last_became_peered":"2023-08-10T10:51:51.611991+0000","last_unstale":"2023-08-10T10:51:52.595157+0000","last_undegraded":"2023-08-10T10:51:52.595157+0000","last_fullsized":"2023-08-10T10:51:52.595157+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.129620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.597019+0000","last_change":"2023-08-10T10:51:50.603167+0000","last_active":"2023-08-10T10:51:52.597019+0000","last_peered":"2023-08-10T10:51:52.597019+0000","last_clean":"2023-08-10T10:51:52.597019+0000","last_became_active":"2023-08-10T10:51:50.602810+0000","last_became_peered":"2023-08-10T10:51:50.602810+0000","last_unstale":"2023-08-10T10:51:52.597019+0000","last_undegraded":"2023-08-10T10:51:52.597019+0000","last_fullsized":"2023-08-10T10:51:52.597019+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:42.935294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839948+0000","last_change":"2023-08-10T10:51:51.616058+0000","last_active":"2023-08-10T10:51:52.839948+0000","last_peered":"2023-08-10T10:51:52.839948+0000","last_clean":"2023-08-10T10:51:52.839948+0000","last_became_active":"2023-08-10T10:51:51.615784+0000","last_became_peered":"2023-08-10T10:51:51.615784+0000","last_unstale":"2023-08-10T10:51:52.839948+0000","last_undegraded":"2023-08-10T10:51:52.839948+0000","last_fullsized":"2023-08-10T10:51:52.839948+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:25.708386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591740+0000","last_change":"2023-08-10T10:51:50.606084+0000","last_active":"2023-08-10T10:51:52.591740+0000","last_peered":"2023-08-10T10:51:52.591740+0000","last_clean":"2023-08-10T10:51:52.591740+0000","last_became_active":"2023-08-10T10:51:50.605816+0000","last_became_peered":"2023-08-10T10:51:50.605816+0000","last_unstale":"2023-08-10T10:51:52.591740+0000","last_undegraded":"2023-08-10T10:51:52.591740+0000","last_fullsized":"2023-08-10T10:51:52.591740+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:09.919412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591448+0000","last_change":"2023-08-10T10:51:51.602164+0000","last_active":"2023-08-10T10:51:52.591448+0000","last_peered":"2023-08-10T10:51:52.591448+0000","last_clean":"2023-08-10T10:51:52.591448+0000","last_became_active":"2023-08-10T10:51:51.599629+0000","last_became_peered":"2023-08-10T10:51:51.599629+0000","last_unstale":"2023-08-10T10:51:52.591448+0000","last_undegraded":"2023-08-10T10:51:52.591448+0000","last_fullsized":"2023-08-10T10:51:52.591448+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:23.542038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595916+0000","last_change":"2023-08-10T10:51:50.606745+0000","last_active":"2023-08-10T10:51:52.595916+0000","last_peered":"2023-08-10T10:51:52.595916+0000","last_clean":"2023-08-10T10:51:52.595916+0000","last_became_active":"2023-08-10T10:51:50.606466+0000","last_became_peered":"2023-08-10T10:51:50.606466+0000","last_unstale":"2023-08-10T10:51:52.595916+0000","last_undegraded":"2023-08-10T10:51:52.595916+0000","last_fullsized":"2023-08-10T10:51:52.595916+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:06:27.210767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994456+0000","last_change":"2023-08-10T10:51:51.623825+0000","last_active":"2023-08-10T10:51:52.994456+0000","last_peered":"2023-08-10T10:51:52.994456+0000","last_clean":"2023-08-10T10:51:52.994456+0000","last_became_active":"2023-08-10T10:51:51.623278+0000","last_became_peered":"2023-08-10T10:51:51.623278+0000","last_unstale":"2023-08-10T10:51:52.994456+0000","last_undegraded":"2023-08-10T10:51:52.994456+0000","last_fullsized":"2023-08-10T10:51:52.994456+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:58.174411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.607143+0000","last_change":"2023-08-10T10:51:50.605798+0000","last_active":"2023-08-10T10:51:51.607143+0000","last_peered":"2023-08-10T10:51:51.607143+0000","last_clean":"2023-08-10T10:51:51.607143+0000","last_became_active":"2023-08-10T10:51:50.605547+0000","last_became_peered":"2023-08-10T10:51:50.605547+0000","last_unstale":"2023-08-10T10:51:51.607143+0000","last_undegraded":"2023-08-10T10:51:51.607143+0000","last_fullsized":"2023-08-10T10:51:51.607143+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:51.644917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839969+0000","last_change":"2023-08-10T10:51:51.616446+0000","last_active":"2023-08-10T10:51:52.839969+0000","last_peered":"2023-08-10T10:51:52.839969+0000","last_clean":"2023-08-10T10:51:52.839969+0000","last_became_active":"2023-08-10T10:51:51.616158+0000","last_became_peered":"2023-08-10T10:51:51.616158+0000","last_unstale":"2023-08-10T10:51:52.839969+0000","last_undegraded":"2023-08-10T10:51:52.839969+0000","last_fullsized":"2023-08-10T10:51:52.839969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:34:48.807018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591577+0000","last_change":"2023-08-10T10:51:50.600236+0000","last_active":"2023-08-10T10:51:52.591577+0000","last_peered":"2023-08-10T10:51:52.591577+0000","last_clean":"2023-08-10T10:51:52.591577+0000","last_became_active":"2023-08-10T10:51:50.599893+0000","last_became_peered":"2023-08-10T10:51:50.599893+0000","last_unstale":"2023-08-10T10:51:52.591577+0000","last_undegraded":"2023-08-10T10:51:52.591577+0000","last_fullsized":"2023-08-10T10:51:52.591577+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:04.990600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":461,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840096+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:51:52.840096+0000","last_peered":"2023-08-10T10:51:52.840096+0000","last_clean":"2023-08-10T10:51:52.840096+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:51:52.840096+0000","last_undegraded":"2023-08-10T10:51:52.840096+0000","last_fullsized":"2023-08-10T10:51:52.840096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:53.028401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596911+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:51:52.596911+0000","last_peered":"2023-08-10T10:51:52.596911+0000","last_clean":"2023-08-10T10:51:52.596911+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:51:52.596911+0000","last_undegraded":"2023-08-10T10:51:52.596911+0000","last_fullsized":"2023-08-10T10:51:52.596911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:51.449108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.590898+0000","last_change":"2023-08-10T10:51:51.605603+0000","last_active":"2023-08-10T10:51:52.590898+0000","last_peered":"2023-08-10T10:51:52.590898+0000","last_clean":"2023-08-10T10:51:52.590898+0000","last_became_active":"2023-08-10T10:51:51.605027+0000","last_became_peered":"2023-08-10T10:51:51.605027+0000","last_unstale":"2023-08-10T10:51:52.590898+0000","last_undegraded":"2023-08-10T10:51:52.590898+0000","last_fullsized":"2023-08-10T10:51:52.590898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:58.706524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"187'3","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595571+0000","last_change":"2023-08-10T10:51:50.597592+0000","last_active":"2023-08-10T10:51:52.595571+0000","last_peered":"2023-08-10T10:51:52.595571+0000","last_clean":"2023-08-10T10:51:52.595571+0000","last_became_active":"2023-08-10T10:51:50.596819+0000","last_became_peered":"2023-08-10T10:51:50.596819+0000","last_unstale":"2023-08-10T10:51:52.595571+0000","last_undegraded":"2023-08-10T10:51:52.595571+0000","last_fullsized":"2023-08-10T10:51:52.595571+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:19.771255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839738+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:51:52.839738+0000","last_peered":"2023-08-10T10:51:52.839738+0000","last_clean":"2023-08-10T10:51:52.839738+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:51:52.839738+0000","last_undegraded":"2023-08-10T10:51:52.839738+0000","last_fullsized":"2023-08-10T10:51:52.839738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:11.820158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995157+0000","last_change":"2023-08-10T10:51:51.620090+0000","last_active":"2023-08-10T10:51:52.995157+0000","last_peered":"2023-08-10T10:51:52.995157+0000","last_clean":"2023-08-10T10:51:52.995157+0000","last_became_active":"2023-08-10T10:51:51.618997+0000","last_became_peered":"2023-08-10T10:51:51.618997+0000","last_unstale":"2023-08-10T10:51:52.995157+0000","last_undegraded":"2023-08-10T10:51:52.995157+0000","last_fullsized":"2023-08-10T10:51:52.995157+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:21:14.818770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"187'6","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.590894+0000","last_change":"2023-08-10T10:51:50.604734+0000","last_active":"2023-08-10T10:51:52.590894+0000","last_peered":"2023-08-10T10:51:52.590894+0000","last_clean":"2023-08-10T10:51:52.590894+0000","last_became_active":"2023-08-10T10:51:50.604082+0000","last_became_peered":"2023-08-10T10:51:50.604082+0000","last_unstale":"2023-08-10T10:51:52.590894+0000","last_undegraded":"2023-08-10T10:51:52.590894+0000","last_fullsized":"2023-08-10T10:51:52.590894+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:35.422964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995747+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:51:52.995747+0000","last_peered":"2023-08-10T10:51:52.995747+0000","last_clean":"2023-08-10T10:51:52.995747+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:51:52.995747+0000","last_undegraded":"2023-08-10T10:51:52.995747+0000","last_fullsized":"2023-08-10T10:51:52.995747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:34.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839351+0000","last_change":"2023-08-10T10:51:51.616297+0000","last_active":"2023-08-10T10:51:52.839351+0000","last_peered":"2023-08-10T10:51:52.839351+0000","last_clean":"2023-08-10T10:51:52.839351+0000","last_became_active":"2023-08-10T10:51:51.615408+0000","last_became_peered":"2023-08-10T10:51:51.615408+0000","last_unstale":"2023-08-10T10:51:52.839351+0000","last_undegraded":"2023-08-10T10:51:52.839351+0000","last_fullsized":"2023-08-10T10:51:52.839351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:37:44.628888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591545+0000","last_change":"2023-08-10T10:51:50.598514+0000","last_active":"2023-08-10T10:51:52.591545+0000","last_peered":"2023-08-10T10:51:52.591545+0000","last_clean":"2023-08-10T10:51:52.591545+0000","last_became_active":"2023-08-10T10:51:50.598245+0000","last_became_peered":"2023-08-10T10:51:50.598245+0000","last_unstale":"2023-08-10T10:51:52.591545+0000","last_undegraded":"2023-08-10T10:51:52.591545+0000","last_fullsized":"2023-08-10T10:51:52.591545+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:22.594501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596247+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:51:52.596247+0000","last_peered":"2023-08-10T10:51:52.596247+0000","last_clean":"2023-08-10T10:51:52.596247+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:51:52.596247+0000","last_undegraded":"2023-08-10T10:51:52.596247+0000","last_fullsized":"2023-08-10T10:51:52.596247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:19.054721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594749+0000","last_change":"2023-08-10T10:51:51.615336+0000","last_active":"2023-08-10T10:51:52.594749+0000","last_peered":"2023-08-10T10:51:52.594749+0000","last_clean":"2023-08-10T10:51:52.594749+0000","last_became_active":"2023-08-10T10:51:51.615087+0000","last_became_peered":"2023-08-10T10:51:51.615087+0000","last_unstale":"2023-08-10T10:51:52.594749+0000","last_undegraded":"2023-08-10T10:51:52.594749+0000","last_fullsized":"2023-08-10T10:51:52.594749+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:23.884147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594958+0000","last_change":"2023-08-10T10:51:50.601961+0000","last_active":"2023-08-10T10:51:52.594958+0000","last_peered":"2023-08-10T10:51:52.594958+0000","last_clean":"2023-08-10T10:51:52.594958+0000","last_became_active":"2023-08-10T10:51:50.601573+0000","last_became_peered":"2023-08-10T10:51:50.601573+0000","last_unstale":"2023-08-10T10:51:52.594958+0000","last_undegraded":"2023-08-10T10:51:52.594958+0000","last_fullsized":"2023-08-10T10:51:52.594958+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:20.097454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.599137+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:51:51.599137+0000","last_peered":"2023-08-10T10:51:51.599137+0000","last_clean":"2023-08-10T10:51:51.599137+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:51:51.599137+0000","last_undegraded":"2023-08-10T10:51:51.599137+0000","last_fullsized":"2023-08-10T10:51:51.599137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:27.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994920+0000","last_change":"2023-08-10T10:51:51.617747+0000","last_active":"2023-08-10T10:51:52.994920+0000","last_peered":"2023-08-10T10:51:52.994920+0000","last_clean":"2023-08-10T10:51:52.994920+0000","last_became_active":"2023-08-10T10:51:51.617250+0000","last_became_peered":"2023-08-10T10:51:51.617250+0000","last_unstale":"2023-08-10T10:51:52.994920+0000","last_undegraded":"2023-08-10T10:51:52.994920+0000","last_fullsized":"2023-08-10T10:51:52.994920+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:43.850671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"187'8","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.638668+0000","last_change":"2023-08-10T10:51:50.601886+0000","last_active":"2023-08-10T10:51:51.638668+0000","last_peered":"2023-08-10T10:51:51.638668+0000","last_clean":"2023-08-10T10:51:51.638668+0000","last_became_active":"2023-08-10T10:51:50.601409+0000","last_became_peered":"2023-08-10T10:51:50.601409+0000","last_unstale":"2023-08-10T10:51:51.638668+0000","last_undegraded":"2023-08-10T10:51:51.638668+0000","last_fullsized":"2023-08-10T10:51:51.638668+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:04:34.412790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839541+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:51:52.839541+0000","last_peered":"2023-08-10T10:51:52.839541+0000","last_clean":"2023-08-10T10:51:52.839541+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:51:52.839541+0000","last_undegraded":"2023-08-10T10:51:52.839541+0000","last_fullsized":"2023-08-10T10:51:52.839541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:13:18.249735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618153+0000","last_change":"2023-08-10T10:51:51.618027+0000","last_active":"2023-08-10T10:51:51.618153+0000","last_peered":"2023-08-10T10:51:51.618153+0000","last_clean":"2023-08-10T10:51:51.618153+0000","last_became_active":"2023-08-10T10:51:51.617599+0000","last_became_peered":"2023-08-10T10:51:51.617599+0000","last_unstale":"2023-08-10T10:51:51.618153+0000","last_undegraded":"2023-08-10T10:51:51.618153+0000","last_fullsized":"2023-08-10T10:51:51.618153+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:28.276038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.634886+0000","last_change":"2023-08-10T10:51:50.602114+0000","last_active":"2023-08-10T10:51:51.634886+0000","last_peered":"2023-08-10T10:51:51.634886+0000","last_clean":"2023-08-10T10:51:51.634886+0000","last_became_active":"2023-08-10T10:51:50.601528+0000","last_became_peered":"2023-08-10T10:51:50.601528+0000","last_unstale":"2023-08-10T10:51:51.634886+0000","last_undegraded":"2023-08-10T10:51:51.634886+0000","last_fullsized":"2023-08-10T10:51:51.634886+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:05:29.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":333,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598214+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:51:51.598214+0000","last_peered":"2023-08-10T10:51:51.598214+0000","last_clean":"2023-08-10T10:51:51.598214+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:51:51.598214+0000","last_undegraded":"2023-08-10T10:51:51.598214+0000","last_fullsized":"2023-08-10T10:51:51.598214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:52:51.765242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.614292+0000","last_change":"2023-08-10T10:51:51.614033+0000","last_active":"2023-08-10T10:51:51.614292+0000","last_peered":"2023-08-10T10:51:51.614292+0000","last_clean":"2023-08-10T10:51:51.614292+0000","last_became_active":"2023-08-10T10:51:51.611476+0000","last_became_peered":"2023-08-10T10:51:51.611476+0000","last_unstale":"2023-08-10T10:51:51.614292+0000","last_undegraded":"2023-08-10T10:51:51.614292+0000","last_fullsized":"2023-08-10T10:51:51.614292+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.113085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591737+0000","last_change":"2023-08-10T10:51:50.609952+0000","last_active":"2023-08-10T10:51:52.591737+0000","last_peered":"2023-08-10T10:51:52.591737+0000","last_clean":"2023-08-10T10:51:52.591737+0000","last_became_active":"2023-08-10T10:51:50.606636+0000","last_became_peered":"2023-08-10T10:51:50.606636+0000","last_unstale":"2023-08-10T10:51:52.591737+0000","last_undegraded":"2023-08-10T10:51:52.591737+0000","last_fullsized":"2023-08-10T10:51:52.591737+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:41.179329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":297,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.603095+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:51:51.603095+0000","last_peered":"2023-08-10T10:51:51.603095+0000","last_clean":"2023-08-10T10:51:51.603095+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:51:51.603095+0000","last_undegraded":"2023-08-10T10:51:51.603095+0000","last_fullsized":"2023-08-10T10:51:51.603095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:25.738307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575015,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193631,"statfs":{"total":200000000,"available":198278718,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2030000000000001,"15min":1.1499999999999999},"min":{"1min":0.86399999999999999,"5min":0.66600000000000004,"15min":0.39600000000000002},"max":{"1min":1.6759999999999999,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.145,"15min":1.1439999999999999},"min":{"1min":0.83499999999999996,"5min":0.72099999999999997,"15min":0.44800000000000001},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.302}]},{"osd":1,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.242,"15min":1.1899999999999999},"min":{"1min":0.96399999999999997,"5min":0.73199999999999998,"15min":0.66500000000000004},"max":{"1min":1.7549999999999999,"5min":1.778,"15min":4.6470000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2070000000000001,"15min":1.1859999999999999},"min":{"1min":0.88300000000000001,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.958,"5min":1.958,"15min":8.0830000000000002},"last":1.224}]},{"osd":2,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.1839999999999999,"15min":1.208},"min":{"1min":0.94099999999999995,"5min":0.69299999999999995,"15min":0.503},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.337,"15min":1.286},"min":{"1min":0.98799999999999999,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":0.874}]},{"osd":3,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.2569999999999999,"15min":1.2370000000000001},"min":{"1min":0.93600000000000005,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4179999999999999,"15min":1.3979999999999999},"min":{"1min":0.94899999999999995,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.867,"5min":2.266,"15min":6.069},"last":1.1890000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2430000000000001,"15min":1.2609999999999999},"min":{"1min":0.86599999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.895,"5min":2.2080000000000002,"15min":7.1950000000000003},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.196,"15min":1.2709999999999999},"min":{"1min":0.89500000000000002,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.788,"5min":1.788,"15min":7.4950000000000001},"last":1.4319999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.4159999999999999,"15min":1.4530000000000001},"min":{"1min":0.92000000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.484},{"interface":"front","average":{"1min":1.524,"5min":1.448,"15min":1.486},"min":{"1min":1.1559999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.7410000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5700000000000001,"15min":1.579},"min":{"1min":1.1639999999999999,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.1920000000000002,"5min":2.2829999999999999,"15min":8.859},"last":1.333},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.4990000000000001},"min":{"1min":1.3,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4039999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.7969999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1870000000000001,"15min":1.1160000000000001},"min":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.444,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.123,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.64900000000000002,"15min":0.46600000000000003},"max":{"1min":1.575,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1579999999999999,"15min":1.1080000000000001},"min":{"1min":0.81399999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.7609999999999999,"5min":1.764,"15min":2.302},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2849999999999999,"15min":1.2270000000000001},"min":{"1min":0.96399999999999997,"5min":0.78200000000000003,"15min":0.70099999999999996},"max":{"1min":1.647,"5min":1.6839999999999999,"15min":2.052},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2390000000000001,"15min":1.1870000000000001},"min":{"1min":0.96299999999999997,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.5289999999999999,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":1.101},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.252,"15min":1.2490000000000001},"min":{"1min":0.93899999999999995,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.415,"5min":1.976,"15min":1.976},"last":1.4299999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.3129999999999999,"15min":1.2809999999999999},"min":{"1min":0.94599999999999995,"5min":0.93100000000000005,"15min":0.69399999999999995},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":3.177},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.98699999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.796,"5min":1.9199999999999999,"15min":2.395},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.264,"15min":1.252},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.919,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.002},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4870000000000001,"15min":1.46},"min":{"1min":1.2070000000000001,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.8260000000000001,"5min":2.512,"15min":2.7589999999999999},"last":1.278}]},{"osd":5,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.423,"15min":1.4319999999999999},"min":{"1min":0.97799999999999998,"5min":0.82699999999999996,"15min":0.59399999999999997},"max":{"1min":2.0369999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.536,"15min":1.524},"min":{"1min":0.92900000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.74,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.391}]},{"osd":7,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.345,"15min":1.371},"min":{"1min":0.85399999999999998,"5min":0.84799999999999998,"15min":0.53700000000000003},"max":{"1min":1.7110000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.171},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.51,"15min":1.514},"min":{"1min":1.1559999999999999,"5min":1.05,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.355,"15min":2.698},"last":1.5549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1103,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194208,"statfs":{"total":200000000,"available":198869981,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1279999999999999},"min":{"1min":0.83199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5249999999999999,"5min":1.645,"15min":2.5070000000000001},"last":1.079},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.89200000000000002,"5min":0.70399999999999996,"15min":0.56599999999999995},"max":{"1min":1.5529999999999999,"5min":1.857,"15min":32.941000000000003},"last":1.3240000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.284,"15min":1.2270000000000001},"min":{"1min":0.89600000000000002,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.5449999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2350000000000001,"15min":1.202},"min":{"1min":0.76900000000000002,"5min":0.66400000000000003,"15min":0.62},"max":{"1min":1.772,"5min":1.772,"15min":4.3360000000000003},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.304,"15min":1.2809999999999999},"min":{"1min":1.004,"5min":0.80100000000000005,"15min":0.67500000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.167},{"interface":"front","average":{"1min":1.196,"5min":1.2330000000000001,"15min":1.194},"min":{"1min":0.80700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5860000000000001,"5min":1.734,"15min":1.734},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.329,"15min":1.2849999999999999},"min":{"1min":0.89800000000000002,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.593,"5min":2.016,"15min":2.016},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.373,"15min":1.3520000000000001},"min":{"1min":1.0229999999999999,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.891,"5min":1.891,"15min":4.0620000000000003},"last":1.054}]},{"osd":4,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.216,"15min":1.2589999999999999},"min":{"1min":0.74299999999999999,"5min":0.68000000000000005,"15min":0.58599999999999997},"max":{"1min":1.7290000000000001,"5min":1.7969999999999999,"15min":4.9859999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.411,"15min":1.377},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.58099999999999996},"max":{"1min":1.768,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.482,"15min":1.3999999999999999},"min":{"1min":0.90300000000000002,"5min":0.67700000000000005,"15min":0.54200000000000004},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4239999999999999,"15min":1.415},"min":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7010000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.6000000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.53,"15min":1.502},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.63100000000000001},"max":{"1min":1.6899999999999999,"5min":2.0659999999999998,"15min":2.403},"last":1.496},{"interface":"front","average":{"1min":1.496,"5min":1.5780000000000001,"15min":1.5269999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":2.0569999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.359}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1105,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194207,"statfs":{"total":200000000,"available":198868322,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.1950000000000001,"15min":1.157},"min":{"1min":0.89000000000000001,"5min":0.79100000000000004,"15min":0.54200000000000004},"max":{"1min":1.573,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.24,"5min":1.2010000000000001,"15min":1.194},"min":{"1min":0.89400000000000002,"5min":0.68400000000000005,"15min":0.55600000000000005},"max":{"1min":1.724,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.26},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6659999999999999,"5min":1.841,"15min":3.9820000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.274,"5min":1.2370000000000001,"15min":1.1699999999999999},"min":{"1min":0.82399999999999995,"5min":0.72299999999999998,"15min":0.58499999999999996},"max":{"1min":1.661,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.5920000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2490000000000001,"15min":1.2030000000000001},"min":{"1min":0.81499999999999995,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.6359999999999999,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3400000000000001,"15min":1.3200000000000001},"min":{"1min":0.94499999999999995,"5min":0.82299999999999995,"15min":0.70499999999999996},"max":{"1min":1.6759999999999999,"5min":1.8500000000000001,"15min":4.226},"last":0.997}]},{"osd":3,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.262,"15min":1.26},"min":{"1min":0.81299999999999994,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.645,"5min":1.7649999999999999,"15min":3.8130000000000002},"last":1.377},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3460000000000001,"15min":1.319},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.67000000000000004},"max":{"1min":1.78,"5min":1.792,"15min":4.6859999999999999},"last":1.4359999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.3380000000000001},"min":{"1min":0.98099999999999998,"5min":0.73499999999999999,"15min":0.64300000000000002},"max":{"1min":1.819,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.141},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.96399999999999997,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.732,"5min":1.911,"15min":2.9340000000000002},"last":1.4750000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3700000000000001,"15min":1.345},"min":{"1min":0.89600000000000002,"5min":0.68100000000000005,"15min":0.47099999999999997},"max":{"1min":1.8540000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.518},{"interface":"front","average":{"1min":1.538,"5min":1.5069999999999999,"15min":1.494},"min":{"1min":1.048,"5min":0.93100000000000005,"15min":0.55000000000000004},"max":{"1min":1.9610000000000001,"5min":2.121,"15min":5.1529999999999996},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.4870000000000001,"15min":1.4590000000000001},"min":{"1min":1.0469999999999999,"5min":1.024,"15min":0.57999999999999996},"max":{"1min":1.8879999999999999,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.546},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.5980000000000001,"15min":1.5489999999999999},"min":{"1min":1.131,"5min":0.875,"15min":0.67400000000000004},"max":{"1min":2.016,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.6399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866918,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":0.92200000000000004},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.375,"5min":2.722,"15min":2.722},"last":1.105},{"interface":"front","average":{"1min":1.274,"5min":1.1930000000000001,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.831,"5min":2.883,"15min":2.883},"last":1.5620000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.016,"15min":0.92800000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.3640000000000001,"5min":1.885,"15min":1.885},"last":0.745},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1579999999999999,"15min":1.0529999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.139,"15min":1.04},"min":{"1min":0.432,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":2.1480000000000001,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.341,"15min":1.1950000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.7210000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.022}]},{"osd":4,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4219999999999999,"15min":1.355},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.9930000000000001,"5min":2.766,"15min":9.8149999999999995},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.292,"15min":1.2509999999999999},"min":{"1min":0.94599999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.72,"5min":2.0390000000000001,"15min":2.5179999999999998},"last":1.617}]},{"osd":5,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.516,"15min":1.413},"min":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8069999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.4930000000000001,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":2.7200000000000002,"5min":2.774,"15min":4.2069999999999999},"last":1.6899999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.419,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.71,"5min":2.129,"15min":2.6560000000000001},"last":1.738},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5980000000000001,"15min":1.4850000000000001},"min":{"1min":1.0189999999999999,"5min":0.749,"15min":0.749},"max":{"1min":2.0529999999999999,"5min":2.964,"15min":2.964},"last":1.4590000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.599,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.4990000000000001,"5min":2.677,"15min":2.677},"last":1.798},{"interface":"front","average":{"1min":1.494,"5min":1.5309999999999999,"15min":1.4279999999999999},"min":{"1min":1.0449999999999999,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":1.8859999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.4910000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575015,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.4670000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.98799999999999999,"15min":0.94999999999999996},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.443},"max":{"1min":1.5269999999999999,"5min":1.825,"15min":1.825},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1299999999999999,"15min":1.087},"min":{"1min":0.78500000000000003,"5min":0.48199999999999998,"15min":0.34999999999999998},"max":{"1min":1.599,"5min":1.6759999999999999,"15min":1.9630000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.248,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.6879999999999999,"5min":1.9179999999999999,"15min":2.0310000000000001},"last":1.159}]},{"osd":3,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.044,"15min":1.004},"min":{"1min":0.754,"5min":0.55500000000000005,"15min":0.50900000000000001},"max":{"1min":1.633,"5min":1.877,"15min":1.877},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1890000000000001,"15min":1.2010000000000001},"min":{"1min":0.86399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5269999999999999,"5min":1.839,"15min":3.6920000000000002},"last":1.21}]},{"osd":4,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.405,"15min":1.3959999999999999},"min":{"1min":1.127,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7490000000000001,"5min":1.9099999999999999,"15min":2.6000000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3640000000000001,"15min":1.3340000000000001},"min":{"1min":1.02,"5min":0.92900000000000005,"15min":0.64200000000000002},"max":{"1min":1.706,"5min":1.968,"15min":4.2220000000000004},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.335,"15min":1.2949999999999999},"min":{"1min":1.052,"5min":0.84899999999999998,"15min":0.66600000000000004},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":2.2280000000000002},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":1.198,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.802,"5min":1.9870000000000001,"15min":3.294},"last":1.591}]},{"osd":6,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4570000000000001,"15min":1.423},"min":{"1min":1.121,"5min":0.88900000000000001,"15min":0.81599999999999995},"max":{"1min":1.839,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4159999999999999,"15min":1.383},"min":{"1min":0.98799999999999999,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.839,"5min":1.907,"15min":2.444},"last":1.5449999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.51,"15min":1.47},"min":{"1min":1.077,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":1.913,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.919},{"interface":"front","average":{"1min":1.51,"5min":1.496,"15min":1.4530000000000001},"min":{"1min":1.1579999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9930000000000001,"5min":2.0950000000000002,"15min":2.556},"last":1.4810000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.91400000000000003,"15min":0.874},"min":{"1min":0.74099999999999999,"5min":0.441,"15min":0.33100000000000002},"max":{"1min":1.2050000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.76700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.611,"5min":1.706,"15min":2.246},"last":1.196}]},{"osd":2,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.044,"15min":0.97999999999999998},"min":{"1min":0.71299999999999997,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.925,"5min":1.925,"15min":2.0209999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.282,"15min":1.1879999999999999},"min":{"1min":1.016,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.423},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.206,"15min":1.1439999999999999},"min":{"1min":0.97499999999999998,"5min":0.624,"15min":0.45400000000000001},"max":{"1min":1.6359999999999999,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.171,"15min":1.0940000000000001},"min":{"1min":0.98299999999999998,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.079}]},{"osd":4,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.2829999999999999,"15min":1.2430000000000001},"min":{"1min":0.95799999999999996,"5min":0.84799999999999998,"15min":0.65500000000000003},"max":{"1min":1.694,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.157},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.478,"15min":1.4419999999999999},"min":{"1min":1.2969999999999999,"5min":0.83299999999999996,"15min":0.72599999999999998},"max":{"1min":1.732,"5min":2.0499999999999998,"15min":2.343},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.452,"15min":1.411},"min":{"1min":1.1100000000000001,"5min":0.83499999999999996,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.4650000000000001,"15min":1.3999999999999999},"min":{"1min":1.222,"5min":0.89600000000000002,"15min":0.71699999999999997},"max":{"1min":2.0790000000000002,"5min":2.5009999999999999,"15min":2.73},"last":1.349}]},{"osd":6,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4470000000000001,"15min":1.411},"min":{"1min":1.2450000000000001,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.724,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.4350000000000001,"15min":1.365},"min":{"1min":1.1299999999999999,"5min":0.93300000000000005,"15min":0.77300000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.5980000000000001,"15min":1.504},"min":{"1min":1.194,"5min":0.81100000000000005,"15min":0.70199999999999996},"max":{"1min":2.0960000000000001,"5min":7.798,"15min":7.798},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.534,"15min":1.476},"min":{"1min":1.3600000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":1.8720000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.4750000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575015,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1673,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193638,"statfs":{"total":200000000,"available":198286286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.46200000000000002,"15min":0.28100000000000003},"max":{"1min":1.55,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.133,"15min":1.113},"min":{"1min":0.71699999999999997,"5min":0.48399999999999999,"15min":0.434},"max":{"1min":1.73,"5min":1.73,"15min":11.173},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.05,"15min":1.0329999999999999},"min":{"1min":0.79600000000000004,"5min":0.54700000000000004,"15min":0.39000000000000001},"max":{"1min":1.4830000000000001,"5min":1.6499999999999999,"15min":2.7240000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.0580000000000001},"min":{"1min":0.78300000000000003,"5min":0.54400000000000004,"15min":0.47399999999999998},"max":{"1min":1.6599999999999999,"5min":1.875,"15min":1.875},"last":1.921}]},{"osd":3,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0409999999999999,"15min":1.02},"min":{"1min":0.76200000000000001,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":1.5609999999999999,"5min":1.796,"15min":5.9980000000000002},"last":0.997},{"interface":"front","average":{"1min":1.292,"5min":1.246,"15min":1.2090000000000001},"min":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":10.739000000000001},"last":1.4910000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3500000000000001,"15min":1.3460000000000001},"min":{"1min":1.032,"5min":0.88100000000000001,"15min":0.73199999999999998},"max":{"1min":1.8440000000000001,"5min":2.0019999999999998,"15min":6.5209999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.468},"min":{"1min":1.165,"5min":0.98199999999999998,"15min":0.751},"max":{"1min":1.9399999999999999,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.3919999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.397,"15min":1.379},"min":{"1min":1.0409999999999999,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.7370000000000001,"5min":2.238,"15min":2.238},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.3700000000000001,"15min":1.421},"min":{"1min":1.0449999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8620000000000001,"5min":1.9890000000000001,"15min":16.058},"last":1.458}]},{"osd":6,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.536,"15min":1.486},"min":{"1min":1.2,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":2.0230000000000001,"5min":2.375,"15min":2.4790000000000001},"last":1.159},{"interface":"front","average":{"1min":1.526,"5min":1.506,"15min":1.4610000000000001},"min":{"1min":1.1339999999999999,"5min":0.86499999999999999,"15min":0.754},"max":{"1min":1.917,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.5840000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.5700000000000001,"15min":1.536},"min":{"1min":1.1259999999999999,"5min":0.95099999999999996,"15min":0.752},"max":{"1min":2.0779999999999998,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.819},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.482,"15min":1.478},"min":{"1min":1.155,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0219999999999998,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.3049999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:51:56.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:51:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.384+0000 7fae4e064640 1 Processor -- start 2023-08-10T10:51:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.384+0000 7fae4e064640 1 -- start start 2023-08-10T10:51:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae4e064640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae480b0c60 0x7fae480c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae4e064640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae480b3f30 0x7fae480c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae4e064640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae48071c70 con 0x7fae4815aa40 2023-08-10T10:51:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae4e064640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480713d0 con 0x7fae480b3f30 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae4e064640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480716b0 con 0x7fae480b0c60 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae47fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae480b3f30 0x7fae480c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae477fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae4815aa40 0x7fae480b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48392/0 (socket says 172.21.15.50:48392) 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.386+0000 7fae47fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae480b3f30 0x7fae480c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51756/0 (socket says 172.21.15.50:51756) 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae477fe640 1 -- 172.21.15.50:0/2720410270 learned_addr learned my addr 172.21.15.50:0/2720410270 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae46ffd640 1 --2- 172.21.15.50:0/2720410270 >> v2:172.21.15.117:3300/0 conn(0x7fae480b0c60 0x7fae480c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae47fff640 1 -- 172.21.15.50:0/2720410270 >> v2:172.21.15.117:3300/0 conn(0x7fae480b0c60 msgr2=0x7fae480c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae47fff640 1 --2- 172.21.15.50:0/2720410270 >> v2:172.21.15.117:3300/0 conn(0x7fae480b0c60 0x7fae480c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae47fff640 1 -- 172.21.15.50:0/2720410270 >> v1:172.21.15.50:6789/0 conn(0x7fae4815aa40 legacy=0x7fae480b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.387+0000 7fae47fff640 1 -- 172.21.15.50:0/2720410270 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48071990 con 0x7fae480b3f30 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.388+0000 7fae47fff640 1 --2- 172.21.15.50:0/2720410270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae480b3f30 0x7fae480c9e60 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fae4815e6e0 tx=0x7fae4002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd68830a7b63a7d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae467fc640 1 -- 172.21.15.50:0/2720410270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4002cbe0 con 0x7fae480b3f30 2023-08-10T10:51:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae467fc640 1 -- 172.21.15.50:0/2720410270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4002cd40 con 0x7fae480b3f30 2023-08-10T10:51:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae467fc640 1 -- 172.21.15.50:0/2720410270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40034660 con 0x7fae480b3f30 2023-08-10T10:51:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 -- 172.21.15.50:0/2720410270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae480b3f30 msgr2=0x7fae480c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 --2- 172.21.15.50:0/2720410270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae480b3f30 0x7fae480c9e60 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fae4815e6e0 tx=0x7fae4002be30 comp rx=0 tx=0).stop 2023-08-10T10:51:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 -- 172.21.15.50:0/2720410270 shutdown_connections 2023-08-10T10:51:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 --2- 172.21.15.50:0/2720410270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae480b3f30 0x7fae480c9e60 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 --2- 172.21.15.50:0/2720410270 >> v2:172.21.15.117:3300/0 conn(0x7fae480b0c60 0x7fae480c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.389+0000 7fae4e064640 1 -- 172.21.15.50:0/2720410270 >> 172.21.15.50:0/2720410270 conn(0x7fae4806b590 msgr2=0x7fae480ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.390+0000 7fae4e064640 1 -- 172.21.15.50:0/2720410270 shutdown_connections 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.390+0000 7fae4e064640 1 -- 172.21.15.50:0/2720410270 wait complete. 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.391+0000 7fae4e064640 1 Processor -- start 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.392+0000 7fae4e064640 1 -- start start 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.392+0000 7fae4e064640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 0x7fae48148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.392+0000 7fae4e064640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 0x7fae481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae4e064640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae4e064640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480c7780 con 0x7fae4815aa40 2023-08-10T10:51:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae4e064640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae48149150 con 0x7fae480b0c60 2023-08-10T10:51:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae4e064640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae481f6210 con 0x7fae480b3f30 2023-08-10T10:51:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51758/0 (socket says 172.21.15.50:51758) 2023-08-10T10:51:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 -- 172.21.15.50:0/594402181 learned_addr learned my addr 172.21.15.50:0/594402181 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae477fe640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 0x7fae48148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae46ffd640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 0x7fae481595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 -- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 msgr2=0x7fae481595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 0x7fae481595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 -- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 msgr2=0x7fae48148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 0x7fae48148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae47fff640 1 -- 172.21.15.50:0/594402181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40009a70 con 0x7fae4815aa40 2023-08-10T10:51:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae477fe640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 0x7fae48148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.393+0000 7fae46ffd640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 0x7fae481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae47fff640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fae40009e80 tx=0x7fae40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40040650 con 0x7fae4815aa40 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae400407d0 con 0x7fae4815aa40 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40040b80 con 0x7fae4815aa40 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae480c74a0 con 0x7fae4815aa40 2023-08-10T10:51:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.394+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae481f5ea0 con 0x7fae4815aa40 2023-08-10T10:51:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.395+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae481f5a20 con 0x7fae4815aa40 2023-08-10T10:51:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.396+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae40040ce0 con 0x7fae4815aa40 2023-08-10T10:51:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.398+0000 7fae2ffff640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 0x7fae3406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.398+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae400ac3d0 con 0x7fae4815aa40 2023-08-10T10:51:56.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.398+0000 7fae477fe640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 0x7fae3406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.399+0000 7fae477fe640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 0x7fae3406d110 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fae38005880 tx=0x7fae38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.402+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae481f5a20 con 0x7fae4815aa40 2023-08-10T10:51:56.539 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-08-10T10:51:56.538+0000 7fa9db45c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:51:56.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.590+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae480c9400 con 0x7fae3406ac50 2023-08-10T10:51:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.614+0000 7fae2ffff640 1 -- 172.21.15.50:0/594402181 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303107 (secure 0 0 0) 0x7fae38001c40 con 0x7fae3406ac50 2023-08-10T10:51:56.619 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:51:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 msgr2=0x7fae3406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 0x7fae3406d110 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fae38005880 tx=0x7fae38009040 comp rx=0 tx=0).stop 2023-08-10T10:51:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 msgr2=0x7fae48159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fae40009e80 tx=0x7fae40004a40 comp rx=0 tx=0).stop 2023-08-10T10:51:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 shutdown_connections 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae4815aa40 0x7fae48159b20 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae480b3f30 0x7fae481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fae3406ac50 0x7fae3406d110 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 --2- 172.21.15.50:0/594402181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae480b0c60 0x7fae48148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.621+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 >> 172.21.15.50:0/594402181 conn(0x7fae4806b590 msgr2=0x7fae480ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.622+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 shutdown_connections 2023-08-10T10:51:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.622+0000 7fae4e064640 1 -- 172.21.15.50:0/594402181 wait complete. 2023-08-10T10:51:56.644 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-08-10T10:51:54.609905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9964,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552535,"statfs":{"total":1600000000,"available":1589795878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046480"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596188+0000","last_change":"2023-08-10T10:51:51.611864+0000","last_active":"2023-08-10T10:51:52.596188+0000","last_peered":"2023-08-10T10:51:52.596188+0000","last_clean":"2023-08-10T10:51:52.596188+0000","last_became_active":"2023-08-10T10:51:51.608610+0000","last_became_peered":"2023-08-10T10:51:51.608610+0000","last_unstale":"2023-08-10T10:51:52.596188+0000","last_undegraded":"2023-08-10T10:51:52.596188+0000","last_fullsized":"2023-08-10T10:51:52.596188+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:25.009982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839172+0000","last_change":"2023-08-10T10:51:51.611969+0000","last_active":"2023-08-10T10:51:52.839172+0000","last_peered":"2023-08-10T10:51:52.839172+0000","last_clean":"2023-08-10T10:51:52.839172+0000","last_became_active":"2023-08-10T10:51:51.611041+0000","last_became_peered":"2023-08-10T10:51:51.611041+0000","last_unstale":"2023-08-10T10:51:52.839172+0000","last_undegraded":"2023-08-10T10:51:52.839172+0000","last_fullsized":"2023-08-10T10:51:52.839172+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:42:47.001036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594714+0000","last_change":"2023-08-10T10:51:51.614135+0000","last_active":"2023-08-10T10:51:52.594714+0000","last_peered":"2023-08-10T10:51:52.594714+0000","last_clean":"2023-08-10T10:51:52.594714+0000","last_became_active":"2023-08-10T10:51:51.613750+0000","last_became_peered":"2023-08-10T10:51:51.613750+0000","last_unstale":"2023-08-10T10:51:52.594714+0000","last_undegraded":"2023-08-10T10:51:52.594714+0000","last_fullsized":"2023-08-10T10:51:52.594714+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:51.571069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594751+0000","last_change":"2023-08-10T10:51:51.605339+0000","last_active":"2023-08-10T10:51:52.594751+0000","last_peered":"2023-08-10T10:51:52.594751+0000","last_clean":"2023-08-10T10:51:52.594751+0000","last_became_active":"2023-08-10T10:51:51.597888+0000","last_became_peered":"2023-08-10T10:51:51.597888+0000","last_unstale":"2023-08-10T10:51:52.594751+0000","last_undegraded":"2023-08-10T10:51:52.594751+0000","last_fullsized":"2023-08-10T10:51:52.594751+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:09:57.736853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618905+0000","last_change":"2023-08-10T10:51:51.618692+0000","last_active":"2023-08-10T10:51:51.618905+0000","last_peered":"2023-08-10T10:51:51.618905+0000","last_clean":"2023-08-10T10:51:51.618905+0000","last_became_active":"2023-08-10T10:51:51.618300+0000","last_became_peered":"2023-08-10T10:51:51.618300+0000","last_unstale":"2023-08-10T10:51:51.618905+0000","last_undegraded":"2023-08-10T10:51:51.618905+0000","last_fullsized":"2023-08-10T10:51:51.618905+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:02.790553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839553+0000","last_change":"2023-08-10T10:51:51.613707+0000","last_active":"2023-08-10T10:51:52.839553+0000","last_peered":"2023-08-10T10:51:52.839553+0000","last_clean":"2023-08-10T10:51:52.839553+0000","last_became_active":"2023-08-10T10:51:51.613458+0000","last_became_peered":"2023-08-10T10:51:51.613458+0000","last_unstale":"2023-08-10T10:51:52.839553+0000","last_undegraded":"2023-08-10T10:51:52.839553+0000","last_fullsized":"2023-08-10T10:51:52.839553+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:15:45.423769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.621821+0000","last_change":"2023-08-10T10:51:51.617797+0000","last_active":"2023-08-10T10:51:51.621821+0000","last_peered":"2023-08-10T10:51:51.621821+0000","last_clean":"2023-08-10T10:51:51.621821+0000","last_became_active":"2023-08-10T10:51:51.617370+0000","last_became_peered":"2023-08-10T10:51:51.617370+0000","last_unstale":"2023-08-10T10:51:51.621821+0000","last_undegraded":"2023-08-10T10:51:51.621821+0000","last_fullsized":"2023-08-10T10:51:51.621821+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:44:50.014836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.613151+0000","last_change":"2023-08-10T10:51:51.612884+0000","last_active":"2023-08-10T10:51:51.613151+0000","last_peered":"2023-08-10T10:51:51.613151+0000","last_clean":"2023-08-10T10:51:51.613151+0000","last_became_active":"2023-08-10T10:51:51.607808+0000","last_became_peered":"2023-08-10T10:51:51.607808+0000","last_unstale":"2023-08-10T10:51:51.613151+0000","last_undegraded":"2023-08-10T10:51:51.613151+0000","last_fullsized":"2023-08-10T10:51:51.613151+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:37.054776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625841+0000","last_change":"2023-08-10T10:51:51.625651+0000","last_active":"2023-08-10T10:51:51.625841+0000","last_peered":"2023-08-10T10:51:51.625841+0000","last_clean":"2023-08-10T10:51:51.625841+0000","last_became_active":"2023-08-10T10:51:51.619644+0000","last_became_peered":"2023-08-10T10:51:51.619644+0000","last_unstale":"2023-08-10T10:51:51.625841+0000","last_undegraded":"2023-08-10T10:51:51.625841+0000","last_fullsized":"2023-08-10T10:51:51.625841+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:36:29.806550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625777+0000","last_change":"2023-08-10T10:51:51.625604+0000","last_active":"2023-08-10T10:51:51.625777+0000","last_peered":"2023-08-10T10:51:51.625777+0000","last_clean":"2023-08-10T10:51:51.625777+0000","last_became_active":"2023-08-10T10:51:51.625061+0000","last_became_peered":"2023-08-10T10:51:51.625061+0000","last_unstale":"2023-08-10T10:51:51.625777+0000","last_undegraded":"2023-08-10T10:51:51.625777+0000","last_fullsized":"2023-08-10T10:51:51.625777+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:12:56.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595876+0000","last_change":"2023-08-10T10:51:51.613495+0000","last_active":"2023-08-10T10:51:52.595876+0000","last_peered":"2023-08-10T10:51:52.595876+0000","last_clean":"2023-08-10T10:51:52.595876+0000","last_became_active":"2023-08-10T10:51:51.612202+0000","last_became_peered":"2023-08-10T10:51:51.612202+0000","last_unstale":"2023-08-10T10:51:52.595876+0000","last_undegraded":"2023-08-10T10:51:52.595876+0000","last_fullsized":"2023-08-10T10:51:52.595876+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:04.299073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840065+0000","last_change":"2023-08-10T10:51:51.615711+0000","last_active":"2023-08-10T10:51:52.840065+0000","last_peered":"2023-08-10T10:51:52.840065+0000","last_clean":"2023-08-10T10:51:52.840065+0000","last_became_active":"2023-08-10T10:51:51.615449+0000","last_became_peered":"2023-08-10T10:51:51.615449+0000","last_unstale":"2023-08-10T10:51:52.840065+0000","last_undegraded":"2023-08-10T10:51:52.840065+0000","last_fullsized":"2023-08-10T10:51:52.840065+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:42:26.980247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591461+0000","last_change":"2023-08-10T10:51:51.614553+0000","last_active":"2023-08-10T10:51:52.591461+0000","last_peered":"2023-08-10T10:51:52.591461+0000","last_clean":"2023-08-10T10:51:52.591461+0000","last_became_active":"2023-08-10T10:51:51.613585+0000","last_became_peered":"2023-08-10T10:51:51.613585+0000","last_unstale":"2023-08-10T10:51:52.591461+0000","last_undegraded":"2023-08-10T10:51:52.591461+0000","last_fullsized":"2023-08-10T10:51:52.591461+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:35.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625464+0000","last_change":"2023-08-10T10:51:51.625377+0000","last_active":"2023-08-10T10:51:51.625464+0000","last_peered":"2023-08-10T10:51:51.625464+0000","last_clean":"2023-08-10T10:51:51.625464+0000","last_became_active":"2023-08-10T10:51:51.624984+0000","last_became_peered":"2023-08-10T10:51:51.624984+0000","last_unstale":"2023-08-10T10:51:51.625464+0000","last_undegraded":"2023-08-10T10:51:51.625464+0000","last_fullsized":"2023-08-10T10:51:51.625464+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:29.602916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596158+0000","last_change":"2023-08-10T10:51:51.609109+0000","last_active":"2023-08-10T10:51:52.596158+0000","last_peered":"2023-08-10T10:51:52.596158+0000","last_clean":"2023-08-10T10:51:52.596158+0000","last_became_active":"2023-08-10T10:51:51.608567+0000","last_became_peered":"2023-08-10T10:51:51.608567+0000","last_unstale":"2023-08-10T10:51:52.596158+0000","last_undegraded":"2023-08-10T10:51:52.596158+0000","last_fullsized":"2023-08-10T10:51:52.596158+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:12.923694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596473+0000","last_change":"2023-08-10T10:51:51.615881+0000","last_active":"2023-08-10T10:51:52.596473+0000","last_peered":"2023-08-10T10:51:52.596473+0000","last_clean":"2023-08-10T10:51:52.596473+0000","last_became_active":"2023-08-10T10:51:51.612901+0000","last_became_peered":"2023-08-10T10:51:51.612901+0000","last_unstale":"2023-08-10T10:51:52.596473+0000","last_undegraded":"2023-08-10T10:51:52.596473+0000","last_fullsized":"2023-08-10T10:51:52.596473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:07.343362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.614873+0000","last_change":"2023-08-10T10:51:51.614746+0000","last_active":"2023-08-10T10:51:51.614873+0000","last_peered":"2023-08-10T10:51:51.614873+0000","last_clean":"2023-08-10T10:51:51.614873+0000","last_became_active":"2023-08-10T10:51:51.614353+0000","last_became_peered":"2023-08-10T10:51:51.614353+0000","last_unstale":"2023-08-10T10:51:51.614873+0000","last_undegraded":"2023-08-10T10:51:51.614873+0000","last_fullsized":"2023-08-10T10:51:51.614873+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:38.421756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.623586+0000","last_change":"2023-08-10T10:51:51.623526+0000","last_active":"2023-08-10T10:51:51.623586+0000","last_peered":"2023-08-10T10:51:51.623586+0000","last_clean":"2023-08-10T10:51:51.623586+0000","last_became_active":"2023-08-10T10:51:51.623335+0000","last_became_peered":"2023-08-10T10:51:51.623335+0000","last_unstale":"2023-08-10T10:51:51.623586+0000","last_undegraded":"2023-08-10T10:51:51.623586+0000","last_fullsized":"2023-08-10T10:51:51.623586+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:04.877612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594386+0000","last_change":"2023-08-10T10:51:51.605552+0000","last_active":"2023-08-10T10:51:52.594386+0000","last_peered":"2023-08-10T10:51:52.594386+0000","last_clean":"2023-08-10T10:51:52.594386+0000","last_became_active":"2023-08-10T10:51:51.605161+0000","last_became_peered":"2023-08-10T10:51:51.605161+0000","last_unstale":"2023-08-10T10:51:52.594386+0000","last_undegraded":"2023-08-10T10:51:52.594386+0000","last_fullsized":"2023-08-10T10:51:52.594386+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:03.899379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995291+0000","last_change":"2023-08-10T10:51:51.616439+0000","last_active":"2023-08-10T10:51:52.995291+0000","last_peered":"2023-08-10T10:51:52.995291+0000","last_clean":"2023-08-10T10:51:52.995291+0000","last_became_active":"2023-08-10T10:51:51.616170+0000","last_became_peered":"2023-08-10T10:51:51.616170+0000","last_unstale":"2023-08-10T10:51:52.995291+0000","last_undegraded":"2023-08-10T10:51:52.995291+0000","last_fullsized":"2023-08-10T10:51:52.995291+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:48:51.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591341+0000","last_change":"2023-08-10T10:51:51.610909+0000","last_active":"2023-08-10T10:51:52.591341+0000","last_peered":"2023-08-10T10:51:52.591341+0000","last_clean":"2023-08-10T10:51:52.591341+0000","last_became_active":"2023-08-10T10:51:51.610361+0000","last_became_peered":"2023-08-10T10:51:51.610361+0000","last_unstale":"2023-08-10T10:51:52.591341+0000","last_undegraded":"2023-08-10T10:51:52.591341+0000","last_fullsized":"2023-08-10T10:51:52.591341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:59:25.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839526+0000","last_change":"2023-08-10T10:51:51.619332+0000","last_active":"2023-08-10T10:51:52.839526+0000","last_peered":"2023-08-10T10:51:52.839526+0000","last_clean":"2023-08-10T10:51:52.839526+0000","last_became_active":"2023-08-10T10:51:51.618192+0000","last_became_peered":"2023-08-10T10:51:51.618192+0000","last_unstale":"2023-08-10T10:51:52.839526+0000","last_undegraded":"2023-08-10T10:51:52.839526+0000","last_fullsized":"2023-08-10T10:51:52.839526+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:27.694468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.616904+0000","last_change":"2023-08-10T10:51:51.616782+0000","last_active":"2023-08-10T10:51:51.616904+0000","last_peered":"2023-08-10T10:51:51.616904+0000","last_clean":"2023-08-10T10:51:51.616904+0000","last_became_active":"2023-08-10T10:51:51.615424+0000","last_became_peered":"2023-08-10T10:51:51.615424+0000","last_unstale":"2023-08-10T10:51:51.616904+0000","last_undegraded":"2023-08-10T10:51:51.616904+0000","last_fullsized":"2023-08-10T10:51:51.616904+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:23.796511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595115+0000","last_change":"2023-08-10T10:51:51.606377+0000","last_active":"2023-08-10T10:51:52.595115+0000","last_peered":"2023-08-10T10:51:52.595115+0000","last_clean":"2023-08-10T10:51:52.595115+0000","last_became_active":"2023-08-10T10:51:51.606006+0000","last_became_peered":"2023-08-10T10:51:51.606006+0000","last_unstale":"2023-08-10T10:51:52.595115+0000","last_undegraded":"2023-08-10T10:51:52.595115+0000","last_fullsized":"2023-08-10T10:51:52.595115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:10.229201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591267+0000","last_change":"2023-08-10T10:51:51.603277+0000","last_active":"2023-08-10T10:51:52.591267+0000","last_peered":"2023-08-10T10:51:52.591267+0000","last_clean":"2023-08-10T10:51:52.591267+0000","last_became_active":"2023-08-10T10:51:51.601525+0000","last_became_peered":"2023-08-10T10:51:51.601525+0000","last_unstale":"2023-08-10T10:51:52.591267+0000","last_undegraded":"2023-08-10T10:51:52.591267+0000","last_fullsized":"2023-08-10T10:51:52.591267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:16.968729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995015+0000","last_change":"2023-08-10T10:51:51.619697+0000","last_active":"2023-08-10T10:51:52.995015+0000","last_peered":"2023-08-10T10:51:52.995015+0000","last_clean":"2023-08-10T10:51:52.995015+0000","last_became_active":"2023-08-10T10:51:51.619121+0000","last_became_peered":"2023-08-10T10:51:51.619121+0000","last_unstale":"2023-08-10T10:51:52.995015+0000","last_undegraded":"2023-08-10T10:51:52.995015+0000","last_fullsized":"2023-08-10T10:51:52.995015+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:25:10.590830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839885+0000","last_change":"2023-08-10T10:51:51.619483+0000","last_active":"2023-08-10T10:51:52.839885+0000","last_peered":"2023-08-10T10:51:52.839885+0000","last_clean":"2023-08-10T10:51:52.839885+0000","last_became_active":"2023-08-10T10:51:51.618725+0000","last_became_peered":"2023-08-10T10:51:51.618725+0000","last_unstale":"2023-08-10T10:51:52.839885+0000","last_undegraded":"2023-08-10T10:51:52.839885+0000","last_fullsized":"2023-08-10T10:51:52.839885+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:11:30.959097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591190+0000","last_change":"2023-08-10T10:51:51.599129+0000","last_active":"2023-08-10T10:51:52.591190+0000","last_peered":"2023-08-10T10:51:52.591190+0000","last_clean":"2023-08-10T10:51:52.591190+0000","last_became_active":"2023-08-10T10:51:51.598364+0000","last_became_peered":"2023-08-10T10:51:51.598364+0000","last_unstale":"2023-08-10T10:51:52.591190+0000","last_undegraded":"2023-08-10T10:51:52.591190+0000","last_fullsized":"2023-08-10T10:51:52.591190+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:15:42.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839399+0000","last_change":"2023-08-10T10:51:51.627143+0000","last_active":"2023-08-10T10:51:52.839399+0000","last_peered":"2023-08-10T10:51:52.839399+0000","last_clean":"2023-08-10T10:51:52.839399+0000","last_became_active":"2023-08-10T10:51:51.626919+0000","last_became_peered":"2023-08-10T10:51:51.626919+0000","last_unstale":"2023-08-10T10:51:52.839399+0000","last_undegraded":"2023-08-10T10:51:52.839399+0000","last_fullsized":"2023-08-10T10:51:52.839399+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:10.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.615198+0000","last_change":"2023-08-10T10:51:51.614653+0000","last_active":"2023-08-10T10:51:51.615198+0000","last_peered":"2023-08-10T10:51:51.615198+0000","last_clean":"2023-08-10T10:51:51.615198+0000","last_became_active":"2023-08-10T10:51:51.614391+0000","last_became_peered":"2023-08-10T10:51:51.614391+0000","last_unstale":"2023-08-10T10:51:51.615198+0000","last_undegraded":"2023-08-10T10:51:51.615198+0000","last_fullsized":"2023-08-10T10:51:51.615198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:14:17.545879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596214+0000","last_change":"2023-08-10T10:51:51.604927+0000","last_active":"2023-08-10T10:51:52.596214+0000","last_peered":"2023-08-10T10:51:52.596214+0000","last_clean":"2023-08-10T10:51:52.596214+0000","last_became_active":"2023-08-10T10:51:51.604233+0000","last_became_peered":"2023-08-10T10:51:51.604233+0000","last_unstale":"2023-08-10T10:51:52.596214+0000","last_undegraded":"2023-08-10T10:51:52.596214+0000","last_fullsized":"2023-08-10T10:51:52.596214+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:03.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.615177+0000","last_change":"2023-08-10T10:51:51.614550+0000","last_active":"2023-08-10T10:51:51.615177+0000","last_peered":"2023-08-10T10:51:51.615177+0000","last_clean":"2023-08-10T10:51:51.615177+0000","last_became_active":"2023-08-10T10:51:51.614273+0000","last_became_peered":"2023-08-10T10:51:51.614273+0000","last_unstale":"2023-08-10T10:51:51.615177+0000","last_undegraded":"2023-08-10T10:51:51.615177+0000","last_fullsized":"2023-08-10T10:51:51.615177+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:54.818759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839066+0000","last_change":"2023-08-10T10:51:51.615300+0000","last_active":"2023-08-10T10:51:52.839066+0000","last_peered":"2023-08-10T10:51:52.839066+0000","last_clean":"2023-08-10T10:51:52.839066+0000","last_became_active":"2023-08-10T10:51:51.615008+0000","last_became_peered":"2023-08-10T10:51:51.615008+0000","last_unstale":"2023-08-10T10:51:52.839066+0000","last_undegraded":"2023-08-10T10:51:52.839066+0000","last_fullsized":"2023-08-10T10:51:52.839066+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:59.108140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"187'4","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595223+0000","last_change":"2023-08-10T10:51:50.604506+0000","last_active":"2023-08-10T10:51:52.595223+0000","last_peered":"2023-08-10T10:51:52.595223+0000","last_clean":"2023-08-10T10:51:52.595223+0000","last_became_active":"2023-08-10T10:51:50.604160+0000","last_became_peered":"2023-08-10T10:51:50.604160+0000","last_unstale":"2023-08-10T10:51:52.595223+0000","last_undegraded":"2023-08-10T10:51:52.595223+0000","last_fullsized":"2023-08-10T10:51:52.595223+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:33.717376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591367+0000","last_change":"2023-08-10T10:51:51.613481+0000","last_active":"2023-08-10T10:51:52.591367+0000","last_peered":"2023-08-10T10:51:52.591367+0000","last_clean":"2023-08-10T10:51:52.591367+0000","last_became_active":"2023-08-10T10:51:51.613089+0000","last_became_peered":"2023-08-10T10:51:51.613089+0000","last_unstale":"2023-08-10T10:51:52.591367+0000","last_undegraded":"2023-08-10T10:51:52.591367+0000","last_fullsized":"2023-08-10T10:51:52.591367+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:28.683224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637944+0000","last_change":"2023-08-10T10:51:50.610055+0000","last_active":"2023-08-10T10:51:51.637944+0000","last_peered":"2023-08-10T10:51:51.637944+0000","last_clean":"2023-08-10T10:51:51.637944+0000","last_became_active":"2023-08-10T10:51:50.609660+0000","last_became_peered":"2023-08-10T10:51:50.609660+0000","last_unstale":"2023-08-10T10:51:51.637944+0000","last_undegraded":"2023-08-10T10:51:51.637944+0000","last_fullsized":"2023-08-10T10:51:51.637944+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:57:36.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618039+0000","last_change":"2023-08-10T10:51:51.617952+0000","last_active":"2023-08-10T10:51:51.618039+0000","last_peered":"2023-08-10T10:51:51.618039+0000","last_clean":"2023-08-10T10:51:51.618039+0000","last_became_active":"2023-08-10T10:51:51.617703+0000","last_became_peered":"2023-08-10T10:51:51.617703+0000","last_unstale":"2023-08-10T10:51:51.618039+0000","last_undegraded":"2023-08-10T10:51:51.618039+0000","last_fullsized":"2023-08-10T10:51:51.618039+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:17.664245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596512+0000","last_change":"2023-08-10T10:51:50.605538+0000","last_active":"2023-08-10T10:51:52.596512+0000","last_peered":"2023-08-10T10:51:52.596512+0000","last_clean":"2023-08-10T10:51:52.596512+0000","last_became_active":"2023-08-10T10:51:50.605175+0000","last_became_peered":"2023-08-10T10:51:50.605175+0000","last_unstale":"2023-08-10T10:51:52.596512+0000","last_undegraded":"2023-08-10T10:51:52.596512+0000","last_fullsized":"2023-08-10T10:51:52.596512+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:10.482055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839744+0000","last_change":"2023-08-10T10:51:51.616517+0000","last_active":"2023-08-10T10:51:52.839744+0000","last_peered":"2023-08-10T10:51:52.839744+0000","last_clean":"2023-08-10T10:51:52.839744+0000","last_became_active":"2023-08-10T10:51:51.615954+0000","last_became_peered":"2023-08-10T10:51:51.615954+0000","last_unstale":"2023-08-10T10:51:52.839744+0000","last_undegraded":"2023-08-10T10:51:52.839744+0000","last_fullsized":"2023-08-10T10:51:52.839744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:45.782516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995375+0000","last_change":"2023-08-10T10:51:50.605949+0000","last_active":"2023-08-10T10:51:52.995375+0000","last_peered":"2023-08-10T10:51:52.995375+0000","last_clean":"2023-08-10T10:51:52.995375+0000","last_became_active":"2023-08-10T10:51:50.605677+0000","last_became_peered":"2023-08-10T10:51:50.605677+0000","last_unstale":"2023-08-10T10:51:52.995375+0000","last_undegraded":"2023-08-10T10:51:52.995375+0000","last_fullsized":"2023-08-10T10:51:52.995375+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:16:04.814789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.625459+0000","last_change":"2023-08-10T10:51:51.625357+0000","last_active":"2023-08-10T10:51:51.625459+0000","last_peered":"2023-08-10T10:51:51.625459+0000","last_clean":"2023-08-10T10:51:51.625459+0000","last_became_active":"2023-08-10T10:51:51.611951+0000","last_became_peered":"2023-08-10T10:51:51.611951+0000","last_unstale":"2023-08-10T10:51:51.625459+0000","last_undegraded":"2023-08-10T10:51:51.625459+0000","last_fullsized":"2023-08-10T10:51:51.625459+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:55.347104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637370+0000","last_change":"2023-08-10T10:51:50.605520+0000","last_active":"2023-08-10T10:51:51.637370+0000","last_peered":"2023-08-10T10:51:51.637370+0000","last_clean":"2023-08-10T10:51:51.637370+0000","last_became_active":"2023-08-10T10:51:50.604522+0000","last_became_peered":"2023-08-10T10:51:50.604522+0000","last_unstale":"2023-08-10T10:51:51.637370+0000","last_undegraded":"2023-08-10T10:51:51.637370+0000","last_fullsized":"2023-08-10T10:51:51.637370+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:22.868516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995288+0000","last_change":"2023-08-10T10:51:51.624720+0000","last_active":"2023-08-10T10:51:52.995288+0000","last_peered":"2023-08-10T10:51:52.995288+0000","last_clean":"2023-08-10T10:51:52.995288+0000","last_became_active":"2023-08-10T10:51:51.622428+0000","last_became_peered":"2023-08-10T10:51:51.622428+0000","last_unstale":"2023-08-10T10:51:52.995288+0000","last_undegraded":"2023-08-10T10:51:52.995288+0000","last_fullsized":"2023-08-10T10:51:52.995288+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:26:38.765449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.636423+0000","last_change":"2023-08-10T10:51:50.611907+0000","last_active":"2023-08-10T10:51:51.636423+0000","last_peered":"2023-08-10T10:51:51.636423+0000","last_clean":"2023-08-10T10:51:51.636423+0000","last_became_active":"2023-08-10T10:51:50.611603+0000","last_became_peered":"2023-08-10T10:51:50.611603+0000","last_unstale":"2023-08-10T10:51:51.636423+0000","last_undegraded":"2023-08-10T10:51:51.636423+0000","last_fullsized":"2023-08-10T10:51:51.636423+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:57:44.362181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995491+0000","last_change":"2023-08-10T10:51:51.616960+0000","last_active":"2023-08-10T10:51:52.995491+0000","last_peered":"2023-08-10T10:51:52.995491+0000","last_clean":"2023-08-10T10:51:52.995491+0000","last_became_active":"2023-08-10T10:51:51.616652+0000","last_became_peered":"2023-08-10T10:51:51.616652+0000","last_unstale":"2023-08-10T10:51:52.995491+0000","last_undegraded":"2023-08-10T10:51:52.995491+0000","last_fullsized":"2023-08-10T10:51:52.995491+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:36.996141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994759+0000","last_change":"2023-08-10T10:51:50.609005+0000","last_active":"2023-08-10T10:51:52.994759+0000","last_peered":"2023-08-10T10:51:52.994759+0000","last_clean":"2023-08-10T10:51:52.994759+0000","last_became_active":"2023-08-10T10:51:50.608759+0000","last_became_peered":"2023-08-10T10:51:50.608759+0000","last_unstale":"2023-08-10T10:51:52.994759+0000","last_undegraded":"2023-08-10T10:51:52.994759+0000","last_fullsized":"2023-08-10T10:51:52.994759+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:35.176011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596762+0000","last_change":"2023-08-10T10:51:51.609009+0000","last_active":"2023-08-10T10:51:52.596762+0000","last_peered":"2023-08-10T10:51:52.596762+0000","last_clean":"2023-08-10T10:51:52.596762+0000","last_became_active":"2023-08-10T10:51:51.606871+0000","last_became_peered":"2023-08-10T10:51:51.606871+0000","last_unstale":"2023-08-10T10:51:52.596762+0000","last_undegraded":"2023-08-10T10:51:52.596762+0000","last_fullsized":"2023-08-10T10:51:52.596762+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:35.038814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598323+0000","last_change":"2023-08-10T10:51:50.604447+0000","last_active":"2023-08-10T10:51:51.598323+0000","last_peered":"2023-08-10T10:51:51.598323+0000","last_clean":"2023-08-10T10:51:51.598323+0000","last_became_active":"2023-08-10T10:51:50.604206+0000","last_became_peered":"2023-08-10T10:51:50.604206+0000","last_unstale":"2023-08-10T10:51:51.598323+0000","last_undegraded":"2023-08-10T10:51:51.598323+0000","last_fullsized":"2023-08-10T10:51:51.598323+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:05.871559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.626082+0000","last_change":"2023-08-10T10:51:51.625981+0000","last_active":"2023-08-10T10:51:51.626082+0000","last_peered":"2023-08-10T10:51:51.626082+0000","last_clean":"2023-08-10T10:51:51.626082+0000","last_became_active":"2023-08-10T10:51:51.620155+0000","last_became_peered":"2023-08-10T10:51:51.620155+0000","last_unstale":"2023-08-10T10:51:51.626082+0000","last_undegraded":"2023-08-10T10:51:51.626082+0000","last_fullsized":"2023-08-10T10:51:51.626082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:10.599787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591064+0000","last_change":"2023-08-10T10:51:50.604878+0000","last_active":"2023-08-10T10:51:52.591064+0000","last_peered":"2023-08-10T10:51:52.591064+0000","last_clean":"2023-08-10T10:51:52.591064+0000","last_became_active":"2023-08-10T10:51:50.604429+0000","last_became_peered":"2023-08-10T10:51:50.604429+0000","last_unstale":"2023-08-10T10:51:52.591064+0000","last_undegraded":"2023-08-10T10:51:52.591064+0000","last_fullsized":"2023-08-10T10:51:52.591064+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:47.102878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.608474+0000","last_change":"2023-08-10T10:51:51.608374+0000","last_active":"2023-08-10T10:51:51.608474+0000","last_peered":"2023-08-10T10:51:51.608474+0000","last_clean":"2023-08-10T10:51:51.608474+0000","last_became_active":"2023-08-10T10:51:51.608072+0000","last_became_peered":"2023-08-10T10:51:51.608072+0000","last_unstale":"2023-08-10T10:51:51.608474+0000","last_undegraded":"2023-08-10T10:51:51.608474+0000","last_fullsized":"2023-08-10T10:51:51.608474+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:32.345032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637657+0000","last_change":"2023-08-10T10:51:50.611176+0000","last_active":"2023-08-10T10:51:51.637657+0000","last_peered":"2023-08-10T10:51:51.637657+0000","last_clean":"2023-08-10T10:51:51.637657+0000","last_became_active":"2023-08-10T10:51:50.609741+0000","last_became_peered":"2023-08-10T10:51:50.609741+0000","last_unstale":"2023-08-10T10:51:51.637657+0000","last_undegraded":"2023-08-10T10:51:51.637657+0000","last_fullsized":"2023-08-10T10:51:51.637657+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:11.908062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596040+0000","last_change":"2023-08-10T10:51:51.600450+0000","last_active":"2023-08-10T10:51:52.596040+0000","last_peered":"2023-08-10T10:51:52.596040+0000","last_clean":"2023-08-10T10:51:52.596040+0000","last_became_active":"2023-08-10T10:51:51.599820+0000","last_became_peered":"2023-08-10T10:51:51.599820+0000","last_unstale":"2023-08-10T10:51:52.596040+0000","last_undegraded":"2023-08-10T10:51:52.596040+0000","last_fullsized":"2023-08-10T10:51:52.596040+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:06.887190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"187'1","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.635608+0000","last_change":"2023-08-10T10:51:50.607177+0000","last_active":"2023-08-10T10:51:51.635608+0000","last_peered":"2023-08-10T10:51:51.635608+0000","last_clean":"2023-08-10T10:51:51.635608+0000","last_became_active":"2023-08-10T10:51:50.606806+0000","last_became_peered":"2023-08-10T10:51:50.606806+0000","last_unstale":"2023-08-10T10:51:51.635608+0000","last_undegraded":"2023-08-10T10:51:51.635608+0000","last_fullsized":"2023-08-10T10:51:51.635608+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:24:05.240953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596798+0000","last_change":"2023-08-10T10:51:51.613008+0000","last_active":"2023-08-10T10:51:52.596798+0000","last_peered":"2023-08-10T10:51:52.596798+0000","last_clean":"2023-08-10T10:51:52.596798+0000","last_became_active":"2023-08-10T10:51:51.611453+0000","last_became_peered":"2023-08-10T10:51:51.611453+0000","last_unstale":"2023-08-10T10:51:52.596798+0000","last_undegraded":"2023-08-10T10:51:52.596798+0000","last_fullsized":"2023-08-10T10:51:52.596798+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:03.116172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598145+0000","last_change":"2023-08-10T10:51:50.605874+0000","last_active":"2023-08-10T10:51:51.598145+0000","last_peered":"2023-08-10T10:51:51.598145+0000","last_clean":"2023-08-10T10:51:51.598145+0000","last_became_active":"2023-08-10T10:51:50.605011+0000","last_became_peered":"2023-08-10T10:51:50.605011+0000","last_unstale":"2023-08-10T10:51:51.598145+0000","last_undegraded":"2023-08-10T10:51:51.598145+0000","last_fullsized":"2023-08-10T10:51:51.598145+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:09:03.283442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591670+0000","last_change":"2023-08-10T10:51:51.602733+0000","last_active":"2023-08-10T10:51:52.591670+0000","last_peered":"2023-08-10T10:51:52.591670+0000","last_clean":"2023-08-10T10:51:52.591670+0000","last_became_active":"2023-08-10T10:51:51.600634+0000","last_became_peered":"2023-08-10T10:51:51.600634+0000","last_unstale":"2023-08-10T10:51:52.591670+0000","last_undegraded":"2023-08-10T10:51:52.591670+0000","last_fullsized":"2023-08-10T10:51:52.591670+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:34:05.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.636297+0000","last_change":"2023-08-10T10:51:50.603688+0000","last_active":"2023-08-10T10:51:51.636297+0000","last_peered":"2023-08-10T10:51:51.636297+0000","last_clean":"2023-08-10T10:51:51.636297+0000","last_became_active":"2023-08-10T10:51:50.603290+0000","last_became_peered":"2023-08-10T10:51:50.603290+0000","last_unstale":"2023-08-10T10:51:51.636297+0000","last_undegraded":"2023-08-10T10:51:51.636297+0000","last_fullsized":"2023-08-10T10:51:51.636297+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:07.296160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.626723+0000","last_change":"2023-08-10T10:51:51.626623+0000","last_active":"2023-08-10T10:51:51.626723+0000","last_peered":"2023-08-10T10:51:51.626723+0000","last_clean":"2023-08-10T10:51:51.626723+0000","last_became_active":"2023-08-10T10:51:51.626165+0000","last_became_peered":"2023-08-10T10:51:51.626165+0000","last_unstale":"2023-08-10T10:51:51.626723+0000","last_undegraded":"2023-08-10T10:51:51.626723+0000","last_fullsized":"2023-08-10T10:51:51.626723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:22.046472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595042+0000","last_change":"2023-08-10T10:51:50.612157+0000","last_active":"2023-08-10T10:51:52.595042+0000","last_peered":"2023-08-10T10:51:52.595042+0000","last_clean":"2023-08-10T10:51:52.595042+0000","last_became_active":"2023-08-10T10:51:50.611916+0000","last_became_peered":"2023-08-10T10:51:50.611916+0000","last_unstale":"2023-08-10T10:51:52.595042+0000","last_undegraded":"2023-08-10T10:51:52.595042+0000","last_fullsized":"2023-08-10T10:51:52.595042+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:04:34.412790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.622963+0000","last_change":"2023-08-10T10:51:51.622820+0000","last_active":"2023-08-10T10:51:51.622963+0000","last_peered":"2023-08-10T10:51:51.622963+0000","last_clean":"2023-08-10T10:51:51.622963+0000","last_became_active":"2023-08-10T10:51:51.622495+0000","last_became_peered":"2023-08-10T10:51:51.622495+0000","last_unstale":"2023-08-10T10:51:51.622963+0000","last_undegraded":"2023-08-10T10:51:51.622963+0000","last_fullsized":"2023-08-10T10:51:51.622963+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:41.526669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995843+0000","last_change":"2023-08-10T10:51:50.607600+0000","last_active":"2023-08-10T10:51:52.995843+0000","last_peered":"2023-08-10T10:51:52.995843+0000","last_clean":"2023-08-10T10:51:52.995843+0000","last_became_active":"2023-08-10T10:51:50.607126+0000","last_became_peered":"2023-08-10T10:51:50.607126+0000","last_unstale":"2023-08-10T10:51:52.995843+0000","last_undegraded":"2023-08-10T10:51:52.995843+0000","last_fullsized":"2023-08-10T10:51:52.995843+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:56:02.725530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840241+0000","last_change":"2023-08-10T10:51:51.619575+0000","last_active":"2023-08-10T10:51:52.840241+0000","last_peered":"2023-08-10T10:51:52.840241+0000","last_clean":"2023-08-10T10:51:52.840241+0000","last_became_active":"2023-08-10T10:51:51.619059+0000","last_became_peered":"2023-08-10T10:51:51.619059+0000","last_unstale":"2023-08-10T10:51:52.840241+0000","last_undegraded":"2023-08-10T10:51:52.840241+0000","last_fullsized":"2023-08-10T10:51:52.840241+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:55:54.525654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840255+0000","last_change":"2023-08-10T10:51:50.602972+0000","last_active":"2023-08-10T10:51:52.840255+0000","last_peered":"2023-08-10T10:51:52.840255+0000","last_clean":"2023-08-10T10:51:52.840255+0000","last_became_active":"2023-08-10T10:51:50.602552+0000","last_became_peered":"2023-08-10T10:51:50.602552+0000","last_unstale":"2023-08-10T10:51:52.840255+0000","last_undegraded":"2023-08-10T10:51:52.840255+0000","last_fullsized":"2023-08-10T10:51:52.840255+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:51:23.766706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596548+0000","last_change":"2023-08-10T10:51:51.609285+0000","last_active":"2023-08-10T10:51:52.596548+0000","last_peered":"2023-08-10T10:51:52.596548+0000","last_clean":"2023-08-10T10:51:52.596548+0000","last_became_active":"2023-08-10T10:51:51.606521+0000","last_became_peered":"2023-08-10T10:51:51.606521+0000","last_unstale":"2023-08-10T10:51:52.596548+0000","last_undegraded":"2023-08-10T10:51:52.596548+0000","last_fullsized":"2023-08-10T10:51:52.596548+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:22.712224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.637022+0000","last_change":"2023-08-10T10:51:50.610828+0000","last_active":"2023-08-10T10:51:51.637022+0000","last_peered":"2023-08-10T10:51:51.637022+0000","last_clean":"2023-08-10T10:51:51.637022+0000","last_became_active":"2023-08-10T10:51:50.608799+0000","last_became_peered":"2023-08-10T10:51:50.608799+0000","last_unstale":"2023-08-10T10:51:51.637022+0000","last_undegraded":"2023-08-10T10:51:51.637022+0000","last_fullsized":"2023-08-10T10:51:51.637022+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:30:04.667491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.623247+0000","last_change":"2023-08-10T10:51:51.615983+0000","last_active":"2023-08-10T10:51:51.623247+0000","last_peered":"2023-08-10T10:51:51.623247+0000","last_clean":"2023-08-10T10:51:51.623247+0000","last_became_active":"2023-08-10T10:51:51.613644+0000","last_became_peered":"2023-08-10T10:51:51.613644+0000","last_unstale":"2023-08-10T10:51:51.623247+0000","last_undegraded":"2023-08-10T10:51:51.623247+0000","last_fullsized":"2023-08-10T10:51:51.623247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:57:28.758825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591682+0000","last_change":"2023-08-10T10:51:50.602189+0000","last_active":"2023-08-10T10:51:52.591682+0000","last_peered":"2023-08-10T10:51:52.591682+0000","last_clean":"2023-08-10T10:51:52.591682+0000","last_became_active":"2023-08-10T10:51:50.601864+0000","last_became_peered":"2023-08-10T10:51:50.601864+0000","last_unstale":"2023-08-10T10:51:52.591682+0000","last_undegraded":"2023-08-10T10:51:52.591682+0000","last_fullsized":"2023-08-10T10:51:52.591682+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:05.099459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994617+0000","last_change":"2023-08-10T10:51:51.623975+0000","last_active":"2023-08-10T10:51:52.994617+0000","last_peered":"2023-08-10T10:51:52.994617+0000","last_clean":"2023-08-10T10:51:52.994617+0000","last_became_active":"2023-08-10T10:51:51.623595+0000","last_became_peered":"2023-08-10T10:51:51.623595+0000","last_unstale":"2023-08-10T10:51:52.994617+0000","last_undegraded":"2023-08-10T10:51:52.994617+0000","last_fullsized":"2023-08-10T10:51:52.994617+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:26.631626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591211+0000","last_change":"2023-08-10T10:51:50.589828+0000","last_active":"2023-08-10T10:51:52.591211+0000","last_peered":"2023-08-10T10:51:52.591211+0000","last_clean":"2023-08-10T10:51:52.591211+0000","last_became_active":"2023-08-10T10:51:50.589288+0000","last_became_peered":"2023-08-10T10:51:50.589288+0000","last_unstale":"2023-08-10T10:51:52.591211+0000","last_undegraded":"2023-08-10T10:51:52.591211+0000","last_fullsized":"2023-08-10T10:51:52.591211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:17:47.811114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.621857+0000","last_change":"2023-08-10T10:51:51.621725+0000","last_active":"2023-08-10T10:51:51.621857+0000","last_peered":"2023-08-10T10:51:51.621857+0000","last_clean":"2023-08-10T10:51:51.621857+0000","last_became_active":"2023-08-10T10:51:51.621466+0000","last_became_peered":"2023-08-10T10:51:51.621466+0000","last_unstale":"2023-08-10T10:51:51.621857+0000","last_undegraded":"2023-08-10T10:51:51.621857+0000","last_fullsized":"2023-08-10T10:51:51.621857+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:03.899379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.996048+0000","last_change":"2023-08-10T10:51:50.610964+0000","last_active":"2023-08-10T10:51:52.996048+0000","last_peered":"2023-08-10T10:51:52.996048+0000","last_clean":"2023-08-10T10:51:52.996048+0000","last_became_active":"2023-08-10T10:51:50.610627+0000","last_became_peered":"2023-08-10T10:51:50.610627+0000","last_unstale":"2023-08-10T10:51:52.996048+0000","last_undegraded":"2023-08-10T10:51:52.996048+0000","last_fullsized":"2023-08-10T10:51:52.996048+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:32:05.420051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595157+0000","last_change":"2023-08-10T10:51:51.612427+0000","last_active":"2023-08-10T10:51:52.595157+0000","last_peered":"2023-08-10T10:51:52.595157+0000","last_clean":"2023-08-10T10:51:52.595157+0000","last_became_active":"2023-08-10T10:51:51.611991+0000","last_became_peered":"2023-08-10T10:51:51.611991+0000","last_unstale":"2023-08-10T10:51:52.595157+0000","last_undegraded":"2023-08-10T10:51:52.595157+0000","last_fullsized":"2023-08-10T10:51:52.595157+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:16.129620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.597019+0000","last_change":"2023-08-10T10:51:50.603167+0000","last_active":"2023-08-10T10:51:52.597019+0000","last_peered":"2023-08-10T10:51:52.597019+0000","last_clean":"2023-08-10T10:51:52.597019+0000","last_became_active":"2023-08-10T10:51:50.602810+0000","last_became_peered":"2023-08-10T10:51:50.602810+0000","last_unstale":"2023-08-10T10:51:52.597019+0000","last_undegraded":"2023-08-10T10:51:52.597019+0000","last_fullsized":"2023-08-10T10:51:52.597019+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:42.935294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839948+0000","last_change":"2023-08-10T10:51:51.616058+0000","last_active":"2023-08-10T10:51:52.839948+0000","last_peered":"2023-08-10T10:51:52.839948+0000","last_clean":"2023-08-10T10:51:52.839948+0000","last_became_active":"2023-08-10T10:51:51.615784+0000","last_became_peered":"2023-08-10T10:51:51.615784+0000","last_unstale":"2023-08-10T10:51:52.839948+0000","last_undegraded":"2023-08-10T10:51:52.839948+0000","last_fullsized":"2023-08-10T10:51:52.839948+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:12:25.708386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591740+0000","last_change":"2023-08-10T10:51:50.606084+0000","last_active":"2023-08-10T10:51:52.591740+0000","last_peered":"2023-08-10T10:51:52.591740+0000","last_clean":"2023-08-10T10:51:52.591740+0000","last_became_active":"2023-08-10T10:51:50.605816+0000","last_became_peered":"2023-08-10T10:51:50.605816+0000","last_unstale":"2023-08-10T10:51:52.591740+0000","last_undegraded":"2023-08-10T10:51:52.591740+0000","last_fullsized":"2023-08-10T10:51:52.591740+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:09.919412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591448+0000","last_change":"2023-08-10T10:51:51.602164+0000","last_active":"2023-08-10T10:51:52.591448+0000","last_peered":"2023-08-10T10:51:52.591448+0000","last_clean":"2023-08-10T10:51:52.591448+0000","last_became_active":"2023-08-10T10:51:51.599629+0000","last_became_peered":"2023-08-10T10:51:51.599629+0000","last_unstale":"2023-08-10T10:51:52.591448+0000","last_undegraded":"2023-08-10T10:51:52.591448+0000","last_fullsized":"2023-08-10T10:51:52.591448+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:23.542038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595916+0000","last_change":"2023-08-10T10:51:50.606745+0000","last_active":"2023-08-10T10:51:52.595916+0000","last_peered":"2023-08-10T10:51:52.595916+0000","last_clean":"2023-08-10T10:51:52.595916+0000","last_became_active":"2023-08-10T10:51:50.606466+0000","last_became_peered":"2023-08-10T10:51:50.606466+0000","last_unstale":"2023-08-10T10:51:52.595916+0000","last_undegraded":"2023-08-10T10:51:52.595916+0000","last_fullsized":"2023-08-10T10:51:52.595916+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:06:27.210767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994456+0000","last_change":"2023-08-10T10:51:51.623825+0000","last_active":"2023-08-10T10:51:52.994456+0000","last_peered":"2023-08-10T10:51:52.994456+0000","last_clean":"2023-08-10T10:51:52.994456+0000","last_became_active":"2023-08-10T10:51:51.623278+0000","last_became_peered":"2023-08-10T10:51:51.623278+0000","last_unstale":"2023-08-10T10:51:52.994456+0000","last_undegraded":"2023-08-10T10:51:52.994456+0000","last_fullsized":"2023-08-10T10:51:52.994456+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:58.174411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.607143+0000","last_change":"2023-08-10T10:51:50.605798+0000","last_active":"2023-08-10T10:51:51.607143+0000","last_peered":"2023-08-10T10:51:51.607143+0000","last_clean":"2023-08-10T10:51:51.607143+0000","last_became_active":"2023-08-10T10:51:50.605547+0000","last_became_peered":"2023-08-10T10:51:50.605547+0000","last_unstale":"2023-08-10T10:51:51.607143+0000","last_undegraded":"2023-08-10T10:51:51.607143+0000","last_fullsized":"2023-08-10T10:51:51.607143+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:51.644917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839969+0000","last_change":"2023-08-10T10:51:51.616446+0000","last_active":"2023-08-10T10:51:52.839969+0000","last_peered":"2023-08-10T10:51:52.839969+0000","last_clean":"2023-08-10T10:51:52.839969+0000","last_became_active":"2023-08-10T10:51:51.616158+0000","last_became_peered":"2023-08-10T10:51:51.616158+0000","last_unstale":"2023-08-10T10:51:52.839969+0000","last_undegraded":"2023-08-10T10:51:52.839969+0000","last_fullsized":"2023-08-10T10:51:52.839969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:34:48.807018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591577+0000","last_change":"2023-08-10T10:51:50.600236+0000","last_active":"2023-08-10T10:51:52.591577+0000","last_peered":"2023-08-10T10:51:52.591577+0000","last_clean":"2023-08-10T10:51:52.591577+0000","last_became_active":"2023-08-10T10:51:50.599893+0000","last_became_peered":"2023-08-10T10:51:50.599893+0000","last_unstale":"2023-08-10T10:51:52.591577+0000","last_undegraded":"2023-08-10T10:51:52.591577+0000","last_fullsized":"2023-08-10T10:51:52.591577+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:04.990600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":461,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.840096+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:51:52.840096+0000","last_peered":"2023-08-10T10:51:52.840096+0000","last_clean":"2023-08-10T10:51:52.840096+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:51:52.840096+0000","last_undegraded":"2023-08-10T10:51:52.840096+0000","last_fullsized":"2023-08-10T10:51:52.840096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:53.028401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596911+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:51:52.596911+0000","last_peered":"2023-08-10T10:51:52.596911+0000","last_clean":"2023-08-10T10:51:52.596911+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:51:52.596911+0000","last_undegraded":"2023-08-10T10:51:52.596911+0000","last_fullsized":"2023-08-10T10:51:52.596911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:51.449108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.590898+0000","last_change":"2023-08-10T10:51:51.605603+0000","last_active":"2023-08-10T10:51:52.590898+0000","last_peered":"2023-08-10T10:51:52.590898+0000","last_clean":"2023-08-10T10:51:52.590898+0000","last_became_active":"2023-08-10T10:51:51.605027+0000","last_became_peered":"2023-08-10T10:51:51.605027+0000","last_unstale":"2023-08-10T10:51:52.590898+0000","last_undegraded":"2023-08-10T10:51:52.590898+0000","last_fullsized":"2023-08-10T10:51:52.590898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:58.706524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"187'3","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.595571+0000","last_change":"2023-08-10T10:51:50.597592+0000","last_active":"2023-08-10T10:51:52.595571+0000","last_peered":"2023-08-10T10:51:52.595571+0000","last_clean":"2023-08-10T10:51:52.595571+0000","last_became_active":"2023-08-10T10:51:50.596819+0000","last_became_peered":"2023-08-10T10:51:50.596819+0000","last_unstale":"2023-08-10T10:51:52.595571+0000","last_undegraded":"2023-08-10T10:51:52.595571+0000","last_fullsized":"2023-08-10T10:51:52.595571+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:19.771255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839738+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:51:52.839738+0000","last_peered":"2023-08-10T10:51:52.839738+0000","last_clean":"2023-08-10T10:51:52.839738+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:51:52.839738+0000","last_undegraded":"2023-08-10T10:51:52.839738+0000","last_fullsized":"2023-08-10T10:51:52.839738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:11.820158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995157+0000","last_change":"2023-08-10T10:51:51.620090+0000","last_active":"2023-08-10T10:51:52.995157+0000","last_peered":"2023-08-10T10:51:52.995157+0000","last_clean":"2023-08-10T10:51:52.995157+0000","last_became_active":"2023-08-10T10:51:51.618997+0000","last_became_peered":"2023-08-10T10:51:51.618997+0000","last_unstale":"2023-08-10T10:51:52.995157+0000","last_undegraded":"2023-08-10T10:51:52.995157+0000","last_fullsized":"2023-08-10T10:51:52.995157+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:21:14.818770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"187'6","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.590894+0000","last_change":"2023-08-10T10:51:50.604734+0000","last_active":"2023-08-10T10:51:52.590894+0000","last_peered":"2023-08-10T10:51:52.590894+0000","last_clean":"2023-08-10T10:51:52.590894+0000","last_became_active":"2023-08-10T10:51:50.604082+0000","last_became_peered":"2023-08-10T10:51:50.604082+0000","last_unstale":"2023-08-10T10:51:52.590894+0000","last_undegraded":"2023-08-10T10:51:52.590894+0000","last_fullsized":"2023-08-10T10:51:52.590894+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:35.422964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.995747+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:51:52.995747+0000","last_peered":"2023-08-10T10:51:52.995747+0000","last_clean":"2023-08-10T10:51:52.995747+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:51:52.995747+0000","last_undegraded":"2023-08-10T10:51:52.995747+0000","last_fullsized":"2023-08-10T10:51:52.995747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:34.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839351+0000","last_change":"2023-08-10T10:51:51.616297+0000","last_active":"2023-08-10T10:51:52.839351+0000","last_peered":"2023-08-10T10:51:52.839351+0000","last_clean":"2023-08-10T10:51:52.839351+0000","last_became_active":"2023-08-10T10:51:51.615408+0000","last_became_peered":"2023-08-10T10:51:51.615408+0000","last_unstale":"2023-08-10T10:51:52.839351+0000","last_undegraded":"2023-08-10T10:51:52.839351+0000","last_fullsized":"2023-08-10T10:51:52.839351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:37:44.628888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591545+0000","last_change":"2023-08-10T10:51:50.598514+0000","last_active":"2023-08-10T10:51:52.591545+0000","last_peered":"2023-08-10T10:51:52.591545+0000","last_clean":"2023-08-10T10:51:52.591545+0000","last_became_active":"2023-08-10T10:51:50.598245+0000","last_became_peered":"2023-08-10T10:51:50.598245+0000","last_unstale":"2023-08-10T10:51:52.591545+0000","last_undegraded":"2023-08-10T10:51:52.591545+0000","last_fullsized":"2023-08-10T10:51:52.591545+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:22.594501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.596247+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:51:52.596247+0000","last_peered":"2023-08-10T10:51:52.596247+0000","last_clean":"2023-08-10T10:51:52.596247+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:51:52.596247+0000","last_undegraded":"2023-08-10T10:51:52.596247+0000","last_fullsized":"2023-08-10T10:51:52.596247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:53:19.054721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594749+0000","last_change":"2023-08-10T10:51:51.615336+0000","last_active":"2023-08-10T10:51:52.594749+0000","last_peered":"2023-08-10T10:51:52.594749+0000","last_clean":"2023-08-10T10:51:52.594749+0000","last_became_active":"2023-08-10T10:51:51.615087+0000","last_became_peered":"2023-08-10T10:51:51.615087+0000","last_unstale":"2023-08-10T10:51:52.594749+0000","last_undegraded":"2023-08-10T10:51:52.594749+0000","last_fullsized":"2023-08-10T10:51:52.594749+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:23.884147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.594958+0000","last_change":"2023-08-10T10:51:50.601961+0000","last_active":"2023-08-10T10:51:52.594958+0000","last_peered":"2023-08-10T10:51:52.594958+0000","last_clean":"2023-08-10T10:51:52.594958+0000","last_became_active":"2023-08-10T10:51:50.601573+0000","last_became_peered":"2023-08-10T10:51:50.601573+0000","last_unstale":"2023-08-10T10:51:52.594958+0000","last_undegraded":"2023-08-10T10:51:52.594958+0000","last_fullsized":"2023-08-10T10:51:52.594958+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:20.097454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.599137+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:51:51.599137+0000","last_peered":"2023-08-10T10:51:51.599137+0000","last_clean":"2023-08-10T10:51:51.599137+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:51:51.599137+0000","last_undegraded":"2023-08-10T10:51:51.599137+0000","last_fullsized":"2023-08-10T10:51:51.599137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:27.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.994920+0000","last_change":"2023-08-10T10:51:51.617747+0000","last_active":"2023-08-10T10:51:52.994920+0000","last_peered":"2023-08-10T10:51:52.994920+0000","last_clean":"2023-08-10T10:51:52.994920+0000","last_became_active":"2023-08-10T10:51:51.617250+0000","last_became_peered":"2023-08-10T10:51:51.617250+0000","last_unstale":"2023-08-10T10:51:52.994920+0000","last_undegraded":"2023-08-10T10:51:52.994920+0000","last_fullsized":"2023-08-10T10:51:52.994920+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:43:43.850671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"187'8","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.638668+0000","last_change":"2023-08-10T10:51:50.601886+0000","last_active":"2023-08-10T10:51:51.638668+0000","last_peered":"2023-08-10T10:51:51.638668+0000","last_clean":"2023-08-10T10:51:51.638668+0000","last_became_active":"2023-08-10T10:51:50.601409+0000","last_became_peered":"2023-08-10T10:51:50.601409+0000","last_unstale":"2023-08-10T10:51:51.638668+0000","last_undegraded":"2023-08-10T10:51:51.638668+0000","last_fullsized":"2023-08-10T10:51:51.638668+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:04:34.412790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.839541+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:51:52.839541+0000","last_peered":"2023-08-10T10:51:52.839541+0000","last_clean":"2023-08-10T10:51:52.839541+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:51:52.839541+0000","last_undegraded":"2023-08-10T10:51:52.839541+0000","last_fullsized":"2023-08-10T10:51:52.839541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:13:18.249735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.618153+0000","last_change":"2023-08-10T10:51:51.618027+0000","last_active":"2023-08-10T10:51:51.618153+0000","last_peered":"2023-08-10T10:51:51.618153+0000","last_clean":"2023-08-10T10:51:51.618153+0000","last_became_active":"2023-08-10T10:51:51.617599+0000","last_became_peered":"2023-08-10T10:51:51.617599+0000","last_unstale":"2023-08-10T10:51:51.618153+0000","last_undegraded":"2023-08-10T10:51:51.618153+0000","last_fullsized":"2023-08-10T10:51:51.618153+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:28.276038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"187'2","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.634886+0000","last_change":"2023-08-10T10:51:50.602114+0000","last_active":"2023-08-10T10:51:51.634886+0000","last_peered":"2023-08-10T10:51:51.634886+0000","last_clean":"2023-08-10T10:51:51.634886+0000","last_became_active":"2023-08-10T10:51:50.601528+0000","last_became_peered":"2023-08-10T10:51:50.601528+0000","last_unstale":"2023-08-10T10:51:51.634886+0000","last_undegraded":"2023-08-10T10:51:51.634886+0000","last_fullsized":"2023-08-10T10:51:51.634886+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:05:29.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":333,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.598214+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:51:51.598214+0000","last_peered":"2023-08-10T10:51:51.598214+0000","last_clean":"2023-08-10T10:51:51.598214+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:51:51.598214+0000","last_undegraded":"2023-08-10T10:51:51.598214+0000","last_fullsized":"2023-08-10T10:51:51.598214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:52:51.765242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.614292+0000","last_change":"2023-08-10T10:51:51.614033+0000","last_active":"2023-08-10T10:51:51.614292+0000","last_peered":"2023-08-10T10:51:51.614292+0000","last_clean":"2023-08-10T10:51:51.614292+0000","last_became_active":"2023-08-10T10:51:51.611476+0000","last_became_peered":"2023-08-10T10:51:51.611476+0000","last_unstale":"2023-08-10T10:51:51.614292+0000","last_undegraded":"2023-08-10T10:51:51.614292+0000","last_fullsized":"2023-08-10T10:51:51.614292+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:50.563365+0000","last_clean_scrub_stamp":"2023-08-10T10:51:50.563365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:21.113085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-10T10:51:52.591737+0000","last_change":"2023-08-10T10:51:50.609952+0000","last_active":"2023-08-10T10:51:52.591737+0000","last_peered":"2023-08-10T10:51:52.591737+0000","last_clean":"2023-08-10T10:51:52.591737+0000","last_became_active":"2023-08-10T10:51:50.606636+0000","last_became_peered":"2023-08-10T10:51:50.606636+0000","last_unstale":"2023-08-10T10:51:52.591737+0000","last_undegraded":"2023-08-10T10:51:52.591737+0000","last_fullsized":"2023-08-10T10:51:52.591737+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:51:49.547734+0000","last_clean_scrub_stamp":"2023-08-10T10:51:49.547734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:41.179329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":297,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-08-10T10:51:51.603095+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:51:51.603095+0000","last_peered":"2023-08-10T10:51:51.603095+0000","last_clean":"2023-08-10T10:51:51.603095+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:51:51.603095+0000","last_undegraded":"2023-08-10T10:51:51.603095+0000","last_fullsized":"2023-08-10T10:51:51.603095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:25.738307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575015,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193631,"statfs":{"total":200000000,"available":198278718,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2030000000000001,"15min":1.1499999999999999},"min":{"1min":0.86399999999999999,"5min":0.66600000000000004,"15min":0.39600000000000002},"max":{"1min":1.6759999999999999,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.145,"15min":1.1439999999999999},"min":{"1min":0.83499999999999996,"5min":0.72099999999999997,"15min":0.44800000000000001},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.302}]},{"osd":1,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.242,"15min":1.1899999999999999},"min":{"1min":0.96399999999999997,"5min":0.73199999999999998,"15min":0.66500000000000004},"max":{"1min":1.7549999999999999,"5min":1.778,"15min":4.6470000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2070000000000001,"15min":1.1859999999999999},"min":{"1min":0.88300000000000001,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.958,"5min":1.958,"15min":8.0830000000000002},"last":1.224}]},{"osd":2,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.1839999999999999,"15min":1.208},"min":{"1min":0.94099999999999995,"5min":0.69299999999999995,"15min":0.503},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.337,"15min":1.286},"min":{"1min":0.98799999999999999,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":0.874}]},{"osd":3,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.2569999999999999,"15min":1.2370000000000001},"min":{"1min":0.93600000000000005,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4179999999999999,"15min":1.3979999999999999},"min":{"1min":0.94899999999999995,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.867,"5min":2.266,"15min":6.069},"last":1.1890000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.2430000000000001,"15min":1.2609999999999999},"min":{"1min":0.86599999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.895,"5min":2.2080000000000002,"15min":7.1950000000000003},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.196,"15min":1.2709999999999999},"min":{"1min":0.89500000000000002,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.788,"5min":1.788,"15min":7.4950000000000001},"last":1.4319999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.4159999999999999,"15min":1.4530000000000001},"min":{"1min":0.92000000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.484},{"interface":"front","average":{"1min":1.524,"5min":1.448,"15min":1.486},"min":{"1min":1.1559999999999999,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.7410000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5700000000000001,"15min":1.579},"min":{"1min":1.1639999999999999,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.1920000000000002,"5min":2.2829999999999999,"15min":8.859},"last":1.333},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.486,"15min":1.4990000000000001},"min":{"1min":1.3,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4039999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.7969999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1870000000000001,"15min":1.1160000000000001},"min":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.444,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.123,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.64900000000000002,"15min":0.46600000000000003},"max":{"1min":1.575,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1579999999999999,"15min":1.1080000000000001},"min":{"1min":0.81399999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.7609999999999999,"5min":1.764,"15min":2.302},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2849999999999999,"15min":1.2270000000000001},"min":{"1min":0.96399999999999997,"5min":0.78200000000000003,"15min":0.70099999999999996},"max":{"1min":1.647,"5min":1.6839999999999999,"15min":2.052},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2390000000000001,"15min":1.1870000000000001},"min":{"1min":0.96299999999999997,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.5289999999999999,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":1.101},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.252,"15min":1.2490000000000001},"min":{"1min":0.93899999999999995,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.415,"5min":1.976,"15min":1.976},"last":1.4299999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.3129999999999999,"15min":1.2809999999999999},"min":{"1min":0.94599999999999995,"5min":0.93100000000000005,"15min":0.69399999999999995},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":3.177},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.98699999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.796,"5min":1.9199999999999999,"15min":2.395},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.264,"15min":1.252},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.919,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.002},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4870000000000001,"15min":1.46},"min":{"1min":1.2070000000000001,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.8260000000000001,"5min":2.512,"15min":2.7589999999999999},"last":1.278}]},{"osd":5,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.423,"15min":1.4319999999999999},"min":{"1min":0.97799999999999998,"5min":0.82699999999999996,"15min":0.59399999999999997},"max":{"1min":2.0369999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.536,"15min":1.524},"min":{"1min":0.92900000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.74,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.391}]},{"osd":7,"last update":"Thu Aug 10 10:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.345,"15min":1.371},"min":{"1min":0.85399999999999998,"5min":0.84799999999999998,"15min":0.53700000000000003},"max":{"1min":1.7110000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.171},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.51,"15min":1.514},"min":{"1min":1.1559999999999999,"5min":1.05,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.355,"15min":2.698},"last":1.5549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1103,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194208,"statfs":{"total":200000000,"available":198869981,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1279999999999999},"min":{"1min":0.83199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5249999999999999,"5min":1.645,"15min":2.5070000000000001},"last":1.079},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.89200000000000002,"5min":0.70399999999999996,"15min":0.56599999999999995},"max":{"1min":1.5529999999999999,"5min":1.857,"15min":32.941000000000003},"last":1.3240000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.284,"15min":1.2270000000000001},"min":{"1min":0.89600000000000002,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.5449999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2350000000000001,"15min":1.202},"min":{"1min":0.76900000000000002,"5min":0.66400000000000003,"15min":0.62},"max":{"1min":1.772,"5min":1.772,"15min":4.3360000000000003},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.304,"15min":1.2809999999999999},"min":{"1min":1.004,"5min":0.80100000000000005,"15min":0.67500000000000004},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.167},{"interface":"front","average":{"1min":1.196,"5min":1.2330000000000001,"15min":1.194},"min":{"1min":0.80700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5860000000000001,"5min":1.734,"15min":1.734},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.329,"15min":1.2849999999999999},"min":{"1min":0.89800000000000002,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.593,"5min":2.016,"15min":2.016},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.373,"15min":1.3520000000000001},"min":{"1min":1.0229999999999999,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.891,"5min":1.891,"15min":4.0620000000000003},"last":1.054}]},{"osd":4,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.216,"15min":1.2589999999999999},"min":{"1min":0.74299999999999999,"5min":0.68000000000000005,"15min":0.58599999999999997},"max":{"1min":1.7290000000000001,"5min":1.7969999999999999,"15min":4.9859999999999998},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.411,"15min":1.377},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.58099999999999996},"max":{"1min":1.768,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.482,"15min":1.3999999999999999},"min":{"1min":0.90300000000000002,"5min":0.67700000000000005,"15min":0.54200000000000004},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4239999999999999,"15min":1.415},"min":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7010000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.6000000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.53,"15min":1.502},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.63100000000000001},"max":{"1min":1.6899999999999999,"5min":2.0659999999999998,"15min":2.403},"last":1.496},{"interface":"front","average":{"1min":1.496,"5min":1.5780000000000001,"15min":1.5269999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":2.0569999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.359}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1105,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194207,"statfs":{"total":200000000,"available":198868322,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.1950000000000001,"15min":1.157},"min":{"1min":0.89000000000000001,"5min":0.79100000000000004,"15min":0.54200000000000004},"max":{"1min":1.573,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.24,"5min":1.2010000000000001,"15min":1.194},"min":{"1min":0.89400000000000002,"5min":0.68400000000000005,"15min":0.55600000000000005},"max":{"1min":1.724,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.26},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6659999999999999,"5min":1.841,"15min":3.9820000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.274,"5min":1.2370000000000001,"15min":1.1699999999999999},"min":{"1min":0.82399999999999995,"5min":0.72299999999999998,"15min":0.58499999999999996},"max":{"1min":1.661,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.5920000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2490000000000001,"15min":1.2030000000000001},"min":{"1min":0.81499999999999995,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.6359999999999999,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.3400000000000001,"15min":1.3200000000000001},"min":{"1min":0.94499999999999995,"5min":0.82299999999999995,"15min":0.70499999999999996},"max":{"1min":1.6759999999999999,"5min":1.8500000000000001,"15min":4.226},"last":0.997}]},{"osd":3,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.262,"15min":1.26},"min":{"1min":0.81299999999999994,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.645,"5min":1.7649999999999999,"15min":3.8130000000000002},"last":1.377},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3460000000000001,"15min":1.319},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.67000000000000004},"max":{"1min":1.78,"5min":1.792,"15min":4.6859999999999999},"last":1.4359999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.3380000000000001},"min":{"1min":0.98099999999999998,"5min":0.73499999999999999,"15min":0.64300000000000002},"max":{"1min":1.819,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.141},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.96399999999999997,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.732,"5min":1.911,"15min":2.9340000000000002},"last":1.4750000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3700000000000001,"15min":1.345},"min":{"1min":0.89600000000000002,"5min":0.68100000000000005,"15min":0.47099999999999997},"max":{"1min":1.8540000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.518},{"interface":"front","average":{"1min":1.538,"5min":1.5069999999999999,"15min":1.494},"min":{"1min":1.048,"5min":0.93100000000000005,"15min":0.55000000000000004},"max":{"1min":1.9610000000000001,"5min":2.121,"15min":5.1529999999999996},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.4870000000000001,"15min":1.4590000000000001},"min":{"1min":1.0469999999999999,"5min":1.024,"15min":0.57999999999999996},"max":{"1min":1.8879999999999999,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.546},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.5980000000000001,"15min":1.5489999999999999},"min":{"1min":1.131,"5min":0.875,"15min":0.67400000000000004},"max":{"1min":2.016,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.6399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866918,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":0.92200000000000004},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.375,"5min":2.722,"15min":2.722},"last":1.105},{"interface":"front","average":{"1min":1.274,"5min":1.1930000000000001,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.831,"5min":2.883,"15min":2.883},"last":1.5620000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.016,"15min":0.92800000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.3640000000000001,"5min":1.885,"15min":1.885},"last":0.745},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1579999999999999,"15min":1.0529999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.139,"15min":1.04},"min":{"1min":0.432,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":2.1480000000000001,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.341,"15min":1.1950000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.7210000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.022}]},{"osd":4,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4219999999999999,"15min":1.355},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.9930000000000001,"5min":2.766,"15min":9.8149999999999995},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.292,"15min":1.2509999999999999},"min":{"1min":0.94599999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.72,"5min":2.0390000000000001,"15min":2.5179999999999998},"last":1.617}]},{"osd":5,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.516,"15min":1.413},"min":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8069999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.4930000000000001,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":2.7200000000000002,"5min":2.774,"15min":4.2069999999999999},"last":1.6899999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.419,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.71,"5min":2.129,"15min":2.6560000000000001},"last":1.738},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5980000000000001,"15min":1.4850000000000001},"min":{"1min":1.0189999999999999,"5min":0.749,"15min":0.749},"max":{"1min":2.0529999999999999,"5min":2.964,"15min":2.964},"last":1.4590000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.599,"15min":1.5009999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.4990000000000001,"5min":2.677,"15min":2.677},"last":1.798},{"interface":"front","average":{"1min":1.494,"5min":1.5309999999999999,"15min":1.4279999999999999},"min":{"1min":1.0449999999999999,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":1.8859999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.4910000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575015,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.4670000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.98799999999999999,"15min":0.94999999999999996},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.443},"max":{"1min":1.5269999999999999,"5min":1.825,"15min":1.825},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1299999999999999,"15min":1.087},"min":{"1min":0.78500000000000003,"5min":0.48199999999999998,"15min":0.34999999999999998},"max":{"1min":1.599,"5min":1.6759999999999999,"15min":1.9630000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.248,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.6879999999999999,"5min":1.9179999999999999,"15min":2.0310000000000001},"last":1.159}]},{"osd":3,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.044,"15min":1.004},"min":{"1min":0.754,"5min":0.55500000000000005,"15min":0.50900000000000001},"max":{"1min":1.633,"5min":1.877,"15min":1.877},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1890000000000001,"15min":1.2010000000000001},"min":{"1min":0.86399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5269999999999999,"5min":1.839,"15min":3.6920000000000002},"last":1.21}]},{"osd":4,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.405,"15min":1.3959999999999999},"min":{"1min":1.127,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7490000000000001,"5min":1.9099999999999999,"15min":2.6000000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3640000000000001,"15min":1.3340000000000001},"min":{"1min":1.02,"5min":0.92900000000000005,"15min":0.64200000000000002},"max":{"1min":1.706,"5min":1.968,"15min":4.2220000000000004},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.335,"15min":1.2949999999999999},"min":{"1min":1.052,"5min":0.84899999999999998,"15min":0.66600000000000004},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":2.2280000000000002},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4490000000000001,"15min":1.46},"min":{"1min":1.198,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.802,"5min":1.9870000000000001,"15min":3.294},"last":1.591}]},{"osd":6,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4570000000000001,"15min":1.423},"min":{"1min":1.121,"5min":0.88900000000000001,"15min":0.81599999999999995},"max":{"1min":1.839,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4159999999999999,"15min":1.383},"min":{"1min":0.98799999999999999,"5min":0.80500000000000005,"15min":0.79700000000000004},"max":{"1min":1.839,"5min":1.907,"15min":2.444},"last":1.5449999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:51:35 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.51,"15min":1.47},"min":{"1min":1.077,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":1.913,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.919},{"interface":"front","average":{"1min":1.51,"5min":1.496,"15min":1.4530000000000001},"min":{"1min":1.1579999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9930000000000001,"5min":2.0950000000000002,"15min":2.556},"last":1.4810000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.91400000000000003,"15min":0.874},"min":{"1min":0.74099999999999999,"5min":0.441,"15min":0.33100000000000002},"max":{"1min":1.2050000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.76700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.611,"5min":1.706,"15min":2.246},"last":1.196}]},{"osd":2,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.044,"15min":0.97999999999999998},"min":{"1min":0.71299999999999997,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.925,"5min":1.925,"15min":2.0209999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.282,"15min":1.1879999999999999},"min":{"1min":1.016,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.423},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.206,"15min":1.1439999999999999},"min":{"1min":0.97499999999999998,"5min":0.624,"15min":0.45400000000000001},"max":{"1min":1.6359999999999999,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.171,"15min":1.0940000000000001},"min":{"1min":0.98299999999999998,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.079}]},{"osd":4,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.2829999999999999,"15min":1.2430000000000001},"min":{"1min":0.95799999999999996,"5min":0.84799999999999998,"15min":0.65500000000000003},"max":{"1min":1.694,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.157},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.478,"15min":1.4419999999999999},"min":{"1min":1.2969999999999999,"5min":0.83299999999999996,"15min":0.72599999999999998},"max":{"1min":1.732,"5min":2.0499999999999998,"15min":2.343},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.452,"15min":1.411},"min":{"1min":1.1100000000000001,"5min":0.83499999999999996,"15min":0.67900000000000005},"max":{"1min":1.73,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.4650000000000001,"15min":1.3999999999999999},"min":{"1min":1.222,"5min":0.89600000000000002,"15min":0.71699999999999997},"max":{"1min":2.0790000000000002,"5min":2.5009999999999999,"15min":2.73},"last":1.349}]},{"osd":6,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4470000000000001,"15min":1.411},"min":{"1min":1.2450000000000001,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.724,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.4350000000000001,"15min":1.365},"min":{"1min":1.1299999999999999,"5min":0.93300000000000005,"15min":0.77300000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:51:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.5980000000000001,"15min":1.504},"min":{"1min":1.194,"5min":0.81100000000000005,"15min":0.70199999999999996},"max":{"1min":2.0960000000000001,"5min":7.798,"15min":7.798},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.534,"15min":1.476},"min":{"1min":1.3600000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":1.8720000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.4750000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575015,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1673,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193638,"statfs":{"total":200000000,"available":198286286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.996,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.46200000000000002,"15min":0.28100000000000003},"max":{"1min":1.55,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.133,"15min":1.113},"min":{"1min":0.71699999999999997,"5min":0.48399999999999999,"15min":0.434},"max":{"1min":1.73,"5min":1.73,"15min":11.173},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.05,"15min":1.0329999999999999},"min":{"1min":0.79600000000000004,"5min":0.54700000000000004,"15min":0.39000000000000001},"max":{"1min":1.4830000000000001,"5min":1.6499999999999999,"15min":2.7240000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.0580000000000001},"min":{"1min":0.78300000000000003,"5min":0.54400000000000004,"15min":0.47399999999999998},"max":{"1min":1.6599999999999999,"5min":1.875,"15min":1.875},"last":1.921}]},{"osd":3,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0409999999999999,"15min":1.02},"min":{"1min":0.76200000000000001,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":1.5609999999999999,"5min":1.796,"15min":5.9980000000000002},"last":0.997},{"interface":"front","average":{"1min":1.292,"5min":1.246,"15min":1.2090000000000001},"min":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":10.739000000000001},"last":1.4910000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3500000000000001,"15min":1.3460000000000001},"min":{"1min":1.032,"5min":0.88100000000000001,"15min":0.73199999999999998},"max":{"1min":1.8440000000000001,"5min":2.0019999999999998,"15min":6.5209999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.468},"min":{"1min":1.165,"5min":0.98199999999999998,"15min":0.751},"max":{"1min":1.9399999999999999,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.3919999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.397,"15min":1.379},"min":{"1min":1.0409999999999999,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.7370000000000001,"5min":2.238,"15min":2.238},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.3700000000000001,"15min":1.421},"min":{"1min":1.0449999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8620000000000001,"5min":1.9890000000000001,"15min":16.058},"last":1.458}]},{"osd":6,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.536,"15min":1.486},"min":{"1min":1.2,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":2.0230000000000001,"5min":2.375,"15min":2.4790000000000001},"last":1.159},{"interface":"front","average":{"1min":1.526,"5min":1.506,"15min":1.4610000000000001},"min":{"1min":1.1339999999999999,"5min":0.86499999999999999,"15min":0.754},"max":{"1min":1.917,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.5840000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.5700000000000001,"15min":1.536},"min":{"1min":1.1259999999999999,"5min":0.95099999999999996,"15min":0.752},"max":{"1min":2.0779999999999998,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.819},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.482,"15min":1.478},"min":{"1min":1.155,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0219999999999998,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.3049999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:51:56.651 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:51:56.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-10T10:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.927+0000 7f41c085d640 1 Processor -- start 2023-08-10T10:51:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.928+0000 7f41c085d640 1 -- start start 2023-08-10T10:51:56.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.929+0000 7f41c085d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41bc160f70 0x7f41bc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.929+0000 7f41c085d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 0x7f41bc0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.929+0000 7f41c085d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc0ad6e0 con 0x7f41bc161350 2023-08-10T10:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.929+0000 7f41c085d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc0cdaf0 con 0x7f41bc160f70 2023-08-10T10:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.929+0000 7f41c085d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc0acb10 con 0x7f41bc15dd10 2023-08-10T10:51:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41bc160f70 0x7f41bc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41bc160f70 0x7f41bc15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51770/0 (socket says 172.21.15.50:51770) 2023-08-10T10:51:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 -- 172.21.15.50:0/4154915760 learned_addr learned my addr 172.21.15.50:0/4154915760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 -- 172.21.15.50:0/4154915760 >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 msgr2=0x7f41bc0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41baffd640 1 --2- 172.21.15.50:0/4154915760 >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 0x7f41bc0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41ba7fc640 1 -- 172.21.15.50:0/4154915760 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140925963 0 0) 0x7f41bc0ad6e0 con 0x7f41bc161350 2023-08-10T10:51:56.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/4154915760 >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 0x7f41bc0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 -- 172.21.15.50:0/4154915760 >> v1:172.21.15.50:6789/0 conn(0x7f41bc161350 legacy=0x7f41bc06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41bb7fe640 1 -- 172.21.15.50:0/4154915760 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0acdb0 con 0x7f41bc160f70 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.930+0000 7f41baffd640 1 --2- 172.21.15.50:0/4154915760 >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 0x7f41bc0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/4154915760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc15d7d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0c93c0 tx=0x7f41ac02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40c2b6925bf0368 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41ba7fc640 1 -- 172.21.15.50:0/4154915760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac030870 con 0x7f41bc160f70 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41ba7fc640 1 -- 172.21.15.50:0/4154915760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac0309d0 con 0x7f41bc160f70 2023-08-10T10:51:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41ba7fc640 1 -- 172.21.15.50:0/4154915760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac030d60 con 0x7f41bc160f70 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41c085d640 1 -- 172.21.15.50:0/4154915760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 msgr2=0x7f41bc15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.932+0000 7f41c085d640 1 --2- 172.21.15.50:0/4154915760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc15d7d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0c93c0 tx=0x7f41ac02b9b0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 -- 172.21.15.50:0/4154915760 shutdown_connections 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 --2- 172.21.15.50:0/4154915760 >> v2:172.21.15.117:3300/0 conn(0x7f41bc15dd10 0x7f41bc0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 --2- 172.21.15.50:0/4154915760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc15d7d0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 -- 172.21.15.50:0/4154915760 >> 172.21.15.50:0/4154915760 conn(0x7f41bc069cd0 msgr2=0x7f41bc0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:56.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 -- 172.21.15.50:0/4154915760 shutdown_connections 2023-08-10T10:51:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.933+0000 7f41c085d640 1 -- 172.21.15.50:0/4154915760 wait complete. 2023-08-10T10:51:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.934+0000 7f41c085d640 1 Processor -- start 2023-08-10T10:51:56.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.935+0000 7f41c085d640 1 -- start start 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 0x7f41bc0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 0x7f41bc0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b1dd0 con 0x7f41bc160f70 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b20b0 con 0x7f41bc15dd10 2023-08-10T10:51:56.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41c085d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b2390 con 0x7f41bc161350 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51778/0 (socket says 172.21.15.50:51778) 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41baffd640 1 -- 172.21.15.50:0/989469174 learned_addr learned my addr 172.21.15.50:0/989469174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 0x7f41bc0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41baffd640 1 -- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 msgr2=0x7f41bc0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.936+0000 7f41bbfff640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 0x7f41bc0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41baffd640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 0x7f41bc0c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41baffd640 1 -- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 msgr2=0x7f41bc0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41baffd640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 0x7f41bc0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41baffd640 1 -- 172.21.15.50:0/989469174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0094d0 con 0x7f41bc160f70 2023-08-10T10:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41bbfff640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 0x7f41bc0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 0x7f41bc0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41baffd640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c7f0 tx=0x7f41b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007a30 con 0x7f41bc160f70 2023-08-10T10:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0007b90 con 0x7f41bc160f70 2023-08-10T10:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000ce40 con 0x7f41bc160f70 2023-08-10T10:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc0b2670 con 0x7f41bc160f70 2023-08-10T10:51:56.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.937+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc0b19d0 con 0x7f41bc160f70 2023-08-10T10:51:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.939+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc0adb50 con 0x7f41bc160f70 2023-08-10T10:51:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.940+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41b00113f0 con 0x7f41bc160f70 2023-08-10T10:51:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.941+0000 7f41a3fff640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 0x7f41a806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.941+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41b0089630 con 0x7f41bc160f70 2023-08-10T10:51:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.941+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 0x7f41a806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.942+0000 7f41bb7fe640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 0x7f41a806d110 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f41ac036000 tx=0x7f41ac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:56.946+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f41bc0adb50 con 0x7f41bc160f70 2023-08-10T10:51:57.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.204+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f41bc0b2b90 con 0x7f41bc160f70 2023-08-10T10:51:57.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.211+0000 7f41a3fff640 1 -- 172.21.15.50:0/989469174 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+147 (secure 0 0 0) 0x7f41bc0b2b90 con 0x7f41bc160f70 2023-08-10T10:51:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-08-10T10:51:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6vdRkhGt6NxAAx7KAs04+TZsX0880+oF/Gg== 2023-08-10T10:51:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-08-10T10:51:57.213 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-08-10T10:51:57.214 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-10T10:51:57.214 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-08-10T10:51:57.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.213+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 msgr2=0x7f41a806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.213+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 0x7f41a806d110 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f41ac036000 tx=0x7f41ac008030 comp rx=0 tx=0).stop 2023-08-10T10:51:57.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 msgr2=0x7f41bc153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c7f0 tx=0x7f41b000cbf0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 shutdown_connections 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41bc161350 0x7f41bc0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41bc160f70 0x7f41bc153a50 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f41a806ac50 0x7f41a806d110 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 --2- 172.21.15.50:0/989469174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41bc15dd10 0x7f41bc0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 >> 172.21.15.50:0/989469174 conn(0x7f41bc069cd0 msgr2=0x7f41bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:57.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 shutdown_connections 2023-08-10T10:51:57.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.214+0000 7f41c085d640 1 -- 172.21.15.50:0/989469174 wait complete. 2023-08-10T10:51:57.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:57.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.459+0000 7fd4de663640 1 Processor -- start 2023-08-10T10:51:57.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.459+0000 7fd4de663640 1 -- start start 2023-08-10T10:51:57.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4de663640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd4d80b0620 0x7fd4d80b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4de663640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d815f2b0 0x7fd4d80b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4de663640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80b1f10 con 0x7fd4d815a940 2023-08-10T10:51:57.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4de663640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80b21f0 con 0x7fd4d815f2b0 2023-08-10T10:51:57.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4de663640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d815e5c0 con 0x7fd4d80b0620 2023-08-10T10:51:57.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4dde62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d815f2b0 0x7fd4d80b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4dde62640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d815f2b0 0x7fd4d80b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51788/0 (socket says 172.21.15.50:51788) 2023-08-10T10:51:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4dde62640 1 -- 172.21.15.50:0/1760011547 learned_addr learned my addr 172.21.15.50:0/1760011547 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.461+0000 7fd4dce60640 1 --2- 172.21.15.50:0/1760011547 >> v2:172.21.15.117:3300/0 conn(0x7fd4d80b0620 0x7fd4d80b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.462+0000 7fd4dde62640 1 -- 172.21.15.50:0/1760011547 >> v2:172.21.15.117:3300/0 conn(0x7fd4d80b0620 msgr2=0x7fd4d80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.462+0000 7fd4dde62640 1 --2- 172.21.15.50:0/1760011547 >> v2:172.21.15.117:3300/0 conn(0x7fd4d80b0620 0x7fd4d80b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.462+0000 7fd4dde62640 1 -- 172.21.15.50:0/1760011547 >> v1:172.21.15.50:6789/0 conn(0x7fd4d815a940 legacy=0x7fd4d80aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.462+0000 7fd4dde62640 1 -- 172.21.15.50:0/1760011547 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d815e7d0 con 0x7fd4d815f2b0 2023-08-10T10:51:57.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.462+0000 7fd4cffff640 1 -- 172.21.15.50:0/1760011547 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088518619 0 0) 0x7fd4d80b1f10 con 0x7fd4d815a940 2023-08-10T10:51:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.463+0000 7fd4dde62640 1 --2- 172.21.15.50:0/1760011547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815f2b0 0x7fd4d80b1800 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80b1080 tx=0x7fd4d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e06b1967ad4ca1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.463+0000 7fd4cffff640 1 -- 172.21.15.50:0/1760011547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d002ca80 con 0x7fd4d815f2b0 2023-08-10T10:51:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.463+0000 7fd4cffff640 1 -- 172.21.15.50:0/1760011547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d002cbe0 con 0x7fd4d815f2b0 2023-08-10T10:51:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.463+0000 7fd4cffff640 1 -- 172.21.15.50:0/1760011547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00343f0 con 0x7fd4d815f2b0 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 -- 172.21.15.50:0/1760011547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815f2b0 msgr2=0x7fd4d80b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 --2- 172.21.15.50:0/1760011547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815f2b0 0x7fd4d80b1800 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80b1080 tx=0x7fd4d002bee0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 -- 172.21.15.50:0/1760011547 shutdown_connections 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 --2- 172.21.15.50:0/1760011547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815f2b0 0x7fd4d80b1800 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 --2- 172.21.15.50:0/1760011547 >> v2:172.21.15.117:3300/0 conn(0x7fd4d80b0620 0x7fd4d80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 -- 172.21.15.50:0/1760011547 >> 172.21.15.50:0/1760011547 conn(0x7fd4d806ab80 msgr2=0x7fd4d806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 -- 172.21.15.50:0/1760011547 shutdown_connections 2023-08-10T10:51:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.464+0000 7fd4de663640 1 -- 172.21.15.50:0/1760011547 wait complete. 2023-08-10T10:51:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.466+0000 7fd4de663640 1 Processor -- start 2023-08-10T10:51:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.466+0000 7fd4de663640 1 -- start start 2023-08-10T10:51:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80b0620 0x7fd4d815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d815f2b0 0x7fd4d81f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8071a20 con 0x7fd4d815a940 2023-08-10T10:51:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815c740 con 0x7fd4d815f2b0 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4de663640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815ca20 con 0x7fd4d80b0620 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4dce60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4dce60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51790/0 (socket says 172.21.15.50:51790) 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.467+0000 7fd4dce60640 1 -- 172.21.15.50:0/2384579838 learned_addr learned my addr 172.21.15.50:0/2384579838 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dd661640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80b0620 0x7fd4d815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dde62640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d815f2b0 0x7fd4d81f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 -- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80b0620 msgr2=0x7fd4d815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80b0620 0x7fd4d815c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 -- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d815f2b0 msgr2=0x7fd4d81f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d815f2b0 0x7fd4d81f1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 -- 172.21.15.50:0/2384579838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009b30 con 0x7fd4d815a940 2023-08-10T10:51:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4dce60640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800d5f0 tx=0x7fd4c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80125f0 con 0x7fd4d815a940 2023-08-10T10:51:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8012750 con 0x7fd4d815a940 2023-08-10T10:51:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8012b00 con 0x7fd4d815a940 2023-08-10T10:51:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.468+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d815cd00 con 0x7fd4d815a940 2023-08-10T10:51:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.469+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d815d2c0 con 0x7fd4d815a940 2023-08-10T10:51:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.470+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d815d480 con 0x7fd4d815a940 2023-08-10T10:51:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.471+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4c8012c60 con 0x7fd4d815a940 2023-08-10T10:51:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.472+0000 7fd4cdffb640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 0x7fd4bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.472+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4c80899a0 con 0x7fd4d815a940 2023-08-10T10:51:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.473+0000 7fd4dd661640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 0x7fd4bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.473+0000 7fd4dd661640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 0x7fd4bc06d110 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000f60 tx=0x7fd4d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.477+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd4c8054a40 con 0x7fd4d815a940 2023-08-10T10:51:57.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.708+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4d8066e30 con 0x7fd4d815a940 2023-08-10T10:51:57.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.709+0000 7fd4cdffb640 1 -- 172.21.15.50:0/2384579838 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7fd4c8058060 con 0x7fd4d815a940 2023-08-10T10:51:57.711 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:51:57.711 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:51:57.711 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:51:57.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 msgr2=0x7fd4bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 0x7fd4bc06d110 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000f60 tx=0x7fd4d4009040 comp rx=0 tx=0).stop 2023-08-10T10:51:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 msgr2=0x7fd4d80714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800d5f0 tx=0x7fd4c800dab0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 shutdown_connections 2023-08-10T10:51:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd4bc06ac50 0x7fd4bc06d110 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d815f2b0 0x7fd4d81f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d815a940 0x7fd4d80714e0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 --2- 172.21.15.50:0/2384579838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80b0620 0x7fd4d815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:57.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 >> 172.21.15.50:0/2384579838 conn(0x7fd4d806ab80 msgr2=0x7fd4d80cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:57.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 shutdown_connections 2023-08-10T10:51:57.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:57.712+0000 7fd4de663640 1 -- 172.21.15.50:0/2384579838 wait complete. 2023-08-10T10:51:58.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:51:51.085628+0000', 'modified': '2023-08-10T10:51:54.629519+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9393': {'gid': 9393, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6836/3577041513', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3577041513}, {'type': 'v1', 'addr': '172.21.15.50:6836', 'nonce': 3577041513}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:51:58.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:51:58.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-10T10:51:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.378+0000 7fe5cd22c640 1 Processor -- start 2023-08-10T10:51:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.378+0000 7fe5cd22c640 1 -- start start 2023-08-10T10:51:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5cd22c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 0x7fe5c80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5cd22c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80c93c0 con 0x7fe5c8069db0 2023-08-10T10:51:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5cd22c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80c9bb0 con 0x7fe5c80c1a10 2023-08-10T10:51:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5cd22c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80c95f0 con 0x7fe5c8165530 2023-08-10T10:51:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5c77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5c8069db0 0x7fe5c80ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48432/0 (socket says 172.21.15.50:48432) 2023-08-10T10:51:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.380+0000 7fe5c77fe640 1 -- 172.21.15.50:0/302211951 learned_addr learned my addr 172.21.15.50:0/302211951 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:51:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/302211951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 0x7fe5c80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273295536 0 0) 0x7fe5c80c93c0 con 0x7fe5c8069db0 2023-08-10T10:51:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b0003520 con 0x7fe5c8069db0 2023-08-10T10:51:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442749470 0 0) 0x7fe5b0003520 con 0x7fe5c8069db0 2023-08-10T10:51:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5cca2b640 1 -- 172.21.15.50:0/302211951 >> v1:172.21.15.117:6789/0 conn(0x7fe5c80c1a10 legacy=0x7fe5c80696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5cca2b640 1 -- 172.21.15.50:0/302211951 >> v1:172.21.15.50:6789/0 conn(0x7fe5c8069db0 legacy=0x7fe5c80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.381+0000 7fe5cca2b640 1 -- 172.21.15.50:0/302211951 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80c98d0 con 0x7fe5c8165530 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.383+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/302211951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 0x7fe5c80c8e80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009dc0 tx=0x7fe5c002bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b38325a0802cc738 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.383+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc001690 con 0x7fe5c8165530 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.383+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c002c770 con 0x7fe5c8165530 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.383+0000 7fe5c6ffd640 1 -- 172.21.15.50:0/302211951 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c002cb00 con 0x7fe5c8165530 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 -- 172.21.15.50:0/302211951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 msgr2=0x7fe5c80c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/302211951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 0x7fe5c80c8e80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009dc0 tx=0x7fe5c002bc40 comp rx=0 tx=0).stop 2023-08-10T10:51:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 -- 172.21.15.50:0/302211951 shutdown_connections 2023-08-10T10:51:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/302211951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c8165530 0x7fe5c80c8e80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 -- 172.21.15.50:0/302211951 >> 172.21.15.50:0/302211951 conn(0x7fe5c80cafa0 msgr2=0x7fe5c80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 -- 172.21.15.50:0/302211951 shutdown_connections 2023-08-10T10:51:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.384+0000 7fe5cd22c640 1 -- 172.21.15.50:0/302211951 wait complete. 2023-08-10T10:51:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.386+0000 7fe5cd22c640 1 Processor -- start 2023-08-10T10:51:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.386+0000 7fe5cd22c640 1 -- start start 2023-08-10T10:51:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c80c1a10 0x7fe5c8150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5c8165530 0x7fe5c80c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8070200 con 0x7fe5c8069db0 2023-08-10T10:51:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80704e0 con 0x7fe5c8165530 2023-08-10T10:51:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.387+0000 7fe5cd22c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80707c0 con 0x7fe5c80c1a10 2023-08-10T10:51:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51802/0 (socket says 172.21.15.50:51802) 2023-08-10T10:51:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 -- 172.21.15.50:0/2255913046 learned_addr learned my addr 172.21.15.50:0/2255913046 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 -- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c80c1a10 msgr2=0x7fe5c8150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c80c1a10 0x7fe5c8150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 -- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5c8165530 msgr2=0x7fe5c80c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5c8165530 0x7fe5c80c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5c8165530 0x7fe5c80c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.388+0000 7fe5c7fff640 1 -- 172.21.15.50:0/2255913046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009a70 con 0x7fe5c8069db0 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c780 tx=0x7fe5b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5c4ff9640 1 -- 172.21.15.50:0/2255913046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8005270 con 0x7fe5c8069db0 2023-08-10T10:51:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5c4ff9640 1 -- 172.21.15.50:0/2255913046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80053f0 con 0x7fe5c8069db0 2023-08-10T10:51:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5c4ff9640 1 -- 172.21.15.50:0/2255913046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800a880 con 0x7fe5c8069db0 2023-08-10T10:51:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c8070aa0 con 0x7fe5c8069db0 2023-08-10T10:51:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.389+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c8150b50 con 0x7fe5c8069db0 2023-08-10T10:51:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.391+0000 7fe5c4ff9640 1 -- 172.21.15.50:0/2255913046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5b800a9e0 con 0x7fe5c8069db0 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.392+0000 7fe5c4ff9640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 0x7fe5b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.392+0000 7fe5c4ff9640 1 -- 172.21.15.50:0/2255913046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5b8088c70 con 0x7fe5c8069db0 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.393+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 0x7fe5b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.393+0000 7fe5d0ffe740 1 Processor -- start 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.393+0000 7fe5d0ffe740 1 -- start start 2023-08-10T10:51:58.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.393+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 0x7fe5b406d110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc001200 tx=0x7fe5bc001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6297a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb6267610 0x555cb6294900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb61d79d0 con 0x555cb626b210 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb61d50c0 con 0x555cb6297690 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cb61d09b0 con 0x555cb6267610 2023-08-10T10:51:58.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.394+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51812/0 (socket says 172.21.15.50:51812) 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1868061918 learned_addr learned my addr 172.21.15.50:0/1868061918 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb6267610 0x555cb6294900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6297a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb6267610 msgr2=0x555cb6294900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb6267610 0x555cb6294900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 msgr2=0x555cb6297a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6297a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1868061918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cb619dc10 con 0x555cb626b210 2023-08-10T10:51:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6297a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.395+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fe5c002c250 tx=0x7fe5c002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3accab25bafbb2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5adffb640 1 -- 172.21.15.50:0/1868061918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0003a10 con 0x555cb626b210 2023-08-10T10:51:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5adffb640 1 -- 172.21.15.50:0/1868061918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0003b70 con 0x555cb626b210 2023-08-10T10:51:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5adffb640 1 -- 172.21.15.50:0/1868061918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c002c8e0 con 0x555cb626b210 2023-08-10T10:51:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1868061918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 msgr2=0x555cb6294e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fe5c002c250 tx=0x7fe5c002e000 comp rx=0 tx=0).stop 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1868061918 shutdown_connections 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb626b210 0x555cb6294e40 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb6267610 0x555cb6294900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1868061918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6297a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.396+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1868061918 >> 172.21.15.50:0/1868061918 conn(0x555cb6269920 msgr2=0x555cb62b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.397+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1868061918 shutdown_connections 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.397+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1868061918 wait complete. 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.397+0000 7fe5d0ffe740 1 -- start start 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.398+0000 7fe5d0ffe740 1 Processor -- start 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb6299f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6281300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb6171940 con 0x555cb6298930 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb61715e0 con 0x555cb6297690 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cb5f37f20 con 0x555cb626b210 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5d0ffe740 10 client.0 _ll_register_callbacks cb 0x555cb61ca250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51824/0 (socket says 172.21.15.50:51824) 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 -- 172.21.15.50:0/2499339773 learned_addr learned my addr 172.21.15.50:0/2499339773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb6299f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6281300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 -- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 msgr2=0x555cb6299f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb6299f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 -- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 msgr2=0x555cb6281300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6281300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.399+0000 7fe5cca2b640 1 -- 172.21.15.50:0/2499339773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c80c98d0 con 0x555cb6298930 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fe5c002cf90 tx=0x7fe5c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d949e8aa216ff029 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00346d0 con 0x555cb6298930 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cb61fabf0 con 0x555cb6298930 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5c0034830 con 0x555cb6298930 2023-08-10T10:51:58.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5c00349f0 con 0x555cb6298930 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5d0ffe740 10 client.9567 fetch_fsmap learned FSMap version 93 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.400+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x555cb61cf030 con 0x555cb6298930 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555cb61fabf0 con 0x555cb6298930 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 93) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe5c0034b50 con 0x555cb6298930 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 10 client.9567 fetch_fsmap finished waiting for FSMap version 93 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 10 client.9567 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:51:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 20 client.9567 populate_metadata read hostname 'smithi050' 2023-08-10T10:51:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb62c2730 0x555cb62c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 4 client.9567 mds_command: new command op to 9393 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 --> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cb61c37c0 con 0x555cb62c2730 2023-08-10T10:51:58.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.401+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb62c2730 0x555cb62c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.402+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb62c2730 0x555cb62c2b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c7669cd526129f0 server_cookie=7f56ecf3ca632565 in_seq=0 out_seq=0 2023-08-10T10:51:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.402+0000 7fe5a6ffd640 10 client.9567 ms_handle_connect on v2:172.21.15.50:6834/3577041513 2023-08-10T10:51:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/2499339773 <== mds.0 v2:172.21.15.50:6834/3577041513 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x555cb61c37c0 con 0x555cb62c2730 2023-08-10T10:51:58.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5a6ffd640 10 client.9567 handle_command_reply: tid=0 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 client.9567 shutdown 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 msgr2=0x555cb6284520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fe5c002cf90 tx=0x7fe5c0004ab0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 shutdown_connections 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb62c2730 0x555cb62c2b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6284520 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6281300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/2499339773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb6299f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5a6ffd640 0 client.9567 ms_handle_reset on v2:172.21.15.50:6834/3577041513 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 >> 172.21.15.50:0/2499339773 conn(0x555cb6267610 msgr2=0x555cb626bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 shutdown_connections 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/2499339773 wait complete. 2023-08-10T10:51:58.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.403+0000 7fe5d0ffe740 20 client.9567 trim_cache size 0 max 16384 2023-08-10T10:51:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.420+0000 7fe5d0ffe740 1 Processor -- start 2023-08-10T10:51:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.420+0000 7fe5d0ffe740 1 -- start start 2023-08-10T10:51:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6298930 0x555cb626d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb62b5be0 con 0x555cb6297690 2023-08-10T10:51:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb62682d0 con 0x555cb6298930 2023-08-10T10:51:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cb6158840 con 0x555cb626b210 2023-08-10T10:51:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.421+0000 7fe5c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51828/0 (socket says 172.21.15.50:51828) 2023-08-10T10:51:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 -- 172.21.15.50:0/4120794087 learned_addr learned my addr 172.21.15.50:0/4120794087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6298930 0x555cb626d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 -- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 msgr2=0x555cb62c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 -- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6298930 msgr2=0x555cb626d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6298930 0x555cb626d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 -- 172.21.15.50:0/4120794087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cb62048a0 con 0x555cb6297690 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.422+0000 7fe5c77fe640 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80c4e80 tx=0x7fe5bc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42700f968c8688b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5ae7fc640 1 -- 172.21.15.50:0/4120794087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0076b0 con 0x555cb6297690 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5ae7fc640 1 -- 172.21.15.50:0/4120794087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc01c070 con 0x555cb6297690 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5ae7fc640 1 -- 172.21.15.50:0/4120794087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00c870 con 0x555cb6297690 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/4120794087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 msgr2=0x555cb626b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80c4e80 tx=0x7fe5bc00f000 comp rx=0 tx=0).stop 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/4120794087 shutdown_connections 2023-08-10T10:51:58.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6298930 0x555cb626d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6297690 0x555cb626b7e0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/4120794087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/4120794087 >> 172.21.15.50:0/4120794087 conn(0x555cb6267610 msgr2=0x555cb62acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/4120794087 shutdown_connections 2023-08-10T10:51:58.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.423+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/4120794087 wait complete. 2023-08-10T10:51:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.424+0000 7fe5d0ffe740 1 -- start start 2023-08-10T10:51:58.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.424+0000 7fe5d0ffe740 1 Processor -- start 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6292010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb62c1a80 con 0x555cb6298930 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb6293630 con 0x555cb6297690 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cb62c1270 con 0x555cb626b210 2023-08-10T10:51:58.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5d0ffe740 10 client.0 _ll_register_callbacks cb 0x7fe5c002cc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.425+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51838/0 (socket says 172.21.15.50:51838) 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1588620178 learned_addr learned my addr 172.21.15.50:0/1588620178 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 msgr2=0x555cb62c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 msgr2=0x555cb6292010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6292010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 -- 172.21.15.50:0/1588620178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0070d0 con 0x555cb6298930 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5cca2b640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0004af0 tx=0x7fe5c0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79409de71d7ff3e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.426+0000 7fe5a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0061070 con 0x555cb6298930 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5c0003b70 con 0x555cb6298930 2023-08-10T10:51:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5c0003990 con 0x555cb6298930 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5c0007080 con 0x555cb6298930 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 10 client.9573 fetch_fsmap learned FSMap version 93 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x555cb6170610 con 0x555cb6298930 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0068070 con 0x555cb6298930 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 93) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe5c0064020 con 0x555cb6298930 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 10 client.9573 fetch_fsmap finished waiting for FSMap version 93 2023-08-10T10:51:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 10 client.9573 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 20 client.9573 populate_metadata read hostname 'smithi050' 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb626b7e0 0x555cb626bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 4 client.9573 mds_command: new command op to 9393 tid=0[{"prefix": "status"}] 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.427+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 --> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555cb61c9990 con 0x555cb626b7e0 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb626b7e0 0x555cb626bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5c7fff640 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb626b7e0 0x555cb626bbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f222d0f6cf0296e8 server_cookie=8c51e6e2f8d54218 in_seq=0 out_seq=0 2023-08-10T10:51:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5a6ffd640 10 client.9573 ms_handle_connect on v2:172.21.15.50:6834/3577041513 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5a6ffd640 1 -- 172.21.15.50:0/1588620178 <== mds.0 v2:172.21.15.50:6834/3577041513 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x555cb61c9990 con 0x555cb626b7e0 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5a6ffd640 10 client.9573 handle_command_reply: tid=0 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.428+0000 7fe5d0ffe740 1 client.9573 shutdown 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 msgr2=0x555cb6292550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0004af0 tx=0x7fe5c0030000 comp rx=0 tx=0).stop 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 shutdown_connections 2023-08-10T10:51:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:6834/3577041513,v1:172.21.15.50:6836/3577041513] conn(0x555cb626b7e0 0x555cb626bbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555cb6298930 0x555cb6292550 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cb6297690 0x555cb6292010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 --2- 172.21.15.50:0/1588620178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cb626b210 0x555cb62c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5a6ffd640 0 client.9573 ms_handle_reset on v2:172.21.15.50:6834/3577041513 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 >> 172.21.15.50:0/1588620178 conn(0x555cb6267610 msgr2=0x555cb626d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 shutdown_connections 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 1 -- 172.21.15.50:0/1588620178 wait complete. 2023-08-10T10:51:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.429+0000 7fe5d0ffe740 20 client.9573 trim_cache size 0 max 16384 2023-08-10T10:51:58.439 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:51:58.439 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:51:58.439 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-08-10T10:51:58.439 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9393, 2023-08-10T10:51:58.439 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.8133798759999999, 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 93, 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 188, 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 188, 2023-08-10T10:51:58.440 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.809386352000001 2023-08-10T10:51:58.441 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:51:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 msgr2=0x7fe5b406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 0x7fe5b406d110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc001200 tx=0x7fe5bc001150 comp rx=0 tx=0).stop 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 msgr2=0x7fe5c80712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c780 tx=0x7fe5b800cc40 comp rx=0 tx=0).stop 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 shutdown_connections 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe5b406ac50 0x7fe5b406d110 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5c8165530 0x7fe5c80c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5c80c1a10 0x7fe5c8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 --2- 172.21.15.50:0/2255913046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c8069db0 0x7fe5c80712a0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 >> 172.21.15.50:0/2255913046 conn(0x7fe5c80cafa0 msgr2=0x7fe5c80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 shutdown_connections 2023-08-10T10:51:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.430+0000 7fe5cd22c640 1 -- 172.21.15.50:0/2255913046 wait complete. 2023-08-10T10:51:58.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:51:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.685+0000 7f2d47301640 1 Processor -- start 2023-08-10T10:51:58.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.685+0000 7f2d47301640 1 -- start start 2023-08-10T10:51:58.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d47301640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d4015aa40 0x7f2d400b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d47301640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d400b0c60 0x7f2d400b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d47301640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d40071c70 con 0x7f2d40070e80 2023-08-10T10:51:58.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d47301640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400713d0 con 0x7f2d400b0c60 2023-08-10T10:51:58.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d47301640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400716b0 con 0x7f2d4015aa40 2023-08-10T10:51:58.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d4489c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d400b0c60 0x7f2d400b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d4489c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d400b0c60 0x7f2d400b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51844/0 (socket says 172.21.15.50:51844) 2023-08-10T10:51:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d4489c640 1 -- 172.21.15.50:0/2090339187 learned_addr learned my addr 172.21.15.50:0/2090339187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d4589e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d40070e80 0x7f2d400696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48446/0 (socket says 172.21.15.50:48446) 2023-08-10T10:51:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.687+0000 7f2d4509d640 1 --2- 172.21.15.50:0/2090339187 >> v2:172.21.15.117:3300/0 conn(0x7f2d4015aa40 0x7f2d400b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.688+0000 7f2d4489c640 1 -- 172.21.15.50:0/2090339187 >> v2:172.21.15.117:3300/0 conn(0x7f2d4015aa40 msgr2=0x7f2d400b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.688+0000 7f2d4489c640 1 --2- 172.21.15.50:0/2090339187 >> v2:172.21.15.117:3300/0 conn(0x7f2d4015aa40 0x7f2d400b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.688+0000 7f2d4489c640 1 -- 172.21.15.50:0/2090339187 >> v1:172.21.15.50:6789/0 conn(0x7f2d40070e80 legacy=0x7f2d400696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.688+0000 7f2d37fff640 1 -- 172.21.15.50:0/2090339187 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547186811 0 0) 0x7f2d40071c70 con 0x7f2d40070e80 2023-08-10T10:51:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.688+0000 7f2d4489c640 1 -- 172.21.15.50:0/2090339187 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40071990 con 0x7f2d400b0c60 2023-08-10T10:51:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.689+0000 7f2d4489c640 1 --2- 172.21.15.50:0/2090339187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d400b3d60 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c8dc0 tx=0x7f2d3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbd4c7556db9dfe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.689+0000 7f2d37fff640 1 -- 172.21.15.50:0/2090339187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30031870 con 0x7f2d400b0c60 2023-08-10T10:51:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d37fff640 1 -- 172.21.15.50:0/2090339187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d300319d0 con 0x7f2d400b0c60 2023-08-10T10:51:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d37fff640 1 -- 172.21.15.50:0/2090339187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30031d60 con 0x7f2d400b0c60 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 -- 172.21.15.50:0/2090339187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 msgr2=0x7f2d400b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 --2- 172.21.15.50:0/2090339187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d400b3d60 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c8dc0 tx=0x7f2d3002b910 comp rx=0 tx=0).stop 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 -- 172.21.15.50:0/2090339187 shutdown_connections 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 --2- 172.21.15.50:0/2090339187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d400b3d60 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 --2- 172.21.15.50:0/2090339187 >> v2:172.21.15.117:3300/0 conn(0x7f2d4015aa40 0x7f2d400b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 -- 172.21.15.50:0/2090339187 >> 172.21.15.50:0/2090339187 conn(0x7f2d4006b590 msgr2=0x7f2d400ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 -- 172.21.15.50:0/2090339187 shutdown_connections 2023-08-10T10:51:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.690+0000 7f2d47301640 1 -- 172.21.15.50:0/2090339187 wait complete. 2023-08-10T10:51:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.692+0000 7f2d47301640 1 Processor -- start 2023-08-10T10:51:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.692+0000 7f2d47301640 1 -- start start 2023-08-10T10:51:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d40070e80 0x7f2d400c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d4015aa40 0x7f2d400cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400c4be0 con 0x7f2d400b0c60 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401f9000 con 0x7f2d40070e80 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.693+0000 7f2d47301640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401f92e0 con 0x7f2d4015aa40 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51854/0 (socket says 172.21.15.50:51854) 2023-08-10T10:51:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 -- 172.21.15.50:0/674499021 learned_addr learned my addr 172.21.15.50:0/674499021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:51:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4589e640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d4015aa40 0x7f2d400cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4509d640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d40070e80 0x7f2d400c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 -- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d4015aa40 msgr2=0x7f2d400cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d4015aa40 0x7f2d400cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 -- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d40070e80 msgr2=0x7f2d400c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d40070e80 0x7f2d400c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.694+0000 7f2d4489c640 1 -- 172.21.15.50:0/674499021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300094d0 con 0x7f2d400b0c60 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d4489c640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002b950 tx=0x7f2d300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004230 con 0x7f2d400b0c60 2023-08-10T10:51:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30004390 con 0x7f2d400b0c60 2023-08-10T10:51:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3003ba60 con 0x7f2d400b0c60 2023-08-10T10:51:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d401f95c0 con 0x7f2d400b0c60 2023-08-10T10:51:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.695+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d401f9b80 con 0x7f2d400b0c60 2023-08-10T10:51:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.697+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4006f8a0 con 0x7f2d400b0c60 2023-08-10T10:51:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.697+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d30043070 con 0x7f2d400b0c60 2023-08-10T10:51:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.698+0000 7f2d35ffb640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 0x7f2d2406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.698+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d3002d040 con 0x7f2d400b0c60 2023-08-10T10:51:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.699+0000 7f2d4509d640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 0x7f2d2406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.699+0000 7f2d4509d640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 0x7f2d2406d110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:58.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.703+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2d300766f0 con 0x7f2d400b0c60 2023-08-10T10:51:58.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.934+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d401f9d70 con 0x7f2d400b0c60 2023-08-10T10:51:58.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.935+0000 7f2d35ffb640 1 -- 172.21.15.50:0/674499021 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d30079d10 con 0x7f2d400b0c60 2023-08-10T10:51:58.937 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:51:58.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.937+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 msgr2=0x7f2d2406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.937+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 0x7f2d2406d110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.937+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 msgr2=0x7f2d401f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.937+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002b950 tx=0x7f2d300046c0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 shutdown_connections 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d4015aa40 0x7f2d400cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d400b0c60 0x7f2d401f8620 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2d2406ac50 0x7f2d2406d110 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 --2- 172.21.15.50:0/674499021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d40070e80 0x7f2d400c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 >> 172.21.15.50:0/674499021 conn(0x7f2d4006b590 msgr2=0x7f2d400c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 shutdown_connections 2023-08-10T10:51:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:51:58.938+0000 7f2d47301640 1 -- 172.21.15.50:0/674499021 wait complete. 2023-08-10T10:51:58.959 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:51:58.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:51:58.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-08-10T10:51:58.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:51:58.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:51:58.961 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:51:58.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:51:58.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:51:58.962 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:51:58.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:58.963 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-08-10T10:51:59.021 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:51:59.021 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:51:59.022 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:51:59.023 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-08-10T10:51:59.023 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:51:59.023 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:51:59.023 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 40407sec preferred_lft 40407sec 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-08-10T10:51:59.024 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.025 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::908a:1bff:fe71:8280/64 scope link 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 7a:c3:16:8e:35:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::78c3:16ff:fe8e:3539/64 scope link 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:51:59.027 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 06:4d:ae:02:20:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:51:59.027 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44d:aeff:fe02:2010/64 scope link 2023-08-10T10:51:59.027 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:51:59.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.029 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:51:59.128 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-08-10T10:51:59.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.132 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-08-10T10:51:59.193 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-08-10T10:51:59.193 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:51:59.193 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-10T10:51:59.193 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-10T10:51:59.194 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:51:59.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.194 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-08-10T10:51:59.195 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-08-10T10:51:59.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-10T10:51:59.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-10T10:51:59.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-10T10:51:59.196 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-08-10T10:51:59.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.397 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:51:59.451 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:51:59.452 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:51:59.452 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:51:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-08-10T10:51:59.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:51:59.553 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:51:59.613 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:51:59.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:51:59.613 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:51:59.668 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:51:59.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:51:59.825 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:51:59.825 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:51:59.856 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:51:59.856 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:51:59.856 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:51:59.857 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:51:59.857 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:51:59.859 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-10T10:51:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:51:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:51:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:51:59.859 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:51:59.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:51:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:51:59.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:51:59.943 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:52:00.011 INFO:teuthology.orchestra.run.smithi050.stdout:client9585 2023-08-10T10:52:00.011 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:00.012 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:00.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:52:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.287+0000 7fd61bfff640 1 Processor -- start 2023-08-10T10:52:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.288+0000 7fd61bfff640 1 -- start start 2023-08-10T10:52:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.289+0000 7fd61bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd61c0696a0 0x7fd61c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.289+0000 7fd61bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd61c069a80 0x7fd61c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.289+0000 7fd61bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0b2280 con 0x7fd61c15ad00 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.289+0000 7fd61bfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0b19e0 con 0x7fd61c069a80 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.289+0000 7fd61bfff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0b1cc0 con 0x7fd61c0696a0 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd61c069a80 0x7fd61c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd61c069a80 0x7fd61c0ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51860/0 (socket says 172.21.15.50:51860) 2023-08-10T10:52:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 -- 172.21.15.50:0/1573566995 learned_addr learned my addr 172.21.15.50:0/1573566995 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61affd640 1 --2- 172.21.15.50:0/1573566995 >> v2:172.21.15.117:3300/0 conn(0x7fd61c0696a0 0x7fd61c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 -- 172.21.15.50:0/1573566995 >> v2:172.21.15.117:3300/0 conn(0x7fd61c0696a0 msgr2=0x7fd61c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 --2- 172.21.15.50:0/1573566995 >> v2:172.21.15.117:3300/0 conn(0x7fd61c0696a0 0x7fd61c0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.290+0000 7fd61b7fe640 1 -- 172.21.15.50:0/1573566995 >> v1:172.21.15.117:6789/0 conn(0x7fd61c15ad00 legacy=0x7fd61c0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.291+0000 7fd61b7fe640 1 -- 172.21.15.50:0/1573566995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0b1fa0 con 0x7fd61c069a80 2023-08-10T10:52:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.292+0000 7fd61b7fe640 1 --2- 172.21.15.50:0/1573566995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c0ccfb0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fd61c06ce50 tx=0x7fd61402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99764d86e5e0e6fb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.292+0000 7fd61a7fc640 1 -- 172.21.15.50:0/1573566995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61402ca80 con 0x7fd61c069a80 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.292+0000 7fd61a7fc640 1 -- 172.21.15.50:0/1573566995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61402cbe0 con 0x7fd61c069a80 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.292+0000 7fd61a7fc640 1 -- 172.21.15.50:0/1573566995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6140343f0 con 0x7fd61c069a80 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 -- 172.21.15.50:0/1573566995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 msgr2=0x7fd61c0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 --2- 172.21.15.50:0/1573566995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c0ccfb0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fd61c06ce50 tx=0x7fd61402bee0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 -- 172.21.15.50:0/1573566995 shutdown_connections 2023-08-10T10:52:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 --2- 172.21.15.50:0/1573566995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c0ccfb0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 --2- 172.21.15.50:0/1573566995 >> v2:172.21.15.117:3300/0 conn(0x7fd61c0696a0 0x7fd61c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 -- 172.21.15.50:0/1573566995 >> 172.21.15.50:0/1573566995 conn(0x7fd61c0cafa0 msgr2=0x7fd61c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 -- 172.21.15.50:0/1573566995 shutdown_connections 2023-08-10T10:52:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.293+0000 7fd61bfff640 1 -- 172.21.15.50:0/1573566995 wait complete. 2023-08-10T10:52:00.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.295+0000 7fd61bfff640 1 Processor -- start 2023-08-10T10:52:00.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.295+0000 7fd61bfff640 1 -- start start 2023-08-10T10:52:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61c0696a0 0x7fd61c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c15ad00 0x7fd61c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c7a30 con 0x7fd61c069a80 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c7d10 con 0x7fd61c15ad00 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd61bfff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c7ff0 con 0x7fd61c0696a0 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd613fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd613fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51868/0 (socket says 172.21.15.50:51868) 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.296+0000 7fd613fff640 1 -- 172.21.15.50:0/4215957057 learned_addr learned my addr 172.21.15.50:0/4215957057 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd61affd640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61c0696a0 0x7fd61c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd61b7fe640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c15ad00 0x7fd61c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 -- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61c0696a0 msgr2=0x7fd61c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61c0696a0 0x7fd61c15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 -- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c15ad00 msgr2=0x7fd61c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c15ad00 0x7fd61c1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 -- 172.21.15.50:0/4215957057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614009b30 con 0x7fd61c069a80 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.297+0000 7fd613fff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c400 tx=0x7fd60400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.298+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040052d0 con 0x7fd61c069a80 2023-08-10T10:52:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.298+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604005430 con 0x7fd61c069a80 2023-08-10T10:52:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.298+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c0c82d0 con 0x7fd61c069a80 2023-08-10T10:52:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.298+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604003830 con 0x7fd61c069a80 2023-08-10T10:52:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.298+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c15d2d0 con 0x7fd61c069a80 2023-08-10T10:52:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.299+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c066e30 con 0x7fd61c069a80 2023-08-10T10:52:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.300+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd604003990 con 0x7fd61c069a80 2023-08-10T10:52:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.301+0000 7fd6137fe640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 0x7fd5fc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.301+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd604088b70 con 0x7fd61c069a80 2023-08-10T10:52:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.301+0000 7fd61affd640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 0x7fd5fc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.302+0000 7fd61affd640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 0x7fd5fc06d110 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006fd0 tx=0x7fd60c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.305+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd604053af0 con 0x7fd61c069a80 2023-08-10T10:52:00.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.535+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd61c1efbe0 con 0x7fd61c069a80 2023-08-10T10:52:00.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.536+0000 7fd6137fe640 1 -- 172.21.15.50:0/4215957057 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd604017020 con 0x7fd61c069a80 2023-08-10T10:52:00.538 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T10:52:00.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 msgr2=0x7fd5fc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 0x7fd5fc06d110 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006fd0 tx=0x7fd60c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:00.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 msgr2=0x7fd61c155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:00.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c400 tx=0x7fd60400c8c0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 shutdown_connections 2023-08-10T10:52:00.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd5fc06ac50 0x7fd5fc06d110 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c15ad00 0x7fd61c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd61c069a80 0x7fd61c155e70 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 --2- 172.21.15.50:0/4215957057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61c0696a0 0x7fd61c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 >> 172.21.15.50:0/4215957057 conn(0x7fd61c0cafa0 msgr2=0x7fd61c159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 shutdown_connections 2023-08-10T10:52:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:00.539+0000 7fd61bfff640 1 -- 172.21.15.50:0/4215957057 wait complete. 2023-08-10T10:52:00.559 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:52:00.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:52:00.561 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-10T10:52:00.561 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:52:00.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:52:00.563 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:52:00.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-10T10:52:00.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:52:00.565 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:52:00.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:00.566 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-10T10:52:00.629 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.630 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:52:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:52:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-08-10T10:52:00.631 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:52:00.632 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:52:00.632 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-08-10T10:52:00.632 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:52:00.632 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:52:00.632 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 40577sec preferred_lft 40577sec 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:52:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ba:44ff:fe4c:4d82/64 scope link 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 86:73:ef:92:8f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::8473:efff:fe92:8fa2/64 scope link 2023-08-10T10:52:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.635 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:52:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fe:da:ea:40:da:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:52:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::fcda:eaff:fe40:da96/64 scope link 2023-08-10T10:52:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:52:00.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:00.637 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:52:00.734 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-10T10:52:00.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:00.740 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-10T10:52:00.796 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-10T10:52:00.796 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:52:00.796 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:52:00.796 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:52:00.796 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:52:00.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:00.798 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-10T10:52:00.798 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-10T10:52:00.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:52:00.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:52:00.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:52:00.799 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-10T10:52:00.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:00.986 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:52:01.035 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:52:01.036 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:52:01.036 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:52:01.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:01.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-10T10:52:01.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:52:01.127 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:52:01.178 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:52:01.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:52:01.178 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:52:01.228 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:52:01.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:01.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:52:01.371 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:52:01.372 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:52:01.405 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:52:01.406 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:52:01.406 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-10T10:52:01.406 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@6795d532-1ac6-4473-b42c-017ab0d4d08a.cephfs=/ 2023-08-10T10:52:01.406 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2023-08-10T10:52:01.407 INFO:teuthology.orchestra.run.smithi117.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-10T10:52:01.408 INFO:teuthology.orchestra.run.smithi117.stdout: You just mounted a file system that supports labels which does not 2023-08-10T10:52:01.408 INFO:teuthology.orchestra.run.smithi117.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-10T10:52:01.408 INFO:teuthology.orchestra.run.smithi117.stdout: applications will generate AVC messages and not be allowed access to 2023-08-10T10:52:01.408 INFO:teuthology.orchestra.run.smithi117.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-10T10:52:01.411 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:52:01.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:01.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:52:01.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:01.494 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:52:01.548 INFO:teuthology.orchestra.run.smithi117.stdout:client6467 2023-08-10T10:52:01.548 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:01.549 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:01.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.841+0000 7fba49186640 1 Processor -- start 2023-08-10T10:52:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.841+0000 7fba49186640 1 -- start start 2023-08-10T10:52:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba49186640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba440b0620 0x7fba440ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba49186640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 0x7fba440cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba49186640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440b40b0 con 0x7fba44161140 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba49186640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440cc100 con 0x7fba440b0620 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba49186640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440cc3e0 con 0x7fba440c14e0 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba43fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba44161140 0x7fba440aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48460/0 (socket says 172.21.15.50:48460) 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba43fff640 1 -- 172.21.15.50:0/89223163 learned_addr learned my addr 172.21.15.50:0/89223163 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.843+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/89223163 >> v2:172.21.15.50:3300/0 conn(0x7fba440b0620 0x7fba440ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba48985640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 0x7fba440cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba3b7fe640 1 -- 172.21.15.50:0/89223163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 msgr2=0x7fba440cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 0x7fba440cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba3b7fe640 1 -- 172.21.15.50:0/89223163 >> v1:172.21.15.50:6789/0 conn(0x7fba44161140 legacy=0x7fba440aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba3b7fe640 1 -- 172.21.15.50:0/89223163 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440cc6c0 con 0x7fba440b0620 2023-08-10T10:52:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.844+0000 7fba48985640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 0x7fba440cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.845+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440b0620 0x7fba440ccbe0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0097a0 tx=0x7fba2c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b95a4a48c8222ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.845+0000 7fba437fe640 1 -- 172.21.15.50:0/89223163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c02d040 con 0x7fba440b0620 2023-08-10T10:52:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.845+0000 7fba437fe640 1 -- 172.21.15.50:0/89223163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c031810 con 0x7fba440b0620 2023-08-10T10:52:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.845+0000 7fba437fe640 1 -- 172.21.15.50:0/89223163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c031ba0 con 0x7fba440b0620 2023-08-10T10:52:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 -- 172.21.15.50:0/89223163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440b0620 msgr2=0x7fba440ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440b0620 0x7fba440ccbe0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0097a0 tx=0x7fba2c02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 -- 172.21.15.50:0/89223163 shutdown_connections 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440b0620 0x7fba440ccbe0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 --2- 172.21.15.50:0/89223163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba440c14e0 0x7fba440cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 -- 172.21.15.50:0/89223163 >> 172.21.15.50:0/89223163 conn(0x7fba4406ab80 msgr2=0x7fba4406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 -- 172.21.15.50:0/89223163 shutdown_connections 2023-08-10T10:52:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.846+0000 7fba49186640 1 -- 172.21.15.50:0/89223163 wait complete. 2023-08-10T10:52:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.848+0000 7fba49186640 1 Processor -- start 2023-08-10T10:52:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.848+0000 7fba49186640 1 -- start start 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440b0620 0x7fba441f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba44161140 0x7fba440c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba441f64b0 con 0x7fba440c14e0 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440b3940 con 0x7fba440b0620 2023-08-10T10:52:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba49186640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c7ef0 con 0x7fba44161140 2023-08-10T10:52:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51888/0 (socket says 172.21.15.50:51888) 2023-08-10T10:52:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.849+0000 7fba3b7fe640 1 -- 172.21.15.50:0/627587140 learned_addr learned my addr 172.21.15.50:0/627587140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 -- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba44161140 msgr2=0x7fba440c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba44161140 0x7fba440c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 -- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440b0620 msgr2=0x7fba441f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440b0620 0x7fba441f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 -- 172.21.15.50:0/627587140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c009400 con 0x7fba440c14e0 2023-08-10T10:52:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.850+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c03ad60 con 0x7fba440c14e0 2023-08-10T10:52:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.851+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c0443f0 con 0x7fba440c14e0 2023-08-10T10:52:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.851+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0447a0 con 0x7fba440c14e0 2023-08-10T10:52:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.851+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba440c81d0 con 0x7fba440c14e0 2023-08-10T10:52:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.851+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba440c8790 con 0x7fba440c14e0 2023-08-10T10:52:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.852+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44066e30 con 0x7fba440c14e0 2023-08-10T10:52:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.853+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba2c04d450 con 0x7fba440c14e0 2023-08-10T10:52:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.854+0000 7fba417fa640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 0x7fba2806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.854+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba2c0ab830 con 0x7fba440c14e0 2023-08-10T10:52:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.854+0000 7fba43fff640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 0x7fba2806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.855+0000 7fba43fff640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 0x7fba2806d110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fba340015f0 tx=0x7fba34007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:01.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:01.859+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fba2c0768d0 con 0x7fba440c14e0 2023-08-10T10:52:02.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.093+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba440c5220 con 0x7fba440c14e0 2023-08-10T10:52:02.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.095+0000 7fba417fa640 1 -- 172.21.15.50:0/627587140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7fba2c079ef0 con 0x7fba440c14e0 2023-08-10T10:52:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:02.097 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:02.097 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:02.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.097+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 msgr2=0x7fba2806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.097+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 0x7fba2806d110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fba340015f0 tx=0x7fba34007a40 comp rx=0 tx=0).stop 2023-08-10T10:52:02.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.097+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 msgr2=0x7fba440c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.097+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 shutdown_connections 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba44161140 0x7fba440c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba440c14e0 0x7fba440c5560 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fba2806ac50 0x7fba2806d110 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 --2- 172.21.15.50:0/627587140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440b0620 0x7fba441f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 >> 172.21.15.50:0/627587140 conn(0x7fba4406ab80 msgr2=0x7fba440afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 shutdown_connections 2023-08-10T10:52:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.098+0000 7fba49186640 1 -- 172.21.15.50:0/627587140 wait complete. 2023-08-10T10:52:02.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:52:02.366 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":9393,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.732452417999999,"mdsmap_epoch":93,"osdmap_epoch":188,"osdmap_epoch_barrier":188,"uptime":16.728473344000001} 2023-08-10T10:52:02.367 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 9393, "mdsmap_epoch": 93, "osdmap_epoch": 188, "osdmap_epoch_barrier": 188, "rank_uptime": 10.732452418, "state": "up:active", "uptime": 16.728473344, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:52:02.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-10T10:52:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.602+0000 7f6725d42640 1 Processor -- start 2023-08-10T10:52:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.603+0000 7f6725d42640 1 -- start start 2023-08-10T10:52:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.604+0000 7f6725d42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67200d2560 0x7f67200b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.604+0000 7f6725d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200d20d0 con 0x7f672015cbe0 2023-08-10T10:52:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.604+0000 7f6725d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672015cfc0 con 0x7f67200b8760 2023-08-10T10:52:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.604+0000 7f6725d42640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67200d12d0 con 0x7f67200d2560 2023-08-10T10:52:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.605+0000 7f671f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f672015cbe0 0x7f67200d0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48466/0 (socket says 172.21.15.50:48466) 2023-08-10T10:52:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.605+0000 7f671f7fe640 1 -- 172.21.15.50:0/1028939689 learned_addr learned my addr 172.21.15.50:0/1028939689 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.605+0000 7f671effd640 1 --2- 172.21.15.50:0/1028939689 >> v2:172.21.15.117:3300/0 conn(0x7f67200d2560 0x7f67200b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.605+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169893452 0 0) 0x7f67200d20d0 con 0x7f672015cbe0 2023-08-10T10:52:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.605+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6708003520 con 0x7f672015cbe0 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 35466778 0 0) 0x7f6708003520 con 0x7f672015cbe0 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 >> v2:172.21.15.117:3300/0 conn(0x7f67200d2560 msgr2=0x7f67200b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 --2- 172.21.15.50:0/1028939689 >> v2:172.21.15.117:3300/0 conn(0x7f67200d2560 0x7f67200b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 >> v1:172.21.15.117:6789/0 conn(0x7f67200b8760 legacy=0x7f67200b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200d14c0 con 0x7f672015cbe0 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f6710001670 con 0x7f672015cbe0 2023-08-10T10:52:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 >> v1:172.21.15.50:6789/0 conn(0x7f672015cbe0 legacy=0x7f67200d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708003970 0x7f6708003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 0x7f6708004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6708005040 0x7f670800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670800bec0 con 0x7f6708004370 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670800c030 con 0x7f6708005040 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670800c1f0 con 0x7f6708003970 2023-08-10T10:52:02.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.606+0000 7f671effd640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 0x7f6708004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671f7fe640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708003970 0x7f6708003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671ffff640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6708005040 0x7f670800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671effd640 1 -- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708003970 msgr2=0x7f6708003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671effd640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708003970 0x7f6708003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671effd640 1 -- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6708005040 msgr2=0x7f670800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671effd640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6708005040 0x7f670800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671effd640 1 -- 172.21.15.50:0/1028939689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708003520 con 0x7f6708004370 2023-08-10T10:52:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.607+0000 7f671ffff640 1 -- 172.21.15.50:0/1028939689 reap_dead start 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.608+0000 7f671effd640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 0x7f6708004840 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f6714009ac0 tx=0x7f67080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbe325000bcf11e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.609+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671402c6b0 con 0x7f6708004370 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.609+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671402c810 con 0x7f6708004370 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.609+0000 7f671e7fc640 1 -- 172.21.15.50:0/1028939689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671402cba0 con 0x7f6708004370 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.609+0000 7f6725d42640 1 -- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 msgr2=0x7f6708004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.609+0000 7f6725d42640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 0x7f6708004840 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f6714009ac0 tx=0x7f67080057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.610+0000 7f6725d42640 1 -- 172.21.15.50:0/1028939689 shutdown_connections 2023-08-10T10:52:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.610+0000 7f6725d42640 1 --2- 172.21.15.50:0/1028939689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6708004370 0x7f6708004840 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.610+0000 7f6725d42640 1 -- 172.21.15.50:0/1028939689 >> 172.21.15.50:0/1028939689 conn(0x7f67200702f0 msgr2=0x7f67200d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.610+0000 7f6725d42640 1 -- 172.21.15.50:0/1028939689 shutdown_connections 2023-08-10T10:52:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.610+0000 7f6725d42640 1 -- 172.21.15.50:0/1028939689 wait complete. 2023-08-10T10:52:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.612+0000 7f6725d42640 1 Processor -- start 2023-08-10T10:52:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.612+0000 7f6725d42640 1 -- start start 2023-08-10T10:52:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708004370 0x7f67201f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67201f5b10 0x7f6720157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720158230 con 0x7f6720157db0 2023-08-10T10:52:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200c6d80 con 0x7f67201f5b10 2023-08-10T10:52:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f6725d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200c6f90 con 0x7f6708004370 2023-08-10T10:52:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f671ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f671ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51906/0 (socket says 172.21.15.50:51906) 2023-08-10T10:52:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f671ffff640 1 -- 172.21.15.50:0/3013420140 learned_addr learned my addr 172.21.15.50:0/3013420140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f671f7fe640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708004370 0x7f67201f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.614+0000 7f671effd640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67201f5b10 0x7f6720157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 -- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708004370 msgr2=0x7f67201f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708004370 0x7f67201f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 -- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67201f5b10 msgr2=0x7f6720157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67201f5b10 0x7f6720157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 -- 172.21.15.50:0/3013420140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200c7270 con 0x7f6720157db0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.615+0000 7f671ffff640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f6718007fd0 tx=0x7f671800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.616+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718003970 con 0x7f6720157db0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.616+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718003ad0 con 0x7f6720157db0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.616+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718003e80 con 0x7f6720157db0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.616+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67200c7550 con 0x7f6720157db0 2023-08-10T10:52:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.616+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67200c7b10 con 0x7f6720157db0 2023-08-10T10:52:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.617+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67201e6b30 con 0x7f6720157db0 2023-08-10T10:52:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.618+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67180050d0 con 0x7f6720157db0 2023-08-10T10:52:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.619+0000 7f6707fff640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 0x7f670c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.619+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67180893c0 con 0x7f6720157db0 2023-08-10T10:52:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.619+0000 7f671f7fe640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 0x7f670c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.620+0000 7f671f7fe640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 0x7f670c06d140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6710001cb0 tx=0x7f6710009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:02.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.624+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6718057ef0 con 0x7f6720157db0 2023-08-10T10:52:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:02.820+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f672004e270 con 0x7f6720157db0 2023-08-10T10:52:03.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.748+0000 7f6707fff640 1 -- 172.21.15.50:0/3013420140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v189) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6718057a80 con 0x7f6720157db0 2023-08-10T10:52:03.750 INFO:teuthology.orchestra.run.smithi050.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-10T10:52:03.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 msgr2=0x7f670c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:03.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 0x7f670c06d140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6710001cb0 tx=0x7f6710009040 comp rx=0 tx=0).stop 2023-08-10T10:52:03.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 msgr2=0x7f672015d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:03.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f6718007fd0 tx=0x7f671800eb90 comp rx=0 tx=0).stop 2023-08-10T10:52:03.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 shutdown_connections 2023-08-10T10:52:03.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6720157db0 0x7f672015d410 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:03.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f670c06ac80 0x7f670c06d140 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67201f5b10 0x7f6720157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 --2- 172.21.15.50:0/3013420140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6708004370 0x7f67201f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 >> 172.21.15.50:0/3013420140 conn(0x7f67200702f0 msgr2=0x7f6720159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 shutdown_connections 2023-08-10T10:52:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:03.753+0000 7f6725d42640 1 -- 172.21.15.50:0/3013420140 wait complete. 2023-08-10T10:52:03.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-10T10:52:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"osd_mon_report_interval":"5"} 2023-08-10T10:52:04.023 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-10T10:52:04.023 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-08-10T10:52:04.023 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:04.024 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:04.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:04.079 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-08-10T10:52:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:16+0 records in 2023-08-10T10:52:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:16+0 records out 2023-08-10T10:52:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.178786 s, 93.8 MB/s 2023-08-10T10:52:04.319 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:04.320 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:04.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:04.375 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-08-10T10:52:04.596 INFO:teuthology.orchestra.run.smithi050.stderr:17+0 records in 2023-08-10T10:52:04.596 INFO:teuthology.orchestra.run.smithi050.stderr:17+0 records out 2023-08-10T10:52:04.597 INFO:teuthology.orchestra.run.smithi050.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.170632 s, 104 MB/s 2023-08-10T10:52:04.598 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-10T10:52:04.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.824+0000 7fa841a0d640 1 Processor -- start 2023-08-10T10:52:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.824+0000 7fa841a0d640 1 -- start start 2023-08-10T10:52:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa841a0d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa83c15aa40 0x7fa83c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa841a0d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa83c0b0c60 0x7fa83c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa841a0d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c071c70 con 0x7fa83c070e80 2023-08-10T10:52:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa841a0d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0713d0 con 0x7fa83c0b0c60 2023-08-10T10:52:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa841a0d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0716b0 con 0x7fa83c15aa40 2023-08-10T10:52:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa833fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa83c0b0c60 0x7fa83c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa833fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa83c0b0c60 0x7fa83c0b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51908/0 (socket says 172.21.15.50:51908) 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.826+0000 7fa833fff640 1 -- 172.21.15.50:0/3617987183 learned_addr learned my addr 172.21.15.50:0/3617987183 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.827+0000 7fa833fff640 1 -- 172.21.15.50:0/3617987183 >> v2:172.21.15.117:3300/0 conn(0x7fa83c15aa40 msgr2=0x7fa83c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.827+0000 7fa833fff640 1 --2- 172.21.15.50:0/3617987183 >> v2:172.21.15.117:3300/0 conn(0x7fa83c15aa40 0x7fa83c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.827+0000 7fa833fff640 1 -- 172.21.15.50:0/3617987183 >> v1:172.21.15.117:6789/0 conn(0x7fa83c070e80 legacy=0x7fa83c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.827+0000 7fa833fff640 1 -- 172.21.15.50:0/3617987183 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c071990 con 0x7fa83c0b0c60 2023-08-10T10:52:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.828+0000 7fa833fff640 1 --2- 172.21.15.50:0/3617987183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0b0c60 0x7fa83c0b3d60 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0c8dc0 tx=0x7fa82402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1160bef307addeb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.828+0000 7fa83a7fc640 1 -- 172.21.15.50:0/3617987183 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8240317e0 con 0x7fa83c0b0c60 2023-08-10T10:52:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.828+0000 7fa83a7fc640 1 -- 172.21.15.50:0/3617987183 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824031940 con 0x7fa83c0b0c60 2023-08-10T10:52:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.828+0000 7fa83a7fc640 1 -- 172.21.15.50:0/3617987183 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824031cd0 con 0x7fa83c0b0c60 2023-08-10T10:52:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 -- 172.21.15.50:0/3617987183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0b0c60 msgr2=0x7fa83c0b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 --2- 172.21.15.50:0/3617987183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0b0c60 0x7fa83c0b3d60 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0c8dc0 tx=0x7fa82402b880 comp rx=0 tx=0).stop 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 -- 172.21.15.50:0/3617987183 shutdown_connections 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 --2- 172.21.15.50:0/3617987183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c0b0c60 0x7fa83c0b3d60 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 --2- 172.21.15.50:0/3617987183 >> v2:172.21.15.117:3300/0 conn(0x7fa83c15aa40 0x7fa83c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 -- 172.21.15.50:0/3617987183 >> 172.21.15.50:0/3617987183 conn(0x7fa83c06b590 msgr2=0x7fa83c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 -- 172.21.15.50:0/3617987183 shutdown_connections 2023-08-10T10:52:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.829+0000 7fa841a0d640 1 -- 172.21.15.50:0/3617987183 wait complete. 2023-08-10T10:52:04.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.831+0000 7fa841a0d640 1 Processor -- start 2023-08-10T10:52:04.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.831+0000 7fa841a0d640 1 -- start start 2023-08-10T10:52:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 0x7fa83c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 0x7fa83c0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1544f0 con 0x7fa83c15aa40 2023-08-10T10:52:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1538e0 con 0x7fa83c070e80 2023-08-10T10:52:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.832+0000 7fa841a0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c153bc0 con 0x7fa83c0b0c60 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51924/0 (socket says 172.21.15.50:51924) 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 -- 172.21.15.50:0/39793927 learned_addr learned my addr 172.21.15.50:0/39793927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa833fff640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 0x7fa83c0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83affd640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 0x7fa83c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 -- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 msgr2=0x7fa83c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 0x7fa83c0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 -- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 msgr2=0x7fa83c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 0x7fa83c0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83b7fe640 1 -- 172.21.15.50:0/39793927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240094d0 con 0x7fa83c15aa40 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa83affd640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 0x7fa83c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.833+0000 7fa833fff640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 0x7fa83c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa83b7fe640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fa83400c780 tx=0x7fa83400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834003d80 con 0x7fa83c15aa40 2023-08-10T10:52:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400ce90 con 0x7fa83c15aa40 2023-08-10T10:52:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340052b0 con 0x7fa83c15aa40 2023-08-10T10:52:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c153ea0 con 0x7fa83c15aa40 2023-08-10T10:52:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.834+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c153590 con 0x7fa83c15aa40 2023-08-10T10:52:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.835+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c154660 con 0x7fa83c15aa40 2023-08-10T10:52:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.837+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa834005410 con 0x7fa83c15aa40 2023-08-10T10:52:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.838+0000 7fa838ff9640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 0x7fa81c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.838+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa834088a80 con 0x7fa83c15aa40 2023-08-10T10:52:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.838+0000 7fa83affd640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 0x7fa81c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.839+0000 7fa83affd640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 0x7fa81c06d110 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00a870 tx=0x7fa82c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:04.843+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa834053a90 con 0x7fa83c15aa40 2023-08-10T10:52:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.039+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa83c04e270 con 0x7fa83c15aa40 2023-08-10T10:52:05.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.043+0000 7fa838ff9640 1 -- 172.21.15.50:0/39793927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+36937 (secure 0 0 0) 0x7fa8340570b0 con 0x7fa83c15aa40 2023-08-10T10:52:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:05.045 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 189, 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:03.732548+0000", 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "189", 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:05.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.105 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.106 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.125 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.126 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:05.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:05.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:05.144 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:05.145 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.146 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.150 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:05.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.158 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.160 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:05.164 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:05.165 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:05.166 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:05.167 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.168 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.170 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:05.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:05.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:05.174 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.175 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:05.176 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.177 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.178 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.179 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:05.180 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.181 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.182 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:05.183 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:05.185 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:05.186 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:05.187 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:05.188 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:05.189 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 msgr2=0x7fa81c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 0x7fa81c06d110 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00a870 tx=0x7fa82c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 msgr2=0x7fa83c1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fa83400c780 tx=0x7fa83400cc40 comp rx=0 tx=0).stop 2023-08-10T10:52:05.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 shutdown_connections 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa83c15aa40 0x7fa83c1576b0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa83c0b0c60 0x7fa83c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa81c06ac50 0x7fa81c06d110 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 --2- 172.21.15.50:0/39793927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa83c070e80 0x7fa83c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.046+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 >> 172.21.15.50:0/39793927 conn(0x7fa83c06b590 msgr2=0x7fa83c0696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.047+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 shutdown_connections 2023-08-10T10:52:05.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:05.047+0000 7fa841a0d640 1 -- 172.21.15.50:0/39793927 wait complete. 2023-08-10T10:52:05.193 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:52:10.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.431+0000 7f9736b5a640 1 Processor -- start 2023-08-10T10:52:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.432+0000 7f9736b5a640 1 -- start start 2023-08-10T10:52:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.433+0000 7f9736b5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f973015a940 0x7f97300aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.433+0000 7f9736b5a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97300b19d0 0x7f97300b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.433+0000 7f9736b5a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300b1f10 con 0x7f973015f2b0 2023-08-10T10:52:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.433+0000 7f9736b5a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300b21f0 con 0x7f97300b19d0 2023-08-10T10:52:10.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.433+0000 7f9736b5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973015e5c0 con 0x7f973015a940 2023-08-10T10:52:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97300b19d0 0x7f97300b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97300b19d0 0x7f97300b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57810/0 (socket says 172.21.15.50:57810) 2023-08-10T10:52:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 -- 172.21.15.50:0/2572048713 learned_addr learned my addr 172.21.15.50:0/2572048713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:10.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9735b58640 1 --2- 172.21.15.50:0/2572048713 >> v2:172.21.15.117:3300/0 conn(0x7f973015a940 0x7f97300aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 -- 172.21.15.50:0/2572048713 >> v2:172.21.15.117:3300/0 conn(0x7f973015a940 msgr2=0x7f97300aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 --2- 172.21.15.50:0/2572048713 >> v2:172.21.15.117:3300/0 conn(0x7f973015a940 0x7f97300aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 -- 172.21.15.50:0/2572048713 >> v1:172.21.15.117:6789/0 conn(0x7f973015f2b0 legacy=0x7f97300b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.434+0000 7f9736359640 1 -- 172.21.15.50:0/2572048713 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973015e7d0 con 0x7f97300b19d0 2023-08-10T10:52:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.435+0000 7f9736359640 1 --2- 172.21.15.50:0/2572048713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97300b19d0 0x7f97300b0450 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f97300ce2e0 tx=0x7f972802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f79006dc470783 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.436+0000 7f9734b56640 1 -- 172.21.15.50:0/2572048713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280317e0 con 0x7f97300b19d0 2023-08-10T10:52:10.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.436+0000 7f9734b56640 1 -- 172.21.15.50:0/2572048713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728031940 con 0x7f97300b19d0 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.436+0000 7f9734b56640 1 -- 172.21.15.50:0/2572048713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728031cd0 con 0x7f97300b19d0 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.436+0000 7f9736b5a640 1 -- 172.21.15.50:0/2572048713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97300b19d0 msgr2=0x7f97300b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.436+0000 7f9736b5a640 1 --2- 172.21.15.50:0/2572048713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97300b19d0 0x7f97300b0450 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f97300ce2e0 tx=0x7f972802b880 comp rx=0 tx=0).stop 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 -- 172.21.15.50:0/2572048713 shutdown_connections 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 --2- 172.21.15.50:0/2572048713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97300b19d0 0x7f97300b0450 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 --2- 172.21.15.50:0/2572048713 >> v2:172.21.15.117:3300/0 conn(0x7f973015a940 0x7f97300aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 -- 172.21.15.50:0/2572048713 >> 172.21.15.50:0/2572048713 conn(0x7f973006ab80 msgr2=0x7f973006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 -- 172.21.15.50:0/2572048713 shutdown_connections 2023-08-10T10:52:10.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.437+0000 7f9736b5a640 1 -- 172.21.15.50:0/2572048713 wait complete. 2023-08-10T10:52:10.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.439+0000 7f9736b5a640 1 Processor -- start 2023-08-10T10:52:10.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.439+0000 7f9736b5a640 1 -- start start 2023-08-10T10:52:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97300b19d0 0x7f973015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973015f2b0 0x7f973015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973015c7a0 con 0x7f973015a940 2023-08-10T10:52:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301571b0 con 0x7f973015f2b0 2023-08-10T10:52:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9736b5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973015bb90 con 0x7f97300b19d0 2023-08-10T10:52:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.440+0000 7f9735357640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57816/0 (socket says 172.21.15.50:57816) 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 -- 172.21.15.50:0/393990985 learned_addr learned my addr 172.21.15.50:0/393990985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735b58640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97300b19d0 0x7f973015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9736359640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973015f2b0 0x7f973015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 -- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97300b19d0 msgr2=0x7f973015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97300b19d0 0x7f973015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 -- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973015f2b0 msgr2=0x7f973015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973015f2b0 0x7f973015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 -- 172.21.15.50:0/393990985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280094d0 con 0x7f973015a940 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.441+0000 7f9735357640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f972000c400 tx=0x7f972000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.442+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720011790 con 0x7f973015a940 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.442+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9720011930 con 0x7f973015a940 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.442+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720011ce0 con 0x7f973015a940 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.442+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973015be70 con 0x7f973015a940 2023-08-10T10:52:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.442+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973015d170 con 0x7f973015a940 2023-08-10T10:52:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.443+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973015c910 con 0x7f973015a940 2023-08-10T10:52:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.444+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f972001c460 con 0x7f973015a940 2023-08-10T10:52:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.445+0000 7f97267fc640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 0x7f971406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.445+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9720089490 con 0x7f973015a940 2023-08-10T10:52:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.445+0000 7f9735b58640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 0x7f971406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.446+0000 7f9735b58640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 0x7f971406d110 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f972c0099c0 tx=0x7f972c003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.450+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9720054530 con 0x7f973015a940 2023-08-10T10:52:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.645+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9730066e30 con 0x7f973015a940 2023-08-10T10:52:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.647+0000 7f97267fc640 1 -- 172.21.15.50:0/393990985 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+36937 (secure 0 0 0) 0x7f9720057b50 con 0x7f973015a940 2023-08-10T10:52:10.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:10.648 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 189, 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:03.732548+0000", 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:10.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:10.650 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.652 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:10.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:10.654 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:10.655 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:10.656 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:10.657 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:10.658 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:10.659 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:10.661 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.662 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:10.663 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:10.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:10.665 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:10.667 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:10.668 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:10.669 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:10.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:10.671 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:10.672 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:10.673 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:10.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:10.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:10.676 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:10.677 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.678 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:10.679 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:10.680 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:10.681 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:10.684 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:10.685 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.686 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:10.687 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:10.688 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:10.689 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "189", 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:10.694 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:10.695 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:10.697 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.700 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:10.702 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.705 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:10.707 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.709 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.711 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.713 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.714 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.717 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.719 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:10.723 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.724 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:10.726 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.729 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.730 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:10.736 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.738 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.739 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.740 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.743 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.744 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.745 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:10.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.749 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.750 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:10.751 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:10.757 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:10.758 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:10.778 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.779 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.782 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.786 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.788 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:10.789 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:10.790 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:10.791 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:10.792 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:10.793 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:10.794 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:10.794 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:10.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:10.794 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 msgr2=0x7f971406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 0x7f971406d110 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f972c0099c0 tx=0x7f972c003990 comp rx=0 tx=0).stop 2023-08-10T10:52:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 msgr2=0x7f9730156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f972000c400 tx=0x7f972000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 shutdown_connections 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f971406ac50 0x7f971406d110 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973015f2b0 0x7f973015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f973015a940 0x7f9730156500 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 --2- 172.21.15.50:0/393990985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97300b19d0 0x7f973015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 >> 172.21.15.50:0/393990985 conn(0x7f973006ab80 msgr2=0x7f97300b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 shutdown_connections 2023-08-10T10:52:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:10.650+0000 7f9736b5a640 1 -- 172.21.15.50:0/393990985 wait complete. 2023-08-10T10:52:10.797 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:52:15.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.036+0000 7fa22f59e640 1 Processor -- start 2023-08-10T10:52:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.036+0000 7fa22f59e640 1 -- start start 2023-08-10T10:52:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.037+0000 7fa22f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa2300aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.037+0000 7fa22f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa23015f2b0 0x7fa2300b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.037+0000 7fa22f59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300b1f10 con 0x7fa2300b12c0 2023-08-10T10:52:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.037+0000 7fa22f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2300b21f0 con 0x7fa23015f2b0 2023-08-10T10:52:16.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.037+0000 7fa22f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015e5c0 con 0x7fa23015a940 2023-08-10T10:52:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.038+0000 7fa22ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2300b12c0 0x7fa2300b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33066/0 (socket says 172.21.15.50:33066) 2023-08-10T10:52:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.038+0000 7fa22ed9d640 1 -- 172.21.15.50:0/4037034577 learned_addr learned my addr 172.21.15.50:0/4037034577 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.038+0000 7fa22e59c640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa2300aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.038+0000 7fa225d9b640 1 --2- 172.21.15.50:0/4037034577 >> v2:172.21.15.117:3300/0 conn(0x7fa23015f2b0 0x7fa2300b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396173863 0 0) 0x7fa2300b1f10 con 0x7fa2300b12c0 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa21c003520 con 0x7fa2300b12c0 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526050578 0 0) 0x7fa21c003520 con 0x7fa2300b12c0 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 msgr2=0x7fa2300aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa2300aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 >> v2:172.21.15.117:3300/0 conn(0x7fa23015f2b0 msgr2=0x7fa2300b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 --2- 172.21.15.50:0/4037034577 >> v2:172.21.15.117:3300/0 conn(0x7fa23015f2b0 0x7fa2300b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23015e7d0 con 0x7fa2300b12c0 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fa228001a10 con 0x7fa2300b12c0 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 >> v1:172.21.15.50:6789/0 conn(0x7fa2300b12c0 legacy=0x7fa2300b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c0039e0 0x7fa21c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa21c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa21c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015e5c0 con 0x7fa21c0047c0 2023-08-10T10:52:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c00b9b0 con 0x7fa21c0039e0 2023-08-10T10:52:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.039+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c00bb70 con 0x7fa23015a940 2023-08-10T10:52:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa21c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa22ed9d640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa21c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa22e59c640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c0039e0 0x7fa21c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 -- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 msgr2=0x7fa21c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa23015a940 0x7fa21c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 -- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c0039e0 msgr2=0x7fa21c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c0039e0 0x7fa21c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.040+0000 7fa225d9b640 1 -- 172.21.15.50:0/4037034577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c003520 con 0x7fa21c0047c0 2023-08-10T10:52:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.041+0000 7fa225d9b640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa21c004c40 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fa218009a90 tx=0x7fa21c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d4a6ce1ed55552 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21802c6b0 con 0x7fa21c0047c0 2023-08-10T10:52:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21802c810 con 0x7fa21c0047c0 2023-08-10T10:52:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22dd9b640 1 -- 172.21.15.50:0/4037034577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21802cba0 con 0x7fa21c0047c0 2023-08-10T10:52:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22f59e640 1 -- 172.21.15.50:0/4037034577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 msgr2=0x7fa21c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22f59e640 1 --2- 172.21.15.50:0/4037034577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa21c004c40 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fa218009a90 tx=0x7fa21c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22ed9d640 1 -- 172.21.15.50:0/4037034577 reap_dead start 2023-08-10T10:52:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22f59e640 1 -- 172.21.15.50:0/4037034577 shutdown_connections 2023-08-10T10:52:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.042+0000 7fa22f59e640 1 -- 172.21.15.50:0/4037034577 >> 172.21.15.50:0/4037034577 conn(0x7fa23006ab80 msgr2=0x7fa23006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.043+0000 7fa22f59e640 1 -- 172.21.15.50:0/4037034577 shutdown_connections 2023-08-10T10:52:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.043+0000 7fa22f59e640 1 -- 172.21.15.50:0/4037034577 wait complete. 2023-08-10T10:52:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.044+0000 7fa22f59e640 1 Processor -- start 2023-08-10T10:52:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.045+0000 7fa22f59e640 1 -- start start 2023-08-10T10:52:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2301f6580 0x7fa23015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 0x7fa2301f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015b6a0 con 0x7fa21c0047c0 2023-08-10T10:52:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301f63a0 con 0x7fa2301f59e0 2023-08-10T10:52:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300c4dc0 con 0x7fa2301f6580 2023-08-10T10:52:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32876/0 (socket says 172.21.15.50:32876) 2023-08-10T10:52:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 -- 172.21.15.50:0/1525833208 learned_addr learned my addr 172.21.15.50:0/1525833208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa225d9b640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2301f6580 0x7fa23015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 -- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2301f6580 msgr2=0x7fa23015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2301f6580 0x7fa23015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22ed9d640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 0x7fa2301f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.046+0000 7fa22e59c640 1 -- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 msgr2=0x7fa2301f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22e59c640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 0x7fa2301f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22e59c640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23015de90 con 0x7fa21c0047c0 2023-08-10T10:52:16.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22ed9d640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 0x7fa2301f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:16.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22e59c640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa220010890 tx=0x7fa220010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:16.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220009610 con 0x7fa21c0047c0 2023-08-10T10:52:16.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000eb60 con 0x7fa21c0047c0 2023-08-10T10:52:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22001c400 con 0x7fa21c0047c0 2023-08-10T10:52:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23015b0e0 con 0x7fa21c0047c0 2023-08-10T10:52:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.047+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa230157880 con 0x7fa21c0047c0 2023-08-10T10:52:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.048+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2301576e0 con 0x7fa21c0047c0 2023-08-10T10:52:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.049+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa22001c560 con 0x7fa21c0047c0 2023-08-10T10:52:16.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.050+0000 7fa2277fe640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 0x7fa21006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:16.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.050+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa220089a20 con 0x7fa21c0047c0 2023-08-10T10:52:16.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.051+0000 7fa225d9b640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 0x7fa21006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:16.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.051+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7fa210072dd0 con 0x7fa21c0047c0 2023-08-10T10:52:16.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.051+0000 7fa225d9b640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 0x7fa21006d140 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa218036000 tx=0x7fa218030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:16.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.056+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa2301576e0 con 0x7fa21c0047c0 2023-08-10T10:52:16.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:16.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.258+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2301576e0 con 0x7fa21c0047c0 2023-08-10T10:52:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.260+0000 7fa2277fe640 1 -- 172.21.15.50:0/1525833208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+36956 (secure 0 0 0) 0x7fa2301576e0 con 0x7fa21c0047c0 2023-08-10T10:52:16.261 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 190, 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:11.691822+0000", 2023-08-10T10:52:16.262 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:16.263 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:16.264 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:16.264 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:16.264 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:16.264 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:16.264 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:16.265 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:16.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:16.268 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:16.270 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:16.271 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:16.272 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:16.273 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:16.274 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.275 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:16.276 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:16.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:16.278 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:16.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:16.280 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:16.281 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:16.282 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:16.283 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.284 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:16.285 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:16.286 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:16.287 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:16.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:16.289 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:16.290 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:16.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:16.292 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:16.293 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:16.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:16.295 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:16.296 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:16.297 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:16.298 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:16.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:16.301 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "190", 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:16.303 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:16.304 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:16.305 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:16.306 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:16.307 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:16.308 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:16.309 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:16.310 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.311 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:16.313 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.316 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:16.319 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:16.320 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:16.321 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.322 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.323 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.324 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.325 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.326 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:16.327 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:16.330 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.332 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.334 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.337 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.338 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:16.339 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.341 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.342 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.343 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.345 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.347 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.349 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.350 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:16.351 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.353 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:16.355 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.358 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.363 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.364 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:16.367 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.369 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:16.370 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.372 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.373 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.374 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.376 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.377 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:16.379 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.380 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:16.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:16.384 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.386 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:16.388 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.389 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:16.391 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:16.392 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:16.407 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:16.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 msgr2=0x7fa21006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 0x7fa21006d140 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa218036000 tx=0x7fa218030000 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 msgr2=0x7fa230156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa220010890 tx=0x7fa220010d50 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 shutdown_connections 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa21006ac80 0x7fa21006d140 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2301f59e0 0x7fa2301f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2301f6580 0x7fa23015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 --2- 172.21.15.50:0/1525833208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa21c0047c0 0x7fa230156770 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.263+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 >> 172.21.15.50:0/1525833208 conn(0x7fa23006ab80 msgr2=0x7fa2300c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.264+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 shutdown_connections 2023-08-10T10:52:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:16.264+0000 7fa22f59e640 1 -- 172.21.15.50:0/1525833208 wait complete. 2023-08-10T10:52:16.411 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-10T10:52:16.412 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:16.412 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:16.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:16.517 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-08-10T10:52:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-10T10:52:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:52:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:52:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.335413 s, 156 MB/s 2023-08-10T10:52:16.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:52:16.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.140+0000 7fa410f6b640 1 Processor -- start 2023-08-10T10:52:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.140+0000 7fa410f6b640 1 -- start start 2023-08-10T10:52:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.141+0000 7fa410f6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa40c0b0c60 0x7fa40c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.141+0000 7fa410f6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa410f6b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c071c70 con 0x7fa40c15aa40 2023-08-10T10:52:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa410f6b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c0713d0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa410f6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0716b0 con 0x7fa40c0b3f30 2023-08-10T10:52:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa40a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa40c15aa40 0x7fa40c0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33074/0 (socket says 172.21.15.50:33074) 2023-08-10T10:52:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa40a59c640 1 -- 172.21.15.50:0/4010286700 learned_addr learned my addr 172.21.15.50:0/4010286700 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4010286700 >> v2:172.21.15.50:3300/0 conn(0x7fa40c0b0c60 0x7fa40c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa40ad9d640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa409d9b640 1 -- 172.21.15.50:0/4010286700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 msgr2=0x7fa40c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa40959a640 1 -- 172.21.15.50:0/4010286700 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624907927 0 0) 0x7fa40c071c70 con 0x7fa40c15aa40 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa409d9b640 1 -- 172.21.15.50:0/4010286700 >> v1:172.21.15.50:6789/0 conn(0x7fa40c15aa40 legacy=0x7fa40c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa409d9b640 1 -- 172.21.15.50:0/4010286700 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c071990 con 0x7fa40c0b0c60 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.142+0000 7fa40ad9d640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.143+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c0c9920 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fa4000097a0 tx=0x7fa40002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c2f1cd8e185f93 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.144+0000 7fa40959a640 1 -- 172.21.15.50:0/4010286700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400031780 con 0x7fa40c0b0c60 2023-08-10T10:52:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.144+0000 7fa40959a640 1 -- 172.21.15.50:0/4010286700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000318e0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.144+0000 7fa40959a640 1 -- 172.21.15.50:0/4010286700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400031c70 con 0x7fa40c0b0c60 2023-08-10T10:52:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.144+0000 7fa410f6b640 1 -- 172.21.15.50:0/4010286700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 msgr2=0x7fa40c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.144+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c0c9920 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fa4000097a0 tx=0x7fa40002b820 comp rx=0 tx=0).stop 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 -- 172.21.15.50:0/4010286700 shutdown_connections 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c0c9920 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4010286700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 -- 172.21.15.50:0/4010286700 >> 172.21.15.50:0/4010286700 conn(0x7fa40c06b590 msgr2=0x7fa40c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 -- 172.21.15.50:0/4010286700 shutdown_connections 2023-08-10T10:52:17.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.145+0000 7fa410f6b640 1 -- 172.21.15.50:0/4010286700 wait complete. 2023-08-10T10:52:17.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.146+0000 7fa410f6b640 1 Processor -- start 2023-08-10T10:52:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.147+0000 7fa410f6b640 1 -- start start 2023-08-10T10:52:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 0x7fa40c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c15bb60 con 0x7fa40c0b0c60 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c58c0 con 0x7fa40c15aa40 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa410f6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c5ba0 con 0x7fa40c0b3f30 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32896/0 (socket says 172.21.15.50:32896) 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 -- 172.21.15.50:0/4205355820 learned_addr learned my addr 172.21.15.50:0/4205355820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 -- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 msgr2=0x7fa40c0b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 -- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 msgr2=0x7fa40c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40ad9d640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 0x7fa40c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 0x7fa40c0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40a59c640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400009400 con 0x7fa40c0b0c60 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.148+0000 7fa40ad9d640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 0x7fa40c0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa40a59c640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c430 tx=0x7fa3fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0074e0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc007660 con 0x7fa40c0b0c60 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc004a20 con 0x7fa40c0b0c60 2023-08-10T10:52:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0c5e80 con 0x7fa40c0b0c60 2023-08-10T10:52:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.149+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c15b7a0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.151+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c0c60c0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.151+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3fc004b80 con 0x7fa40c0b0c60 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.152+0000 7fa3faffd640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 0x7fa3ec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.152+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3fc089240 con 0x7fa40c0b0c60 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.153+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7fa3ec072da0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.153+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 0x7fa3ec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.153+0000 7fa409d9b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 0x7fa3ec06d110 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa400036000 tx=0x7fa400008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.157+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3fc054380 con 0x7fa40c0b0c60 2023-08-10T10:52:17.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.349+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa40c04e270 con 0x7fa40c0b0c60 2023-08-10T10:52:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.353+0000 7fa3faffd640 1 -- 172.21.15.50:0/4205355820 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+36956 (secure 0 0 0) 0x7fa3fc0579a0 con 0x7fa40c0b0c60 2023-08-10T10:52:17.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:17.354 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:17.354 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 190, 2023-08-10T10:52:17.354 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:11.691822+0000", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:17.355 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:17.356 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:17.357 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:17.357 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:17.357 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:17.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:17.358 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:17.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:17.358 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:17.359 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:17.359 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:17.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:17.360 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:17.360 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:17.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:17.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:17.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:17.361 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:17.362 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:17.362 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:17.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:17.362 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:17.363 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:17.363 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:17.363 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:17.363 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:17.364 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:17.364 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:17.364 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:17.365 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:17.365 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:17.365 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:17.365 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:17.368 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:17.368 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:17.368 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:17.368 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:17.369 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:17.369 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:17.369 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:17.370 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:17.370 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:17.370 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:17.370 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:17.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:17.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:17.371 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:17.371 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:17.372 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:17.372 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:17.372 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:17.372 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:17.373 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:17.373 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:17.373 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:17.374 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:17.374 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:17.374 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:17.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:17.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.375 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:17.375 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:17.376 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:17.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:17.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:17.376 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:17.377 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:17.377 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:17.377 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:17.378 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:17.378 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:17.378 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:17.378 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:17.379 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:17.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.379 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:17.379 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:17.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.380 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:17.380 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:17.380 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:17.381 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:17.381 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:17.381 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:17.381 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:17.382 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:17.382 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:17.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.383 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:17.383 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:17.384 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:17.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:17.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:17.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:17.385 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:17.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:17.385 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:17.385 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:17.386 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:17.387 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:17.388 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:17.389 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:17.390 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:17.391 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:17.391 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:17.391 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:17.391 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:17.391 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:17.392 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:17.392 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:17.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:17.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.393 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:17.393 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:17.393 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:17.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:17.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:17.394 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:17.394 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:17.394 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:17.395 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:17.395 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:17.395 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:17.396 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:17.396 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:17.396 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:17.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.397 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:17.397 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:17.397 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:17.398 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:17.398 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:17.398 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:17.399 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:17.399 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:17.399 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:17.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.400 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:17.400 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:17.400 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:17.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:17.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:17.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:17.401 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "190", 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:17.534 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 msgr2=0x7fa3ec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 0x7fa3ec06d110 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa400036000 tx=0x7fa400008030 comp rx=0 tx=0).stop 2023-08-10T10:52:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 msgr2=0x7fa40c15de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c430 tx=0x7fa3fc00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 shutdown_connections 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa3ec06ac50 0x7fa3ec06d110 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa40c15aa40 0x7fa40c0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa40c0b3f30 0x7fa40c0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 --2- 172.21.15.50:0/4205355820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa40c0b0c60 0x7fa40c15de30 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.355+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 >> 172.21.15.50:0/4205355820 conn(0x7fa40c06b590 msgr2=0x7fa40c0c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.356+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 shutdown_connections 2023-08-10T10:52:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.356+0000 7fa410f6b640 1 -- 172.21.15.50:0/4205355820 wait complete. 2023-08-10T10:52:17.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:17.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.773+0000 7ffa027d6640 1 Processor -- start 2023-08-10T10:52:17.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.773+0000 7ffa027d6640 1 -- start start 2023-08-10T10:52:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.774+0000 7ffa027d6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9fc15a940 0x7ff9fc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.774+0000 7ffa027d6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9fc0b19d0 0x7ff9fc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.774+0000 7ffa027d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc0b1f10 con 0x7ff9fc15f2b0 2023-08-10T10:52:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.774+0000 7ffa027d6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc0b21f0 con 0x7ff9fc15a940 2023-08-10T10:52:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.774+0000 7ffa027d6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc15e5c0 con 0x7ff9fc0b19d0 2023-08-10T10:52:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.775+0000 7ffa017d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9fc15a940 0x7ff9fc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.775+0000 7ffa00fd3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9fc15f2b0 0x7ff9fc0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33076/0 (socket says 172.21.15.50:33076) 2023-08-10T10:52:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.775+0000 7ffa00fd3640 1 -- 172.21.15.50:0/3386742222 learned_addr learned my addr 172.21.15.50:0/3386742222 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.775+0000 7ffa01fd5640 1 --2- 172.21.15.50:0/3386742222 >> v2:172.21.15.117:3300/0 conn(0x7ff9fc0b19d0 0x7ff9fc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.776+0000 7ffa017d4640 1 -- 172.21.15.50:0/3386742222 >> v2:172.21.15.117:3300/0 conn(0x7ff9fc0b19d0 msgr2=0x7ff9fc0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.776+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3386742222 >> v2:172.21.15.117:3300/0 conn(0x7ff9fc0b19d0 0x7ff9fc0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.776+0000 7ffa017d4640 1 -- 172.21.15.50:0/3386742222 >> v1:172.21.15.50:6789/0 conn(0x7ff9fc15f2b0 legacy=0x7ff9fc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.776+0000 7ff9f3fff640 1 -- 172.21.15.50:0/3386742222 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830282538 0 0) 0x7ff9fc0b1f10 con 0x7ff9fc15f2b0 2023-08-10T10:52:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.776+0000 7ffa017d4640 1 -- 172.21.15.50:0/3386742222 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc15e7d0 con 0x7ff9fc15a940 2023-08-10T10:52:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.777+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3386742222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0aff10 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc15e4f0 tx=0x7ff9f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8acdc18969b9753 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ff9f3fff640 1 -- 172.21.15.50:0/3386742222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f802e070 con 0x7ff9fc15a940 2023-08-10T10:52:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ff9f3fff640 1 -- 172.21.15.50:0/3386742222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80315a0 con 0x7ff9fc15a940 2023-08-10T10:52:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ff9f3fff640 1 -- 172.21.15.50:0/3386742222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8031930 con 0x7ff9fc15a940 2023-08-10T10:52:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 -- 172.21.15.50:0/3386742222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 msgr2=0x7ff9fc0aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3386742222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0aff10 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc15e4f0 tx=0x7ff9f802b840 comp rx=0 tx=0).stop 2023-08-10T10:52:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 -- 172.21.15.50:0/3386742222 shutdown_connections 2023-08-10T10:52:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3386742222 >> v2:172.21.15.117:3300/0 conn(0x7ff9fc0b19d0 0x7ff9fc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3386742222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0aff10 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 -- 172.21.15.50:0/3386742222 >> 172.21.15.50:0/3386742222 conn(0x7ff9fc06ab80 msgr2=0x7ff9fc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.778+0000 7ffa027d6640 1 -- 172.21.15.50:0/3386742222 shutdown_connections 2023-08-10T10:52:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.779+0000 7ffa027d6640 1 -- 172.21.15.50:0/3386742222 wait complete. 2023-08-10T10:52:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.780+0000 7ffa027d6640 1 Processor -- start 2023-08-10T10:52:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.780+0000 7ffa027d6640 1 -- start start 2023-08-10T10:52:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 0x7ff9fc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9fc15f2b0 0x7ff9fc070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc06fcd0 con 0x7ff9fc15a940 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc06ffb0 con 0x7ff9fc0b19d0 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.781+0000 7ffa027d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc070290 con 0x7ff9fc15f2b0 2023-08-10T10:52:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32924/0 (socket says 172.21.15.50:32924) 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 -- 172.21.15.50:0/3771298247 learned_addr learned my addr 172.21.15.50:0/3771298247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 0x7ff9fc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 -- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9fc15f2b0 msgr2=0x7ff9fc070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9fc15f2b0 0x7ff9fc070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 -- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 msgr2=0x7ff9fc158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 0x7ff9fc158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa00fd3640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8009400 con 0x7ff9fc15a940 2023-08-10T10:52:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.782+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 0x7ff9fc158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ffa00fd3640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00c430 tx=0x7ff9ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0074e0 con 0x7ff9fc15a940 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec007660 con 0x7ff9fc15a940 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec004a20 con 0x7ff9fc15a940 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc070570 con 0x7ff9fc15a940 2023-08-10T10:52:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.783+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc1594e0 con 0x7ff9fc15a940 2023-08-10T10:52:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.784+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc070a90 con 0x7ff9fc15a940 2023-08-10T10:52:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.785+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9ec004b80 con 0x7ff9fc15a940 2023-08-10T10:52:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.786+0000 7ff9f1ffb640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 0x7ff9e006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.786+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9ec089360 con 0x7ff9fc15a940 2023-08-10T10:52:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.786+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7ff9e0072da0 con 0x7ff9fc15a940 2023-08-10T10:52:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.786+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 0x7ff9e006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.787+0000 7ffa017d4640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 0x7ff9e006d110 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8036000 tx=0x7ff9f803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:17.791+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9fc070a90 con 0x7ff9fc15a940 2023-08-10T10:52:18.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.021+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9fc070a90 con 0x7ff9fc15a940 2023-08-10T10:52:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.023+0000 7ff9f1ffb640 1 -- 172.21.15.50:0/3771298247 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7ff9fc070a90 con 0x7ff9fc15a940 2023-08-10T10:52:18.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:18.024 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 msgr2=0x7ff9e006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 0x7ff9e006d110 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8036000 tx=0x7ff9f803d040 comp rx=0 tx=0).stop 2023-08-10T10:52:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 msgr2=0x7ff9fc0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00c430 tx=0x7ff9ec00c8f0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 shutdown_connections 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9fc15f2b0 0x7ff9fc070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc15a940 0x7ff9fc0c7d00 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff9e006ac50 0x7ff9e006d110 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 --2- 172.21.15.50:0/3771298247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9fc0b19d0 0x7ff9fc158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.025+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 >> 172.21.15.50:0/3771298247 conn(0x7ff9fc06ab80 msgr2=0x7ff9fc0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.026+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 shutdown_connections 2023-08-10T10:52:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.026+0000 7ffa027d6640 1 -- 172.21.15.50:0/3771298247 wait complete. 2023-08-10T10:52:18.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:52:18.290 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":9393,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.656957906999999,"mdsmap_epoch":93,"osdmap_epoch":190,"osdmap_epoch_barrier":190,"uptime":32.652978959999999} 2023-08-10T10:52:18.291 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 9393, "mdsmap_epoch": 93, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "rank_uptime": 26.656957907, "state": "up:active", "uptime": 32.65297896, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:52:18.291 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:52:18.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:18.292 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-10T10:52:18.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:18.352 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-10T10:52:18.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.659+0000 7f73fbb2b640 1 Processor -- start 2023-08-10T10:52:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.659+0000 7f73fbb2b640 1 -- start start 2023-08-10T10:52:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.661+0000 7f73fbb2b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73f415aa40 0x7f73f40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73fbb2b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f4071c70 con 0x7f73f40b0c60 2023-08-10T10:52:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73fbb2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f406a4c0 con 0x7f73f40ca930 2023-08-10T10:52:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73fbb2b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f40713d0 con 0x7f73f415aa40 2023-08-10T10:52:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73f98c7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73f415aa40 0x7f73f40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73f90c6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73f40b0c60 0x7f73f40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33088/0 (socket says 172.21.15.50:33088) 2023-08-10T10:52:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73f90c6640 1 -- 172.21.15.50:0/2951958096 learned_addr learned my addr 172.21.15.50:0/2951958096 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73f88c5640 1 -- 172.21.15.50:0/2951958096 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121549599 0 0) 0x7f73f4071c70 con 0x7f73f40b0c60 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.662+0000 7f73f88c5640 1 -- 172.21.15.50:0/2951958096 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e0003520 con 0x7f73f40b0c60 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.663+0000 7f73f98c7640 1 -- 172.21.15.50:0/2951958096 >> v1:172.21.15.117:6789/0 conn(0x7f73f40ca930 legacy=0x7f73f4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.663+0000 7f73f98c7640 1 -- 172.21.15.50:0/2951958096 >> v1:172.21.15.50:6789/0 conn(0x7f73f40b0c60 legacy=0x7f73f40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.663+0000 7f73f98c7640 1 -- 172.21.15.50:0/2951958096 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40716b0 con 0x7f73f415aa40 2023-08-10T10:52:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.664+0000 7f73f98c7640 1 --2- 172.21.15.50:0/2951958096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f40b3820 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f73f00097a0 tx=0x7f73f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7c6c7311788eea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73f88c5640 1 -- 172.21.15.50:0/2951958096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0031830 con 0x7f73f415aa40 2023-08-10T10:52:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73f88c5640 1 -- 172.21.15.50:0/2951958096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0031990 con 0x7f73f415aa40 2023-08-10T10:52:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73f88c5640 1 -- 172.21.15.50:0/2951958096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0031d00 con 0x7f73f415aa40 2023-08-10T10:52:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 -- 172.21.15.50:0/2951958096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 msgr2=0x7f73f40b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/2951958096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f40b3820 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f73f00097a0 tx=0x7f73f002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 -- 172.21.15.50:0/2951958096 shutdown_connections 2023-08-10T10:52:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/2951958096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f40b3820 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 -- 172.21.15.50:0/2951958096 >> 172.21.15.50:0/2951958096 conn(0x7f73f406b590 msgr2=0x7f73f40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 -- 172.21.15.50:0/2951958096 shutdown_connections 2023-08-10T10:52:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.665+0000 7f73fbb2b640 1 -- 172.21.15.50:0/2951958096 wait complete. 2023-08-10T10:52:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.667+0000 7f73fbb2b640 1 Processor -- start 2023-08-10T10:52:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.667+0000 7f73fbb2b640 1 -- start start 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f40b0c60 0x7f73f41f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 0x7f73f4140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f413ea80 con 0x7f73f415aa40 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f413f600 con 0x7f73f40b0c60 2023-08-10T10:52:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.668+0000 7f73fbb2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f413ecd0 con 0x7f73f40ca930 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32932/0 (socket says 172.21.15.50:32932) 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 -- 172.21.15.50:0/4080727884 learned_addr learned my addr 172.21.15.50:0/4080727884 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73f98c7640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f40b0c60 0x7f73f41f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73f90c6640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 0x7f73f4140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 -- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 msgr2=0x7f73f4140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 0x7f73f4140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 -- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f40b0c60 msgr2=0x7f73f41f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f40b0c60 0x7f73f41f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73fa0c8640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009400 con 0x7f73f415aa40 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.669+0000 7f73f90c6640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 0x7f73f4140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73fa0c8640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c7d0 tx=0x7f73ec00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec003b70 con 0x7f73f415aa40 2023-08-10T10:52:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec003cf0 con 0x7f73f415aa40 2023-08-10T10:52:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00aa90 con 0x7f73f415aa40 2023-08-10T10:52:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f413efb0 con 0x7f73f415aa40 2023-08-10T10:52:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.670+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f41f2040 con 0x7f73f415aa40 2023-08-10T10:52:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.671+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f413f790 con 0x7f73f415aa40 2023-08-10T10:52:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.672+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73ec00abf0 con 0x7f73f415aa40 2023-08-10T10:52:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.673+0000 7f73ea7fc640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 0x7f73d806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.673+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73ec089300 con 0x7f73f415aa40 2023-08-10T10:52:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.673+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7f73d8072dd0 con 0x7f73f415aa40 2023-08-10T10:52:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.673+0000 7f73f98c7640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 0x7f73d806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.674+0000 7f73f98c7640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 0x7f73d806d140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73f0036000 tx=0x7f73f003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.678+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f73ec003e60 con 0x7f73f415aa40 2023-08-10T10:52:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.872+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f73f404e270 con 0x7f73f415aa40 2023-08-10T10:52:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.875+0000 7f73ea7fc640 1 -- 172.21.15.50:0/4080727884 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+36956 (secure 0 0 0) 0x7f73ec0543a0 con 0x7f73f415aa40 2023-08-10T10:52:18.876 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:18.876 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:18.876 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 190, 2023-08-10T10:52:18.876 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:18.876 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:11.691822+0000", 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:18.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:18.878 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:18.879 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:18.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:18.881 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:18.882 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:18.884 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:18.885 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.889 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:18.890 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:18.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:18.892 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:18.893 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:18.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:18.895 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:18.896 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:18.897 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:18.898 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:18.899 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:18.900 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:18.902 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:18.903 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:18.905 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:18.906 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:18.907 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:18.908 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:18.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:18.910 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:18.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:18.912 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:18.913 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:18.914 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:18.915 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "190", 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:18.917 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:18.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.920 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:18.921 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:18.923 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.925 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.926 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.928 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:18.931 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.932 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.933 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.934 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.936 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.938 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.941 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:18.944 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.945 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.950 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:18.953 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:18.954 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:18.955 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.956 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:18.957 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.960 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:18.963 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:18.965 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.966 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:18.967 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.968 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.972 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.973 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:18.974 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.975 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.976 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.977 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.982 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:18.984 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.985 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.986 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.987 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:18.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:18.994 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:18.996 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:18.999 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:19.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:19.004 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.005 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.006 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.007 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.008 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:19.020 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.877+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 msgr2=0x7f73d806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.877+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 0x7f73d806d140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73f0036000 tx=0x7f73f003c040 comp rx=0 tx=0).stop 2023-08-10T10:52:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.877+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 msgr2=0x7f73f4141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.877+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c7d0 tx=0x7f73ec00cc90 comp rx=0 tx=0).stop 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 shutdown_connections 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f415aa40 0x7f73f4141050 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f40ca930 0x7f73f4140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f73d806ac80 0x7f73d806d140 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 --2- 172.21.15.50:0/4080727884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f40b0c60 0x7f73f41f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 >> 172.21.15.50:0/4080727884 conn(0x7f73f406b590 msgr2=0x7f73f40cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 shutdown_connections 2023-08-10T10:52:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:18.878+0000 7f73fbb2b640 1 -- 172.21.15.50:0/4080727884 wait complete. 2023-08-10T10:52:19.023 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:52:24.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.263+0000 7fcb19f86640 1 Processor -- start 2023-08-10T10:52:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.264+0000 7fcb19f86640 1 -- start start 2023-08-10T10:52:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.265+0000 7fcb19f86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb1415aa40 0x7fcb140b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.265+0000 7fcb19f86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.265+0000 7fcb19f86640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb14071c70 con 0x7fcb14070e80 2023-08-10T10:52:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.265+0000 7fcb19f86640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb140713d0 con 0x7fcb1415aa40 2023-08-10T10:52:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.265+0000 7fcb19f86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140716b0 con 0x7fcb140b0c60 2023-08-10T10:52:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.266+0000 7fcb0affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.266+0000 7fcb0affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:46662/0 (socket says 172.21.15.50:46662) 2023-08-10T10:52:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.266+0000 7fcb0affd640 1 -- 172.21.15.50:0/3166230449 learned_addr learned my addr 172.21.15.50:0/3166230449 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.266+0000 7fcb137fe640 1 --2- 172.21.15.50:0/3166230449 >> v2:172.21.15.117:3300/0 conn(0x7fcb1415aa40 0x7fcb140b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.267+0000 7fcb0affd640 1 -- 172.21.15.50:0/3166230449 >> v2:172.21.15.117:3300/0 conn(0x7fcb1415aa40 msgr2=0x7fcb140b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.267+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3166230449 >> v2:172.21.15.117:3300/0 conn(0x7fcb1415aa40 0x7fcb140b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.267+0000 7fcb0affd640 1 -- 172.21.15.50:0/3166230449 >> v1:172.21.15.117:6789/0 conn(0x7fcb14070e80 legacy=0x7fcb140696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.267+0000 7fcb0affd640 1 -- 172.21.15.50:0/3166230449 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14071990 con 0x7fcb140b0c60 2023-08-10T10:52:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.268+0000 7fcb0affd640 1 --2- 172.21.15.50:0/3166230449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009870 tx=0x7fcafc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda3e42d6f26b17d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.269+0000 7fcb12ffd640 1 -- 172.21.15.50:0/3166230449 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc031640 con 0x7fcb140b0c60 2023-08-10T10:52:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.269+0000 7fcb12ffd640 1 -- 172.21.15.50:0/3166230449 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc0317a0 con 0x7fcb140b0c60 2023-08-10T10:52:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.269+0000 7fcb12ffd640 1 -- 172.21.15.50:0/3166230449 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc031b30 con 0x7fcb140b0c60 2023-08-10T10:52:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 -- 172.21.15.50:0/3166230449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 msgr2=0x7fcb140b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 --2- 172.21.15.50:0/3166230449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009870 tx=0x7fcafc02b8f0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 -- 172.21.15.50:0/3166230449 shutdown_connections 2023-08-10T10:52:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 --2- 172.21.15.50:0/3166230449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb140b3d60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 --2- 172.21.15.50:0/3166230449 >> v2:172.21.15.117:3300/0 conn(0x7fcb1415aa40 0x7fcb140b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 -- 172.21.15.50:0/3166230449 >> 172.21.15.50:0/3166230449 conn(0x7fcb1406b590 msgr2=0x7fcb140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 -- 172.21.15.50:0/3166230449 shutdown_connections 2023-08-10T10:52:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.270+0000 7fcb19f86640 1 -- 172.21.15.50:0/3166230449 wait complete. 2023-08-10T10:52:24.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.272+0000 7fcb19f86640 1 Processor -- start 2023-08-10T10:52:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.272+0000 7fcb19f86640 1 -- start start 2023-08-10T10:52:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb14070e80 0x7fcb14155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb14151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14152360 con 0x7fcb1415aa40 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb141545f0 con 0x7fcb14070e80 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb19f86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14153ad0 con 0x7fcb140b0c60 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32946/0 (socket says 172.21.15.50:32946) 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.273+0000 7fcb13fff640 1 -- 172.21.15.50:0/2681586846 learned_addr learned my addr 172.21.15.50:0/2681586846 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb137fe640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb14070e80 0x7fcb14155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb0affd640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb14151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 -- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 msgr2=0x7fcb14151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb14151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 -- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb14070e80 msgr2=0x7fcb14155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb14070e80 0x7fcb14155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc0094d0 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb13fff640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c7d0 tx=0x7fcb0c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.274+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c003b70 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.275+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c003cf0 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.275+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb14153d50 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.275+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00aa90 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.275+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14154310 con 0x7fcb1415aa40 2023-08-10T10:52:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.276+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1404e270 con 0x7fcb1415aa40 2023-08-10T10:52:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.277+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb0c00abf0 con 0x7fcb1415aa40 2023-08-10T10:52:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.278+0000 7fcb10ff9640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 0x7fcaf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.278+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb0c089300 con 0x7fcb1415aa40 2023-08-10T10:52:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.278+0000 7fcb137fe640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 0x7fcaf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.279+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7fcaf4072da0 con 0x7fcb1415aa40 2023-08-10T10:52:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.279+0000 7fcb137fe640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 0x7fcaf406d110 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009a30 tx=0x7fcb04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.283+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb0c003e60 con 0x7fcb1415aa40 2023-08-10T10:52:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.475+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcb1406edc0 con 0x7fcb1415aa40 2023-08-10T10:52:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.479+0000 7fcb10ff9640 1 -- 172.21.15.50:0/2681586846 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+36956 (secure 0 0 0) 0x7fcb0c0543a0 con 0x7fcb1415aa40 2023-08-10T10:52:24.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 190, 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:11.691822+0000", 2023-08-10T10:52:24.480 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:24.481 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:24.485 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:24.486 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:24.486 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:24.486 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:24.486 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:24.486 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:24.487 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:24.487 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:24.487 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:24.487 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:24.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:24.488 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:24.489 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:24.491 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:24.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:24.493 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.494 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:24.495 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:24.496 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:24.497 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:24.498 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:24.499 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:24.499 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:24.499 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:24.499 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:24.499 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:24.500 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:24.500 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:24.500 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:24.500 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:24.501 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:24.501 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:24.501 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:24.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:24.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:24.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:24.502 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:24.503 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:24.503 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:24.503 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:24.503 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:24.504 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:24.504 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:24.504 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:24.504 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:24.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:24.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:24.505 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:24.505 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:24.506 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:24.506 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:24.506 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:24.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:24.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:24.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:24.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:24.508 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:24.508 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:24.508 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:24.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:24.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.509 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:24.509 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:24.509 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:24.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:24.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:24.510 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:24.510 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:24.511 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:24.511 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:24.511 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:24.511 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:24.512 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:24.512 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:24.512 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:24.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.513 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:24.513 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:24.513 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:24.513 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:24.514 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:24.514 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:24.514 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:24.514 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:24.515 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:24.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:24.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:24.516 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:24.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:24.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:24.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:24.517 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:24.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:24.518 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:24.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:24.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:24.518 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:24.519 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:24.519 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:24.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:24.519 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:24.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:24.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:24.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:24.521 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:24.521 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:24.521 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:24.521 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:24.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:24.522 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:24.522 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:24.522 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:24.523 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:24.524 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:24.525 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:24.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1027, 2023-08-10T10:52:24.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:24.532 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:24.533 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "190", 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:24.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:24.539 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:24.541 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.542 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.544 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:24.653 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.481+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 msgr2=0x7fcaf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.481+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 0x7fcaf406d110 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009a30 tx=0x7fcb04008040 comp rx=0 tx=0).stop 2023-08-10T10:52:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.481+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 msgr2=0x7fcb14153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.481+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c7d0 tx=0x7fcb0c00cc90 comp rx=0 tx=0).stop 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 shutdown_connections 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1415aa40 0x7fcb14153590 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb140b0c60 0x7fcb14151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcaf406ac50 0x7fcaf406d110 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 --2- 172.21.15.50:0/2681586846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb14070e80 0x7fcb14155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 >> 172.21.15.50:0/2681586846 conn(0x7fcb1406b590 msgr2=0x7fcb140c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 shutdown_connections 2023-08-10T10:52:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:24.482+0000 7fcb19f86640 1 -- 172.21.15.50:0/2681586846 wait complete. 2023-08-10T10:52:24.657 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-10T10:52:29.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:29.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.896+0000 7f1fe61d6640 1 Processor -- start 2023-08-10T10:52:29.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.896+0000 7f1fe61d6640 1 -- start start 2023-08-10T10:52:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.897+0000 7f1fe61d6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe00b1510 0x7f1fe00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fe61d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe00b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fe61d6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1fe00ca5b0 0x7f1fe00b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fe61d6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe01596e0 con 0x7f1fe00b1510 2023-08-10T10:52:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fe61d6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe00c90b0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fe61d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe00c9390 con 0x7f1fe00ca150 2023-08-10T10:52:29.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe00b1510 0x7f1fe00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:29.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe00b1510 0x7f1fe00b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45044/0 (socket says 172.21.15.50:45044) 2023-08-10T10:52:29.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 -- 172.21.15.50:0/3518923820 learned_addr learned my addr 172.21.15.50:0/3518923820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:29.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 -- 172.21.15.50:0/3518923820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 msgr2=0x7f1fe00b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:29.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3518923820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe00b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 -- 172.21.15.50:0/3518923820 >> v2:172.21.15.117:3300/0 conn(0x7f1fe00ca5b0 msgr2=0x7f1fe00b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3518923820 >> v2:172.21.15.117:3300/0 conn(0x7f1fe00ca5b0 0x7f1fe00b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.898+0000 7f1fdf7fe640 1 -- 172.21.15.50:0/3518923820 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe00c9670 con 0x7f1fe00b1510 2023-08-10T10:52:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.900+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3518923820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00b1510 0x7f1fe00b2370 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00b2ee0 tx=0x7f1fd002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f5c7cea071293 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.900+0000 7f1fdeffd640 1 -- 172.21.15.50:0/3518923820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0031880 con 0x7f1fe00b1510 2023-08-10T10:52:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.900+0000 7f1fdeffd640 1 -- 172.21.15.50:0/3518923820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd00319e0 con 0x7f1fe00b1510 2023-08-10T10:52:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.900+0000 7f1fdeffd640 1 -- 172.21.15.50:0/3518923820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0031d70 con 0x7f1fe00b1510 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3518923820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00b1510 msgr2=0x7f1fe00b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3518923820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00b1510 0x7f1fe00b2370 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00b2ee0 tx=0x7f1fd002b920 comp rx=0 tx=0).stop 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3518923820 shutdown_connections 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3518923820 >> v2:172.21.15.117:3300/0 conn(0x7f1fe00ca5b0 0x7f1fe00b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3518923820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe00b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3518923820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00b1510 0x7f1fe00b2370 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3518923820 >> 172.21.15.50:0/3518923820 conn(0x7f1fe006b590 msgr2=0x7f1fe00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3518923820 shutdown_connections 2023-08-10T10:52:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.901+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3518923820 wait complete. 2023-08-10T10:52:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.903+0000 7f1fe61d6640 1 Processor -- start 2023-08-10T10:52:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.903+0000 7f1fe61d6640 1 -- start start 2023-08-10T10:52:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fe00b1510 0x7f1fe015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01584f0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01598d0 con 0x7f1fe00b1510 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fe61d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe014c9f0 con 0x7f1fe00ca150 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45058/0 (socket says 172.21.15.50:45058) 2023-08-10T10:52:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fdffff640 1 -- 172.21.15.50:0/3176597684 learned_addr learned my addr 172.21.15.50:0/3176597684 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.904+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fe00b1510 0x7f1fe015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fd7fff640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 -- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 msgr2=0x7f1fe014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe014c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 -- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fe00b1510 msgr2=0x7f1fe015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fe00b1510 0x7f1fe015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 -- 172.21.15.50:0/3176597684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00094d0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdffff640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800b9a0 tx=0x7f1fd800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800cba0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800cd20 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe0151580 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.905+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8014680 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.906+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe01589e0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.907+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe004e270 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.907+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fd801d3b0 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.909+0000 7f1fdcff9640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 0x7f1fc006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.909+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fd8089490 con 0x7f1fe00ca5b0 2023-08-10T10:52:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.909+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 0x7f1fc006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.910+0000 7f1fdf7fe640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 0x7f1fc006d110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0036000 tx=0x7f1fd003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:29.914+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1fd80544a0 con 0x7f1fe00ca5b0 2023-08-10T10:52:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.107+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1fe0159a10 con 0x7f1fe00ca5b0 2023-08-10T10:52:30.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.110+0000 7f1fdcff9640 1 -- 172.21.15.50:0/3176597684 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+36937 (secure 0 0 0) 0x7f1fd8057ac0 con 0x7f1fe00ca5b0 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 191, 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:30.112 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:26.698474+0000", 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:30.113 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:30.114 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:30.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.116 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.117 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.123 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.123 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.124 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.127 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.128 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.129 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:30.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.132 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.132 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.132 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.132 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:30.132 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.133 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.134 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.136 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.138 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.139 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:30.140 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.142 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.143 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.143 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.144 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.144 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:30.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.147 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.148 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.148 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.148 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.150 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.151 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:30.152 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.153 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.154 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:30.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.156 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:30.157 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.158 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "191", 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.161 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.161 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.161 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.161 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.161 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.163 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.164 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:30.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:30.166 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.168 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.169 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.170 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:30.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.176 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.178 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.179 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.180 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.180 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:30.180 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.183 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:30.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.188 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.189 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.190 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:30.195 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.198 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.199 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.200 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.202 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:30.205 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.206 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.207 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.208 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.209 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.210 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.212 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:30.215 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.217 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.218 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.219 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.220 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.222 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.225 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.228 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.229 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.230 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.232 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:30.235 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.238 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.239 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.240 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:30.248 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.249 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.251 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.252 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:30.253 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:30.255 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.256 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.257 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:30.258 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.259 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:30.260 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:30.261 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:30.262 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.263 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 msgr2=0x7f1fc006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 0x7f1fc006d110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0036000 tx=0x7f1fd003c040 comp rx=0 tx=0).stop 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 msgr2=0x7f1fe0151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800b9a0 tx=0x7f1fd800be60 comp rx=0 tx=0).stop 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 shutdown_connections 2023-08-10T10:52:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe00ca5b0 0x7f1fe0151040 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fe00ca150 0x7f1fe014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1fc006ac50 0x7f1fc006d110 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 --2- 172.21.15.50:0/3176597684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fe00b1510 0x7f1fe015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 >> 172.21.15.50:0/3176597684 conn(0x7f1fe006b590 msgr2=0x7f1fe006fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 shutdown_connections 2023-08-10T10:52:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.113+0000 7f1fe61d6640 1 -- 172.21.15.50:0/3176597684 wait complete. 2023-08-10T10:52:30.267 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-10T10:52:30.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-10T10:52:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.505+0000 7f1d7a1c4640 1 Processor -- start 2023-08-10T10:52:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.505+0000 7f1d7a1c4640 1 -- start start 2023-08-10T10:52:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d7a1c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d740b8430 0x7f1d740cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d7a1c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d740cddb0 0x7f1d740d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d7a1c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740ce200 con 0x7f1d7415cd60 2023-08-10T10:52:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d7a1c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740b5bd0 con 0x7f1d740cddb0 2023-08-10T10:52:30.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d7a1c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d74161180 con 0x7f1d740b8430 2023-08-10T10:52:30.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d737fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1d7415cd60 0x7f1d74160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34336/0 (socket says 172.21.15.50:34336) 2023-08-10T10:52:30.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.506+0000 7f1d737fe640 1 -- 172.21.15.50:0/1712390396 learned_addr learned my addr 172.21.15.50:0/1712390396 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:30.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d73fff640 1 --2- 172.21.15.50:0/1712390396 >> v2:172.21.15.50:3300/0 conn(0x7f1d740cddb0 0x7f1d740d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d72ffd640 1 --2- 172.21.15.50:0/1712390396 >> v2:172.21.15.117:3300/0 conn(0x7f1d740b8430 0x7f1d740cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d73fff640 1 -- 172.21.15.50:0/1712390396 >> v2:172.21.15.117:3300/0 conn(0x7f1d740b8430 msgr2=0x7f1d740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d73fff640 1 --2- 172.21.15.50:0/1712390396 >> v2:172.21.15.117:3300/0 conn(0x7f1d740b8430 0x7f1d740cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d73fff640 1 -- 172.21.15.50:0/1712390396 >> v1:172.21.15.50:6789/0 conn(0x7f1d7415cd60 legacy=0x7f1d74160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d73fff640 1 -- 172.21.15.50:0/1712390396 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74161460 con 0x7f1d740cddb0 2023-08-10T10:52:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.507+0000 7f1d727fc640 1 -- 172.21.15.50:0/1712390396 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052506782 0 0) 0x7f1d5c001110 con 0x7f1d7415cd60 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.508+0000 7f1d73fff640 1 --2- 172.21.15.50:0/1712390396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cddb0 0x7f1d740d1400 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ceeb0 tx=0x7f1d6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d418d08381e2fa8f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d727fc640 1 -- 172.21.15.50:0/1712390396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c030610 con 0x7f1d740cddb0 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d727fc640 1 -- 172.21.15.50:0/1712390396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c030770 con 0x7f1d740cddb0 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d727fc640 1 -- 172.21.15.50:0/1712390396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c030b00 con 0x7f1d740cddb0 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/1712390396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cddb0 msgr2=0x7f1d740d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/1712390396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cddb0 0x7f1d740d1400 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ceeb0 tx=0x7f1d6c02b960 comp rx=0 tx=0).stop 2023-08-10T10:52:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/1712390396 shutdown_connections 2023-08-10T10:52:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/1712390396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740cddb0 0x7f1d740d1400 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/1712390396 >> v2:172.21.15.117:3300/0 conn(0x7f1d740b8430 0x7f1d740cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.509+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/1712390396 >> 172.21.15.50:0/1712390396 conn(0x7f1d740d2ac0 msgr2=0x7f1d740d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:30.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.510+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/1712390396 shutdown_connections 2023-08-10T10:52:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.510+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/1712390396 wait complete. 2023-08-10T10:52:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.512+0000 7f1d7a1c4640 1 Processor -- start 2023-08-10T10:52:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.512+0000 7f1d7a1c4640 1 -- start start 2023-08-10T10:52:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d740cddb0 0x7f1d740b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 0x7f1d740b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740c9b00 con 0x7f1d740b8430 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741f5ca0 con 0x7f1d740cddb0 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d7a1c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741f5f80 con 0x7f1d7415cd60 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45084/0 (socket says 172.21.15.50:45084) 2023-08-10T10:52:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 -- 172.21.15.50:0/3160454134 learned_addr learned my addr 172.21.15.50:0/3160454134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:30.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d72ffd640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d740cddb0 0x7f1d740b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d73fff640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 0x7f1d740b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 -- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 msgr2=0x7f1d740b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 0x7f1d740b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 -- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d740cddb0 msgr2=0x7f1d740b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d740cddb0 0x7f1d740b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d737fe640 1 -- 172.21.15.50:0/3160454134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009400 con 0x7f1d740b8430 2023-08-10T10:52:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.513+0000 7f1d73fff640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 0x7f1d740b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d737fe640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00c780 tx=0x7f1d5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0072d0 con 0x7f1d740b8430 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c007450 con 0x7f1d740b8430 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0047e0 con 0x7f1d740b8430 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d741f6260 con 0x7f1d740b8430 2023-08-10T10:52:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.514+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d740c8790 con 0x7f1d740b8430 2023-08-10T10:52:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.516+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d740c9c70 con 0x7f1d740b8430 2023-08-10T10:52:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.516+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d5c004960 con 0x7f1d740b8430 2023-08-10T10:52:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.518+0000 7f1d6bfff640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 0x7f1d5406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.518+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d5c088700 con 0x7f1d740b8430 2023-08-10T10:52:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.518+0000 7f1d72ffd640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 0x7f1d5406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.519+0000 7f1d72ffd640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 0x7f1d5406d110 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1d740b3fb0 tx=0x7f1d6400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.522+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d740c9c70 con 0x7f1d740b8430 2023-08-10T10:52:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.720+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1d740ce200 con 0x7f1d740b8430 2023-08-10T10:52:30.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.721+0000 7f1d6bfff640 1 -- 172.21.15.50:0/3160454134 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+36937 (secure 0 0 0) 0x7f1d740ce200 con 0x7f1d740b8430 2023-08-10T10:52:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:30.723 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 191, 2023-08-10T10:52:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", 2023-08-10T10:52:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2023-08-10T10:38:01.359846+0000", 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2023-08-10T10:52:26.698474+0000", 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2023-08-10T10:38:07.839441+0000", 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2023-08-10T10:38:04.816895+0000", 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2023-08-10T10:52:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 4, 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.69999998807907104, 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-10T10:52:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 24, 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "reef", 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2023-08-10T10:52:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:08.392868+0000", 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2023-08-10T10:52:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2023-08-10T10:52:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:38:14.051975+0000", 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "116", 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2023-08-10T10:52:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2023-08-10T10:52:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 23, 2023-08-10T10:52:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_metadata", 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:49.463467+0000", 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "187", 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_bias": 4, 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 16, 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_priority": 5 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": "cephfs" 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2023-08-10T10:52:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 24, 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "cephfs_data", 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2023-08-10T10:51:50.099047+0000", 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-08-10T10:52:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2023-08-10T10:52:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 64, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 64, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 64, 2023-08-10T10:52:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 64, 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 64, 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2023-08-10T10:52:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "191", 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2023-08-10T10:52:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 33554432, 2023-08-10T10:52:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2023-08-10T10:52:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2023-08-10T10:52:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2023-08-10T10:52:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2023-08-10T10:52:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 64, 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "target_size_ratio": 0.89999997615814209 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs": { 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "data": "cephfs" 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2023-08-10T10:52:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2023-08-10T10:52:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 274313722 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6821/274313722", 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6824/274313722", 2023-08-10T10:52:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/274313722", 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6827/274313722", 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 534751664 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/534751664", 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6820/534751664", 2023-08-10T10:52:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6830/534751664", 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6825/534751664", 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2061476148 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/2061476148", 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/2061476148", 2023-08-10T10:52:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/2061476148", 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/2061476148", 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2023-08-10T10:52:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2023-08-10T10:52:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1161775809 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/1161775809", 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/1161775809", 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/1161775809", 2023-08-10T10:52:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/1161775809", 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6816", 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6817", 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6818", 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6819", 2023-08-10T10:52:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6822", 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6823", 2023-08-10T10:52:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6820", 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6821", 2023-08-10T10:52:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4052651543 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6817/4052651543", 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6819/4052651543", 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6823/4052651543", 2023-08-10T10:52:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6821/4052651543", 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6800", 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6801", 2023-08-10T10:52:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6802", 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6803", 2023-08-10T10:52:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6806", 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6807", 2023-08-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6804", 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6805", 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3863318081 2023-08-10T10:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6801/3863318081", 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6803/3863318081", 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6807/3863318081", 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6805/3863318081", 2023-08-10T10:52:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6808", 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6809", 2023-08-10T10:52:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6810", 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6811", 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6814", 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6815", 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6812", 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6813", 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1322471095 2023-08-10T10:52:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6809/1322471095", 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6811/1322471095", 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6815/1322471095", 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6813/1322471095", 2023-08-10T10:52:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-10T10:52:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 13, 2023-08-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 186, 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6824", 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6825", 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6826", 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6827", 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6830", 2023-08-10T10:52:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6831", 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6828", 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.117:6829", 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3330340519 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.117:6825/3330340519", 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.117:6827/3330340519", 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.117:6831/3330340519", 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.117:6829/3330340519", 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2023-08-10T10:52:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2023-08-10T10:52:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.090853+0000", 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.159416+0000", 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.039936+0000", 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.122269+0000", 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.077187+0000", 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.098045+0000", 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.063734+0000", 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2023-08-10T10:52:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540138322906710015, 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2023-08-10T10:38:06.116993+0000", 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2023-08-10T10:52:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2023-08-10T10:52:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2023-08-10T10:52:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-08-10T10:52:30.880 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 msgr2=0x7f1d5406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 0x7f1d5406d110 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1d740b3fb0 tx=0x7f1d6400b040 comp rx=0 tx=0).stop 2023-08-10T10:52:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 msgr2=0x7f1d740c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00c780 tx=0x7f1d5c00cc40 comp rx=0 tx=0).stop 2023-08-10T10:52:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 shutdown_connections 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d7415cd60 0x7f1d740b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f1d5406ac50 0x7f1d5406d110 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d740cddb0 0x7f1d740b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 --2- 172.21.15.50:0/3160454134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d740b8430 0x7f1d740c8250 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 >> 172.21.15.50:0/3160454134 conn(0x7f1d740d2ac0 msgr2=0x7f1d740cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.724+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 shutdown_connections 2023-08-10T10:52:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:30.725+0000 7f1d7a1c4640 1 -- 172.21.15.50:0/3160454134 wait complete. 2023-08-10T10:52:30.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.118+0000 7fe16601f640 1 Processor -- start 2023-08-10T10:52:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.119+0000 7fe16601f640 1 -- start start 2023-08-10T10:52:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.121+0000 7fe16601f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1600b8430 0x7fe1600cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.121+0000 7fe16601f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.121+0000 7fe16601f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe160161180 con 0x7fe16015cd60 2023-08-10T10:52:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.121+0000 7fe16601f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600ce240 con 0x7fe1600b8430 2023-08-10T10:52:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.121+0000 7fe16601f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600b5bd0 con 0x7fe1600cddb0 2023-08-10T10:52:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.122+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.122+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:46632/0 (socket says 172.21.15.50:46632) 2023-08-10T10:52:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.122+0000 7fe15ffff640 1 -- 172.21.15.50:0/883545973 learned_addr learned my addr 172.21.15.50:0/883545973 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.122+0000 7fe15effd640 1 --2- 172.21.15.50:0/883545973 >> v2:172.21.15.117:3300/0 conn(0x7fe1600b8430 0x7fe1600cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.123+0000 7fe15ffff640 1 -- 172.21.15.50:0/883545973 >> v2:172.21.15.117:3300/0 conn(0x7fe1600b8430 msgr2=0x7fe1600cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.123+0000 7fe15ffff640 1 --2- 172.21.15.50:0/883545973 >> v2:172.21.15.117:3300/0 conn(0x7fe1600b8430 0x7fe1600cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.123+0000 7fe15ffff640 1 -- 172.21.15.50:0/883545973 >> v1:172.21.15.117:6789/0 conn(0x7fe16015cd60 legacy=0x7fe160160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.123+0000 7fe15ffff640 1 -- 172.21.15.50:0/883545973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160161460 con 0x7fe1600cddb0 2023-08-10T10:52:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.123+0000 7fe15e7fc640 1 -- 172.21.15.50:0/883545973 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342317823 0 0) 0x7fe160161180 con 0x7fe16015cd60 2023-08-10T10:52:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.124+0000 7fe15ffff640 1 --2- 172.21.15.50:0/883545973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe158009870 tx=0x7fe15802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e6c67414462988 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.124+0000 7fe15e7fc640 1 -- 172.21.15.50:0/883545973 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802f840 con 0x7fe1600cddb0 2023-08-10T10:52:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.124+0000 7fe15e7fc640 1 -- 172.21.15.50:0/883545973 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15802f9a0 con 0x7fe1600cddb0 2023-08-10T10:52:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.124+0000 7fe15e7fc640 1 -- 172.21.15.50:0/883545973 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802fd30 con 0x7fe1600cddb0 2023-08-10T10:52:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 -- 172.21.15.50:0/883545973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 msgr2=0x7fe1600d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 --2- 172.21.15.50:0/883545973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe158009870 tx=0x7fe15802ba20 comp rx=0 tx=0).stop 2023-08-10T10:52:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 -- 172.21.15.50:0/883545973 shutdown_connections 2023-08-10T10:52:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 --2- 172.21.15.50:0/883545973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600d1400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 --2- 172.21.15.50:0/883545973 >> v2:172.21.15.117:3300/0 conn(0x7fe1600b8430 0x7fe1600cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 -- 172.21.15.50:0/883545973 >> 172.21.15.50:0/883545973 conn(0x7fe1600d2ac0 msgr2=0x7fe1600d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 -- 172.21.15.50:0/883545973 shutdown_connections 2023-08-10T10:52:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.125+0000 7fe16601f640 1 -- 172.21.15.50:0/883545973 wait complete. 2023-08-10T10:52:31.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.127+0000 7fe16601f640 1 Processor -- start 2023-08-10T10:52:31.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.127+0000 7fe16601f640 1 -- start start 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600b8430 0x7fe1600a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600cc330 con 0x7fe16015cd60 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600cda80 con 0x7fe1600b8430 2023-08-10T10:52:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.128+0000 7fe16601f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1601f2110 con 0x7fe1600cddb0 2023-08-10T10:52:31.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45086/0 (socket says 172.21.15.50:45086) 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 -- 172.21.15.50:0/1723014670 learned_addr learned my addr 172.21.15.50:0/1723014670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15f7fe640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600b8430 0x7fe1600a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15effd640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 -- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 msgr2=0x7fe1600cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 -- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600b8430 msgr2=0x7fe1600a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600b8430 0x7fe1600a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 -- 172.21.15.50:0/1723014670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580094d0 con 0x7fe16015cd60 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.129+0000 7fe15ffff640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe158009870 tx=0x7fe158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.130+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158037c40 con 0x7fe16015cd60 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.130+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158037dc0 con 0x7fe16015cd60 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.130+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158041640 con 0x7fe16015cd60 2023-08-10T10:52:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.130+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1600a9af0 con 0x7fe16015cd60 2023-08-10T10:52:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.130+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1600cd430 con 0x7fe16015cd60 2023-08-10T10:52:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.131+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1600c9b00 con 0x7fe16015cd60 2023-08-10T10:52:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.132+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1580417a0 con 0x7fe16015cd60 2023-08-10T10:52:31.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.134+0000 7fe157fff640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 0x7fe14406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:31.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.134+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe15803c070 con 0x7fe16015cd60 2023-08-10T10:52:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.134+0000 7fe15f7fe640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 0x7fe14406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.135+0000 7fe15f7fe640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 0x7fe14406d110 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe150000f60 tx=0x7fe150009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.139+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe1580de330 con 0x7fe16015cd60 2023-08-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.366+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1600d0bc0 con 0x7fe16015cd60 2023-08-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.367+0000 7fe157fff640 1 -- 172.21.15.50:0/1723014670 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7fe1600c9b00 con 0x7fe16015cd60 2023-08-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.369+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 msgr2=0x7fe14406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.369+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 0x7fe14406d110 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe150000f60 tx=0x7fe150009040 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.369+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 msgr2=0x7fe1600a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.369+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe158009870 tx=0x7fe158004730 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 shutdown_connections 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe16015cd60 0x7fe1600a9e80 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1600cddb0 0x7fe1600cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fe14406ac50 0x7fe14406d110 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 --2- 172.21.15.50:0/1723014670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600b8430 0x7fe1600a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 >> 172.21.15.50:0/1723014670 conn(0x7fe1600d2ac0 msgr2=0x7fe16015c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 shutdown_connections 2023-08-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:31.370+0000 7fe16601f640 1 -- 172.21.15.50:0/1723014670 wait complete. 2023-08-10T10:52:31.388 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-10T10:52:31.639 INFO:teuthology.orchestra.run.smithi050.stdout:{"cluster_fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","whoami":0,"id":9393,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":40.006365258999999,"mdsmap_epoch":93,"osdmap_epoch":191,"osdmap_epoch_barrier":190,"uptime":46.002385492000002} 2023-08-10T10:52:31.640 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "6795d532-1ac6-4473-b42c-017ab0d4d08a", "fs_name": "cephfs", "id": 9393, "mdsmap_epoch": 93, "osdmap_epoch": 191, "osdmap_epoch_barrier": 190, "rank_uptime": 40.006365259, "state": "up:active", "uptime": 46.002385492, "want_state": "up:active", "whoami": 0 } 2023-08-10T10:52:31.640 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-10T10:52:31.641 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:31.641 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:31.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:31.693 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-10T10:52:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records in 2023-08-10T10:52:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:50+0 records out 2023-08-10T10:52:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.435197 s, 120 MB/s 2023-08-10T10:52:32.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-10T10:52:32.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:52:32.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-10T10:52:32.414 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-10T10:52:32.415 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:32.415 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:32.479 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:32.480 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:32.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:32.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.772+0000 7fb61a86a640 1 Processor -- start 2023-08-10T10:52:32.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.772+0000 7fb61a86a640 1 -- start start 2023-08-10T10:52:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb61a86a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 0x7fb6140b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb61a86a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb614071c70 con 0x7fb6140b0c60 2023-08-10T10:52:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb61a86a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61406a4c0 con 0x7fb6140ca930 2023-08-10T10:52:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb61a86a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140713d0 con 0x7fb61415aa40 2023-08-10T10:52:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb6137fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6140b0c60 0x7fb6140696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34348/0 (socket says 172.21.15.50:34348) 2023-08-10T10:52:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.774+0000 7fb6137fe640 1 -- 172.21.15.50:0/682699523 learned_addr learned my addr 172.21.15.50:0/682699523 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:32.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb613fff640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 0x7fb6140b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783236191 0 0) 0x7fb614071c70 con 0x7fb6140b0c60 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc003520 con 0x7fb6140b0c60 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531507570 0 0) 0x7fb5fc003520 con 0x7fb6140b0c60 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 msgr2=0x7fb6140b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 0x7fb6140b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 >> v1:172.21.15.117:6789/0 conn(0x7fb6140ca930 legacy=0x7fb614069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140716b0 con 0x7fb6140b0c60 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fb608001670 con 0x7fb6140b0c60 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 >> v1:172.21.15.50:6789/0 conn(0x7fb6140b0c60 legacy=0x7fb6140696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 0x7fb5fc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140713d0 con 0x7fb5fc0039a0 2023-08-10T10:52:32.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00bb10 con 0x7fb5fc0047c0 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.775+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00bcd0 con 0x7fb61415aa40 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb6137fe640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 -- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 msgr2=0x7fb5fc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61415aa40 0x7fb5fc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 -- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5fc0047c0 msgr2=0x7fb5fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:32.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb613fff640 1 -- 172.21.15.50:0/682699523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc003520 con 0x7fb5fc0039a0 2023-08-10T10:52:32.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.776+0000 7fb6137fe640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.777+0000 7fb613fff640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb604009ac0 tx=0x7fb5fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3709769dc0abe2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60402c710 con 0x7fb5fc0039a0 2023-08-10T10:52:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60402c870 con 0x7fb5fc0039a0 2023-08-10T10:52:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb612ffd640 1 -- 172.21.15.50:0/682699523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60402cc00 con 0x7fb5fc0039a0 2023-08-10T10:52:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 -- 172.21.15.50:0/682699523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 msgr2=0x7fb5fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 --2- 172.21.15.50:0/682699523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb604009ac0 tx=0x7fb5fc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb618e07640 1 -- 172.21.15.50:0/682699523 reap_dead start 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 -- 172.21.15.50:0/682699523 shutdown_connections 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 -- 172.21.15.50:0/682699523 >> 172.21.15.50:0/682699523 conn(0x7fb61406b590 msgr2=0x7fb6140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 -- 172.21.15.50:0/682699523 shutdown_connections 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.778+0000 7fb61a86a640 1 -- 172.21.15.50:0/682699523 wait complete. 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.780+0000 7fb61a86a640 1 Processor -- start 2023-08-10T10:52:32.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.780+0000 7fb61a86a640 1 -- start start 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 0x7fb614153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb614153650 0x7fb6140b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb614153ad0 con 0x7fb5fc0039a0 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61414c7f0 con 0x7fb614153650 2023-08-10T10:52:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.781+0000 7fb61a86a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140b24b0 con 0x7fb6141eed50 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45104/0 (socket says 172.21.15.50:45104) 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 -- 172.21.15.50:0/1243181686 learned_addr learned my addr 172.21.15.50:0/1243181686 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb6137fe640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 0x7fb614153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 -- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 msgr2=0x7fb614153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb618e07640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb614153650 0x7fb6140b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 0x7fb614153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 -- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb614153650 msgr2=0x7fb6140b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb614153650 0x7fb6140b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 -- 172.21.15.50:0/1243181686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61414ca40 con 0x7fb5fc0039a0 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb6137fe640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 0x7fb614153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.782+0000 7fb613fff640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fb604037040 tx=0x7fb604004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.783+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604003610 con 0x7fb5fc0039a0 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.783+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604003770 con 0x7fb5fc0039a0 2023-08-10T10:52:32.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.783+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604003b00 con 0x7fb5fc0039a0 2023-08-10T10:52:32.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.783+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61414cd20 con 0x7fb5fc0039a0 2023-08-10T10:52:32.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.783+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6141ef1b0 con 0x7fb5fc0039a0 2023-08-10T10:52:32.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.784+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61404e270 con 0x7fb5fc0039a0 2023-08-10T10:52:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.785+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb60403b070 con 0x7fb5fc0039a0 2023-08-10T10:52:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.787+0000 7fb610ff9640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 0x7fb60006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.787+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6040aaea0 con 0x7fb5fc0039a0 2023-08-10T10:52:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.787+0000 7fb6137fe640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 0x7fb60006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:32.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.788+0000 7fb6137fe640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 0x7fb60006d140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb6080017a0 tx=0x7fb608009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:32.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.791+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb604076000 con 0x7fb5fc0039a0 2023-08-10T10:52:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.986+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb614157860 con 0x7fb5fc0039a0 2023-08-10T10:52:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.987+0000 7fb610ff9640 1 -- 172.21.15.50:0/1243181686 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fb604039090 con 0x7fb5fc0039a0 2023-08-10T10:52:32.989 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:32.990 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":191,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:26.698474+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:32.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 msgr2=0x7fb60006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 0x7fb60006d140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb6080017a0 tx=0x7fb608009040 comp rx=0 tx=0).stop 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 msgr2=0x7fb61414d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fb604037040 tx=0x7fb604004730 comp rx=0 tx=0).stop 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 shutdown_connections 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb60006ac80 0x7fb60006d140 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb614153650 0x7fb6140b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6141eed50 0x7fb614153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 --2- 172.21.15.50:0/1243181686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc0039a0 0x7fb61414d520 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 >> 172.21.15.50:0/1243181686 conn(0x7fb61406b590 msgr2=0x7fb614154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 shutdown_connections 2023-08-10T10:52:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:32.990+0000 7fb61a86a640 1 -- 172.21.15.50:0/1243181686 wait complete. 2023-08-10T10:52:33.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:51:49.463467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:51:50.099047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:52:33.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:52:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.245+0000 7ff35f59e640 1 Processor -- start 2023-08-10T10:52:33.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.245+0000 7ff35f59e640 1 -- start start 2023-08-10T10:52:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.246+0000 7ff35f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff360159790 0x7ff3600b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.246+0000 7ff35f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff36006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.246+0000 7ff35f59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff360159b70 con 0x7ff36006b0c0 2023-08-10T10:52:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.246+0000 7ff35f59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36006b550 con 0x7ff360159790 2023-08-10T10:52:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.246+0000 7ff35f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cc380 con 0x7ff3600b3490 2023-08-10T10:52:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff36006b0c0 0x7ff36015d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34352/0 (socket says 172.21.15.50:34352) 2023-08-10T10:52:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35ed9d640 1 -- 172.21.15.50:0/1926910860 learned_addr learned my addr 172.21.15.50:0/1926910860 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35e59c640 1 --2- 172.21.15.50:0/1926910860 >> v2:172.21.15.117:3300/0 conn(0x7ff360159790 0x7ff3600b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35dd9b640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff36006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345928493 0 0) 0x7ff360159b70 con 0x7ff36006b0c0 2023-08-10T10:52:33.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.247+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff348003520 con 0x7ff36006b0c0 2023-08-10T10:52:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598035129 0 0) 0x7ff348003520 con 0x7ff36006b0c0 2023-08-10T10:52:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 msgr2=0x7ff36006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff36006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 >> v2:172.21.15.117:3300/0 conn(0x7ff360159790 msgr2=0x7ff3600b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 --2- 172.21.15.50:0/1926910860 >> v2:172.21.15.117:3300/0 conn(0x7ff360159790 0x7ff3600b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600cc590 con 0x7ff36006b0c0 2023-08-10T10:52:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7ff3580019f0 con 0x7ff36006b0c0 2023-08-10T10:52:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 >> v1:172.21.15.50:6789/0 conn(0x7ff36006b0c0 legacy=0x7ff36015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff3480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348003f60 0x7ff3480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff348004d00 0x7ff348005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36006b550 con 0x7ff348004d00 2023-08-10T10:52:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600cc380 con 0x7ff348003f60 2023-08-10T10:52:33.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34800dbc0 con 0x7ff3600b3490 2023-08-10T10:52:33.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.248+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff348004d00 0x7ff348005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35e59c640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff3480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35dd9b640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348003f60 0x7ff3480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35ed9d640 1 -- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 msgr2=0x7ff3480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600b3490 0x7ff3480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35ed9d640 1 -- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348003f60 msgr2=0x7ff3480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348003f60 0x7ff3480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35ed9d640 1 -- 172.21.15.50:0/1926910860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348003520 con 0x7ff348004d00 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.249+0000 7ff35dd9b640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348003f60 0x7ff3480047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.250+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff348004d00 0x7ff348005180 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff35800a860 tx=0x7ff3480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290639538b22fa04 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.250+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358034630 con 0x7ff348004d00 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.250+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35802f070 con 0x7ff348004d00 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.250+0000 7ff35d59a640 1 -- 172.21.15.50:0/1926910860 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358034a30 con 0x7ff348004d00 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 -- 172.21.15.50:0/1926910860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff348004d00 msgr2=0x7ff348005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 --2- 172.21.15.50:0/1926910860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff348004d00 0x7ff348005180 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff35800a860 tx=0x7ff3480057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35ed9d640 1 -- 172.21.15.50:0/1926910860 reap_dead start 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 -- 172.21.15.50:0/1926910860 shutdown_connections 2023-08-10T10:52:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 -- 172.21.15.50:0/1926910860 >> 172.21.15.50:0/1926910860 conn(0x7ff360069cd0 msgr2=0x7ff3600caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 -- 172.21.15.50:0/1926910860 shutdown_connections 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.251+0000 7ff35f59e640 1 -- 172.21.15.50:0/1926910860 wait complete. 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.253+0000 7ff35f59e640 1 Processor -- start 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.253+0000 7ff35f59e640 1 -- start start 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348004d00 0x7ff360071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600c68a0 0x7ff3600c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600af110 con 0x7ff3600ae750 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600719c0 con 0x7ff348004d00 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35f59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600c7410 con 0x7ff3600c68a0 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45130/0 (socket says 172.21.15.50:45130) 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.254+0000 7ff35ed9d640 1 -- 172.21.15.50:0/3651147239 learned_addr learned my addr 172.21.15.50:0/3651147239 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 -- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600c68a0 msgr2=0x7ff3600c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600c68a0 0x7ff3600c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 -- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348004d00 msgr2=0x7ff360071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35e59c640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348004d00 0x7ff360071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348004d00 0x7ff360071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 -- 172.21.15.50:0/3651147239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600c76f0 con 0x7ff3600ae750 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35ed9d640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff358001cb0 tx=0x7ff358001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358001fd0 con 0x7ff3600ae750 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358034640 con 0x7ff3600ae750 2023-08-10T10:52:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580349b0 con 0x7ff3600ae750 2023-08-10T10:52:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.255+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600c79d0 con 0x7ff3600ae750 2023-08-10T10:52:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.256+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3600c7f90 con 0x7ff3600ae750 2023-08-10T10:52:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.257+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360066e30 con 0x7ff3600ae750 2023-08-10T10:52:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.258+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff358031030 con 0x7ff3600ae750 2023-08-10T10:52:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.258+0000 7ff34effd640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.259+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3580ab700 con 0x7ff3600ae750 2023-08-10T10:52:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.259+0000 7ff35e59c640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.259+0000 7ff35e59c640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 0x7ff34006d110 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff3500099b0 tx=0x7ff350008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.263+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff358076680 con 0x7ff3600ae750 2023-08-10T10:52:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.457+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff360066e30 con 0x7ff3600ae750 2023-08-10T10:52:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.458+0000 7ff34effd640 1 -- 172.21.15.50:0/3651147239 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v191) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff358079ca0 con 0x7ff3600ae750 2023-08-10T10:52:33.460 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:52:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.460+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 msgr2=0x7ff34006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.460+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 0x7ff34006d110 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff3500099b0 tx=0x7ff350008040 comp rx=0 tx=0).stop 2023-08-10T10:52:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.460+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 msgr2=0x7ff3600aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.460+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff358001cb0 tx=0x7ff358001d80 comp rx=0 tx=0).stop 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 shutdown_connections 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3600ae750 0x7ff3600aebd0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600c68a0 0x7ff3600c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff34006ac50 0x7ff34006d110 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 --2- 172.21.15.50:0/3651147239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff348004d00 0x7ff360071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 >> 172.21.15.50:0/3651147239 conn(0x7ff360069cd0 msgr2=0x7ff3600cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 shutdown_connections 2023-08-10T10:52:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.461+0000 7ff35f59e640 1 -- 172.21.15.50:0/3651147239 wait complete. 2023-08-10T10:52:33.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:52:33.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.707+0000 7f0f3a271640 1 Processor -- start 2023-08-10T10:52:33.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.707+0000 7f0f3a271640 1 -- start start 2023-08-10T10:52:33.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.708+0000 7f0f3a271640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f3415cb90 0x7f0f340b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.708+0000 7f0f3a271640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f34160a40 con 0x7f0f3415cf70 2023-08-10T10:52:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.708+0000 7f0f3a271640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340b4bb0 con 0x7f0f341615e0 2023-08-10T10:52:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.708+0000 7f0f3a271640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340b4e90 con 0x7f0f3415cb90 2023-08-10T10:52:33.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f337fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0f3415cf70 0x7f0f34160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34360/0 (socket says 172.21.15.50:34360) 2023-08-10T10:52:33.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f337fe640 1 -- 172.21.15.50:0/2165406405 learned_addr learned my addr 172.21.15.50:0/2165406405 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839511958 0 0) 0x7f0f34160a40 con 0x7f0f3415cf70 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f33fff640 1 --2- 172.21.15.50:0/2165406405 >> v2:172.21.15.117:3300/0 conn(0x7f0f3415cb90 0x7f0f340b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f1c003520 con 0x7f0f3415cf70 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.709+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727450076 0 0) 0x7f0f1c003520 con 0x7f0f3415cf70 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 >> v2:172.21.15.117:3300/0 conn(0x7f0f3415cb90 msgr2=0x7f0f340b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 --2- 172.21.15.50:0/2165406405 >> v2:172.21.15.117:3300/0 conn(0x7f0f3415cb90 0x7f0f340b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 >> v1:172.21.15.117:6789/0 conn(0x7f0f341615e0 legacy=0x7f0f3406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340b5170 con 0x7f0f3415cf70 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f0f280019f0 con 0x7f0f3415cf70 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 >> v1:172.21.15.50:6789/0 conn(0x7f0f3415cf70 legacy=0x7f0f34160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 0x7f0f1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c0047c0 0x7f0f1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1c005180 0x7f0f1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340b4e90 con 0x7f0f1c003970 2023-08-10T10:52:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c00c0d0 con 0x7f0f1c005180 2023-08-10T10:52:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c00c290 con 0x7f0f1c0047c0 2023-08-10T10:52:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f33fff640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 0x7f0f1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f33fff640 1 -- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c0047c0 msgr2=0x7f0f1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f33fff640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c0047c0 0x7f0f1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f33fff640 1 -- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1c005180 msgr2=0x7f0f1c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.710+0000 7f0f3880e640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1c005180 0x7f0f1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.711+0000 7f0f33fff640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1c005180 0x7f0f1c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.711+0000 7f0f33fff640 1 -- 172.21.15.50:0/2165406405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c003520 con 0x7f0f1c003970 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.711+0000 7f0f3880e640 1 -- 172.21.15.50:0/2165406405 reap_dead start 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.712+0000 7f0f33fff640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 0x7f0f1c003d90 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ba30 tx=0x7f0f1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e1c98673a2285 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.712+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24032640 con 0x7f0f1c003970 2023-08-10T10:52:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.712+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240327a0 con 0x7f0f1c003970 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.712+0000 7f0f32ffd640 1 -- 172.21.15.50:0/2165406405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24032b30 con 0x7f0f1c003970 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 -- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 msgr2=0x7f0f1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 0x7f0f1c003d90 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ba30 tx=0x7f0f1c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 -- 172.21.15.50:0/2165406405 shutdown_connections 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 --2- 172.21.15.50:0/2165406405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f1c003970 0x7f0f1c003d90 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 -- 172.21.15.50:0/2165406405 >> 172.21.15.50:0/2165406405 conn(0x7f0f340cf640 msgr2=0x7f0f340cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 -- 172.21.15.50:0/2165406405 shutdown_connections 2023-08-10T10:52:33.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.713+0000 7f0f3a271640 1 -- 172.21.15.50:0/2165406405 wait complete. 2023-08-10T10:52:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.715+0000 7f0f3a271640 1 Processor -- start 2023-08-10T10:52:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.715+0000 7f0f3a271640 1 -- start start 2023-08-10T10:52:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c003970 0x7f0f341f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f340c8ec0 0x7f0f340c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340c5d10 con 0x7f0f340c9320 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34158580 con 0x7f0f340c8ec0 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3a271640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340c7eb0 con 0x7f0f1c003970 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3880e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3880e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45140/0 (socket says 172.21.15.50:45140) 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.716+0000 7f0f3880e640 1 -- 172.21.15.50:0/46289160 learned_addr learned my addr 172.21.15.50:0/46289160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 -- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c003970 msgr2=0x7f0f341f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c003970 0x7f0f341f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 -- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f340c8ec0 msgr2=0x7f0f340c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f340c8ec0 0x7f0f340c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 -- 172.21.15.50:0/46289160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340c8a30 con 0x7f0f340c9320 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3880e640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f0f340d0230 tx=0x7f0f2c00d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00b070 con 0x7f0f340c9320 2023-08-10T10:52:33.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00de60 con 0x7f0f340c9320 2023-08-10T10:52:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c003830 con 0x7f0f340c9320 2023-08-10T10:52:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.717+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f340c8100 con 0x7f0f340c9320 2023-08-10T10:52:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.718+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f340c86c0 con 0x7f0f340c9320 2023-08-10T10:52:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.719+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f340612b0 con 0x7f0f340c9320 2023-08-10T10:52:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.720+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f2c003990 con 0x7f0f340c9320 2023-08-10T10:52:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.721+0000 7f0f30ff9640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 0x7f0f2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.721+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f2c088ab0 con 0x7f0f340c9320 2023-08-10T10:52:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.721+0000 7f0f33fff640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 0x7f0f2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.722+0000 7f0f33fff640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 0x7f0f2006d110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ba00 tx=0x7f0f24032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.725+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f2c053ad0 con 0x7f0f340c9320 2023-08-10T10:52:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.921+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f340c8bc0 con 0x7f0f340c9320 2023-08-10T10:52:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.922+0000 7f0f30ff9640 1 -- 172.21.15.50:0/46289160 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v191) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f2c018070 con 0x7f0f340c9320 2023-08-10T10:52:33.924 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:52:33.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 msgr2=0x7f0f2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 0x7f0f2006d110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ba00 tx=0x7f0f24032000 comp rx=0 tx=0).stop 2023-08-10T10:52:33.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 msgr2=0x7f0f340c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:33.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f0f340d0230 tx=0x7f0f2c00d660 comp rx=0 tx=0).stop 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 shutdown_connections 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f340c9320 0x7f0f340c71b0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0f2006ac50 0x7f0f2006d110 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f340c8ec0 0x7f0f340c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 --2- 172.21.15.50:0/46289160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1c003970 0x7f0f341f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.925+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 >> 172.21.15.50:0/46289160 conn(0x7f0f340cf640 msgr2=0x7f0f34156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:33.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.926+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 shutdown_connections 2023-08-10T10:52:33.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:33.926+0000 7f0f3a271640 1 -- 172.21.15.50:0/46289160 wait complete. 2023-08-10T10:52:33.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.174+0000 7f2bca666640 1 Processor -- start 2023-08-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.174+0000 7f2bca666640 1 -- start start 2023-08-10T10:52:34.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bca666640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2bc415ff90 0x7f2bc4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bca666640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bc40d28b0 0x7f2bc40d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bca666640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc4160370 con 0x7f2bc40cd960 2023-08-10T10:52:34.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bca666640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40d0b90 con 0x7f2bc415ff90 2023-08-10T10:52:34.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bca666640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc41614d0 con 0x7f2bc40d28b0 2023-08-10T10:52:34.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bc9664640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2bc415ff90 0x7f2bc4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bc8e63640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2bc40cd960 0x7f2bc40d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34362/0 (socket says 172.21.15.50:34362) 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.176+0000 7f2bc8e63640 1 -- 172.21.15.50:0/938424165 learned_addr learned my addr 172.21.15.50:0/938424165 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bc9e65640 1 --2- 172.21.15.50:0/938424165 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40d28b0 0x7f2bc40d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bc9664640 1 -- 172.21.15.50:0/938424165 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40d28b0 msgr2=0x7f2bc40d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bc9664640 1 --2- 172.21.15.50:0/938424165 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40d28b0 0x7f2bc40d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bc9664640 1 -- 172.21.15.50:0/938424165 >> v1:172.21.15.50:6789/0 conn(0x7f2bc40cd960 legacy=0x7f2bc40d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bbbfff640 1 -- 172.21.15.50:0/938424165 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205753759 0 0) 0x7f2bb4001110 con 0x7f2bc40cd960 2023-08-10T10:52:34.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.177+0000 7f2bc9664640 1 -- 172.21.15.50:0/938424165 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40d3200 con 0x7f2bc415ff90 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.178+0000 7f2bc9664640 1 --2- 172.21.15.50:0/938424165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc415ff90 0x7f2bc4160f90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40d0260 tx=0x7f2bc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560c93b3cf392ce5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.178+0000 7f2bbbfff640 1 -- 172.21.15.50:0/938424165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0031830 con 0x7f2bc415ff90 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.178+0000 7f2bbbfff640 1 -- 172.21.15.50:0/938424165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0031990 con 0x7f2bc415ff90 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.178+0000 7f2bbbfff640 1 -- 172.21.15.50:0/938424165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0031d20 con 0x7f2bc415ff90 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 -- 172.21.15.50:0/938424165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc415ff90 msgr2=0x7f2bc4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 --2- 172.21.15.50:0/938424165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc415ff90 0x7f2bc4160f90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40d0260 tx=0x7f2bc002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 -- 172.21.15.50:0/938424165 shutdown_connections 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 --2- 172.21.15.50:0/938424165 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40d28b0 0x7f2bc40d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 --2- 172.21.15.50:0/938424165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc415ff90 0x7f2bc4160f90 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 -- 172.21.15.50:0/938424165 >> 172.21.15.50:0/938424165 conn(0x7f2bc4069ac0 msgr2=0x7f2bc4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 -- 172.21.15.50:0/938424165 shutdown_connections 2023-08-10T10:52:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.179+0000 7f2bca666640 1 -- 172.21.15.50:0/938424165 wait complete. 2023-08-10T10:52:34.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.181+0000 7f2bca666640 1 Processor -- start 2023-08-10T10:52:34.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.181+0000 7f2bca666640 1 -- start start 2023-08-10T10:52:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40d28b0 0x7f2bc41f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc415ff90 0x7f2bc414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40ca3c0 con 0x7f2bc40cd960 2023-08-10T10:52:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc414ef10 con 0x7f2bc415ff90 2023-08-10T10:52:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bca666640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc414f1f0 con 0x7f2bc40d28b0 2023-08-10T10:52:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bc9664640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bc9664640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45150/0 (socket says 172.21.15.50:45150) 2023-08-10T10:52:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.182+0000 7f2bc9664640 1 -- 172.21.15.50:0/4234742231 learned_addr learned my addr 172.21.15.50:0/4234742231 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 -- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40d28b0 msgr2=0x7f2bc41f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40d28b0 0x7f2bc41f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 -- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc415ff90 msgr2=0x7f2bc414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc415ff90 0x7f2bc414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 -- 172.21.15.50:0/4234742231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009400 con 0x7f2bc40cd960 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bc9664640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0000c00 tx=0x7f2bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.183+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc003aa60 con 0x7f2bc40cd960 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.184+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc003abc0 con 0x7f2bc40cd960 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.184+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00443f0 con 0x7f2bc40cd960 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.184+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc414f4d0 con 0x7f2bc40cd960 2023-08-10T10:52:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.184+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc414eb60 con 0x7f2bc40cd960 2023-08-10T10:52:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.185+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc414f6c0 con 0x7f2bc40cd960 2023-08-10T10:52:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.186+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bc004d450 con 0x7f2bc40cd960 2023-08-10T10:52:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.187+0000 7f2bb9ffb640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 0x7f2ba806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.187+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bc00ab6a0 con 0x7f2bc40cd960 2023-08-10T10:52:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.187+0000 7f2bc8e63640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 0x7f2ba806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.188+0000 7f2bc8e63640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 0x7f2ba806d110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4007fd0 tx=0x7f2bb4001310 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.191+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2bc414f6c0 con 0x7f2bc40cd960 2023-08-10T10:52:34.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.384+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bc414f6c0 con 0x7f2bc40cd960 2023-08-10T10:52:34.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.384+0000 7f2bb9ffb640 1 -- 172.21.15.50:0/4234742231 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v191) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bc414f6c0 con 0x7f2bc40cd960 2023-08-10T10:52:34.386 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:52:34.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.387+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 msgr2=0x7f2ba806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.387+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 0x7f2ba806d110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4007fd0 tx=0x7f2bb4001310 comp rx=0 tx=0).stop 2023-08-10T10:52:34.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.387+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 msgr2=0x7f2bc41f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.387+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0000c00 tx=0x7f2bc00046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 shutdown_connections 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2ba806ac50 0x7f2ba806d110 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc415ff90 0x7f2bc414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc40d28b0 0x7f2bc41f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 --2- 172.21.15.50:0/4234742231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc40cd960 0x7f2bc41f6300 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 >> 172.21.15.50:0/4234742231 conn(0x7f2bc4069ac0 msgr2=0x7f2bc415e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 shutdown_connections 2023-08-10T10:52:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.388+0000 7f2bca666640 1 -- 172.21.15.50:0/4234742231 wait complete. 2023-08-10T10:52:34.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:52:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.640+0000 7f321d271640 1 Processor -- start 2023-08-10T10:52:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.640+0000 7f321d271640 1 -- start start 2023-08-10T10:52:34.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.641+0000 7f321d271640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 0x7f32180710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.641+0000 7f321d271640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32180718a0 0x7f32180ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f321d271640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32180cca70 con 0x7f32180af9b0 2023-08-10T10:52:34.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f321d271640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32180cdf10 con 0x7f32180718a0 2023-08-10T10:52:34.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f321d271640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3218071620 con 0x7f3218070d00 2023-08-10T10:52:34.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32180718a0 0x7f32180ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32180718a0 0x7f32180ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45154/0 (socket says 172.21.15.50:45154) 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 -- 172.21.15.50:0/909226969 learned_addr learned my addr 172.21.15.50:0/909226969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f3216ffd640 1 --2- 172.21.15.50:0/909226969 >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 0x7f32180710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 -- 172.21.15.50:0/909226969 >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 msgr2=0x7f32180710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 --2- 172.21.15.50:0/909226969 >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 0x7f32180710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.642+0000 7f320e7fc640 1 -- 172.21.15.50:0/909226969 >> v1:172.21.15.117:6789/0 conn(0x7f32180af9b0 legacy=0x7f32180cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.643+0000 7f320e7fc640 1 -- 172.21.15.50:0/909226969 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180cf8a0 con 0x7f32180718a0 2023-08-10T10:52:34.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.643+0000 7f3216ffd640 1 --2- 172.21.15.50:0/909226969 >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 0x7f32180710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.644+0000 7f320e7fc640 1 --2- 172.21.15.50:0/909226969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32180718a0 0x7f32180ce4c0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f3218073d10 tx=0x7f320002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526a4f4d3950f00a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.644+0000 7f32167fc640 1 -- 172.21.15.50:0/909226969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200031800 con 0x7f32180718a0 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.644+0000 7f32167fc640 1 -- 172.21.15.50:0/909226969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200031960 con 0x7f32180718a0 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.644+0000 7f32167fc640 1 -- 172.21.15.50:0/909226969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200031cf0 con 0x7f32180718a0 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 -- 172.21.15.50:0/909226969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32180718a0 msgr2=0x7f32180ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 --2- 172.21.15.50:0/909226969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32180718a0 0x7f32180ce4c0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f3218073d10 tx=0x7f320002b8a0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 -- 172.21.15.50:0/909226969 shutdown_connections 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 --2- 172.21.15.50:0/909226969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32180718a0 0x7f32180ce4c0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 --2- 172.21.15.50:0/909226969 >> v2:172.21.15.117:3300/0 conn(0x7f3218070d00 0x7f32180710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 -- 172.21.15.50:0/909226969 >> 172.21.15.50:0/909226969 conn(0x7f32180b23e0 msgr2=0x7f32180b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 -- 172.21.15.50:0/909226969 shutdown_connections 2023-08-10T10:52:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.645+0000 7f321d271640 1 -- 172.21.15.50:0/909226969 wait complete. 2023-08-10T10:52:34.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.647+0000 7f321d271640 1 Processor -- start 2023-08-10T10:52:34.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.647+0000 7f321d271640 1 -- start start 2023-08-10T10:52:34.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180718a0 0x7f32181f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 0x7f32180b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321815ca60 con 0x7f3218070d00 2023-08-10T10:52:34.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c8a40 con 0x7f32180718a0 2023-08-10T10:52:34.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f321d271640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c8d20 con 0x7f32180af9b0 2023-08-10T10:52:34.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f3216ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f3216ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45162/0 (socket says 172.21.15.50:45162) 2023-08-10T10:52:34.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f3216ffd640 1 -- 172.21.15.50:0/3276155225 learned_addr learned my addr 172.21.15.50:0/3276155225 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:34.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f320e7fc640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180718a0 0x7f32181f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.648+0000 7f32177fe640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 0x7f32180b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 -- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 msgr2=0x7f32180b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 0x7f32180b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 -- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180718a0 msgr2=0x7f32181f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180718a0 0x7f32181f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 -- 172.21.15.50:0/3276155225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000094d0 con 0x7f3218070d00 2023-08-10T10:52:34.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f32177fe640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 0x7f32180b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:34.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f3216ffd640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f320800c7f0 tx=0x7f320800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208007a30 con 0x7f3218070d00 2023-08-10T10:52:34.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208007b90 con 0x7f3218070d00 2023-08-10T10:52:34.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320800ce40 con 0x7f3218070d00 2023-08-10T10:52:34.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180c9000 con 0x7f3218070d00 2023-08-10T10:52:34.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.649+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32181f1af0 con 0x7f3218070d00 2023-08-10T10:52:34.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.650+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32180c9240 con 0x7f3218070d00 2023-08-10T10:52:34.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.651+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32080113f0 con 0x7f3218070d00 2023-08-10T10:52:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.652+0000 7f320ffff640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 0x7f31f806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.652+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3208089750 con 0x7f3218070d00 2023-08-10T10:52:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.653+0000 7f320e7fc640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 0x7f31f806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.654+0000 7f320e7fc640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 0x7f31f806d140 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f320003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.657+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f32180c9240 con 0x7f3218070d00 2023-08-10T10:52:34.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.858+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32180c9240 con 0x7f3218070d00 2023-08-10T10:52:34.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.859+0000 7f320ffff640 1 -- 172.21.15.50:0/3276155225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v191) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32180c9240 con 0x7f3218070d00 2023-08-10T10:52:34.861 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:52:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.861+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 msgr2=0x7f31f806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.861+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 0x7f31f806d140 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f320003c040 comp rx=0 tx=0).stop 2023-08-10T10:52:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.861+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 msgr2=0x7f321815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.861+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f320800c7f0 tx=0x7f320800cbf0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 shutdown_connections 2023-08-10T10:52:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32180af9b0 0x7f32180b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f31f806ac80 0x7f31f806d140 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180718a0 0x7f32181f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 --2- 172.21.15.50:0/3276155225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3218070d00 0x7f321815c520 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 >> 172.21.15.50:0/3276155225 conn(0x7f32180b23e0 msgr2=0x7f32180b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 shutdown_connections 2023-08-10T10:52:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:34.862+0000 7f321d271640 1 -- 172.21.15.50:0/3276155225 wait complete. 2023-08-10T10:52:34.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:52:35.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.115+0000 7f9c92d42640 1 Processor -- start 2023-08-10T10:52:35.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.115+0000 7f9c92d42640 1 -- start start 2023-08-10T10:52:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c92d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c8c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c92d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0d14a0 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c92d42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0d27a0 con 0x7f9c8c0b84b0 2023-08-10T10:52:35.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c92d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1700 con 0x7f9c8c15ce80 2023-08-10T10:52:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c912df640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c8c0d31c0 0x7f9c8c0b5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35332/0 (socket says 172.21.15.50:35332) 2023-08-10T10:52:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.117+0000 7f9c912df640 1 -- 172.21.15.50:0/2393717285 learned_addr learned my addr 172.21.15.50:0/2393717285 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c8c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135695874 0 0) 0x7f9c8c0d14a0 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c74003520 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687460770 0 0) 0x7f9c74003520 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 msgr2=0x7f9c8c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c8c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 >> v1:172.21.15.117:6789/0 conn(0x7f9c8c0b84b0 legacy=0x7f9c8c0d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0d19e0 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9c84001670 con 0x7f9c8c0d31c0 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 >> v1:172.21.15.50:6789/0 conn(0x7f9c8c0d31c0 legacy=0x7f9c8c0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74003f20 0x7f9c740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c74004d00 0x7f9c74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1700 con 0x7f9c74004d00 2023-08-10T10:52:35.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7400bb10 con 0x7f9c74003f20 2023-08-10T10:52:35.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.118+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7400bcd0 con 0x7f9c8c15ce80 2023-08-10T10:52:35.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c74004d00 0x7f9c74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 -- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 msgr2=0x7f9c740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:35.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c15ce80 0x7f9c740039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 -- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74003f20 msgr2=0x7f9c740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c8bfff640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74003f20 0x7f9c740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74003f20 0x7f9c740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c912df640 1 -- 172.21.15.50:0/2393717285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74003520 con 0x7f9c74004d00 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.119+0000 7f9c8bfff640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74003f20 0x7f9c740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.120+0000 7f9c912df640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c74004d00 0x7f9c74005180 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c210 tx=0x7f9c740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787ffd6253aa69d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84005ad0 con 0x7f9c74004d00 2023-08-10T10:52:35.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84005c30 con 0x7f9c74004d00 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c8b7fe640 1 -- 172.21.15.50:0/2393717285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8402c890 con 0x7f9c74004d00 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c92d42640 1 -- 172.21.15.50:0/2393717285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c74004d00 msgr2=0x7f9c74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2393717285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c74004d00 0x7f9c74005180 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c210 tx=0x7f9c740057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c912df640 1 -- 172.21.15.50:0/2393717285 reap_dead start 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c92d42640 1 -- 172.21.15.50:0/2393717285 shutdown_connections 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.121+0000 7f9c92d42640 1 -- 172.21.15.50:0/2393717285 >> 172.21.15.50:0/2393717285 conn(0x7f9c8c069a90 msgr2=0x7f9c8c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.122+0000 7f9c92d42640 1 -- 172.21.15.50:0/2393717285 shutdown_connections 2023-08-10T10:52:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.122+0000 7f9c92d42640 1 -- 172.21.15.50:0/2393717285 wait complete. 2023-08-10T10:52:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.123+0000 7f9c92d42640 1 Processor -- start 2023-08-10T10:52:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.124+0000 7f9c92d42640 1 -- start start 2023-08-10T10:52:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 0x7f9c8c0aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 0x7f9c8c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c14eae0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0cc780 con 0x7f9c74004d00 2023-08-10T10:52:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c92d42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0c7e00 con 0x7f9c8c0c8ea0 2023-08-10T10:52:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c912df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c912df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49990/0 (socket says 172.21.15.50:49990) 2023-08-10T10:52:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c912df640 1 -- 172.21.15.50:0/2238033044 learned_addr learned my addr 172.21.15.50:0/2238033044 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 0x7f9c8c0aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c8bfff640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 0x7f9c8c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.125+0000 7f9c912df640 1 -- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 msgr2=0x7f9c8c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c912df640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 0x7f9c8c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c912df640 1 -- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 msgr2=0x7f9c8c0aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c912df640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 0x7f9c8c0aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c912df640 1 -- 172.21.15.50:0/2238033044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0c80e0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c8bfff640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 0x7f9c8c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 0x7f9c8c0aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c912df640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f9c8402c500 tx=0x7f9c8402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8403c040 con 0x7f9c8c0cc300 2023-08-10T10:52:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c840017a0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84000ed0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c0c83c0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.126+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c0c8980 con 0x7f9c8c0cc300 2023-08-10T10:52:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.128+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c0c8b70 con 0x7f9c8c0cc300 2023-08-10T10:52:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.129+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c84032070 con 0x7f9c8c0cc300 2023-08-10T10:52:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.129+0000 7f9c897fa640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 0x7f9c7806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.130+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c840aa470 con 0x7f9c8c0cc300 2023-08-10T10:52:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.130+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 0x7f9c7806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.131+0000 7f9c90ade640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 0x7f9c7806d110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c007460 tx=0x7f9c7c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.134+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c840755b0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.342+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9c8c04e270 con 0x7f9c8c0cc300 2023-08-10T10:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.342+0000 7f9c897fa640 1 -- 172.21.15.50:0/2238033044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v191) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9c84078bd0 con 0x7f9c8c0cc300 2023-08-10T10:52:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:52:35.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 msgr2=0x7f9c7806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 0x7f9c7806d110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c007460 tx=0x7f9c7c00d040 comp rx=0 tx=0).stop 2023-08-10T10:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 msgr2=0x7f9c8c1f19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f9c8402c500 tx=0x7f9c8402e070 comp rx=0 tx=0).stop 2023-08-10T10:52:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 shutdown_connections 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c8c0cc300 0x7f9c8c1f19a0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c8c0c8ea0 0x7f9c8c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9c7806ac50 0x7f9c7806d110 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 --2- 172.21.15.50:0/2238033044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c74004d00 0x7f9c8c0aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.345+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 >> 172.21.15.50:0/2238033044 conn(0x7f9c8c069a90 msgr2=0x7f9c8c0b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.346+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 shutdown_connections 2023-08-10T10:52:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.346+0000 7f9c92d42640 1 -- 172.21.15.50:0/2238033044 wait complete. 2023-08-10T10:52:35.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:52:35.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:35.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:52:35.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:52:35.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:35.528 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:52:35.574 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:35.574 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:35.623 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:35.623 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:35.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.957+0000 7fd95dbf1640 1 Processor -- start 2023-08-10T10:52:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.957+0000 7fd95dbf1640 1 -- start start 2023-08-10T10:52:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95dbf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd95815a940 0x7fd9580aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95dbf1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9580b19d0 0x7fd9580b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95dbf1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580b1f10 con 0x7fd95815f2b0 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95dbf1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580b21f0 con 0x7fd95815a940 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95dbf1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95815e5c0 con 0x7fd9580b19d0 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd957fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd95815f2b0 0x7fd9580b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35340/0 (socket says 172.21.15.50:35340) 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd957fff640 1 -- 172.21.15.50:0/3105537185 learned_addr learned my addr 172.21.15.50:0/3105537185 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95cbef640 1 --2- 172.21.15.50:0/3105537185 >> v2:172.21.15.50:3300/0 conn(0x7fd95815a940 0x7fd9580aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.959+0000 7fd95d3f0640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9580b19d0 0x7fd9580b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.960+0000 7fd95cbef640 1 -- 172.21.15.50:0/3105537185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9580b19d0 msgr2=0x7fd9580b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.960+0000 7fd95cbef640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9580b19d0 0x7fd9580b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.960+0000 7fd95cbef640 1 -- 172.21.15.50:0/3105537185 >> v1:172.21.15.50:6789/0 conn(0x7fd95815f2b0 legacy=0x7fd9580b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.960+0000 7fd95cbef640 1 -- 172.21.15.50:0/3105537185 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95815e7d0 con 0x7fd95815a940 2023-08-10T10:52:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.960+0000 7fd9577fe640 1 -- 172.21.15.50:0/3105537185 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884984618 0 0) 0x7fd9580b1f10 con 0x7fd95815f2b0 2023-08-10T10:52:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.961+0000 7fd95cbef640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95815a940 0x7fd9580aff10 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0097a0 tx=0x7fd94c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1745808dcae02c92 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.961+0000 7fd9577fe640 1 -- 172.21.15.50:0/3105537185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c031780 con 0x7fd95815a940 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.961+0000 7fd9577fe640 1 -- 172.21.15.50:0/3105537185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c0318e0 con 0x7fd95815a940 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.961+0000 7fd9577fe640 1 -- 172.21.15.50:0/3105537185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c031c70 con 0x7fd95815a940 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 -- 172.21.15.50:0/3105537185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95815a940 msgr2=0x7fd9580aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95815a940 0x7fd9580aff10 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0097a0 tx=0x7fd94c02b820 comp rx=0 tx=0).stop 2023-08-10T10:52:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 -- 172.21.15.50:0/3105537185 shutdown_connections 2023-08-10T10:52:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9580b19d0 0x7fd9580b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/3105537185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd95815a940 0x7fd9580aff10 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 -- 172.21.15.50:0/3105537185 >> 172.21.15.50:0/3105537185 conn(0x7fd95806ab80 msgr2=0x7fd95806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 -- 172.21.15.50:0/3105537185 shutdown_connections 2023-08-10T10:52:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.962+0000 7fd95dbf1640 1 -- 172.21.15.50:0/3105537185 wait complete. 2023-08-10T10:52:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.964+0000 7fd95dbf1640 1 Processor -- start 2023-08-10T10:52:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.964+0000 7fd95dbf1640 1 -- start start 2023-08-10T10:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd95815a940 0x7fd9580c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd95815f2b0 0x7fd9580c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95815b0a0 con 0x7fd9580b19d0 2023-08-10T10:52:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95806f610 con 0x7fd95815f2b0 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95dbf1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95806f8f0 con 0x7fd95815a940 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95cbef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95cbef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50010/0 (socket says 172.21.15.50:50010) 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.965+0000 7fd95cbef640 1 -- 172.21.15.50:0/4137130854 learned_addr learned my addr 172.21.15.50:0/4137130854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 -- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd95815a940 msgr2=0x7fd9580c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd95815a940 0x7fd9580c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95d3f0640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd95815f2b0 0x7fd9580c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 -- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd95815f2b0 msgr2=0x7fd9580c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:35.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd95815f2b0 0x7fd9580c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:35.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 -- 172.21.15.50:0/4137130854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009400 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95cbef640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd94c034040 tx=0x7fd94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c032820 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c032980 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c032d30 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.966+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95806fbd0 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.967+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95806f2a0 con 0x7fd9580b19d0 2023-08-10T10:52:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.968+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95815ed70 con 0x7fd9580b19d0 2023-08-10T10:52:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.969+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd94c04d3f0 con 0x7fd9580b19d0 2023-08-10T10:52:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.969+0000 7fd9557fa640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 0x7fd93c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.970+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd94c0ab260 con 0x7fd9580b19d0 2023-08-10T10:52:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.970+0000 7fd957fff640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 0x7fd93c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.970+0000 7fd957fff640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 0x7fd93c06d110 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c41e0 tx=0x7fd944007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:35.975+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd95815ed70 con 0x7fd9580b19d0 2023-08-10T10:52:36.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.168+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd95815ed70 con 0x7fd9580b19d0 2023-08-10T10:52:36.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.171+0000 7fd9557fa640 1 -- 172.21.15.50:0/4137130854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fd95815ed70 con 0x7fd9580b19d0 2023-08-10T10:52:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:36.174 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":191,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:26.698474+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 msgr2=0x7fd93c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 0x7fd93c06d110 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c41e0 tx=0x7fd944007950 comp rx=0 tx=0).stop 2023-08-10T10:52:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 msgr2=0x7fd95806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd94c034040 tx=0x7fd94c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 shutdown_connections 2023-08-10T10:52:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd93c06ac50 0x7fd93c06d110 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd95815f2b0 0x7fd9580c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd95815a940 0x7fd9580c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 --2- 172.21.15.50:0/4137130854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9580b19d0 0x7fd95806e700 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 >> 172.21.15.50:0/4137130854 conn(0x7fd95806ab80 msgr2=0x7fd9580ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:36.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 shutdown_connections 2023-08-10T10:52:36.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.174+0000 7fd95dbf1640 1 -- 172.21.15.50:0/4137130854 wait complete. 2023-08-10T10:52:36.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:51:49.463467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:51:50.099047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:52:36.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:52:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.428+0000 7f9f8d3b1640 1 Processor -- start 2023-08-10T10:52:36.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.429+0000 7f9f8d3b1640 1 -- start start 2023-08-10T10:52:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.430+0000 7f9f8d3b1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f8815ae40 0x7f9f880b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.430+0000 7f9f8d3b1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9f880cd9b0 0x7f9f880ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.430+0000 7f9f8d3b1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880adcb0 con 0x7f9f8806cb30 2023-08-10T10:52:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.430+0000 7f9f8d3b1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8806c320 con 0x7f9f8815ae40 2023-08-10T10:52:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.430+0000 7f9f8d3b1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8806b770 con 0x7f9f880cd9b0 2023-08-10T10:52:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f8815ae40 0x7f9f880b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f867fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f8806cb30 0x7f9f880cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35356/0 (socket says 172.21.15.50:35356) 2023-08-10T10:52:36.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f8815ae40 0x7f9f880b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50022/0 (socket says 172.21.15.50:50022) 2023-08-10T10:52:36.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f867fc640 1 -- 172.21.15.50:0/3389509612 learned_addr learned my addr 172.21.15.50:0/3389509612 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:36.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f877fe640 1 --2- 172.21.15.50:0/3389509612 >> v2:172.21.15.117:3300/0 conn(0x7f9f880cd9b0 0x7f9f880ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 -- 172.21.15.50:0/3389509612 >> v2:172.21.15.117:3300/0 conn(0x7f9f880cd9b0 msgr2=0x7f9f880ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:36.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 --2- 172.21.15.50:0/3389509612 >> v2:172.21.15.117:3300/0 conn(0x7f9f880cd9b0 0x7f9f880ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 -- 172.21.15.50:0/3389509612 >> v1:172.21.15.50:6789/0 conn(0x7f9f8806cb30 legacy=0x7f9f880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f86ffd640 1 -- 172.21.15.50:0/3389509612 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8806b9f0 con 0x7f9f8815ae40 2023-08-10T10:52:36.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.431+0000 7f9f85ffb640 1 -- 172.21.15.50:0/3389509612 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548565236 0 0) 0x7f9f880adcb0 con 0x7f9f8806cb30 2023-08-10T10:52:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.433+0000 7f9f86ffd640 1 --2- 172.21.15.50:0/3389509612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f8815ae40 0x7f9f880b1510 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b0d60 tx=0x7f9f7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b2418aa9129074 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.433+0000 7f9f85ffb640 1 -- 172.21.15.50:0/3389509612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78031830 con 0x7f9f8815ae40 2023-08-10T10:52:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.433+0000 7f9f85ffb640 1 -- 172.21.15.50:0/3389509612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78031990 con 0x7f9f8815ae40 2023-08-10T10:52:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.433+0000 7f9f85ffb640 1 -- 172.21.15.50:0/3389509612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78031d20 con 0x7f9f8815ae40 2023-08-10T10:52:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/3389509612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f8815ae40 msgr2=0x7f9f880b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/3389509612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f8815ae40 0x7f9f880b1510 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b0d60 tx=0x7f9f7802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/3389509612 shutdown_connections 2023-08-10T10:52:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/3389509612 >> v2:172.21.15.117:3300/0 conn(0x7f9f880cd9b0 0x7f9f880ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/3389509612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f8815ae40 0x7f9f880b1510 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/3389509612 >> 172.21.15.50:0/3389509612 conn(0x7f9f880b01b0 msgr2=0x7f9f880b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/3389509612 shutdown_connections 2023-08-10T10:52:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.434+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/3389509612 wait complete. 2023-08-10T10:52:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.436+0000 7f9f8d3b1640 1 Processor -- start 2023-08-10T10:52:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.436+0000 7f9f8d3b1640 1 -- start start 2023-08-10T10:52:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8806cb30 0x7f9f880c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f8815ae40 0x7f9f8814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8815d460 con 0x7f9f880cd9b0 2023-08-10T10:52:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8815c590 con 0x7f9f8806cb30 2023-08-10T10:52:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f8d3b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8815c7e0 con 0x7f9f8815ae40 2023-08-10T10:52:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50024/0 (socket says 172.21.15.50:50024) 2023-08-10T10:52:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f867fc640 1 -- 172.21.15.50:0/791856492 learned_addr learned my addr 172.21.15.50:0/791856492 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.437+0000 7f9f86ffd640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8806cb30 0x7f9f880c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 -- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f8815ae40 msgr2=0x7f9f8814a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f8815ae40 0x7f9f8814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 -- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8806cb30 msgr2=0x7f9f880c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8806cb30 0x7f9f880c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 -- 172.21.15.50:0/791856492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78009400 con 0x7f9f880cd9b0 2023-08-10T10:52:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f867fc640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c410 tx=0x7f9f7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0074e0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c007660 con 0x7f9f880cd9b0 2023-08-10T10:52:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c004a20 con 0x7f9f880cd9b0 2023-08-10T10:52:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8815cac0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.438+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8815d080 con 0x7f9f880cd9b0 2023-08-10T10:52:36.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.440+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8815d5a0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.441+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f7c004b80 con 0x7f9f880cd9b0 2023-08-10T10:52:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.442+0000 7f9f6f7fe640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 0x7f9f7406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.442+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f7c0892d0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.442+0000 7f9f86ffd640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 0x7f9f7406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.443+0000 7f9f86ffd640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 0x7f9f7406d110 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9f78036000 tx=0x7f9f78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.446+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9f8815d5a0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.638+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f8815d5a0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.639+0000 7f9f6f7fe640 1 -- 172.21.15.50:0/791856492 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v191) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f8815d5a0 con 0x7f9f880cd9b0 2023-08-10T10:52:36.641 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:52:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 msgr2=0x7f9f7406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 0x7f9f7406d110 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9f78036000 tx=0x7f9f78008030 comp rx=0 tx=0).stop 2023-08-10T10:52:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 msgr2=0x7f9f8814b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c410 tx=0x7f9f7c00c8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 shutdown_connections 2023-08-10T10:52:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f8815ae40 0x7f9f8814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cd9b0 0x7f9f8814b570 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9f7406ac50 0x7f9f7406d110 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 --2- 172.21.15.50:0/791856492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f8806cb30 0x7f9f880c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 >> 172.21.15.50:0/791856492 conn(0x7f9f880b01b0 msgr2=0x7f9f880cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 shutdown_connections 2023-08-10T10:52:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.642+0000 7f9f8d3b1640 1 -- 172.21.15.50:0/791856492 wait complete. 2023-08-10T10:52:36.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:52:36.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.878+0000 7f6df6683640 1 Processor -- start 2023-08-10T10:52:36.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.878+0000 7f6df6683640 1 -- start start 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6df015cf70 0x7f6df0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6df00b4640 0x7f6df0161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df0160a40 con 0x7f6df015cf70 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00b4bb0 con 0x7f6df00b4640 2023-08-10T10:52:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6df6683640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00b4e90 con 0x7f6df015cb90 2023-08-10T10:52:36.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.879+0000 7f6de77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6df015cf70 0x7f6df0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6df015cf70 0x7f6df0160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50026/0 (socket says 172.21.15.50:50026) 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 -- 172.21.15.50:0/1198573330 learned_addr learned my addr 172.21.15.50:0/1198573330 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6df4c20640 1 --2- 172.21.15.50:0/1198573330 >> v2:172.21.15.117:3300/0 conn(0x7f6df00b4640 0x7f6df0161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6deffff640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 -- 172.21.15.50:0/1198573330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 msgr2=0x7f6df00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df00b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 -- 172.21.15.50:0/1198573330 >> v2:172.21.15.117:3300/0 conn(0x7f6df00b4640 msgr2=0x7f6df0161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:36.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 --2- 172.21.15.50:0/1198573330 >> v2:172.21.15.117:3300/0 conn(0x7f6df00b4640 0x7f6df0161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.880+0000 7f6de77fe640 1 -- 172.21.15.50:0/1198573330 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00b5170 con 0x7f6df015cf70 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.881+0000 7f6de77fe640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df0160ed0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f6df00718c0 tx=0x7f6dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7122f91519937b5d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.882+0000 7f6def7fe640 1 -- 172.21.15.50:0/1198573330 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031870 con 0x7f6df015cf70 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.882+0000 7f6def7fe640 1 -- 172.21.15.50:0/1198573330 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80319d0 con 0x7f6df015cf70 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.882+0000 7f6def7fe640 1 -- 172.21.15.50:0/1198573330 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031d60 con 0x7f6df015cf70 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.882+0000 7f6df6683640 1 -- 172.21.15.50:0/1198573330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 msgr2=0x7f6df0160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.882+0000 7f6df6683640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df0160ed0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f6df00718c0 tx=0x7f6dd802b910 comp rx=0 tx=0).stop 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 -- 172.21.15.50:0/1198573330 shutdown_connections 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 --2- 172.21.15.50:0/1198573330 >> v2:172.21.15.117:3300/0 conn(0x7f6df00b4640 0x7f6df0161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df0160ed0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 --2- 172.21.15.50:0/1198573330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df00b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 -- 172.21.15.50:0/1198573330 >> 172.21.15.50:0/1198573330 conn(0x7f6df00cf640 msgr2=0x7f6df00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 -- 172.21.15.50:0/1198573330 shutdown_connections 2023-08-10T10:52:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.883+0000 7f6df6683640 1 -- 172.21.15.50:0/1198573330 wait complete. 2023-08-10T10:52:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.885+0000 7f6df6683640 1 Processor -- start 2023-08-10T10:52:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.885+0000 7f6df6683640 1 -- start start 2023-08-10T10:52:36.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df00b4640 0x7f6df014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df01506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df014f560 con 0x7f6df015cf70 2023-08-10T10:52:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df014d280 con 0x7f6df00b4640 2023-08-10T10:52:36.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df6683640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df014f0d0 con 0x7f6df015cb90 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df4c20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df4c20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50038/0 (socket says 172.21.15.50:50038) 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6df4c20640 1 -- 172.21.15.50:0/1359294157 learned_addr learned my addr 172.21.15.50:0/1359294157 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6de77fe640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df01506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.886+0000 7f6deffff640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df00b4640 0x7f6df014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 -- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 msgr2=0x7f6df01506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df01506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 -- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df00b4640 msgr2=0x7f6df014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df00b4640 0x7f6df014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80094d0 con 0x7f6df015cf70 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df4c20640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f6de800d800 tx=0x7f6de800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80096c0 con 0x7f6df015cf70 2023-08-10T10:52:36.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8009840 con 0x7f6df015cf70 2023-08-10T10:52:36.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8009bf0 con 0x7f6df015cf70 2023-08-10T10:52:36.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.887+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df0150060 con 0x7f6df015cf70 2023-08-10T10:52:36.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.888+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df014ed60 con 0x7f6df015cf70 2023-08-10T10:52:36.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.889+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df00c77a0 con 0x7f6df015cf70 2023-08-10T10:52:36.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.890+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6de8009d50 con 0x7f6df015cf70 2023-08-10T10:52:36.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.891+0000 7f6ded7fa640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 0x7f6dd006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:36.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.891+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6de8089c60 con 0x7f6df015cf70 2023-08-10T10:52:36.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.891+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f6dd0072da0 con 0x7f6df015cf70 2023-08-10T10:52:36.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.891+0000 7f6deffff640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 0x7f6dd006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:36.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.892+0000 7f6deffff640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 0x7f6dd006d110 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009a60 tx=0x7f6de0003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:36.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:36.895+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6de8054d00 con 0x7f6df015cf70 2023-08-10T10:52:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.089+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6df00612b0 con 0x7f6df015cf70 2023-08-10T10:52:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.090+0000 7f6ded7fa640 1 -- 172.21.15.50:0/1359294157 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6de8018030 con 0x7f6df015cf70 2023-08-10T10:52:37.091 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:52:37.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 msgr2=0x7f6dd006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 0x7f6dd006d110 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009a60 tx=0x7f6de0003990 comp rx=0 tx=0).stop 2023-08-10T10:52:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 msgr2=0x7f6df014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f6de800d800 tx=0x7f6de800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 shutdown_connections 2023-08-10T10:52:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df015cf70 0x7f6df014df90 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015cb90 0x7f6df01506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f6dd006ac50 0x7f6dd006d110 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 --2- 172.21.15.50:0/1359294157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df00b4640 0x7f6df014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 >> 172.21.15.50:0/1359294157 conn(0x7f6df00cf640 msgr2=0x7f6df00cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 shutdown_connections 2023-08-10T10:52:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.092+0000 7f6df6683640 1 -- 172.21.15.50:0/1359294157 wait complete. 2023-08-10T10:52:37.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:52:37.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.341+0000 7f7f32afa640 1 Processor -- start 2023-08-10T10:52:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.341+0000 7f7f32afa640 1 -- start start 2023-08-10T10:52:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.342+0000 7f7f32afa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f2c15cb90 0x7f7f2c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f32afa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c160a40 con 0x7f7f2c1615e0 2023-08-10T10:52:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f32afa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0b4bb0 con 0x7f7f2c15cf70 2023-08-10T10:52:37.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f32afa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0b4e90 con 0x7f7f2c15cb90 2023-08-10T10:52:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f31097640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7f2c1615e0 0x7f7f2c06fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35358/0 (socket says 172.21.15.50:35358) 2023-08-10T10:52:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f31097640 1 -- 172.21.15.50:0/695187942 learned_addr learned my addr 172.21.15.50:0/695187942 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.343+0000 7f7f30896640 1 --2- 172.21.15.50:0/695187942 >> v2:172.21.15.117:3300/0 conn(0x7f7f2c15cb90 0x7f7f2c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417634008 0 0) 0x7f7f2c160a40 con 0x7f7f2c1615e0 2023-08-10T10:52:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f14003520 con 0x7f7f2c1615e0 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159921378 0 0) 0x7f7f14003520 con 0x7f7f2c1615e0 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 >> v2:172.21.15.117:3300/0 conn(0x7f7f2c15cb90 msgr2=0x7f7f2c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 --2- 172.21.15.50:0/695187942 >> v2:172.21.15.117:3300/0 conn(0x7f7f2c15cb90 0x7f7f2c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 >> v1:172.21.15.117:6789/0 conn(0x7f7f2c15cf70 legacy=0x7f7f2c160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0b5170 con 0x7f7f2c1615e0 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7f24001670 con 0x7f7f2c1615e0 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 >> v1:172.21.15.50:6789/0 conn(0x7f7f2c1615e0 legacy=0x7f7f2c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 0x7f7f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140047c0 0x7f7f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14005180 0x7f7f1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0b4e90 con 0x7f7f14003970 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1400c020 con 0x7f7f140047c0 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.344+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1400c1e0 con 0x7f7f14005180 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 0x7f7f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 -- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14005180 msgr2=0x7f7f1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f23fff640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140047c0 0x7f7f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f31097640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14005180 0x7f7f1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14005180 0x7f7f1400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 -- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140047c0 msgr2=0x7f7f14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140047c0 0x7f7f14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f30896640 1 -- 172.21.15.50:0/695187942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14003520 con 0x7f7f14003970 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f23fff640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140047c0 0x7f7f14004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:37.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f31097640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14005180 0x7f7f1400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.345+0000 7f7f31097640 1 -- 172.21.15.50:0/695187942 reap_dead start 2023-08-10T10:52:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.346+0000 7f7f30896640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 0x7f7f14003d90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009fc0 tx=0x7f7f140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6741349a36ffeae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2802cbf0 con 0x7f7f14003970 2023-08-10T10:52:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2800f040 con 0x7f7f14003970 2023-08-10T10:52:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f237fe640 1 -- 172.21.15.50:0/695187942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28034440 con 0x7f7f14003970 2023-08-10T10:52:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 -- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 msgr2=0x7f7f14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 0x7f7f14003d90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009fc0 tx=0x7f7f140057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 -- 172.21.15.50:0/695187942 shutdown_connections 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 --2- 172.21.15.50:0/695187942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f14003970 0x7f7f14003d90 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 -- 172.21.15.50:0/695187942 >> 172.21.15.50:0/695187942 conn(0x7f7f2c0cf640 msgr2=0x7f7f2c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.347+0000 7f7f32afa640 1 -- 172.21.15.50:0/695187942 shutdown_connections 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.348+0000 7f7f32afa640 1 -- 172.21.15.50:0/695187942 wait complete. 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.349+0000 7f7f32afa640 1 Processor -- start 2023-08-10T10:52:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.349+0000 7f7f32afa640 1 -- start start 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.350+0000 7f7f32afa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14003970 0x7f7f2c150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.350+0000 7f7f32afa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2c0cac50 0x7f7f2c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f32afa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f32afa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cb610 con 0x7f7f2c15d390 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f32afa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c15dd50 con 0x7f7f2c0cac50 2023-08-10T10:52:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f32afa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c15fc20 con 0x7f7f14003970 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50054/0 (socket says 172.21.15.50:50054) 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 -- 172.21.15.50:0/788942850 learned_addr learned my addr 172.21.15.50:0/788942850 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f23fff640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2c0cac50 0x7f7f2c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f30896640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14003970 0x7f7f2c150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 -- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14003970 msgr2=0x7f7f2c150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14003970 0x7f7f2c150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 -- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2c0cac50 msgr2=0x7f7f2c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2c0cac50 0x7f7f2c0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.351+0000 7f7f31097640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c1586e0 con 0x7f7f2c15d390 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f31097640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0d0230 tx=0x7f7f2400d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240074e0 con 0x7f7f2c15d390 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24007680 con 0x7f7f2c15d390 2023-08-10T10:52:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24004a00 con 0x7f7f2c15d390 2023-08-10T10:52:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c15df70 con 0x7f7f2c15d390 2023-08-10T10:52:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.352+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c158c30 con 0x7f7f2c15d390 2023-08-10T10:52:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.353+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c0612b0 con 0x7f7f2c15d390 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.354+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f24004b60 con 0x7f7f2c15d390 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.355+0000 7f7f217fa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 0x7f7f1806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.356+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f24088780 con 0x7f7f2c15d390 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.356+0000 7f7f30896640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 0x7f7f1806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.356+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f7f18072da0 con 0x7f7f2c15d390 2023-08-10T10:52:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.357+0000 7f7f30896640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 0x7f7f1806d110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7f28036000 tx=0x7f7f2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.360+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f24053820 con 0x7f7f2c15d390 2023-08-10T10:52:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.552+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f2c0653d0 con 0x7f7f2c15d390 2023-08-10T10:52:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.553+0000 7f7f217fa640 1 -- 172.21.15.50:0/788942850 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v192) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f24056e40 con 0x7f7f2c15d390 2023-08-10T10:52:37.555 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:52:37.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 msgr2=0x7f7f1806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 0x7f7f1806d110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7f28036000 tx=0x7f7f2802e000 comp rx=0 tx=0).stop 2023-08-10T10:52:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 msgr2=0x7f7f2c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0d0230 tx=0x7f7f2400d860 comp rx=0 tx=0).stop 2023-08-10T10:52:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 shutdown_connections 2023-08-10T10:52:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f2c15d390 0x7f7f2c15d810 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7f1806ac50 0x7f7f1806d110 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2c0cac50 0x7f7f2c0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 --2- 172.21.15.50:0/788942850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f14003970 0x7f7f2c150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 >> 172.21.15.50:0/788942850 conn(0x7f7f2c0cf640 msgr2=0x7f7f2c0b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:37.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 shutdown_connections 2023-08-10T10:52:37.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.556+0000 7f7f32afa640 1 -- 172.21.15.50:0/788942850 wait complete. 2023-08-10T10:52:37.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:52:37.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.799+0000 7ff12e8d3640 1 Processor -- start 2023-08-10T10:52:37.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.800+0000 7ff12e8d3640 1 -- start start 2023-08-10T10:52:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff12e8d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1280ada70 0x7ff12806f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff12e8d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 0x7ff12806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff12e8d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280ade50 con 0x7ff12806ec90 2023-08-10T10:52:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff12e8d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff128159750 con 0x7ff1280ada70 2023-08-10T10:52:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff12e8d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280ca220 con 0x7ff12806b900 2023-08-10T10:52:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff127fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1280ada70 0x7ff12806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff127fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1280ada70 0x7ff12806f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50056/0 (socket says 172.21.15.50:50056) 2023-08-10T10:52:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.802+0000 7ff127fff640 1 -- 172.21.15.50:0/3720734849 learned_addr learned my addr 172.21.15.50:0/3720734849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff12ce70640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 0x7ff12806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff127fff640 1 -- 172.21.15.50:0/3720734849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 msgr2=0x7ff12806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff127fff640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 0x7ff12806f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff127fff640 1 -- 172.21.15.50:0/3720734849 >> v1:172.21.15.117:6789/0 conn(0x7ff12806ec90 legacy=0x7ff1280c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff127fff640 1 -- 172.21.15.50:0/3720734849 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280ca500 con 0x7ff1280ada70 2023-08-10T10:52:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.803+0000 7ff12ce70640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 0x7ff12806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:37.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.804+0000 7ff127fff640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff12806f490 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d150 tx=0x7ff11802e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be383890c1355d39 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.804+0000 7ff126ffd640 1 -- 172.21.15.50:0/3720734849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11802ea70 con 0x7ff1280ada70 2023-08-10T10:52:37.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.804+0000 7ff126ffd640 1 -- 172.21.15.50:0/3720734849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11802ebd0 con 0x7ff1280ada70 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.804+0000 7ff126ffd640 1 -- 172.21.15.50:0/3720734849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118009600 con 0x7ff1280ada70 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 -- 172.21.15.50:0/3720734849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 msgr2=0x7ff12806f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff12806f490 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d150 tx=0x7ff11802e0d0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 -- 172.21.15.50:0/3720734849 shutdown_connections 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806b900 0x7ff12806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/3720734849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff12806f490 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 -- 172.21.15.50:0/3720734849 >> 172.21.15.50:0/3720734849 conn(0x7ff1280b01b0 msgr2=0x7ff1280b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:37.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 -- 172.21.15.50:0/3720734849 shutdown_connections 2023-08-10T10:52:37.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.805+0000 7ff12e8d3640 1 -- 172.21.15.50:0/3720734849 wait complete. 2023-08-10T10:52:37.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.807+0000 7ff12e8d3640 1 Processor -- start 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.807+0000 7ff12e8d3640 1 -- start start 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff12806b900 0x7ff1280b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806ec90 0x7ff1280ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280a8480 con 0x7ff1280ada70 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280ac5e0 con 0x7ff12806b900 2023-08-10T10:52:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12e8d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280ac880 con 0x7ff12806ec90 2023-08-10T10:52:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.808+0000 7ff12ce70640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2023-08-10T10:52:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 -- 172.21.15.50:0/822006709 learned_addr learned my addr 172.21.15.50:0/822006709 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff127fff640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff12806b900 0x7ff1280b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff1277fe640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806ec90 0x7ff1280ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 -- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806ec90 msgr2=0x7ff1280ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806ec90 0x7ff1280ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 -- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff12806b900 msgr2=0x7ff1280b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff12806b900 0x7ff1280b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11800bd40 con 0x7ff1280ada70 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.809+0000 7ff12ce70640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c7c0 tx=0x7ff12000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.810+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120004230 con 0x7ff1280ada70 2023-08-10T10:52:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.810+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120004390 con 0x7ff1280ada70 2023-08-10T10:52:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.810+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120007860 con 0x7ff1280ada70 2023-08-10T10:52:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.810+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1280acb60 con 0x7ff1280ada70 2023-08-10T10:52:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.810+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1280a86d0 con 0x7ff1280ada70 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.811+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1280612b0 con 0x7ff1280ada70 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.812+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1200079c0 con 0x7ff1280ada70 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.813+0000 7ff124ff9640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 0x7ff11406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.813+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff120089730 con 0x7ff1280ada70 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.813+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7ff114072da0 con 0x7ff1280ada70 2023-08-10T10:52:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.813+0000 7ff127fff640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 0x7ff11406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:37.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.814+0000 7ff127fff640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 0x7ff11406d110 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff118037000 tx=0x7ff118032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:37.817+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff120054940 con 0x7ff1280ada70 2023-08-10T10:52:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.016+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1280ad4d0 con 0x7ff1280ada70 2023-08-10T10:52:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.016+0000 7ff124ff9640 1 -- 172.21.15.50:0/822006709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v192) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1200150a0 con 0x7ff1280ada70 2023-08-10T10:52:38.018 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:52:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 msgr2=0x7ff11406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 0x7ff11406d110 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff118037000 tx=0x7ff118032000 comp rx=0 tx=0).stop 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 msgr2=0x7ff128157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c7c0 tx=0x7ff12000cc80 comp rx=0 tx=0).stop 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 shutdown_connections 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1280ada70 0x7ff128157f80 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff12806ec90 0x7ff1280ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff11406ac50 0x7ff11406d110 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 --2- 172.21.15.50:0/822006709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff12806b900 0x7ff1280b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 >> 172.21.15.50:0/822006709 conn(0x7ff1280b01b0 msgr2=0x7ff128158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 shutdown_connections 2023-08-10T10:52:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.019+0000 7ff12e8d3640 1 -- 172.21.15.50:0/822006709 wait complete. 2023-08-10T10:52:38.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:52:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.254+0000 7fd88b59e640 1 Processor -- start 2023-08-10T10:52:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.254+0000 7fd88b59e640 1 -- start start 2023-08-10T10:52:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.255+0000 7fd88b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c15cc30 0x7fd88c0d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd88b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd88c0d08e0 0x7fd88c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd88b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c0d2630 con 0x7fd88c0cfc40 2023-08-10T10:52:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd88b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0d00d0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd88b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0b8010 con 0x7fd88c15cc30 2023-08-10T10:52:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd88c0d08e0 0x7fd88c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd88c0d08e0 0x7fd88c0cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50068/0 (socket says 172.21.15.50:50068) 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 -- 172.21.15.50:0/3925627139 learned_addr learned my addr 172.21.15.50:0/3925627139 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd88a59c640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c15cc30 0x7fd88c0d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 -- 172.21.15.50:0/3925627139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c15cc30 msgr2=0x7fd88c0d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c15cc30 0x7fd88c0d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.256+0000 7fd883fff640 1 -- 172.21.15.50:0/3925627139 >> v1:172.21.15.50:6789/0 conn(0x7fd88c0cfc40 legacy=0x7fd88c0d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.257+0000 7fd889d9b640 1 -- 172.21.15.50:0/3925627139 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104368415 0 0) 0x7fd88c0d2630 con 0x7fd88c0cfc40 2023-08-10T10:52:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.257+0000 7fd883fff640 1 -- 172.21.15.50:0/3925627139 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c0d0ea0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd883fff640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c0cf700 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd874009870 tx=0x7fd87402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df54fc5b8bb77c2b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd889d9b640 1 -- 172.21.15.50:0/3925627139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874030840 con 0x7fd88c0d08e0 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd889d9b640 1 -- 172.21.15.50:0/3925627139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8740309a0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd889d9b640 1 -- 172.21.15.50:0/3925627139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874030d30 con 0x7fd88c0d08e0 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd88b59e640 1 -- 172.21.15.50:0/3925627139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 msgr2=0x7fd88c0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.258+0000 7fd88b59e640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c0cf700 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd874009870 tx=0x7fd87402b980 comp rx=0 tx=0).stop 2023-08-10T10:52:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 -- 172.21.15.50:0/3925627139 shutdown_connections 2023-08-10T10:52:38.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c0cf700 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 --2- 172.21.15.50:0/3925627139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c15cc30 0x7fd88c0d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 -- 172.21.15.50:0/3925627139 >> 172.21.15.50:0/3925627139 conn(0x7fd88c069880 msgr2=0x7fd88c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:38.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 -- 172.21.15.50:0/3925627139 shutdown_connections 2023-08-10T10:52:38.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.259+0000 7fd88b59e640 1 -- 172.21.15.50:0/3925627139 wait complete. 2023-08-10T10:52:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.261+0000 7fd88b59e640 1 Processor -- start 2023-08-10T10:52:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.261+0000 7fd88b59e640 1 -- start start 2023-08-10T10:52:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 0x7fd88c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd88c15cc30 0x7fd88c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0a9300 con 0x7fd88c0d08e0 2023-08-10T10:52:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c151aa0 con 0x7fd88c15cc30 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c152490 con 0x7fd88c0cfc40 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50074/0 (socket says 172.21.15.50:50074) 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 -- 172.21.15.50:0/245667023 learned_addr learned my addr 172.21.15.50:0/245667023 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd88a59c640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 0x7fd88c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 -- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 msgr2=0x7fd88c0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 0x7fd88c0caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 -- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd88c15cc30 msgr2=0x7fd88c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd88c15cc30 0x7fd88c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.262+0000 7fd883fff640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740094d0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd88a59c640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 0x7fd88c0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd883fff640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fd8740090b0 tx=0x7fd8740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87403e070 con 0x7fd88c0d08e0 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874004030 con 0x7fd88c0d08e0 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c0cb030 con 0x7fd88c0d08e0 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740043e0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.263+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c0cb5f0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.264+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c0a9440 con 0x7fd88c0d08e0 2023-08-10T10:52:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.266+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd874042070 con 0x7fd88c0d08e0 2023-08-10T10:52:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.267+0000 7fd882ffd640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 0x7fd86c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.267+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8740ab510 con 0x7fd88c0d08e0 2023-08-10T10:52:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.267+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fd86c072da0 con 0x7fd88c0d08e0 2023-08-10T10:52:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.267+0000 7fd88a59c640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 0x7fd86c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.268+0000 7fd88a59c640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 0x7fd86c06d110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd87c008890 tx=0x7fd87c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:38.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.271+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd88c0a9440 con 0x7fd88c0d08e0 2023-08-10T10:52:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.480+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd88c0a9440 con 0x7fd88c0d08e0 2023-08-10T10:52:38.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.481+0000 7fd882ffd640 1 -- 172.21.15.50:0/245667023 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v192) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd88c0a9440 con 0x7fd88c0d08e0 2023-08-10T10:52:38.482 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-08-10T10:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.483+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 msgr2=0x7fd86c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.483+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 0x7fd86c06d110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd87c008890 tx=0x7fd87c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.483+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 msgr2=0x7fd88c1f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.483+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fd8740090b0 tx=0x7fd8740046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 shutdown_connections 2023-08-10T10:52:38.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd86c06ac50 0x7fd86c06d110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd88c15cc30 0x7fd88c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd88c0d08e0 0x7fd88c1f1d50 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 --2- 172.21.15.50:0/245667023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88c0cfc40 0x7fd88c0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 >> 172.21.15.50:0/245667023 conn(0x7fd88c069880 msgr2=0x7fd88c15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 shutdown_connections 2023-08-10T10:52:38.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:38.484+0000 7fd88b59e640 1 -- 172.21.15.50:0/245667023 wait complete. 2023-08-10T10:52:38.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:52:38.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:38.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:52:38.637 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:52:38.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:38.638 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:52:38.687 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:38.687 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:38.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:52:38.755 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:38.756 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:38.813 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:52:38.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:39.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.052+0000 7f9ad7b98640 1 Processor -- start 2023-08-10T10:52:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.052+0000 7f9ad7b98640 1 -- start start 2023-08-10T10:52:39.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.053+0000 7f9ad7b98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ad015cd60 0x7f9ad0160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.053+0000 7f9ad7b98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9ad00d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.053+0000 7f9ad7b98640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad0161180 con 0x7f9ad00b8430 2023-08-10T10:52:39.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.053+0000 7f9ad7b98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad00b5bd0 con 0x7f9ad015cd60 2023-08-10T10:52:39.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.053+0000 7f9ad7b98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad0161460 con 0x7f9ad00cdf80 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad5133640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ad00b8430 0x7f9ad00cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35388/0 (socket says 172.21.15.50:35388) 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad5133640 1 -- 172.21.15.50:0/312452651 learned_addr learned my addr 172.21.15.50:0/312452651 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad5934640 1 --2- 172.21.15.50:0/312452651 >> v2:172.21.15.117:3300/0 conn(0x7f9ad015cd60 0x7f9ad0160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad6135640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9ad00d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281316309 0 0) 0x7f9ad0161180 con 0x7f9ad00b8430 2023-08-10T10:52:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.054+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9abc003520 con 0x7f9ad00b8430 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119173591 0 0) 0x7f9abc003520 con 0x7f9ad00b8430 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 msgr2=0x7f9ad00d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9ad00d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 >> v2:172.21.15.117:3300/0 conn(0x7f9ad015cd60 msgr2=0x7f9ad0160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 --2- 172.21.15.50:0/312452651 >> v2:172.21.15.117:3300/0 conn(0x7f9ad015cd60 0x7f9ad0160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0161740 con 0x7f9ad00b8430 2023-08-10T10:52:39.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f9ac0001670 con 0x7f9ad00b8430 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 >> v1:172.21.15.50:6789/0 conn(0x7f9ad00b8430 legacy=0x7f9ad00cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9abc003970 0x7f9abc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc0047c0 0x7f9abc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9abc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b5bd0 con 0x7f9abc0047c0 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad0161460 con 0x7f9abc003970 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00b9b0 con 0x7f9ad00cdf80 2023-08-10T10:52:39.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.055+0000 7f9ad5133640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc0047c0 0x7f9abc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5934640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9abc003970 0x7f9abc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad6135640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9abc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5133640 1 -- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 msgr2=0x7f9abc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5133640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ad00cdf80 0x7f9abc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5133640 1 -- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9abc003970 msgr2=0x7f9abc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5133640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9abc003970 0x7f9abc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.056+0000 7f9ad5133640 1 -- 172.21.15.50:0/312452651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc003520 con 0x7f9abc0047c0 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.057+0000 7f9ad5133640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc0047c0 0x7f9abc004c40 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c240 tx=0x7f9abc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b528d32041db3b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.057+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac002cb00 con 0x7f9abc0047c0 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.057+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac002cc60 con 0x7f9abc0047c0 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.057+0000 7f9ad4932640 1 -- 172.21.15.50:0/312452651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00058d0 con 0x7f9abc0047c0 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 -- 172.21.15.50:0/312452651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc0047c0 msgr2=0x7f9abc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/312452651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9abc0047c0 0x7f9abc004c40 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c240 tx=0x7f9abc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad6135640 1 -- 172.21.15.50:0/312452651 reap_dead start 2023-08-10T10:52:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 -- 172.21.15.50:0/312452651 shutdown_connections 2023-08-10T10:52:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 -- 172.21.15.50:0/312452651 >> 172.21.15.50:0/312452651 conn(0x7f9ad00d2ac0 msgr2=0x7f9ad00d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 -- 172.21.15.50:0/312452651 shutdown_connections 2023-08-10T10:52:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.058+0000 7f9ad7b98640 1 -- 172.21.15.50:0/312452651 wait complete. 2023-08-10T10:52:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.060+0000 7f9ad7b98640 1 Processor -- start 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.060+0000 7f9ad7b98640 1 -- start start 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9abc0047c0 0x7f9ad0155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 0x7f9ad01f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad015e210 con 0x7f9ad015e630 2023-08-10T10:52:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad015d590 con 0x7f9ad015eab0 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.061+0000 7f9ad7b98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad015d870 con 0x7f9abc0047c0 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50088/0 (socket says 172.21.15.50:50088) 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 -- 172.21.15.50:0/968671386 learned_addr learned my addr 172.21.15.50:0/968671386 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5934640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9abc0047c0 0x7f9ad0155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad6135640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 0x7f9ad01f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 -- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9abc0047c0 msgr2=0x7f9ad0155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9abc0047c0 0x7f9ad0155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 -- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 msgr2=0x7f9ad01f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 0x7f9ad01f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad5133640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad015db50 con 0x7f9ad015e630 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.062+0000 7f9ad6135640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 0x7f9ad01f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ad5133640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c240 tx=0x7f9ac0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0039030 con 0x7f9ad015e630 2023-08-10T10:52:39.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac0004bf0 con 0x7f9ad015e630 2023-08-10T10:52:39.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad015de30 con 0x7f9ad015e630 2023-08-10T10:52:39.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac003c040 con 0x7f9ad015e630 2023-08-10T10:52:39.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.063+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad015d320 con 0x7f9ad015e630 2023-08-10T10:52:39.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.064+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad004e270 con 0x7f9ad015e630 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.065+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ac0032070 con 0x7f9ad015e630 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.066+0000 7f9ac67fc640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 0x7f9ab406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.066+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ac00aa8c0 con 0x7f9ad015e630 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.066+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f9ab4072dd0 con 0x7f9ad015e630 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.066+0000 7f9ad5934640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 0x7f9ab406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.067+0000 7f9ad5934640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 0x7f9ab406d140 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009a10 tx=0x7f9acc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.071+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9ac0075960 con 0x7f9ad015e630 2023-08-10T10:52:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.305+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ad00d3940 con 0x7f9ad015e630 2023-08-10T10:52:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.306+0000 7f9ac67fc640 1 -- 172.21.15.50:0/968671386 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f9ac0078f80 con 0x7f9ad015e630 2023-08-10T10:52:39.307 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:39.308 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:39.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.308+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 msgr2=0x7f9ab406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 0x7f9ab406d140 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009a10 tx=0x7f9acc008040 comp rx=0 tx=0).stop 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 msgr2=0x7f9ad01f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c240 tx=0x7f9ac0001a00 comp rx=0 tx=0).stop 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 shutdown_connections 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f9ab406ac80 0x7f9ab406d140 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ad015eab0 0x7f9ad01f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad015e630 0x7f9ad01f5a20 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 --2- 172.21.15.50:0/968671386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9abc0047c0 0x7f9ad0155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 >> 172.21.15.50:0/968671386 conn(0x7f9ad00d2ac0 msgr2=0x7f9ad00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:39.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 shutdown_connections 2023-08-10T10:52:39.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.309+0000 7f9ad7b98640 1 -- 172.21.15.50:0/968671386 wait complete. 2023-08-10T10:52:39.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.548+0000 7ff6a9f22640 1 Processor -- start 2023-08-10T10:52:39.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.548+0000 7ff6a9f22640 1 -- start start 2023-08-10T10:52:39.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.549+0000 7ff6a9f22640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6a4153850 0x7ff6a40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.549+0000 7ff6a9f22640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a415d010 con 0x7ff6a4153c30 2023-08-10T10:52:39.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.549+0000 7ff6a9f22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a415d290 con 0x7ff6a40cfd40 2023-08-10T10:52:39.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.549+0000 7ff6a9f22640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a415d570 con 0x7ff6a4153850 2023-08-10T10:52:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff6a8f20640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6a4153850 0x7ff6a40b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff69bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6a4153c30 0x7ff6a40cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35394/0 (socket says 172.21.15.50:35394) 2023-08-10T10:52:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff69bfff640 1 -- 172.21.15.50:0/280020712 learned_addr learned my addr 172.21.15.50:0/280020712 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff69b7fe640 1 -- 172.21.15.50:0/280020712 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240070898 0 0) 0x7ff6a415d010 con 0x7ff6a4153c30 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff69b7fe640 1 -- 172.21.15.50:0/280020712 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff68c003520 con 0x7ff6a4153c30 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff6a8f20640 1 -- 172.21.15.50:0/280020712 >> v1:172.21.15.117:6789/0 conn(0x7ff6a40cfd40 legacy=0x7ff6a40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff6a8f20640 1 -- 172.21.15.50:0/280020712 >> v1:172.21.15.50:6789/0 conn(0x7ff6a4153c30 legacy=0x7ff6a40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.550+0000 7ff6a8f20640 1 -- 172.21.15.50:0/280020712 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a415d850 con 0x7ff6a4153850 2023-08-10T10:52:39.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.551+0000 7ff6a8f20640 1 --2- 172.21.15.50:0/280020712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a40b1690 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00097a0 tx=0x7ff6a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6d1ac7564147c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff69b7fe640 1 -- 172.21.15.50:0/280020712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0031830 con 0x7ff6a4153850 2023-08-10T10:52:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff69b7fe640 1 -- 172.21.15.50:0/280020712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0031990 con 0x7ff6a4153850 2023-08-10T10:52:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff69b7fe640 1 -- 172.21.15.50:0/280020712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0031d20 con 0x7ff6a4153850 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 -- 172.21.15.50:0/280020712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 msgr2=0x7ff6a40b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/280020712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a40b1690 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00097a0 tx=0x7ff6a002b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 -- 172.21.15.50:0/280020712 shutdown_connections 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/280020712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a40b1690 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 -- 172.21.15.50:0/280020712 >> 172.21.15.50:0/280020712 conn(0x7ff6a4069880 msgr2=0x7ff6a4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 -- 172.21.15.50:0/280020712 shutdown_connections 2023-08-10T10:52:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.552+0000 7ff6a9f22640 1 -- 172.21.15.50:0/280020712 wait complete. 2023-08-10T10:52:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.554+0000 7ff6a9f22640 1 Processor -- start 2023-08-10T10:52:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.554+0000 7ff6a9f22640 1 -- start start 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a40cfd40 0x7ff6a4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a4153c30 0x7ff6a4156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a414c840 con 0x7ff6a4153850 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4154e50 con 0x7ff6a40cfd40 2023-08-10T10:52:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.555+0000 7ff6a9f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4155130 con 0x7ff6a4153c30 2023-08-10T10:52:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50100/0 (socket says 172.21.15.50:50100) 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 -- 172.21.15.50:0/4247642723 learned_addr learned my addr 172.21.15.50:0/4247642723 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff6a8f20640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a40cfd40 0x7ff6a4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff6a9721640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a4153c30 0x7ff6a4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 -- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a4153c30 msgr2=0x7ff6a4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a4153c30 0x7ff6a4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 -- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a40cfd40 msgr2=0x7ff6a4155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a40cfd40 0x7ff6a4155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.556+0000 7ff69bfff640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0009400 con 0x7ff6a4153850 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff69bfff640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c400 tx=0x7ff69400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694005ce0 con 0x7ff6a4153850 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694005e40 con 0x7ff6a4153850 2023-08-10T10:52:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940072d0 con 0x7ff6a4153850 2023-08-10T10:52:39.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4155410 con 0x7ff6a4153850 2023-08-10T10:52:39.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.557+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41559d0 con 0x7ff6a4153850 2023-08-10T10:52:39.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.558+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a40ce7d0 con 0x7ff6a4153850 2023-08-10T10:52:39.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.559+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6940074f0 con 0x7ff6a4153850 2023-08-10T10:52:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.560+0000 7ff6997fa640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 0x7ff69006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.560+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff694088990 con 0x7ff6a4153850 2023-08-10T10:52:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.560+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7ff690072da0 con 0x7ff6a4153850 2023-08-10T10:52:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.560+0000 7ff6a8f20640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 0x7ff69006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.561+0000 7ff6a8f20640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 0x7ff69006d110 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0036000 tx=0x7ff6a003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:39.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.564+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff694053ae0 con 0x7ff6a4153850 2023-08-10T10:52:39.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.765+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a4066e30 con 0x7ff6a4153850 2023-08-10T10:52:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.766+0000 7ff6997fa640 1 -- 172.21.15.50:0/4247642723 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18309 (secure 0 0 0) 0x7ff694017030 con 0x7ff6a4153850 2023-08-10T10:52:39.768 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:39.769 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":192,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:36.701939+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 msgr2=0x7ff69006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 0x7ff69006d110 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0036000 tx=0x7ff6a003c040 comp rx=0 tx=0).stop 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 msgr2=0x7ff6a414c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c400 tx=0x7ff69400c8c0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 shutdown_connections 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a4153c30 0x7ff6a4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4153850 0x7ff6a414c300 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ff69006ac50 0x7ff69006d110 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 --2- 172.21.15.50:0/4247642723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a40cfd40 0x7ff6a4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 >> 172.21.15.50:0/4247642723 conn(0x7ff6a4069880 msgr2=0x7ff6a4152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 shutdown_connections 2023-08-10T10:52:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:39.769+0000 7ff6a9f22640 1 -- 172.21.15.50:0/4247642723 wait complete. 2023-08-10T10:52:39.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:38:08.392868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:38:14.051975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:51:49.463467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:51:50.099047+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:52:39.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:52:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.022+0000 7fb5289cf640 1 Processor -- start 2023-08-10T10:52:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.022+0000 7fb5289cf640 1 -- start start 2023-08-10T10:52:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.023+0000 7fb5289cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52415cb90 0x7fb5240b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb5289cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb524160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb5289cf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb524160a40 con 0x7fb5240b4640 2023-08-10T10:52:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb5289cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240b4bb0 con 0x7fb52415cb90 2023-08-10T10:52:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb5289cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240b4e90 con 0x7fb52415cf70 2023-08-10T10:52:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52415cb90 0x7fb5240b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52415cb90 0x7fb5240b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50106/0 (socket says 172.21.15.50:50106) 2023-08-10T10:52:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 -- 172.21.15.50:0/1425796443 learned_addr learned my addr 172.21.15.50:0/1425796443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb524160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 -- 172.21.15.50:0/1425796443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 msgr2=0x7fb524160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb524160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 -- 172.21.15.50:0/1425796443 >> v1:172.21.15.117:6789/0 conn(0x7fb5240b4640 legacy=0x7fb52406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb52259c640 1 -- 172.21.15.50:0/1425796443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240b5170 con 0x7fb52415cb90 2023-08-10T10:52:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.024+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb524160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.025+0000 7fb52259c640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52415cb90 0x7fb5240b5dd0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb514009e50 tx=0x7fb51402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88634f92be6f4f4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.026+0000 7fb52159a640 1 -- 172.21.15.50:0/1425796443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51402ca80 con 0x7fb52415cb90 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.026+0000 7fb52159a640 1 -- 172.21.15.50:0/1425796443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51402cbe0 con 0x7fb52415cb90 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.026+0000 7fb52159a640 1 -- 172.21.15.50:0/1425796443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140343f0 con 0x7fb52415cb90 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 -- 172.21.15.50:0/1425796443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52415cb90 msgr2=0x7fb5240b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52415cb90 0x7fb5240b5dd0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb514009e50 tx=0x7fb51402bee0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 -- 172.21.15.50:0/1425796443 shutdown_connections 2023-08-10T10:52:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb524160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1425796443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52415cb90 0x7fb5240b5dd0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 -- 172.21.15.50:0/1425796443 >> 172.21.15.50:0/1425796443 conn(0x7fb5240cf640 msgr2=0x7fb5240cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 -- 172.21.15.50:0/1425796443 shutdown_connections 2023-08-10T10:52:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.027+0000 7fb5289cf640 1 -- 172.21.15.50:0/1425796443 wait complete. 2023-08-10T10:52:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.029+0000 7fb5289cf640 1 Processor -- start 2023-08-10T10:52:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.029+0000 7fb5289cf640 1 -- start start 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 0x7fb52415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb5240c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240c80d0 con 0x7fb5240b4640 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240c7550 con 0x7fb52415cb90 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb5289cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240c7830 con 0x7fb52415cf70 2023-08-10T10:52:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb52259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb52259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50122/0 (socket says 172.21.15.50:50122) 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb52259c640 1 -- 172.21.15.50:0/1926506361 learned_addr learned my addr 172.21.15.50:0/1926506361 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 0x7fb52415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb52259c640 1 -- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 msgr2=0x7fb5240c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb522d9d640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb5240c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.030+0000 7fb52259c640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb5240c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb52259c640 1 -- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 msgr2=0x7fb52415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb52259c640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 0x7fb52415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb52259c640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009b30 con 0x7fb5240b4640 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 0x7fb52415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb522d9d640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb5240c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb52259c640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fb514009e50 tx=0x7fb514004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51403e450 con 0x7fb5240b4640 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51403e5f0 con 0x7fb5240b4640 2023-08-10T10:52:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51403e9a0 con 0x7fb5240b4640 2023-08-10T10:52:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5240c7b10 con 0x7fb5240b4640 2023-08-10T10:52:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.031+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb524155200 con 0x7fb5240b4640 2023-08-10T10:52:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.033+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5240612b0 con 0x7fb5240b4640 2023-08-10T10:52:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.034+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb51402cd50 con 0x7fb5240b4640 2023-08-10T10:52:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.035+0000 7fb51affd640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 0x7fb50406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.035+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5140ac1d0 con 0x7fb5240b4640 2023-08-10T10:52:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.035+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 0x7fb50406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.035+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fb504072da0 con 0x7fb5240b4640 2023-08-10T10:52:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.036+0000 7fb521d9b640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 0x7fb50406d110 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb50c006fd0 tx=0x7fb50c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.039+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb5140771e0 con 0x7fb5240b4640 2023-08-10T10:52:40.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.228+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5240c9570 con 0x7fb5240b4640 2023-08-10T10:52:40.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.229+0000 7fb51affd640 1 -- 172.21.15.50:0/1926506361 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb51407a800 con 0x7fb5240b4640 2023-08-10T10:52:40.231 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-08-10T10:52:40.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 msgr2=0x7fb50406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 0x7fb50406d110 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb50c006fd0 tx=0x7fb50c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 msgr2=0x7fb524154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fb514009e50 tx=0x7fb514004a40 comp rx=0 tx=0).stop 2023-08-10T10:52:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 shutdown_connections 2023-08-10T10:52:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52415cf70 0x7fb5240c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb50406ac50 0x7fb50406d110 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52415cb90 0x7fb52415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 --2- 172.21.15.50:0/1926506361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5240b4640 0x7fb524154cc0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 >> 172.21.15.50:0/1926506361 conn(0x7fb5240cf640 msgr2=0x7fb5240cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:40.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 shutdown_connections 2023-08-10T10:52:40.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.232+0000 7fb5289cf640 1 -- 172.21.15.50:0/1926506361 wait complete. 2023-08-10T10:52:40.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:52:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.485+0000 7f272f636640 1 Processor -- start 2023-08-10T10:52:40.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.485+0000 7f272f636640 1 -- start start 2023-08-10T10:52:40.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272f636640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27280af9b0 0x7f27280cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272f636640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280cca70 con 0x7f2728070d00 2023-08-10T10:52:40.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272f636640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280cf8a0 con 0x7f27280718a0 2023-08-10T10:52:40.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272f636640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280cfb80 con 0x7f27280af9b0 2023-08-10T10:52:40.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272d3d2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2728070d00 0x7f27280710e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35406/0 (socket says 172.21.15.50:35406) 2023-08-10T10:52:40.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272d3d2640 1 -- 172.21.15.50:0/2173368794 learned_addr learned my addr 172.21.15.50:0/2173368794 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:40.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.487+0000 7f272dbd3640 1 --2- 172.21.15.50:0/2173368794 >> v2:172.21.15.50:3300/0 conn(0x7f27280af9b0 0x7f27280cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.488+0000 7f272dbd3640 1 -- 172.21.15.50:0/2173368794 >> v1:172.21.15.117:6789/0 conn(0x7f27280718a0 legacy=0x7f27280ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.488+0000 7f272dbd3640 1 -- 172.21.15.50:0/2173368794 >> v1:172.21.15.50:6789/0 conn(0x7f2728070d00 legacy=0x7f27280710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.488+0000 7f272dbd3640 1 -- 172.21.15.50:0/2173368794 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280b3280 con 0x7f27280af9b0 2023-08-10T10:52:40.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.488+0000 7f271ffff640 1 -- 172.21.15.50:0/2173368794 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623321462 0 0) 0x7f27280cca70 con 0x7f2728070d00 2023-08-10T10:52:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.489+0000 7f272dbd3640 1 --2- 172.21.15.50:0/2173368794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280af9b0 0x7f27280cd610 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7187f20565e8ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.489+0000 7f271ffff640 1 -- 172.21.15.50:0/2173368794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272002cc60 con 0x7f27280af9b0 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.489+0000 7f271ffff640 1 -- 172.21.15.50:0/2173368794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272002cdc0 con 0x7f27280af9b0 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.489+0000 7f271ffff640 1 -- 172.21.15.50:0/2173368794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720034660 con 0x7f27280af9b0 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 -- 172.21.15.50:0/2173368794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280af9b0 msgr2=0x7f27280cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 --2- 172.21.15.50:0/2173368794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280af9b0 0x7f27280cd610 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002beb0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 -- 172.21.15.50:0/2173368794 shutdown_connections 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 --2- 172.21.15.50:0/2173368794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280af9b0 0x7f27280cd610 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 -- 172.21.15.50:0/2173368794 >> 172.21.15.50:0/2173368794 conn(0x7f27280b23e0 msgr2=0x7f27280b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 -- 172.21.15.50:0/2173368794 shutdown_connections 2023-08-10T10:52:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.490+0000 7f272f636640 1 -- 172.21.15.50:0/2173368794 wait complete. 2023-08-10T10:52:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.492+0000 7f272f636640 1 Processor -- start 2023-08-10T10:52:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.493+0000 7f272f636640 1 -- start start 2023-08-10T10:52:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2728070d00 0x7f27281564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27280af9b0 0x7f27280aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272806ae60 con 0x7f27280718a0 2023-08-10T10:52:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272806a250 con 0x7f27280af9b0 2023-08-10T10:52:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272f636640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272806a530 con 0x7f2728070d00 2023-08-10T10:52:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272cbd1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272cbd1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50142/0 (socket says 172.21.15.50:50142) 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.494+0000 7f272cbd1640 1 -- 172.21.15.50:0/2803258300 learned_addr learned my addr 172.21.15.50:0/2803258300 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272d3d2640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2728070d00 0x7f27281564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272dbd3640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27280af9b0 0x7f27280aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 -- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2728070d00 msgr2=0x7f27281564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2728070d00 0x7f27281564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 -- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27280af9b0 msgr2=0x7f27280aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27280af9b0 0x7f27280aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009a70 con 0x7f27280718a0 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.495+0000 7f272cbd1640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f271800c450 tx=0x7f271800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.496+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180052d0 con 0x7f27280718a0 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.496+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718005430 con 0x7f27280718a0 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.496+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718012870 con 0x7f27280718a0 2023-08-10T10:52:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.496+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272806a810 con 0x7f27280718a0 2023-08-10T10:52:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.496+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728156a00 con 0x7f27280718a0 2023-08-10T10:52:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.497+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27280612b0 con 0x7f27280718a0 2023-08-10T10:52:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.498+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27180129d0 con 0x7f27280718a0 2023-08-10T10:52:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.499+0000 7f271dffb640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 0x7f270c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.499+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27180890a0 con 0x7f27280718a0 2023-08-10T10:52:40.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.499+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f270c072da0 con 0x7f27280718a0 2023-08-10T10:52:40.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.500+0000 7f272d3d2640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 0x7f270c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.501+0000 7f272d3d2640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 0x7f270c06d110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2724000f60 tx=0x7f2724007d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.504+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27180540b0 con 0x7f27280718a0 2023-08-10T10:52:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.697+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27280b2b40 con 0x7f27280718a0 2023-08-10T10:52:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.698+0000 7f271dffb640 1 -- 172.21.15.50:0/2803258300 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27180576d0 con 0x7f27280718a0 2023-08-10T10:52:40.700 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-08-10T10:52:40.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.700+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 msgr2=0x7f270c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.700+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 0x7f270c06d110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2724000f60 tx=0x7f2724007d00 comp rx=0 tx=0).stop 2023-08-10T10:52:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.700+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 msgr2=0x7f27280ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.700+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f271800c450 tx=0x7f271800c910 comp rx=0 tx=0).stop 2023-08-10T10:52:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 shutdown_connections 2023-08-10T10:52:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f270c06ac50 0x7f270c06d110 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27280af9b0 0x7f27280aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280718a0 0x7f27280ae9d0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 --2- 172.21.15.50:0/2803258300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2728070d00 0x7f27281564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 >> 172.21.15.50:0/2803258300 conn(0x7f27280b23e0 msgr2=0x7f27280b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 shutdown_connections 2023-08-10T10:52:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.701+0000 7f272f636640 1 -- 172.21.15.50:0/2803258300 wait complete. 2023-08-10T10:52:40.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:52:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.956+0000 7fb003fff640 1 Processor -- start 2023-08-10T10:52:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.957+0000 7fb003fff640 1 -- start start 2023-08-10T10:52:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7fb003fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb004069db0 0x7fb0040b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7fb003fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040cdca0 con 0x7fb0040c8b50 2023-08-10T10:52:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7fb003fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040cdf80 con 0x7fb0041599e0 2023-08-10T10:52:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7fb003fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040b2910 con 0x7fb004069db0 2023-08-10T10:52:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7faffa7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0040c8b50 0x7fb0040696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35420/0 (socket says 172.21.15.50:35420) 2023-08-10T10:52:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.958+0000 7faffa7fc640 1 -- 172.21.15.50:0/1308350735 learned_addr learned my addr 172.21.15.50:0/1308350735 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207965784 0 0) 0x7fb0040cdca0 con 0x7fb0040c8b50 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff0003520 con 0x7fb0040c8b50 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2246900906 0 0) 0x7faff0003520 con 0x7fb0040c8b50 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> v2:172.21.15.117:3300/0 conn(0x7fb004069db0 0x7fb0040b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 >> v2:172.21.15.117:3300/0 conn(0x7fb004069db0 msgr2=0x7fb0040b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 --2- 172.21.15.50:0/1308350735 >> v2:172.21.15.117:3300/0 conn(0x7fb004069db0 0x7fb0040b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 >> v1:172.21.15.117:6789/0 conn(0x7fb0041599e0 legacy=0x7fb0040ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040b2bf0 con 0x7fb0040c8b50 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fafec001670 con 0x7fb0040c8b50 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 >> v1:172.21.15.50:6789/0 conn(0x7fb0040c8b50 legacy=0x7fb0040696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faff00039e0 0x7faff0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00047c0 0x7faff0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 0x7faff000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040b2910 con 0x7faff00052d0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff000c210 con 0x7faff00039e0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff000c3d0 con 0x7faff00047c0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.959+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> v2:172.21.15.117:3300/0 conn(0x7fb004069db0 0x7fb0040b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 0x7faff000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb002ffd640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faff00039e0 0x7faff0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7faffa7fc640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00047c0 0x7faff0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 -- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00047c0 msgr2=0x7faff0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00047c0 0x7faff0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 -- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faff00039e0 msgr2=0x7faff0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faff00039e0 0x7faff0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.960+0000 7fb0037fe640 1 -- 172.21.15.50:0/1308350735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0003520 con 0x7faff00052d0 2023-08-10T10:52:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.961+0000 7fb0037fe640 1 -- 172.21.15.50:0/1308350735 reap_dead start 2023-08-10T10:52:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.961+0000 7fb0037fe640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 0x7faff000b980 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7faffc00aa70 tx=0x7faff00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8d31c9d74e8625 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.961+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc02d610 con 0x7faff00052d0 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.961+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc02d7b0 con 0x7faff00052d0 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.961+0000 7fb0027fc640 1 -- 172.21.15.50:0/1308350735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc02db60 con 0x7faff00052d0 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 -- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 msgr2=0x7faff000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 0x7faff000b980 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7faffc00aa70 tx=0x7faff00057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 -- 172.21.15.50:0/1308350735 shutdown_connections 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 --2- 172.21.15.50:0/1308350735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00052d0 0x7faff000b980 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 -- 172.21.15.50:0/1308350735 >> 172.21.15.50:0/1308350735 conn(0x7fb0040caf80 msgr2=0x7fb0040cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 -- 172.21.15.50:0/1308350735 shutdown_connections 2023-08-10T10:52:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.962+0000 7fb003fff640 1 -- 172.21.15.50:0/1308350735 wait complete. 2023-08-10T10:52:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.964+0000 7fb003fff640 1 Processor -- start 2023-08-10T10:52:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.964+0000 7fb003fff640 1 -- start start 2023-08-10T10:52:40.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00052d0 0x7fb004155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0040c55d0 0x7fb004151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040ad250 con 0x7fb0040ac890 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041f5e70 con 0x7fb0040c55d0 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.965+0000 7fb003fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041f6150 con 0x7faff00052d0 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50162/0 (socket says 172.21.15.50:50162) 2023-08-10T10:52:40.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 -- 172.21.15.50:0/4001482815 learned_addr learned my addr 172.21.15.50:0/4001482815 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7faffa7fc640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0040c55d0 0x7fb004151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 -- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00052d0 msgr2=0x7fb004155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00052d0 0x7fb004155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 -- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0040c55d0 msgr2=0x7fb004151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0040c55d0 0x7fb004151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0041f6430 con 0x7fb0040ac890 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.966+0000 7fb0037fe640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7faffc00ab90 tx=0x7faffc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.967+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc037810 con 0x7fb0040ac890 2023-08-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.967+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc037970 con 0x7fb0040ac890 2023-08-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.967+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc037d20 con 0x7fb0040ac890 2023-08-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.967+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0041f6710 con 0x7fb0040ac890 2023-08-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.967+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0041f6d60 con 0x7fb0040ac890 2023-08-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.968+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040cd8d0 con 0x7fb0040ac890 2023-08-10T10:52:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.969+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faffc041020 con 0x7fb0040ac890 2023-08-10T10:52:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.970+0000 7fb000ff9640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 0x7fafe406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.970+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faffc0aac00 con 0x7fb0040ac890 2023-08-10T10:52:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.970+0000 7fb002ffd640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 0x7fafe406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.970+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fafe4072da0 con 0x7fb0040ac890 2023-08-10T10:52:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.971+0000 7fb002ffd640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 0x7fafe406d110 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:40.974+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faffc049060 con 0x7fb0040ac890 2023-08-10T10:52:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.164+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb004066e30 con 0x7fb0040ac890 2023-08-10T10:52:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.164+0000 7fb000ff9640 1 -- 172.21.15.50:0/4001482815 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v192) v1 ==== 104+0+11 (secure 0 0 0) 0x7faffc075dc0 con 0x7fb0040ac890 2023-08-10T10:52:41.166 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 msgr2=0x7fafe406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 0x7fafe406d110 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).stop 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 msgr2=0x7fb0040acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7faffc00ab90 tx=0x7faffc004730 comp rx=0 tx=0).stop 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 shutdown_connections 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0040ac890 0x7fb0040acd10 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fafe406ac50 0x7fafe406d110 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0040c55d0 0x7fb004151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 --2- 172.21.15.50:0/4001482815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faff00052d0 0x7fb004155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 >> 172.21.15.50:0/4001482815 conn(0x7fb0040caf80 msgr2=0x7fb0040c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 shutdown_connections 2023-08-10T10:52:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.167+0000 7fb003fff640 1 -- 172.21.15.50:0/4001482815 wait complete. 2023-08-10T10:52:41.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:52:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.412+0000 7fdfd3fff640 1 Processor -- start 2023-08-10T10:52:41.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.412+0000 7fdfd3fff640 1 -- start start 2023-08-10T10:52:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cf310 0x7fdfd40cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfd415ce90 0x7fdfd40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfd40cd920 0x7fdfd40b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40ce100 con 0x7fdfd40cd920 2023-08-10T10:52:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40cfc30 con 0x7fdfd415ce90 2023-08-10T10:52:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40cde20 con 0x7fdfd40cf310 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfd40cd920 0x7fdfd40b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfd40cd920 0x7fdfd40b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50164/0 (socket says 172.21.15.50:50164) 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd37fe640 1 -- 172.21.15.50:0/326321341 learned_addr learned my addr 172.21.15.50:0/326321341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfd2ffd640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cf310 0x7fdfd40cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.414+0000 7fdfcbfff640 1 --2- 172.21.15.50:0/326321341 >> v2:172.21.15.117:3300/0 conn(0x7fdfd415ce90 0x7fdfd40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.415+0000 7fdfd37fe640 1 -- 172.21.15.50:0/326321341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cf310 msgr2=0x7fdfd40cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.415+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cf310 0x7fdfd40cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.415+0000 7fdfd37fe640 1 -- 172.21.15.50:0/326321341 >> v2:172.21.15.117:3300/0 conn(0x7fdfd415ce90 msgr2=0x7fdfd40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.415+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/326321341 >> v2:172.21.15.117:3300/0 conn(0x7fdfd415ce90 0x7fdfd40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.415+0000 7fdfd37fe640 1 -- 172.21.15.50:0/326321341 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40d1950 con 0x7fdfd40cd920 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.416+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd40cd920 0x7fdfd40b48c0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40d3990 tx=0x7fdfcc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f803aa61920c85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.416+0000 7fdfd27fc640 1 -- 172.21.15.50:0/326321341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc02ca80 con 0x7fdfd40cd920 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.416+0000 7fdfd27fc640 1 -- 172.21.15.50:0/326321341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc02cbe0 con 0x7fdfd40cd920 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.416+0000 7fdfd27fc640 1 -- 172.21.15.50:0/326321341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0343f0 con 0x7fdfd40cd920 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 -- 172.21.15.50:0/326321341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd40cd920 msgr2=0x7fdfd40b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd40cd920 0x7fdfd40b48c0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40d3990 tx=0x7fdfcc02bee0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 -- 172.21.15.50:0/326321341 shutdown_connections 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd40cd920 0x7fdfd40b48c0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/326321341 >> v2:172.21.15.117:3300/0 conn(0x7fdfd415ce90 0x7fdfd40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/326321341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cf310 0x7fdfd40cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 -- 172.21.15.50:0/326321341 >> 172.21.15.50:0/326321341 conn(0x7fdfd406fcc0 msgr2=0x7fdfd40700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 -- 172.21.15.50:0/326321341 shutdown_connections 2023-08-10T10:52:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.417+0000 7fdfd3fff640 1 -- 172.21.15.50:0/326321341 wait complete. 2023-08-10T10:52:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.419+0000 7fdfd3fff640 1 Processor -- start 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.419+0000 7fdfd3fff640 1 -- start start 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cd920 0x7fdfd40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 0x7fdfd415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40c9b70 con 0x7fdfd415ce90 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40c9e50 con 0x7fdfd40cf310 2023-08-10T10:52:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40ca130 con 0x7fdfd40cd920 2023-08-10T10:52:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50180/0 (socket says 172.21.15.50:50180) 2023-08-10T10:52:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 -- 172.21.15.50:0/3064342765 learned_addr learned my addr 172.21.15.50:0/3064342765 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfcbfff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 0x7fdfd415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd2ffd640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cd920 0x7fdfd40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 -- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cd920 msgr2=0x7fdfd40cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cd920 0x7fdfd40cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 -- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 msgr2=0x7fdfd415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 0x7fdfd415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.420+0000 7fdfd37fe640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc009b30 con 0x7fdfd415ce90 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfcbfff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 0x7fdfd415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd37fe640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc036040 tx=0x7fdfcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc009510 con 0x7fdfd415ce90 2023-08-10T10:52:41.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc03e450 con 0x7fdfd415ce90 2023-08-10T10:52:41.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc03e800 con 0x7fdfd415ce90 2023-08-10T10:52:41.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40ca410 con 0x7fdfd415ce90 2023-08-10T10:52:41.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.421+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd40b50b0 con 0x7fdfd415ce90 2023-08-10T10:52:41.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.423+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40b5240 con 0x7fdfd415ce90 2023-08-10T10:52:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.424+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfcc02cd50 con 0x7fdfd415ce90 2023-08-10T10:52:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.425+0000 7fdfd0ff9640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 0x7fdfb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.425+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfcc0ac0b0 con 0x7fdfd415ce90 2023-08-10T10:52:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.425+0000 7fdfd2ffd640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 0x7fdfb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.425+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fdfb4072da0 con 0x7fdfd415ce90 2023-08-10T10:52:41.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.426+0000 7fdfd2ffd640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 0x7fdfb406d110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4006fd0 tx=0x7fdfc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.429+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdfcc0770c0 con 0x7fdfd415ce90 2023-08-10T10:52:41.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.620+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfd4066e30 con 0x7fdfd415ce90 2023-08-10T10:52:41.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.621+0000 7fdfd0ff9640 1 -- 172.21.15.50:0/3064342765 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v192) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfcc07d020 con 0x7fdfd415ce90 2023-08-10T10:52:41.623 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 msgr2=0x7fdfb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 0x7fdfb406d110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4006fd0 tx=0x7fdfc4008040 comp rx=0 tx=0).stop 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 msgr2=0x7fdfd415f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc036040 tx=0x7fdfcc004a40 comp rx=0 tx=0).stop 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 shutdown_connections 2023-08-10T10:52:41.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd415ce90 0x7fdfd415f5e0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fdfb406ac50 0x7fdfb406d110 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd40cf310 0x7fdfd415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 --2- 172.21.15.50:0/3064342765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd40cd920 0x7fdfd40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 >> 172.21.15.50:0/3064342765 conn(0x7fdfd406fcc0 msgr2=0x7fdfd40700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 shutdown_connections 2023-08-10T10:52:41.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.624+0000 7fdfd3fff640 1 -- 172.21.15.50:0/3064342765 wait complete. 2023-08-10T10:52:41.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.870+0000 7f4392300640 1 Processor -- start 2023-08-10T10:52:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.870+0000 7f4392300640 1 -- start start 2023-08-10T10:52:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4392300640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15a940 0x7f438c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4392300640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f438c15f2b0 0x7f438c0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4392300640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0b1f10 con 0x7f438c0b12c0 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4392300640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0b21f0 con 0x7f438c15f2b0 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4392300640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15e5c0 con 0x7f438c15a940 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4390afd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f438c15f2b0 0x7f438c0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4390afd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f438c15f2b0 0x7f438c0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50190/0 (socket says 172.21.15.50:50190) 2023-08-10T10:52:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.872+0000 7f4390afd640 1 -- 172.21.15.50:0/561893849 learned_addr learned my addr 172.21.15.50:0/561893849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.873+0000 7f43912fe640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15a940 0x7f438c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.873+0000 7f4390afd640 1 -- 172.21.15.50:0/561893849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15a940 msgr2=0x7f438c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.873+0000 7f4390afd640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15a940 0x7f438c0aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.873+0000 7f4390afd640 1 -- 172.21.15.50:0/561893849 >> v1:172.21.15.117:6789/0 conn(0x7f438c0b12c0 legacy=0x7f438c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.873+0000 7f4390afd640 1 -- 172.21.15.50:0/561893849 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c15e7d0 con 0x7f438c15f2b0 2023-08-10T10:52:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.874+0000 7f4390afd640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c15f2b0 0x7f438c0b0450 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f438c0cbf80 tx=0x7f437c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762e40b7547e5d03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.874+0000 7f4383fff640 1 -- 172.21.15.50:0/561893849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c02e070 con 0x7f438c15f2b0 2023-08-10T10:52:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.874+0000 7f4383fff640 1 -- 172.21.15.50:0/561893849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c0315a0 con 0x7f438c15f2b0 2023-08-10T10:52:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.874+0000 7f4383fff640 1 -- 172.21.15.50:0/561893849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c031930 con 0x7f438c15f2b0 2023-08-10T10:52:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 -- 172.21.15.50:0/561893849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c15f2b0 msgr2=0x7f438c0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c15f2b0 0x7f438c0b0450 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f438c0cbf80 tx=0x7f437c02b840 comp rx=0 tx=0).stop 2023-08-10T10:52:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 -- 172.21.15.50:0/561893849 shutdown_connections 2023-08-10T10:52:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c15f2b0 0x7f438c0b0450 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 --2- 172.21.15.50:0/561893849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15a940 0x7f438c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 -- 172.21.15.50:0/561893849 >> 172.21.15.50:0/561893849 conn(0x7f438c06ab80 msgr2=0x7f438c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 -- 172.21.15.50:0/561893849 shutdown_connections 2023-08-10T10:52:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.875+0000 7f4392300640 1 -- 172.21.15.50:0/561893849 wait complete. 2023-08-10T10:52:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.877+0000 7f4392300640 1 Processor -- start 2023-08-10T10:52:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.877+0000 7f4392300640 1 -- start start 2023-08-10T10:52:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 0x7f438c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 0x7f438c0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15ba70 con 0x7f438c0b12c0 2023-08-10T10:52:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c070080 con 0x7f438c15a940 2023-08-10T10:52:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f4392300640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15b140 con 0x7f438c15f2b0 2023-08-10T10:52:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f43912fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f43912fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50202/0 (socket says 172.21.15.50:50202) 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.878+0000 7f43912fe640 1 -- 172.21.15.50:0/551901432 learned_addr learned my addr 172.21.15.50:0/551901432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f4390afd640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 0x7f438c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f4391aff640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 0x7f438c0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 -- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 msgr2=0x7f438c0702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 0x7f438c0702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 -- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 msgr2=0x7f438c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 0x7f438c154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c0094d0 con 0x7f438c0b12c0 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f4390afd640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 0x7f438c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f4391aff640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 0x7f438c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f43912fe640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f438800c7f0 tx=0x7f438800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.879+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388004220 con 0x7f438c0b12c0 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.880+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388004380 con 0x7f438c0b12c0 2023-08-10T10:52:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.880+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388007840 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.880+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c15b420 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.880+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c154b70 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.881+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c066e30 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.882+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4388007bb0 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.883+0000 7f4381ffb640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 0x7f437006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.883+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4388089470 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.883+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f4370072da0 con 0x7f438c0b12c0 2023-08-10T10:52:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.883+0000 7f4390afd640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 0x7f437006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.884+0000 7f4390afd640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 0x7f437006d110 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f437c036000 tx=0x7f437c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:41.887+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f438801e060 con 0x7f438c0b12c0 2023-08-10T10:52:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.123+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f438c15e360 con 0x7f438c0b12c0 2023-08-10T10:52:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.125+0000 7f4381ffb640 1 -- 172.21.15.50:0/551901432 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f438801e070 con 0x7f438c0b12c0 2023-08-10T10:52:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:42.127 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 msgr2=0x7f437006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 0x7f437006d110 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f437c036000 tx=0x7f437c03d040 comp rx=0 tx=0).stop 2023-08-10T10:52:42.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 msgr2=0x7f438c0cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f438800c7f0 tx=0x7f438800ccb0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 shutdown_connections 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438c15f2b0 0x7f438c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f437006ac50 0x7f437006d110 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438c15a940 0x7f438c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 --2- 172.21.15.50:0/551901432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0b12c0 0x7f438c0cc040 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.128+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 >> 172.21.15.50:0/551901432 conn(0x7f438c06ab80 msgr2=0x7f438c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.129+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 shutdown_connections 2023-08-10T10:52:42.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.129+0000 7f4392300640 1 -- 172.21.15.50:0/551901432 wait complete. 2023-08-10T10:52:42.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:42.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.379+0000 7f4226244640 1 Processor -- start 2023-08-10T10:52:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.380+0000 7f4226244640 1 -- start start 2023-08-10T10:52:42.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4226244640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42200c9d00 0x7f42200cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4226244640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42200cd290 0x7f42200cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4226244640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200cc5a0 con 0x7f4220159830 2023-08-10T10:52:42.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4226244640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200b4170 con 0x7f42200c9d00 2023-08-10T10:52:42.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4226244640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422015d720 con 0x7f42200cd290 2023-08-10T10:52:42.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4225242640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4220159830 0x7f422015dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35432/0 (socket says 172.21.15.50:35432) 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.381+0000 7f4225242640 1 -- 172.21.15.50:0/2022083885 learned_addr learned my addr 172.21.15.50:0/2022083885 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664211525 0 0) 0x7f42200cc5a0 con 0x7f4220159830 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.117:3300/0 conn(0x7f42200cd290 0x7f42200cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f420c003520 con 0x7f4220159830 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4224a41640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.50:3300/0 conn(0x7f42200c9d00 0x7f42200cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329362329 0 0) 0x7f420c003520 con 0x7f4220159830 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 >> v2:172.21.15.117:3300/0 conn(0x7f42200cd290 msgr2=0x7f42200cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.117:3300/0 conn(0x7f42200cd290 0x7f42200cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 >> v2:172.21.15.50:3300/0 conn(0x7f42200c9d00 msgr2=0x7f42200cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.50:3300/0 conn(0x7f42200c9d00 0x7f42200cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220159c10 con 0x7f4220159830 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f421c0019f0 con 0x7f4220159830 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.117:3300/0 conn(0x7f42200cd290 0x7f42200cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:42.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 >> v1:172.21.15.50:6789/0 conn(0x7f4220159830 legacy=0x7f422015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f420c0039e0 0x7f420c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f420c0047c0 0x7f420c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f420c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422015d720 con 0x7f420c0047c0 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00c150 con 0x7f420c0051f0 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.382+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00c310 con 0x7f420c0039e0 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.383+0000 7f4224a41640 1 --2- 172.21.15.50:0/2022083885 >> v2:172.21.15.50:3300/0 conn(0x7f42200c9d00 0x7f42200cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.383+0000 7f4225242640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f420c0039e0 0x7f420c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.383+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f420c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4224a41640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f420c0047c0 0x7f420c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4225a43640 1 -- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f420c0039e0 msgr2=0x7f420c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f420c0039e0 0x7f420c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4225a43640 1 -- 172.21.15.50:0/2022083885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f420c0047c0 msgr2=0x7f420c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f420c0047c0 0x7f420c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4225a43640 1 -- 172.21.15.50:0/2022083885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c003520 con 0x7f420c0051f0 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.384+0000 7f4224a41640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f420c0047c0 0x7f420c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:42.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.385+0000 7f4225a43640 1 -- 172.21.15.50:0/2022083885 reap_dead start 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.385+0000 7f4225a43640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f420c00b980 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f42180098a0 tx=0x7f420c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9122f710d88b7e55 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.386+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218004220 con 0x7f420c0051f0 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.386+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180043c0 con 0x7f420c0051f0 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.386+0000 7f4217fff640 1 -- 172.21.15.50:0/2022083885 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003850 con 0x7f420c0051f0 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 -- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 msgr2=0x7f420c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f420c00b980 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f42180098a0 tx=0x7f420c0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 -- 172.21.15.50:0/2022083885 shutdown_connections 2023-08-10T10:52:42.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 --2- 172.21.15.50:0/2022083885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f420c00b980 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 -- 172.21.15.50:0/2022083885 >> 172.21.15.50:0/2022083885 conn(0x7f422006ab80 msgr2=0x7f422006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 -- 172.21.15.50:0/2022083885 shutdown_connections 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.387+0000 7f4226244640 1 -- 172.21.15.50:0/2022083885 wait complete. 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.389+0000 7f4226244640 1 Processor -- start 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.389+0000 7f4226244640 1 -- start start 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f4220158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220070260 0x7f422006e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220159200 con 0x7f42200706e0 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422006fdd0 con 0x7f420c0051f0 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4226244640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422006f1c0 con 0x7f4220070260 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4225a43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4225a43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50228/0 (socket says 172.21.15.50:50228) 2023-08-10T10:52:42.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.390+0000 7f4225a43640 1 -- 172.21.15.50:0/2355209062 learned_addr learned my addr 172.21.15.50:0/2355209062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225242640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f4220158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 -- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220070260 msgr2=0x7f422006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220070260 0x7f422006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 -- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 msgr2=0x7f4220158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f4220158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422006f4a0 con 0x7f42200706e0 2023-08-10T10:52:42.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4225a43640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f42180099c0 tx=0x7f4218004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421802f800 con 0x7f42200706e0 2023-08-10T10:52:42.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421802f980 con 0x7f42200706e0 2023-08-10T10:52:42.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421802fd30 con 0x7f42200706e0 2023-08-10T10:52:42.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.391+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422006f780 con 0x7f42200706e0 2023-08-10T10:52:42.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.392+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200c3e60 con 0x7f42200706e0 2023-08-10T10:52:42.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.393+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220066e30 con 0x7f42200706e0 2023-08-10T10:52:42.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.394+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f421804b3b0 con 0x7f42200706e0 2023-08-10T10:52:42.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.395+0000 7f4215ffb640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 0x7f420406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.395+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42180ab320 con 0x7f42200706e0 2023-08-10T10:52:42.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.395+0000 7f4225242640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 0x7f420406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.395+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f4204072da0 con 0x7f42200706e0 2023-08-10T10:52:42.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.396+0000 7f4225242640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 0x7f420406d110 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f421c001870 tx=0x7f421c006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.399+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f42180763c0 con 0x7f42200706e0 2023-08-10T10:52:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.594+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f422006ff10 con 0x7f42200706e0 2023-08-10T10:52:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.598+0000 7f4215ffb640 1 -- 172.21.15.50:0/2355209062 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18309 (secure 0 0 0) 0x7f4218047020 con 0x7f42200706e0 2023-08-10T10:52:42.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:42.600 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":192,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:36.701939+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.600+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 msgr2=0x7f420406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.600+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 0x7f420406d110 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f421c001870 tx=0x7f421c006040 comp rx=0 tx=0).stop 2023-08-10T10:52:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.600+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 msgr2=0x7f42200ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.600+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f42180099c0 tx=0x7f4218004730 comp rx=0 tx=0).stop 2023-08-10T10:52:42.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 shutdown_connections 2023-08-10T10:52:42.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42200706e0 0x7f42200ce880 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4220070260 0x7f422006e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f420406ac50 0x7f420406d110 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 --2- 172.21.15.50:0/2355209062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f420c0051f0 0x7f4220158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 >> 172.21.15.50:0/2355209062 conn(0x7f422006ab80 msgr2=0x7f422006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 shutdown_connections 2023-08-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.601+0000 7f4226244640 1 -- 172.21.15.50:0/2355209062 wait complete. 2023-08-10T10:52:42.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:52:42.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.845+0000 7f0ed5487640 1 Processor -- start 2023-08-10T10:52:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.845+0000 7f0ed5487640 1 -- start start 2023-08-10T10:52:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ed5487640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ed00b3010 0x7f0ed00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ed5487640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed00c9b30 0x7f0ed0069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ed5487640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00719f0 con 0x7f0ed015ccb0 2023-08-10T10:52:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ed5487640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00c8db0 con 0x7f0ed00b3010 2023-08-10T10:52:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ed5487640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00c9050 con 0x7f0ed00c9b30 2023-08-10T10:52:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0eceffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0ed015ccb0 0x7f0ed00b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35442/0 (socket says 172.21.15.50:35442) 2023-08-10T10:52:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0eceffd640 1 -- 172.21.15.50:0/3853327440 learned_addr learned my addr 172.21.15.50:0/3853327440 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.847+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/3853327440 >> v2:172.21.15.50:3300/0 conn(0x7f0ed00b3010 0x7f0ed00696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ecf7fe640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed00c9b30 0x7f0ed0069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ece7fc640 1 -- 172.21.15.50:0/3853327440 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687363345 0 0) 0x7f0ed00719f0 con 0x7f0ed015ccb0 2023-08-10T10:52:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ece7fc640 1 -- 172.21.15.50:0/3853327440 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc003520 con 0x7f0ed015ccb0 2023-08-10T10:52:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ec7fff640 1 -- 172.21.15.50:0/3853327440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed00c9b30 msgr2=0x7f0ed0069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed00c9b30 0x7f0ed0069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ec7fff640 1 -- 172.21.15.50:0/3853327440 >> v1:172.21.15.50:6789/0 conn(0x7f0ed015ccb0 legacy=0x7f0ed00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.848+0000 7f0ec7fff640 1 -- 172.21.15.50:0/3853327440 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00c9330 con 0x7f0ed00b3010 2023-08-10T10:52:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.849+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed00696a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80097a0 tx=0x7f0eb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf988705ef31eb74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ece7fc640 1 -- 172.21.15.50:0/3853327440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8031830 con 0x7f0ed00b3010 2023-08-10T10:52:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ece7fc640 1 -- 172.21.15.50:0/3853327440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8031990 con 0x7f0ed00b3010 2023-08-10T10:52:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ece7fc640 1 -- 172.21.15.50:0/3853327440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8031d00 con 0x7f0ed00b3010 2023-08-10T10:52:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 -- 172.21.15.50:0/3853327440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 msgr2=0x7f0ed00696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed00696a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80097a0 tx=0x7f0eb802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 -- 172.21.15.50:0/3853327440 shutdown_connections 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed00696a0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 --2- 172.21.15.50:0/3853327440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed00c9b30 0x7f0ed0069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.850+0000 7f0ed5487640 1 -- 172.21.15.50:0/3853327440 >> 172.21.15.50:0/3853327440 conn(0x7f0ed006b590 msgr2=0x7f0ed00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.851+0000 7f0ed5487640 1 -- 172.21.15.50:0/3853327440 shutdown_connections 2023-08-10T10:52:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.851+0000 7f0ed5487640 1 -- 172.21.15.50:0/3853327440 wait complete. 2023-08-10T10:52:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.852+0000 7f0ed5487640 1 Processor -- start 2023-08-10T10:52:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.852+0000 7f0ed5487640 1 -- start start 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 0x7f0ed0148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed015ccb0 0x7f0ed01f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0149bc0 con 0x7f0ed00b3010 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed014a590 con 0x7f0ed00c9b30 2023-08-10T10:52:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.853+0000 7f0ed5487640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0148fb0 con 0x7f0ed015ccb0 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50244/0 (socket says 172.21.15.50:50244) 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 -- 172.21.15.50:0/623909793 learned_addr learned my addr 172.21.15.50:0/623909793 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 0x7f0ed0148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0ecf7fe640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed015ccb0 0x7f0ed01f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 -- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed015ccb0 msgr2=0x7f0ed01f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed015ccb0 0x7f0ed01f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 -- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 msgr2=0x7f0ed0148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 0x7f0ed0148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8009400 con 0x7f0ed00b3010 2023-08-10T10:52:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 0x7f0ed0148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.854+0000 7f0eceffd640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c390 tx=0x7f0ec000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.855+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0005ce0 con 0x7f0ed00b3010 2023-08-10T10:52:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.855+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0005e40 con 0x7f0ed00b3010 2023-08-10T10:52:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.855+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00072f0 con 0x7f0ed00b3010 2023-08-10T10:52:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.855+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0149290 con 0x7f0ed00b3010 2023-08-10T10:52:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.855+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0149850 con 0x7f0ed00b3010 2023-08-10T10:52:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.856+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed004e270 con 0x7f0ed00b3010 2023-08-10T10:52:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.857+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ec0007450 con 0x7f0ed00b3010 2023-08-10T10:52:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.858+0000 7f0ec77fe640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 0x7f0eb006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.858+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ec0088b00 con 0x7f0ed00b3010 2023-08-10T10:52:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.858+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f0eb0072da0 con 0x7f0ed00b3010 2023-08-10T10:52:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.858+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 0x7f0eb006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.859+0000 7f0ec7fff640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 0x7f0eb006d110 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8036000 tx=0x7f0eb8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:42.862+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ec0017060 con 0x7f0ed00b3010 2023-08-10T10:52:43.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.092+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed0069f00 con 0x7f0ed00b3010 2023-08-10T10:52:43.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.093+0000 7f0ec77fe640 1 -- 172.21.15.50:0/623909793 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f0ec0053bb0 con 0x7f0ed00b3010 2023-08-10T10:52:43.095 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:43.095 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:43.096 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:43.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 msgr2=0x7f0eb006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 0x7f0eb006d110 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8036000 tx=0x7f0eb8008030 comp rx=0 tx=0).stop 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 msgr2=0x7f0ed014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c390 tx=0x7f0ec000c850 comp rx=0 tx=0).stop 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 shutdown_connections 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ed015ccb0 0x7f0ed01f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0eb006ac50 0x7f0eb006d110 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed00c9b30 0x7f0ed0148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 --2- 172.21.15.50:0/623909793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed00b3010 0x7f0ed014a050 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.096+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 >> 172.21.15.50:0/623909793 conn(0x7f0ed006b590 msgr2=0x7f0ed00cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.097+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 shutdown_connections 2023-08-10T10:52:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.097+0000 7f0ed5487640 1 -- 172.21.15.50:0/623909793 wait complete. 2023-08-10T10:52:43.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:43.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.342+0000 7fcefa9b2640 1 Processor -- start 2023-08-10T10:52:43.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.342+0000 7fcefa9b2640 1 -- start start 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcefa9b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcef40aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcefa9b2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcef40b19d0 0x7fcef40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcefa9b2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40b1f10 con 0x7fcef415f2b0 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcefa9b2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b21f0 con 0x7fcef40b19d0 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcefa9b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415e5c0 con 0x7fcef415a940 2023-08-10T10:52:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcef91af640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcef415f2b0 0x7fcef40b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35454/0 (socket says 172.21.15.50:35454) 2023-08-10T10:52:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.343+0000 7fcef91af640 1 -- 172.21.15.50:0/1810234483 learned_addr learned my addr 172.21.15.50:0/1810234483 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcefa1b1640 1 --2- 172.21.15.50:0/1810234483 >> v2:172.21.15.117:3300/0 conn(0x7fcef40b19d0 0x7fcef40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef99b0640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcef40aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626711696 0 0) 0x7fcef40b1f10 con 0x7fcef415f2b0 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcedc003520 con 0x7fcef415f2b0 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698016867 0 0) 0x7fcedc003520 con 0x7fcef415f2b0 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 msgr2=0x7fcef40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcef40aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 >> v2:172.21.15.117:3300/0 conn(0x7fcef40b19d0 msgr2=0x7fcef40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 --2- 172.21.15.50:0/1810234483 >> v2:172.21.15.117:3300/0 conn(0x7fcef40b19d0 0x7fcef40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef415e7d0 con 0x7fcef415f2b0 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fcee8001690 con 0x7fcef415f2b0 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 >> v1:172.21.15.50:6789/0 conn(0x7fcef415f2b0 legacy=0x7fcef40b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0039e0 0x7fcedc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.344+0000 7fcef89ae640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcedc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef89ae640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc004d00 0x7fcedc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415e5c0 con 0x7fcedc0039e0 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc00b980 con 0x7fcedc004d00 2023-08-10T10:52:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc00bb10 con 0x7fcef415a940 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0039e0 0x7fcedc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef91af640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcedc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 -- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 msgr2=0x7fcedc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef415a940 0x7fcedc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 -- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc004d00 msgr2=0x7fcedc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcefa1b1640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc004d00 0x7fcedc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc004d00 0x7fcedc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.345+0000 7fcef99b0640 1 -- 172.21.15.50:0/1810234483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc003520 con 0x7fcedc0039e0 2023-08-10T10:52:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.346+0000 7fcef99b0640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0039e0 0x7fcedc003e00 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009fc0 tx=0x7fcedc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274f82590cb2f83 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee402cc20 con 0x7fcedc0039e0 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400f040 con 0x7fcedc0039e0 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcef89ae640 1 -- 172.21.15.50:0/1810234483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4034440 con 0x7fcedc0039e0 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 -- 172.21.15.50:0/1810234483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0039e0 msgr2=0x7fcedc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/1810234483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0039e0 0x7fcedc003e00 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009fc0 tx=0x7fcedc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa1b1640 1 -- 172.21.15.50:0/1810234483 reap_dead start 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 -- 172.21.15.50:0/1810234483 shutdown_connections 2023-08-10T10:52:43.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 -- 172.21.15.50:0/1810234483 >> 172.21.15.50:0/1810234483 conn(0x7fcef406ab80 msgr2=0x7fcef406af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 -- 172.21.15.50:0/1810234483 shutdown_connections 2023-08-10T10:52:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.347+0000 7fcefa9b2640 1 -- 172.21.15.50:0/1810234483 wait complete. 2023-08-10T10:52:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.349+0000 7fcefa9b2640 1 Processor -- start 2023-08-10T10:52:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.349+0000 7fcefa9b2640 1 -- start start 2023-08-10T10:52:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0039e0 0x7fcef4157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415d660 0x7fcef40c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415d1d0 con 0x7fcef41580a0 2023-08-10T10:52:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c9f40 con 0x7fcef415d660 2023-08-10T10:52:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.350+0000 7fcefa9b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c9c60 con 0x7fcedc0039e0 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50268/0 (socket says 172.21.15.50:50268) 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 -- 172.21.15.50:0/4193832015 learned_addr learned my addr 172.21.15.50:0/4193832015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcef99b0640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0039e0 0x7fcef4157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcef91af640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415d660 0x7fcef40c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 -- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0039e0 msgr2=0x7fcef4157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0039e0 0x7fcef4157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 -- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415d660 msgr2=0x7fcef40c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415d660 0x7fcef40c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.351+0000 7fcefa1b1640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef415cb80 con 0x7fcef41580a0 2023-08-10T10:52:43.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcefa1b1640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b1080 tx=0x7fceec010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00e8a0 con 0x7fcef41580a0 2023-08-10T10:52:43.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00ea20 con 0x7fcef41580a0 2023-08-10T10:52:43.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00edd0 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef415ce60 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.352+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef40c2a20 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.353+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef415da40 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.354+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fceec0143f0 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.355+0000 7fcef27fc640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 0x7fcee006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.355+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fceec089350 con 0x7fcef41580a0 2023-08-10T10:52:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.355+0000 7fcef99b0640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 0x7fcee006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.355+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fcee0072da0 con 0x7fcef41580a0 2023-08-10T10:52:43.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.356+0000 7fcef99b0640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 0x7fcee006d110 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcee4036000 tx=0x7fcee402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.359+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fceec000e60 con 0x7fcef41580a0 2023-08-10T10:52:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.593+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcef4066e30 con 0x7fcef41580a0 2023-08-10T10:52:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.594+0000 7fcef27fc640 1 -- 172.21.15.50:0/4193832015 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4719 (secure 0 0 0) 0x7fceec000e60 con 0x7fcef41580a0 2023-08-10T10:52:43.596 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:43.596 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:51:51.085628+0000","modified":"2023-08-10T10:51:54.629519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9393":{"gid":9393,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6836/3577041513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3577041513},{"type":"v1","addr":"172.21.15.50:6836","nonce":3577041513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-10T10:52:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 93 2023-08-10T10:52:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.596+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 msgr2=0x7fcee006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 0x7fcee006d110 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcee4036000 tx=0x7fcee402e000 comp rx=0 tx=0).stop 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 msgr2=0x7fcef40c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b1080 tx=0x7fceec010c20 comp rx=0 tx=0).stop 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 shutdown_connections 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcef41580a0 0x7fcef40c24e0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcee006ac50 0x7fcee006d110 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415d660 0x7fcef40c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 --2- 172.21.15.50:0/4193832015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0039e0 0x7fcef4157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 >> 172.21.15.50:0/4193832015 conn(0x7fcef406ab80 msgr2=0x7fcef4159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 shutdown_connections 2023-08-10T10:52:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.597+0000 7fcefa9b2640 1 -- 172.21.15.50:0/4193832015 wait complete. 2023-08-10T10:52:43.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.837+0000 7f93ac0f5640 1 Processor -- start 2023-08-10T10:52:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.837+0000 7f93ac0f5640 1 -- start start 2023-08-10T10:52:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93ac0f5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93a40b0c60 0x7f93a40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93ac0f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93ac0f5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a4071c70 con 0x7f93a415aa40 2023-08-10T10:52:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93ac0f5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40713d0 con 0x7f93a40b0c60 2023-08-10T10:52:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93ac0f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40716b0 con 0x7f93a40b3f30 2023-08-10T10:52:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.839+0000 7f93a9690640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93a40b0c60 0x7f93a40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93a40b0c60 0x7f93a40c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50282/0 (socket says 172.21.15.50:50282) 2023-08-10T10:52:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 -- 172.21.15.50:0/981204510 learned_addr learned my addr 172.21.15.50:0/981204510 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93aa692640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 -- 172.21.15.50:0/981204510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 msgr2=0x7f93a40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 -- 172.21.15.50:0/981204510 >> v1:172.21.15.117:6789/0 conn(0x7f93a415aa40 legacy=0x7f93a40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93a9690640 1 -- 172.21.15.50:0/981204510 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4071990 con 0x7f93a40b0c60 2023-08-10T10:52:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.840+0000 7f93aa692640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.841+0000 7f93a9690640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a40b0c60 0x7f93a40c9920 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f9394009870 tx=0x7f939402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ff11b8cbcd3421 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93a8e8f640 1 -- 172.21.15.50:0/981204510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394031640 con 0x7f93a40b0c60 2023-08-10T10:52:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93a8e8f640 1 -- 172.21.15.50:0/981204510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93940317a0 con 0x7f93a40b0c60 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93a8e8f640 1 -- 172.21.15.50:0/981204510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394031b30 con 0x7f93a40b0c60 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 -- 172.21.15.50:0/981204510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a40b0c60 msgr2=0x7f93a40c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a40b0c60 0x7f93a40c9920 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f9394009870 tx=0x7f939402b8f0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 -- 172.21.15.50:0/981204510 shutdown_connections 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/981204510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a40b0c60 0x7f93a40c9920 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 -- 172.21.15.50:0/981204510 >> 172.21.15.50:0/981204510 conn(0x7f93a406b590 msgr2=0x7f93a40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.842+0000 7f93ac0f5640 1 -- 172.21.15.50:0/981204510 shutdown_connections 2023-08-10T10:52:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.843+0000 7f93ac0f5640 1 -- 172.21.15.50:0/981204510 wait complete. 2023-08-10T10:52:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.844+0000 7f93ac0f5640 1 Processor -- start 2023-08-10T10:52:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.844+0000 7f93ac0f5640 1 -- start start 2023-08-10T10:52:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a40b0c60 0x7f93a40c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4158fc0 con 0x7f93a415aa40 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41592a0 con 0x7f93a40b0c60 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.845+0000 7f93ac0f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4159580 con 0x7f93a40b3f30 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50296/0 (socket says 172.21.15.50:50296) 2023-08-10T10:52:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 -- 172.21.15.50:0/873078930 learned_addr learned my addr 172.21.15.50:0/873078930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93a9e91640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a40b0c60 0x7f93a40c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93a9690640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 -- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 msgr2=0x7f93a40b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 -- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a40b0c60 msgr2=0x7f93a40c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a40b0c60 0x7f93a40c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93aa692640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940094d0 con 0x7f93a415aa40 2023-08-10T10:52:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.846+0000 7f93a9690640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f93aa692640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f939c00cef0 tx=0x7f939c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00d840 con 0x7f93a415aa40 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00d9c0 con 0x7f93a415aa40 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00dd70 con 0x7f93a415aa40 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a40b1b40 con 0x7f93a415aa40 2023-08-10T10:52:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.847+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a40c86b0 con 0x7f93a415aa40 2023-08-10T10:52:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.848+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a404e270 con 0x7f93a415aa40 2023-08-10T10:52:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.849+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f939c01e3b0 con 0x7f93a415aa40 2023-08-10T10:52:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.850+0000 7f939a7fc640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 0x7f938806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.850+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f939c089fe0 con 0x7f93a415aa40 2023-08-10T10:52:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.851+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f9388072da0 con 0x7f93a415aa40 2023-08-10T10:52:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.851+0000 7f93a9e91640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 0x7f938806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.851+0000 7f93a9e91640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 0x7f938806d110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93a0000f60 tx=0x7f93a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:43.855+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f939c01a060 con 0x7f93a415aa40 2023-08-10T10:52:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.048+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93a40cab40 con 0x7f93a415aa40 2023-08-10T10:52:44.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.050+0000 7f939a7fc640 1 -- 172.21.15.50:0/873078930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18309 (secure 0 0 0) 0x7f939c0550f0 con 0x7f93a415aa40 2023-08-10T10:52:44.052 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:44.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":192,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:36.701939+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:51:49.463467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-10T10:51:50.099047+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 msgr2=0x7f938806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 0x7f938806d110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93a0000f60 tx=0x7f93a0009040 comp rx=0 tx=0).stop 2023-08-10T10:52:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 msgr2=0x7f93a40afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f939c00cef0 tx=0x7f939c00a710 comp rx=0 tx=0).stop 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 shutdown_connections 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93a415aa40 0x7f93a40afaf0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a40b3f30 0x7f93a40b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f938806ac50 0x7f938806d110 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 --2- 172.21.15.50:0/873078930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a40b0c60 0x7f93a40c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.053+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 >> 172.21.15.50:0/873078930 conn(0x7f93a406b590 msgr2=0x7f93a4155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.054+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 shutdown_connections 2023-08-10T10:52:44.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.054+0000 7f93ac0f5640 1 -- 172.21.15.50:0/873078930 wait complete. 2023-08-10T10:52:44.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:52:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.302+0000 7feb152c2640 1 Processor -- start 2023-08-10T10:52:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.302+0000 7feb152c2640 1 -- start start 2023-08-10T10:52:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb152c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1015ff90 0x7feb10160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb152c2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb100cd960 0x7feb100d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb152c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb10160370 con 0x7feb100d2370 2023-08-10T10:52:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb152c2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100d0b90 con 0x7feb100cd960 2023-08-10T10:52:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb152c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb101614d0 con 0x7feb1015ff90 2023-08-10T10:52:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb077fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb100cd960 0x7feb100d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb077fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb100cd960 0x7feb100d1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50308/0 (socket says 172.21.15.50:50308) 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb077fe640 1 -- 172.21.15.50:0/2965956812 learned_addr learned my addr 172.21.15.50:0/2965956812 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.304+0000 7feb0ffff640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1015ff90 0x7feb10160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.305+0000 7feb077fe640 1 -- 172.21.15.50:0/2965956812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1015ff90 msgr2=0x7feb10160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.305+0000 7feb077fe640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1015ff90 0x7feb10160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.305+0000 7feb077fe640 1 -- 172.21.15.50:0/2965956812 >> v1:172.21.15.117:6789/0 conn(0x7feb100d2370 legacy=0x7feb100d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.305+0000 7feb077fe640 1 -- 172.21.15.50:0/2965956812 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100d0d90 con 0x7feb100cd960 2023-08-10T10:52:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.306+0000 7feb077fe640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb100cd960 0x7feb100d1e30 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009870 tx=0x7feaf802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7ede3de86c1bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.307+0000 7feb0f7fe640 1 -- 172.21.15.50:0/2965956812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8030840 con 0x7feb100cd960 2023-08-10T10:52:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.307+0000 7feb0f7fe640 1 -- 172.21.15.50:0/2965956812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80309a0 con 0x7feb100cd960 2023-08-10T10:52:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.307+0000 7feb0f7fe640 1 -- 172.21.15.50:0/2965956812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8030d30 con 0x7feb100cd960 2023-08-10T10:52:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.307+0000 7feb152c2640 1 -- 172.21.15.50:0/2965956812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb100cd960 msgr2=0x7feb100d1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.307+0000 7feb152c2640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb100cd960 0x7feb100d1e30 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009870 tx=0x7feaf802b980 comp rx=0 tx=0).stop 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 -- 172.21.15.50:0/2965956812 shutdown_connections 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb100cd960 0x7feb100d1e30 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 --2- 172.21.15.50:0/2965956812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1015ff90 0x7feb10160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 -- 172.21.15.50:0/2965956812 >> 172.21.15.50:0/2965956812 conn(0x7feb10069ac0 msgr2=0x7feb10069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 -- 172.21.15.50:0/2965956812 shutdown_connections 2023-08-10T10:52:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.308+0000 7feb152c2640 1 -- 172.21.15.50:0/2965956812 wait complete. 2023-08-10T10:52:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.309+0000 7feb152c2640 1 Processor -- start 2023-08-10T10:52:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.310+0000 7feb152c2640 1 -- start start 2023-08-10T10:52:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.310+0000 7feb152c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 0x7feb100ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.310+0000 7feb152c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100d2370 0x7feb100cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb152c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb152c2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb100cc3c0 con 0x7feb1015ff90 2023-08-10T10:52:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb152c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb100cc620 con 0x7feb100d2370 2023-08-10T10:52:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb152c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb101e64d0 con 0x7feb100cd960 2023-08-10T10:52:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb14ac1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb14ac1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50310/0 (socket says 172.21.15.50:50310) 2023-08-10T10:52:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb14ac1640 1 -- 172.21.15.50:0/1031972693 learned_addr learned my addr 172.21.15.50:0/1031972693 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb0ffff640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 0x7feb100ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.311+0000 7feb077fe640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100d2370 0x7feb100cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 -- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 msgr2=0x7feb100ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 0x7feb100ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 -- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100d2370 msgr2=0x7feb100cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100d2370 0x7feb100cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80094d0 con 0x7feb1015ff90 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb0ffff640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 0x7feb100ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb14ac1640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7feb08001eb0 tx=0x7feb0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080052d0 con 0x7feb1015ff90 2023-08-10T10:52:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08005430 con 0x7feb1015ff90 2023-08-10T10:52:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08003810 con 0x7feb1015ff90 2023-08-10T10:52:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb101e67b0 con 0x7feb1015ff90 2023-08-10T10:52:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.312+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1014a140 con 0x7feb1015ff90 2023-08-10T10:52:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.313+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb10066e30 con 0x7feb1015ff90 2023-08-10T10:52:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.314+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb08003970 con 0x7feb1015ff90 2023-08-10T10:52:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.315+0000 7feb0d7fa640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 0x7feaf006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.315+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb08088910 con 0x7feb1015ff90 2023-08-10T10:52:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.316+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7feaf0072da0 con 0x7feb1015ff90 2023-08-10T10:52:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.316+0000 7feb0ffff640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 0x7feaf006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.316+0000 7feb0ffff640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 0x7feaf006d110 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7feb1014d930 tx=0x7feb000039f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.319+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feb080539b0 con 0x7feb1015ff90 2023-08-10T10:52:44.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.553+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feb10160370 con 0x7feb1015ff90 2023-08-10T10:52:44.556 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-08-10T10:52:44.555+0000 7fa479717640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-10T10:52:44.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.559+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(193..193 src has 1..193) v4 ==== 374+0+0 (secure 0 0 0) 0x7feb0805f9c0 con 0x7feb1015ff90 2023-08-10T10:52:44.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.559+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7feaf0073650 con 0x7feb1015ff90 2023-08-10T10:52:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.562+0000 7feb0d7fa640 1 -- 172.21.15.50:0/1031972693 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7feb10160370 con 0x7feb1015ff90 2023-08-10T10:52:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:52:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 msgr2=0x7feaf006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 0x7feaf006d110 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7feb1014d930 tx=0x7feb000039f0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 msgr2=0x7feb10149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7feb08001eb0 tx=0x7feb0800c890 comp rx=0 tx=0).stop 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 shutdown_connections 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1015ff90 0x7feb10149c00 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7feaf006ac50 0x7feaf006d110 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb100d2370 0x7feb100cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 --2- 172.21.15.50:0/1031972693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb100cd960 0x7feb100ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.567+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 >> 172.21.15.50:0/1031972693 conn(0x7feb10069ac0 msgr2=0x7feb100d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.568+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 shutdown_connections 2023-08-10T10:52:44.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.568+0000 7feb152c2640 1 -- 172.21.15.50:0/1031972693 wait complete. 2023-08-10T10:52:44.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:52:44.592 INFO:tasks.ceph.mds.c.smithi050.stderr: -9520> 2023-08-10T10:51:56.538+0000 7fa9db45c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:52:44.677 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-08-10T10:52:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.795+0000 7f89c8cba640 1 Processor -- start 2023-08-10T10:52:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.795+0000 7f89c8cba640 1 -- start start 2023-08-10T10:52:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.796+0000 7f89c8cba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89c406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.796+0000 7f89c8cba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c415bcb0 con 0x7f89c415a820 2023-08-10T10:52:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.796+0000 7f89c8cba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c415b0a0 con 0x7f89c415ac00 2023-08-10T10:52:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.796+0000 7f89c8cba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c5540 con 0x7f89c4069db0 2023-08-10T10:52:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89c415a820 0x7f89c40696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35474/0 (socket says 172.21.15.50:35474) 2023-08-10T10:52:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c259c640 1 -- 172.21.15.50:0/2295365286 learned_addr learned my addr 172.21.15.50:0/2295365286 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89c406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017475373 0 0) 0x7f89c415bcb0 con 0x7f89c415a820 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0003520 con 0x7f89c415a820 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.797+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353948931 0 0) 0x7f89b0003520 con 0x7f89c415a820 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 msgr2=0x7f89c406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89c406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 >> v1:172.21.15.117:6789/0 conn(0x7f89c415ac00 legacy=0x7f89c40cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c415b380 con 0x7f89c415a820 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f89b4001670 con 0x7f89c415a820 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 >> v1:172.21.15.50:6789/0 conn(0x7f89c415a820 legacy=0x7f89c40696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89b00039a0 0x7f89b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89b0004d00 0x7f89b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c5540 con 0x7f89b0004d00 2023-08-10T10:52:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b000ba60 con 0x7f89b00039a0 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b000bc20 con 0x7f89c4069db0 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89b0004d00 0x7f89b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c1d9b640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.798+0000 7f89c259c640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89b00039a0 0x7f89b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c2d9d640 1 -- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 msgr2=0x7f89b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c4069db0 0x7f89b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c2d9d640 1 -- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89b00039a0 msgr2=0x7f89b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89b00039a0 0x7f89b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c2d9d640 1 -- 172.21.15.50:0/2295365286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0003520 con 0x7f89b0004d00 2023-08-10T10:52:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.799+0000 7f89c259c640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89b00039a0 0x7f89b0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:44.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.800+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89b0004d00 0x7f89b0005180 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f89c415bc60 tx=0x7f89b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17da905c3d0d6a5c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.800+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc02c660 con 0x7f89b0004d00 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.800+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc02c7c0 con 0x7f89b0004d00 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.800+0000 7f89c159a640 1 -- 172.21.15.50:0/2295365286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc02cb50 con 0x7f89b0004d00 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.800+0000 7f89c8cba640 1 -- 172.21.15.50:0/2295365286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89b0004d00 msgr2=0x7f89b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c8cba640 1 --2- 172.21.15.50:0/2295365286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89b0004d00 0x7f89b0005180 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f89c415bc60 tx=0x7f89b00057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c2d9d640 1 -- 172.21.15.50:0/2295365286 reap_dead start 2023-08-10T10:52:44.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c8cba640 1 -- 172.21.15.50:0/2295365286 shutdown_connections 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c8cba640 1 -- 172.21.15.50:0/2295365286 >> 172.21.15.50:0/2295365286 conn(0x7f89c40b08e0 msgr2=0x7f89c40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c8cba640 1 -- 172.21.15.50:0/2295365286 shutdown_connections 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.801+0000 7f89c8cba640 1 -- 172.21.15.50:0/2295365286 wait complete. 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.802+0000 7f89c8cba640 1 Processor -- start 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.803+0000 7f89c8cba640 1 -- start start 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89b0004d00 0x7f89c4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 0x7f89c415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40aec80 con 0x7f89c40c20a0 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40add20 con 0x7f89c40b3130 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c8cba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40ae000 con 0x7f89b0004d00 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50344/0 (socket says 172.21.15.50:50344) 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 -- 172.21.15.50:0/464948732 learned_addr learned my addr 172.21.15.50:0/464948732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c259c640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89b0004d00 0x7f89c4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 -- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89b0004d00 msgr2=0x7f89c4153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89b0004d00 0x7f89c4153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 0x7f89c415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 -- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 msgr2=0x7f89c415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 0x7f89c415d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c1d9b640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40ae2e0 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.804+0000 7f89c2d9d640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 0x7f89c415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89c1d9b640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00e840 tx=0x7f89ac00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac003b80 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac003ce0 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac005310 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40ae5c0 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.805+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c40c2520 con 0x7f89c40c20a0 2023-08-10T10:52:44.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.807+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c40b3510 con 0x7f89c40c20a0 2023-08-10T10:52:44.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.807+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89ac005470 con 0x7f89c40c20a0 2023-08-10T10:52:44.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.808+0000 7f89baffd640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 0x7f89a406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.808+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f89ac0895d0 con 0x7f89c40c20a0 2023-08-10T10:52:44.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.809+0000 7f89c259c640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 0x7f89a406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.809+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f89a4072eb0 con 0x7f89c40c20a0 2023-08-10T10:52:44.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.809+0000 7f89c259c640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 0x7f89a406d110 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f89b40017a0 tx=0x7f89b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:44.812+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f89ac054610 con 0x7f89c40c20a0 2023-08-10T10:52:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.043+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f89c404e270 con 0x7f89c40c20a0 2023-08-10T10:52:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.566+0000 7f89baffd640 1 -- 172.21.15.50:0/464948732 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89ac057c30 con 0x7f89c40c20a0 2023-08-10T10:52:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 msgr2=0x7f89a406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 0x7f89a406d110 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f89b40017a0 tx=0x7f89b4009040 comp rx=0 tx=0).stop 2023-08-10T10:52:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 msgr2=0x7f89c40b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00e840 tx=0x7f89ac00ed00 comp rx=0 tx=0).stop 2023-08-10T10:52:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 shutdown_connections 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f89a406ac50 0x7f89a406d110 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40b3130 0x7f89c415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40c20a0 0x7f89c40b2bf0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 --2- 172.21.15.50:0/464948732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89b0004d00 0x7f89c4153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 >> 172.21.15.50:0/464948732 conn(0x7f89c40b08e0 msgr2=0x7f89c4156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.570+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 shutdown_connections 2023-08-10T10:52:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.571+0000 7f89c8cba640 1 -- 172.21.15.50:0/464948732 wait complete. 2023-08-10T10:52:45.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:52:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.818+0000 7f7eda391640 1 Processor -- start 2023-08-10T10:52:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.818+0000 7f7eda391640 1 -- start start 2023-08-10T10:52:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.819+0000 7f7eda391640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ed415aaf0 0x7f7ed40cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7eda391640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ed40cd890 0x7f7ed40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7eda391640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed4071380 con 0x7f7ed40cfdb0 2023-08-10T10:52:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7eda391640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed40cc260 con 0x7f7ed415aaf0 2023-08-10T10:52:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7eda391640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed40cc540 con 0x7f7ed40cd890 2023-08-10T10:52:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7ed938f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ed415aaf0 0x7f7ed40cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7ed8b8e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ed40cfdb0 0x7f7ed40cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49174/0 (socket says 172.21.15.50:49174) 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7ed8b8e640 1 -- 172.21.15.50:0/4276651590 learned_addr learned my addr 172.21.15.50:0/4276651590 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.820+0000 7f7ed9b90640 1 --2- 172.21.15.50:0/4276651590 >> v2:172.21.15.117:3300/0 conn(0x7f7ed40cd890 0x7f7ed40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.821+0000 7f7ed938f640 1 -- 172.21.15.50:0/4276651590 >> v2:172.21.15.117:3300/0 conn(0x7f7ed40cd890 msgr2=0x7f7ed40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.821+0000 7f7ed938f640 1 --2- 172.21.15.50:0/4276651590 >> v2:172.21.15.117:3300/0 conn(0x7f7ed40cd890 0x7f7ed40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.821+0000 7f7ed938f640 1 -- 172.21.15.50:0/4276651590 >> v1:172.21.15.50:6789/0 conn(0x7f7ed40cfdb0 legacy=0x7f7ed40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.821+0000 7f7ed938f640 1 -- 172.21.15.50:0/4276651590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40cc820 con 0x7f7ed415aaf0 2023-08-10T10:52:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.821+0000 7f7ecbfff640 1 -- 172.21.15.50:0/4276651590 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936216037 0 0) 0x7f7ed4071380 con 0x7f7ed40cfdb0 2023-08-10T10:52:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.822+0000 7f7ed938f640 1 --2- 172.21.15.50:0/4276651590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40cf870 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40b3040 tx=0x7f7ed002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc126e938bece35d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.823+0000 7f7ecbfff640 1 -- 172.21.15.50:0/4276651590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed002cc80 con 0x7f7ed415aaf0 2023-08-10T10:52:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.823+0000 7f7ecbfff640 1 -- 172.21.15.50:0/4276651590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed002cde0 con 0x7f7ed415aaf0 2023-08-10T10:52:45.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.823+0000 7f7ecbfff640 1 -- 172.21.15.50:0/4276651590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0034660 con 0x7f7ed415aaf0 2023-08-10T10:52:45.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.823+0000 7f7eda391640 1 -- 172.21.15.50:0/4276651590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 msgr2=0x7f7ed40cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.823+0000 7f7eda391640 1 --2- 172.21.15.50:0/4276651590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40cf870 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40b3040 tx=0x7f7ed002bed0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 -- 172.21.15.50:0/4276651590 shutdown_connections 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 --2- 172.21.15.50:0/4276651590 >> v2:172.21.15.117:3300/0 conn(0x7f7ed40cd890 0x7f7ed40ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 --2- 172.21.15.50:0/4276651590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40cf870 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 -- 172.21.15.50:0/4276651590 >> 172.21.15.50:0/4276651590 conn(0x7f7ed406d3c0 msgr2=0x7f7ed40b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 -- 172.21.15.50:0/4276651590 shutdown_connections 2023-08-10T10:52:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.824+0000 7f7eda391640 1 -- 172.21.15.50:0/4276651590 wait complete. 2023-08-10T10:52:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.826+0000 7f7eda391640 1 Processor -- start 2023-08-10T10:52:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.826+0000 7f7eda391640 1 -- start start 2023-08-10T10:52:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed40cd890 0x7f7ed41f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed40cfdb0 0x7f7ed4144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40c8cf0 con 0x7f7ed415aaf0 2023-08-10T10:52:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40c9870 con 0x7f7ed40cfdb0 2023-08-10T10:52:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7eda391640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40c8f40 con 0x7f7ed40cd890 2023-08-10T10:52:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7ed9b90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7ed9b90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51270/0 (socket says 172.21.15.50:51270) 2023-08-10T10:52:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7ed9b90640 1 -- 172.21.15.50:0/3243961480 learned_addr learned my addr 172.21.15.50:0/3243961480 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.828+0000 7f7ed938f640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed40cd890 0x7f7ed41f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed8b8e640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed40cfdb0 0x7f7ed4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 -- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed40cd890 msgr2=0x7f7ed41f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed40cd890 0x7f7ed41f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 -- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed40cfdb0 msgr2=0x7f7ed4144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed40cfdb0 0x7f7ed4144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009a70 con 0x7f7ed415aaf0 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ed9b90640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00d600 tx=0x7f7ecc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0125f0 con 0x7f7ed415aaf0 2023-08-10T10:52:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.829+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc012750 con 0x7f7ed415aaf0 2023-08-10T10:52:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.830+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40c9220 con 0x7f7ed415aaf0 2023-08-10T10:52:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.830+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc012b00 con 0x7f7ed415aaf0 2023-08-10T10:52:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.830+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed41f2390 con 0x7f7ed415aaf0 2023-08-10T10:52:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.831+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4066e30 con 0x7f7ed415aaf0 2023-08-10T10:52:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.832+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ecc012c60 con 0x7f7ed415aaf0 2023-08-10T10:52:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.833+0000 7f7ec9ffb640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 0x7f7eb806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.833+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7ecc089a30 con 0x7f7ed415aaf0 2023-08-10T10:52:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.833+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f7eb8072ee0 con 0x7f7ed415aaf0 2023-08-10T10:52:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.833+0000 7f7ed938f640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 0x7f7eb806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.834+0000 7f7ed938f640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 0x7f7eb806d140 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0036000 tx=0x7f7ed0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:45.837+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7ecc054a70 con 0x7f7ed415aaf0 2023-08-10T10:52:46.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:46.028+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7ed40c99b0 con 0x7f7ed415aaf0 2023-08-10T10:52:46.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:46.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:52:46.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:46.983+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(194..194 src has 1..194) v4 ==== 296+0+0 (secure 0 0 0) 0x7f7ecc05c6f0 con 0x7f7ed415aaf0 2023-08-10T10:52:46.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:46.983+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f7eb8071310 con 0x7f7ed415aaf0 2023-08-10T10:52:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:46.989+0000 7f7ec9ffb640 1 -- 172.21.15.50:0/3243961480 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v194) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7ecc058090 con 0x7f7ed415aaf0 2023-08-10T10:52:46.997 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:52:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.000+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 msgr2=0x7f7eb806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.000+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 0x7f7eb806d140 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0036000 tx=0x7f7ed0030000 comp rx=0 tx=0).stop 2023-08-10T10:52:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.000+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 msgr2=0x7f7ed40c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.000+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00d600 tx=0x7f7ecc00dac0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 shutdown_connections 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed415aaf0 0x7f7ed40c9d00 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f7eb806ac80 0x7f7eb806d140 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed40cfdb0 0x7f7ed4144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 --2- 172.21.15.50:0/3243961480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed40cd890 0x7f7ed41f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 >> 172.21.15.50:0/3243961480 conn(0x7f7ed406d3c0 msgr2=0x7f7ed40b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 shutdown_connections 2023-08-10T10:52:47.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.001+0000 7f7eda391640 1 -- 172.21.15.50:0/3243961480 wait complete. 2023-08-10T10:52:47.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:52:47.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.243+0000 7f0ce4083640 1 Processor -- start 2023-08-10T10:52:47.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.243+0000 7f0ce4083640 1 -- start start 2023-08-10T10:52:47.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.244+0000 7f0ce4083640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cdc157460 0x7f0cdc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.244+0000 7f0ce4083640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0cdc0cd2d0 0x7f0cdc0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.244+0000 7f0ce4083640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc0cdc70 con 0x7f0cdc15d390 2023-08-10T10:52:47.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.244+0000 7f0ce4083640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc15ad60 con 0x7f0cdc157460 2023-08-10T10:52:47.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.244+0000 7f0ce4083640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc157840 con 0x7f0cdc0cd2d0 2023-08-10T10:52:47.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce1e1f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cdc157460 0x7f0cdc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce2620640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cdc15d390 0x7f0cdc15d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49176/0 (socket says 172.21.15.50:49176) 2023-08-10T10:52:47.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce2620640 1 -- 172.21.15.50:0/4191511392 learned_addr learned my addr 172.21.15.50:0/4191511392 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:47.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce161e640 1 --2- 172.21.15.50:0/4191511392 >> v2:172.21.15.117:3300/0 conn(0x7f0cdc0cd2d0 0x7f0cdc0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce1e1f640 1 -- 172.21.15.50:0/4191511392 >> v2:172.21.15.117:3300/0 conn(0x7f0cdc0cd2d0 msgr2=0x7f0cdc0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce1e1f640 1 --2- 172.21.15.50:0/4191511392 >> v2:172.21.15.117:3300/0 conn(0x7f0cdc0cd2d0 0x7f0cdc0cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce1e1f640 1 -- 172.21.15.50:0/4191511392 >> v1:172.21.15.50:6789/0 conn(0x7f0cdc15d390 legacy=0x7f0cdc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce0e1d640 1 -- 172.21.15.50:0/4191511392 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880528063 0 0) 0x7f0cdc0cdc70 con 0x7f0cdc15d390 2023-08-10T10:52:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.245+0000 7f0ce1e1f640 1 -- 172.21.15.50:0/4191511392 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc06fa90 con 0x7f0cdc157460 2023-08-10T10:52:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.246+0000 7f0ce1e1f640 1 --2- 172.21.15.50:0/4191511392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc15a820 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06cc70 tx=0x7f0cd802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b6f343658c9e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce0e1d640 1 -- 172.21.15.50:0/4191511392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031830 con 0x7f0cdc157460 2023-08-10T10:52:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce0e1d640 1 -- 172.21.15.50:0/4191511392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8031990 con 0x7f0cdc157460 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce0e1d640 1 -- 172.21.15.50:0/4191511392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031d20 con 0x7f0cdc157460 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 -- 172.21.15.50:0/4191511392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 msgr2=0x7f0cdc15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 --2- 172.21.15.50:0/4191511392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc15a820 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06cc70 tx=0x7f0cd802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 -- 172.21.15.50:0/4191511392 shutdown_connections 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 --2- 172.21.15.50:0/4191511392 >> v2:172.21.15.117:3300/0 conn(0x7f0cdc0cd2d0 0x7f0cdc0cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 --2- 172.21.15.50:0/4191511392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc15a820 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 -- 172.21.15.50:0/4191511392 >> 172.21.15.50:0/4191511392 conn(0x7f0cdc0b08e0 msgr2=0x7f0cdc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.247+0000 7f0ce4083640 1 -- 172.21.15.50:0/4191511392 shutdown_connections 2023-08-10T10:52:47.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.248+0000 7f0ce4083640 1 -- 172.21.15.50:0/4191511392 wait complete. 2023-08-10T10:52:47.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.249+0000 7f0ce4083640 1 Processor -- start 2023-08-10T10:52:47.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.250+0000 7f0ce4083640 1 -- start start 2023-08-10T10:52:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.250+0000 7f0ce4083640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cdc0cd2d0 0x7f0cdc14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.250+0000 7f0ce4083640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce4083640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 0x7f0cdc0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce4083640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc14f2d0 con 0x7f0cdc157460 2023-08-10T10:52:47.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce4083640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0cb480 con 0x7f0cdc15d390 2023-08-10T10:52:47.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce4083640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc14c310 con 0x7f0cdc0cd2d0 2023-08-10T10:52:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51290/0 (socket says 172.21.15.50:51290) 2023-08-10T10:52:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 -- 172.21.15.50:0/1651518764 learned_addr learned my addr 172.21.15.50:0/1651518764 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce1e1f640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cdc0cd2d0 0x7f0cdc14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce2620640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 0x7f0cdc0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 -- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cdc0cd2d0 msgr2=0x7f0cdc14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cdc0cd2d0 0x7f0cdc14e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 -- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 msgr2=0x7f0cdc0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 0x7f0cdc0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce161e640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8009400 con 0x7f0cdc157460 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.251+0000 7f0ce2620640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 0x7f0cdc0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0ce161e640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00d5f0 tx=0x7f0ccc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:47.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0125f0 con 0x7f0cdc157460 2023-08-10T10:52:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc012750 con 0x7f0cdc157460 2023-08-10T10:52:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc012b00 con 0x7f0cdc157460 2023-08-10T10:52:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc0ca800 con 0x7f0cdc157460 2023-08-10T10:52:47.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.252+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc0cadc0 con 0x7f0cdc157460 2023-08-10T10:52:47.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.253+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc04e270 con 0x7f0cdc157460 2023-08-10T10:52:47.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.254+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ccc012c60 con 0x7f0cdc157460 2023-08-10T10:52:47.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.255+0000 7f0cd27fc640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 0x7f0cc006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:47.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.255+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f0ccc089890 con 0x7f0cdc157460 2023-08-10T10:52:47.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.255+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f0cc0072070 con 0x7f0cdc157460 2023-08-10T10:52:47.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.256+0000 7f0ce1e1f640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 0x7f0cc006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:47.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.256+0000 7f0ce1e1f640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 0x7f0cc006d140 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8036000 tx=0x7f0cd8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:47.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.260+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ccc054a90 con 0x7f0cdc157460 2023-08-10T10:52:47.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.450+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0cdc15d120 con 0x7f0cdc157460 2023-08-10T10:52:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.995+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 7 ==== osd_map(195..195 src has 1..195) v4 ==== 296+0+0 (secure 0 0 0) 0x7f0ccc05c710 con 0x7f0cdc157460 2023-08-10T10:52:47.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:47.995+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f0cc0070e00 con 0x7f0cdc157460 2023-08-10T10:52:48.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.012+0000 7f0cd27fc640 1 -- 172.21.15.50:0/1651518764 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v195) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ccc0580b0 con 0x7f0cdc157460 2023-08-10T10:52:48.014 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-08-10T10:52:48.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.020+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 msgr2=0x7f0cc006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.020+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 0x7f0cc006d140 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8036000 tx=0x7f0cd8008030 comp rx=0 tx=0).stop 2023-08-10T10:52:48.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.020+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 msgr2=0x7f0cdc14ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.020+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00d5f0 tx=0x7f0ccc00dab0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 shutdown_connections 2023-08-10T10:52:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f0cc006ac80 0x7f0cc006d140 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cdc15d390 0x7f0cdc0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc157460 0x7f0cdc14ed90 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 --2- 172.21.15.50:0/1651518764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cdc0cd2d0 0x7f0cdc14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 >> 172.21.15.50:0/1651518764 conn(0x7f0cdc0b08e0 msgr2=0x7f0cdc15ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 shutdown_connections 2023-08-10T10:52:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.021+0000 7f0ce4083640 1 -- 172.21.15.50:0/1651518764 wait complete. 2023-08-10T10:52:48.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-10T10:52:48.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.252+0000 7f39d98a6640 1 Processor -- start 2023-08-10T10:52:48.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.252+0000 7f39d98a6640 1 -- start start 2023-08-10T10:52:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.254+0000 7f39d98a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.254+0000 7f39d98a6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f39d406f550 0x7f39d406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.254+0000 7f39d98a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40cae00 con 0x7f39d40ac890 2023-08-10T10:52:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.254+0000 7f39d98a6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d40c9150 con 0x7f39d406f550 2023-08-10T10:52:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.254+0000 7f39d98a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40ca5c0 con 0x7f39d40ca160 2023-08-10T10:52:48.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.255+0000 7f39ca7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.255+0000 7f39ca7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:45268/0 (socket says 172.21.15.50:45268) 2023-08-10T10:52:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.255+0000 7f39ca7fc640 1 -- 172.21.15.50:0/1216791234 learned_addr learned my addr 172.21.15.50:0/1216791234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.255+0000 7f39d37fe640 1 --2- 172.21.15.50:0/1216791234 >> v2:172.21.15.117:3300/0 conn(0x7f39d406f550 0x7f39d406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.256+0000 7f39ca7fc640 1 -- 172.21.15.50:0/1216791234 >> v2:172.21.15.117:3300/0 conn(0x7f39d406f550 msgr2=0x7f39d406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.256+0000 7f39ca7fc640 1 --2- 172.21.15.50:0/1216791234 >> v2:172.21.15.117:3300/0 conn(0x7f39d406f550 0x7f39d406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.256+0000 7f39ca7fc640 1 -- 172.21.15.50:0/1216791234 >> v1:172.21.15.117:6789/0 conn(0x7f39d40ac890 legacy=0x7f39d40acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.256+0000 7f39ca7fc640 1 -- 172.21.15.50:0/1216791234 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40cdba0 con 0x7f39d40ca160 2023-08-10T10:52:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.257+0000 7f39ca7fc640 1 --2- 172.21.15.50:0/1216791234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2170e5c870386969 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.258+0000 7f39d27fc640 1 -- 172.21.15.50:0/1216791234 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0317c0 con 0x7f39d40ca160 2023-08-10T10:52:48.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.258+0000 7f39d27fc640 1 -- 172.21.15.50:0/1216791234 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc031920 con 0x7f39d40ca160 2023-08-10T10:52:48.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.258+0000 7f39d27fc640 1 -- 172.21.15.50:0/1216791234 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc031cb0 con 0x7f39d40ca160 2023-08-10T10:52:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 -- 172.21.15.50:0/1216791234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 msgr2=0x7f39d40cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1216791234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc02b860 comp rx=0 tx=0).stop 2023-08-10T10:52:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 -- 172.21.15.50:0/1216791234 shutdown_connections 2023-08-10T10:52:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1216791234 >> v2:172.21.15.117:3300/0 conn(0x7f39d406f550 0x7f39d406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1216791234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d40ca160 0x7f39d40cd660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 -- 172.21.15.50:0/1216791234 >> 172.21.15.50:0/1216791234 conn(0x7f39d40b08e0 msgr2=0x7f39d40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 -- 172.21.15.50:0/1216791234 shutdown_connections 2023-08-10T10:52:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.259+0000 7f39d98a6640 1 -- 172.21.15.50:0/1216791234 wait complete. 2023-08-10T10:52:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.261+0000 7f39d98a6640 1 Processor -- start 2023-08-10T10:52:48.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.261+0000 7f39d98a6640 1 -- start start 2023-08-10T10:52:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d406f550 0x7f39d415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39d40ac890 0x7f39d40c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d41f6510 con 0x7f39d40ca160 2023-08-10T10:52:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d415fcf0 con 0x7f39d40ac890 2023-08-10T10:52:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d98a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d406a750 con 0x7f39d406f550 2023-08-10T10:52:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51300/0 (socket says 172.21.15.50:51300) 2023-08-10T10:52:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d37fe640 1 -- 172.21.15.50:0/1546725205 learned_addr learned my addr 172.21.15.50:0/1546725205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39ca7fc640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39d40ac890 0x7f39d40c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.263+0000 7f39d2ffd640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d406f550 0x7f39d415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 -- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d406f550 msgr2=0x7f39d415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d406f550 0x7f39d415f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 -- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39d40ac890 msgr2=0x7f39d40c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39d40ac890 0x7f39d40c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 -- 172.21.15.50:0/1546725205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0094d0 con 0x7f39d40ca160 2023-08-10T10:52:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d37fe640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d600 tx=0x7f39cc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0125f0 con 0x7f39d40ca160 2023-08-10T10:52:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc012770 con 0x7f39d40ca160 2023-08-10T10:52:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc012b20 con 0x7f39d40ca160 2023-08-10T10:52:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.264+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d40c2660 con 0x7f39d40ca160 2023-08-10T10:52:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.265+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d406aca0 con 0x7f39d40ca160 2023-08-10T10:52:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.266+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d41611a0 con 0x7f39d40ca160 2023-08-10T10:52:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.267+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39cc012c80 con 0x7f39d40ca160 2023-08-10T10:52:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.267+0000 7f39d0ff9640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 0x7f39b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.268+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f39cc089720 con 0x7f39d40ca160 2023-08-10T10:52:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.268+0000 7f39d2ffd640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 0x7f39b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.269+0000 7f39d2ffd640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 0x7f39b406d110 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f39c40012e0 tx=0x7f39c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.272+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39cc054a60 con 0x7f39d40ca160 2023-08-10T10:52:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.468+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f39d404e270 con 0x7f39d40ca160 2023-08-10T10:52:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.477+0000 7f39d0ff9640 1 -- 172.21.15.50:0/1546725205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f39cc058080 con 0x7f39d40ca160 2023-08-10T10:52:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.479+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 msgr2=0x7f39b406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.479+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 0x7f39b406d110 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f39c40012e0 tx=0x7f39c4009040 comp rx=0 tx=0).stop 2023-08-10T10:52:48.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.479+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 msgr2=0x7f39d4160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d600 tx=0x7f39cc00dac0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 shutdown_connections 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d40ca160 0x7f39d4160c60 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f39b406ac50 0x7f39b406d110 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39d40ac890 0x7f39d40c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 --2- 172.21.15.50:0/1546725205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39d406f550 0x7f39d415f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 >> 172.21.15.50:0/1546725205 conn(0x7f39d40b08e0 msgr2=0x7f39d40ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 shutdown_connections 2023-08-10T10:52:48.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.480+0000 7f39d98a6640 1 -- 172.21.15.50:0/1546725205 wait complete. 2023-08-10T10:52:48.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-08-10T10:52:48.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.725+0000 7f782b59e640 1 Processor -- start 2023-08-10T10:52:48.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.725+0000 7f782b59e640 1 -- start start 2023-08-10T10:52:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f782c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c160370 con 0x7f782c0d28b0 2023-08-10T10:52:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782b59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0d0d90 con 0x7f782c15ff90 2023-08-10T10:52:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0d0b90 con 0x7f782c0cd960 2023-08-10T10:52:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f782c0d28b0 0x7f782c0b5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49186/0 (socket says 172.21.15.50:49186) 2023-08-10T10:52:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782ad9d640 1 -- 172.21.15.50:0/3108721895 learned_addr learned my addr 172.21.15.50:0/3108721895 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f7829d9b640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f782c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.727+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471869195 0 0) 0x7f7824001110 con 0x7f782c0d28b0 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814003520 con 0x7f782c0d28b0 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3524462063 0 0) 0x7f7814003520 con 0x7f782c0d28b0 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 msgr2=0x7f782c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:48.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f782c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 >> v1:172.21.15.117:6789/0 conn(0x7f782c15ff90 legacy=0x7f782c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0d1070 con 0x7f782c0d28b0 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f7824001800 con 0x7f782c0d28b0 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 >> v1:172.21.15.50:6789/0 conn(0x7f782c0d28b0 legacy=0x7f782c0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78140039a0 0x7f7814003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f78140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d00 0x7f7814005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0d0b90 con 0x7f78140039a0 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781400ba60 con 0x7f7814004d00 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781400bc20 con 0x7f782c0cd960 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.728+0000 7f782a59c640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78140039a0 0x7f7814003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782ad9d640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d00 0x7f7814005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782a59c640 1 -- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 msgr2=0x7f78140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f7829d9b640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f78140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782a59c640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f78140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782a59c640 1 -- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d00 msgr2=0x7f7814005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782a59c640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d00 0x7f7814005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782a59c640 1 -- 172.21.15.50:0/3108721895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814003520 con 0x7f78140039a0 2023-08-10T10:52:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f782ad9d640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d00 0x7f7814005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:48.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.729+0000 7f7829d9b640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0cd960 0x7f78140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.730+0000 7f782a59c640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78140039a0 0x7f7814003dc0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f781c001e20 tx=0x7f78140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3de8c3540165b99 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.730+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c003b70 con 0x7f78140039a0 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.730+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c003cd0 con 0x7f78140039a0 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.730+0000 7f782959a640 1 -- 172.21.15.50:0/3108721895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c005310 con 0x7f78140039a0 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 -- 172.21.15.50:0/3108721895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78140039a0 msgr2=0x7f7814003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 --2- 172.21.15.50:0/3108721895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78140039a0 0x7f7814003dc0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f781c001e20 tx=0x7f78140057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782ad9d640 1 -- 172.21.15.50:0/3108721895 reap_dead start 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 -- 172.21.15.50:0/3108721895 shutdown_connections 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 -- 172.21.15.50:0/3108721895 >> 172.21.15.50:0/3108721895 conn(0x7f782c069ac0 msgr2=0x7f782c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 -- 172.21.15.50:0/3108721895 shutdown_connections 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.731+0000 7f782b59e640 1 -- 172.21.15.50:0/3108721895 wait complete. 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.733+0000 7f782b59e640 1 Processor -- start 2023-08-10T10:52:48.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.733+0000 7f782b59e640 1 -- start start 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78140039a0 0x7f782c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c1f2770 0x7f782c0b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b6450 con 0x7f782c1f22f0 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b7360 con 0x7f78140039a0 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0cc6a0 con 0x7f782c1f2770 2023-08-10T10:52:48.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f7829d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f7829d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51316/0 (socket says 172.21.15.50:51316) 2023-08-10T10:52:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f7829d9b640 1 -- 172.21.15.50:0/1186693711 learned_addr learned my addr 172.21.15.50:0/1186693711 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.734+0000 7f782ad9d640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c1f2770 0x7f782c0b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f782a59c640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78140039a0 0x7f782c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 -- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c1f2770 msgr2=0x7f782c0b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c1f2770 0x7f782c0b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 -- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78140039a0 msgr2=0x7f782c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:48.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78140039a0 0x7f782c158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 -- 172.21.15.50:0/1186693711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c1593f0 con 0x7f782c1f22f0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f7829d9b640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f78200108b0 tx=0x7f7820010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000eb60 con 0x7f782c1f22f0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782000ecc0 con 0x7f782c1f22f0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782001c400 con 0x7f782c1f22f0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.735+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c0b5b20 con 0x7f782c1f22f0 2023-08-10T10:52:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.736+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0b60e0 con 0x7f782c1f22f0 2023-08-10T10:52:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.737+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c066e30 con 0x7f782c1f22f0 2023-08-10T10:52:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.738+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f782001c560 con 0x7f782c1f22f0 2023-08-10T10:52:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.739+0000 7f781affd640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 0x7f780c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.739+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7820089760 con 0x7f782c1f22f0 2023-08-10T10:52:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.739+0000 7f782a59c640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 0x7f780c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.740+0000 7f782a59c640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 0x7f780c06d110 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f781c034000 tx=0x7f781c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:48.745+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7820054bc0 con 0x7f782c1f22f0 2023-08-10T10:52:49.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:49.022+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f782c0c5f50 con 0x7f782c1f22f0 2023-08-10T10:52:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:49.996+0000 7f781affd640 1 -- 172.21.15.50:0/1186693711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v708) v1 ==== 135+0+0 (secure 0 0 0) 0x7f78200581e0 con 0x7f782c1f22f0 2023-08-10T10:52:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 msgr2=0x7f780c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 0x7f780c06d110 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f781c034000 tx=0x7f781c009030 comp rx=0 tx=0).stop 2023-08-10T10:52:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 msgr2=0x7f782c0b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f78200108b0 tx=0x7f7820010d70 comp rx=0 tx=0).stop 2023-08-10T10:52:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 shutdown_connections 2023-08-10T10:52:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c1f2770 0x7f782c0b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f782c1f22f0 0x7f782c0b68e0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f780c06ac50 0x7f780c06d110 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:50.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 --2- 172.21.15.50:0/1186693711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78140039a0 0x7f782c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:50.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 >> 172.21.15.50:0/1186693711 conn(0x7f782c069ac0 msgr2=0x7f782c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:50.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 shutdown_connections 2023-08-10T10:52:50.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:50.001+0000 7f782b59e640 1 -- 172.21.15.50:0/1186693711 wait complete. 2023-08-10T10:52:50.022 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-10T10:52:50.023 INFO:tasks.cephfs_test_runner: 2023-08-10T10:52:50.024 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-10T10:52:50.024 INFO:tasks.cephfs_test_runner:Ran 10 tests in 825.856s 2023-08-10T10:52:50.024 INFO:tasks.cephfs_test_runner: 2023-08-10T10:52:50.025 INFO:tasks.cephfs_test_runner:OK 2023-08-10T10:52:50.025 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-10T10:52:50.034 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-10T10:52:50.086 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-10T10:52:50.087 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:50.087 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:50.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:52:50.150 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-08-10T10:52:50.150 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:50.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-10T10:52:50.208 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:50.208 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:50.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:52:50.269 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-10T10:52:50.269 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:52:50.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053666,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-10T10:52:50.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.324 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:52:50.388 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:52:50.388 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:52:50.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:52:50.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:52:50.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-08-10T10:52:50.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.731 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-08-10T10:52:50.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-08-10T10:52:50.867 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-08-10T10:52:50.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:52:50.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.870 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:52:50.931 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:52:50.931 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:52:50.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:50.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:52:51.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:51.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:52:51.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:51.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-10T10:52:51.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:51.267 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-10T10:52:51.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:52:51.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-10T10:52:51.438 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-10T10:52:51.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:52:51.442 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-10T10:52:51.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-10T10:52:51.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:52:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.692+0000 7f20d6404640 1 Processor -- start 2023-08-10T10:52:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.692+0000 7f20d6404640 1 -- start start 2023-08-10T10:52:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.693+0000 7f20d6404640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20d0159970 0x7f20d00b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.693+0000 7f20d6404640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20d00b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.693+0000 7f20d6404640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d015e1f0 con 0x7f20d00b0f00 2023-08-10T10:52:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.693+0000 7f20d6404640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d015d5e0 con 0x7f20d0159970 2023-08-10T10:52:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.693+0000 7f20d6404640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015d8c0 con 0x7f20d0069db0 2023-08-10T10:52:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20c77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f20d00b0f00 0x7f20d00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49200/0 (socket says 172.21.15.50:49200) 2023-08-10T10:52:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20c77fe640 1 -- 172.21.15.50:0/1573687648 learned_addr learned my addr 172.21.15.50:0/1573687648 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20cffff640 1 --2- 172.21.15.50:0/1573687648 >> v2:172.21.15.117:3300/0 conn(0x7f20d0159970 0x7f20d00b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20d49a1640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20d00b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802965014 0 0) 0x7f20d015e1f0 con 0x7f20d00b0f00 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.694+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc003520 con 0x7f20d00b0f00 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446783872 0 0) 0x7f20bc003520 con 0x7f20d00b0f00 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 msgr2=0x7f20d00b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20d00b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 >> v2:172.21.15.117:3300/0 conn(0x7f20d0159970 msgr2=0x7f20d00b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 --2- 172.21.15.50:0/1573687648 >> v2:172.21.15.117:3300/0 conn(0x7f20d0159970 0x7f20d00b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d015dba0 con 0x7f20d00b0f00 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7f20b8001670 con 0x7f20d00b0f00 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 >> v1:172.21.15.50:6789/0 conn(0x7f20d00b0f00 legacy=0x7f20d00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20bc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003ef0 0x7f20bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc004d00 0x7f20bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015d5e0 con 0x7f20bc004d00 2023-08-10T10:52:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015d8c0 con 0x7f20bc003ef0 2023-08-10T10:52:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc00b980 con 0x7f20d0069db0 2023-08-10T10:52:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20d49a1640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc004d00 0x7f20bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20c77fe640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003ef0 0x7f20bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.695+0000 7f20cffff640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20bc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.696+0000 7f20d49a1640 1 -- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 msgr2=0x7f20bc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.696+0000 7f20d49a1640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d0069db0 0x7f20bc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.696+0000 7f20d49a1640 1 -- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003ef0 msgr2=0x7f20bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.696+0000 7f20d49a1640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003ef0 0x7f20bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.696+0000 7f20d49a1640 1 -- 172.21.15.50:0/1573687648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc003520 con 0x7f20bc004d00 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.697+0000 7f20d49a1640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc004d00 0x7f20bc005180 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f20c800bf40 tx=0x7f20bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427c6aafe28ff006 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.697+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c802eb70 con 0x7f20bc004d00 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.697+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8011040 con 0x7f20bc004d00 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.697+0000 7f20cf7fe640 1 -- 172.21.15.50:0/1573687648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8036440 con 0x7f20bc004d00 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 -- 172.21.15.50:0/1573687648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc004d00 msgr2=0x7f20bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 --2- 172.21.15.50:0/1573687648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc004d00 0x7f20bc005180 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f20c800bf40 tx=0x7f20bc0057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d49a1640 1 -- 172.21.15.50:0/1573687648 reap_dead start 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 -- 172.21.15.50:0/1573687648 shutdown_connections 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 -- 172.21.15.50:0/1573687648 >> 172.21.15.50:0/1573687648 conn(0x7f20d006b590 msgr2=0x7f20d00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 -- 172.21.15.50:0/1573687648 shutdown_connections 2023-08-10T10:52:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.698+0000 7f20d6404640 1 -- 172.21.15.50:0/1573687648 wait complete. 2023-08-10T10:52:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.700+0000 7f20d6404640 1 Processor -- start 2023-08-10T10:52:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.700+0000 7f20d6404640 1 -- start start 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 0x7f20d00c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 0x7f20d00c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015bfa0 con 0x7f20d015b5e0 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015a8e0 con 0x7f20d00c2a60 2023-08-10T10:52:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20d6404640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015ab30 con 0x7f20bc004d00 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51336/0 (socket says 172.21.15.50:51336) 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20c77fe640 1 -- 172.21.15.50:0/4272902972 learned_addr learned my addr 172.21.15.50:0/4272902972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.701+0000 7f20cffff640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 0x7f20d00c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20d49a1640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 0x7f20d00c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 -- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 msgr2=0x7f20d00c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 0x7f20d00c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 -- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 msgr2=0x7f20d00c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 0x7f20d00c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 -- 172.21.15.50:0/4272902972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d015ae10 con 0x7f20d015b5e0 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20cffff640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 0x7f20d00c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20d49a1640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 0x7f20d00c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20c77fe640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e870 tx=0x7f20b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800c8d0 con 0x7f20d015b5e0 2023-08-10T10:52:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800ca30 con 0x7f20d015b5e0 2023-08-10T10:52:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800cde0 con 0x7f20d015b5e0 2023-08-10T10:52:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.702+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00c2260 con 0x7f20d015b5e0 2023-08-10T10:52:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.703+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01f2480 con 0x7f20d015b5e0 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.704+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d015de60 con 0x7f20d015b5e0 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.705+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20b801d460 con 0x7f20d015b5e0 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.706+0000 7f20cd7fa640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 0x7f20b006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.706+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f20b80891f0 con 0x7f20d015b5e0 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.706+0000 7f20cffff640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 0x7f20b006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.707+0000 7f20cffff640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 0x7f20b006d140 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009a80 tx=0x7f20c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.710+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f20d015de60 con 0x7f20d015b5e0 2023-08-10T10:52:51.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.900+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20d0159d50 con 0x7f20b006ac80 2023-08-10T10:52:51.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.907+0000 7f20cd7fa640 1 -- 172.21.15.50:0/4272902972 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67879 (secure 0 0 0) 0x7f20c0012a10 con 0x7f20b006ac80 2023-08-10T10:52:51.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:51.910 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:52:51.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 msgr2=0x7f20b006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 0x7f20b006d140 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009a80 tx=0x7f20c0008040 comp rx=0 tx=0).stop 2023-08-10T10:52:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 msgr2=0x7f20d015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e870 tx=0x7f20b800ed30 comp rx=0 tx=0).stop 2023-08-10T10:52:51.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 shutdown_connections 2023-08-10T10:52:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f20b006ac80 0x7f20b006d140 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00c2a60 0x7f20d00c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d015b5e0 0x7f20d015ba60 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.910+0000 7f20d6404640 1 --2- 172.21.15.50:0/4272902972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20bc004d00 0x7f20d00c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.911+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 >> 172.21.15.50:0/4272902972 conn(0x7f20d006b590 msgr2=0x7f20d00ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.911+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 shutdown_connections 2023-08-10T10:52:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:51.911+0000 7f20d6404640 1 -- 172.21.15.50:0/4272902972 wait complete. 2023-08-10T10:52:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":628,"stamp":"2023-08-10T10:52:50.633831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":51277,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1511222,"statfs":{"total":1600000000,"available":1547492062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490845,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.073162"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":476,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.009508+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:52:48.009508+0000","last_peered":"2023-08-10T10:52:48.009508+0000","last_clean":"2023-08-10T10:52:48.009508+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:52:48.009508+0000","last_undegraded":"2023-08-10T10:52:48.009508+0000","last_fullsized":"2023-08-10T10:52:48.009508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:23.115632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.013687+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:52:48.013687+0000","last_peered":"2023-08-10T10:52:48.013687+0000","last_clean":"2023-08-10T10:52:48.013687+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:52:48.013687+0000","last_undegraded":"2023-08-10T10:52:48.013687+0000","last_fullsized":"2023-08-10T10:52:48.013687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:14.897089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008540+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:52:48.008540+0000","last_peered":"2023-08-10T10:52:48.008540+0000","last_clean":"2023-08-10T10:52:48.008540+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:52:48.008540+0000","last_undegraded":"2023-08-10T10:52:48.008540+0000","last_fullsized":"2023-08-10T10:52:48.008540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:19.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.014359+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:52:48.014359+0000","last_peered":"2023-08-10T10:52:48.014359+0000","last_clean":"2023-08-10T10:52:48.014359+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:52:48.014359+0000","last_undegraded":"2023-08-10T10:52:48.014359+0000","last_fullsized":"2023-08-10T10:52:48.014359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:48.547955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003616+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:52:48.003616+0000","last_peered":"2023-08-10T10:52:48.003616+0000","last_clean":"2023-08-10T10:52:48.003616+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:52:48.003616+0000","last_undegraded":"2023-08-10T10:52:48.003616+0000","last_fullsized":"2023-08-10T10:52:48.003616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:54.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.012927+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:52:48.012927+0000","last_peered":"2023-08-10T10:52:48.012927+0000","last_clean":"2023-08-10T10:52:48.012927+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:52:48.012927+0000","last_undegraded":"2023-08-10T10:52:48.012927+0000","last_fullsized":"2023-08-10T10:52:48.012927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:08.962612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008370+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:52:48.008370+0000","last_peered":"2023-08-10T10:52:48.008370+0000","last_clean":"2023-08-10T10:52:48.008370+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:52:48.008370+0000","last_undegraded":"2023-08-10T10:52:48.008370+0000","last_fullsized":"2023-08-10T10:52:48.008370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:11.514997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.005555+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:52:48.005555+0000","last_peered":"2023-08-10T10:52:48.005555+0000","last_clean":"2023-08-10T10:52:48.005555+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:52:48.005555+0000","last_undegraded":"2023-08-10T10:52:48.005555+0000","last_fullsized":"2023-08-10T10:52:48.005555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:51.233312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":313,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003352+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:52:48.003352+0000","last_peered":"2023-08-10T10:52:48.003352+0000","last_clean":"2023-08-10T10:52:48.003352+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:52:48.003352+0000","last_undegraded":"2023-08-10T10:52:48.003352+0000","last_fullsized":"2023-08-10T10:52:48.003352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:43.456199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193587,"statfs":{"total":200000000,"available":198233398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.143},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.39600000000000002},"max":{"1min":1.756,"5min":1.756,"15min":4.5679999999999996},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.44800000000000001},"max":{"1min":1.302,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.66500000000000004},"max":{"1min":1.6659999999999999,"5min":1.7549999999999999,"15min":4.6470000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.754,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.4930000000000001,"5min":1.958,"15min":8.0830000000000002},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.84799999999999998,"5min":0.70199999999999996,"15min":0.503},"max":{"1min":1.4690000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.323,"15min":1.2869999999999999},"min":{"1min":0.874,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":1.7589999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":1.115}]},{"osd":3,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":1.496,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.409,"15min":1.397},"min":{"1min":1.024,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.8560000000000001,"5min":1.867,"15min":6.069},"last":1.331}]},{"osd":4,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8380000000000001,"5min":1.9339999999999999,"15min":7.1950000000000003},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":0.876,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":7.4950000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4079999999999999,"15min":1.452},"min":{"1min":0.999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9790000000000001,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.643},{"interface":"front","average":{"1min":1.409,"5min":1.4279999999999999,"15min":1.48},"min":{"1min":0.998,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":1.96,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.595}]},{"osd":6,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5620000000000001,"15min":1.5740000000000001},"min":{"1min":1.26,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.0790000000000002,"5min":2.1920000000000002,"15min":8.859},"last":1.55},{"interface":"front","average":{"1min":1.474,"5min":1.48,"15min":1.496},"min":{"1min":1.081,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7969999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.506}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190073,"statfs":{"total":200000000,"available":194635380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.752,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.1379999999999999,"15min":1.0860000000000001},"min":{"1min":0.81899999999999995,"5min":0.71699999999999997,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.577,"5min":1.764,"15min":2.302},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.304,"15min":1.238},"min":{"1min":0.93700000000000006,"5min":0.82999999999999996,"15min":0.70099999999999996},"max":{"1min":1.728,"5min":1.728,"15min":2.052},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.232,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.6040000000000001,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.264,"15min":1.252},"min":{"1min":0.95799999999999996,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.976,"15min":1.976},"last":1.1180000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3069999999999999,"15min":1.2909999999999999},"min":{"1min":1.016,"5min":0.94599999999999995,"15min":0.69399999999999995},"max":{"1min":1.7390000000000001,"5min":2.4009999999999998,"15min":3.177},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":1.1379999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.5740000000000001,"5min":1.9199999999999999,"15min":2.395},"last":1.032}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2789999999999999,"15min":1.262},"min":{"1min":0.86299999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.75,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.504,"15min":1.4690000000000001},"min":{"1min":0.84399999999999997,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.788,"5min":2.512,"15min":2.7589999999999999},"last":1.238}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.446,"15min":1.4419999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.59399999999999997},"max":{"1min":1.7769999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.274},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5389999999999999,"15min":1.532},"min":{"1min":1.1799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8859999999999999,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.375},"min":{"1min":0.93200000000000005,"5min":0.85399999999999998,"15min":0.53700000000000003},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.506,"15min":1.5189999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65400000000000003},"max":{"1min":1.8320000000000001,"5min":2.355,"15min":2.698},"last":1.3069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190074,"statfs":{"total":200000000,"available":194636399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.165,"15min":1.133},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.57699999999999996},"max":{"1min":1.548,"5min":1.645,"15min":2.5070000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.56599999999999995},"max":{"1min":1.708,"5min":1.857,"15min":32.941000000000003},"last":1.1759999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2729999999999999,"15min":1.2270000000000001},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.228,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.70299999999999996,"15min":0.62},"max":{"1min":1.5009999999999999,"5min":1.772,"15min":4.3360000000000003},"last":1.6739999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3260000000000001,"15min":1.276},"min":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.67500000000000004},"max":{"1min":1.764,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.52600000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.383}]},{"osd":3,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3460000000000001,"15min":1.29},"min":{"1min":1.0129999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.6970000000000001,"5min":2.016,"15min":2.016},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.349},"min":{"1min":0.83299999999999996,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.667,"5min":1.891,"15min":4.0620000000000003},"last":1.252}]},{"osd":4,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58599999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.9859999999999998},"last":1.53},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3859999999999999,"15min":1.3740000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.58099999999999996},"max":{"1min":1.708,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4770000000000001,"15min":1.407},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54200000000000004},"max":{"1min":1.792,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.577},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4179999999999999,"15min":1.417},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63600000000000001},"max":{"1min":1.8300000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5149999999999999,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.63100000000000001},"max":{"1min":1.766,"5min":2.0659999999999998,"15min":2.403},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5680000000000001,"15min":1.526},"min":{"1min":0.73599999999999999,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":1.8839999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.732}]}]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.151},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.54200000000000004},"max":{"1min":1.4790000000000001,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55600000000000005},"max":{"1min":1.6950000000000001,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.272,"15min":1.2529999999999999},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6799999999999999,"5min":1.841,"15min":3.9820000000000002},"last":1.157},{"interface":"front","average":{"1min":1.236,"5min":1.2669999999999999,"15min":1.1759999999999999},"min":{"1min":0.80300000000000005,"5min":0.752,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.5640000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2529999999999999,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.621},"max":{"1min":1.6180000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.98699999999999999,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.6539999999999999,"5min":1.6819999999999999,"15min":3.8130000000000002},"last":1.3},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.333,"15min":1.3140000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.67000000000000004},"max":{"1min":1.786,"5min":1.792,"15min":4.6859999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.64300000000000002},"max":{"1min":1.851,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.254},{"interface":"front","average":{"1min":1.383,"5min":1.3240000000000001,"15min":1.304},"min":{"1min":0.92200000000000004,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.734,"5min":1.798,"15min":2.9340000000000002},"last":1.474}]},{"osd":6,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.47099999999999997},"max":{"1min":1.6080000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.206},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.504,"15min":1.4930000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.55000000000000004},"max":{"1min":1.7869999999999999,"5min":2.121,"15min":5.1529999999999996},"last":1.345}]},{"osd":7,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.57999999999999996},"max":{"1min":1.8260000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.5740000000000001,"15min":1.546},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.67400000000000004},"max":{"1min":1.875,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.522}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173689,"statfs":{"total":200000000,"available":177858164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.998,"15min":0.93799999999999994},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.5289999999999999,"5min":2.722,"15min":2.722},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.1990000000000001,"15min":1.125},"min":{"1min":0.66500000000000004,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.5620000000000001,"5min":2.883,"15min":2.883},"last":1.012}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0069999999999999,"15min":0.93600000000000005},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.885,"15min":1.885},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.1459999999999999,"15min":1.0640000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1439999999999999,"15min":1.056},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":1.74,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.333,"15min":1.21},"min":{"1min":0.71099999999999997,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.6850000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.423,"15min":1.367},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.833,"5min":2.766,"15min":9.8149999999999995},"last":1.238},{"interface":"front","average":{"1min":1.361,"5min":1.304,"15min":1.264},"min":{"1min":0.92700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":2.0259999999999998,"15min":2.5179999999999998},"last":1.7090000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5229999999999999,"15min":1.4259999999999999},"min":{"1min":1.081,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8620000000000001,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.488,"15min":1.4350000000000001},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.9670000000000001,"5min":2.774,"15min":4.2069999999999999},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.421,"15min":1.367},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.6560000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.597,"15min":1.4950000000000001},"min":{"1min":0.95199999999999996,"5min":0.749,"15min":0.749},"max":{"1min":1.861,"5min":2.964,"15min":2.964},"last":1.425}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5860000000000001,"15min":1.5109999999999999},"min":{"1min":1.1040000000000001,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.0739999999999998,"5min":2.677,"15min":2.677},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.524,"15min":1.4430000000000001},"min":{"1min":1.002,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":2.1920000000000002,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.645}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181881,"statfs":{"total":200000000,"available":186246772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.3160000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0069999999999999,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.443},"max":{"1min":1.8140000000000001,"5min":1.825,"15min":1.825},"last":1.5580000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1279999999999999,"15min":1.087},"min":{"1min":0.61099999999999999,"5min":0.51800000000000002,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.9630000000000001},"last":1.327},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.248,"15min":1.1899999999999999},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.925,"5min":1.925,"15min":2.0310000000000001},"last":1.472}]},{"osd":3,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.028,"15min":1},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.661,"5min":1.742,"15min":1.877},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.194,"15min":1.1919999999999999},"min":{"1min":0.70499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7190000000000001,"5min":1.839,"15min":3.6920000000000002},"last":1.518}]},{"osd":4,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.391},"min":{"1min":0.96299999999999997,"5min":0.88500000000000001,"15min":0.81799999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6000000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.3560000000000001,"15min":1.333},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.64200000000000002},"max":{"1min":1.75,"5min":1.968,"15min":4.2220000000000004},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3420000000000001,"15min":1.2969999999999999},"min":{"1min":0.91700000000000004,"5min":0.90400000000000003,"15min":0.66600000000000004},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2280000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4550000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.64900000000000002},"max":{"1min":1.8200000000000001,"5min":1.968,"15min":3.294},"last":1.6659999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4430000000000001,"15min":1.4239999999999999},"min":{"1min":0.95999999999999996,"5min":0.90900000000000003,"15min":0.81599999999999995},"max":{"1min":1.7689999999999999,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.79700000000000004},"max":{"1min":1.851,"5min":1.907,"15min":2.444},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5129999999999999,"15min":1.48},"min":{"1min":0.98899999999999999,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":2.0449999999999999,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4990000000000001,"15min":1.454},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.79000000000000004},"max":{"1min":1.8029999999999999,"5min":2.0030000000000001,"15min":2.556},"last":1.1519999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92300000000000004,"15min":0.879},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":1.4319999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":1.3819999999999999,"5min":1.706,"15min":2.246},"last":1.165}]},{"osd":2,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0449999999999999,"15min":0.996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5249999999999999,"5min":1.925,"15min":2.0209999999999999},"last":1.411},{"interface":"front","average":{"1min":1.141,"5min":1.276,"15min":1.2},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.42599999999999999},"max":{"1min":1.5640000000000001,"5min":2.0019999999999998,"15min":2.423},"last":1.236}]},{"osd":3,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2110000000000001,"15min":1.1539999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.579,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.1659999999999999,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.024}]},{"osd":4,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.288,"15min":1.25},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6180000000000001,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.55},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4810000000000001,"15min":1.444},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.738,"5min":2.0499999999999998,"15min":2.343},"last":1.458}]},{"osd":5,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4379999999999999,"15min":1.4099999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.67900000000000005},"max":{"1min":1.752,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.329},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4119999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0179999999999998,"5min":2.5009999999999999,"15min":2.73},"last":1.7030000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4390000000000001,"15min":1.4119999999999999},"min":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4450000000000001,"15min":1.3779999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1200000000000001,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.633}]},{"osd":7,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.605,"15min":1.5069999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1440000000000001,"5min":7.798,"15min":7.798},"last":1.673},{"interface":"front","average":{"1min":1.466,"5min":1.546,"15min":1.4850000000000001},"min":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":2.2130000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.6040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193588,"statfs":{"total":200000000,"available":198234417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.004,"15min":0.98499999999999999},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.28100000000000003},"max":{"1min":1.3919999999999999,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1359999999999999,"15min":1.1100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.434},"max":{"1min":1.4890000000000001,"5min":1.73,"15min":11.173},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0640000000000001,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.39000000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":2.7240000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.0580000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0600000000000001,"15min":1.0209999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5529999999999999,"5min":1.796,"15min":5.9980000000000002},"last":1.117},{"interface":"front","average":{"1min":1.216,"5min":1.2689999999999999,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.794,"5min":1.9730000000000001,"15min":10.739000000000001},"last":1.262}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.351,"15min":1.3480000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.73199999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":6.5209999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.512,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.751},"max":{"1min":2.0739999999999998,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.536}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.375,"15min":1.369},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":2.238,"15min":2.238},"last":1},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.387,"15min":1.4239999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.72399999999999998},"max":{"1min":1.6679999999999999,"5min":1.9890000000000001,"15min":16.058},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.54,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":1.974,"5min":2.375,"15min":2.4790000000000001},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.508,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.754},"max":{"1min":1.9370000000000001,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.464}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.5629999999999999,"15min":1.5269999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.752},"max":{"1min":1.988,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.508,"15min":1.48},"min":{"1min":0.96699999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.875,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.4379999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:52:51.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:52:52.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.155+0000 7f32e5914640 1 Processor -- start 2023-08-10T10:52:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.155+0000 7f32e5914640 1 -- start start 2023-08-10T10:52:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ce7e0 0x7f32e00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5914640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32e00ccac0 0x7f32e00cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5914640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00cc270 con 0x7f32e00cc660 2023-08-10T10:52:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5914640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e00cf100 con 0x7f32e00ccac0 2023-08-10T10:52:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00cb1d0 con 0x7f32e00ce7e0 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5113640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32e00ccac0 0x7f32e00cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5113640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32e00ccac0 0x7f32e00cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51346/0 (socket says 172.21.15.50:51346) 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e5113640 1 -- 172.21.15.50:0/2749600822 learned_addr learned my addr 172.21.15.50:0/2749600822 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.157+0000 7f32e4912640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ce7e0 0x7f32e00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.158+0000 7f32e5113640 1 -- 172.21.15.50:0/2749600822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ce7e0 msgr2=0x7f32e00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.158+0000 7f32e5113640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ce7e0 0x7f32e00cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.158+0000 7f32e5113640 1 -- 172.21.15.50:0/2749600822 >> v1:172.21.15.117:6789/0 conn(0x7f32e00cc660 legacy=0x7f32e00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.158+0000 7f32e5113640 1 -- 172.21.15.50:0/2749600822 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00cb4b0 con 0x7f32e00ccac0 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.159+0000 7f32e5113640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00ccac0 0x7f32e00cd700 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009e50 tx=0x7f32d802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62684fc552fa8b21 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.159+0000 7f32df7fe640 1 -- 172.21.15.50:0/2749600822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d802cb00 con 0x7f32e00ccac0 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.159+0000 7f32df7fe640 1 -- 172.21.15.50:0/2749600822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d802cc60 con 0x7f32e00ccac0 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.159+0000 7f32df7fe640 1 -- 172.21.15.50:0/2749600822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80343f0 con 0x7f32e00ccac0 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 -- 172.21.15.50:0/2749600822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00ccac0 msgr2=0x7f32e00cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00ccac0 0x7f32e00cd700 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009e50 tx=0x7f32d802bf60 comp rx=0 tx=0).stop 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 -- 172.21.15.50:0/2749600822 shutdown_connections 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00ccac0 0x7f32e00cd700 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 --2- 172.21.15.50:0/2749600822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ce7e0 0x7f32e00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 -- 172.21.15.50:0/2749600822 >> 172.21.15.50:0/2749600822 conn(0x7f32e00b3530 msgr2=0x7f32e00b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 -- 172.21.15.50:0/2749600822 shutdown_connections 2023-08-10T10:52:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.160+0000 7f32e5914640 1 -- 172.21.15.50:0/2749600822 wait complete. 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.162+0000 7f32e5914640 1 Processor -- start 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.162+0000 7f32e5914640 1 -- start start 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ccac0 0x7f32e01f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32e00ce7e0 0x7f32e009d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e015be10 con 0x7f32e00cc660 2023-08-10T10:52:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01f2ef0 con 0x7f32e00ce7e0 2023-08-10T10:52:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e5914640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00c67e0 con 0x7f32e00ccac0 2023-08-10T10:52:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e4912640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e4912640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51358/0 (socket says 172.21.15.50:51358) 2023-08-10T10:52:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.163+0000 7f32e4912640 1 -- 172.21.15.50:0/1462346977 learned_addr learned my addr 172.21.15.50:0/1462346977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32dffff640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ccac0 0x7f32e01f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e5113640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32e00ce7e0 0x7f32e009d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 -- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ccac0 msgr2=0x7f32e01f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ccac0 0x7f32e01f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 -- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32e00ce7e0 msgr2=0x7f32e009d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32e00ce7e0 0x7f32e009d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 -- 172.21.15.50:0/1462346977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8009b30 con 0x7f32e00cc660 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32e4912640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d800 tx=0x7f32d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4005990 con 0x7f32e00cc660 2023-08-10T10:52:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4005af0 con 0x7f32e00cc660 2023-08-10T10:52:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.164+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4005ea0 con 0x7f32e00cc660 2023-08-10T10:52:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.165+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00b6080 con 0x7f32e00cc660 2023-08-10T10:52:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.165+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e015c300 con 0x7f32e00cc660 2023-08-10T10:52:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.166+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0066e30 con 0x7f32e00cc660 2023-08-10T10:52:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.167+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32d4009640 con 0x7f32e00cc660 2023-08-10T10:52:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.168+0000 7f32dd7fa640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 0x7f32c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.168+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f32d4089340 con 0x7f32e00cc660 2023-08-10T10:52:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.168+0000 7f32dffff640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 0x7f32c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.169+0000 7f32dffff640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 0x7f32c406d110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f32e00c6a50 tx=0x7f32cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.175+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f32d4058190 con 0x7f32e00cc660 2023-08-10T10:52:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.370+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32e00cba70 con 0x7f32c406ac50 2023-08-10T10:52:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.377+0000 7f32dd7fa640 1 -- 172.21.15.50:0/1462346977 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67879 (secure 0 0 0) 0x7f32cc005080 con 0x7f32c406ac50 2023-08-10T10:52:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:52:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 msgr2=0x7f32c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 0x7f32c406d110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f32e00c6a50 tx=0x7f32cc009040 comp rx=0 tx=0).stop 2023-08-10T10:52:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 msgr2=0x7f32e00c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d800 tx=0x7f32d400dcc0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 shutdown_connections 2023-08-10T10:52:52.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f32c406ac50 0x7f32c406d110 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32e00ce7e0 0x7f32e009d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32e00ccac0 0x7f32e01f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 --2- 172.21.15.50:0/1462346977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e00cc660 0x7f32e00c76b0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 >> 172.21.15.50:0/1462346977 conn(0x7f32e00b3530 msgr2=0x7f32e00b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 shutdown_connections 2023-08-10T10:52:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.380+0000 7f32e5914640 1 -- 172.21.15.50:0/1462346977 wait complete. 2023-08-10T10:52:52.400 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":628,"stamp":"2023-08-10T10:52:50.633831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":51277,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1511222,"statfs":{"total":1600000000,"available":1547492062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490845,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.073162"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":476,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.009508+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:52:48.009508+0000","last_peered":"2023-08-10T10:52:48.009508+0000","last_clean":"2023-08-10T10:52:48.009508+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:52:48.009508+0000","last_undegraded":"2023-08-10T10:52:48.009508+0000","last_fullsized":"2023-08-10T10:52:48.009508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:23.115632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.013687+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:52:48.013687+0000","last_peered":"2023-08-10T10:52:48.013687+0000","last_clean":"2023-08-10T10:52:48.013687+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:52:48.013687+0000","last_undegraded":"2023-08-10T10:52:48.013687+0000","last_fullsized":"2023-08-10T10:52:48.013687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:14.897089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008540+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:52:48.008540+0000","last_peered":"2023-08-10T10:52:48.008540+0000","last_clean":"2023-08-10T10:52:48.008540+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:52:48.008540+0000","last_undegraded":"2023-08-10T10:52:48.008540+0000","last_fullsized":"2023-08-10T10:52:48.008540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:19.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.014359+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:52:48.014359+0000","last_peered":"2023-08-10T10:52:48.014359+0000","last_clean":"2023-08-10T10:52:48.014359+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:52:48.014359+0000","last_undegraded":"2023-08-10T10:52:48.014359+0000","last_fullsized":"2023-08-10T10:52:48.014359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:48.547955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003616+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:52:48.003616+0000","last_peered":"2023-08-10T10:52:48.003616+0000","last_clean":"2023-08-10T10:52:48.003616+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:52:48.003616+0000","last_undegraded":"2023-08-10T10:52:48.003616+0000","last_fullsized":"2023-08-10T10:52:48.003616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:54.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.012927+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:52:48.012927+0000","last_peered":"2023-08-10T10:52:48.012927+0000","last_clean":"2023-08-10T10:52:48.012927+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:52:48.012927+0000","last_undegraded":"2023-08-10T10:52:48.012927+0000","last_fullsized":"2023-08-10T10:52:48.012927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:08.962612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008370+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:52:48.008370+0000","last_peered":"2023-08-10T10:52:48.008370+0000","last_clean":"2023-08-10T10:52:48.008370+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:52:48.008370+0000","last_undegraded":"2023-08-10T10:52:48.008370+0000","last_fullsized":"2023-08-10T10:52:48.008370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:11.514997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.005555+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:52:48.005555+0000","last_peered":"2023-08-10T10:52:48.005555+0000","last_clean":"2023-08-10T10:52:48.005555+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:52:48.005555+0000","last_undegraded":"2023-08-10T10:52:48.005555+0000","last_fullsized":"2023-08-10T10:52:48.005555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:51.233312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":313,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003352+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:52:48.003352+0000","last_peered":"2023-08-10T10:52:48.003352+0000","last_clean":"2023-08-10T10:52:48.003352+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:52:48.003352+0000","last_undegraded":"2023-08-10T10:52:48.003352+0000","last_fullsized":"2023-08-10T10:52:48.003352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:43.456199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193587,"statfs":{"total":200000000,"available":198233398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.143},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.39600000000000002},"max":{"1min":1.756,"5min":1.756,"15min":4.5679999999999996},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.44800000000000001},"max":{"1min":1.302,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.66500000000000004},"max":{"1min":1.6659999999999999,"5min":1.7549999999999999,"15min":4.6470000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.754,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.4930000000000001,"5min":1.958,"15min":8.0830000000000002},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.84799999999999998,"5min":0.70199999999999996,"15min":0.503},"max":{"1min":1.4690000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.323,"15min":1.2869999999999999},"min":{"1min":0.874,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":1.7589999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":1.115}]},{"osd":3,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":1.496,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.409,"15min":1.397},"min":{"1min":1.024,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.8560000000000001,"5min":1.867,"15min":6.069},"last":1.331}]},{"osd":4,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8380000000000001,"5min":1.9339999999999999,"15min":7.1950000000000003},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":0.876,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":7.4950000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4079999999999999,"15min":1.452},"min":{"1min":0.999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9790000000000001,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.643},{"interface":"front","average":{"1min":1.409,"5min":1.4279999999999999,"15min":1.48},"min":{"1min":0.998,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":1.96,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.595}]},{"osd":6,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5620000000000001,"15min":1.5740000000000001},"min":{"1min":1.26,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.0790000000000002,"5min":2.1920000000000002,"15min":8.859},"last":1.55},{"interface":"front","average":{"1min":1.474,"5min":1.48,"15min":1.496},"min":{"1min":1.081,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7969999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.506}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190073,"statfs":{"total":200000000,"available":194635380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.752,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.1379999999999999,"15min":1.0860000000000001},"min":{"1min":0.81899999999999995,"5min":0.71699999999999997,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.577,"5min":1.764,"15min":2.302},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.304,"15min":1.238},"min":{"1min":0.93700000000000006,"5min":0.82999999999999996,"15min":0.70099999999999996},"max":{"1min":1.728,"5min":1.728,"15min":2.052},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.232,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.6040000000000001,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.264,"15min":1.252},"min":{"1min":0.95799999999999996,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.976,"15min":1.976},"last":1.1180000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3069999999999999,"15min":1.2909999999999999},"min":{"1min":1.016,"5min":0.94599999999999995,"15min":0.69399999999999995},"max":{"1min":1.7390000000000001,"5min":2.4009999999999998,"15min":3.177},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":1.1379999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.5740000000000001,"5min":1.9199999999999999,"15min":2.395},"last":1.032}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2789999999999999,"15min":1.262},"min":{"1min":0.86299999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.75,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.504,"15min":1.4690000000000001},"min":{"1min":0.84399999999999997,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.788,"5min":2.512,"15min":2.7589999999999999},"last":1.238}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.446,"15min":1.4419999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.59399999999999997},"max":{"1min":1.7769999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.274},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5389999999999999,"15min":1.532},"min":{"1min":1.1799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8859999999999999,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.375},"min":{"1min":0.93200000000000005,"5min":0.85399999999999998,"15min":0.53700000000000003},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.506,"15min":1.5189999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65400000000000003},"max":{"1min":1.8320000000000001,"5min":2.355,"15min":2.698},"last":1.3069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190074,"statfs":{"total":200000000,"available":194636399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.165,"15min":1.133},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.57699999999999996},"max":{"1min":1.548,"5min":1.645,"15min":2.5070000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.56599999999999995},"max":{"1min":1.708,"5min":1.857,"15min":32.941000000000003},"last":1.1759999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2729999999999999,"15min":1.2270000000000001},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.228,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.70299999999999996,"15min":0.62},"max":{"1min":1.5009999999999999,"5min":1.772,"15min":4.3360000000000003},"last":1.6739999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3260000000000001,"15min":1.276},"min":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.67500000000000004},"max":{"1min":1.764,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.52600000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.383}]},{"osd":3,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3460000000000001,"15min":1.29},"min":{"1min":1.0129999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.6970000000000001,"5min":2.016,"15min":2.016},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.349},"min":{"1min":0.83299999999999996,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.667,"5min":1.891,"15min":4.0620000000000003},"last":1.252}]},{"osd":4,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58599999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.9859999999999998},"last":1.53},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3859999999999999,"15min":1.3740000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.58099999999999996},"max":{"1min":1.708,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4770000000000001,"15min":1.407},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54200000000000004},"max":{"1min":1.792,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.577},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4179999999999999,"15min":1.417},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63600000000000001},"max":{"1min":1.8300000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5149999999999999,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.63100000000000001},"max":{"1min":1.766,"5min":2.0659999999999998,"15min":2.403},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5680000000000001,"15min":1.526},"min":{"1min":0.73599999999999999,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":1.8839999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.732}]}]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.151},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.54200000000000004},"max":{"1min":1.4790000000000001,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55600000000000005},"max":{"1min":1.6950000000000001,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.272,"15min":1.2529999999999999},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6799999999999999,"5min":1.841,"15min":3.9820000000000002},"last":1.157},{"interface":"front","average":{"1min":1.236,"5min":1.2669999999999999,"15min":1.1759999999999999},"min":{"1min":0.80300000000000005,"5min":0.752,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.5640000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2529999999999999,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.621},"max":{"1min":1.6180000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.98699999999999999,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.6539999999999999,"5min":1.6819999999999999,"15min":3.8130000000000002},"last":1.3},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.333,"15min":1.3140000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.67000000000000004},"max":{"1min":1.786,"5min":1.792,"15min":4.6859999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.64300000000000002},"max":{"1min":1.851,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.254},{"interface":"front","average":{"1min":1.383,"5min":1.3240000000000001,"15min":1.304},"min":{"1min":0.92200000000000004,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.734,"5min":1.798,"15min":2.9340000000000002},"last":1.474}]},{"osd":6,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.47099999999999997},"max":{"1min":1.6080000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.206},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.504,"15min":1.4930000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.55000000000000004},"max":{"1min":1.7869999999999999,"5min":2.121,"15min":5.1529999999999996},"last":1.345}]},{"osd":7,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.57999999999999996},"max":{"1min":1.8260000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.5740000000000001,"15min":1.546},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.67400000000000004},"max":{"1min":1.875,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.522}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173689,"statfs":{"total":200000000,"available":177858164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.998,"15min":0.93799999999999994},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.5289999999999999,"5min":2.722,"15min":2.722},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.1990000000000001,"15min":1.125},"min":{"1min":0.66500000000000004,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.5620000000000001,"5min":2.883,"15min":2.883},"last":1.012}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0069999999999999,"15min":0.93600000000000005},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.885,"15min":1.885},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.1459999999999999,"15min":1.0640000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1439999999999999,"15min":1.056},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":1.74,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.333,"15min":1.21},"min":{"1min":0.71099999999999997,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.6850000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.423,"15min":1.367},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.833,"5min":2.766,"15min":9.8149999999999995},"last":1.238},{"interface":"front","average":{"1min":1.361,"5min":1.304,"15min":1.264},"min":{"1min":0.92700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":2.0259999999999998,"15min":2.5179999999999998},"last":1.7090000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5229999999999999,"15min":1.4259999999999999},"min":{"1min":1.081,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8620000000000001,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.488,"15min":1.4350000000000001},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.9670000000000001,"5min":2.774,"15min":4.2069999999999999},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.421,"15min":1.367},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.6560000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.597,"15min":1.4950000000000001},"min":{"1min":0.95199999999999996,"5min":0.749,"15min":0.749},"max":{"1min":1.861,"5min":2.964,"15min":2.964},"last":1.425}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5860000000000001,"15min":1.5109999999999999},"min":{"1min":1.1040000000000001,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.0739999999999998,"5min":2.677,"15min":2.677},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.524,"15min":1.4430000000000001},"min":{"1min":1.002,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":2.1920000000000002,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.645}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181881,"statfs":{"total":200000000,"available":186246772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.3160000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0069999999999999,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.443},"max":{"1min":1.8140000000000001,"5min":1.825,"15min":1.825},"last":1.5580000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1279999999999999,"15min":1.087},"min":{"1min":0.61099999999999999,"5min":0.51800000000000002,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.9630000000000001},"last":1.327},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.248,"15min":1.1899999999999999},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.925,"5min":1.925,"15min":2.0310000000000001},"last":1.472}]},{"osd":3,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.028,"15min":1},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.661,"5min":1.742,"15min":1.877},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.194,"15min":1.1919999999999999},"min":{"1min":0.70499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7190000000000001,"5min":1.839,"15min":3.6920000000000002},"last":1.518}]},{"osd":4,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.391},"min":{"1min":0.96299999999999997,"5min":0.88500000000000001,"15min":0.81799999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6000000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.3560000000000001,"15min":1.333},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.64200000000000002},"max":{"1min":1.75,"5min":1.968,"15min":4.2220000000000004},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3420000000000001,"15min":1.2969999999999999},"min":{"1min":0.91700000000000004,"5min":0.90400000000000003,"15min":0.66600000000000004},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2280000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4550000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.64900000000000002},"max":{"1min":1.8200000000000001,"5min":1.968,"15min":3.294},"last":1.6659999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4430000000000001,"15min":1.4239999999999999},"min":{"1min":0.95999999999999996,"5min":0.90900000000000003,"15min":0.81599999999999995},"max":{"1min":1.7689999999999999,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.79700000000000004},"max":{"1min":1.851,"5min":1.907,"15min":2.444},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5129999999999999,"15min":1.48},"min":{"1min":0.98899999999999999,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":2.0449999999999999,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4990000000000001,"15min":1.454},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.79000000000000004},"max":{"1min":1.8029999999999999,"5min":2.0030000000000001,"15min":2.556},"last":1.1519999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92300000000000004,"15min":0.879},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":1.4319999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":1.3819999999999999,"5min":1.706,"15min":2.246},"last":1.165}]},{"osd":2,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0449999999999999,"15min":0.996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5249999999999999,"5min":1.925,"15min":2.0209999999999999},"last":1.411},{"interface":"front","average":{"1min":1.141,"5min":1.276,"15min":1.2},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.42599999999999999},"max":{"1min":1.5640000000000001,"5min":2.0019999999999998,"15min":2.423},"last":1.236}]},{"osd":3,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2110000000000001,"15min":1.1539999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.579,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.1659999999999999,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.024}]},{"osd":4,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.288,"15min":1.25},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6180000000000001,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.55},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4810000000000001,"15min":1.444},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.738,"5min":2.0499999999999998,"15min":2.343},"last":1.458}]},{"osd":5,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4379999999999999,"15min":1.4099999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.67900000000000005},"max":{"1min":1.752,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.329},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4119999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0179999999999998,"5min":2.5009999999999999,"15min":2.73},"last":1.7030000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4390000000000001,"15min":1.4119999999999999},"min":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4450000000000001,"15min":1.3779999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1200000000000001,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.633}]},{"osd":7,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.605,"15min":1.5069999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1440000000000001,"5min":7.798,"15min":7.798},"last":1.673},{"interface":"front","average":{"1min":1.466,"5min":1.546,"15min":1.4850000000000001},"min":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":2.2130000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.6040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193588,"statfs":{"total":200000000,"available":198234417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.004,"15min":0.98499999999999999},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.28100000000000003},"max":{"1min":1.3919999999999999,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1359999999999999,"15min":1.1100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.434},"max":{"1min":1.4890000000000001,"5min":1.73,"15min":11.173},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0640000000000001,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.39000000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":2.7240000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.0580000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0600000000000001,"15min":1.0209999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5529999999999999,"5min":1.796,"15min":5.9980000000000002},"last":1.117},{"interface":"front","average":{"1min":1.216,"5min":1.2689999999999999,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.794,"5min":1.9730000000000001,"15min":10.739000000000001},"last":1.262}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.351,"15min":1.3480000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.73199999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":6.5209999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.512,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.751},"max":{"1min":2.0739999999999998,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.536}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.375,"15min":1.369},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":2.238,"15min":2.238},"last":1},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.387,"15min":1.4239999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.72399999999999998},"max":{"1min":1.6679999999999999,"5min":1.9890000000000001,"15min":16.058},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.54,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":1.974,"5min":2.375,"15min":2.4790000000000001},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.508,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.754},"max":{"1min":1.9370000000000001,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.464}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.5629999999999999,"15min":1.5269999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.752},"max":{"1min":1.988,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.508,"15min":1.48},"min":{"1min":0.96699999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.875,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.4379999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:52:52.402 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-10T10:52:52.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:52:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.630+0000 7f619d6fa640 1 Processor -- start 2023-08-10T10:52:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.630+0000 7f619d6fa640 1 -- start start 2023-08-10T10:52:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.631+0000 7f619d6fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f619815ccb0 0x7f61980b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.631+0000 7f619d6fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f61980b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.631+0000 7f619d6fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61980696a0 0x7f6198069b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.631+0000 7f619d6fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619806a090 con 0x7f619815ccb0 2023-08-10T10:52:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f619d6fa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980719f0 con 0x7f61980696a0 2023-08-10T10:52:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f619d6fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c8db0 con 0x7f61980c9b30 2023-08-10T10:52:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f6196ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f619815ccb0 0x7f61980b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f6196ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f619815ccb0 0x7f61980b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51362/0 (socket says 172.21.15.50:51362) 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f6196ffd640 1 -- 172.21.15.50:0/1361315128 learned_addr learned my addr 172.21.15.50:0/1361315128 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f61977fe640 1 --2- 172.21.15.50:0/1361315128 >> v2:172.21.15.117:3300/0 conn(0x7f61980696a0 0x7f6198069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f618ffff640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f61980b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.632+0000 7f6196ffd640 1 -- 172.21.15.50:0/1361315128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 msgr2=0x7f61980b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.633+0000 7f6196ffd640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f61980b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.633+0000 7f6196ffd640 1 -- 172.21.15.50:0/1361315128 >> v2:172.21.15.117:3300/0 conn(0x7f61980696a0 msgr2=0x7f6198069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.633+0000 7f6196ffd640 1 --2- 172.21.15.50:0/1361315128 >> v2:172.21.15.117:3300/0 conn(0x7f61980696a0 0x7f6198069b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.633+0000 7f6196ffd640 1 -- 172.21.15.50:0/1361315128 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980c9050 con 0x7f619815ccb0 2023-08-10T10:52:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.634+0000 7f6196ffd640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980b2900 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f61980cf760 tx=0x7f618802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c742495804b49851 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.634+0000 7f61967fc640 1 -- 172.21.15.50:0/1361315128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188031870 con 0x7f619815ccb0 2023-08-10T10:52:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.634+0000 7f61967fc640 1 -- 172.21.15.50:0/1361315128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880319d0 con 0x7f619815ccb0 2023-08-10T10:52:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.634+0000 7f61967fc640 1 -- 172.21.15.50:0/1361315128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188031d60 con 0x7f619815ccb0 2023-08-10T10:52:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 -- 172.21.15.50:0/1361315128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 msgr2=0x7f61980b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980b2900 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f61980cf760 tx=0x7f618802b910 comp rx=0 tx=0).stop 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 -- 172.21.15.50:0/1361315128 shutdown_connections 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 --2- 172.21.15.50:0/1361315128 >> v2:172.21.15.117:3300/0 conn(0x7f61980696a0 0x7f6198069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f61980b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 --2- 172.21.15.50:0/1361315128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980b2900 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 -- 172.21.15.50:0/1361315128 >> 172.21.15.50:0/1361315128 conn(0x7f619806b590 msgr2=0x7f61980ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 -- 172.21.15.50:0/1361315128 shutdown_connections 2023-08-10T10:52:52.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.635+0000 7f619d6fa640 1 -- 172.21.15.50:0/1361315128 wait complete. 2023-08-10T10:52:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.637+0000 7f619d6fa640 1 Processor -- start 2023-08-10T10:52:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.637+0000 7f619d6fa640 1 -- start start 2023-08-10T10:52:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61980696a0 0x7f6198150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f6198156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981517f0 con 0x7f619815ccb0 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981576d0 con 0x7f61980696a0 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f619d6fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61981579b0 con 0x7f61980c9b30 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f61977fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f61977fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51364/0 (socket says 172.21.15.50:51364) 2023-08-10T10:52:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f61977fe640 1 -- 172.21.15.50:0/2412453692 learned_addr learned my addr 172.21.15.50:0/2412453692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f6196ffd640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61980696a0 0x7f6198150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.638+0000 7f618ffff640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f6198156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 -- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 msgr2=0x7f6198156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f6198156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 -- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61980696a0 msgr2=0x7f6198150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61980696a0 0x7f6198150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 -- 172.21.15.50:0/2412453692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880094d0 con 0x7f619815ccb0 2023-08-10T10:52:52.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f61977fe640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f6190007d20 tx=0x7f619000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190014420 con 0x7f619815ccb0 2023-08-10T10:52:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61900145a0 con 0x7f619815ccb0 2023-08-10T10:52:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190014950 con 0x7f619815ccb0 2023-08-10T10:52:52.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198157c90 con 0x7f619815ccb0 2023-08-10T10:52:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.639+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61981573c0 con 0x7f619815ccb0 2023-08-10T10:52:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.641+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61981515c0 con 0x7f619815ccb0 2023-08-10T10:52:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.642+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6190014ab0 con 0x7f619815ccb0 2023-08-10T10:52:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.643+0000 7f618f7fe640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 0x7f617806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:52.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.643+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6190089a70 con 0x7f619815ccb0 2023-08-10T10:52:52.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.643+0000 7f6196ffd640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 0x7f617806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.644+0000 7f6196ffd640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 0x7f617806d110 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6188036000 tx=0x7f618803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.647+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f61981515c0 con 0x7f619815ccb0 2023-08-10T10:52:52.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.835+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61980c9610 con 0x7f617806ac50 2023-08-10T10:52:52.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.842+0000 7f618f7fe640 1 -- 172.21.15.50:0/2412453692 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67879 (secure 0 0 0) 0x7f6188044400 con 0x7f617806ac50 2023-08-10T10:52:52.843 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:52.844 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:52:52.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 msgr2=0x7f617806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 0x7f617806d110 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6188036000 tx=0x7f618803c040 comp rx=0 tx=0).stop 2023-08-10T10:52:52.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 msgr2=0x7f61980cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:52.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f6190007d20 tx=0x7f619000e4b0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 shutdown_connections 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f619815ccb0 0x7f61980cc320 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61980c9b30 0x7f6198156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f617806ac50 0x7f617806d110 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 --2- 172.21.15.50:0/2412453692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61980696a0 0x7f6198150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 >> 172.21.15.50:0/2412453692 conn(0x7f619806b590 msgr2=0x7f6198070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 shutdown_connections 2023-08-10T10:52:52.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:52.845+0000 7f619d6fa640 1 -- 172.21.15.50:0/2412453692 wait complete. 2023-08-10T10:52:52.865 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2023-08-10T10:52:52.634245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":51277,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1511222,"statfs":{"total":1600000000,"available":1547492062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490845,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002013"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":476,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.009508+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:52:48.009508+0000","last_peered":"2023-08-10T10:52:48.009508+0000","last_clean":"2023-08-10T10:52:48.009508+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:52:48.009508+0000","last_undegraded":"2023-08-10T10:52:48.009508+0000","last_fullsized":"2023-08-10T10:52:48.009508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:23.115632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.013687+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:52:48.013687+0000","last_peered":"2023-08-10T10:52:48.013687+0000","last_clean":"2023-08-10T10:52:48.013687+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:52:48.013687+0000","last_undegraded":"2023-08-10T10:52:48.013687+0000","last_fullsized":"2023-08-10T10:52:48.013687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:14.897089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008540+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:52:48.008540+0000","last_peered":"2023-08-10T10:52:48.008540+0000","last_clean":"2023-08-10T10:52:48.008540+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:52:48.008540+0000","last_undegraded":"2023-08-10T10:52:48.008540+0000","last_fullsized":"2023-08-10T10:52:48.008540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:19.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":335,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.014359+0000","last_change":"2023-08-10T10:38:15.117610+0000","last_active":"2023-08-10T10:52:48.014359+0000","last_peered":"2023-08-10T10:52:48.014359+0000","last_clean":"2023-08-10T10:52:48.014359+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:52:48.014359+0000","last_undegraded":"2023-08-10T10:52:48.014359+0000","last_fullsized":"2023-08-10T10:52:48.014359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:48.547955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":343,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003616+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:52:48.003616+0000","last_peered":"2023-08-10T10:52:48.003616+0000","last_clean":"2023-08-10T10:52:48.003616+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:52:48.003616+0000","last_undegraded":"2023-08-10T10:52:48.003616+0000","last_fullsized":"2023-08-10T10:52:48.003616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:54.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.012927+0000","last_change":"2023-08-10T10:38:15.170526+0000","last_active":"2023-08-10T10:52:48.012927+0000","last_peered":"2023-08-10T10:52:48.012927+0000","last_clean":"2023-08-10T10:52:48.012927+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:52:48.012927+0000","last_undegraded":"2023-08-10T10:52:48.012927+0000","last_fullsized":"2023-08-10T10:52:48.012927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:02:08.962612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008370+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:52:48.008370+0000","last_peered":"2023-08-10T10:52:48.008370+0000","last_clean":"2023-08-10T10:52:48.008370+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:52:48.008370+0000","last_undegraded":"2023-08-10T10:52:48.008370+0000","last_fullsized":"2023-08-10T10:52:48.008370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:11.514997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":349,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.005555+0000","last_change":"2023-08-10T10:38:15.120128+0000","last_active":"2023-08-10T10:52:48.005555+0000","last_peered":"2023-08-10T10:52:48.005555+0000","last_clean":"2023-08-10T10:52:48.005555+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:52:48.005555+0000","last_undegraded":"2023-08-10T10:52:48.005555+0000","last_fullsized":"2023-08-10T10:52:48.005555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:51.233312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":313,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003352+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:52:48.003352+0000","last_peered":"2023-08-10T10:52:48.003352+0000","last_clean":"2023-08-10T10:52:48.003352+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:52:48.003352+0000","last_undegraded":"2023-08-10T10:52:48.003352+0000","last_fullsized":"2023-08-10T10:52:48.003352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:43.456199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193587,"statfs":{"total":200000000,"available":198233398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.143},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.39600000000000002},"max":{"1min":1.756,"5min":1.756,"15min":4.5679999999999996},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.44800000000000001},"max":{"1min":1.302,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.66500000000000004},"max":{"1min":1.6659999999999999,"5min":1.7549999999999999,"15min":4.6470000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.754,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.4930000000000001,"5min":1.958,"15min":8.0830000000000002},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.84799999999999998,"5min":0.70199999999999996,"15min":0.503},"max":{"1min":1.4690000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.323,"15min":1.2869999999999999},"min":{"1min":0.874,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":1.7589999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":1.115}]},{"osd":3,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":1.496,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.409,"15min":1.397},"min":{"1min":1.024,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.8560000000000001,"5min":1.867,"15min":6.069},"last":1.331}]},{"osd":4,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8380000000000001,"5min":1.9339999999999999,"15min":7.1950000000000003},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":0.876,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":7.4950000000000001},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4079999999999999,"15min":1.452},"min":{"1min":0.999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9790000000000001,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.643},{"interface":"front","average":{"1min":1.409,"5min":1.4279999999999999,"15min":1.48},"min":{"1min":0.998,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":1.96,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.595}]},{"osd":6,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5620000000000001,"15min":1.5740000000000001},"min":{"1min":1.26,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.0790000000000002,"5min":2.1920000000000002,"15min":8.859},"last":1.55},{"interface":"front","average":{"1min":1.474,"5min":1.48,"15min":1.496},"min":{"1min":1.081,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7969999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.506}]}]},{"osd":6,"up_from":13,"seq":55834575026,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190073,"statfs":{"total":200000000,"available":194635380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.752,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.1379999999999999,"15min":1.0860000000000001},"min":{"1min":0.81899999999999995,"5min":0.71699999999999997,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.577,"5min":1.764,"15min":2.302},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.304,"15min":1.238},"min":{"1min":0.93700000000000006,"5min":0.82999999999999996,"15min":0.70099999999999996},"max":{"1min":1.728,"5min":1.728,"15min":2.052},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.232,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.6040000000000001,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.264,"15min":1.252},"min":{"1min":0.95799999999999996,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.976,"15min":1.976},"last":1.1180000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3069999999999999,"15min":1.2909999999999999},"min":{"1min":1.016,"5min":0.94599999999999995,"15min":0.69399999999999995},"max":{"1min":1.7390000000000001,"5min":2.4009999999999998,"15min":3.177},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":1.1379999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.5740000000000001,"5min":1.9199999999999999,"15min":2.395},"last":1.032}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2789999999999999,"15min":1.262},"min":{"1min":0.86299999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.75,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.504,"15min":1.4690000000000001},"min":{"1min":0.84399999999999997,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.788,"5min":2.512,"15min":2.7589999999999999},"last":1.238}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.446,"15min":1.4419999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.59399999999999997},"max":{"1min":1.7769999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.274},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5389999999999999,"15min":1.532},"min":{"1min":1.1799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8859999999999999,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.375},"min":{"1min":0.93200000000000005,"5min":0.85399999999999998,"15min":0.53700000000000003},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.506,"15min":1.5189999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65400000000000003},"max":{"1min":1.8320000000000001,"5min":2.355,"15min":2.698},"last":1.3069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190074,"statfs":{"total":200000000,"available":194636399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.165,"15min":1.133},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.57699999999999996},"max":{"1min":1.548,"5min":1.645,"15min":2.5070000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.56599999999999995},"max":{"1min":1.708,"5min":1.857,"15min":32.941000000000003},"last":1.1759999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2729999999999999,"15min":1.2270000000000001},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.228,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.70299999999999996,"15min":0.62},"max":{"1min":1.5009999999999999,"5min":1.772,"15min":4.3360000000000003},"last":1.6739999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3260000000000001,"15min":1.276},"min":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.67500000000000004},"max":{"1min":1.764,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.52600000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.383}]},{"osd":3,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3460000000000001,"15min":1.29},"min":{"1min":1.0129999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.6970000000000001,"5min":2.016,"15min":2.016},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.349},"min":{"1min":0.83299999999999996,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.667,"5min":1.891,"15min":4.0620000000000003},"last":1.252}]},{"osd":4,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58599999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.9859999999999998},"last":1.53},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3859999999999999,"15min":1.3740000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.58099999999999996},"max":{"1min":1.708,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4770000000000001,"15min":1.407},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54200000000000004},"max":{"1min":1.792,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.577},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4179999999999999,"15min":1.417},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63600000000000001},"max":{"1min":1.8300000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5149999999999999,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.63100000000000001},"max":{"1min":1.766,"5min":2.0659999999999998,"15min":2.403},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5680000000000001,"15min":1.526},"min":{"1min":0.73599999999999999,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":1.8839999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.732}]}]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.151},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.54200000000000004},"max":{"1min":1.4790000000000001,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55600000000000005},"max":{"1min":1.6950000000000001,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.272,"15min":1.2529999999999999},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6799999999999999,"5min":1.841,"15min":3.9820000000000002},"last":1.157},{"interface":"front","average":{"1min":1.236,"5min":1.2669999999999999,"15min":1.1759999999999999},"min":{"1min":0.80300000000000005,"5min":0.752,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.5640000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2529999999999999,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.621},"max":{"1min":1.6180000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.98699999999999999,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.6539999999999999,"5min":1.6819999999999999,"15min":3.8130000000000002},"last":1.3},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.333,"15min":1.3140000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.67000000000000004},"max":{"1min":1.786,"5min":1.792,"15min":4.6859999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.64300000000000002},"max":{"1min":1.851,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.254},{"interface":"front","average":{"1min":1.383,"5min":1.3240000000000001,"15min":1.304},"min":{"1min":0.92200000000000004,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.734,"5min":1.798,"15min":2.9340000000000002},"last":1.474}]},{"osd":6,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.47099999999999997},"max":{"1min":1.6080000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.206},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.504,"15min":1.4930000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.55000000000000004},"max":{"1min":1.7869999999999999,"5min":2.121,"15min":5.1529999999999996},"last":1.345}]},{"osd":7,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.57999999999999996},"max":{"1min":1.8260000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.5740000000000001,"15min":1.546},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.67400000000000004},"max":{"1min":1.875,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.522}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173689,"statfs":{"total":200000000,"available":177858164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.998,"15min":0.93799999999999994},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.5289999999999999,"5min":2.722,"15min":2.722},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.1990000000000001,"15min":1.125},"min":{"1min":0.66500000000000004,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.5620000000000001,"5min":2.883,"15min":2.883},"last":1.012}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0069999999999999,"15min":0.93600000000000005},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.885,"15min":1.885},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.1459999999999999,"15min":1.0640000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1439999999999999,"15min":1.056},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":1.74,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.333,"15min":1.21},"min":{"1min":0.71099999999999997,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.6850000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.423,"15min":1.367},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.833,"5min":2.766,"15min":9.8149999999999995},"last":1.238},{"interface":"front","average":{"1min":1.361,"5min":1.304,"15min":1.264},"min":{"1min":0.92700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":2.0259999999999998,"15min":2.5179999999999998},"last":1.7090000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5229999999999999,"15min":1.4259999999999999},"min":{"1min":1.081,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8620000000000001,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.488,"15min":1.4350000000000001},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.9670000000000001,"5min":2.774,"15min":4.2069999999999999},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.421,"15min":1.367},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.6560000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.597,"15min":1.4950000000000001},"min":{"1min":0.95199999999999996,"5min":0.749,"15min":0.749},"max":{"1min":1.861,"5min":2.964,"15min":2.964},"last":1.425}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5860000000000001,"15min":1.5109999999999999},"min":{"1min":1.1040000000000001,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.0739999999999998,"5min":2.677,"15min":2.677},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.524,"15min":1.4430000000000001},"min":{"1min":1.002,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":2.1920000000000002,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.645}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13430,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181881,"statfs":{"total":200000000,"available":186246772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.3160000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0069999999999999,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.443},"max":{"1min":1.8140000000000001,"5min":1.825,"15min":1.825},"last":1.5580000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1279999999999999,"15min":1.087},"min":{"1min":0.61099999999999999,"5min":0.51800000000000002,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.9630000000000001},"last":1.327},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.248,"15min":1.1899999999999999},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.925,"5min":1.925,"15min":2.0310000000000001},"last":1.472}]},{"osd":3,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.028,"15min":1},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.661,"5min":1.742,"15min":1.877},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.194,"15min":1.1919999999999999},"min":{"1min":0.70499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7190000000000001,"5min":1.839,"15min":3.6920000000000002},"last":1.518}]},{"osd":4,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.391},"min":{"1min":0.96299999999999997,"5min":0.88500000000000001,"15min":0.81799999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6000000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.3560000000000001,"15min":1.333},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.64200000000000002},"max":{"1min":1.75,"5min":1.968,"15min":4.2220000000000004},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3420000000000001,"15min":1.2969999999999999},"min":{"1min":0.91700000000000004,"5min":0.90400000000000003,"15min":0.66600000000000004},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2280000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4550000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.64900000000000002},"max":{"1min":1.8200000000000001,"5min":1.968,"15min":3.294},"last":1.6659999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4430000000000001,"15min":1.4239999999999999},"min":{"1min":0.95999999999999996,"5min":0.90900000000000003,"15min":0.81599999999999995},"max":{"1min":1.7689999999999999,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.79700000000000004},"max":{"1min":1.851,"5min":1.907,"15min":2.444},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5129999999999999,"15min":1.48},"min":{"1min":0.98899999999999999,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":2.0449999999999999,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4990000000000001,"15min":1.454},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.79000000000000004},"max":{"1min":1.8029999999999999,"5min":2.0030000000000001,"15min":2.556},"last":1.1519999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92300000000000004,"15min":0.879},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":1.4319999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":1.3819999999999999,"5min":1.706,"15min":2.246},"last":1.165}]},{"osd":2,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0449999999999999,"15min":0.996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5249999999999999,"5min":1.925,"15min":2.0209999999999999},"last":1.411},{"interface":"front","average":{"1min":1.141,"5min":1.276,"15min":1.2},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.42599999999999999},"max":{"1min":1.5640000000000001,"5min":2.0019999999999998,"15min":2.423},"last":1.236}]},{"osd":3,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2110000000000001,"15min":1.1539999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.579,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.1659999999999999,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.024}]},{"osd":4,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.288,"15min":1.25},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6180000000000001,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.55},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4810000000000001,"15min":1.444},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.738,"5min":2.0499999999999998,"15min":2.343},"last":1.458}]},{"osd":5,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4379999999999999,"15min":1.4099999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.67900000000000005},"max":{"1min":1.752,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.329},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4119999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0179999999999998,"5min":2.5009999999999999,"15min":2.73},"last":1.7030000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4390000000000001,"15min":1.4119999999999999},"min":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4450000000000001,"15min":1.3779999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1200000000000001,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.633}]},{"osd":7,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.605,"15min":1.5069999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1440000000000001,"5min":7.798,"15min":7.798},"last":1.673},{"interface":"front","average":{"1min":1.466,"5min":1.546,"15min":1.4850000000000001},"min":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":2.2130000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.6040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193588,"statfs":{"total":200000000,"available":198234417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.004,"15min":0.98499999999999999},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.28100000000000003},"max":{"1min":1.3919999999999999,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1359999999999999,"15min":1.1100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.434},"max":{"1min":1.4890000000000001,"5min":1.73,"15min":11.173},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0640000000000001,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.39000000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":2.7240000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.0580000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0600000000000001,"15min":1.0209999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5529999999999999,"5min":1.796,"15min":5.9980000000000002},"last":1.117},{"interface":"front","average":{"1min":1.216,"5min":1.2689999999999999,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.794,"5min":1.9730000000000001,"15min":10.739000000000001},"last":1.262}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.351,"15min":1.3480000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.73199999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":6.5209999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.512,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.751},"max":{"1min":2.0739999999999998,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.536}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.375,"15min":1.369},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":2.238,"15min":2.238},"last":1},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.387,"15min":1.4239999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.72399999999999998},"max":{"1min":1.6679999999999999,"5min":1.9890000000000001,"15min":16.058},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.54,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":1.974,"5min":2.375,"15min":2.4790000000000001},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.508,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.754},"max":{"1min":1.9370000000000001,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.464}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.5629999999999999,"15min":1.5269999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.752},"max":{"1min":1.988,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.508,"15min":1.48},"min":{"1min":0.96699999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.875,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.4379999999999999}]}]}],"pool_statfs":[]}} 2023-08-10T10:52:52.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:52:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.095+0000 7fbeae0fa640 1 Processor -- start 2023-08-10T10:52:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.095+0000 7fbeae0fa640 1 -- start start 2023-08-10T10:52:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbea80cb9b0 0x7fbea80cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbea8070990 0x7fbea815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8065bd0 0x7fbea806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea80cc2d0 con 0x7fbea8070990 2023-08-10T10:52:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea8070e50 con 0x7fbea80cb9b0 2023-08-10T10:52:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.096+0000 7fbeae0fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8071130 con 0x7fbea8065bd0 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.097+0000 7fbe9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbea8070990 0x7fbea815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.097+0000 7fbe9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbea8070990 0x7fbea815eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51374/0 (socket says 172.21.15.50:51374) 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.097+0000 7fbe9effd640 1 -- 172.21.15.50:0/405142403 learned_addr learned my addr 172.21.15.50:0/405142403 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.097+0000 7fbea77fe640 1 --2- 172.21.15.50:0/405142403 >> v2:172.21.15.117:3300/0 conn(0x7fbea80cb9b0 0x7fbea80cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.097+0000 7fbea7fff640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8065bd0 0x7fbea806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.098+0000 7fbe9effd640 1 -- 172.21.15.50:0/405142403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8065bd0 msgr2=0x7fbea806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.098+0000 7fbe9effd640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8065bd0 0x7fbea806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.098+0000 7fbe9effd640 1 -- 172.21.15.50:0/405142403 >> v2:172.21.15.117:3300/0 conn(0x7fbea80cb9b0 msgr2=0x7fbea80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.098+0000 7fbe9effd640 1 --2- 172.21.15.50:0/405142403 >> v2:172.21.15.117:3300/0 conn(0x7fbea80cb9b0 0x7fbea80cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.098+0000 7fbe9effd640 1 -- 172.21.15.50:0/405142403 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8071410 con 0x7fbea8070990 2023-08-10T10:52:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.099+0000 7fbe9effd640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea8070990 0x7fbea815eca0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fbea806c3f0 tx=0x7fbe9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b7b8d0f2b0c8a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.099+0000 7fbea6ffd640 1 -- 172.21.15.50:0/405142403 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900317e0 con 0x7fbea8070990 2023-08-10T10:52:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.099+0000 7fbea6ffd640 1 -- 172.21.15.50:0/405142403 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90031940 con 0x7fbea8070990 2023-08-10T10:52:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.099+0000 7fbea6ffd640 1 -- 172.21.15.50:0/405142403 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90031cd0 con 0x7fbea8070990 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 -- 172.21.15.50:0/405142403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea8070990 msgr2=0x7fbea815eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea8070990 0x7fbea815eca0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fbea806c3f0 tx=0x7fbe9002b880 comp rx=0 tx=0).stop 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 -- 172.21.15.50:0/405142403 shutdown_connections 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8065bd0 0x7fbea806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/405142403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea8070990 0x7fbea815eca0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/405142403 >> v2:172.21.15.117:3300/0 conn(0x7fbea80cb9b0 0x7fbea80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 -- 172.21.15.50:0/405142403 >> 172.21.15.50:0/405142403 conn(0x7fbea80cefa0 msgr2=0x7fbea80cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 -- 172.21.15.50:0/405142403 shutdown_connections 2023-08-10T10:52:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.100+0000 7fbeae0fa640 1 -- 172.21.15.50:0/405142403 wait complete. 2023-08-10T10:52:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.102+0000 7fbeae0fa640 1 Processor -- start 2023-08-10T10:52:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.102+0000 7fbeae0fa640 1 -- start start 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 0x7fbea80cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8070990 0x7fbea80c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea815baa0 con 0x7fbea80cb9b0 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80c2ad0 con 0x7fbea8065bd0 2023-08-10T10:52:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbeae0fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80c2db0 con 0x7fbea8070990 2023-08-10T10:52:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbea7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51390/0 (socket says 172.21.15.50:51390) 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.103+0000 7fbea7fff640 1 -- 172.21.15.50:0/4034828981 learned_addr learned my addr 172.21.15.50:0/4034828981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbe9effd640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8070990 0x7fbea80c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea77fe640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 0x7fbea80cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 -- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8070990 msgr2=0x7fbea80c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8070990 0x7fbea80c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 -- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 msgr2=0x7fbea80cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 0x7fbea80cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 -- 172.21.15.50:0/4034828981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900094d0 con 0x7fbea80cb9b0 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea77fe640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 0x7fbea80cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea7fff640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fbea000d5d0 tx=0x7fbea000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.104+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea00125f0 con 0x7fbea80cb9b0 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.105+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0012770 con 0x7fbea80cb9b0 2023-08-10T10:52:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.105+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0012b20 con 0x7fbea80cb9b0 2023-08-10T10:52:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.105+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea80c3090 con 0x7fbea80cb9b0 2023-08-10T10:52:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.105+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea80c3650 con 0x7fbea80cb9b0 2023-08-10T10:52:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.106+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea804e270 con 0x7fbea80cb9b0 2023-08-10T10:52:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.107+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbea0012c80 con 0x7fbea80cb9b0 2023-08-10T10:52:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.108+0000 7fbea4ff9640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 0x7fbe8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.108+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbea0089730 con 0x7fbea80cb9b0 2023-08-10T10:52:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.108+0000 7fbea77fe640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 0x7fbe8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.109+0000 7fbea77fe640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 0x7fbe8806d110 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbea80ce870 tx=0x7fbe9800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.112+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbea0054a70 con 0x7fbea80cb9b0 2023-08-10T10:52:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.305+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbea80c92d0 con 0x7fbea80cb9b0 2023-08-10T10:52:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.306+0000 7fbea4ff9640 1 -- 172.21.15.50:0/4034828981 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+14768 (secure 0 0 0) 0x7fbea0058090 con 0x7fbea80cb9b0 2023-08-10T10:52:53.307 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:52:53.308 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":195,"fsid":"6795d532-1ac6-4473-b42c-017ab0d4d08a","created":"2023-08-10T10:38:01.359846+0000","modified":"2023-08-10T10:52:47.984342+0000","last_up_change":"2023-08-10T10:38:07.839441+0000","last_in_change":"2023-08-10T10:38:04.816895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:38:08.392868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:38:14.051975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6821","nonce":274313722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6824","nonce":274313722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6831","nonce":274313722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":274313722},{"type":"v1","addr":"172.21.15.50:6827","nonce":274313722}]},"public_addr":"172.21.15.50:6821/274313722","cluster_addr":"172.21.15.50:6824/274313722","heartbeat_back_addr":"172.21.15.50:6831/274313722","heartbeat_front_addr":"172.21.15.50:6827/274313722","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6817","nonce":534751664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6820","nonce":534751664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6830","nonce":534751664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":534751664},{"type":"v1","addr":"172.21.15.50:6825","nonce":534751664}]},"public_addr":"172.21.15.50:6817/534751664","cluster_addr":"172.21.15.50:6820/534751664","heartbeat_back_addr":"172.21.15.50:6830/534751664","heartbeat_front_addr":"172.21.15.50:6825/534751664","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6801","nonce":2061476148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6803","nonce":2061476148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6807","nonce":2061476148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2061476148},{"type":"v1","addr":"172.21.15.50:6805","nonce":2061476148}]},"public_addr":"172.21.15.50:6801/2061476148","cluster_addr":"172.21.15.50:6803/2061476148","heartbeat_back_addr":"172.21.15.50:6807/2061476148","heartbeat_front_addr":"172.21.15.50:6805/2061476148","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6809","nonce":1161775809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6811","nonce":1161775809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6815","nonce":1161775809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1161775809},{"type":"v1","addr":"172.21.15.50:6813","nonce":1161775809}]},"public_addr":"172.21.15.50:6809/1161775809","cluster_addr":"172.21.15.50:6811/1161775809","heartbeat_back_addr":"172.21.15.50:6815/1161775809","heartbeat_front_addr":"172.21.15.50:6813/1161775809","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6817","nonce":4052651543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6819","nonce":4052651543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6823","nonce":4052651543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4052651543},{"type":"v1","addr":"172.21.15.117:6821","nonce":4052651543}]},"public_addr":"172.21.15.117:6817/4052651543","cluster_addr":"172.21.15.117:6819/4052651543","heartbeat_back_addr":"172.21.15.117:6823/4052651543","heartbeat_front_addr":"172.21.15.117:6821/4052651543","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3863318081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3863318081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3863318081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3863318081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3863318081}]},"public_addr":"172.21.15.117:6801/3863318081","cluster_addr":"172.21.15.117:6803/3863318081","heartbeat_back_addr":"172.21.15.117:6807/3863318081","heartbeat_front_addr":"172.21.15.117:6805/3863318081","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6809","nonce":1322471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6811","nonce":1322471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6815","nonce":1322471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1322471095},{"type":"v1","addr":"172.21.15.117:6813","nonce":1322471095}]},"public_addr":"172.21.15.117:6809/1322471095","cluster_addr":"172.21.15.117:6811/1322471095","heartbeat_back_addr":"172.21.15.117:6815/1322471095","heartbeat_front_addr":"172.21.15.117:6813/1322471095","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6825","nonce":3330340519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6827","nonce":3330340519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6831","nonce":3330340519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3330340519},{"type":"v1","addr":"172.21.15.117:6829","nonce":3330340519}]},"public_addr":"172.21.15.117:6825/3330340519","cluster_addr":"172.21.15.117:6827/3330340519","heartbeat_back_addr":"172.21.15.117:6831/3330340519","heartbeat_front_addr":"172.21.15.117:6829/3330340519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.090853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.159416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.039936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.122269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.077187+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.098045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.063734+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:38:06.116993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6836/3577041513":"2023-08-11T10:52:44.556164+0000","172.21.15.50:6834/3577041513":"2023-08-11T10:52:44.556164+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:52:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 msgr2=0x7fbe8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 0x7fbe8806d110 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbea80ce870 tx=0x7fbe9800b040 comp rx=0 tx=0).stop 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 msgr2=0x7fbea81f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fbea000d5d0 tx=0x7fbea000da90 comp rx=0 tx=0).stop 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 shutdown_connections 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea80cb9b0 0x7fbea81f5f10 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea8070990 0x7fbea80c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fbe8806ac50 0x7fbe8806d110 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 --2- 172.21.15.50:0/4034828981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8065bd0 0x7fbea80cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 >> 172.21.15.50:0/4034828981 conn(0x7fbea80cefa0 msgr2=0x7fbea80ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 shutdown_connections 2023-08-10T10:52:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:53.309+0000 7fbeae0fa640 1 -- 172.21.15.50:0/4034828981 wait complete. 2023-08-10T10:52:54.330 INFO:tasks.ceph:Scrubbing osd.0 2023-08-10T10:52:54.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.572+0000 7f82a1271640 1 Processor -- start 2023-08-10T10:52:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.572+0000 7f82a1271640 1 -- start start 2023-08-10T10:52:54.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f82a1271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c0cd660 0x7f829c06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f82a1271640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f829c0b1e00 0x7f829c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f82a1271640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c06a5c0 con 0x7f829c15fde0 2023-08-10T10:52:54.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f82a1271640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c06b0c0 con 0x7f829c0b1e00 2023-08-10T10:52:54.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f82a1271640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c06a820 con 0x7f829c0cd660 2023-08-10T10:52:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f829bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f829c15fde0 0x7f829c0ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49208/0 (socket says 172.21.15.50:49208) 2023-08-10T10:52:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.573+0000 7f829bfff640 1 -- 172.21.15.50:0/365691051 learned_addr learned my addr 172.21.15.50:0/365691051 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f82a0a70640 1 --2- 172.21.15.50:0/365691051 >> v2:172.21.15.50:3300/0 conn(0x7f829c0b1e00 0x7f829c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f829b7fe640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c0cd660 0x7f829c06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f829affd640 1 -- 172.21.15.50:0/365691051 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996987364 0 0) 0x7f829c06a5c0 con 0x7f829c15fde0 2023-08-10T10:52:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f829affd640 1 -- 172.21.15.50:0/365691051 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8288003520 con 0x7f829c15fde0 2023-08-10T10:52:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f82a0a70640 1 -- 172.21.15.50:0/365691051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c0cd660 msgr2=0x7f829c06a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f82a0a70640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c0cd660 0x7f829c06a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f82a0a70640 1 -- 172.21.15.50:0/365691051 >> v1:172.21.15.50:6789/0 conn(0x7f829c15fde0 legacy=0x7f829c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.574+0000 7f82a0a70640 1 -- 172.21.15.50:0/365691051 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c06ab00 con 0x7f829c0b1e00 2023-08-10T10:52:54.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.575+0000 7f82a0a70640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c0d0b20 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f82940097a0 tx=0x7f829402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d322b479ca7c102 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.576+0000 7f829affd640 1 -- 172.21.15.50:0/365691051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940316f0 con 0x7f829c0b1e00 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.576+0000 7f829affd640 1 -- 172.21.15.50:0/365691051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294031850 con 0x7f829c0b1e00 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.576+0000 7f829affd640 1 -- 172.21.15.50:0/365691051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294031bc0 con 0x7f829c0b1e00 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.576+0000 7f82a1271640 1 -- 172.21.15.50:0/365691051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 msgr2=0x7f829c0d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.576+0000 7f82a1271640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c0d0b20 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f82940097a0 tx=0x7f829402b790 comp rx=0 tx=0).stop 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 -- 172.21.15.50:0/365691051 shutdown_connections 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c0d0b20 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 --2- 172.21.15.50:0/365691051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c0cd660 0x7f829c06a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 -- 172.21.15.50:0/365691051 >> 172.21.15.50:0/365691051 conn(0x7f829c0d2900 msgr2=0x7f829c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 -- 172.21.15.50:0/365691051 shutdown_connections 2023-08-10T10:52:54.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.577+0000 7f82a1271640 1 -- 172.21.15.50:0/365691051 wait complete. 2023-08-10T10:52:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.578+0000 7f82a1271640 1 Processor -- start 2023-08-10T10:52:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.579+0000 7f82a1271640 1 -- start start 2023-08-10T10:52:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.579+0000 7f82a1271640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.579+0000 7f82a1271640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f829c0cd660 0x7f829c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f82a1271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c15fde0 0x7f829c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f82a1271640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c8300 con 0x7f829c0b1e00 2023-08-10T10:52:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f82a1271640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c85e0 con 0x7f829c0cd660 2023-08-10T10:52:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f82a1271640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c88c0 con 0x7f829c15fde0 2023-08-10T10:52:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51400/0 (socket says 172.21.15.50:51400) 2023-08-10T10:52:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 -- 172.21.15.50:0/1843919884 learned_addr learned my addr 172.21.15.50:0/1843919884 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 -- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c15fde0 msgr2=0x7f829c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f829c15fde0 0x7f829c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829b7fe640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f829c0cd660 0x7f829c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 -- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f829c0cd660 msgr2=0x7f829c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f829c0cd660 0x7f829c0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829bfff640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009400 con 0x7f829c0b1e00 2023-08-10T10:52:54.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.580+0000 7f829b7fe640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f829c0cd660 0x7f829c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:54.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f829bfff640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c15c570 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f828c00cb40 tx=0x7f828c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00aca0 con 0x7f829c0b1e00 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00ae00 con 0x7f829c0b1e00 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c012620 con 0x7f829c0b1e00 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0c8ba0 con 0x7f829c0b1e00 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.581+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0c7540 con 0x7f829c0b1e00 2023-08-10T10:52:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.582+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f829c0c8750 con 0x7f829c0b1e00 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.583+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f828c007070 con 0x7f829c0b1e00 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.584+0000 7f8298ff9640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f827c06ac50 0x7f827c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.584+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f828c089260 con 0x7f829c0b1e00 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.584+0000 7f8298ff9640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f827c0710d0 0x7f827c0734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.584+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f827c073ba0 con 0x7f827c0710d0 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.585+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828c08b840 con 0x7f829c0b1e00 2023-08-10T10:52:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.585+0000 7f829b7fe640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f827c06ac50 0x7f827c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.585+0000 7f82a0a70640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f827c0710d0 0x7f827c0734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.585+0000 7f829b7fe640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f827c06ac50 0x7f827c06d110 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8284006fd0 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.585+0000 7f82a0a70640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f827c0710d0 0x7f827c0734f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.586+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== osd.0 v2:172.21.15.50:6819/274313722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f827c073ba0 con 0x7f827c0710d0 2023-08-10T10:52:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.599+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 --> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f829c0c8a30 con 0x7f827c0710d0 2023-08-10T10:52:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f8298ff9640 1 -- 172.21.15.50:0/1843919884 <== osd.0 v2:172.21.15.50:6819/274313722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f829c0c8a30 con 0x7f827c0710d0 2023-08-10T10:52:54.600 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:54.601 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:54.601 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f827c0710d0 msgr2=0x7f827c0734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6819/274313722,v1:172.21.15.50:6821/274313722] conn(0x7f827c0710d0 0x7f827c0734f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f827c06ac50 msgr2=0x7f827c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f827c06ac50 0x7f827c06d110 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8284006fd0 tx=0x7f8284008040 comp rx=0 tx=0).stop 2023-08-10T10:52:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 msgr2=0x7f829c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 --2- 172.21.15.50:0/1843919884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c0b1e00 0x7f829c15c570 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f828c00cb40 tx=0x7f828c00a060 comp rx=0 tx=0).stop 2023-08-10T10:52:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a0a70640 1 -- 172.21.15.50:0/1843919884 reap_dead start 2023-08-10T10:52:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 shutdown_connections 2023-08-10T10:52:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 >> 172.21.15.50:0/1843919884 conn(0x7f829c0d2900 msgr2=0x7f829c065340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 shutdown_connections 2023-08-10T10:52:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.600+0000 7f82a1271640 1 -- 172.21.15.50:0/1843919884 wait complete. 2023-08-10T10:52:54.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-10T10:52:54.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.850+0000 7f3333353640 1 Processor -- start 2023-08-10T10:52:54.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.851+0000 7f3333353640 1 -- start start 2023-08-10T10:52:54.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.852+0000 7f3333353640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c15c8d0 0x7f332c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.852+0000 7f3333353640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15d960 0x7f332c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.852+0000 7f3333353640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c1606f0 con 0x7f332c15ccb0 2023-08-10T10:52:54.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.852+0000 7f3333353640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c15dda0 con 0x7f332c15c8d0 2023-08-10T10:52:54.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.852+0000 7f3333353640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c15df80 con 0x7f332c15d960 2023-08-10T10:52:54.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c15c8d0 0x7f332c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f332c15c8d0 0x7f332c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51408/0 (socket says 172.21.15.50:51408) 2023-08-10T10:52:54.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3331b50640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f332c15ccb0 0x7f332c15d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49212/0 (socket says 172.21.15.50:49212) 2023-08-10T10:52:54.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 -- 172.21.15.50:0/513843336 learned_addr learned my addr 172.21.15.50:0/513843336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:54.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332b52640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15d960 0x7f332c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 -- 172.21.15.50:0/513843336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15d960 msgr2=0x7f332c069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:54.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15d960 0x7f332c069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 -- 172.21.15.50:0/513843336 >> v1:172.21.15.50:6789/0 conn(0x7f332c15ccb0 legacy=0x7f332c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f3332351640 1 -- 172.21.15.50:0/513843336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c160990 con 0x7f332c15c8d0 2023-08-10T10:52:54.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.853+0000 7f333134f640 1 -- 172.21.15.50:0/513843336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658790888 0 0) 0x7f332c1606f0 con 0x7f332c15ccb0 2023-08-10T10:52:54.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.854+0000 7f3332351640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15c8d0 0x7f332c0696a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c680a67d3827c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f333134f640 1 -- 172.21.15.50:0/513843336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328030840 con 0x7f332c15c8d0 2023-08-10T10:52:54.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f333134f640 1 -- 172.21.15.50:0/513843336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280309a0 con 0x7f332c15c8d0 2023-08-10T10:52:54.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f333134f640 1 -- 172.21.15.50:0/513843336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328030d30 con 0x7f332c15c8d0 2023-08-10T10:52:54.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 -- 172.21.15.50:0/513843336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15c8d0 msgr2=0x7f332c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15c8d0 0x7f332c0696a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332802b980 comp rx=0 tx=0).stop 2023-08-10T10:52:54.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 -- 172.21.15.50:0/513843336 shutdown_connections 2023-08-10T10:52:54.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15d960 0x7f332c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 --2- 172.21.15.50:0/513843336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15c8d0 0x7f332c0696a0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.855+0000 7f3333353640 1 -- 172.21.15.50:0/513843336 >> 172.21.15.50:0/513843336 conn(0x7f332c0cafa0 msgr2=0x7f332c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:54.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.856+0000 7f3333353640 1 -- 172.21.15.50:0/513843336 shutdown_connections 2023-08-10T10:52:54.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.856+0000 7f3333353640 1 -- 172.21.15.50:0/513843336 wait complete. 2023-08-10T10:52:54.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.858+0000 7f3333353640 1 Processor -- start 2023-08-10T10:52:54.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.858+0000 7f3333353640 1 -- start start 2023-08-10T10:52:54.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15c8d0 0x7f332c0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15ccb0 0x7f332c1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c06e840 con 0x7f332c15d960 2023-08-10T10:52:54.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1f3170 con 0x7f332c15c8d0 2023-08-10T10:52:54.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3333353640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0cf110 con 0x7f332c15ccb0 2023-08-10T10:52:54.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3332b52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3332b52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51418/0 (socket says 172.21.15.50:51418) 2023-08-10T10:52:54.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3332b52640 1 -- 172.21.15.50:0/4032064212 learned_addr learned my addr 172.21.15.50:0/4032064212 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:54.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.859+0000 7f3332351640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15c8d0 0x7f332c0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 -- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15ccb0 msgr2=0x7f332c1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15ccb0 0x7f332c1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 -- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15c8d0 msgr2=0x7f332c0c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:54.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15c8d0 0x7f332c0c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:54.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 -- 172.21.15.50:0/4032064212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280094d0 con 0x7f332c15d960 2023-08-10T10:52:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3332b52640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f3324007e40 tx=0x7f332400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324014620 con 0x7f332c15d960 2023-08-10T10:52:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400ee90 con 0x7f332c15d960 2023-08-10T10:52:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240149e0 con 0x7f332c15d960 2023-08-10T10:52:54.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c159060 con 0x7f332c15d960 2023-08-10T10:52:54.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.860+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c0b2220 con 0x7f332c15d960 2023-08-10T10:52:54.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.861+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c066e30 con 0x7f332c15d960 2023-08-10T10:52:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.863+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3324014b40 con 0x7f332c15d960 2023-08-10T10:52:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.864+0000 7f3322ffd640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.864+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3324089c60 con 0x7f332c15d960 2023-08-10T10:52:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.864+0000 7f3332351640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.865+0000 7f3332351640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3328036000 tx=0x7f332803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:54.868+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3324054f90 con 0x7f332c15d960 2023-08-10T10:52:55.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.061+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f332c160f50 con 0x7f331006ac50 2023-08-10T10:52:55.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.062+0000 7f3322ffd640 1 -- 172.21.15.50:0/4032064212 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3328030b90 con 0x7f331006ac50 2023-08-10T10:52:55.062 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 msgr2=0x7f331006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3328036000 tx=0x7f332803b040 comp rx=0 tx=0).stop 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 msgr2=0x7f332c158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f3324007e40 tx=0x7f332400e4b0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 shutdown_connections 2023-08-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f332c15d960 0x7f332c158b20 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f332c15ccb0 0x7f332c1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f331006ac50 0x7f331006d110 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 --2- 172.21.15.50:0/4032064212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f332c15c8d0 0x7f332c0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.064+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 >> 172.21.15.50:0/4032064212 conn(0x7f332c0cafa0 msgr2=0x7f332c0696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.065+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 shutdown_connections 2023-08-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.065+0000 7f3333353640 1 -- 172.21.15.50:0/4032064212 wait complete. 2023-08-10T10:52:55.084 INFO:tasks.ceph:Scrubbing osd.1 2023-08-10T10:52:55.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.316+0000 7f8d6fdcb640 1 Processor -- start 2023-08-10T10:52:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.316+0000 7f8d6fdcb640 1 -- start start 2023-08-10T10:52:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.317+0000 7f8d6fdcb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d680ac890 0x7f8d680ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.317+0000 7f8d6fdcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6806f550 0x7f8d6806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6fdcb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d680cae00 con 0x7f8d680acc70 2023-08-10T10:52:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6fdcb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680c9150 con 0x7f8d680ac890 2023-08-10T10:52:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6fdcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680ca840 con 0x7f8d6806f550 2023-08-10T10:52:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6db67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d680ac890 0x7f8d680ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6e368640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6806f550 0x7f8d6806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6db67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d680ac890 0x7f8d680ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.50:51068/0 (socket says 172.21.15.50:51068) 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6db67640 1 -- 172.21.15.50:0/3916702880 learned_addr learned my addr 172.21.15.50:0/3916702880 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.318+0000 7f8d6d366640 1 --1- 172.21.15.50:0/3916702880 >> v1:172.21.15.117:6789/0 conn(0x7f8d680acc70 0x7f8d680cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:56206/0 (socket says 172.21.15.50:56206) 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.319+0000 7f8d6db67640 1 -- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6806f550 msgr2=0x7f8d6806f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.319+0000 7f8d6db67640 1 --2- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6806f550 0x7f8d6806f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.319+0000 7f8d6db67640 1 -- 172.21.15.50:0/3916702880 >> v1:172.21.15.117:6789/0 conn(0x7f8d680acc70 legacy=0x7f8d680cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.319+0000 7f8d6db67640 1 -- 172.21.15.50:0/3916702880 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680cab20 con 0x7f8d680ac890 2023-08-10T10:52:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.320+0000 7f8d6db67640 1 --2- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680ca160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009870 tx=0x7f8d6402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63dbb8414cce3476 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.321+0000 7f8d6cb65640 1 -- 172.21.15.50:0/3916702880 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640317c0 con 0x7f8d680ac890 2023-08-10T10:52:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.321+0000 7f8d6cb65640 1 -- 172.21.15.50:0/3916702880 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64031920 con 0x7f8d680ac890 2023-08-10T10:52:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.321+0000 7f8d6cb65640 1 -- 172.21.15.50:0/3916702880 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64031cb0 con 0x7f8d680ac890 2023-08-10T10:52:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.321+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 msgr2=0x7f8d680ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.321+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680ca160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009870 tx=0x7f8d6402b860 comp rx=0 tx=0).stop 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/3916702880 shutdown_connections 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6806f550 0x7f8d6806f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/3916702880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680ca160 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/3916702880 >> 172.21.15.50:0/3916702880 conn(0x7f8d680b08e0 msgr2=0x7f8d680ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/3916702880 shutdown_connections 2023-08-10T10:52:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.322+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/3916702880 wait complete. 2023-08-10T10:52:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.324+0000 7f8d6fdcb640 1 Processor -- start 2023-08-10T10:52:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.324+0000 7f8d6fdcb640 1 -- start start 2023-08-10T10:52:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 0x7f8d68151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d680acc70 0x7f8d680aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6815e000 con 0x7f8d6806f550 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6806c110 con 0x7f8d680ac890 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6fdcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681f3350 con 0x7f8d680acc70 2023-08-10T10:52:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6db67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 0x7f8d68151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6db67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 0x7f8d68151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43124/0 (socket says 172.21.15.50:43124) 2023-08-10T10:52:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6db67640 1 -- 172.21.15.50:0/1111002162 learned_addr learned my addr 172.21.15.50:0/1111002162 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6e368640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d680acc70 0x7f8d680aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.325+0000 7f8d6d366640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 -- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d680acc70 msgr2=0x7f8d680aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d680acc70 0x7f8d680aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 -- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 msgr2=0x7f8d680aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d680ac890 0x7f8d680aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640094d0 con 0x7f8d6806f550 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6db67640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 0x7f8d68151c30 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f8d640090b0 tx=0x7f8d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64032860 con 0x7f8d6806f550 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d640329c0 con 0x7f8d6806f550 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64032d70 con 0x7f8d6806f550 2023-08-10T10:52:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.326+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6815e270 con 0x7f8d6806f550 2023-08-10T10:52:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.327+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d681f3630 con 0x7f8d6806f550 2023-08-10T10:52:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.327+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d680ad0d0 con 0x7f8d6806f550 2023-08-10T10:52:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.329+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d6404d3f0 con 0x7f8d6806f550 2023-08-10T10:52:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d5e7fc640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8d4c06ac50 0x7f8d4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8d640ab180 con 0x7f8d6806f550 2023-08-10T10:52:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d5e7fc640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f8d4c0710d0 0x7f8d4c0734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d4c073ba0 con 0x7f8d4c0710d0 2023-08-10T10:52:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d640ab5b0 con 0x7f8d6806f550 2023-08-10T10:52:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d6d366640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8d4c06ac50 0x7f8d4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.330+0000 7f8d6e368640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f8d4c0710d0 0x7f8d4c0734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.331+0000 7f8d6d366640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8d4c06ac50 0x7f8d4c06d110 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8d68070920 tx=0x7f8d58007cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.331+0000 7f8d6e368640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f8d4c0710d0 0x7f8d4c0734f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.332+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== osd.1 v2:172.21.15.50:6816/534751664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f8d4c073ba0 con 0x7f8d4c0710d0 2023-08-10T10:52:55.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.344+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 --> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d680663d0 con 0x7f8d4c0710d0 2023-08-10T10:52:55.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d5e7fc640 1 -- 172.21.15.50:0/1111002162 <== osd.1 v2:172.21.15.50:6816/534751664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f8d680663d0 con 0x7f8d4c0710d0 2023-08-10T10:52:55.346 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:55.346 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:55.346 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f8d4c0710d0 msgr2=0x7f8d4c0734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6816/534751664,v1:172.21.15.50:6817/534751664] conn(0x7f8d4c0710d0 0x7f8d4c0734f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8d4c06ac50 msgr2=0x7f8d4c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8d4c06ac50 0x7f8d4c06d110 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8d68070920 tx=0x7f8d58007cc0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 msgr2=0x7f8d68151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6fdcb640 1 --2- 172.21.15.50:0/1111002162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6806f550 0x7f8d68151c30 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f8d640090b0 tx=0x7f8d640046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.345+0000 7f8d6e368640 1 -- 172.21.15.50:0/1111002162 reap_dead start 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.346+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 shutdown_connections 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.346+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 >> 172.21.15.50:0/1111002162 conn(0x7f8d680b08e0 msgr2=0x7f8d680c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.346+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 shutdown_connections 2023-08-10T10:52:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.346+0000 7f8d6fdcb640 1 -- 172.21.15.50:0/1111002162 wait complete. 2023-08-10T10:52:55.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-10T10:52:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.588+0000 7f2fb759e640 1 Processor -- start 2023-08-10T10:52:55.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.588+0000 7f2fb759e640 1 -- start start 2023-08-10T10:52:55.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80cd960 0x7f2fb8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb759e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb8160370 con 0x7f2fb80d28b0 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb80d0d90 con 0x7f2fb815ff90 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb759e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb80d0b90 con 0x7f2fb80cd960 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80cd960 0x7f2fb8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80cd960 0x7f2fb8160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43140/0 (socket says 172.21.15.50:43140) 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2fb80d28b0 0x7f2fb80d2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59726/0 (socket says 172.21.15.50:59726) 2023-08-10T10:52:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/3172859220 learned_addr learned my addr 172.21.15.50:0/3172859220 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:55.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/3172859220 >> v1:172.21.15.117:6789/0 conn(0x7f2fb815ff90 legacy=0x7f2fb80d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:55.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/3172859220 >> v1:172.21.15.50:6789/0 conn(0x7f2fb80d28b0 legacy=0x7f2fb80d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.590+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/3172859220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80d1070 con 0x7f2fb80cd960 2023-08-10T10:52:55.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.591+0000 7f2fb5d9b640 1 --2- 172.21.15.50:0/3172859220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cd960 0x7f2fb8160f90 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8c4942a80c4172 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb559a640 1 -- 172.21.15.50:0/3172859220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac030860 con 0x7f2fb80cd960 2023-08-10T10:52:55.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb559a640 1 -- 172.21.15.50:0/3172859220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0309c0 con 0x7f2fb80cd960 2023-08-10T10:52:55.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb559a640 1 -- 172.21.15.50:0/3172859220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac030d50 con 0x7f2fb80cd960 2023-08-10T10:52:55.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 -- 172.21.15.50:0/3172859220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cd960 msgr2=0x7f2fb8160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 --2- 172.21.15.50:0/3172859220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cd960 0x7f2fb8160f90 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac02b9a0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 -- 172.21.15.50:0/3172859220 shutdown_connections 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 --2- 172.21.15.50:0/3172859220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cd960 0x7f2fb8160f90 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 -- 172.21.15.50:0/3172859220 >> 172.21.15.50:0/3172859220 conn(0x7f2fb8069ac0 msgr2=0x7f2fb8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.592+0000 7f2fb759e640 1 -- 172.21.15.50:0/3172859220 shutdown_connections 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.593+0000 7f2fb759e640 1 -- 172.21.15.50:0/3172859220 wait complete. 2023-08-10T10:52:55.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.594+0000 7f2fb759e640 1 Processor -- start 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.594+0000 7f2fb759e640 1 -- start start 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fb80cd960 0x7f2fb8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb815ff90 0x7f2fb81e7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81e8950 con 0x7f2fb80d28b0 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81555b0 con 0x7f2fb815ff90 2023-08-10T10:52:55.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.595+0000 7f2fb759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80b4bb0 con 0x7f2fb80cd960 2023-08-10T10:52:55.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43146/0 (socket says 172.21.15.50:43146) 2023-08-10T10:52:55.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/4023314868 learned_addr learned my addr 172.21.15.50:0/4023314868 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:55.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fb80cd960 msgr2=0x7f2fb8155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fb80cd960 0x7f2fb8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb815ff90 msgr2=0x7f2fb81e7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb815ff90 0x7f2fb81e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 -- 172.21.15.50:0/4023314868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094d0 con 0x7f2fb80d28b0 2023-08-10T10:52:55.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.596+0000 7f2fb5d9b640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.597+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac030810 con 0x7f2fb80d28b0 2023-08-10T10:52:55.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.597+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac043400 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.597+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0437b0 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.597+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb80b4e90 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.597+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb81e85e0 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.598+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb8066e30 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.599+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fac043910 con 0x7f2fb80d28b0 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.600+0000 7f2fa6ffd640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 0x7f2f9806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:55.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.600+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2fac03e070 con 0x7f2fb80d28b0 2023-08-10T10:52:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.600+0000 7f2fb659c640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 0x7f2f9806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.601+0000 7f2fb659c640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 0x7f2f9806d140 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8006fd0 tx=0x7f2fa8006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.604+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2fac077930 con 0x7f2fb80d28b0 2023-08-10T10:52:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.796+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fb80d1630 con 0x7f2f9806ac80 2023-08-10T10:52:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.796+0000 7f2fa6ffd640 1 -- 172.21.15.50:0/4023314868 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2fa8004020 con 0x7f2f9806ac80 2023-08-10T10:52:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2023-08-10T10:52:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.798+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 msgr2=0x7f2f9806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.798+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 0x7f2f9806d140 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8006fd0 tx=0x7f2fa8006bc0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.798+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 msgr2=0x7f2fb81e5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.798+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac004730 comp rx=0 tx=0).stop 2023-08-10T10:52:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 shutdown_connections 2023-08-10T10:52:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f2f9806ac80 0x7f2f9806d140 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb815ff90 0x7f2fb81e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80d28b0 0x7f2fb81e5eb0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 --2- 172.21.15.50:0/4023314868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fb80cd960 0x7f2fb8155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 >> 172.21.15.50:0/4023314868 conn(0x7f2fb8069ac0 msgr2=0x7f2fb80b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 shutdown_connections 2023-08-10T10:52:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:55.799+0000 7f2fb759e640 1 -- 172.21.15.50:0/4023314868 wait complete. 2023-08-10T10:52:55.817 INFO:tasks.ceph:Scrubbing osd.2 2023-08-10T10:52:55.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.051+0000 7f551270c640 1 Processor -- start 2023-08-10T10:52:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.051+0000 7f551270c640 1 -- start start 2023-08-10T10:52:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f551270c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f550c06ea80 0x7f550c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f551270c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f550c0ce130 0x7f550c165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f551270c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c0cc6d0 con 0x7f550c0c8c40 2023-08-10T10:52:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f551270c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c06f3a0 con 0x7f550c0ce130 2023-08-10T10:52:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f551270c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0ca0d0 con 0x7f550c06ea80 2023-08-10T10:52:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f5510ca9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f550c0ce130 0x7f550c165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f5510ca9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f550c0ce130 0x7f550c165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43156/0 (socket says 172.21.15.50:43156) 2023-08-10T10:52:56.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.053+0000 7f5510ca9640 1 -- 172.21.15.50:0/2817134966 learned_addr learned my addr 172.21.15.50:0/2817134966 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:56.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.054+0000 7f550bfff640 1 --2- 172.21.15.50:0/2817134966 >> v2:172.21.15.117:3300/0 conn(0x7f550c06ea80 0x7f550c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.054+0000 7f5510ca9640 1 -- 172.21.15.50:0/2817134966 >> v2:172.21.15.117:3300/0 conn(0x7f550c06ea80 msgr2=0x7f550c06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.054+0000 7f5510ca9640 1 --2- 172.21.15.50:0/2817134966 >> v2:172.21.15.117:3300/0 conn(0x7f550c06ea80 0x7f550c06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.054+0000 7f5510ca9640 1 -- 172.21.15.50:0/2817134966 >> v1:172.21.15.117:6789/0 conn(0x7f550c0c8c40 legacy=0x7f550c164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.054+0000 7f5510ca9640 1 -- 172.21.15.50:0/2817134966 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0ca3b0 con 0x7f550c0ce130 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.055+0000 7f5510ca9640 1 --2- 172.21.15.50:0/2817134966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c165340 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f550c0b11f0 tx=0x7f550402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d55d96ec925a1a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.055+0000 7f550affd640 1 -- 172.21.15.50:0/2817134966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550402cb20 con 0x7f550c0ce130 2023-08-10T10:52:56.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.055+0000 7f550affd640 1 -- 172.21.15.50:0/2817134966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550402cc80 con 0x7f550c0ce130 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.055+0000 7f550affd640 1 -- 172.21.15.50:0/2817134966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040343f0 con 0x7f550c0ce130 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 -- 172.21.15.50:0/2817134966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 msgr2=0x7f550c165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 --2- 172.21.15.50:0/2817134966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c165340 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f550c0b11f0 tx=0x7f550402bf80 comp rx=0 tx=0).stop 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 -- 172.21.15.50:0/2817134966 shutdown_connections 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 --2- 172.21.15.50:0/2817134966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c165340 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 --2- 172.21.15.50:0/2817134966 >> v2:172.21.15.117:3300/0 conn(0x7f550c06ea80 0x7f550c06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 -- 172.21.15.50:0/2817134966 >> 172.21.15.50:0/2817134966 conn(0x7f550c0b08e0 msgr2=0x7f550c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 -- 172.21.15.50:0/2817134966 shutdown_connections 2023-08-10T10:52:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.056+0000 7f551270c640 1 -- 172.21.15.50:0/2817134966 wait complete. 2023-08-10T10:52:56.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.058+0000 7f551270c640 1 Processor -- start 2023-08-10T10:52:56.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.058+0000 7f551270c640 1 -- start start 2023-08-10T10:52:56.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.059+0000 7f551270c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f550c06ea80 0x7f550c148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.059+0000 7f551270c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f550c0c8c40 0x7f550c0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.059+0000 7f551270c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f551270c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c4a10 con 0x7f550c0ce130 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f551270c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c7040 con 0x7f550c06ea80 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f551270c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c148f70 con 0x7f550c0c8c40 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c0c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43164/0 (socket says 172.21.15.50:43164) 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 -- 172.21.15.50:0/2876909622 learned_addr learned my addr 172.21.15.50:0/2876909622 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f550bfff640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f550c06ea80 0x7f550c148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f550b7fe640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f550c0c8c40 0x7f550c0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 -- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f550c0c8c40 msgr2=0x7f550c0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f550c0c8c40 0x7f550c0c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 -- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f550c06ea80 msgr2=0x7f550c148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f550c06ea80 0x7f550c148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.060+0000 7f5510ca9640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009b30 con 0x7f550c0ce130 2023-08-10T10:52:56.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f5510ca9640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c0c3ba0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f5504036040 tx=0x7f5504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504007e70 con 0x7f550c0ce130 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5504009510 con 0x7f550c0ce130 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550403e690 con 0x7f550c0ce130 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0c6d60 con 0x7f550c0ce130 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.061+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c0c46a0 con 0x7f550c0ce130 2023-08-10T10:52:56.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.062+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f550c0ccc00 con 0x7f550c0ce130 2023-08-10T10:52:56.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.063+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f550403e7f0 con 0x7f550c0ce130 2023-08-10T10:52:56.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.064+0000 7f5508ff9640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54ec06aca0 0x7f54ec06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.064+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f55040abe60 con 0x7f550c0ce130 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.065+0000 7f5508ff9640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7f54ec071120 0x7f54ec073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.065+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54ec073bf0 con 0x7f54ec071120 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.065+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55040ae440 con 0x7f550c0ce130 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.065+0000 7f550bfff640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54ec06aca0 0x7f54ec06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.065+0000 7f550b7fe640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7f54ec071120 0x7f54ec073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.066+0000 7f550bfff640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54ec06aca0 0x7f54ec06d160 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.066+0000 7f550b7fe640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7f54ec071120 0x7f54ec073540 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.066+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== osd.2 v2:172.21.15.50:6800/2061476148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f54ec073bf0 con 0x7f54ec071120 2023-08-10T10:52:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.079+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 --> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f550c0663d0 con 0x7f54ec071120 2023-08-10T10:52:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f5508ff9640 1 -- 172.21.15.50:0/2876909622 <== osd.2 v2:172.21.15.50:6800/2061476148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f550c0663d0 con 0x7f54ec071120 2023-08-10T10:52:56.081 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:56.081 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:56.081 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7f54ec071120 msgr2=0x7f54ec073540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6800/2061476148,v1:172.21.15.50:6801/2061476148] conn(0x7f54ec071120 0x7f54ec073540 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54ec06aca0 msgr2=0x7f54ec06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f54ec06aca0 0x7f54ec06d160 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2023-08-10T10:52:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 msgr2=0x7f550c0c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.080+0000 7f551270c640 1 --2- 172.21.15.50:0/2876909622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f550c0ce130 0x7f550c0c3ba0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f5504036040 tx=0x7f5504004a40 comp rx=0 tx=0).stop 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.081+0000 7f5510ca9640 1 -- 172.21.15.50:0/2876909622 reap_dead start 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.081+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 shutdown_connections 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.081+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 >> 172.21.15.50:0/2876909622 conn(0x7f550c0b08e0 msgr2=0x7f550c06bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.081+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 shutdown_connections 2023-08-10T10:52:56.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.081+0000 7f551270c640 1 -- 172.21.15.50:0/2876909622 wait complete. 2023-08-10T10:52:56.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-10T10:52:56.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.320+0000 7f4fdf20f640 1 Processor -- start 2023-08-10T10:52:56.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.320+0000 7f4fdf20f640 1 -- start start 2023-08-10T10:52:56.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.322+0000 7f4fdf20f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4fd80cd960 0x7f4fd8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.322+0000 7f4fdf20f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd80d28b0 0x7f4fd80d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.322+0000 7f4fdf20f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd8160370 con 0x7f4fd815ff90 2023-08-10T10:52:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.322+0000 7f4fdf20f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80d0b90 con 0x7f4fd80cd960 2023-08-10T10:52:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.322+0000 7f4fdf20f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81614d0 con 0x7f4fd80d28b0 2023-08-10T10:52:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.323+0000 7f4fdea0e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd80d28b0 0x7f4fd80d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.323+0000 7f4fde20d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4fd815ff90 0x7f4fd80d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:56228/0 (socket says 172.21.15.50:56228) 2023-08-10T10:52:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.323+0000 7f4fde20d640 1 -- 172.21.15.50:0/518876324 learned_addr learned my addr 172.21.15.50:0/518876324 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.323+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/518876324 >> v2:172.21.15.117:3300/0 conn(0x7f4fd80cd960 0x7f4fd8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.324+0000 7f4fdda0c640 1 -- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd80d28b0 msgr2=0x7f4fd80d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.324+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd80d28b0 0x7f4fd80d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.324+0000 7f4fdda0c640 1 -- 172.21.15.50:0/518876324 >> v1:172.21.15.117:6789/0 conn(0x7f4fd815ff90 legacy=0x7f4fd80d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.324+0000 7f4fdd20b640 1 -- 172.21.15.50:0/518876324 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745623196 0 0) 0x7f4fd4001110 con 0x7f4fd815ff90 2023-08-10T10:52:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.324+0000 7f4fdda0c640 1 -- 172.21.15.50:0/518876324 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80d3240 con 0x7f4fd80cd960 2023-08-10T10:52:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.325+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80cd960 0x7f4fd8160f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac81c4a845299bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.326+0000 7f4fdd20b640 1 -- 172.21.15.50:0/518876324 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8031830 con 0x7f4fd80cd960 2023-08-10T10:52:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.326+0000 7f4fdd20b640 1 -- 172.21.15.50:0/518876324 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8031990 con 0x7f4fd80cd960 2023-08-10T10:52:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.326+0000 7f4fdd20b640 1 -- 172.21.15.50:0/518876324 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8031d20 con 0x7f4fd80cd960 2023-08-10T10:52:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.326+0000 7f4fdf20f640 1 -- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80cd960 msgr2=0x7f4fd8160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.326+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80cd960 0x7f4fd8160f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802b8d0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 -- 172.21.15.50:0/518876324 shutdown_connections 2023-08-10T10:52:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd80d28b0 0x7f4fd80d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/518876324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80cd960 0x7f4fd8160f90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 -- 172.21.15.50:0/518876324 >> 172.21.15.50:0/518876324 conn(0x7f4fd8069ac0 msgr2=0x7f4fd8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 -- 172.21.15.50:0/518876324 shutdown_connections 2023-08-10T10:52:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.327+0000 7f4fdf20f640 1 -- 172.21.15.50:0/518876324 wait complete. 2023-08-10T10:52:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.329+0000 7f4fdf20f640 1 Processor -- start 2023-08-10T10:52:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.329+0000 7f4fdf20f640 1 -- start start 2023-08-10T10:52:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 0x7f4fd80b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd815ff90 0x7f4fd80b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81f5b80 con 0x7f4fd80cd960 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81f3190 con 0x7f4fd80d28b0 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdf20f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b3de0 con 0x7f4fd815ff90 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fde20d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fde20d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43178/0 (socket says 172.21.15.50:43178) 2023-08-10T10:52:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fde20d640 1 -- 172.21.15.50:0/996827142 learned_addr learned my addr 172.21.15.50:0/996827142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdea0e640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd815ff90 0x7f4fd80b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.330+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 0x7f4fd80b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 -- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd815ff90 msgr2=0x7f4fd80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd815ff90 0x7f4fd80b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 -- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 msgr2=0x7f4fd80b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 0x7f4fd80b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 -- 172.21.15.50:0/996827142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009400 con 0x7f4fd80cd960 2023-08-10T10:52:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 0x7f4fd80b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fde20d640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c780 tx=0x7f4fd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40072d0 con 0x7f4fd80cd960 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4007430 con 0x7f4fd80cd960 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40047e0 con 0x7f4fd80cd960 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.331+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd81f2eb0 con 0x7f4fd80cd960 2023-08-10T10:52:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.332+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80cb370 con 0x7f4fd80cd960 2023-08-10T10:52:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.333+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8066e30 con 0x7f4fd80cd960 2023-08-10T10:52:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.334+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fd4004940 con 0x7f4fd80cd960 2023-08-10T10:52:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.334+0000 7f4fceffd640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 0x7f4fbc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.335+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4fd40882f0 con 0x7f4fd80cd960 2023-08-10T10:52:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.335+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 0x7f4fbc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.336+0000 7f4fdda0c640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 0x7f4fbc06d110 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8036000 tx=0x7f4fc803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.339+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4fd40536b0 con 0x7f4fd80cd960 2023-08-10T10:52:56.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.531+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fd80d1070 con 0x7f4fbc06ac50 2023-08-10T10:52:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.532+0000 7f4fceffd640 1 -- 172.21.15.50:0/996827142 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4fc8031b80 con 0x7f4fbc06ac50 2023-08-10T10:52:56.533 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2023-08-10T10:52:56.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 msgr2=0x7f4fbc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 0x7f4fbc06d110 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8036000 tx=0x7f4fc803c040 comp rx=0 tx=0).stop 2023-08-10T10:52:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 msgr2=0x7f4fd80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c780 tx=0x7f4fd400cc40 comp rx=0 tx=0).stop 2023-08-10T10:52:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 shutdown_connections 2023-08-10T10:52:56.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fd815ff90 0x7f4fd80b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f4fbc06ac50 0x7f4fbc06d110 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fd80d28b0 0x7f4fd80b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 --2- 172.21.15.50:0/996827142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd80cd960 0x7f4fd80cbb70 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 >> 172.21.15.50:0/996827142 conn(0x7f4fd8069ac0 msgr2=0x7f4fd80c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.535+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 shutdown_connections 2023-08-10T10:52:56.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.536+0000 7f4fdf20f640 1 -- 172.21.15.50:0/996827142 wait complete. 2023-08-10T10:52:56.555 INFO:tasks.ceph:Scrubbing osd.3 2023-08-10T10:52:56.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.781+0000 7fd0daeb8640 1 Processor -- start 2023-08-10T10:52:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.781+0000 7fd0daeb8640 1 -- start start 2023-08-10T10:52:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.782+0000 7fd0daeb8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0d406ea80 0x7fd0d406ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.782+0000 7fd0daeb8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d40cc6d0 con 0x7fd0d40ce130 2023-08-10T10:52:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.782+0000 7fd0daeb8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d4165a50 con 0x7fd0d40c8c40 2023-08-10T10:52:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.782+0000 7fd0daeb8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d406f3a0 con 0x7fd0d406ea80 2023-08-10T10:52:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d9455640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0d40ce130 0x7fd0d4165340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59740/0 (socket says 172.21.15.50:59740) 2023-08-10T10:52:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d9455640 1 -- 172.21.15.50:0/928026994 learned_addr learned my addr 172.21.15.50:0/928026994 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863686603 0 0) 0x7fd0d40cc6d0 con 0x7fd0d40ce130 2023-08-10T10:52:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c0003520 con 0x7fd0d40ce130 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d8c54640 1 --2- 172.21.15.50:0/928026994 >> v2:172.21.15.117:3300/0 conn(0x7fd0d406ea80 0x7fd0d406ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096070021 0 0) 0x7fd0c0003520 con 0x7fd0d40ce130 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 >> v2:172.21.15.117:3300/0 conn(0x7fd0d406ea80 msgr2=0x7fd0d406ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 --2- 172.21.15.50:0/928026994 >> v2:172.21.15.117:3300/0 conn(0x7fd0d406ea80 0x7fd0d406ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 >> v1:172.21.15.117:6789/0 conn(0x7fd0d40c8c40 legacy=0x7fd0d4164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40ca0d0 con 0x7fd0d40ce130 2023-08-10T10:52:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4097136371 0 0) 0x7fd0cc001670 con 0x7fd0d40ce130 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 >> v1:172.21.15.50:6789/0 conn(0x7fd0d40ce130 legacy=0x7fd0d4165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0c0003970 0x7fd0c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.783+0000 7fd0d37fe640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c00047c0 0x7fd0c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d37fe640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 0x7fd0c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d406f3a0 con 0x7fd0c0005180 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c000c0b0 con 0x7fd0c0003970 2023-08-10T10:52:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c000c270 con 0x7fd0c00047c0 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 0x7fd0c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d8c54640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0c0003970 0x7fd0c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d3fff640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c00047c0 0x7fd0c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 -- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c00047c0 msgr2=0x7fd0c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c00047c0 0x7fd0c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 -- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0c0003970 msgr2=0x7fd0c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0c0003970 0x7fd0c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d9455640 1 -- 172.21.15.50:0/928026994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0003520 con 0x7fd0c0005180 2023-08-10T10:52:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.784+0000 7fd0d3fff640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c00047c0 0x7fd0c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.785+0000 7fd0d9455640 1 -- 172.21.15.50:0/928026994 reap_dead start 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0d9455640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 0x7fd0c000b980 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c240 tx=0x7fd0c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71571ce45730eb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc005ad0 con 0x7fd0c0005180 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc005c70 con 0x7fd0c0005180 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0d37fe640 1 -- 172.21.15.50:0/928026994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc02c8b0 con 0x7fd0c0005180 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 -- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 msgr2=0x7fd0c000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 0x7fd0c000b980 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c240 tx=0x7fd0c00057f0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 -- 172.21.15.50:0/928026994 shutdown_connections 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 --2- 172.21.15.50:0/928026994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0c0005180 0x7fd0c000b980 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 -- 172.21.15.50:0/928026994 >> 172.21.15.50:0/928026994 conn(0x7fd0d40b08e0 msgr2=0x7fd0d40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.786+0000 7fd0daeb8640 1 -- 172.21.15.50:0/928026994 shutdown_connections 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.787+0000 7fd0daeb8640 1 -- 172.21.15.50:0/928026994 wait complete. 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.788+0000 7fd0daeb8640 1 Processor -- start 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.788+0000 7fd0daeb8640 1 -- start start 2023-08-10T10:52:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c0005180 0x7fd0d415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 0x7fd0d41f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0d41f7090 0x7fd0d40b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d415f140 con 0x7fd0d40b16e0 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41f7af0 con 0x7fd0d41f7090 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.789+0000 7fd0daeb8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41f7530 con 0x7fd0c0005180 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 0x7fd0d41f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 0x7fd0d41f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43186/0 (socket says 172.21.15.50:43186) 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 -- 172.21.15.50:0/635327731 learned_addr learned my addr 172.21.15.50:0/635327731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 -- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c0005180 msgr2=0x7fd0d415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d8c54640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c0005180 0x7fd0d415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d9455640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0d41f7090 0x7fd0d40b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0c0005180 0x7fd0d415ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 -- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0d41f7090 msgr2=0x7fd0d40b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0d41f7090 0x7fd0d40b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d41f7810 con 0x7fd0d40b16e0 2023-08-10T10:52:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.790+0000 7fd0d3fff640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 0x7fd0d41f6b50 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00dae0 tx=0x7fd0bc002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.791+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003da0 con 0x7fd0d40b16e0 2023-08-10T10:52:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.791+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc00b710 con 0x7fd0d40b16e0 2023-08-10T10:52:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.791+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d41628e0 con 0x7fd0d40b16e0 2023-08-10T10:52:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.791+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00bac0 con 0x7fd0d40b16e0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.791+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d40c6490 con 0x7fd0d40b16e0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.792+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0d40cc920 con 0x7fd0d40b16e0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.793+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0bc00bc20 con 0x7fd0d40b16e0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d17fa640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd0b406ac50 0x7fd0b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd0bc089500 con 0x7fd0d40b16e0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d8c54640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd0b406ac50 0x7fd0b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d17fa640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7fd0b40710d0 0x7fd0b40734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0b4073ba0 con 0x7fd0b40710d0 2023-08-10T10:52:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.795+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0bc08ba60 con 0x7fd0d40b16e0 2023-08-10T10:52:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.796+0000 7fd0d9455640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7fd0b40710d0 0x7fd0b40734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.796+0000 7fd0d8c54640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd0b406ac50 0x7fd0b406d110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4006fd0 tx=0x7fd0c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.796+0000 7fd0d9455640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7fd0b40710d0 0x7fd0b40734f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.797+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== osd.3 v2:172.21.15.50:6808/1161775809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd0b4073ba0 con 0x7fd0b40710d0 2023-08-10T10:52:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.810+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 --> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0d40663d0 con 0x7fd0b40710d0 2023-08-10T10:52:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0d17fa640 1 -- 172.21.15.50:0/635327731 <== osd.3 v2:172.21.15.50:6808/1161775809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fd0d40663d0 con 0x7fd0b40710d0 2023-08-10T10:52:56.811 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:56.812 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7fd0b40710d0 msgr2=0x7fd0b40734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6808/1161775809,v1:172.21.15.50:6809/1161775809] conn(0x7fd0b40710d0 0x7fd0b40734f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd0b406ac50 msgr2=0x7fd0b406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fd0b406ac50 0x7fd0b406d110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4006fd0 tx=0x7fd0c4008040 comp rx=0 tx=0).stop 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 msgr2=0x7fd0d41f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.811+0000 7fd0daeb8640 1 --2- 172.21.15.50:0/635327731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0d40b16e0 0x7fd0d41f6b50 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00dae0 tx=0x7fd0bc002070 comp rx=0 tx=0).stop 2023-08-10T10:52:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.812+0000 7fd0d9455640 1 -- 172.21.15.50:0/635327731 reap_dead start 2023-08-10T10:52:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.812+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 shutdown_connections 2023-08-10T10:52:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.812+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 >> 172.21.15.50:0/635327731 conn(0x7fd0d40b08e0 msgr2=0x7fd0d406a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.812+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 shutdown_connections 2023-08-10T10:52:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:56.812+0000 7fd0daeb8640 1 -- 172.21.15.50:0/635327731 wait complete. 2023-08-10T10:52:56.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-10T10:52:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.056+0000 7f003dea5640 1 Processor -- start 2023-08-10T10:52:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.056+0000 7f003dea5640 1 -- start start 2023-08-10T10:52:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.058+0000 7f003dea5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00380c1a10 0x7f0038165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.058+0000 7f003dea5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00380c8e80 0x7f00380696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.058+0000 7f003dea5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380c9bb0 con 0x7f0038069be0 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.058+0000 7f003dea5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0038165a70 con 0x7f00380c8e80 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.058+0000 7f003dea5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0038069ff0 con 0x7f00380c1a10 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00380c8e80 0x7f00380696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f00380c8e80 0x7f00380696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43196/0 (socket says 172.21.15.50:43196) 2023-08-10T10:52:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 -- 172.21.15.50:0/4260016397 learned_addr learned my addr 172.21.15.50:0/4260016397 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f003cea3640 1 --2- 172.21.15.50:0/4260016397 >> v2:172.21.15.117:3300/0 conn(0x7f00380c1a10 0x7f0038165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 -- 172.21.15.50:0/4260016397 >> v2:172.21.15.117:3300/0 conn(0x7f00380c1a10 msgr2=0x7f0038165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 --2- 172.21.15.50:0/4260016397 >> v2:172.21.15.117:3300/0 conn(0x7f00380c1a10 0x7f0038165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 -- 172.21.15.50:0/4260016397 >> v1:172.21.15.50:6789/0 conn(0x7f0038069be0 legacy=0x7f003806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.059+0000 7f0037fff640 1 -- 172.21.15.50:0/4260016397 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380c95f0 con 0x7f00380c8e80 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.060+0000 7f0037fff640 1 --2- 172.21.15.50:0/4260016397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c8e80 0x7f00380696a0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f003806cc70 tx=0x7f002402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38561bec592ed4f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f00377fe640 1 -- 172.21.15.50:0/4260016397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024030860 con 0x7f00380c8e80 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f00377fe640 1 -- 172.21.15.50:0/4260016397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240309c0 con 0x7f00380c8e80 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f00377fe640 1 -- 172.21.15.50:0/4260016397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024030d50 con 0x7f00380c8e80 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 -- 172.21.15.50:0/4260016397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c8e80 msgr2=0x7f00380696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 --2- 172.21.15.50:0/4260016397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c8e80 0x7f00380696a0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f003806cc70 tx=0x7f002402b9a0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 -- 172.21.15.50:0/4260016397 shutdown_connections 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 --2- 172.21.15.50:0/4260016397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c8e80 0x7f00380696a0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 --2- 172.21.15.50:0/4260016397 >> v2:172.21.15.117:3300/0 conn(0x7f00380c1a10 0x7f0038165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 -- 172.21.15.50:0/4260016397 >> 172.21.15.50:0/4260016397 conn(0x7f00380cafa0 msgr2=0x7f00380cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 -- 172.21.15.50:0/4260016397 shutdown_connections 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.061+0000 7f003dea5640 1 -- 172.21.15.50:0/4260016397 wait complete. 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.063+0000 7f003dea5640 1 Processor -- start 2023-08-10T10:52:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.063+0000 7f003dea5640 1 -- start start 2023-08-10T10:52:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 0x7f0038163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 0x7f0038070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c71d0 con 0x7f00380c1a10 2023-08-10T10:52:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c6130 con 0x7f00380c8e80 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.064+0000 7f003dea5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c6410 con 0x7f0038069be0 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43208/0 (socket says 172.21.15.50:43208) 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 -- 172.21.15.50:0/2504968827 learned_addr learned my addr 172.21.15.50:0/2504968827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f003cea3640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 0x7f0038163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f003d6a4640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 0x7f0038070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 -- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 msgr2=0x7f0038163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 0x7f0038163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 -- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 msgr2=0x7f0038070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 0x7f0038070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f0037fff640 1 -- 172.21.15.50:0/2504968827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240094d0 con 0x7f00380c1a10 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f003cea3640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 0x7f0038163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.065+0000 7f003d6a4640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 0x7f0038070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f0037fff640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f002402b9e0 tx=0x7f0024004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024039b60 con 0x7f00380c1a10 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024039ce0 con 0x7f00380c1a10 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024043650 con 0x7f00380c1a10 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00380c66f0 con 0x7f00380c1a10 2023-08-10T10:52:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.066+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00380c6cb0 con 0x7f00380c1a10 2023-08-10T10:52:57.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.067+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00380c6ea0 con 0x7f00380c1a10 2023-08-10T10:52:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.068+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f002402f3b0 con 0x7f00380c1a10 2023-08-10T10:52:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.069+0000 7f00357fa640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 0x7f001c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.069+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f00240ab4c0 con 0x7f00380c1a10 2023-08-10T10:52:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.070+0000 7f003cea3640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 0x7f001c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.070+0000 7f003cea3640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 0x7f001c06d110 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f002c006fd0 tx=0x7f002c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.074+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0024076880 con 0x7f00380c1a10 2023-08-10T10:52:57.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.266+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f00380cc5a0 con 0x7f001c06ac50 2023-08-10T10:52:57.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.267+0000 7f00357fa640 1 -- 172.21.15.50:0/2504968827 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f002c0095f0 con 0x7f001c06ac50 2023-08-10T10:52:57.267 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2023-08-10T10:52:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 msgr2=0x7f001c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 0x7f001c06d110 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f002c006fd0 tx=0x7f002c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 msgr2=0x7f00380c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f002402b9e0 tx=0x7f0024004730 comp rx=0 tx=0).stop 2023-08-10T10:52:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 shutdown_connections 2023-08-10T10:52:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f001c06ac50 0x7f001c06d110 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00380c8e80 0x7f0038070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00380c1a10 0x7f00380c7d10 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 --2- 172.21.15.50:0/2504968827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0038069be0 0x7f0038163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 >> 172.21.15.50:0/2504968827 conn(0x7f00380cafa0 msgr2=0x7f00380cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 shutdown_connections 2023-08-10T10:52:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.269+0000 7f003dea5640 1 -- 172.21.15.50:0/2504968827 wait complete. 2023-08-10T10:52:57.289 INFO:tasks.ceph:Scrubbing osd.4 2023-08-10T10:52:57.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.515+0000 7fa47eb40640 1 Processor -- start 2023-08-10T10:52:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.516+0000 7fa47eb40640 1 -- start start 2023-08-10T10:52:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.517+0000 7fa47eb40640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa47815fde0 0x7fa47806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.517+0000 7fa47eb40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.517+0000 7fa47eb40640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47806a5c0 con 0x7fa4780cd490 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.517+0000 7fa47eb40640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47806b0c0 con 0x7fa47815fde0 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.517+0000 7fa47eb40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780cd920 con 0x7fa4780b1e00 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa47815fde0 0x7fa47806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa47815fde0 0x7fa47806a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43214/0 (socket says 172.21.15.50:43214) 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 -- 172.21.15.50:0/3492601275 learned_addr learned my addr 172.21.15.50:0/3492601275 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:57.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47e33f640 1 --1- 172.21.15.50:0/3492601275 >> v1:172.21.15.50:6789/0 conn(0x7fa4780cd490 0x7fa4781604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59760/0 (socket says 172.21.15.50:59760) 2023-08-10T10:52:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47d33d640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 -- 172.21.15.50:0/3492601275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 msgr2=0x7fa4780ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 -- 172.21.15.50:0/3492601275 >> v1:172.21.15.50:6789/0 conn(0x7fa4780cd490 legacy=0x7fa4781604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47db3e640 1 -- 172.21.15.50:0/3492601275 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47806a820 con 0x7fa47815fde0 2023-08-10T10:52:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.518+0000 7fa47cb3c640 1 -- 172.21.15.50:0/3492601275 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057801371 0 0) 0x7fa47806a5c0 con 0x7fa4780cd490 2023-08-10T10:52:57.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.520+0000 7fa47db3e640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47806a080 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fa474009870 tx=0x7fa47402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1def433916903b7b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47cb3c640 1 -- 172.21.15.50:0/3492601275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740317c0 con 0x7fa47815fde0 2023-08-10T10:52:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47cb3c640 1 -- 172.21.15.50:0/3492601275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474031920 con 0x7fa47815fde0 2023-08-10T10:52:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47cb3c640 1 -- 172.21.15.50:0/3492601275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474031cb0 con 0x7fa47815fde0 2023-08-10T10:52:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47eb40640 1 -- 172.21.15.50:0/3492601275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 msgr2=0x7fa47806a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47eb40640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47806a080 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fa474009870 tx=0x7fa47402b860 comp rx=0 tx=0).stop 2023-08-10T10:52:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.521+0000 7fa47eb40640 1 -- 172.21.15.50:0/3492601275 shutdown_connections 2023-08-10T10:52:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.522+0000 7fa47eb40640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.522+0000 7fa47eb40640 1 --2- 172.21.15.50:0/3492601275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47806a080 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.522+0000 7fa47eb40640 1 -- 172.21.15.50:0/3492601275 >> 172.21.15.50:0/3492601275 conn(0x7fa4780d2900 msgr2=0x7fa4780d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.522+0000 7fa47eb40640 1 -- 172.21.15.50:0/3492601275 shutdown_connections 2023-08-10T10:52:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.522+0000 7fa47eb40640 1 -- 172.21.15.50:0/3492601275 wait complete. 2023-08-10T10:52:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.524+0000 7fa47eb40640 1 Processor -- start 2023-08-10T10:52:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.524+0000 7fa47eb40640 1 -- start start 2023-08-10T10:52:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780cd490 0x7fa47815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781f2110 con 0x7fa47815fde0 2023-08-10T10:52:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781f2300 con 0x7fa4780cd490 2023-08-10T10:52:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47eb40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781493c0 con 0x7fa4780b1e00 2023-08-10T10:52:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47e33f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47e33f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43222/0 (socket says 172.21.15.50:43222) 2023-08-10T10:52:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47e33f640 1 -- 172.21.15.50:0/2494360059 learned_addr learned my addr 172.21.15.50:0/2494360059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47d33d640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780cd490 0x7fa47815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.526+0000 7fa47db3e640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 -- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 msgr2=0x7fa4780c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 -- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780cd490 msgr2=0x7fa47815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780cd490 0x7fa47815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740094d0 con 0x7fa47815fde0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47db3e640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4780b1e00 0x7fa4780c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa47e33f640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47815dc00 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c700 tx=0x7fa47000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000ce10 con 0x7fa47815fde0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.527+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000a640 con 0x7fa47815fde0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.528+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000aa70 con 0x7fa47815fde0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.528+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4781f25c0 con 0x7fa47815fde0 2023-08-10T10:52:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.528+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4780c91a0 con 0x7fa47815fde0 2023-08-10T10:52:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.529+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa47806ade0 con 0x7fa47815fde0 2023-08-10T10:52:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.530+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa47000abd0 con 0x7fa47815fde0 2023-08-10T10:52:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa46e7fc640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa45c06ac50 0x7fa45c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa470088700 con 0x7fa47815fde0 2023-08-10T10:52:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa46e7fc640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7fa45c0710d0 0x7fa45c0734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa47db3e640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa45c06ac50 0x7fa45c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa45c073ba0 con 0x7fa45c0710d0 2023-08-10T10:52:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.531+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47008ace0 con 0x7fa47815fde0 2023-08-10T10:52:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.532+0000 7fa47d33d640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7fa45c0710d0 0x7fa45c0734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.532+0000 7fa47db3e640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa45c06ac50 0x7fa45c06d110 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa474036000 tx=0x7fa474008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.533+0000 7fa47d33d640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7fa45c0710d0 0x7fa45c0734f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.535+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== osd.4 v2:172.21.15.117:6816/4052651543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fa45c073ba0 con 0x7fa45c0710d0 2023-08-10T10:52:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.550+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 --> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa47806ab00 con 0x7fa45c0710d0 2023-08-10T10:52:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.551+0000 7fa46e7fc640 1 -- 172.21.15.50:0/2494360059 <== osd.4 v2:172.21.15.117:6816/4052651543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fa4680075f0 con 0x7fa45c0710d0 2023-08-10T10:52:57.552 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:57.552 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:57.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7fa45c0710d0 msgr2=0x7fa45c0734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.117:6816/4052651543,v1:172.21.15.117:6817/4052651543] conn(0x7fa45c0710d0 0x7fa45c0734f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa45c06ac50 msgr2=0x7fa45c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fa45c06ac50 0x7fa45c06d110 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa474036000 tx=0x7fa474008030 comp rx=0 tx=0).stop 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 msgr2=0x7fa47815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 --2- 172.21.15.50:0/2494360059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa47815fde0 0x7fa47815dc00 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c700 tx=0x7fa47000cbc0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47e33f640 1 -- 172.21.15.50:0/2494360059 reap_dead start 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 shutdown_connections 2023-08-10T10:52:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 >> 172.21.15.50:0/2494360059 conn(0x7fa4780d2900 msgr2=0x7fa47815cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:57.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.552+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 shutdown_connections 2023-08-10T10:52:57.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.553+0000 7fa47eb40640 1 -- 172.21.15.50:0/2494360059 wait complete. 2023-08-10T10:52:57.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-10T10:52:57.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.803+0000 7f30d9cbd640 1 Processor -- start 2023-08-10T10:52:57.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.804+0000 7f30d9cbd640 1 -- start start 2023-08-10T10:52:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d9cbd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30d415ff90 0x7f30d4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d9cbd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30d40d28b0 0x7f30d40d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d9cbd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d4160370 con 0x7f30d40cd960 2023-08-10T10:52:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d9cbd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40d0b90 con 0x7f30d415ff90 2023-08-10T10:52:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d9cbd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d41614d0 con 0x7f30d40d28b0 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d8cbb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30d415ff90 0x7f30d4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30cbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30d40cd960 0x7f30d40d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59770/0 (socket says 172.21.15.50:59770) 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30d8cbb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30d415ff90 0x7f30d4160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43238/0 (socket says 172.21.15.50:43238) 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.805+0000 7f30cbfff640 1 -- 172.21.15.50:0/1943845260 learned_addr learned my addr 172.21.15.50:0/1943845260 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.806+0000 7f30d94bc640 1 --2- 172.21.15.50:0/1943845260 >> v2:172.21.15.117:3300/0 conn(0x7f30d40d28b0 0x7f30d40d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.806+0000 7f30d8cbb640 1 -- 172.21.15.50:0/1943845260 >> v2:172.21.15.117:3300/0 conn(0x7f30d40d28b0 msgr2=0x7f30d40d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.806+0000 7f30d8cbb640 1 --2- 172.21.15.50:0/1943845260 >> v2:172.21.15.117:3300/0 conn(0x7f30d40d28b0 0x7f30d40d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.806+0000 7f30d8cbb640 1 -- 172.21.15.50:0/1943845260 >> v1:172.21.15.50:6789/0 conn(0x7f30d40cd960 legacy=0x7f30d40d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.806+0000 7f30d8cbb640 1 -- 172.21.15.50:0/1943845260 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40d3200 con 0x7f30d415ff90 2023-08-10T10:52:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.807+0000 7f30d8cbb640 1 --2- 172.21.15.50:0/1943845260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d415ff90 0x7f30d4160f90 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f30d40d0260 tx=0x7f30d002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150ee4f0b5b0917 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.807+0000 7f30cb7fe640 1 -- 172.21.15.50:0/1943845260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002cc70 con 0x7f30d415ff90 2023-08-10T10:52:57.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.807+0000 7f30cb7fe640 1 -- 172.21.15.50:0/1943845260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d002cdd0 con 0x7f30d415ff90 2023-08-10T10:52:57.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.807+0000 7f30cb7fe640 1 -- 172.21.15.50:0/1943845260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0034660 con 0x7f30d415ff90 2023-08-10T10:52:57.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 -- 172.21.15.50:0/1943845260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d415ff90 msgr2=0x7f30d4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/1943845260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d415ff90 0x7f30d4160f90 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f30d40d0260 tx=0x7f30d002bec0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 -- 172.21.15.50:0/1943845260 shutdown_connections 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/1943845260 >> v2:172.21.15.117:3300/0 conn(0x7f30d40d28b0 0x7f30d40d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/1943845260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d415ff90 0x7f30d4160f90 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 -- 172.21.15.50:0/1943845260 >> 172.21.15.50:0/1943845260 conn(0x7f30d4069ac0 msgr2=0x7f30d4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 -- 172.21.15.50:0/1943845260 shutdown_connections 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.808+0000 7f30d9cbd640 1 -- 172.21.15.50:0/1943845260 wait complete. 2023-08-10T10:52:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.810+0000 7f30d9cbd640 1 Processor -- start 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.810+0000 7f30d9cbd640 1 -- start start 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d40d28b0 0x7f30d40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d415ff90 0x7f30d40c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d415c0b0 con 0x7f30d40cd960 2023-08-10T10:52:57.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40c9f40 con 0x7f30d415ff90 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d9cbd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40ca220 con 0x7f30d40d28b0 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d8cbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d8cbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43254/0 (socket says 172.21.15.50:43254) 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.811+0000 7f30d8cbb640 1 -- 172.21.15.50:0/2719788458 learned_addr learned my addr 172.21.15.50:0/2719788458 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 -- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d40d28b0 msgr2=0x7f30d40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d40d28b0 0x7f30d40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 -- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d415ff90 msgr2=0x7f30d40c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d415ff90 0x7f30d40c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 -- 172.21.15.50:0/2719788458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009a70 con 0x7f30d40cd960 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d8cbb640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f30d0037040 tx=0x7f30d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0040650 con 0x7f30d40cd960 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d00407b0 con 0x7f30d40cd960 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0040b60 con 0x7f30d40cd960 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d40ca500 con 0x7f30d40cd960 2023-08-10T10:52:57.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.812+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d40caac0 con 0x7f30d40cd960 2023-08-10T10:52:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.814+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d4066e30 con 0x7f30d40cd960 2023-08-10T10:52:57.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.815+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30d0040cc0 con 0x7f30d40cd960 2023-08-10T10:52:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.815+0000 7f30c97fa640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 0x7f30c006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.816+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f30d00ac090 con 0x7f30d40cd960 2023-08-10T10:52:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.816+0000 7f30cbfff640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 0x7f30c006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.817+0000 7f30cbfff640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 0x7f30c006d110 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f30d40cd240 tx=0x7f30c4007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:57.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:57.820+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f30d0077450 con 0x7f30d40cd960 2023-08-10T10:52:58.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.018+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f30d40d1070 con 0x7f30c006ac50 2023-08-10T10:52:58.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.019+0000 7f30c97fa640 1 -- 172.21.15.50:0/2719788458 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f30c40058b0 con 0x7f30c006ac50 2023-08-10T10:52:58.020 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2023-08-10T10:52:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 msgr2=0x7f30c006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 0x7f30c006d110 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f30d40cd240 tx=0x7f30c4007a40 comp rx=0 tx=0).stop 2023-08-10T10:52:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 msgr2=0x7f30d415bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f30d0037040 tx=0x7f30d0004a40 comp rx=0 tx=0).stop 2023-08-10T10:52:58.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 shutdown_connections 2023-08-10T10:52:58.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f30c006ac50 0x7f30c006d110 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d415ff90 0x7f30d40c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d40d28b0 0x7f30d40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 --2- 172.21.15.50:0/2719788458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30d40cd960 0x7f30d415bb70 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 >> 172.21.15.50:0/2719788458 conn(0x7f30d4069ac0 msgr2=0x7f30d40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 shutdown_connections 2023-08-10T10:52:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.022+0000 7f30d9cbd640 1 -- 172.21.15.50:0/2719788458 wait complete. 2023-08-10T10:52:58.041 INFO:tasks.ceph:Scrubbing osd.5 2023-08-10T10:52:58.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:58.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.262+0000 7f86e9c6a640 1 Processor -- start 2023-08-10T10:52:58.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.262+0000 7f86e9c6a640 1 -- start start 2023-08-10T10:52:58.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.264+0000 7f86e9c6a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86e415fde0 0x7f86e406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.264+0000 7f86e9c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.264+0000 7f86e9c6a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406a5c0 con 0x7f86e40b1e00 2023-08-10T10:52:58.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.264+0000 7f86e9c6a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e406b0c0 con 0x7f86e415fde0 2023-08-10T10:52:58.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.264+0000 7f86e9c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e406a820 con 0x7f86e40cd660 2023-08-10T10:52:58.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.265+0000 7f86e9469640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.265+0000 7f86e9469640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.50:41320/0 (socket says 172.21.15.50:41320) 2023-08-10T10:52:58.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.265+0000 7f86e9469640 1 -- 172.21.15.50:0/3175405554 learned_addr learned my addr 172.21.15.50:0/3175405554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:58.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.265+0000 7f86e8c68640 1 --2- 172.21.15.50:0/3175405554 >> v2:172.21.15.117:3300/0 conn(0x7f86e415fde0 0x7f86e406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.266+0000 7f86e9469640 1 -- 172.21.15.50:0/3175405554 >> v2:172.21.15.117:3300/0 conn(0x7f86e415fde0 msgr2=0x7f86e406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:58.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.266+0000 7f86e9469640 1 --2- 172.21.15.50:0/3175405554 >> v2:172.21.15.117:3300/0 conn(0x7f86e415fde0 0x7f86e406a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.266+0000 7f86e9469640 1 -- 172.21.15.50:0/3175405554 >> v1:172.21.15.117:6789/0 conn(0x7f86e40b1e00 legacy=0x7f86e40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.266+0000 7f86e9469640 1 -- 172.21.15.50:0/3175405554 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e406ab00 con 0x7f86e40cd660 2023-08-10T10:52:58.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.267+0000 7f86e9469640 1 --2- 172.21.15.50:0/3175405554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e50 tx=0x7f86dc02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65a93ceffd1c1de6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.267+0000 7f86e37fe640 1 -- 172.21.15.50:0/3175405554 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc02c9e0 con 0x7f86e40cd660 2023-08-10T10:52:58.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e37fe640 1 -- 172.21.15.50:0/3175405554 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc02cb40 con 0x7f86e40cd660 2023-08-10T10:52:58.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e37fe640 1 -- 172.21.15.50:0/3175405554 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0343f0 con 0x7f86e40cd660 2023-08-10T10:52:58.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 -- 172.21.15.50:0/3175405554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 msgr2=0x7f86e40d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/3175405554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e50 tx=0x7f86dc02be40 comp rx=0 tx=0).stop 2023-08-10T10:52:58.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 -- 172.21.15.50:0/3175405554 shutdown_connections 2023-08-10T10:52:58.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/3175405554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e40cd660 0x7f86e40d0b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/3175405554 >> v2:172.21.15.117:3300/0 conn(0x7f86e415fde0 0x7f86e406a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 -- 172.21.15.50:0/3175405554 >> 172.21.15.50:0/3175405554 conn(0x7f86e40d2900 msgr2=0x7f86e40d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 -- 172.21.15.50:0/3175405554 shutdown_connections 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.268+0000 7f86e9c6a640 1 -- 172.21.15.50:0/3175405554 wait complete. 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.270+0000 7f86e9c6a640 1 Processor -- start 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.270+0000 7f86e9c6a640 1 -- start start 2023-08-10T10:52:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e40b1e00 0x7f86e415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 0x7f86e4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e415fde0 0x7f86e40a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41597c0 con 0x7f86e40cd660 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415b060 con 0x7f86e40b1e00 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.271+0000 7f86e9c6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415b340 con 0x7f86e415fde0 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 0x7f86e4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 0x7f86e4159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43268/0 (socket says 172.21.15.50:43268) 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 -- 172.21.15.50:0/2569326849 learned_addr learned my addr 172.21.15.50:0/2569326849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e9469640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e415fde0 0x7f86e40a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e8c68640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e40b1e00 0x7f86e415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 -- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e415fde0 msgr2=0x7f86e40a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86e415fde0 0x7f86e40a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 -- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e40b1e00 msgr2=0x7f86e415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e40b1e00 0x7f86e415c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009b30 con 0x7f86e40cd660 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.272+0000 7f86e3fff640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 0x7f86e4159280 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c400 tx=0x7f86d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.273+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00052d0 con 0x7f86e40cd660 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.273+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0005450 con 0x7f86e40cd660 2023-08-10T10:52:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.273+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0007260 con 0x7f86e40cd660 2023-08-10T10:52:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.273+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e415b620 con 0x7f86e40cd660 2023-08-10T10:52:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.273+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e415bbe0 con 0x7f86e40cd660 2023-08-10T10:52:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.274+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86e40d0600 con 0x7f86e40cd660 2023-08-10T10:52:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.275+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86d00073c0 con 0x7f86e40cd660 2023-08-10T10:52:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e17fa640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86c806ac50 0x7f86c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f86d00885f0 con 0x7f86e40cd660 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e8c68640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86c806ac50 0x7f86c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e17fa640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f86c80710d0 0x7f86c80734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86c8073ba0 con 0x7f86c80710d0 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.276+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86d008ab70 con 0x7f86e40cd660 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.277+0000 7f86e8c68640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86c806ac50 0x7f86c806d110 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f86e40b1330 tx=0x7f86d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.277+0000 7f86e9469640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f86c80710d0 0x7f86c80734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.278+0000 7f86e9469640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f86c80710d0 0x7f86c80734f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.280+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== osd.5 v2:172.21.15.117:6800/3863318081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f86c8073ba0 con 0x7f86c80710d0 2023-08-10T10:52:58.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.292+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 --> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86e406ade0 con 0x7f86c80710d0 2023-08-10T10:52:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.293+0000 7f86e17fa640 1 -- 172.21.15.50:0/2569326849 <== osd.5 v2:172.21.15.117:6800/3863318081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f86dc040410 con 0x7f86c80710d0 2023-08-10T10:52:58.294 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:58.294 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:58.294 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f86c80710d0 msgr2=0x7f86c80734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.117:6800/3863318081,v1:172.21.15.117:6801/3863318081] conn(0x7f86c80710d0 0x7f86c80734f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86c806ac50 msgr2=0x7f86c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f86c806ac50 0x7f86c806d110 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f86e40b1330 tx=0x7f86d8008040 comp rx=0 tx=0).stop 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 msgr2=0x7f86e4159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 --2- 172.21.15.50:0/2569326849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40cd660 0x7f86e4159280 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c400 tx=0x7f86d000c8c0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9469640 1 -- 172.21.15.50:0/2569326849 reap_dead start 2023-08-10T10:52:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 shutdown_connections 2023-08-10T10:52:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 >> 172.21.15.50:0/2569326849 conn(0x7f86e40d2900 msgr2=0x7f86e40b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 shutdown_connections 2023-08-10T10:52:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.294+0000 7f86e9c6a640 1 -- 172.21.15.50:0/2569326849 wait complete. 2023-08-10T10:52:58.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-10T10:52:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.535+0000 7fcee95a4640 1 Processor -- start 2023-08-10T10:52:58.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.535+0000 7fcee95a4640 1 -- start start 2023-08-10T10:52:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee95a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 0x7fcee406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee95a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcee415ac00 0x7fcee40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee95a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee415bcb0 con 0x7fcee40b40e0 2023-08-10T10:52:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee95a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40c5540 con 0x7fcee415ac00 2023-08-10T10:52:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee95a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee415b0a0 con 0x7fcee415a820 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcee40b40e0 0x7fcee415e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59784/0 (socket says 172.21.15.50:59784) 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fcee37fe640 1 -- 172.21.15.50:0/3187274769 learned_addr learned my addr 172.21.15.50:0/3187274769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.537+0000 7fceda7fc640 1 --2- 172.21.15.50:0/3187274769 >> v2:172.21.15.50:3300/0 conn(0x7fcee415ac00 0x7fcee40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fcee2ffd640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 0x7fcee406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fcee27fc640 1 -- 172.21.15.50:0/3187274769 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838864456 0 0) 0x7fcee415bcb0 con 0x7fcee40b40e0 2023-08-10T10:52:58.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fcee27fc640 1 -- 172.21.15.50:0/3187274769 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced0003520 con 0x7fcee40b40e0 2023-08-10T10:52:58.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fceda7fc640 1 -- 172.21.15.50:0/3187274769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 msgr2=0x7fcee406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:58.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fceda7fc640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 0x7fcee406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fceda7fc640 1 -- 172.21.15.50:0/3187274769 >> v1:172.21.15.50:6789/0 conn(0x7fcee40b40e0 legacy=0x7fcee415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fceda7fc640 1 -- 172.21.15.50:0/3187274769 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee415b380 con 0x7fcee415ac00 2023-08-10T10:52:58.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.538+0000 7fcee2ffd640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 0x7fcee406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.539+0000 7fceda7fc640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee415ac00 0x7fcee40696a0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd554f526242f4bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.540+0000 7fcee27fc640 1 -- 172.21.15.50:0/3187274769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc02d040 con 0x7fcee415ac00 2023-08-10T10:52:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.540+0000 7fcee27fc640 1 -- 172.21.15.50:0/3187274769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc031810 con 0x7fcee415ac00 2023-08-10T10:52:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.540+0000 7fcee27fc640 1 -- 172.21.15.50:0/3187274769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc031b80 con 0x7fcee415ac00 2023-08-10T10:52:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.540+0000 7fcee95a4640 1 -- 172.21.15.50:0/3187274769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee415ac00 msgr2=0x7fcee40696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.540+0000 7fcee95a4640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee415ac00 0x7fcee40696a0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b8b0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 -- 172.21.15.50:0/3187274769 shutdown_connections 2023-08-10T10:52:58.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee415ac00 0x7fcee40696a0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 --2- 172.21.15.50:0/3187274769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415a820 0x7fcee406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 -- 172.21.15.50:0/3187274769 >> 172.21.15.50:0/3187274769 conn(0x7fcee40b08e0 msgr2=0x7fcee40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 -- 172.21.15.50:0/3187274769 shutdown_connections 2023-08-10T10:52:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.541+0000 7fcee95a4640 1 -- 172.21.15.50:0/3187274769 wait complete. 2023-08-10T10:52:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.543+0000 7fcee95a4640 1 Processor -- start 2023-08-10T10:52:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.543+0000 7fcee95a4640 1 -- start start 2023-08-10T10:52:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 0x7fcee41f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415ac00 0x7fcee414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41f3470 con 0x7fcee40b40e0 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40ad980 con 0x7fcee415a820 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee95a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40adc60 con 0x7fcee415ac00 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43278/0 (socket says 172.21.15.50:43278) 2023-08-10T10:52:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fcee2ffd640 1 -- 172.21.15.50:0/1475495732 learned_addr learned my addr 172.21.15.50:0/1475495732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.544+0000 7fceda7fc640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 0x7fcee41f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee37fe640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415ac00 0x7fcee414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 -- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415ac00 msgr2=0x7fcee414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415ac00 0x7fcee414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 -- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 msgr2=0x7fcee41f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 0x7fcee41f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 -- 172.21.15.50:0/1475495732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009400 con 0x7fcee40b40e0 2023-08-10T10:52:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fceda7fc640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 0x7fcee41f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee2ffd640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fced400e730 tx=0x7fced400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4004230 con 0x7fcee40b40e0 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4004390 con 0x7fcee40b40e0 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400c8f0 con 0x7fcee40b40e0 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee40adf40 con 0x7fcee40b40e0 2023-08-10T10:52:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.545+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee40ae500 con 0x7fcee40b40e0 2023-08-10T10:52:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.547+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee404e270 con 0x7fcee40b40e0 2023-08-10T10:52:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.547+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fced400ca50 con 0x7fcee40b40e0 2023-08-10T10:52:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.548+0000 7fcedbfff640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 0x7fcec406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.548+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fced4088e90 con 0x7fcee40b40e0 2023-08-10T10:52:58.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.549+0000 7fceda7fc640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 0x7fcec406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.550+0000 7fceda7fc640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 0x7fcec406d110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.552+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fced40541c0 con 0x7fcee40b40e0 2023-08-10T10:52:58.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.745+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcee415b940 con 0x7fcec406ac50 2023-08-10T10:52:58.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.745+0000 7fcedbfff640 1 -- 172.21.15.50:0/1475495732 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcecc004380 con 0x7fcec406ac50 2023-08-10T10:52:58.746 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2023-08-10T10:52:58.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 msgr2=0x7fcec406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 0x7fcec406d110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc008030 comp rx=0 tx=0).stop 2023-08-10T10:52:58.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 msgr2=0x7fcee40c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fced400e730 tx=0x7fced400ebf0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 shutdown_connections 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcee415ac00 0x7fcee414a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fcec406ac50 0x7fcec406d110 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcee415a820 0x7fcee41f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 --2- 172.21.15.50:0/1475495732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee40b40e0 0x7fcee40c4bc0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 >> 172.21.15.50:0/1475495732 conn(0x7fcee40b08e0 msgr2=0x7fcee40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 shutdown_connections 2023-08-10T10:52:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.748+0000 7fcee95a4640 1 -- 172.21.15.50:0/1475495732 wait complete. 2023-08-10T10:52:58.768 INFO:tasks.ceph:Scrubbing osd.6 2023-08-10T10:52:58.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.994+0000 7fde6461f640 1 Processor -- start 2023-08-10T10:52:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.994+0000 7fde6461f640 1 -- start start 2023-08-10T10:52:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde6461f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c15a820 0x7fde5c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde6461f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde5c15ac00 0x7fde5c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde6461f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c15bcb0 con 0x7fde5c0b40e0 2023-08-10T10:52:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde6461f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0c5540 con 0x7fde5c15ac00 2023-08-10T10:52:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde6461f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15b0a0 con 0x7fde5c15a820 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde61bba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde5c15ac00 0x7fde5c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde61bba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde5c15ac00 0x7fde5c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43286/0 (socket says 172.21.15.50:43286) 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde61bba640 1 -- 172.21.15.50:0/2217899887 learned_addr learned my addr 172.21.15.50:0/2217899887 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.996+0000 7fde62bbc640 1 --1- 172.21.15.50:0/2217899887 >> v1:172.21.15.50:6789/0 conn(0x7fde5c0b40e0 0x7fde5c15e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59794/0 (socket says 172.21.15.50:59794) 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde623bb640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c15a820 0x7fde5c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde61bba640 1 -- 172.21.15.50:0/2217899887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c15a820 msgr2=0x7fde5c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde61bba640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c15a820 0x7fde5c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde61bba640 1 -- 172.21.15.50:0/2217899887 >> v1:172.21.15.50:6789/0 conn(0x7fde5c0b40e0 legacy=0x7fde5c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde61bba640 1 -- 172.21.15.50:0/2217899887 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c15b380 con 0x7fde5c15ac00 2023-08-10T10:52:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.997+0000 7fde613b9640 1 -- 172.21.15.50:0/2217899887 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080239447 0 0) 0x7fde5c15bcb0 con 0x7fde5c0b40e0 2023-08-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.998+0000 7fde61bba640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15ac00 0x7fde5c0696a0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009870 tx=0x7fde4c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b26eda764df1f13 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.998+0000 7fde613b9640 1 -- 172.21.15.50:0/2217899887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c030840 con 0x7fde5c15ac00 2023-08-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.998+0000 7fde613b9640 1 -- 172.21.15.50:0/2217899887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0309a0 con 0x7fde5c15ac00 2023-08-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.998+0000 7fde613b9640 1 -- 172.21.15.50:0/2217899887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c030d30 con 0x7fde5c15ac00 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 -- 172.21.15.50:0/2217899887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15ac00 msgr2=0x7fde5c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15ac00 0x7fde5c0696a0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009870 tx=0x7fde4c02b980 comp rx=0 tx=0).stop 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 -- 172.21.15.50:0/2217899887 shutdown_connections 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15ac00 0x7fde5c0696a0 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 --2- 172.21.15.50:0/2217899887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c15a820 0x7fde5c06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 -- 172.21.15.50:0/2217899887 >> 172.21.15.50:0/2217899887 conn(0x7fde5c0b08e0 msgr2=0x7fde5c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 -- 172.21.15.50:0/2217899887 shutdown_connections 2023-08-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:58.999+0000 7fde6461f640 1 -- 172.21.15.50:0/2217899887 wait complete. 2023-08-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.001+0000 7fde6461f640 1 Processor -- start 2023-08-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.001+0000 7fde6461f640 1 -- start start 2023-08-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0b40e0 0x7fde5c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 0x7fde5c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c15ac00 0x7fde5c0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0c2100 con 0x7fde5c15a820 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1f0610 con 0x7fde5c15ac00 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde6461f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1f08f0 con 0x7fde5c0b40e0 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde61bba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 0x7fde5c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde61bba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 0x7fde5c0c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43302/0 (socket says 172.21.15.50:43302) 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.002+0000 7fde61bba640 1 -- 172.21.15.50:0/981719717 learned_addr learned my addr 172.21.15.50:0/981719717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde623bb640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0b40e0 0x7fde5c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 -- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0b40e0 msgr2=0x7fde5c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0b40e0 0x7fde5c0ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 -- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c15ac00 msgr2=0x7fde5c0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c15ac00 0x7fde5c0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0094d0 con 0x7fde5c15a820 2023-08-10T10:52:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde61bba640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 0x7fde5c0c3d00 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c03e070 con 0x7fde5c15a820 2023-08-10T10:52:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c004030 con 0x7fde5c15a820 2023-08-10T10:52:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.003+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0043c0 con 0x7fde5c15a820 2023-08-10T10:52:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.004+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c1f0bd0 con 0x7fde5c15a820 2023-08-10T10:52:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.004+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0c4240 con 0x7fde5c15a820 2023-08-10T10:52:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.005+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde5c15b940 con 0x7fde5c15a820 2023-08-10T10:52:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.006+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde4c042070 con 0x7fde5c15a820 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde52ffd640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde4006ac80 0x7fde4006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fde4c0ab0e0 con 0x7fde5c15a820 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde623bb640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde4006ac80 0x7fde4006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde52ffd640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7fde40071100 0x7fde40073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde40073bd0 con 0x7fde40071100 2023-08-10T10:52:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.007+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde4c0ad6c0 con 0x7fde5c15a820 2023-08-10T10:52:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.008+0000 7fde623bb640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde4006ac80 0x7fde4006d140 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fde58006fd0 tx=0x7fde58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.008+0000 7fde62bbc640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7fde40071100 0x7fde40073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.009+0000 7fde62bbc640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7fde40071100 0x7fde40073520 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.011+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== osd.6 v2:172.21.15.117:6808/1322471095 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fde40073bd0 con 0x7fde40071100 2023-08-10T10:52:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.024+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 --> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde5c15b660 con 0x7fde40071100 2023-08-10T10:52:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.025+0000 7fde52ffd640 1 -- 172.21.15.50:0/981719717 <== osd.6 v2:172.21.15.117:6808/1322471095 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fde54001930 con 0x7fde40071100 2023-08-10T10:52:59.025 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:59.026 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.025+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7fde40071100 msgr2=0x7fde40073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.025+0000 7fde6461f640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.117:6808/1322471095,v1:172.21.15.117:6809/1322471095] conn(0x7fde40071100 0x7fde40073520 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde4006ac80 msgr2=0x7fde4006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fde4006ac80 0x7fde4006d140 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fde58006fd0 tx=0x7fde58008040 comp rx=0 tx=0).stop 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 msgr2=0x7fde5c0c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 --2- 172.21.15.50:0/981719717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde5c15a820 0x7fde5c0c3d00 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c0046c0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde62bbc640 1 -- 172.21.15.50:0/981719717 reap_dead start 2023-08-10T10:52:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 shutdown_connections 2023-08-10T10:52:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 >> 172.21.15.50:0/981719717 conn(0x7fde5c0b08e0 msgr2=0x7fde5c06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 shutdown_connections 2023-08-10T10:52:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.026+0000 7fde6461f640 1 -- 172.21.15.50:0/981719717 wait complete. 2023-08-10T10:52:59.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-10T10:52:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.283+0000 7fc240db1640 1 Processor -- start 2023-08-10T10:52:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.283+0000 7fc240db1640 1 -- start start 2023-08-10T10:52:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.284+0000 7fc240db1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.284+0000 7fc240db1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc23c069db0 0x7fc23c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.284+0000 7fc240db1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c15bcb0 con 0x7fc23c15ac00 2023-08-10T10:52:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.284+0000 7fc240db1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c0c5540 con 0x7fc23c069db0 2023-08-10T10:52:59.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.284+0000 7fc240db1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c15b0a0 con 0x7fc23c15a820 2023-08-10T10:52:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc23c069db0 0x7fc23c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc239d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc23c15ac00 0x7fc23c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59798/0 (socket says 172.21.15.50:59798) 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc239d9b640 1 -- 172.21.15.50:0/2243729523 learned_addr learned my addr 172.21.15.50:0/2243729523 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23a59c640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23ad9d640 1 -- 172.21.15.50:0/2243729523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 msgr2=0x7fc23c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23ad9d640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c06c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23ad9d640 1 -- 172.21.15.50:0/2243729523 >> v1:172.21.15.50:6789/0 conn(0x7fc23c15ac00 legacy=0x7fc23c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23ad9d640 1 -- 172.21.15.50:0/2243729523 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c15b380 con 0x7fc23c069db0 2023-08-10T10:52:59.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.285+0000 7fc23959a640 1 -- 172.21.15.50:0/2243729523 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901866298 0 0) 0x7fc23c15bcb0 con 0x7fc23c15ac00 2023-08-10T10:52:59.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc23ad9d640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c069db0 0x7fc23c0cc370 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fc234009d90 tx=0x7fc23402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62206c3a74c2a3a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc23959a640 1 -- 172.21.15.50:0/2243729523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402cc50 con 0x7fc23c069db0 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc23959a640 1 -- 172.21.15.50:0/2243729523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23402cdb0 con 0x7fc23c069db0 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc23959a640 1 -- 172.21.15.50:0/2243729523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234034660 con 0x7fc23c069db0 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc240db1640 1 -- 172.21.15.50:0/2243729523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c069db0 msgr2=0x7fc23c0cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.287+0000 7fc240db1640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c069db0 0x7fc23c0cc370 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fc234009d90 tx=0x7fc23402bea0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 -- 172.21.15.50:0/2243729523 shutdown_connections 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c069db0 0x7fc23c0cc370 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 --2- 172.21.15.50:0/2243729523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c06c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 -- 172.21.15.50:0/2243729523 >> 172.21.15.50:0/2243729523 conn(0x7fc23c0b08e0 msgr2=0x7fc23c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 -- 172.21.15.50:0/2243729523 shutdown_connections 2023-08-10T10:52:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.288+0000 7fc240db1640 1 -- 172.21.15.50:0/2243729523 wait complete. 2023-08-10T10:52:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.289+0000 7fc240db1640 1 Processor -- start 2023-08-10T10:52:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.290+0000 7fc240db1640 1 -- start start 2023-08-10T10:52:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 0x7fc23c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c2730 con 0x7fc23c15ac00 2023-08-10T10:52:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c2100 con 0x7fc23c069db0 2023-08-10T10:52:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc240db1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c3090 con 0x7fc23c15a820 2023-08-10T10:52:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43316/0 (socket says 172.21.15.50:43316) 2023-08-10T10:52:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 -- 172.21.15.50:0/214921539 learned_addr learned my addr 172.21.15.50:0/214921539 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc239d9b640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 -- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 msgr2=0x7fc23c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23a59c640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 0x7fc23c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.291+0000 7fc23ad9d640 1 -- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 msgr2=0x7fc23c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc23ad9d640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 0x7fc23c0c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc23ad9d640 1 -- 172.21.15.50:0/214921539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009a70 con 0x7fc23c15ac00 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc239d9b640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc23a59c640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 0x7fc23c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc23ad9d640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fc234009d90 tx=0x7fc234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234003b90 con 0x7fc23c15ac00 2023-08-10T10:52:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234003cf0 con 0x7fc23c15ac00 2023-08-10T10:52:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234004270 con 0x7fc23c15ac00 2023-08-10T10:52:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c145e30 con 0x7fc23c15ac00 2023-08-10T10:52:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.292+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c0c2350 con 0x7fc23c15ac00 2023-08-10T10:52:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.294+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c1462f0 con 0x7fc23c15ac00 2023-08-10T10:52:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.295+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc23403b050 con 0x7fc23c15ac00 2023-08-10T10:52:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.296+0000 7fc22affd640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 0x7fc21c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.296+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc2340ab760 con 0x7fc23c15ac00 2023-08-10T10:52:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.296+0000 7fc23a59c640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 0x7fc21c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.297+0000 7fc23a59c640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 0x7fc21c06d110 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc22c006fd0 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.300+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc234076b20 con 0x7fc23c15ac00 2023-08-10T10:52:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.491+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc23c15b940 con 0x7fc21c06ac50 2023-08-10T10:52:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.492+0000 7fc22affd640 1 -- 172.21.15.50:0/214921539 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc22c009e10 con 0x7fc21c06ac50 2023-08-10T10:52:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2023-08-10T10:52:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 msgr2=0x7fc21c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 0x7fc21c06d110 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc22c006fd0 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2023-08-10T10:52:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 msgr2=0x7fc23c1453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fc234009d90 tx=0x7fc234004a40 comp rx=0 tx=0).stop 2023-08-10T10:52:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 shutdown_connections 2023-08-10T10:52:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c15ac00 0x7fc23c1453b0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23c15a820 0x7fc23c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fc21c06ac50 0x7fc21c06d110 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 --2- 172.21.15.50:0/214921539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c069db0 0x7fc23c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 >> 172.21.15.50:0/214921539 conn(0x7fc23c0b08e0 msgr2=0x7fc23c15bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 shutdown_connections 2023-08-10T10:52:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.496+0000 7fc240db1640 1 -- 172.21.15.50:0/214921539 wait complete. 2023-08-10T10:52:59.515 INFO:tasks.ceph:Scrubbing osd.7 2023-08-10T10:52:59.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:52:59.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.751+0000 7f3bf7b39640 1 Processor -- start 2023-08-10T10:52:59.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.752+0000 7f3bf7b39640 1 -- start start 2023-08-10T10:52:59.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.753+0000 7f3bf7b39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00cd730 0x7f3bf00d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.753+0000 7f3bf7b39640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3bf015ce00 0x7f3bf00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.753+0000 7f3bf7b39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00d1220 con 0x7f3bf00b5af0 2023-08-10T10:52:59.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.753+0000 7f3bf7b39640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00d2930 con 0x7f3bf015ce00 2023-08-10T10:52:59.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.753+0000 7f3bf7b39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b8a30 con 0x7f3bf00cd730 2023-08-10T10:52:59.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf50d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3bf015ce00 0x7f3bf00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf60d6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bf00b5af0 0x7f3bf00d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59808/0 (socket says 172.21.15.50:59808) 2023-08-10T10:52:59.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf60d6640 1 -- 172.21.15.50:0/279787638 learned_addr learned my addr 172.21.15.50:0/279787638 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:52:59.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf58d5640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00cd730 0x7f3bf00d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf50d4640 1 -- 172.21.15.50:0/279787638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00cd730 msgr2=0x7f3bf00d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:59.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf50d4640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00cd730 0x7f3bf00d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf50d4640 1 -- 172.21.15.50:0/279787638 >> v1:172.21.15.50:6789/0 conn(0x7f3bf00b5af0 legacy=0x7f3bf00d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.754+0000 7f3bf50d4640 1 -- 172.21.15.50:0/279787638 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00b1e70 con 0x7f3bf015ce00 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.755+0000 7f3bf50d4640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf00cdb10 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f3be00097a0 tx=0x7f3be002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acb4b12c6319bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.756+0000 7f3bf48d3640 1 -- 172.21.15.50:0/279787638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be002d040 con 0x7f3bf015ce00 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.756+0000 7f3bf48d3640 1 -- 172.21.15.50:0/279787638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0031810 con 0x7f3bf015ce00 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.756+0000 7f3bf48d3640 1 -- 172.21.15.50:0/279787638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0031ba0 con 0x7f3bf015ce00 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.756+0000 7f3bf7b39640 1 -- 172.21.15.50:0/279787638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 msgr2=0x7f3bf00cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.756+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf00cdb10 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f3be00097a0 tx=0x7f3be002b8b0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 -- 172.21.15.50:0/279787638 shutdown_connections 2023-08-10T10:52:59.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf00cdb10 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/279787638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00cd730 0x7f3bf00d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 -- 172.21.15.50:0/279787638 >> 172.21.15.50:0/279787638 conn(0x7f3bf00d2c60 msgr2=0x7f3bf00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 -- 172.21.15.50:0/279787638 shutdown_connections 2023-08-10T10:52:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.757+0000 7f3bf7b39640 1 -- 172.21.15.50:0/279787638 wait complete. 2023-08-10T10:52:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.758+0000 7f3bf7b39640 1 Processor -- start 2023-08-10T10:52:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.759+0000 7f3bf7b39640 1 -- start start 2023-08-10T10:52:59.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00b5af0 0x7f3bf015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bf00cd730 0x7f3bf01f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf015e620 con 0x7f3bf015ce00 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf015da10 con 0x7f3bf00cd730 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf7b39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf015dcf0 con 0x7f3bf00b5af0 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43332/0 (socket says 172.21.15.50:43332) 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 -- 172.21.15.50:0/3916033913 learned_addr learned my addr 172.21.15.50:0/3916033913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:52:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf50d4640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bf00cd730 0x7f3bf01f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf58d5640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00b5af0 0x7f3bf015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 -- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00b5af0 msgr2=0x7f3bf015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00b5af0 0x7f3bf015d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 -- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bf00cd730 msgr2=0x7f3bf01f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bf00cd730 0x7f3bf01f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf60d6640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009400 con 0x7f3bf015ce00 2023-08-10T10:52:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.760+0000 7f3bf58d5640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3bf00b5af0 0x7f3bf015d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3bf60d6640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf015eb00 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ca70 tx=0x7f3be800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800abd0 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800ad30 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8012600 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf015dfd0 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.761+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf015d720 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.762+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bf00ce050 con 0x7f3bf015ce00 2023-08-10T10:52:59.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.763+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3be8007070 con 0x7f3bf015ce00 2023-08-10T10:52:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.764+0000 7f3be67fc640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3bd406ac50 0x7f3bd406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3be8089020 con 0x7f3bf015ce00 2023-08-10T10:52:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3bf58d5640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3bd406ac50 0x7f3bd406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3be67fc640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7f3bd40710d0 0x7f3bd40734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bd4073ba0 con 0x7f3bd40710d0 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=195) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3be808b600 con 0x7f3bf015ce00 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3bf58d5640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3bd406ac50 0x7f3bd406d110 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3bec006fd0 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.765+0000 7f3bf50d4640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7f3bd40710d0 0x7f3bd40734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.766+0000 7f3bf50d4640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7f3bd40710d0 0x7f3bd40734f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.768+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== osd.7 v2:172.21.15.117:6824/3330340519 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f3bd4073ba0 con 0x7f3bd40710d0 2023-08-10T10:52:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.781+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 --> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3bf00d0c10 con 0x7f3bd40710d0 2023-08-10T10:52:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.782+0000 7f3be67fc640 1 -- 172.21.15.50:0/3916033913 <== osd.7 v2:172.21.15.117:6824/3330340519 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f3be0031ad0 con 0x7f3bd40710d0 2023-08-10T10:52:59.783 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-08-10T10:52:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-10T10:52:59.784 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-08-10T10:52:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7f3bd40710d0 msgr2=0x7f3bd40734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.117:6824/3330340519,v1:172.21.15.117:6825/3330340519] conn(0x7f3bd40710d0 0x7f3bd40734f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3bd406ac50 msgr2=0x7f3bd406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f3bd406ac50 0x7f3bd406d110 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3bec006fd0 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 msgr2=0x7f3bf015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 --2- 172.21.15.50:0/3916033913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf015ce00 0x7f3bf015eb00 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ca70 tx=0x7f3be800cf30 comp rx=0 tx=0).stop 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf60d6640 1 -- 172.21.15.50:0/3916033913 reap_dead start 2023-08-10T10:52:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 shutdown_connections 2023-08-10T10:52:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.783+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 >> 172.21.15.50:0/3916033913 conn(0x7f3bf00d2c60 msgr2=0x7f3bf00b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.784+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 shutdown_connections 2023-08-10T10:52:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:52:59.784+0000 7f3bf7b39640 1 -- 172.21.15.50:0/3916033913 wait complete. 2023-08-10T10:52:59.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-10T10:53:00.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.024+0000 7f8c58db5640 1 Processor -- start 2023-08-10T10:53:00.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.024+0000 7f8c58db5640 1 -- start start 2023-08-10T10:53:00.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c58db5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c540c3dc0 0x7f8c540b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c58db5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540af710 0x7f8c540b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c58db5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540c41a0 con 0x7f8c540afc60 2023-08-10T10:53:00.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c58db5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540b0160 con 0x7f8c540c3dc0 2023-08-10T10:53:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c58db5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c541650a0 con 0x7f8c540af710 2023-08-10T10:53:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c51d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8c540afc60 0x7f8c5406e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.50:56260/0 (socket says 172.21.15.50:56260) 2023-08-10T10:53:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c5259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c540c3dc0 0x7f8c540b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.026+0000 7f8c51d9b640 1 -- 172.21.15.50:0/1545953352 learned_addr learned my addr 172.21.15.50:0/1545953352 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:53:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.027+0000 7f8c52d9d640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540af710 0x7f8c540b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.027+0000 7f8c5259c640 1 -- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540af710 msgr2=0x7f8c540b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.027+0000 7f8c5259c640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540af710 0x7f8c540b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.027+0000 7f8c5259c640 1 -- 172.21.15.50:0/1545953352 >> v1:172.21.15.117:6789/0 conn(0x7f8c540afc60 legacy=0x7f8c5406e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.027+0000 7f8c5259c640 1 -- 172.21.15.50:0/1545953352 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54165380 con 0x7f8c540c3dc0 2023-08-10T10:53:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.029+0000 7f8c5259c640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540c3dc0 0x7f8c540b22f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009d90 tx=0x7f8c4402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35685868d568036f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.029+0000 7f8c5159a640 1 -- 172.21.15.50:0/1545953352 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402cc60 con 0x7f8c540c3dc0 2023-08-10T10:53:00.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.029+0000 7f8c5159a640 1 -- 172.21.15.50:0/1545953352 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4402cdc0 con 0x7f8c540c3dc0 2023-08-10T10:53:00.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.029+0000 7f8c5159a640 1 -- 172.21.15.50:0/1545953352 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44034660 con 0x7f8c540c3dc0 2023-08-10T10:53:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.030+0000 7f8c58db5640 1 -- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540c3dc0 msgr2=0x7f8c540b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.030+0000 7f8c58db5640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540c3dc0 0x7f8c540b22f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009d90 tx=0x7f8c4402beb0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 -- 172.21.15.50:0/1545953352 shutdown_connections 2023-08-10T10:53:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540af710 0x7f8c540b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 --2- 172.21.15.50:0/1545953352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540c3dc0 0x7f8c540b22f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 -- 172.21.15.50:0/1545953352 >> 172.21.15.50:0/1545953352 conn(0x7f8c540cd2f0 msgr2=0x7f8c540cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 -- 172.21.15.50:0/1545953352 shutdown_connections 2023-08-10T10:53:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.031+0000 7f8c58db5640 1 -- 172.21.15.50:0/1545953352 wait complete. 2023-08-10T10:53:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.032+0000 7f8c58db5640 1 Processor -- start 2023-08-10T10:53:00.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.033+0000 7f8c58db5640 1 -- start start 2023-08-10T10:53:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540afc60 0x7f8c541fa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540c3dc0 0x7f8c541f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c541fb3f0 con 0x7f8c540af710 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54148e70 con 0x7f8c540afc60 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c58db5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c541fae30 con 0x7f8c540c3dc0 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43348/0 (socket says 172.21.15.50:43348) 2023-08-10T10:53:00.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 -- 172.21.15.50:0/2271988542 learned_addr learned my addr 172.21.15.50:0/2271988542 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c51d9b640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540afc60 0x7f8c541fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c52d9d640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540c3dc0 0x7f8c541f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 -- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540c3dc0 msgr2=0x7f8c541f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540c3dc0 0x7f8c541f7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 -- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540afc60 msgr2=0x7f8c541fa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.034+0000 7f8c5259c640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540afc60 0x7f8c541fa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c5259c640 1 -- 172.21.15.50:0/2271988542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009a70 con 0x7f8c540af710 2023-08-10T10:53:00.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c5259c640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009eb0 tx=0x7f8c44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4403e610 con 0x7f8c540af710 2023-08-10T10:53:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4403e790 con 0x7f8c540af710 2023-08-10T10:53:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4403eb40 con 0x7f8c540af710 2023-08-10T10:53:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c541fb110 con 0x7f8c540af710 2023-08-10T10:53:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.035+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c54149840 con 0x7f8c540af710 2023-08-10T10:53:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.037+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5404e270 con 0x7f8c540af710 2023-08-10T10:53:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.038+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c4403b050 con 0x7f8c540af710 2023-08-10T10:53:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.039+0000 7f8c42ffd640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 0x7f8c3406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.039+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8c440aba50 con 0x7f8c540af710 2023-08-10T10:53:00.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.039+0000 7f8c51d9b640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 0x7f8c3406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.040+0000 7f8c51d9b640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 0x7f8c3406d110 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406abb0 tx=0x7f8c48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.044+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c44076e10 con 0x7f8c540af710 2023-08-10T10:53:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.235+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c54165940 con 0x7f8c3406ac50 2023-08-10T10:53:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.236+0000 7f8c42ffd640 1 -- 172.21.15.50:0/2271988542 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8c48001370 con 0x7f8c3406ac50 2023-08-10T10:53:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 msgr2=0x7f8c3406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 0x7f8c3406d110 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406abb0 tx=0x7f8c48009040 comp rx=0 tx=0).stop 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 msgr2=0x7f8c54149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009eb0 tx=0x7f8c44004a40 comp rx=0 tx=0).stop 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 shutdown_connections 2023-08-10T10:53:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c540c3dc0 0x7f8c541f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7f8c3406ac50 0x7f8c3406d110 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c540afc60 0x7f8c541fa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 --2- 172.21.15.50:0/2271988542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c540af710 0x7f8c54149300 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 >> 172.21.15.50:0/2271988542 conn(0x7f8c540cd2f0 msgr2=0x7f8c5406e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 shutdown_connections 2023-08-10T10:53:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.239+0000 7f8c58db5640 1 -- 172.21.15.50:0/2271988542 wait complete. 2023-08-10T10:53:00.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:53:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.479+0000 7fb24b59e640 1 Processor -- start 2023-08-10T10:53:00.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.479+0000 7fb24b59e640 1 -- start start 2023-08-10T10:53:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24b59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 0x7fb24c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb24c153c30 0x7fb24c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24b59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c15d010 con 0x7fb24c153850 2023-08-10T10:53:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24b59e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c15d290 con 0x7fb24c153c30 2023-08-10T10:53:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24b59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c15d570 con 0x7fb24c0b1da0 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb24c153c30 0x7fb24c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb24c153c30 0x7fb24c0cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43364/0 (socket says 172.21.15.50:43364) 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24ad9d640 1 -- 172.21.15.50:0/3224569262 learned_addr learned my addr 172.21.15.50:0/3224569262 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb24a59c640 1 --1- 172.21.15.50:0/3224569262 >> v1:172.21.15.50:6789/0 conn(0x7fb24c153850 0x7fb24c0b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59816/0 (socket says 172.21.15.50:59816) 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.481+0000 7fb249d9b640 1 --2- 172.21.15.50:0/3224569262 >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 0x7fb24c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb24ad9d640 1 -- 172.21.15.50:0/3224569262 >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 msgr2=0x7fb24c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb24ad9d640 1 --2- 172.21.15.50:0/3224569262 >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 0x7fb24c0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb24ad9d640 1 -- 172.21.15.50:0/3224569262 >> v1:172.21.15.50:6789/0 conn(0x7fb24c153850 legacy=0x7fb24c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb24ad9d640 1 -- 172.21.15.50:0/3224569262 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c15d850 con 0x7fb24c153c30 2023-08-10T10:53:00.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb24959a640 1 -- 172.21.15.50:0/3224569262 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710484487 0 0) 0x7fb24c15d010 con 0x7fb24c153850 2023-08-10T10:53:00.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.482+0000 7fb249d9b640 1 --2- 172.21.15.50:0/3224569262 >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 0x7fb24c0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.483+0000 7fb24ad9d640 1 --2- 172.21.15.50:0/3224569262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153c30 0x7fb24c0cfb70 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fb24c08b960 tx=0x7fb24402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916e6d1a8bc279e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.483+0000 7fb24959a640 1 -- 172.21.15.50:0/3224569262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244030840 con 0x7fb24c153c30 2023-08-10T10:53:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.483+0000 7fb24959a640 1 -- 172.21.15.50:0/3224569262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2440309a0 con 0x7fb24c153c30 2023-08-10T10:53:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.483+0000 7fb24959a640 1 -- 172.21.15.50:0/3224569262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244030d30 con 0x7fb24c153c30 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 -- 172.21.15.50:0/3224569262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153c30 msgr2=0x7fb24c0cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 --2- 172.21.15.50:0/3224569262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153c30 0x7fb24c0cfb70 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fb24c08b960 tx=0x7fb24402b980 comp rx=0 tx=0).stop 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 -- 172.21.15.50:0/3224569262 shutdown_connections 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 --2- 172.21.15.50:0/3224569262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153c30 0x7fb24c0cfb70 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 --2- 172.21.15.50:0/3224569262 >> v2:172.21.15.117:3300/0 conn(0x7fb24c0b1da0 0x7fb24c0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 -- 172.21.15.50:0/3224569262 >> 172.21.15.50:0/3224569262 conn(0x7fb24c069880 msgr2=0x7fb24c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:00.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 -- 172.21.15.50:0/3224569262 shutdown_connections 2023-08-10T10:53:00.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.484+0000 7fb24b59e640 1 -- 172.21.15.50:0/3224569262 wait complete. 2023-08-10T10:53:00.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.486+0000 7fb24b59e640 1 Processor -- start 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.486+0000 7fb24b59e640 1 -- start start 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 0x7fb24c0d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24c152d20 0x7fb24c1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c67e0 con 0x7fb24c153850 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c6ac0 con 0x7fb24c153c30 2023-08-10T10:53:00.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24b59e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c6da0 con 0x7fb24c152d20 2023-08-10T10:53:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43374/0 (socket says 172.21.15.50:43374) 2023-08-10T10:53:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.487+0000 7fb24a59c640 1 -- 172.21.15.50:0/498785117 learned_addr learned my addr 172.21.15.50:0/498785117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb249d9b640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 0x7fb24c0d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24ad9d640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24c152d20 0x7fb24c1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 -- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24c152d20 msgr2=0x7fb24c1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24c152d20 0x7fb24c1560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 -- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 msgr2=0x7fb24c0d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 0x7fb24c0d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 -- 172.21.15.50:0/498785117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440094b0 con 0x7fb24c153850 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb249d9b640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 0x7fb24c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:00.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24a59c640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00c4b0 tx=0x7fb23c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c007480 con 0x7fb24c153850 2023-08-10T10:53:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0075e0 con 0x7fb24c153850 2023-08-10T10:53:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c004a20 con 0x7fb24c153850 2023-08-10T10:53:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.488+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c0c7080 con 0x7fb24c153850 2023-08-10T10:53:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.489+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0ca630 con 0x7fb24c153850 2023-08-10T10:53:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.490+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c0ca820 con 0x7fb24c153850 2023-08-10T10:53:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.491+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb23c004b80 con 0x7fb24c153850 2023-08-10T10:53:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.492+0000 7fb23affd640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 0x7fb22c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.492+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb23c088330 con 0x7fb24c153850 2023-08-10T10:53:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.492+0000 7fb249d9b640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 0x7fb22c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:00.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.493+0000 7fb249d9b640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 0x7fb22c06d140 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb2400094c0 tx=0x7fb24000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.496+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb23c053720 con 0x7fb24c153850 2023-08-10T10:53:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.687+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb24c15db30 con 0x7fb22c06ac80 2023-08-10T10:53:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.691+0000 7fb23affd640 1 -- 172.21.15.50:0/498785117 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67993 (secure 0 0 0) 0x7fb24000f040 con 0x7fb22c06ac80 2023-08-10T10:53:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:53:00.693 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:53:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 msgr2=0x7fb22c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 0x7fb22c06d140 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb2400094c0 tx=0x7fb24000b040 comp rx=0 tx=0).stop 2023-08-10T10:53:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 msgr2=0x7fb24c0c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00c4b0 tx=0x7fb23c00c970 comp rx=0 tx=0).stop 2023-08-10T10:53:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 shutdown_connections 2023-08-10T10:53:00.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24c152d20 0x7fb24c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7fb22c06ac80 0x7fb22c06d140 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24c153c30 0x7fb24c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 --2- 172.21.15.50:0/498785117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb24c153850 0x7fb24c0c6200 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 >> 172.21.15.50:0/498785117 conn(0x7fb24c069880 msgr2=0x7fb24c0b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 shutdown_connections 2023-08-10T10:53:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:00.694+0000 7fb24b59e640 1 -- 172.21.15.50:0/498785117 wait complete. 2023-08-10T10:53:00.713 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":633,"stamp":"2023-08-10T10:53:00.636163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10340,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552159,"statfs":{"total":1600000000,"available":1589411430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002878"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":476,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.009508+0000","last_change":"2023-08-10T10:38:09.904106+0000","last_active":"2023-08-10T10:52:48.009508+0000","last_peered":"2023-08-10T10:52:48.009508+0000","last_clean":"2023-08-10T10:52:48.009508+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:52:48.009508+0000","last_undegraded":"2023-08-10T10:52:48.009508+0000","last_fullsized":"2023-08-10T10:52:48.009508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:08.872624+0000","last_clean_scrub_stamp":"2023-08-10T10:38:08.872624+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:10:23.115632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":344,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.013759+0000","last_change":"2023-08-10T10:38:15.121426+0000","last_active":"2023-08-10T10:52:48.013759+0000","last_peered":"2023-08-10T10:52:48.013759+0000","last_clean":"2023-08-10T10:52:48.013759+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:52:48.013759+0000","last_undegraded":"2023-08-10T10:52:48.013759+0000","last_fullsized":"2023-08-10T10:52:48.013759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:16:14.897089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008540+0000","last_change":"2023-08-10T10:38:15.121942+0000","last_active":"2023-08-10T10:52:48.008540+0000","last_peered":"2023-08-10T10:52:48.008540+0000","last_clean":"2023-08-10T10:52:48.008540+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:52:48.008540+0000","last_undegraded":"2023-08-10T10:52:48.008540+0000","last_fullsized":"2023-08-10T10:52:48.008540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:19.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:56.579874+0000","last_change":"2023-08-10T10:52:56.579929+0000","last_active":"2023-08-10T10:52:56.579874+0000","last_peered":"2023-08-10T10:52:56.579874+0000","last_clean":"2023-08-10T10:52:56.579874+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:52:56.579874+0000","last_undegraded":"2023-08-10T10:52:56.579874+0000","last_fullsized":"2023-08-10T10:52:56.579874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:56.579822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:56.579822+0000","last_clean_scrub_stamp":"2023-08-10T10:52:56.579822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:38.361488+0000","scrub_duration":0.0014375519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":344,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003760+0000","last_change":"2023-08-10T10:38:15.120871+0000","last_active":"2023-08-10T10:52:48.003760+0000","last_peered":"2023-08-10T10:52:48.003760+0000","last_clean":"2023-08-10T10:52:48.003760+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:52:48.003760+0000","last_undegraded":"2023-08-10T10:52:48.003760+0000","last_fullsized":"2023-08-10T10:52:48.003760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:59:54.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":359,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:57.409216+0000","last_change":"2023-08-10T10:52:57.409299+0000","last_active":"2023-08-10T10:52:57.409216+0000","last_peered":"2023-08-10T10:52:57.409216+0000","last_clean":"2023-08-10T10:52:57.409216+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:52:57.409216+0000","last_undegraded":"2023-08-10T10:52:57.409216+0000","last_fullsized":"2023-08-10T10:52:57.409216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:57.409132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:57.409132+0000","last_clean_scrub_stamp":"2023-08-10T10:52:57.409132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:57:01.240558+0000","scrub_duration":0.0028903219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.008423+0000","last_change":"2023-08-10T10:38:15.171055+0000","last_active":"2023-08-10T10:52:48.008423+0000","last_peered":"2023-08-10T10:52:48.008423+0000","last_clean":"2023-08-10T10:52:48.008423+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:52:48.008423+0000","last_undegraded":"2023-08-10T10:52:48.008423+0000","last_fullsized":"2023-08-10T10:52:48.008423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:11.514997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":358,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:56.375379+0000","last_change":"2023-08-10T10:52:56.375489+0000","last_active":"2023-08-10T10:52:56.375379+0000","last_peered":"2023-08-10T10:52:56.375379+0000","last_clean":"2023-08-10T10:52:56.375379+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:52:56.375379+0000","last_undegraded":"2023-08-10T10:52:56.375379+0000","last_fullsized":"2023-08-10T10:52:56.375379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:56.375292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:56.375292+0000","last_clean_scrub_stamp":"2023-08-10T10:52:56.375292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:57:32.911617+0000","scrub_duration":0.0029643590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":313,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:48.003352+0000","last_change":"2023-08-10T10:38:15.122409+0000","last_active":"2023-08-10T10:52:48.003352+0000","last_peered":"2023-08-10T10:52:48.003352+0000","last_clean":"2023-08-10T10:52:48.003352+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:52:48.003352+0000","last_undegraded":"2023-08-10T10:52:48.003352+0000","last_fullsized":"2023-08-10T10:52:48.003352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:38:14.102209+0000","last_clean_scrub_stamp":"2023-08-10T10:38:14.102209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:43.456199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193587,"statfs":{"total":200000000,"available":198233398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.143},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.39600000000000002},"max":{"1min":1.756,"5min":1.756,"15min":4.5679999999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.44800000000000001},"max":{"1min":1.302,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.0760000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.66500000000000004},"max":{"1min":1.6659999999999999,"5min":1.7549999999999999,"15min":4.6470000000000002},"last":0.878},{"interface":"front","average":{"1min":1.159,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.754,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.4930000000000001,"5min":1.958,"15min":8.0830000000000002},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.84799999999999998,"5min":0.70199999999999996,"15min":0.503},"max":{"1min":1.4690000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.323,"15min":1.2869999999999999},"min":{"1min":0.874,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":1.7589999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":0.997}]},{"osd":3,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":1.496,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.409,"15min":1.397},"min":{"1min":1.024,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.8560000000000001,"5min":1.867,"15min":6.069},"last":1.266}]},{"osd":4,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8380000000000001,"5min":1.9339999999999999,"15min":7.1950000000000003},"last":1.137},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":0.876,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":7.4950000000000001},"last":1.198}]},{"osd":5,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4079999999999999,"15min":1.452},"min":{"1min":0.999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9790000000000001,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4279999999999999,"15min":1.48},"min":{"1min":0.998,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":1.96,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.431}]},{"osd":6,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5620000000000001,"15min":1.5740000000000001},"min":{"1min":1.26,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.0790000000000002,"5min":2.1920000000000002,"15min":8.859},"last":1.724},{"interface":"front","average":{"1min":1.474,"5min":1.48,"15min":1.496},"min":{"1min":1.081,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7969999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.6080000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.752,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1379999999999999,"15min":1.0860000000000001},"min":{"1min":0.81899999999999995,"5min":0.71699999999999997,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.002}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.577,"5min":1.764,"15min":2.302},"last":1.351},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.304,"15min":1.238},"min":{"1min":0.93700000000000006,"5min":0.82999999999999996,"15min":0.70099999999999996},"max":{"1min":1.728,"5min":1.728,"15min":2.052},"last":1.556}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.232,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.6040000000000001,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.264,"15min":1.252},"min":{"1min":0.95799999999999996,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.976,"15min":1.976},"last":1.292}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3069999999999999,"15min":1.2909999999999999},"min":{"1min":1.016,"5min":0.94599999999999995,"15min":0.69399999999999995},"max":{"1min":1.7390000000000001,"5min":2.4009999999999998,"15min":3.177},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":1.1379999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.5740000000000001,"5min":1.9199999999999999,"15min":2.395},"last":1.264}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2789999999999999,"15min":1.262},"min":{"1min":0.86299999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.75,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.504,"15min":1.4690000000000001},"min":{"1min":0.84399999999999997,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.788,"5min":2.512,"15min":2.7589999999999999},"last":1.7430000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.446,"15min":1.4419999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.59399999999999997},"max":{"1min":1.7769999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5389999999999999,"15min":1.532},"min":{"1min":1.1799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8859999999999999,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.8049999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.375},"min":{"1min":0.93200000000000005,"5min":0.85399999999999998,"15min":0.53700000000000003},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.415},{"interface":"front","average":{"1min":1.512,"5min":1.506,"15min":1.5189999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65400000000000003},"max":{"1min":1.8320000000000001,"5min":2.355,"15min":2.698},"last":1.7749999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194164,"statfs":{"total":200000000,"available":198824785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.165,"15min":1.133},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.57699999999999996},"max":{"1min":1.548,"5min":1.645,"15min":2.5070000000000001},"last":1.405},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.56599999999999995},"max":{"1min":1.708,"5min":1.857,"15min":32.941000000000003},"last":1.2390000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2729999999999999,"15min":1.2270000000000001},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.583},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.228,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.70299999999999996,"15min":0.62},"max":{"1min":1.5009999999999999,"5min":1.772,"15min":4.3360000000000003},"last":1.1890000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3260000000000001,"15min":1.276},"min":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.67500000000000004},"max":{"1min":1.764,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.375},{"interface":"front","average":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.52600000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.538}]},{"osd":3,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3460000000000001,"15min":1.29},"min":{"1min":1.0129999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.6970000000000001,"5min":2.016,"15min":2.016},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.349},"min":{"1min":0.83299999999999996,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.667,"5min":1.891,"15min":4.0620000000000003},"last":1.5009999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58599999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.9859999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3859999999999999,"15min":1.3740000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.58099999999999996},"max":{"1min":1.708,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4770000000000001,"15min":1.407},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54200000000000004},"max":{"1min":1.792,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4179999999999999,"15min":1.417},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63600000000000001},"max":{"1min":1.8300000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.083}]},{"osd":7,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5149999999999999,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.63100000000000001},"max":{"1min":1.766,"5min":2.0659999999999998,"15min":2.403},"last":1.335},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5680000000000001,"15min":1.526},"min":{"1min":0.73599999999999999,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":1.8839999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.621}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.151},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.54200000000000004},"max":{"1min":1.4790000000000001,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":1.167},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55600000000000005},"max":{"1min":1.6950000000000001,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.272,"15min":1.2529999999999999},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6799999999999999,"5min":1.841,"15min":3.9820000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.2669999999999999,"15min":1.1759999999999999},"min":{"1min":0.80300000000000005,"5min":0.752,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2529999999999999,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.621},"max":{"1min":1.6180000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.081},{"interface":"front","average":{"1min":1.167,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":4.226},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.98699999999999999,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.6539999999999999,"5min":1.6819999999999999,"15min":3.8130000000000002},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.333,"15min":1.3140000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.67000000000000004},"max":{"1min":1.786,"5min":1.792,"15min":4.6859999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.64300000000000002},"max":{"1min":1.851,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.143},{"interface":"front","average":{"1min":1.383,"5min":1.3240000000000001,"15min":1.304},"min":{"1min":0.92200000000000004,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.734,"5min":1.798,"15min":2.9340000000000002},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.47099999999999997},"max":{"1min":1.6080000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.504,"15min":1.4930000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.55000000000000004},"max":{"1min":1.7869999999999999,"5min":2.121,"15min":5.1529999999999996},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.57999999999999996},"max":{"1min":1.8260000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.391},{"interface":"front","average":{"1min":1.456,"5min":1.5740000000000001,"15min":1.546},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.67400000000000004},"max":{"1min":1.875,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.298}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.998,"15min":0.93799999999999994},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.5289999999999999,"5min":2.722,"15min":2.722},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1990000000000001,"15min":1.125},"min":{"1min":0.66500000000000004,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.5620000000000001,"5min":2.883,"15min":2.883},"last":1.472}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0069999999999999,"15min":0.93600000000000005},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.885,"15min":1.885},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.1459999999999999,"15min":1.0640000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1439999999999999,"15min":1.056},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":1.74,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.333,"15min":1.21},"min":{"1min":0.71099999999999997,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.6850000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.3140000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.423,"15min":1.367},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.833,"5min":2.766,"15min":9.8149999999999995},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.304,"15min":1.264},"min":{"1min":0.92700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":2.0259999999999998,"15min":2.5179999999999998},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5229999999999999,"15min":1.4259999999999999},"min":{"1min":1.081,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8620000000000001,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.488,"15min":1.4350000000000001},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.9670000000000001,"5min":2.774,"15min":4.2069999999999999},"last":1.3580000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.421,"15min":1.367},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.6560000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.597,"15min":1.4950000000000001},"min":{"1min":0.95199999999999996,"5min":0.749,"15min":0.749},"max":{"1min":1.861,"5min":2.964,"15min":2.964},"last":1.5189999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5860000000000001,"15min":1.5109999999999999},"min":{"1min":1.1040000000000001,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.0739999999999998,"5min":2.677,"15min":2.677},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.524,"15min":1.4430000000000001},"min":{"1min":1.002,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":2.1920000000000002,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.3759999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.3160000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0069999999999999,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.443},"max":{"1min":1.8140000000000001,"5min":1.825,"15min":1.825},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1279999999999999,"15min":1.087},"min":{"1min":0.61099999999999999,"5min":0.51800000000000002,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.9630000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.248,"15min":1.1899999999999999},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.925,"5min":1.925,"15min":2.0310000000000001},"last":1.125}]},{"osd":3,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.028,"15min":1},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.661,"5min":1.742,"15min":1.877},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.194,"15min":1.1919999999999999},"min":{"1min":0.70499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7190000000000001,"5min":1.839,"15min":3.6920000000000002},"last":1.296}]},{"osd":4,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.391},"min":{"1min":0.96299999999999997,"5min":0.88500000000000001,"15min":0.81799999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6000000000000001},"last":1.008},{"interface":"front","average":{"1min":1.276,"5min":1.3560000000000001,"15min":1.333},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.64200000000000002},"max":{"1min":1.75,"5min":1.968,"15min":4.2220000000000004},"last":1.4219999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3420000000000001,"15min":1.2969999999999999},"min":{"1min":0.91700000000000004,"5min":0.90400000000000003,"15min":0.66600000000000004},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2280000000000002},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4550000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.64900000000000002},"max":{"1min":1.8200000000000001,"5min":1.968,"15min":3.294},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4430000000000001,"15min":1.4239999999999999},"min":{"1min":0.95999999999999996,"5min":0.90900000000000003,"15min":0.81599999999999995},"max":{"1min":1.7689999999999999,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.252},{"interface":"front","average":{"1min":1.359,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.79700000000000004},"max":{"1min":1.851,"5min":1.907,"15min":2.444},"last":1.466}]},{"osd":7,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5129999999999999,"15min":1.48},"min":{"1min":0.98899999999999999,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":2.0449999999999999,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4990000000000001,"15min":1.454},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.79000000000000004},"max":{"1min":1.8029999999999999,"5min":2.0030000000000001,"15min":2.556},"last":1.343}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92300000000000004,"15min":0.879},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":1.4319999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":1.3819999999999999,"5min":1.706,"15min":2.246},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0449999999999999,"15min":0.996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5249999999999999,"5min":1.925,"15min":2.0209999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.276,"15min":1.2},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.42599999999999999},"max":{"1min":1.5640000000000001,"5min":2.0019999999999998,"15min":2.423},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2110000000000001,"15min":1.1539999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.579,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.1659999999999999,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.288,"15min":1.25},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6180000000000001,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.012},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4810000000000001,"15min":1.444},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.738,"5min":2.0499999999999998,"15min":2.343},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4379999999999999,"15min":1.4099999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.67900000000000005},"max":{"1min":1.752,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4119999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0179999999999998,"5min":2.5009999999999999,"15min":2.73},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4390000000000001,"15min":1.4119999999999999},"min":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.2},{"interface":"front","average":{"1min":1.391,"5min":1.4450000000000001,"15min":1.3779999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1200000000000001,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.605,"15min":1.5069999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1440000000000001,"5min":7.798,"15min":7.798},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.466,"5min":1.546,"15min":1.4850000000000001},"min":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":2.2130000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.1639999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575028,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193588,"statfs":{"total":200000000,"available":198234417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.004,"15min":0.98499999999999999},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.28100000000000003},"max":{"1min":1.3919999999999999,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1359999999999999,"15min":1.1100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.434},"max":{"1min":1.4890000000000001,"5min":1.73,"15min":11.173},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0640000000000001,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.39000000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":2.7240000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.0580000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0600000000000001,"15min":1.0209999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5529999999999999,"5min":1.796,"15min":5.9980000000000002},"last":0.624},{"interface":"front","average":{"1min":1.216,"5min":1.2689999999999999,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.794,"5min":1.9730000000000001,"15min":10.739000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.351,"15min":1.3480000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.73199999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":6.5209999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.512,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.751},"max":{"1min":2.0739999999999998,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.026}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.375,"15min":1.369},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":2.238,"15min":2.238},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.387,"15min":1.4239999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.72399999999999998},"max":{"1min":1.6679999999999999,"5min":1.9890000000000001,"15min":16.058},"last":1.151}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.54,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":1.974,"5min":2.375,"15min":2.4790000000000001},"last":1.113},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.508,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.754},"max":{"1min":1.9370000000000001,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.5629999999999999,"15min":1.5269999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.752},"max":{"1min":1.988,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.421,"5min":1.508,"15min":1.48},"min":{"1min":0.96699999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.875,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":0.90100000000000002}]}]}],"pool_statfs":[]}} 2023-08-10T10:53:00.717 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-10T10:38:08.872624+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=8, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.718 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-10T10:38:14.102209+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=14, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.718 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-10T10:38:14.102209+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=14, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.718 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-10T10:38:14.102209+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=14, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.718 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-10T10:38:14.102209+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=14, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.719 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-10T10:38:14.102209+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=38, tm_sec=14, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=52, tm_sec=53, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:53:00.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-10T10:53:16.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:16.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:20.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:53:20.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.961+0000 7ffab57a4640 1 Processor -- start 2023-08-10T10:53:20.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.961+0000 7ffab57a4640 1 -- start start 2023-08-10T10:53:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffab57a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffab00b0620 0x7ffab00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffab57a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffab015f2b0 0x7ffab00b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffab57a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00b1f10 con 0x7ffab015a940 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffab57a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00b21f0 con 0x7ffab00b0620 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffab57a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab015e5c0 con 0x7ffab015f2b0 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffaa7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffab00b0620 0x7ffab00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffaa7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffab00b0620 0x7ffab00b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52620/0 (socket says 172.21.15.50:52620) 2023-08-10T10:53:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.963+0000 7ffaa7fff640 1 -- 172.21.15.50:0/1877229787 learned_addr learned my addr 172.21.15.50:0/1877229787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.964+0000 7ffab4fa3640 1 --2- 172.21.15.50:0/1877229787 >> v2:172.21.15.117:3300/0 conn(0x7ffab015f2b0 0x7ffab00b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.964+0000 7ffaa7fff640 1 -- 172.21.15.50:0/1877229787 >> v2:172.21.15.117:3300/0 conn(0x7ffab015f2b0 msgr2=0x7ffab00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.964+0000 7ffaa7fff640 1 --2- 172.21.15.50:0/1877229787 >> v2:172.21.15.117:3300/0 conn(0x7ffab015f2b0 0x7ffab00b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.964+0000 7ffaa7fff640 1 -- 172.21.15.50:0/1877229787 >> v1:172.21.15.50:6789/0 conn(0x7ffab015a940 legacy=0x7ffab00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.964+0000 7ffaa7fff640 1 -- 172.21.15.50:0/1877229787 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab015e7d0 con 0x7ffab00b0620 2023-08-10T10:53:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.965+0000 7ffaa7fff640 1 --2- 172.21.15.50:0/1877229787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab00b0620 0x7ffab00b12c0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7ffab015e520 tx=0x7ffa9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7711ed30979023e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.965+0000 7ffaaf7fe640 1 -- 172.21.15.50:0/1877229787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031870 con 0x7ffab00b0620 2023-08-10T10:53:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.965+0000 7ffaaf7fe640 1 -- 172.21.15.50:0/1877229787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980319d0 con 0x7ffab00b0620 2023-08-10T10:53:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.965+0000 7ffaaf7fe640 1 -- 172.21.15.50:0/1877229787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031d60 con 0x7ffab00b0620 2023-08-10T10:53:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 -- 172.21.15.50:0/1877229787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab00b0620 msgr2=0x7ffab00b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 --2- 172.21.15.50:0/1877229787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab00b0620 0x7ffab00b12c0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7ffab015e520 tx=0x7ffa9802b910 comp rx=0 tx=0).stop 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 -- 172.21.15.50:0/1877229787 shutdown_connections 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 --2- 172.21.15.50:0/1877229787 >> v2:172.21.15.117:3300/0 conn(0x7ffab015f2b0 0x7ffab00b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 --2- 172.21.15.50:0/1877229787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab00b0620 0x7ffab00b12c0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 -- 172.21.15.50:0/1877229787 >> 172.21.15.50:0/1877229787 conn(0x7ffab006ab80 msgr2=0x7ffab006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 -- 172.21.15.50:0/1877229787 shutdown_connections 2023-08-10T10:53:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.966+0000 7ffab57a4640 1 -- 172.21.15.50:0/1877229787 wait complete. 2023-08-10T10:53:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.968+0000 7ffab57a4640 1 Processor -- start 2023-08-10T10:53:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.968+0000 7ffab57a4640 1 -- start start 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffab00b0620 0x7ffab01f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 0x7ffab00ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01f2300 con 0x7ffab015a940 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c67b0 con 0x7ffab015f2b0 2023-08-10T10:53:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffab57a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c6a90 con 0x7ffab00b0620 2023-08-10T10:53:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52622/0 (socket says 172.21.15.50:52622) 2023-08-10T10:53:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.969+0000 7ffaa7fff640 1 -- 172.21.15.50:0/3187285304 learned_addr learned my addr 172.21.15.50:0/3187285304 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaaffff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffab00b0620 0x7ffab01f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 -- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffab00b0620 msgr2=0x7ffab01f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffab4fa3640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 0x7ffab00ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffab00b0620 0x7ffab01f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 -- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 msgr2=0x7ffab00ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 0x7ffab00ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 -- 172.21.15.50:0/3187285304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980094d0 con 0x7ffab015a940 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffab4fa3640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 0x7ffab00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaa7fff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7ffa9802b950 tx=0x7ffa980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9803ad30 con 0x7ffab015a940 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980443f0 con 0x7ffab015a940 2023-08-10T10:53:20.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980447a0 con 0x7ffab015a940 2023-08-10T10:53:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.970+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab01f24e0 con 0x7ffab015a940 2023-08-10T10:53:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.971+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00c6d70 con 0x7ffab015a940 2023-08-10T10:53:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.972+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00c6bd0 con 0x7ffab015a940 2023-08-10T10:53:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.973+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa98044900 con 0x7ffab015a940 2023-08-10T10:53:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.974+0000 7ffaad7fa640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 0x7ffa9006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.974+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffa9802d040 con 0x7ffab015a940 2023-08-10T10:53:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.974+0000 7ffaaffff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 0x7ffa9006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.975+0000 7ffaaffff640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 0x7ffa9006d0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c43f0 tx=0x7ffaa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:20.979+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffab00c6bd0 con 0x7ffab015a940 2023-08-10T10:53:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.166+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 --> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffab015ed90 con 0x7ffa9006ac20 2023-08-10T10:53:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.171+0000 7ffaad7fa640 1 -- 172.21.15.50:0/3187285304 <== mgr.4103 v2:172.21.15.50:6832/2197471967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67839 (secure 0 0 0) 0x7ffaa0005080 con 0x7ffa9006ac20 2023-08-10T10:53:21.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:53:21.174 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 msgr2=0x7ffa9006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 0x7ffa9006d0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c43f0 tx=0x7ffaa0009040 comp rx=0 tx=0).stop 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 msgr2=0x7ffab01f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7ffa9802b950 tx=0x7ffa980046c0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 shutdown_connections 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffa9006ac20 0x7ffa9006d0e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffab015f2b0 0x7ffab00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab015a940 0x7ffab01f2ce0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 --2- 172.21.15.50:0/3187285304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffab00b0620 0x7ffab01f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 >> 172.21.15.50:0/3187285304 conn(0x7ffab006ab80 msgr2=0x7ffab00ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 shutdown_connections 2023-08-10T10:53:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.174+0000 7ffab57a4640 1 -- 172.21.15.50:0/3187285304 wait complete. 2023-08-10T10:53:21.194 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":643,"stamp":"2023-08-10T10:53:20.641980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10340,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552159,"statfs":{"total":1600000000,"available":1589411430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003368"},"pg_stats":[{"pgid":"1.0","version":"195'119","reported_seq":487,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:02.154989+0000","last_change":"2023-08-10T10:53:02.155110+0000","last_active":"2023-08-10T10:53:02.154989+0000","last_peered":"2023-08-10T10:53:02.154989+0000","last_clean":"2023-08-10T10:53:02.154989+0000","last_became_active":"2023-08-10T10:38:09.903506+0000","last_became_peered":"2023-08-10T10:38:09.903506+0000","last_unstale":"2023-08-10T10:53:02.154989+0000","last_undegraded":"2023-08-10T10:53:02.154989+0000","last_fullsized":"2023-08-10T10:53:02.154989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"195'119","last_scrub_stamp":"2023-08-10T10:53:02.154891+0000","last_deep_scrub":"195'119","last_deep_scrub_stamp":"2023-08-10T10:53:02.154891+0000","last_clean_scrub_stamp":"2023-08-10T10:53:02.154891+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:42.221816+0000","scrub_duration":0.0062830230000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":353,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:03.778846+0000","last_change":"2023-08-10T10:53:03.778948+0000","last_active":"2023-08-10T10:53:03.778846+0000","last_peered":"2023-08-10T10:53:03.778846+0000","last_clean":"2023-08-10T10:53:03.778846+0000","last_became_active":"2023-08-10T10:38:15.120254+0000","last_became_peered":"2023-08-10T10:38:15.120254+0000","last_unstale":"2023-08-10T10:53:03.778846+0000","last_undegraded":"2023-08-10T10:53:03.778846+0000","last_fullsized":"2023-08-10T10:53:03.778846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:53:03.778761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:53:03.778761+0000","last_clean_scrub_stamp":"2023-08-10T10:53:03.778761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:06.872874+0000","scrub_duration":0.0031518290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":331,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:05.167726+0000","last_change":"2023-08-10T10:53:05.167830+0000","last_active":"2023-08-10T10:53:05.167726+0000","last_peered":"2023-08-10T10:53:05.167726+0000","last_clean":"2023-08-10T10:53:05.167726+0000","last_became_active":"2023-08-10T10:38:15.121287+0000","last_became_peered":"2023-08-10T10:38:15.121287+0000","last_unstale":"2023-08-10T10:53:05.167726+0000","last_undegraded":"2023-08-10T10:53:05.167726+0000","last_fullsized":"2023-08-10T10:53:05.167726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:53:05.167606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:53:05.167606+0000","last_clean_scrub_stamp":"2023-08-10T10:53:05.167606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:30:31.244893+0000","scrub_duration":0.003207091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:56.579874+0000","last_change":"2023-08-10T10:52:56.579929+0000","last_active":"2023-08-10T10:52:56.579874+0000","last_peered":"2023-08-10T10:52:56.579874+0000","last_clean":"2023-08-10T10:52:56.579874+0000","last_became_active":"2023-08-10T10:38:15.116920+0000","last_became_peered":"2023-08-10T10:38:15.116920+0000","last_unstale":"2023-08-10T10:52:56.579874+0000","last_undegraded":"2023-08-10T10:52:56.579874+0000","last_fullsized":"2023-08-10T10:52:56.579874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:56.579822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:56.579822+0000","last_clean_scrub_stamp":"2023-08-10T10:52:56.579822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:20:38.361488+0000","scrub_duration":0.0014375519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":353,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:05.732484+0000","last_change":"2023-08-10T10:53:05.732596+0000","last_active":"2023-08-10T10:53:05.732484+0000","last_peered":"2023-08-10T10:53:05.732484+0000","last_clean":"2023-08-10T10:53:05.732484+0000","last_became_active":"2023-08-10T10:38:15.120085+0000","last_became_peered":"2023-08-10T10:38:15.120085+0000","last_unstale":"2023-08-10T10:53:05.732484+0000","last_undegraded":"2023-08-10T10:53:05.732484+0000","last_fullsized":"2023-08-10T10:53:05.732484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:53:05.732404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:53:05.732404+0000","last_clean_scrub_stamp":"2023-08-10T10:53:05.732404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:02.170075+0000","scrub_duration":0.003200151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":359,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:57.409216+0000","last_change":"2023-08-10T10:52:57.409299+0000","last_active":"2023-08-10T10:52:57.409216+0000","last_peered":"2023-08-10T10:52:57.409216+0000","last_clean":"2023-08-10T10:52:57.409216+0000","last_became_active":"2023-08-10T10:38:15.170193+0000","last_became_peered":"2023-08-10T10:38:15.170193+0000","last_unstale":"2023-08-10T10:52:57.409216+0000","last_undegraded":"2023-08-10T10:52:57.409216+0000","last_fullsized":"2023-08-10T10:52:57.409216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:57.409132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:57.409132+0000","last_clean_scrub_stamp":"2023-08-10T10:52:57.409132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:57:01.240558+0000","scrub_duration":0.0028903219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":331,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:04.214859+0000","last_change":"2023-08-10T10:53:04.214996+0000","last_active":"2023-08-10T10:53:04.214859+0000","last_peered":"2023-08-10T10:53:04.214859+0000","last_clean":"2023-08-10T10:53:04.214859+0000","last_became_active":"2023-08-10T10:38:15.170441+0000","last_became_peered":"2023-08-10T10:38:15.170441+0000","last_unstale":"2023-08-10T10:53:04.214859+0000","last_undegraded":"2023-08-10T10:53:04.214859+0000","last_fullsized":"2023-08-10T10:53:04.214859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:53:04.214769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:53:04.214769+0000","last_clean_scrub_stamp":"2023-08-10T10:53:04.214769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:40.218199+0000","scrub_duration":0.002986785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":358,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:52:56.375379+0000","last_change":"2023-08-10T10:52:56.375489+0000","last_active":"2023-08-10T10:52:56.375379+0000","last_peered":"2023-08-10T10:52:56.375379+0000","last_clean":"2023-08-10T10:52:56.375379+0000","last_became_active":"2023-08-10T10:38:15.119746+0000","last_became_peered":"2023-08-10T10:38:15.119746+0000","last_unstale":"2023-08-10T10:52:56.375379+0000","last_undegraded":"2023-08-10T10:52:56.375379+0000","last_fullsized":"2023-08-10T10:52:56.375379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:52:56.375292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:52:56.375292+0000","last_clean_scrub_stamp":"2023-08-10T10:52:56.375292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:57:32.911617+0000","scrub_duration":0.0029643590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":322,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-08-10T10:53:04.936960+0000","last_change":"2023-08-10T10:53:04.937057+0000","last_active":"2023-08-10T10:53:04.936960+0000","last_peered":"2023-08-10T10:53:04.936960+0000","last_clean":"2023-08-10T10:53:04.936960+0000","last_became_active":"2023-08-10T10:38:15.121676+0000","last_became_peered":"2023-08-10T10:38:15.121676+0000","last_unstale":"2023-08-10T10:53:04.936960+0000","last_undegraded":"2023-08-10T10:53:04.936960+0000","last_fullsized":"2023-08-10T10:53:04.936960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:53:04.936876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:53:04.936876+0000","last_clean_scrub_stamp":"2023-08-10T10:53:04.936876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:47.719818+0000","scrub_duration":0.0026205780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193587,"statfs":{"total":200000000,"available":198233398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.143},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.39600000000000002},"max":{"1min":1.756,"5min":1.756,"15min":4.5679999999999996},"last":1.024},{"interface":"front","average":{"1min":0.995,"5min":1.1299999999999999,"15min":1.1419999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.44800000000000001},"max":{"1min":1.302,"5min":1.8999999999999999,"15min":7.3570000000000002},"last":1.28}]},{"osd":1,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2150000000000001,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.66500000000000004},"max":{"1min":1.6659999999999999,"5min":1.7549999999999999,"15min":4.6470000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2110000000000001,"15min":1.1879999999999999},"min":{"1min":0.754,"5min":0.67100000000000004,"15min":0.378},"max":{"1min":1.4930000000000001,"5min":1.958,"15min":8.0830000000000002},"last":1.1160000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.84799999999999998,"5min":0.70199999999999996,"15min":0.503},"max":{"1min":1.4690000000000001,"5min":2.0270000000000001,"15min":7.4329999999999998},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.323,"15min":1.2869999999999999},"min":{"1min":0.874,"5min":0.81499999999999995,"15min":0.497},"max":{"1min":1.7589999999999999,"5min":2.1339999999999999,"15min":4.5700000000000003},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.433},"max":{"1min":1.496,"5min":2.2320000000000002,"15min":6.5190000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.409,"15min":1.397},"min":{"1min":1.024,"5min":0.75800000000000001,"15min":0.63600000000000001},"max":{"1min":1.8560000000000001,"5min":1.867,"15min":6.069},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8380000000000001,"5min":1.9339999999999999,"15min":7.1950000000000003},"last":1.331},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":0.876,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":7.4950000000000001},"last":1.179}]},{"osd":5,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4079999999999999,"15min":1.452},"min":{"1min":0.999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9790000000000001,"5min":2.0739999999999998,"15min":6.0090000000000003},"last":1.391},{"interface":"front","average":{"1min":1.409,"5min":1.4279999999999999,"15min":1.48},"min":{"1min":0.998,"5min":0.64600000000000002,"15min":0.60399999999999998},"max":{"1min":1.96,"5min":2.1669999999999998,"15min":7.5529999999999999},"last":1.4630000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.5620000000000001,"15min":1.5740000000000001},"min":{"1min":1.26,"5min":0.998,"15min":0.58599999999999997},"max":{"1min":2.0790000000000002,"5min":2.1920000000000002,"15min":8.859},"last":1.599},{"interface":"front","average":{"1min":1.474,"5min":1.48,"15min":1.496},"min":{"1min":1.081,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.7969999999999999,"5min":2.4239999999999999,"15min":7.1139999999999999},"last":1.522}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.175,"15min":1.1259999999999999},"min":{"1min":0.752,"5min":0.72199999999999998,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.1379999999999999,"15min":1.0860000000000001},"min":{"1min":0.81899999999999995,"5min":0.71699999999999997,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.234}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1599999999999999,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.69399999999999995,"15min":0.58499999999999996},"max":{"1min":1.577,"5min":1.764,"15min":2.302},"last":1.516},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.304,"15min":1.238},"min":{"1min":0.93700000000000006,"5min":0.82999999999999996,"15min":0.70099999999999996},"max":{"1min":1.728,"5min":1.728,"15min":2.052},"last":1.397}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.232,"15min":1.1930000000000001},"min":{"1min":0.76800000000000002,"5min":0.72699999999999998,"15min":0.66800000000000004},"max":{"1min":1.6040000000000001,"5min":1.8149999999999999,"15min":2.1669999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.264,"15min":1.252},"min":{"1min":0.95799999999999996,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.976,"15min":1.976},"last":1.3089999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3069999999999999,"15min":1.2909999999999999},"min":{"1min":1.016,"5min":0.94599999999999995,"15min":0.69399999999999995},"max":{"1min":1.7390000000000001,"5min":2.4009999999999998,"15min":3.177},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3340000000000001,"15min":1.296},"min":{"1min":1.1379999999999999,"5min":0.86699999999999999,"15min":0.71599999999999997},"max":{"1min":1.5740000000000001,"5min":1.9199999999999999,"15min":2.395},"last":1.353}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2789999999999999,"15min":1.262},"min":{"1min":0.86299999999999999,"5min":0.73799999999999999,"15min":0.49399999999999999},"max":{"1min":1.75,"5min":2.1480000000000001,"15min":2.7250000000000001},"last":1.2},{"interface":"front","average":{"1min":1.518,"5min":1.504,"15min":1.4690000000000001},"min":{"1min":0.84399999999999997,"5min":0.67100000000000004,"15min":0.622},"max":{"1min":1.788,"5min":2.512,"15min":2.7589999999999999},"last":1.623}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.446,"15min":1.4419999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.59399999999999997},"max":{"1min":1.7769999999999999,"5min":2.2330000000000001,"15min":2.4510000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5389999999999999,"15min":1.532},"min":{"1min":1.1799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8859999999999999,"5min":2.2829999999999999,"15min":2.8700000000000001},"last":1.6679999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.375},"min":{"1min":0.93200000000000005,"5min":0.85399999999999998,"15min":0.53700000000000003},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":3.1019999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.506,"15min":1.5189999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65400000000000003},"max":{"1min":1.8320000000000001,"5min":2.355,"15min":2.698},"last":1.5549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194164,"statfs":{"total":200000000,"available":198824785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.165,"15min":1.133},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.57699999999999996},"max":{"1min":1.548,"5min":1.645,"15min":2.5070000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.56599999999999995},"max":{"1min":1.708,"5min":1.857,"15min":32.941000000000003},"last":1.044}]},{"osd":1,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2729999999999999,"15min":1.2270000000000001},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.51400000000000001},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.2450000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.228,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.70299999999999996,"15min":0.62},"max":{"1min":1.5009999999999999,"5min":1.772,"15min":4.3360000000000003},"last":1.093}]},{"osd":2,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3260000000000001,"15min":1.276},"min":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.67500000000000004},"max":{"1min":1.764,"5min":1.9490000000000001,"15min":4.1980000000000004},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.52600000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3460000000000001,"15min":1.29},"min":{"1min":1.0129999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"max":{"1min":1.6970000000000001,"5min":2.016,"15min":2.016},"last":1.329},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3779999999999999,"15min":1.349},"min":{"1min":0.83299999999999996,"5min":0.82299999999999995,"15min":0.76400000000000001},"max":{"1min":1.667,"5min":1.891,"15min":4.0620000000000003},"last":1.534}]},{"osd":4,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2210000000000001,"15min":1.254},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58599999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":4.9859999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3859999999999999,"15min":1.3740000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.58099999999999996},"max":{"1min":1.708,"5min":1.9019999999999999,"15min":2.0299999999999998},"last":1.139}]},{"osd":6,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4770000000000001,"15min":1.407},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54200000000000004},"max":{"1min":1.792,"5min":2.0089999999999999,"15min":2.0499999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4179999999999999,"15min":1.417},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.63600000000000001},"max":{"1min":1.8300000000000001,"5min":2.0840000000000001,"15min":3.1970000000000001},"last":1.577}]},{"osd":7,"last update":"Thu Aug 10 10:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5149999999999999,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.63100000000000001},"max":{"1min":1.766,"5min":2.0659999999999998,"15min":2.403},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5680000000000001,"15min":1.526},"min":{"1min":0.73599999999999999,"5min":0.72899999999999998,"15min":0.67300000000000004},"max":{"1min":1.8839999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.667}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.151},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.54200000000000004},"max":{"1min":1.4790000000000001,"5min":1.8839999999999999,"15min":4.4009999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.216,"15min":1.1919999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55600000000000005},"max":{"1min":1.6950000000000001,"5min":1.7490000000000001,"15min":3.7629999999999999},"last":1.238}]},{"osd":1,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.272,"15min":1.2529999999999999},"min":{"1min":0.79400000000000004,"5min":0.63700000000000001,"15min":0.61899999999999999},"max":{"1min":1.6799999999999999,"5min":1.841,"15min":3.9820000000000002},"last":1.627},{"interface":"front","average":{"1min":1.236,"5min":1.2669999999999999,"15min":1.1759999999999999},"min":{"1min":0.80300000000000005,"5min":0.752,"15min":0.58499999999999996},"max":{"1min":1.5920000000000001,"5min":2.0539999999999998,"15min":2.2200000000000002},"last":1.0009999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2529999999999999,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.621},"max":{"1min":1.6180000000000001,"5min":2.2850000000000001,"15min":4.4969999999999999},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":4.226},"last":1.5429999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.98699999999999999,"5min":0.67900000000000005,"15min":0.64300000000000002},"max":{"1min":1.6539999999999999,"5min":1.6819999999999999,"15min":3.8130000000000002},"last":1.204},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.333,"15min":1.3140000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.67000000000000004},"max":{"1min":1.786,"5min":1.792,"15min":4.6859999999999999},"last":1.6020000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.337},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.64300000000000002},"max":{"1min":1.851,"5min":1.9750000000000001,"15min":4.8550000000000004},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3240000000000001,"15min":1.304},"min":{"1min":0.92200000000000004,"5min":0.76900000000000002,"15min":0.42399999999999999},"max":{"1min":1.734,"5min":1.798,"15min":2.9340000000000002},"last":1.1080000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.47099999999999997},"max":{"1min":1.6080000000000001,"5min":1.9690000000000001,"15min":4.5590000000000002},"last":1.381},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.504,"15min":1.4930000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.55000000000000004},"max":{"1min":1.7869999999999999,"5min":2.121,"15min":5.1529999999999996},"last":1.337}]},{"osd":7,"last update":"Thu Aug 10 10:52:43 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.57999999999999996},"max":{"1min":1.8260000000000001,"5min":2.3340000000000001,"15min":3.7130000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.5740000000000001,"15min":1.546},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.67400000000000004},"max":{"1min":1.875,"5min":2.3900000000000001,"15min":4.6280000000000001},"last":1.6799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.998,"15min":0.93799999999999994},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.28999999999999998},"max":{"1min":1.5289999999999999,"5min":2.722,"15min":2.722},"last":1.123},{"interface":"front","average":{"1min":1.157,"5min":1.1990000000000001,"15min":1.125},"min":{"1min":0.66500000000000004,"5min":0.47099999999999997,"15min":0.433},"max":{"1min":1.5620000000000001,"5min":2.883,"15min":2.883},"last":1.071}]},{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0069999999999999,"15min":0.93600000000000005},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.885,"15min":1.885},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.1459999999999999,"15min":1.0640000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34100000000000003},"max":{"1min":1.6080000000000001,"5min":1.97,"15min":1.97},"last":1.359}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1439999999999999,"15min":1.056},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.34899999999999998},"max":{"1min":1.74,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.599},{"interface":"front","average":{"1min":1.204,"5min":1.333,"15min":1.21},"min":{"1min":0.71099999999999997,"5min":0.53900000000000003,"15min":0.46899999999999997},"max":{"1min":1.6850000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.3}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.423,"15min":1.367},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.70599999999999996},"max":{"1min":1.833,"5min":2.766,"15min":9.8149999999999995},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.304,"15min":1.264},"min":{"1min":0.92700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":2.0259999999999998,"15min":2.5179999999999998},"last":1.393}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.5229999999999999,"15min":1.4259999999999999},"min":{"1min":1.081,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8620000000000001,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.452},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.488,"15min":1.4350000000000001},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.621},"max":{"1min":1.9670000000000001,"5min":2.774,"15min":4.2069999999999999},"last":1.504}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.421,"15min":1.367},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.6560000000000001},"last":1.635},{"interface":"front","average":{"1min":1.494,"5min":1.597,"15min":1.4950000000000001},"min":{"1min":0.95199999999999996,"5min":0.749,"15min":0.749},"max":{"1min":1.861,"5min":2.964,"15min":2.964},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5860000000000001,"15min":1.5109999999999999},"min":{"1min":1.1040000000000001,"5min":0.82399999999999995,"15min":0.754},"max":{"1min":2.0739999999999998,"5min":2.677,"15min":2.677},"last":1.673},{"interface":"front","average":{"1min":1.504,"5min":1.524,"15min":1.4430000000000001},"min":{"1min":1.002,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":2.1920000000000002,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.724}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.30099999999999999},"max":{"1min":1.3160000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0069999999999999,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.443},"max":{"1min":1.8140000000000001,"5min":1.825,"15min":1.825},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1279999999999999,"15min":1.087},"min":{"1min":0.61099999999999999,"5min":0.51800000000000002,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.9630000000000001},"last":1.333},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.248,"15min":1.1899999999999999},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.503},"max":{"1min":1.925,"5min":1.925,"15min":2.0310000000000001},"last":1.7030000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.028,"15min":1},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.661,"5min":1.742,"15min":1.877},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.194,"15min":1.1919999999999999},"min":{"1min":0.70499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7190000000000001,"5min":1.839,"15min":3.6920000000000002},"last":1.3939999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.391},"min":{"1min":0.96299999999999997,"5min":0.88500000000000001,"15min":0.81799999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6000000000000001},"last":1.659},{"interface":"front","average":{"1min":1.276,"5min":1.3560000000000001,"15min":1.333},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.64200000000000002},"max":{"1min":1.75,"5min":1.968,"15min":4.2220000000000004},"last":1.3640000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3420000000000001,"15min":1.2969999999999999},"min":{"1min":0.91700000000000004,"5min":0.90400000000000003,"15min":0.66600000000000004},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2280000000000002},"last":1.288},{"interface":"front","average":{"1min":1.409,"5min":1.462,"15min":1.4550000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.64900000000000002},"max":{"1min":1.8200000000000001,"5min":1.968,"15min":3.294},"last":1.9850000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4430000000000001,"15min":1.4239999999999999},"min":{"1min":0.95999999999999996,"5min":0.90900000000000003,"15min":0.81599999999999995},"max":{"1min":1.7689999999999999,"5min":2.0960000000000001,"15min":2.6509999999999998},"last":1.611},{"interface":"front","average":{"1min":1.359,"5min":1.4259999999999999,"15min":1.385},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.79700000000000004},"max":{"1min":1.851,"5min":1.907,"15min":2.444},"last":1.427}]},{"osd":7,"last update":"Thu Aug 10 10:52:39 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5129999999999999,"15min":1.48},"min":{"1min":0.98899999999999999,"5min":0.84999999999999998,"15min":0.79800000000000004},"max":{"1min":2.0449999999999999,"5min":2.2240000000000002,"15min":2.9009999999999998},"last":1.476},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4990000000000001,"15min":1.454},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.79000000000000004},"max":{"1min":1.8029999999999999,"5min":2.0030000000000001,"15min":2.556},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194163,"statfs":{"total":200000000,"available":198823766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92300000000000004,"15min":0.879},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":1.4319999999999999,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":1.3819999999999999,"5min":1.706,"15min":2.246},"last":1.127}]},{"osd":2,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0449999999999999,"15min":0.996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.436},"max":{"1min":1.5249999999999999,"5min":1.925,"15min":2.0209999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.276,"15min":1.2},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.42599999999999999},"max":{"1min":1.5640000000000001,"5min":2.0019999999999998,"15min":2.423},"last":1.2070000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2110000000000001,"15min":1.1539999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.579,"5min":1.7150000000000001,"15min":2.5350000000000001},"last":1.345},{"interface":"front","average":{"1min":1.052,"5min":1.1659999999999999,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":2.8940000000000001},"last":1.006}]},{"osd":4,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.288,"15min":1.25},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6180000000000001,"5min":1.8069999999999999,"15min":2.1269999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4810000000000001,"15min":1.444},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.738,"5min":2.0499999999999998,"15min":2.343},"last":1.4990000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4379999999999999,"15min":1.4099999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.67900000000000005},"max":{"1min":1.752,"5min":2.3959999999999999,"15min":2.9969999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4119999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0179999999999998,"5min":2.5009999999999999,"15min":2.73},"last":1.401}]},{"osd":6,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4390000000000001,"15min":1.4119999999999999},"min":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0310000000000001,"15min":2.4670000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4450000000000001,"15min":1.3779999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.1200000000000001,"5min":2.2280000000000002,"15min":2.2490000000000001},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.605,"15min":1.5069999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1440000000000001,"5min":7.798,"15min":7.798},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.546,"15min":1.4850000000000001},"min":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.625},"max":{"1min":2.2130000000000001,"5min":2.2480000000000002,"15min":2.605},"last":1.3149999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193588,"statfs":{"total":200000000,"available":198234417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.004,"15min":0.98499999999999999},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.28100000000000003},"max":{"1min":1.3919999999999999,"5min":1.5920000000000001,"15min":8.6899999999999995},"last":1.141},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1359999999999999,"15min":1.1100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.434},"max":{"1min":1.4890000000000001,"5min":1.73,"15min":11.173},"last":1.1719999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0640000000000001,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.39000000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":2.7240000000000002},"last":1.256},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.0580000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.0369999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0600000000000001,"15min":1.0209999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5529999999999999,"5min":1.796,"15min":5.9980000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.2689999999999999,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.46700000000000003},"max":{"1min":1.794,"5min":1.9730000000000001,"15min":10.739000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.351,"15min":1.3480000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.73199999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":6.5209999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.512,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.751},"max":{"1min":2.0739999999999998,"5min":2.6190000000000002,"15min":3.1739999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.375,"15min":1.369},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.69999999999999996},"max":{"1min":1.861,"5min":2.238,"15min":2.238},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.387,"15min":1.4239999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.72399999999999998},"max":{"1min":1.6679999999999999,"5min":1.9890000000000001,"15min":16.058},"last":1.212}]},{"osd":6,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.54,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.878,"15min":0.71699999999999997},"max":{"1min":1.974,"5min":2.375,"15min":2.4790000000000001},"last":1.637},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.508,"15min":1.458},"min":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.754},"max":{"1min":1.9370000000000001,"5min":2.3010000000000002,"15min":3.2240000000000002},"last":1.603}]},{"osd":7,"last update":"Thu Aug 10 10:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.5629999999999999,"15min":1.5269999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.752},"max":{"1min":1.988,"5min":2.1549999999999998,"15min":3.3330000000000002},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.508,"15min":1.48},"min":{"1min":0.96699999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.875,"5min":2.0249999999999999,"15min":6.5670000000000002},"last":1.494}]}]}],"pool_statfs":[]}} 2023-08-10T10:53:21.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-10T10:53:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.405+0000 7ffbcf509640 1 Processor -- start 2023-08-10T10:53:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.405+0000 7ffbcf509640 1 -- start start 2023-08-10T10:53:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.406+0000 7ffbcf509640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffbc80c15e0 0x7ffbc80c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcf509640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbc80696a0 0x7ffbc8069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcf509640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc80cc8d0 con 0x7ffbc8160fa0 2023-08-10T10:53:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcf509640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc806a050 con 0x7ffbc80696a0 2023-08-10T10:53:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcf509640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80ccbb0 con 0x7ffbc80c15e0 2023-08-10T10:53:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbce507640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffbc8160fa0 0x7ffbc80cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41496/0 (socket says 172.21.15.50:41496) 2023-08-10T10:53:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbce507640 1 -- 172.21.15.50:0/3995117836 learned_addr learned my addr 172.21.15.50:0/3995117836 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-08-10T10:53:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbced08640 1 --2- 172.21.15.50:0/3995117836 >> v2:172.21.15.50:3300/0 conn(0x7ffbc80696a0 0x7ffbc8069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcdd06640 1 --2- 172.21.15.50:0/3995117836 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80c15e0 0x7ffbc80c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcd505640 1 -- 172.21.15.50:0/3995117836 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702455918 0 0) 0x7ffbc80cc8d0 con 0x7ffbc8160fa0 2023-08-10T10:53:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.407+0000 7ffbcd505640 1 -- 172.21.15.50:0/3995117836 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb4003520 con 0x7ffbc8160fa0 2023-08-10T10:53:21.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.408+0000 7ffbced08640 1 -- 172.21.15.50:0/3995117836 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80c15e0 msgr2=0x7ffbc80c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.408+0000 7ffbced08640 1 --2- 172.21.15.50:0/3995117836 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80c15e0 0x7ffbc80c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.408+0000 7ffbced08640 1 -- 172.21.15.50:0/3995117836 >> v1:172.21.15.50:6789/0 conn(0x7ffbc8160fa0 legacy=0x7ffbc80cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.408+0000 7ffbced08640 1 -- 172.21.15.50:0/3995117836 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80cce90 con 0x7ffbc80696a0 2023-08-10T10:53:21.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbced08640 1 --2- 172.21.15.50:0/3995117836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc80696a0 0x7ffbc8069b10 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806a7a0 tx=0x7ffbc002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb2a6f17714a50e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbcd505640 1 -- 172.21.15.50:0/3995117836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc002cc70 con 0x7ffbc80696a0 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbcd505640 1 -- 172.21.15.50:0/3995117836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc002cdd0 con 0x7ffbc80696a0 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbcd505640 1 -- 172.21.15.50:0/3995117836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0034640 con 0x7ffbc80696a0 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbcf509640 1 -- 172.21.15.50:0/3995117836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc80696a0 msgr2=0x7ffbc8069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.409+0000 7ffbcf509640 1 --2- 172.21.15.50:0/3995117836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc80696a0 0x7ffbc8069b10 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806a7a0 tx=0x7ffbc002bec0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 -- 172.21.15.50:0/3995117836 shutdown_connections 2023-08-10T10:53:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 --2- 172.21.15.50:0/3995117836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc80696a0 0x7ffbc8069b10 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 --2- 172.21.15.50:0/3995117836 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80c15e0 0x7ffbc80c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 -- 172.21.15.50:0/3995117836 >> 172.21.15.50:0/3995117836 conn(0x7ffbc80caf80 msgr2=0x7ffbc80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 -- 172.21.15.50:0/3995117836 shutdown_connections 2023-08-10T10:53:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.410+0000 7ffbcf509640 1 -- 172.21.15.50:0/3995117836 wait complete. 2023-08-10T10:53:21.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.411+0000 7ffbcf509640 1 Processor -- start 2023-08-10T10:53:21.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.412+0000 7ffbcf509640 1 -- start start 2023-08-10T10:53:21.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.412+0000 7ffbcf509640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc80696a0 0x7ffbc81f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.412+0000 7ffbcf509640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80c15e0 0x7ffbc806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.412+0000 7ffbcf509640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbcf509640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81f44f0 con 0x7ffbc8160fa0 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbcf509640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c3790 con 0x7ffbc80696a0 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbcf509640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c3a00 con 0x7ffbc80c15e0 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52628/0 (socket says 172.21.15.50:52628) 2023-08-10T10:53:21.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 -- 172.21.15.50:0/1407638225 learned_addr learned my addr 172.21.15.50:0/1407638225 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:21.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 -- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80c15e0 msgr2=0x7ffbc806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80c15e0 0x7ffbc806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 -- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc80696a0 msgr2=0x7ffbc81f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc80696a0 0x7ffbc81f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 -- 172.21.15.50:0/1407638225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009a70 con 0x7ffbc8160fa0 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.413+0000 7ffbced08640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ffbc002c4d0 tx=0x7ffbc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.414+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0004450 con 0x7ffbc8160fa0 2023-08-10T10:53:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.414+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00045b0 con 0x7ffbc8160fa0 2023-08-10T10:53:21.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.414+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0034440 con 0x7ffbc8160fa0 2023-08-10T10:53:21.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.414+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc80c3ce0 con 0x7ffbc8160fa0 2023-08-10T10:53:21.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.414+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81f7950 con 0x7ffbc8160fa0 2023-08-10T10:53:21.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.415+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc806cc20 con 0x7ffbc8160fa0 2023-08-10T10:53:21.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.416+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffbc003b030 con 0x7ffbc8160fa0 2023-08-10T10:53:21.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.417+0000 7ffbbeffd640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 0x7ffbac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.417+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffbc00ab680 con 0x7ffbc8160fa0 2023-08-10T10:53:21.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.417+0000 7ffbce507640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 0x7ffbac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.418+0000 7ffbce507640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 0x7ffbac06d110 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4000f60 tx=0x7ffbc40078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.421+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffbc0076b60 con 0x7ffbc8160fa0 2023-08-10T10:53:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.608+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ffbc80c4200 con 0x7ffbc8160fa0 2023-08-10T10:53:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.614+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffbc0076b60 con 0x7ffbc8160fa0 2023-08-10T10:53:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.614+0000 7ffbbeffd640 1 -- 172.21.15.50:0/1407638225 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7ffbc007a180 con 0x7ffbc8160fa0 2023-08-10T10:53:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.618+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 msgr2=0x7ffbac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.618+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 0x7ffbac06d110 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4000f60 tx=0x7ffbc40078f0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.618+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 msgr2=0x7ffbc80af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.618+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ffbc002c4d0 tx=0x7ffbc0004a40 comp rx=0 tx=0).stop 2023-08-10T10:53:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 shutdown_connections 2023-08-10T10:53:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbc8160fa0 0x7ffbc80af340 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80c15e0 0x7ffbc806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7ffbac06ac50 0x7ffbac06d110 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 --2- 172.21.15.50:0/1407638225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc80696a0 0x7ffbc81f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.619+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 >> 172.21.15.50:0/1407638225 conn(0x7ffbc80caf80 msgr2=0x7ffbc81600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:21.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.620+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 shutdown_connections 2023-08-10T10:53:21.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.620+0000 7ffbcf509640 1 -- 172.21.15.50:0/1407638225 wait complete. 2023-08-10T10:53:21.638 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:53:21.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:53:21.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.847+0000 7efd0f50f640 1 Processor -- start 2023-08-10T10:53:21.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.847+0000 7efd0f50f640 1 -- start start 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0f50f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd0815cd60 0x7efd08160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0f50f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd080cdf80 0x7efd080d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0f50f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd08161180 con 0x7efd080b8430 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0f50f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080b5bd0 con 0x7efd0815cd60 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0f50f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd08161460 con 0x7efd080cdf80 2023-08-10T10:53:21.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0d2ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd0815cd60 0x7efd08160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0d2ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd0815cd60 0x7efd08160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52630/0 (socket says 172.21.15.50:52630) 2023-08-10T10:53:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.848+0000 7efd0d2ab640 1 -- 172.21.15.50:0/4249035159 learned_addr learned my addr 172.21.15.50:0/4249035159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.849+0000 7efd0d2ab640 1 -- 172.21.15.50:0/4249035159 >> v2:172.21.15.117:3300/0 conn(0x7efd080cdf80 msgr2=0x7efd080d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.849+0000 7efd0d2ab640 1 --2- 172.21.15.50:0/4249035159 >> v2:172.21.15.117:3300/0 conn(0x7efd080cdf80 0x7efd080d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.849+0000 7efd0d2ab640 1 -- 172.21.15.50:0/4249035159 >> v1:172.21.15.117:6789/0 conn(0x7efd080b8430 legacy=0x7efd080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.849+0000 7efd0d2ab640 1 -- 172.21.15.50:0/4249035159 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08161740 con 0x7efd0815cd60 2023-08-10T10:53:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.850+0000 7efd0d2ab640 1 --2- 172.21.15.50:0/4249035159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd0815cd60 0x7efd08160930 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7efd08074130 tx=0x7efcf802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb9a2cba1f7e179 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.850+0000 7efd07fff640 1 -- 172.21.15.50:0/4249035159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf802cb10 con 0x7efd0815cd60 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.850+0000 7efd07fff640 1 -- 172.21.15.50:0/4249035159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efcf802cc70 con 0x7efd0815cd60 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.850+0000 7efd07fff640 1 -- 172.21.15.50:0/4249035159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80343f0 con 0x7efd0815cd60 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 -- 172.21.15.50:0/4249035159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd0815cd60 msgr2=0x7efd08160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 --2- 172.21.15.50:0/4249035159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd0815cd60 0x7efd08160930 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7efd08074130 tx=0x7efcf802bf70 comp rx=0 tx=0).stop 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 -- 172.21.15.50:0/4249035159 shutdown_connections 2023-08-10T10:53:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 --2- 172.21.15.50:0/4249035159 >> v2:172.21.15.117:3300/0 conn(0x7efd080cdf80 0x7efd080d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 --2- 172.21.15.50:0/4249035159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd0815cd60 0x7efd08160930 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 -- 172.21.15.50:0/4249035159 >> 172.21.15.50:0/4249035159 conn(0x7efd080d2ac0 msgr2=0x7efd080d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 -- 172.21.15.50:0/4249035159 shutdown_connections 2023-08-10T10:53:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.851+0000 7efd0f50f640 1 -- 172.21.15.50:0/4249035159 wait complete. 2023-08-10T10:53:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.853+0000 7efd0f50f640 1 Processor -- start 2023-08-10T10:53:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.853+0000 7efd0f50f640 1 -- start start 2023-08-10T10:53:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd080b8430 0x7efd080cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0815cd60 0x7efd080a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0814ee40 con 0x7efd080cdf80 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080a99a0 con 0x7efd0815cd60 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0f50f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd080cbbb0 con 0x7efd080b8430 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0caaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0caaa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52642/0 (socket says 172.21.15.50:52642) 2023-08-10T10:53:21.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0caaa640 1 -- 172.21.15.50:0/2672616593 learned_addr learned my addr 172.21.15.50:0/2672616593 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-08-10T10:53:21.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.854+0000 7efd0daac640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0815cd60 0x7efd080a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0d2ab640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd080b8430 0x7efd080cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 -- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd080b8430 msgr2=0x7efd080cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd080b8430 0x7efd080cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 -- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0815cd60 msgr2=0x7efd080a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0815cd60 0x7efd080a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 -- 172.21.15.50:0/2672616593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009b30 con 0x7efd080cdf80 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0caaa640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c440 tx=0x7efcfc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc005480 con 0x7efd080cdf80 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efcfc0035f0 con 0x7efd080cdf80 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0039e0 con 0x7efd080cdf80 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd080cbe90 con 0x7efd080cdf80 2023-08-10T10:53:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.855+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd080cc450 con 0x7efd080cdf80 2023-08-10T10:53:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.856+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd080d0bc0 con 0x7efd080cdf80 2023-08-10T10:53:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.858+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efcfc003b40 con 0x7efd080cdf80 2023-08-10T10:53:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.858+0000 7efd05ffb640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 0x7efcf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.859+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efcfc088500 con 0x7efd080cdf80 2023-08-10T10:53:21.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.859+0000 7efd0d2ab640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 0x7efcf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:21.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.860+0000 7efd0d2ab640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 0x7efcf406d110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efcf8035000 tx=0x7efcf8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:21.865+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efcfc057230 con 0x7efd080cdf80 2023-08-10T10:53:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.095+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd0804e270 con 0x7efd080cdf80 2023-08-10T10:53:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.095+0000 7efd05ffb640 1 -- 172.21.15.50:0/2672616593 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3535 (secure 0 0 0) 0x7efcfc017de0 con 0x7efd080cdf80 2023-08-10T10:53:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-08-10T10:53:22.098 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6410,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2166548456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6835","nonce":2166548456},{"type":"v1","addr":"172.21.15.50:6837","nonce":2166548456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1305258836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1305258836},{"type":"v1","addr":"172.21.15.117:6833","nonce":1305258836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":7060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1223051214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1223051214},{"type":"v1","addr":"172.21.15.117:6835","nonce":1223051214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":9846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6836/4168687513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4168687513},{"type":"v1","addr":"172.21.15.50:6836","nonce":4168687513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95}],"filesystems":[]} 2023-08-10T10:53:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 95 2023-08-10T10:53:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 msgr2=0x7efcf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 0x7efcf406d110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efcf8035000 tx=0x7efcf8030000 comp rx=0 tx=0).stop 2023-08-10T10:53:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 msgr2=0x7efd081f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c440 tx=0x7efcfc00c900 comp rx=0 tx=0).stop 2023-08-10T10:53:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 shutdown_connections 2023-08-10T10:53:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:6832/2197471967,v1:172.21.15.50:6833/2197471967] conn(0x7efcf406ac50 0x7efcf406d110 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd0815cd60 0x7efd080a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd080cdf80 0x7efd081f2110 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 --2- 172.21.15.50:0/2672616593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd080b8430 0x7efd080cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 >> 172.21.15.50:0/2672616593 conn(0x7efd080d2ac0 msgr2=0x7efd080b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 shutdown_connections 2023-08-10T10:53:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-08-10T10:53:22.099+0000 7efd0f50f640 1 -- 172.21.15.50:0/2672616593 wait complete. 2023-08-10T10:53:22.120 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-10T10:53:22.120 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-10T10:53:22.121 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:53:22.121 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:22.137 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:53:22.138 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:53:22.138 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:22.203 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:53:22.204 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:53:22.204 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:22.235 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:53:22.235 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:53:22.236 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:22.307 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:53:22.307 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-10T10:53:22.308 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-10T10:53:22.308 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:28.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-08-10T10:53:28.409 INFO:tasks.ceph.osd.0:Stopped 2023-08-10T10:53:28.410 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-10T10:53:28.410 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:34.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-08-10T10:53:34.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-08-10T10:53:34.511 INFO:tasks.ceph.osd.1:Stopped 2023-08-10T10:53:34.512 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-10T10:53:34.512 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:34.572 INFO:tasks.ceph.osd.2:Stopped 2023-08-10T10:53:34.572 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-10T10:53:34.572 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:40.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-08-10T10:53:40.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-08-10T10:53:40.674 INFO:tasks.ceph.osd.3:Stopped 2023-08-10T10:53:40.675 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-10T10:53:40.675 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:46.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-08-10T10:53:46.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-08-10T10:53:46.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:46.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:46.777 INFO:tasks.ceph.osd.4:Stopped 2023-08-10T10:53:46.778 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-10T10:53:46.778 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:46.825 INFO:tasks.ceph.osd.5:Stopped 2023-08-10T10:53:46.826 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-10T10:53:46.826 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:46.889 INFO:tasks.ceph.osd.6:Stopped 2023-08-10T10:53:46.889 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-10T10:53:46.889 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:51.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-08-10T10:53:51.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-08-10T10:53:52.991 INFO:tasks.ceph.osd.7:Stopped 2023-08-10T10:53:52.992 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-10T10:53:52.992 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-10T10:53:52.993 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:53.062 INFO:tasks.ceph.mgr.y:Stopped 2023-08-10T10:53:53.062 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-10T10:53:53.063 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:53.146 INFO:tasks.ceph.mgr.x:Stopped 2023-08-10T10:53:53.147 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-10T10:53:53.147 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-10T10:53:53.148 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:53.201 INFO:tasks.ceph.mon.a:Stopped 2023-08-10T10:53:53.202 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-10T10:53:53.202 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:53.239 INFO:tasks.ceph.mon.b:Stopped 2023-08-10T10:53:53.240 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-10T10:53:53.240 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:53:53.309 INFO:tasks.ceph.mon.c:Stopped 2023-08-10T10:53:53.309 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-10T10:53:53.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-10T10:53:53.428 INFO:teuthology.orchestra.run.smithi050.stdout:2023-08-10T10:38:06.867375+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 101244.552031 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-08-10T10:53:53.429 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-10T10:53:53.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-10T10:53:53.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-10T10:53:53.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-10T10:53:53.709 INFO:teuthology.orchestra.run.smithi050.stdout:2023-08-10T10:38:06.867375+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 101244.552031 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-08-10T10:53:53.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:53:53.711 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-10T10:53:54.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:53:54.074 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-10T10:53:54.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:53:54.336 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-10T10:53:54.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:53:54.621 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-10T10:53:54.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:53:54.898 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-10T10:53:55.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:53:55.261 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-10T10:53:55.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:53:55.514 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-10T10:53:55.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:53:55.799 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-10T10:53:56.051 INFO:tasks.ceph:Archiving mon data... 2023-08-10T10:53:56.053 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/data/mon.a.tgz 2023-08-10T10:53:56.053 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-08-10T10:53:56.118 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.1OiBiuqZCo 2023-08-10T10:53:56.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1OiBiuqZCo 2023-08-10T10:53:56.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.1OiBiuqZCo 2023-08-10T10:53:56.500 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.1OiBiuqZCo is 432KB 2023-08-10T10:53:56.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-08-10T10:53:56.612 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.1OiBiuqZCo 2023-08-10T10:53:56.676 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/data/mon.b.tgz 2023-08-10T10:53:56.677 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-08-10T10:53:56.738 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.eTmndIHkEn 2023-08-10T10:53:56.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.eTmndIHkEn 2023-08-10T10:53:56.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.eTmndIHkEn 2023-08-10T10:53:57.076 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.eTmndIHkEn is 433KB 2023-08-10T10:53:57.180 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.eTmndIHkEn 2023-08-10T10:53:57.240 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/data/mon.c.tgz 2023-08-10T10:53:57.241 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-08-10T10:53:57.294 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.RG4uRYrwBq 2023-08-10T10:53:57.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RG4uRYrwBq 2023-08-10T10:53:57.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.RG4uRYrwBq 2023-08-10T10:53:57.623 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.RG4uRYrwBq is 433KB 2023-08-10T10:53:57.723 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.RG4uRYrwBq 2023-08-10T10:53:57.782 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-10T10:53:57.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-10T10:53:57.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-10T10:53:57.893 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-10T10:53:57.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-10T10:53:57.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-10T10:53:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-10T10:53:58.007 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-10T10:53:58.020 INFO:tasks.ceph:Archiving crash dumps... 2023-08-10T10:53:58.021 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi050/crash 2023-08-10T10:53:58.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-10T10:53:58.105 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi117/crash 2023-08-10T10:53:58.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-10T10:53:58.202 INFO:tasks.ceph:Shutting down logrotate 2023-08-10T10:53:58.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:58.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:58.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:58.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-10T10:53:58.544 INFO:tasks.ceph:Compressing logs... 2023-08-10T10:53:58.545 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T10:53:58.555 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T10:53:58.649 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128370.log 2023-08-10T10:53:58.650 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122663.log 2023-08-10T10:53:58.650 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90088.log 2023-08-10T10:53:58.651 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.128370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128370.log.gz 2023-08-10T10:53:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.86763.log 2023-08-10T10:53:58.651 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155115.log 2023-08-10T10:53:58.652 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.90088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90088.log.gz 2023-08-10T10:53:58.652 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89509.log 2023-08-10T10:53:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122663.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122663.log.gz 2023-08-10T10:53:58.653 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133276.log 2023-08-10T10:53:58.654 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.86763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.86763.log.gz 2023-08-10T10:53:58.654 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88944.log 2023-08-10T10:53:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.155115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.155115.log.gz 2023-08-10T10:53:58.654 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119197.log 2023-08-10T10:53:58.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143856.log 2023-08-10T10:53:58.656 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133276.log.gz 2023-08-10T10:53:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.89509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89509.log.gz 2023-08-10T10:53:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91071.log 2023-08-10T10:53:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.88944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88944.log.gz 2023-08-10T10:53:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-10T10:53:58.658 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.91071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91071.log.gz 2023-08-10T10:53:58.659 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85447.log 2023-08-10T10:53:58.660 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-10T10:53:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130851.log 2023-08-10T10:53:58.662 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119197.log.gz 2023-08-10T10:53:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141381.log 2023-08-10T10:53:58.663 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143856.log.gz 2023-08-10T10:53:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136686.log 88.4% 2023-08-10T10:53:58.664 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130851.log.gz 2023-08-10T10:53:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141381.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141381.log.gz 2023-08-10T10:53:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123167.log 2023-08-10T10:53:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136686.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136686.log.gz 2023-08-10T10:53:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143814.log 2023-08-10T10:53:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149620.log 2023-08-10T10:53:58.665 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123167.log.gz 2023-08-10T10:53:58.672 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85447.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85447.log.gz 2023-08-10T10:53:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-10T10:53:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-10T10:53:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87371.log 2023-08-10T10:53:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92195.log 2023-08-10T10:53:58.674 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.87371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87371.log.gz 2023-08-10T10:53:58.674 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-10T10:53:58.674 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.92195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92195.log.gz 2023-08-10T10:53:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87908.log 2023-08-10T10:53:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85527.log 2023-08-10T10:53:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.87908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87908.log.gz 2023-08-10T10:53:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91681.log 2023-08-10T10:53:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85527.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85527.log.gz 2023-08-10T10:53:58.686 INFO:teuthology.orchestra.run.smithi117.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-10T10:53:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.91681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91681.log.gz 2023-08-10T10:53:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-10T10:53:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose 93.6% -- /var/log/ceph/ceph-client.admin.85487.log 2023-08-10T10:53:58.687 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-10T10:53:58.687 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-10T10:53:58.687 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85487.log.gz 2023-08-10T10:53:58.687 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.86370.log 2023-08-10T10:53:58.688 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90566.log 2023-08-10T10:53:58.688 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.86370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.86370.log.gz 2023-08-10T10:53:58.691 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-10T10:53:58.691 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.90566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90566.log.gz 2023-08-10T10:53:58.692 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-10T10:53:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143814.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143814.log.gz 2023-08-10T10:53:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153733.log 2023-08-10T10:53:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133673.log 2023-08-10T10:53:58.695 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149620.log.gz 2023-08-10T10:53:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129675.log 2023-08-10T10:53:58.695 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153733.log.gz 2023-08-10T10:53:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133673.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133673.log.gz 2023-08-10T10:53:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134770.log 2023-08-10T10:53:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129675.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129675.log.gz 2023-08-10T10:53:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132174.log 2023-08-10T10:53:58.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134770.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134770.log.gz 2023-08-10T10:53:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151244.log 2023-08-10T10:53:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132174.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132174.log.gz 2023-08-10T10:53:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119113.log 2023-08-10T10:53:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151244.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.151244.log.gz 2023-08-10T10:53:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154820.log 2023-08-10T10:53:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142687.log 2023-08-10T10:53:58.698 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119113.log.gz 2023-08-10T10:53:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156389.log 2023-08-10T10:53:58.699 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154820.log.gz 2023-08-10T10:53:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142687.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-osd.2.log 2023-08-10T10:53:58.699 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142687.log.gz 2023-08-10T10:53:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150266.log 2023-08-10T10:53:58.700 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156389.log.gz 2023-08-10T10:53:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150604.log 2023-08-10T10:53:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144967.log 2023-08-10T10:53:58.700 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150266.log.gz 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130357.log 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150604.log.gz 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138205.log 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144967.log.gz 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136874.log 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130357.log.gz 2023-08-10T10:53:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.138205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.138205.log.gz 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128945.log 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136874.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.136874.log.gz --verbose 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.146595.log 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137257.log 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128945.log.gz 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154526.log 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146595.log.gz 2023-08-10T10:53:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137257.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137257.log.gz 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147488.log 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150562.log 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154526.log.gz 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151650.log 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.147488.log.gz 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129113.log 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150562.log.gz 2023-08-10T10:53:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151650.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151650.log.gz 2023-08-10T10:53:58.704 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158145.log 2023-08-10T10:53:58.704 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.145154.log 2023-08-10T10:53:58.704 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129113.log.gz 2023-08-10T10:53:58.705 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: 94.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-10T10:53:58.705 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-10T10:53:58.707 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145274.log 2023-08-10T10:53:58.707 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158145.log.gz 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.145154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.145154.log.gz 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133819.log 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145274.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145274.log.gz 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133360.log 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124942.log 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133819.log.gz 2023-08-10T10:53:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133360.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.133360.log.gz -5 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.138325.log 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116413.log 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124942.log.gz 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140354.log 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138325.log.gz 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137091.log 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116413.log.gz 2023-08-10T10:53:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140354.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.148169.log 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140354.log.gz 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138619.log 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137091.log.gz 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151072.log 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148169.log.gz 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115744.log 2023-08-10T10:53:58.710 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138619.log.gz 2023-08-10T10:53:58.711 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151072.log.gz 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122459.log 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115744.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115744.log.gz -5 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.153294.log 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122459.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122459.log.gz 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136916.log 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124001.log 2023-08-10T10:53:58.712 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153294.log.gz 2023-08-10T10:53:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136916.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.136916.log.gz -5 2023-08-10T10:53:58.713 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.116883.log 2023-08-10T10:53:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138000.log 2023-08-10T10:53:58.714 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124001.log.gz 2023-08-10T10:53:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144341.log 2023-08-10T10:53:58.715 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116883.log.gz 2023-08-10T10:53:58.715 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88421.log 2023-08-10T10:53:58.716 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145683.log 2023-08-10T10:53:58.716 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138000.log.gz 2023-08-10T10:53:58.717 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118300.log 2023-08-10T10:53:58.717 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144341.log.gz 2023-08-10T10:53:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145683.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145683.log.gz 2023-08-10T10:53:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139192.log 2023-08-10T10:53:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137934.log 2023-08-10T10:53:58.719 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118300.log.gz 2023-08-10T10:53:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157129.log 2023-08-10T10:53:58.720 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139192.log.gz 2023-08-10T10:53:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152402.log 2023-08-10T10:53:58.722 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.137934.log.gz 2023-08-10T10:53:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85316.log 2023-08-10T10:53:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156431.log 88.9% 2023-08-10T10:53:58.723 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.157129.log.gz 2023-08-10T10:53:58.724 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152402.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152402.log.gz 2023-08-10T10:53:58.724 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153691.log 2023-08-10T10:53:58.725 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142483.log 2023-08-10T10:53:58.726 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156431.log.gz 2023-08-10T10:53:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136350.log 2023-08-10T10:53:58.727 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153691.log.gz 2023-08-10T10:53:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155603.log 2023-08-10T10:53:58.728 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142483.log.gz 2023-08-10T10:53:58.729 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149314.log 2023-08-10T10:53:58.729 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136350.log.gz 2023-08-10T10:53:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131139.log 2023-08-10T10:53:58.730 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.88421.log: 92.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85276.log 2023-08-10T10:53:58.730 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-08-10T10:53:58.731 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155603.log.gz 2023-08-10T10:53:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140312.log 2023-08-10T10:53:58.731 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149314.log.gz 2023-08-10T10:53:58.732 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131139.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131139.log.gzgzip 2023-08-10T10:53:58.733 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117677.log 2023-08-10T10:53:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140312.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140312.log.gz 2023-08-10T10:53:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151692.log 2023-08-10T10:53:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143039.log 2023-08-10T10:53:58.735 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117677.log.gz 2023-08-10T10:53:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136182.log 2023-08-10T10:53:58.736 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151692.log.gz 2023-08-10T10:53:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88421.log.gz 2023-08-10T10:53:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143039.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143039.log.gz 2023-08-10T10:53:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121532.log 2023-08-10T10:53:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136182.log.gz 2023-08-10T10:53:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156142.log 2023-08-10T10:53:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121532.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121532.log.gz 2023-08-10T10:53:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136266.log 2023-08-10T10:53:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151548.log 2023-08-10T10:53:58.741 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156142.log.gz 2023-08-10T10:53:58.743 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144859.log 2023-08-10T10:53:58.743 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136266.log.gz 2023-08-10T10:53:58.744 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85316.log.gz 2023-08-10T10:53:58.744 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151548.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-10T10:53:58.744 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151548.log.gz 2023-08-10T10:53:58.745 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144859.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144859.log.gz 2023-08-10T10:53:58.745 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134177.log 2023-08-10T10:53:58.746 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137555.log 2023-08-10T10:53:58.747 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122291.log 2023-08-10T10:53:58.748 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134177.log.gz 2023-08-10T10:53:58.748 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85407.log 2023-08-10T10:53:58.749 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140821.log 2023-08-10T10:53:58.749 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137555.log.gz 2023-08-10T10:53:58.749 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85276.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85276.log.gz 2023-08-10T10:53:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122291.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122291.log.gz 2023-08-10T10:53:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137213.log 2023-08-10T10:53:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140821.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140821.log.gz 2023-08-10T10:53:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126880.log 2023-08-10T10:53:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137808.log 2023-08-10T10:53:58.753 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137213.log.gz 2023-08-10T10:53:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126880.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126880.log.gz -5 2023-08-10T10:53:58.754 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.141465.log 2023-08-10T10:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137808.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137808.log.gz 2023-08-10T10:53:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128657.log 2023-08-10T10:53:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130171.log 2023-08-10T10:53:58.757 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.141465.log.gz 2023-08-10T10:53:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128657.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128657.log.gz -5 2023-08-10T10:53:58.759 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.116799.log 2023-08-10T10:53:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130171.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130171.log.gz 2023-08-10T10:53:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144049.log 2023-08-10T10:53:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153336.log 2023-08-10T10:53:58.761 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116799.log.gz 2023-08-10T10:53:58.762 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85356.log 2023-08-10T10:53:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124317.log 2023-08-10T10:53:58.763 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144049.log.gz 2023-08-10T10:53:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131783.log 2023-08-10T10:53:58.764 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153336.log.gz 2023-08-10T10:53:58.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85407.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85407.log.gz 2023-08-10T10:53:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124317.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124317.log.gz 2023-08-10T10:53:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129777.log 2023-08-10T10:53:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118356.log 2023-08-10T10:53:58.767 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.131783.log.gz 2023-08-10T10:53:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129777.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129777.log.gz 2023-08-10T10:53:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138728.log 2023-08-10T10:53:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146779.log 2023-08-10T10:53:58.770 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118356.log.gz 2023-08-10T10:53:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138728.log: gzip -5 89.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.138728.log.gz -- 2023-08-10T10:53:58.771 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.138770.log 2023-08-10T10:53:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125614.log 2023-08-10T10:53:58.772 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146779.log.gz 2023-08-10T10:53:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138770.log.gz 2023-08-10T10:53:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135608.log 2023-08-10T10:53:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143333.log 2023-08-10T10:53:58.775 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125614.log.gz 2023-08-10T10:53:58.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143604.log 2023-08-10T10:53:58.777 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135608.log.gz 2023-08-10T10:53:58.777 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85236.log 2023-08-10T10:53:58.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126254.log 2023-08-10T10:53:58.778 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143333.log.gz 2023-08-10T10:53:58.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85356.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85356.log.gz 2023-08-10T10:53:58.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143604.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143604.log.gz 2023-08-10T10:53:58.779 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118033.log 2023-08-10T10:53:58.780 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135914.log 2023-08-10T10:53:58.780 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126254.log.gz 2023-08-10T10:53:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118033.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.118033.log.gz 2023-08-10T10:53:58.782 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.125818.log 2023-08-10T10:53:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116967.log 2023-08-10T10:53:58.783 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135914.log.gz 2023-08-10T10:53:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125818.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125818.log.gz 2023-08-10T10:53:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-10T10:53:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151294.log 2023-08-10T10:53:58.786 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116967.log.gz 2023-08-10T10:53:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134262.log 2023-08-10T10:53:58.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.85236.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-10T10:53:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151294.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151294.log.gz 2023-08-10T10:53:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157240.log 2023-08-10T10:53:58.790 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85236.log.gz 2023-08-10T10:53:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134220.log 2023-08-10T10:53:58.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134262.log.gz 2023-08-10T10:53:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124233.log 2023-08-10T10:53:58.794 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157240.log.gz 2023-08-10T10:53:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134220.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134220.log.gz 2023-08-10T10:53:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128117.log 2023-08-10T10:53:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128816.log 2023-08-10T10:53:58.797 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124233.log.gz 2023-08-10T10:53:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135956.log 2023-08-10T10:53:58.799 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.128117.log.gz 2023-08-10T10:53:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137513.log 2023-08-10T10:53:58.800 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128816.log.gz 2023-08-10T10:53:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156184.log 2023-08-10T10:53:58.802 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135956.log.gz 2023-08-10T10:53:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137513.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137513.log.gz 2023-08-10T10:53:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119155.log 2023-08-10T10:53:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127949.log 2023-08-10T10:53:58.806 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156184.log.gz 2023-08-10T10:53:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119155.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119155.log.gz -5 2023-08-10T10:53:58.807 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.146469.log 2023-08-10T10:53:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120756.log 2023-08-10T10:53:58.809 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127949.log.gz 2023-08-10T10:53:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146469.log.gz 2023-08-10T10:53:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144775.log 2023-08-10T10:53:58.812 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120756.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120756.log.gz 2023-08-10T10:53:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155645.log 2023-08-10T10:53:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144775.log.gz 2023-08-10T10:53:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121260.log 2023-08-10T10:53:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139934.log 2023-08-10T10:53:58.816 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155645.log.gz 2023-08-10T10:53:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121260.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121260.log.gz 2023-08-10T10:53:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123539.log 2023-08-10T10:53:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139934.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139934.log.gz 2023-08-10T10:53:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142194.log 2023-08-10T10:53:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149888.log 2023-08-10T10:53:58.821 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123539.log.gz 2023-08-10T10:53:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152528.log 2023-08-10T10:53:58.823 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142194.log.gz 2023-08-10T10:53:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156473.log 2023-08-10T10:53:58.825 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149888.log.gz 2023-08-10T10:53:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153084.log 2023-08-10T10:53:58.826 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152528.log.gz 2023-08-10T10:53:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156473.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156473.log.gz 2023-08-10T10:53:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141339.log 2023-08-10T10:53:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116925.log 2023-08-10T10:53:58.829 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153084.log.gz 2023-08-10T10:53:58.831 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152958.log 2023-08-10T10:53:58.831 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141339.log.gz 2023-08-10T10:53:58.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116925.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116925.log.gz 2023-08-10T10:53:58.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143688.log 2023-08-10T10:53:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148589.log 2023-08-10T10:53:58.835 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152958.log.gz 2023-08-10T10:53:58.836 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143688.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.143688.log.gz 2023-08-10T10:53:58.837 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.135872.log 2023-08-10T10:53:58.838 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122417.log 2023-08-10T10:53:58.839 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.148589.log.gz 2023-08-10T10:53:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135872.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135872.log.gz 2023-08-10T10:53:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134560.log 2023-08-10T10:53:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122417.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122417.log.gz 2023-08-10T10:53:58.841 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.123251.log 2023-08-10T10:53:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123665.log 2023-08-10T10:53:58.843 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134560.log.gz 2023-08-10T10:53:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123251.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123251.log.gz 2023-08-10T10:53:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140144.log 2023-08-10T10:53:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137299.log 2023-08-10T10:53:58.847 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123665.log.gz 2023-08-10T10:53:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153481.log 2023-08-10T10:53:58.848 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140144.log.gz 2023-08-10T10:53:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144429.log 2023-08-10T10:53:58.850 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137299.log.gz 2023-08-10T10:53:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153481.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.153481.log.gz -- 2023-08-10T10:53:58.852 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.127655.log 2023-08-10T10:53:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2023-08-10T10:53:58.854 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144429.log.gz 2023-08-10T10:53:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119071.log 2023-08-10T10:53:58.855 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127655.log.gz 2023-08-10T10:53:58.857 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149746.log 2023-08-10T10:53:58.857 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2023-08-10T10:53:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119071.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119071.log.gz 2023-08-10T10:53:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122957.log 2023-08-10T10:53:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154484.log 2023-08-10T10:53:58.861 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149746.log.gz 2023-08-10T10:53:58.862 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116757.log 2023-08-10T10:53:58.863 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122957.log.gz 2023-08-10T10:53:58.864 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120546.log 2023-08-10T10:53:58.864 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154484.log.gz 2023-08-10T10:53:58.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116757.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.116757.log.gz -5 --verbose 2023-08-10T10:53:58.866 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.153438.log 2023-08-10T10:53:58.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142525.log 2023-08-10T10:53:58.868 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120546.log.gz 2023-08-10T10:53:58.869 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120377.log 2023-08-10T10:53:58.869 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153438.log.gz 2023-08-10T10:53:58.870 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134686.log 2023-08-10T10:53:58.870 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142525.log.gz 2023-08-10T10:53:58.872 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120377.log.gz 2023-08-10T10:53:58.872 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118035.log 2023-08-10T10:53:58.874 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134476.log 2023-08-10T10:53:58.874 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134686.log.gz 2023-08-10T10:53:58.876 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131489.log 2023-08-10T10:53:58.877 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz 2023-08-10T10:53:58.878 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132509.log 2023-08-10T10:53:58.878 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134476.log.gz 2023-08-10T10:53:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122747.log 2023-08-10T10:53:58.880 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131489.log.gz 2023-08-10T10:53:58.881 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132509.log.gz 2023-08-10T10:53:58.881 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129735.log 2023-08-10T10:53:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126650.log 2023-08-10T10:53:58.884 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122747.log.gz 2023-08-10T10:53:58.885 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136392.log 2023-08-10T10:53:58.885 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129735.log.gz 2023-08-10T10:53:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148127.log 2023-08-10T10:53:58.886 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126650.log.gz 2023-08-10T10:53:58.888 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136392.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136392.log.gz 2023-08-10T10:53:58.888 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150098.log 2023-08-10T10:53:58.890 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118371.log 2023-08-10T10:53:58.891 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148127.log.gz 2023-08-10T10:53:58.892 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151422.log 2023-08-10T10:53:58.892 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150098.log.gz 2023-08-10T10:53:58.893 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124485.log 2023-08-10T10:53:58.893 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118371.log.gz 2023-08-10T10:53:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151422.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151422.log.gz 2023-08-10T10:53:58.895 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131573.log 2023-08-10T10:53:58.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137723.log 2023-08-10T10:53:58.898 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124485.log.gz 2023-08-10T10:53:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133777.log 2023-08-10T10:53:58.899 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131573.log.gz 2023-08-10T10:53:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139892.log 2023-08-10T10:53:58.900 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137723.log.gz 2023-08-10T10:53:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133777.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133777.log.gz 2023-08-10T10:53:58.902 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157850.log 2023-08-10T10:53:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139066.log 2023-08-10T10:53:58.904 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139892.log.gz 2023-08-10T10:53:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133505.log 2023-08-10T10:53:58.906 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157850.log.gz 2023-08-10T10:53:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154302.log 2023-08-10T10:53:58.907 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139066.log.gz 2023-08-10T10:53:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133505.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133505.log.gz 2023-08-10T10:53:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125487.log 2023-08-10T10:53:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118370.log 2023-08-10T10:53:58.911 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154302.log.gz 2023-08-10T10:53:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118777.log 2023-08-10T10:53:58.914 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125487.log.gz 2023-08-10T10:53:58.915 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126796.log 2023-08-10T10:53:58.915 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118370.log.gz 2023-08-10T10:53:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126002.log 2023-08-10T10:53:58.917 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118777.log.gz 2023-08-10T10:53:58.918 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126796.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126796.log.gz 2023-08-10T10:53:58.918 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152816.log 2023-08-10T10:53:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143165.log 2023-08-10T10:53:58.920 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126002.log.gz 2023-08-10T10:53:58.921 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124275.log 2023-08-10T10:53:58.922 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152816.log.gz 2023-08-10T10:53:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130129.log 2023-08-10T10:53:58.923 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143165.log.gz 2023-08-10T10:53:58.925 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124275.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124275.log.gz 2023-08-10T10:53:58.925 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143249.log 2023-08-10T10:53:58.927 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122117.log 2023-08-10T10:53:58.927 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130129.log.gz 2023-08-10T10:53:58.929 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136644.log 2023-08-10T10:53:58.930 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143249.log.gz 2023-08-10T10:53:58.931 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146905.log 2023-08-10T10:53:58.931 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122117.log.gz 2023-08-10T10:53:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154778.log 2023-08-10T10:53:58.933 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136644.log.gz 2023-08-10T10:53:58.934 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146905.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146905.log.gz 2023-08-10T10:53:58.934 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149846.log 2023-08-10T10:53:58.936 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154778.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154778.log.gz 2023-08-10T10:53:58.936 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139850.log 2023-08-10T10:53:58.937 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131531.log 2023-08-10T10:53:58.937 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149846.log.gz 2023-08-10T10:53:58.938 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133318.log 2023-08-10T10:53:58.939 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139850.log.gz 2023-08-10T10:53:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156557.log 2023-08-10T10:53:58.940 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131531.log.gz 2023-08-10T10:53:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122789.log 2023-08-10T10:53:58.942 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133318.log.gz 2023-08-10T10:53:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156557.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156557.log.gz 2023-08-10T10:53:58.944 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142813.log 2023-08-10T10:53:58.945 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122789.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122789.log.gz 2023-08-10T10:53:58.946 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149536.log 2023-08-10T10:53:58.947 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147747.log 2023-08-10T10:53:58.947 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142813.log.gz 2023-08-10T10:53:58.949 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149536.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149536.log.gz 2023-08-10T10:53:58.949 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-10T10:53:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147747.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147747.log.gz 2023-08-10T10:53:58.950 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131097.log 2023-08-10T10:53:58.952 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134602.log 2023-08-10T10:53:58.953 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131097.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131097.log.gz 2023-08-10T10:53:58.954 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146863.log 2023-08-10T10:53:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134602.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134602.log.gz 2023-08-10T10:53:58.956 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150944.log 2023-08-10T10:53:58.958 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146863.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.146863.log.gz /var/log/ceph/ceph-client.admin.138982.log 2023-08-10T10:53:58.958 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:58.958 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-10T10:53:58.960 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118903.log 2023-08-10T10:53:58.960 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150944.log.gz 2023-08-10T10:53:58.962 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143730.log 2023-08-10T10:53:58.962 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138982.log.gz 2023-08-10T10:53:58.963 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118903.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118903.log.gz 2023-08-10T10:53:58.964 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123581.log 2023-08-10T10:53:58.966 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128183.log 2023-08-10T10:53:58.966 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143730.log.gz 2023-08-10T10:53:58.968 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123581.log.gz 2023-08-10T10:53:58.968 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121322.log 2023-08-10T10:53:58.969 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128183.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.128183.log.gz 2023-08-10T10:53:58.969 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122579.log 2023-08-10T10:53:58.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140102.log 2023-08-10T10:53:58.971 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121322.log.gz 2023-08-10T10:53:58.972 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122579.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122579.log.gz 2023-08-10T10:53:58.973 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147667.log 2023-08-10T10:53:58.975 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140102.log.gz 2023-08-10T10:53:58.975 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129471.log 2023-08-10T10:53:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151030.log 2023-08-10T10:53:58.977 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147667.log.gz 2023-08-10T10:53:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140949.log 2023-08-10T10:53:58.979 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129471.log.gz 2023-08-10T10:53:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118023.log 2023-08-10T10:53:58.981 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151030.log.gz 2023-08-10T10:53:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139396.log 2023-08-10T10:53:58.982 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140949.log.gz 2023-08-10T10:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118023.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118023.log.gz 2023-08-10T10:53:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133444.log 2023-08-10T10:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156226.log 2023-08-10T10:53:58.985 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139396.log.gz 2023-08-10T10:53:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122375.log 2023-08-10T10:53:58.987 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133444.log.gz 2023-08-10T10:53:58.989 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136014.log 2023-08-10T10:53:58.989 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156226.log.gz 2023-08-10T10:53:58.990 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132467.log 2023-08-10T10:53:58.990 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122375.log.gz 2023-08-10T10:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137892.log 2023-08-10T10:53:58.992 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136014.log.gz 2023-08-10T10:53:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132467.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132467.log.gz 2023-08-10T10:53:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125445.log 2023-08-10T10:53:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158455.log 2023-08-10T10:53:58.996 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137892.log.gz 2023-08-10T10:53:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123833.log 2023-08-10T10:53:58.997 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125445.log.gz 2023-08-10T10:53:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152774.log 2023-08-10T10:53:58.999 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158455.log.gz 2023-08-10T10:53:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123833.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123833.log.gz 2023-08-10T10:53:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118365.log 2023-08-10T10:53:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120504.log 2023-08-10T10:53:59.003 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152774.log.gz 2023-08-10T10:53:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125734.log 2023-08-10T10:53:59.005 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118365.log.gz 2023-08-10T10:53:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152065.log 2023-08-10T10:53:59.006 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120504.log.gz 2023-08-10T10:53:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134434.log 2023-08-10T10:53:59.008 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125734.log.gz 2023-08-10T10:53:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152065.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152065.log.gz 2023-08-10T10:53:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154736.log 2023-08-10T10:53:59.012 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149804.log 2023-08-10T10:53:59.012 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134434.log.gz 2023-08-10T10:53:59.013 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122075.log 88.2% 2023-08-10T10:53:59.014 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154736.log.gz 2023-08-10T10:53:59.014 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131657.log 2023-08-10T10:53:59.015 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149804.log.gz 2023-08-10T10:53:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154260.log 2023-08-10T10:53:59.022 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122075.log.gz 2023-08-10T10:53:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122873.log 2023-08-10T10:53:59.022 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131657.log.gz 2023-08-10T10:53:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151800.log 2023-08-10T10:53:59.023 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154260.log.gz 2023-08-10T10:53:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156909.log 2023-08-10T10:53:59.023 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122873.log.gz 2023-08-10T10:53:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151800.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151800.log.gz 2023-08-10T10:53:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143417.log 2023-08-10T10:53:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117689.log 2023-08-10T10:53:59.026 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156909.log.gz 2023-08-10T10:53:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123293.log 2023-08-10T10:53:59.028 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143417.log.gz 2023-08-10T10:53:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153000.log 2023-08-10T10:53:59.029 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117689.log.gz 2023-08-10T10:53:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123293.log.gz 2023-08-10T10:53:59.030 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133956.log 2023-08-10T10:53:59.032 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123791.log 2023-08-10T10:53:59.033 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153000.log.gz 2023-08-10T10:53:59.034 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130003.log 2023-08-10T10:53:59.034 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133956.log.gz 2023-08-10T10:53:59.035 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144171.log 2023-08-10T10:53:59.036 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123791.log.gz 2023-08-10T10:53:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130003.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130003.log.gz 2023-08-10T10:53:59.037 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132054.log 2023-08-10T10:53:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135269.log 2023-08-10T10:53:59.040 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144171.log.gz 2023-08-10T10:53:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.132054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132054.log.gz 2023-08-10T10:53:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137011.log 2023-08-10T10:53:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134390.log 2023-08-10T10:53:59.043 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135269.log.gz 2023-08-10T10:53:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137011.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137011.log.gz 2023-08-10T10:53:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130087.log 2023-08-10T10:53:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121176.log 2023-08-10T10:53:59.047 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134390.log.gz 2023-08-10T10:53:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133631.log 2023-08-10T10:53:59.048 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130087.log.gz 2023-08-10T10:53:59.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122999.log 2023-08-10T10:53:59.049 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121176.log.gz 2023-08-10T10:53:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133631.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133631.log.gz 2023-08-10T10:53:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128699.log 2023-08-10T10:53:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122999.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122999.log.gz 2023-08-10T10:53:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126548.log 2023-08-10T10:53:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153378.log 2023-08-10T10:53:59.054 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128699.log.gz 2023-08-10T10:53:59.056 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126548.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126548.log.gz 2023-08-10T10:53:59.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118819.log 2023-08-10T10:53:59.058 INFO:teuthology.orchestra.run.smithi117.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-10T10:53:59.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150014.log 2023-08-10T10:53:59.058 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153378.log.gz 2023-08-10T10:53:59.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116714.log 2023-08-10T10:53:59.060 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118819.log.gz 2023-08-10T10:53:59.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150014.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150014.log.gz 2023-08-10T10:53:59.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127177.log 2023-08-10T10:53:59.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136560.log 2023-08-10T10:53:59.064 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116714.log.gz 2023-08-10T10:53:59.065 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127177.log.gz 2023-08-10T10:53:59.065 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144521.log 2023-08-10T10:53:59.066 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136560.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136560.log.gz 2023-08-10T10:53:59.067 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157324.log 2023-08-10T10:53:59.067 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144521.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144521.log.gz 2023-08-10T10:53:59.068 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133735.log 2023-08-10T10:53:59.069 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137427.log 2023-08-10T10:53:59.070 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157324.log.gz 2023-08-10T10:53:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133735.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133735.log.gz 2023-08-10T10:53:59.071 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124089.log 2023-08-10T10:53:59.072 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137427.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137427.log.gz 2023-08-10T10:53:59.073 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144733.log 2023-08-10T10:53:59.074 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124089.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124089.log.gz 2023-08-10T10:53:59.075 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130442.log 2023-08-10T10:53:59.075 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-10T10:53:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144733.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144733.log.gz 2023-08-10T10:53:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121050.log 2023-08-10T10:53:59.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133150.log 2023-08-10T10:53:59.078 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130442.log.gz 2023-08-10T10:53:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121050.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121050.log.gz 2023-08-10T10:53:59.079 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129877.log 2023-08-10T10:53:59.080 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133150.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133150.log.gz 2023-08-10T10:53:59.081 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147955.log 2023-08-10T10:53:59.082 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129877.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129877.log.gz 2023-08-10T10:53:59.082 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143477.log 2023-08-10T10:53:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133108.log 2023-08-10T10:53:59.084 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147955.log.gz 2023-08-10T10:53:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143477.log.gz 2023-08-10T10:53:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117698.log 2023-08-10T10:53:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133108.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133108.log.gz 2023-08-10T10:53:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136832.log 2023-08-10T10:53:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117698.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117698.log.gz 2023-08-10T10:53:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125860.log 2023-08-10T10:53:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131403.log 2023-08-10T10:53:59.089 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136832.log.gz 2023-08-10T10:53:59.090 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125860.log.gz 2023-08-10T10:53:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153126.log 2023-08-10T10:53:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131403.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131403.log.gz 2023-08-10T10:53:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136476.log 2023-08-10T10:53:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153126.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153126.log.gz 2023-08-10T10:53:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118567.log 2023-08-10T10:53:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136476.log.gz 2023-08-10T10:53:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129919.log 2023-08-10T10:53:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118567.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118567.log.gz 2023-08-10T10:53:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118015.log 2023-08-10T10:53:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129919.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129919.log.gz 2023-08-10T10:53:59.099 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132940.log 2023-08-10T10:53:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118015.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118015.log.gz 2023-08-10T10:53:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117097.log 2023-08-10T10:53:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132940.log.gz 2023-08-10T10:53:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124131.log 2023-08-10T10:53:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117097.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117097.log.gz 2023-08-10T10:53:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158271.log 2023-08-10T10:53:59.106 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129029.log 2023-08-10T10:53:59.106 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124131.log.gz 2023-08-10T10:53:59.107 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136308.log 2023-08-10T10:53:59.108 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129029.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158271.log.gz 2023-08-10T10:53:59.109 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129029.log.gz 2023-08-10T10:53:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147530.log 2023-08-10T10:53:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136308.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136308.log.gz 2023-08-10T10:53:59.111 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139498.log 2023-08-10T10:53:59.114 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147530.log.gz 2023-08-10T10:53:59.114 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118030.log 2023-08-10T10:53:59.114 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139498.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139498.log.gz 2023-08-10T10:53:59.115 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117265.log 2023-08-10T10:53:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129961.log 2023-08-10T10:53:59.117 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118030.log.gz 2023-08-10T10:53:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150350.log 2023-08-10T10:53:59.118 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117265.log.gz 2023-08-10T10:53:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144129.log 2023-08-10T10:53:59.120 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129961.log.gz 2023-08-10T10:53:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119239.log 2023-08-10T10:53:59.121 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150350.log.gz 2023-08-10T10:53:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144129.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144129.log.gz 2023-08-10T10:53:59.123 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125944.log 2023-08-10T10:53:59.124 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119239.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119239.log.gz 2023-08-10T10:53:59.124 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127433.log 2023-08-10T10:53:59.125 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125944.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125944.log.gz 2023-08-10T10:53:59.126 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146947.log 2023-08-10T10:53:59.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127433.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127433.log.gz 2023-08-10T10:53:59.128 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157934.log 2023-08-10T10:53:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146947.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146947.log.gz 2023-08-10T10:53:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118651.log 2023-08-10T10:53:59.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157934.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157934.log.gz 2023-08-10T10:53:59.131 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117307.log 2023-08-10T10:53:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118651.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118651.log.gz 2023-08-10T10:53:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116009.log 2023-08-10T10:53:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117307.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117307.log.gz 2023-08-10T10:53:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138577.log 2023-08-10T10:53:59.136 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143081.log 2023-08-10T10:53:59.136 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116009.log.gz 2023-08-10T10:53:59.137 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138577.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138577.log.gz 2023-08-10T10:53:59.138 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125656.log 2023-08-10T10:53:59.139 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143081.log.gz 2023-08-10T10:53:59.139 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123623.log 2023-08-10T10:53:59.140 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125656.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125656.log.gz 2023-08-10T10:53:59.141 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118735.log 2023-08-10T10:53:59.142 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127305.log 2023-08-10T10:53:59.142 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123623.log.gz 2023-08-10T10:53:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118735.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.118735.log.gz 2023-08-10T10:53:59.144 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139150.log 2023-08-10T10:53:59.145 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127305.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127305.log.gz 2023-08-10T10:53:59.145 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150986.log 2023-08-10T10:53:59.146 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139150.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139150.log.gz 2023-08-10T10:53:59.147 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145821.log 2023-08-10T10:53:59.148 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130931.log 2023-08-10T10:53:59.148 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150986.log.gz 2023-08-10T10:53:59.150 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145821.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145821.log.gz 2023-08-10T10:53:59.150 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145464.log 2023-08-10T10:53:59.151 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130931.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130931.log.gz 2023-08-10T10:53:59.151 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152858.log 2023-08-10T10:53:59.152 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145464.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145464.log.gz 2023-08-10T10:53:59.153 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155783.log 2023-08-10T10:53:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152858.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152858.log.gz 2023-08-10T10:53:59.154 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145232.log 2023-08-10T10:53:59.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137597.log 2023-08-10T10:53:59.156 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155783.log.gz 2023-08-10T10:53:59.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145232.log.gz 2023-08-10T10:53:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128033.log 2023-08-10T10:53:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137597.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137597.log.gz 2023-08-10T10:53:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158355.log 2023-08-10T10:53:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152169.log 2023-08-10T10:53:59.161 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128033.log.gz 2023-08-10T10:53:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158355.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158355.log.gz 2023-08-10T10:53:59.162 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126086.log 2023-08-10T10:53:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152169.log.gz 2023-08-10T10:53:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128987.log 2023-08-10T10:53:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122333.log 2023-08-10T10:53:59.165 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126086.log.gz 2023-08-10T10:53:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128987.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128987.log.gz 2023-08-10T10:53:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141918.log 2023-08-10T10:53:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122333.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122333.log.gz 2023-08-10T10:53:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154218.log 2023-08-10T10:53:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139724.log 2023-08-10T10:53:59.169 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141918.log.gz 2023-08-10T10:53:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154218.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154218.log.gz 2023-08-10T10:53:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118034.log 2023-08-10T10:53:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139724.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139724.log.gz 2023-08-10T10:53:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-10T10:53:59.173 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125164.log 2023-08-10T10:53:59.174 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118034.log.gz 2023-08-10T10:53:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133192.log 2023-08-10T10:53:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125164.log: gzip -5 87.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.125164.log.gz 2023-08-10T10:53:59.177 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.153565.log 2023-08-10T10:53:59.177 INFO:teuthology.orchestra.run.smithi050.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-10T10:53:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147913.log 2023-08-10T10:53:59.178 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133192.log.gz 2023-08-10T10:53:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121685.log 2023-08-10T10:53:59.179 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153565.log.gz 2023-08-10T10:53:59.180 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-10T10:53:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147913.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147913.log.gz 2023-08-10T10:53:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135770.log 2023-08-10T10:53:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130045.log 2023-08-10T10:53:59.182 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121685.log.gz 2023-08-10T10:53:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135770.log.gz 2023-08-10T10:53:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126608.log 2023-08-10T10:53:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157556.log 2023-08-10T10:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130045.log.gz 2023-08-10T10:53:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126608.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126608.log.gz 2023-08-10T10:53:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144479.log 2023-08-10T10:53:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153168.log 2023-08-10T10:53:59.187 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157556.log.gz 2023-08-10T10:53:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144479.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144479.log.gz 2023-08-10T10:53:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148962.log 2023-08-10T10:53:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155741.log 2023-08-10T10:53:59.190 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153168.log.gz 2023-08-10T10:53:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148962.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148962.log.gz 2023-08-10T10:53:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137850.log 2023-08-10T10:53:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130213.log 2023-08-10T10:53:59.193 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155741.log.gz 2023-08-10T10:53:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137850.log.gz 2023-08-10T10:53:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129345.log 2023-08-10T10:53:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127389.log 2023-08-10T10:53:59.195 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130213.log.gz 2023-08-10T10:53:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129345.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129345.log.gz 2023-08-10T10:53:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123335.log 2023-08-10T10:53:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143772.log 2023-08-10T10:53:59.197 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127389.log.gz 2023-08-10T10:53:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123335.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123335.log.gz 2023-08-10T10:53:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151506.log 2023-08-10T10:53:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142771.log 2023-08-10T10:53:59.200 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143772.log.gz 2023-08-10T10:53:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151506.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151506.log.gz 2023-08-10T10:53:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140905.log 2023-08-10T10:53:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.142771.log: -- /var/log/ceph/ceph-client.admin.130672.log 2023-08-10T10:53:59.203 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142771.log.gz 2023-08-10T10:53:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140905.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140905.log.gz 2023-08-10T10:53:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157035.log 2023-08-10T10:53:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147278.log 2023-08-10T10:53:59.206 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130672.log.gz 2023-08-10T10:53:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157035.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157035.log.gz 2023-08-10T10:53:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141814.log 2023-08-10T10:53:59.208 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134135.log 2023-08-10T10:53:59.209 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.147278.log.gz 2023-08-10T10:53:59.209 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141814.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141814.log.gz 2023-08-10T10:53:59.210 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147175.log 2023-08-10T10:53:59.212 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130526.log 2023-08-10T10:53:59.212 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134135.log.gz 2023-08-10T10:53:59.212 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147175.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.147175.log.gz 2023-08-10T10:53:59.212 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150056.log 2023-08-10T10:53:59.213 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144691.log 2023-08-10T10:53:59.214 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130526.log.gz 2023-08-10T10:53:59.215 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150056.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150056.log.gz 2023-08-10T10:53:59.215 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153523.log 2023-08-10T10:53:59.215 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123917.log 2023-08-10T10:53:59.216 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144691.log.gz 2023-08-10T10:53:59.216 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153523.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153523.log.gz 2023-08-10T10:53:59.217 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143291.log 2023-08-10T10:53:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127739.log 2023-08-10T10:53:59.218 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123917.log.gz 2023-08-10T10:53:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143291.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143291.log.gz 2023-08-10T10:53:59.219 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157766.log 2023-08-10T10:53:59.220 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125260.log 2023-08-10T10:53:59.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127739.log.gz 2023-08-10T10:53:59.221 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157766.log.gz 2023-08-10T10:53:59.222 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141297.log 2023-08-10T10:53:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132383.log 2023-08-10T10:53:59.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125260.log.gz 2023-08-10T10:53:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141297.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141297.log.gz 2023-08-10T10:53:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122915.log 2023-08-10T10:53:59.225 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117682.log 2023-08-10T10:53:59.226 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132383.log.gz 2023-08-10T10:53:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122915.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122915.log.gz 2023-08-10T10:53:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118018.log 2023-08-10T10:53:59.228 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141043.log 2023-08-10T10:53:59.228 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117682.log.gz 2023-08-10T10:53:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118018.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118018.log.gz 2023-08-10T10:53:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133234.log 2023-08-10T10:53:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149398.log 2023-08-10T10:53:59.231 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141043.log.gz 2023-08-10T10:53:59.231 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133234.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133234.log.gz 2023-08-10T10:53:59.232 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-10T10:53:59.233 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146223.log 2023-08-10T10:53:59.233 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149398.log.gz 2023-08-10T10:53:59.234 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125571.log 2023-08-10T10:53:59.236 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153042.log 2023-08-10T10:53:59.236 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146223.log.gz 2023-08-10T10:53:59.237 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117696.log 2023-08-10T10:53:59.238 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125571.log.gz 2023-08-10T10:53:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153042.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153042.log.gz 2023-08-10T10:53:59.239 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158187.log 2023-08-10T10:53:59.241 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127991.log 2023-08-10T10:53:59.241 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117696.log.gz 2023-08-10T10:53:59.242 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158187.log: gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158187.log.gz 2023-08-10T10:53:59.242 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.118027.log 2023-08-10T10:53:59.243 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127991.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127991.log.gz 2023-08-10T10:53:59.244 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143646.log 2023-08-10T10:53:59.245 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153210.log 2023-08-10T10:53:59.246 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118027.log.gz 2023-08-10T10:53:59.247 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133024.log 2023-08-10T10:53:59.247 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143646.log.gz 2023-08-10T10:53:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153210.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.153210.log.gz --verbose 2023-08-10T10:53:59.248 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.154610.log 2023-08-10T10:53:59.250 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150392.log 2023-08-10T10:53:59.250 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.133024.log.gz 2023-08-10T10:53:59.252 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154610.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154610.log.gz 2023-08-10T10:53:59.252 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.0.148842.log 2023-08-10T10:53:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150392.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150392.log.gz 2023-08-10T10:53:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155193.log 2023-08-10T10:53:59.254 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.148842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.148842.log.gz 2023-08-10T10:53:59.255 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139976.log 2023-08-10T10:53:59.256 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155193.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155193.log.gz 2023-08-10T10:53:59.256 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137471.log 2023-08-10T10:53:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139976.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139976.log.gz 2023-08-10T10:53:59.258 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132672.log 2023-08-10T10:53:59.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137471.log: gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137471.log.gz 2023-08-10T10:53:59.260 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.126380.log 2023-08-10T10:53:59.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132672.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132672.log.gz 2023-08-10T10:53:59.261 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116511.log 2023-08-10T10:53:59.263 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124635.log 2023-08-10T10:53:59.263 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126380.log.gz 2023-08-10T10:53:59.264 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116511.log: gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116511.log.gz 2023-08-10T10:53:59.265 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.150476.log 2023-08-10T10:53:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124635.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124635.log.gz 2023-08-10T10:53:59.266 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156615.log 2023-08-10T10:53:59.268 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132798.log 2023-08-10T10:53:59.268 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.150476.log.gz 2023-08-10T10:53:59.270 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156615.log: gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156615.log.gz 2023-08-10T10:53:59.270 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.153912.log 2023-08-10T10:53:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132798.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132798.log.gz 2023-08-10T10:53:59.271 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121490.log 2023-08-10T10:53:59.273 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149972.log 2023-08-10T10:53:59.273 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.153912.log.gz 2023-08-10T10:53:59.274 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121490.log: gzip -5 --verbose 89.4% -- replaced with /var/log/ceph/ceph-client.admin.121490.log.gz 2023-08-10T10:53:59.275 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.154176.log 2023-08-10T10:53:59.275 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149972.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149972.log.gz 2023-08-10T10:53:59.276 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151156.log 2023-08-10T10:53:59.278 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123875.log 2023-08-10T10:53:59.278 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154176.log.gz 2023-08-10T10:53:59.279 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151156.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151156.log.gz 2023-08-10T10:53:59.279 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.140779.log 2023-08-10T10:53:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123875.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123875.log.gz 2023-08-10T10:53:59.281 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142897.log 2023-08-10T10:53:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140779.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140779.log.gz 2023-08-10T10:53:59.283 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154568.log 2023-08-10T10:53:59.284 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126506.log 2023-08-10T10:53:59.284 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142897.log.gz 2023-08-10T10:53:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154568.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154568.log.gz 2023-08-10T10:53:59.287 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.157808.log 2023-08-10T10:53:59.288 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126506.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126506.log.gz 2023-08-10T10:53:59.288 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150864.log 2023-08-10T10:53:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157808.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.157808.log.gz 2023-08-10T10:53:59.290 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.116672.log 2023-08-10T10:53:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150864.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150864.log.gz 2023-08-10T10:53:59.291 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.152107.log 2023-08-10T10:53:59.292 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116672.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116672.log.gz 2023-08-10T10:53:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148655.log 2023-08-10T10:53:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152107.log: gzip -5 --verbose 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152107.log.gz 2023-08-10T10:53:59.295 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.127569.log 2023-08-10T10:53:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148655.log.gz 2023-08-10T10:53:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147362.log 2023-08-10T10:53:59.298 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133589.log 2023-08-10T10:53:59.298 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127569.log.gz 2023-08-10T10:53:59.299 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147362.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142609.log 2023-08-10T10:53:59.299 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147362.log.gz 2023-08-10T10:53:59.300 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148039.log 2023-08-10T10:53:59.301 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133589.log.gz 2023-08-10T10:53:59.302 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142609.log: gzip 87.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.131447.log 2023-08-10T10:53:59.302 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142609.log.gz 2023-08-10T10:53:59.303 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148039.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148039.log.gz 2023-08-10T10:53:59.303 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138854.log 2023-08-10T10:53:59.305 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146097.log 89.6% 2023-08-10T10:53:59.305 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131447.log.gz 2023-08-10T10:53:59.306 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138854.log: gzip 87.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.130400.log 2023-08-10T10:53:59.306 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.138854.log.gz 2023-08-10T10:53:59.308 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146097.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146097.log.gz 2023-08-10T10:53:59.308 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143957.log 2023-08-10T10:53:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143123.log 2023-08-10T10:53:59.309 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130400.log.gz 2023-08-10T10:53:59.311 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152444.log 2023-08-10T10:53:59.311 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143957.log.gz 2023-08-10T10:53:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143123.log: gzip -5 89.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.143123.log.gz -- 2023-08-10T10:53:59.312 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.135650.log 2023-08-10T10:53:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152444.log.gz 2023-08-10T10:53:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124569.log 2023-08-10T10:53:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135650.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135650.log.gz 2023-08-10T10:53:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127263.log 2023-08-10T10:53:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129429.log 2023-08-10T10:53:59.318 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.124569.log.gz 2023-08-10T10:53:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127263.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127263.log.gz 2023-08-10T10:53:59.319 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.121991.log 2023-08-10T10:53:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129429.log.gz 2023-08-10T10:53:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154133.log 2023-08-10T10:53:59.322 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136098.log 2023-08-10T10:53:59.323 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121991.log.gz 2023-08-10T10:53:59.324 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154133.log: gzip 87.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.120672.log 2023-08-10T10:53:59.324 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154133.log.gz 2023-08-10T10:53:59.326 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136098.log.gz 2023-08-10T10:53:59.326 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120335.log 2023-08-10T10:53:59.327 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120672.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.135728.log -- replaced with /var/log/ceph/ceph-client.admin.120672.log.gz 2023-08-10T10:53:59.327 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.329 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120335.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120335.log.gz 2023-08-10T10:53:59.329 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.135482.log 2023-08-10T10:53:59.330 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135728.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135728.log.gz 2023-08-10T10:53:59.330 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158415.log 2023-08-10T10:53:59.332 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127527.log 2023-08-10T10:53:59.332 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135482.log.gz 2023-08-10T10:53:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158415.log: gzip -5 88.3% --verbose -- /var/log/ceph/ceph-client.admin.140694.log 2023-08-10T10:53:59.334 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158415.log.gz 2023-08-10T10:53:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127527.log.gz 2023-08-10T10:53:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138460.log 2023-08-10T10:53:59.336 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142955.log 2023-08-10T10:53:59.337 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140694.log.gz 2023-08-10T10:53:59.338 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138460.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.117349.log -- replaced with /var/log/ceph/ceph-client.admin.138460.log.gz 2023-08-10T10:53:59.338 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.340 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142955.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142955.log.gz 2023-08-10T10:53:59.340 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117391.log 2023-08-10T10:53:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117349.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117349.log.gz 2023-08-10T10:53:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119281.log 2023-08-10T10:53:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140018.log 2023-08-10T10:53:59.344 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117391.log.gz 2023-08-10T10:53:59.352 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146427.log 2023-08-10T10:53:59.352 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.119281.log.gz 2023-08-10T10:53:59.352 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140018.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.140018.log.gz 2023-08-10T10:53:59.353 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142729.log 2023-08-10T10:53:59.353 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158103.log 2023-08-10T10:53:59.353 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146427.log.gz 2023-08-10T10:53:59.353 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142729.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142729.log.gz 2023-08-10T10:53:59.353 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.121769.log 2023-08-10T10:53:59.354 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158103.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158103.log.gz 2023-08-10T10:53:59.354 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127865.log 2023-08-10T10:53:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121769.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.121769.log.gz -- 2023-08-10T10:53:59.356 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.141856.log 2023-08-10T10:53:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127865.log.gz 2023-08-10T10:53:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142399.log 2023-08-10T10:53:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141856.log.gz 2023-08-10T10:53:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129549.log 2023-08-10T10:53:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142399.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.142399.log.gz /var/log/ceph/ceph-client.admin.141129.log 2023-08-10T10:53:59.358 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129549.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129549.log.gz 2023-08-10T10:53:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152570.log 2023-08-10T10:53:59.360 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146265.log 2023-08-10T10:53:59.361 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141129.log.gz 2023-08-10T10:53:59.362 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152570.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152570.log.gz 2023-08-10T10:53:59.362 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.121008.log 2023-08-10T10:53:59.363 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146265.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146265.log.gz 2023-08-10T10:53:59.364 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126044.log 2023-08-10T10:53:59.365 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121008.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.121008.log.gz -5 2023-08-10T10:53:59.366 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.150519.log 2023-08-10T10:53:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126044.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126044.log.gz -5 2023-08-10T10:53:59.367 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143520.log 2023-08-10T10:53:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150519.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150519.log.gz 2023-08-10T10:53:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140863.log 2023-08-10T10:53:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143520.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143520.log.gz 2023-08-10T10:53:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127219.log 2023-08-10T10:53:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141171.log 2023-08-10T10:53:59.372 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140863.log.gz 2023-08-10T10:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127219.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127219.log.gz 2023-08-10T10:53:59.374 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.127611.log 2023-08-10T10:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141171.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141171.log.gz 2023-08-10T10:53:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135440.log 2023-08-10T10:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120882.log 2023-08-10T10:53:59.377 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127611.log.gz 2023-08-10T10:53:59.379 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135440.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125080.log 2023-08-10T10:53:59.379 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135440.log.gz 2023-08-10T10:53:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117433.log 2023-08-10T10:53:59.380 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120882.log.gz 2023-08-10T10:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125080.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125080.log.gz 2023-08-10T10:53:59.382 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.126170.log 2023-08-10T10:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117433.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117433.log.gz 2023-08-10T10:53:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143375.log 2023-08-10T10:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150646.log 2023-08-10T10:53:59.385 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126170.log.gz 2023-08-10T10:53:59.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143375.log.gz 2023-08-10T10:53:59.387 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129387.log 2023-08-10T10:53:59.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150646.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150646.log.gz 2023-08-10T10:53:59.388 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117693.log 2023-08-10T10:53:59.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124173.log 2023-08-10T10:53:59.390 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129387.log.gz 2023-08-10T10:53:59.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117693.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117693.log.gz 2023-08-10T10:53:59.392 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130484.log 2023-08-10T10:53:59.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124173.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124173.log.gz 2023-08-10T10:53:59.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156268.log 2023-08-10T10:53:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130484.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130484.log.gz 2023-08-10T10:53:59.396 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.146653.log 2023-08-10T10:53:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156268.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156268.log.gz 2023-08-10T10:53:59.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131361.log 2023-08-10T10:53:59.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156515.log 2023-08-10T10:53:59.398 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146653.log.gz 2023-08-10T10:53:59.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131361.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131361.log.gz 2023-08-10T10:53:59.400 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.124984.log 2023-08-10T10:53:59.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156515.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156515.log.gz 2023-08-10T10:53:59.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134728.log 2023-08-10T10:53:59.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145905.log 2023-08-10T10:53:59.403 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124984.log.gz 2023-08-10T10:53:59.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134728.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134728.log.gz 2023-08-10T10:53:59.405 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117011.log 2023-08-10T10:53:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145905.log.gz 2023-08-10T10:53:59.406 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140438.log 2023-08-10T10:53:59.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156699.log 2023-08-10T10:53:59.408 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117011.log.gz 2023-08-10T10:53:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140438.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.140438.log.gz 2023-08-10T10:53:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131311.log 2023-08-10T10:53:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156699.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156699.log.gz 2023-08-10T10:53:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126296.log 2023-08-10T10:53:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131311.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131311.log.gz 2023-08-10T10:53:59.413 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117517.log 2023-08-10T10:53:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126296.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126296.log.gz 2023-08-10T10:53:59.415 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.132982.log 2023-08-10T10:53:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117517.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117517.log.gz 2023-08-10T10:53:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123209.log 2023-08-10T10:53:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140060.log 2023-08-10T10:53:59.418 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132982.log.gz 2023-08-10T10:53:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123209.log: gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123209.log.gz 2023-08-10T10:53:59.420 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.149456.log 2023-08-10T10:53:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140060.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140060.log.gz 2023-08-10T10:53:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156951.log 2023-08-10T10:53:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149456.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123377.log 2023-08-10T10:53:59.423 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149456.log.gz 2023-08-10T10:53:59.424 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139024.log 2023-08-10T10:53:59.424 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156951.log.gz 2023-08-10T10:53:59.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123377.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.123377.log.gz /var/log/ceph/ceph-client.admin.138502.log 2023-08-10T10:53:59.426 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137171.log 2023-08-10T10:53:59.428 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139024.log.gz 2023-08-10T10:53:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138502.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.138502.log.gz -- 2023-08-10T10:53:59.429 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.132132.log 2023-08-10T10:53:59.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137171.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150688.log 2023-08-10T10:53:59.431 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137171.log.gz 2023-08-10T10:53:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142441.log 2023-08-10T10:53:59.432 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132132.log.gz 2023-08-10T10:53:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150688.log: gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150688.log.gz 2023-08-10T10:53:59.434 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.127907.log 2023-08-10T10:53:59.435 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142441.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142441.log.gz 2023-08-10T10:53:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133066.log 2023-08-10T10:53:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127907.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127907.log.gz 2023-08-10T10:53:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149930.log 2023-08-10T10:53:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133066.log.gz 2023-08-10T10:53:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127477.log 2023-08-10T10:53:59.440 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149930.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149930.log.gz 2023-08-10T10:53:59.441 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122705.log 2023-08-10T10:53:59.442 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127477.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127477.log.gz 2023-08-10T10:53:59.442 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131849.log 2023-08-10T10:53:59.444 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144607.log 2023-08-10T10:53:59.444 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122705.log.gz 2023-08-10T10:53:59.446 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131849.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131849.log.gz 2023-08-10T10:53:59.447 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.134812.log 2023-08-10T10:53:59.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144607.log.gz 2023-08-10T10:53:59.448 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150784.log 2023-08-10T10:53:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134812.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134812.log.gz 2023-08-10T10:53:59.449 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.142997.log 2023-08-10T10:53:59.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150784.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150784.log.gz 2023-08-10T10:53:59.450 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146737.log 2023-08-10T10:53:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129835.log 2023-08-10T10:53:59.452 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142997.log.gz 2023-08-10T10:53:59.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146737.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146737.log.gz 2023-08-10T10:53:59.454 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.120924.log 2023-08-10T10:53:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129835.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129835.log.gz 2023-08-10T10:53:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154390.log 2023-08-10T10:53:59.457 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157892.log 2023-08-10T10:53:59.457 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120924.log.gz 2023-08-10T10:53:59.458 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154390.log: gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154390.log.gz 2023-08-10T10:53:59.459 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.134518.log 2023-08-10T10:53:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157892.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157892.log.gz 2023-08-10T10:53:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144215.log 2023-08-10T10:53:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134518.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134518.log.gz 2023-08-10T10:53:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137341.log 2023-08-10T10:53:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144215.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144215.log.gz 2023-08-10T10:53:59.464 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.136728.log 2023-08-10T10:53:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137341.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137341.log.gz 2023-08-10T10:53:59.466 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156347.log 2023-08-10T10:53:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136728.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136728.log.gz 2023-08-10T10:53:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130297.log 2023-08-10T10:53:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156347.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156347.log.gz 2023-08-10T10:53:59.469 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.141255.log 2023-08-10T10:53:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130297.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130297.log.gz 2023-08-10T10:53:59.470 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157282.log 2023-08-10T10:53:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125529.log 2023-08-10T10:53:59.472 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141255.log.gz 2023-08-10T10:53:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157282.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157282.log.gz 2023-08-10T10:53:59.474 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.121448.log 2023-08-10T10:53:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125529.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125529.log.gz 2023-08-10T10:53:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147031.log 2023-08-10T10:53:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121448.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121448.log.gz 2023-08-10T10:53:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149704.log 2023-08-10T10:53:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147031.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.147031.log.gz 2023-08-10T10:53:59.479 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.145336.log 2023-08-10T10:53:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149704.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149704.log.gz 2023-08-10T10:53:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152486.log 2023-08-10T10:53:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145336.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145336.log.gz 2023-08-10T10:53:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158497.log 2023-08-10T10:53:59.483 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152486.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152486.log.gz 2023-08-10T10:53:59.484 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117055.log 2023-08-10T10:53:59.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158497.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.121364.log -- replaced with /var/log/ceph/ceph-client.admin.158497.log.gz 2023-08-10T10:53:59.486 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132882.log 2023-08-10T10:53:59.487 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117055.log.gz 2023-08-10T10:53:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121364.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121364.log.gz 2023-08-10T10:53:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123041.log 2023-08-10T10:53:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132882.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132882.log.gz 2023-08-10T10:53:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120966.log 2023-08-10T10:53:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123041.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123041.log.gz 2023-08-10T10:53:59.492 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.153817.log 2023-08-10T10:53:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120966.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120966.log.gz 2023-08-10T10:53:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.114219.log 2023-08-10T10:53:59.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.120205.log 2023-08-10T10:53:59.495 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153817.log.gz 2023-08-10T10:53:59.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.114219.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.114219.log.gz 2023-08-10T10:53:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137766.log 2023-08-10T10:53:59.497 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.2.120205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.120205.log.gz 2023-08-10T10:53:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147236.log 2023-08-10T10:53:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137766.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.137766.log.gz -5 2023-08-10T10:53:59.500 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.124401.log 2023-08-10T10:53:59.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147236.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147236.log.gz 2023-08-10T10:53:59.502 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.130568.log 2023-08-10T10:53:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124401.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124401.log.gz 2023-08-10T10:53:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124822.log 2023-08-10T10:53:59.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130568.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130568.log.gz 2023-08-10T10:53:59.506 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.155510.log 2023-08-10T10:53:59.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.124822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124822.log.gz 2023-08-10T10:53:59.507 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137383.log 2023-08-10T10:53:59.508 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140613.log 2023-08-10T10:53:59.508 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155510.log.gz 2023-08-10T10:53:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137383.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137383.log.gz 2023-08-10T10:53:59.510 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.154442.log 2023-08-10T10:53:59.511 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140613.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140613.log.gz 2023-08-10T10:53:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137681.log 2023-08-10T10:53:59.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154442.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154442.log.gz 2023-08-10T10:53:59.514 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123707.log 2023-08-10T10:53:59.515 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137681.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137681.log.gz 2023-08-10T10:53:59.515 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.139556.log 2023-08-10T10:53:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123707.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140396.log 2023-08-10T10:53:59.517 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123707.log.gz 2023-08-10T10:53:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153252.log 2023-08-10T10:53:59.518 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139556.log.gz 2023-08-10T10:53:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140396.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140396.log.gz 2023-08-10T10:53:59.520 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145863.log 2023-08-10T10:53:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134346.log 2023-08-10T10:53:59.521 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153252.log.gz 2023-08-10T10:53:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136790.log 2023-08-10T10:53:59.523 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145863.log.gz 2023-08-10T10:53:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134346.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.126838.log 2023-08-10T10:53:59.524 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134346.log.gz 2023-08-10T10:53:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136790.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.136790.log.gz 2023-08-10T10:53:59.526 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.119435.log 2023-08-10T10:53:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126838.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126838.log.gz 2023-08-10T10:53:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135524.log 2023-08-10T10:53:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119435.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119435.log.gz 2023-08-10T10:53:59.529 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.119029.log 2023-08-10T10:53:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135524.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135524.log.gz 2023-08-10T10:53:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140993.log 2023-08-10T10:53:59.532 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116469.log 2023-08-10T10:53:59.532 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119029.log.gz 2023-08-10T10:53:59.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140993.log: gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.157598.log 2023-08-10T10:53:59.534 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140993.log.gz 2023-08-10T10:53:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116469.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116469.log.gz 2023-08-10T10:53:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158229.log 2023-08-10T10:53:59.537 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157598.log: gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157598.log.gz 2023-08-10T10:53:59.537 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.116841.log 2023-08-10T10:53:59.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158229.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158229.log.gz 2023-08-10T10:53:59.539 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126922.log 2023-08-10T10:53:59.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116841.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116841.log.gz 2023-08-10T10:53:59.541 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157180.log 2023-08-10T10:53:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126922.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126922.log.gz 2023-08-10T10:53:59.542 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121092.log 2023-08-10T10:53:59.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157180.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157180.log.gz 2023-08-10T10:53:59.544 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120840.log 2023-08-10T10:53:59.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121092.log: gzip -5 --verbose 88.6% -- /var/log/ceph/ceph-client.admin.144385.log -- replaced with /var/log/ceph/ceph-client.admin.121092.log.gz 2023-08-10T10:53:59.545 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:53:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120840.log: gzip -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120840.log.gz 2023-08-10T10:53:59.547 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.132551.log 2023-08-10T10:53:59.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144385.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144385.log.gz 2023-08-10T10:53:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141213.log 2023-08-10T10:53:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132551.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132551.log.gz 2023-08-10T10:53:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118609.log 2023-08-10T10:53:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141213.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141213.log.gz 2023-08-10T10:53:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139354.log 2023-08-10T10:53:59.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118609.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118609.log.gz 2023-08-10T10:53:59.554 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.135823.log 2023-08-10T10:53:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139354.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139354.log.gz 2023-08-10T10:53:59.555 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126212.log 2023-08-10T10:53:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140186.log 2023-08-10T10:53:59.557 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135823.log.gz 2023-08-10T10:53:59.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126212.log: gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126212.log.gz 2023-08-10T10:53:59.559 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.126692.log 2023-08-10T10:53:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140186.log.gz 2023-08-10T10:53:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147320.log 2023-08-10T10:53:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126692.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126692.log.gz 2023-08-10T10:53:59.562 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.144649.log 2023-08-10T10:53:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147320.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.147320.log.gz 2023-08-10T10:53:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127347.log 2023-08-10T10:53:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144649.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144649.log.gz 2023-08-10T10:53:59.565 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.127781.log 2023-08-10T10:53:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127347.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127347.log.gz 2023-08-10T10:53:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158313.log 2023-08-10T10:53:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127781.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127781.log.gz 2023-08-10T10:53:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118359.log 2023-08-10T10:53:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158313.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158313.log.gz 2023-08-10T10:53:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131054.log 2023-08-10T10:53:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118359.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118359.log.gz 2023-08-10T10:53:59.572 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153992.log 2023-08-10T10:53:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131054.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131054.log.gz 2023-08-10T10:53:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136140.log 2023-08-10T10:53:59.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139766.log 2023-08-10T10:53:59.575 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153992.log.gz 2023-08-10T10:53:59.577 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136140.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136140.log.gz -5 2023-08-10T10:53:59.577 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.139640.log 2023-08-10T10:53:59.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139766.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139766.log.gz 2023-08-10T10:53:59.579 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.121727.log 2023-08-10T10:53:59.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139640.log.gz 2023-08-10T10:53:59.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132840.log 2023-08-10T10:53:59.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139270.log 2023-08-10T10:53:59.582 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121727.log.gz 2023-08-10T10:53:59.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132840.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132840.log.gz 2023-08-10T10:53:59.584 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.131699.log 2023-08-10T10:53:59.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139270.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139270.log.gz 2023-08-10T10:53:59.585 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118861.log 2023-08-10T10:53:59.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131699.log: gzip 88.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.122537.log 2023-08-10T10:53:59.587 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131699.log.gz 2023-08-10T10:53:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118861.log.gz 2023-08-10T10:53:59.588 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146511.log 2023-08-10T10:53:59.589 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152732.log 2023-08-10T10:53:59.590 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122537.log.gz 2023-08-10T10:53:59.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146511.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146511.log.gz 2023-08-10T10:53:59.592 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.155867.log 2023-08-10T10:53:59.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152732.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152732.log.gz 2023-08-10T10:53:59.593 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122159.log 2023-08-10T10:53:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131267.log 2023-08-10T10:53:59.595 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155867.log.gz 2023-08-10T10:53:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122159.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.122159.log.gz 2023-08-10T10:53:59.597 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.120630.log 2023-08-10T10:53:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131267.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131267.log.gz 2023-08-10T10:53:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130255.log 2023-08-10T10:53:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120630.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120630.log.gz 2023-08-10T10:53:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147446.log 2023-08-10T10:53:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130255.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.130255.log.gz -5 2023-08-10T10:53:59.602 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.146307.log 2023-08-10T10:53:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147446.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.147446.log.gz 2023-08-10T10:53:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126422.log 2023-08-10T10:53:59.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146307.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146307.log.gz 2023-08-10T10:53:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134644.log 2023-08-10T10:53:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126422.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126422.log.gz 2023-08-10T10:53:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130630.log 2023-08-10T10:53:59.611 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134644.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134644.log.gz 2023-08-10T10:53:59.611 INFO:teuthology.orchestra.run.smithi050.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-10T10:53:59.612 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122831.log 2023-08-10T10:53:59.613 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130630.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148463.log 2023-08-10T10:53:59.613 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130630.log.gz 2023-08-10T10:53:59.614 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125776.log 2023-08-10T10:53:59.615 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122831.log.gz 2023-08-10T10:53:59.616 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148463.log.gz 2023-08-10T10:53:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133402.log 2023-08-10T10:53:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149662.log 2023-08-10T10:53:59.618 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125776.log.gz 2023-08-10T10:53:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133402.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.133402.log.gz 2023-08-10T10:53:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121811.log 2023-08-10T10:53:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149662.log.gz 2023-08-10T10:53:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145641.log 2023-08-10T10:53:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121811.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121811.log.gz 2023-08-10T10:53:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122249.log 2023-08-10T10:53:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145641.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145641.log.gz 2023-08-10T10:53:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121643.log 2023-08-10T10:53:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122249.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122249.log.gz 2023-08-10T10:53:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140270.log 2023-08-10T10:53:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121643.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-10T10:53:59.628 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121643.log.gz 2023-08-10T10:53:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140270.log.gz 2023-08-10T10:53:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141087.log 2023-08-10T10:53:59.630 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-10T10:53:59.630 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124527.log 2023-08-10T10:53:59.632 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128490.log 2023-08-10T10:53:59.632 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141087.log.gz 2023-08-10T10:53:59.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124527.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124527.log.gz 2023-08-10T10:53:59.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133861.log 2023-08-10T10:53:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116591.log 2023-08-10T10:53:59.635 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128490.log.gz 2023-08-10T10:53:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133861.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133861.log.gz 2023-08-10T10:53:59.636 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154091.log 2023-08-10T10:53:59.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116591.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-10T10:53:59.637 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116591.log.gz 2023-08-10T10:53:59.637 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154091.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154091.log.gz 2023-08-10T10:53:59.638 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129071.log 2023-08-10T10:53:59.639 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134854.log 2023-08-10T10:53:59.640 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129071.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129071.log.gz 2023-08-10T10:53:59.640 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139312.log 2023-08-10T10:53:59.641 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146181.log 2023-08-10T10:53:59.642 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134854.log.gz 2023-08-10T10:53:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139312.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139312.log.gz 2023-08-10T10:53:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145506.log 2023-08-10T10:53:59.644 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121853.log 2023-08-10T10:53:59.644 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146181.log.gz 2023-08-10T10:53:59.646 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156867.log 2023-08-10T10:53:59.646 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145506.log.gz 2023-08-10T10:53:59.647 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127017.log 2023-08-10T10:53:59.647 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121853.log.gz 2023-08-10T10:53:59.649 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156867.log.gz 2023-08-10T10:53:59.649 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135566.log 2023-08-10T10:53:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127017.log.gz 2023-08-10T10:53:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-10T10:53:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135566.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135566.log.gz 2023-08-10T10:53:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126338.log 2023-08-10T10:53:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147572.log 2023-08-10T10:53:59.655 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126338.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.126338.log.gz --verbose 2023-08-10T10:53:59.655 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.148547.log 2023-08-10T10:53:59.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147572.log: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-10T10:53:59.656 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128075.log 2023-08-10T10:53:59.657 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147572.log.gz 2023-08-10T10:53:59.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140228.log 2023-08-10T10:53:59.658 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148547.log.gz 2023-08-10T10:53:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128075.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128075.log.gz 2023-08-10T10:53:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145566.log 2023-08-10T10:53:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116256.log 2023-08-10T10:53:59.661 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140228.log.gz 2023-08-10T10:53:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145566.log.gz 2023-08-10T10:53:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117475.log 2023-08-10T10:53:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134962.log 2023-08-10T10:53:59.663 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116256.log.gz 2023-08-10T10:53:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117475.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117475.log.gz 2023-08-10T10:53:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145779.log 2023-08-10T10:53:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151734.log 2023-08-10T10:53:59.666 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.134962.log.gz 2023-08-10T10:53:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145779.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145779.log.gz 2023-08-10T10:53:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157077.log 2023-08-10T10:53:59.668 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-10T10:53:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139108.log 2023-08-10T10:53:59.669 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.151734.log.gz 2023-08-10T10:53:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157077.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157077.log.gz 2023-08-10T10:53:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139598.log 2023-08-10T10:53:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147870.log 2023-08-10T10:53:59.672 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9%/var/log/ceph/ceph-client.admin.139598.log: -- replaced with /var/log/ceph/ceph-client.admin.139108.log.gz 2023-08-10T10:53:59.672 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139598.log.gz 2023-08-10T10:53:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138812.log 2023-08-10T10:53:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.147870.log.gz 2023-08-10T10:53:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147997.log 2023-08-10T10:53:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138812.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138812.log.gz 2023-08-10T10:53:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126734.log 2023-08-10T10:53:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147997.log.gz 2023-08-10T10:53:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152690.log 2023-08-10T10:53:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126734.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126734.log.gz 2023-08-10T10:53:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144257.log 2023-08-10T10:53:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152690.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152690.log.gz 2023-08-10T10:53:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120798.log 2023-08-10T10:53:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144257.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144257.log.gz 2023-08-10T10:53:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121949.log 2023-08-10T10:53:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120798.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120798.log.gz 2023-08-10T10:53:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156100.log 2023-08-10T10:53:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121949.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121949.log.gz 2023-08-10T10:53:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131615.log 2023-08-10T10:53:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156100.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156100.log.gz 2023-08-10T10:53:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139682.log 2023-08-10T10:53:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131615.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131615.log.gz 2023-08-10T10:53:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134036.log 2023-08-10T10:53:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139682.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.139682.log.gz 2023-08-10T10:53:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158061.log 2023-08-10T10:53:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134036.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134036.log.gz 2023-08-10T10:53:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128774.log 2023-08-10T10:53:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158061.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158061.log.gz 2023-08-10T10:53:59.694 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142056.log 2023-08-10T10:53:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128774.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128774.log.gz 2023-08-10T10:53:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153607.log 2023-08-10T10:53:59.697 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142056.log.gz 2023-08-10T10:53:59.697 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145947.log 2023-08-10T10:53:59.698 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153607.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153607.log.gz 2023-08-10T10:53:59.699 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147115.log 2023-08-10T10:53:59.700 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145947.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145947.log.gz 2023-08-10T10:53:59.700 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148379.log 2023-08-10T10:53:59.701 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147115.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147115.log.gz 2023-08-10T10:53:59.702 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136056.log 2023-08-10T10:53:59.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148379.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148379.log.gz 2023-08-10T10:53:59.703 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118945.log 2023-08-10T10:53:59.704 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136056.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136056.log.gz 2023-08-10T10:53:59.705 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156657.log 2023-08-10T10:53:59.706 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118945.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118945.log.gz 2023-08-10T10:53:59.707 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141531.log 2023-08-10T10:53:59.708 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156657.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156657.log.gz 2023-08-10T10:53:59.708 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122621.log 2023-08-10T10:53:59.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141531.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141531.log.gz 2023-08-10T10:53:59.710 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155235.log 2023-08-10T10:53:59.711 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122621.log.gz 2023-08-10T10:53:59.711 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124045.log 2023-08-10T10:53:59.712 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-10T10:53:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155235.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155235.log.gz 2023-08-10T10:53:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142567.log 2023-08-10T10:53:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124045.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124045.log.gz 2023-08-10T10:53:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123125.log 2023-08-10T10:53:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142567.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142567.log.gz 2023-08-10T10:53:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128448.log 2023-08-10T10:53:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123125.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123125.log.gz 2023-08-10T10:53:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118355.log 2023-08-10T10:53:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128448.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128448.log.gz 2023-08-10T10:53:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149578.log 2023-08-10T10:53:59.720 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118355.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118355.log.gz 2023-08-10T10:53:59.721 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149230.log 2023-08-10T10:53:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149578.log.gz 2023-08-10T10:53:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148253.log 2023-08-10T10:53:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149230.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149230.log.gz 2023-08-10T10:53:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126128.log 2023-08-10T10:53:59.725 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148253.log.gz 2023-08-10T10:53:59.726 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149272.log 2023-08-10T10:53:59.727 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126128.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126128.log.gz 2023-08-10T10:53:59.727 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131741.log 2023-08-10T10:53:59.729 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149272.log.gz 2023-08-10T10:53:59.729 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156825.log 2023-08-10T10:53:59.730 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131741.log.gz 2023-08-10T10:53:59.731 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136224.log 2023-08-10T10:53:59.732 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156825.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156825.log.gz 2023-08-10T10:53:59.732 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131223.log 2023-08-10T10:53:59.733 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136224.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136224.log.gz 2023-08-10T10:53:59.734 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153775.log 2023-08-10T10:53:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131223.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131223.log.gz 2023-08-10T10:53:59.735 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146989.log 2023-08-10T10:53:59.736 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-10T10:53:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153775.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153775.log.gz 2023-08-10T10:53:59.737 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129591.log 2023-08-10T10:53:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146989.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146989.log.gz 2023-08-10T10:53:59.739 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-10T10:53:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129591.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129591.log.gz 2023-08-10T10:53:59.740 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151114.log 2023-08-10T10:53:59.742 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140736.log 2023-08-10T10:53:59.743 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149356.log 2023-08-10T10:53:59.744 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151114.log.gz 2023-08-10T10:53:59.745 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140736.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134896.log 2023-08-10T10:53:59.745 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140736.log.gz 2023-08-10T10:53:59.747 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149356.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149356.log.gz 2023-08-10T10:53:59.747 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.150140.log 2023-08-10T10:53:59.748 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134896.log: gzip -5 --verbose 90.7% -- replaced with /var/log/ceph/ceph-client.admin.134896.log.gz 2023-08-10T10:53:59.749 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.133547.log 2023-08-10T10:53:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150140.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150140.log.gz 2023-08-10T10:53:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144565.log 2023-08-10T10:53:59.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133547.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133547.log.gz 2023-08-10T10:53:59.752 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.148083.log 2023-08-10T10:53:59.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144565.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144565.log.gz 2023-08-10T10:53:59.754 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149004.log 2023-08-10T10:53:59.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148083.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148083.log.gz 2023-08-10T10:53:59.756 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.152360.log 2023-08-10T10:53:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149004.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149004.log.gz 2023-08-10T10:53:59.757 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157682.log 2023-08-10T10:53:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152360.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152360.log.gz 2023-08-10T10:53:59.759 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121406.log 2023-08-10T10:53:59.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157682.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157682.log.gz 2023-08-10T10:53:59.761 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144901.log 2023-08-10T10:53:59.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121406.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121406.log.gz 2023-08-10T10:53:59.762 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.139438.log 2023-08-10T10:53:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121134.log 2023-08-10T10:53:59.764 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.144901.log.gz 2023-08-10T10:53:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139438.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139438.log.gz 2023-08-10T10:53:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150224.log 2023-08-10T10:53:59.767 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-10T10:53:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121134.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121134.log.gz 2023-08-10T10:53:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146385.log 2023-08-10T10:53:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150224.log: gzip -5 --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150224.log.gz 2023-08-10T10:53:59.770 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.127097.log 2023-08-10T10:53:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146385.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146385.log.gz 2023-08-10T10:53:59.771 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-08-10T10:53:59.771 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m1.163s 2023-08-10T10:53:59.772 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m5.158s 2023-08-10T10:53:59.772 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.617s 2023-08-10T10:53:59.773 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155825.log 2023-08-10T10:53:59.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127097.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141736.log 2023-08-10T10:53:59.773 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127097.log.gz 2023-08-10T10:53:59.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155825.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155825.log.gz 2023-08-10T10:53:59.775 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.121218.log 2023-08-10T10:53:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.141736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141736.log.gz 2023-08-10T10:53:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120462.log 2023-08-10T10:53:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121218.log: gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121218.log.gz 2023-08-10T10:53:59.778 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.150308.log 2023-08-10T10:53:59.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120462.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120462.log.gz 2023-08-10T10:53:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157514.log 2023-08-10T10:53:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150308.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150308.log.gz 2023-08-10T10:53:59.782 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.154346.log 2023-08-10T10:53:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157514.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157514.log.gz 2023-08-10T10:53:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129303.log 2023-08-10T10:53:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154346.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154346.log.gz 2023-08-10T10:53:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147828.log 2023-08-10T10:53:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135227.log 2023-08-10T10:53:59.787 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0%/var/log/ceph/ceph-client.admin.147828.log: -- replaced with /var/log/ceph/ceph-client.admin.129303.log.gz 2023-08-10T10:53:59.788 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157640.log 2023-08-10T10:53:59.788 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147828.log.gz 2023-08-10T10:53:59.790 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134304.log 2023-08-10T10:53:59.790 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135227.log.gz 2023-08-10T10:53:59.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157640.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156993.log 2023-08-10T10:53:59.792 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.157640.log.gz 2023-08-10T10:53:59.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119904.log 2023-08-10T10:53:59.793 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134304.log.gz 2023-08-10T10:53:59.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140533.log 2023-08-10T10:53:59.795 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156993.log.gz 2023-08-10T10:53:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142855.log 2023-08-10T10:53:59.796 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119904.log.gz 2023-08-10T10:53:59.797 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140533.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140533.log.gz 2023-08-10T10:53:59.798 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141423.log 2023-08-10T10:53:59.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142855.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.142855.log.gz --verbose 2023-08-10T10:53:59.800 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.148295.log 2023-08-10T10:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141423.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152916.log 2023-08-10T10:53:59.801 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141423.log.gz 2023-08-10T10:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148295.log: gzip -5 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148295.log.gz 2023-08-10T10:53:59.803 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.147073.log 2023-08-10T10:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152916.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152916.log.gz 2023-08-10T10:53:59.804 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130756.log 2023-08-10T10:53:59.805 INFO:teuthology.orchestra.run.smithi050.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-10T10:53:59.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143562.log 2023-08-10T10:53:59.807 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.147073.log.gz 2023-08-10T10:53:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130756.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130756.log.gz 2023-08-10T10:53:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129261.log 2023-08-10T10:53:59.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117692.log 2023-08-10T10:53:59.809 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143562.log.gz 2023-08-10T10:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129261.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129261.log.gz 2023-08-10T10:53:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142098.log 2023-08-10T10:53:59.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117692.log.gz 2023-08-10T10:53:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156783.log 2023-08-10T10:53:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142098.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142098.log.gz 2023-08-10T10:53:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152648.log 2023-08-10T10:53:59.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156783.log.gz 2023-08-10T10:53:59.815 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122033.log 2023-08-10T10:53:59.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152648.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152648.log.gz 2023-08-10T10:53:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154928.log 2023-08-10T10:53:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122033.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122033.log.gz 2023-08-10T10:53:59.818 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117139.log 2023-08-10T10:53:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154928.log.gz 2023-08-10T10:53:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157976.log 2023-08-10T10:53:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117139.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117139.log.gz 2023-08-10T10:53:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151380.log 2023-08-10T10:53:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157976.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157976.log.gz 2023-08-10T10:53:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127697.log 2023-08-10T10:53:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151380.log.gz 2023-08-10T10:53:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123749.log 2023-08-10T10:53:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127697.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127697.log.gz 2023-08-10T10:53:59.826 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146553.log 2023-08-10T10:53:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123749.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123749.log.gz 2023-08-10T10:53:59.827 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150434.log 2023-08-10T10:53:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146553.log.gz 2023-08-10T10:53:59.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130714.log 2023-08-10T10:53:59.830 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150434.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150434.log.gz 2023-08-10T10:53:59.831 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131181.log 2023-08-10T10:53:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130714.log.gz 2023-08-10T10:53:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123959.log 2023-08-10T10:53:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131181.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131181.log.gz 2023-08-10T10:53:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120588.log 2023-08-10T10:53:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123959.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123959.log.gz 2023-08-10T10:53:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146821.log 2023-08-10T10:53:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120588.log.gz 2023-08-10T10:53:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146139.log 2023-08-10T10:53:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146821.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146821.log.gz 2023-08-10T10:53:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155468.log 2023-08-10T10:53:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146139.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146139.log.gz 2023-08-10T10:53:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132756.log 2023-08-10T10:53:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155468.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155468.log.gz 2023-08-10T10:53:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156741.log 2023-08-10T10:53:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132756.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132756.log.gz 2023-08-10T10:53:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151590.log 2023-08-10T10:53:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156741.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156741.log.gz 2023-08-10T10:53:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148920.log 2023-08-10T10:53:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151590.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151590.log.gz 2023-08-10T10:53:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154652.log 2023-08-10T10:53:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148920.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148920.log.gz 2023-08-10T10:53:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142014.log 2023-08-10T10:53:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154652.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154652.log.gz 2023-08-10T10:53:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146695.log 2023-08-10T10:53:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142014.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142014.log.gz 2023-08-10T10:53:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119769.log 2023-08-10T10:53:59.853 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146695.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146695.log.gz 2023-08-10T10:53:59.853 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135149.log 2023-08-10T10:53:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.119769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119769.log.gz 2023-08-10T10:53:59.854 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132714.log 2023-08-10T10:53:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.135149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.135149.log.gz 2023-08-10T10:53:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143207.log 2023-08-10T10:53:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132714.log.gz 2023-08-10T10:53:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124443.log 2023-08-10T10:53:59.859 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143207.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143207.log.gz 2023-08-10T10:53:59.859 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117181.log 2023-08-10T10:53:59.860 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124443.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124443.log.gz 2023-08-10T10:53:59.861 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.151987.log 2023-08-10T10:53:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117181.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117181.log.gz 2023-08-10T10:53:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148337.log 2023-08-10T10:53:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.151987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.151987.log.gz 2023-08-10T10:53:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148211.log 2023-08-10T10:53:59.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148337.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148337.log.gz 2023-08-10T10:53:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147404.log 2023-08-10T10:53:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148211.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148211.log.gz 2023-08-10T10:53:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137639.log 2023-08-10T10:53:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147404.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147404.log.gz 2023-08-10T10:53:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126464.log 2023-08-10T10:53:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137639.log.gz 2023-08-10T10:53:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154694.log 2023-08-10T10:53:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126464.log.gz 2023-08-10T10:53:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120714.log 2023-08-10T10:53:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154694.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154694.log.gz 2023-08-10T10:53:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136434.log 2023-08-10T10:53:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120714.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120714.log.gz 2023-08-10T10:53:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132593.log 2023-08-10T10:53:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136434.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136434.log.gz 2023-08-10T10:53:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125122.log 2023-08-10T10:53:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132593.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132593.log.gz 2023-08-10T10:53:59.879 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155426.log 2023-08-10T10:53:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125122.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.125122.log.gz 2023-08-10T10:53:59.880 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127823.log 2023-08-10T10:53:59.881 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155426.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155426.log.gz 2023-08-10T10:53:59.882 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158019.log 2023-08-10T10:53:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127823.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127823.log.gz 2023-08-10T10:53:59.883 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139808.log 2023-08-10T10:53:59.884 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.158019.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158019.log.gz 2023-08-10T10:53:59.885 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155909.log 2023-08-10T10:53:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.139808.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139808.log.gz 2023-08-10T10:53:59.886 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118693.log 2023-08-10T10:53:59.887 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155909.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155909.log.gz 2023-08-10T10:53:59.888 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150182.log 2023-08-10T10:53:59.889 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118693.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118693.log.gz 2023-08-10T10:53:59.890 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125902.log 2023-08-10T10:53:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150182.log.gz 2023-08-10T10:53:59.891 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129633.log 2023-08-10T10:53:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.125902.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125902.log.gz 2023-08-10T10:53:59.893 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123457.log 2023-08-10T10:53:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129633.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129633.log.gz 2023-08-10T10:53:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144817.log 2023-08-10T10:53:59.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123457.log.gz 2023-08-10T10:53:59.896 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131012.log 2023-08-10T10:53:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144817.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144817.log.gz 2023-08-10T10:53:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123083.log 2023-08-10T10:53:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131012.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131012.log.gz 2023-08-10T10:53:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151200.log 2023-08-10T10:53:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123083.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123083.log.gz 2023-08-10T10:53:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132425.log 2023-08-10T10:53:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151200.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151200.log.gz 2023-08-10T10:53:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118353.log 2023-08-10T10:53:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132425.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132425.log.gz 2023-08-10T10:53:59.904 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148421.log 2023-08-10T10:53:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118353.log.gz 2023-08-10T10:53:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155297.log 2023-08-10T10:53:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148421.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148421.log.gz 2023-08-10T10:53:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138283.log 2023-08-10T10:53:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.155297.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155297.log.gz 2023-08-10T10:53:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120420.log 2023-08-10T10:53:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.138283.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138283.log.gz 2023-08-10T10:53:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136602.log 2023-08-10T10:53:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120420.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120420.log.gz 2023-08-10T10:53:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118987.log 2023-08-10T10:53:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136602.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136602.log.gz 2023-08-10T10:53:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148505.log 2023-08-10T10:53:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118987.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118987.log.gz 2023-08-10T10:53:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124900.log 2023-08-10T10:53:59.916 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148505.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148505.log.gz 2023-08-10T10:53:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153649.log 2023-08-10T10:53:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124900.log.gz 2023-08-10T10:53:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136518.log 2023-08-10T10:53:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153649.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153649.log.gz 2023-08-10T10:53:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124359.log 2023-08-10T10:53:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136518.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136518.log.gz 2023-08-10T10:53:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151464.log 2023-08-10T10:53:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124359.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124359.log.gz 2023-08-10T10:53:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156058.log 2023-08-10T10:53:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157724.log 2023-08-10T10:53:59.925 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151464.log.gz 2023-08-10T10:53:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156058.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156058.log.gz 2023-08-10T10:53:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144299.log 2023-08-10T10:53:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157724.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157724.log.gz 2023-08-10T10:53:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117699.log 2023-08-10T10:53:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144299.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144299.log.gz 2023-08-10T10:53:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151336.log 2023-08-10T10:53:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117699.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117699.log.gz 2023-08-10T10:53:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154862.log 2023-08-10T10:53:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.151336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151336.log.gz 2023-08-10T10:53:59.934 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154862.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.154862.log.gz 2023-08-10T10:53:59.945 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-10T10:54:00.009 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-10T10:54:00.688 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-10T10:54:00.690 INFO:teuthology.orchestra.run.smithi050.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-10T10:54:00.693 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-08-10T10:54:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m2.089s 2023-08-10T10:54:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m5.751s 2023-08-10T10:54:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m3.029s 2023-08-10T10:54:00.695 INFO:tasks.ceph:Archiving logs... 2023-08-10T10:54:00.695 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi050/log 2023-08-10T10:54:00.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T10:54:01.943 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi117/log 2023-08-10T10:54:01.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T10:54:02.567 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-10T10:54:02.576 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-10T10:54:02.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T10:54:02.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T10:54:02.745 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-10T10:54:02.755 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-10T10:54:02.756 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:54:02.764 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:54:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-08-10T10:54:02.820 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -201us[ -156us] +/- 84ms 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -322us[ -276us] +/- 66ms 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +509us[ +555us] +/- 65ms 2023-08-10T10:54:02.825 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:54:02.830 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:54:02.830 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2023-08-10T10:54:02.830 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -197us[ -197us] +/- 84ms 2023-08-10T10:54:02.830 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv02.front.sepia.ceph.com 3 7 377 14 -252us[ -231us] +/- 66ms 2023-08-10T10:54:02.831 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 79 +549us[ +571us] +/- 64ms 2023-08-10T10:54:02.831 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:54:02.831 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-10T10:54:02.841 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-10T10:54:02.842 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-10T10:54:02.851 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T10:54:03.163 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T10:54:03.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:54:03.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:54:03.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:54:03.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:54:03.643 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-10T10:54:03.652 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-10T10:54:03.662 INFO:teuthology.task.internal:Duration was 2740.203410 seconds 2023-08-10T10:54:03.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-10T10:54:03.674 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-10T10:54:03.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T10:54:03.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T10:54:03.855 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:54:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:54:04.156 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-10T10:54:04.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-08-10T10:54:04.157 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T10:54:04.227 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2023-08-10T10:54:04.228 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T10:54:04.309 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-10T10:54:04.309 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T10:54:04.319 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T10:54:04.425 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-10T10:54:04.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T10:54:04.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T10:54:05.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-10T10:54:05.614 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-10T10:54:05.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T10:54:05.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T10:54:05.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-10T10:54:05.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:54:05.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:54:05.955 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-08-10T10:54:05.956 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2023-08-10T10:54:06.012 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:54:06.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:54:06.066 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:54:06.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:54:06.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-10T10:54:06.135 INFO:teuthology.task.internal:Transferring archived files... 2023-08-10T10:54:06.135 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi050 2023-08-10T10:54:06.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T10:54:06.261 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529/remote/smithi117 2023-08-10T10:54:06.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T10:54:06.375 INFO:teuthology.task.internal:Removing archive directory... 2023-08-10T10:54:06.375 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T10:54:06.385 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T10:54:06.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-10T10:54:06.484 INFO:teuthology.task.internal:Not uploading archives. 2023-08-10T10:54:06.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-10T10:54:06.495 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-10T10:54:06.495 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T10:54:06.504 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T10:54:06.560 INFO:teuthology.orchestra.run.smithi050.stdout: 263229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 10:54 /home/ubuntu/cephtest 2023-08-10T10:54:06.562 INFO:teuthology.orchestra.run.smithi117.stdout: 263652 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 10:54 /home/ubuntu/cephtest 2023-08-10T10:54:06.565 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-10T10:54:06.576 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-10T10:54:06.597 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T10:54:06.625 DEBUG:teuthology.nuke:shortname: smithi050 2023-08-10T10:54:06.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:54:06.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:53.591669', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjIamWIXq3UVt00gEPbsgSAOOwebaQ5RW4IEp7f0ABBaPCi+wUcI9GmgKhgtIlAX5oRI4bHIhQrD4zvEYfMY+M='} 2023-08-10T10:54:06.654 DEBUG:teuthology.nuke:shortname: smithi117 2023-08-10T10:54:06.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:54:06.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:53.592885', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3vC83PZpFEB/j0ySbC9zOSLGsmnDV6i8+w1/TKbOc/I9Svzn2yEEfdeyuU9mVYlbjFcHoQ/865Lc+UemjGdhU='} 2023-08-10T10:54:06.701 INFO:teuthology.orchestra.console.smithi050:Power off 2023-08-10T10:54:06.702 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:54:06.725 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-08-10T10:54:06.726 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:06.744 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-10T10:54:06.744 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:54:06.754 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-08-10T10:54:06.766 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-10T10:54:06.766 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:06.791 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-10T10:54:10.756 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:10.792 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:10.868 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-08-10T10:54:10.904 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-10T10:54:14.872 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:14.905 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:14.982 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-08-10T10:54:15.018 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-10T10:54:18.987 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:19.018 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:54:19.099 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-08-10T10:54:19.128 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-10T10:54:19.200 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-08-10T10:54:19.229 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-10T10:54:19.334 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 client.1-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 2740.2034101486206 failure_reason: '"2023-08-10T10:38:06.867375+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 101244.552031 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-08-10T10:54:19.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:54:19.417 INFO:teuthology.run:FAIL